Poor adherence of randomised trials in surgery to CONSORT guidelines for non-pharmacological treatments (NPT): a cross-sectional study

A Systematic Review of Registered Clinical Trials for Peripheral Nerve Injuries

ABSTRACT

Upper extremity peripheral nerve injuries (PNIs) significantly impact daily functionality and necessitate effective treatment strategies. Clinical trials play a crucial role in developing these strategies. However, challenges like retrospective data collection, reporting biases, inconsistent outcome measures, and inadequate data sharing practices hinder effective research and treatment advancements. This review aims to analyze the landscape of reporting, methodological design, outcome measures, and data sharing practices in registered clinical trials concerning upper extremity PNIs. It seeks to guide future research in this vital area by identifying current trends and gaps.A systematic search was conducted on ClinicalTrials.gov and WHO International Clinical Trials Registry Platform up to November 10, 2023, using a combination of MeSH terms and keywords related to upper extremity nerve injury. The PRISMA 2020 guidelines were followed, and the studies were selected based on predefined inclusion and exclusion criteria. A narrative synthesis of findings was performed, with statistical analysis for associations and completion rates.Of 3051 identified studies, 96 met the inclusion criteria. These included 47 randomized controlled trials, 27 nonrandomized trials, and others. Sensory objective measures were the most common primary outcomes. Only 13 studies had a data sharing plan. The analysis revealed varied intervention methods and inconsistencies in outcome measures. There was a significant association between study funding, design, and completion status, but no association between enrollment numbers and completion.This review highlights the need for standardized outcome measures, patient-centered assessments, and improved data sharing in upper extremity PNI trials. The varied nature of interventions and inconsistency in outcome measures indicate the necessity for more rigorous and transparent research practices to strengthen the evidence base for managing these injuries.

Methods of quality assurance in multicenter trials in laparoscopic fundoplication for gastroesophageal reflux disease

BACKGROUND

Operative performance may affect the internal and external validity of randomized trials. The aim of this study was to review the use of surgical quality assurance mechanisms of published trials on laparoscopic anti-reflux surgery, with the objective to appraise their internal (research quality) and external validity (applicability to the clinical setting).

METHODS

Building upon a previous systematic review and network meta-analysis published by the authors, Medline, Embase, AMED, CINAHL, CENTRAL, and OpenGrey databases were searched for randomized control trials comparing different methods of laparoscopic anti-reflux surgery for the management of gastroesophageal disease. Quality assurance in individual studies was appraised using a specified framework addressing surgeon accreditation, procedure standardization, and performance monitoring.

RESULTS

In total, 2276 articles were screened to obtain 43 publications reporting 29 randomized controlled trials. Twenty-five out of 43 (58.1%) articles reported the number of participating centers and surgeons involved. Additionally, only 21/43 (48.8%) of articles reported consistent use of a bougie, while 23/43 (53.5%) of articles reported consistent division of the short gastric arteries during fundoplication. Surgical experience and credentials were stated in half of the studies. Standardization of the technique was reported in almost 70% of cases, whereas operative notes or video was submitted in one fourth of the studies. Monitoring of the operative performance during the trial was not documented in most of the trials (62%).

CONCLUSION

Surgical quality assurance in randomized trials on laparoscopic anti-reflux surgery is insufficient, which does not allow appraisal of the internal and external validity of this research. With improved reporting, trials assessing the use of laparoscopic anti-reflux surgery will enable surgeons to make informed treatment decisions to enhance patient care in the surgical management of GERD.

Analysis of the Evidence Underpinning the American Academy of Orthopedic Surgeons Knee Osteoarthritis Clinical Practice Guidelines

CONTEXT

Clinical practice guidelines (CPGs) are vital to establishing a standardized and evidence-based approach in medicine. These guidelines rely on the use of methodologically sound clinical trials, and the subsequent reporting of their methodology.

OBJECTIVE

To evaluate the completeness of randomized controlled trials (RCTs) underpinning CPGs published by the American Academy of Orthopedic Surgeons (AAOS) for management of osteoarthritis of the knee.

DATA SOURCES

We searched the most recent AAOS CPGs for surgical and nonsurgical management of osteoarthritis of the knee for RCTs. To estimate the necessary sample size, we performed a power analysis using OpenEpi 3.0 (openepi.com).

STUDY SELECTION

Two authors independently screened the reference sections of the included CPGs. Included studies met the definition of an RCT, were retrievable in the English language, and were cited in at least one of the included CPGs.

STUDY DESIGN

Meta-Analysis.

LEVEL OF EVIDENCE

Level 1a.

DATA EXTRACTION

We performed double-blind screening and extraction of RCTs included in the AAOS CPGs. We evaluated each RCT for adherence to the Consolidated Standards of Reporting Trials (CONSORT) 2010 checklist. A multiple regression analysis was conducted to assess CONSORT adherence against characteristics of included studies (ie, type of intervention, funding source, etc).

RESULTS

Our study included 179 RCTs. The overall adherence was 68.5% with significant differences between those published before and since the development of the 2010 CONSORT guidelines (P = 0.02). We found that RCTs receiving funding from industry/private sources as well as studies that included a conflict of interest statement showed more completeness than RCTs that reported receiving no funding (P < 0.01).

CONCLUSION

We found suboptimal CONSORT adherence for RCTs cited in AAOS CGPs for management of osteoarthritis of the knee. Therefore, the CPGs are likely supported by outdated evidence and lack of high-quality reporting. It is important that evidence used to guide clinical decision making be of the highest quality in order to optimize patient outcomes. In order for clinicians to confer the greatest benefits to their patients, CPGs should provide the totality of evidence and emphasize emerging high-quality RCTs to ensure up-to-date, evidence-based clinical decision-making.

An Analysis of the Evidence Underpinning the American Academy Orthopaedic Surgery Pediatrics Clinical Practice Guidelines

BACKGROUND

Randomized control trials (RCTs) serve as evidentiary support for recommendations underpinning clinical practice guidelines (CPGs) with the goal of optimizing patient care. A knowledge gap exists within scientific literature when evaluating the quality of RCTs used as evidence in the American Academy of Orthopaedic Surgery (AAOS) pediatric CPGs. We aim to evaluate the reporting quality and risk of bias in RCTs underlying AAOS Pediatric CPG recommendations.

METHODS

We located all AAOS Pediatric CPGs. We then extracted all RCTs from the CPG reference sections. All included RCTs were evaluated using the Consolidated Standards of Reporting Trials (CONSORT) checklist and Cochrane Collaboration risk of bias assessment tool (RoB 2.0). Descriptive statistics were recorded, and bivariate analysis was used to account for variance in CONSORT scores. A Mann-Whitney U test was completed to compare CONSORT studies published before and after 2010.

RESULTS

Three CPGs and 23 RCTs met inclusion criteria. Mean CONSORT adherence was 69.8% (21.6/31). The lowest adhered to CONSORT items were 10, 23, and 24, while items 2a, 13a, and 18 displayed the highest adherence. Ten RCTs (43.5%, 10/23) had "low" risk of bias, 5 RCTs (21.7%, 5/23) were of "some concerns," and 8 RCTs (34.8%, 8/23) received a "high" designation for risk of bias. There were no statistically significant associations in the bivariate regression analysis or Mann-Whitney U test.

CONCLUSIONS

Our results suggest that CONSORT adherence within RCTs used as evidence in AAOS Pediatric CPGs is substandard-relying on evidence that, in some cases, is >20 years old. Many of the RCTs cited as supporting evidence have a "high" risk of bias. Altogether, these CPGs may need to be updated or expanded to include more recent evidence relevant to pediatric orthopaedic surgery.

Is there resource wastage in the research for spinal diseases? An observational analysis of discontinuation and non-publication in randomised controlled trials

Introduction

The scale of waste in research funding systems is large and detrimental to research capacity. Both incompleteness and non-publication of Randomised Controlled Trials (RCTs) have been increasingly reported in the literature. This is a serious consequence as RCTs demand monumental amounts of healthcare resources leading to wastage. Most importantly, both under-reporting and non-publication can distort the evidence landscape and obscure rationale behind clinical decisions.

Research question

We, therefore, aimed at conducting the first systematic assessment of registered trial discontinuation and non-publication in the field of spinal disorders.

Material and methods

A list of RCTs was obtained from the U.S National Library of Medicine ClinicalTrials.gov database from January 1st, 2013, to December 31st, 2020. Two independent authors excluded all non-RCTs, trials unrelated to spinal diseases, and trials that are in or before the recruitment phase. We extracted the progress status, sources of funding, the number of centres, type of intervention, principal investigator's department affiliation, publication status, location, the reason for discontinuation, publication date, and subtopics.

Results

112 trials were included in the study. 25 (22%) trials were discontinued early, with slow recruitment being the major reason (38%). Only 56 (50%) of the trials were published in peer-reviewed journals. The publication rate amongst discontinued trials was significantly lower compared to completed trials (P ​< ​0·001). The trial discontinuation rate was much higher in trials registered in the United States (US) compared to other countries (P ​= ​0·009). Industry-sponsored studies had 11 trials (23·4%) that were discontinued whilst there was 20% of non-industry-sponsored studies that were unfinished. Only 20% of the trials were compliant with the FDA reporting requirements over the study period.

Discussion and conclusion

Nearly a quarter of all trials in spinal disorders were discontinued. Half of the trials were unpublished. There was over a third of trials that were completed but not published. These rates remain worrisome from an ethical and financial perspective. Both under-reporting and non-publication adversely affect efforts in evidence synthesis and can compromise clinical guideline development.

•

Nearly a quarter of all trials in spinal disorders were discontinued early.

•

Only half of the trials were published in peer-reviewed journals.

•

Over a third of the trials were completed but not published.

•

The rates of trial discontinuation and non-publication are worrisome from an ethical and financial perspective.

•

Both under-reporting and non-publication adversely affect efforts in evidence synthesis and can compromise clinical guideline development.

Reporting quality of surgical randomised controlled trials in head and neck cancer: a systematic review

PURPOSE

Randomised controlled trials (RCTs) are considered the gold standard for evaluating the efficacy of an intervention. However, previous research has shown that RCTs in several surgical specialities are poorly reported, making it difficult to ascertain if various biases have been appropriately minimised. This systematic review assesses the reporting quality of surgical head and neck cancer RCTs.

METHODS

A literature search of PubMed and Embase was performed. Papers were included if they reported RCTs which assessed a surgical technique used to treat or diagnose head and neck cancer published during or after 2011. The CONSORT 2010 checklist was used to evaluate the reporting quality of these trials.

RESULTS

41 papers were included. The mean CONSORT score was 16.5/25 (66% adherence) and the scores ranged from 7.5 (30%) to 25. The most common omissions were full trial protocol (found in 14.6%), participant recruitment method (22%) and effect size with a precision estimate for all outcome measures (29.3%). The full design and implementation of the randomisation methods were reported in 6 (14.6%). Papers published in journals which endorsed CONSORT had significantly higher scores (p = 0.02) and the journal impact factor was significantly correlated with CONSORT score (p = 0.01).

CONCLUSION

We have identified several pieces of information that are underreported in surgical head and neck cancer RCTs. These omissions make understanding and comparing the methodologies and conclusions of RCTs more difficult. The endorsement of CONSORT by journals improved adherence, suggesting that wider adoption of the checklist may improve reporting.

Systematic review on reporting of components and outcomes in randomized clinical trials of paraoesophageal hernia mesh repair

BACKGROUND

Surgical interventions, such as paraoesophageal hernia (POH) repair, are complex with multiple components that require consideration in the reporting of clinical trials. Many aspects of POH repair, including mesh hiatal reinforcement and fundoplication type, are contentious. This review summarizes the reporting of components and outcomes in RCTs of POH repair.

METHODS

Systematic searches identified RCTs of POH repair published from 1995 to 2020. The patient selection criteria for RCT involvement were noted. The components of the surgical interventions in these RCTs were recorded using the CONSORT guidelines for non-pharmacological treatments, Template for Intervention Description and Replication (TIDieR) and Blencowe frameworks. The outcomes were summarized and definitions sought for critical variables, including recurrence.

RESULTS

Of 1918 abstracts and 21 screened full-text articles, 12 full papers reporting on six RCTs were included in the review. The patient selection criteria and definitions of POH between trials varied considerably. Although some description of trial interventions was provided in all RCTs, this varied in depth and detail. Four RCTs described efforts to standardize the trial intervention. Outcomes were reported inconsistently, were rarely defined fully, and overall trial conclusions varied during follow-up.

CONCLUSION

This lack of detail on the surgical intervention in POH repair RCTs prevents full understanding of what exact procedure was evaluated and how it should be delivered in clinical practice to gain the desired treatment effects. Improved focus on the definitions, descriptions and reporting of surgical interventions in POH repair is required for better future RCTs.

Adherence to the CONSORT statement and extension for nonpharmacological treatments in randomized controlled trials of bariatric surgery: A systematic survey

Reporting is critical for establishing the value of randomized controlled trials (RCTs). This study evaluated the adherence of bariatric surgery RCT reporting to the CONsolidated Standards Of Reporting Trials (CONSORT) statement 2010 and its 2017 extension for non-pharmacologic treatments (NPT extension). We identified all RCTs comparing bariatric surgery with conservational therapy or alternative bariatric surgery up to June 30, 2020. Reporting quality was assessed using criteria developed from the CONSORT statement and the NPT extension and scored as a percentage. The factors associated with reporting quality were explored by univariate and multivariate analysis. In total, 102 RCTs of bariatric surgery were included. The median scores according to the CONSORT statement and NPT extension were 63.3 and 26.8 of a maximum possible 100, respectively. Two-thirds of NPT extension items were reported in less than 25% of the RCTs. The median score improved over time for the CONSORT statement but not the NPT extension. A higher CONSORT score was associated with publication in core clinical journals, protocol registration, and funding. No factors associated with the NPT extension score were identified. Substantial efforts are warranted from authors, journals, registration platforms, and funders to overcome the flaws in the reporting of bariatric surgery RCTs.

Exploring the reporting standards of RCTs involving invasive procedures for assisted vaginal birth: A systematic review

OBJECTIVE

Assisted vaginal birth (AVB) is a complex intervention involving medical devices, comprising multiple components. This complexity creates difficulties when designing and conducting randomised controlled trials (RCTs), in terms of describing, standardising and monitoring the intervention, and accounting for differing clinician expertise. This review examines the reporting standards of complex interventions involving a medical device, in the context of AVB RCTs.

STUDY DESIGN

Searches were undertaken from the start of indexing to March 2021, and limited to RCTs, feasibility and pilot studies including at least one device for AVB. RCTs were selected if they included participants having an AVB with any device, with or without a comparator group. Reporting details were assessed according to the Consolidating Standards of Reporting Trials extension for non-pharmacological treatments (CONSORT-NPT), focusing on intervention descriptions, standardization, adherence and clinician expertise. Screening of abstracts, full-text articles and data extraction was performed by two independent reviewers.

RESULTS

Of 4098 abstracts and 83 full-text articles, 39 papers were included, investigating 80 interventions. Twenty-seven different named devices were identified. Intervention descriptions were provided in 20 (55%) papers with varying levels of detail and with only one covering the entire procedure. Standardization of interventions was mentioned in 25 papers (64%). Only eight (21%) papers reported any form of adherence to the intended procedure. Some data regarding expertise were reported in 25 (64%) papers.

CONCLUSIONS

Despite some compliance with reporting standards, there is a lack of detail regarding intervention description, standardization, adherence and expertise in RCTs of AVB. This creates difficulties in understanding how intervention delivery was intended and what actually occurred. Clearer guidelines for the reporting of invasive procedures and devices are required.

A systematic review of reporting quality for anaesthetic interventions in randomised controlled trials

Interventions from randomised controlled trials can only be replicated if they are reported in sufficient detail. The results of trials can only be confidently interpreted if the delivery of the intervention was systematic and the protocol adhered to. We systematically reviewed trials of anaesthetic interventions published in 12 journals from January 2016 to September 2019. We assessed the detail with which interventions were reported, using the Consolidated Standards of Reporting Trials statement for non-pharmacological treatments. We analysed 162 interventions reported by 78 trials in 18,675 participants. Detail sufficiently precise to replicate the intervention was reported for 111 (69%) interventions. Intervention standardisation was reported for 135 (83%) out of the 162 interventions, and protocol adherence was reported for 20 (12%) interventions. Sixty (77%) out of the 78 trials reported the administrative context in which interventions were delivered and 36 (46%) trials detailed the expertise of the practitioners. We conclude that bespoke reporting tools should be developed for anaesthetic interventions and interventions in other areas such as critical care.

The myth of ivory tower versus practice-oriented research: A systematic review of randomised studies in medical education

CONTEXT

A long-standing myth in medical education research is a divide between two different poles: research aiming to advance theory with little focus on practical applications ('ivory tower' research) and practically oriented research aiming to serve educators and decision-makers with little focus on advancing theory ('in-the-trenches' practice). We explored this myth in a sample of randomised medical education studies using Stokes' four-quadrant framework for the classification of research perspective.

METHODS

We searched MEDLINE, Embase, CINAHL, PsychINFO, ERIC, Web of Science and Scopus for studies in medical education using a randomised design that were published between 1 January 2018 and 31 December 2018. We used Stokes' four-quadrant framework to categorise the studies according to their use of theory, concepts and their justification for practical use. We compared medical education research published in medical education journals and clinical journals.

RESULTS

A total of 150 randomised studies were included in the analysis. The largest segment of studies (46.7%) was categorised as use-inspired basic research (Pasteur's Quadrant), closely followed by pure applied research (40.7%, Edison's Quadrant). Only a few studies were categorised as aiming to advance knowledge with no thought for practical educational application (2.0%, Bohr's Quadrant). The proportion of studies that included educational concepts and theory differed according to publication in clinical journals or medical education journals: 40.5% vs 71.8%, respectively, P < .001. There were no differences between journals with regard to the proportion of studies that included a practical educational or clinical rationale (P = .99).

CONCLUSION

In a large sample of studies using randomised designs, we found no evidence to support the myth that medical education research divides between two singular poles represented by 'ivory tower research' and 'in-the-trenches practice'. We did confirm prevailing assumptions regarding an emphasis on non-theoretical medical education research in clinical journals.

Adherence to the Consolidated Standards of Reporting Trials (CONSORT) Guidelines for Reporting Randomized Controlled Trials Related to Mandibular Third Molars

PURPOSE

Randomized controlled trials (RCTs) are the backbone of evidence-based medicine. Despite the widespread acceptance of the Consolidated Standards of Reporting Trials (CONSORT), its use for reporting clinical trials in journals remains poor. The purpose of this study was to find out to what extent RCTs related to mandibular third molars have adhered to the CONSORT statement.

METHODS

This study was carried out during April 2020 to June 2020. PubMed was used to retrieve RCTs related to mandibular third molars conducted during the last 5 years. The search terms used were mandibular third molar OR lower third molar OR impacted mandibular third molar AND randomized controlled trial. Each article was assessed for adherence to the CONSORT statement.

RESULTS

Eighty unique articles were retrieved. The mean percentage adherence to the CONSORT statement noted was 60.26%. Of the 37 CONSORT items, only 4 items showed 100% adherence (2a, 2b, 4a, and 12a). The most underreported items were #10, 12b, 17a, 17b, 18, 19, 23 to 25. Of the 23 journals considered, 6 journals did not recommend CONSORT for reporting RCT in the "Instructions to Authors" guidelines.

CONCLUSIONS

Within the limits of the study, it is clear that the RCTs related to third molar do not show 100% adherence to the CONSORT checklist. The editorial policy, peer reviewers, and researchers should endorse the use of the CONSORT checklist for transparent reporting of the RCTs.

Evidence-based Plastic Surgery: Assessing Progress over Two 5-year Periods from 2009 to 2019

Publications on evidence-based medicine have increased. Previous articles have examined evidence-based plastic surgery, but the latest was published in 2013. The aim of this study was to examine the trend in the number of high-evidence publications over two 5-year periods across 3 main plastic surgery journals. Further, this study aimed to quality-assess randomized controlled trials (RCTs) published in the latter period.

Methods

All articles were identified using PubMed Search Tools and Single Citation Matcher. Three journals were manually screened from May 15, 2009, to May 15, 2014, and from May 16, 2014, to May 16, 2019. The reporting of RCTs was assessed using a modified Consolidated Standards of Reporting Trials (CONSORT) checklist.

Results

Of a total of 17,334 publications, 6 were meta-analyses of RCTs, 120 were other meta-analyses, and 247 were initially identified as RCTs. Although a significant increase in the number of higher-evidence publications is observed, these represent 2.09% (n = 363) of the total. An estimated 86 RCTs were eligible for quality-assessment, with the most popular sub-specialty being breast surgery (n = 30). The most highly reported criteria were inclusion/exclusion criteria and blinding (both n = 67; 77.91%), and the least reported criterion was allocation concealment (n = 21; 24.42%).

Conclusions

This study observes a positive trend in high-evidence publications. The number of RCTs published has increased significantly over a breadth of sub-specialties. The reporting of several CONSORT criteria in RCTs remains poor. Observation to standard reporting guidelines is advocated to improve the quality of reporting.

Interpreting Patient-Reported Outcome Measures in Orthopaedic Surgery: A Systematic Review

BACKGROUND

The Consolidated Standards of Reporting Trials (CONSORT) Statement recommends that studies report results beyond p values and include treatment effect(s) and measures of precision (e.g., confidence intervals [CIs]) to facilitate the interpretation of results. The objective of this systematic review was to assess the reporting and interpretation of patient-reported outcome measure (PROM) results in clinical studies from high-impact orthopaedic journals, to determine the proportion of studies that (1) only reported a p value; (2) reported a treatment effect, CI, or minimal clinically important difference (MCID); and (3) offered an interpretation of the results beyond interpreting a p value.

METHODS

We included studies from 5 high-impact-factor orthopaedic journals published in 2017 and 2019 that compared at least 2 intervention groups using PROMs.

RESULTS

A total of 228 studies were analyzed, including 126 randomized controlled trials, 35 prospective cohort studies, 61 retrospective cohort studies, 1 mixed cohort study, and 5 case-control studies. Seventy-six percent of studies (174) reported p values exclusively to express and interpret between-group differences, and only 22.4% (51) reported a treatment effect (mean difference, mean change, or odds ratio) with 95% CI. Of the 54 studies reporting a treatment effect, 31 interpreted the results using an important threshold (MCID, margin, or Cohen d), but only 3 interpreted the CIs. We found an absolute improvement of 35.5% (95% CI, 20.8% to 48.4%) in the reporting of the MCID between 2017 and 2019.

CONCLUSIONS

The majority of interventional studies reporting PROMs do not report CIs around between-group differences in outcome and do not define a clinically meaningful difference. A p value cannot effectively communicate the readiness for implementation in a clinical setting and may be misleading. Thus, reporting requirements should be expanded to require authors to define and provide a rationale for between-group clinically important difference thresholds, and study findings should be communicated by comparing CIs with these thresholds.

Reporting of key methodological issues in placebo-controlled trials of surgery needs improvement: a systematic review

OBJECTIVES

To examine key methodological considerations for using a placebo intervention in randomized controlled trials (RCTs) evaluating invasive procedures, including surgery.

STUDY DESIGN AND SETTING

RCTs comparing an invasive procedure with a placebo were included in this systematic review. Articles published from database inception to December 31, 2017, were retrieved from Ovid MEDLINE, Ovid EMBASE and CENTRAL electronic databases, by handsearching references and expert knowledge. Data on trial characteristics (clinical area, nature of invasive procedure, number of patients and centers) and key methodological (rationale for using placebos, minimization of risk, information provision, offering the treatment intervention to patients randomized to placebo, delivery of cointerventions, and intervention standardization and fidelity) were extracted and summarized descriptively.

RESULTS

One hundred thirteen articles reporting 96 RCTs were identified. Most were conducted in gastrointestinal surgery (n = 40, 42%) and evaluated minimally invasive procedures (n = 44, 46%). Over two-thirds randomized fewer than 100 patients (n = 65, 68%) and a third were single center (n = 31, 32%). A third (n = 33, 34%) did not report a rationale for using a placebo. Most common strategies to minimize patient risk were operator skill (n = 22, 23%) and independent data monitoring (n = 28, 29%). Provision of patient information regarding placebo use was infrequently reported (n = 11, 11%). Treatment interventions were offered to patients randomized to placebo in 43 trials (45%). Cointerventions were inconsistently reported, but 64 trials (67%) stated that anesthesia was matched between groups. Attempts to standardize interventions and monitor their delivery were reported in n = 7, (7%) and n = 4, (4%) trials, respectively.

CONCLUSION

Most placebo-controlled trials in surgery evaluate minor surgical procedures and currently there is inconsistent reporting of key trial methods. There is a need for guidance to optimize the transparency of trial reporting in this area.

Treatment interventions for hand fractures and joint injuries: a scoping review of randomized controlled trials

The aim of this study was to identify and assess all existing randomized studies on treatment interventions for hand fractures and joint injuries, to inform practice and plan future research. PubMed, Cochrane CENTRAL, MEDLINE and Embase were searched. We identified 78 randomized controlled trials published over 35 years, covering seven anatomical areas of the hand. We report on sources of bias, sample size, follow-up length and retention, outcome measures and reporting. In terms of interventions studied, the trials were extremely heterogeneous, so it is difficult to draw conclusions on individual treatments. The published randomized controlled clinical trial evidence for hand fractures and joint injuries is narrow in scope and of generally low methodological quality. Mapping provides a useful resource and stepping-stone for planning further research. There is a need for high-quality, collaborative research to guide management of a wider range of common hand injuries.

Reporting Quality of Journal Abstracts for Surgical Randomized Controlled Trials Before and After the Implementation of the CONSORT Extension for Abstracts

BACKGROUND

Adequate reporting is crucial in full-text publications but even more so in abstracts because they are the most frequently read part of a publication. In 2008, an extension for abstracts of the Consolidated Standards of Reporting Trials (CONSORT-A) statement was published, defining which items should be reported in abstracts of randomized controlled trials (RCTs). Therefore, we compared the adherence of RCT abstracts to CONSORT-A before and after the publication of CONSORT-A.

METHODS

RCTs published in the five surgical journals with the highest impact factor were identified through PubMed for 2005-2007 and 2014-2016. Adherence to 15 CONSORT-A items and two additional items for abstracts of non-pharmacological trials was assessed in duplicate. We compared the overall adherence to CONSORT-A between the two time periods using an unpaired t test and explored adherence to specific items.

RESULTS

A total of 192 and 164 surgical RCT abstracts were assessed (2005-2007 and 2014-2016, respectively). In the pre-CONSORT-A phase, the mean score of adequately reported items was 6.14 (95% confidence interval [CI] 5.90-6.38) and 8.11 in the post-CONSORT-A phase (95% CI 7.83-8.39; mean difference 1.97, 95% CI 1.60-2.34; p < 0.0001). The comparison of individual items indicated a significant improvement in 9 of the 15 items. The three least reported items in the post-CONSORT-A phase were randomization (2.4%), blinding (13.4%), and funding (0.0%). Specific items for non-pharmacological trials were rarely reported (approximately 10%).

CONCLUSION

The reporting in abstracts of surgical RCTs has improved after the implementation of CONSORT-A. More importantly, there is still ample room for improvement.

Reporting quality of randomized controlled trials in otolaryngology: review of adherence to the CONSORT statement

Background

Randomized controlled trials are the gold standard in medical and surgical research to assess the efficacy of therapeutic interventions. The reporting of these trials should be of high quality to allow readers’ appropriate interpretation and application.

Methods

The objectives of our study were to assess the extent to which the recent Otolaryngology – Head and Neck Surgery (ORL-HNS) randomized control trials in the top nine journals and in the top Canadian journal comply with the Consolidated Standards of Reporting Trials (CONSORT) statement, and to identify the CONSORT items most in need of improvement. Based on the impact factor and circulation number of 2014, the top nine Otolaryngology journals and the top Canadian Otolaryngology journal were selected and were searched to identify RCTs published in English and between 2010 and 2014. Two authors independently reviewed and extracted data using a standardized data extraction form constructed with the help of a medical librarian. Our outcome was to assess the adherence of articles reporting to the CONSORT items. Descriptive statistics were used.

Results

One hundred and eighty-two Otolaryngologic RCTs were identified in the top nine international journals and in the top Canadian journal. The inter-rater reliability between two raters was 0.32. The extent of adherence to CONSORT Statement ranged from 25 to 93.5% with a mean of 59.0% and a median of 59.4%. Only 6.5% of RCTs described the individual responsible for enrolling and assigning subjects and method of randomization; 32.4% reported the estimated effect size and precision; 40.6% reported a sample size calculation and 32.4% mentioned external validity or implications of the findings.

Conclusion

Findings revealed that the reporting of RCTs in the top nine ORL-HNS journals and in the top Canadian ORL-HNS journal is suboptimal. The quality of reporting can be improved by addressing the three CONSORT items found most deficient in this study namely, sample size calculations, estimated effect size and precision, and external validity.

Avoidable waste related to inadequate methods and incomplete reporting of interventions: a systematic review of randomized trials performed in Sub-Saharan Africa

Background

Randomized controlled trials (RCTs) are needed to improve health care in Sub-Saharan Africa (SSA). However, inadequate methods and incomplete reporting of interventions can prevent the transposition of research in practice which leads waste of research. The aim of this systematic review was to assess the avoidable waste in research related to inadequate methods and incomplete reporting of interventions in RCTs performed in SSA.

Methods

We performed a methodological systematic review of RCTs performed in SSA and published between 1 January 2014 and 31 March 2015. We searched PubMed, the Cochrane library and the African Index Medicus to identify reports. We assessed the risk of bias using the Cochrane Risk of Bias tool, and for each risk of bias item, determined whether easy adjustments with no or minor cost could change the domain to low risk of bias. The reporting of interventions was assessed by using standardized checklists based on the Consolidated Standards for Reporting Trials, and core items of the Template for Intervention Description and Replication. Corresponding authors of reports with incomplete reporting of interventions were contacted to obtain additional information. Data were descriptively analyzed.

Results

Among 121 RCTs selected, 74 (61%) evaluated pharmacological treatments (PTs), including drugs and nutritional supplements; and 47 (39%) nonpharmacological treatments (NPTs) (40 participative interventions, 1 surgical procedure, 3 medical devices and 3 therapeutic strategies). Overall, the randomization sequence was adequately generated in 76 reports (62%) and the intervention allocation concealed in 48 (39%). The primary outcome was described as blinded in 46 reports (38%), and incomplete outcome data were adequately addressed in 78 (64%). Applying easy methodological adjustments with no or minor additional cost to trials with at least one domain at high risk of bias could have reduced the number of domains at high risk for 24 RCTs (19%). Interventions were completely reported for 73/121 (60%) RCTs: 51/74 (68%) of PTs and 22/47 (46%) of NPTs. Additional information was obtained from corresponding authors for 11/48 reports (22%).

Conclusion

Inadequate methods and incomplete reporting of published SSA RCTs could be improved by easy and inexpensive methodological adjustments and adherence to reporting guidelines.

Electronic supplementary material

The online version of this article (doi:10.1186/s13063-017-2034-0) contains supplementary material, which is available to authorized users.

Effects of Integrated Traditional Chinese and Western Medicine for the Treatment of Lupus Nephritis: A Meta-Analysis of Randomized Trials

After a thorough search through the database as CNKI database, VIP database, Wanfang database, PubMed, and Cochrane Library, the clinical experimental articles have been selected out on the effects of Integrated Traditional Chinese and Western Medicine on the treatment of lupus nephritis. A meta-analysis was carried out in terms of clinical efficacy criteria and safety criteria by RevMan 5.3 software. Based on the results, we cautiously conclude that Integrated Traditional Chinese and Western Medicine used for lupus nephritis could improve the clinical efficacy while at same time lower the 24-hour urine protein, serum creatinine, and adverse drug reactions.

Quality of reporting in surgical randomized clinical trials

BACKGROUND

RCTs testing surgical interventions can change clinical practice. The adequate reporting of surgical trials is an important issue.

METHODS

A cross-sectional survey was undertaken by searching PubMed for two-arm parallel randomized trials assessing surgical interventions published in 2003 or 2013. Quality of reporting was evaluated against the CONSORT checklist containing 29 items (standard CONSORT plus CONSORT Extension for Trials Assessing Non-Pharmacological Treatments). Univariable and multivariable linear regression was undertaken to explore factors associated with quality of reporting measured with CONSORT scores.

RESULTS

Some 120 trials were identified and included. The mean(s.d.) CONSORT score was 12·7(4·0). Trials published in 2013 achieved a higher CONSORT score than those published in 2003 (mean 14·5(3·8) versus 10·8(3·4) respectively; P < 0·001). The extent to which these trials met the requirement for CONSORT reporting differed substantially across items: four of 29 items were reported adequately across trials, and seven were reported adequately in less than 20 per cent of trials. Less than 40 per cent of the trials described the additional items related to surgical interventions and care providers (such as nursing care and anaesthetic management). In multivariable regression analysis, trials published in 2013 (coefficient 3·05, 95 per cent c.i. 1·89 to 4·20) and multicentre studies (coefficient 2·08, 0·79 to 3·37) were associated with statistically higher quality of reporting.

CONCLUSION

The quality of reporting in surgical trials has improved in the past decade. Overall quality, however, remains suboptimal, particularly in relation to details regarding surgical interventions and management.

A systematic review of randomized controlled trials and reviews in the management of ventral hernias

BACKGROUND

The literature supporting ventral hernia management is growing; however, it is unclear whether the quality of work is improving. We hypothesize that the quality of clinical ventral hernia research has improved over the past 2.5 decades.

METHODS

A review of MEDLINE, Scopus, and Cochrane databases was conducted for all ventral hernia studies from January 1, 1980 to May 1, 2015. Relevant abstracts were assigned a level according to the Oxford Center for Evidence-Based Medicine. Reviews, and meta-analyses were graded using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) Checklist and randomized controlled trials (RCTs) using the Consolidated Standards of Reporting Trials (CONSORT) checklist. Studies that did not fulfill at least 70% of the elements for the PRISMA (19/27) or CONSORT (26/37) checklists were considered to contain substantial methodological flaws.

RESULTS

Of 12,431 citations, 1336 met criteria for quality evaluation. Level 1 studies were sparse (n = 104, 7.8%), and most were level 2 or 3 (n = 463, 34.7%) or 4 (n = 769, 57.6%). Of the level 1 studies, 37 (35.6%) were RCTs, 61(58.7%) were reviews and/or meta-analyses, and 6 (5.8%) were consensus statements. Most RCTs and reviews and/or meta-analyses contained substantial methodological flaws (75.7%, 75.8%). Critical areas of weakness in RCTs were explaining losses and exclusions after randomization and/or allocation and reporting determination of sample size. For reviews and/or meta-analyses, areas of weakness were presenting an electronic search strategy and providing an assessment of risk of bias before pooling data. Linear regressions of PRISMA and CONSORT scores demonstrated improvement over time (PRISMA slope 0.95, R(2) = 0.24; CONSORT slope 0.34, R(2) = 0.08).

CONCLUSIONS

Although the quality of literature guiding ventral hernia management has improved over time, there is room for improvement.

Systematic review of intervention design and delivery in pragmatic and explanatory surgical randomized clinical trials

BACKGROUND

Surgical interventions are complex, with multiple components that require consideration in trial reporting. This review examines the reporting of details of surgical interventions in randomized clinical trials (RCTs) within the context of explanatory and pragmatic study designs.

METHODS

Systematic searches identified RCTs of surgical interventions published in 2010 and 2011. Included studies were categorized as predominantly explanatory or pragmatic. The extent of intervention details in the reports were compared with the CONSORT statement for reporting trials of non-pharmacological treatments (CONSORT-NPT). CONSORT-NPT recommends reporting the descriptions of surgical interventions, whether they were standardized and adhered to (items 4a, 4b and 4c). Reporting of the context of intervention delivery (items 3 and 15) and operator expertise (item 15) were assessed.

RESULTS

Of 4541 abstracts and 131 full-text articles, 80 were included (of which 39 were classified as predominantly pragmatic), reporting 160 interventions. Descriptions of 129 interventions (80.6 per cent) were provided. Standardization was mentioned for 47 (29.4 per cent) of the 160 interventions, and 22 articles (28 per cent) reported measurement of adherence to at least one aspect of the intervention. Seventy-one papers (89 per cent) provided some information about context. For one-third of interventions (55, 34.4 per cent), some data were provided regarding the expertise of personnel involved. Reporting standards were similar in trials classified as pragmatic or explanatory.

CONCLUSION

The lack of detail in trial reports about surgical interventions creates difficulties in understanding which operations were actually evaluated. Methods for designing and reporting surgical interventions in RCTs, contributing to the quality of the overall study design, are required. This should allow better implementation of trial results into practice.