Poor outcome reporting in medical research; building practice on spoilt grounds

Primary outcome reporting in clinical trials for older adults with depression

BACKGROUND

Findings from randomised controlled trials (RCTs) are synthesised through meta-analyses, which inform evidence-based decision-making. When key details regarding trial outcomes are not fully reported, knowledge synthesis and uptake of findings into clinical practice are impeded.

AIMS

Our study assessed reporting of primary outcomes in RCTs for older adults with major depressive disorder (MDD).

METHOD

Trials published between 2011 and 2021, which assessed any intervention for adults aged ≥65 years with a MDD diagnosis, and that specified a single primary outcome were considered for inclusion in our study. Outcome reporting assessment was conducted independently and in duplicate with a 58-item checklist, used in developing the CONSORT-Outcomes statement, and information in each RCT was scored as 'fully reported', 'partially reported' or 'not reported', as applicable.

RESULTS

Thirty-one of 49 RCTs reported one primary outcome and were included in our study. Most trials (71%) did not fully report over half of the 58 checklist items. Items pertaining to outcome analyses and interpretation were fully reported by 65% or more of trials. Items reported less frequently included: outcome measurement instrument properties (varied from 3 to 30%) and justification of the criteria used to define clinically meaningful change (23%).

CONCLUSIONS

There is variability in how geriatric depression RCTs report primary outcomes, with omission of details regarding measurement, selection, justification and definition of clinically meaningful change. Outcome reporting deficiencies may hinder replicability and synthesis efforts that inform clinical guidelines and decision-making. The CONSORT-Outcomes guideline should be used when reporting geriatric depression RCTs.

Immunotherapy for Esophageal Cancer: State-of-the Art in 2021

The management of esophageal cancer (EC) has experienced manifold changes during the last decades. Centralization of EC treatment has been introduced in many countries, subsequently allowing the development of specialized high-volume centers. Minimal invasive surgery has replaced open surgery in many centers, whereas more potent systemic treatments have been introduced in clinical practice. Newer chemotherapy regimens increase long-term survival. Nevertheless, the overall survival of EC patients remains dismal for advanced tumor stages. In this direction, a wide range of targeted biologic agents (immunotherapy) is currently under assessment. Anti- Human Epidermal Growth Factor Receptor-2 (HER-2) monoclonal antibodies are used in HER2 (+) tumors, predominantly well-differentiated adenocarcinomas, and are currently assessed in the neoadjuvant setting (TRAP, INNOVATION trials). Immune checkpoint inhibitors Nivolumab (ATTRACTION-03) and pembrolizumab (KEYNOTE-181), have demonstrated a survival benefit compared with conventional chemotherapy in heavily pre-treated progressive disease. More recently, CheckMate-577 showed very promising results for nivolumab in a curative adjuvant setting, improving disease-free survival mainly for esophageal squamous cell carcinoma. Several ongoing trials are investigating novel targeted agents in the preoperative setting of locally advanced EC. In addition, other immunomodulatory approaches such as peptide vaccines and tumor infiltrating lymphocytes (TILs) are currently under development and should be increasingly integrated into clinical practice.

Metabolic side effects of antipsychotic drugs in individuals with schizophrenia during medium- to long-term treatment: protocol for a systematic review and network meta-analysis of randomized controlled trials

BACKGROUND

Antipsychotic drugs and especially the newer compounds are known to cause metabolic side effects. However, a comprehensive comparison of the different substances regarding their propensity to cause metabolic side effects in medium- to long-term treatment of schizophrenia is lacking.

METHODS

We will conduct a systematic review and network meta-analysis (NMA). We will include randomized controlled trials (RCTs) in which participants received either placebo or an antipsychotic (i.e. placebo-controlled trials and head-to-head comparisons of drugs). We will include studies in individuals with schizophrenia or related disorders (such as schizophreniform or schizoaffective disorders) at any stage of the disease (acute episode; maintenance phase). We will include studies with a duration of more than 3 months (medium- to long-term treatment). The primary outcome will be the change in body weight. Secondary outcomes will be the further metabolic parameters: fastening glucose, total cholesterol, low-density lipoprotein (LDL) cholesterol, high-density lipoprotein (HDL) cholesterol and triglycerides. We will search for eligible studies (independent of the publication status) in Cochrane Schizophrenia Group's Study-Based Register of Trials, which is compiled by regular searches in trial registries and multiple electronic databases from their inception onwards including MEDLINE, EMBASE and PsycINFO. Additionally, we will search previously published systematic reviews and websites of pharmaceutical companies for eligible studies. At least two reviewers will independently conduct the process of study selection and data extraction. We will use the Cochrane Risk of Bias 2 tool to evaluate the risk of bias in studies. We will conduct random-effects NMA within a Bayesian framework to synthesize all evidence for each outcome. We will conduct sensitivity and subgroup analyses to assess the robustness of the findings and to explore heterogeneity. The confidence in the results will be evaluated using the Confidence in Network Meta-Analysis (CINeMA) framework.

DISCUSSION

This systematic review and network meta-analysis will provide a synthesis of the existing evidence from RCTs how antipsychotic drugs differ in terms of metabolic side effects during medium- to long-term treatment. The findings have the potential to influence the choice of antipsychotic medication made by individuals with schizophrenia and their physicians.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42020175414.

A tool for assessing the comprehensiveness of outcome reporting within clinical trials in pregnancy

INTRODUCTION

Clinical trials provide fundamental evidence used to inform healthcare decisions at patient- and population levels and it is thus important that trials consider outcomes relevant to both patients and stakeholders. Although validated tools assessing other aspects of trial integrity exist, there is no tool for assessing the breadth and completeness of outcomes measured. Our objective was to develop a comprehensiveness of outcome reporting (COR) tool to assess this within trials in pregnancy.

MATERIAL AND METHODS

We developed a tool that aids in visualizing outcome reporting through the automatic generation of a heatmap, enabling assessment of the range of maternal and fetal/neonatal outcomes included in clinical trials. Outcome reporting and measurement of each study is compared to a context-specific, user-determined, ideal standard set of outcomes, created by initially considering all domains within five core outcome areas. These include mortality, morbidity, functioning/life-impact, resource-use, and adverse events, as identified by the most recent taxonomy for outcomes in medical research. We tested the tool's functionality using trials previously identified as studies on obesity in pregnant patients, and further compared the utility of the COR Tool against Cochrane's Risk of Bias 2.0 Tool using correlational analysis.

RESULTS

The pilot heatmap using clinical trials studying obesity in pregnancy (n = 15), illustrated a lack of comprehensiveness of reported outcomes in the majority of studies. Included trials were found to readily report physiological/clinical outcome but consistently neglected outcome areas related to functioning, delivery of care, resource-use, and adverse events. Outcome areas reported and measured were done so with largely varying degrees of quality. When the COR Tool was compared with Cochrane's RoB 2.0 Tool on a scatter plot, only a weak correlation was found (R = 0.2936, R²  = 0.0862) CONCLUSIONS: The COR Tool will promote transparency in clarifying what outcomes a trial's conclusions are based on, encourage trialists to consider outcomes related to all aspects of maternal and fetal/neonatal health, and support reviewers in appraising outcome reporting and measurement in the assessment of trial integrity. Used in tandem with RoB tools and core outcome sets, we hope the COR Tool will meaningfully contribute to improving maternal-infant health.

Neurodevelopmental outcome descriptions in cohorts of extremely preterm children

BACKGROUND AND OBJECTIVES

Caregivers and clinicians of extremely preterm infants (born before 26 weeks' gestation) depend on long-term follow-up research to inform clinical decision-making. The completeness of outcome reporting in this area is unknown. The objective of this study was to evaluate the reporting of outcome definitions, selection, measurement and analysis in existing cohort studies that report on neurodevelopmental outcomes of children born extremely preterm.

METHODS

We evaluated the completeness of reporting of 'cognitive function' and 'cerebral palsy' in prospective cohort studies summarised in a meta-analysis that assessed the effect of preterm birth on school-age neurodevelopment. Outcome reporting was evaluated using a checklist of 55 items addressing outcome selection, definition, measurement, analysis, presentation and interpretation. Reporting frequencies were calculated to identify strengths and deficiencies in outcome descriptions.

RESULTS

All 14 included studies reported 'cognitive function' as an outcome; nine reported both 'cognitive function' and 'cerebral palsy' as outcomes. Studies reported between 26% and 46% of the 55 outcome reporting items assessed; results were similar for 'cognitive function' and 'cerebral palsy' (on average 34% and 33% of items reported, respectively). Key methodological concepts often omitted included the reporting of masking of outcome assessors, methods used to handle missing data and stakeholder involvement in outcome selection.

CONCLUSIONS

The reporting of neurodevelopmental outcomes in cohort studies of infants born extremely preterm is variable and often incomplete. This may affect stakeholders' interpretation of study results, impair knowledge synthesis efforts and limit evidence-based decision-making for this population.

Outcome reporting recommendations for clinical trial protocols and reports: a scoping review

BACKGROUND

Clinicians, patients, and policy-makers rely on published evidence from clinical trials to help inform decision-making. A lack of complete and transparent reporting of the investigated trial outcomes limits reproducibility of results and knowledge synthesis efforts, and contributes to outcome switching and other reporting biases. Outcome-specific extensions for the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT-Outcomes) and Consolidated Standards of Reporting Trials (CONSORT-Outcomes) reporting guidelines are under development to facilitate harmonized reporting of outcomes in trial protocols and reports. The aim of this review was to identify and synthesize existing guidance for trial outcome reporting to inform extension development.

METHODS

We searched for documents published in the last 10 years that provided guidance on trial outcome reporting using: an electronic bibliographic database search (MEDLINE and the Cochrane Methodology Register); a grey literature search; and solicitation of colleagues using a snowballing approach. Two reviewers completed title and abstract screening, full-text screening, and data charting after training. Extracted trial outcome reporting guidance was compared with candidate reporting items to support, refute, or refine the items and to assess the need for the development of additional items.

RESULTS

In total, 1758 trial outcome reporting recommendations were identified within 244 eligible documents. The majority of documents were published by academic journals (72%). Comparison of each recommendation with the initial list of 70 candidate items led to the development of an additional 62 items, producing 132 candidate items. The items encompassed outcome selection, definition, measurement, analysis, interpretation, and reporting of modifications between trial documents. The total number of documents supporting each candidate item ranged widely (median 5, range 0-84 documents per item), illustrating heterogeneity in the recommendations currently available for outcome reporting across a large and diverse sample of sources.

CONCLUSIONS

Outcome reporting guidance for clinical trial protocols and reports lacks consistency and is spread across a large number of sources that may be challenging to access and implement in practice. Evidence and consensus-based guidance, currently in development (SPIRIT-Outcomes and CONSORT-Outcomes), may help authors adequately describe trial outcomes in protocols and reports transparently and completely to help reduce avoidable research waste.

Primary outcome reporting in adolescent depression clinical trials needs standardization

BACKGROUND

Evidence-based health care is informed by results of randomized clinical trials (RCTs) and their syntheses in meta-analyses. When the trial outcomes measured are not clearly described in trial publications, knowledge synthesis, translation, and decision-making may be impeded. While heterogeneity in outcomes measured in adolescent major depressive disorder (MDD) RCTs has been described, the comprehensiveness of outcome reporting is unknown. This study aimed to assess the reporting of primary outcomes in RCTs evaluating treatments for adolescent MDD.

METHODS

RCTs evaluating treatment interventions in adolescents with a diagnosis of MDD published between 2008 and 2017 specifying a single primary outcome were eligible for outcome reporting assessment. Outcome reporting assessment was done independently in duplicate using a comprehensive checklist of 58 reporting items. Primary outcome information provided in each RCT publication was scored as "fully reported", "partially reported", or "not reported" for each checklist item, as applicable.

RESULTS

Eighteen of 42 identified articles were found to have a discernable single primary outcome and were included for outcome reporting assessment. Most trials (72%) did not fully report on over half of the 58 checklist items. Items describing masking of outcome assessors, timing and frequency of outcome assessment, and outcome analyses were fully reported in over 70% of trials. Items less frequently reported included outcome measurement instrument properties (ranging from 6 to 17%), justification of timing and frequency of outcome assessment (6%), and justification of criteria used for clinically significant differences (17%). The overall comprehensiveness of reporting appeared stable over time.

CONCLUSIONS

Heterogeneous reporting exists in published adolescent MDD RCTs, with frequent omissions of key details about their primary outcomes. These omissions may impair interpretability, replicability, and synthesis of RCTs that inform clinical guidelines and decision-making in this field. Consensus on the minimal criteria for outcome reporting in adolescent MDD RCTs is needed.

Improving outcome reporting in clinical trial reports and protocols: study protocol for the Instrument for reporting Planned Endpoints in Clinical Trials (InsPECT)

Background

Inadequate and poor quality outcome reporting in clinical trials is a well-documented problem that impedes the ability of researchers to evaluate, replicate, synthesize, and build upon study findings and impacts evidence-based decision-making by patients, clinicians, and policy-makers. To facilitate harmonized and transparent reporting of outcomes in trial protocols and published reports, the Instrument for reporting Planned Endpoints in Clinical Trials (InsPECT) is being developed. The final product will provide unique InsPECT extensions to the SPIRIT (Standard Protocol Items: Recommendations for Interventional Trials) and CONSORT (Consolidated Standards of Reporting Trials) reporting guidelines.

Methods

The InsPECT SPIRIT and CONSORT extensions will be developed in accordance with the methodological framework created by the EQUATOR (Enhancing the Quality and Transparency of Health Research Quality) Network for reporting guideline development. Development will consist of (1) the creation of an initial list of candidate outcome reporting items synthesized from expert consultations and a scoping review of existing guidance for reporting outcomes in trial protocols and reports; (2) a three-round international Delphi study to identify additional candidate items and assess candidate item importance on a 9-point Likert scale, completed by stakeholders such as trial report and protocol authors, systematic review authors, biostatisticians and epidemiologists, reporting guideline developers, clinicians, journal editors, and research ethics board representatives; and (3) an in-person expert consensus meeting to finalize the set of essential outcome reporting items for trial protocols and reports, respectively. The consensus meeting discussions will be independently facilitated and informed by the empirical evidence identified in the primary literature and through the opinions (aggregate rankings and comments) collected via the Delphi study. An integrated knowledge translation approach will be used throughout InsPECT development to facilitate implementation and dissemination, in addition to standard post-development activities.

Discussion

InsPECT will provide evidence-informed and consensus-based standards focused on outcome reporting in clinical trials that can be applied across diverse disease areas, study populations, and outcomes. InsPECT will support the standardization of trial outcome reporting, which will maximize trial usability, reduce bias, foster trial replication, improve trial design and execution, and ultimately reduce research waste and help improve patient outcomes.

Electronic supplementary material

The online version of this article (10.1186/s13063-019-3248-0) contains supplementary material, which is available to authorized users.

Nephrotoxicity prevalence in patients treated with polymyxins: a systematic review with meta-analysis of observational studies

Colistin and polymyxin B are increasingly reintroduced in clinical practice due to the absence of effective antibiotics for the treatment of emerging infections caused by gram-negative bacteria. The synthesis of current evidence on the characteristics of polymyxins, especially regarding nephrotoxicity, is necessary. This study aims to conduct a systematic review and meta-analysis of cohort-type observational studies in order to identify the prevalence of nephrotoxicity in patients treated with either colistin or polymyxin B. PubMed, Scopus, and DOAJ electronic databases were searched, and manual searches were done. Cohort studies evaluating renal damage (nephrotoxicity) in adult patients caused by colistin or polymyxin B were included. Meta-analyses of the prevalence of nephrotoxicity as well as cumulative meta-analysis and meta-regression were conducted. After the systematic searches, 95 cohorts (n = 7911 patients) were included for analysis. The nephrotoxicity prevalence was 26.7% [confidence interval (CI) 95%: 22.8-30.9%] for colistin and 29.8% (CI 23.8-36.7%) for polymyxin B (P = 0.720). The publication year of the studies, the criteria used to classify renal damage, and the nephrotoxicity as primary or secondary outcome showed a significant influence on the adverse event rates.