Quality of reporting of outcomes in phase III studies of pulmonary tuberculosis: a systematic review

Drug-resistant tuberculosis treatments, the case for a phase III platform trial

Most phase III trials in drug-resistant tuberculosis have either been underpowered to quantify differences in microbiological endpoints or have taken up to a decade to complete. Composite primary endpoints, dominated by differences in treatment discontinuation and regimen changes, may mask important differences in treatment failure and relapse. Although new regimens for drug-resistant tuberculosis appear very effective, resistance to new drugs is emerging rapidly. There is a need for shorter, safer and more tolerable regimens, including those active against bedaquiline-resistant tuberculosis. Transitioning from multiple regimen A versus regimen B trials to a single large phase III platform trial would accelerate the acquisition of robust estimates of relative efficacy and safety. Further efficiencies could be achieved by adopting modern adaptive platform designs. Collaboration among trialists, affected community representatives, funders and regulators is essential for developing such a phase III platform trial for drug-resistant tuberculosis treatment regimens.

Evaluation of outcome reporting in clinical trials of physiotherapy in bronchiectasis: The first stage of core outcome set development

INTRODUCTION

The aim of this study is to explore outcomes currently reported in physiotherapy trials for bronchiectasis and investigate the level of consistency in outcome reporting. This mapping of outcomes will be used to inform the development of a core outcome set (COS) for physiotherapy research in bronchiectasis. Outcomes reported in randomised clinical trials (RCTs) and RCT protocols were reviewed and evaluated. We included trials with physiotherapy as the main intervention, including pulmonary rehabilitation, exercise prescription, airway clearance, positive expiratory pressure devices, breathing training, self-management plans, and home exercise program. Medline, CINAHL, Scopus, Cochrane Central Register of Controlled Trials (CENTRAL), and the physiotherapy evidence database (PEDro) were searched from inception using a prespecified search strategy. Records including adult patients with bronchiectasis were included. Outcomes were listed verbatim and categorised into domains based on a pre-specified system, frequency of reporting and sources of variation were inspected.

RESULTS

Of 2158 abstracts screened, 37 trials (1202 participants) and 17 trial protocols were identified. Eighteen different physiotherapy techniques were investigated. A total of 331 outcomes were reported. No single outcome was reported by all trials. The most reported outcomes were lung function (27 trials, 50%), health related quality of life (26 trials, 48.1%), and dyspnoea (18 trials, 33.3%). A list of 104 unique outcomes covering 23 domains was created. Trials focus on physiological outcomes, mainly those related to respiratory system functions. Outcomes related to functioning and life impact are often neglected.

CONCLUSION

Outcome reporting in physiotherapy research for bronchiectasis was found to be inconsistent in terms of choosing and defining outcomes. Developing a core outcome set in this area of research is needed to facilitate aggregation of future trial results in systematic reviews that will in turn inform the strength of evidence for the effectiveness of physiotherapy. Outcome choice should include all stakeholders, including patients.

TRIAL REGISTRATION

This study is registered in the PROSPERO registry under the number CRD42021266247.

Concordance of three approaches for operationalizing outcome definitions for multidrug-resistant TB

BACKGROUND: The WHO provides standardized outcome definitions for rifampicin-resistant (RR) and multidrug-resistant (MDR) TB. However, operationalizing these definitions can be challenging in some clinical settings, and incorrect classification may generate bias in reporting and research. Outcomes calculated by algorithms can increase standardization and be adapted to suit the research question. We evaluated concordance between clinician-assigned treatment outcomes and outcomes calculated based on one of two standardized algorithms, one which identified failure at its earliest possible recurrence (i.e., failure-dominant algorithm), and one which calculated the outcome based on culture results at the end of treatment, regardless of early occurrence of failure (i.e., success-dominant algorithm).METHODS: Among 2,525 patients enrolled in the multi-country endTB observational study, we calculated the frequencies of concordance using cross-tabulations of clinician-assigned and algorithm-assigned outcomes. We summarized the common discrepancies.RESULTS: Treatment success calculated by algorithms had high concordance with treatment success assigned by clinicians (95.8 and 97.7% for failure-dominant and success-dominant algorithms, respectively). The frequency and pattern of the most common discrepancies varied by country.CONCLUSION: High concordance was found between clinician-assigned and algorithm-assigned outcomes. Heterogeneity in discrepancies across settings suggests that using algorithms to calculate outcomes may minimize bias.

A comparison of methods for analyzing a binary composite endpoint with partially observed components in randomized controlled trials

Composite endpoints are commonly used to define primary outcomes in randomized controlled trials. A participant may be classified as meeting the endpoint if they experience an event in one or several components (eg, a favorable outcome based on a composite of being alive and attaining negative culture results in trials assessing tuberculosis treatments). Partially observed components that are not missing simultaneously complicate the analysis of the composite endpoint. An intuitive strategy frequently used in practice for handling missing values in the components is to derive the values of the composite endpoint from observed components when possible, and exclude from analysis participants whose composite endpoint cannot be derived. Alternatively, complete record analysis (CRA) (excluding participants with any missing components) or multiple imputation (MI) can be used. We compare a set of methods for analyzing a composite endpoint with partially observed components mathematically and by simulation, and apply these methods in a reanalysis of a published trial (TOPPS). We show that the derived composite endpoint can be missing not at random even when the components are missing completely at random. Consequently, the treatment effect estimated from the derived endpoint is biased while CRA results without the derived endpoint are valid. Missing at random mechanisms require MI of the components. We conclude that, although superficially attractive, deriving the composite endpoint from observed components should generally be avoided. Despite the potential risk of imputation model mis-specification, MI of missing components is the preferred approach in this study setting.

A systematic review of endpoint definitions in late phase pulmonary tuberculosis therapeutic trials

BACKGROUND

Safe, more efficacious treatments are needed to address the considerable morbidity and mortality associated with pulmonary tuberculosis (TB). However, the current practice in TB therapeutics trials is to use composite binary outcomes, which in the absence of standardization may inflate false positive and negative errors in evaluating regimens. The lack of standardization of outcomes is a barrier to the identification of highly efficacious regimens and the introduction of innovative methodologies METHODS: We conducted a systematic review of trials designed to advance new pulmonary TB drugs or regimens for regulatory approval and inform practice guidelines. Trials were primarily identified from the WHO International Clinical Trial Registry Platform (ICTRP). Only trials that collected post-treatment follow-up data and enrolled at least 100 patients were included. Protocols and Statistical Analysis Plans (SAP) for eligible trials from 1995 to the present were obtained from trial investigators. Details of outcome data, both explicit and implied, were abstracted and organized into three broad categories: favorable, unfavorable, and not assessable. Within these categories, individual trial definitions were recorded and collated, and areas of broad consensus and disagreement were identified and described.

RESULTS

From 2205 trials in any way related to TB, 51 were selected for protocol and SAP review, from which 31 were both eligible and had accessible documentation. Within the three designated categories, we found broad consensus in the definitions of favorable and unfavorable outcomes, although specific details were not always provided, and when explicitly addressed, were heterogeneous. Favorable outcomes were handled the most consistently but were widely variable with respect to specification. In some cases, the same events were defined differently by different protocols, particularly in distinguishing unfavorable from not assessable events. Death was often interpreted as conditional on cause. Patients who did not complete the study because of withdrawal or loss to follow-up presented a particular challenge to consistent interpretation and analytic treatment of outcomes.

CONCLUSIONS

In a review of 31 clinical trials, we found that outcome definitions were heterogeneous, highlighting the need to establish clearer specification and a move towards universal standardization of outcomes across pulmonary TB trials. The ICH E9 (R1) addendum provides guidelines for undertaking and achieving this goal.

PROSPERO REGISTRATION

PROSPERO CRD42020197993 . Registration 11 August 2020.

Defining Outcomes of Tuberculosis (Treatment): From the Past to the Future

Untreated active tuberculosis (TB) has a very high long-term mortality. Treatment of TB reduces mortality dramatically and should maximize cure, preventing ongoing transmission and TB sequelae. However, predicting the risk of failure and relapse is crucial for the management of individual patients and for the evaluation of effectiveness of programs. Various outcome definitions for drug-sensitive and drug-resistant TB were developed, implemented, and endorsed since introduction of TB chemotherapy by the World Health Organization (WHO), mostly based on culture and smear results. They should be applicable for individual patient care, surveillance, and research. Definitions with focus on program evaluation differ from definitions to evaluate the efficacy and effectiveness of regimens. Lack of sputum production at the later stage of treatment reduces the easy applicability of current definitions. Definitions of failure and cure are sometimes difficult to apply. Alternative approaches suggest culture positivity at 6 months or more of treatment as an indicator for failure. New definitions for cure including a relapse-free period posttreatment and reduced number of culture and smear results are considered. Increasing variation and individualization of treatment and its duration urgently require new approaches using pathogen- or host-specific biomarkers, which indicate risk of failure and define cure. Such biomarkers are under evaluation but still far from translation in clinical routine practice.

The impact of inclusion, dose and duration of pyrazinamide (PZA) on efficacy and safety outcomes in tuberculosis: systematic review and meta-analysis protocol

BACKGROUND

Pyrazinamide (PZA) is a key component of current and future regimens for tuberculosis (TB). Inclusion of PZA at higher doses and for longer durations may improve efficacy outcomes but must be balanced against the potential for worse safety outcomes.

METHODS

We will search for randomised and quasi-randomised clinical trials in adult participants with and without the inclusion of PZA in TB treatment regimens in the Cochrane infectious diseases group's trials register, Cochrane central register of controlled trials (CENTRAL), MEDLINE, EMBASE, LILACS, the metaRegister of Controlled Trials (mRCT) and the World Health Organization (WHO) international clinical trials registry platform. One author will screen abstracts and remove ineligible studies (10% of which will be double-screened by a second author). Two authors will review full texts for inclusion. Safety and efficacy data will be extracted to pre-piloted forms by one author (10% of which will be double-extracted by a second author). The Cochrane risk of bias tool will be used to assess study quality. The study has three objectives: the association of (1) inclusion, (2) dose and (3) duration of PZA with efficacy and safety outcomes. Risk ratios as relative measures of effect for direct comparisons within trials (all objectives) and proportions as absolute measures of effect for indirect comparisons across trials (for objectives 2 and 3) will be calculated. If there is insufficient data for direct comparisons within trials for objective 1, indirect comparisons between trials will be performed. Measures of effect will be pooled, with corresponding 95% confidence intervals and p values. Meta-analysis will be performed using the generalised inverse variance method for fixed effects models (FEM) or the DerSimonian-Laird method for random effects models (REM). For indirect comparisons, meta-regression for absolute measures against dose and duration data will be performed. Heterogeneity will be quantified through the I2-statistic for direct comparisons and the τ2 statistic for indirect comparisons using meta-regression.

DISCUSSION

The current use of PZA for TB is based on over 60 years of clinical trial data, but this has never been synthesised to guide rationale use in future regimens and clinical trials. Systematic review registration: International Prospective Register of Systematic Reviews (PROSPERO) CRD42019138735.

Designing noninferiority tuberculosis treatment trials: Identifying practical advantages for drug regimens with acceptable effectiveness

In this Collection Review for the Novel Treatments for Tuberculosis Collection, Piero Olliaro and Michael Vaillant discuss the considerations when choosing a non-inferiority margin that is meaningful from statistical, ethical, clinical, and health standpoint.