Prevalence, characteristics, and publication of discontinued randomized trials

MultiSCRIPT-Cycle 1-a pragmatic trial embedded within the Swiss Multiple Sclerosis Cohort (SMSC) on neurofilament light chain monitoring to inform personalized treatment decisions in multiple sclerosis: a study protocol for a randomized clinical trial

BACKGROUND

Treatment decisions for persons with relapsing-remitting multiple sclerosis (RRMS) rely on clinical and radiological disease activity, the benefit-harm profile of drug therapy, and preferences of patients and physicians. However, there is limited evidence to support evidence-based personalized decision-making on how to adapt disease-modifying therapy treatments targeting no evidence of disease activity, while achieving better patient-relevant outcomes, fewer adverse events, and improved care. Serum neurofilament light chain (sNfL) is a sensitive measure of disease activity that captures and prognosticates disease worsening in RRMS. sNfL might therefore be instrumental for a patient-tailored treatment adaptation. We aim to assess whether 6-monthly sNfL monitoring in addition to usual care improves patient-relevant outcomes compared to usual care alone.

METHODS

Pragmatic multicenter, 1:1 randomized, platform trial embedded in the Swiss Multiple Sclerosis Cohort (SMSC). All patients with RRMS in the SMSC for ≥ 1 year are eligible. We plan to include 915 patients with RRMS, randomly allocated to two groups with different care strategies, one of them new (group A) and one of them usual care (group B). In group A, 6-monthly monitoring of sNfL will together with information on relapses, disability, and magnetic resonance imaging (MRI) inform personalized treatment decisions (e.g., escalation or de-escalation) supported by pre-specified algorithms. In group B, patients will receive usual care with their usual 6- or 12-monthly visits. Two primary outcomes will be used: (1) evidence of disease activity (EDA3: occurrence of relapses, disability worsening, or MRI activity) and (2) quality of life (MQoL-54) using 24-month follow-up. The new treatment strategy with sNfL will be considered superior to usual care if either more patients have no EDA3, or their health-related quality of life increases. Data collection will be embedded within the SMSC using established trial-level quality procedures.

DISCUSSION

MultiSCRIPT aims to be a platform where research and care are optimally combined to generate evidence to inform personalized decision-making in usual care. This approach aims to foster better personalized treatment and care strategies, at low cost and with rapid translation to clinical practice.

TRIAL REGISTRATION

ClinicalTrials.gov NCT06095271. Registered on October 23, 2023.

The time-dependent Poisson-gamma model in practice: Recruitment forecasting in HIV trials

Despite a growing body of literature in the area of recruitment modeling for multicenter studies, in practice, statistical models to predict enrollments are rarely used and when they are, they often rely on unrealistic assumptions. The time-dependent Poisson-Gamma model (tPG) is a recently developed flexible methodology which allows analysts to predict recruitments in an ongoing multicenter trial, and its performance has been validated on data from a cohort study. In this article, we illustrate and further validate the tPG model on recruitment data from randomized controlled trials. Additionally, in the appendix, we provide a practical and easy to follow guide to its implementation via the tPG R package. To validate the model, we show the predictive performance of the proposed methodology in forecasting the recruitment process of two HIV vaccine trials conducted by the HIV Vaccine Trials Network in multiple Sub-Saharan countries.

Successes and Challenges in Clinical Trial Recruitment: The Experience of a New Study Team

Participant recruitment is one of the most challenging aspects of a clinical trial, directly impacting both the study's duration and the quality of its results. Therefore, reporting successful recruitment strategies is crucial. This study aimed to document the recruitment tactics and experiences of a research team during a university-based randomized clinical trial, conducted as part of a clinical research immersion program. Recruitment took place from October 2021 to October 2022. Before the study commenced, study team members received formal training in clinical trial participant recruitment from the Principal Investigator. The recruitment strategies were integrated into initial study design, which was approved by the Institutional Review Board. A multimodal approach was employed, incorporating both direct and indirect recruitment methods. These strategies successfully met the enrollment target within the twelve-month period. Throughout the process, team members acquired valuable knowledge in recruitment design and implementation, along with transferable interpersonal and networking skills. In-person recruitment was the most efficient and cost-effective strategy, followed by personal referrals. The primary challenge was accommodating participants' availability. Other study teams should consider these recruitment strategies during their study designs. Additionally, the knowledge and skills gained by this study team underscore the value of experiential learning in research education.

Running the enrollment numbers on ophthalmic clinical trials in the United States

SIGNIFICANCE

This is one of the first reports to summarize the enrollment metrics for ophthalmology trials completed in the United States (US).

PURPOSE

This study aimed to describe US ophthalmology clinical trial enrollment metrics to facilitate planning and budgeting of US Food and Drug Administration-regulated ophthalmological drugs trials.

METHODS

A GlobalData PLC search was conducted on or before February 27, 2024, to evaluate the clinical trial landscape for completed ophthalmology clinical trials conducted in the US. The primary search contained only the term "ophthalmology," which was restricted to trials that were completed and were conducted within the US. Trials were classified as multicenter when trials included three sites or more, and when the enrollment search resulted in ≥30 multicenter trials for an individual indication, enrollment data were further broken down by Food and Drug Administration trial phase.

RESULT

The search yielded 2229 trials, which analyzed 980 different drugs produced by 854 different sponsors. The most common indications evaluated in US trials were macular degeneration, glaucoma, macular edema, allergies, and keratoconjunctivitis. Multicenter trials by indication had an overall median enrollment period range of 4.8 to 35.1 months; number of subjects enrollment, range of 36 to 518 subjects; number of sites utilized, range of 4 to 74 sites; and enrollment rate, range of 0.11 to 4.04 subjects/sites per month. There were 17 indications with ≥30 multicenter trials, which allowed for enrollment metric calculation by trial phase.

CONCLUSIONS

This study provides sponsors with an understanding of the number of subjects and sites needed to complete a trial while also setting realistic enrollment timelines. Although this work represents the US market, more work is needed to better understand other countries given that country-specific guidelines and subject beliefs may impact enrollment metrics.

Anlotinib hydrochloride consolidation after concurrent chemoradiotherapy in stage III non-small-cell lung cancer: a truncated, randomized, multicenter, clinical study (ALTER-L029)

Anlotinib is an antiangiogenic drug that shows good efficacy and safety in patients with advanced non-small-cell lung cancer (NSCLC). This study aimed to explore the efficacy and safety of anlotinib for consolidation therapy in patients with stage III locally advanced, unresectable NSCLC after concurrent chemoradiotherapy (cCRT). This was a randomized, parallel-controlled, open-label, multicenter, phase II trial of patients with unresectable/nonoperated NSCLC treated with cCRT. The participants were randomized 2:1 to the anlotinib or control group. The primary endpoint was progression-free survival (PFS). The secondary endpoints were the disease control rate (DCR) and overall survival. This study was terminated early due to poor recruitment. Nine and two participants were randomly assigned to the anlotinib and control groups, respectively. One participant in the control group was excluded due to taking prohibited medications before the first efficacy evaluation. In the anlotinib group, the median age was 63 (range, 37-74) years. Two participants achieved partial response, six stable disease, and one progressive disease as best response. The DCR was 88.9%. The median PFS was 11.5 months, and the 12-month PFS rate was 33.9%. All related adverse events were grade 1 or 2. Two participants had a dose adjustment during the study. The evaluable data suggest that anlotinib alone was effective and tolerable in consolidation therapy after cCRT in patients with stage III unresectable NSCLC. The results need to be confirmed by a large-sample trial. This clinical trial was registered on www.clinicaltrials.gov (NCT03743129). Registration date: 6 September 2018.

The utility of recruitment incentives in early Alzheimer's disease trials

INTRODUCTION

Amid recent approvals, early Alzheimer's disease (AD) remains an active area of treatment development.

METHODS

We performed a conjoint experiment to compare preferences among 26 patients with mild cognitive impairment for four trial features including designs incorporating active aducanumab-control (vs. placebo), returning tau positron emission tomography (PET) results (vs. no disclosure), remote study partner participation (vs. in person), and increased risk of brain swelling (vs. lower risk). We used a generalized estimating equation to model the utility of factor levels.

RESULTS

Returning tau PET results had the highest utility (est: 0.47; 95% confidence interval [CI]: 0.13, 0.81; P = 0.007); remote study partner participation showed a similar trend (est: 0.29; 95% CI: -0.05, 0.63; P = 0.097). Trials with active-controlled design (est: 0.01; 95% CI: -0.33, 0.35; P = 0.956) did not demonstrate utility and higher risk of brain swelling had negative utility (est: -0.64; 95% CI: -0.99, -0.30; P < 0.001).

DISCUSSION

Returning additional biomarker results may increase willingness to enroll in early AD trials.

HIGHLIGHTS

We compared mild cognitive impairment participant preferences for four trial design features. Returning tau positron emission tomography results had the highest utility. Remote study partner participation showed a positive, albeit non-significant, trend. No utility was observed for an active aducanumab-control design.

Discontinuation and non-publication of randomized controlled trials on cervical cancer or precancer

BACKGROUND

Research waste is a considerable problem in clinical trials, with nonpublication being a significant contributor. We aimed to determine the prevalence of discontinuation and nonpublication of randomized controlled trials (RCTs) on cervical cancer or precancer.

METHODS

We searched ClinicalTrials.gov for registered RCTs investigating cervical cancer or precancer that started between January 2000 and December 2020. The primary and secondary outcomes were trial nonpublication and premature discontinuation, respectively. Publication status was determined by systematic searches of peer-reviewed journals using the PubMed and Scopus databases.

RESULTS

A total of 113 RCTs met the inclusion criteria. Among the 85 trials completed before December 2020, 44 (51.8%) were prematurely discontinued and 40 (47.1%) were unpublished. A single-center design (61.4% vs. 34.1%, P = .012) and lack of external funding (59.1% vs. 36.6%, P = .038) were significantly associated with trial discontinuation. Large-scale (target sample size >400; 46.7% vs. 17.5%, P = .004) and externally funded trials (66.7% vs. 35.0%, P = .004) were more likely to be published. Multivariate logistic analysis revealed that a large sample size [odd ratio (OR): 4.125, 95% confidence interval (CI): 1.511-11.259, P = .006] and presence of external funding (OR: 3.714, 95% CI: 1.513-9.117, P = .004) were independent positive factors for trial publication.

CONCLUSION

A significant proportion of RCTs related to cervical cancer or precancer were discontinued early or remain unpublished, resulting in a waste of research resources.

Recruitment into randomised trials of arteriovenous grafts: A systematic review

Although randomised controlled trials (RCT) are considered the optimal form of evidence, there are relatively few in surgery. Surgical RCT are particularly likely to be discontinued with poor recruitment cited as a leading reason. Surgical RCT present challenges over and above those seen in drug trials as the treatment under study may vary between procedures, between surgeons in one unit, and between units in multi-centred RCT. The most contentious and debated area of vascular access remains the role of arteriovenous grafts, and thus the quality of the data that is used to support opinions, guidelines and recommendations is critical. The aim of this review was to determine the extent of variation in the planning and recruitment in all RCT involving AVG. The findings of this are stark: there have been only 31 RCT performed in 31 years, the vast majority of which exhibited major limitations severe enough to undermine the results. This underlines the need for better quality RCT and data, and further inform the design of future studies. Perhaps most fundamental is the planning for a RCT that accounts for the intended population, the uptake of a RCT and the attrition for the significant co-morbidity in this population.

Adapting, restarting, and terminating a randomised control trial for people with cystic fibrosis: Reflections on the impact of the COVID-19 pandemic upon research in a clinical population

Background

Habitual physical activity (PA) and exercise form a cornerstone of the management of cystic fibrosis (CF), a genetically inherited pulmonary and digestive condition - whereby telehealth platforms have been proposed as a mechanism to engage remotely people with CF in PA and exercise.

Methods

To test this, in early 2020, the 'ActivOnline: Physical Activity in Cystic Fibrosis Trial' (ActiOn PACT) randomised control trial was established to examine whether an online intervention was effective at increasing PA in adolescents and adults with CF.

Results

The emergence of the COVID-19 pandemic in 2020 forced this trial to be paused and modified, with the adoption of online recruitment and remote assessment of outcome measures. Despite such adaptations in accord with frameworks developed by the National Institute for Health Research, this trial failed to recruit and was subsequently terminated.

Conclusions

This article details the authors reflections upon the proposed reasons for lack of recruitment, including improved technology and medications for people with CF, and contextualises this finding in relation to the wider issue of non-reporting of trial results in clinical research.

recruIT: A cloud-native clinical trial recruitment support system based on Health Level 7 Fast Healthcare Interoperability Resources (HL7 FHIR) and the Observational Medical Outcomes Partnership Common Data Model (OMOP CDM)

BACKGROUND

Clinical trials (CTs) are foundational to the advancement of evidence-based medicine and recruiting a sufficient number of participants is one of the crucial steps to their successful conduct. Yet, poor recruitment remains the most frequent reason for premature discontinuation or costly extension of clinical trials.

METHODS

We designed and implemented a novel, open-source software system to support the recruitment process in clinical trials by generating automatic recruitment recommendations. The development is guided by modern, cloud-native design principles and based on Health Level 7 (HL7) Fast Healthcare Interoperability Resources (FHIR) as an interoperability standard with the Observational Medical Outcomes Partnership (OMOP) Common Data Model (CDM) being used as a source of patient data. We evaluated the usability using the system usability scale (SUS) after deploying the application for use by study personnel.

RESULTS

The implementation is based on the OMOP CDM as a repository of patient data that is continuously queried for possible trial candidates based on given clinical trial eligibility criteria. A web-based screening list can be used to display the candidates and email notifications about possible new trial participants can be sent automatically. All interactions between services use HL7 FHIR as the communication standard. The system can be installed using standard container technology and supports more sophisticated deployments on Kubernetes clusters. End-users (n = 19) rated the system with a SUS score of 79.9/100.

CONCLUSION

We contribute a novel, open-source implementation to support the patient recruitment process in clinical trials that can be deployed using state-of-the art technologies. According to the SUS score, the system provides good usability.

Participant recruitment and attrition in surgical randomised trials with placebo controls versus non-operative controls: a meta-epidemiological study and meta-analysis

OBJECTIVE

To compare differences in recruitment and attrition between placebo control randomised trials of surgery, and trials of the same surgical interventions and conditions that used non-operative (non-placebo) controls.

DESIGN

Meta-epidemiological study.

DATA SOURCES

Randomised controlled trials were identified from an electronic search of MEDLINE, EMBASE and Cochrane Central Register of Controlled Trials from their inception date to 21 November 2018.

STUDY SELECTION

Placebo control trials evaluating efficacy of any surgical intervention and non-operative control trials of the same surgical intervention were included in this study. 25 730 records were retrieved from our systemic search, identifying 61 placebo control and 38 non-operative control trials for inclusion in analysis.

OUTCOME MEASURES

Primary outcome measures were recruitment and attrition. These were assessed in terms of recruitment rate (number of participants enrolled, as a proportion of those eligible) and overall attrition rate (composite of dropout, loss to follow-up and cross-overs, expressed as proportion of total sample size). Secondary outcome measures included participant cross-over rate, dropout and loss to follow-up.

RESULTS

Unadjusted pooled recruitment and attrition rates were similar between placebo and non-operative control trials. Study characteristics were not significantly different apart from time to primary timepoint which was shorter in studies with placebo controls (365 vs 274 days, p=0.006). After adjusting for covariates (follow-up duration and number of timepoints), the attrition rate of placebo control trials was almost twice as high compared with non-operative controlled-trials (incident rate ratio (IRR) (95% CI) 1.8 (1.1 to 3.0), p=0.032). The incorporation of one additional follow-up timepoint (regardless of follow-up duration) was associated with reduced attrition in placebo control surgical trials (IRR (95% CI) 0.64 (0.52 to 0.79), p<0.001).

CONCLUSIONS

Placebo control trials of surgery have similar recruitment issues but higher attrition compared with non-operative (non-placebo) control trials. Study design should incorporate strategies such as increased timepoints for given follow-up duration to mitigate losses to follow-up and dropout.

PROSPERO REGISTRATION NUMBER

CRD42019117364.

Factors Associated With Premature Termination of Hyperacute Stroke Trials: A Review

BACKGROUND

We performed a review of acute stroke trials to determine features associated with premature termination of trial enrollment, defined by the authors as not meeting preplanned sample size.

METHODS AND RESULTS

MEDLINE was searched for randomized clinical stroke trials published in 9 major clinical journals between 2013 and 2022. We included randomized clinical trials that were phase 2 or 3 with a preplanned sample size ≥100 and a time-to-treatment within 24 hours of onset for transient ischemic attack, ischemic stroke, or intracerebral hemorrhage. Data were abstracted on trial features including trial design, inclusion criteria, imaging, location and number of sites, masking, treatment complexity, control group (standard therapy, placebo), industry involvement, and preplanned stopping rules (futility and efficacy). Least absolute shrinkage and selection operator regression was used to select the most important factors associated with premature termination; then, a multivariable logistic regression was fit including only the least absolute shrinkage and selection operator selected variables. Of 1475 studies assessed, 98 trials met eligibility criteria. Forty-five (46%) trials were prematurely terminated, of which 27% were stopped for benefit/efficacy, 20% for lack of money/slow enrollment, 18% for futility, 16% for newly available evidence, 17% for other reasons, and 4% due to harm. Complex trials (adjusted odds ratio [aOR], 2.76 [95% CI, 1.13-7.49]), presence of a futility rule (aOR, 4.43 [95% CI, 1.62-17.91]), and exclusion of prestroke dependency (none/slight disability only; aOR, 2.19 [95% CI, 0.84-6.72] versus dependency allowed) were identified as the strongest predictors.

CONCLUSIONS

Nearly half of acute stroke trials were terminated prematurely. Broadening inclusion criteria and simplifying trial design may decrease the likelihood of unplanned termination, whereas planned futility analyses may appropriately terminate trials early, saving money and resources.

Can propensity score matching replace randomized controlled trials?

Randomized controlled trials (RCTs) have long been recognized as the gold standard for establishing causal relationships in clinical research. Despite that, various limitations of RCTs prevent its widespread implementation, ranging from the ethicality of withholding potentially-lifesaving treatment from a group to relatively poor external validity due to stringent inclusion criteria, amongst others. However, with the introduction of propensity score matching (PSM) as a retrospective statistical tool, new frontiers in establishing causation in clinical research were opened up. PSM predicts treatment effects using observational data from existing sources such as registries or electronic health records, to create a matched sample of participants who received or did not receive the intervention based on their propensity scores, which takes into account characteristics such as age, gender and comorbidities. Given its retrospective nature and its use of observational data from existing sources, PSM circumvents the aforementioned ethical issues faced by RCTs. Majority of RCTs exclude elderly, pregnant women and young children; thus, evidence of therapy efficacy is rarely proven by robust clinical research for this population. On the other hand, by matching study patient characteristics to that of the population of interest, including the elderly, pregnant women and young children, PSM allows for generalization of results to the wider population and hence greatly increases the external validity. Instead of replacing RCTs with PSM, the synergistic integration of PSM into RCTs stands to provide better research outcomes with both methods complementing each other. For example, in an RCT investigating the impact of mannitol on outcomes among participants of the Intensive Blood Pressure Reduction in Acute Cerebral Hemorrhage Trial, the baseline characteristics of comorbidities and current medications between treatment and control arms were significantly different despite the randomization protocol. Therefore, PSM was incorporated in its analysis to create samples from the treatment and control arms that were matched in terms of these baseline characteristics, thus providing a fairer comparison for the impact of mannitol. This literature review reports the applications, advantages, and considerations of using PSM with RCTs, illustrating its utility in refining randomization, improving external validity, and accounting for non-compliance to protocol. Future research should consider integrating the use of PSM in RCTs to better generalize outcomes to target populations for clinical practice and thereby benefit a wider range of patients, while maintaining the robustness of randomization offered by RCTs.

Characteristics, Progression, and Output of Randomized Platform Trials: A Systematic Review

Importance

Platform trials have become increasingly common, and evidence is needed to determine how this trial design is actually applied in current research practice.

Objective

To determine the characteristics, progression, and output of randomized platform trials.

Evidence Review

In this systematic review of randomized platform trials, Medline, Embase, Scopus, trial registries, gray literature, and preprint servers were searched, and citation tracking was performed in July 2022. Investigators were contacted in February 2023 to confirm data accuracy and to provide updated information on the status of platform trial arms. Randomized platform trials were eligible if they explicitly planned to add or drop arms. Data were extracted in duplicate from protocols, publications, websites, and registry entries. For each platform trial, design features such as the use of a common control arm, use of nonconcurrent control data, statistical framework, adjustment for multiplicity, and use of additional adaptive design features were collected. Progression and output of each platform trial were determined by the recruitment status of individual arms, the number of arms added or dropped, and the availability of results for each intervention arm.

Findings

The search identified 127 randomized platform trials with a total of 823 arms; most trials were conducted in the field of oncology (57 [44.9%]) and COVID-19 (45 [35.4%]). After a more than twofold increase in the initiation of new platform trials at the beginning of the COVID-19 pandemic, the number of platform trials has since declined. Platform trial features were often not reported (not reported: nonconcurrent control, 61 of 127 [48.0%]; multiplicity adjustment for arms, 98 of 127 [77.2%]; statistical framework, 37 of 127 [29.1%]). Adaptive design features were only used by half the studies (63 of 127 [49.6%]). Results were available for 65.2% of closed arms (230 of 353). Premature closure of platform trial arms due to recruitment problems was infrequent (5 of 353 [1.4%]).

Conclusions and Relevance

This systematic review found that platform trials were initiated most frequently during the COVID-19 pandemic and declined thereafter. The reporting of platform features and the availability of results were insufficient. Premature arm closure for poor recruitment was rare.

A Decade of Efforts to Add Value to Child Health Research Practices

OBJECTIVE

To identify practices that add value to improve the design, conduct, and reporting of child health research and reduce research waste.

STUDY DESIGN

In order to categorize the contributions of members of Standards for Research (StaR) in Child Health network, we developed a novel Child Health Improving Research Practices (CHIRP) framework comprised of 5 domains meant to counteract avoidable child health research waste and improve quality: 1) address research questions relevant to children, their families, clinicians, and researchers; 2) apply appropriate research design, conduct and analysis; 3) ensure efficient research oversight and regulation; 4) Provide accessible research protocols and reports; and 5) develop unbiased and usable research reports, including 17 responsible research practice recommendations. All child health research relevant publications by the 48 original StaR standards' authors over the last decade were identified, and main topic areas were categorized using this framework.

RESULTS

A total of 247 publications were included in the final sample: 100 publications (41%) in domain 1 (3 recommendations), 77 publications (31%) in domain 2 (3), 35 publications (14%) in domain 3 (4), 20 publications (8%) in domain 4 (4), and 15 publications (6%) in domain 5 (3). We identified readily implementable "responsible" research practices to counter child health research waste and improve quality, especially in the areas of patients and families' engagement throughout the research process, developing Core Outcome Sets, and addressing ethics and regulatory oversight issues.

CONCLUSION

While most of the practices are readily implementable, increased awareness of methodological issues and wider guideline uptake is needed to improve child health research. The CHIRP Framework can be used to guide responsible research practices that add value to child health research.

Evaluation of Eligibility Criteria Relevance for the Purpose of IT-Supported Trial Recruitment: Descriptive Quantitative Analysis

BACKGROUND

Clinical trials (CTs) are crucial for medical research; however, they frequently fall short of the requisite number of participants who meet all eligibility criteria (EC). A clinical trial recruitment support system (CTRSS) is developed to help identify potential participants by performing a search on a specific data pool. The accuracy of the search results is directly related to the quality of the data used for comparison. Data accessibility can present challenges, making it crucial to identify the necessary data for a CTRSS to query. Prior research has examined the data elements frequently used in CT EC but has not evaluated which criteria are actually used to search for participants. Although all EC must be met to enroll a person in a CT, not all criteria have the same importance when searching for potential participants in an existing data pool, such as an electronic health record, because some of the criteria are only relevant at the time of enrollment.

OBJECTIVE

In this study, we investigated which groups of data elements are relevant in practice for finding suitable participants and whether there are typical elements that are not relevant and can therefore be omitted.

METHODS

We asked trial experts and CTRSS developers to first categorize the EC of their CTs according to data element groups and then to classify them into 1 of 3 categories: necessary, complementary, and irrelevant. In addition, the experts assessed whether a criterion was documented (on paper or digitally) or whether it was information known only to the treating physicians or patients.

RESULTS

We reviewed 82 CTs with 1132 unique EC. Of these 1132 EC, 350 (30.9%) were considered necessary, 224 (19.8%) complementary, and 341 (30.1%) total irrelevant. To identify the most relevant data elements, we introduced the data element relevance index (DERI). This describes the percentage of studies in which the corresponding data element occurs and is also classified as necessary or supplementary. We found that the query of "diagnosis" was relevant for finding participants in 79 (96.3%) of the CTs. This group was followed by "date of birth/age" with a DERI of 85.4% (n=70) and "procedure" with a DERI of 35.4% (n=29).

CONCLUSIONS

The distribution of data element groups in CTs has been heterogeneously described in previous works. Therefore, we recommend identifying the percentage of CTs in which data element groups can be found as a more reliable way to determine the relevance of EC. Only necessary and complementary criteria should be included in this DERI.

Analysis of the discontinuation and nonpublication of neurooncological randomized clinical trials

Background

Premature discontinuation and nonpublication of clinical trials contribute to research waste and compromise our ability to improve patient outcomes. However, the extent to which these problems exist in neurooncological randomized clinical trials (RCTs) is not known. This study aimed to evaluate the prevalence of discontinuation and nonpublication of neurooncological RCTs, identify contributing factors, and assess trial characteristics associated with each.

Methods

We performed a retrospective, cross-sectional study of neurooncological RCTs registered in Clinicaltrials.gov before March 7, 2023. Data were collected from Clinicaltrials.gov and associated publications were located. We attempted to contact authors for all trials without associated publications or an identified reason for discontinuation.

Results

Of 139 included RCTs, 57 (41%) were discontinued. The most common reason for discontinuation identified was slow enrollment or accrual (23%), though 30 trials (53%) were discontinued for unknown reasons. Trials funded by sources other than industry or the National Institutes of Health were more likely to be discontinued (odds ratio 4.2, 95% confidence interval 1.3-13.8). In total, 67 of the 139 (48%) RCTs were unpublished, including 50 of the 57 (88%) discontinued studies and 17 of the 82 (21%) completed studies.

Conclusions

In our study, discontinuation of neurooncological clinical trials was common and often occurred for unknown reasons. Trials were also frequently unpublished, particularly those that were discontinued. Addressing these findings may provide an opportunity to reduce research waste and improve outcomes for patients with neurological cancers.

Publication Bias and Selective Outcome Reporting in Randomized Controlled Trials Related to Rehabilitation: A Literature Review

OBJECTIVE

To investigate the rate of registered protocols published as research papers as a measure of publication bias, and the concordance rates of the primary outcomes between research protocol and published papers as a measure of selective outcome reporting bias in randomized controlled trials (RCTs) related to rehabilitation.

DATA SOURCES

Protocols related to RCTs were extracted from electronic databases, the University Hospital Medical Information Network (UMIN), International Standard Research Clinical Trial Number (ISRCTN), ClinicalTrials.gov, and MEDLINE. Published papers were retrieved from MEDLINE.

STUDY SELECTION

The inclusion criteria were as follows: (1) initial registration (UMIN, ISRCTN, ClinicalTrials.gov) within the designated period; (2) published as a paper from a research protocol in MEDLINE (PubMed); and (3) written in English or Japanese. The search period was from January 1, 2013, to December 31, 2020.

DATA EXTRACTION

The outcome of this study was set as the rate of published papers that were consistent with the extracted research protocol and the concordance rate between the primary outcomes in published papers and in protocols. The concordance rate of the primary outcomes was evaluated by checking whether the description in the research protocol matched that in the paper's abstract and main text.

DATA SYNTHESIS

Out of the 5597 research protocols registered, only 727 were published (13.0%). The concordance rates of the primary outcomes were 48.7% and 72.6% in the abstract and main text, respectively.

CONCLUSIONS

This study revealed major discrepancies between the number of research protocols and published papers, and difference of description regarding the primary outcomes in published papers which were already defined in the research protocols.

The scientific chaos phase of the great pandemic: A longitudinal analysis and systematic review of the first surge of clinical research concerning COVID-19

BACKGROUND

Early stages of catastrophes like COVID-19 are often led by chaos and panic. To characterize the initial chaos phase of clinical research in such situations, we analyzed the first surge of more than 1000 clinical trials about the new disease at baseline and after two years follow-up. Our 3 main objectives were: (1) Assessment of spatial and temporal evolution of clinical research of COVID-19 across the globe, (2) Assessment of transparency and quality-trial registration, (3) Assessment of research waste and redundancies.

METHODS

By entering the keyword "COVID-19" we screened the International Clinical Trials Registry Platform of the WHO and downloaded the search output when our goal of 1000 trials was reached on the 1st of April 2020. Additionally, we verified the integrity of the downloaded data from the meta registry by comparing the data with each individual registration record on their source register. Also, we conducted a follow-up after two years to track their progress.

RESULTS

(1) The spatial evolution followed the geographical spread of the disease as expected, however, the temporal development suggested that panic was the main driver for clinical research activities. (2) Trial registrations and registers showed a huge lack of transparency by allowing retrospective registrations and not keeping their registration records up to date. Quality of trial registration seems to have improved over the last decade, yet crucial information still was missing. (3) Research waste and redundancies were present as suggested by discontinuation of trials, preventable flaws in study design, and similar but uncoordinated research topics operationally fragmented in isolated silo-structures.

CONCLUSION

The scientific response mechanism across the globe was intact during the chaos phase. However, supervision, leadership, and accountability are urgently needed to prevent research waste, to ensure effective structure, quality, and validity to ultimately break the "panic-then-forget" cycle in future catastrophes.

Facilitating increased participation in clinical trials: what do consumers expect of clinical trial matching websites?

Clinical trials offer access to novel therapies and potential major benefits for patients, but identifying and accessing suitable trials remains a significant challenge for consumers. A burgeoning range of online services aims to meet this need; however, there is a paucity of data on whether these services are addressing the requirements and concerns of consumers. Here, we report our findings from a survey of cancer consumers, with results we believe are relevant to the broader research community.

Development, implementation, and dissemination of operational innovations across the trial innovation network

Improving the quality and conduct of multi-center clinical trials is essential to the generation of generalizable knowledge about the safety and efficacy of healthcare treatments. Despite significant effort and expense, many clinical trials are unsuccessful. The National Center for Advancing Translational Science launched the Trial Innovation Network to address critical roadblocks in multi-center trials by leveraging existing infrastructure and developing operational innovations. We provide an overview of the roadblocks that led to opportunities for operational innovation, our work to develop, define, and map innovations across the network, and how we implemented and disseminated mature innovations.

Selective Publication within Vascular Surgery: Characteristics of Discontinued and Unpublished Randomized Clinical Trials

BACKGROUND

Discontinued and unpublished randomized clinical trials (RCTs) are common resulting in biased publication and loss of potential knowledge. The magnitude of selective publication within vascular surgery remains unknown.

METHODS

RCT relevant to vascular surgery registered (01/01/2010-10/31/2019) on ClinicalTrials.gov were included. Trials ending normally with conclusion of participant treatment and examination were considered completed whereas discontinued trials stopped early. Publications were identified through automatically indexed PubMed citations on ClinicalTrials.gov or manually identified on PubMed or Google Scholar >30 months after the completion date, the date the final participant was examined, allowing time for publication.

RESULTS

Of 108 RCT (n = 37, 837), 22.2% (24/108) were discontinued, including 16.7% (4/24) stopped prior to and 83.3% (20/24) after starting enrollment. Only 28.4% of estimated enrollment was achieved for all discontinued RCT. Nineteen (79.2%) investigators provided a reason for discontinuation, which most commonly included poor enrollment (45.8%), inadequate supplies or funding (12.5%), and trial design concerns (8.3%). Of the 20 trials terminated following enrollment, 20.0% (4/20) were published in peer-reviewed journals and 80.0% (16/20) failed to reach publication. Of the 77.8% trials completed, 75.0% (63/84) were published and 25.0% (21/84) remain unpublished. In a multivariate regression of completed trials, industry funding was significantly associated with decreased likelihood of peer-reviewed publication (OR = 0.18, (95% CI 0.05-0.71), P = 0.01). Of the discontinued and completed trials remaining unpublished, 62.5% and 61.9% failed to report results on ClinicalTrials.gov, respectively, encompassing a total of 4,788 enrollees without publicly available results.

CONCLUSIONS

Nearly 25% of registered vascular RCT were discontinued. Of completed RCT, 25% remain unpublished with industry funding associated with decreased likelihood of publication. This study identifies opportunities to report all findings for completed and discontinued vascular surgery RCT, whether industry sponsored, or investigator initiated.

Failure of a Multi-Centric Clinical Trial Investigating Neoadjuvant Radio-Chemotherapy in Resectable Pancreatic Carcinoma (NEOPA-NCT01900327)-Which Lessons Are Learnt?

BACKGROUND

A significant number of clinical trials must be prematurely discontinued due to recruitment failure, and only a small fraction publish results and a failure analysis. Based on our experience on conducting the NEOPA trial on neoadjuvant radiochemotherapy for resectable and borderline resectable pancreatic carcinoma (NCT01900327-funded by the German Federal Ministry of Education and Research-BMBF), we performed an analysis of potential reasons for recruitment failure and general problems in conducting clinical trials in Germany.

METHODS

Systematic analysis of environmental factors, trial history, conducting and funding in the background of the published literature.

RESULTS

The recruitment failure was based on various study-specific conceptional and local environmental aspects and in peculiarities of the German surgical study culture. General reservations against a neo-adjuvant study concept combined with game changing scientific progresses during the long-lasting planning and funding phase have led to a reduced interest in the trial design and recruitment.

CONCLUSIONS

Trial planning and conducting should be focused, professionalized and financed on a national basis. Individual interests must be subordinated to reach the goal to perform more relevant and successful clinical trials in Germany. Bureaucratic processes must be further fastened between a trial idea and the start of a study.

Autopsy of a failed trial part 1: A qualitative investigation of clinician's views on and experiences of the implementation of the DAISIES trial in UK-based intensive eating disorder services

OBJECTIVE

The DAISIES trial, comparing inpatient and stepped-care day patient treatment for adults with severe anorexia nervosa was prematurely terminated in March 2022 due to poor recruitment. This qualitative study seeks to understand the difficulties faced during the trial by investigating stakeholders' views on and experiences of its implementation.

METHOD

Semi-structured interview and focus group transcripts, and trial management and oversight group meeting minutes from May 2020-June 2022 were analysed using thematic analysis. Participants were 47 clinicians and co-investigators involved with the DAISIES trial. The Non-Adoption, Abandonment, Scale-up, Spread, and Sustainability (NASSS) framework was applied to the interpretive themes to classify barriers and facilitators to implementation.

RESULTS

Five themes were identified: incompatible participation interests; changing standard practice; concerns around clinical management; systemic capacity and capability issues; and Covid-19 disrupting implementation. Applying the NASSS framework indicated the greatest implementation challenges to arise with the adopters (e.g. patients, clinicians), the organisational systems (e.g. service capacity), and the wider socio-political context (e.g. Covid-19 closing services).

CONCLUSIONS

Our findings emphasise the top-down impact of systemic-level research implementation challenges. The impact of the Covid-19 pandemic accentuated pre-existing organisational barriers to trial implementation within intensive eating disorder services, further limiting the capacity for research.

'Just one interview': making visible the hidden workload associated with qualitative research

BACKGROUND

Appropriate costing and allocation of resources is vital to ensure that recruitment to a study is achieved on time and on target. However, there is little guidance concerning the workload associated with qualitative research.

AIM

To review the planned versus actual workloads in a qualitative sub-study following elective cardiac surgery in children.

DISCUSSION

Parents of children approached for a clinical trial were invited to participate in a semi-structured interview to explore their views about making decisions concerning their children's participation in the trial. A workload audit was conducted using anticipated points of contact with participants, and the duration of activities identified in the protocol and Health Research Authority statement of activities; these were compared with timed activities documented by the research team.

CONCLUSION

The current system did not anticipate or capture the workload associated with conducting a relatively straightforward qualitative sub-study of a clinical trial with a research-engaged patient group.

IMPLICATIONS FOR PRACTICE

Understanding the hidden workload associated with qualitative research is vital in ensuring that project timelines, recruitment targets and funding for research staff are realistic.

A systematic review to identify and collate factors influencing patient journeys through clinical trials

Patient-centred trial design and delivery; improves recruitment and retention; increases participant satisfaction; encourages participation by a more representative cohort; and allows researchers to better meet participants' needs. Research in this area mostly focusses on narrow facets of trial participation. We aimed to systematically identify the breadth of patient-centred factors influencing participation and engagement in trials, and collate them into a framework. Through this we hoped to assist researchers to identify factors that could improve patient-centred trial design and delivery. Robust qualitative and mixed methods systematic reviews are becoming increasingly common in health research. The protocol for this review was prospectively registered on PROSPERO, CRD42020184886. We used the SPIDER (Sample, Phenomenon of Interest, Design, Evaluation, Research Type) framework as a standardised systematic search strategy tool. 3 databases were searched as well as references checking, and thematic synthesis was conducted. Screening agreement was performed and code and theme checking were conducted by 2 independent researchers. Data were drawn from 285 peer-reviewed articles. 300 discrete factors were identified, and sorted into 13 themes and subthemes. The full catalogue of factors is included in the Supplementary Material. A summary framework is included in the body of the article. This paper focusses on outlining common ground that themes share, highlighting critical features, and exploring interesting points from the data. Through this, we hope researchers from multiple specialities may be better able to meet patients' needs, protect patients' psychosocial wellbeing, and optimise trial recruitment and retention, with direct positive impact on research time and cost efficiency.

Approaches for enhancing the informativeness and quality of clinical trials: Innovations and principles for implementing multicenter trials from the Trial Innovation Network

One challenge for multisite clinical trials is ensuring that the conditions of an informative trial are incorporated into all aspects of trial planning and execution. The multicenter model can provide the potential for a more informative environment, but it can also place a trial at risk of becoming uninformative due to lack of rigor, quality control, or effective recruitment, resulting in premature discontinuation and/or non-publication. Key factors that support informativeness are having the right team and resources during study planning and implementation and adequate funding to support performance activities. This communication draws on the experience of the National Center for Advancing Translational Science (NCATS) Trial Innovation Network (TIN) to develop approaches for enhancing the informativeness of clinical trials. We distilled this information into three principles: (1) assemble a diverse team, (2) leverage existing processes and systems, and (3) carefully consider budgets and contracts. The TIN, comprised of NCATS, three Trial Innovation Centers, a Recruitment Innovation Center, and 60+ CTSA Program hubs, provides resources to investigators who are proposing multicenter collaborations. In addition to sharing principles that support the informativeness of clinical trials, we highlight TIN-developed resources relevant for multicenter trial initiation and conduct.

Centralizing prescreening data collection to inform data-driven approaches to clinical trial recruitment

BACKGROUND

Recruiting to multi-site trials is challenging, particularly when striving to ensure the randomized sample is demographically representative of the larger disease-suffering population. While previous studies have reported disparities by race and ethnicity in enrollment and randomization, they have not typically investigated whether disparities exist in the recruitment process prior to consent. To identify participants most likely to be eligible for a trial, study sites frequently include a prescreening process, generally conducted by telephone, to conserve resources. Collection and analysis of such prescreening data across sites could provide valuable information to improve understanding of recruitment intervention effectiveness, including whether traditionally underrepresented participants are lost prior to screening.

METHODS

We developed an infrastructure within the National Institute on Aging (NIA) Alzheimer's Clinical Trials Consortium (ACTC) to centrally collect a subset of prescreening variables. Prior to study-wide implementation in the AHEAD 3-45 study (NCT NCT04468659), an ongoing ACTC trial recruiting older cognitively unimpaired participants, we completed a vanguard phase with seven study sites. Variables collected included age, self-reported sex, self-reported race, self-reported ethnicity, self-reported education, self-reported occupation, zip code, recruitment source, prescreening eligibility status, reason for prescreen ineligibility, and the AHEAD 3-45 participant ID for those who continued to an in-person screening visit after study enrollment.

RESULTS

Each of the sites was able to submit prescreening data. Vanguard sites provided prescreening data on a total of 1029 participants. The total number of prescreened participants varied widely among sites (range 3-611), with the differences driven mainly by the time to receive site approval for the main study. Key learnings instructed design/informatic/procedural changes prior to study-wide launch.

CONCLUSION

Centralized capture of prescreening data in multi-site clinical trials is feasible. Identifying and quantifying the impact of central and site recruitment activities, prior to participants signing consent, has the potential to identify and address selection bias, instruct resource use, contribute to effective trial design, and accelerate trial enrollment timelines.

Discontinuation and nonpublication analysis of chronic pain randomized controlled trials

Introduction

The primary objective of this cross-sectional analysis is to evaluate rates of discontinuation and nonpublication of Randomized controlled trials (RCTs) of therapeutic interventions to treat chronic pain.

Methods

Using ClinicalTrials.gov, a sample was obtained which included clinical trials pertaining to chronic pain. Trials were analyzed for publication status and completion status of each trial. If information was unavailable on the trial registry database, or could not be allocated through a systematic search, the corresponding trialist was contacted and data points were gathered.

Results

In our final analysis of the 408 RCTs, we found that 281 (68.9%) were published in a peer-reviewed journal and 127 (31.1%) were unpublished trials. Of 112 discontinued trials, 59 (52.7%) reached publication. In addition, 221 of 296 completed trials (74.7%) were published, and 75 (25.3%) remained unpublished after trial completion. The most common listed reason for trial discontinuation was administrative recommendations (41 of 71 trials [57.7%]), while not receiving an email reply to our standardized email from the corresponding trialist was the most common result for trial nonpublication (49 of 88 trials [55.7%]). Clinical trials funded by nonindustry sponsors were more likely to reach publication than industry-funded clinical trials (unadjusted odds ratio 1.86 [95% CI, 1.18-2.95]; adjusted odds ratio 3.01 [95% CI, 1.76-5.14]).

Conclusion

The rate of discontinuation of RCTs involving patients with chronic pain is concerning. Chronic pain affects many patients; thus, the importance of having quality data from clinical trials cannot be overstated. Our study indicates that chronic pain RCTs are frequently discontinued and their findings often go unpublished - all of which could provide crucial information to providers and patients regarding the treatment of chronic pain. We offer suggestions to enhance chronic pain RCT completion, thereby reducing the waste of resources in chronic pain research.

From Protocol to Definitive Study-The State of Randomized Controlled Trial Evidence in Sports Medicine Research: A Systematic Review and Survey Study

OBJECTIVE

To evaluate the progression, quality, and challenges associated with conducting and publishing randomized controlled trials (RCTs) in sports medicine.

DESIGN

Systematic review and survey.

SETTING

MEDLINE and Embase were searched for all publications before September 17, 2021. A targeted search of clinicaltrials.gov , BMC Musculoskeletal Disorders, PubMed, and Google Scholar were also conducted. The survey was administered to authors using REDCap.

PARTICIPANTS

Where the systematic search revealed no corresponding published definitive trial, authors of the published pilots were surveyed.

INTERVENTIONS

Survey assessing limitations to definitive trials.

MAIN OUTCOME MEASURES

Protocol/method articles, pilot articles, and relevant clinical trial registry records with corresponding definitive trials were pooled.

RESULTS

Our literature search yielded 27 006 studies; of which, we included 208 studies (60 (28.8%) pilot RCTs, 84 (40.4%) protocol/method articles, and 64 (30.8%) trial registry records). From these, 44 corresponding definitive RCTs were identified. Pilot study and definitive RCT methodological quality increased on average most significantly during the duration of this review (30.6% and 8.2%). Of the 176 authors surveyed, 59 (33.5%) responded; 24.6% (14/57) stated that they completed an unpublished definitive trial, while 52.6% (30/57) reported having one underway.

CONCLUSIONS

The quality and number of RCT publications within the field of sports medicine has been increasing since 1999. The number of sports medicine-related protocol and pilot articles preceding a definitive trial publication showed a sharp increase over the past 10 years, although only 5 pilot studies have progressed to a definitive RCT.

Completion and publication of clinical trials in a cooperative group: a cohort study of trials of the Swiss Group for Clinical Cancer Research (SAKK)

BACKGROUND

Premature trial discontinuation and non-publication of trial results are still major issues negatively affecting reliable evidence generation.

OBJECTIVES

To investigate trial completion and publication rate of cancer trials conducted within the Swiss Group for Clinical Cancer Research (SAKK).

DESIGN

Cohort study of clinical trials.

SETTING

Cohort of interventional cancer trials conducted in Switzerland with accrual closure between 1986 and 2021 identified from the SAKK trial management system.

OUTCOMES

Premature trial discontinuation and publication in peer-reviewed journal.

RESULTS

We included 261 trials; median number of recruited patients was 150.5 (range 1-8028). Most trials (67.0%) were randomised. Overall, 76 of 261 (29.1%) trials were prematurely closed for accrual. The three main reasons for premature closure were insufficient accrual in 28 trials, followed by stopping for futility in 17 or efficacy in 8 trials. We included 240 trials for the publication status (21 excluded, because 8 still in follow-up, for 10 the primary completion date was less than a year ago and for 3 the manuscript was submitted, but to accepted yet). 216 of 240 (90.0%) were published as a full article, 14 were published in other formats, leading to an overall publication rate of 95.8%. The rate of premature discontinuation declined over time, with 34.2%, 27.8% and 23.5% in trials activated before 2000, between 2000 and 2009, and since 2010, respectively. We observed an increasing publication rate in peer-reviewed journals over time: 79.2% (closed before 2000), 95.7% (closed between 2000 and 2009) and 93.2% (closed after 2010).

CONCLUSION

Insufficient patient recruitment is still the major reason for premature trial discontinuation. SAKK has continuously improved its quality management of trial conduct over time leading to increased successful trial completion and publication. However, there is still room for improvement to increase the number of trials reaching their target sample size.

Recommendations for progression criteria during external randomised pilot trial design, conduct, analysis and reporting

BACKGROUND

External randomised pilot trials aim to assess whether a future definitive Randomised Controlled Trial (RCT) is feasible. Prespecified progression criteria help guide the interpretation of pilot trial findings to decide whether, and how, a definitive RCT should be conducted. This commentary presents a set of proposed recommendations for progression criteria to guide researchers when (i) designing, (ii) conducting, (iii) analysing and (iv) reporting external randomised pilot trials.

METHODS

Recommendations were developed following a mixed methods approach. This involved (i) a methodological review of pilot trial publications, (ii) a cross-sectional study of pilot trial research funding applications, (iii) qualitative interviews with pilot trial researchers and (iv) a survey of corresponding authors of identified pilot trial publications. Initial recommendations were refined following two consultation stakeholder workshops held in July 2022. Recommendations for progression criteria for external randomised pilot trials: i.

DESIGN

consider progression criteria from the earliest opportunity; map progression criteria to feasibility objectives; consider quantitative and qualitative interpretations of feasibility; provide justification; develop guidelines rather than rules; seek input from relevant stakeholders. ii. Conduct: regularly monitor pilot trial data against progression criteria. iii.

ANALYSIS

avoid considering each progression criterion in isolation; engage in discussion with relevant stakeholders; consider context and other factors external to the pilot trial; consider feasibility (can we?) and progression (will we?). iv. Reporting: we propose a reporting checklist in relation to progression criteria and recommend reporting in a table format for clarity.

CONCLUSION

These recommendations provide a helpful resource for researchers to consider progression criteria at different stages of external randomised pilot trials. We have produced a simple infographic tool to summarise these recommendations for researchers to refer to. Further research is needed to evaluate whether these proposed recommendations should inform future development, or update, of established guidelines for the design, conduct, analysis and reporting of external randomised pilot trials.

Development of a risk-tailored approach and dashboard for efficient management and monitoring of investigator-initiated trials

BACKGROUND

Most randomized controlled trials (RCTs) in the academic setting have limited resources for clinical trial management and monitoring. Inefficient conduct of trials was identified as an important source of waste even in well-designed studies. Thoroughly identifying trial-specific risks to enable focussing of monitoring and management efforts on these critical areas during trial conduct may allow for the timely initiation of corrective action and to improve the efficiency of trial conduct. We developed a risk-tailored approach with an initial risk assessment of an individual trial that informs the compilation of monitoring and management procedures in a trial dashboard.

METHODS

We performed a literature review to identify risk indicators and trial monitoring approaches followed by a contextual analysis involving local, national and international stakeholders. Based on this work we developed a risk-tailored management approach with integrated monitoring for RCTs and including a visualizing trial dashboard. We piloted the approach and refined it in an iterative process based on feedback from stakeholders and performed formal user testing with investigators and staff of two clinical trials.

RESULTS

The developed risk assessment comprises four domains (patient safety and rights, overall trial management, intervention management, trial data). An accompanying manual provides rationales and detailed instructions for the risk assessment. We programmed two trial dashboards tailored to one medical and one surgical RCT to manage identified trial risks based on daily exports of accumulating trial data. We made the code for a generic dashboard available on GitHub that can be adapted to individual trials.

CONCLUSIONS

The presented trial management approach with integrated monitoring enables user-friendly, continuous checking of critical elements of trial conduct to support trial teams in the academic setting. Further work is needed in order to show effectiveness of the dashboard in terms of safe trial conduct and successful completion of clinical trials.

Rates of discontinuation and non-publication of upper and lower extremity fracture clinical trials

PURPOSE

To our knowledge, no study has quantified the rate of discontinuation and nonpublication of randomized controlled trials (RCTs) regarding upper and lower extremity fractures.

METHODS

We searched ClinicalTrials.gov on September 9th, 2020, for phase 3 and 4 RCTs pertaining to upper and lower extremity fractures. Trial completion status was determined using records available on ClinicalTrials.gov. Publication status was determined using records on ClinicalTrials.gov and by searching PubMed (MEDLINE), Embase, and Google Scholar. We queried corresponding authors on trial status if a peer-reviewed publication was not identified.

RESULTS

Our final analysis included 142 RCTs, of which 57 (40.1%) were discontinued and 71 (50%) were unpublished. Thirty-six (of 57, 63.2%) discontinued trials failed to provide a reason for discontinuation, the most commonly identified reason for discontinuation was due to inadequate recruitment (13/21, 61.9%). Completed trials were more likely to reach publication (59/85; 69.4%; X² = 32.92; P ≤ 0.001) than discontinued trials. Trials with more than 80 participants were less likely not to reach publication (AOR: 0.12; 95% CI 0.15-0.66).

CONCLUSION

Our analysis of 142 upper and lower extremity fracture RCTs demonstrated one-half failed to reach publication and two-fifths were discontinued prior to trial completion. These findings indicate the need for increased guidance in developing, completing, and publishing RCTs in upper and lower extremity fractures. Discontinuation and nonpublication of orthopaedic RCTs hinder the public's access to collected data and negate the valued contribution from study participants. Discontinuation and non-publication of clinical trials may subject participants to potentially harmful interventions, limit the advancement of clinical research, and contribute to research waste.

LEVEL OF EVIDENCE

III.

Public reporting of clinical trial findings as an ethical responsibility to participants: a qualitative study

OBJECTIVE

To understand how the experiences and views of trial participants, trial investigators and others connected to clinical trial research relate to whether researchers have a duty to participants to publicly report research findings.

DESIGN

Qualitative interview study.

SETTING

Semistructured interviews held in person or by telephone between March 2019 and April 2021 with participants in the Canadian provinces of Alberta, British Columbia and Ontario.

PARTICIPANTS

34 participants, including 10 clinical trial participants, 17 clinical trial investigators, 1 clinical research coordinator, 3 research administrators and 3 research ethics board members.

ANALYSIS

We conducted a thematic analysis, including qualitative coding of interview transcripts and identification of key themes.

MAIN OUTCOME MEASURES

Key themes identified through qualitative coding of interview data.

RESULTS

Most clinical trial participants felt that reporting clinical trial results is important. Accounts of trial participants suggest their contributions are part of a reciprocal relationship involving the expectation that research will advance medical knowledge. Similarly, comments from trial investigators suggest that reporting trial results is part of reciprocity with trial participants and is a necessary part of honouring informed consent. Accounts of trial investigators suggest that when drug trials are not reported, this may undermine informed consent in subsequent trials by withholding information on harms or efficacy relevant to informed decisions on whether to conduct or enroll in future trials of similar drugs.

CONCLUSION

The views of trial participants, trial investigators and others connected to clinical trial research in Canada suggest that researchers have an obligation to participants to publicly report clinical trial results and that reporting results is necessary for honouring informed consent.

Recruitment across two decades of NIH-funded Alzheimer's disease clinical trials

BACKGROUND

Timely accrual of a representative sample is a key factor in whether Alzheimer's disease (AD) clinical trials successfully answer the scientific questions under study. Studies in other fields have observed that, over time, recruitment to trials has become increasingly reliant on larger numbers of sites, with declines in the average per-site recruitment rate. Here, we examined the trends in recruitment over a 20-year period of NIH-funded AD clinical trials conducted by the Alzheimer's Disease Cooperative Study (ADCS), a temporally consistent network of sites devoted to interventional research.

METHODS

We performed retrospective analyses of eleven ADCS randomized clinical trials. To examine the recruitment planning, we calculated the expected number of participants to be enrolled per site for each trial. To examine the actual trial recruitment rates, we quantified the number of participants enrolled per site per month.

RESULTS

No effects of time were observed on recruitment planning or overall recruitment rates across trials. No trial achieved an overall recruitment rate greater than one subject per site per month. We observed the fastest recruitment rates in trials with no competition and the slowest in trials that overlapped in time. The highest recruitment rates were consistently seen early within trials and declined over the course of studies.

CONCLUSIONS

Trial recruitment projections should plan for fewer than one participant randomized per site per month and consider the number of other AD trials being conducted concurrently.

The Collaborative Approach for Asian Americans and Pacific Islanders Research and Education (CARE): A recruitment registry for Alzheimer's disease and related dementias, aging, and caregiver-related research

INTRODUCTION

Clinical research focused on aging, Alzheimer's disease and related dementias (ADRD), and caregiving often does not recruit Asian Americans and Pacific Islanders (AAPIs).

METHODS

With funding from the National Institute on Aging, we designed and launched the Collaborative Approach for AAPIs Research and Education (CARE), a research recruitment registry to increase AAPIs' participation in ADRD, aging, and caregiving research. We present the design of this novel recruitment program.

RESULTS

CARE uses community-based participatory research methods that are culturally and linguistically appropriate. Since CARE's launch, it has enrolled >7000 AAPIs in a 1-year period. The majority enrolled in CARE via community organizations and reported never having participated in any kind of research before. CARE also engages researchers by establishing a recruitment referral request protocol.

DISCUSSION

CARE provides a promising venue to foster meaningful inclusion of AAPIs who are under-represented in aging and dementia-related research.

Analysis of Rates of Completion, Delays, and Participant Recruitment in Randomized Clinical Trials in Surgery

IMPORTANCE

Discontinuation and nonpublication are established sources of avoidable waste among surgical trials, but rates of delayed completion and recruiting shortfalls remain unclear.

OBJECTIVES

To examine the rate of delayed completion, incomplete enrollment, and discontinuation among randomized clinical trials in surgical populations and the duration of delays and extent of recruiting shortfalls among these trials.

DESIGN, SETTING, AND PARTICIPANTS

This cross-sectional study examined randomized clinical trials in surgical populations registered on ClinicalTrials.gov between January 1, 2010, and December 31, 2014. Analysis was conducted between October 27, 2021, and June 30, 2022.

MAIN OUTCOMES AND MEASURES

The main outcomes were the percentages of trials completed on time or with full enrollment. Delays and recruiting shortfalls were identified by comparing projected enrollment and study timeframes prespecified at the time of registration with the actual study duration and enrollment reported on completion or discontinuation. Absolute and relative differences between planned and actual trial conduct were presented for discontinued trials and those completed with delays or recruiting shortfalls.

RESULTS

In total, 2542 randomized clinical trials in surgical populations were included in the study sample, of which 370 (14.6%; 95% CI, 13.2%-15.9%) were completed both on time and with full enrollment. Approximately 1 in 5 trials (20.4%; 95% CI, 18.9%-22.0%) were completed within their planned timeframe, and 1166 trials (45.9%; 95% CI, 43.9%-47.8%) met their prespecified enrollment target. The median delay among completed trials was 12.2 months (IQR, 5.1-24.3 months) or 66.7% (IQR, 30.1%-135.8%) longer than planned. Among completed trials that did not meet their prespecified enrollment target, the median recruiting shortfall was equivalent to 31.0% (IQR, 12.7%-55.5%) of the planned study sample. A total of 546 trials (21.5%; 95% CI, 19.9%-23.1%) were discontinued. The median time to discontinuation was 26.4 months (IQR, 15.2-45.7 months), and the median recruiting shortfall among discontinued trials was equivalent to 92.7% (IQR, 65.0%-100.0%) of the trial's prespecified enrollment target.

CONCLUSIONS AND RELEVANCE

This cross-sectional study found that delayed completion, recruiting shortfalls, and untimely discontinuation were common among surgical trials. These findings highlight the importance of ensuring that investigators and funders do not overestimate the feasibility of planned trials.

Improving clinical trial recruitment with warm transfers

During recruitment for a large, decentralized clinical trial for high-risk individuals with COVID-19, respondents were either transferred in real-time to a clinical research coordinator (i.e. warm transfer), or a callback time was arranged. A retrospective analysis was conducted on 2341 respondents comparing the rate of enrollment among those who were warm-transferred and those for whom a callback was arranged. A respondent who warm-transferred was significantly more likely to enroll in the clinical trial.

Getting them through the door: Social and behavioral determinants of uptake and engagement in an obesity intervention

Using data from a large-scale screening program (N = 19634), we aimed to prospectively identify factors predicting uptake (i.e. acceptance of the invitation) and engagement (i.e. participation in at least two sessions) in a multi-component-intensive-behavioral-intervention for obesity-management (MBIOM) intervention targeting adolescents (n = 2862; 12-14 years; BMI ≥90th percentile). Approximately one third of adolescents most in need of weight management declined the initial invitation to enter the MBIOM. Poor diet, sedentary behavior, and parental education predicted willingness to enter and stay in the intervention, however measured body mass index did not matter. Perceived family support, instead of initial motivation, facilitated engagement. Our results provide new insights on the importance of regional socio-geographical factors including trust in local authorities.

A good use of time? Providing evidence for how effort is invested in primary and secondary outcome data collection in trials

BACKGROUND

Data collection is a substantial part of trial workload for participants and staff alike. How these hours of work are spent is important because stakeholders are more interested in some outcomes than others. The ORINOCO study compared the time spent collecting primary outcome data to the time spent collecting secondary outcome data in a cohort of trials.

METHODS

We searched PubMed for phase III trials indexed between 2015 and 2019. From these, we randomly selected 120 trials evaluating a therapeutic intervention plus an additional random selection of 20 trials evaluating a public health intervention. We also added eligible trials from a cohort of 189 trials in rheumatology that had used the same core outcome set. We then obtained the time taken to collect primary and secondary outcomes in each trial. We used a hierarchy of methods that included data in trial reports, contacting the trial team and approaching individuals with experience of using the identified outcome measures. We calculated the primary to secondary data collection time ratio and notional data collection cost for each included trial.

RESULTS

We included 161 trials (120 phase III; 21 core outcome set; 20 public health), which together collected 230 primary and 688 secondary outcomes. Full primary and secondary timing data were obtained for 134 trials (100 phase III; 17 core outcome set; 17 public health). The median time spent on primaries was 56.1 h (range: 0.0-10,746.7, IQR: 226.89) and the median time spent on secondaries was 190.7 hours (range: 0.0-1,356,832.9, IQR: 617.6). The median primary to secondary data collection time ratio was 1.0:3.0 (i.e. for every minute spent on primary outcomes, 3.0 were spent on secondaries). The ratio varied by trial type: phase III trials were 1.0:3.1, core outcome set 1.0:3.4 and public health trials 1.0:2.2. The median notional overall data collection cost was £8015.73 (range: £52.90-£31,899,140.70, IQR: £20,096.64).

CONCLUSIONS

Depending on trial type, between two and three times as much time is spent collecting secondary outcome data than collecting primary outcome data. Trial teams should explicitly consider how long it will take to collect the data for an outcome and decide whether that time is worth it given importance of the outcome to the trial.

A Qualitative Scoping Review of Early-Terminated Clinical Trials Sponsored by the Department of Veterans Affairs Cooperative Studies Program From 2010 to 2020

Increasing attention has been paid to the risks and benefits of terminating large clinical trials before reaching prespecified targets, because such decisions can greatly affect the implementation of findings. The Department of Veterans Affairs (VA) Cooperative Studies Program (CSP) is a research infrastructure dedicated to conducting high-quality clinical research. A scoping review was performed to characterize barriers preventing the attainment of prespecified recruitment, statistical power, or sample-size targets in VA CSP trials. A trial was eligible for inclusion if the trial was sponsored by the VA CSP, primary findings were published within the last 10 years, and a decision was made to terminate enrollment or follow-up before meeting a priori recruitment or endpoint targets. In 11 of 29 included trials (37.9%), a decision was made to terminate the trial early. The most common reason for early termination was related to under-recruitment (n = 5). Other reasons included early detection of safety signals (n = 2), futility (n = 1), and benefit (n = 1). This review highlights recruitment as a critical facet of trial conduct that may hinder the production of high-quality data and thus warrant additional attention. Solutions to enhance recruitment now implemented by the VA CSP, including dedicated enrollment infrastructure and screening facilitated by informatics approaches, show promise in reducing this cause for early termination.

Challenges in Recruiting University Students for Web-Based Indicated Prevention of Depression and Anxiety: Results From a Randomized Controlled Trial (ICare Prevent)

BACKGROUND

Depression and anxiety are common mental health conditions in college and university student populations. Offering transdiagnostic, web-based prevention programs such as ICare Prevent to those with subclinical complaints has the potential to reduce some barriers to receiving help (eg, availability of services, privacy considerations, and students' desire for autonomy). However, uptake of these interventions is often low, and accounts of recruitment challenges are needed to complement available effectiveness research in student populations.

OBJECTIVE

The aims of this study were to describe recruitment challenges together with effective recruitment strategies for ICare Prevent and provide basic information on the intervention's effectiveness.

METHODS

A 3-arm randomized controlled trial was conducted in a student sample with subclinical symptoms of depression and anxiety on the effectiveness of an individually guided (human support and feedback on exercises provided after each session, tailored to each participant) and automatically guided (computer-generated messages provided after each session, geared toward motivation) version of ICare Prevent, a web-based intervention with transdiagnostic components for the indicated prevention of depression and anxiety. The intervention was compared with care as usual. Descriptive statistics were used to outline recruitment challenges and effective web-based and offline strategies as well as students' use of the intervention. A basic analysis of intervention effects was conducted using a Bayesian linear mixed model, with Bayes factors reported as the effect size.

RESULTS

Direct recruitment through students' email addresses via the central student administration was the most effective strategy. Data from 35 participants were analyzed (individually guided: n=14, 40%; automatically guided: n=8, 23%; care as usual: n=13, 37%). Use of the intervention was low, with an average of 3 out of 7 sessions (SD 2.9) completed. The analyses did not suggest any intervention effects other than anecdotal evidence (all Bayes factors₁₀≤2.7).

CONCLUSIONS

This report adds to the existing literature on recruitment challenges specific to the student population. Testing the feasibility of recruitment measures and the greater involvement of the target population in their design, as well as shifting from direct to indirect prevention, can potentially help future studies in the field. In addition, this report demonstrates an alternative basic analytical strategy for underpowered randomized controlled trials.

TRIAL REGISTRATION

International Clinical Trials Registry Platform NTR6562; https://tinyurl.com/4rbexzrk.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.1186/s13063-018-2477-y.

The Pediatric Guideline Adherence and Outcomes (PEGASUS Argentina) program in severe traumatic brain injury: study protocol adaptations during the COVID-19 pandemic for a multisite implementation-effectiveness cluster randomized controlled trial

BACKGROUND

The aim of this protocol is to describe the study protocol changes made and subsequently implemented to the Pediatric Guideline Adherence and Outcomes (PEGASUS) Argentina randomized controlled trial (RCT) for care of children with severe traumatic brain injuries (TBI) imposed by the COVID-19 pandemic. The PEGASUS study group met in spring 2020 to evaluate available literature review guidance and the study design change or pausing options due to the potential interruption of research.

METHODS

As a parallel cluster RCT, pediatric patients with severe TBIs are admitted to 8 control (usual care) and 8 intervention (PEGASUS program) hospitals in Argentina, Chile, and Paraguay. PEGASUS is an intervention that aims to increase guideline adherence and best practice care for improving patient outcomes using multi-level implementation science-based approaches. Strengths and weaknesses of proposed options were assessed and resulted in a decision to revert from a stepped wedge to a parallel cluster RCT but to not delay planned implementation.

DISCUSSION

The parallel cluster design was considered more robust and flexible to secular interruptions and acceptable and feasible to the local study sites in this situation. Due to the early stage of the study, the team had flexibility to redesign and implement a design more compatible with the conditions of the research landscape in 2020 while balancing analytical methods and power, logistical and implementation feasibility, and acceptability. As of fall 2022, the PEGASUS RCT has been active for nearly 2 years of implementation and data collection, scheduled to be completed in in fall 2023. The experience of navigating research during this period will influence decisions about future research design, strategies, and contingencies.

TRIAL REGISTRATION

Pediatric Guideline Adherence and Outcomes-Argentina. Registered with ClinicalTrials.gov Identifier NCT03896789 on April 1, 2019.

Bioethics for Neonatal Cardiac Care

BACKGROUND

Clinicians caring for neonates with congenital heart disease encounter challenges with ethical implications in daily practice and must have some basic fluency in ethical principles and practical applications.

METHODS

Good ethical practice begins with a thorough understanding of the details and narrative of each individual case, examination via classic principles of bioethics, and further framing of that translation into practice.

RESULTS

We explore some of these issues and expand awareness through the lens of a case presentation beginning with fetal considerations through end-of-life discussions.

CONCLUSIONS

We include specific sections that bring attention to shared decision-making, research ethics, and outcomes reporting. We review empirical evidence and highlight recommendations.

Active vs Traditional Methods of Recruiting Children for a Clinical Trial in Rural Primary Care Clinics: A Cluster-Randomized Clinical Trial

IMPORTANCE

To our knowledge, there are no published randomized clinical trials of recruitment strategies. Rigorously evaluated successful recruitment strategies for children are needed.

OBJECTIVE

To evaluate the feasibility of 2 recruitment methods for enrolling rural children through primary care clinics to assess whether either or both methods are sufficiently effective for enrolling participants into a clinical trial of a behavioral telehealth intervention for children with overweight or obesity.

DESIGN, SETTING, AND PARTICIPANTS

This cluster-randomized clinical trial of 2 recruitment methods was conducted at 4 primary care clinics in 4 separate states. Each clinic used both recruitment methods in random order. Clinic eligibility criteria included at least 40% pediatric patients with Medicaid coverage and at least 100 potential participants. Eligibility criteria for children included a rural home address, age 6 to 11 years, and body mass index at or above the 85th percentile. Recruitment began February 3, 2020, and randomization of participants occurred on August 17, 2020. Data were analyzed from October 3, 2021, to April 21, 2022.

INTERVENTIONS

Two recruitment methods were assessed: the active method, for which a list of potential participants seen within the past year at each clinic was generated through the electronic health record and consecutively approached by research staff based on visit date to the clinic, and the traditional method, for which recruitment included posters, flyers, social media, and press release. Clinics were randomized to the order in which the 2 methods were implemented in 4-week periods, followed by a 4-week catch-up period using the method found most effective in previous periods.

MAIN OUTCOMES AND MEASURES

For each recruitment method, the number and proportion of randomized children among those who were approached was calculated.

RESULTS

A total of 104 participants were randomized (58 girls [55.8%]; mean age, 9.3 [95% CI, 9.0-9.6] years). Using the active method, 535 child-parent dyads were approached and 99 (18.5% [95% CI, 15.3%-22.1%]) were randomized. Using the traditional method, 23 caregivers expressed interest, and 5 (21.7% [95% CI, 7.5%-43.7%]) were randomized. All sites reached full enrollment using the active method and no sites achieved full enrollment using the traditional method. Mean time to full enrollment was 26.3 (range, 21.0-31.0) days.

CONCLUSIONS AND RELEVANCE

This study supports the use of the active approach with local primary care clinics to recruit children with overweight and obesity from rural communities into clinical trials.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT04142034.

A practical guide to implementing a successful social media recruitment strategy: lessons from the Eczema Monitoring Online trial

BACKGROUND

Participant recruitment into clinical trials remains challenging. The global increase in the number of social media users has accelerated the use of social media as a modality of recruitment, particularly during the COVID-19 pandemic when traditional recruitment methods were reduced. However, there is limited evidence on the performance of social media recruitment strategies into eczema clinical trials.

METHODS

From September 2021 to January 2022, we recruited participants with eczema into an online randomised controlled trial using free advertising on Twitter, Facebook, Instagram and Reddit (unpaid methods), followed by paid Facebook advertisements (paid method). Unpaid methods were used periodically for 63 days, whilst the paid method for 16 days. Interested individuals who clicked on the advertisement link were directed to the study website, where they could sign up to participate. Consenting, randomisation and data collection occurred exclusively online, using a database management web platform. Evaluation of the social media recruitment methods was performed, including the number of expression of interests, enrolment yield, cost, baseline characteristics and retention.

RESULTS

Our multi-platform based social media recruitment strategy resulted in 400 expressions of interests, leading to 296 participants. Unpaid methods accounted for 136 (45.9%) of participants, incurring no financial cost. Paid Facebook adverts reached 154,370 individuals, resulting in 123 (41.6%) trial participants for a total cost of £259.93 (£2.11 per participant) and other recruitment methods resulted in 37 (12.5%) enrolments. Paid advertisements predominantly attracted younger participants below the age of 20, whereas unpaid methods mainly drew in participants between 20-29 years of age. The social media platforms recruited an ethnically diverse participant population. Completion rate of follow-up was slightly higher for the paid method (n = 103, 83.7%) compared with the unpaid methods (n = 111, 81.6%).

CONCLUSIONS

Unpaid social media posts recruited the most participants; however, it was time consuming for the researcher. Paid Facebook adverts rapidly recruited a large number of participants for a low cost and provided flexibility to target specific audiences. Our findings indicate that social media is an efficient tool that can potentially support recruitment to clinical trials.

TRIAL REGISTRATION

ISRCTN45167024. Registered on 29 June 2021.

Panoramic quality assessment tool for investigator initiated trials

Objectives

Quality can be a challenge for Investigator initiated trials (IITs) since these trials are scarcely overseen by a sponsor or monitoring team. Therefore, quality assessment for departments managing clinical research grants program is important and urgently needed. Our study aims at developing a handy quality assessment tool for IITs that can be applied by both departments and project teams.

Methods

The framework of the quality assessment tool was developed based on the literature studies, accepted guidelines and the Delphi method. A total of 272 ongoing IITs funded by Shanghai non-profit organizations in 2015 and 2016 were used to extract quality indexes. Confirmatory factor analysis (CFA) was used to further evaluate the validity and feasibility of the conceptual quality assessment tool.

Results

The tool consisted of 4 critical quality attributes, including progress, quality, regulation, scientificity, and 13 observed quality indexes. A total of 257 IITs were included in the validity and feasibility assessment. The majority (60.29%) were Randomized Controlled Trial (RCT), and 41.18% were multi-center studies. In order to test the validity and feasibility of IITs quality assessment tool, CFA showed that the model fit the data adequately. (CMIN/DF = 1.868, GFI = 0.916; CFI = 0.936; TLI = 0.919; RMSEA = 0.063; SRMR = 0.076). Different types of clinical studies fit well in the tool. However, RCT scored lower than prospective cohort and retrospective study in enrollment progress (7.02 vs. 7.43, 9.63, respectively).

Conclusion

This study established a panoramic quality assessment tool based on the Delphi method and CFA, and the feasibility and effectiveness of the tool were verified through clinical research examples. The use of this tool can help project management departments effectively and dynamically manage research projects, rationally allocate resources, and ensure the quality of IITs.

Willingness to participate in, support or carry out scientific studies for benefit assessment of available medical interventions: A stakeholder survey

BACKGROUND

Post-entry studies are a key element in managed entry agreements and aim at generating evidence about the additional benefit of new medical interventions before reimbursement decisions are made. This study evaluates the willingness of different stakeholder groups to engage post-entry in studies for benefit assessment and to assess differences in their willingness by study type, i.e. randomised controlled trial or observational study.

METHODS

We conducted a cross-sectional, web-based survey with a self-administrated questionnaire in German language. We disseminated invitations to patients, patient representatives, healthcare providers, trialists & scientists and representatives of the medical private sector, using a snowball system, public contact details of German associations and organisations, and social media. We analysed quantitative data descriptively and qualitative data inductively.

RESULTS

Data of 154 respondents were available for analysis. The majority (>85%) was willing to engage in the studies in general, and regarding different study types. Scientists reported a higher willingness to conduct and support RCTs (p = 0.01) as compared to observational studies. Representatives of the private sector were mainly willing to support, but not to carry out post-entry studies. Stakeholders frequently mentioned that potential personal benefit and altruistic motives were relevant for their decision to engage in studies. Practical inconveniences, poor integration into daily life, high demand for time and personnel, and lack of resources were commonly mentioned barriers.

DISCUSSION AND CONCLUSION

Stakeholders clearly reported to be willing to engage in post-entry studies for benefit assessment. Self-reported willingness to participate in and support for studies seems higher than practical recruitment rates. The survey might be subject to survey error and self-enhancement of participants. Inquiring about the willingness of hypothetical studies might have caused participants to report higher willingness. Motives for and against participation may be possible starting points for approaches to overcome recruitment difficulties and facilitate successful study conduct.