Compliance with legal requirement to report clinical trial results on ClinicalTrials.gov: a cohort study

BACKGROUND

Failure to report the results of a clinical trial can distort the evidence base for clinical practice, breaches researchers' ethical obligations to participants, and represents an important source of research waste. The Food and Drug Administration Amendments Act (FDAAA) of 2007 now requires sponsors of applicable trials to report their results directly onto ClinicalTrials.gov within 1 year of completion. The first trials covered by the Final Rule of this act became due to report results in January, 2018. In this cohort study, we set out to assess compliance.

METHODS

We downloaded data for all registered trials on ClinicalTrials.gov each month from March, 2018, to September, 2019. All cross-sectional analyses in this manuscript were performed on data extracted from ClinicalTrials.gov on Sept 16, 2019; monthly trends analysis used archived data closest to the 15th day of each month from March, 2018, to September, 2019. Our study cohort included all applicable trials due to report results under FDAAA. We excluded all non-applicable trials, those not yet due to report, and those given a certificate allowing for delayed reporting. A trial was considered reported if results had been submitted and were either publicly available, or undergoing quality control review at ClinicalTrials.gov. A trial was considered compliant if these results were submitted within 1 year of the primary completion date, as required by the legislation. We described compliance with the FDAAA 2007 Final Rule, assessed trial characteristics associated with results reporting using logistic regression models, described sponsor-level reporting, examined trends in reporting, and described time-to-report using the Kaplan-Meier method.

FINDINGS

4209 trials were due to report results; 1722 (40·9%; 95% CI 39·4-42·2) did so within the 1-year deadline. 2686 (63·8%; 62·4-65·3) trials had results submitted at any time. Compliance has not improved since July, 2018. Industry sponsors were significantly more likely to be compliant than non-industry, non-US Government sponsors (odds ratio [OR] 3·08 [95% CI 2·52-3·77]), and sponsors running large numbers of trials were significantly more likely to be compliant than smaller sponsors (OR 11·84 [9·36-14·99]). The median delay from primary completion date to submission date was 424 days (95% CI 412-435), 59 days higher than the legal reporting requirement of 1 year.

INTERPRETATION

Compliance with the FDAAA 2007 is poor, and not improving. To our knowledge, this is the first study to fully assess compliance with the Final Rule of the FDAAA 2007. Poor compliance is likely to reflect lack of enforcement by regulators. Effective enforcement and action from sponsors is needed; until then, open public audit of compliance for each individual sponsor may help. We will maintain updated compliance data for each individual sponsor and trial at fdaaa.trialstracker.net.

FUNDING

Laura and John Arnold Foundation.

A multistage crucible of revision and approval shapes IPCC policymaker summaries

Intergovernmental Panel on Climate Change (IPCC) member governments approve each report's summary for policymakers (SPM) by consensus, discussing and agreeing on each sentence in a plenary session with scientist authors. A defining feature of IPCC assessment, the governmental approval process builds joint ownership of current knowledge by scientists and governments. The resulting SPM revisions have been extensively discussed in anecdotes, interviews, and perspectives, but they have not been comprehensively analyzed. We provide an in-depth evaluation of IPCC SPM revisions, establishing an evidential basis for understanding their nature. Revisions associated with governmental review and approval generally expand SPMs, with SPM text growing by 17 to 53% across recent assessment reports. Cases of high political sensitivity and failure to reach consensus are notable exceptions, resulting in SPM contractions. In contrast to recent claims, we find that IPCC SPMs are as readable, for multiple metrics of reading ease, as other professionally edited assessment summaries. Across reading-ease metrics, some SPMs become more readable through governmental review and approval, whereas others do not. In an SPM examined through the entire revision process, most revisions associated with governmental review and approval occurred before the start of the government-approval plenary session. These author revisions emphasize clarity, scientific rigor, and explanation. In contrast, the subsequent plenary revisions place greater emphasis especially on policy relevance, comprehensiveness of examples, and nuances of expert judgment. Overall, the value added by the IPCC process emerges in a multistage crucible of revision and approval, as individuals together navigate complex science-policy terrain.

Few comply with clinical trials reporting law

The Food and Drug Administration Amendments Act requires researchers to submit clinical trial results to ClinicalTrials.gov within a year of completion. However, a new study indicates that only 13.4% of trials comply.

Linguistic traces of a scientific fraud: the case of Diederik Stapel

When scientists report false data, does their writing style reflect their deception? In this study, we investigated the linguistic patterns of fraudulent (N  =  24; 170,008 words) and genuine publications (N  =  25; 189,705 words) first-authored by social psychologist Diederik Stapel. The analysis revealed that Stapel's fraudulent papers contained linguistic changes in science-related discourse dimensions, including more terms pertaining to methods, investigation, and certainty than his genuine papers. His writing style also matched patterns in other deceptive language, including fewer adjectives in fraudulent publications relative to genuine publications. Using differences in language dimensions we were able to classify Stapel's publications with above chance accuracy. Beyond these discourse dimensions, Stapel included fewer co-authors when reporting fake data than genuine data, although other evidentiary claims (e.g., number of references and experiments) did not differ across the two article types. This research supports recent findings that language cues vary systematically with deception, and that deception can be revealed in fraudulent scientific discourse.

Great expectations--ethics, avian flu and the value of progress

A recent controversy over the US National Science Advisory Board for Biosecurity's recommendation to censor two publications on genetically modified H5N1 avian influenza has generated concern over the threat to scientific freedom such censorship presents. In this paper, I argue that in the case of these studies, appeals to scientific freedom are not sufficient to motivate a rejection of censorship. I then use this conclusion to draw broader concerns about the ethics of dual-use research.

The Bruce Report and social welfare leadership in the politics of Toronto’s “Slums”, 1934–1939

Slum clearance and rebuilding first became a serious political project in Toronto during the 1930s. Following the release of a systematic housing survey known as the Bruce Report (1934), a set of actors distinguished by their planning authority with respect to social agencies, influence over social work education, coordination of social research, and role as spokespersons of religious bodies inaugurated a political struggle over state power. While the campaign failed, it called forth a reaction from established authorities and reconfigured the local political field as it related to low-income housing. This article gives an account of these processes by drawing upon correspondence and minutes of meetings of city officials and the campaign’s organizers, newspaper clippings, and published materials.

Religion and attitudes toward abortion and abortion policy in Brazil

This study examines the association between religion and attitudes toward the practice of abortion and abortion policy in Brazil. Drawing upon data from the 2002 Brazilian Social Research Survey (BSRS), we test a number of hypotheses with regard to the role of religion on opposition to the practice of abortion and its legalization. Findings indicate that frequently attending Pentecostals demonstrate the strongest opposition to the practice of abortion and both frequently attending Pentecostals and Catholics demonstrate the strongest opposition to its legalization. Additional religious factors, such as a commitment to biblical literalism, were also found to be significantly associated with opposition to both abortion issues. Ultimately, the findings have implications for the future of public policy on abortion and other contentious social issues in Brazil.