1
|
Binko MA, Reitz KM, Chaer RA, Haga LM, Go C, Alie-Cusson FS, Tzeng E, Eslami MH, Sridharan ND. Selective Publication within Vascular Surgery: Characteristics of Discontinued and Unpublished Randomized Clinical Trials. Ann Vasc Surg 2023; 95:251-261. [PMID: 37311508 DOI: 10.1016/j.avsg.2023.05.035] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2023] [Revised: 05/25/2023] [Accepted: 05/31/2023] [Indexed: 06/15/2023]
Abstract
BACKGROUND Discontinued and unpublished randomized clinical trials (RCTs) are common resulting in biased publication and loss of potential knowledge. The magnitude of selective publication within vascular surgery remains unknown. METHODS RCT relevant to vascular surgery registered (01/01/2010-10/31/2019) on ClinicalTrials.gov were included. Trials ending normally with conclusion of participant treatment and examination were considered completed whereas discontinued trials stopped early. Publications were identified through automatically indexed PubMed citations on ClinicalTrials.gov or manually identified on PubMed or Google Scholar >30 months after the completion date, the date the final participant was examined, allowing time for publication. RESULTS Of 108 RCT (n = 37, 837), 22.2% (24/108) were discontinued, including 16.7% (4/24) stopped prior to and 83.3% (20/24) after starting enrollment. Only 28.4% of estimated enrollment was achieved for all discontinued RCT. Nineteen (79.2%) investigators provided a reason for discontinuation, which most commonly included poor enrollment (45.8%), inadequate supplies or funding (12.5%), and trial design concerns (8.3%). Of the 20 trials terminated following enrollment, 20.0% (4/20) were published in peer-reviewed journals and 80.0% (16/20) failed to reach publication. Of the 77.8% trials completed, 75.0% (63/84) were published and 25.0% (21/84) remain unpublished. In a multivariate regression of completed trials, industry funding was significantly associated with decreased likelihood of peer-reviewed publication (OR = 0.18, (95% CI 0.05-0.71), P = 0.01). Of the discontinued and completed trials remaining unpublished, 62.5% and 61.9% failed to report results on ClinicalTrials.gov, respectively, encompassing a total of 4,788 enrollees without publicly available results. CONCLUSIONS Nearly 25% of registered vascular RCT were discontinued. Of completed RCT, 25% remain unpublished with industry funding associated with decreased likelihood of publication. This study identifies opportunities to report all findings for completed and discontinued vascular surgery RCT, whether industry sponsored, or investigator initiated.
Collapse
Affiliation(s)
- Mary A Binko
- School of Medicine, University of Pittsburgh, Pittsburgh, PA
| | - Katherine M Reitz
- Division of Vascular Surgery, Department of Surgery, UPMC, Pittsburgh, PA
| | - Rabih A Chaer
- Division of Vascular Surgery, Department of Surgery, UPMC, Pittsburgh, PA
| | - Lindsey M Haga
- Division of Vascular Surgery, Department of Surgery, UPMC, Pittsburgh, PA
| | - Catherine Go
- Division of Vascular Surgery, Department of Surgery, UPMC, Pittsburgh, PA
| | | | - Edith Tzeng
- Division of Vascular Surgery, Department of Surgery, UPMC, Pittsburgh, PA
| | - Mohammad H Eslami
- Division of Vascular Surgery, Department of Surgery, UPMC, Pittsburgh, PA
| | | |
Collapse
|
2
|
Paludan-Müller AS, Ogden MC, Marquardsen M, Jørgensen KJ, Gøtzsche PC. Are investigators' access to trial data and rights to publish restricted and are potential trial participants informed about this? A comparison of trial protocols and informed consent materials. BMC Med Ethics 2021; 22:115. [PMID: 34454496 PMCID: PMC8403412 DOI: 10.1186/s12910-021-00681-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2020] [Accepted: 08/20/2021] [Indexed: 11/25/2022] Open
Abstract
OBJECTIVES To determine to which degree industry partners in randomised clinical trials own the data and can constrain publication rights of academic investigators. METHODS Cohort study of trial protocols, publication agreements and other documents obtained through Freedom of Information requests, for a sample of 42 trials with industry involvement approved by ethics committees in Denmark. The main outcome measures used were: proportion of trials where data was owned by the industry partner, where the investigators right to publish were constrained and if this was mentioned in informed consent documents, and where the industry partner could review data while the trial was ongoing and stop the trial early. RESULTS The industry partner owned all data in 20 trials (48%) and in 16 trials (38%) it was unclear. Publication constraints were described for 30 trials (71%) and this was not communicated to trial participants in informed consent documents in any of the trials. In eight trials (19%) the industry partner could review data during the trial, for 20 trials (48%) it was unclear. The industry partner could stop the trial early without any specific reason in 23 trials (55%). CONCLUSIONS Publication constraints are common, and data is often owned by industry partners. This is rarely communicated to trial participants. Such constraints might contribute to problems with selective outcome reporting. Patients should be fully informed about these aspects of trial conduct.
Collapse
Affiliation(s)
- Asger S Paludan-Müller
- Center for Evidence-Based Medicine Odense and Cochrane Denmark, Department of Clinical Research, University of Southern Denmark, JB Winsløwsvej 9b, 3rd floor, 5000, Odence, Denmark.
- Open Patient data Exploratory Network (OPEN), Odense University Hospital, Odense, Denmark.
| | | | | | - Karsten J Jørgensen
- Center for Evidence-Based Medicine Odense and Cochrane Denmark, Department of Clinical Research, University of Southern Denmark, JB Winsløwsvej 9b, 3rd floor, 5000, Odence, Denmark
- Open Patient data Exploratory Network (OPEN), Odense University Hospital, Odense, Denmark
| | | |
Collapse
|
3
|
Review of the Current Evidence for Topical Treatment for Venous Leg Ulcers. J Vasc Surg Venous Lymphat Disord 2021; 10:241-247.e15. [PMID: 34171531 DOI: 10.1016/j.jvsv.2021.06.010] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2021] [Accepted: 06/06/2021] [Indexed: 01/30/2023]
Abstract
OBJECTIVE The development of a venous leg ulcer (VLU) represents the most severe clinical manifestation of a chronic venous disease. Despite major progress, there is a limited understanding of VLU pathogenesis and wound healing biology. Treatment of VLUs remains a serious challenge for physicians of different specialties. This communication focuses on describing the rationale and scientific basis for topical wound care in the management of VLUs. METHODS A literature review was performed to summarize methods with proven efficacy in VLU management. A systematic literature search was also performed to identify new evidence from the randomized controlled trials published within 2014-2021. The scientific challenges, clinical practice concerns, economic obstacles, and possible directions for further research have been discussed. RESULTS Hundreds of topical products have been advertised for the treatment of VLUs. Published data on topical treatment of venous ulcers is insufficient, scattered, weak, and has significant methodological flaws. Forty-three randomized controlled trials on topical treatment of VLUs have been published within 2014-2021. Clinical practice guidelines need to be updated. Major gaps in knowledge have been identified, and suggestions for future research directions have been provided. CONCLUSIONS The American Venous Forum Research Committee would like to bring attention to topical wound care for VLUs as a critical gap in knowledge, and encourage scientists, practitioners, and industry to collaborate to fill this gap.
Collapse
|
4
|
Lexchin J, Bero LA, Davis C, Gagnon MA. Achieving greater independence from commercial influence in research. BMJ 2021; 372:n370. [PMID: 33687982 DOI: 10.1136/bmj.n370] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Affiliation(s)
- Joel Lexchin
- School of Health Policy and Management, York University, Toronto, ON, Canada
- Department of Family and Community Medicine University of Toronto, Toronto, Canada
- University Health Network, Toronto, Canada
| | - Lisa A Bero
- Center for Bioethics and Humanities, Anschutz Medical Campus, University of Colorado, Aurora, CO, USA
| | - Courtney Davis
- Department of Global Health and Social Medicine, King's College London, London, UK
| | - Marc-Andre Gagnon
- School of Public Policy and Administration, Carleton University, Ottawa, ON, Canada
| |
Collapse
|
5
|
Lipscomb M. The replication crisis. J Adv Nurs 2020; 77:501-503. [PMID: 33289136 DOI: 10.1111/jan.14697] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2020] [Accepted: 11/18/2020] [Indexed: 11/27/2022]
Affiliation(s)
- Martin Lipscomb
- Institute of Health and Society, The University of Worcester, Worcester, UK
| |
Collapse
|
6
|
Martins CC, Riva JJ, Firmino RT, Colunga-Lozano LE, Granville-Garcia AF, Zhang Y, Schünemann HJ. Conflict of interest is not associated with positive conclusions in toothpaste trials: a systematic survey. J Clin Epidemiol 2019; 108:141-143. [DOI: 10.1016/j.jclinepi.2018.11.026] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2018] [Revised: 10/15/2018] [Accepted: 11/30/2018] [Indexed: 11/29/2022]
|
7
|
Clinical Trials and Their Principles in Urologic Oncology. Urol Oncol 2019. [DOI: 10.1007/978-3-319-42623-5_54] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
|
8
|
Mello MM, Murtagh L, Joffe S, Taylor PL, Greenberg Y, Campbell EG. Beyond financial conflicts of interest: Institutional oversight of faculty consulting agreements at schools of medicine and public health. PLoS One 2018; 13:e0203179. [PMID: 30372431 PMCID: PMC6205599 DOI: 10.1371/journal.pone.0203179] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2018] [Accepted: 10/08/2018] [Indexed: 11/18/2022] Open
Abstract
IMPORTANCE Approximately one-third of U.S. life sciences faculty engage in industry consulting. Despite reports that consulting contracts often impinge on faculty and university interests, institutional approaches to regulating consulting agreements are largely unknown. OBJECTIVE To investigate the nature of institutional oversight of faculty consulting contracts at U.S. schools of medicine and public health. DESIGN Structured telephone interviews with institutional administrators. Questions included the nature of oversight for faculty consulting agreements, if any, and views about consulting as a private versus institutional matter. Interviews were analyzed using a structured coding scheme. SETTING All accredited schools of medicine and public health in the U.S. PARTICIPANTS Administrators responsible for faculty affairs were identified via internet searches and telephone and email follow-up. The 118 administrators interviewed represented 73% of U.S. schools of medicine and public health, and 75% of those invited to participate. INTERVENTION Structured, 15-30 minute telephone interviews. MAIN OUTCOMES AND MEASURES Prevalence and type of institutional oversight; responses to concerning provisions in consulting agreements; perceptions of institutional oversight. RESULTS One third of institutions (36%) required faculty to submit at least some agreements for institutional review and 36% reviewed contracts upon request, while 35% refused to review contracts. Among institutions with review, there was wide variation the issues covered. The most common topic was intellectual property rights (64%), while only 23% looked at publication rights and 19% for inappropriately broad confidentiality provisions. Six in ten administrators reported they had no power to prevent faculty from signing consulting agreements. Although most respondents identified institutional risks from consulting relationships, many maintained that consulting agreements are "private." CONCLUSIONS AND RELEVANCE Oversight of faculty consulting agreements at U.S. schools of medicine and public health is inconsistent across institutions and usually not robust. The interests at stake suggest the need for stronger oversight.
Collapse
Affiliation(s)
- Michelle M. Mello
- Stanford Law School and the Department of Health Research and Policy, Stanford University School of Medicine, Stanford, California, United States of America
| | - Lindsey Murtagh
- Department of Health Policy and Management, Harvard T.H. Chan School of Public Health, Boston, Massachusetts, United States of America
| | - Steven Joffe
- Department of Medical Ethics and Health Policy, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania, United States of America
| | - Patrick L. Taylor
- Petrie-Flom Center for Health Law Policy, Biotechnology and Bioethics, Harvard Law School, Cambridge, Massachusetts, United States of America
| | - Yelena Greenberg
- Department of Health Policy and Management, Harvard T.H. Chan School of Public Health, Boston, Massachusetts, United States of America
| | - Eric G. Campbell
- Center for Bioethics and Humanities, University of Colorado School of Medicine, Aurora, Colorado, United States of America
| |
Collapse
|
9
|
Rasmussen K, Bero L, Redberg R, Gøtzsche PC, Lundh A. Collaboration between academics and industry in clinical trials: cross sectional study of publications and survey of lead academic authors. BMJ 2018; 363:k3654. [PMID: 30282703 PMCID: PMC6169401 DOI: 10.1136/bmj.k3654] [Citation(s) in RCA: 38] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 07/30/2018] [Indexed: 11/20/2022]
Abstract
OBJECTIVES To determine the role of academic authors, funders, and contract research organisations in industry funded trials of vaccines, drugs, and devices and to determine lead academic authors' experiences with industry funder collaborations. DESIGN Cross sectional analysis of trial publications and survey of lead academic authors. ELIGIBILITY CRITERIA FOR SELECTING STUDIES The most recent 200 phase III and IV trials of vaccines, drugs, and devices with full industry funding, at least one academic author, published in one of the top seven high impact general medical journals (New England Journal of Medicine, Lancet, JAMA, BMJ, Annals of Internal Medicine, JAMA Internal Medicine, and PLoS Medicine). RESULTS Employees of industry funders co-authored 173 (87%) of publications; 183 (92%) trials reported involvement of funders in design, and 167 (84%) reported involvement of academic authors. Data analysis involved the funder in 146 (73%) trials and the academic authors in 79 (40%). Trial reporting involved the funder in 173 (87%) trials and academic authors in 197 (99%). Contract research organisations were involved in the reporting of 123 (62%) trials.Eighty (40%) of 200 lead academic authors responded to the survey. Twenty nine (33%) of the 80 responders reported that academics had final say on the design. Ten responders described involvement of an unnamed funder and/or contract research organisation employee in the data analysis and/or reporting. Most academic authors found the collaboration with industry funder beneficial, but 3 (4%) experienced delay in publication due to the industry funder and 9 (11%) reported disagreements with the industry funder, mostly concerning trial design and reporting. CONCLUSIONS Industry employees and academic authors are involved in the design, conduct, and reporting of most industry funded trials in high impact journals. However, data analysis is often conducted without academic involvement. Academics view the collaboration as beneficial, but some report loss of academic freedom.
Collapse
Affiliation(s)
| | - Lisa Bero
- Charles Perkins Centre and Faculty of Pharmacy, University of Sydney, Sydney, NSW, Australia
| | - Rita Redberg
- UCSF Division of Cardiology, San Francisco, CA, USA
| | | | - Andreas Lundh
- Centre for Evidence-Based Medicine Odense (CEBMO) and Odense Patient data Exploratory Network (OPEN), Odense University Hospital, Odense, Denmark
| |
Collapse
|
10
|
Chan AW, Hróbjartsson A. Promoting public access to clinical trial protocols: challenges and recommendations. Trials 2018; 19:116. [PMID: 29454390 PMCID: PMC5816550 DOI: 10.1186/s13063-018-2510-1] [Citation(s) in RCA: 32] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2017] [Accepted: 01/29/2018] [Indexed: 12/17/2022] Open
Abstract
BACKGROUND Recognizing the value of promoting public access to clinical trial protocols, Trials pioneered the way for their publication over a decade ago. However, despite major advances in the public accessibility of information about trial methods and results, protocol sharing remains relatively rare. MAIN BODY Protocol sharing facilitates the critical appraisal of clinical trials and helps to identify and deter the selective reporting of outcomes and analyses. Challenges to the routine availability of high quality trial protocols include the gaps in incentives and adherence mechanisms, limited venues for sharing the original and final protocol versions, and the need for mechanisms to ensure transparent and complete protocol content. CONCLUSIONS We propose recommendations for addressing key challenges to protocol sharing in order to promote routine public access to protocols for the benefit of patients and other users of evidence from clinical trials.
Collapse
Affiliation(s)
- An-Wen Chan
- Women’s College Research Institute, Women’s College Hospital, 76 Grenville St, Rm 6416, Toronto, ON M5S 1B2 Canada
- Department of Medicine, University of Toronto, Toronto, ON Canada
| | - Asbjørn Hróbjartsson
- Center for Evidence-Based Medicine, Odense University Hospital, Odense, Denmark
- Department of Clinical Research, University of Southern Denmark, Odense, Denmark
| |
Collapse
|
11
|
Karabatsos G. A Bayesian nonparametric test of significance chasing biases. Res Synth Methods 2017; 9:51-61. [PMID: 28985020 DOI: 10.1002/jrsm.1269] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2017] [Revised: 08/21/2017] [Accepted: 09/18/2017] [Indexed: 11/07/2022]
Abstract
There is a growing concern that much of the published research literature is distorted by the pursuit of statistically significant results. In a seminal article, Ioannidis and Trikalinos (2007, Clinical Trials) proposed an omnibus (I&T) test for significance chasing (SC) biases. This test compares the observed number of studies that report statistically significant results, against their expected number based on study power, assuming a common effect size across studies. The current article extends this approach by developing a Bayesian nonparametric (BNP) meta-regression model and test of SC bias, which can diagnose bias at the individual study level. This new BNP test is based on a flexible model of the predictive distribution of study power, conditionally on study-level covariates which account for study diversity, including diversity due to heterogeneous effect sizes across studies. A test of SC bias proceeds by comparing each study's significant outcome report indicator against its estimated posterior predictive distribution of study power, conditionally on the study's covariates. The BNP model and SC bias test are illustrated through the analyses of 3 meta-analytic data sets and through a simulation study. Software code for the BNP model and test, and the data sets, are provided as Supporting Information.
Collapse
Affiliation(s)
- George Karabatsos
- Departments of Educational Psychology, and Mathematics, Statistics, and by courtesy, Computer Science, University of Illinois at Chicago, Chicago, IL 60607, USA
| |
Collapse
|
12
|
Hakoum MB, Jouni N, Abou-Jaoude EA, Hasbani DJ, Abou-Jaoude EA, Lopes LC, Khaldieh M, Hammoud MZ, Al-Gibbawi M, Anouti S, Guyatt G, Akl EA. Characteristics of funding of clinical trials: cross-sectional survey and proposed guidance. BMJ Open 2017; 7:e015997. [PMID: 28982811 PMCID: PMC5639984 DOI: 10.1136/bmjopen-2017-015997] [Citation(s) in RCA: 36] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/31/2023] Open
Abstract
OBJECTIVES To provide a detailed and current characterisation of funding of a representative sample clinical trials. We also aimed to develop guidance for standardised reporting of funding information. METHODS We addressed the extent to which clinical trials published in 2015 in any of the 119 Core Clinical Journals included a statement on the funding source (eg, whether a not-for-profit organisation was supported by a private-for-profit organisation), type of funding, amount and role of funder. We used a stepwise approach to develop a guidance and an instrument for standardised reporting of funding information. RESULTS Of 200 trials, 178 (89%) included a funding statement, of which 171 (96%) reported being funded. Funding statements in the 171 funded trials indicated the source in 100%, amount in 1% and roles of funders in 50%. The most frequent sources were governmental (58%) and private-for-profit (40%). Of 54 funding statements in which the source was a not-for-profit organisation, we found evidence of undisclosed support of those from private-for-profit organisation(s) in 26 (48%). The most frequently reported roles of funders in the 171 funded trials related to study design (42%) and data analysis, interpretation or management (41%). Of 139 randomised controlled trials (RCTs) addressing pharmacological or surgical interventions, 29 (21%) reported information on the supplier of the medication or device. The proposed guidance addresses both the funding information that RCTs should report and the reporting process. Attached to the guidance is a fillable PDF document for use as an instrument for standardised reporting of funding information. CONCLUSION Although the majority of RCTs report funding, there is considerable variability in the reporting of funding source, amount and roles of funders. A standardised approach to reporting of funding information would address these limitations. Future research should explore the implications of funding by not-for-profit organisations that are supported by for-profit organisations.
Collapse
Affiliation(s)
- Maram B Hakoum
- Clinical Research Institute, American University of Beirut Medical Center, Beirut, Lebanon
| | - Nahla Jouni
- Faculty of Agriculture and Food Sciences, American University of Beirut, Beirut, Lebanon
| | - Eliane A Abou-Jaoude
- Department of Internal Medicine, University at Buffalo - The State University of New York, Buffalo, New York, USA
| | | | | | - Luciane Cruz Lopes
- Graduate Program in Pharmaceutical Sciences, University of Sorocaba, Brazil, Sorocaba, São Paulo, Brazil
| | - Mariam Khaldieh
- Faculty of Sciences, American University of Beirut, Beirut, Lebanon
| | - Mira Zein Hammoud
- Department of Psychiatry, Massachusetts General Hospital, Boston, Massachusetts, USA
| | | | - Sirine Anouti
- Department of Epidemiology and Population Health, American University of Beirut, Beirut, Lebanon
| | - Gordon Guyatt
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
| | - Elie A Akl
- Clinical Research Institute, American University of Beirut Medical Center, Beirut, Lebanon
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
- Department of Internal Medicine, American University of Beirut Medical Center, Beirut, Lebanon
| |
Collapse
|
13
|
|
14
|
Jasny BR, Wigginton N, McNutt M, Bubela T, Buck S, Cook-Deegan R, Gardner T, Hanson B, Hustad C, Kiermer V, Lazer D, Lupia A, Manrai A, McConnell L, Noonan K, Phimister E, Simon B, Strandburg K, Summers Z, Watts D. Fostering reproducibility in industry-academia research. Science 2017; 357:759-761. [PMID: 28839064 DOI: 10.1126/science.aan4906] [Citation(s) in RCA: 25] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
Affiliation(s)
| | - N Wigginton
- University of Michigan, Ann Arbor, MI 48109, USA
| | - M McNutt
- National Academy of Sciences, Washington, DC 20001, USA.
| | - T Bubela
- Faculty of Health Sciences, Simon Fraser University, British Columbia, BC V5A 1S6, Canada
| | - S Buck
- Laura and John Arnold Foundation, Houston, TX 77056, USA
| | - R Cook-Deegan
- Consortium for Science Policy and Outcomes at Arizona State University, Washington, DC 20009, USA
| | - T Gardner
- Riffyn, Inc., Oakland, CA 94612, USA
| | - B Hanson
- American Geophysical Union, Washington, DC 20009, USA
| | - C Hustad
- Merck & Co., Inc., Kenilworth, NJ 07033, USA
| | - V Kiermer
- Public Library of Science (PLOS), San Francisco, CA 94111, USA
| | - D Lazer
- Northeastern University, Boston, MA 02115, USA
| | - A Lupia
- University of Michigan, Ann Arbor, MI 48109, USA
| | - A Manrai
- Harvard Medical School, Boston, MA 02115, USA
| | - L McConnell
- Bayer U.S., Research Triangle Park, NC 27709, USA
| | - K Noonan
- McDonnell Boehnen Hulbert & Berghoff LLP, Chicago, IL 60606, USA
| | - E Phimister
- The New England Journal of Medicine, Boston, MA 02115, USA
| | - B Simon
- Thomas Jefferson School of Law, San Diego, CA 92101, USA
| | - K Strandburg
- New York University School of Law, New York, NY 10012, USA
| | - Z Summers
- ExxonMobil Research and Engineering Company, Annandale, NJ 08801, USA
| | - D Watts
- Microsoft Research, New York, NY 10003, USA
| |
Collapse
|
15
|
Brookman-May SD, Mir MC, May M, Klatte T. Clinical Trials and Their Principles in Urologic Oncology. Urol Oncol 2017. [DOI: 10.1007/978-3-319-42603-7_54-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
16
|
Nissen SB, Magidson T, Gross K, Bergstrom CT. Publication bias and the canonization of false facts. eLife 2016; 5. [PMID: 27995896 PMCID: PMC5173326 DOI: 10.7554/elife.21451] [Citation(s) in RCA: 98] [Impact Index Per Article: 12.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2016] [Accepted: 11/28/2016] [Indexed: 12/28/2022] Open
Abstract
Science is facing a “replication crisis” in which many experimental findings cannot be replicated and are likely to be false. Does this imply that many scientific facts are false as well? To find out, we explore the process by which a claim becomes fact. We model the community’s confidence in a claim as a Markov process with successive published results shifting the degree of belief. Publication bias in favor of positive findings influences the distribution of published results. We find that unless a sufficient fraction of negative results are published, false claims frequently can become canonized as fact. Data-dredging, p-hacking, and similar behaviors exacerbate the problem. Should negative results become easier to publish as a claim approaches acceptance as a fact, however, true and false claims would be more readily distinguished. To the degree that the model reflects the real world, there may be serious concerns about the validity of purported facts in some disciplines. DOI:http://dx.doi.org/10.7554/eLife.21451.001
Collapse
Affiliation(s)
| | - Tali Magidson
- Department of Computer Science, University of Washington, Seattle, United States
| | - Kevin Gross
- Department of Statistics, North Carolina State University, Raleigh, United States
| | - Carl T Bergstrom
- Department of Biology, University of Washington, Seattle, United States
| |
Collapse
|
17
|
Kasenda B, von Elm E, You JJ, Blümle A, Tomonaga Y, Saccilotto R, Amstutz A, Bengough T, Meerpohl JJ, Stegert M, Olu KK, Tikkinen KAO, Neumann I, Carrasco-Labra A, Faulhaber M, Mulla SM, Mertz D, Akl EA, Bassler D, Busse JW, Ferreira-González I, Lamontagne F, Nordmann A, Gloy V, Raatz H, Moja L, Ebrahim S, Schandelmaier S, Sun X, Vandvik PO, Johnston BC, Walter MA, Burnand B, Schwenkglenks M, Hemkens LG, Bucher HC, Guyatt GH, Briel M. Agreements between Industry and Academia on Publication Rights: A Retrospective Study of Protocols and Publications of Randomized Clinical Trials. PLoS Med 2016; 13:e1002046. [PMID: 27352244 PMCID: PMC4924795 DOI: 10.1371/journal.pmed.1002046] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/13/2015] [Accepted: 05/06/2016] [Indexed: 02/05/2023] Open
Abstract
BACKGROUND Little is known about publication agreements between industry and academic investigators in trial protocols and the consistency of these agreements with corresponding statements in publications. We aimed to investigate (i) the existence and types of publication agreements in trial protocols, (ii) the completeness and consistency of the reporting of these agreements in subsequent publications, and (iii) the frequency of co-authorship by industry employees. METHODS AND FINDINGS We used a retrospective cohort of randomized clinical trials (RCTs) based on archived protocols approved by six research ethics committees between 13 January 2000 and 25 November 2003. Only RCTs with industry involvement were eligible. We investigated the documentation of publication agreements in RCT protocols and statements in corresponding journal publications. Of 647 eligible RCT protocols, 456 (70.5%) mentioned an agreement regarding publication of results. Of these 456, 393 (86.2%) documented an industry partner's right to disapprove or at least review proposed manuscripts; 39 (8.6%) agreements were without constraints of publication. The remaining 24 (5.3%) protocols referred to separate agreement documents not accessible to us. Of those 432 protocols with an accessible publication agreement, 268 (62.0%) trials were published. Most agreements documented in the protocol were not reported in the subsequent publication (197/268 [73.5%]). Of 71 agreements reported in publications, 52 (73.2%) were concordant with those documented in the protocol. In 14 of 37 (37.8%) publications in which statements suggested unrestricted publication rights, at least one co-author was an industry employee. In 25 protocol-publication pairs, author statements in publications suggested no constraints, but 18 corresponding protocols documented restricting agreements. CONCLUSIONS Publication agreements constraining academic authors' independence are common. Journal articles seldom report on publication agreements, and, if they do, statements can be discrepant with the trial protocol.
Collapse
Affiliation(s)
- Benjamin Kasenda
- Basel Institute for Clinical Epidemiology and Biostatistics, University Hospital of Basel, Basel, Switzerland
| | - Erik von Elm
- Cochrane Switzerland, Institute of Social and Preventive Medicine (IUMSP), Lausanne University Hospital, Lausanne, Switzerland
| | - John J. You
- Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Ontario, Canada
- Department of Medicine, McMaster University, Hamilton, Ontario, Canada
| | - Anette Blümle
- Cochrane Germany, University of Freiburg, Freiburg, Germany
| | - Yuki Tomonaga
- Epidemiology, Biostatistics and Prevention Institute (EBPI), University of Zurich, Zurich, Switzerland
| | - Ramon Saccilotto
- Basel Institute for Clinical Epidemiology and Biostatistics, University Hospital of Basel, Basel, Switzerland
| | - Alain Amstutz
- Basel Institute for Clinical Epidemiology and Biostatistics, University Hospital of Basel, Basel, Switzerland
| | - Theresa Bengough
- Cochrane Switzerland, Institute of Social and Preventive Medicine (IUMSP), Lausanne University Hospital, Lausanne, Switzerland
- Austrian Federal Institute for Health Care, Department of Health and Society, Vienna, Austria
| | | | - Mihaela Stegert
- Basel Institute for Clinical Epidemiology and Biostatistics, University Hospital of Basel, Basel, Switzerland
| | - Kelechi K. Olu
- Basel Institute for Clinical Epidemiology and Biostatistics, University Hospital of Basel, Basel, Switzerland
| | - Kari A. O. Tikkinen
- Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Ontario, Canada
- Departments of Urology and Public Health, Helsinki University Hospital and University of Helsinki, Helsinki, Finland
| | - Ignacio Neumann
- Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Ontario, Canada
- Department of Internal Medicine, Pontificia Universidad Católica de Chile, Santiago, Chile
| | - Alonso Carrasco-Labra
- Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Ontario, Canada
- Evidence-Based Dentistry Unit, Faculty of Dentistry, Universidad de Chile, Santiago, Chile
| | - Markus Faulhaber
- Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Ontario, Canada
| | - Sohail M. Mulla
- Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Ontario, Canada
| | - Dominik Mertz
- Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Ontario, Canada
- Department of Medicine, McMaster University, Hamilton, Ontario, Canada
- Michael G. DeGroote Institute for Infectious Disease Research, McMaster University, Hamilton, Ontario, Canada
| | - Elie A. Akl
- Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Ontario, Canada
- Department of Internal Medicine, American University of Beirut, Beirut, Lebanon
- Department of Medicine, State University of New York at Buffalo, Buffalo, New York, United States of America
| | - Dirk Bassler
- Department of Neonatology, University Hospital of Zurich, Zurich, Switzerland
| | - Jason W. Busse
- Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Ontario, Canada
- Michael G. DeGroote Institute for Pain Research and Care, McMaster University, Hamilton, Ontario, Canada
- Department of Anesthesia, McMaster University, Hamilton, Ontario, Canada
| | - Ignacio Ferreira-González
- Epidemiology Unit, Department of Cardiology, Vall d’Hebron Hospital and Centro de Investigación Biomédica en Red de Epidemiología y Salud Publica (CIBERESP), Barcelona, Spain
| | - Francois Lamontagne
- Centre de Recherche Clinique Étienne-Le Bel and Department of Medicine, Université de Sherbrooke, Sherbrooke, Quebec, Canada
| | - Alain Nordmann
- Basel Institute for Clinical Epidemiology and Biostatistics, University Hospital of Basel, Basel, Switzerland
| | - Viktoria Gloy
- Basel Institute for Clinical Epidemiology and Biostatistics, University Hospital of Basel, Basel, Switzerland
- Institute of Nuclear Medicine, University Hospital of Bern, Bern, Switzerland
| | - Heike Raatz
- Basel Institute for Clinical Epidemiology and Biostatistics, University Hospital of Basel, Basel, Switzerland
| | - Lorenzo Moja
- IRCCS Orthopedic Institute Galeazzi, Milan, Italy
| | - Shanil Ebrahim
- Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Ontario, Canada
- Michael G. DeGroote Institute for Pain Research and Care, McMaster University, Hamilton, Ontario, Canada
- Department of Anesthesia, McMaster University, Hamilton, Ontario, Canada
- Stanford Prevention Research Center, Stanford University, Stanford, California, United States of America
| | - Stefan Schandelmaier
- Basel Institute for Clinical Epidemiology and Biostatistics, University Hospital of Basel, Basel, Switzerland
- Academy of Swiss Insurance Medicine, University Hospital of Basel, Basel, Switzerland
| | - Xin Sun
- Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Ontario, Canada
- Chinese Evidence-Based Medicine Center, West China Hospital, Sichuan University, Chengdu, China
| | - Per O. Vandvik
- Department of Medicine, Innlandet Hospital Trust–Division Gjøvik, Oppland, Norway
| | - Bradley C. Johnston
- Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Ontario, Canada
- Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Ontario, Canada
- Department of Anesthesia and Pain Medicine, Hospital for Sick Children, Toronto, Ontario, Canada
| | - Martin A. Walter
- Institute of Nuclear Medicine, University Hospital of Bern, Bern, Switzerland
| | - Bernard Burnand
- Cochrane Switzerland, Institute of Social and Preventive Medicine (IUMSP), Lausanne University Hospital, Lausanne, Switzerland
| | - Matthias Schwenkglenks
- Epidemiology, Biostatistics and Prevention Institute (EBPI), University of Zurich, Zurich, Switzerland
| | - Lars G. Hemkens
- Basel Institute for Clinical Epidemiology and Biostatistics, University Hospital of Basel, Basel, Switzerland
| | - Heiner C. Bucher
- Basel Institute for Clinical Epidemiology and Biostatistics, University Hospital of Basel, Basel, Switzerland
| | - Gordon H. Guyatt
- Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Ontario, Canada
- Department of Medicine, McMaster University, Hamilton, Ontario, Canada
| | - Matthias Briel
- Basel Institute for Clinical Epidemiology and Biostatistics, University Hospital of Basel, Basel, Switzerland
- Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Ontario, Canada
| |
Collapse
|