1
|
Norris E, He Y, Loh R, West R, Michie S. Assessing Markers of Reproducibility and Transparency in Smoking Behaviour Change Intervention Evaluations. J Smok Cessat 2021; 2021:6694386. [PMID: 34306236 PMCID: PMC8279208 DOI: 10.1155/2021/6694386] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2020] [Accepted: 11/27/2020] [Indexed: 12/16/2022] Open
Abstract
INTRODUCTION Activities promoting research reproducibility and transparency are crucial for generating trustworthy evidence. Evaluation of smoking interventions is one area where vested interests may motivate reduced reproducibility and transparency. AIMS Assess markers of transparency and reproducibility in smoking behaviour change intervention evaluation reports. METHODS One hundred evaluation reports of smoking behaviour change intervention randomised controlled trials published in 2018-2019 were identified. Reproducibility markers of pre-registration; protocol sharing; data, material, and analysis script sharing; replication of a previous study; and open access publication were coded in identified reports. Transparency markers of funding and conflict of interest declarations were also coded. Coding was performed by two researchers, with inter-rater reliability calculated using Krippendorff's alpha. RESULTS Seventy-one percent of reports were open access, and 73% were pre-registered. However, there are only 13% provided accessible materials, 7% accessible data, and 1% accessible analysis scripts. No reports were replication studies. Ninety-four percent of reports provided a funding source statement, and eighty-eight percent of reports provided a conflict of interest statement. CONCLUSIONS Open data, materials, analysis, and replications are rare in smoking behaviour change interventions, whereas funding source and conflict of interest declarations are common. Future smoking research should be more reproducible to enable knowledge accumulation. This study was pre-registered: https://osf.io/yqj5p.
Collapse
Affiliation(s)
- Emma Norris
- Health Behaviour Change Research Group, Department of Health Sciences, Brunel University, UK
- Centre for Behaviour Change, University College London, UK
| | - Yiwei He
- Psychology & Language Sciences, University College London, UK
| | - Rachel Loh
- Psychology & Language Sciences, University College London, UK
| | - Robert West
- Research Department of Epidemiology & Public Health, University College London, UK
| | - Susan Michie
- Centre for Behaviour Change, University College London, UK
| |
Collapse
|
2
|
Velicer C, St Helen G, Glantz SA. Tobacco papers and tobacco industry ties in regulatory toxicology and pharmacology. J Public Health Policy 2018; 39:34-48. [PMID: 29116189 PMCID: PMC5775030 DOI: 10.1057/s41271-017-0096-6] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2017] [Indexed: 11/21/2022]
Abstract
We examined the relationship between the tobacco industry and the journal Regulatory Toxicology and Pharmacology (RTP) using the Truth Tobacco Industry Documents Library and internet sources. We determined the funding relationships, and categorised the conclusions of all 52 RTP papers on tobacco or nicotine between January 2013 and June 2015, as "positive", "negative" or "neutral" for the tobacco industry. RTP's editor, 57% (4/7) of associate editors and 37% (14/38) of editorial board members had worked or consulted for tobacco companies. Almost all (96%, 50/52) of the papers had authors with tobacco industry ties. Seventy-six percent (38/50) of these papers drew conclusions positive for industry; none drew negative conclusions. The two papers by authors not related to the tobacco industry reached conclusions negative to the industry (p < .001). These results call into question the confidence that members of the scientific community and tobacco product regulators worldwide can have in the conclusions of papers published in RTP.
Collapse
Affiliation(s)
- Clayton Velicer
- Center for Tobacco Control Research and Education, University of California San Francisco, 530 Parnassus, Suite 366, San Francisco, CA, 94143-1390, USA
| | - Gideon St Helen
- Center for Tobacco Control Research and Education, University of California San Francisco, 530 Parnassus, Suite 366, San Francisco, CA, 94143-1390, USA
- Cardiovascular Research Institute, University of California San Francisco, San Francisco, CA, USA
- Helen Diller Family Comprehensive Cancer Center, University of California San Francisco, San Francisco, CA, USA
- Department of Medicine, University of California San Francisco, San Francisco, CA, USA
| | - Stanton A Glantz
- Center for Tobacco Control Research and Education, University of California San Francisco, 530 Parnassus, Suite 366, San Francisco, CA, 94143-1390, USA.
- Cardiovascular Research Institute, University of California San Francisco, San Francisco, CA, USA.
- Helen Diller Family Comprehensive Cancer Center, University of California San Francisco, San Francisco, CA, USA.
- Department of Medicine, University of California San Francisco, San Francisco, CA, USA.
| |
Collapse
|
3
|
Hemmerich N, Klein EG, Berman M. Evidentiary Support in Public Comments to the FDA's Center for Tobacco Products. JOURNAL OF HEALTH POLITICS, POLICY AND LAW 2017; 42:645-666. [PMID: 28483810 PMCID: PMC5522345 DOI: 10.1215/03616878-3856121] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
Electronic Nicotine Delivery Systems (ENDS) were introduced into the US market in 2007, and until recently these devices were unregulated at the federal level. In 2014, the US Food and Drug Administration (FDA) published a Notice of Proposed Rulemaking asserting its intention to regulate ENDS and requesting public comments on numerous related issues, including potential limits on the sale of flavored ENDS. This article analyzes key comments submitted to the FDA on the issue of flavor regulation in ENDS and examines the weight and credibility of the evidence presented by both supporters and opponents of regulation. It also describes the final deeming rule, published in May 2016, and the FDA's response to the evidence submitted. This is the first study to examine public comments submitted to the FDA's Center for Tobacco Products, and it concludes that opponents of regulation were more likely to rely on sources that were not peer reviewed and that were affected by conflicts of interest. In light of these findings, the FDA and the research community should develop processes to carefully and critically analyze public comments submitted to the FDA on issues of tobacco regulation.
Collapse
|
4
|
Wells EM. Evidence Regarding the Impact of Conflicts of Interest on Environmental and Occupational Health Research. Curr Environ Health Rep 2017; 4:109-118. [PMID: 28397095 DOI: 10.1007/s40572-017-0139-y] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
PURPOSE OF REVIEW This review describes published literature providing evidence for financial conflicts of interest in environmental and occupational health research. Secondary goals were to describe evidence that (a) utilized quantitative methods to evaluate the association of conflicts with study outcomes, and (b) assessed undisclosed as well as disclosed conflicts of interest. RECENT FINDINGS Forty-three studies were identified which contained descriptions of the impact of financial conflicts of interest on research results; 11 of these conducted quantitative analyses to demonstrate these relationships. All 11 articles which quantified associations identified significant associations of the presence of financial conflicts of interest with study findings. In studies which measured undisclosed conflicts, these comprised a substantial proportion of all conflicts. Suggestions for improving understanding and interpretation of research results are presented.
Collapse
Affiliation(s)
- Ellen M Wells
- School of Health Sciences, Purdue University, 550 Stadium Mall Drive, West Lafayette, IN, 47907, USA.
| |
Collapse
|
5
|
Hatchard JL, Fooks GJ, Evans-Reeves KA, Ulucanlar S, Gilmore AB. A critical evaluation of the volume, relevance and quality of evidence submitted by the tobacco industry to oppose standardised packaging of tobacco products. BMJ Open 2014; 4:e003757. [PMID: 24523419 PMCID: PMC3927933 DOI: 10.1136/bmjopen-2013-003757] [Citation(s) in RCA: 37] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/03/2022] Open
Abstract
OBJECTIVES To examine the volume, relevance and quality of transnational tobacco corporations' (TTCs) evidence that standardised packaging of tobacco products 'won't work', following the UK government's decision to 'wait and see' until further evidence is available. DESIGN Content analysis. SETTING We analysed the evidence cited in submissions by the UK's four largest TTCs to the UK Department of Health consultation on standardised packaging in 2012. OUTCOME MEASURES The volume, relevance (subject matter) and quality (as measured by independence from industry and peer-review) of evidence cited by TTCs was compared with evidence from a systematic review of standardised packaging . Fisher's exact test was used to assess differences in the quality of TTC and systematic review evidence. 100% of the data were second-coded to validate the findings: 94.7% intercoder reliability; all differences were resolved. RESULTS 77/143 pieces of TTC-cited evidence were used to promote their claim that standardised packaging 'won't work'. Of these, just 17/77 addressed standardised packaging: 14 were industry connected and none were published in peer-reviewed journals. Comparison of TTC and systematic review evidence on standardised packaging showed that the industry evidence was of significantly lower quality in terms of tobacco industry connections and peer-review (p<0.0001). The most relevant TTC evidence (on standardised packaging or packaging generally, n=26) was of significantly lower quality (p<0.0001) than the least relevant (on other topics, n=51). Across the dataset, TTC-connected evidence was significantly less likely to be published in a peer-reviewed journal (p=0.0045). CONCLUSIONS With few exceptions, evidence cited by TTCs to promote their claim that standardised packaging 'won't work' lacks either policy relevance or key indicators of quality. Policymakers could use these three criteria-subject matter, independence and peer-review status-to critically assess evidence submitted to them by corporate interests via Better Regulation processes.
Collapse
Affiliation(s)
- Jenny L Hatchard
- Tobacco Control Research Group, University of Bath, and UK Centre for Tobacco and Alcohol Studies, Bath, UK
| | | | | | | | | |
Collapse
|
6
|
Wertz MS, Kyriss T, Paranjape S, Glantz SA. The toxic effects of cigarette additives. Philip Morris' project mix reconsidered: an analysis of documents released through litigation. PLoS Med 2011; 8:e1001145. [PMID: 22205885 PMCID: PMC3243707 DOI: 10.1371/journal.pmed.1001145] [Citation(s) in RCA: 31] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/28/2010] [Accepted: 11/07/2011] [Indexed: 11/22/2022] Open
Abstract
BACKGROUND In 2009, the promulgation of US Food and Drug Administration (FDA) tobacco regulation focused attention on cigarette flavor additives. The tobacco industry had prepared for this eventuality by initiating a research program focusing on additive toxicity. The objective of this study was to analyze Philip Morris' Project MIX as a case study of tobacco industry scientific research being positioned strategically to prevent anticipated tobacco control regulations. METHODS AND FINDINGS We analyzed previously secret tobacco industry documents to identify internal strategies for research on cigarette additives and reanalyzed tobacco industry peer-reviewed published results of this research. We focused on the key group of studies conducted by Phillip Morris in a coordinated effort known as "Project MIX." Documents showed that Project MIX subsumed the study of various combinations of 333 cigarette additives. In addition to multiple internal reports, this work also led to four peer-reviewed publications (published in 2001). These papers concluded that there was no evidence of substantial toxicity attributable to the cigarette additives studied. Internal documents revealed post hoc changes in analytical protocols after initial statistical findings indicated an additive-associated increase in cigarette toxicity as well as increased total particulate matter (TPM) concentrations in additive-modified cigarette smoke. By expressing the data adjusted by TPM concentration, the published papers obscured this underlying toxicity and particulate increase. The animal toxicology results were based on a small number of rats in each experiment, raising the possibility that the failure to detect statistically significant changes in the end points was due to underpowering the experiments rather than lack of a real effect. CONCLUSION The case study of Project MIX shows tobacco industry scientific research on the use of cigarette additives cannot be taken at face value. The results demonstrate that toxins in cigarette smoke increase substantially when additives are put in cigarettes, including the level of TPM. In particular, regulatory authorities, including the FDA and similar agencies elsewhere, could use the Project MIX data to eliminate the use of these 333 additives (including menthol) from cigarettes.
Collapse
Affiliation(s)
- Marcia S. Wertz
- Center for Tobacco Control Research and Education, University of California San Francisco, San Francisco, California, United States of America
- Department of Social and Behavioral Sciences, School of Nursing, University of California San Francisco San Francisco, California, United States of America
| | - Thomas Kyriss
- Thoracic Surgery, Schillerhoehe Hospital, Gerlingen, Germany
| | - Suman Paranjape
- Center for Tobacco Control Research and Education, University of California San Francisco, San Francisco, California, United States of America
| | - Stanton A. Glantz
- Center for Tobacco Control Research and Education, University of California San Francisco, San Francisco, California, United States of America
- Department of Medicine, University of California San Francisco, San Francisco, California, United States of America
| |
Collapse
|
7
|
Muggli ME, Lee K, Gan Q, Ebbert JO, Hurt RD. "Efforts to Reprioritise the Agenda" in China: British American Tobacco's Efforts to Influence Public Policy on Secondhand Smoke in China. PLoS Med 2008; 5:1729-69. [PMID: 19108603 PMCID: PMC2605899 DOI: 10.1371/journal.pmed.0050251] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/26/2008] [Accepted: 11/10/2008] [Indexed: 11/19/2022] Open
Abstract
BACKGROUND Each year, 540 million Chinese are exposed to secondhand smoke (SHS), resulting in more than 100,000 deaths. Smoke-free policies have been demonstrated to decrease overall cigarette consumption, encourage smokers to quit, and protect the health of nonsmokers. However, restrictions on smoking in China remain limited and ineffective. Internal tobacco industry documents show that transnational tobacco companies (TTCs) have pursued a multifaceted strategy for undermining the adoption of restrictions on smoking in many countries. METHODS AND FINDINGS To understand company activities in China related to SHS, we analyzed British American Tobacco's (BAT's) internal corporate documents produced in response to litigation against the major cigarette manufacturers to understand company activities in China related to SHS. BAT has carried out an extensive strategy to undermine the health policy agenda on SHS in China by attempting to divert public attention from SHS issues towards liver disease prevention, pushing the so-called "resocialisation of smoking" accommodation principles, and providing "training" for industry, public officials, and the media based on BAT's corporate agenda that SHS is an insignificant contributor to the larger issue of air pollution. CONCLUSIONS The public health community in China should be aware of the tactics previously used by TTCs, including efforts by the tobacco industry to co-opt prominent Chinese benevolent organizations, when seeking to enact stronger restrictions on smoking in public places.
Collapse
|
8
|
MacKenzie R, Collin J. "A good personal scientific relationship": Philip Morris scientists and the Chulabhorn Research Institute, Bangkok. PLoS Med 2008; 5:1737-48. [PMID: 19108600 PMCID: PMC2605886 DOI: 10.1371/journal.pmed.0050238] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/26/2008] [Accepted: 10/27/2008] [Indexed: 11/18/2022] Open
Abstract
BACKGROUND This paper examines the efforts of consultants affiliated with Philip Morris (PM), the world's leading transnational tobacco corporation, to influence scientific research and training in Thailand via the Chulabhorn Research Institute (CRI). A leading Southeast Asian institute for environmental health science, the CRI is headed by Professor Dr. Her Royal Highness Princess Chulabhorn, the daughter of the King of Thailand, and it has assumed international significance via its designation as a World Health Organization (WHO) Collaborating Centre in December 2005. METHODS AND FINDINGS This paper analyses previously confidential tobacco industry documents that were made publicly available following litigation in the United States. PM documents reveal that ostensibly independent overseas scientists, now identified as industry consultants, were able to gain access to the Thai scientific community. Most significantly, PM scientist Roger Walk has established close connections with the CRI. Documents indicate that Walk was able to use such links to influence the study and teaching of environmental toxicology in the institute and to develop relations with key officials and local scientists so as to advance the interests of PM within Thailand and across Asia. While sensitivities surrounding royal patronage of the CRI make public criticism extremely difficult, indications of ongoing involvement by tobacco industry consultants suggest the need for detailed scrutiny of such relationships. CONCLUSIONS The establishment of close links with the CRI advances industry strategies to influence scientific research and debate around tobacco and health, particularly regarding secondhand smoke, to link with academic institutions, and to build relationships with national elites. Such strategies assume particular significance in the national and regional contexts presented here amid the globalisation of the tobacco pandemic. From an international perspective, particular concern is raised by the CRI's recently awarded status as a WHO Collaborating Centre. Since the network of WHO Collaborating Centres rests on the principle of "using national institutions for international purposes," the documents presented below suggest that more rigorous safeguards are required to ensure that such use advances public health goals rather than the objectives of transnational corporations.
Collapse
Affiliation(s)
- Ross MacKenzie
- School of Public Health, University of Sydney, Sydney, New South Wales, Australia
| | - Jeff Collin
- Centre for International Public Health Policy, University of Edinburgh, Edinburgh, Scotland
| |
Collapse
|
9
|
Baethge C. Transparent texts: authors of scientific articles often have conflicts of interest. It is important for these to be communicated transparently to the readers. DEUTSCHES ARZTEBLATT INTERNATIONAL 2008; 105:675-9. [PMID: 19623285 PMCID: PMC2696960 DOI: 10.3238/arztebl.2008.0675] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
10
|
Butler C, Castleden W, Ruff T, Westberg G, Corra L. A call for publishers to declare their conflicts of interest. Med Chir Trans 2007; 100:355. [PMID: 17682023 PMCID: PMC1939945 DOI: 10.1177/014107680710000805] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
|
11
|
Hardell L, Hansson Mild K. Mobile phone use and risk of acoustic neuroma: results of the interphone case-control study in five North European countries. Br J Cancer 2006; 94:1348-9; author reply 1352-3. [PMID: 16570040 PMCID: PMC2361400 DOI: 10.1038/sj.bjc.6603070] [Citation(s) in RCA: 12] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022] Open
Affiliation(s)
- L Hardell
- Department of Oncology, University Hospital, Örebro, SE-701 85 Sweden
- Department of Natural Sciences, Örebro University, Örebro, SE-701 82 Sweden
- Department of Oncology, University Hospital, Örebro, SE-701 85 Sweden. E-mail:
| | - K Hansson Mild
- Department of Natural Sciences, Örebro University, Örebro, SE-701 82 Sweden
- National Institute for Working Life, Umeå, SE-907 13 Sweden
| |
Collapse
|
12
|
Tong S, Olsen J. The threat to scientific integrity in environmental and occupational medicine. Occup Environ Med 2006; 62:843-6. [PMID: 16299092 PMCID: PMC1740935 DOI: 10.1136/oem.2005.021410] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Over the last century, environmental and occupational medicine has played a significant role in the protection and improvement of public health. However, scientific integrity in this field has been increasingly threatened by pressure from some industries and governments. For example, it has been reported that the tobacco industry manipulated eminent scientists to legitimise their industrial positions, irresponsibly distorted risk and deliberately subverted scientific processes, and influenced many organisations in receipt of tobacco funding. Many environmental whistleblowers were sued and encountered numerous personal attacks. In some countries, scientific findings have been suppressed and distorted, and scientific advisory committees manipulated for political purposes by government agencies. How to respond to these threats is an important challenge for environmental and occupational medicine professionals and their societies. The authors recommend that professional organisations adopt a code of ethics that requires openness from public health professionals; that they not undertake research or use data where they do not have freedom to publish their results if these data have public health implications; that they disclose all possible conflicts; that the veracity of their research results should not be compromised; and that their research independence be protected through professional and legal support. The authors furthermore recommend that research funding for public health not be directly from the industry to the researcher. An independent, intermediate funding scheme should be established to ensure that there is no pressure to analyse data and publish results in bad faith. Such a funding system should also provide equal competition for funds and selection of the best proposals according to standard scientific criteria.
Collapse
Affiliation(s)
- S Tong
- School of Public Health, Queensland University of Technology, Kelvin Grove, Queensland, Australia.
| | | |
Collapse
|