Funding source and research report quality in nutrition practice-related research

Completeness of intervention reporting of nutrition-focused weight management interventions adjunct to metabolic and bariatric surgery: effect of the TIDieR checklist

Nutrition-focused interventions are essential to optimize the bariatric care process and improve health and weight outcomes over time. Clear and detailed reporting of these interventions in research reports is crucial for understanding and applying the findings effectively in clinical practice and research replication. Given the importance of reporting transparency in research, this study aimed to use the Template for Intervention Description and Replication (TIDieR) checklist to evaluate the completeness of intervention reporting in nutritional weight management interventions adjunct to metabolic and bariatric surgery (MBS). The secondary aim was to examine the factors associated with better reporting. A literature search in PubMed, PsychINFO, EMBASE, Scopus, and the Cochrane Controlled Register of Trials was conducted to include randomized controlled trials (RCT), quasi-RCTs and parallel group trials. A total of 22 trials were included in the final analysis. Among the TIDieR 12 items, 6.6 ± 1.9 items were fully reported by all studies. None of the studies completely reported all intervention descriptors. The main areas where reporting required improvement were providing adequate details of the materials and procedures of the interventions, intervention personalization, and intervention modifications during the study. The quality of intervention reporting remained the same after vs. before the release of the TIDieR guidelines. Receiving funds from industrial organizations (p = 0.02) and having the study recorded within a registry platform (p = 0.08) were associated with better intervention reporting. Nutritional weight management interventions in MBS care are still below the desirable standards for reporting. The present study highlights the need to improve adequate reporting of such interventions, which would allow for greater replicability, evaluation through evidence synthesis studies, and transferability into clinical practice.

Misleading presentations in functional food trials led by contract research organizations were frequently observed in Japan: meta-epidemiological study

OBJECTIVES

The functional food market has experienced significant growth, leading to an uptick in clinical trials conducted by contract research organizations (CROs). Research focusing on CRO-managed trials and the communication of trial outcomes to the consumer market remains underexplored. This metaepidemiological study aims to evaluate the quality of randomized controlled trials (RCTs) facilitated by prominent CROs in Japan and to examine the quality of the representations used to convey their results to consumers.

STUDY DESIGN AND SETTING

This study focused on the food trials that were registered in the University Hospital Medical Information Network Clinical Trial Registry or the International Clinical Trials Registry Platform by the top 5 CROs. Press releases of study results or advertisements of food products based on the study results were identified by conducting a Google search. The risk of bias in the RCT publications was independently assessed by 2 reviewers, who also evaluated the presence of "spin" in the abstracts and full texts. An assessment of "spin" in press releases/advertisements was undertaken.

RESULTS

A total of 76 RCT registrations, 32 RCT publications, and 11 press releases/advertisements were included. Approximately 72% of the RCT publications exhibited a high risk of bias due to selective outcome reporting. "Spin" was present in the results of the abstract (72%), abstract conclusion (81%), full-text results (44%), and full-text conclusion (84%). "Spin" appeared in 73% of press releases/advertisements due to the selective outcome reporting.

CONCLUSION

Functional food presentations in Japan frequently contained "spin." The Japanese government should more rigorously check whether food manufacturers report outcomes selectively.

Completeness of Reporting in Diet- and Nutrition-Related Randomized Controlled Trials and Systematic Reviews With Meta-Analysis: Protocol for 2 Independent Meta-Research Studies

BACKGROUND

Journal articles describing randomized controlled trials (RCTs) and systematic reviews with meta-analysis of RCTs are not optimally reported and often miss crucial details. This poor reporting makes assessing these studies' risk of bias or reproducing their results difficult. However, the reporting quality of diet- and nutrition-related RCTs and meta-analyses has not been explored.

OBJECTIVE

We aimed to assess the reporting completeness and identify the main reporting limitations of diet- and nutrition-related RCTs and meta-analyses of RCTs, estimate the frequency of reproducible research practices among these RCTs, and estimate the frequency of distorted presentation or spin among these meta-analyses.

METHODS

Two independent meta-research studies will be conducted using articles published in PubMed-indexed journals. The first will include a sample of diet- and nutrition-related RCTs; the second will include a sample of systematic reviews with meta-analysis of diet- and nutrition-related RCTs. A validated search strategy will be used to identify RCTs of nutritional interventions and an adapted strategy to identify meta-analyses in PubMed. We will search for RCTs and meta-analyses indexed in 1 calendar year and randomly select 100 RCTs (June 2021 to June 2022) and 100 meta-analyses (July 2021 to July 2022). Two reviewers will independently screen the titles and abstracts of records yielded by the searches, then read the full texts to confirm their eligibility. The general features of these published RCTs and meta-analyses will be extracted into a research electronic data capture database (REDCap; Vanderbilt University). The completeness of reporting of each RCT will be assessed using the items in the CONSORT (Consolidated Standards of Reporting Trials), its extensions, and the TIDieR (Template for Intervention Description and Replication) statements. Information about practices that promote research transparency and reproducibility, such as the publication of protocols and statistical analysis plans will be collected. There will be an assessment of the completeness of reporting of each meta-analysis using the items in the Preferred Reporting Items for Systematic reviews and Meta-Analysis (PRISMA) statement and collection of information about spin in the abstracts and full-texts. The results will be presented as descriptive statistics in diagrams or tables. These 2 meta-research studies are registered in the Open Science Framework.

RESULTS

The literature search for the first meta-research retrieved 20,030 records and 2182 were potentially eligible. The literature search for the second meta-research retrieved 10,918 records and 850 were potentially eligible. Among them, random samples of 100 RCTs and 100 meta-analyses were selected for data extraction. Data extraction is currently in progress, and completion is expected by the beginning of 2023.

CONCLUSIONS

Our meta-research studies will summarize the main limitation on reporting completeness of nutrition- or diet-related RCTs and meta-analyses and provide comprehensive information regarding the particularities in the reporting of intervention studies in the nutrition field.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/43537.

A Meta-Epidemiological Study of Positive Results in Clinical Nutrition Research: The Good, the Bad and the Ugly of Statistically Significant Findings

Positive (statistically significant) findings are easily produced in nutrition research when specific aspects of the research design and analysis are not accounted for. To address this issue, recently, a pledge was made to reform nutrition research and improve scientific trust on the science, encompass research transparency and achieve reproducibility. The aim of the present meta-epidemiological study was to evaluate the statistical significance status of research items published in three academic journals, all with a focus on clinical nutrition science and assessing certain methodological/transparency issues. All research items were published between the years 2015 and 2019. Study design, primary and secondary findings, sample size and age group, funding sources, positivist findings, the existence of a published research protocol and the adjustment of nutrients/dietary indexes to the energy intake (EI) of participants, were extracted for each study. Out of 2127 studies in total, those with positive findings consisted of the majority, in all three journals. Most studies had a published research protocol, however, this was mainly due to the randomized controlled trials and not to the evidence-synthesis studies. No differences were found in the distribution of positive findings according to the existence/inexistence of a published research protocol. In the pooled sample of studies, positive findings differed according to study design and more significant findings were reported by researchers failing to report any funding source. The majority of items published in the three journals (65.9%) failed to account for the EI of participants. The present results indicate that there is still room for the improvement of nutrition research in terms of design, analyses and reporting.

The Relationships among Microelement Composition of Reindeer Meat (Rangifer tarandus) and Adaptation: A Systematic Review and Meta-Analysis

This systematic review and meta-analysis based on PRISMA statements aimed to summarise the data on the chemical composition of reindeer meat depending on the region of the Rangifer tarandus. We searched SCOPUS, PubMed, Embase, CrossRef, Medline, Cochrane library, eLibrary, and CyberLeninka. A total of 3310 records published between January 1980 and December 2021 were screened. We identified 34 relevant studies conducted in Russia, Norway, the USA, Canada, and Finland for the synthesis. Overall, the consumption of reindeer meat reduces arterial hypertension and atherosclerosis due to many polyunsaturated fatty acids (linoleic, linolenic, arachidonic) and vitamin C, which balances lipid fractions. Venison is an effective means of preventing obesity and adapting to cold due to the content of a complete set of essential trace elements, amino acids, and even L-carnitine. The high content of vitamin C and microelements (iron, zinc, copper) in reindeer meat is likely to increase the body’s antioxidant defence against free radicals and help prevent chronic non-infectious diseases. Thus, venison is an essential component of the adaptation mechanism for the Arctic population.

Beyond nutrition and physical activity: food industry shaping of the very principles of scientific integrity

BACKGROUND

There is evidence that food industry actors try to shape science on nutrition and physical activity. But they are also involved in influencing the principles of scientific integrity. Our research objective was to study the extent of that involvement, with a case study of ILSI as a key actor in that space. We conducted a qualitative document analysis, triangulating data from an existing scoping review, publicly available information, internal industry documents, and existing freedom of information requests.

RESULTS

Food companies have joined forces through ILSI to shape the development of scientific integrity principles. These activities started in 2007, in direct response to the growing criticism of the food industry's funding of research. ILSI first built a niche literature on COI in food science and nutrition at the individual and study levels. Because the literature was scarce on that topic, these publications were used and cited in ILSI's and others' further work on COI, scientific integrity, and PPP, beyond the fields of nutrition and food science. In the past few years, ILSI started to shape the very principles of scientific integrity then and to propose that government agencies, professional associations, non-for-profits, and others, adopt these principles. In the process, ILSI built a reputation in the scientific integrity space. ILSI's work on scientific integrity ignores the risks of accepting corporate funding and fails to provide guidelines to protect from these risks.

CONCLUSIONS

The activities developed by ILSI on scientific integrity principles are part of a broader set of political practices of industry actors to influence public health policy, research, and practice. It is important to learn about and counter these practices as they risk shaping scientific standards to suit the industry's interests rather than public health ones.

Using risk of bias domains to identify opportunities for improvement in food- and nutrition-related research: An evaluation of research type and design, year of publication, and source of funding

PURPOSE

This retrospective cross-sectional study aimed to identify opportunities for improvement in food and nutrition research by examining risk of bias (ROB) domains.

METHODS

Ratings were extracted from critical appraisal records for 5675 studies used in systematic reviews conducted by three organizations. Variables were as follows: ROB domains defined by the Cochrane Collaboration (Selection, Performance, Detection, Attrition, and Reporting), publication year, research type (intervention or observation) and specific design, funder, and overall quality rating (positive, neutral, or negative). Appraisal instrument questions were mapped to ROB domains. The kappa statistic was used to determine consistency when multiple ROB ratings were available. Binary logistic regression and multinomial logistic regression were used to predict overall quality and ROB domains.

FINDINGS

Studies represented a wide variety of research topics (clinical nutrition, food safety, dietary patterns, and dietary supplements) among 15 different research designs with a balance of intervention (49%) and observation (51%) types, published between 1930 and 2015 (64% between 2000-2009). Duplicate ratings (10%) were consistent (κ = 0.86-0.94). Selection and Performance domain criteria were least likely to be met (57.9% to 60.1%). Selection, Detection, and Performance ROB ratings predicted neutral or negative quality compared to positive quality (p<0.001). Funder, year, and research design were significant predictors of ROB. Some sources of funding predicted increased ROB (p<0.001) for Selection (interventional: industry only and none/not reported; observational: other only and none/not reported) and Reporting (observational: university only and other only). Reduced ROB was predicted by combined and other-only funding for intervention research (p<0.005). Performance ROB domain ratings started significantly improving in 2000; others improved after 1990 (p<0.001). Research designs with higher ROB were nonrandomized intervention and time series designs compared to RCT and prospective cohort designs respectively (p<0.001).

CONCLUSIONS

Opportunities for improvement in food and nutrition research are in the Selection, Performance, and Detection ROB domains.

Scientific rigor and credibility in the nutrition research landscape

Scientific progress depends on the quality and credibility of research methods. As discourse on rigor, transparency, and reproducibility joins the cacophony of nutrition information and misinformation in mass media, buttressing the real and perceived reliability of nutrition science is more important than ever. This broad topic was the focus of a 2016 plenary session, "Scientific Rigor and Competing Interests in the Nutrition Research Landscape." This article summarizes and expands on this session in an effort to increase understanding and dialogue with regard to factors that limit the real and perceived reliability of nutrition science and steps that can be taken to mitigate those factors. The end goal is to both earn and merit greater trust in nutrition science by both the scientific community and the general public. The authors offer suggestions in each of the domains of education and training, communications, research conduct, and procedures and policies to help achieve this goal. The authors emphasize the need for adequate funding to support these efforts toward greater rigor and transparency, which will be resource demanding and may require either increased research funding or the recognition that a greater proportion of research funding may need to be allocated to these tasks.

[A critical assessment of the relation between the food industry and health research]

OBJECTIVE

To describe the influence of the food industry in health research, observing how funding influences health outcomes and the quality of the studies.

METHOD

We performed a systematic review in MEDLINE, Cochrane Library Plus and Scopus using the MESH "Food Industry", "Food-Processing Industry", "Biomedical Research", "Research Support as Topic", and the keywords "Industry Sponsorship" and "Funding Source". The quality was assessed using the PRISMA guidelines.

RESULTS

We revised 1,506 articles and 10 were included; two reviewed the relationship between funding-outcomes and quality-outcomes; six focused on the funding-outcomes relationship; and the other two focused on methodological quality. Six showed that funding from the food industry resulted in more favourable outcomes for their products. No differences in quality were found in relation to the funding source, but those which did not declare their funding had a worse quality.

CONCLUSION

Studies funded by the food industry showed favourable results for their products. However, this fact did not affect the quality of the studies.

Micronutrients in HIV: a Bayesian meta-analysis

BACKGROUND

Approximately 28.5 million people living with HIV are eligible for treatment (CD4<500), but currently have no access to antiretroviral therapy. Reduced serum level of micronutrients is common in HIV disease. Micronutrient supplementation (MNS) may mitigate disease progression and mortality.

OBJECTIVES

We synthesized evidence on the effect of micronutrient supplementation on mortality and rate of disease progression in HIV disease.

METHODS

We searched MEDLINE, EMBASE, the Cochrane Central, AMED and CINAHL databases through December 2014, without language restriction, for studies of greater than 3 micronutrients versus any or no comparator. We built a hierarchical Bayesian random effects model to synthesize results. Inferences are based on the posterior distribution of the population effects; posterior distributions were approximated by Markov chain Monte Carlo in OpenBugs.

PRINCIPAL FINDINGS

From 2166 initial references, we selected 49 studies for full review and identified eight reporting on disease progression and/or mortality. Bayesian synthesis of data from 2,249 adults in three studies estimated the relative risk of disease progression in subjects on MNS vs. control as 0.62 (95% credible interval, 0.37, 0.96). Median number needed to treat is 8.4 (4.8, 29.9) and the Bayes Factor 53.4. Based on data reporting on 4,095 adults reporting mortality in 7 randomized controlled studies, the RR was 0.84 (0.38, 1.85), NNT is 25 (4.3, ∞).

CONCLUSIONS

MNS significantly and substantially slows disease progression in HIV+ adults not on ARV, and possibly reduces mortality. Micronutrient supplements are effective in reducing progression with a posterior probability of 97.9%. Considering MNS low cost and lack of adverse effects, MNS should be standard of care for HIV+ adults not yet on ARV.

Ocular gene transfer in the spotlight: implications of newspaper content for clinical communications

BACKGROUND

Ocular gene transfer clinical trials are raising hopes for blindness treatments and attracting media attention. News media provide an accessible health information source for patients and the public, but are often criticized for overemphasizing benefits and underplaying risks of novel biomedical interventions. Overly optimistic portrayals of unproven interventions may influence public and patient expectations; the latter may cause patients to downplay risks and over-emphasize benefits, with implications for informed consent for clinical trials. We analyze the news media communications landscape about ocular gene transfer and make recommendations for improving communications between clinicians and potential trial participants in light of media coverage.

METHODS

We analyzed leading newspaper articles about ocular gene transfer (1990-2012) from United States (n = 55), Canada (n = 26), and United Kingdom (n = 77) from Factiva and Canadian Newsstand databases using pre-defined coding categories. We evaluated the content of newspaper articles about ocular gene transfer for hereditary retinopathies, exploring representations of framing techniques, research design, risks/benefits, and translational timelines.

RESULTS

The dominant frame in 61% of stories was a celebration of progress, followed by human-interest in 30% of stories. Missing from the positive frames were explanations of research design; articles conflated clinical research with treatment. Conflicts-of-interest and funding sources were similarly omitted. Attention was directed to the benefits of gene transfer, while risks were only reported in 43% of articles. A range of visual outcomes was described from slowing vision loss to cure, but the latter was the most frequently represented even though it is clinically infeasible. Despite the prominence of visual benefit portrayals, 87% of the articles failed to provide timelines for the commencement of clinical trials or for clinical implementation.

CONCLUSIONS

Our analysis confirms that despite many initiatives to improve media communications about experimental biotechnologies, media coverage remains overly optimistic and omits important information. In light of these findings, our recommendations focus on the need for clinicians account for media coverage in their communications with patients, especially in the context of clinical trial enrolment. The development of evidence-based communication strategies will facilitate informed consent and promote the ethical translation of this biotechnology.

Reviews examining sugar-sweetened beverages and body weight: correlates of their quality and conclusions

BACKGROUND

The role of sugar-sweetened beverages (SSBs) in increasing obesity is of great scientific, clinical, and public health interest. Many reviews have been published on this topic in recent years with very different conclusions.

OBJECTIVE

We sought to assess the scientific quality and other characteristics that may be associated with the conclusions of reviews regarding the causal relation between SSB consumption and body weight.

DESIGN

A systematic search of reviews in English language-published peer-reviewed journals in 2006-2013 was performed. Their methodologic quality was assessed by 2 judges using 2 scoring systems: the Assessment of Multiple Systematic Reviews and the American Dietetic Association Quality Criteria Checklist. The conclusions were blindly assessed by 11 independent readers using a Likert scale ranging from a position score of 0 = no evidence of a causal relation to 5 = strong evidence of a causal relation.

RESULTS

Twenty reviews were identified: 5 meta-analyses, 3 qualitative systematic reviews, and 12 qualitative nonsystematic reviews. Four received funding from the food industry. Quality scores were neither correlated with the readers' perception of conclusions nor with the source of funding. However, industry-funded reviews were more likely to suggest that evidence supporting a causal relation between SSB consumption and weight gain was weak (mean position score = 1.78), whereas evidence was generally considered well-founded in other reviews (mean position score = 3.39; P ≤ 0.01).

CONCLUSIONS

For a complex and controversial scientific issue, it is important to minimize perceived or actual threats to scientific objectivity and methodologic quality. More refined tools are needed to better assess their scientific quality and to identify factors and mechanisms that may influence authors' conclusions.

Overstatement of results in the nutrition and obesity peer-reviewed literature

BACKGROUND

Scientific authors who overreach in presenting results can potentially, without intending to, distort the state of knowledge and inappropriately influence clinicians, decision makers, the media, and the public.

PURPOSE

The goal of the study was to determine the extent to which authors present overreaching statements in the obesity and nutrition literature, and whether journal, author, or study characteristics are associated with this practice.

METHODS

A total of 937 papers on nutrition or obesity published in 2001 and 2011 in leading specialty, medical, and public health journals were systematically studied to estimate the extent to which authors overstate the results of their study in the published abstract. Focus was placed on overreaching statements that may include (1) reporting an associative relationship as causal; (2) making policy recommendations based on observational data that show associations only (e.g., not cause and effect); and (3) generalizing to a population not represented by their sample. Data were compiled in 2012 and analyzed in 2013.

RESULTS

Results indicate that 8.9% of studies have overreaching conclusions with a higher percentage in 2011 compared to 2001 (OR=2.14, risk difference=+3.9%, p=0.020). Unfunded studies (OR=2.41, p=0.039) were more likely to have an overstatement of results of the type described here. In contrast, those with a greater number of coauthors were significantly less likely than those with four or fewer authors (the reference group) to have overstated results (seven or eight authors: OR=0.30, risk difference=-6.1%, p=0.008; ≥9 authors: OR=0.41, risk difference= -4.0%, p=0.037).

CONCLUSIONS

Overreaching in presenting results in studies focused on nutrition and obesity topics is common in articles published in leading journals. Testable strategies are proposed to reduce the prevalence of such instances in the literature.