2
|
Jamshidi-Naeini Y, Brown AW, Mehta T, Glueck DH, Golzarri-Arroyo L, Muller KE, Tekwe CD, Allison DB. A practical decision tree to support editorial adjudication of submitted parallel cluster randomized controlled trials. Obesity (Silver Spring) 2022; 30:565-570. [PMID: 35195364 PMCID: PMC9203170 DOI: 10.1002/oby.23373] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/20/2021] [Revised: 11/08/2021] [Accepted: 12/12/2021] [Indexed: 01/23/2023]
Affiliation(s)
- Yasaman Jamshidi-Naeini
- Department of Epidemiology and Biostatistics, Indiana University School of Public Health-Bloomington, Bloomington, Indiana, USA
| | - Andrew W. Brown
- Department of Applied Health Science, Indiana University School of Public Health-Bloomington, Bloomington, Indiana, USA
| | - Tapan Mehta
- Department of Health Services Administration, University of Alabama at Birmingham, Birmingham, Alabama, USA
| | - Deborah H. Glueck
- Department of Pediatrics, University of Colorado School of Medicine, University of Colorado Denver, Aurora, Colorado, USA
| | - Lilian Golzarri-Arroyo
- Department of Epidemiology and Biostatistics, Indiana University School of Public Health-Bloomington, Bloomington, Indiana, USA
| | - Keith E. Muller
- Department of Health Outcomes and Biomedical Informatics, College of Medicine, University of Florida, Gainesville, Florida, USA
| | - Carmen D. Tekwe
- Department of Epidemiology and Biostatistics, Indiana University School of Public Health-Bloomington, Bloomington, Indiana, USA
| | - David B. Allison
- Department of Epidemiology and Biostatistics, Indiana University School of Public Health-Bloomington, Bloomington, Indiana, USA
| |
Collapse
|
3
|
Brown AW, Altman DG, Baranowski T, Bland JM, Dawson JA, Dhurandhar NV, Dowla S, Fontaine KR, Gelman A, Heymsfield SB, Jayawardene W, Keith SW, Kyle TK, Loken E, Oakes JM, Stevens J, Thomas DM, Allison DB. Childhood obesity intervention studies: A narrative review and guide for investigators, authors, editors, reviewers, journalists, and readers to guard against exaggerated effectiveness claims. Obes Rev 2019; 20:1523-1541. [PMID: 31426126 PMCID: PMC7436851 DOI: 10.1111/obr.12923] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/17/2019] [Revised: 07/13/2019] [Accepted: 07/14/2019] [Indexed: 12/16/2022]
Abstract
Being able to draw accurate conclusions from childhood obesity trials is important to make advances in reversing the obesity epidemic. However, obesity research sometimes is not conducted or reported to appropriate scientific standards. To constructively draw attention to this issue, we present 10 errors that are commonly committed, illustrate each error with examples from the childhood obesity literature, and follow with suggestions on how to avoid these errors. These errors are as follows: using self-reported outcomes and teaching to the test; foregoing control groups and risking regression to the mean creating differences over time; changing the goal posts; ignoring clustering in studies that randomize groups of children; following the forking paths, subsetting, p-hacking, and data dredging; basing conclusions on tests for significant differences from baseline; equating "no statistically significant difference" with "equally effective"; ignoring intervention study results in favor of observational analyses; using one-sided testing for statistical significance; and stating that effects are clinically significant even though they are not statistically significant. We hope that compiling these errors in one article will serve as the beginning of a checklist to support fidelity in conducting, analyzing, and reporting childhood obesity research.
Collapse
Affiliation(s)
- Andrew W Brown
- Department of Applied Health Science, Indiana University School of Public Health-Bloomington, Bloomington, Indiana
| | - Douglas G Altman
- Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology, and Musculoskeletal Sciences, University of Oxford, Oxford, UK
| | - Tom Baranowski
- Department of Pediatrics, Baylor College of Medicine, USDA/ARS Children's Nutrition Research Center, Houston, Texas
| | - J Martin Bland
- Department of Health Sciences, University of York, York, UK
| | - John A Dawson
- Department of Nutritional Sciences, Texas Tech University, Lubbock, Texas
| | | | - Shima Dowla
- School of Medicine, University of Alabama at Birmingham, Birmingham, Alabama
| | - Kevin R Fontaine
- Department of Health Behavior, School of Public Health, University of Alabama at Birmingham, Birmingham, Alabama
| | - Andrew Gelman
- Department of Statistics and Department of Political Science, Columbia University, New York, New York
| | - Steven B Heymsfield
- Pennington Biomedical Research Center, Louisiana State University, Baton Rouge, Louisiana
| | - Wasantha Jayawardene
- Department of Applied Health Science, Indiana University School of Public Health-Bloomington, Bloomington, Indiana
| | - Scott W Keith
- Department of Pharmacology and Experimental Therapeutics, Division of Biostatistics, Sidney Kimmel Medical College, Thomas Jefferson University, Philadelphia, Pennsylvania
| | | | - Eric Loken
- Neag School of Education, University of Connecticut, Storrs, Connecticut
| | - J Michael Oakes
- Department of Epidemiology, School of Public Health, University of Minnesota, Minneapolis, Minnesota
| | - June Stevens
- Departments of Nutrition and Epidemiology, Gillings School of Global Public Health, University of North Carolina, Chapel Hill, North Carolina
| | - Diana M Thomas
- Department of Mathematical Sciences, United States Military Academy, West Point, New York
| | - David B Allison
- Department of Epidemiology and Biostatistics, Indiana University School of Public Health-Bloomington, Bloomington, Indiana
| |
Collapse
|
4
|
Brown AW, Kaiser KA, Allison DB. Issues with data and analyses: Errors, underlying themes, and potential solutions. Proc Natl Acad Sci U S A 2018; 115:2563-2570. [PMID: 29531079 PMCID: PMC5856502 DOI: 10.1073/pnas.1708279115] [Citation(s) in RCA: 78] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/18/2022] Open
Abstract
Some aspects of science, taken at the broadest level, are universal in empirical research. These include collecting, analyzing, and reporting data. In each of these aspects, errors can and do occur. In this work, we first discuss the importance of focusing on statistical and data errors to continually improve the practice of science. We then describe underlying themes of the types of errors and postulate contributing factors. To do so, we describe a case series of relatively severe data and statistical errors coupled with surveys of some types of errors to better characterize the magnitude, frequency, and trends. Having examined these errors, we then discuss the consequences of specific errors or classes of errors. Finally, given the extracted themes, we discuss methodological, cultural, and system-level approaches to reducing the frequency of commonly observed errors. These approaches will plausibly contribute to the self-critical, self-correcting, ever-evolving practice of science, and ultimately to furthering knowledge.
Collapse
Affiliation(s)
- Andrew W Brown
- Office of Energetics and Nutrition Obesity Research Center, University of Alabama at Birmingham, Birmingham, AL 35294
| | - Kathryn A Kaiser
- Office of Energetics and Nutrition Obesity Research Center, University of Alabama at Birmingham, Birmingham, AL 35294
| | - David B Allison
- Office of Energetics and Nutrition Obesity Research Center, University of Alabama at Birmingham, Birmingham, AL 35294
| |
Collapse
|
5
|
Affiliation(s)
- David B Allison
- Department of Biostatistics, School of Public Health, University of Alabama at Birmingham, Alabama, USA
| | - Andrew W Brown
- Office of Energetics and the Nutrition Obesity Research Center, University of Alabama at Birmingham, Alabama, USA
| | - Brandon J George
- Office of Energetics, University of Alabama at Birmingham, Alabama, USA
| | - Kathryn A Kaiser
- Office of Energetics and the Nutrition Obesity Research Center, University of Alabama at Birmingham, Alabama, USA
| |
Collapse
|
7
|
Sichieri R, Cunha DB. Authors’ response to Li et al. Obes Facts 2015;8:DOI: 10.159/000381434. Obes Facts 2015; 8:130-1. [PMID: 25870949 PMCID: PMC5644869 DOI: 10.1159/000381576] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/06/2015] [Accepted: 02/18/2015] [Indexed: 11/22/2022] Open
Affiliation(s)
- Rosely Sichieri
- *Rosely Sichieri, MD, PhD, Department of Epidemiology, Institute of Social Medicine, State University of Rio de Janeiro, Rua São Francisco Xavier, 524,7° andar, Bloco E., Cep 20550-012, Rio de Janeiro, RJ, Brazil,
| | | |
Collapse
|
8
|
Hauner H. Quality Management in Scientific Publishing--the Importance to Critically Scrutinize Scientific Work. Obes Facts 2015; 8:125-6. [PMID: 25832728 PMCID: PMC5644844 DOI: 10.1159/000381481] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/09/2015] [Accepted: 03/20/2015] [Indexed: 11/19/2022] Open
Affiliation(s)
- Hans Hauner
- Klinikum rechts der Isar, Else Kröner-Fresenius-Zentrum für Ernährungsmedizin, Uptown München Campus D, Munich, Germany
- Else Kröner-Fresenius-Zentrum für Ernährungsmedizin, TU München, Freising-Weihenstephan, Germany
- *Prof. Dr. Hans Hauner, Else Kröner-Fresenius-Zentrum für Ernährungsmedizin, TU München, Gregor-Mendel-Straße 2, 85350 Freising-Weihenstephan, Germany,
| |
Collapse
|