1
|
Gulbrandsen MT, Filler RJ, Rice RC, Chung JH, Gulbrandsen TR, Phipatanakul WP, Liu JN. Spin in the Abstracts of Meta-analyses and Systematic Reviews: Midshaft Clavicle Fracture. J Orthop Trauma 2022; 37:e128-e134. [PMID: 36191349 DOI: 10.1097/bot.0000000000002497] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/02/2023]
Abstract
OBJECTIVES Spin is a reporting bias that presents the beneficial effect of an experimental treatment as greater than what is found in the results of the study. This bias can result in patient care recommendations that are more subjective than objective. The purpose of this study is to identify the prevalence of spin in meta-analysis and systematic review abstracts regarding treatment of midshaft clavicle fractures. METHODS Electronic libraries (MEDLINE, Embase, Web of Science, Google Scholar) were systematically searched. Meta-analyses and systematic reviews regarding treatment of midshaft clavicular fractures were analyzed. The nine most severe types of spin commonly found in abstracts were used as an evaluation tool to assess the articles. Other variables analyzed include year of publication, journal impact factor, number of citations, and methodologic quality according to A Measurement Tool to Assess Systematic Reviews (AMSTAR-2). RESULTS The database search resulted in 401 articles, of which 53 met inclusion criteria. After review, it was found that 52.8% (28/53) of the included articles contained spin within the abstract. Of the nine most severe types of spin found in abstracts, type 3 spin ("selective reporting of or overemphasis on efficacy outcomes or analysis favoring the beneficial effect of the experimental intervention") was found to be the most prevalent 28.3% (15/53). CONCLUSION This study demonstrated the presence of spin in the majority of meta-analyses and systematic review abstracts pertaining to midshaft clavicular fractures. Orthopedic surgeons should be aware and recognize spin as they review articles when deciding the treatment course for such injuries. LEVEL OF EVIDENCE Level 3. See Instructions for Authors for a complete description of levels of evidence.
Collapse
Affiliation(s)
- Matthew T Gulbrandsen
- Department of Orthopaedic Surgery, Loma Linda University School of Medicine, Loma Linda, CA
| | - Ryan J Filler
- Department of Orthopaedic Surgery, Loma Linda University School of Medicine, Loma Linda, CA
| | - Richard Casey Rice
- Department of Orthopaedic Surgery, Loma Linda University School of Medicine, Loma Linda, CA
| | - Jun Ho Chung
- Department of Orthopaedic Surgery, Loma Linda University School of Medicine, Loma Linda, CA
| | - Trevor R Gulbrandsen
- Department of Orthopaedic Surgery, University of Iowa Hospital, Iowa City, IA; and
| | - Wesley P Phipatanakul
- Department of Orthopaedic Surgery, Loma Linda University School of Medicine, Loma Linda, CA
| | - Joseph N Liu
- Department of Orthopaedic Surgery, University of Southern California Keck School of Medicine, Los Angeles, CA
| |
Collapse
|
2
|
Wise A, Mannem D, Arthur W, Ottwell R, Greiner B, Srouji D, Wildes D, Hartwell M, Wright DN, Khojasteh J, Vassar M. Spin within systematic review abstracts on antiplatelet therapies after acute coronary syndrome: a cross-sectional study. BMJ Open 2022; 12:e049421. [PMID: 35918107 PMCID: PMC9351322 DOI: 10.1136/bmjopen-2021-049421] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/03/2022] Open
Abstract
OBJECTIVES Spin is a reporting practice in which study results are misrepresented by overestimating efficacy or underestimating harm. Prevalence of spin varies between clinical specialties, and estimates are based almost entirely on clinical trials. Little is known about spin in systematic reviews. DESIGN We performed a cross-sectional analysis searching MEDLINE and Embase for systematic reviews and meta-analyses pertaining to antiplatelet therapies following acute coronary syndrome on 2 June 2020. Data were extracted evaluating the presence of spin and study characteristics, including methodological quality as rated by A MeaSurement Tool to Assess systematic Reviews (AMSTAR-2). All data extraction was conducted in a masked, duplicate manner from 2 June 2020 to 26 June 2020. PARTICIPANTS AND SETTING Not applicable. PRIMARY AND SECONDARY OUTCOME MEASURES We assessed abstracts of systematic reviews on antiplatelet therapy following acute coronary syndrome and evaluated the prevalence of the nine most severe types of spin. We additionally explored associations between spin and certain study characteristics, including quality. RESULTS Our searches returned 15 263 articles, and 185 systematic reviews met inclusion criteria. Of these 185 reviews, 31.9% (59/185) contained some form of spin in the abstract. Seven forms of spin (1, 2, 3, 4, 5, 7 and 9) among the nine most severe were identified. No instances of types 6 or 8 were found. There were no statistically significant relationships between spin and the evaluated study characteristics or AMSTAR-2 appraisals. CONCLUSIONS Spin was present in abstracts for systematic reviews and meta-analyses; subsequent studies are needed to identify correlations between spin and specific study characteristics. There were no statistically significant associations between spin and study characteristics or AMSTAR-2 ratings; however, implementing changes will ensure that spin is reduced in the field of cardiology as well as other fields of medicine.
Collapse
Affiliation(s)
- Audrey Wise
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Deepika Mannem
- Arkansas College of Osteopathic Medicine, Fort Smith, Arkansas, USA
| | - Wade Arthur
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Ryan Ottwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Benjamin Greiner
- The University of Texas Medical Branch at Galveston Department of Internal Medicine, Galveston, Texas, USA
| | - Derek Srouji
- Cardiology, Oklahoma State University Medical Center, Tulsa, Oklahoma, USA
| | - Daniel Wildes
- Cardiology, Oklahoma State University Medical Center, Tulsa, Oklahoma, USA
| | - Micah Hartwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Drew N Wright
- Samuel J. Wood Library & C.V. Starr Biomedical Information Center, Weill Cornell Medical College, New York, New York, USA
| | - Jam Khojasteh
- School of Educational Foundations, Leadership and Aviation, Oklahoma State University - Tulsa, Tulsa, Oklahoma, USA
| | - Matthew Vassar
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| |
Collapse
|
3
|
Bruns M, Manojkumar A, Ottwell R, Hartwell M, Arthur W, Roberts W, White B, Young J, Martin J, Wright DN, Chen S, Miao Z, Vassar M. Evaluation of spin in the abstracts of systematic reviews and meta-analyses relating to postoperative nausea and vomiting. Eur J Anaesthesiol 2022; 39:701-710. [PMID: 35796313 DOI: 10.1097/eja.0000000000001709] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Abstract
INTRODUCTION Spin - the beautification of study results to emphasise benefits or minimise harms - is a deceptive reporting strategy with the potential to affect clinical decision-making adversely. Few studies have investigated the extent of spin in systematic reviews. Here, we sought to address this gap by evaluating the presence of the nine most severe forms of spin in the abstracts of systematic reviews on treatments for postoperative nausea and vomiting (PONV). PONV has the potential to increase hospital costs and patient burden, adversely affecting outcomes. METHODS We developed search strategies for MEDLINE and Embase to identify systematic reviews focused on PONV. Following title and abstract screening of the reviews identified during the initial search, those that met inclusion criteria were evaluated for the presence of spin and received a revised AMSTAR-2 (A Measurement Tool to Assess Systematic Reviews) appraisal by two investigators in a masked, duplicate manner. Study characteristics for each review were also extracted in duplicate. RESULTS Our systematic search returned 3513 studies, of which 130 systematic reviews and meta-analyses were eligible for data extraction. We found that 29.2% of included systematic reviews contained spin (38/130). Eight of the nine types of spin were identified, with spin type 3 ('selective reporting of or overemphasis on efficacy outcomes or analysis favouring the beneficial effect of the experimental intervention') being the most common. Associations were found between spin and funding source. Spin was more likely in the abstracts of privately funded than nonfunded studies, odds ratio (OR) 2.81 [95% confidence interval (CI), 0.66 to 11.98]. In the abstracts of studies not mentioning funding spin was also more likely than in nonfunded studies, OR 2.30 (95% CI, 0.61 to 8.70). Neither of these results were statistically significant. Significance was found in the association between the presence of spin and AMSTAR-2 ratings: 'low' quality studies were less likely to contain spin than 'high' quality, OR 0.24 (95% CI, 0.07 to 0.88): 'critically low' studies were also less likely to contain spin than 'high' quality studies, OR 0.21 (95% CI, 0.07 to 0.65). There were no other associations between spin and the remaining extracted study characteristics or AMSTAR-2 ratings. CONCLUSION Spin was present in greater than 29% of abstracts of systematic reviews and meta-analyses regarding PONV. Various stakeholders must take steps to improve the reporting quality of abstracts on PONV.
Collapse
Affiliation(s)
- Matthew Bruns
- From the Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma (MB, RO, MH, WA, WR, MV), Arkansas College of Osteopathic Medicine, Fort Smith, Arkansas (AM), Department of Internal Medicine, University of Oklahoma, School of Community Medicine, Tulsa, Oklahoma (RO), Department of Dermatology, St. Joseph Mercy Hospital, Ann Arbor, Michigan (RO), Department of Anesthesiology, Oklahoma State University Medical Center, Tulsa, Oklahoma (WR, BW, JY), Samuel J. Wood Library & C. V. Starr Biomedical Information Center, Weill Cornell Medical College, New York, New York, USA (MH, DNW), Department of Anesthesia & Perioperative Medicine, MEDICI Centre, Western University, London, Ontario, Canada (JM), Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa (MV), School of Industrial Engineering and Management (SC) and Center for Health Systems Innovation, Oklahoma State University, Stillwater, Oklahoma, USA (ZM)
| | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
4
|
Gallo L, Yuan M, Gallo M, Chin B, Huynh MNQ, McRae M, McRae M, Coroneos CJ, Thoma A, Voineskos SH. Evaluation of "Spin" in the Abstracts of Systematic Reviews and Meta-analyses of Therapeutic Interventions Published in High-Impact Plastic Surgery Journals: A Systematic Review. Aesthet Surg J 2022; 42:1332-1342. [PMID: 35466993 DOI: 10.1093/asj/sjac109] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2022] [Indexed: 02/06/2023] Open
Abstract
BACKGROUND "Spin" is a form of reporting bias where there is an misappropriated presentation of study results, often overstating efficacy or understating harms. Abstracts of systematic reviews in other clinical domains have been demonstrated to employ spin, which may lead to clinical recommendations that are not justified by the literature. OBJECTIVES The objective of this study was to determine the prevalence of spin strategies in abstracts of plastic surgery systematic reviews. METHODS A literature search was conducted using MEDLINE, Embase, and CENTRAL, to identify all systematic reviews published in the top five plastic surgery journals from 2015-2021. Screening, data extraction, and spin analysis were performed by two independent reviewers. Data checking of the spin analysis was performed by a plastic surgery resident with graduate level training in clinical epidemiology. RESULTS From an initial search of 826 systematic reviews, 60 systematic reviews and meta-analyses were included in this study. Various types of spin were identified in 73% of systematic review abstracts (n=44). "Conclusion claims the beneficial effect of the experimental treatment despite high risk of bias in primary studies," was the most prevalent type of spin and was identified in 63% of systematic reviews (n=38). There were no significant associations between the presence of spin and study characteristics. CONCLUSIONS The present study found that 73% of abstracts in plastic surgery systematic reviews contain spin. Although systemic reviews represent the highest level of evidence, readers should be aware of types of "spin" when interpreting results and incorporating recommendations into patient care.
Collapse
Affiliation(s)
- Lucas Gallo
- Department of Plastic Surgery, McMaster University, Hamilton, ON, Canada
| | - Morgan Yuan
- Michael G. DeGroote School of Medicine, McMaster University, Hamilton, ON, Canada
| | - Matteo Gallo
- Department of Plastic Surgery, McMaster University, Hamilton, ON, Canada
- University of Ottawa, Ottawa, ON, Canada
| | - Brian Chin
- Department of Plastic Surgery, McMaster University, Hamilton, ON, Canada
| | - Minh N Q Huynh
- Department of Plastic Surgery, McMaster University, Hamilton, ON, Canada
| | - Mark McRae
- Department of Plastic Surgery, McMaster University, Hamilton, ON, Canada
| | - Matthew McRae
- Department of Plastic Surgery, McMaster University, Hamilton, ON, Canada
| | | | - Achilleas Thoma
- Department of Plastic Surgery, McMaster University, Hamilton, ON, Canada
| | | |
Collapse
|
5
|
Nowlin R, Wirtz A, Wenger D, Ottwell R, Cook C, Arthur W, Sallee B, Levin J, Hartwell M, Wright D, Sealey M, Zhu L, Vassar M. Spin in Abstracts of Systematic Reviews and Meta-analyses of Melanoma Therapies: Cross-sectional Analysis. JMIR DERMATOLOGY 2022; 5:e33996. [PMID: 37632865 PMCID: PMC10334896 DOI: 10.2196/33996] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2021] [Revised: 01/01/2022] [Accepted: 01/03/2022] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND Spin is defined as the misrepresentation of a study's results, which may lead to misperceptions or misinterpretation of the findings. Spin has previously been found in randomized controlled trials and systematic reviews of acne vulgaris treatments and treatments of various nondermatological conditions. OBJECTIVE The purpose of this study was to quantify the presence of spin in abstracts of systematic reviews and meta-analyses of melanoma therapies and identify any related secondary characteristics of these articles. METHODS We used a cross-sectional approach on June 2, 2020, to search the MEDLINE and Embase databases from their inception. To meet inclusion criteria, a study was required to be a systematic review or meta-analysis pertaining to the treatment of melanoma in human subjects, and reported in English. We used the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) definition of systematic reviews and meta-analyses. Data were extracted in a masked, duplicate fashion. We conducted a powered bivariate linear regression and calculated odds ratios for each study characteristic. RESULTS A total of 200 systematic reviews met the inclusion criteria. We identified spin in 38% (n=76) of the abstracts. The most common type of spin found was type 3 (selective reporting of or overemphasis on efficacy outcomes or analysis favoring the beneficial effect of the experimental intervention), occurring 40 times; the least common was type 2 (title claims or suggests a beneficial effect of the experimental intervention not supported by the findings), which was not present in any included abstracts. We found that abstracts pertaining to pharmacologic interventions were 3.84 times more likely to contain spin. The likelihood of an article containing spin has decreased annually (adjusted odds ratio 0.91, 95% CI 0.84-0.99). No significant correlation between funding source or other study characteristics and the presence of spin was identified. CONCLUSIONS We have found that spin is fairly common in the abstracts of systematic reviews of melanoma treatments, but the prevalence of spin in these abstracts has been declining from 1992-2020.
Collapse
Affiliation(s)
- Ross Nowlin
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, United States
| | - Alexis Wirtz
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, United States
| | - David Wenger
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, United States
| | - Ryan Ottwell
- Department of Internal Medicine, University of Oklahoma College of Community Medicine, Tulsa, OK, United States
- Department of Dermatology, St. Joseph Mercy Hospital, Ann Arbor, MI, United States
| | - Courtney Cook
- Department of Dermatology, University of Oklahoma Health Sciences Center, Oklahoma City, OK, United States
| | - Wade Arthur
- Department of Internal Medicine, University of Arkansas for Medical Sciences, Fayetteville, AR, United States
| | - Brigitte Sallee
- Department of Dermatology, University of Oklahoma Health Sciences Center, Oklahoma City, OK, United States
| | - Jarad Levin
- Department of Dermatology, University of Oklahoma Health Sciences Center, Oklahoma City, OK, United States
| | - Micah Hartwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, United States
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, OK, United States
| | - Drew Wright
- Samuel J. Wood Library and C.V. Starr Biomedical Information Center, Weill Cornell Medical College, New York, NY, United States
| | - Meghan Sealey
- Department of Statistics, Oklahoma State University, Stillwater, OK, United States
| | - Lan Zhu
- Department of Statistics, Oklahoma State University, Stillwater, OK, United States
| | - Matt Vassar
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, United States
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, OK, United States
| |
Collapse
|
6
|
Reddy AK, Shepard S, Ottwell R, Thompson J, Price CM, Arthur W, Hanson C, Ebert A, Wright DN, Hartwell M, Vassar M. Over 30% of Systematic Reviews and Meta-analyses Focused on Rotator Cuff Tear Treatments Contained Spin in the Abstract. Arthroscopy 2021; 37:2953-2959. [PMID: 33887409 DOI: 10.1016/j.arthro.2021.03.066] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/14/2020] [Revised: 03/26/2021] [Accepted: 03/29/2021] [Indexed: 02/02/2023]
Abstract
PURPOSE The purpose of this study is to determine the prevalence of spin in the abstracts of systematic reviews and meta-analyses on treatments for rotator cuff tears and whether various study and publishing journal characteristics were associated with the presence of spin. METHODS A search strategy was developed for Ovid MEDLINE and Ovid Embase to retrieve systematic reviews focused on treatments for rotator cuff tears. For an article to be included, it must meet the following criteria: (1) the article must be a systematic review with or without a meta-analysis, (2) the article must pertain to the treatment of rotator cuff tears, (3) the article must only contain human subjects, and (4) the article must be accessible in English. Systematic reviews were analyzed for spin using a previously developed classification scheme in a masked, duplicate manner. Binary logistic regression was used to examine independent associations via unadjusted odds ratios and 95% confidence intervals between the presence of spin and study characteristics. RESULTS Search queries returned 932 articles, of which 121 systematic reviews and meta-analyses were eligible. A total of 36.4% (44/121) of systematic reviews contained spin. Among the general characteristics evaluated, there were no correlations with spin. CONCLUSIONS Spin was present in more than one-third of systematic reviews and meta-analyses covering rotator cuff tear treatments. Spin was not associated with any general study or journal characteristics, which indicates that clinicians must be aware of the potential presence of spin in all such abstracts. CLINICAL RELEVANCE Clinicians rely on systematic reviews and meta-analyses, especially abstracts of these articles, to provide succinct guidance on best practices in patient care. The presence of spin could adversely affect patient care; thus, steps should be taken to improve the reporting quality of abstracts on rotator cuff tear treatment.
Collapse
Affiliation(s)
- Arjun K Reddy
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, U.S.A..
| | - Samuel Shepard
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, U.S.A
| | - Ryan Ottwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, U.S.A
| | - Jay Thompson
- Department of Orthopedic Surgery, Oklahoma State University Medical Center, Tulsa, Oklahoma, U.S.A
| | - Christopher M Price
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, U.S.A
| | - Wade Arthur
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, U.S.A
| | - Chad Hanson
- Department of Orthopedic Surgery, Oklahoma State University Medical Center, Tulsa, Oklahoma, U.S.A
| | - Andrew Ebert
- Department of Orthopedic Surgery, Oklahoma State University Medical Center, Tulsa, Oklahoma, U.S.A
| | - Drew N Wright
- Samuel J. Wood Library & C. V. Starr Biomedical Information Center, Weill Cornell Medical College, New York, New York, U.S.A
| | - Micah Hartwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, U.S.A.; Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, U.S.A
| | - Matt Vassar
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, U.S.A.; Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, U.S.A
| |
Collapse
|
7
|
Ferrell MC, Schell J, Ottwell R, Arthur W, Bickford T, Gardner G, Goodrich W, Platts-Mills TF, Hartwell M, Sealey M, Zhu L, Vassar M. Evaluation of spin in the abstracts of emergency medicine systematic reviews and meta-analyses. Eur J Emerg Med 2021; 29:118-125. [PMID: 34456295 DOI: 10.1097/mej.0000000000000864] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
INTRODUCTION The objective of this study was to assess for spin - a form of reporting that overemphasizes benefits or downplay harms - within abstracts of systematic reviews and meta-analyses related to the clinical practice of emergency medicine (EM). METHODS PubMed was searched for systematic reviews and meta-analyses published since 2015 in either EM or general medical journals that examined an aspect of emergency medical care. In a duplicate, masked fashion, article titles and abstracts were screened to determine eligibility based on predetermined inclusion criteria. The included full-text studies were read and evaluated for spin using a previously determined search strategy. Two authors further evaluated study quality using the AMSTAR-2 tool. RESULTS Our PubMed search identified 478 systematic reviews and meta-analyses, of which a random sample of 200 was selected for data extraction. Spin within the abstract of the manuscript was identified in 34.5% (69/200) of the included reviews. We identified seven of the nine spin types, with two types being most common: (1) conclusion claiming a benefit despite high risk of bias among studies reviewed (19.5% of abstracts), and (2) conclusion claiming a benefit despite reporting bias (14.5%). No significant associations were found between the presence of spin and any of the evaluated study characteristics, the AMSTAR-2 appraisal, or the journal of publication. CONCLUSION Spin is commonly present in abstracts of EM systematic reviews. The reporting quality for EM systematic reviews requires improvement. Measures should be taken to improve the overall review process and way information is conveyed through abstracts.
Collapse
Affiliation(s)
- Matthew C Ferrell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences
| | - Jace Schell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences
| | - Ryan Ottwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences
| | - Wade Arthur
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences
| | - Trevor Bickford
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences
| | - Gavin Gardner
- Department of Emergency Medicine, Oklahoma State University Medical Center, Tulsa, Oklahoma
| | - Will Goodrich
- Department of Emergency Medicine, Oklahoma State University Medical Center, Tulsa, Oklahoma
| | - Timothy F Platts-Mills
- Department of Emergency Medicine, University of North Carolina, Chapel Hill, North Carolina
| | - Micah Hartwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa
| | - Meghan Sealey
- Department of Statistics, Oklahoma State University, Stillwater, Oklahoma, USA
| | - Lan Zhu
- Department of Statistics, Oklahoma State University, Stillwater, Oklahoma, USA
| | - Matt Vassar
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa
| |
Collapse
|
8
|
Faulkner JJ, Polson C, Dodd AH, Ottwell R, Arthur W, Neff J, Chronister J, Hartwell M, Wright DN, Vassar M. Evaluation of spin in the abstracts of systematic reviews and meta-analyses focused on the treatment of obesity. Obesity (Silver Spring) 2021; 29:1285-1293. [PMID: 34314111 DOI: 10.1002/oby.23192] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/16/2020] [Revised: 02/27/2021] [Accepted: 03/23/2021] [Indexed: 01/08/2023]
Abstract
OBJECTIVE Spin, i.e., the misrepresentation of research findings, has the potential to affect patient care. Evidence suggests that spin is prevalent in obesity randomized controlled trials. Therefore, the primary objective of this study was to evaluate spin in abstracts of systematic reviews covering obesity treatments. METHODS MEDLINE and Embase were searched to retrieve systematic reviews on obesity treatments. Each systematic review abstract was inspected for the nine most severe types of spin, i.e., the misrepresentation of study findings by exaggeration or omission, regardless of intentionality. Screening and data extraction occurred in a masked, triplicate fashion. Methodological quality was determined using A MeaSurement Tool to Assess systematic Reviews (AMSTAR-2). RESULTS Spin was identified in 20 (out of 200, 10%) abstracts, with spin type 5 (claiming efficacy despite high risk of bias among primary studies) being most common (11/200, 5.5%). Spin types 2 and 7, both related to unsupported efficacy claims, were not found. No associations were found between spin and extracted study characteristics. The methodological quality of the sample was rated as follows: critically low (23.0%), low (13.5%), moderate (60.5%), and high (3%). CONCLUSIONS Although these findings demonstrate a low proportion of spin in the abstracts of systematic reviews for obesity treatment; increased preventive measures may further reduce its presence.
Collapse
Affiliation(s)
- Jantzen J Faulkner
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Connor Polson
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Andrew H Dodd
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Ryan Ottwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Wade Arthur
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Jenny Neff
- Department of Internal Medicine, Oklahoma State University Medical Center, Tulsa, Oklahoma, USA
| | - Justin Chronister
- Department of Internal Medicine, Oklahoma State University Medical Center, Tulsa, Oklahoma, USA
| | - Micah Hartwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Drew N Wright
- Samuel J. Wood Library & C. V. Starr Biomedical Information Center, Weill Cornell Medical College, New York, New York, USA
| | - Matt Vassar
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| |
Collapse
|
9
|
Ottwell R, Esmond L, Rea W, Hartwell M, Som M, Harris R, Miao Z, Zhu L, Arthur W, Brachtenbach T, Wright DN, Vassar M. Spin Infrequently Occurs in Abstracts of Systematic Reviews For The Pharmacological Treatment of Type 2 Diabetes Mellitus. Diabet Med 2021; 38:e14653. [PMID: 34289158 DOI: 10.1111/dme.14653] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/26/2021] [Accepted: 07/13/2021] [Indexed: 12/19/2022]
Abstract
AIMS Currently, there is a growing body of research demonstrating that spin - the misinterpretation and distortion of a study's findings - is common in different fields of medicine. To our knowledge, no study has investigated its presence in systematic reviews focused on diabetic therapies. METHODS We performed a cross-sectional study by searching MEDLINE and Embase for systematic reviews focused on pharmacologic treatments for type 2 diabetes mellitus. Our search retrieved 26,490 records, from which 199 studies were extracted in a masked, duplicate fashion. Each study was evaluated for the nine most severe types of spin and other study design parameters. Spin was presented as frequencies and odds ratios to identify associations between study characteristics. RESULTS Spin was identified in the abstracts of 15 systematic reviews (15/199, 7.5%). Spin type 5 was the most common type identified (7/199, 3.5%). Spin types 1, 2, 4, and 8 were not identified. In the last 5 years (2016-2021), 7 systematic reviews contained spin within their abstract. There was no association between spins presence and any extracted study characteristic . CONCLUSIONS Our findings show that spin infrequently occurs in abstracts of systematic reviews focused on pharmacologic therapies for type 2 diabetes mellitus. However, any amount of spin can lead to the distortion of a reader's interpretation of the study's findings. Thus, we provide recommendations with rationale to prevent spin in future systematic reviews.
Collapse
Affiliation(s)
- Ryan Ottwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
- Department of Internal Medicine, University of Oklahoma, School of Community Medicine, Tulsa, OK, USA
- Samuel J. Wood Library & C.V. Starr Biomedical Information Center, Weill Cornell Medical College, New York, NY, USA
| | - Lindy Esmond
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - William Rea
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
- Kansas City University of Medicine and Biosciences, Joplin, MO, USA
| | - Micah Hartwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Mousumi Som
- Department of Internal Medicine, Oklahoma State University Medical Center, Tulsa, OK, USA
| | - Rachael Harris
- Department of Internal Medicine, Oklahoma State University Medical Center, Tulsa, OK, USA
| | - Zhuqi Miao
- Spears School of Business, Oklahoma State University, Stillwater, OK, USA
| | - Lan Zhu
- Department of Statistics, Oklahoma State University, Stillwater, OK, USA
| | - Wade Arthur
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Travis Brachtenbach
- Department of Internal Medicine, Oklahoma State University Medical Center, Tulsa, OK, USA
| | - Drew N Wright
- Spears School of Business, Oklahoma State University, Stillwater, OK, USA
| | - Matt Vassar
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| |
Collapse
|
10
|
Corcoran A, Neale M, Arthur W, Ottwell R, Roberts W, Hartwell M, Cates S, Wright DN, Beaman J, Vassar M. Evaluating spin in the abstracts of systematic reviews and meta-analyses on cannabis use disorder. Subst Abus 2021; 43:1-9. [PMID: 34283700 DOI: 10.1080/08897077.2021.1944953] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/08/2023]
Abstract
BACKGROUND Clinicians rely upon abstracts to provide them quick synopses of research findings that may apply to their practice. Spin can exist within these abstracts that distorts or misrepresents the findings. Our goal was to evaluate the level of spin within systematic reviews (SRs) focused on the treatment of cannabis use disorder (CUD). Methods: A systematic search was conducted in May 2020. To meet inclusion criteria, publications had to be either an SR or meta-analysis related to the treatment of cannabis use. Screening and data extraction was performed in a duplicate and masked fashion. Study quality was assessed using AMSTAR-2 Results: 16/24 SRs (66.7%) contained at least one form of spin in the abstract. The most common forms of spin identified were type 3-selective reporting of or overemphasis on efficacy outcomes or analysis favoring the beneficial effect of the experimental intervention (45.8%)-and type 8-the review's findings from a surrogate marker or a specific outcome to the global improvement of the disease (37.5%). No significant association between spin and intervention type, PRISMA requirements, or funding source was identified. Weak positive correlations were found between the presence of spin and abstract word count (r =.217) and between spin and AMSTAR-2 rating (r = 0.143). "Moderate" was the most common AMSTAR-2 rating (9/24, 37.5%), followed by "low" (7/24, 29.2%) and "critically low" (7/24, 29.2%). One systematic review received an AMSTAR-2 rating of "high" (1/24, 4.2%). Conclusions: Spin was common among abstracts from the SRs focused on the treatments for CUD. Higher quality studies may help reduce the overall rate as well as standardizing treatment outcomes. To facilitate this, we encourage all authors, peer-reviewers, and editors to be more aware of the various types of spin as they can help reduce the overall amount of spin seen within the literature.
Collapse
Affiliation(s)
- Adam Corcoran
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Monika Neale
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
- College of Osteopathic Medicine, Kansas City University of Medicine and Biosciences, Kansas City, Missouri, USA
| | - Wade Arthur
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Ryan Ottwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Will Roberts
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Micah Hartwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Stephens Cates
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Drew N Wright
- Samuel J. Wood Library & C. V. Starr Biomedical Information Center, Weill Cornell Medical College, New York, New York, USA
| | - Jason Beaman
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Matt Vassar
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| |
Collapse
|
11
|
Cole WT, Wittl P, Arthur W, Ottwell R, Greiner B, Koshy G, Chronister J, Hartwell M, Staheli J, Wright DN, Sealey M, Zhu L, Vassar M. Spin in the abstracts of systematic reviews and metaanalyses focused on percutaneous coronary intervention. J Osteopath Med 2021; 121:723-731. [PMID: 34213843 DOI: 10.1515/jom-2021-0085] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2021] [Accepted: 05/25/2021] [Indexed: 01/10/2023]
Abstract
CONTEXT "Spin" is a form of bias that involves highlighting study results in a way that presents the conclusions about benefit or efficacy beyond the scope of the data. Spin in the abstract of published studies has the potential to affect patient care, making investigations about its presence and prevalence important for readers. OBJECTIVES To evaluate the most severe types of spin in the abstracts of systematic reviews and metaanalyses focused on percutaneous coronary intervention. METHODS Using a cross sectional study design, the authors searched MEDLINE and Embase with the terms "percutaneous coronary intervention," "percutaneous coronary revascularization," "PCI," "systematic review," "meta analysis," and "meta-analysis." To be considered for this study, the article must have (1) focused on PCI; (2) had either a systematic review or metaanalysis study design; (3) been conducted on human subjects; and (4) been available in English. Reviews were excluded if these criteria were not met. Each included article was assessed for the nine most severe types of spin as defined in a previously published article, as well as other study characteristics (type of intervention being compared, date the review was received, adherence of systematic review and/or meta-analysis to Preferred Reporting for Systematic Reviews or Metanalyses (PRISMA) guidelines, requirement of PRISMA guidelines by the publishing journal, the publishing journal's five-year impact factor, and sources of funding). RESULTS Our database search retrieved 7,038 records; 2,190 duplicates were removed. Initial title and abstract screening led to the exclusion of 4,367 records, and an additional 281 records were excluded during full text screening. An arbitrary limit of 200 articles was applied for this analysis; five additional articles were excluded for ineligible study design, so 195 were included in our final analysis. Spin was present in the abstracts of 43 studies from that pool (22.1%). Spin type 3-selective reporting of or overemphasis on efficacy outcomes or analysis favoring the beneficial effect of the experimental intervention-occurred most frequently (29; 14.8%). The presence of spin was not associated with any of the extracted study characteristics. CONCLUSIONS Our data showed that spin occurred in more than one in every five systematic reviews or metaanalyses of PCI. Spin has the potential to distort a reader's ability to translate the true findings of a study; therefore, efforts are needed to prevent spin from appearing in article summaries.
Collapse
Affiliation(s)
- Wesley Tanner Cole
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Peter Wittl
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Wade Arthur
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Ryan Ottwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Benjamin Greiner
- Department of Internal Medicine, University of Texas Medical Branch, Galveston, TX, USA
| | - Gershon Koshy
- Department of Internal Medicine, Oklahoma State University Medical Center, Tulsa, OK, USA
| | - Justin Chronister
- Department of Internal Medicine, Oklahoma State University Medical Center, Tulsa, OK, USA
| | - Micah Hartwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Jonathan Staheli
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Drew N Wright
- Samuel J. Wood Library & C. V. Starr Biomedical Information Center, Weill Cornell Medical College, New York, NY, USA
| | - Meghan Sealey
- Department of Statistics, Oklahoma State University, Stillwater, OK, USA
| | - Lan Zhu
- Department of Statistics, Oklahoma State University, Stillwater, OK, USA
| | - Matt Vassar
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| |
Collapse
|
12
|
Garrett M, Koochin T, Ottwell R, Arthur W, Rogers TC, Hartwell M, Chen E, Ford A, Wright DN, Sealey M, Zhu L, Vassar M. Evaluation of spin in the abstracts of systematic reviews and meta-analyses of treatments and interventions for smoking cessation. Tob Prev Cessat 2021; 7:35. [PMID: 34046532 PMCID: PMC8135573 DOI: 10.18332/tpc/134238] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2020] [Revised: 03/12/2021] [Accepted: 03/12/2021] [Indexed: 12/18/2022]
Abstract
INTRODUCTION Smoking cessation treatments and available evidence continue to evolve. To stay current with the latest research, physicians often refer to abstracts of systematic reviews. Because abstracts of systematic reviews may have direct effects on patient care, the information within them should be free of 'spin'. Spin is a specific way of reporting, intentional or not, to highlight that the beneficial effect of the experimental treatment in terms of efficacy or safety is greater than that shown by the results (i.e. overstate efficacy and/or understate harm). METHODS We searched systematic reviews and meta-analyses focused on interventions and treatments for smoking cessation. Full-text screening, data extraction, evaluation of spin, and quality assessment were conducted in masked, duplicate fashion. Study and journal characteristics were also recorded to determine whether they were associated with the presence of spin. RESULTS A total of 200 systematic reviews that met inclusion criteria were included in the final analyses. Spin occurred in 3.5% (7/200) of the systematic review abstracts included in our sample. No study characteristics were significantly associated with spin. CONCLUSIONS Of the reviewed abstracts in systematic reviews and meta-analyses, 96.5% of those that focused on smoking cessation were free of spin. However, the existence of spin warrants further steps to improve the scientific accuracy of abstracts on smoking cessation treatments. By identifying and acknowledging the presence of spin in systematic reviews, we hope to increase awareness about reporting practices in an ultimate effort to improve the integrity of scientific research as a whole.
Collapse
Affiliation(s)
- Morgan Garrett
- Office of Medical Student Research, Center for Health Sciences, Oklahoma State University, Tulsa, United States
| | - Tremayne Koochin
- Office of Medical Student Research, Center for Health Sciences, Oklahoma State University, Tulsa, United States
- College of Osteopathic Medicine, Kansas City University of Medicine and Biosciences, Joplin, United States
| | - Ryan Ottwell
- Office of Medical Student Research, Center for Health Sciences, Oklahoma State University, Tulsa, United States
| | - Wade Arthur
- Office of Medical Student Research, Center for Health Sciences, Oklahoma State University, Tulsa, United States
| | - Taylor C. Rogers
- Office of Medical Student Research, Center for Health Sciences, Oklahoma State University, Tulsa, United States
| | - Micah Hartwell
- Office of Medical Student Research, Center for Health Sciences, Oklahoma State University, Tulsa, United States
- Department of Psychiatry and Behavioral Sciences, Center for Health Sciences, Oklahoma State University, Tulsa, United States
| | - Elizabeth Chen
- Department of Psychiatry and Behavioral Sciences, Center for Health Sciences, Oklahoma State University, Tulsa, United States
| | - Alicia Ford
- Department of Psychiatry and Behavioral Sciences, Center for Health Sciences, Oklahoma State University, Tulsa, United States
| | - Drew N. Wright
- Samuel J. Wood Library and C. V. Starr Biomedical Information Center, Weill Cornell Medical College, Cornell University, New York, United States
| | - Meghan Sealey
- Department of Statistics, Oklahoma State University, Stillwater, United States
| | - Lan Zhu
- Department of Statistics, Oklahoma State University, Stillwater, United States
| | - Matt Vassar
- Office of Medical Student Research, Center for Health Sciences, Oklahoma State University, Tulsa, United States
- Department of Psychiatry and Behavioral Sciences, Center for Health Sciences, Oklahoma State University, Tulsa, United States
| |
Collapse
|
13
|
Lin V, Patel R, Wirtz A, Mannem D, Ottwell R, Arthur W, Cook C, Howard H, Wright D, Hartwell M, Vassar M. Evaluation of Spin in the Abstracts of Systematic Reviews and Meta-Analyses of Atopic Dermatitis Treatments and Interventions. Dermatology 2021; 237:496-505. [PMID: 34000718 DOI: 10.1159/000515299] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2020] [Accepted: 12/25/2020] [Indexed: 11/19/2022] Open
Abstract
BACKGROUND Spin - the misrepresentation of a study's results - has been identified in abstracts of studies focused on a variety of disorders from multiple fields of medicine. OBJECTIVES This study's primary objective was to evaluate the abstracts of systematic reviews and meta-analyses focused on the treatment of atopic dermatitis for the nine most severe forms of spin. METHODS We systematically searched Embase and MEDLINE for systematic reviews of atopic dermatitis therapies. Screening and data extraction occurred in a masked, duplicate fashion. Each included study was evaluated for the nine most severe types of spin and other study characteristics. RESULTS Our searches retrieved 2,456 studies, of which 113 were included for data extraction. Spin was found in 74.3% of our included studies (84/113). Spin type 6 occurred most frequently (68/113, 60.2%). Spin types 1, 2, and 9 were not identified. All industry-funded systematic reviews contained spin in their abstract. The presence of spin was not associated with any specific study characteristics, including the methodological quality of the study. CONCLUSIONS Severe forms of spin were found in the majority of abstracts for systematic reviews of atopic dermatitis treatments. Steps should be taken to prevent spin to improve the quality of reporting in abstracts.
Collapse
Affiliation(s)
- Vanessa Lin
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Raahi Patel
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
- Arkansas Colleges of Health Education, Fort Smith, Arkansas, USA
| | - Alexis Wirtz
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
- Arkansas Colleges of Health Education, Fort Smith, Arkansas, USA
| | - Deepika Mannem
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
- Arkansas Colleges of Health Education, Fort Smith, Arkansas, USA
| | - Ryan Ottwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Wade Arthur
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Courtney Cook
- Department of Dermatology, University of Oklahoma Health Sciences Center, Oklahoma City, Oklahoma, USA
| | | | - Drew Wright
- Samuel J. Wood Library & C.V. Starr Biomedical Information Center, Weill Cornell Medical College, New York, New York, New York, USA
| | - Micah Hartwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Matt Vassar
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| |
Collapse
|
14
|
Balcerak G, Shepard S, Ottwell R, Arthur W, Hartwell M, Beaman J, Lu K, Zhu L, Wright DN, Vassar M. Evaluation of spin in the abstracts of systematic reviews and meta-analyses of studies on opioid use disorder. Subst Abus 2021; 42:1-9. [PMID: 33848450 DOI: 10.1080/08897077.2021.1904092] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
BACKGROUND Spin, or the inappropriate formatting of information to emphasize certain outcomes, should not be present in research. This study focuses on identifying and characterizing the presence of spin in systematic review and meta-analysis abstracts that focus on the treatment of opioid use disorder. Methods: Search strategies were developed to identify studies pertaining to the treatment of opioid use disorder. The studies were then screened by two authors. These qualifying studies were then evaluated for the presence of spin within their abstracts by two trained authors. These studies were also evaluated by the AMSTAR-2 standards to evaluate the quality of the qualifying systematic reviews by two trained reviewers. Results: The sample in this study included 113 systematic reviews and meta-analyses. Spin was present in 20 of these studies (20/113, 17.7%). The most common spin form was spin type 3 (6/20, 30%), followed by types 5 and 9 (both 4/20, 20%), type 6 (3/20, 15%), type 7 (2/20, 10%), and type 8 (1/20, 5%). The remaining spin types 1, 2, and 4 were not present in the sample. Of the 113 included studies, the most common intervention type was pharmacologic (93/113, 82%). No significant association was found between the quality of a systematic review and the presence of spin. Conclusions: Findings in this study show positive trends in prevalence of five forms of spin evaluated in abstracts of systematic reviews and meta-analyses looking at treatments for opioid use disorder. However, study quality had no significant association with the presence of spin. Misrepresentation of results, or spin, may alter a clinician's perceptions about treatment efficacies. Therefore, increasing physician awareness of spin may improve clinical decision-making.
Collapse
Affiliation(s)
- Greg Balcerak
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Samuel Shepard
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Ryan Ottwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Wade Arthur
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Micah Hartwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Jason Beaman
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Kaelyn Lu
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Lan Zhu
- Department of Statistics, Oklahoma State University, Stillwater, Oklahoma, USA
| | - Drew N Wright
- Samuel J. Wood Library & C. V. Starr Biomedical Information Center, Weill Cornell Medical College, New York, New York, USA
| | - Matt Vassar
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| |
Collapse
|
15
|
Demla S, Shinn E, Ottwell R, Arthur W, Khattab M, Hartwell M, Wright DN, Vassar M. Evaluation of spin in the abstracts of systematic reviews and meta-analyses focused on cataract therapies. Am J Ophthalmol 2021; 228:47-57. [PMID: 33823157 DOI: 10.1016/j.ajo.2021.03.032] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2020] [Revised: 03/04/2021] [Accepted: 03/18/2021] [Indexed: 01/07/2023]
Abstract
PURPOSE Spin-the misrepresentation of study findings such that the beneficial effects of an intervention are magnified beyond what the results actually show-is a reporting practice that has been shown to influence perceptions of treatment efficacy and clinical decision making. We evaluated the extent of spin in the abstracts of systematic reviews of cataract surgery and its complications. We also evaluated whether particular study attributes were associated with spin. DESIGN Cross-sectional study. METHODS We searched MEDLINE and Embase for systematic reviews and meta-analyses relating to cataract treatment. From these search records, screening for eligible studies was done in duplicate. Using a previously developed classification system for spin, we assessed the systematic reviews that met our eligibility criteria for the occurrence of the 9 most severe forms of spin. We performed the evaluation of spin, extracted study characteristics, and appraised the methodological quality of each study using the 16-question AMSTAR-2 scale in duplicate. RESULTS Searches retrieved 2,059 studies, of which 110 were eligible for data extraction. We found at least 1 form of spin in 30.0% of included systematic reviews (33/110). Six of the 9 types of spin were identified in our sample, the most common being type 3 in 18.2% (20/110) of abstracts. We found no significant association between spin in abstracts, AMSTAR-2 appraisal, and any of the extracted study characteristics. CONCLUSION Spin was evident in approximately one-third of the abstracts of evaluated systematic reviews and meta-analyses of cataract surgery and associated complications.
Collapse
Affiliation(s)
- Simran Demla
- From the Office of Medical Student Research (S.D., E.S., R.O., W.A., M.K., M.H., M.V.), Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA.
| | - Erin Shinn
- From the Office of Medical Student Research (S.D., E.S., R.O., W.A., M.K., M.H., M.V.), Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA; Arkansas College of Osteopathic Medicine (E.S.), Fort Smith, Arkansas, USA
| | - Ryan Ottwell
- From the Office of Medical Student Research (S.D., E.S., R.O., W.A., M.K., M.H., M.V.), Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Wade Arthur
- From the Office of Medical Student Research (S.D., E.S., R.O., W.A., M.K., M.H., M.V.), Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Mostafa Khattab
- From the Office of Medical Student Research (S.D., E.S., R.O., W.A., M.K., M.H., M.V.), Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Micah Hartwell
- From the Office of Medical Student Research (S.D., E.S., R.O., W.A., M.K., M.H., M.V.), Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA; Department of Psychiatry and Behavioral Sciences (M.H., M.V.), Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma
| | - Drew N Wright
- Samuel J. Wood Library and C.V. Starr Biomedical Information Center (D.N.W.), Weill Cornell Medical College, New York, New York, USA
| | - Matt Vassar
- From the Office of Medical Student Research (S.D., E.S., R.O., W.A., M.K., M.H., M.V.), Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA; Department of Psychiatry and Behavioral Sciences (M.H., M.V.), Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma
| |
Collapse
|
16
|
Williams HC. Are Dermatology Systematic Reviews Spinning Out of Control? Dermatology 2021; 237:493-495. [PMID: 33784672 DOI: 10.1159/000515300] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2020] [Accepted: 01/09/2021] [Indexed: 11/19/2022] Open
Affiliation(s)
- Hywel C Williams
- Centre of Evidence-Based Dermatology, School of Medicine, University of Nottingham, Nottingham, United Kingdom
| |
Collapse
|
17
|
Heigle B, Kee M, Ottwell R, Arthur W, Brame L, Wright DN, Hartwell M, Khojasteh J, Vassar M. Spin the Abstracts of Systematic Reviews and Meta-Analyses Regarding the Treatment of Ménière's Disease. Ann Otol Rhinol Laryngol 2021; 130:34894211000493. [PMID: 33730925 DOI: 10.1177/00034894211000493] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/08/2023]
Abstract
OBJECTIVES To identify, quantify, and characterize the presence of spin-specific strategies leading to misrepresentation of study results-in the abstracts of systematic reviews and meta-analyses of Ménière's disease treatment. METHODS Using a cross-sectional design, we searched MEDLINE and Embase on May 28, 2020, for systematic reviews and meta-analyses focused on Ménière's disease treatment. Returned searches were screened, and data were extracted in a masked, duplicate fashion. RESULTS Our sample included 36 systematic reviews and meta-analyses. Of the 36 included studies, 22 (61.1%) abstracts contained spin while 14 (38.9%) did not. The most common spin types were selective reporting of benefit (10/36, 27.8%) or harm (8/36, 22.2%). Other types of spin occurred when findings were extrapolated to the global improvement of the disease (5/36, 13.9%), beneficial effects were reported with high risk of bias in primary studies (3/36, 8.3%), and when beneficial effects were extrapolated to an entire class of interventions (1/36, 2.8%). No instances of other spin types occurred. Abstracts containing spin were substantively associated with studies of critically low methodological quality compared with studies with low and moderate quality. No studies had a methodological rating of high quality. No associations were observed between spin and intervention types, journal recommendation of adhering to Preferred Reporting Items for Systematic Reviews and Meta-Analyses, or funding. We found a negative correlation (r = -.31) between abstract word limit and presence of spin. CONCLUSIONS Our study highlights that spin in the abstracts of systematic reviews of Ménière's disease is common, and it further enhances the discussion surrounding spin in abstracts of scientific research. Spin in an abstract does not discredit a study's findings; however, its occurrence should be eliminated.
Collapse
Affiliation(s)
- Benjamin Heigle
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Micah Kee
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Ryan Ottwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Wade Arthur
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Lacy Brame
- Department of Otolaryngology-Head and Neck Surgery, Oklahoma State University Medical Center, Tulsa, OK, USA
| | - Drew N Wright
- Samuel J. Wood Library & C. V. Starr Biomedical Information Center, Weill Cornell Medical College, New York, NY, USA
| | - Micah Hartwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
- Department of Psychiatry and Behavioral Science, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Jam Khojasteh
- Research, Evaluation, Measurement and Statistics, Oklahoma State University, Tulsa, OK, USA
| | - Matt Vassar
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
- Department of Psychiatry and Behavioral Science, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| |
Collapse
|
18
|
Flores H, Kannan D, Ottwell R, Arthur W, Hartwell M, Patel N, Bowers A, Po W, Wright DN, Chen S, Miao Z, Vassar M. Evaluation of spin in the abstracts of systematic reviews and meta-analyses on breast cancer treatment, screening, and quality of life outcomes: A cross-sectional study. J Cancer Policy 2021; 27:100268. [DOI: 10.1016/j.jcpo.2020.100268] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2020] [Revised: 12/13/2020] [Accepted: 12/14/2020] [Indexed: 01/23/2023]
|
19
|
Jones C, Rulon Z, Arthur W, Ottwell R, Checketts J, Detweiler B, Calder M, Adil A, Hartwell M, Wright DN, Vassar M. Evaluation of spin in the abstracts of systematic reviews and meta-analyses related to the treatment of proximal humerus fractures. J Shoulder Elbow Surg 2021; 30:2197-2205. [PMID: 33482369 DOI: 10.1016/j.jse.2020.11.026] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/09/2020] [Revised: 11/17/2020] [Accepted: 11/19/2020] [Indexed: 02/01/2023]
Abstract
BACKGROUND Research has shown that many physicians rely solely on abstracts to make clinical decisions. However, many abstracts have been shown to be misleading. The primary objective of this study was to identify the prevalence of spin - bias towards particular results - within the abstracts of systematic reviews and meta-analyses pertaining to the treatment of proximal humerus fractures, one of the most common osteoporotic fractures among elderly patients. METHODS We systematically searched MEDLINE and Embase databases to identify systematic reviews and meta-analyses examining the treatment of proximal humerus fractures. Screening and data extraction occurred in a masked, duplicate fashion. The nine most severe types of spin that occur within abstracts were extracted along with study characteristics, including journal recommendations to adhere to the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) and year in which the review was performed, to identify potential associations. We subsequently explored the association between spin and the methodological quality of a systematic review using the revised A MeaSurement Tool to Assess systematic Reviews (AMSTAR 2) appraisal instrument. RESULTS Our search retrieved 505 articles, of which 73 systematic reviews met inclusion criteria. We found that 34.2% (25/73) of the included systematic reviews contained spin. Spin type 3 (selective reporting of or overemphasis on efficacy outcomes or analysis favoring the beneficial effect of the experimental intervention) was the most common type identified (12/73, 16.4%). Three spin types were not identified in any of the abstracts. Spin was 3.2 (OR 3.2; 95% CI, 1.02-10.02) times more likely to be present in systematic reviews published in journals recommending adherence to PRISMA. Furthermore, the odds of an abstract containing spin was 1.25 (OR 1.25; 95% CI, 1.02-1.52) times more likely to be present in systematic reviews for each year after 2000. No other study characteristics were associated with spin. The methodological quality of 24 studies were rated as "critically low" (32.9%), 14 were "low" (19.2%), 28 were "moderate" (38.4%), and 7 were "high" (9.6%), but these findings were not associated with spin. CONCLUSION Spin was present in systematic review abstracts regarding treatment of proximal humerus fractures. Measures such as education on the subject of spin and improved reporting standards should be implemented to increase awareness and reduce incidence of spin in abstracts. LEVEL OF EVIDENCE OF THE STUDY PERFORMED Basic Science Study; Research Methodology.
Collapse
Affiliation(s)
- Caleb Jones
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Zane Rulon
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Wade Arthur
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Ryan Ottwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA.
| | - Jake Checketts
- Department of Orthopedic Surgery, Oklahoma State University Center Medical Center, Tulsa, OK, USA
| | - Byron Detweiler
- Department of Orthopedic Surgery, Oklahoma State University Center Medical Center, Tulsa, OK, USA
| | - Mark Calder
- Orthopedic & Trauma Services of Oklahoma, Tulsa, OK, USA
| | - Abrar Adil
- Orthopedic & Trauma Services of Oklahoma, Tulsa, OK, USA
| | - Micah Hartwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA; Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Drew N Wright
- Samuel J. Wood Library and C. V. Starr Biomedical Information Center, Weill Cornell Medical College, New York, NY, USA
| | - Matt Vassar
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA; Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| |
Collapse
|
20
|
Carr M, Dye D, Arthur W, Ottwell R, Detweiler B, Stotler W, Hawkins B, Wright DN, Hartwell M, Chen S, Miao Z, Vassar M. Evaluation of Spin in the Abstracts of Systematic Reviews and Meta-analyses Covering Treatments for Achilles Tendon Ruptures. FOOT & ANKLE ORTHOPAEDICS 2021; 6:24730114211000637. [PMID: 35097436 PMCID: PMC8702684 DOI: 10.1177/24730114211000637] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/08/2023] Open
Abstract
Background: Approximately 18 in every 100 000 people have experienced a ruptured Achilles tendon. Despite the prevalence of this condition, treatment options remain contested. Hypothesis/purpose: The objective of this study was to evaluate the use of spin—reporting practices that may exaggerate benefit or minimize harm—in abstracts of systematic reviews related to Achilles tendon repair. We also evaluated whether particular study characteristics were associated with spin. Study design: Cross-sectional. Methods: We developed a search strategy for Ovid MEDLINE and Ovid Embase for systematic reviews focused on Achilles tendon treatment. Following title and abstract screening of these search returns, these reviews were evaluated for spin (according to a previously developed classification scheme) and received AMSTAR-2 (A Measurement Tool to Assess Systematic Reviews–2) appraisals by 2 investigators in a masked, duplicate manner. Study characteristics for each review were also extracted in duplicate. Results: Our systematic search returned 251 articles of which 43 systematic reviews and meta-analyses were eligible for data extraction. We found that 65.1% of included studies contained spin (28/43). Spin type 3 was the most common type, occurring in 53.5% (23/43) of abstracts. Spin types 5, 6, 1, and 4 occurred in 16.3% (7/43), 9.3% (4/43), 7% (3/43), and 5.3% (1/43), respectively. Spin types 2, 7, 8, and 9 did not occur. AMSTAR-2 appraised 32.6% (14/43) of the studies as “moderate” quality, 32.6% (14/43) as “low” quality, and 34.9% (15/43) as “critically low” quality. No systematic reviews were rated as “high” quality. There was no significant association between the presence of spin and the following study characteristics: intervention type, article discussing Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) adherence, journal recommending PRISMA adherence, funding sources, journal 5-year impact factor, year the review was received for publication, or AMSTAR-2 critical appraisals. Conclusion: Spin was present in abstracts of systematic reviews and meta-analyses—covering Achilles tendon tear treatment. Steps should be taken to improve the reporting quality of abstracts on Achilles tendon treatment as well as other common orthopedic conditions. Clinical relevance: In order to avoid negative patient outcomes, articles should be free of spin within the abstract.
Collapse
Affiliation(s)
- Marvin Carr
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - David Dye
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA.,Kansas City University of Medicine and Biosciences-College of Osteopathic Medicine, Joplin, MO, USA
| | - Wade Arthur
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Ryan Ottwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Byron Detweiler
- Department of Orthopaedic Surgery, Oklahoma State University Center Medical Center, Tulsa, OK, USA
| | | | | | - Drew N Wright
- Samuel J. Wood Library & C.V. Starr Biomedical Information Center, Weill Cornell Medical College, New York, NY, USA
| | - Micah Hartwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA.,Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Suhao Chen
- School of Industrial Engineering and Management, Oklahoma State University, Stillwater, OK, USA
| | - Zhuqi Miao
- Center for Health Systems Innovation, Oklahoma State University, Stillwater, OK, USA
| | - Matt Vassar
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA.,Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| |
Collapse
|
21
|
Okonya O, Lai E, Ottwell R, Khattab M, Arthur W, Khaimi MA, Wright DN, Hartwell M, Vassar M. Evaluation of Spin in the Abstracts of Systematic Reviews and Meta-analyses of Treatments for Glaucoma. J Glaucoma 2020; 30:235-241. [PMID: 33350656 DOI: 10.1097/ijg.0000000000001735] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
PURPOSE Spin - the misrepresentation of the study's actual findings - carries the ability to distort a reader's perception of a treatments' full benefits and risks. Recent studies have suggested that spin is common in abstracts of randomized controlled trials and systematic reviews focused on treatments for a variety of medical disorders. Therefore, our primary objective was to evaluate the prevalence of spin in the abstracts of systematic reviews and meta-analyses related to glaucoma treatments. We further assessed whether specific study characteristics were associated with spin, including the methodological quality of a study. PATIENTS AND METHODS We used a cross-sectional study design searching MEDLINE and Embase databases all for systematic reviews and meta-analyses focused on glaucoma treatments. Each abstract was assessed for the nine most severe - severity determined by likelihood of distorting a reader's perception - types of spin that occur in systematic review abstracts. The screening and data extraction was performed in a duplicate, masked fashion. The methodological quality of each review was assessed using A MeaSurement Tool to Assess Systematic Reviews (AMSTAR-2) instrument. To evaluate relationships between spin, AMSTAR-2 appraisals, and other study characteristics, we used unadjusted odds ratios and Fisher's exact test. RESULTS Only three of the 102 abstracts contained spin, with spin type 5 being the most prevalent. No abstracts contained spin types 1, 2, 3, 4, 6, or 8, and no association was found between the presence of spin in an abstract and any particular study characteristic. Using the AMSTAR-2 quality appraisal instrument, 35 (34.3%) of the studies received a methodological quality rating as high, 42 (41.2%) as moderate, 11 (10.8%) as low, and 14 (13.7%) as critically low. CONCLUSIONS We found that's pin is present in only a small proportion of systematic reviews and meta-analyses covering the treatment of glaucoma. In comparison to studies in other fields of medicine, ophthalmology appears to be a leader in publishing systematic reviews and meta-analyses with low rates of spin occurring in the abstract.
Collapse
Affiliation(s)
| | - Elaine Lai
- Office of Medical Student Research
- Kansas City University of Medicine and Biosciences, College of Osteopathic Medicine, Joplin, MO
| | | | | | | | - Mahmoud A Khaimi
- Department of Ophthalmology Dean McGee Eye Institute, University of Oklahoma Health Sciences Center, Oklahoma City, OK
| | - Drew N Wright
- Samuel J. Wood Library & C. V. Starr Biomedical Information Center, Weill Cornell Medical College, New York, NY
| | - Micah Hartwell
- Office of Medical Student Research
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa
| | - Matt Vassar
- Office of Medical Student Research
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa
| |
Collapse
|