1
|
Wu J, Haile SS, Ho W, Klotz L, Yuan M, Lee JY, Krakowsky Y. 'Spin' in urology non-randomised studies comparing therapeutic interventions: a temporal analysis. BJU Int 2024; 133:656-664. [PMID: 38506328 DOI: 10.1111/bju.16342] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/21/2024]
Abstract
OBJECTIVE To determine the prevalence of 'spin' (i.e., reporting practices that distort the interpretation of results by positively reflecting negative findings or downplaying potential harms) strategies and level of spin in urological observational studies and whether the use of spin has changed over time. MATERIALS AND METHODS MEDLINE and Embase were searched to identify observational studies comparing therapeutic interventions in the top five urology journals and major urological subspecialty journals, published between 2000 and 2001, 2010 and 2011, and 2020 and 2021. RESULTS A total of 235 studies were included. Spin was identified in 81% of studies, with a median of two strategies per study. The most commonly used strategies were inadequate implication for clinical practice (30%), causal language or causal claim (29%), and use of linguistic spin (29%). Moderate to high levels of spin were found in 55% of conclusions. From 2000 to 2020, the average number of strategies used has significantly decreased each decade (H = 27.459, P < 0.001), and the median level of spin in conclusions was significantly lower in studies published in the 2020s and 2010s than in the 2000s (H = 11.649, P = 0.003). CONCLUSIONS Our results suggest that 81% of urological observational studies comparing therapeutic interventions contained spin. Over the past two decades, the use of spin has significantly declined, but this remains an area for improvement, with 70% of included studies published in the 2020s employing spin. Medical writing should scrupulously avoid words or phrases that are not supported by data in the manuscript.
Collapse
Affiliation(s)
- Jeremy Wu
- Temerty Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Samuel S Haile
- Temerty Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Wilson Ho
- Temerty Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Laurence Klotz
- Division of Urology, Department of Surgery, University of Toronto, Toronto, Ontario, Canada
- Division of Urology, Department of Surgery, Sunnybrook Hospital, Toronto, Ontario, Canada
| | - Morgan Yuan
- Division of Plastic, Reconstructive & Aesthetic Surgery, Department of Surgery, University of Toronto, Toronto, Ontario, Canada
| | - Jason Y Lee
- Division of Urology, Department of Surgery, University of Toronto, Toronto, Ontario, Canada
- Division of Urology, Department of Surgery, University Health Network, Toronto, Ontario, Canada
| | - Yonah Krakowsky
- Division of Urology, Department of Surgery, University of Toronto, Toronto, Ontario, Canada
- Division of Urology, Department of Surgery, Women's College Hospital and Mount Sinai Hospital, Toronto, Ontario, Canada
| |
Collapse
|
2
|
Lan M, Cheng M, Hoang L, Ter Riet G, Kilicoglu H. Automatic categorization of self-acknowledged limitations in randomized controlled trial publications. J Biomed Inform 2024; 152:104628. [PMID: 38548008 DOI: 10.1016/j.jbi.2024.104628] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2023] [Revised: 03/09/2024] [Accepted: 03/24/2024] [Indexed: 04/05/2024]
Abstract
OBJECTIVE Acknowledging study limitations in a scientific publication is a crucial element in scientific transparency and progress. However, limitation reporting is often inadequate. Natural language processing (NLP) methods could support automated reporting checks, improving research transparency. In this study, our objective was to develop a dataset and NLP methods to detect and categorize self-acknowledged limitations (e.g., sample size, blinding) reported in randomized controlled trial (RCT) publications. METHODS We created a data model of limitation types in RCT studies and annotated a corpus of 200 full-text RCT publications using this data model. We fine-tuned BERT-based sentence classification models to recognize the limitation sentences and their types. To address the small size of the annotated corpus, we experimented with data augmentation approaches, including Easy Data Augmentation (EDA) and Prompt-Based Data Augmentation (PromDA). We applied the best-performing model to a set of about 12K RCT publications to characterize self-acknowledged limitations at larger scale. RESULTS Our data model consists of 15 categories and 24 sub-categories (e.g., Population and its sub-category DiagnosticCriteria). We annotated 1090 instances of limitation types in 952 sentences (4.8 limitation sentences and 5.5 limitation types per article). A fine-tuned PubMedBERT model for limitation sentence classification improved upon our earlier model by about 1.5 absolute percentage points in F1 score (0.821 vs. 0.8) with statistical significance (p<.001). Our best-performing limitation type classification model, PubMedBERT fine-tuning with PromDA (Output View), achieved an F1 score of 0.7, improving upon the vanilla PubMedBERT model by 2.7 percentage points, with statistical significance (p<.001). CONCLUSION The model could support automated screening tools which can be used by journals to draw the authors' attention to reporting issues. Automatic extraction of limitations from RCT publications could benefit peer review and evidence synthesis, and support advanced methods to search and aggregate the evidence from the clinical trial literature.
Collapse
Affiliation(s)
- Mengfei Lan
- School of Information Sciences, University of Illinois Urbana-Champaign, 501 Daniel Street, Champaign, 61820, IL, USA
| | - Mandy Cheng
- Department of Biological Sciences, Binghamton University, 4400 Vestal Parkway East, New York City, 13902, NY, USA
| | - Linh Hoang
- School of Information Sciences, University of Illinois Urbana-Champaign, 501 Daniel Street, Champaign, 61820, IL, USA
| | - Gerben Ter Riet
- Faculty of Health, Amsterdam University of Applied Sciences, Tafelbergweg 51, Amsterdam, 1105 BD, The Netherlands
| | - Halil Kilicoglu
- School of Information Sciences, University of Illinois Urbana-Champaign, 501 Daniel Street, Champaign, 61820, IL, USA.
| |
Collapse
|
3
|
Ott DE. Limitations in Medical Research: Recognition, Influence, and Warning. JSLS 2024; 28:e2023.00049. [PMID: 38405216 PMCID: PMC10882193 DOI: 10.4293/jsls.2023.00049] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/27/2024] Open
Abstract
Background As the number of limitations increases in a medical research article, their consequences multiply and the validity of findings decreases. How often do limitations occur in a medical article? What are the implications of limitation interaction? How often are the conclusions hedged in their explanation? Objective To identify the number, type, and frequency of limitations and words used to describe conclusion(s) in medical research articles. Methods Search, analysis, and evaluation of open access research articles from 2021 and 2022 from the Journal of the Society of Laparoscopic and Robotic Surgery and 2022 Surgical Endoscopy for type(s) of limitation(s) admitted to by author(s) and the number of times they occurred. Limitations not admitted to were found, obvious, and not claimed. An automated text analysis was performed for hedging words in conclusion statements. A limitation index score is proposed to gauge the validity of statements and conclusions as the number of limitations increases. Results A total of 298 articles were reviewed and analyzed, finding 1,764 limitations. Four articles had no limitations. The average was between 3.7% and 6.9% per article. Hedging, weasel words and words of estimative probability description was found in 95.6% of the conclusions. Conclusions Limitations and their number matter. The greater the number of limitations and ramifications of their effects, the more outcomes and conclusions are affected. Wording ambiguity using hedging or weasel words shows that limitations affect the uncertainty of claims. The limitation index scoring method shows the diminished validity of finding(s) and conclusion(s).
Collapse
|
4
|
Stöckli S, Koufatzidou M, Seehra J, Pandis N. The reporting of study limitations in randomized controlled trials published in the leading dental journals: Is it sufficient? J Dent 2023; 136:104603. [PMID: 37414393 DOI: 10.1016/j.jdent.2023.104603] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2023] [Accepted: 07/03/2023] [Indexed: 07/08/2023] Open
Abstract
OBJECTIVES Adequate reporting of limitations is crucial to enable clinicians to accurately interpret the clinical trial findings. This meta-epidemiological study aimed to evaluate whether study limitations are reported in full-text articles of randomized controlled trials (RCTs) published in the leading dental journals. Associations between the trial characteristics and the reporting of limitations were also explored. METHODS RCTs published between 1st January and 31st December in the years 2011, 2016 and 2021 were identified from the 12 high impact factor dental journals (general and specialty). RCT characteristics were extracted, and reporting of limitations was recorded for the selected studies. Descriptive statistics were calculated for trial and limitations related characteristics. Univariable ordinal logistic regression models were fit to explore univariable associations between trial characteristics and reporting of limitations. RESULTS Two hundred and sixty-seven trials were included and analyzed. Most RCTs were published in 2021 (40.8%), had authors based in Europe (50.2%), did not have a statistician involved (88.8%) and assessed a procedure/method intervention type (40.5%). The reporting of trial limitations was generally sub-optimal. More recent trials and studies with a published protocol were associated with better reporting of limitations. The type of journal was a significant predictor for limitation reporting. CONCLUSIONS Within this study, the clear reporting of study limitations in the manuscripts of dental RCTs is sub-optimal and requires improvement. CLINICAL SIGNIFICANCE The reporting of limitations should not be viewed as a weakness of a trial but due diligence, so clinicians can fully interpret the impact of these limitations on both the validity and generalisability of the results.
Collapse
Affiliation(s)
- Simone Stöckli
- Department of Orthodontics and Dentofacial Orthopedics, Dental School/Medical Faculty, University of Bern, Freiburgstrasse7, CH, 3010, Bern, Switzerland
| | | | - Jadbinder Seehra
- Department of Orthodontics, Faculty of Dentistry, Oral & Craniofacial Sciences, King's College London, Department of Orthodontics, Floor 25, Guy's Hospital, Guy's and St Thomas NHS Foundation Trust, London, SE1 9RT, United Kingdom
| | - Nikolaos Pandis
- Department of Orthodontics and Dentofacial Orthopedics, Dental School/Medical Faculty, University of Bern, Freiburgstrasse7, CH, 3010, Bern, Switzerland.
| |
Collapse
|
5
|
Sargeant JM, Ruple A, Selmic LE, O'Connor AM. The standards of reporting trials in pets (PetSORT): Explanation and elaboration. Front Vet Sci 2023; 10:1137781. [PMID: 37065227 PMCID: PMC10103631 DOI: 10.3389/fvets.2023.1137781] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2023] [Accepted: 03/01/2023] [Indexed: 04/03/2023] Open
Abstract
Well-designed randomized controlled trials (RCTs) provide the best evidence of the primary research designs for evaluating the effectiveness of interventions. However, if RCTs are incompletely reported, the methodological rigor with which they were conducted cannot be reliably evaluated and it may not be possible to replicate the intervention. Missing information also may limit the reader's ability to evaluate the external validity of a trial. Reporting guidelines are available for clinical trials in human healthcare (CONSORT), livestock populations (REFLECT), and preclinical experimental research involving animals (ARRIVE 2.0). The PetSORT guidelines complement these existing guidelines, providing recommendations for reporting controlled trials in pet dogs and cats. The rationale and scientific background are explained for each of the 25 items in the PetSORT reporting recommendations checklist, with examples from well-reported trials.
Collapse
Affiliation(s)
- Jan M. Sargeant
- Department of Population Medicine, Ontario Veterinary College, University of Guelph, Guelph, ON, Canada
| | - Audrey Ruple
- Department of Population Health Sciences, Virginia-Maryland College of Veterinary Medicine, Virginia Tech, Blacksburg, VA, United States
- *Correspondence: Audrey Ruple
| | - Laura E. Selmic
- Department of Veterinary Clinical Sciences, College of Veterinary Medicine, The Ohio State University, Columbus, OH, United States
| | - Annette M. O'Connor
- Department of Large Animal Clinical Sciences, College of Veterinary Medicine, Michigan State University, East Lansing, MI, United States
| |
Collapse
|
6
|
Carl J, Barratt J, Arbour-Nicitopoulos KP, Barnett LM, Dudley DA, Holler P, Keegan R, Kwan M, Scurati R, Sum RKW, Wainwright N, Cairney J. Development, explanation, and presentation of the Physical Literacy Interventions Reporting Template (PLIRT). Int J Behav Nutr Phys Act 2023; 20:21. [PMID: 36805731 PMCID: PMC9938627 DOI: 10.1186/s12966-023-01423-3] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2022] [Accepted: 02/07/2023] [Indexed: 02/19/2023] Open
Abstract
BACKGROUND The physical literacy (PL) concept integrates different personal (e.g., physical, cognitive, psychological/affective, social) determinants of physical activity and has received growing attention recently. Although practical efforts increasingly adopt PL as a guiding concept, latest evidence has shown that PL interventions often lack specification of important theoretical foundations and basic delivery information. Therefore, the goal of the present study was to develop an expert-based template that supports researchers and practitioners in planning and reporting PL interventions. METHODS The development process was informed by Moher et al.'s guidance for the development of research reporting guidelines. We composed a group of ten distinguished experts on PL. In two face-to-face meetings, the group first discussed a literature-driven draft of reporting items. In the second stage, the experts anonymously voted and commented on the items in two rounds (each leading to revisions) until consensus was reached. RESULTS The panel recommended that stakeholders of PL initiatives should tightly interlock interventional aspects with PL theory while ensuring consistency throughout all stages of intervention development. The Physical Literacy Interventions Reporting Template (PLIRT) encompasses a total of 14 items (two additional items for mixed-methods studies) in six different sections: title (one item), background and definition (three items), assessment (one item each for quantitative and qualitative studies), design and content (five items), evaluation (one item plus one item each for quantitative and qualitative studies), discussion and conclusion (two items). CONCLUSION The PLIRT was designed to facilitate improved transparency and interpretability in reports on PL interventions. The template has the potential to close gaps between theory and practice, thereby contributing to more holistic interventions for the fields of physical education, sport, and health.
Collapse
Affiliation(s)
- Johannes Carl
- Department of Sport Science and Sport, Friedrich-Alexander University Erlangen-Nürnberg, Gebbertstraße 123b, 91058, Erlangen, Germany.
| | - Jaime Barratt
- School of Human Movement and Nutrition Sciences, The University of Queensland, Qld, 4072, Brisbane, Australia
| | - Kelly P Arbour-Nicitopoulos
- Faculty of Kinesiology and Physical Education, University of Toronto, 55 Harbord Street, ON, Toronto, Canada
| | - Lisa M Barnett
- Faculty of Health, Institute for Physical Activity and Nutrition, School of Health and Social Development, Deakin University, 221 Burwood Hwy, Burwood, 3147, Melbourne, Australia
| | - Dean A Dudley
- School of Human Movement and Nutrition Sciences, The University of Queensland, Qld, 4072, Brisbane, Australia.,Macquarie School of Education, Macquarie University, 1 University Ave, 2109, Sydney, Australia
| | - Peter Holler
- FH JOANNEUM, Institute of Health and Tourism Management, Kaiser-Franz-Josef-Straße 24, 8344, Bad Gleichenberg, Austria
| | - Richard Keegan
- Faculty of Health Canberra, Research Institute for Sport and Exercise (UC-RISE), University of Canberra, ACT, 2617, Canberra, Australia
| | - Matthew Kwan
- Faculty of Social Sciences, Brock University, Child and Youth Studies, 1812 Sir Isaac Brock Way , ON, St. Catharines, Canada
| | - Raffaele Scurati
- Department of Biomedical Sciences for Health, University of Milan, Via Kramer 4/4A, 20129, Milano, Italy
| | - Raymond Kim-Wai Sum
- Department of Sports Science and Physical Education, Faculty of Education, The Chinese University of Hong Kong, G09, Kwok Sports Building, Hong Kong, Hong Kong SAR
| | - Nalda Wainwright
- Wales Academy for Health and Physical Literacy, University of Wales Trinity Saint David , College Road, Wales, SA31 3EP, Carmarthen, Great Britain
| | - John Cairney
- School of Human Movement and Nutrition Sciences, The University of Queensland, Qld, 4072, Brisbane, Australia
| |
Collapse
|
7
|
Barata J, da Cunha PR, de Figueiredo AD. Self-reporting Limitations in Information Systems Design Science Research. BUSINESS & INFORMATION SYSTEMS ENGINEERING 2022. [DOI: 10.1007/s12599-022-00782-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/07/2022]
|
8
|
Koufatzidou M, Karveleas I, Seehra J, Pandis N. The clear reporting of study limitations in the reports of orthodontic randomized controlled trials is not routinely undertaken: A systematic search and review. Am J Orthod Dentofacial Orthop 2022; 162:e295-e301. [DOI: 10.1016/j.ajodo.2022.08.016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2021] [Revised: 08/01/2022] [Accepted: 08/01/2022] [Indexed: 11/28/2022]
|
9
|
Mihailidis TH, Al-Benna S. Examining trends in the evidence base for the treatment of burns and a quality assessment of randomised controlled trials over an 11-year period. Burns 2022; 48:753-761. [PMID: 34998668 DOI: 10.1016/j.burns.2021.11.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2020] [Revised: 10/30/2021] [Accepted: 11/05/2021] [Indexed: 12/15/2022]
Abstract
BACKGROUND Previous articles assessed the evidence-base for the treatment of burns, but the latest was published in 2010, examining data up to and inclusive of 2008. The aim of this article is to examine the trend in the number of high-evidence publications over the subsequent 11-year period and quality-assess RCTs within this timeframe. MATERIALS AND METHODS All articles published in Burns and Journal of Burn Care and Research (JBCR) were identified using PubMed Search Tools and its Single Citation Matcher function. These journals were manually screened from 01/01/2009-01/06/2020 inclusive. Additionally, a PubMed search was conducted searching for RCTs and meta-analyses in English with the MESH term burns to identify meta-analyses and RCTs in all other journals. The reporting of RCTs was assessed using a modified CONsolidated Standards of Reporting Trials (CONSORT) checklist. RESULTS A total of 5145 articles were evaluated from Burns and JBCR, with 3230 (62.78%) from Burns and 1915 (37.22%) from JBCR. 0.012% were meta-analyses of RCTs, 0.30% were other meta-analyses, and 2.52% were initially identified as RCTs. Whilst a significant increase in the number of high-evidence publications is observed, these represent 2.83% (n = 237) of the total. An additional 95 RCTs were identified in other journals, 58 being included in quality-analysis. A total 128 RCTs were thus eligible for quality-assessment, the most popular individual topic being wound healing (n = 28; 21.88%). The most highly reported criterion was listed inclusion and exclusion criteria (n = 111; 86.72%) and the least reported criterion was allocation concealment (n = 22; 13.92%). CONCLUSIONS This study observes a positive trend in high-evidence publications. The reporting of several CONSORT criteria in RCTs remains poor. Observation to standard reporting guidelines is advocated to improve the quality of reporting.
Collapse
Affiliation(s)
- Toni Huw Mihailidis
- Division of Plastic and Reconstructive Surgery, Faculty of Medicine and Health Sciences, Stellenbosch University and Tygerberg Academic Hospital, Cape Town, South Africa
| | - Sammy Al-Benna
- Division of Plastic and Reconstructive Surgery, Faculty of Medicine and Health Sciences, Stellenbosch University and Tygerberg Academic Hospital, Cape Town, South Africa.
| |
Collapse
|
10
|
A comparative assessment of the dentoskeletal effects of clear aligners vs miniplate-supported posterior intrusion with fixed appliances in adult patients with anterior open bite. A multicenter, retrospective cohort study. Am J Orthod Dentofacial Orthop 2022; 162:214-228.e4. [PMID: 35339320 DOI: 10.1016/j.ajodo.2021.03.022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2020] [Revised: 03/01/2021] [Accepted: 03/01/2021] [Indexed: 11/23/2022]
Abstract
INTRODUCTION This study aimed to retrospectively evaluate the dentoskeletal effects of clear aligners (Invisalign) vs miniplate-supported posterior intrusion (MSPI) and identify factors associated with posttreatment overbite in adults with anterior open bite. METHODS Twenty-nine patients treated with Invisalign and 24 with MSPI combined with full-fixed orthodontic appliances were included from 5 orthodontic practices. Pretreatment and posttreatment lateral cephalometric measurements were included as outcomes. Comparisons across groups and identification of final overbite predictors were assessed with regression modeling and machine learning techniques. RESULTS MSPI induced significantly greater maxillary molar intrusion (1.5 mm; 95% confidence interval [CI], 0.83-2.17; P <0.001), with subsequent reduction of anterior face height (ANS-Me) (-2.77 mm; 95% CI, -3.64 to -1.91; P <0.001), Mp-SN° (-1.95°; 95% CI, -2.77 to -1.12; P <0.001), and ANB° (-1.69°; 95% CI, -2.44 to -0.94; P <0.001) compared with Invisalign. MSPI resulted in a significantly larger increase in SNB° (0.94°; 95% CI, 0.23-1.65; P = 0.01) and point-Pog projection (2.45 mm; 95% CI, 1.12-3.77; P = 0.001). Compared with MSPI, Invisalign had a significantly greater increase in the distance of maxillary (1.05 mm; 95% CI, 0.38-1.72; P = 0.003) and mandibular (0.9 mm; 95% CI, 0.19-1.60; P = 0.01) incisal edges relative to their apical bases, with borderline greater lingual tipping of only the maxillary incisors (2.82°; 95% CI, -0.44 to 6.09; P = 0.09). Appliance type and initial overbite were significant final overbite predictors across all models. However, this difference was only evident in male patients (males [1.65; 95% CI, 0.99-2.32; P <0.001]; female [-0.04; 95% CI, -0.52 to 0.44; P = 0.87]). CONCLUSIONS Both appliances effectively improve overbite. MSPI applied the correction via molar intrusion and counterclockwise mandibular autorotation, whereas Invisalign via maxillary and mandibular incisor extrusion.
Collapse
|
11
|
Brown FN, Mackie AR, He Q, Branch A, Sarkar A. Protein-saliva interactions: a systematic review. Food Funct 2021; 12:3324-3351. [PMID: 33900320 DOI: 10.1039/d0fo03180a] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2022]
Abstract
Food industries are challenged to reformulate foods and beverages with higher protein contents to lower fat and sugar content. However, increasing protein concentration can reduce sensory acceptability due to astringency perception. Since the properties of food-saliva mixtures govern mouthfeel perception, understanding how saliva and protein interact is key to guide development of future protein-rich reformulations with optimal sensory attributes. Hence, this systematic review investigated protein-saliva interaction using both model and real human saliva, including a quality assessment. A literature search of five databases (Medline, Pubmed, Embase, Scopus and Web of Science) was undertaken covering the last 20 years, yielding 36 604 articles. Using pre-defined criteria, this was reduced to a set of 33 articles with bulk protein solutions (n = 17), protein-stabilized emulsions (n = 13) and protein-rich food systems (n = 4). Interaction of dairy proteins, lysozyme and gelatine with model or human saliva dominated the literature. The pH was shown to have a strong effect on electrostatic interaction of proteins with negatively-charged salivary mucins, with greater interactions occurring below the isoelectric point of proteins. The effect of protein concentration was unclear due to the limited range of concentrations being studied. Most studies employed a 1 : 1 w/w protein : saliva ratio, which is not representative of true oral conditions. The interaction between protein and saliva appears to affect mouthfeel through aggregation and increased friction. The searches identified a gap in research on plant proteins. Accurate simulation of in vivo oral conditions should clarify understanding of protein-saliva interaction and its influence on sensory perception.
Collapse
Affiliation(s)
- Frances N Brown
- Food Colloids and Bioprocessing Group, School of Food Science and Nutrition, University of Leeds, Leeds, UK.
| | | | | | | | | |
Collapse
|
12
|
Kalsi AS, Moreno F, Petridis H. Biomarkers associated with periodontitis and peri-implantitis: a systematic review. J Periodontal Implant Sci 2021; 51:3-17. [PMID: 33634611 PMCID: PMC7920841 DOI: 10.5051/jpis.1902840142] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2019] [Revised: 06/15/2020] [Accepted: 08/17/2020] [Indexed: 01/18/2023] Open
Abstract
Purpose The pathology of peri-implantitis is still not fully understood and there have been recent challenges to the consensus on its aetiology and pathology, especially in comparison with periodontitis. The assessment of biomarkers allows a comparison of the pathology of these diseases. The aim of this systematic review was to answer the research question: “Is there a difference in the biomarkers associated with peri-implantitis compared with periodontitis in adult humans?” Methods Electronic databases were searched and screened, and a manual search was also undertaken. The inclusion criteria were adults with peri-implantitis who had been compared to adults with periodontitis with the outcome of biomarkers assessed via biopsies or crevicular fluid samples in primary or secondary care settings, as recorded in case-control, case series and retrospective, prospective and cross-sectional observational studies. Two reviewers independently screened titles and abstracts and assessed full text articles for eligibility and inclusion. Both reviewers independently extracted data and assessed risk of bias. Differences in biomarker levels were the primary outcome and a narrative review was undertaken due to the heterogeneity of studies. Results In total, 2,374 articles were identified in the search, of which 111 full-text articles were assessed for eligibility and 13 were included in the qualitative synthesis. Five of the 13 included studies were deemed to be at high risk of bias, with the others having moderate risk. All studies were cross-sectional and performed at university hospitals. Nine of the 13 included studies found significant differences in the levels of biomarkers or their ratios between peri-implantitis and periodontitis. Four of the studies found no significant differences. Conclusions Within the limitations of the included studies, it appears that there may be a difference in biomarker levels and ratios between peri-implantitis and periodontitis, suggesting that these disease processes are somewhat distinct.
Collapse
Affiliation(s)
- Amardip Singh Kalsi
- Department of Restorative Dentistry, Cambridge University Hospitals, Cambridge, UK.
| | - Federico Moreno
- Unit of Periodontics, UCL Eastman Dental Institute, London, UK
| | | |
Collapse
|
13
|
Hogan KO, Fraga GR. Compliance With Standards for STARD 2015 Reporting Recommendations in Pathology. Am J Clin Pathol 2020; 154:828-836. [PMID: 32789451 DOI: 10.1093/ajcp/aqaa103] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022] Open
Abstract
OBJECTIVES Lack of experimental reproducibility has led to growing interest in guidelines to enhance completeness and transparency in research reporting. This retrospective survey sought to determine compliance with Standards for Reporting of Diagnostic Accuracy Studies (STARD) 2015 statement in the recent pathology scientific literature. METHODS Two raters independently scored 171 pathology diagnostic accuracy studies for compliance with 34 STARD items and subcomponents. Overall adherence was calculated as a proportion after excluding nonapplicable items. RESULTS After excluding nonapplicable items, there was 50% overall adherence to STARD reporting recommendations. In total, 15.44 ± 3.59 items were reported per article (range, 4-28 out of maximum possible of 34). There was substantial heterogeneity in individual item reporting, with greater than 75% reporting in eight of 34 items and less than 25% reporting in 11 of 34 items. Less than 10% of articles reported hypotheses, subgroup analyses for confounding, sample size calculations, subject flow diagrams, study registrations, and links to full study protocols. Significantly more items were reported in articles from journals that endorsed STARD (16.14 vs 14.84, P = .0175). CONCLUSIONS These findings demonstrate incomplete reporting of essential items in pathology diagnostic accuracy studies. More vigorous enforcement of reporting checklists might improve adherence to minimum reporting standards.
Collapse
Affiliation(s)
- Keenan O Hogan
- Department of Pathology and Laboratory Medicine, University of Kansas School of Medicine, Kansas City
| | - Garth R Fraga
- Department of Pathology and Laboratory Medicine, University of Kansas School of Medicine, Kansas City
| |
Collapse
|
14
|
Alvarez G, Núñez-Cortés R, Solà I, Sitjà-Rabert M, Fort-Vanmeerhaeghe A, Fernández C, Bonfill X, Urrútia G. Sample size, study length, and inadequate controls were the most common self-acknowledged limitations in manual therapy trials: A methodological review. J Clin Epidemiol 2020; 130:96-106. [PMID: 33144246 DOI: 10.1016/j.jclinepi.2020.10.018] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2020] [Revised: 10/23/2020] [Accepted: 10/28/2020] [Indexed: 02/06/2023]
Abstract
OBJECTIVES The aim of this study was to quantify and analyze the presence and type of self-acknowledged limitations (SALs) in a sample of manual therapy (MT) randomized controlled trials. STUDY DESIGN AND SETTING We randomly selected 120 MT trials. We extracted data related to SALs from the original reports and classified them into 12 categories. After data extraction, specific limitations within each category were identified. A descriptive analysis was performed using frequencies and percentages for qualitative variables. RESULTS The number of SALs per trial article ranged from 0 to 8, and more than two-thirds of trials acknowledged at least two different limitations. Despite its small proportion, 9% of trials did not report SALs. The most common limitation declared, in almost half of our sample, related to sample size (47.5%) followed by limitations related to study length and follow-up (33.3%) and inadequate controls (32.5%). CONCLUSION Our results indicate that at least two different limitations are consistently acknowledged in MT trial reports, the most common being those related to sample size, study length, follow-up, and inadequate controls. Analysis of the reasons behind the SALs gives some insights about the main difficulties in conducting research in this field and may help develop strategies to improve future research.
Collapse
Affiliation(s)
- Gerard Alvarez
- Iberoamerican Cochrane Centre - Sant Pau Biomedical Research Institute, IIB Sant Pau, Barcelona, Spain; Foundation Centre for Osteopathic Medicine Collaboration. Spain National Centre, Barcelona, Spain.
| | - Rodrigo Núñez-Cortés
- Department of Physical Therapy, Faculty of Medicine, University of Chile, Santiago, Chile
| | - Ivan Solà
- Iberoamerican Cochrane Centre - Sant Pau Biomedical Research Institute, IIB Sant Pau, Barcelona, Spain; CIBER Epidemiología y Salud Pública (CIBERESP), Spain
| | - Mercè Sitjà-Rabert
- Blanquerna School of Health Science (FCS), Ramon Llull University, Barcelona, Spain; Global Research on Wellbeing (GRoW) Research Group, Ramon Llull University, Barcelona, Spain
| | - Azahara Fort-Vanmeerhaeghe
- Blanquerna School of Health Science (FCS), Ramon Llull University, Barcelona, Spain; Blanquerna Faculty of Psychology, Education Sciences and Sport (FPCEE), Ramon Llull University, Barcelona, Spain
| | - Carles Fernández
- Blanquerna School of Health Science (FCS), Ramon Llull University, Barcelona, Spain; Global Research on Wellbeing (GRoW) Research Group, Ramon Llull University, Barcelona, Spain
| | - Xavier Bonfill
- Iberoamerican Cochrane Centre - Sant Pau Biomedical Research Institute, IIB Sant Pau, Barcelona, Spain; CIBER Epidemiología y Salud Pública (CIBERESP), Spain
| | - Gerard Urrútia
- Iberoamerican Cochrane Centre - Sant Pau Biomedical Research Institute, IIB Sant Pau, Barcelona, Spain; CIBER Epidemiología y Salud Pública (CIBERESP), Spain
| |
Collapse
|
15
|
Gopalani SV, Sedani AE, Janitz AE, Clifton SC, Stoner J, Peck J, Comiford A, Salvatore AL, Campbell J. HPV vaccination and Native Americans: protocol for a systematic review of factors associated with HPV vaccine uptake among American Indians and Alaska Natives in the USA. BMJ Open 2020; 10:e035658. [PMID: 32895265 PMCID: PMC7478049 DOI: 10.1136/bmjopen-2019-035658] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/10/2019] [Revised: 04/06/2020] [Accepted: 07/07/2020] [Indexed: 11/04/2022] Open
Abstract
INTRODUCTION The nine-valent human papillomavirus (HPV) vaccine could prevent an estimated 92% of the cancers attributable to HPV types targeted by the vaccine. However, uptake of the HPV vaccine among American Indian and Alaska Native (AI/AN) adolescents has been low. AI/ANs also bear a disproportionate burden of cervical and other HPV-associated cancers. Increasing HPV vaccination rates is a national priority, but reviews and national surveys on HPV vaccination factors are lacking for the AI/AN population. The objective of this systematic review is to assess factors associated with HPV vaccination among AI/ANs in the USA. METHODS AND ANALYSIS A systematic review is proposed to synthesise the current literature on HPV vaccination factors in AI/ANs from 1 July 2006 until 30 September 2019. As applicable, controlled vocabulary terms, keywords and special features (eg, limits, explode and focus) will be incorporated into database searches. To maximise the identification of relevant studies, citation indexes and databases that index dissertations, preprints and grey literature are included. Studies will be screened and selected independently in two stages. In stage 1, titles and abstracts will be screened. In stage 2, full-text articles will be screened and selected. A data extraction form and quality assessment tool will be piloted, revised and implemented. If available, measures of frequency and association will be presented. A narrative synthesis of the included studies will also be undertaken and reported. ETHICS AND DISSEMINATION As our review will use publicly available data and publications, an Institutional Review Board review will not be required. We will disseminate the findings from this review through peer-reviewed publication(s) and conference presentation(s). POTENTIAL AMENDMENTS In the event of amendments to the protocol, we will provide the date, rationale, and description of the change for each amendment. PROSPERO REGISTRATION NUMBER CRD42020156865.
Collapse
Affiliation(s)
- Sameer Vali Gopalani
- Department of Epidemiology and Biostatistics, University of Oklahoma Health Sciences Center, Oklahoma City, Oklahoma, USA
| | - Ami E Sedani
- Department of Biostatistics and Epidemiology, University of Oklahoma Health Sciences Center, Oklahoma City, Oklahoma, USA
| | - Amanda E Janitz
- Department of Biostatistics and Epidemiology, University of Oklahoma Health Sciences Center, Oklahoma City, Oklahoma, USA
| | - Shari C Clifton
- Robert M. Bird Health Sciences Library, University of Oklahoma Health Sciences Center, Oklahoma City, Oklahoma, USA
| | - Julie Stoner
- Department of Biostatistics and Epidemiology, University of Oklahoma Health Sciences Center, Oklahoma City, Oklahoma, USA
| | - Jennifer Peck
- Department of Biostatistics and Epidemiology, University of Oklahoma Health Sciences Center, Oklahoma City, Oklahoma, USA
| | - Ashley Comiford
- Community Health Promotion, Cherokee Nation, Tahlequah, Oklahoma, USA
| | - Alicia L Salvatore
- Value Institute, Christiana Care Health Services, Wilmington, Delaware, USA
| | - Janis Campbell
- Department of Biostatistics and Epidemiology, University of Oklahoma Health Sciences Center, Oklahoma City, Oklahoma, USA
| |
Collapse
|
16
|
Proulx G, Cattet M, Serfass TL, Baker SE. Updating the AIHTS Trapping Standards to Improve Animal Welfare and Capture Efficiency and Selectivity. Animals (Basel) 2020; 10:E1262. [PMID: 32722315 PMCID: PMC7459571 DOI: 10.3390/ani10081262] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2020] [Revised: 07/20/2020] [Accepted: 07/23/2020] [Indexed: 01/23/2023] Open
Abstract
In 1999, after pressure from the European Union, an Agreement on International Humane Trapping Standards (AIHTS) that would result in the banning of the steel-jawed leghold traps in the European Community, Canada, and Russia was signed. The United States implemented these standards through an Agreed Minute with the European Community. Over the last two decades, scientists have criticized the AIHTS for (1) omitting species that are commonly trapped; (2) threshold levels of trap acceptance that are not representative of state-of-the-art trap technology; (3) excluding popular traps which are commonly used by trappers although they are known to cause prolonged pain and stress to captured animals; (4) inadequate coverage of capture efficiency and species selectivity (i.e., number of captures of target and non-target species) performance. Concerns about the ability of standards and test procedures to ensure animal welfare, and about the implementation of standards, have also been voiced by wildlife biologists, managers, and conservation groups. In this review, we present a synopsis of current trapping standards and test procedures, and we compare the standards to a then contemporary 1985-1993 Canadian trap research and development program. On the basis of the above-noted concerns about AIHTS, and our experience as wildlife professionals involved in the capture of mammals, we formulated the following hypotheses: (1) the list of mammal species included in the AIHTS is incomplete; (2) the AIHTS have relatively low animal welfare performance thresholds of killing trap acceptance and do not reflect state-of-the-art trapping technology; (3) the AIHTS animal welfare indicators and injuries for restraining traps are insufficient; (4) the AIHTS testing procedures are neither thorough nor transparent; (5) the AIHTS protocols for the use of certified traps are inadequate; (6) the AIHTS procedures for the handling and dispatching of animals are nonexistent; (7) the AIHTS criteria to assess trap capture efficiency and species selectivity are inappropriate. We conclude that the AIHTS do not reflect state-of-the-art trapping technology, and assessment protocols need to be updated to include trap components and sets, animal handling and dispatching, and trap visit intervals. The list of traps and species included in the standards should be updated. Finally, the concepts of capture efficiency and trap selectivity should be developed and included in the standards. Based on our review, it is clear that mammal trapping standards need to be revisited to implement state-of-the-art trapping technology and improve capture efficiency and species selectivity. We believe that a committee of international professionals consisting of wildlife biologists and veterinarians with extensive experience in the capture of mammals and animal welfare could produce new standards within 1-2 years. We propose a series of measures to fund trap testing and implement new standards.
Collapse
Affiliation(s)
- Gilbert Proulx
- Alpha Wildlife Research & Management Ltd., 229 Lilac Terrace, Sherwood Park, AB T8H 1W3, Canada
| | - Marc Cattet
- RGL Recovery Wildlife Health & Veterinary Services, 415 Mount Allison Crescent, Saskatoon, SK S7H 4A6, Canada;
| | - Thomas L. Serfass
- Department of Biology and Natural Resources, Frostburg State University, Frostburg, MD 21532, USA;
| | - Sandra E. Baker
- Wildlife Conservation Research Unit, Department of Zoology, The Recanati-Kaplan Centre, University of Oxford, Tubney House, Abingdon Road, Tubney, Abingdon OX13 5QL, UK;
| |
Collapse
|
17
|
Percie du Sert N, Ahluwalia A, Alam S, Avey MT, Baker M, Browne WJ, Clark A, Cuthill IC, Dirnagl U, Emerson M, Garner P, Holgate ST, Howells DW, Hurst V, Karp NA, Lazic SE, Lidster K, MacCallum CJ, Macleod M, Pearl EJ, Petersen OH, Rawle F, Reynolds P, Rooney K, Sena ES, Silberberg SD, Steckler T, Würbel H. Reporting animal research: Explanation and elaboration for the ARRIVE guidelines 2.0. PLoS Biol 2020; 18:e3000411. [PMID: 32663221 PMCID: PMC7360025 DOI: 10.1371/journal.pbio.3000411] [Citation(s) in RCA: 989] [Impact Index Per Article: 247.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022] Open
Abstract
Improving the reproducibility of biomedical research is a major challenge. Transparent and accurate reporting is vital to this process; it allows readers to assess the reliability of the findings and repeat or build upon the work of other researchers. The ARRIVE guidelines (Animal Research: Reporting In Vivo Experiments) were developed in 2010 to help authors and journals identify the minimum information necessary to report in publications describing in vivo experiments. Despite widespread endorsement by the scientific community, the impact of ARRIVE on the transparency of reporting in animal research publications has been limited. We have revised the ARRIVE guidelines to update them and facilitate their use in practice. The revised guidelines are published alongside this paper. This explanation and elaboration document was developed as part of the revision. It provides further information about each of the 21 items in ARRIVE 2.0, including the rationale and supporting evidence for their inclusion in the guidelines, elaboration of details to report, and examples of good reporting from the published literature. This document also covers advice and best practice in the design and conduct of animal studies to support researchers in improving standards from the start of the experimental design process through to publication.
Collapse
Affiliation(s)
| | - Amrita Ahluwalia
- The William Harvey Research Institute, London, United Kingdom
- Barts Cardiovascular CTU, Queen Mary University of London, London, United Kingdom
| | - Sabina Alam
- Taylor & Francis Group, London, United Kingdom
| | - Marc T. Avey
- Health Science Practice, ICF, Durham, North Carolina, United States of America
| | - Monya Baker
- Nature, San Francisco, California, United States of America
| | | | | | - Innes C. Cuthill
- School of Biological Sciences, University of Bristol, Bristol, United Kingdom
| | - Ulrich Dirnagl
- QUEST Center for Transforming Biomedical Research, Berlin Institute of Health & Department of Experimental Neurology, Charite Universitätsmedizin Berlin, Berlin, Germany
| | - Michael Emerson
- National Heart and Lung Institute, Imperial College London, London, United Kingdom
| | - Paul Garner
- Centre for Evidence Synthesis in Global Health, Clinical Sciences Department, Liverpool School of Tropical Medicine, Liverpool, United Kingdom
| | - Stephen T. Holgate
- Clinical and Experimental Sciences, University of Southampton, Southampton, United Kingdom
| | - David W. Howells
- Tasmanian School of Medicine, University of Tasmania, Hobart, Australia
| | | | - Natasha A. Karp
- Data Sciences & Quantitative Biology, Discovery Sciences, R&D, AstraZeneca, Cambridge, United Kingdom
| | | | | | | | - Malcolm Macleod
- Centre for Clinical Brain Sciences, University of Edinburgh, Edinburgh, United Kingdom
| | | | - Ole H. Petersen
- Academia Europaea Knowledge Hub, Cardiff University, Cardiff, United Kingdom
| | | | - Penny Reynolds
- Statistics in Anesthesiology Research (STAR) Core, Department of Anesthesiology, College of Medicine, University of Florida, Gainesville, Florida, United States of America
| | - Kieron Rooney
- Discipline of Exercise and Sport Science, Faculty of Medicine and Health, University of Sydney, Sydney, Australia
| | - Emily S. Sena
- Centre for Clinical Brain Sciences, University of Edinburgh, Edinburgh, United Kingdom
| | - Shai D. Silberberg
- National Institute of Neurological Disorders and Stroke, Bethesda, Maryland, United States of America
| | | | - Hanno Würbel
- Veterinary Public Health Institute, Vetsuisse Faculty, University of Bern, Bern, Switzerland
| |
Collapse
|
18
|
Josefsson J, Hiron M, Arlt D, Auffret AG, Berg Å, Chevalier M, Glimskär A, Hartman G, Kačergytė I, Klein J, Knape J, Laugen AT, Low M, Paquet M, Pasanen‐Mortensen M, Rosin ZM, Rubene D, Żmihorski M, Pärt T. Improving scientific rigour in conservation evaluations and a plea deal for transparency on potential biases. Conserv Lett 2020. [DOI: 10.1111/conl.12726] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022] Open
Affiliation(s)
- Jonas Josefsson
- Department of Ecology Swedish University of Agricultural Sciences Uppsala Sweden
| | - Matthew Hiron
- Department of Ecology Swedish University of Agricultural Sciences Uppsala Sweden
| | - Debora Arlt
- Department of Ecology Swedish University of Agricultural Sciences Uppsala Sweden
| | - Alistair G. Auffret
- Department of Ecology Swedish University of Agricultural Sciences Uppsala Sweden
| | - Åke Berg
- Swedish Biodiversity Centre Swedish University of Agricultural Sciences Uppsala Sweden
| | - Mathieu Chevalier
- Department of Ecology Swedish University of Agricultural Sciences Uppsala Sweden
- Department of Ecology and Evolution University of Lausanne Lausanne Switzerland
| | - Anders Glimskär
- Department of Ecology Swedish University of Agricultural Sciences Uppsala Sweden
| | - Göran Hartman
- Department of Ecology Swedish University of Agricultural Sciences Uppsala Sweden
| | - Ineta Kačergytė
- Department of Ecology Swedish University of Agricultural Sciences Uppsala Sweden
| | - Julian Klein
- Department of Ecology Swedish University of Agricultural Sciences Uppsala Sweden
| | - Jonas Knape
- Department of Ecology Swedish University of Agricultural Sciences Uppsala Sweden
| | - Ane T. Laugen
- Department of Ecology Swedish University of Agricultural Sciences Uppsala Sweden
- Department of Natural Sciences, Centre for Coastal Research University of Agder Kristiansand Norway
| | - Matthew Low
- Department of Ecology Swedish University of Agricultural Sciences Uppsala Sweden
| | - Matthieu Paquet
- Department of Ecology Swedish University of Agricultural Sciences Uppsala Sweden
| | - Marianne Pasanen‐Mortensen
- Department of Ecology Swedish University of Agricultural Sciences Uppsala Sweden
- Department of Zoology Stockholm University Stockholm Sweden
| | - Zuzanna M. Rosin
- Department of Ecology Swedish University of Agricultural Sciences Uppsala Sweden
- Department of Cell Biology Institute of Experimental Biology, Faculty of Biology, Adam Mickiewicz University Umultowska Poznań Poland
| | - Diana Rubene
- Department of Ecology Swedish University of Agricultural Sciences Uppsala Sweden
- Department of Crop Production Ecology Swedish University of Agricultural Sciences Uppsala Sweden
| | - Michał Żmihorski
- Department of Ecology Swedish University of Agricultural Sciences Uppsala Sweden
- Mammal Research Institute, Polish Academy of Sciences Białowieża Poland
| | - Tomas Pärt
- Department of Ecology Swedish University of Agricultural Sciences Uppsala Sweden
| |
Collapse
|
19
|
Abstract
Study limitations represent weaknesses within a research design that may influence outcomes and conclusions of the research. Researchers have an obligation to the academic community to present complete and honest limitations of a presented study. Too often, authors use generic descriptions to describe study limitations. Including redundant or irrelevant limitations is an ineffective use of the already limited word count. A meaningful presentation of study limitations should describe the potential limitation, explain the implication of the limitation, provide possible alternative approaches, and describe steps taken to mitigate the limitation. This includes placing research findings within their proper context to ensure readers do not overemphasize or minimize findings. A more complete presentation will enrich the readers' understanding of the study's limitations and support future investigation.
Collapse
Affiliation(s)
- Paula T Ross
- Medical School, University of Michigan, Ann Arbor, MI, USA.
| | | |
Collapse
|
20
|
Avidan MS, Ioannidis JPA, Mashour GA. Independent discussion sections for improving inferential reproducibility in published research. Br J Anaesth 2019; 122:413-420. [PMID: 30857597 PMCID: PMC6435840 DOI: 10.1016/j.bja.2018.12.010] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2018] [Revised: 12/11/2018] [Accepted: 12/13/2018] [Indexed: 01/15/2023] Open
Abstract
There is a reproducibility crisis in science. There are many potential contributors to replication failure in research across the translational continuum. In this perspective piece, we focus on the narrow topic of inferential reproducibility. Although replication of methods and results is necessary to demonstrate reproducibility, it is not sufficient. Also fundamental is consistent interpretation in the Discussion section. Current deficiencies in the Discussion sections of manuscripts might limit the inferential reproducibility of scientific research. Lack of contextualisation using systematic reviews, overinterpretation and misinterpretation of results, and insufficient acknowledgement of limitations are common problems in Discussion sections; these deficiencies can harm the translational process. Proposed solutions include eliminating or not reading Discussions, writing accompanying editorials, and post-publication review and comments; however, none of these solutions works very well. A second Discussion written by an independent author with appropriate expertise in research methodology is a new testable solution that could help probe inferential reproducibility, and address some deficiencies in primary Discussion sections.
Collapse
Affiliation(s)
- Michael S Avidan
- Department of Anesthesiology, Washington University School of Medicine, St Louis, MO, USA.
| | - John P A Ioannidis
- Departments of Health Research and Policy, Medicine, Biomedical Data Science, and Statistics, Meta-Research Innovation Center, Stanford University, Palo Alto, CA, USA
| | - George A Mashour
- Department of Anesthesiology, University of Michigan, Ann Arbor, MI, USA
| |
Collapse
|
21
|
Aiman U, Rahman SZ. Standard of reporting animal-based experimental research in Indian Journal of Pharmacology. Indian J Pharmacol 2015; 47:514-7. [PMID: 26600640 PMCID: PMC4621672 DOI: 10.4103/0253-7613.165188] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
Objective: The objective of present study was to survey and determine the reporting standards of animal studies published during three years from 2012 to 2014 in the Indian Journal of Pharmacology (IJP). Material and Methods: All issues of IJP published in the year 2012, 2013 and 2014 were reviewed to identify animal studies. Each animal study was searched for 15 parameters specifically designed to review standards of animal experimentation and research methodology. Observation: All published studies had clearly defined aims and objectives while a statement on ethical clearance about the study protocol was provided in 97% of papers. Information about animal strain and sex was given in 91.8% and 90% of papers respectively. Age of experimental animals was mentioned by 44.4% papers while source of animals was given in 50.8% papers. Randomization was reported by 37.4% while 9.9% studies reported blinding. Only 3.5% studies mentioned any limitations of their work. Conclusion: Present study demonstrates relatively good reporting standards in animal studies published in IJP. The items which need to be improved are randomization, blinding, sample size calculation, stating the limitations of study, sources of support and conflict of interest. The knowledge shared in the present paper could be used for better reporting of animal based experiments.
Collapse
Affiliation(s)
- Umme Aiman
- Department of Pharmacology, Jawaharlal Nehru Medical College, Aligarh Muslim University, Aligarh, Uttar Pradesh, India
| | - Syed Ziaur Rahman
- Department of Pharmacology, Jawaharlal Nehru Medical College, Aligarh Muslim University, Aligarh, Uttar Pradesh, India
| |
Collapse
|
22
|
Coyne KS, LoCasale RJ, Datto CJ, Sexton CC, Yeomans K, Tack J. Opioid-induced constipation in patients with chronic noncancer pain in the USA, Canada, Germany, and the UK: descriptive analysis of baseline patient-reported outcomes and retrospective chart review. CLINICOECONOMICS AND OUTCOMES RESEARCH 2014; 6:269-81. [PMID: 24904217 PMCID: PMC4041290 DOI: 10.2147/ceor.s61602] [Citation(s) in RCA: 86] [Impact Index Per Article: 8.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022] Open
Abstract
BACKGROUND The characteristics of patients who suffer from noncancer pain and opioid-induced constipation are not well understood. METHODS Cross-sectional patient survey and chart review data from the baseline assessment of an ongoing longitudinal study in the USA, Canada, Germany, and the UK were evaluated via descriptive statistics. Participants had confirmation of daily opioid therapy ≥30 mg for ≥4 weeks and self-reported opioid-induced constipation. Response to laxatives was defined by classifying participants into categories of laxative use and evaluating the prevalence of inadequate response to one laxative agent and two or more agents from at least two different laxative classes. Outcomes included the Patient Assessment of Constipation-Symptoms, Work Productivity and Activity Impairment Questionnaire-Specific Health Problem, EuroQOL 5 Dimensions, and Global Assessment of Treatment Benefit, Satisfaction, and Willingness to Continue. RESULTS Patients reported a mean of 1.4 bowel movements not preceded by laxatives and 3.7 bowel movements with laxative use per week; 83% wanted at least one bowel movement per day. Most commonly reported on Patient Assessment of Constipation-Symptoms were straining/squeezing to pass bowel movements (83%), bowel movements too hard (75%), flatulence (69%), and bloating (69%). Eighty-four percent were taking natural or behavioral therapies; 60% were taking at least one over-the-counter laxative; and 19% were taking at least one prescription laxative. Prevalence of inadequate response to one laxative agent was 94%; inadequate response to two or more agents from at least two different laxative classes was 27%. Mean Work Productivity and Activity Impairment Questionnaire-Specific Health Problem values for percent work time missed, percent impairment while working, and percent activity impairment were 9%, 32% (equivalent of 14 hours of lost productivity per week), and 38%. Mean EuroQOL 5 Dimensions index and visual analog scale scores were 0.49 and 50.6, respectively. Forty-four percent reported being satisfied with their treatment for constipation. CONCLUSION Patients treated with opioids for noncancer pain commonly endure constipation symptoms that limit their work productivity and overall health-related quality of life while adhering to treatments that provide little relief. Further research is needed to identify more efficacious constipation therapies for this patient population.
Collapse
Affiliation(s)
| | | | | | | | - Karen Yeomans
- UBC: an Express Scripts Company, Montreal, QC, Canada
| | - Jan Tack
- University Hospital Gasthuisberg, Leuven, Belgium
| |
Collapse
|
23
|
There was less self-critique among basic than in clinical science articles in three rheumatology journals. J Clin Epidemiol 2014; 67:654-7. [PMID: 24439068 DOI: 10.1016/j.jclinepi.2013.10.014] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2013] [Revised: 10/22/2013] [Accepted: 10/25/2013] [Indexed: 11/21/2022]
Abstract
OBJECTIVES There is concern that self-critique with authors acknowledging limitations of their work is not given due importance in scientific articles. We had the impression that this was more true for articles in basic compared with clinical science. We thus surveyed for the presence of self-critique in the discussion sections of the original articles in three rheumatology journals with attention to differences between the basic and the clinical science articles. STUDY DESIGN AND SETTING The discussion sections of the original articles in January, May, and September 2012 issues of Annals of the Rheumatic Diseases, Arthritis and Rheumatism, and Rheumatology (Oxford) were surveyed (n = 223) after classifying each article as mainly related to clinical or basic science. The discussion sections were electronically scanned by two observers for the presence of the root word "limit" or its derivatives who also read each discussion section for the presence of any limitations otherwise voiced. RESULTS A limitation discussion in any form was present in only 19 (20.2%) or 29 (30.1%) of 94 basic science vs. 95 (73.6%) or 107 (82.3%) of 129 clinical science articles (P < 0.0001 for either observer). CONCLUSION Self-critique, especially lacking in basic science articles, should be given due attention.
Collapse
|
24
|
ter Riet G, Chesley P, Gross AG, Siebeling L, Muggensturm P, Heller N, Umbehr M, Vollenweider D, Yu T, Akl EA, Brewster L, Dekkers OM, Mühlhauser I, Richter B, Singh S, Goodman S, Puhan MA. All that glitters isn't gold: a survey on acknowledgment of limitations in biomedical studies. PLoS One 2013; 8:e73623. [PMID: 24324540 PMCID: PMC3854521 DOI: 10.1371/journal.pone.0073623] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2013] [Accepted: 07/26/2013] [Indexed: 11/18/2022] Open
Abstract
BACKGROUND Acknowledgment of all serious limitations to research evidence is important for patient care and scientific progress. Formal research on how biomedical authors acknowledge limitations is scarce. OBJECTIVES To assess the extent to which limitations are acknowledged in biomedical publications explicitly, and implicitly by investigating the use of phrases that express uncertainty, so-called hedges; to assess the association between industry support and the extent of hedging. DESIGN We analyzed reporting of limitations and use of hedges in 300 biomedical publications published in 30 high and medium -ranked journals in 2007. Hedges were assessed using linguistic software that assigned weights between 1 and 5 to each expression of uncertainty. RESULTS Twenty-seven percent of publications (81/300) did not mention any limitations, while 73% acknowledged a median of 3 (range 1-8) limitations. Five percent mentioned a limitation in the abstract. After controlling for confounders, publications on industry-supported studies used significantly fewer hedges than publications not so supported (p = 0.028). LIMITATIONS Detection and classification of limitations was--to some extent--subjective. The weighting scheme used by the hedging detection software has subjective elements. CONCLUSIONS Reporting of limitations in biomedical publications is probably very incomplete. Transparent reporting of limitations may protect clinicians and guideline committees against overly confident beliefs and decisions and support scientific progress through better design, conduct or analysis of new studies.
Collapse
Affiliation(s)
- Gerben ter Riet
- Department of General Practice, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands
- * E-mail:
| | - Paula Chesley
- Seminar für Sprachwissenschaft University of Tübingen, Tübingen, Germany
| | - Alan G. Gross
- Department of Communication Studies, University of Minnesota - Twin Cities, Minneapolis, Minnesota, United States of America
| | - Lara Siebeling
- Department of General Practice, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands
| | - Patrick Muggensturm
- Horten Centre for Patient-Oriented Research, University of Zurich, Zurich, Switzerland
| | - Nadine Heller
- Ambulatorium Glattal, Zurich-Schwamendingen, Winterthur, Switzerland
| | - Martin Umbehr
- Horten Centre for Patient-Oriented Research, University of Zurich, Zurich, Switzerland
- Department of Urology, University Hospital Zurich, Zurich, Switzerland
| | | | - Tsung Yu
- Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland, United States of America
| | - Elie A. Akl
- Department of Internal Medicine, American University of Beirut, Beirut, Lebanon
- Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Ontario, Canada
- Department of Medicine, State University of New York at Buffalo, Buffalo, New York, United States of America
| | - Lizzy Brewster
- Departments of Internal and Vascular Medicine, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands
| | - Olaf M. Dekkers
- Department of Clinical Epidemiology, Leiden University Medical Centre, Leiden, The Netherlands
| | - Ingrid Mühlhauser
- Mathematics, Informatics, Natural Sciences Faculty, Health Sciences and Education, University Hamburg, Hamburg, Germany
| | - Bernd Richter
- Institute of General Practice, University Hospital Düsseldorf, Heinrich-Heine University, Düsseldorf, Germany
| | - Sonal Singh
- Division of General Internal Medicine, Johns Hopkins University, Baltimore, Maryland, United States of America
| | - Steven Goodman
- Stanford University School of Medicine, Stanford, California, United States of America
| | - Milo A. Puhan
- Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland, United States of America
- Institute for Social and Preventive Medicine, University of Zurich, Zurich, Switzerland
| |
Collapse
|