1
|
Tran AV, Stadler JK, Ernst Z, Smith CA, Nees D, Hughes GK, Vassar M. Evaluating guideline and registration policies among neurology journals: a cross-sectional analysis. BMC Neurol 2024; 24:321. [PMID: 39237894 PMCID: PMC11376083 DOI: 10.1186/s12883-024-03839-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2024] [Accepted: 08/29/2024] [Indexed: 09/07/2024] Open
Abstract
BACKGROUND Neurological disorders have had a substantial rise the last three decades, imposing substantial burdens on both patients and healthcare costs. Consequently, the demand for high-quality research has become crucial for exploring effective treatment options. However, current neurology research has some limitations in terms of transparency, reproducibility, and reporting bias. The adoption of reporting guidelines (RGs) and trial registration policies has been proven to address these issues and improve research quality in other medical disciplines. It is unclear the extent to which these policies are being endorsed by neurology journals. Therefore, our study aims to evaluate the publishing policies of top neurology journals regarding RGs and trial registration. METHODS For this cross-sectional study, neurology journals were identified using the 2021 Scopus CiteScore Tool. The top 100 journals were listed and screened for eligibility for our study. In a masked, duplicate fashion, investigators extracted data on journal characteristics, policies on RGs, and policies on trial registration using information from each journal's Instruction for Authors webpage. Additionally, investigators contacted journal editors to ensure information was current and accurate. No human participants were involved in this study. Our data collection and analyses were performed from December 14, 2022, to January 9, 2023. RESULTS Of the 356 neurology journals identified, the top 100 were included into our sample. The five-year impact of these journals ranged from 50.844 to 2.226 (mean [SD], 7.82 [7.01]). Twenty-five (25.0%) journals did not require or recommend a single RG within their Instructions for Authors webpage, and a third (33.0%) did not require or recommend clinical trial registration. The most frequently mentioned RGs were CONSORT (64.6%), PRISMA (52.5%), and ARRIVE (53.1%). The least mentioned RG was QUOROM (1.0%), followed by MOOSE (9.0%), and SQUIRE (17.9%). CONCLUSIONS While many top neurology journals endorse the use of RGs and trial registries, there are still areas where their adoption can be improved. Addressing these shortcomings leads to further advancements in the field of neurology, resulting in higher-quality research and better outcomes for patients.
Collapse
Affiliation(s)
- Andrew V Tran
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, USA.
- Oklahoma State University Center for Health Sciences, 1111 W 17th St, Tulsa, OK, 74107, USA.
| | - John K Stadler
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, USA
| | - Zachary Ernst
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, USA
| | - Caleb A Smith
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, USA
| | - Danya Nees
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, USA
| | - Griffin K Hughes
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, USA
| | - Matt Vassar
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, USA
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, USA
| |
Collapse
|
2
|
Shiri P, Rezaeian S, Abdi A, Jalilian M, Khatony A. Risk factors for thrombosis in dialysis patients: A comprehensive systematic review and meta-analysis. JOURNAL OF VASCULAR NURSING 2024; 42:165-176. [PMID: 39244328 DOI: 10.1016/j.jvn.2024.05.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Revised: 05/06/2024] [Accepted: 05/13/2024] [Indexed: 09/09/2024]
Abstract
AIM To identify the factors associated with thrombosis in dialysis patients. BACKGROUND Thrombosis is a leading cause of vascular access failure in dialysis patients. Numerous risk factors contribute to thrombosis in this population. METHODS A systematic search was conducted across international databases using standardized keywords. The quality of the selected studies was assessed using the STROBE and CONSORT checklists. The findings were summarized in a Garrard table. Meta-analysis was performed using CMA software. The study adhered to the guidelines outlined in the PRISMA statement. RESULTS A total of 180 articles were reviewed. The odds ratio for thrombosis in patients with arteriovenous grafts compared to arteriovenous fistulas was 10.93 (95 % CI: 9.35-12.78), demonstrating statistical significance (P = 0.001). Similarly, hemodialysis patients had an odds ratio of thrombosis 3.60 times higher than non-hemodialysis patients (95 % CI: 3.54-4.19), with statistical significance (P = 0.001). Patients undergoing single-stage basilic vein transposition had a 1.89 times higher risk of thrombosis compared to those undergoing two-stage transposition (95 % CI: 1.04-3.46), also demonstrating statistical significance (P = 0.038). CONCLUSIONS Thrombosis in patients with end-stage renal disease undergoing dialysis was significantly associated with various factors, including graft access, single-stage basilic vein transposition, and hemodialysis. Additional contributing factors to thrombosis included diabetes, elevated homocysteine levels, female gender, age over 50, access location, and low access blood flow velocity. The analysis revealed a higher incidence of thrombosis in end-stage renal disease patients undergoing hemodialysis compared to those not undergoing dialysis, as well as in patients with arteriovenous grafts compared to those with arteriovenous fistulas. These findings underscore the importance of recognizing and managing these risk factors to prevent thrombotic events and enhance patient care within the dialysis setting.
Collapse
Affiliation(s)
- Parisa Shiri
- Student Research Committee, Kermanshah University of Medical Sciences, Kermanshah, Iran
| | - Shabab Rezaeian
- Social Development and Health Promotion Research Centre, Health Institute, Kermanshah University of Medical Sciences, Kermanshah, Iran
| | - Alireza Abdi
- Student Research Committee, Kermanshah University of Medical Sciences, Kermanshah, Iran
| | - Milad Jalilian
- Student Research Committee, Kermanshah University of Medical Sciences, Kermanshah, Iran
| | - Alireza Khatony
- Social Development and Health Promotion Research Centre, Health Institute, Kermanshah University of Medical Sciences, Kermanshah, Iran; Infectious Diseases Research Centre, Kermanshah University of Medical Sciences, Kermanshah, Iran.
| |
Collapse
|
3
|
Abbassi F, Pfister M, Domenghino A, Puhan MA, Clavien PA. Surgical Outcome Reporting. Moving From a Comic to a Tragic Opera? Ann Surg 2024; 280:248-252. [PMID: 38323468 DOI: 10.1097/sla.0000000000006226] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/08/2024]
Abstract
OBJECTIVES To assess the current quality of surgical outcome reporting in the medical literature and to provide recommendations for improvement. BACKGROUND In 1996, The Lancet labeled surgery as a "comic opera" mostly referring to the poor quality of outcome reporting in the literature impeding improvement in surgical quality and patient care. METHODS We screened 3 first-tier and 2 second-tier surgical journals, as well as 3 leading medical journals for original articles reporting on results of surgical procedures published over a recent 18-month period. The quality of outcome reporting was assessed using a prespecified 12-item checklist. RESULTS Six hundred twenty-seven articles reporting surgical outcomes were analyzed, including 125 randomized controlled trials. Only 1 (0.2%) article met all 12 criteria of the checklist, whereas 356 articles (57%) fulfilled less than half of the criteria. The poorest reporting was on cumulative morbidity burden, which was missing in 94% of articles (n=591) as well as patient-reported outcomes missing in 83% of publications (n=518). Comparing journal groups for the individual criterion, we found moderate to very strong statistical evidence for better quality of reporting in high versus lower impact journals for 7 of 12 criteria and strong statistical evidence for better reporting of patient-reported outcomes in medical versus surgical journals ( P <0·001). CONCLUSIONS The quality of outcomes reporting in the medical literature remains poor, lacking improvement over the past 20 years on most key end points. The implementation of standardized outcome reporting is urgently needed to minimize biased interpretation of data thereby enabling improved patient care and the elaboration of meaningful guidelines.
Collapse
Affiliation(s)
- Fariba Abbassi
- Department of Surgery and Transplantation, University Hospital Zurich, Zurich, Switzerland
- Epidemiology, Biostatistics and Prevention Institute, University of Zurich, Zurich, Switzerland
| | - Matthias Pfister
- Department of Surgery and Transplantation, University Hospital Zurich, Zurich, Switzerland
| | - Anja Domenghino
- Department of Surgery and Transplantation, University Hospital Zurich, Zurich, Switzerland
- Epidemiology, Biostatistics and Prevention Institute, University of Zurich, Zurich, Switzerland
| | - Milo A Puhan
- Epidemiology, Biostatistics and Prevention Institute, University of Zurich, Zurich, Switzerland
| | - Pierre-Alain Clavien
- Wyss Translational Center, Swiss Medical Network, University of Zurich, Zurich, Switzerland
| |
Collapse
|
4
|
Best AM, Lang TA, Greenberg BL, Gunsolley JC, Ioannidou E. The Oral Health Statistics Guidelines for Reporting Observational Studies and Clinical Trials in Oral Health Research: Explanation and Elaboration. J Oral Maxillofac Surg 2024:S0278-2391(24)00584-6. [PMID: 39032518 DOI: 10.1016/j.joms.2024.06.174] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2024] [Accepted: 06/24/2024] [Indexed: 07/23/2024]
Abstract
Adequate and transparent reporting is necessary for critically appraising research. Yet, evidence suggests that the design, conduct, analysis, interpretation, and reporting of oral health research could be greatly improved. Accordingly, the Task Force on Design and Analysis in Oral Health Research-statisticians and trialists from academia and industry-empaneled a group of authors to develop methodological and statistical reporting guidelines identifying the minimum information needed to document and evaluate observational studies and clinical trials in oral health: the Oral Health Statistics Guidelines. Drafts were circulated to the editors of 85 oral health journals and to task force members and sponsors and discussed at a December 2020 workshop attended by 49 researchers. The final version was subsequently approved by the task force in September 2021, submitted for journal review in 2022, and revised in 2023. The checklist consists of 48 guidelines: 5 for introductory information, 17 for methods, 13 for statistical analysis, 6 for results, and 7 for interpretation; 7 are specific to clinical trials. Each of these guidelines identifies relevant information, explains its importance, and often describes best practices. The checklist was published in multiple journals. The article was published simultaneously in Journal of Dental Research Clinical and Translational Research, the Journal of the American Dental Association, and the Journal of Oral and Maxillofacial Surgery. Completed checklists should accompany manuscripts submitted for publication to these and other oral health journals to help authors, journal editors, and reviewers verify that the manuscript provides the information necessary to adequately document and evaluate the research.
Collapse
Affiliation(s)
- Al M Best
- Professor Emeritus, School of Dentistry and Department of Biostatistics, School of Medicine, Virginia Commonwealth University, Richmond, VA
| | - Thomas A Lang
- Adjunct Faculty, University of Chicago Medical Writing Program, Chicago, IL
| | - Barbara L Greenberg
- Adjunct Professor, Epidemiology and Biostatistics, Touro College of Dental Medicine at New York Medical College, Valhalla, NY
| | - John C Gunsolley
- Professor Emeritus, School of Dentistry, Virginia Commonwealth University, Richmond, VA
| | - Effie Ioannidou
- Professor and Chair of Orofacial Sciences, UCSF School of Dentistry, San Francisco, CA.
| |
Collapse
|
5
|
Best AM, Lang TA, Greenberg BL, Gunsolley JC, Ioannidou E. The OHStat Guidelines for Reporting Observational Studies and Clinical Trials in Oral Health Research: explanation and elaboration. J Am Dent Assoc 2024:S0002-8177(24)00316-7. [PMID: 39001723 DOI: 10.1016/j.adaj.2024.06.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/15/2024]
Abstract
Adequate and transparent reporting is necessary for critically appraising research. Yet, evidence suggests that the design, conduct, analysis, interpretation, and reporting of oral health research could be greatly improved. Accordingly, the Task Force on Design and Analysis in Oral Health Research-statisticians and trialists from academia and industry-empaneled a group of authors to develop methodological and statistical reporting guidelines identifying the minimum information needed to document and evaluate observational studies and clinical trials in oral health: the OHstat Guidelines. Drafts were circulated to the editors of 85 oral health journals and to Task Force members and sponsors and discussed at a December 2020 workshop attended by 49 researchers. The final version was subsequently approved by the Task Force in September 2021, submitted for journal review in 2022, and revised in 2023. The checklist consists of 48 guidelines: 5 for introductory information, 17 for methods, 13 for statistical analysis, 6 for results, and 7 for interpretation; 7 are specific to clinical trials. Each of these guidelines identifies relevant information, explains its importance, and often describes best practices. The checklist was published in multiple journals. The article was published simultaneously in JDR Clinical and Translational Research, the Journal of the American Dental Association, and the Journal of Oral and Maxillofacial Surgery. Completed checklists should accompany manuscripts submitted for publication to these and other oral health journals to help authors, journal editors, and reviewers verify that the manuscript provides the information necessary to adequately document and evaluate the research.
Collapse
|
6
|
Best AM, Lang TA, Greenberg BL, Gunsolley JC, Ioannidou E. The OHStat Guidelines for Reporting Observational Studies and Clinical Trials in Oral Health Research: Explanation and Elaboration. JDR Clin Trans Res 2024:23800844241247029. [PMID: 38993046 DOI: 10.1177/23800844241247029] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/13/2024] Open
Abstract
Adequate and transparent reporting is necessary for critically appraising research. Yet, evidence suggests that the design, conduct, analysis, interpretation, and reporting of oral health research could be greatly improved. Accordingly, the Task Force on Design and Analysis in Oral Health Research-statisticians and trialists from academia and industry-empaneled a group of authors to develop methodological and statistical reporting guidelines identifying the minimum information needed to document and evaluate observational studies and clinical trials in oral health: the OHstat Guidelines. Drafts were circulated to the editors of 85 oral health journals and to Task Force members and sponsors and discussed at a December 2020 workshop attended by 49 researchers. The final version was subsequently approved by the Task Force in September 2021, submitted for journal review in 2022, and revised in 2023. The checklist consists of 48 guidelines: 5 for introductory information, 17 for methods, 13 for statistical analysis, 6 for results, and 7 for interpretation; 7 are specific to clinical trials. Each of these guidelines identifies relevant information, explains its importance, and often describes best practices. The checklist was published in multiple journals. The article was published simultaneously in JDR Clinical and Translational Research, the Journal of the American Dental Association, and the Journal of Oral and Maxillofacial Surgery. Completed checklists should accompany manuscripts submitted for publication to these and other oral health journals to help authors, journal editors, and reviewers verify that the manuscript provides the information necessary to adequately document and evaluate the research.
Collapse
Affiliation(s)
- A M Best
- School of Dentistry and Department of Biostatistics, School of Medicine, Virginia Commonwealth University, Richmond, VA, USA
| | - T A Lang
- University of Chicago Medical Writing Program, Chicago, IL, USA
| | - B L Greenberg
- Epidemiology and Biostatistics, Touro College of Dental Medicine at New York Medical College, Valhalla, NY, USA
| | - J C Gunsolley
- School of Dentistry, Virginia Commonwealth University, Richmond, VA, USA
| | - E Ioannidou
- UCSF School of Dentistry, San Francisco, CA, USA
| |
Collapse
|
7
|
Tomlinson E, Cooper C, Davenport C, Rutjes AWS, Leeflang M, Mallett S, Whiting P. Common challenges and suggestions for risk of bias tool development: a systematic review of methodological studies. J Clin Epidemiol 2024; 171:111370. [PMID: 38670243 DOI: 10.1016/j.jclinepi.2024.111370] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2023] [Revised: 04/16/2024] [Accepted: 04/17/2024] [Indexed: 04/28/2024]
Abstract
OBJECTIVES To review the findings of studies that have evaluated the design and/or usability of key risk of bias (RoB) tools for the assessment of RoB in primary studies, as categorized by the Library of Assessment Tools and InsTruments Used to assess Data validity in Evidence Synthesis Network (a searchable library of RoB tools for evidence synthesis): Prediction model Risk Of Bias ASessment Tool (PROBAST) , Risk of Bias-2 (RoB2), Risk Of Bias In Non-randomised Studies of Interventions (ROBINS-I), Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2), Quality Assessment of Diagnostic Accuracy Studies-Comparative (QUADAS-C), Quality Assessment of Prognostic Accuracy Studies (QUAPAS), Risk Of Bias in Non-randomised Studies of Exposures (ROBINS-E), and the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) RoB checklist. STUDY DESIGN AND SETTING Systematic review of methodological studies. We conducted a forward citation search from the primary report of each tool, to identify primary studies that aimed to evaluate the design and/or usability of the tool. Two reviewers assessed studies for inclusion. We extracted tool features into Microsoft Word and used NVivo for document analysis, comprising a mix of deductive and inductive approaches. We summarized findings within each tool and explored common findings across tools. RESULTS We identified 13 tool evaluations meeting our inclusion criteria: PROBAST (3), RoB2 (3), ROBINS-I (4), and QUADAS-2 (3). We identified no evaluations for the other tools. Evaluations varied in clinical topic area, methodology, approach to bias assessment, and tool user background. Some had limitations affecting generalizability. We identified common findings across tools for 6/14 themes: (1) challenging items (eg, RoB2/ROBINS-I "deviations from intended interventions" domain), (2) overall RoB judgment (concerns with overall risk calculation in PROBAST/ROBINS-I), (3) tool usability (concerns about complexity), (4) time to complete tool (varying demands on time, eg, depending on number of outcomes assessed), (5) user agreement (varied across tools), and (6) recommendations for future use (eg, piloting) and development (add intermediate domain answer to QUADAS-2/PROBAST; provide clearer guidance for all tools). Of the other eight themes, seven only had findings for the QUADAS-2 tool, limiting comparison across tools, and one ("reorganization of questions") had no findings. CONCLUSION Evaluations of key RoB tools have posited common challenges and recommendations for tool use and development. These findings may be helpful to people who use or develop RoB tools. Guidance is necessary to support the design and implementation of future RoB tool evaluations.
Collapse
Affiliation(s)
- Eve Tomlinson
- Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK.
| | - Chris Cooper
- Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK
| | - Clare Davenport
- Test and Prediction Group, Institute of Applied Health Research, University of Birmingham, Birmingham, B15 2TT, UK; NIHR Birmingham Biomedical Research Centre, University Hospitals Birmingham NHS Foundation Trust and University of Birmingham, Birmingham B15 2TT, UK
| | - Anne W S Rutjes
- Department of Medical and Surgical Sciences for Children and Adults (SMECHIMAI), University of Modena and Reggio Emilia, Modena, Italy
| | - Mariska Leeflang
- Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, The Netherlands
| | - Sue Mallett
- Centre for Medical Imaging, University College London, London, UK
| | - Penny Whiting
- Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK
| |
Collapse
|
8
|
Kwon CS, Chua MMJ, Jetté N, Rolston JD. A knowledge synthesis of health research reporting standards relevant to epilepsy surgery. Epilepsia 2024. [PMID: 38949199 DOI: 10.1111/epi.18047] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2024] [Revised: 05/08/2024] [Accepted: 06/07/2024] [Indexed: 07/02/2024]
Abstract
OBJECTIVE Numerous studies have examined epilepsy surgery outcomes, yet the variability in the level of detail reported hampers our ability to apply these findings broadly across patient groups. Established reporting standards in other clinical research fields enhance the quality and generalizability of results, ensuring that the insights gained from studying these surgeries can benefit future patients effectively. This study aims to assess current reporting standards for epilepsy surgery research and identify potential gaps and areas for enhancement. METHODS The Enhancing the Quality and Transparency of Health Research (EQUATOR) repository was accessed from inception to April 27, 2023, yielding 561 available reporting standards. Reporting standards were manually reviewed in duplicate independently for applicability to epilepsy and/or neurosurgery research. The reporting standards had to cover the following aspects in human studies: (1) reporting standards for epilepsy/epilepsy surgery and (2) reporting standards for neurosurgery. Disagreements were resolved by a third author. The top five neurosurgery, neurology, and medicine journals were also identified through Google Scholar's citation index and examined to determine the relevant reporting standards they recommended and whether those were registered with EQUATOR. RESULTS Of the 561 EQUATOR reporting standards, 181 were pertinent to epilepsy surgery. One was related to epilepsy, six were specific to surgical research, and nine were related to neurological/neurosurgical research. The remaining 165 reporting standards were applicable to research across various disciplines and included but were not limited to CONSORT (Consolidated Standards of Reporting Trails), STROBE (Strengthening the Reporting of Observational Studies in Epidemiology), and PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses). None of these required reporting factors associated with epilepsy surgery outcomes, such as duration of epilepsy or magnetic resonance imaging findings. SIGNIFICANCE Reporting standards specific to epilepsy surgery are lacking, reflecting a gap in standards that may affect the quality of publications. Improving this gap with a set of specific reporting standards would ensure that epilepsy surgery studies are more transparent and rigorous in their design.
Collapse
Affiliation(s)
- Churl-Su Kwon
- Departments of Neurology, Epidemiology, and Neurosurgery and Gertrude H. Sergievsky Center, Columbia University Irving Medical Center, New York, New York, USA
| | - Melissa M J Chua
- Department of Neurosurgery, Harvard Medical School, Brigham and Women's Hospital, Boston, Massachusetts, USA
| | - Nathalie Jetté
- Department of Clinical Neurosciences and Department of Community Health Sciences, University of Calgary, Calgary, Alberta, Canada
| | - John D Rolston
- Department of Neurosurgery, Harvard Medical School, Brigham and Women's Hospital, Boston, Massachusetts, USA
| |
Collapse
|
9
|
Ben-Porat T, Yousefi R, Stojanovic J, Boucher VG, Fortin A, Lavoie K, Bacon SL. Completeness of intervention reporting of nutrition-focused weight management interventions adjunct to metabolic and bariatric surgery: effect of the TIDieR checklist. Int J Obes (Lond) 2024; 48:901-912. [PMID: 38459257 DOI: 10.1038/s41366-024-01506-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/07/2023] [Revised: 02/20/2024] [Accepted: 02/26/2024] [Indexed: 03/10/2024]
Abstract
Nutrition-focused interventions are essential to optimize the bariatric care process and improve health and weight outcomes over time. Clear and detailed reporting of these interventions in research reports is crucial for understanding and applying the findings effectively in clinical practice and research replication. Given the importance of reporting transparency in research, this study aimed to use the Template for Intervention Description and Replication (TIDieR) checklist to evaluate the completeness of intervention reporting in nutritional weight management interventions adjunct to metabolic and bariatric surgery (MBS). The secondary aim was to examine the factors associated with better reporting. A literature search in PubMed, PsychINFO, EMBASE, Scopus, and the Cochrane Controlled Register of Trials was conducted to include randomized controlled trials (RCT), quasi-RCTs and parallel group trials. A total of 22 trials were included in the final analysis. Among the TIDieR 12 items, 6.6 ± 1.9 items were fully reported by all studies. None of the studies completely reported all intervention descriptors. The main areas where reporting required improvement were providing adequate details of the materials and procedures of the interventions, intervention personalization, and intervention modifications during the study. The quality of intervention reporting remained the same after vs. before the release of the TIDieR guidelines. Receiving funds from industrial organizations (p = 0.02) and having the study recorded within a registry platform (p = 0.08) were associated with better intervention reporting. Nutritional weight management interventions in MBS care are still below the desirable standards for reporting. The present study highlights the need to improve adequate reporting of such interventions, which would allow for greater replicability, evaluation through evidence synthesis studies, and transferability into clinical practice.
Collapse
Affiliation(s)
- Tair Ben-Porat
- Montreal Behavioural Medicine Centre (MBMC), Centre intégré universitaire de santé et de services sociaux du Nord-de-l'Île-de-Montréal (CIUSSS-NIM), Montreal, Canada
- Department of Health, Kinesiology and Applied Physiology, Concordia University, Montreal, Canada
| | - Reyhaneh Yousefi
- Montreal Behavioural Medicine Centre (MBMC), Centre intégré universitaire de santé et de services sociaux du Nord-de-l'Île-de-Montréal (CIUSSS-NIM), Montreal, Canada
- Department of Health, Kinesiology and Applied Physiology, Concordia University, Montreal, Canada
| | - Jovana Stojanovic
- Canadian Agency for Drugs and Health Technologies in Health (CADTH), Ottawa, Canada
| | - Vincent Gosselin Boucher
- School of Kinesiology, Faculty of Education, The University of British Columbia, Vancouver, Canada
| | - Annabelle Fortin
- Montreal Behavioural Medicine Centre (MBMC), Centre intégré universitaire de santé et de services sociaux du Nord-de-l'Île-de-Montréal (CIUSSS-NIM), Montreal, Canada
- Department of Psychology, Université du Québec à Montréal, Montreal, Canada
| | - Kim Lavoie
- Montreal Behavioural Medicine Centre (MBMC), Centre intégré universitaire de santé et de services sociaux du Nord-de-l'Île-de-Montréal (CIUSSS-NIM), Montreal, Canada
- Department of Psychology, Université du Québec à Montréal, Montreal, Canada
| | - Simon L Bacon
- Montreal Behavioural Medicine Centre (MBMC), Centre intégré universitaire de santé et de services sociaux du Nord-de-l'Île-de-Montréal (CIUSSS-NIM), Montreal, Canada.
- Department of Health, Kinesiology and Applied Physiology, Concordia University, Montreal, Canada.
| |
Collapse
|
10
|
Tihista M, Robinson E, Polmear M, Scanaliato J, Ramirez M, Dunn J. Pharmacologic Treatments in Upper Extremity Complex Regional Pain Syndrome: A Review and Analysis of Quality of Evidence. Hand (N Y) 2024; 19:533-544. [PMID: 36424817 PMCID: PMC11141415 DOI: 10.1177/15589447221131847] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Abstract
BACKGROUND The purpose of this study was to assess the quality of evidence informing on common pharmacologic modalities used in upper extremity complex regional pain syndrome (CRPS). METHODS A literature search was performed for primary prospective trials that reported on the pharmacologic treatment of CRPS type I and II specific to the upper extremity. Thirty-one trials were included and evaluated by 2 independent reviewers according to the Oxford Levels of Evidence (LOE), modified Coleman Methodology Score, and the revised Consolidated Standards of Reporting Trials (CONSORT) score. Cohen's kappa coefficient was calculated to measure interrater reliability. RESULTS Twenty-two Oxford LOE I and 9 level II trials met the inclusion criteria. Overall, there was high interrater reliability in the Oxford LOE (100% agreement), modified Coleman Methodology Score (87% agreement), and CONSORT score (94% agreement). The pharmacologic interventions with the highest quality of evidence supporting use in treatment of upper extremity CRPS were bisphosphonates and ketamine. Interventions that lack high-quality evidence are tricyclic antidepressants (TCAs) and topical dimethyl sulfoxide (DMSO). Pharmacologic agents that remain inconclusive are calcitonin, gabapentin, mycophenolate, probiotics, steroids, nonsteroidal anti-inflammatory drugs, vitamin C, and N-acetylcysteine. Agents with limited benefit are mannitol, isosorbide dinitrate, guanethidine, and morphine. CONCLUSIONS Based on the evidence evaluated in this study, bisphosphonates should be considered as a first-line medication in the treatment of CRPS. In patients presenting with chronic or refractory CRPS, strong consideration should be given for the use of ketamine. Adjunct treatment in the acute setting should include TCAs and/or topical DMSO.
Collapse
Affiliation(s)
- Mikel Tihista
- William Beaumont Army Medical Center, El Paso, TX, USA
| | | | | | | | | | - John Dunn
- William Beaumont Army Medical Center, El Paso, TX, USA
| |
Collapse
|
11
|
Stiegel L, Visperas A, Piuzzi NS, Klika A. Exploring Differences in Screening and Enrollment Metrics in Orthopaedic Clinical Trials. J Knee Surg 2024; 37:492-497. [PMID: 37734404 DOI: 10.1055/a-2179-8281] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 09/23/2023]
Abstract
The success of any clinical trial relies heavily on patient recruitment and retention. The purpose of this study was to review screening and enrollment metrics for orthopaedic clinical trials, comparing different patient populations to determine common challenges to recruitment and differences in rates of enrollment. Screening logs and study trackers were manually reviewed for four clinical trials at a single academic institution and included randomized controlled trials (RCTs) and an observational study. Data extracted from these documents included the number of patients screened, number excluded and reasons for exclusion, number enrolled, number of withdrawn and reason. Of the four trials reviewed, the point-of-care diagnostic test had the highest number of patients excluded and the lowest patient refusal rate. Refusal rates were highest in the venous thromboembolism prophylaxis study and enrollment rates were the lowest in the RCT of drug treatments and the highest rate in the observational study. The success of the trial relies on the ability to recruit patients and factors need to be considered when recruiting participants including sample size requirements and inclusion and exclusion criteria. These data provide some insights into the patient recruitment experience at our institution with different patient populations and study types, highlighting key points to be aware of when planning for an orthopaedic clinical trial.
Collapse
Affiliation(s)
- Laura Stiegel
- Department of Orthopaedic Surgery, Cleveland Clinic Foundation, Cleveland, Ohio
| | - Anabelle Visperas
- Department of Orthopaedic Surgery, Cleveland Clinic Foundation, Cleveland, Ohio
| | - Nicolas S Piuzzi
- Department of Orthopaedic Surgery, Cleveland Clinic Foundation, Cleveland, Ohio
| | - Alison Klika
- Department of Orthopaedic Surgery, Cleveland Clinic Foundation, Cleveland, Ohio
| |
Collapse
|
12
|
Dutil C, Podinic I, Featherstone RB, Eaton A, Sadler CM, Goldfield GS, Hadjiyannakis S, Gruber R, Tremblay MS, Prud’homme D, Chaput JP. Sleep and insulin sensitivity in adolescents at risk of type 2 diabetes: the Sleep Manipulation in Adolescents at Risk of Type 2 Diabetes randomized crossover study. Sleep 2024; 47:zsad313. [PMID: 38070132 PMCID: PMC11082473 DOI: 10.1093/sleep/zsad313] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2023] [Revised: 11/01/2023] [Indexed: 01/21/2024] Open
Abstract
STUDY OBJECTIVES To investigate the effect of increasing sleep duration for 1 week, compared to a week of habitual and decreased sleep, on insulin sensitivity (IS) in adolescents at risk for type 2 diabetes (T2D). METHODS Adolescents, 13-18 years old, at risk for T2D, with obesity and other risk factors, were recruited for a randomized (1:1), open-label, sex-stratified crossover study, that manipulated time-in-bed to modify sleep duration (measured by actigraphy). Following a week of habitual (HB) sleep, time-in-bed was increased (IN) and decreased (DE) by 1 hour 30 min/night for 1 week, counterbalanced across participants (HBINDE or HBDEIN), and separated by a week of washout sleep. The main outcome measure was IS, obtained via 2-hour oral-glucose-tolerance-test conducted after each sleep week. RESULTS Of the 43 participants recruited, 36 (84%) completed all sleep interventions (52.8% female, age = 15.1 years, body mass index = 99.9th percentile, order: HBINDE = 18 and HBDEIN = 18). On average, during the HB week, participants slept 7 hours 31 min/night; sleep duration was 1 hour 02 min/night higher during the IN week and 1 hour 19 min/night lower during the DE week. We found a significant effect of sleep week on IS with a large effect size. Following the IN sleep week, IS was 20% higher compared to after the HB and DE sleep weeks, but there was no significant difference in IS following HB versus DE sleep weeks. CONCLUSIONS Whenever possible, clinicians should empower youth at risk of T2D to improve their sleep duration, since even a modest increase in sleep duration of 1 h/night for 1 week can have a positive impact on IS in this population. CLINICAL TRIALS Sleep Extension and IS in Adolescents, https://clinicaltrials.gov/study/NCT03754036, November 23rd, 2018. TRIAL REGISTRATION ClinicalTrials.gov (ID:NCT03754036).
Collapse
Affiliation(s)
- Caroline Dutil
- Healthy Active Living and Obesity Research Group, Children’s Hospital of Eastern Ontario (CHEO) Research Institute, Ottawa, ON, Canada
- School of Human Kinetics, University of Ottawa, Ottawa, ON, Canada
| | - Irina Podinic
- Healthy Active Living and Obesity Research Group, Children’s Hospital of Eastern Ontario (CHEO) Research Institute, Ottawa, ON, Canada
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, ON, Canada
| | - Ryan B Featherstone
- Healthy Active Living and Obesity Research Group, Children’s Hospital of Eastern Ontario (CHEO) Research Institute, Ottawa, ON, Canada
- School of Human Kinetics, University of Ottawa, Ottawa, ON, Canada
- Centre for Healthy Active Living (CHAL), Children’s Hospital of Eastern Ontario (CHEO), Ottawa, ON, Canada
| | - Amelia Eaton
- Healthy Active Living and Obesity Research Group, Children’s Hospital of Eastern Ontario (CHEO) Research Institute, Ottawa, ON, Canada
- School of Human Kinetics, University of Ottawa, Ottawa, ON, Canada
| | - Christin M Sadler
- Healthy Active Living and Obesity Research Group, Children’s Hospital of Eastern Ontario (CHEO) Research Institute, Ottawa, ON, Canada
- School of Human Kinetics, University of Ottawa, Ottawa, ON, Canada
| | - Gary S Goldfield
- Healthy Active Living and Obesity Research Group, Children’s Hospital of Eastern Ontario (CHEO) Research Institute, Ottawa, ON, Canada
- Department of Pediatrics, University of Ottawa, Ottawa, ON, Canada
| | - Stasia Hadjiyannakis
- Centre for Healthy Active Living (CHAL), Children’s Hospital of Eastern Ontario (CHEO), Ottawa, ON, Canada
- Department of Pediatrics, University of Ottawa, Ottawa, ON, Canada
| | - Reut Gruber
- Department of Psychiatry, McGill University, Montreal, QC, Canada
- Attention, Behaviour and Sleep Lab, Douglas Mental Health University Institute, Montreal, QC, Canada
| | - Mark S Tremblay
- Healthy Active Living and Obesity Research Group, Children’s Hospital of Eastern Ontario (CHEO) Research Institute, Ottawa, ON, Canada
- Department of Pediatrics, University of Ottawa, Ottawa, ON, Canada
| | - Denis Prud’homme
- School of Human Kinetics, University of Ottawa, Ottawa, ON, Canada
- Université de Moncton, Moncton, NB, Canada
| | - Jean-Philippe Chaput
- Healthy Active Living and Obesity Research Group, Children’s Hospital of Eastern Ontario (CHEO) Research Institute, Ottawa, ON, Canada
- School of Human Kinetics, University of Ottawa, Ottawa, ON, Canada
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, ON, Canada
- Department of Pediatrics, University of Ottawa, Ottawa, ON, Canada
| |
Collapse
|
13
|
Gordon M, Khudr J, Sinopoulou V, Lakunina S, Rane A, Akobeng A. Quality of reporting inflammatory bowel disease randomised controlled trials: a systematic review. BMJ Open Gastroenterol 2024; 11:e001337. [PMID: 38631808 PMCID: PMC11033348 DOI: 10.1136/bmjgast-2023-001337] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/22/2023] [Accepted: 04/02/2024] [Indexed: 04/19/2024] Open
Abstract
OBJECTIVE Our objective was to perform a systemic evaluation of the risk of bias in randomised controlled trial (RCT) reports published on inflammatory bowel disease (IBD). DESIGN We assessed the risk of bias using the Cochrane tool, as indicators of poor methodology or subsequently poor reporting. We systematically selected, with dual independent judgements, all studies published on IBD with no time limits and assessed the methodological quality of included studies again using independent dual ratings. RESULTS 563 full texts were included after selection and review. No abstract publications were free of any source of bias. Full-text publications still fared badly, as only 103 full-text papers exhibited a low risk of bias in all reporting domains when excluding blinding. RCTs published in journals with higher impact factor (IF) were associated with an overall reduced rate of being at high risk. However, only 6% of full RCT publications in journals with an IF greater than 10, published in the past 5 years, were free of bias.The trend over time is towards improved reporting in all areas. Trials published by larger author teams, in full-text form and by industry and public sponsorship were positively correlated with a lower risk of bias. Only allocation concealment showed a statistically significant improvement with time (p=0.037). CONCLUSION These findings are consistent with those of other specialties in the literature. While this unclear risk of bias may represent poor reporting of methods instead of poor methodological quality, it leaves readers and future secondary researchers with significant questions regarding such key issues.
Collapse
Affiliation(s)
- Morris Gordon
- School of Medicine, University of Central Lancashire, Preston, UK
- Blackpool Families Division, Blackpool Victoria Hospital, Blackpool, UK
| | - Jamal Khudr
- School of Medicine, University of Central Lancashire, Preston, UK
- Plastic Surgery, Manchester University NHS Foundation Trust, Manchester, UK
| | | | | | - Aditi Rane
- School of Medicine, University of Central Lancashire, Preston, UK
| | - Anthony Akobeng
- Gastroenterology, Sidra Medicine, Doha, Ad Dawhah, Qatar
- School of Medicine, Weill Cornell Medical College-Qatar, Doha, Qatar
| |
Collapse
|
14
|
Xu X, Zhou W, Wang Y, Wang Z, Zhang X, Zhang X, Tian S, Wu G. Enhanced external counterpulsation improves sleep quality in chronic insomnia: A pilot randomized controlled study. J Affect Disord 2024; 350:608-617. [PMID: 38218261 DOI: 10.1016/j.jad.2024.01.090] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/26/2023] [Revised: 10/05/2023] [Accepted: 01/07/2024] [Indexed: 01/15/2024]
Abstract
PURPOSE To investigate the short-term efficacy of enhanced external counterpulsation (EECP) on chronic insomnia. METHODS This is a pilot randomized, participant-blind, and sham-controlled study. Forty-six participants with chronic insomnia were randomly assigned in a 1:1 ratio to receive EECP or sham EECP intervention (total of 35 sessions with 45 min each). The primary outcome was Pittsburgh Sleep Quality Index (PSQI). The secondary outcomes included sleep diary, Hospital Anxiety and Depression Scale (HADS), Short-Form Health Survey (SF12), flow mediated dilation (FMD), serum biomarkers of melatonin, cortisol, interleukin-6, and high sensitivity C-reactive protein. Outcomes were assessed after treatment and at 3-month follow-up. RESULTS The PSQI was significantly decreased in both EECP and sham groups after 35-session intervention (13.74 to 6.96 in EECP and 13.04 to 9.48 in sham), and EECP decreased PSQI more than sham EECP (p = 0.009). PSQI in two groups kept improved at 3-month follow-up. After treatment, the total sleep time, sleep efficiency, FMD value and SF12 mental component of EECP group were significantly improved, and group differences were found for these outcomes. At follow-up, total sleep time, sleep efficiency and SF12 mental component of EECP group remained improved, and group difference for SF12 mental component was found. Post-treatment and follow-up HADS-A significantly decreased in both groups, with no differences between groups. Post-treatment serum biomarkers showed no differences within and between groups. LIMITATION Lack of objective sleep measurement. CONCLUSION EECP could improve sleep quality and mental quality of life in chronic insomnia and the therapeutic effect maintained for 3 months.
Collapse
Affiliation(s)
- Xiuli Xu
- Department of Cardiology, The Eighth Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong 518033, China; Guangdong Innovative Engineering and Technology Research Center for Assisted Circulation, Sun Yat-sen University, Shenzhen, Guangdong 518033, China; National Health Commission Key Laboratory of Assisted Circulation, Sun Yat-sen University, Guangzhou, Guangdong 528478, China
| | - Wenjuan Zhou
- Department of Cardiology, The Eighth Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong 518033, China
| | - Yinfen Wang
- Department of Cardiology, The Eighth Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong 518033, China
| | - Zhenyu Wang
- Department of Cardiology, The Eighth Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong 518033, China; Guangdong Innovative Engineering and Technology Research Center for Assisted Circulation, Sun Yat-sen University, Shenzhen, Guangdong 518033, China; National Health Commission Key Laboratory of Assisted Circulation, Sun Yat-sen University, Guangzhou, Guangdong 528478, China
| | - Xiaocong Zhang
- Department of Cardiology, The Eighth Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong 518033, China; Guangdong Innovative Engineering and Technology Research Center for Assisted Circulation, Sun Yat-sen University, Shenzhen, Guangdong 518033, China; National Health Commission Key Laboratory of Assisted Circulation, Sun Yat-sen University, Guangzhou, Guangdong 528478, China
| | - Xinxia Zhang
- Department of Cardiology, The Eighth Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong 518033, China; Guangdong Innovative Engineering and Technology Research Center for Assisted Circulation, Sun Yat-sen University, Shenzhen, Guangdong 518033, China
| | - Shuai Tian
- Department of Cardiology, The Eighth Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong 518033, China; Guangdong Innovative Engineering and Technology Research Center for Assisted Circulation, Sun Yat-sen University, Shenzhen, Guangdong 518033, China; National Health Commission Key Laboratory of Assisted Circulation, Sun Yat-sen University, Guangzhou, Guangdong 528478, China.
| | - Guifu Wu
- Department of Cardiology, The Eighth Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong 518033, China; Guangdong Innovative Engineering and Technology Research Center for Assisted Circulation, Sun Yat-sen University, Shenzhen, Guangdong 518033, China; National Health Commission Key Laboratory of Assisted Circulation, Sun Yat-sen University, Guangzhou, Guangdong 528478, China.
| |
Collapse
|
15
|
Kocak B, Keles A, Akinci D'Antonoli T. Self-reporting with checklists in artificial intelligence research on medical imaging: a systematic review based on citations of CLAIM. Eur Radiol 2024; 34:2805-2815. [PMID: 37740080 DOI: 10.1007/s00330-023-10243-9] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2023] [Revised: 08/09/2023] [Accepted: 08/20/2023] [Indexed: 09/24/2023]
Abstract
OBJECTIVE To evaluate the usage of a well-known and widely adopted checklist, Checklist for Artificial Intelligence in Medical imaging (CLAIM), for self-reporting through a systematic analysis of its citations. METHODS Google Scholar, Web of Science, and Scopus were used to search for citations (date, 29 April 2023). CLAIM's use for self-reporting with proof (i.e., filled-out checklist) and other potential use cases were systematically assessed in research papers. Eligible papers were evaluated independently by two readers, with the help of automatic annotation. Item-by-item confirmation analysis on papers with checklist proof was subsequently performed. RESULTS A total of 391 unique citations were identified from three databases. Of the 118 papers included in this study, 12 (10%) provided a proof of self-reported CLAIM checklist. More than half (70; 59%) only mentioned some sort of adherence to CLAIM without providing any proof in the form of a checklist. Approximately one-third (36; 31%) cited the CLAIM for reasons unrelated to their reporting or methodological adherence. Overall, the claims on 57 to 93% of the items per publication were confirmed in the item-by-item analysis, with a mean and standard deviation of 81% and 10%, respectively. CONCLUSION Only a small proportion of the publications used CLAIM as checklist and supplied filled-out documentation; however, the self-reported checklists may contain errors and should be approached cautiously. We hope that this systematic citation analysis would motivate artificial intelligence community about the importance of proper self-reporting, and encourage researchers, journals, editors, and reviewers to take action to ensure the proper usage of checklists. CLINICAL RELEVANCE STATEMENT Only a small percentage of the publications used CLAIM for self-reporting with proof (i.e., filled-out checklist). However, the filled-out checklist proofs may contain errors, e.g., false claims of adherence, and should be approached cautiously. These may indicate inappropriate usage of checklists and necessitate further action by authorities. KEY POINTS • Of 118 eligible papers, only 12 (10%) followed the CLAIM checklist for self-reporting with proof (i.e., filled-out checklist). More than half (70; 59%) only mentioned some kind of adherence without providing any proof. • Overall, claims on 57 to 93% of the items were valid in item-by-item confirmation analysis, with a mean and standard deviation of 81% and 10%, respectively. • Even with the checklist proof, the items declared may contain errors and should be approached cautiously.
Collapse
Affiliation(s)
- Burak Kocak
- Department of Radiology, University of Health Sciences, Basaksehir Cam and Sakura City Hospital, Istanbul, Turkey.
| | - Ali Keles
- Department of Radiology, University of Health Sciences, Basaksehir Cam and Sakura City Hospital, Istanbul, Turkey
| | - Tugba Akinci D'Antonoli
- Institute of Radiology and Nuclear Medicine, Cantonal Hospital Baselland, Liestal, Switzerland
| |
Collapse
|
16
|
Preobrazenski N, McCaig A, Turner A, Kushner M, Pacitti L, Mendolia P, MacDonald B, Storoschuk K, Bouck T, Zaza Y, Lu S, Gurd BJ. Risk of bias in exercise science: A systematic review of 340 studies. iScience 2024; 27:109010. [PMID: 38405604 PMCID: PMC10884506 DOI: 10.1016/j.isci.2024.109010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2023] [Revised: 12/19/2023] [Accepted: 01/22/2024] [Indexed: 02/27/2024] Open
Abstract
Risk of bias can contribute to irreproducible science and mislead decision making. Analyses of smaller subsections of the exercise science literature suggest many exercise science studies have unclear or high risk of bias. The current review (osf.io/jznv8) assesses whether this unclear or high risk of bias is more widespread in the exercise science literature and whether this bias has decreased since the publication of the 1996 Consolidated Standards of Reporting Trials (CONSORT) guidelines. We report significant reductions in selection, performance, detection, and reporting biases in 2020 compared with 1995 in the 340 of 5,451 studies assessed using the Cochrane Risk of Bias tool. Despite these improvements, most 2020 studies still had unclear or high risks of bias. These results underscore the need for methodological vigilance, adherence to reporting standards, and education on experimental bias. Factors contributing to these improvements, such advancements in education and journal requirements, remain uncertain.
Collapse
Affiliation(s)
| | - Abby McCaig
- School of Kinesiology and Health Studies, Queen’s University, Kingston, ON K7L 3N6, Canada
| | - Anna Turner
- School of Kinesiology and Health Studies, Queen’s University, Kingston, ON K7L 3N6, Canada
| | - Maddy Kushner
- School of Kinesiology and Health Studies, Queen’s University, Kingston, ON K7L 3N6, Canada
| | - Lauren Pacitti
- School of Kinesiology and Health Studies, Queen’s University, Kingston, ON K7L 3N6, Canada
| | - Peter Mendolia
- School of Kinesiology and Health Studies, Queen’s University, Kingston, ON K7L 3N6, Canada
| | - Ben MacDonald
- School of Kinesiology and Health Studies, Queen’s University, Kingston, ON K7L 3N6, Canada
| | - Kristi Storoschuk
- School of Kinesiology and Health Studies, Queen’s University, Kingston, ON K7L 3N6, Canada
| | - Tori Bouck
- School of Kinesiology and Health Studies, Queen’s University, Kingston, ON K7L 3N6, Canada
| | - Youssef Zaza
- School of Kinesiology and Health Studies, Queen’s University, Kingston, ON K7L 3N6, Canada
| | - Stephanie Lu
- School of Kinesiology and Health Studies, Queen’s University, Kingston, ON K7L 3N6, Canada
| | - Brendon J. Gurd
- School of Kinesiology and Health Studies, Queen’s University, Kingston, ON K7L 3N6, Canada
| |
Collapse
|
17
|
Hansford HJ, Cashin AG, Doyle J, Leake HB, McAuley JH, Jones MD. Barriers and Enablers to Using Intervention Reporting Guidelines in Sports and Exercise Medicine Trials: A Mixed-Methods Study. J Orthop Sports Phys Ther 2024; 54:142-152. [PMID: 37970804 DOI: 10.2519/jospt.2023.12110] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/19/2023]
Abstract
OBJECTIVE: To identify barriers and facilitators for using intervention reporting guidelines (CERT and TIDieR) from authors of randomized controlled trials in sports and exercise medicine journals. DESIGN: Mixed-methods cross-sectional online survey. METHODS: We recruited authors of randomized controlled trials published from June 2, 2018, to June 2, 2022, in the 10 leading sports and exercise medicine journals. We invited authors of eligible trials to complete an online survey that included multiple-choice and Likert-scale questions, as well as open-ended free-text questions on the barriers and facilitators to using intervention reporting guidelines. We used descriptive analysis to summarize the quantitative data and a hybrid deductive-inductive thematic analysis to identify barriers and facilitators from the qualitative data. We conducted a subgroup analysis to explore differences in barriers and facilitators between early-mid career researchers and senior researchers. RESULTS: Eighty-four participants from 21 countries completed the survey (44 early-mid-career researchers, 40 senior researchers). We identified 8 themes relating to using intervention reporting guidelines. Themes classified as barriers related to publication constraints (word count limits), low awareness of intervention reporting guidelines, unclear benefits of the guidelines, and the increased burden imposed upon the researcher. Themes classified as facilitators related to journal requirements for guidelines use, the desire to accurately describe interventions, recommendations from other researchers, and reporting guideline use indicating "quality" of work. CONCLUSION: Barriers to using intervention reporting guidelines are largely modifiable and could be addressed by journals mandating their use, and educational initiatives. J Orthop Sports Phys Ther 2024;54(2):1-11. Epub 16 November 2023. doi:10.2519/jospt.2023.12110.
Collapse
|
18
|
Talukdar JR, Chu A, Garg A, Chowdhury F, E. Harnack H, Huang L, Sikorski C, Mbuagbaw L, de Souza RJ. Assessment of reporting quality of randomized controlled trials investigating the effects of inulin-type fructans supplementation on cardiovascular disease risk factors: A systematic survey. PLoS One 2024; 19:e0292184. [PMID: 38166017 PMCID: PMC10760872 DOI: 10.1371/journal.pone.0292184] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2023] [Accepted: 09/11/2023] [Indexed: 01/04/2024] Open
Abstract
BACKGROUND Transparent and detailed reporting of randomized controlled trials (RCTs) is essential to judge its validity and generalizability. We assessed the reporting quality of RCTs examining the effects of inulin-type fructans supplementation on cardiovascular risk factors, before and after the publication of the Consolidated Standards of Reporting Trials (CONSORT) in 2010. METHODS We searched MEDLINE, EMBASE, Emcare, AMED, the Cochrane Library, and CINAHL from inception to May 15, 2022, including the reference lists of selected RCTs. We screened titles and abstracts and extracted the data independently and in duplicate. We included RCTs that investigated the effects of inulin-type fructans on cardiovascular disease risk factors (e.g., low-density lipoprotein cholesterol, triglycerides, fasting blood glucose) in adults (18 years or older). The primary outcomes of this study were: the overall reporting quality of RCTs (defined as the total number of items [0 to 36] present from the CONSORT checklist) published before and after CONSORT; and the study characteristics (e.g., sample size, significance of primary outcome) predictive of the CONSORT score. The secondary outcome was the reporting of each specific item of the CONSORT checklist during pre- and post-CONSORT periods. The mean difference in the total number of reported items in studies published before and after CONSORT were compared using a t-test and Poisson regression to explore the factors associated with overall reporting quality of RCTs. We used Fisher's exact test to compare the adherence to each of the 36 items during pre- and post-CONSORT periods. RESULTS We identified 1,767 citations from our systematic search, of which 55 were eligible. There was a significant increase in the reporting of CONSORT items (mean difference 8.5, 95% confidence interval [CI] 5.24 to 11.71) between studies published before and after publication of CONSORT. The sole variable that was predictive of better reporting quality of RCTs was whether the study was published before or after CONSORT (incidence rate ratio 1.67, 95% CI 1.40 to 2.02). Completeness of reporting of RCTs only improved in 15 out of 36 items (41.6%) after the publication of CONSORT. CONCLUSION The completeness of reporting in RCTs investigating inulin-type fructans supplementation on cardiovascular disease risk factors remains inadequate after the publication of CONSORT. Greater adherence to CONSORT by authors and enforcement of CONSORT by journals may improve the quality of reporting among RCTs.
Collapse
Affiliation(s)
- Jhalok Ronjan Talukdar
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
| | - Alexandro Chu
- Department of Medicine, McMaster University, Hamilton, Ontario, Canada
| | - Anika Garg
- Faculty of Health Sciences, McMaster University, Hamilton, Ontario, Canada
| | - Fariha Chowdhury
- School of Rehabilitation Sciences, McMaster University, Hamilton, Ontario, Canada
| | - Hope E. Harnack
- Department of Kinesiology, McMaster University, Hamilton, Ontario, Canada
| | - Louise Huang
- Faculty of Health Sciences, McMaster University, Hamilton, Ontario, Canada
| | - Claudia Sikorski
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
- Population Health Research Institute, Hamilton Health Sciences Corporation, Hamilton, Ontario, Canada
| | - Lawrence Mbuagbaw
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
- Department of Anesthesia, McMaster University, Hamilton, Ontario, Canada
- Department of Pediatrics, McMaster University, Hamilton, Ontario, Canada
- Biostatistics Unit, Father Sean O’Sullivan Research Centre, St Joseph’s Healthcare, Hamilton, Ontario, Canada
- Centre for Development of Best Practices in Health (CDBPH), Yaoundé Central Hospital, Yaoundé, Cameroon
- Department of Global Health, Stellenbosch University, Cape Town, South Africa
| | - Russell J. de Souza
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
- Population Health Research Institute, Hamilton Health Sciences Corporation, Hamilton, Ontario, Canada
- Toronto 3D Knowledge Synthesis and Clinical Trials Unit, Clinical Nutrition, St Michael’s Hospital, Toronto, ON, Canada
- Clinical Nutrition & Risk Factor Modification Centre, St. Michael’s Hospital, Toronto, Ontario, Canada
- Li Ka Shing Knowledge Institute, St. Michael’s Hospital, Toronto, Ontario, Canada
- Global Health Graduate Program, McMaster University, Hamilton, Ontario, Canada
| |
Collapse
|
19
|
Imam N, Sudah SY, Shaikh SZ, Bonney AA, Nicholson AD, Namdari S, Menendez ME. The Rising Quality of Randomized Controlled Trials in The Journal of Bone & Joint Surgery: An Updated Analysis from 2014 to 2022. JB JS Open Access 2024; 9:e23.00079. [PMID: 38348145 PMCID: PMC10852364 DOI: 10.2106/jbjs.oa.23.00079] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/15/2024] Open
Abstract
Background Previous reports found that 40% of randomized controlled trials (RCTs) published in The Journal of Bone & Joint Surgery (JBJS) from 1988 to 2000 and 47% of those published from 2001 to 2013 were of high quality. The purpose of this study was to assess the quality of RCTs published from 2014 to 2022 in JBJS and to compare these findings with those of prior analyses in order to identify trends over time and areas for continued improvement. Methods PubMed was searched for the term "randomized controlled trial" to identify studies published in JBJS from 2014 to 2022. Each included RCT was evaluated with use of the Detsky score and a risk-of-bias assessment modified from the Cochrane tool. These evaluations were then compared with previous evaluations of RCTs from the 1988 to 2000 and 2001 to 2013 periods with use of independent-sample t tests. A transformed Detsky score of >75% and a modified risk-of-bias score of ≥8 were defined as being indicative of high quality. Results A total of 218 RCTs were published in JBJS from 2014 to 2022. An a priori sample size was calculated in 183 studies (83.9%). A total of 152 (83.1%) of the 183 studies enrolled the calculated number of patients, of which 126 (82.9%) maintained an adequate number at the time of final follow-up. Most RCTs were conducted at a single center (146 of 218; 67%), evaluated a surgical intervention (162 of 218; 74%), and reported positive results (142 of 218; 65%). The mean transformed Detsky score was 85% ± 10% (95% confidence interval, 83.7% to 86.3%), with 82% of trials (179 of 218) scored as high quality. The mean transformed Detsky score from 2014 to 2022 was higher than that from 1988 to 2000 and that from 2001 to 2013 (85% versus 76% and 68%, respectively; p < 0.001). The mean modified risk-of-bias score was 7 ± 1, with 42% of trials (92 of 218) scored as high quality. RCTs published from 2014 to 2022 had a higher mean modified risk-of-bias score than those published from 2001 to 2013 (7 ± 1 versus 6 ± 1; p < 0.001). Compared with the 2001 to 2013 and 2014 to 2022 periods, the 1988 to 2000 period had a greater proportion of trials that reported positive results (51% and 65% versus 82%, respectively; p < 0.001) and that included data from multiple centers (31% and 33% versus 67%; p < 0.001). Conclusions The quality of RCTs published in JBJS from 2014 to 2022 has improved from that reported previously, as demonstrated by the increases in the modified risk-of-bias score and transformed Detsky score from prior periods. This may be the result of journal policies such as the requirements of CONSORT adherence and prospective trial registration. Investigators should focus on improving the clarity of reporting, limiting attrition bias, and making efforts to blind support staff in order to increase the quality of future RCTs. Clinical Relevance Improving the quality of RCTs is crucial given their potential to influence current clinical practice.
Collapse
Affiliation(s)
- Nareena Imam
- Department of Orthopedic Surgery, Rutgers Robert Wood Johnson Medical School, New Brunswick, New Jersey
| | - Suleiman Y. Sudah
- Department of Orthopedic Surgery, Monmouth Medical Center, Long Branch, New Jersey
| | - Siraj Z. Shaikh
- Department of Orthopedic Surgery, Rutgers New Jersey Medical School, Newark, New Jersey
| | - Ashley A. Bonney
- Department of Orthopedic Surgery, Hackensack Meridian School of Medicine, Nutley, New Jersey
| | - Allen D. Nicholson
- Department of Orthopedic Surgery, Monmouth Medical Center, Long Branch, New Jersey
| | - Surena Namdari
- Department of Orthopaedic Surgery, Rothman Orthopaedic Institute, Sidney Kimmel Medical College, Thomas Jefferson University, Philadelphia, Pennsylvania
| | | |
Collapse
|
20
|
Grech V, Eldawlatly AA. STROBE, CONSORT, PRISMA, MOOSE, STARD, SPIRIT, and other guidelines - Overview and application. Saudi J Anaesth 2024; 18:137-141. [PMID: 38313708 PMCID: PMC10833025 DOI: 10.4103/sja.sja_545_23] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2023] [Accepted: 06/24/2023] [Indexed: 02/06/2024] Open
Abstract
The purpose of research is to seek answers and new knowledge. When conducted properly and systematically, research adds to humanity's corpus of knowledge and hence to our general advancement. However, this is only possible if reported research is accurate and transparent. Guidelines for all the major types of studies (STROBE, CONSORT, PRISMA, MOOSE, STARD, and SPIRIT) have been developed and refined over the years, and their inception, development, and application are briefly discussed in this paper. Indeed, there are currently over 250 of these guidelines for various types of medical research, and these are published by the EQUATOR network. This paper will also briefly review progress in acceptance and adoption of these guidelines.
Collapse
Affiliation(s)
- Victor Grech
- Consultant Paediatrician (Cardiology), Mater Dei Hospital, Malta
| | | |
Collapse
|
21
|
Janczak J, Ukegjini K, Bischofberger S, Turina M, Müller PC, Steffen T. Quality of Surgical Outcome Reporting in Randomised Clinical Trials of Multimodal Rectal Cancer Treatment: A Systematic Review. Cancers (Basel) 2023; 16:26. [PMID: 38201454 PMCID: PMC10778098 DOI: 10.3390/cancers16010026] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2023] [Revised: 12/07/2023] [Accepted: 12/18/2023] [Indexed: 01/12/2024] Open
Abstract
INTRODUCTION Randomised controlled trials (RCTs) continue to provide the best evidence for treatment options, but the quality of reporting in RCTs and the completeness rate of reporting of surgical outcomes and complication data vary widely. The aim of this study was to measure the quality of reporting of the surgical outcome and complication data in RCTs of rectal cancer treatment and whether this quality has changed over time. METHODS Eligible articles with the keywords ("rectal cancer" OR "rectal carcinoma") AND ("radiation" OR "radiotherapy") that were RCTs and published in the English, German, Polish, or Italian language were identified by reviewing all abstracts published from 1982 through 2022. Two authors independently screened and analysed all studies. The quality of the surgical outcome and complication data was assessed based on fourteen criteria, and the quality of RCTs was evaluated based on a modified Jadad scale. The primary outcome was the quality of reporting in RCTs and the completeness rate of reporting of surgical results and complication data. RESULTS A total of 340 articles reporting multimodal therapy outcomes for 143,576 rectal cancer patients were analysed. A total of 7 articles (2%) met all 14 reporting criteria, 13 met 13 criteria, 27 met from 11 to 12 criteria, 36 met from 9 to 10 criteria, 76 met from 7 to 8 criteria, and most articles met fewer than 7 criteria (mean 5.5 criteria). Commonly underreported criteria included complication severity (15% of articles), macroscopic integrity of mesorectal excision (17% of articles), length of stay (18% of articles), number of lymph nodes (21% of articles), distance between the tumour and circumferential resection margin (CRM) (26% of articles), surgical radicality according to the site of the primary tumour (R0 vs. R1 + R2) (29% of articles), and CRM status (38% of articles). CONCLUSION Inconsistent surgical outcome and complication data reporting in multimodal rectal cancer treatment RCTs is standard. Standardised reporting of clinical and oncological outcomes should be established to facilitate comparing studies and results of related research topics.
Collapse
Affiliation(s)
- Joanna Janczak
- Clinic for General and Visceral Surgery, Hospital for the Region Fürstenland Toggenburg, CH-9500 Wil, Switzerland;
| | - Kristjan Ukegjini
- Department of Surgery, Hospital of the Canton of St. Gallen, CH-9007 St. Gallen, Switzerland; (K.U.); (S.B.)
| | - Stephan Bischofberger
- Department of Surgery, Hospital of the Canton of St. Gallen, CH-9007 St. Gallen, Switzerland; (K.U.); (S.B.)
| | - Matthias Turina
- Department of Surgery and Transplantation, University Hospital Zurich, CH-8091 Zurich, Switzerland;
| | - Philip C. Müller
- Department of Surgery, Clarunis—University Centre for Gastrointestinal and Hepatopancreatobiliary Diseases, CH-4002 Basel, Switzerland;
| | - Thomas Steffen
- Department of Surgery, Hospital of the Canton of St. Gallen, CH-9007 St. Gallen, Switzerland; (K.U.); (S.B.)
| |
Collapse
|
22
|
Zhang J, Deng J, Wang N, Wang P, Li J, Wang Y, Cui W, Liang F, Chen P, Wang J, Han F, Chan CP, Lyu A, Bian Z, Zhang X. Quality of reporting of integrative Chinese and Western medicine intervention in randomized controlled trials of ulcerative colitis: a review. Syst Rev 2023; 12:228. [PMID: 38062492 PMCID: PMC10704853 DOI: 10.1186/s13643-023-02402-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/01/2023] [Accepted: 11/29/2023] [Indexed: 12/18/2023] Open
Abstract
BACKGROUND Integrative Chinese and Western medicine (ICWM) is commonly used for the treatment of ulcerative colitis (UC) in clinical practice. However, it is unclear whether the details of ICWM interventions, such as selection rationale, implementation design, and potential interactions, were adequately reported. Therefore, this study aimed to assess the quality of reporting in the ICWM interventional randomized controlled trials (RCTs) of UC and to identify the common problems if any. METHODS Through a search of 10 international electronic databases, we identified RCTs of UC with ICWM interventions published in English or Chinese from the inception date of each database up to 16 June 2023. Literature screening was strictly conducted based on the inclusion and exclusion criteria of the Population, Concept, and Context (PCC) framework. The general characteristics of the included studies were described. The quality of reporting was assessed according to three checklists, including the CONSORT (Consolidated Standards of Reporting Trials) with 36 items (except for one item 1b about abstract), the CONSORT for Abstracts (17 items), and a self-designed ICWM-related checklist (27 items covering design rationale, intervention details, outcome assessments, and analysis). The reporting scores of RCTs published before and after 2010 were compared. RESULTS A total of 1458 eligible RCTs were included. For the reporting compliance, the median score (interquartile ranges) of the CONSORT (72 score in total), the CONSORT for Abstract (34 score), and ICWM-related (54 score) items was 21 (18-25), 13 (12-15), and 18 (15-21), respectively. Although the time period comparisons showed that reporting quality of included publications improved significantly after the CONSORT 2010 issued (P < 0.01), more than 50% of items were evaluated as poor quality (reporting rate < 65%) among each checklist, especially in the CONSORT for Abstract and ICWM-specific items. CONCLUSION Although CONSORT appears to have enhanced the reporting of RCTs in UC, the quality of ICWM specifics is variable and in need of improvement. Reporting guidelines of the ICWM recommendations should be developed to improve their quality.
Collapse
Affiliation(s)
- Jialing Zhang
- Hong Kong Chinese Medicine Clinical Study Centre, Chinese EQUATOR Centre, School of Chinese Medicine, Chinese Clinical Trial Registry (Hong Kong), Hong Kong Baptist University, HKSAR, China
- Centre for Chinese Herbal Medicine Drug Development, Hong Kong Baptist University, HKSAR, China
| | - Jiashuai Deng
- School of Traditional Chinese Medicine, Beijing University of Chinese Medicine, Beijing, China
| | - Nana Wang
- Hong Kong Chinese Medicine Clinical Study Centre, Chinese EQUATOR Centre, School of Chinese Medicine, Chinese Clinical Trial Registry (Hong Kong), Hong Kong Baptist University, HKSAR, China
| | - Ping Wang
- China Academy of Chinese Medical Sciences, Xiyuan Hospital, Beijing, China
| | - Ji Li
- Department of Pediatrics, China Academy of Chinese Medical Sciences, Guang'anmen Hospital, Beijing, China
| | - Yunhai Wang
- College of Traditional Chinese Medicine, Tianjin University of Traditional Chinese Medicine, Tianjin, China
| | - Wanting Cui
- College of Traditional Chinese Medicine, Tianjin University of Traditional Chinese Medicine, Tianjin, China
| | - Feng Liang
- Hong Kong Chinese Medicine Clinical Study Centre, Chinese EQUATOR Centre, School of Chinese Medicine, Chinese Clinical Trial Registry (Hong Kong), Hong Kong Baptist University, HKSAR, China
| | - Peijin Chen
- Hong Kong Chinese Medicine Clinical Study Centre, Chinese EQUATOR Centre, School of Chinese Medicine, Chinese Clinical Trial Registry (Hong Kong), Hong Kong Baptist University, HKSAR, China
| | - Juan Wang
- Hong Kong Chinese Medicine Clinical Study Centre, Chinese EQUATOR Centre, School of Chinese Medicine, Chinese Clinical Trial Registry (Hong Kong), Hong Kong Baptist University, HKSAR, China
| | - Fei Han
- Department of Pediatrics, China Academy of Chinese Medical Sciences, Guang'anmen Hospital, Beijing, China
| | - Chun Pong Chan
- Department of Computer Science, Faculty of Science, Hong Kong Baptist University, HKSAR, China
| | - Aiping Lyu
- Hong Kong Chinese Medicine Clinical Study Centre, Chinese EQUATOR Centre, School of Chinese Medicine, Chinese Clinical Trial Registry (Hong Kong), Hong Kong Baptist University, HKSAR, China
| | - Zhaoxiang Bian
- Hong Kong Chinese Medicine Clinical Study Centre, Chinese EQUATOR Centre, School of Chinese Medicine, Chinese Clinical Trial Registry (Hong Kong), Hong Kong Baptist University, HKSAR, China.
- Centre for Chinese Herbal Medicine Drug Development, Hong Kong Baptist University, HKSAR, China.
| | - Xuan Zhang
- Hong Kong Chinese Medicine Clinical Study Centre, Chinese EQUATOR Centre, School of Chinese Medicine, Chinese Clinical Trial Registry (Hong Kong), Hong Kong Baptist University, HKSAR, China.
- Centre for Chinese Herbal Medicine Drug Development, Hong Kong Baptist University, HKSAR, China.
| |
Collapse
|
23
|
Feng Q, Mol BW, Ioannidis JPA, Li W. Statistical significance and publication reporting bias in abstracts of reproductive medicine studies. Hum Reprod 2023; 39:548-558. [PMID: 38015794 PMCID: PMC10905502 DOI: 10.1093/humrep/dead248] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2023] [Revised: 11/06/2023] [Indexed: 11/30/2023] Open
Abstract
STUDY QUESTION What were the frequency and temporal trends of reporting P-values and effect measures in the abstracts of reproductive medicine studies in 1990-2022, how were reported P-values distributed, and what proportion of articles that present with statistical inference reported statistically significant results, i.e. 'positive' results? SUMMARY ANSWER Around one in six abstracts reported P-values alone without effect measures, while the prevalence of effect measures, whether reported alone or accompanied by P-values, has been increasing, especially in meta-analyses and randomized controlled trials (RCTs); the reported P-values were frequently observed around certain cut-off values, notably at 0.001, 0.01, or 0.05, and among abstracts present with statistical inference (i.e. P-value, CIs, or significant terms), a large majority (77%) reported at least one statistically significant finding. WHAT IS KNOWN ALREADY Publishing or reporting only results that show a 'positive' finding causes bias in evaluating interventions and risk factors and may incur adverse health outcomes for patients. Despite efforts to minimize publication reporting bias in medical research, it remains unclear whether the magnitude and patterns of the bias have changed over time. STUDY DESIGN, SIZE, DURATION We studied abstracts of reproductive medicine studies from 1990 to 2022. The reproductive medicine studies were published in 23 first-quartile journals under the category of Obstetrics and Gynaecology and Reproductive Biology in Journal Citation Reports and 5 high-impact general medical journals (The Journal of the American Medical Association, The Lancet, The BMJ, The New England Journal of Medicine, and PLoS Medicine). Articles without abstracts, animal studies, and non-research articles, such as case reports or guidelines, were excluded. PARTICIPANTS/MATERIALS, SETTING, METHODS Automated text-mining was used to extract three types of statistical significance reporting, including P-values, CIs, and text description. Meanwhile, abstracts were text-mined for the presence of effect size metrics and Bayes factors. Five hundred abstracts were randomly selected and manually checked for the accuracy of automatic text extraction. The extracted statistical significance information was then analysed for temporal trends and distribution in general as well as in subgroups of study designs and journals. MAIN RESULTS AND THE ROLE OF CHANCE A total of 24 907 eligible reproductive medicine articles were identified from 170 739 screened articles published in 28 journals. The proportion of abstracts not reporting any statistical significance inference halved from 81% (95% CI, 76-84%) in 1990 to 40% (95% CI, 38-44%) in 2021, while reporting P-values alone remained relatively stable, at 15% (95% CI, 12-18%) in 1990 and 19% (95% CI, 16-22%) in 2021. By contrast, the proportion of abstracts reporting effect measures alone increased considerably from 4.1% (95% CI, 2.6-6.3%) in 1990 to 26% (95% CI, 23-29%) in 2021. Similarly, the proportion of abstracts reporting effect measures together with P-values showed substantial growth from 0.8% (95% CI, 0.3-2.2%) to 14% (95% CI, 12-17%) during the same timeframe. Of 30 182 statistical significance inferences, 56% (n = 17 077) conveyed statistical inferences via P-values alone, 30% (n = 8945) via text description alone such as significant or non-significant, 9.3% (n = 2820) via CIs alone, and 4.7% (n = 1340) via both CI and P-values. The reported P-values (n = 18 417), including both a continuum of P-values and dichotomized P-values, were frequently observed around common cut-off values such as 0.001 (20%), 0.05 (16%), and 0.01 (10%). Of the 13 200 reproductive medicine abstracts containing at least one statistical inference, 77% of abstracts made at least one statistically significant statement. Among articles that reported statistical inference, a decline in the proportion of making at least one statistically significant inference was only seen in RCTs, dropping from 71% (95% CI, 48-88%) in 1990 to 59% (95% CI, 42-73%) in 2021, whereas the proportion in the rest of study types remained almost constant over the years. Of abstracts that reported P-value, 87% (95% CI, 86-88%) reported at least one statistically significant P-value; it was 92% (95% CI, 82-97%) in 1990 and reached its peak at 97% (95% CI, 93-99%) in 2001 before declining to 81% (95% CI, 76-85%) in 2021. LIMITATIONS, REASONS FOR CAUTION First, our analysis focused solely on reporting patterns in abstracts but not full-text papers; however, in principle, abstracts should include condensed impartial information and avoid selective reporting. Second, while we attempted to identify all types of statistical significance reporting, our text mining was not flawless. However, the manual assessment showed that inaccuracies were not frequent. WIDER IMPLICATIONS OF THE FINDINGS There is a welcome trend that effect measures are increasingly reported in the abstracts of reproductive medicine studies, specifically in RCTs and meta-analyses. Publication reporting bias remains a major concern. Inflated estimates of interventions and risk factors could harm decisions built upon biased evidence, including clinical recommendations and planning of future research. STUDY FUNDING/COMPETING INTEREST(S) No funding was received for this study. B.W.M. is supported by an NHMRC Investigator grant (GNT1176437); B.W.M. reports research grants and travel support from Merck and consultancy from Merch and ObsEva. W.L. is supported by an NHMRC Investigator Grant (GNT2016729). Q.F. reports receiving a PhD scholarship from Merck. The other author has no conflict of interest to declare. TRIAL REGISTRATION NUMBER N/A.
Collapse
Affiliation(s)
- Qian Feng
- Department of Obstetrics and Gynaecology, Monash University, Clayton, VIC, Australia
| | - Ben W Mol
- Department of Obstetrics and Gynaecology, Monash University, Clayton, VIC, Australia
- Aberdeen Centre for Women’s Health Research, School of Medicine, Medical Sciences and Nutrition, University of Aberdeen, Aberdeen, UK
| | - John P A Ioannidis
- Department of Medicine, Stanford University, Stanford, CA, USA
- Department of Epidemiology and Population Health, Stanford University, Stanford, CA, USA
- Department of Biomedical Data Science, Stanford University, Stanford, CA, USA
- Department of Statistics, Stanford University, Stanford, CA, USA
- Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, CA, USA
| | - Wentao Li
- Department of Obstetrics and Gynaecology, Monash University, Clayton, VIC, Australia
| |
Collapse
|
24
|
Garegnani LI. Bias, quality and reporting in health research: differences and tools for appraisal. BMJ Evid Based Med 2023; 28:407-409. [PMID: 37076263 DOI: 10.1136/bmjebm-2023-112260] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 04/09/2023] [Indexed: 04/21/2023]
Affiliation(s)
- Luis Ignacio Garegnani
- Research department, Instituto Universitario del Hospital Italiano de Buenos Aires, Buenos Aires, Argentina
| |
Collapse
|
25
|
Hollis-Hansen K, Tan S, Bargnesi S, McGovern L, Drozdowsky J, Epstein LH, Leone LA, Mak E, Masci J, Anzman-Frasca S. Feasibility and implementation of a grocery shopping intervention for adults diagnosed with or at-risk for type 2 diabetes. Public Health Nutr 2023; 26:2118-2129. [PMID: 37496394 PMCID: PMC10564597 DOI: 10.1017/s1368980023001453] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2022] [Revised: 05/23/2023] [Accepted: 07/05/2023] [Indexed: 07/28/2023]
Abstract
OBJECTIVE To examine the feasibility and implementation of an optimal defaults intervention designed to align grocery purchases with a diet recommended for people with or at-risk for type 2 diabetes. DESIGN This was a 5-week pilot randomised trial with three groups: in-person grocery shopping, shopping online and shopping online with 'default' carts. Participants were asked to shop normally in Week One, according to group assignment in Weeks Two-Four (intervention period), and as preferred in Week Five. All groups received diabetes-friendly recipes via email each intervention week. SETTING Participants grocery shopped in person or online. Grocery receipt forms, enrolment information and exit surveys were collected remotely and used to assess feasibility and implementation. PARTICIPANTS Sixty-five adults with or at-risk for type 2 diabetes. RESULTS Sixty-two participants completed the exit survey and fifty-five submitted receipts all 5 weeks. Forty utilised recipes, 95 % of whom indicated recipes were somewhat or very useful. Orange chicken, quesadillas and pork with potato and apples were the most liked recipes. Most Defaults group participants accepted at least some default cart items. Recipes with the highest default acceptance were whole grain pasta and chicken, quesadillas with black beans and chicken with olives. Participants' primary concerns about the intervention were costs associated with online shopping, inability to select preferred foods and some recipes including ingredients household members would not eat. CONCLUSIONS The study had high retention, data were successfully collected remotely and the intervention was acceptable to most participants. Tailoring recipes to household preferences may be beneficial in future studies.
Collapse
Affiliation(s)
- Kelseanna Hollis-Hansen
- Peter O’Donnell Jr. School of Public Health, UT Southwestern Medical Center, Dallas, TX, USA
- Harold C. Simmons Comprehensive Cancer Center, Dallas, TX, USA
| | - Sherey Tan
- Department of Pediatrics, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, USA
| | - Sarah Bargnesi
- Department of Pediatrics, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, USA
| | - Lily McGovern
- Department of Pediatrics, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, USA
| | - Julia Drozdowsky
- Department of Pediatrics, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, USA
| | - Leonard H Epstein
- Department of Pediatrics, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, USA
- Center for Ingestive Behavior Research, University at Buffalo, Buffalo, NY, USA
| | - Lucia A Leone
- Center for Ingestive Behavior Research, University at Buffalo, Buffalo, NY, USA
- Department of Community Health and Health Behavior, School of Public Health and Health Professions, University at Buffalo, Buffalo, NY, USA
| | - Eunice Mak
- Department of Pediatrics, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, USA
| | - Jaclyn Masci
- Department of Community Health and Health Behavior, School of Public Health and Health Professions, University at Buffalo, Buffalo, NY, USA
| | - Stephanie Anzman-Frasca
- Department of Pediatrics, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, USA
- Center for Ingestive Behavior Research, University at Buffalo, Buffalo, NY, USA
| |
Collapse
|
26
|
Hansford HJ, Cashin AG, Jones MD, Swanson SA, Islam N, Douglas SRG, Rizzo RRN, Devonshire JJ, Williams SA, Dahabreh IJ, Dickerman BA, Egger M, Garcia-Albeniz X, Golub RM, Lodi S, Moreno-Betancur M, Pearson SA, Schneeweiss S, Sterne JAC, Sharp MK, Stuart EA, Hernán MA, Lee H, McAuley JH. Reporting of Observational Studies Explicitly Aiming to Emulate Randomized Trials: A Systematic Review. JAMA Netw Open 2023; 6:e2336023. [PMID: 37755828 PMCID: PMC10534275 DOI: 10.1001/jamanetworkopen.2023.36023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/09/2023] [Accepted: 08/22/2023] [Indexed: 09/28/2023] Open
Abstract
Importance Observational (nonexperimental) studies that aim to emulate a randomized trial (ie, the target trial) are increasingly informing medical and policy decision-making, but it is unclear how these studies are reported in the literature. Consistent reporting is essential for quality appraisal, evidence synthesis, and translation of evidence to policy and practice. Objective To assess the reporting of observational studies that explicitly aimed to emulate a target trial. Evidence Review We searched Medline, Embase, PsycINFO, and Web of Science for observational studies published between March 2012 and October 2022 that explicitly aimed to emulate a target trial of a health or medical intervention. Two reviewers double-screened and -extracted data on study characteristics, key predefined components of the target trial protocol and its emulation (eligibility criteria, treatment strategies, treatment assignment, outcome[s], follow-up, causal contrast[s], and analysis plan), and other items related to the target trial emulation. Findings A total of 200 studies that explicitly aimed to emulate a target trial were included. These studies included 26 subfields of medicine, and 168 (84%) were published from January 2020 to October 2022. The aim to emulate a target trial was explicit in 70 study titles (35%). Forty-three studies (22%) reported use of a published reporting guideline (eg, Strengthening the Reporting of Observational Studies in Epidemiology). Eighty-five studies (43%) did not describe all key items of how the target trial was emulated and 113 (57%) did not describe the protocol of the target trial and its emulation. Conclusion and Relevance In this systematic review of 200 studies that explicitly aimed to emulate a target trial, reporting of how the target trial was emulated was inconsistent. A reporting guideline for studies explicitly aiming to emulate a target trial may improve the reporting of the target trial protocols and other aspects of these emulation attempts.
Collapse
Affiliation(s)
- Harrison J. Hansford
- School of Health Sciences, Faculty of Medicine and Health, UNSW Sydney, Sydney, Australia
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| | - Aidan G. Cashin
- School of Health Sciences, Faculty of Medicine and Health, UNSW Sydney, Sydney, Australia
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| | - Matthew D. Jones
- School of Health Sciences, Faculty of Medicine and Health, UNSW Sydney, Sydney, Australia
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| | - Sonja A. Swanson
- Department of Epidemiology, University of Pittsburgh, Pittsburgh, Pennsylvania
- CAUSALab, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
| | - Nazrul Islam
- Oxford Population Health, Big Data Institute, University of Oxford, Oxford, United Kingdom
- Faculty of Medicine, University of Southampton, Southampton, United Kingdom
| | - Susan R. G. Douglas
- School of Health Sciences, Faculty of Medicine and Health, UNSW Sydney, Sydney, Australia
| | - Rodrigo R. N. Rizzo
- School of Health Sciences, Faculty of Medicine and Health, UNSW Sydney, Sydney, Australia
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| | - Jack J. Devonshire
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| | - Sam A. Williams
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| | - Issa J. Dahabreh
- CAUSALab, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
| | - Barbra A. Dickerman
- CAUSALab, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
| | - Matthias Egger
- Institute of Social and Preventive Medicine, University of Bern, Bern, Switzerland
- Centre for Infectious Disease Epidemiology and Research, Faculty of Health Sciences, University of Cape Town, Cape Town, South Africa
- Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, United Kingdom
| | - Xabier Garcia-Albeniz
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- RTI Health Solutions, Barcelona, Spain
| | - Robert M. Golub
- Department of Medicine, Northwestern University Feinberg School of Medicine, Chicago, Illinois
| | - Sara Lodi
- CAUSALab, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- Department of Biostatistics, Boston University School of Public Health, Boston, Massachusetts
| | - Margarita Moreno-Betancur
- Clinical Epidemiology & Biostatistics Unit, Murdoch Children’s Research Institute, Royal Children’s Hospital, Parkville, Victoria, Australia
- Department of Paediatrics, The University of Melbourne, Parkville, Victoria, Australia
| | - Sallie-Anne Pearson
- School of Population Health, Faculty of Medicine and Health, UNSW Sydney, New South Wales, Australia
| | - Sebastian Schneeweiss
- Division of Pharmacoepidemiology, Department of Medicine, Brigham & Women’s Hospital, Harvard Medical School, Boston, Massachusetts
| | - Jonathan A. C. Sterne
- Department of Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, United Kingdom
- NIHR Bristol Biomedical Research Centre, Bristol, United Kingdom
- Health Data Research UK South-West, Bristol, United Kingdom
| | - Melissa K. Sharp
- Department of Public Health and Epidemiology, RCSI University of Medicine and Health Sciences, Dublin, Ireland
| | - Elizabeth A. Stuart
- Department of Biostatistics, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland
| | - Miguel A. Hernán
- CAUSALab, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
| | - Hopin Lee
- University of Exeter Medical School, Exeter, United Kingdom
| | - James H. McAuley
- School of Health Sciences, Faculty of Medicine and Health, UNSW Sydney, Sydney, Australia
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| |
Collapse
|
27
|
Klement W, El Emam K. Consolidated Reporting Guidelines for Prognostic and Diagnostic Machine Learning Modeling Studies: Development and Validation. J Med Internet Res 2023; 25:e48763. [PMID: 37651179 PMCID: PMC10502599 DOI: 10.2196/48763] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2023] [Revised: 07/11/2023] [Accepted: 07/31/2023] [Indexed: 09/01/2023] Open
Abstract
BACKGROUND The reporting of machine learning (ML) prognostic and diagnostic modeling studies is often inadequate, making it difficult to understand and replicate such studies. To address this issue, multiple consensus and expert reporting guidelines for ML studies have been published. However, these guidelines cover different parts of the analytics lifecycle, and individually, none of them provide a complete set of reporting requirements. OBJECTIVE We aimed to consolidate the ML reporting guidelines and checklists in the literature to provide reporting items for prognostic and diagnostic ML in in-silico and shadow mode studies. METHODS We conducted a literature search that identified 192 unique peer-reviewed English articles that provide guidance and checklists for reporting ML studies. The articles were screened by their title and abstract against a set of 9 inclusion and exclusion criteria. Articles that were filtered through had their quality evaluated by 2 raters using a 9-point checklist constructed from guideline development good practices. The average κ was 0.71 across all quality criteria. The resulting 17 high-quality source papers were defined as having a quality score equal to or higher than the median. The reporting items in these 17 articles were consolidated and screened against a set of 6 inclusion and exclusion criteria. The resulting reporting items were sent to an external group of 11 ML experts for review and updated accordingly. The updated checklist was used to assess the reporting in 6 recent modeling papers in JMIR AI. Feedback from the external review and initial validation efforts was used to improve the reporting items. RESULTS In total, 37 reporting items were identified and grouped into 5 categories based on the stage of the ML project: defining the study details, defining and collecting the data, modeling methodology, model evaluation, and explainability. None of the 17 source articles covered all the reporting items. The study details and data description reporting items were the most common in the source literature, with explainability and methodology guidance (ie, data preparation and model training) having the least coverage. For instance, a median of 75% of the data description reporting items appeared in each of the 17 high-quality source guidelines, but only a median of 33% of the data explainability reporting items appeared. The highest-quality source articles tended to have more items on reporting study details. Other categories of reporting items were not related to the source article quality. We converted the reporting items into a checklist to support more complete reporting. CONCLUSIONS Our findings supported the need for a set of consolidated reporting items, given that existing high-quality guidelines and checklists do not individually provide complete coverage. The consolidated set of reporting items is expected to improve the quality and reproducibility of ML modeling studies.
Collapse
Affiliation(s)
- William Klement
- University of Ottawa, Ottawa, ON, Canada
- CHEO Research Institute, Ottawa, ON, Canada
| | - Khaled El Emam
- University of Ottawa, Ottawa, ON, Canada
- CHEO Research Institute, Ottawa, ON, Canada
| |
Collapse
|
28
|
Heissel A, Heinen D, Brokmeier LL, Skarabis N, Kangas M, Vancampfort D, Stubbs B, Firth J, Ward PB, Rosenbaum S, Hallgren M, Schuch F. Exercise as medicine for depressive symptoms? A systematic review and meta-analysis with meta-regression. Br J Sports Med 2023; 57:1049-1057. [PMID: 36731907 PMCID: PMC10423472 DOI: 10.1136/bjsports-2022-106282] [Citation(s) in RCA: 72] [Impact Index Per Article: 72.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/11/2023] [Indexed: 02/04/2023]
Abstract
OBJECTIVE To estimate the efficacy of exercise on depressive symptoms compared with non-active control groups and to determine the moderating effects of exercise on depression and the presence of publication bias. DESIGN Systematic review and meta-analysis with meta-regression. DATA SOURCES The Cochrane Central Register of Controlled Trials, PubMed, MEDLINE, Embase, SPORTDiscus, PsycINFO, Scopus and Web of Science were searched without language restrictions from inception to 13 September2022 (PROSPERO registration no CRD42020210651). ELIGIBILITY CRITERIA FOR SELECTING STUDIES Randomised controlled trials including participants aged 18 years or older with a diagnosis of major depressive disorder or those with depressive symptoms determined by validated screening measures scoring above the threshold value, investigating the effects of an exercise intervention (aerobic and/or resistance exercise) compared with a non-exercising control group. RESULTS Forty-one studies, comprising 2264 participants post intervention were included in the meta-analysis demonstrating large effects (standardised mean difference (SMD)=-0.946, 95% CI -1.18 to -0.71) favouring exercise interventions which corresponds to the number needed to treat (NNT)=2 (95% CI 1.68 to 2.59). Large effects were found in studies with individuals with major depressive disorder (SMD=-0.998, 95% CI -1.39 to -0.61, k=20), supervised exercise interventions (SMD=-1.026, 95% CI -1.28 to -0.77, k=40) and moderate effects when analyses were restricted to low risk of bias studies (SMD=-0.666, 95% CI -0.99 to -0.34, k=12, NNT=2.8 (95% CI 1.94 to 5.22)). CONCLUSION Exercise is efficacious in treating depression and depressive symptoms and should be offered as an evidence-based treatment option focusing on supervised and group exercise with moderate intensity and aerobic exercise regimes. The small sample sizes of many trials and high heterogeneity in methods should be considered when interpreting the results.
Collapse
Affiliation(s)
- Andreas Heissel
- Social and Preventive Medicine, Department of Sports and Health Sciences, Intra faculty unit "Cognitive Sciences", Faculty of Human Science and Faculty of Health Sciences Brandenburg, Research Area Services Research and e-Health, Potsdam, Brandenburg, Germany
| | - Darlene Heinen
- Social and Preventive Medicine, Department of Sports and Health Sciences, Intra faculty unit "Cognitive Sciences", Faculty of Human Science and Faculty of Health Sciences Brandenburg, Research Area Services Research and e-Health, Potsdam, Brandenburg, Germany
| | - Luisa Leonie Brokmeier
- Social and Preventive Medicine, Department of Sports and Health Sciences, Intra faculty unit "Cognitive Sciences", Faculty of Human Science and Faculty of Health Sciences Brandenburg, Research Area Services Research and e-Health, Potsdam, Brandenburg, Germany
| | - Nora Skarabis
- Social and Preventive Medicine, Department of Sports and Health Sciences, Intra faculty unit "Cognitive Sciences", Faculty of Human Science and Faculty of Health Sciences Brandenburg, Research Area Services Research and e-Health, Potsdam, Brandenburg, Germany
| | - Maria Kangas
- School of Psychological Sciences, Centre for Emotional Health, Macquarie University, Sydney, New South Wales, Australia
| | - Davy Vancampfort
- Department of Rehabilitation Sciences, University of Leuven, Leuven, Belgium
| | - Brendon Stubbs
- Physiotherapy Department, South London and Maudsley NHS Foundation Trust; Department of Psychological Medicine, Institute of Psychiatry, Psychology and Neuroscience, Kings College London, London, UK
| | - Joseph Firth
- Division of Psychology and Mental Health, University of Manchester, Manchester Academic Health Science Centre, Manchester, UK; NICM Health Research Institute, Western Sydney University, Westmead Australia; Greater Manchester Mental Health NHS Foundation Trust, Manchester Academic Health Science Centre, Manchester, UK
| | - Philip B Ward
- Discipline of Psychiatry and Mental Health, UNSW Sydney, Sydney New South Wales, Australia; Ingham Institute of Applied Medical Research, UNSW, Liverpool BC, New South Wales, Australia
| | - Simon Rosenbaum
- School of Psychiatry, UNSW, Sydney, New South Wales, Australia
| | - Mats Hallgren
- Epidemiology of Psychiatric Conditions, Substance use and Social Environment (EPiCSS), Department of Public Health Sciences, Karolinska Institute Solna, Solna, Sverige, Sweden
| | - Felipe Schuch
- Department of Sports Methods and Techniques, Federal University of Santa Maria, Santa Maria, Brazil
- Institute of Psychiatry, Federal University of Rio de Janeiro, Rio de Janeiro, Brazil
- Universidad Autónoma de Chile, Providencia, Chile
| |
Collapse
|
29
|
Plumb AN, Lesnak JB, Berardi G, Hayashi K, Janowski AJ, Smith AF, Bailey D, Kerkman C, Kienenberger Z, Martin B, Patterson E, Van Roekel H, Vance CGT, Sluka KA. Standing on the shoulders of bias: lack of transparency and reporting of critical rigor characteristics in pain research. Pain 2023; 164:1775-1782. [PMID: 36877823 PMCID: PMC10356741 DOI: 10.1097/j.pain.0000000000002874] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2022] [Accepted: 01/03/2023] [Indexed: 03/08/2023]
Abstract
ABSTRACT Rigorous experimental design with transparent reporting in biomedical science reduces risk of bias and allows for scientists to judge the quality of the research. Basic factors of rigor such as blinding, randomization, power analysis, and inclusion of both sexes impact the reproducibility by reducing experimental bias. We designed a systematic study to analyze basic factors of rigor, inclusion of sex, and whether data were analyzed or disaggregated by sex over the past 10 years in the journal PAIN . Studies that included humans reported randomization in 81%, blinding in 48%, and the use of a power analysis calculation in 27% over the past 10 years. Studies that included mice reported randomization in 35%, blinding in 70%, and the use of a power analysis in 9%. Studies that included rats reported randomization in 38%, blinding in 63%, and the use of power analysis in 12%. This study also found that human studies consistently included both sexes over the past decade, but less than 20% of data were disaggregated or analyzed for sex differences. Although mouse and rat studies predominately used males only, there has been a slight increase in inclusion of both sexes over the past few years. Justification for single-sex studies was below 50% in both human and rodent data. In both human and animal studies, transparency in reporting of experimental design and inclusion of both sexes should be considered standard practice and will result in improved quality and reproducibility of published research.
Collapse
Affiliation(s)
- Ashley N Plumb
- Department of Physical Therapy and Rehabilitation Science, University of Iowa, Iowa City, IA, United States
| | | | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
30
|
Melo JLDMA, Coelho CPES, Nunes FDPES, Heller D, Grisi DC, Guimarães MDCM, Dame-Teixeira N. A scoping review on hyposalivation associated with systemic conditions: the role of physical stimulation in the treatment approaches. BMC Oral Health 2023; 23:505. [PMID: 37480103 PMCID: PMC10360219 DOI: 10.1186/s12903-023-03192-8] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2023] [Accepted: 06/30/2023] [Indexed: 07/23/2023] Open
Abstract
BACKGROUND Several systemic conditions can result in distinct degrees of salivary gland damage and consequent hypofunction. The development of successful management schemes is highly challenging due to the complexity of saliva. This study aimed to systematically map the literature on the physical stimulation of salivary glands for hyposalivation management and the response of individuals according to different systemic conditions causing salivary impairment. METHODS A systematic search in the literature was performed. Two reviewers independently selected clinical trials, randomized or not, that used physical stimulation to treat hyposalivation caused by systemic conditions. Studies evaluating healthy subjects without hyposalivation were included as controls. Single-arm clinical studies or case series were also included for protocol mapping (PRISMA extension for scoping reviews). RESULTS Out of 24 included studies, 10 evaluated healthy subjects, from which 9 tested transcutaneous electrical nerve stimulation (TENS) and 1 tested acupuncture and electroacupuncture. Fourteen studies evaluated individuals with hyposalivation: 6 applied TENS, 6 applied low-level laser therapy (LLLT), and 2 applied acupuncture, carried out in post-chemotherapy, medication use, postmenopausal women, hemodialysis patients, smokers, diabetics, Sjögren's syndrome (SS). All showed increased salivation after treatment, except for two LLLT studies in individuals with SS. CONCLUSIONS Among the different patient groups, individuals with Sjögren's syndrome (SS) exhibited the poorest responses, while those with medication-induced hyposalivation demonstrated the most favorable treatment outcomes, independently of the management strategy for saliva stimulation. It means that physical stimulation of salivary glands holds promise as an alternative for managing hyposalivation in cases of reversible gland damage. However, to make informed decisions in current practice, it is necessary to conduct new well-designed randomized clinical trials with appropriate methodologies.
Collapse
Affiliation(s)
| | | | | | - Debora Heller
- Post Graduate Program in Dentistry, Cruzeiro Do Sul University, São Paulo, Brazil
- Experimental Research, Hospital Israelita Albert Einstein, São Paulo, Brazil
- Department of Periodontology, UT Health San Antonio, San Antonio, TX, USA
| | - Daniela Corrêa Grisi
- Department of Dentistry, School of Health Sciences, University of Brasilia, Brasília, Brazil.
| | | | - Naile Dame-Teixeira
- Department of Dentistry, School of Health Sciences, University of Brasilia, Brasília, Brazil.
- Oral Biology Division, School of Dentistry, University of Leeds, Leeds, UK.
| |
Collapse
|
31
|
Lee YS, Kim SY, Lee H, Chae Y, Lee MS. ACURATE: A guide for reporting sham controls in trials using acupuncture. Integr Med Res 2023; 12:100955. [PMID: 37250752 PMCID: PMC10220258 DOI: 10.1016/j.imr.2023.100955] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2023] [Revised: 05/03/2023] [Accepted: 05/10/2023] [Indexed: 05/31/2023] Open
Abstract
This paper presents the Acupuncture Controls gUideline for Reporting humAn Trials and Experiments (ACURATE) checklist, an extension of The Consolidated Standards for Reporting of Trials (CONSORT) and to be used along with STandards for Reporting Interventions in Clinical Trials of Acupuncture (STRICTA) when both real and sham acupuncture needles are used in the study. This checklist focuses on a clear depiction of sham needling procedures to enhance replicability and enable a precise appraisal. We encourage researchers to use ACURATE in trials and reviews involving sham acupuncture to assist reporting of sham acupuncture procedures and the related components.
Collapse
Affiliation(s)
- Ye-Seul Lee
- Jaseng Spine and Joint Research Institute, Jaseng Medical Foundation, Seoul, Republic of Korea
| | - Song-Yi Kim
- Department of Anatomy and Acupoint, College of Korean Medicine, Gachon University, Seongnam, Republic of Korea
| | - Hyangsook Lee
- Department of Science in Korean Medicine, College of Korean Medicine, Graduate School, Kyung Hee University, Seoul, Republic of Korea
| | - Younbyoung Chae
- Acupuncture and Meridian Science Research Center, College of Korean Medicine, Kyung Hee University, Seoul, Republic of Korea
| | - Myeong Soo Lee
- KM Science Research Division, Korea Institute of Oriental Medicine, Daejeon, Republic of Korea
| |
Collapse
|
32
|
Machine Learning Models to Forecast Outcomes of Pituitary Surgery: A Systematic Review in Quality of Reporting and Current Evidence. Brain Sci 2023; 13:brainsci13030495. [PMID: 36979305 PMCID: PMC10046799 DOI: 10.3390/brainsci13030495] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2023] [Revised: 03/08/2023] [Accepted: 03/13/2023] [Indexed: 03/17/2023] Open
Abstract
Background: The complex nature and heterogeneity involving pituitary surgery results have increased interest in machine learning (ML) applications for prediction of outcomes over the last decade. This study aims to systematically review the characteristics of ML models involving pituitary surgery outcome prediction and assess their reporting quality. Methods: We searched the PubMed, Scopus, and Web of Knowledge databases for publications on the use of ML to predict pituitary surgery outcomes. We used the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) to assess report quality. Our search strategy was based on the terms “artificial intelligence”, “machine learning”, and “pituitary”. Results: 20 studies were included in this review. The principal models reported in each article were post-surgical endocrine outcomes (n = 10), tumor management (n = 3), and intra- and postoperative complications (n = 7). Overall, the included studies adhered to a median of 65% (IQR = 60–72%) of TRIPOD criteria, ranging from 43% to 83%. The median reported AUC was 0.84 (IQR = 0.80–0.91). The most popular algorithms were support vector machine (n = 5) and random forest (n = 5). Only two studies reported external validation and adherence to any reporting guideline. Calibration methods were not reported in 15 studies. No model achieved the phase of actual clinical applicability. Conclusion: Applications of ML in the prediction of pituitary outcomes are still nascent, as evidenced by the lack of any model validated for clinical practice. Although studies have demonstrated promising results, greater transparency in model development and reporting is needed to enable their use in clinical practice. Further adherence to reporting guidelines can help increase AI’s real-world utility and improve clinical practice.
Collapse
|
33
|
Lee YS, Kim SY, Lee H, Chae Y, Lee MS. ACURATE: A guide for reporting sham controls in trials using acupuncture. J Evid Based Med 2023; 16:82-90. [PMID: 36959765 DOI: 10.1111/jebm.12524] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/09/2022] [Accepted: 03/06/2023] [Indexed: 03/25/2023]
Abstract
OBJECTIVE To promote better reporting quality regarding sham acupuncture in clinical trials for a precise appraisal of the adequacy of the sham acupuncture procedure. METHODS A three-stage online Delphi survey was conducted to a group of experts. Items with higher than 80% consensus from the initial checklist were selected as the final candidates. Further discussion among the working group was convened to preclude potential redundancy among the items. RESULTS A total of 23 experts out of 35 (66%) responded to the Delphi process. The final checklist consists of 23 items in six categories: type of sham acupuncture, details of sham acupuncture manipulation, location of sham acupuncture, treatment regimen, practitioner, and protocol and settings. CONCLUSION This paper presents the Acupuncture Controls gUideline for Reporting humAn Trials and Experiments (ACURATE) checklist, an extension of The Consolidated Standards for Reporting of Trials (CONSORT) and to be used along with STandards for Reporting Interventions in Clinical Trials of Acupuncture (STRICTA) when sham acupuncture needles are used in the study. This checklist focuses on a clear depiction of sham needling procedures to enhance replicability and enable a precise appraisal. We encourage researchers to use ACURATE in trials and reviews involving sham acupuncture to assist reporting sham acupuncture procedures and the related components.
Collapse
Affiliation(s)
- Ye-Seul Lee
- Jaseng Spine and Joint Research Institute, Jaseng Medical Foundation, Seoul, Republic of Korea
| | - Song-Yi Kim
- Department of Anatomy and Acupoint, College of Korean Medicine, Gachon University, Seongnam, Republic of Korea
| | - Hyangsook Lee
- Department of Science in Korean Medicine, College of Korean Medicine, Graduate School, Kyung Hee University, Seoul, Republic of Korea
| | - Younbyoung Chae
- Acupuncture and Meridian Science Research Center, College of Korean Medicine, Kyung Hee University, Seoul, Republic of Korea
| | - Myeong Soo Lee
- KM Science Research Division, Korea Institute of Oriental Medicine, Daejeon, Republic of Korea
| |
Collapse
|
34
|
Towards a Checklist for Improving Action Research Quality in Healthcare Contexts. SYSTEMIC PRACTICE AND ACTION RESEARCH 2023. [DOI: 10.1007/s11213-023-09635-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/23/2023]
Abstract
AbstractPublished accounts of action research studies in healthcare frequently underreport the quality of the action research. These studies often lack the specificity and details needed to demonstrate the rationale for the selection of an action research approach and how the authors perceive the respective study to have met action research quality criteria. This lack contributes to a perception among academics, research funding agencies, clinicians and policy makers, that action research is ‘second class’ research. This article addresses the challenge of this perception by offering a bespoke checklist called a Quality Action Research Checklist (QuARC) for reporting action research studies and is based on a quality framework first published in this journal. This checklist, comprising four factors - context, quality of relationships, quality of the action research process itself and the dual outcomes, aims to encourage researchers to provide complete and transparent reporting and indirectly improve the rigor and quality of action research. In addition, the benefit of using a checklist and the challenges inherent in such application are also discussed.
Collapse
|
35
|
Liu X, Cruz Rivera S, Moher D, Calvert MJ, Denniston AK. [Reporting guidelines for clinical trial reports for interventions involving artificial intelligence: the CONSORT-AI extensionDiretrizes para relatórios de ensaios clínicos com intervenções que utilizam inteligência artificial: a extensão CONSORT-AI]. Rev Panam Salud Publica 2023; 48:e13. [PMID: 38352035 PMCID: PMC10863743 DOI: 10.26633/rpsp.2024.13] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2020] [Accepted: 07/23/2020] [Indexed: 02/16/2024] Open
Abstract
The CONSORT 2010 statement provides minimum guidelines for reporting randomized trials. Its widespread use has been instrumental in ensuring transparency in the evaluation of new interventions. More recently, there has been a growing recognition that interventions involving artificial intelligence (AI) need to undergo rigorous, prospective evaluation to demonstrate impact on health outcomes. The CONSORT-AI (Consolidated Standards of Reporting Trials-Artificial Intelligence) extension is a new reporting guideline for clinical trials evaluating interventions with an AI component. It was developed in parallel with its companion statement for clinical trial protocols: SPIRIT-AI (Standard Protocol Items: Recommendations for Interventional Trials-Artificial Intelligence). Both guidelines were developed through a staged consensus process involving literature review and expert consultation to generate 29 candidate items, which were assessed by an international multi-stakeholder group in a two-stage Delphi survey (103 stakeholders), agreed upon in a two-day consensus meeting (31 stakeholders) and refined through a checklist pilot (34 participants). The CONSORT-AI extension includes 14 new items that were considered sufficiently important for AI interventions that they should be routinely reported in addition to the core CONSORT 2010 items. CONSORT-AI recommends that investigators provide clear descriptions of the AI intervention, including instructions and skills required for use, the setting in which the AI intervention is integrated, the handling of inputs and outputs of the AI intervention, the human-AI interaction and provision of an analysis of error cases. CONSORT-AI will help promote transparency and completeness in reporting clinical trials for AI interventions. It will assist editors and peer reviewers, as well as the general readership, to understand, interpret and critically appraise the quality of clinical trial design and risk of bias in the reported outcomes.
Collapse
Affiliation(s)
- Xiaoxuan Liu
- Moorfields Eye Hospital NHS Foundation TrustLondresReino UnidoMoorfields Eye Hospital NHS Foundation Trust, Londres, Reino Unido.
- Academic Unit of OphthalmologyInstitute of Inflammation and AgeingUniversity of BirminghamBirminghamReino UnidoAcademic Unit of Ophthalmology, Institute of Inflammation and Ageing, University of Birmingham, Birmingham, Reino Unido.
- University Hospitals Birmingham NHS Foundation TrustBirminghamReino UnidoUniversity Hospitals Birmingham NHS Foundation Trust, Birmingham, Reino Unido.
- Health Data Research Reino UnidoLondresReino UnidoHealth Data Research Reino Unido, Londres, Reino Unido.
- Birmingham Health Partners Centre for Regulatory Science and InnovationUniversity of BirminghamBirminghamReino UnidoBirmingham Health Partners Centre for Regulatory Science and Innovation, University of Birmingham, Birmingham, Reino Unido.
| | - Samantha Cruz Rivera
- Birmingham Health Partners Centre for Regulatory Science and InnovationUniversity of BirminghamBirminghamReino UnidoBirmingham Health Partners Centre for Regulatory Science and Innovation, University of Birmingham, Birmingham, Reino Unido.
- Centre for Patient Reported Outcomes ResearchInstitute of Applied Health ResearchUniversity of BirminghamBirmingham Centre for Patient Reported Outcomes Research, Institute of Applied Health Research, University of Birmingham, Birmingham.
- Institute of Applied Health ResearchUniversity of BirminghamBirminghamReino UnidoInstitute of Applied Health Research, University of Birmingham, Birmingham, Reino Unido.
| | - David Moher
- Centre for JournalologyClinical Epidemiology ProgramOttawa Hospital Research InstituteOttawaCanadáCentre for Journalology, Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Canadá.
- School of Epidemiology and Public HealthFaculty of MedicineUniversity of OttawaOttawaCanadaSchool of Epidemiology and Public Health, Faculty of Medicine, University of Ottawa, Ottawa, Canada.
| | - Melanie J. Calvert
- Health Data Research Reino UnidoLondresReino UnidoHealth Data Research Reino Unido, Londres, Reino Unido.
- Birmingham Health Partners Centre for Regulatory Science and InnovationUniversity of BirminghamBirminghamReino UnidoBirmingham Health Partners Centre for Regulatory Science and Innovation, University of Birmingham, Birmingham, Reino Unido.
- Centre for Patient Reported Outcomes ResearchInstitute of Applied Health ResearchUniversity of BirminghamBirmingham Centre for Patient Reported Outcomes Research, Institute of Applied Health Research, University of Birmingham, Birmingham.
- Institute of Applied Health ResearchUniversity of BirminghamBirminghamReino UnidoInstitute of Applied Health Research, University of Birmingham, Birmingham, Reino Unido.
- National Institute of Health Research Birmingham Biomedical Research CentreUniversity of Birmingham and University Hospitals Birmingham NHS Foundation TrustBirminghamReino UnidoNational Institute of Health Research Birmingham Biomedical Research Centre, University of Birmingham and University Hospitals Birmingham NHS Foundation Trust, Birmingham, Reino Unido.
- National Institute of Health Research Applied Research Collaborative West MidlandsCoventryReino Unido.National Institute of Health Research Applied Research Collaborative West Midlands, Coventry, Reino Unido.
- National Institute of Health Research Surgical Reconstruction and Microbiology CentreUniversity of Birmingham and University Hospitals Birmingham NHS Foundation TrustBirminghamReino UnidoNational Institute of Health Research Surgical Reconstruction and Microbiology Centre, University of Birmingham and University Hospitals Birmingham NHS Foundation Trust, Birmingham, Reino Unido.
| | - Alastair K. Denniston
- Academic Unit of OphthalmologyInstitute of Inflammation and AgeingUniversity of BirminghamBirminghamReino UnidoAcademic Unit of Ophthalmology, Institute of Inflammation and Ageing, University of Birmingham, Birmingham, Reino Unido.
- University Hospitals Birmingham NHS Foundation TrustBirminghamReino UnidoUniversity Hospitals Birmingham NHS Foundation Trust, Birmingham, Reino Unido.
- Health Data Research Reino UnidoLondresReino UnidoHealth Data Research Reino Unido, Londres, Reino Unido.
- Birmingham Health Partners Centre for Regulatory Science and InnovationUniversity of BirminghamBirminghamReino UnidoBirmingham Health Partners Centre for Regulatory Science and Innovation, University of Birmingham, Birmingham, Reino Unido.
- Centre for Patient Reported Outcomes ResearchInstitute of Applied Health ResearchUniversity of BirminghamBirmingham Centre for Patient Reported Outcomes Research, Institute of Applied Health Research, University of Birmingham, Birmingham.
- NIHR Biomedical Research Center at Moorfields Eye Hospital NHS Foundation Trust and UCL Institute of OphthalmologyLondresReino UnidoNIHR Biomedical Research Center at Moorfields Eye Hospital NHS Foundation Trust and UCL Institute of Ophthalmology, Londres, Reino Unido.
| | | |
Collapse
|
36
|
Chloro-aluminum phthalocyanine-mediated photodynamic therapy improves peri-implant parameters and crevicular fluid cytokine levels in cigarette smokers with chronic hyperglycemia. Photodiagnosis Photodyn Ther 2023; 41:103309. [PMID: 36709015 DOI: 10.1016/j.pdpdt.2023.103309] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2022] [Revised: 01/23/2023] [Accepted: 01/24/2023] [Indexed: 01/26/2023]
Abstract
PURPOSE This clinical trial aimed to evaluate the effectiveness of chloroaluminum phthalocyanine-mediated photodynamic therapy (CAPC-PDT) as an adjunct to peri-implant mechanical debridement (PID) in the treatment of peri-implantitis in patients with chronic hyperglycemia and cigarette smoking. METHODS The selected participants with peri-implantitis were divided into two groups: Group I (n=15) included hyperglycemic patients with no history of smoking and Group II (n=15) included hyperglycemic patients with a history of smoking cigarettes. Both groups were further divided into two subgroups based on the type of therapy provided: PDT+PID and PID alone. Peri-implant bleeding on probing (PiBOP), peri-implant pocket depth (PiPD), peri-implant plaque scores (PiPS), and crestal bone loss (CBL) were assessed. Peri-implant crevicular fluid (PICF) was sampled for quantification of interleukin (IL)-1β and tumor necrosis factor-alpha (TNF-α) using an enzyme-linked immunosorbent assay. All assessments were performed at baseline and at three and six months. RESULTS PDT+PID showed a higher reduction in PiBOP than PID alone in hyperglycemic/non-smoking participants (p<0.01). PDT+PID and PID show a significant reduction in PiBOP in smokers only at 6 months (p<0.05), with comparable differences between PDT+PID and PID (p>0.05). PDT+PID significantly reduced PiPD hyperglycemic/smoking patients at 3 and 6 months (p<0.05), whereas PID only produced a significant reduction in PiPD at 6 months in smoking patients (p<0.05). CBL alone with PDT+PID in both smokers and non-smokers showed a statistically significant reduction at 6 months follow-up (p<0.05). IL-1β was significantly reduced in hyperglycemic/non-smoking participants at 6 months follow-up with both PDT+PID and PID alone (p<0.01). This trend was also observed in cigarette smokers, with an additional short-term reduction in IL-1β at 3 months with PDT+PID (p<0.05). Only the PDT+PID group showed a significant reduction in TNF-a among cigarette smoking patients with chronic hyperglycemia at 6 months follow-up (p<0.05) CONCLUSION: Chloroaluminum phthalocyanine-mediated PDT proved effective in improving peri-implant clinical outcomes and reducing cytokine levels in smoking patients with chronic hyperglycemia.
Collapse
|
37
|
Liu C, Qi Y, Liu X, Chen M, Xiong Y, Huang S, Zou K, Tan J, Sun X. The reporting of prognostic prediction models for obstetric care was poor: a cross-sectional survey of 10-year publications. BMC Med Res Methodol 2023; 23:9. [PMID: 36635634 PMCID: PMC9835271 DOI: 10.1186/s12874-023-01832-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2022] [Accepted: 01/02/2023] [Indexed: 01/13/2023] Open
Abstract
BACKGROUND To investigate the reporting of prognostic prediction model studies in obstetric care through a cross-sectional survey design. METHODS PubMed was searched to identify prognostic prediction model studies in obstetric care published from January 2011 to December 2020. The quality of reporting was assessed by the TRIPOD checklist. The overall adherence by study and the adherence by item were calculated separately, and linear regression analysis was conducted to explore the association between overall adherence and prespecified study characteristics. RESULTS A total of 121 studies were included, while no study completely adhered to the TRIPOD. The results showed that the overall adherence was poor (median 46.4%), and no significant improvement was observed after the release of the TRIPOD (43.9 to 46.7%). Studies including both model development and external validation had higher reporting quality versus those including model development only (68.1% vs. 44.8%). Among the 37 items required by the TRIPOD, 10 items were reported adequately with an adherence rate over of 80%, and the remaining 27 items had an adherence rate ranging from 2.5 to 79.3%. In addition, 11 items had a report rate lower than 25.0% and even covered key methodological aspects, including blinding assessment of predictors (2.5%), methods for model-building procedures (4.5%) and predictor handling (13.5%), how to use the model (13.5%), and presentation of model performance (14.4%). CONCLUSIONS In a 10-year span, prognostic prediction studies in obstetric care continued to be poorly reported and did not improve even after the release of the TRIPOD checklist. Substantial efforts are warranted to improve the reporting of obstetric prognostic prediction models, particularly those that adhere to the TRIPOD checklist are highly desirable.
Collapse
Affiliation(s)
- Chunrong Liu
- grid.412901.f0000 0004 1770 1022Chinese Evidence-Based Medicine Center, West China Hospital, Sichuan University, 37 Guo Xue Xiang, Chengdu, 610041 Sichuan China ,NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, 610041 Sichuan China ,Hainan Healthcare Security Administration Key Laboratory for Real World Data Research, Chengdu, China
| | - Yana Qi
- grid.412901.f0000 0004 1770 1022Chinese Evidence-Based Medicine Center, West China Hospital, Sichuan University, 37 Guo Xue Xiang, Chengdu, 610041 Sichuan China ,NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, 610041 Sichuan China ,Hainan Healthcare Security Administration Key Laboratory for Real World Data Research, Chengdu, China
| | - Xinghui Liu
- grid.461863.e0000 0004 1757 9397Department of Obstetrics and Gynecology, and Key Laboratory of Birth Defects and Related Diseases of Women and Children (Sichuan University), Ministry of Education, West China Second University Hospital, Sichuan University, Chengdu, 610041 Sichuan China
| | - Meng Chen
- grid.461863.e0000 0004 1757 9397Department of Obstetrics and Gynecology, and Key Laboratory of Birth Defects and Related Diseases of Women and Children (Sichuan University), Ministry of Education, West China Second University Hospital, Sichuan University, Chengdu, 610041 Sichuan China
| | - Yiquan Xiong
- grid.412901.f0000 0004 1770 1022Chinese Evidence-Based Medicine Center, West China Hospital, Sichuan University, 37 Guo Xue Xiang, Chengdu, 610041 Sichuan China ,NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, 610041 Sichuan China ,Hainan Healthcare Security Administration Key Laboratory for Real World Data Research, Chengdu, China
| | - Shiyao Huang
- grid.412901.f0000 0004 1770 1022Chinese Evidence-Based Medicine Center, West China Hospital, Sichuan University, 37 Guo Xue Xiang, Chengdu, 610041 Sichuan China ,NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, 610041 Sichuan China ,Hainan Healthcare Security Administration Key Laboratory for Real World Data Research, Chengdu, China
| | - Kang Zou
- grid.412901.f0000 0004 1770 1022Chinese Evidence-Based Medicine Center, West China Hospital, Sichuan University, 37 Guo Xue Xiang, Chengdu, 610041 Sichuan China ,NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, 610041 Sichuan China ,Hainan Healthcare Security Administration Key Laboratory for Real World Data Research, Chengdu, China
| | - Jing Tan
- grid.412901.f0000 0004 1770 1022Chinese Evidence-Based Medicine Center, West China Hospital, Sichuan University, 37 Guo Xue Xiang, Chengdu, 610041 Sichuan China ,NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, 610041 Sichuan China ,Hainan Healthcare Security Administration Key Laboratory for Real World Data Research, Chengdu, China ,grid.25073.330000 0004 1936 8227Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Canada ,grid.416721.70000 0001 0742 7355Biostatistics Unit, St Joseph’s Healthcare—Hamilton, Hamilton, Canada
| | - Xin Sun
- grid.412901.f0000 0004 1770 1022Chinese Evidence-Based Medicine Center, West China Hospital, Sichuan University, 37 Guo Xue Xiang, Chengdu, 610041 Sichuan China ,NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, 610041 Sichuan China ,Hainan Healthcare Security Administration Key Laboratory for Real World Data Research, Chengdu, China
| |
Collapse
|
38
|
Aydinli A, Karadağ S. "Effects of abdominal massage applied with ginger and lavender oil for elderly with constipation: A randomized controlled trial". Explore (NY) 2023; 19:115-120. [PMID: 36058824 DOI: 10.1016/j.explore.2022.08.010] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2022] [Revised: 08/19/2022] [Accepted: 08/19/2022] [Indexed: 01/25/2023]
Abstract
BACKGROUND AND OBJECTIVES Constipation, which is commonly seen in the elderly and negatively affects an individual's physical and psychological well-being, is a treatable health problem. This study was conducted as a randomized controlled experimental study to investigate the effect of abdominal massage applied with lavender and ginger oil on constipation for elderly individuals. METHODS The study examined a total of 40 elderly individuals who lived in a nursing home and suffered from constipation. Elderly individuals in the intervention group underwent 15 min of aromatherapy massage for 5 weekdays per week for 4 weeks. No intervention was conducted for individuals in the control group. RESULTS While the Bristol Stool Chart and the Constipation Severity Scale scores were similar in the intervention and control groups of elderly individuals at the first follow-up (p > 0.05), in the second and fourth week after the application, scores in the Bristol Stool Chart increased significantly and scores in the Constipation Severity Scale decreased significantly in the intervention group compared to the control group (p < 0.05). CONCLUSION It was determined that aromatherapy massage applied to elderly individuals experiencing constipation softened stool consistency, decreased constipation severity, and reduced symptoms associated with constipation.
Collapse
Affiliation(s)
- Ayşe Aydinli
- Süleyman Demirel University, Department of Nursing, Faculty of Health Sciences, Isparta, Turkey.
| | - Songül Karadağ
- Department of Nursing, Faculty of Health Sciences, Çukurova University, Adana 01038, Turkey
| |
Collapse
|
39
|
Zhang X, Zhang G, Liu J, Song X, Li M, Zhang Y, Hao J, Wang C, Li H. Cross-sectional study of the quality of randomized control trials on problem-based learning in medical education. Clin Anat 2023; 36:151-160. [PMID: 36349397 DOI: 10.1002/ca.23977] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2022] [Revised: 10/24/2022] [Accepted: 11/04/2022] [Indexed: 11/11/2022]
Abstract
Problem-based learning (PBL) is increasingly being used in medical education globally, but its effectiveness in teaching remains controversial. A randomized controlled trial (RCT) is the method of choice for evaluating its effectiveness. The quality of an RCT has a significant effect on this evaluation, but to date we have not seen an assessment of the quality of RCTs for PBL. Two researchers searched MEDLINE and EMBASE for RCTs addressing PBL in medical education. The overall quality of each report was measured on a 28-point overall quality score (OQS) based on the 2010 revised Comprehensive Standards for Reporting and Testing (CONSORT) Statement. Furthermore, to study the key factors affecting OQS more effectively, a linear regression model of those factors was established using SPSS. After literature screening, 30 RCTs were eventually included and analyzed. The median OQS was 15 (range, 7-20), which meant that half of the items in the revised 2010 CONSORT statement were poorly reported in at least 40% of the RCTs analyzed. The regression model showed that the year of publication of RCTs and the impact factors of the journals in which they were published were the main factors affecting OQS. The overall quality of reporting of RCTs on PBL teaching in medical education was not satisfactory. Some RCTs were subjectively selective in reporting certain items, leading to heterogeneity in quality. It is expected that statisticians will develop new standards more suitable for evaluating RCTs related to teaching research and that editors and peer reviewers will be required to review the relevant RCTs more strictly.
Collapse
Affiliation(s)
- Xiaoli Zhang
- Department of Histology & Embryology, School of Basic Medical Sciences, Key Laboratory for Experimental Teratology of Ministry of Education, Shandong University, Jinan, China
| | - Guanran Zhang
- Department of Histology & Embryology, School of Basic Medical Sciences, Key Laboratory for Experimental Teratology of Ministry of Education, Shandong University, Jinan, China
| | - Jing Liu
- Department of Biostatistics, School of Public Health, Shandong University, Jinan, China
| | - Xinyi Song
- Department of Histology & Embryology, School of Basic Medical Sciences, Key Laboratory for Experimental Teratology of Ministry of Education, Shandong University, Jinan, China
| | - Manyu Li
- Department of Histology & Embryology, School of Basic Medical Sciences, Key Laboratory for Experimental Teratology of Ministry of Education, Shandong University, Jinan, China
| | - Yuhua Zhang
- Information-based Teaching Research Center, School of Basic Medical Sciences, Shandong University, Jinan, China
| | - Jing Hao
- Department of Histology & Embryology, School of Basic Medical Sciences, Key Laboratory for Experimental Teratology of Ministry of Education, Shandong University, Jinan, China
| | - Chuanzheng Wang
- Department of Histology & Embryology, School of Basic Medical Sciences, Key Laboratory for Experimental Teratology of Ministry of Education, Shandong University, Jinan, China
| | - Han Li
- Department of Histology & Embryology, School of Basic Medical Sciences, Key Laboratory for Experimental Teratology of Ministry of Education, Shandong University, Jinan, China
| |
Collapse
|
40
|
Hüneburg R, Bucksch K, Schmeißer F, Heling D, Marwitz T, Aretz S, Kaczmarek DJ, Kristiansen G, Hommerding O, Strassburg CP, Engel C, Nattermann J. Real-time use of artificial intelligence (CADEYE) in colorectal cancer surveillance of patients with Lynch syndrome-A randomized controlled pilot trial (CADLY). United European Gastroenterol J 2022; 11:60-68. [PMID: 36571259 PMCID: PMC9892476 DOI: 10.1002/ueg2.12354] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/30/2022] [Accepted: 12/06/2022] [Indexed: 12/27/2022] Open
Abstract
BACKGROUND Lynch syndrome (LS), an autosomal dominant disorder caused by pathogenic germline variants in DNA mismatch repair (MMR) genes, represents the most common hereditary colorectal cancer (CRC) syndrome. Lynch syndrome patients are at high risk of CRC despite regular endoscopic surveillance. OBJECTIVE Our aim was to investigate the diagnostic performance of artificial intelligence (AI)-assisted colonoscopy in comparison to High-Definition white-light endoscopy (HD-WLE) for the first time. METHODS Patients ≥18 years with LS, with a pathogenic germline variant (MLH1, MHS2, MSH6), and at least one previous colonoscopy (interval 10-36 months) were eligible. Patients were stratified by previous CRC and affected MMR gene with a 1:1 allocation ratio (AI-assisted vs. HD white-light endoscopy) in this exploratory pilot trial. RESULTS Between Dec-2021 and Dec-2022, 101 LS patients were randomised and 96 patients were finally analyzed after exclusion of 5 patients due to insufficient bowel preparation. In the HD-WLE arm, adenomas were detected in 12/46 patients compared to 18/50 in the AI arm (26.1% [95% CI 14.3-41.1] vs. 36.0% [22.9-50.8]; p = 0.379). The use of AI-assisted colonoscopy especially increased detection of flat adenomas (Paris classification 0-IIb) (examinations with detected flat adenomas: 3/46 [6.5%] vs. 10/50 [20%]; p = 0.07; numbers of detected flat adenomas: 4/20 vs. 17/30, p = 0.018). The median withdrawal time did not differ significantly between HD-WLE and AI (14 vs. 15 min; p = 0.170). CONCLUSION We here present first data suggesting that real-time AI-assisted colonoscopy is a promising approach to optimize endoscopic surveillance in LS patients, in particular to improve the detection of flat adenomas.
Collapse
Affiliation(s)
- Robert Hüneburg
- National Center for Hereditary Tumor SyndromesUniversity Hospital BonnBonnGermany,Department of Internal Medicine IUniversity Hospital BonnBonnGermany
| | - Karolin Bucksch
- University of LeipzigInstitute for Medical InformaticsStatistics and EpidemiologyLeipzigGermany
| | - Friederike Schmeißer
- National Center for Hereditary Tumor SyndromesUniversity Hospital BonnBonnGermany,Department of Internal Medicine IUniversity Hospital BonnBonnGermany
| | - Dominik Heling
- National Center for Hereditary Tumor SyndromesUniversity Hospital BonnBonnGermany,Department of Internal Medicine IUniversity Hospital BonnBonnGermany
| | - Tim Marwitz
- National Center for Hereditary Tumor SyndromesUniversity Hospital BonnBonnGermany,Department of Internal Medicine IUniversity Hospital BonnBonnGermany
| | - Stefan Aretz
- National Center for Hereditary Tumor SyndromesUniversity Hospital BonnBonnGermany,Institute of Human GeneticsUniversity of BonnBonnGermany
| | - Dominik J. Kaczmarek
- National Center for Hereditary Tumor SyndromesUniversity Hospital BonnBonnGermany,Department of Internal Medicine IUniversity Hospital BonnBonnGermany
| | - Glen Kristiansen
- National Center for Hereditary Tumor SyndromesUniversity Hospital BonnBonnGermany,Institute of PathologyUniversity Hospital BonnBonnGermany
| | - Oliver Hommerding
- National Center for Hereditary Tumor SyndromesUniversity Hospital BonnBonnGermany,Institute of PathologyUniversity Hospital BonnBonnGermany
| | - Christian P. Strassburg
- National Center for Hereditary Tumor SyndromesUniversity Hospital BonnBonnGermany,Department of Internal Medicine IUniversity Hospital BonnBonnGermany
| | - Christoph Engel
- University of LeipzigInstitute for Medical InformaticsStatistics and EpidemiologyLeipzigGermany
| | - Jacob Nattermann
- National Center for Hereditary Tumor SyndromesUniversity Hospital BonnBonnGermany,Department of Internal Medicine IUniversity Hospital BonnBonnGermany
| |
Collapse
|
41
|
Wei Z, Chu X, Han J, Zhang N, Li Y, Yang C, Wang Q, Li J, Belal AA, Yan P, Li X, Yang K. The reporting quality of N-of-1 trials and protocols still needs improvement. J Evid Based Med 2022; 15:365-372. [PMID: 35919928 DOI: 10.1111/jebm.12484] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/24/2022] [Accepted: 07/27/2022] [Indexed: 01/11/2023]
Abstract
OBJECTIVE To evaluate the reporting quality of single-patient (N-of-1) trials and protocols based on the CONSORT Extension for N-of-1 trials (CENT) statement and the standard protocol items: recommendations for interventional trials (SPIRIT) extension and elaboration for N-of-1 trials (SPENT) checklist to examine the factors that influenced reporting quality. METHODS Four electronic databases were searched to identify N-of-1 trials and protocols from 2015 to 2020. Quality was assessed by two reviewers. We calculated the overall scores based on binary responses in which "Yes" was scored as 1 (if the item was fully reported), and "No" was scored as 0 (if the item was not clearly reported or not definitely stated). RESULTS A total of 78 publications (55 N-of-1 trials and 23 protocols) were identified. The mean reporting score (SD) of the N-of-1 trials and protocols were 29.24 (0.89) and 29.61 (1.83), respectively. For the items related to outcomes, sample size, allocation concealment protocol, and informed consent materials, the reporting quality was low. Our results showed that the year of publication (t = -0.793, p = 0.872 for the trials and t = 1.352, p = 0.623 for the protocols) and the impact factor of the journal (t = 1.416, p = 0.619 for the trials and t = 0.359, p = 0.667 for the protocols) were not factors associated with better reporting quality. CONCLUSION With the publication of the CENT 2015 statement and the SPENT 2019 checklist, authors should adhere to the relevant reporting guidelines and improve the reporting quality of N-of-1 trials and protocols.
Collapse
Affiliation(s)
- Zhipeng Wei
- Evidence-Based Social Science Research Center, School of Public Health, Lanzhou University, Lanzhou, China
- Health Technology Assessment Center of Lanzhou University, School of Public Health, Lanzhou University, Lanzhou, China
- Evidence-Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, China
- Key Laboratory of Evidence-Based Medicine and Knowledge Translation of Gansu Province, Lanzhou, China
| | - Xiajing Chu
- Evidence-Based Social Science Research Center, School of Public Health, Lanzhou University, Lanzhou, China
- Health Technology Assessment Center of Lanzhou University, School of Public Health, Lanzhou University, Lanzhou, China
- Evidence-Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, China
- Key Laboratory of Evidence-Based Medicine and Knowledge Translation of Gansu Province, Lanzhou, China
| | - Jiani Han
- Evidence-Based Social Science Research Center, School of Public Health, Lanzhou University, Lanzhou, China
- Health Technology Assessment Center of Lanzhou University, School of Public Health, Lanzhou University, Lanzhou, China
- Evidence-Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, China
- Key Laboratory of Evidence-Based Medicine and Knowledge Translation of Gansu Province, Lanzhou, China
| | - Na Zhang
- Evidence-Based Social Science Research Center, School of Public Health, Lanzhou University, Lanzhou, China
- Health Technology Assessment Center of Lanzhou University, School of Public Health, Lanzhou University, Lanzhou, China
- Evidence-Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, China
- Key Laboratory of Evidence-Based Medicine and Knowledge Translation of Gansu Province, Lanzhou, China
| | - Yanfei Li
- Evidence-Based Social Science Research Center, School of Public Health, Lanzhou University, Lanzhou, China
- Health Technology Assessment Center of Lanzhou University, School of Public Health, Lanzhou University, Lanzhou, China
- Evidence-Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, China
- Key Laboratory of Evidence-Based Medicine and Knowledge Translation of Gansu Province, Lanzhou, China
| | - Chaoqun Yang
- Evidence-Based Social Science Research Center, School of Public Health, Lanzhou University, Lanzhou, China
- Health Technology Assessment Center of Lanzhou University, School of Public Health, Lanzhou University, Lanzhou, China
- Evidence-Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, China
- Key Laboratory of Evidence-Based Medicine and Knowledge Translation of Gansu Province, Lanzhou, China
| | - Qi Wang
- Health Policy PhD Program, McMaster University, Hamilton, Ontario, Canada
- McMaster Health Forum, McMaster University, Hamilton, Ontario, Canada
- Faculty of Health Sciences, Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, Ontario, Canada
| | - Jiang Li
- Evidence-Based Social Science Research Center, School of Public Health, Lanzhou University, Lanzhou, China
- Key Laboratory of Evidence-Based Medicine and Knowledge Translation of Gansu Province, Lanzhou, China
- Cancer Hospital, Chinese Academy of Medical Sciences, Beijing, China
| | - Ahmed Atef Belal
- Health Policy PhD Program, McMaster University, Hamilton, Ontario, Canada
- McMaster Health Forum, McMaster University, Hamilton, Ontario, Canada
- Faculty of Health Sciences, Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, Ontario, Canada
| | - Peijing Yan
- Department of Epidemiology and Health Statistics, West China School of Public Health and West China Fourth Hospital, Sichuan University, Chengdu, China
| | - Xiuxia Li
- Evidence-Based Social Science Research Center, School of Public Health, Lanzhou University, Lanzhou, China
- Health Technology Assessment Center of Lanzhou University, School of Public Health, Lanzhou University, Lanzhou, China
- Evidence-Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, China
- Key Laboratory of Evidence-Based Medicine and Knowledge Translation of Gansu Province, Lanzhou, China
| | - Kehu Yang
- Evidence-Based Social Science Research Center, School of Public Health, Lanzhou University, Lanzhou, China
- Health Technology Assessment Center of Lanzhou University, School of Public Health, Lanzhou University, Lanzhou, China
- Evidence-Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, China
- Key Laboratory of Evidence-Based Medicine and Knowledge Translation of Gansu Province, Lanzhou, China
| |
Collapse
|
42
|
Bryant A, Grayling M, Hiu S, Gajjar K, Johnson E, Elattar A, Vale L, Craig D, Naik R. Residual disease after primary surgery for advanced epithelial ovarian cancer: expert elicitation exercise to explore opinions about potential impact of publication bias in a planned systematic review and meta-analysis. BMJ Open 2022; 12:e060183. [PMID: 36038183 PMCID: PMC9438036 DOI: 10.1136/bmjopen-2021-060183] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/14/2021] [Accepted: 08/03/2022] [Indexed: 01/21/2023] Open
Abstract
OBJECTIVES We consider expert opinion and its incorporation into a planned meta-analysis as a way of adjusting for anticipated publication bias. We conduct an elicitation exercise among eligible British Gynaecological Cancer Society (BGCS) members with expertise in gynaecology. DESIGN Expert elicitation exercise. SETTING BGCS. PARTICIPANTS Members of the BGCS with expertise in gynaecology. METHODS Experts were presented with details of a planned prospective systematic review and meta-analysis, assessing overall survival for the extent of excision of residual disease (RD) after primary surgery for advanced epithelial ovarian cancer. Participants were asked views on the likelihood of different studies (varied in the size of the study population and the RD thresholds being compared) not being published. Descriptive statistics were produced and opinions on total number of missing studies by sample size and magnitude of effect size estimated. RESULTS Eighteen expert respondents were included. Responders perceived publication bias to be a possibility for comparisons of RD <1 cm versus RD=0 cm, but more so for comparisons involving higher volume suboptimal RD thresholds. However, experts' perceived publication bias in comparisons of RD=0 cm versus suboptimal RD thresholds did not translate into many elicited missing studies in Part B of the elicitation exercise. The median number of missing studies estimated by responders for the main comparison of RD<1 cm versus RD=0 cm was 10 (IQR: 5-20), with the number of missing studies influenced by whether the effect size was equivocal. The median number of missing studies estimated for suboptimal RD versus RD=0 cm was lower. CONCLUSIONS The results may raise awareness that a degree of scepticism is needed when reviewing studies comparing RD <1 cm versus RD=0 cm. There is also a belief among respondents that comparisons involving RD=0 cm and suboptimal thresholds (>1 cm) are likely to be impacted by publication bias, but this is unlikely to attenuate effect estimates in meta-analyses.
Collapse
Affiliation(s)
- Andrew Bryant
- Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Michael Grayling
- Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Shaun Hiu
- Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Ketankumar Gajjar
- Obstetrics and Gynaecology, Nottingham City Hospital, Nottingham, UK
| | - Eugenie Johnson
- Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Ahmed Elattar
- Pan-Birmingham Gynaecological Oncology Cancer Centre, Sandwell and West Birmingham Hospitals NHS Trust, Birmingham, UK
| | - Luke Vale
- Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Dawn Craig
- Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Raj Naik
- Northern Gynaecological Oncology Centre, Queen Elizabeth Hospital, Gateshead, UK
| |
Collapse
|
43
|
Wiehn J, Nonte J, Prugger C. Reporting quality for abstracts of randomised trials on child and adolescent depression prevention: a meta-epidemiological study on adherence to CONSORT for abstracts. BMJ Open 2022; 12:e061873. [PMID: 35922097 PMCID: PMC9352996 DOI: 10.1136/bmjopen-2022-061873] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
OBJECTIVES This study aimed to investigate adherence to Consolidated Standards of Reporting Trials (CONSORT) for abstracts in reports of randomised trials on child and adolescent depression prevention. Secondary objective was to examine factors associated with overall reporting quality. DESIGN Meta-epidemiological study. DATA SOURCES We searched MEDLINE, EMBASE, PsycINFO, PsycArticles and CENTRAL. ELIGIBILITY CRITERIA Trials were eligible if the sample consisted of children and adolescents under 18 years with or without an increased risk for depression or subthreshold depression. We included reports published from 1 January 2003 to 8 August 2020 on randomised controlled trials (RCTs) and cluster randomised trials (CRTs) assessing universal, selective and indicated interventions aiming to prevent the onset of depression or reducing depressive symptoms. DATA EXTRACTION AND SYNTHESIS As the primary outcome measure, we assessed for each trial abstract whether information recommended by CONSORT was adequately reported, inadequately reported or not reported. Moreover, we calculated a summative score of overall reporting quality and analysed associations with trial and journal characteristics. RESULTS We identified 169 eligible studies, 103 (61%) RCTs and 66 (39%) CRTs. Adequate reporting varied considerably across CONSORT items: while 9 out of 10 abstracts adequately reported the study objective, no abstract adequately provided information on blinding. Important adverse events or side effects were only adequately reported in one out of 169 abstracts. Summative scores for the abstracts' overall reporting quality ranged from 17% to 83%, with a median of 40%. Scores were associated with the number of authors, abstract word count, journal impact factor, year of publication and abstract structure. CONCLUSIONS Reporting quality for abstracts of trials on child and adolescent depression prevention is suboptimal. To help health professionals make informed judgements, efforts for improving adherence to reporting guidelines for abstracts are needed.
Collapse
Affiliation(s)
- Jascha Wiehn
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Institute of Public Health, Berlin, Germany
| | - Johanna Nonte
- Department of Population Medicine and Health Services Research, Bielefeld School of Public Health, Universität Bielefeld, Bielefeld, Germany
| | - Christof Prugger
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Institute of Public Health, Berlin, Germany
| |
Collapse
|
44
|
Waters P, Anderson R, Anderson JM, Scott J, Detweiler B, Streck S, Hartwell M, Torgerson T, Vassar M. Analysis of the Evidence Underpinning the American Academy of Orthopedic Surgeons Knee Osteoarthritis Clinical Practice Guidelines. Sports Health 2022; 15:11-25. [PMID: 35915571 PMCID: PMC9808825 DOI: 10.1177/19417381221112674] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/07/2023] Open
Abstract
CONTEXT Clinical practice guidelines (CPGs) are vital to establishing a standardized and evidence-based approach in medicine. These guidelines rely on the use of methodologically sound clinical trials, and the subsequent reporting of their methodology. OBJECTIVE To evaluate the completeness of randomized controlled trials (RCTs) underpinning CPGs published by the American Academy of Orthopedic Surgeons (AAOS) for management of osteoarthritis of the knee. DATA SOURCES We searched the most recent AAOS CPGs for surgical and nonsurgical management of osteoarthritis of the knee for RCTs. To estimate the necessary sample size, we performed a power analysis using OpenEpi 3.0 (openepi.com). STUDY SELECTION Two authors independently screened the reference sections of the included CPGs. Included studies met the definition of an RCT, were retrievable in the English language, and were cited in at least one of the included CPGs. STUDY DESIGN Meta-Analysis. LEVEL OF EVIDENCE Level 1a. DATA EXTRACTION We performed double-blind screening and extraction of RCTs included in the AAOS CPGs. We evaluated each RCT for adherence to the Consolidated Standards of Reporting Trials (CONSORT) 2010 checklist. A multiple regression analysis was conducted to assess CONSORT adherence against characteristics of included studies (ie, type of intervention, funding source, etc). RESULTS Our study included 179 RCTs. The overall adherence was 68.5% with significant differences between those published before and since the development of the 2010 CONSORT guidelines (P = 0.02). We found that RCTs receiving funding from industry/private sources as well as studies that included a conflict of interest statement showed more completeness than RCTs that reported receiving no funding (P < 0.01). CONCLUSION We found suboptimal CONSORT adherence for RCTs cited in AAOS CGPs for management of osteoarthritis of the knee. Therefore, the CPGs are likely supported by outdated evidence and lack of high-quality reporting. It is important that evidence used to guide clinical decision making be of the highest quality in order to optimize patient outcomes. In order for clinicians to confer the greatest benefits to their patients, CPGs should provide the totality of evidence and emphasize emerging high-quality RCTs to ensure up-to-date, evidence-based clinical decision-making.
Collapse
Affiliation(s)
- Philo Waters
- Philo Waters, BS, Oklahoma
State University Center for Health Sciences, 1111 W 17th St., Tulsa, OK 74107
() (Twitter: @PWaters04)
| | | | | | | | | | | | | | | | | |
Collapse
|
45
|
Zhao B, Hu K, Zeng X, Kwong JSW, Li B, Chen H, Tian G, Xiong J, Li Z, Niu J, Jiao M, Yang J, Ding F, Liu C, Du L, Zhang J, Ma B. Development of a reporting guideline for systematic reviews of animal experiments in the field of traditional Chinese medicine. J Evid Based Med 2022; 15:152-167. [PMID: 35775104 DOI: 10.1111/jebm.12480] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/30/2022] [Accepted: 06/09/2022] [Indexed: 02/05/2023]
Abstract
OBJECTIVE In recent years, there are several systematic reviews published on animal experiments of Traditional Chinese medicine (TCM). PRISMA (preferred reporting items for systematic reviews and meta-analysis) guidelines provide a guarantee for significantly improving the reporting quality of systematic reviews (SRs) and meta-analysis (MAs) to a certain extent; however, there are still certain defects found in the quality of SRs/MAs of animal experiments of TCM. It has been found that especially, the descriptions of the rationale and animal characteristics of TCM interventions are inadequate. As a result, we have developed a novel reporting guideline for SRs/MAs of animal experimental in the field of TCM (PRISMA-ATCM) to overcome these problems. METHODS PRISMA-ATCM reporting guidelines were formed by analyzing both the status and quality of published SRs/MAs of animal experiments and consulting experts in the related fields, and then by Delphi consultation, consensus meeting and revision. RESULTS Among the 27 items on the PRISMA checklist, Title (1), Structured summary (2), Rationale (3), Objectives (4), Protocol and registration (5), Eligibility criteria (6), Data items (11), Planned methods of analysis (14), Study characteristics (18), Summary of evidence (24), Limitations (25), and Funding (27) have been extensively revised and expanded, to specifically include the details about TCM intervention and animal characteristics. In addition, illustrative examples and explanations have been provided for each item. CONCLUSION PRISMA-ATCM could markedly improve the quality SRs/MAs of animal experiments in the field of TCM.
Collapse
Affiliation(s)
- Bing Zhao
- Evidence-Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, China
| | - Kaiyan Hu
- Evidence-Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, China
| | - Xiantao Zeng
- Center for Evidence-Based and Translational Medicine, Zhongnan Hospital of Wuhan University, Wuhan, China
| | - J S W Kwong
- Global Health Nursing, St. Luke's International University, Chuo-Ku, Tokyo, Japan
| | - Bo Li
- Beijing Hospital of Traditional Chinese Medicine, Evidence-Based Chinese Medicine Center, Beijing Institute of Chinese Medicine, Capital Medical University, Beijing, Beijing, China
| | - Hao Chen
- College of Acupuncture and Chinese Tuina, Nanjing University of Chinese Medicine, Nanjing, China
| | - Guoxiang Tian
- Department of Geriatric Medicine, Editorial Department of Chinese Journal of Evidence-Based Cardiovascular Medicine, Seventh Medical Center of Chinese PLA General Hospital, Beijing, China
| | - Jun Xiong
- The Affiliated Hospital of Jiangxi University of Traditional Chinese Medicine, Nanchang, China
| | - Zhaoxia Li
- Second Provincial People's Hospital of Gansu, Affiliated Hospital of Northwest Minzu University, Lanzhou, China
| | - Junqiang Niu
- Department of Traditional Chinese Medicine, the First Hospital of Lanzhou University, Lanzhou, China
| | - Mingyue Jiao
- Evidence-Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, China
| | - Jinwei Yang
- Evidence-Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, China
| | - Fengxing Ding
- Evidence-Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, China
| | - Chen Liu
- Evidence-Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, China
| | - Liang Du
- Chinese Evidence-Based Medicine Center/West China Publishers, West China Hospital, Sichuan University, Chengdu, China
| | - Junhua Zhang
- Evidence-based Medicine Center, Tianjin University of Traditional Chinese Medicine, Tianjin, China
| | - Bin Ma
- Evidence-Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, China
- Key Laboratory of Evidence Based Medicine and Knowledge Translation of Gansu Province, Lanzhou University, Lanzhou, China
| |
Collapse
|
46
|
Bruno AM, Blue NR. Challenges in Interpreting Obstetrics and Gynecology Literature. Clin Obstet Gynecol 2022; 65:225-235. [PMID: 35318984 PMCID: PMC9050836 DOI: 10.1097/grf.0000000000000707] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
The field of obstetrics and gynecology is constantly replenished with the newest research findings. In an era of rapidly available study publications, there are a number of challenges to interpreting the obstetrics and gynecology literature. Common pitfalls include the over reliance on the dichotomized P-value, lack of transparency, bias in study reporting, limitations of resources, absence of standardized practices and outcomes in study design, and the rare concerns for data integrity. We review these predominant challenges and their potential solutions, in interpreting the obstetrics and gynecology literature.
Collapse
Affiliation(s)
- Ann M. Bruno
- University of Utah Health, Salt Lake City, UT
- Intermountain Healthcare, Salt Lake City, UT
| | - Nathan R. Blue
- University of Utah Health, Salt Lake City, UT
- Intermountain Healthcare, Salt Lake City, UT
| |
Collapse
|
47
|
Lee YS, Kim SY, Kim M, Kim M, Won J, Lee H, Lee MS, Chae Y. Reporting quality of sham needles used as controls in acupuncture trials: a methodological evaluation. Chin Med 2022; 17:64. [PMID: 35637519 PMCID: PMC9153153 DOI: 10.1186/s13020-022-00608-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2021] [Accepted: 04/10/2022] [Indexed: 11/10/2022] Open
Abstract
OBJECTIVE The description of controls is important in acupuncture clinical trials to interpret its effectiveness without fallacy. This paper aims to evaluate the reporting quality of acupuncture studies on the characteristics of sham needles. STUDY DESIGN AND SETTING Using a checklist developed from previously published reporting guidelines, the distribution of reported items and changes of reporting rates over time were investigated. Two-way ANOVA and linear regression were conducted. RESULTS Original articles of RCTs of any design involving sham needles as controls were eligible for assessment. 117 trials from three 2-year time periods between 2009 and 2018 were included. Seven items out of 25 were reported in more than 50% of the studies. While significant differences of reporting scores among categories were observed, there were no significant differences among time periods; no significant improvement was observed over time. CONCLUSIONS Low reporting qualities of sham needles used in acupuncture studies may influence how researchers understand the effectiveness of acupuncture. This study evaluated previous publications from 2009 to 2018 and found that reporting qualities on sham needles did not improve over time. Further studies are required to validate the items used in this study to endorse better reporting of controls in acupuncture trials.
Collapse
Affiliation(s)
- Ye-Seul Lee
- Jaseng Spine and Joint Research Institute, Jaseng Medical Foundation, Seoul, Republic of Korea
| | - Song-Yi Kim
- Department of Anatomy and Acupoint, College of Korean Medicine, Gachon University, Seongnam, Republic of Korea
| | - Mariah Kim
- Department of Internal Medicine, Korean Medicine Hospital of Pusan National University, Yangsan, South Korea
| | - Minseo Kim
- Department of Anatomy and Acupoint, College of Korean Medicine, Gachon University, Seongnam, Republic of Korea
| | - Jiyoon Won
- KM Science Research Division, Korea Institute of Oriental Medicine, Daejeon, South Korea
| | - Hyangsook Lee
- Department of Science in Korean Medicine, College of Korean Medicine, Graduate School, Kyung Hee University, Seoul, South Korea
| | - Myeong Soo Lee
- KM Science Research Division, Korea Institute of Oriental Medicine, Daejeon, South Korea
| | - Younbyoung Chae
- Acupuncture and Meridian Science Research Center, College of Korean Medicine, Kyung Hee University, 1 Hoegi-dong, Dongdaemun-gu, Seoul, Republic of Korea.
| |
Collapse
|
48
|
Vasey B, Nagendran M, Campbell B, Clifton DA, Collins GS, Denaxas S, Denniston AK, Faes L, Geerts B, Ibrahim M, Liu X, Mateen BA, Mathur P, McCradden MD, Morgan L, Ordish J, Rogers C, Saria S, Ting DSW, Watkinson P, Weber W, Wheatstone P, McCulloch P. Reporting guideline for the early stage clinical evaluation of decision support systems driven by artificial intelligence: DECIDE-AI. BMJ 2022; 377:e070904. [PMID: 35584845 PMCID: PMC9116198 DOI: 10.1136/bmj-2022-070904] [Citation(s) in RCA: 60] [Impact Index Per Article: 30.0] [Reference Citation Analysis] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 04/26/2022] [Indexed: 01/04/2023]
Affiliation(s)
- Baptiste Vasey
- Nuffield Department of Surgical Sciences, University of Oxford, Oxford, UK
- Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, Oxford, UK
- Critical Care Research Group, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, UK
| | - Myura Nagendran
- UKRI Centre for Doctoral Training in AI for Healthcare, Imperial College London, London, UK
| | - Bruce Campbell
- University of Exeter Medical School, Exeter, UK
- Royal Devon and Exeter Hospital, Exeter, UK
| | - David A Clifton
- Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, Oxford, UK
| | - Gary S Collins
- Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, UK
| | - Spiros Denaxas
- Institute of Health Informatics, University College London, London, UK
- British Heart Foundation Data Science Centre, London, UK
- Health Data Research UK, London, UK
- UCL Hospitals Biomedical Research Centre, London, UK
| | - Alastair K Denniston
- University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK
- Academic Unit of Ophthalmology, Institute of Inflammation and Ageing, College of Medical and Dental Sciences, University of Birmingham, Birmingham, UK
- Moorfields Eye Hospital NHS Foundation Trust, London, UK
| | - Livia Faes
- Moorfields Eye Hospital NHS Foundation Trust, London, UK
| | | | - Mudathir Ibrahim
- Nuffield Department of Surgical Sciences, University of Oxford, Oxford, UK
- Department of Surgery, Maimonides Medical Center, New York, NY, USA
| | - Xiaoxuan Liu
- University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK
- Academic Unit of Ophthalmology, Institute of Inflammation and Ageing, College of Medical and Dental Sciences, University of Birmingham, Birmingham, UK
| | - Bilal A Mateen
- Institute of Health Informatics, University College London, London, UK
- Wellcome Trust, London, UK
- Alan Turing Institute, London, UK
| | - Piyush Mathur
- Department of General Anesthesiology, Anesthesiology Institute, Cleveland Clinic, Cleveland, OH, USA
| | - Melissa D McCradden
- Hospital for Sick Children, Toronto, ON, Canada
- Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada
| | | | - Johan Ordish
- The Medicines and Healthcare products Regulatory Agency, London, UK
| | | | - Suchi Saria
- Departments of Computer Science, Statistics, and Health Policy, and Division of Informatics, Johns Hopkins University, Baltimore, MD, USA
- Bayesian Health, New York, NY, USA
| | - Daniel S W Ting
- Singapore National Eye Center, Singapore Eye Research Institute, Singapore
- Duke-NUS Medical School, National University of Singapore, Singapore
| | - Peter Watkinson
- Critical Care Research Group, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, UK
- NIHR Biomedical Research Centre Oxford, Oxford University Hospitals NHS Trust, Oxford, UK
| | | | | | - Peter McCulloch
- Nuffield Department of Surgical Sciences, University of Oxford, Oxford, UK
| |
Collapse
|
49
|
Vasey B, Nagendran M, Campbell B, Clifton DA, Collins GS, Denaxas S, Denniston AK, Faes L, Geerts B, Ibrahim M, Liu X, Mateen BA, Mathur P, McCradden MD, Morgan L, Ordish J, Rogers C, Saria S, Ting DSW, Watkinson P, Weber W, Wheatstone P, McCulloch P. Reporting guideline for the early-stage clinical evaluation of decision support systems driven by artificial intelligence: DECIDE-AI. Nat Med 2022; 28:924-933. [PMID: 35585198 DOI: 10.1038/s41591-022-01772-9] [Citation(s) in RCA: 126] [Impact Index Per Article: 63.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2021] [Accepted: 03/03/2022] [Indexed: 12/31/2022]
Abstract
A growing number of artificial intelligence (AI)-based clinical decision support systems are showing promising performance in preclinical, in silico evaluation, but few have yet demonstrated real benefit to patient care. Early-stage clinical evaluation is important to assess an AI system's actual clinical performance at small scale, ensure its safety, evaluate the human factors surrounding its use and pave the way to further large-scale trials. However, the reporting of these early studies remains inadequate. The present statement provides a multi-stakeholder, consensus-based reporting guideline for the Developmental and Exploratory Clinical Investigations of DEcision support systems driven by Artificial Intelligence (DECIDE-AI). We conducted a two-round, modified Delphi process to collect and analyze expert opinion on the reporting of early clinical evaluation of AI systems. Experts were recruited from 20 pre-defined stakeholder categories. The final composition and wording of the guideline was determined at a virtual consensus meeting. The checklist and the Explanation & Elaboration (E&E) sections were refined based on feedback from a qualitative evaluation process. In total, 123 experts participated in the first round of Delphi, 138 in the second round, 16 in the consensus meeting and 16 in the qualitative evaluation. The DECIDE-AI reporting guideline comprises 17 AI-specific reporting items (made of 28 subitems) and ten generic reporting items, with an E&E paragraph provided for each. Through consultation and consensus with a range of stakeholders, we developed a guideline comprising key items that should be reported in early-stage clinical studies of AI-based decision support systems in healthcare. By providing an actionable checklist of minimal reporting items, the DECIDE-AI guideline will facilitate the appraisal of these studies and replicability of their findings.
Collapse
Affiliation(s)
- Baptiste Vasey
- Nuffield Department of Surgical Sciences, University of Oxford, Oxford, UK.
- Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, Oxford, UK.
- Critical Care Research Group, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, UK.
| | - Myura Nagendran
- UKRI Centre for Doctoral Training in AI for Healthcare, Imperial College London, London, UK
| | - Bruce Campbell
- University of Exeter Medical School, Exeter, UK
- Royal Devon and Exeter Hospital, Exeter, UK
| | - David A Clifton
- Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, Oxford, UK
| | - Gary S Collins
- Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology & Musculoskeletal Sciences, University of Oxford, Oxford, UK
| | - Spiros Denaxas
- Institute of Health Informatics, University College London, London, UK
- British Heart Foundation Data Science Centre, London, UK
- Health Data Research UK, London, UK
- UCL Hospitals Biomedical Research Centre, London, UK
| | - Alastair K Denniston
- University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK
- Academic Unit of Ophthalmology, Institute of Inflammation and Ageing, College of Medical and Dental Sciences, University of Birmingham, Birmingham, UK
- Moorfields Eye Hospital NHS Foundation Trust, London, UK
| | - Livia Faes
- Moorfields Eye Hospital NHS Foundation Trust, London, UK
| | - Bart Geerts
- Healthplus.ai-R&D BV, Amsterdam, The Netherlands
| | - Mudathir Ibrahim
- Nuffield Department of Surgical Sciences, University of Oxford, Oxford, UK
- Department of Surgery, Maimonides Medical Center, Brooklyn, NY, USA
| | - Xiaoxuan Liu
- University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK
- Academic Unit of Ophthalmology, Institute of Inflammation and Ageing, College of Medical and Dental Sciences, University of Birmingham, Birmingham, UK
| | - Bilal A Mateen
- Institute of Health Informatics, University College London, London, UK
- The Wellcome Trust, London, UK
- The Alan Turing Institute, London, UK
| | - Piyush Mathur
- Department of General Anesthesiology, Anesthesiology Institute, Cleveland Clinic, Cleveland, OH, USA
| | - Melissa D McCradden
- The Hospital for Sick Children, Toronto ON, Canada
- Dalla Lana School of Public Health, University of Toronto, Toronto ON, Canada
| | | | - Johan Ordish
- Medicines and Healthcare products Regulatory Agency, London, UK
| | | | - Suchi Saria
- Departments of Computer Science, Statistics, and Health Policy, and Division of Informatics, Johns Hopkins University, Baltimore, MD, USA
- Bayesian Health, New York, NY, USA
| | - Daniel S W Ting
- Singapore National Eye Center, Singapore Eye Research Institute, Singapore, Singapore
- Duke-NUS Medical School, National University of Singapore, Singapore, Singapore
| | - Peter Watkinson
- Critical Care Research Group, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, UK
- NIHR Biomedical Research Centre Oxford, Oxford University Hospitals NHS Trust, Oxford, UK
| | | | | | - Peter McCulloch
- Nuffield Department of Surgical Sciences, University of Oxford, Oxford, UK
| |
Collapse
|
50
|
Miao S, Pan C, Li D, Shen S, Wen A. Endorsement of the TRIPOD statement and the reporting of studies developing contrast-induced nephropathy prediction models for the coronary angiography/percutaneous coronary intervention population: a cross-sectional study. BMJ Open 2022; 12:e052568. [PMID: 35190425 PMCID: PMC8862501 DOI: 10.1136/bmjopen-2021-052568] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/25/2022] Open
Abstract
OBJECTIVE Clear and specific reporting of a research paper is essential for its validity and applicability. Some studies have revealed that the reporting of studies based on the clinical prediction models was generally insufficient based on the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) checklist. However, the reporting of studies on contrast-induced nephropathy (CIN) prediction models in the coronary angiography (CAG)/percutaneous coronary intervention (PCI) population has not been thoroughly assessed. Thus, the aim is to evaluate the reporting of the studies on CIN prediction models for the CAG/PCI population using the TRIPOD checklist. DESIGN A cross-sectional study. METHODS PubMed and Embase were systematically searched from inception to 30 September 2021. Only the studies on the development of CIN prediction models for the CAG/PCI population were included. The data were extracted into a standardised spreadsheet designed in accordance with the 'TRIPOD Adherence Assessment Form'. The overall completeness of reporting of each model and each TRIPOD item were evaluated, and the reporting before and after the publication of the TRIPOD statement was compared. The linear relationship between model performance and TRIPOD adherence was also assessed. RESULTS We identified 36 studies that developed CIN prediction models for the CAG/PCI population. Median TRIPOD checklist adherence was 60% (34%-77%), and no significant improvement was found since the publication of the TRIPOD checklist (p=0.770). There was a significant difference in adherence to individual TRIPOD items, ranging from 0% to 100%. Moreover, most studies did not specify critical information within the Methods section. Only 5 studies (14%) explained how they arrived at the study size, and only 13 studies (36%) described how to handle missing data. In the Statistical analysis section, how the continuous predictors were modelled, the cut-points of categorical or categorised predictors, and the methods to choose the cut-points were only reported in 7 (19%), 6 (17%) and 1 (3%) of the studies, respectively. Nevertheless, no relationship was found between model performance and TRIPOD adherence in both the development and validation datasets (r=-0.260 and r=-0.069, respectively). CONCLUSIONS The reporting of CIN prediction models for the CAG/PCI population still needs to be improved based on the TRIPOD checklist. In order to promote further external validation and clinical application of the prediction models, more information should be provided in future studies.
Collapse
Affiliation(s)
- Simeng Miao
- Department of Pharmacy, Beijing Friendship Hospital, Capital Medical University, Beijing, China
- Department of Pharmacy, Shanxi Cancer Hospital, Taiyuan, Shanxi, China
| | - Chen Pan
- Department of Pharmacy, Beijing Friendship Hospital, Capital Medical University, Beijing, China
| | - Dandan Li
- Department of Pharmacy, Beijing Friendship Hospital, Capital Medical University, Beijing, China
| | - Su Shen
- Department of Pharmacy, Beijing Friendship Hospital, Capital Medical University, Beijing, China
| | - Aiping Wen
- Department of Pharmacy, Beijing Friendship Hospital, Capital Medical University, Beijing, China
| |
Collapse
|