Do randomised controlled trials relevant to pharmacy meet best practice standards for quality conduct and reporting? A systematic review

Methods and results of studies on reporting guideline adherence are poorly reported: a meta-research study

OBJECTIVES

We investigated recent meta-research studies on adherence to four reporting guidelines to determine the proportion that provided (1) an explanation for how adherence to guideline items was rated and (2) results from all included individual studies. We examined conclusions of each meta-research study to evaluate possible repetitive and similar findings.

STUDY DESIGN AND SETTING

A cross-sectional meta-research study. MEDLINE (Ovid) was searched on July 5, 2022 for studies that used any version of the Consolidated Standards of Reporting Trials, Preferred Reporting Items for Systematic Reviews and Meta-Analyses, Standards for the Reporting of Diagnostic Accuracy Studies, or Strengthening the Reporting of Observational Studies in Epidemiology reporting guidelines or their extensions to evaluate reporting.

RESULTS

Of 148 included meta-research studies published between August 2020 and June 2022, 14 (10%, 95% confidence interval [CI] 6%-15%) provided a fully replicable explanation of how they coded the adherence ratings and 49 (33%, 95% CI 26%-41%) completely reported individual study results. Of 90 studies that classified reporting as adequate or inadequate in the study abstract, six (7%, 95% CI 3%-14%) concluded that reporting was adequate, but none of those six studies provided information on how items were coded or provided item-level results for included studies.

CONCLUSION

Almost all included meta-research studies found that reporting in health research is suboptimal. However, few of these reported enough information for verification or replication.

Improving the quality of publications in and advancing the paradigms of clinical and social pharmacy practice research: The Granada statements

Pharmacy and pharmaceutical sciences embrace a series of different disciplines. Pharmacy practice has been defined as "the scientific discipline that studies the different aspects of the practice of pharmacy and its impact on health care systems, medicine use, and patient care". Thus, pharmacy practice studies embrace both clinical pharmacy and social pharmacy elements. Like any other scientific discipline, clinical and social pharmacy practice disseminates research findings using scientific journals. Clinical pharmacy and social pharmacy journal editors have a role in promoting the discipline by enhancing the quality of the articles published. As has occurred in other health care areas (i.e., medicine and nursing), a group of clinical and social pharmacy practice journal editors gathered in Granada, Spain to discuss how journals could contribute to strengthening pharmacy practice as a discipline. The result of that meeting was compiled in these Granada Statements, which comprise 18 recommendations gathered into six topics: the appropriate use of terminology, impactful abstracts, the required peer reviews, journal scattering, more effective and wiser use of journal and article performance metrics, and authors' selection of the most appropriate pharmacy practice journal to submit their work.

Improving the quality of publications in and advancing the paradigms of clinical and social pharmacy practice research: The Granada Statements

Pharmacy and pharmaceutical sciences embrace a series of different disciplines. Pharmacy practice has been defined as "the scientific discipline that studies the different aspects of the practice of pharmacy and its impact on health care systems, medicine use, and patient care". Thus, pharmacy practice studies embrace both clinical pharmacy and social pharmacy elements. Like any other scientific discipline, clinical and social pharmacy practice disseminates research findings using scientific journals. Clinical pharmacy and social pharmacy journal editors have a role in promoting the discipline by enhancing the quality of the articles published. As has occurred in other health care areas (i.e., medicine and nursing), a group of clinical and social pharmacy practice journal editors gathered in Granada, Spain to discuss how journals could contribute to strengthening pharmacy practice as a discipline. The result of that meeting was compiled in these Granada Statements, which comprise 18 recommendations gathered into six topics: the appropriate use of terminology, impactful abstracts, the required peer reviews, journal scattering, more effective and wiser use of journal and article performance metrics, and authors' selection of the most appropriate pharmacy practice journal to submit their work.

Improving the quality of publications in and advancing the paradigms of clinical and social Pharmacy Practice Research: The Granada statements

Pharmacy and pharmaceutical sciences embrace a series of different disciplines. Pharmacy practice has been defined as "the scientific discipline that studies the different aspects of the practice of pharmacy and its impact on health care systems, medicine use, and patient care". Thus, pharmacy practice studies embrace both clinical pharmacy and social pharmacy elements. Like any other scientific discipline, clinical and social pharmacy practice disseminates research findings using scientific journals. Clinical pharmacy and social pharmacy journal editors have a role in promoting the discipline by enhancing the quality of the articles published. As has occurred in other health care areas (i.e., medicine and nursing), a group of clinical and social pharmacy practice journal editors gathered in Granada, Spain to discuss how journals could contribute to strengthening pharmacy practice as a discipline. The result of that meeting was compiled in these Granada Statements, which comprise 18 recommendations gathered into six topics: the appropriate use of terminology, impactful abstracts, the required peer reviews, journal scattering, more effective and wiser use of journal and article performance metrics, and authors' selection of the most appropriate pharmacy practice journal to submit their work. © 2023 The Author(s) Published by Elsevier Inc, Springer Nature, Brazilian Society of Hospital Pharmacy and Health Services, Elsevier Inc, Royal Pharmaceutical Society, Biomedcentral, Sociedad Española de Farmacia Hospitalaria (S.E.F.H), Pharmaceutical Care España Foundation, European Association of Hospital Pharmacists, Faculty of Pharmacy.

Improving the quality of publications in and advancing the paradigms of clinical and social pharmacy practice research: the Granada Statements

Pharmacy and pharmaceutical sciences embrace a series of different disciplines. Pharmacy practice has been defined as "the scientific discipline that studies the different aspects of the practice of pharmacy and its impact on health care systems, medicine use, and patient care". Thus, pharmacy practice studies embrace both clinical pharmacy and social pharmacy elements. Like any other scientific discipline, clinical and social pharmacy practice disseminates research findings using scientific journals. Clinical pharmacy and social pharmacy journal editors have a role in promoting the discipline by enhancing the quality of the articles published. As has occurred in other health care areas (i.e., medicine and nursing), a group of clinical and social pharmacy practice journal editors gathered in Granada, Spain to discuss how journals could contribute to strengthening pharmacy practice as a discipline. The result of that meeting was compiled in these Granada Statements, which comprise 18 recommendations gathered into six topics: the appropriate use of terminology, impactful abstracts, the required peer reviews, journal scattering, more effective and wiser use of journal and article performance metrics, and authors' selection of the most appropriate pharmacy practice journal to submit their work.

Improving the quality of publications in and advancing the paradigms of clinical and social pharmacy practice research: the Granada Statements

Pharmacy and pharmaceutical sciences embrace a series of different disciplines. Pharmacy practice has been defined as 'the scientific discipline that studies the different aspects of the practice of pharmacy and its impact on healthcare systems, medicine use, and patient care'. Thus, pharmacy practice studies embrace both clinical pharmacy and social pharmacy elements. Like any other scientific discipline, clinical and social pharmacy practice disseminates research findings using scientific journals. Clinical pharmacy and social pharmacy journal editors have a role in promoting the discipline by enhancing the quality of the articles published. As has occurred in other healthcare areas (ie, medicine and nursing), a group of clinical and social pharmacy practice journal editors gathered in Granada, Spain to discuss how journals could contribute to strengthening pharmacy practice as a discipline. The result of that meeting was compiled in these Granada Statements, which comprise 18 recommendations gathered into six topics: the appropriate use of terminology, impactful abstracts, the required peer reviews, journal scattering, more effective and wiser use of journal and article performance metrics, and authors' selection of the most appropriate pharmacy practice journal to submit their work.

Improving the quality of publications in and advancing the paradigms of clinical and social pharmacy practice research: The Granada statements

Pharmacy and pharmaceutical sciences embrace a series of different disciplines. Pharmacy practice has been defined as "the scientific discipline that studies the different aspects of the practice of pharmacy and its impact on health care systems, medicine use, and patient care". Thus, pharmacy practice studies embrace both clinical pharmacy and social pharmacy elements. Like any other scientific discipline, clinical and social pharmacy practice disseminates research findings using scientific journals. Clinical pharmacy and social pharmacy journal editors have a role in promoting the discipline by enhancing the quality of the articles published. As has occurred in other health care areas (i.e., medicine and nursing), a group of clinical and social pharmacy practice journal editors gathered in Granada, Spain to discuss how journals could contribute to strengthening pharmacy practice as a discipline. The result of that meeting was compiled in these Granada Statements, which comprise 18 recommendations gathered into six topics: the appropriate use of terminology, impactful abstracts, the required peer reviews, journal scattering, more effective and wiser use of journal and article performance metrics, and authors' selection of the most appropriate pharmacy practice journal to submit their work.

Improving the quality of publications in and advancing the paradigms of clinical and social pharmacy practice research: The Granada Statements

Pharmacy and pharmaceutical sciences embrace a series of different disciplines. Pharmacy practice has been defined as "the scientific discipline that studies the different aspects of the practice of pharmacy and its impact on health care systems, medicine use, and patient care". Thus, pharmacy practice studies embrace both clinical pharmacy and social pharmacy elements. Like any other scientific discipline, clinical and social pharmacy practice disseminates research findings using scientific journals. Clinical pharmacy and social pharmacy journal editors have a role in promoting the discipline by enhancing the quality of the articles published. As has occurred in other health care areas (i.e., medicine and nursing), a group of clinical and social pharmacy practice journal editors gathered in Granada, Spain to discuss how journals could contribute to strengthening pharmacy practice as a discipline. The result of that meeting was compiled in these Granada Statements, which comprise 18 recommendations gathered into six topics: the appropriate use of terminology, impactful abstracts, the required peer reviews, journal scattering, more effective and wiser use of journal and article performance metrics, and authors' selection of the most appropriate pharmacy practice journal to submit their work.

Meta-computational techniques' for managing spare data: An application in off-pump heart surgery

BACKGROUND AND OBJECTIVES

This research looked at the key considerations to remember when selecting a model for working with sparse data. In the presence of sparse evidence, it proposes ideal conditions for conducting meta-analysis.

METHODS

Monte Carlo simulations were used to produce study results, and three forms of continuity correction were used in the research. Besides, meta-analytical approaches were used to measure the cumulative effect of treatment and estimate each method's efficiency. A clinical trial in off-pump surgery met the main objectives of this research. Meta-analysis methods were used to determine the outcome of postoperative risk results. After that, with a total population of 3030, Monte Carlo simulations were used to produce research data to run fixed and random-effect models with three continuity correction forms. The type of consistency adjustment used, group imbalances, statistical analysis used, and variance values between studies all affect meta-analytical methods' results.

RESULTS

MSE values for balanced groups are normally zero. While the Arc-sine variation approach does a decent job of coping with inconsistent results on the effect of treatment, it has concerns with boundary estimates of variance between tests. Furthermore, using continuity correction methods introduces bias and imprecise medication outcome calculations. The spectrum of statistical analysis, such as fixed effects and random effects, can be inferred as completely based on data in samples. The sensitivity analysis of correction decisions could increase the reliability of meta-analysis approaches by enabling researchers to analyze various effect estimation findings.

CONCLUSION

This research study can be expanded upon by identifying alternative approaches to continuity correction methods and resolving boundary estimate problems. The range of statistical analysis, such as fixed effects and random effects, can be entirely dependent on the samples' type of data. The sensitivity analysis of correction decisions could improve the efficiency of meta-analysis methods by allowing researchers to investigate a wide range of effect estimation results.

Comparing the reporting and conduct quality of exercise and pharmacological randomised controlled trials: a systematic review

OBJECTIVE

Evaluate the quality of exercise randomised controlled trial (RCT) reporting and conduct in clinical populations (ie, adults with or at risk of chronic conditions) and compare with matched pharmacological RCTs.

DESIGN

Systematic review.

DATA SOURCES

Embase (Elsevier), PubMed (NLM) and CINAHL (EBSCO).

STUDY SELECTION

RCTs of exercise in clinical populations with matching pharmacological RCTs published in leading clinical, medical and specialist journals with impact factors ≥15.

REVIEW METHODS

Overall RCT quality was evaluated by two independent reviewers using three research reporting guidelines (ie, Consolidated Standards of Reporting Trials (CONSORT; pharmacological RCTs)/CONSORT for non-pharmacological treatments; exercise RCTs), CONSORT-Harms, Template for Intervention Description and Replication) and two risk of bias assessment (research conduct) tools (ie, Cochrane Risk of Bias, Jadad Scale). We compared research reporting and conduct quality within exercise RCTs with matched pharmacological RCTs, and examined factors associated with quality in exercise and pharmacological RCTs, separately.

FINDINGS

Forty-eight exercise RCTs (11 658 patients; median sample n=138) and 48 matched pharmacological RCTs were evaluated (18 501 patients; median sample n=160). RCTs were conducted primarily in cardiovascular medicine (43%) or oncology (31%). Overall quality score (composite of all research reporting and conduct quality scores; primary endpoint) for exercise RCTs was 58% (median score 46 of 80; IQR: 39-51) compared with 77% (53 of 68; IQR: 47-58) in the matched pharmacological RCTs (p≤0.001). Individual quality scores for trial reporting and conduct were lower in exercise RCTs compared with matched pharmacological RCTs (p≤0.03). Factors associated with higher overall quality scores for exercise RCTs were journal impact factor (≥25), sample size (≥152) and publication year (≥2013).

CONCLUSIONS AND RELEVANCE

Research reporting and conduct quality within exercise RCTs is inferior to matched pharmacological RCTs. Suboptimal RCT reporting and conduct impact the fidelity, interpretation, and reproducibility of exercise trials and, ultimately, implementation of exercise in clinical populations.

PROSPERO REGISTRATION NUMBER

CRD42018095033.

Quality of reporting and risk of bias: a review of randomised trials in occupational health

Objectives

To assess the reporting quality of randomisation and allocation methods in occupational health and safety (OHS) trials in relation to Consolidated Standards of Reporting Trials (CONSORT) requirements of journals, risk of bias (RoB) and publication year.

Methods

We systematically searched for randomised controlled trials (RCTs) in PubMed between 2010 and May 2019 in 18 OHS journals. We measured reporting quality as percentage compliance with the CONSORT 2010 checklist (items 8–10) and RoB with the ROB V.2.0 tool (first domain). We tested the mean difference (MD) in % in reporting quality between CONSORT-requiring and non-requiring journals, trials with low, some concern and high RoB and publications before and after 2015.

Results

In 135 articles reporting on 129 RCTs, average reporting quality was at 37.4% compliance (95% CI 31.9% to 43.0%), with 10% of articles reaching 100% compliance. Reporting quality was significantly better in CONSORT-requiring journals than non-requiring journals (MD 31.0% (95% CI 21.4% to 40.7%)), for studies at low RoB than high RoB (MD 33.1% (95% CI 16.1% to 50.2%)) and with RoB of some concern (MD 39.8% (95% CI 30.0% to 49.7%)). Reporting quality did not improve over time (MD −5.7% (95% CI −16.8% to 5.4%).

Conclusions

Articles in CONSORT-requiring journals and of low RoB studies show better reporting quality. Low reporting quality is linked to unclear RoB judgements (some concern). Reporting quality did not improve over the last 10 years and CONSORT is insufficiently implemented. Concerted efforts by editors and authors are needed to improve CONSORT implementation.

Reporting of methodological studies in health research: a protocol for the development of the MethodologIcal STudy reportIng Checklist (MISTIC)

INTRODUCTION

Methodological studies (ie, studies that evaluate the design, conduct, analysis or reporting of other studies in health research) address various facets of health research including, for instance, data collection techniques, differences in approaches to analyses, reporting quality, adherence to guidelines or publication bias. As a result, methodological studies can help to identify knowledge gaps in the methodology of health research and strategies for improvement in research practices. Differences in methodological study names and a lack of reporting guidance contribute to lack of comparability across studies and difficulties in identifying relevant previous methodological studies. This paper outlines the methods we will use to develop an evidence-based tool-the MethodologIcal STudy reportIng Checklist-to harmonise naming conventions and improve the reporting of methodological studies.

METHODS AND ANALYSIS

We will search for methodological studies in the Cumulative Index to Nursing and Allied Health Literature, Cochrane Library, Embase, MEDLINE, Web of Science, check reference lists and contact experts in the field. We will extract and summarise data on the study names, design and reporting features of the included methodological studies. Consensus on study terms and recommended reporting items will be achieved via video conference meetings with a panel of experts including researchers who have published methodological studies.

ETHICS AND DISSEMINATION

The consensus study has been exempt from ethics review by the Hamilton Integrated Research Ethics Board. The results of the review and the reporting guideline will be disseminated in stakeholder meetings, conferences, peer-reviewed publications, in requests to journal editors (to endorse or make the guideline a requirement for authors), and on the Enhancing the QUAlity and Transparency Of health Research (EQUATOR) Network and reporting guideline websites.

REGISTRATION

We have registered the development of the reporting guideline with the EQUATOR Network and publicly posted this project on the Open Science Framework (www.osf.io/9hgbq).

A tutorial on methodological studies: the what, when, how and why

BACKGROUND

Methodological studies - studies that evaluate the design, analysis or reporting of other research-related reports - play an important role in health research. They help to highlight issues in the conduct of research with the aim of improving health research methodology, and ultimately reducing research waste.

MAIN BODY

We provide an overview of some of the key aspects of methodological studies such as what they are, and when, how and why they are done. We adopt a "frequently asked questions" format to facilitate reading this paper and provide multiple examples to help guide researchers interested in conducting methodological studies. Some of the topics addressed include: is it necessary to publish a study protocol? How to select relevant research reports and databases for a methodological study? What approaches to data extraction and statistical analysis should be considered when conducting a methodological study? What are potential threats to validity and is there a way to appraise the quality of methodological studies?

CONCLUSION

Appropriate reflection and application of basic principles of epidemiology and biostatistics are required in the design and analysis of methodological studies. This paper provides an introduction for further discussion about the conduct of methodological studies.