Reporting quality of chronic kidney disease practice guidelines according to the RIGHT statement: a systematic analysis

Quality appraisal of clinical guidelines for Helicobacter pylori infection and systematic analysis of the level of evidence for recommendations

OBJECTIVES

To systematically assess the quality of clinical practice guidelines (CPGs) for Helicobacter pylori (HP) infection and identify gaps that limit their development.

STUDY DESIGN AND SETTING

CPGs for HP infection were systematically collected from PubMed, Embase, the Cochrane Library, the Cumulative Index to Nursing and Allied Health Literature, and six online guideline repositories. Three researchers independently used the AGREE Ⅱ tool to evaluate the methodological quality of the eligible CPGs. In addition, the reporting and recommendation qualities were appraised by using the RIGHT and AGREE-REX tools, respectively. The distribution of the level of evidence and strength of recommendation among evidence-based CPGs was determined.

RESULTS

A total of 7,019 records were identified, and 24 CPGs met the eligibility criteria. Of the eligible CPGs, 19 were evidence-based and 5 were consensus-based. The mean overall rating score of AGREE II was 50.7% (SD = 17.2%). Among six domains, the highest mean score was for scope and purpose (74.4%, SD = 17.7%) and the lowest mean score was for applicability (24.3%, SD = 8.9). Only three of 24 CPGs were high-quality. The mean overall score of recommendation quality was 35.5% (SD = 12.2%), and the mean scores in each domain of AGREE-REX and RIGHT were all ≤ 60%, with values and preferences scoring the lowest (16.6%, SD = 11.9%). A total of 505 recommendations were identified. Strong recommendations accounted for 64.1%, and only 34.3% of strong recommendations were based on high-quality evidence.

CONCLUSION

The overall quality of CPGs for HP infection is poor, and CPG developers tend to neglect some domains, resulting in a wide variability in the quality of the CPGs. Additionally, CPGs for HP infection lack sufficient high-quality evidence, and the grading of recommendation strength should be based on the quality of evidence. The CPGs for HP infection have much room for improvement and further researches are required to minimize the evidence gap.

Evidence mapping of clinical practice guidelines recommendations and quality for depression in children and adolescents

This study systematically reviewed the clinical practice guidelines (CPGs) for depression in children and adolescents and assessed the quality and recommendation consistency of those CPGs. Evidence mapping was presented to illustrate the research trends and identify gaps to guide future research. Literature on CPGs for depression was systematically collected from PubMed, Embase, Web of Science, guideline databases, and psychiatric association/ society websites. The basic information, recommendations, methodological quality, and reporting quality of CPGs were extracted, and the supporting evidence strength for the included CPGs was analyzed in Excel. Four appraisers independently assessed the eligible CPGs using AGREE II instrument and the RIGHT checklist. All recommendations from the CPGs were summarized and analyzed, and the evidence mapping bubble charts were plotted in Excel. After excluding 15,184 records, 12 depression CPGs were eventually proved eligible, six of which were of high quality and six medium quality. A total of 39 major recommendations were summarized, 35 of which were supported by high-quality CPGs. Although direct comparisons are challenging due to differences in grading schemes and research quality, most CPGs share many pivotal recommendations that can help guide clinical practice. However, the evidence for some clinical problems is still lacking. Thus, more research is necessary on the screening and treatment of children and adolescents to put forward more evidence-based and high-quality recommendations.

Evaluation of reporting quality in clinical practice guidelines for acute myeloid leukemia using the RIGHT checklist

BACKGROUND

Acute myeloid leukemia (AML) is an aggressive hematologic malignancy. Clinical practice guidelines (CPGs) on the management of AML have great value in clinical practice. However, the reporting quality of CPGs for AML has not yet been evaluated. This is the first study aiming to evaluate the reporting quality of the most recent AML CPGs published worldwide using the Reporting Items for Practice Guidelines in Healthcare (RIGHT) checklist.

METHODS

We systematically searched PubMed, Chinese National Knowledge Infrastructure (CNKI), Wanfang, and Chinese Biomedical Literature (CBM) to extract CPGs for AML published between January 2016 and December 2020. Websites for guideline development organizations and medical associations were also searched. Two independent researchers assessed compliance of the guidelines to each of the 35 checklist items and summarized reporting rates for the 7 domains of the RIGHT checklist.

RESULTS

We identified 16 guidelines, of which 3 (18.8%) were written in Chinese and 13 (81.3%) were written in English. The average overall reporting rate of the 16 guidelines was 52.9%, and only 7 CPGs (43.8%) had a reporting rate >50%. The average reporting rates of the 7 domains (basic information; background; evidence; recommendations; review and quality assurance; funding, declaration, and management of interests; and other information) were 79.2%, 62.5%, 38.8%, 53.6%, 21.9%, 32.8%, and 43.8%, respectively. For the 35 checklist items, the average reporting rate was 52.9%, and only 16 items had a reporting rate >50%, of which 5 items were reported by all the guidelines. There was 1 item which was not reported by any of the guidelines.

CONCLUSIONS

The reporting quality of recently published AML guidelines remains poor. While the recommendations of CPGs have great value in clinical practice, the reporting quality of CPGs for AML still needs to be improved.

Reporting quality of practice guidelines on colorectal cancer: evaluation using the RIGHT reporting checklist

Background

Clinical practice guidelines are an essential tool for translating evidence into practice. Reporting Items for Practice Guidelines in Healthcare (RIGHT) checklist assists to guide the reporting in guidelines. We used RIGHT to assess the reporting completeness and quality of guidelines on colorectal cancer (CRC).

Methods

We searched the electronic databases Medline (via PubMed), Chinese National Knowledge Infrastructure (CNKI), Wanfang and Chinese Biomedical Literature (CBM) from January 1st, 2018 to December 1st, 2020 for guidelines on CRC. Websites of guideline development organizations were also searched. Two investigators assessed the reporting quality of the included guidelines, and calculated the numbers of guidelines that were compliant with each RIGHT checklist item and the mean proportions of reported items for each of the seven RIGHT checklist domains.

Results

Twenty-seven colorectal guidelines were included. The proportions of reported items in each RIGHT domain were 71.0% for Basic information, 66.2% for Background, 45.9% for Evidence, 68.8% for Recommendations, 24.1% for Review and quality assurance, 33.3% for Funding and declaration and management of interests, and 40.7% for Other information.

Conclusions

The reporting quality of colorectal guidelines was moderate. A systematic use of the RIGHT checklist during the development process could improve the reporting quality of guidelines in the future.

An evaluation of the reporting quality in clinical practice guidelines for hepatocellular carcinoma using the RIGHT checklist

BACKGROUND

Hepatocellular carcinoma (HCC) is one of the most common malignant tumors worldwide. Clinical practice guidelines (CPGs) on the prevention, surveillance, diagnosis and management of HCC are essential to guide clinical practice. The objective of this study was to evaluate the reporting quality of the most recent CPGs for HCC published worldwide.

METHODS

We systematically searched literature databases and websites of guideline development organizations and medical associations to extract CPGs on HCC published between January 2018 and December 2020. We evaluated the reporting quality using the Reporting Items for practice Guidelines in Healthcare (RIGHT) statement. We assessed for each of the 35 RIGHT checklist items whether the guidelines reported the corresponding information. We calculated the mean (± standard error of the mean, SEM) percentages of the guidelines' compliance with the items (reporting rate), both overall and for each of the seven domains of the RIGHT checklist.

RESULTS

We identified 22 guidelines, of which three (14%) were written in Chinese and 19 (86%) in English. The mean ±SEM overall reporting rate in the twenty-two guidelines was 56%±4%. The reporting rates of the seven domains were the following: basic information 81%±3%, background 58%±6%, evidence 58%±6%, recommendations 59%±5%, review and quality assurance 34%±10%, funding and declaration and management of interests 39%±4%, and other information 23%±6%.

CONCLUSIONS

The reporting quality of the recently published guidelines for HCC was suboptimal. While there is no doubt about the great value of the CPGs' recommendations in clinical practice, the reporting in CPGs for HCC still needs improvement.