A review of quality assessment of the methodology used in guidelines and systematic reviews on oral mucositis

Quality of Clinical Guidelines on Oral Care for Children with Special Healthcare Needs: A Systematic Review

Robust evidence-based guidelines are important in everyday clinical practice, especially when delivering and managing oral care needs to a vulnerable group such as children with special healthcare needs (SHCNs).

METHODS

To assess the quality of guidelines on the management of oral care for children with special healthcare needs (SHCNs) and to find appropriate guidelines, an electronic search of MEDLINE Ovid was carried out alongside an additional search of common guideline websites. The AGREE II tool was used to assess the quality of the guidelines. Assessment was undertaken independently by three assessors. Furthermore, the underlying evidence used to formulate recommendations in the identified guidelines was qualitatively assessed.

RESULTS

There were nine guidelines, with 41 recommendations, that met the eligibility criteria. The quality of the guidelines was generally found to be poor. Only one guideline was assessed as "recommended" by the assessors, based on the quality of the methods, the reporting, or both. Only 2 of the 41 sets of recommendations, made across the nine guidelines, were judged to be valid and based on a rigorous systematic review of the evidence.

CONCLUSIONS

The current state of guidelines on oral care management for children with special healthcare needs (SHCNs) is, on the whole, of very low quality. The scientific community should work together to enhance the quality and strength of the current clinical guidelines and to ensure that they are trustworthy prior to implementation.

Appraising of the Clinical Practice Guidelines Quality in the Non-Pharmacological Management of Chemotherapy-Induced Febrile Neutropenia; A Review

Background:

Febrile neutropenia is a common and serious chemotherapy side effect, is associated with increased mortality, morbidity, and treatment expenditures. Several CPGs (Clinical practice guidelines) have been released for managing chemotherapy-induced febrile neutropenia. The aim of this study is Appraisal of the clinical practice Guidelines quality in the management of chemotherapy-induced febrile neutropenia.

Methods:

A review study with a systematic search of the present CPGs for the management of chemotherapy-induced febrile neutropenia. After screening the CPGs based on eligibility criteria, three CPGs were selected and 5 independent reviewers appraised them for methodological quality by using the AGREE II Instrument.

Results:

Three CPGs were included; all of them were evidence-based guidelines. The clarity of presentation domain scored the highest and the applicability domain has the lowest score among all domains of AGREE instrument and the rest of domains scored as descending respectively; Scope and purpose, stakeholder involvement, editorial independence, rigor of development. In general, the intra-class correlation coefficient (ICC) scores of all domains were very good according to the Landis and Koch’s scale, except the Applicability domain scored as substantial.

Conclusions:

This study showed the quality of appraised CPGs. Three domains of these CPGs based on the AGREE instrument scored less than other domains and were in relatively unfavorable status: applicability, rigor of development, editorial independence. Given the importance of these domains in guideline implementation, it is necessary to take actions for reducing these defects.

The quality of guidelines in non-pharmacological prevention and management of chemotherapy-induced neuropathy: A review

Chemotherapy-induced peripheral neuropathy is a common adverse effect occurring in patients undergoing neurotoxic chemotherapy. However, there is no FDA-approved treatment option for it. Given the importance of clinical practice guidelines in this area, this study aimed to determine the methodological quality of extant CIPN guidelines. The study was done as part of the adaptation process of CIPN related CPGs at Isfahan University of Medical Sciences, Iran. A systematic search of published CPGs about chemotherapy-induced CIPN in which the AGREE II instrument was applied for appraising CPGs of CIPN was performed. In general, amongst all of the AGREE II Instrument’s domains in the evaluated CPGs, the clarity of presentation and stakeholder involvement domains took favorable scores; and other domains obtained unfavorable and relatively favorable scores. The quality of cancer therapy-induced neuropathy CPGs needs to be improved and designing high-quality CPGs must be considered.

Quality and transparency of overviews of systematic reviews

OBJECTIVE

To evaluate the reporting and methodological quality of overviews of systematic reviews.

METHOD

We developed an 18-item assessment tool for overviews of systematic reviews. We then performed a systematic search for such overviews using the terms ('overview' AND ('meta analys*' OR 'systematic review*')) OR 'umbrella review' in the title. We only included those overviews that were limited to systematic reviews or meta-analyses. Their methodological and reporting quality were assessed by two independent reviewers using the checklist, and differences were resolved by a third reviewer. Data analyses was conducted by SPSS version 15.0 for Windows.

RESULTS

We identified 41 overviews of systematic reviews whose mean total reporting score was 10.78 (SD 3.84) and methodological score 3.05 (SD 2.09). Some important items were not adequately reported: only 69% reported defined eligibility criteria, 76% reported search strategy, 49% reported the process of review selection, 44% reported the data collection process, 5% reported evaluating the reporting quality, 46% reported evaluating methodological quality, and 20% reported assessing the evidence level for each outcome.

CONCLUSION

The reporting and methodological quality of overviews of systematic reviews was very poor, and there is still much room for improvement. A checklist for overviews of systematic reviews should be developed and used.

Clarity and applicability of drug-drug interaction management guidelines: a systematic appraisal by general practitioners and community pharmacists in the Netherlands

BACKGROUND

Despite the availability and daily use of computerized drug-drug interaction surveillance systems, exposure to potentially relevant drug-drug interactions (DDIs) continues. DDI management guidelines are often inadequate and clear management options are lacking, which attributes to overriding of DDI signals. Although general criteria for the development and reporting of high-quality clinical practice guidelines have been identified, it appears these have not yet been applied to DDI management guidelines.

OBJECTIVES

The aim of the study was to assess the clarity and applicability of guidelines for the management of potentially harmful DDIs.

METHODS

We selected 13 DDIs that are potentially harmful for patients and frequently occur in community pharmacy practice in the Netherlands. The clarity and applicability of the management guidelines of these DDIs were appraised using the appropriate two domains - 'Clarity and presentation' and 'Applicability', of the validated Appraisal of Guidelines for Research and Evaluation (AGREE) Instrument. The appraisal was performed by 12 community pharmacists and 12 general practitioners. The standardized domain scores and mean item scores for 'Clarity and presentation' and 'Applicability' were compared.

RESULTS

All DDI management guidelines were generally found to score well on 'Clarity and presentation', but poorly with respect to 'Applicability' (standardized domain scores 68.0 vs 26.1%). Within the domain 'Clarity and presentation', the item 'tools for application' received the lowest scores. Within the domain 'Applicability', cost implications, organizational barriers and key review criteria were all poorly documented. All guidelines presented non-directive advice using words such as 'consider' and 'regularly'.

CONCLUSIONS

Developers of DDI management guidelines should take the appropriate domains of the AGREE Instrument into consideration in their development processes. The applicability of DDI management guidelines should be pretested before publishing. To improve guideline quality, more attention should particularly be paid to the available tools for applications and cost implications.

Efficacy of a spray compound containing a pool of collagen precursor synthetic aminoacids (l-proline, l-leucine, l-lysine and glycine) combined with sodium hyaluronate to manage chemo/radiotherapy-induced oral mucositis: preliminary data of an open trial

Oral mucositis (OM) is a very frequent and potentially severe complication experienced by patients receiving chemotherapy and/or radiotherapy, which often leads to significant morbidity and mortality, and decreased quality of life, and is very costly. Despite its severity and prevalence, there is no standard recognised management today. The aim of this open clinical trial is to evaluate the efficacy and compliance of a new spray compound containing sodium hyaluronate (SH) and a pool of collagen precursor amino acids (AAs) combined with sodium hyaluronate (SH) to manage radio/chemotherapy-induced OM. Twenty-seven consecutive patients with OM were treated according to the manufacturers instructions. At time T0 (baseline before intervention), we evaluated the following parameters: (i) pain score (by linear visual analogue scale; 0100) and (ii) severity of OM scored according to WHO Mucositis scale. The treatment efficacy was evaluated on i) pain score, ii) clinical resolution index (CRI) and iii) patient compliance at times T01 (after 2 hours), T1 (after 24 hours), T2 (after 72 hours), T3 (after 7 days) and T4 (after 14 days). Results showed that painful symptoms were significantly reduced after only 2 hours of spray administration compared with baseline measurements (p less than 0.0001; z=-4.541). A progressive reduction of pain through the 2 weeks was also noted (p less than 0.0001). Patient lesions treated with SH-Asbased spray also significantly improved after 72 hours of treatment (p=0.0051; z=-2.803). During the two-week observation, all patients significantly improved from the baseline (p less than 0.0001) and progressively ameliorated their ability to swallow foods and liquids. The compliance of all patients to the product was very good, and at the end of the study there were no adverse effects. The results suggest that the SHAAs-based spray accelerates lesion healing and above all helps to manage mucositis pain, especially in terms of immediate pain relief (after 2 hours from application). Although further randomized controlled studies are recommended, our findings suggest that frequent applications of this spray may offer rapid and effective pain management, aiding faster mucosal wound healing.