Discordant and inappropriate discordant recommendations in consensus and evidence based guidelines: empirical analysis

Quality evaluation of French guidelines in primary care infectious disease: An AGREE II assessment

RATIONALE

Antibiotic prescription, its nature and its duration are a very common decision-making situation in primary care practice. Clinical practice guidelines (CPGs) are regularly emitted by various organisations on this topic.

AIMS AND OBJECTIVES

Our goal is to run a quality appraisal of the current French guidelines, for the most common primary care infectious pathologies.

METHOD

We collected all primary care CPGs that are currently prevailing in France through a systematic review of the french website Antibioclic®. For each of these guidelines, a quality assessment was run by 3 independent reviewers, by means of the Appraisal of Guidelines for REsearch & Evaluation II instrument. The main outcome was a 'reliability score', defined as the sum of the scores in domains 'rigour of development' and 'editorial independence'. To be considered 'reliable', the CPG had to reach a 60% threshold in these two domains. Secondary outcomes were as follows: global quality score of CPGs, number and ratio of CPGs for which a systematic review has been conducted during its conception.

RESULTS

Over the 43 CPGs that have been assessed, none reached the 60%-threshold as to the reliability score. Only one CPG (2.33%) gets an over-60% quality assessment in the domain of rigour of development (D3), whereas three CPGs (6.98%) reach this threshold in the domain of editorial independence (D6). One CPG (2.33%) met the quality threshold of 60% as to overall assessment. Rigour of development and editorial independence are the domains that obtained the lowest average score, respectively, 11% and 21%. Overall assessment received an average score of 29%. A systematic review of the literature was mentioned for 10 CPGs (23.26%).

CONCLUSION

There is a lack of quality in the development process of the current French guidelines in primary care infectiology. This process should be reconsidered, with higher insistence as to its quality.

Industry effects on evidence: a case study of long-acting injectable antipsychotics

A vigorously debated issue in the psychiatric literature is whether long-acting injectable antipsychotics (LAIs) show clinical benefit over antipsychotics taken orally. In addressing this question, it is critical that systematic reviews incorporate risk of bias assessments of trial data in a robust way and are free of undue industry influence. In this paper, we present a case analysis in which we identify some of the design problems in a recent systematic review on LAIs vs oral formulations. This case illustrates how evidence syntheses that are shaped by commercial interests may undermine patient-centered models of recovery and care. We offer recommendations that address both the bioethical and research design issues that arise in the systematic review process when researchers have financial conflicts of interest.

How strong is the evidence supporting the WHO guidelines on physical activity, sedentary behaviour and sleep in early childhood?

BACKGROUND

The WHO issued recommendations about the ideal amount of physical activity, sedentary behaviour and sleep in infants, toddlers and preschool children. To facilitate their interpretation and translation into public health policies, we analysed the quantity and quality of the evidence that supported the development of each WHO recommendation.

METHODS

All data for each exposure-outcome pair analysed in the studies informing WHO guidelines were extracted, and predefined criteria, based upon GRADE methodology, were used to classify each outcome and study result.

RESULTS

Among the 237 studies that could be included, 37 were experimental and 200 were observational, yielding 920 analyses of exposure-outcome associations. Sixty-two analyses used a relevant outcome, with or without significant results. Five of the 10 WHO recommendations were based upon zero analyses with significant results on relevant health outcomes. The remaining recommendations were mostly based upon analyses evaluating obesity-related outcomes. Eight of the 10 GLs thresholds were not supported by any significant analysis on clinically relevant outcomes.

CONCLUSION

While these findings should not be interpreted as an attempt to disprove the benefits of healthy lifestyle habits in early childhood, neither to minimize the work of the experts in this complex research field, very limited evidence currently supports the adoption of recommended thresholds as behavioural surveillance and public health interventions targets. Therefore, until further data are available, public health interventions should be developed balancing whether to focus on the achievement of specific targets that are still not supported by high-quality evidence or on the general promotion of healthy behaviours.

Blood pressure targets for hypertension in people with chronic renal disease

BACKGROUND

Chronic kidney disease (CKD) is an independent risk factor for cardiovascular disease, development of end-stage renal disease, and all-cause mortality. It affects around 10% of the population worldwide. The prevalence of hypertension in people with CKD ranges from 22% in stage 1 to 80% in stage 4. Elevated arterial blood pressure is one of the major independent risk factors for adverse cardiovascular events. Thereby, reducing blood pressure to below standard targets may be beneficial but could also increase the risk of adverse events. The optimal blood pressure target in people with hypertension and CKD remains unknown.

OBJECTIVES

Primary: to compare the effects of standard and lower-than-standard blood pressure targets for hypertension in people with chronic kidney disease on mortality and morbidity outcomes. Secondary: to assess the magnitude of reductions in systolic and diastolic blood pressure, the proportion of participants reaching blood pressure targets, and the number of drugs necessary to achieve the assigned target.

SEARCH METHODS

We used standard, extensive Cochrane search methods. We searched the Cochrane Hypertension Specialized Register, CENTRAL, MEDLINE, Embase, one other database, and two trial registers up to 8 February 2023. We also contacted authors of relevant papers regarding further published and unpublished work. We applied no language restrictions.

SELECTION CRITERIA

We included randomized controlled trials (RCTs) in people with hypertension and CKD that provided at least twelve months' follow-up. Eligible interventions compared lower targets for systolic/diastolic blood pressure (130/80 mmHg or lower) to standard targets for blood pressure (140 to 160/90 to 100 mmHg or lower). Participants were adults with CKD and elevated blood pressure documented in a standard way on at least two occasions, or already receiving treatment for elevated blood pressure.

DATA COLLECTION AND ANALYSIS

We used standard Cochrane methods. Our critical outcomes were: total mortality, total serious adverse events, total cardiovascular events, cardiovascular mortality, and progression to end-stage renal disease. Important outcomes were: participant withdrawals due to adverse effects, and number of participants with a doubling of serum creatinine level or at least a 50% reduction in the glomerular filtration rate (GFR) at the end of the study. We used GRADE to assess the certainty of the evidence for the critical outcomes. This review received no funding.

MAIN RESULTS

We included six RCTs that contributed data for meta-analysis, involving 7348 participants overall (range 840 to 4733 people per study). The mean follow-up was 3.6 years (range 1.0 to 8.0 years). Three studies were publicly funded, two were privately funded, and one had both public and private funding. All RCTs provided individual participant data. None of the included studies blinded participants or clinicians because of the need to titrate antihypertensive drugs to reach a specific blood pressure target. However, an independent committee blinded to group allocation assessed clinical events in all studies. Critical outcomes. Compared with standard blood pressure targets, lower targets likely result in little to no difference in total mortality (risk ratio (RR) 0.90, 95% confidence interval (CI) 0.76 to 1.06; 6 studies, 7348 participants), total serious adverse events (RR 1.01, 95% CI 0.94 to 1.08; 6 studies, 7348 participants), and total cardiovascular events (RR 1.00, 95% CI 0.87 to 1.15; 5 studies, 6508 participants), all with moderate-certainty evidence. Compared with standard blood pressure targets, lower targets may result in little to no difference in cardiovascular mortality (RR 0.90, 95% CI 0.70 to 1.16; 6 studies, 7348 participants) and progression to end-stage renal disease (RR 0.94, 95% CI 0.80 to 1.11; 4 studies, 4788 participants), both with low-certainty evidence. Important outcomes. We found little to no differences in: participant withdrawals due to adverse effects; and the number of participants with a doubling of serum creatinine level, or at least a 50% reduction in GFR at the end of the study. Exploratory outcomes. Compared to the standard blood pressure target groups, participants in the lower target groups achieved lower systolic and diastolic blood pressure values after one year, and required a higher number of antihypertensive drugs at the end of the studies. A higher proportion of participants in the standard blood pressure target groups achieved the targets they were assigned than did participants in the intensive target groups.

AUTHORS' CONCLUSIONS

Compared to a standard blood pressure target, lower blood pressure targets probably result in little to no difference in total mortality, total serious adverse events, and total cardiovascular events, and may result in little to no difference in total cardiovascular mortality or in the progression to end-stage renal disease in people with hypertension and CKD. However, the evidence underpinning these conclusions has several limitations. All studies were open design, blood pressure measurement was performed at a medical office, and there was scant information about adverse events. Future research should include high-quality adverse event data, report results for people with different levels of proteinuria, and consider out-of-office blood pressure monitoring. Several studies are ongoing, and may provide new evidence for this topic in the near future.

Decision theoretical foundations of clinical practice guidelines: an extension of the ASH thrombophilia guidelines

ABSTRACT

Decision analysis can play an essential role in informing practice guidelines. The American Society of Hematology (ASH) thrombophilia guidelines have made a significant step forward in demonstrating how decision modeling integrated within Grading of Recommendations Assessment, Developing, and Evaluation (GRADE) methodology can advance the field of guideline development. Although the ASH model was transparent and understandable, it does, however, suffer from certain limitations that may have generated potentially wrong recommendations. That is, the panel considered 2 models separately: after 3 to 6 months of index venous thromboembolism (VTE), the panel compared thrombophilia testing (A) vs discontinuing anticoagulants (B) and testing (A) vs recommending indefinite anticoagulation to all patients (C), instead of considering all relevant options simultaneously (A vs B vs C). Our study aimed to avoid what we refer to as the omitted choice bias by integrating 2 ASH models into a single unifying threshold decision model. We analyzed 6 ASH panel's recommendations related to the testing for thrombophilia in settings of "provoked" vs "unprovoked" VTE and low vs high bleeding risk (total 12 recommendations). Our model disagreed with the ASH guideline panels' recommendations in 4 of the 12 recommendations we considered. Considering all 3 options simultaneously, our model provided results that would have produced sounder recommendations for patient care. By revisiting the ASH guidelines methodology, we have not only improved the recommendations for thrombophilia but also provided a method that can be easily applied to other clinical problems and promises to improve the current guidelines' methodology.

Best practice for the selection, design and implementation of UK Kidney Association guidelines: a modified Delphi consensus approach

BACKGROUND

Despite research into how to effectively implement evidence-based recommendations into clinical practice, a lack of standardisation in the commissioning and development of clinical practice guidelines can lead to inconsistencies and gaps in implementation. This research aimed to ascertain how topics in kidney care worthy of guideline development within the UK should be chosen, prioritised, designed and implemented.

METHODS

Following a modified Delphi methodology, a multi-disciplinary panel of experts in kidney healthcare from across the UK developed 35 statements on the issues surrounding the selection, development and implementation of nephrology guidelines. Consensus with these statements was determined by agreement using an online survey; the consensus threshold was defined as 75% agreement.

RESULTS

419 responses were received. Of the 364 healthcare practitioners (HCPs), the majority had over 20 years of experience in their role (n=123) and most respondents were nephrologists (n=95). Of the 55 non-clinical respondents, the majority were people with kidney disease (n=41) and the rest were their carers or family. Participants were from across England, Northern Ireland, Scotland and Wales. Consensus between HCPs was achieved in 32/35 statements, with 28 statements reaching ≥90% agreement. Consensus between patients and patient representatives was achieved across all 20 statements, with 13/20 reaching ≥90% agreement.

CONCLUSIONS

The current results have provided the basis for six recommendations to improve the selection, design and implementation of guidelines. Actioning these recommendations will help improve the accessibility of, and engagement with, clinical guidelines, contributing to the continuing development of best practice in UK kidney care.

Distinguishing ASH clinical practice guidelines from other forms of ASH clinical advice

ABSTRACT

The American Society of Hematology (ASH) develops a variety of resources that provide guidance to clinicians on the diagnosis and management of blood diseases. These resources include clinical practice guidelines (CPGs) and other forms of clinical advice. Although both ASH CPGs and other forms of clinical advice provide recommendations, they differ with respect to the methods underpinning their development, the principal type of recommendations they offer, their transparency and concordance with published evidence, and the time and resources required for their development. It is crucial that end users be aware of the differences between CPGs and other forms of clinical advice and that producers and publishers of these resources use clear and unambiguous terminology to facilitate their distinction. The objective of this article is to highlight the similarities and differences between ASH CPGs and other forms of ASH clinical advice and discuss the implications of these differences for end users.

Comprehensive consideration of multiple determinants from evidence to recommendations in guidelines for most traditional Chinese medicine was suboptimal: a systematic review

BACKGROUND

The overall comprehensive consideration of the factors influencing the recommendations in the traditional Chinese medicine (TCM) guidelines remains poorly studied. This study systematically evaluate the factors influencing recommendations formation in the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) clinical practice guidelines (CPGs) and TCM CPGs.

METHODS

This was a methodological review in which we searched six databases and multiple related websites. The GRADE CPGs were identified as the guidelines developed by the GRADE Working Group or the two Co-Chairs. For the TCM CPGs, we randomly selected guidelines that were published by the TCM or integrative medicine academic societies from China mainland (published by the TCM or integrative medicine academic societies of China mainland). Two reviewers independently screened and extracted data. We included CPGs published in 2018-2022. We extracted information on the influencing factors of evidence to recommendation and conducted the analyses using descriptive statistics and calculated the proportion of relevant items by IBM SPSS Statistics and Microsoft Excel to compare the differences between the GRADE CPGs and the TCM CPGs.

RESULTS

Forty-five GRADE CPGs (including 912 recommendations) and 88 TCM CPGs (including 2452 recommendations) were included. TCM recommendations mainly considered the four key determinants of desirable anticipated effects, undesirable anticipated effects, balance between desirable and undesirable effects, certainty of evidence, with less than 20% of other dimensions. And TCM CPGs presented more strong recommendations (for or against) and inappropriate discordant recommendations than GRADE CPGs. GRADE CPGs were more comprehensive considered about the factors affecting the recommendations, and considered more than 70% of all factors in the evidence to recommendation.

CONCLUSIONS

The TCM CPGs lack a comprehensive consideration of multiple influencing determinants from evidence to recommendations. In the future, the correct application of the GRADE approaches should be emphasized.

Association between Conflicts of Interest Disclosure and Quality of Clinical Practice Guidelines in Japan: A Meta-Epidemiological Study

Accurate disclosure of financial conflicts of interest (COI) among clinical practice guideline (CPG) developers is critical to ensure the quality of CPGs. However, there is limited evidence on the impact of underreporting COIs on the quality of CPGs. This study aimed to examine the proportion of underreported COI disclosures in the development of Japanese CPGs and to estimate the association between underreported COIs and CPG quality using the Appraisal of Guidelines for Research & Evaluation (AGREE) II. Twenty-three Japanese CPGs published in 2019 and their 1114 developers were included in the study. The results show that underreporting of COIs occurred in 52% of the included CPGs and 8% of all CPG developers. Underreporting COI disclosures was negatively associated with low-quality CPG (Odds ratio [OR], 0.57; 95% confidence interval [CI]: 0.11, 3.04). On the other hand, CPGs that had more than 13% of CPG developers with voting rights on recommendation decisions and underreporting of COI disclosures were positively associated with low quality (OR, 1.78; 95% CI: 0.25, 12.45). For individual CPG developers with voting rights for recommendation decisions, the presence of a COI was positively associated with low quality (OR, 1.11; 95% CI: 0.71, 1.75). This study demonstrates that the involvement and underreporting of COIs did not seriously distort the CPG development process. However, the COI-related factors of CPG developers with voting rights for recommendation decisions may be associated with low CPG quality.

Professional medical education approaches: mobilizing evidence for clinicians

Rapidly proliferating high-quality evidence supports daily decision-making in clinical practice. Continuing professional medical education links this evidence to practicing clinicians who are strongly motivated to improve the quality of their care by using the latest information. Approaches to professional education vary, and their effects depend on specific scenarios. This narrative review summarizes the main approaches for professional medical education that facilitate the mobilization of evidence for clinicians. It includes traditional learning (passive and active dissemination of educational materials, lectures, and mass media dissemination), constructivist learning (engaging in local consensus processes and education outreach visits, interfacing with local opinion leaders, conducting patient-mediated interventions, employing audit and feedback processes, and utilizing clinical decision-supporting systems), and blended learning approaches (the integration of in-person or online passive learning with active and creative learning by the learners). An optimized selection from these approaches is challenging but critical to clinicians and healthcare systems.

Cross-sectional analysis of pharmaceutical payments to Japanese board-certified gastroenterologists between 2016 and 2019

OBJECTIVES

Limited evidence is available regarding the financial relationships between gastroenterologists and pharmaceutical companies in Japan. This study analysed the magnitude, prevalence and trends of personal payments made by major pharmaceutical companies to board-certified gastroenterologists in Japan in recent years.

DESIGN

Cross-sectional analysis SETTING AND PARTICIPANTS: Using payment data publicly disclosed by 92 major pharmaceutical companies, this study examined the non-research payments made to all board-certified gastroenterologists by the Japanese Society of Gastroenterology.

PRIMARY AND SECONDARY OUTCOME MEASURES

The primary outcomes were payment amounts, the prevalence of gastroenterologists receiving payments, yearly trends in per-gastroenterologist payment values and the number of gastroenterologists with payments. Additionally, we evaluated the differences in payments among influential gastroenterologists, including clinical practice guideline authors, society board member gastroenterologists and other general gastroenterologists.

RESULTS

Approximately 52.8% of all board-certified gastroenterologists received a total of US$89 151 253, entailing 134 249 payment contracts as the reimbursement for lecturing, consulting and writing, from 84 pharmaceutical companies between 2016 and 2019. The average and median payments per gastroenterologist were US$7670 (SD: US$26 842) and US$1533 (IQR: US$582-US$4781), respectively. The payment value per gastroenterologist did not significantly change during the study period, while the number of gastroenterologists with payments decreased by -1.01% (95% CI: -1.61% to -0.40%, p<0.001) annually. Board member gastroenterologists (median: US$132 777) and the guideline authoring gastroenterologists (median: US$106 069) received 29.9 times and 17.3 times higher payments, respectively, than general gastroenterologists (median: US$284).

CONCLUSION

Most gastroenterologists received personal payments from pharmaceutical companies, but only very few influential gastroenterologists with authority accepted substantial amounts in Japan. There should be transparent and rigorous management strategies for financial conflicts of interest among gastroenterologists working in influential positions.

Strong recommendations from low certainty evidence: a cross-sectional analysis of a suite of national guidelines

BACKGROUND

Clinical guidelines should be based on a thorough evaluation of the evidence and generally include a rating of the quality of evidence and assign a strength to recommendations. Grading of Recommendations Assessment, Development and Evaluation (GRADE) guidance warns against making strong recommendations when the certainty of the evidence is low or very low, but has identified five paradigmatic situations (e.g. life-threatening situations) where this may be justified.

AIMS AND OBJECTIVES

We aimed to characterize the strength of recommendations and certainty of the evidence in Irish National Clinical Guidelines using the GRADE approach.

METHODS

All National Clinical Guidelines from the National Clinical Effectiveness Committee (NCEC) website using the GRADE approach (fully or partially) were included. All recommendations and their corresponding certainty of the evidence, strength of recommendations and justifications were extracted. Authors classified instances of strong recommendations with low certainty evidence (referred to as discordant recommendations) into one of the five paradigmatic situations. Descriptive statistics were calculated.

RESULTS

From the 29 NCEC Clinical Guidelines available at the time of analysis, we identified 8 guidelines using GRADE with a total of 240 recommendations; 38 recommendations did not use the GRADE approach and were excluded. Half of the included guidelines focused on emergency situations. In the final dataset of 202 recommendations, 151 (74.7%) were classified as strong and 51 (25.3%) as conditional. Of the 151 strong recommendations, 55 (36.4%) were supported by high or moderate certainty evidence and 96 (63.6%) by low or very low certainty evidence and were considered discordant. Of these 96 discordant recommendations, 55 (73.7%) were consistent with one of the five paradigmatic situations. However, none were specifically described as such within the guidelines.

CONCLUSIONS

The proportion of discordant recommendations identified in this analysis was higher than some previous international studies (range of all strong recommendations being discordant 30-50%), but similar to other guidelines focused on emergency situations. The majority of discordant recommendations could be mapped to one of the five situations, but no National Clinical Guideline explicitly referenced this. Guideline developers require further guidance to enable greater transparency in the reporting of the reasons for discordant recommendations.

Putting Evidence Into Practice: An Update on the US Preventive Services Task Force Methods for Developing Recommendations for Preventive Services

PURPOSE

The US Preventive Services Task Force (USPSTF) is an independent body that makes evidence-based recommendations regarding preventive services to improve health for people nationwide. Here, we summarize current USPSTF methods, describe how methods are evolving to address preventive health equity, and define evidence gaps for future research.

METHODS

We summarize current USPSTF methods as well as ongoing methods development.

RESULTS

The USPSTF prioritizes topics on the basis of disease burden, extent of new evidence, and whether the service can be provided in primary care and going forward will increasingly consider health equity. Analytic frameworks specify the key questions and linkages connecting the preventive service to health outcomes. Contextual questions provide information on natural history, current practice, health outcomes in high-risk groups, and health equity. The USPSTF assigns a level of certainty to the estimate of net benefit of a preventive service (high, moderate, or low). The magnitude of net benefit is also judged (substantial, moderate, small, or zero/negative). The USPSTF uses these assessments to assign a letter grade from A (recommend) to D (recommend against). I statements are issued when evidence is insufficient.

CONCLUSIONS

The USPSTF will continue to evolve its methods for simulation modeling and to use evidence to address conditions for which there are limited data for population groups who bear a disproportionate burden of disease. Additional pilot work is underway to better understand the relations of the social constructs of race, ethnicity, and gender with health outcomes to inform the development of a USPSTF health equity framework.

Evaluation of Financial Conflicts of Interest and Quality of Evidence Underlying the American Diabetes Association Clinical Practice Guidelines: The Standards of Medical Care in Diabetes, 2021

BACKGROUND

Clinical practice guidelines make recommendations based on the best available evidence. Proper management and disclosure of financial conflicts of interest (FCOIs) are necessary for trustworthy clinical practice guidelines. This study evaluated the prevalence of FCOIs and quality of evidence underlying the American Diabetes Association (ADA) guidelines.

METHODS

Using the Open Payments Database (OPD) between 2018 and 2020, we examined the research and general payments to all authors of the Standards of Medical Care in Diabetes, 2021. The quality of evidence and tone of recommendations were assessed and the associations between the two were evaluated by logistic regression analysis.

RESULTS

Of the 25 guideline authors, 15 (60.0%) were United States (US)-based physicians eligible for the OPD search. Eight (32.0%) and 12 (48.0%) received one or more industry payments one year and three years prior to the guideline publication, respectively. The median total payments (interquartile range) per author were $33,262 ($4,638‒$101,271) in 2020 and $18,053 ($2,529‒$220,659) in 2018-2020. One author received a research payment of over $10,000 undeclared. Of 471 recommendations, 61 (13.0%) and 97 (20.6%) were supported by low-quality evidence and expert opinions, respectively. Also, 439 (93.2%) recommendations had a positive tone. The lower quality of evidence tended to recommend positively with an odds ratio of 1.56 (95% confidence interval: 0.96-2.56, p=0.075) without reaching statistical significance.

CONCLUSION

A minority of the guideline authors received industry payments from the healthcare industry, and declared FCOIs were mostly accurate. However, the ADA FCOI policy required the guideline authors to declare their FCOIs for one year before publication. A more transparent and rigorous FCOI policy is needed in the ADA guidelines.

Evaluation of financial conflicts of interest and quality of evidence in Japanese gastroenterology clinical practice guidelines

BACKGROUND

Clinical practice guidelines assist healthcare professionals in providing evidence-based care. However, pharmaceutical companies' financial interests often influence guideline content. This study aimed to elucidate the magnitude of financial ties among Japanese gastroenterology guideline authors and the pharmaceutical industry.

METHODS

Using pharmaceutical company disclosed payment data, we evaluated financial conflicts of interest (COI) among Japanese Society of Gastroenterology guideline authors between 2016 and 2021. Additionally, we assessed the evidence quality supporting guideline recommendations and associations with financial COI. Finally, we evaluated author COI management during guideline development against global standards.

RESULTS

Overall, 88.2% (231/262) of guideline authors received a median of $12 968 (interquartile range [IQR]: $1839-$70 374) in payments between 2016 and 2019 for lectures, writings, and consulting. Chairpersons received significantly higher payments (median: $86 444 [IQR: $15 455-$165 679]). Notably, 41 (15.6%) authors had undeclared payments exceeding declaration requirements. Low or very low-quality evidence supported 41.0% of recommendations. There was a negative association between the median 4-year payment per author and the proportion of recommendations based on low-quality evidence (odds ratio: 0.966 [95% confidence interval [95% CI]: 0.945-0.987], P = 0.002) and positive association with moderate-quality evidence (odds ratio: 1.018 [95% CI: 1.011-1.025], P < 0.001). Still, the Japanese Society of Gastroenterology guideline development process remains less transparent, with insufficient COI policies relative to global standards.

CONCLUSION

There were extensive financial COI between pharmaceutical companies and guideline authors, and more than 40% of recommendations were based on low-quality evidence. More rigorous and transparent COI policies for guideline development adhering to global standards are warranted.

Recommendations on Off-Label Drug Use in Pediatric Guidelines

Objective: To systematically analyze the supporting evidence, drug information, and the type of off-label drug use in recommendations on off-label drug use in pediatric guidelines. Methods: A cross-sectional study was performed by systematic search through MEDLINE (via PubMed) and Embase databases to identify literature published from 1 January 2018, to 31 December 2020. Only pediatric clinical practice guidelines that included recommendations on off-label use of drugs were included. We present descriptive information on the sources of the included guidelines, country, publication year, evidence grading system used, details on the types of off-label drug use, and the types of studies used as references to support the recommendations. Results: A total of 66 pediatric guidelines with 605 recommendations were included. Eighty-seven (14.4%) recommendations did not cite any references; and the remaining 518 recommendations were supported by 2,240 references (mean 4.3 references/recommendation). The most common types of studies cited were pediatric RCTs (n = 314, 14.0%), pediatric case series studies (n = 260, 11.6%), and reviews (n = 255, 11.4%). Twenty-one percent (n = 470) of the references were studies on adults. One hundred and forty (23.1%) recommendations were graded using the Grading of Recommendations, Assessments, Development, and Evaluations (GRADE) system, of which 37 (26.4%) were graded as strong but supported with only C or D level of evidence. The most commonly reported type of information in the recommendations was indication (n = 499, 82.5%). The most commonly addressed type of off-label drug use in the 523 positive recommendations was unapproved population (n = 255, 48.8%). Sixty-nine (11.4%) recommendations explicitly reported the drug use as off-label. Conclusion: Children may be exposed to medical risks due to gaps in reporting and evidence of off-label drug use recommendations in pediatric guidelines.

Evaluation of Conflicts of Interest among Participants of the Japanese Nephrology Clinical Practice Guideline

BACKGROUND AND OBJECTIVES

Rigorous and transparent management strategies for conflicts of interest and clinical practice guidelines with the best available evidence are necessary for the development of nephrology guidelines. However, there was no study assessing financial and nonfinancial conflicts of interest, quality of evidence underlying the Japanese guidelines for CKD, and conflict of interest policies for guideline development.

DESIGN, SETTING, PARTICIPANTS, & MEASUREMENTS

This cross-sectional study examined financial and nonfinancial conflicts of interest among all 142 authors of CKD guidelines issued by the Japanese Society of Nephrology using a personal payment database from all 92 major Japanese pharmaceutical companies between 2016 and 2019 and self-citations by guideline authors. Also, the quality of evidence and strength of recommendations underlying the guidelines and conflicts of interest policies of Japanese, US, and European nephrology societies were evaluated.

RESULTS

Among 142 authors, 125 authors (88%) received $6,742,889 in personal payments from 56 pharmaceutical companies between 2016 and 2019. Four-year combined median payment per author was $8258 (interquartile range, $2230‒$51,617). The amounts of payments and proportion of guideline authors with payments remained stable during and after guideline development. The chairperson, vice chairperson, and group leaders received higher personal payments than other guideline authors. Of 861 references in the guidelines, 69 (8%) references were self-cited by the guideline authors, and 76% of the recommendations were on the basis of low or very low quality of evidence. There were no fully rigorous and transparent conflicts of interest policies for nephrology guideline authors in the United States, Europe, and Japan.

CONCLUSIONS

Most of the Japanese CKD guideline recommendations were on the basis of low quality of evidence by the guideline authors tied with pharmaceutical companies, suggesting the need for better financial conflicts of interest management.

Guidelines, guidelines and more guidelines for haemorrhoid treatment: A review to sort the wheat from the chaff

AIM

Guidelines benefit patients and clinicians by distilling evidence into easy-to-read recommendations. The literature around the management of haemorrhoids is immense and guidelines are invaluable to improve treatment integrity and patient outcomes. We identified current haemorrhoid guidelines and assessed them for quality and consistency.

METHODS

A systematic search of the literature from January 2011 to October 2021 was carried out. Guidelines identified were assessed for quality using the AGREE II instrument and for consistency in terms of tabulated treatment recommendations.

RESULTS

During this period nine guidelines were identified worldwide. The general quality was poor with only one guideline considered of high enough quality for use. In general, expert selection criteria for guideline development groups were vaguely defined. There were inconsistencies in the interpretation of the published evidence leading to variation in treatment recommendations.

DISCUSSION

Fewer, higher quality guidelines, with more consistent results, are needed. Particular attention should be given to defining the selection of experts involved.