Progress in evidence-based medicine: a quarter century on

What is the probability that higher versus lower quality of evidence represents true effects estimates?

RATIONALE, AIMS, AND OBJECTIVES

The previous studies demonstrated that the Grading of Recommendations Assessment, Development and Evaluation (GRADE) system, a leading method for evaluating the certainty (quality) of scientific evidence (CoE), cannot reliably differentiate between various levels of CoE when the objective is to accurately assess the magnitude of the treatment effect. An estimated effect size is a function of multiple factors, including the true underlying treatment effect, biases, and other nonlinear factors that affect the estimate in different directions. We postulate that non-weighted, simple linear tallying can provide more accurate estimates of the probability of a true estimate of treatment effects as a function of CoE.

METHODS

We reasoned that stable treatment effect estimates over time indicate truthfulness. We compared odds ratios (ORs) from meta-analyses (MAs) before and after updates, hypothesising that a ratio of odds ratios (ROR) equal to 1 will be more commonly observed in higher versus lower CoE. We used a subset of a previously analysed data set consisting of 82 Cochrane pairs of MAs in which CoE has not changed with the updated MA. If the linear model is valid, we would expect a decrease in the number of ROR = 1 cases as we move from high to moderate, low, and very low CoE.

RESULTS

We found a linear relationship between the probability of a potentially 'true' estimate of treatment effects as a function of CoE (assuming a 10% ROR error margin) (R2 = 1; p = 0.001). The probability of potentially 'true' estimates decreases by 21% (95% CI: 18%-24%) for each drop in the rating of CoE. A linear relationship with a 5% ROR error margin was less clear, likely due to a smaller sample size. Still, higher CoE showed a significantly greater probability of 'true' effects (53%) compared to non-high (i.e., moderate, low, or very low) CoE (25%); p = 0.032.

CONCLUSION

This study confirmed linear relationship between CoE and the probability of potentially 'true' estimates. We found that the probability of potentially "true" estimates decreases by about 20% for each drop in CoE (from about 80% for high to 55% for moderate to 35% to low and 15% to very low CoE).

Hypnosis for depression: Systematic review of randomized clinical trials with meta-analysis

INTRODUCTION

Major Depressive Disorder (MDD) is one of the most debilitating diseases worldwide and has seen a significant increase in diagnoses during the pandemic, demanding more and better therapeutic tools to manage the post-pandemic scenario.

OBJECTIVE

The aim of this systematic review is to provide a comprehensive analysis of the last 20 years of clinical research on Hypnotherapy (HT) to determine whether this intervention has evidence to support its recommendation for the treatment of MDD.

METHODS

This review included only randomized clinical trials (RCTs) involving adult populations diagnosed with MDD, regardless of the severity level (mild, moderate, or severe) according to any validated diagnostic criteria, compared to a control group (active treatment or none), with any follow-up duration and free access to the manuscript. The bibliographic survey was conducted across seven distinct databases: MEDLINE (PubMed), Embase, CENTRAL, PsycINFO, Scopus, ScieELO, and Latin American and Caribbean Health Sciences Literature (LILACS). The risk of bias was assessed by two independent investigators using Cochrane's revised tool (RoB 2), and the final judgment was made by consensus. To better analyze the included studies, the certainty of the evidence was evaluated through the Grading of Recommendations Assessment, Development and Evaluation (GRADE).

RESULTS

There is not enough evidence to indicate that hypnosis-based interventions may reduce the severity of depression, which precludes the clinical recommendation of this intervention for patients in the real world, pending the production of better evidence of effectiveness and safety, although no evidence of significant adverse effects was found.

Clinicians' attitudes towards supplemental oxygen for trauma patients - A survey

INTRODUCTION

The Advanced Trauma Life Support guidelines (ATLS; 2018, 10th ed.) recommend an early and liberal supplemental oxygen for all severely injured trauma patients to prevent hypoxaemia. As of 2024, these guidelines remain the most current. This may lead to hyperoxaemia, which has been associated with increased mortality and respiratory complications. We aimed to investigate the attitudes among clinicians, defined as physicians and prehospital personnel, towards the use of supplemental oxygen in trauma cases.

MATERIALS AND METHODS

A European, web-based, cross-sectional survey was conducted consisting of 23 questions. The primary outcome was the question: "In your opinion, should all severely injured trauma patients always be given supplemental oxygen, regardless of arterial oxygen saturation measured by pulse oximetry?".

RESULTS

The survey was answered by 707 respondents, which corresponded to a response rate of 52 %. The respondents were predominantly male (76 %), with the largest representation from Denmark (82 %), and primarily educated as physicians (62 %). A majority of respondents (73 % [95 % CI: 70 to 76 %]) did not support that supplemental oxygen should always be provided to all severely injured trauma patients without consideration of their arterial oxygen saturation as measured by pulse oximetry (SpO2), with no significant difference between physicians and non-physicians (p = 0.08). Based on the respondents' preferred dosages, the median initial administered dosage of supplemental oxygen for spontaneously breathing trauma patients with a normal SpO2 in the first few hours after trauma was 0 (interquartile range [IQR] 0-3) litres per minute, with 58 % of respondents opting not to provide any supplemental oxygen. The lowest acceptable SpO2 goal in the first few hours after trauma was 94 % (IQR 92-95). In clinical scenarios with TBI, higher dosage of supplemental oxygen and fraction of inspired oxygen (FiO2) were preferred, as well as targeting partial pressure of oxygen in arterial blood as opposed to adjusting the FiO2 directly, compared to no TBI.

CONCLUSION

Almost three out of four clinicians did not support the administration of supplemental oxygen to all severely injured trauma patients, regardless of SpO2. This corresponds to a more restrictive approach than recommended in the current ATLS (2018, 10th ed.) guidelines.

Factors Influencing the Translation of Evidence Into Clinical Practice for Hospital Allied Health Professionals in Terms of the Domains of Behaviour Change Theory: A Systematic Review

This systematic review provides an overview of the unique challenges allied health professions face in the translation and implementation of evidence into practice, which remain relatively under reported and uninformed by a theoretical basis of behaviour change. MEDLINE, EMBASE, CINAHL and Scopus databases from 2010 to 2022 were searched for primary study designs resulting in 21 articles included in this review (PROSPERO: 2022 CRD42022314996). Allied health disciplines reported in the review were mainly from occupational therapy, physiotherapy, dietetics, and speech pathology. The most frequently reported implementation determinants across the Theoretical Domains Framework were identified as 'environmental context and resources', and 'knowledge'. The results also identified a greater influence of 'social influences' and 'beliefs about consequences' in implementation. Implementing evidence into clinical practice is a multifaceted, complex process, and the use of the Theoretical Domains Framework provided a systematic approach to understanding the drivers behind the target behaviours. However, there is a paucity of studies across the allied health professions that describe implementation strategies used and their impact. Many of the studies focused on implementation by the individual clinician rather than the role organizations can play in the translation of evidence into practice.

Inconsistent decision making in dental caries diagnosis and treatment: A case-based questionnaire survey

Background and Aims

Delayed implementation of new knowledge into clinical practice poses patient safety risks. This study investigates agreement on use of the dental caries interventions, sealing, and stepwise excavation.

Methods

A cross-sectional questionnaire survey, based on 11 constructed cases with descriptions of patient symptoms, radiographic, and clinical findings. Interrater agreement on dental caries- and pulp diagnoses and interventions were measured with Cohen's and Light's κ. The data collection period was September 28 to November 5, 2021. To explore variations in use and knowledge factors, we examined Danish dentists' attitudes toward continuing education.

Results

Based on 243 responses, moderate interrater agreement for dental caries and pulp diagnoses and weak agreement on interventions were seen. The agreement with the gold standard for caries was moderate. No agreement was found for dental pulp diagnosis, and for interventions the agreement was weak. No pattern in agreement with the gold standard was seen in relation to case difficulty level. The majority reported knowing of and using stepwise excavation, in conflict with findings that less than half chose stepwise excavation in cases, where considered appropriate. One in four (25%) reported to be unfamiliar with sealing, and half (50%) use sealing regularly. Better access to continuing education and for universities to offer continuing education as alternatives to one-sided private market were requested.

Conclusion

Some patients may receive too radical treatment despite available less invasive evidence-based effective treatments. Dentists acknowledge the importance of continuing education. Easier access and perhaps more incentives for seeking out high-quality continuing education from trustworthy sources are needed.

Comparison of Khorana vs. ONKOTEV predictive score to individualize anticoagulant prophylaxis in outpatients with cancer

BACKGROUND

Based on the Khorana score, guidelines recommend anticoagulation for primary prophylaxis (PP) in outpatients with cancer with an intermediate-to-high risk of venous thromboembolism (VTE). ONKOTEV score has been prospectively externally validated as novel risk assessment model (RAM) with good discriminatory performances but no direct comparisons with Khorana Score are available.

METHODS

Using the ONKOTEV validation dataset (n = 425), we applied generalized decision curve analysis (gDCA) which integrates the principles of evidence-based medicine with treatment effects, model accuracy and patient preferences (weighted as the relative value [RV] of avoiding VTE versus major bleeding [MB]). The aim is to select the most optimal treatment strategy among multiple options: "no treatment", "treat all patients with DOAC/LMVH", or "use ONKOTEV/KHORANA scores to guide PP with DOAC/LMWH".

RESULTS

Results showed that ONKOTEV-guided PP (using DOAC or LMWH) remained the most optimal strategy for wide range assumption of treatment efficacy and patient's preference. For those patients, who value avoiding VTE more than MB, then offering DOAC to all patients represents the best strategy. When MBs are feared more than the morbidity of VTE, ONKOTEV-guided PP (DOAC) represents the best management strategy. In all cases, ONKOTEV outperformed Khorana for individualized VTE prevention.

CONCLUSIONS

When the two predictive models are integrated within a decision analysis framework, ONKOTEV appears superior to Khorana Score in guiding individualized prevention of cancer-related VTE in outpatients with cancer. The findings herein reported provide cutting edge insights in cancer care and support the spread of ONKOTEV score in the ambulatory cancer setting.

Navigating the uncommon: challenges in applying evidence-based medicine to rare diseases and the prospects of artificial intelligence solutions

The study of rare diseases has long been an area of challenge for medical researchers, with agonizingly slow movement towards improved understanding of pathophysiology and treatments compared with more common illnesses. The push towards evidence-based medicine (EBM), which prioritizes certain types of evidence over others, poses a particular issue when mapped onto rare diseases, which may not be feasibly investigated using the methodologies endorsed by EBM, due to a number of constraints. While other trial designs have been suggested to overcome these limitations (with varying success), perhaps the most recent and enthusiastically adopted is the application of artificial intelligence to rare disease data. This paper critically examines the pitfalls of EBM (and its trial design offshoots) as it pertains to rare diseases, exploring the current landscape of AI as a potential solution to these challenges. This discussion is also taken a step further, providing philosophical commentary on the weaknesses and dangers of AI algorithms applied to rare disease research. While not proposing a singular solution, this article does provide a thoughtful reminder that no 'one-size-fits-all' approach exists in the complex world of rare diseases. We must balance cautious optimism with critical evaluation of new research paradigms and technology, while at the same time not neglecting the ever-important aspect of patient values and preferences, which may be challenging to incorporate into computer-driven models.

New Public Management, Austerity, and the Alienation of the Medical Profession in France

In the last twenty years, France has gone through health policy changes that are perceived as paradigm shifts. After briefly describing the reforms driven by the new public management and the subsequent re-centralization of the French health system for budgetary purposes, it appears that those reforms had outcomes below expectations. The regrouping of policy decisions within the Regional Health Agencies and the rise of a French Welfare elite weakened the medical profession. Blame-shifting strategy, political dilution, and spatial inequality linger. The COVID-19 epidemic highlights those limitations. The negative societal and political impact of failed public reforms is increasingly evident.

Computational simulation of the potential improvement in clinical outcomes of cardiovascular diseases with the use of a personalized predictive medicine approach

IMPORTANCE AND OBJECTIVES

The current medical paradigm of evidence-based medicine relies on clinical guidelines derived from randomized clinical trials (RCTs), but these guidelines often overlook individual variations in treatment effects. Approaches have been proposed to develop models predicting the effects of individualized management, such as predictive allocation, individualizing treatment allocation. It is currently unknown whether widespread implementation of predictive allocation could result in better population-level outcomes over guideline-based therapy. We sought to simulate the potential effect of predictive allocation using data from previously conducted RCTs.

METHODS AND RESULTS

Data from 3 RCTs (positive trial, negative trial, trial stopped for futility) in pediatric cardiology were used in a computational simulation study to quantify the potential benefits of a personalized approach based on predictive allocation. Outcomes were compared when using a universal approach vs predictive allocation where each patient was allocated to the treatment associated with the lowest predicted probability of negative outcome. Compared to results from RCTs, predictive allocation yielded absolute risk reductions of 13.8% (95% confidence interval [CI] -1.9 to 29.5), 13.9% (95% CI 4.5-23.2), and 15.6% (95% CI 1.5-29.6), respectively, corresponding to a number needed to treat of 7.3, 7.2, and 6.4. The net benefit of predictive allocation was directly proportional to the performance of the prediction models and disappeared as model performance degraded below an area under the curve of 0.55.

DISCUSSION

These findings highlight that predictive allocation could result in improved group-level outcomes, particularly when highly predictive models are available. These findings will need to be confirmed in simulations of other trials with varying conditions and eventually in RCTs of predictive vs guideline-based treatment allocation.

Characterization of clinical trials in Ecuador and their association with disease burden: Are there research gaps?

This study offers a detailed analysis of clinical trials conducted in Ecuador from 2010 to 2022 to assess alignment with the country's disease burden as indicated by the Global Burden of Disease study. Utilizing data from five registries, including ARCSA and Clinicaltrials.gov, we analyzed characteristics and coverage of 75 CTs after removing duplicates and ineligible studies. Findings reveal a 50% research gap across disease groups, with neoplasms being the only category matching disease burden. The scarcity of clinical research highlights the disparity between CTs and prevalent diseases such as cardiovascular and kidney diseases, diabetes, and other non-communicable conditions. Our results underscore the urgent need for increased clinical research investment addressing these critical health challenges in Ecuador.

Physicians found an interactive tool displaying structured evidence summaries for multiple comparisons understandable and useful: a qualitative user testing study

OBJECTIVES

To evaluate and improve "Making Alternative Treatment Choices Intuitive and Trustworthy" (MATCH-IT)-a digital, interactive decision support tool displaying structured evidence summaries for multiple comparisons-to help physicians interpret and apply evidence from network meta-analysis (NMA) for their clinical decision-making.

STUDY DESIGN AND SETTING

We conducted a qualitative user testing study, applying principles from user-centered design in an iterative development process. We recruited a convenience sample of practicing physicians in Norway, Belgium, and Canada, and asked them to interpret structured evidence summaries for multiple comparisons-linked to clinical guideline recommendations-displayed in MATCH-IT. User testing included (a) introduction of a clinical scenario, (b) a think-aloud session with participant-tool interaction, and (c) a semistructured interview. We video recorded, transcribed, and analyzed user tests using directed content analysis. The results informed new updates in MATCH-IT.

RESULTS

Distributed across 5 development cycles we tested MATCH-IT with 26 physicians. Of these, 24 (94%) reported either no or sparse prior experience with interpretation of NMA. Physicians perceived MATCH-IT as easy to interpret and navigate, and appreciated its ability to provide an overview of the evidence. Visualization of effects in pictograms and inclusion of information on burden of treatment ("practical issues") were highlighted as potentially useful features in interacting with patients. We also identified problems, including undiscovered functionalities (drag and drop), suboptimal tutorial, and cumbersome navigation of the tool. In addition, physicians wanted definition/explanation of key terms (eg, outcomes and "certainty"), and there were concerns that overwhelming evidence from a large NMA would complicate applicability to clinical practice. This led to several updates with development of a new start page, tutorial, updated user interface for more efficient maneuvering, solutions to display definition of key terms and a "frequently asked questions" section. To facilitate interpretation of large networks, we improved categorization of results using color coding and added filtering functionality. These modifications allowed physicians to focus on interventions of interest and reduce information overload.

CONCLUSION

This study provides proof of concept that physicians can use MATCH-IT to understand NMA evidence. Key features of MATCH-IT in a clinical context include providing an overview of the evidence, visualization of effects, and the display of information on burden of treatments. However, unfamiliarity with the Grading of Recommendations Assessment, Development and Evaluation concepts, time constraints, and accessibility at the point of care may be challenges for use. To what extent our results are transferable to real-world clinical contexts remains to be explored.

Standardized Wound Care: Patchwork Practices?

Standardized care is crucial in health care for ensuring consistent, safe, high-quality, efficient, and evidence-based practices. Care pathways that standardize procedures promote adherence to best practices, reduce variability in treatment, and encourage collaboration among health care teams. This approach ultimately improves patient outcomes, enhances safety, and boosts the overall effectiveness of health care services. However, despite these benefits being widespread across most of the U.S. health care system, wound care stands out as an area where standards can vary significantly. The inconsistency in wound care standards in the United States can be traced to several factors. These include limited structured clinical wound care education, the discretion of health care providers in different business environments, differences in wound care settings, varying access to advanced treatments and technology, patient demographics and socioeconomic status, as well as differences in state laws and regional or institutional practices. Addressing these disparities requires a comprehensive approach that considers the complex interplay of the abovementioned factors. Active measures are needed to improve access, equity, and the quality of wound care services for all patients, regardless of where they live, their socioeconomic status, their health care coverage, or the business interests of providers and their institutions as well as of vendors marketing wound care products inconsistent with evidence-based practice. By understanding and actively addressing these factors, we can work toward achieving more standardized, evidence-based, and patient-centered practices in wound care across the nation.

Decision theoretical foundations of clinical practice guidelines: an extension of the ASH thrombophilia guidelines

ABSTRACT

Decision analysis can play an essential role in informing practice guidelines. The American Society of Hematology (ASH) thrombophilia guidelines have made a significant step forward in demonstrating how decision modeling integrated within Grading of Recommendations Assessment, Developing, and Evaluation (GRADE) methodology can advance the field of guideline development. Although the ASH model was transparent and understandable, it does, however, suffer from certain limitations that may have generated potentially wrong recommendations. That is, the panel considered 2 models separately: after 3 to 6 months of index venous thromboembolism (VTE), the panel compared thrombophilia testing (A) vs discontinuing anticoagulants (B) and testing (A) vs recommending indefinite anticoagulation to all patients (C), instead of considering all relevant options simultaneously (A vs B vs C). Our study aimed to avoid what we refer to as the omitted choice bias by integrating 2 ASH models into a single unifying threshold decision model. We analyzed 6 ASH panel's recommendations related to the testing for thrombophilia in settings of "provoked" vs "unprovoked" VTE and low vs high bleeding risk (total 12 recommendations). Our model disagreed with the ASH guideline panels' recommendations in 4 of the 12 recommendations we considered. Considering all 3 options simultaneously, our model provided results that would have produced sounder recommendations for patient care. By revisiting the ASH guidelines methodology, we have not only improved the recommendations for thrombophilia but also provided a method that can be easily applied to other clinical problems and promises to improve the current guidelines' methodology.

High certainty evidence is stable and trustworthy, whereas evidence of moderate or lower certainty may be equally prone to being unstable

OBJECTIVES

To assess to what extent the overall quality of evidence indicates changes to observe intervention effect estimates when new data become available.

METHODS

We conducted a meta-epidemiological study. We obtained evidence from meta-analyses of randomized trials of Cochrane reviews addressing the same health-care question that was updated with inclusion of additional data between January 2016 and May 2021. We extracted the reported effect estimates with 95% confidence intervals (CIs) from meta-analyses and corresponding GRADE (Grading of Recommendations Assessment, Development, and Evaluation) assessments of any intervention comparison for the primary outcome in the first and the last updated review version. We considered the reported overall quality (certainty) of evidence (CoE) and specific evidence limitations (no, serious or very serious for risk of bias, imprecision, inconsistency, and/or indirectness). We assessed the change in pooled effect estimates between the original and updated evidence using the ratio of odds ratio (ROR), absolute ratio of odds ratio (aROR), ratio of standard errors (RoSE), direction of effects, and level of statistical significance.

RESULTS

High CoE without limitations characterized 19.3% (n = 29) out of 150 included original Cochrane reviews. The update with additional data did not systematically change the effect estimates (mean ROR 1.00; 95% CI 0.99-1.02), which deviated 1.06-fold from the older estimates (median aROR; interquartile range [IQR]: 1.01-1.15), gained precision (median RoSE 0.87; IQR 0.76-1.00), and maintained the same direction with the same level of statistical significance in 93% (27 of 29) of cases. Lower CoE with limitations characterized 121 original reviews and graded as moderate CoE in 30.0% (45 of 150), low CoE in 32.0% (48 of 150), and very low CoE in 18.7% (28 of 150) reviews. Their update had larger absolute deviations (median aROR 1.12 to 1.33) and larger gains in precision (median RoSE 0.78-0.86) without clear and consistent differences between these categories of CoE. Changes in effect direction or statistical significance were also more common in the lower quality evidence, again with a similar extent across categories (without change in 75.6%, 64.6%, and 75.0% for moderate, low, very low CoE). As limitations increased, effect estimates deviated more (aROR 1.05 with zero, 1.11 with one, 1.25 with two, 1.24 with three limitations) and changes in direction or significance became more frequent (93.2% stable with no limitations, 74.5% with one, 68.2% with two, and 61.5% with three limitations).

CONCLUSION

High-quality evidence without methodological deficiencies is trustworthy and stable, providing reliable intervention effect estimates when updated with new data. Evidence of moderate and lower quality may be equally prone to being unstable and cannot indicate if available effect estimates are true, exaggerated, or underestimated.

Converting IMPROVE bleeding and VTE risk assessment models into a fast-and-frugal decision tree for optimal hospital VTE prophylaxis

ABSTRACT

Current hospital venous thromboembolism (VTE) prophylaxis for medical patients is characterized by both underuse and overuse. The American Society of Hematology (ASH) has endorsed the use of risk assessment models (RAMs) as an approach to individualize VTE prophylaxis by balancing overuse (excessive risk of bleeding) and underuse (risk of avoidable VTE). ASH has endorsed IMPROVE (International Medical Prevention Registry on Venous Thromboembolism) risk assessment models, the only RAMs to assess short-term bleeding and VTE risk in acutely ill medical inpatients. ASH, however, notes that no RAMs have been thoroughly analyzed for their effect on patient outcomes. We aimed to validate the IMPROVE models and adapt them into a simple, fast-and-frugal (FFT) decision tree to evaluate the impact of VTE prevention on health outcomes and costs. We used 3 methods: the "best evidence" from ASH guidelines, a "learning health system paradigm" combining guideline and real-world data from the Medical University of South Carolina (MUSC), and a "real-world data" approach based solely on MUSC data retrospectively extracted from electronic records. We found that the most effective VTE prevention strategy used the FFT decision tree based on an IMPROVE VTE score of ≥2 or ≥4 and a bleeding score of <7. This method could prevent 45% of unnecessary treatments, saving ∼$5 million annually for patients such as the MUSC cohort. We recommend integrating IMPROVE models into hospital electronic medical records as a point-of-care tool, thereby enhancing VTE prevention in hospitalized medical patients.

Unravelling clinicians' shared decision-making adoption: a qualitative exploration through the lens of diffusion of innovations theory

OBJECTIVES

This study uses the diffusion of innovations (DOI) theory to comprehensively understand the adoption of shared decision-making (SDM) in clinical practice, specifically focusing on the 'knowledge' and 'persuasion' stages within DOI. We aim to understand the challenges and dynamics associated with SDM adoption, offering insights for more patient-centred decision-making in healthcare.

DESIGN

This qualitative study employs a modified framework analysis approach, integrating ethnographic and interview data from prior research, along with additional interviews. The framework used is based on the DOI theory.

STUDY SETTING AND PARTICIPANTS

This study was conducted in the obstetrics and gynaecology department of a tertiary teaching hospital in the Eastern region of the Netherlands. It included interviews with 20 participants, including gynaecologists, obstetrics registrars and junior doctors currently practising in the department. Additionally, data from prior research conducted within the same department were incorporated, ensuring the maintenance of contextual consistency.

RESULTS

Findings reveal a complex interplay between SDM's benefits and challenges. Clinicians value SDM for upholding patient autonomy and enhancing medical practice, viewing it as valuable for medical decision-making. Decision aids are seen as advantageous in supporting treatment decisions. Challenges include compatibility issues between patient and clinician preferences, perceptions of SDM as time-consuming and difficult and limitations imposed by the rapid pace of healthcare and its swift decisions. Additionally, perceived complexity varies by situation, influenced by colleagues' attitudes, with limited trialability and sparsely observed instances of SDM.

CONCLUSIONS

Clinicians' decision to adopt or reject SDM is multifaceted, shaped by beliefs, cognitive processes and contextual challenges. Cognitive dissonance is critical as clinicians reconcile their existing practices with the adoption of SDM. Practical strategies such as practice assessments, open discussions about SDM's utility and reflective practice through professional development initiatives empower clinicians to make the best informed decision to adopt or reject SDM.

Did pediatric drug development advance epilepsy treatment in young patients? It is time for new research goals

Modern drugs have changed epilepsy, which affects people of all ages. However, for young people with epilepsy, the framework of drug development has stalled. In the wake of the thalidomide catastrophe, the misconception emerged that for people < 18 years of age drugs, including antiseizure medications (ASMs), need separate proof of efficacy and safety, overall called "pediatric drug development". For ASMs, this has changed to some degree. Authorities now accept that ASMs are effective in < 18 years as well, but they still require "extrapolation of efficacy," as if minors were another species. As a result, some of the pediatric clinical epilepsy research over the past decades was unnecessary. Even more importantly, this has hampered research on meaningful research goals. We do not need to confirm that ASMs work before as they do after the 18th birthday. Instead, we need to learn how to prevent brain damage in young patients by preventing seizures and optimize ASMs' uses. Herein we discuss how to proceed in this endeavor.

Artificial intelligence in healthcare: an Italian perspective on ethical and medico-legal implications

Artificial intelligence (AI) is a multidisciplinary field intersecting computer science, cognitive science, and other disciplines, able to address the creation of systems that perform tasks generally requiring human intelligence. It consists of algorithms and computational methods that allow machines to learn from data, make decisions, and perform complex tasks, aiming to develop an intelligent system that can work independently or collaboratively with humans. Since AI technologies may help physicians in life-threatening disease prevention and diagnosis and make treatment smart and more targeted, they are spreading in health services. Indeed, humans and machines have unique strengths and weaknesses and can complement each other in providing and optimizing healthcare. However, the healthcare implementation of these technologies is related to emerging ethical and deontological issues regarding the fearsome reduction of doctors' decision-making autonomy and acting discretion, generally strongly conditioned by cognitive elements concerning the specific clinical case. Moreover, this new operational dimension also modifies the usual allocation system of responsibilities in case of adverse events due to healthcare malpractice, thus probably imposing a redefinition of the established medico-legal assessment criteria of medical professional liability. This article outlines the new challenges arising from AI healthcare integration and the possible ways to overcome them, with a focus on Italian legal framework. In this evolving and transitional context emerges the need to balance the human dimension with the artificial one, without mutual exclusion, for a new concept of medicine "with" machines and not "of" machines.

Axicabtagene Ciloleucel versus Tisagenlecleucel for Relapsed or Refractory Large B Cell Lymphoma: A Systematic Review and Meta-Analysis

Axicabtagene ciloleucel (axi-cel) and tisagenlecleucel (tisa-cel) are CD19-directed chimeric antigen receptor T cell (CAR-T) therapies approved for relapsed/refractory aggressive large B cell lymphoma (LBCL). Significant costs and complex manufacturing underscore the importance of evidence-based counseling regarding the outcomes of these treatments. With the aim of examining the efficacy and safety of axi-cel versus tisa-cel in patients with relapsed/refractory aggressive LBCL, we performed a systematic literature search of comparative studies evaluating outcomes in relapsed/refractory aggressive LBCL after treatment with axi-cel or tisa-cel. We calculated odds ratios (ORs) and 95% confidence intervals (CIs) for response, progression-free survival (PFS), overall survival (OS), cytokine release syndrome (CRS), immune effector cell-associated neurotoxicity syndrome (ICANS), and hematotoxicity. Meta-analysis and meta-regression were used to generate summary statistics. A total of 2372 participants were included in the 8 studies in our analysis. The dropout rate between apheresis and infusion was 13% for axi-cel versus 18% for tisa-cel, and the median time from apheresis to infusion was 32 days versus 45 days. Axi-cel showed higher odds for a complete response (OR, 1.65; P < .001) and was associated with higher odds for PFS at 1 year after infusion (OR, .60; P < .001). OS appeared to be improved with axi-cel (OR, .84; 95% CI, .68 to 1.02; P = .08), whereas the cumulative incidence of nonrelapse mortality (NRM) was 11.5% for axi-cel versus 3.7% for tisa-cel (P = .002). The main predictors for survival were lactate dehydrogenase level, Eastern Cooperative Oncology Group Performance Status, and response to bridging, and axi-cel maintained superior efficacy even in elderly patients. In terms of safety, axi-cel was associated with significantly higher odds of any-grade CRS (OR, 3.23; P < .001), but not of grade ≥3 CRS (P = .92). Axi-cel was associated with significantly higher odds of severe ICANS grade ≥3 (OR, 4.03; P < .001). In terms of hematotoxicity, axi-cel was significantly associated with higher odds of severe neutropenia at 1 month after infusion (OR, 2.06; P = .003). As a result, axi-cel was associated with significantly greater resource utilization, including prolonged hospital stay, more frequent intensive care admission, and use of agents such as tocilizumab for toxicity management. We provide strong evidence of the greater efficacy of axi-cel versus tisa-cel in relapsed/refractory aggressive LBCL. The higher toxicity and NRM seen with axi-cel might not counterbalance the overall results, highlighting the need for timely intervention and careful selection of patients, balancing resource utilization and clinical benefit.

Methodological proposals for developing trustworthy recommendations of integrative Chinese-Western medicine

Background

To refine the methods of developing clinical practice guidelines (CPGs) for integrative Chinese-Western medicine (ICWM), promoting the formation of trustworthy, implementable recommendations that integrate the strengths of Chinese and Western medicine.

Methods

Using a nominal group technique (NGT) approach, a multidisciplinary expert panel was established. The panel identified key methodological issues in ICWM-CPG development through literature review and iterative discussions, and formulated methodological proposals to address these issues. The final set of proposals was achieved through consensus among the panel members.

Results

The collaborative effort resulted in the identification of five pivotal methodological issues and the subsequent establishment of 22 specific recommendations. These encompass strict adherence to renowned standards, such as those proposed by the Institute of Medicine (IOM) and Guidelines International Network (G-I-N), the employment of methodologies like the GRADE approach and RIGHT statement, the strategic constitution of a balanced development group, the adept identification of ICWM-focused clinical inquiries, the nuanced integration of diverse evidence sources, and the detailed crafting of transparent, implementable recommendations.

Conclusions

This study concentrates on the most crucial and prevalent methodological issues in ICWM-CPG development, proposing a series of recommendations. These suggestions result from a multidisciplinary expert consensus, aiming to provide methodological guidance for ICWM-CPG developers, building upon the current foundational methodologies.

Quality analysis of the clinical practice guidelines for management of impacted maxillary central incisors: a systematic review

PURPOSE

To assess the quality of clinical practice guidelines (CPG) for management of impacted central incisors.

METHODS

Search was performed in PubMed, LILACS, Web of Science, EMBASE, Scopus, and Cochrane databases, and guideline-focused databases/repositories on 15-09-2022 without any limitations and was updated on 15-07-2023. Grey literature search was also performed. Two independent reviewers were involved in the study selection and data extraction. Quality assessment of the included CPG was performed by four independent appraisers using the AGREE-II instrument. The degree of agreement among the appraisers was calculated using the intraclass correlation coefficient (ICC).

RESULTS

Five CPG were included in the review. The Ministry of Health, Malaysia (MHM) guideline obtained the highest scores in all six domains of AGREE-II and an overall score of 73% demonstrating the "highest" quality. The remaining four guidelines obtained overall "low-quality" scores ranging from 34.57-37.52%. The ICC scores ranged from 0.530 to 0.990 for various domains of AGREE-II.

CONCLUSION

MHM guidelines demonstrated high-quality scores in domains of 'scope and purpose', 'clarity of presentation', 'applicability domain', and 'editorial independence', while others were found to have moderate or low quality. This review identified areas that can be addressed by future guideline developers to avoid these discrepancies.

Systematic overview of intraosseous access versus intravenous delivery for emergency resuscitation: Efficacy and quality of existing evidence

BACKGROUND

The impact of intraosseous (IO) access on resuscitation outcomes, as compared to intravenous (IV) administration, is subject to ongoing debate. This review aims to provide a comprehensive evaluation of the methodological, reporting, and evidence quality of existing Systematic Reviews/Meta-Analyses (SRs/MAs) on IO use during resuscitation.

METHODS

Following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines, we conducted a strategic literature search to identify pertinent SRs/MAs published up until May 6th, 2023. After an extensive screening process, 4 SRs/MAs were included for review. We used the A Measurement Tool to Assess Systematic Reviews-2 tool for assessing methodological quality, the Preferred Reporting Items for Systematic Reviews and Meta-Analyses checklist for evaluating reporting quality, and the Grading of Recommendations Assessment, Development, and Evaluation framework for examining the quality of evidence.

RESULTS

The assessment revealed high methodological quality across all the included SRs/MAs but showed significant variability in the quality of evidence. The studies offered conflicting findings on the impact of IO access on resuscitation outcomes such as return of spontaneous circulation, survival rates at hospital discharge, and favorable neurological outcomes. Some studies suggested an association of IO access with poorer outcomes, while others indicated no significant difference between IO and IV routes.

CONCLUSIONS

Despite the perceived utility of IO access when IV access is unachievable, the impact of IO on survival, return of spontaneous circulation, and neurological outcomes remains ambiguous due to the inconsistency in the existing evidence. This review underscores the critical need for more rigorous and consistent primary research in this area to strengthen clinical guidelines and improve patient outcomes.

The effect of education regarding treatment guidelines for schizophrenia and major depressive disorders on psychiatrists' hypnotic medication prescribing behavior: a multicenter study

BACKGROUND

To examine whether the "Effectiveness of Guideline for Dissemination and Education in psychiatric treatment (EGIUDE)" project affects the rate of prescriptions of hypnotic medication and the type of hypnotic medications prescribed among psychiatrists, for schizophrenia and major depressive disorder in Japan.

METHODS

The EGUIDE project is a nationwide prospective study of evidence-based clinical guidelines for schizophrenia and major depressive disorder in Japan. From 2016 to 2021, clinical and prescribing data from patients discharged from hospitals participating in the EGUIDE project were used to examine hypnotic medication prescriptions The prescribing rate of hypnotics and the prescribing rate of each type of hypnotic (benzodiazepine receptor agonist, nonbenzodiazepine receptor agonist, melatonin receptor agonist, and orexin receptor antagonist) were compared among patients who had been prescribed medication by psychiatrists participating in the EGUIDE project and patients who had been prescribed medication by nonparticipating psychiatrists. Multivariate logistic regression analysis was performed to examine the effect of the EGUIDE project on the prescription of hypnotic medications.

RESULTS

A total of 12,161 patients with schizophrenia and 6,167 patients with major depressive disorder were included. Psychiatrists participating in the EGUIDE project significantly reduced the rate of prescribing hypnotic medication and benzodiazepine receptor agonists for both schizophrenia (P < 0.001) and major depressive disorder (P < 0.001) patients.

CONCLUSION

This is the first study to investigate the educational effects of guidelines for the treatment of psychiatric disorders on psychiatrists in terms of prescribing hypnotic medications to patients. The EGUIDE project may play an important role in reducing hypnotic medication prescription rates, particularly with respect to benzodiazepine receptor agonists. The results suggest that the EGUIDE project may result in improved therapeutic behavior.

Scientific approach, attitudes, and perspectives on research among Swedish physiotherapy students-a cross-sectional study

BACKGROUND

Scientific evidence is important to evidence-based practice. Hence, the application of evidence-based practice requires relevant skills and an understanding of science, which therefore need to be learned and trained during the undergraduate program in physiotherapy. The aim of this study was to investigate attitudes, perceived competence, and conditions for a scientific approach among physiotherapy students in Sweden, and to compare attitudes and perceived competence between students in different program years.

METHODS

Physiotherapy students from six universities (n = 1499) were invited to respond to a digital survey. The survey contained questions regarding attitudes toward science, perceived competence in research interpretations and open comments regarding requirements for a strengthened scientific approach during education. Comparisons between education years were performed with ANOVA/Kruskal‒Wallis test (scale outcomes) and logistic regression (binary outcomes).

RESULTS

A total of 466 students responded to the survey. In total, 57% (n = 266) of the students had a high interest in science. No significant difference in interest in science was found between students in the three program years, but 75% (n = 347) reported increased interest during the program. A perceived high ability to understand the structure and performance of scientific studies was reported by 31% (n = 144), to evaluate the methodology by 16% (n = 72) and to interpret statistical results from scientific studies by 12% (n = 55). The lowest perceived competence was reported among students in their second year (p < 0.05). A majority of the students (88%; n = 410) reported a perceived personal need for strengthened conditions for a scientific approach, with suggested prerequisites during education via increased theoretical and applied understanding of the research.

CONCLUSION

Even though this study does not fully cover physiotherapy students at all undergraduate programmes in Sweden, the results support that a scientific approach and training should be strengthened during education to enable physiotherapists to understand and interpret science and to fully apply an evidence-based approach in upcoming clinical practice. Both theoretical and applied knowledge and understanding are needed.

Assessing the Risk of Bias in Randomized Clinical Trials With Large Language Models

Importance

Large language models (LLMs) may facilitate the labor-intensive process of systematic reviews. However, the exact methods and reliability remain uncertain.

Objective

To explore the feasibility and reliability of using LLMs to assess risk of bias (ROB) in randomized clinical trials (RCTs).

Design, Setting, and Participants

A survey study was conducted between August 10, 2023, and October 30, 2023. Thirty RCTs were selected from published systematic reviews.

Main Outcomes and Measures

A structured prompt was developed to guide ChatGPT (LLM 1) and Claude (LLM 2) in assessing the ROB in these RCTs using a modified version of the Cochrane ROB tool developed by the CLARITY group at McMaster University. Each RCT was assessed twice by both models, and the results were documented. The results were compared with an assessment by 3 experts, which was considered a criterion standard. Correct assessment rates, sensitivity, specificity, and F1 scores were calculated to reflect accuracy, both overall and for each domain of the Cochrane ROB tool; consistent assessment rates and Cohen κ were calculated to gauge consistency; and assessment time was calculated to measure efficiency. Performance between the 2 models was compared using risk differences.

Results

Both models demonstrated high correct assessment rates. LLM 1 reached a mean correct assessment rate of 84.5% (95% CI, 81.5%-87.3%), and LLM 2 reached a significantly higher rate of 89.5% (95% CI, 87.0%-91.8%). The risk difference between the 2 models was 0.05 (95% CI, 0.01-0.09). In most domains, domain-specific correct rates were around 80% to 90%; however, sensitivity below 0.80 was observed in domains 1 (random sequence generation), 2 (allocation concealment), and 6 (other concerns). Domains 4 (missing outcome data), 5 (selective outcome reporting), and 6 had F1 scores below 0.50. The consistent rates between the 2 assessments were 84.0% for LLM 1 and 87.3% for LLM 2. LLM 1's κ exceeded 0.80 in 7 and LLM 2's in 8 domains. The mean (SD) time needed for assessment was 77 (16) seconds for LLM 1 and 53 (12) seconds for LLM 2.

Conclusions

In this survey study of applying LLMs for ROB assessment, LLM 1 and LLM 2 demonstrated substantial accuracy and consistency in evaluating RCTs, suggesting their potential as supportive tools in systematic review processes.

Quality appraisal of clinical guidelines for Helicobacter pylori infection and systematic analysis of the level of evidence for recommendations

OBJECTIVES

To systematically assess the quality of clinical practice guidelines (CPGs) for Helicobacter pylori (HP) infection and identify gaps that limit their development.

STUDY DESIGN AND SETTING

CPGs for HP infection were systematically collected from PubMed, Embase, the Cochrane Library, the Cumulative Index to Nursing and Allied Health Literature, and six online guideline repositories. Three researchers independently used the AGREE Ⅱ tool to evaluate the methodological quality of the eligible CPGs. In addition, the reporting and recommendation qualities were appraised by using the RIGHT and AGREE-REX tools, respectively. The distribution of the level of evidence and strength of recommendation among evidence-based CPGs was determined.

RESULTS

A total of 7,019 records were identified, and 24 CPGs met the eligibility criteria. Of the eligible CPGs, 19 were evidence-based and 5 were consensus-based. The mean overall rating score of AGREE II was 50.7% (SD = 17.2%). Among six domains, the highest mean score was for scope and purpose (74.4%, SD = 17.7%) and the lowest mean score was for applicability (24.3%, SD = 8.9). Only three of 24 CPGs were high-quality. The mean overall score of recommendation quality was 35.5% (SD = 12.2%), and the mean scores in each domain of AGREE-REX and RIGHT were all ≤ 60%, with values and preferences scoring the lowest (16.6%, SD = 11.9%). A total of 505 recommendations were identified. Strong recommendations accounted for 64.1%, and only 34.3% of strong recommendations were based on high-quality evidence.

CONCLUSION

The overall quality of CPGs for HP infection is poor, and CPG developers tend to neglect some domains, resulting in a wide variability in the quality of the CPGs. Additionally, CPGs for HP infection lack sufficient high-quality evidence, and the grading of recommendation strength should be based on the quality of evidence. The CPGs for HP infection have much room for improvement and further researches are required to minimize the evidence gap.

Vitamin D Supplementation for Patients with Dysmenorrhoea: A Meta-Analysis with Trial Sequential Analysis of Randomised Controlled Trials

Vitamin D reduces prostaglandin levels and inflammation, making it a promising treatment option for dysmenorrhoea. However, its effects on pain intensity in different types of dysmenorrhoea remain unclear. We examined whether vitamin D supplementation decreases pain intensity in patients with dysmenorrhoea. The Cochrane Library, Embase, Google Scholar, Medline, and Scopus databases were searched from inception to 30 December 2023. Randomised controlled trials (RCTs) evaluating vitamin D supplementation effects on such patients were included. The primary and secondary outcomes were measured by the changes in pain intensity and rescue analgesic use, respectively. Pooled mean differences and rate ratios were calculated using a random-effect model; trial sequential analysis (TSA) was also performed. Overall, 11 studies involving 687 participants were included. Vitamin D supplementation significantly decreased pain intensity in patients with dysmenorrhoea compared with controls (pooled mean difference, -1.64; 95% confidence interval, -2.27 to -1.00; p < 0.001; CoE, moderate; I2 statistic, 79.43%) and indicated substantial heterogeneity among the included studies. TSA revealed that the current RCTs provide sufficient information. In subgroup analyses, vitamin D supplement reduced primary dysmenorrhoea pain but not secondary dysmenorrhoea pain. In conclusion, although substantial heterogeneity persists, vitamin D supplementation decreased pain intensity in patients with dysmenorrhea, especially in those with primary dysmenorrhoea.

Collaborative sustainability planning for an outcome measure in outpatient stroke rehabilitation: A qualitative description study

RATIONALE

Evidence suggests that sustainability planning and the use of a collaborative approach to planning result in better sustainability outcomes and more relevant knowledge. Yet, both approaches appear to be underutilized. A detailed description of collaborative sustainability planning may encourage the use of these two impactful strategies.

AIMS AND OBJECTIVES

To explore the collaborative sustainability planning process for a single outcome measure in three rehabilitation sites.

METHODOLOGY

Within the Mayo-Portland Adaptability Inventory-version 4 (MPAI-4) implementation project, we conducted a qualitative description study. We used data from 12 core sustainability planning meetings and 108 follow-up meetings that included a total of 31 clinical and research team participants. Sustainability planning was informed by an MPAI-4-specific implementation guide, and by the results from a realist review of the sustainability of rehabilitation practices and the Clinical Sustainability Assessment Tool. We analyzed qualitative data using thematic content analysis.

RESULTS

Three themes describe the collaborative sustainability planning process: (1) "collaboration as a driver for sustainability" which captures the active collaboration underpinning sustainability planning; (2) "co-creation of a sustainability plan to achieve shared objectives" which captures the identified barriers and facilitators, and selected sustainability strategies linked to one of six collaboratively identified shared objectives; and (3) "the iterative nature of sustainability planning" which captures the necessity of an agile and responsive sustainability planning process.

CONCLUSION

Identified strategies may be useful to support (collaborative) sustainment. Future research could investigate the effect of collaborative sustainability planning on sustainability objectives, and the relationship between these objectives.

Reporting guidelines for traditional Chinese medicine could be improved: a cross-sectional study

OBJECTIVES

The aim of this study is to identify available reporting guidelines for traditional Chinese medicine (TCM), delineate their fundamental characteristics, assess the scientific rigor of their development process, and evaluate their dissemination.

STUDY DESIGN AND SETTING

A search was conducted in Medline (via PubMed), China National Knowledge Infrastructure (CNKI), SinoMed, WANFANG DATA, and the EQUATOR Network to identify TCM reporting guidelines. A preprepared Excel database was used to extract information on the basic characteristics, development process, and dissemination information. The development process quality of TCM reporting guidelines was assessed by evaluating their compliance with the Guidance for Developers of Health Research Reporting Guidelines (GDHRRG). The extent of dissemination of these guidelines was analyzed by examining the number of citations received.

RESULTS

A total of 26 reporting guidelines for TCM were obtained from 20 academic journals, with 61.5% of them published in English journals. Among the guidelines, 14 (53.8%) were registered in the EQUATOR Network. On average, the compliance rate of GDHRRG guidelines was reported to be 63.3% ranging from 22.2% to 94.4%. Three steps showed poor compliance, namely guideline endorsement (23.1%), translated guidelines (19.2%), and developing a publication strategy (19.2%). Furthermore, the compliance rate of GDHRRG guidelines published in English journals was higher than that in Chinese journals. In terms of the dissemination, 15.4% of the guidelines had been cited over 100 times, while 73.1% had been cited less than 50 times.

CONCLUSION

The development of TCM reporting guidelines still has limitations in terms of regarding scientific rigor and follow-up dissemination. Therefore, it is important to ensure adherence to the scientific process in the development of TCM reporting guidelines and to strengthen their promotion, dissemination, and implementation.

A Guide to an Iterative Approach to Model-Based Decision Making in Health and Medicine: An Iterative Decision-Making Framework

Decision makers frequently face decisions about optimal resource allocation. A model-based economic evaluation can be used to guide decision makers in their choices by systematically evaluating the magnitude of expected health effects and costs of decision options and by making trade-offs explicit. We provide a guide to an iterative approach to the medical decision-making process by following a coherent framework, and outline the overarching iterative steps of model-based decision making. We systematized the framework by performing three steps. First, we compiled the existing guidelines provided by the ISPOR-SMDM Modeling Good Research Practices Task Force, and the ISPOR Value of Information Task Force. Second, we identified other previous work related to frameworks and guidelines for model-based decision analyses through a literature search in PubMed. Third, we assessed the role of the evidence and iterative process in decision making and formalized key steps in a model-based decision-making framework. We provide guidance on an iterative approach to medical decision making by applying the compiled iterative model-based decision-making framework. The framework formally combines the decision problem conceptualization (Part I), the model conceptualization and development (Part II), and the process of model-based decision analysis (Part III). Following the overarching steps of the framework ensures compliance to the principles of evidence-based medicine and regular updates of the evidence, given that value of information analysis represents an essential component of model-based decision analysis in the framework. Following the provided guide and the steps outlined in the framework can help inform various health care decisions, and therefore it has the potential to improve decision making.

Improving methods of clinical practice guidelines: From guidelines to pathways to fast-and-frugal trees and decision analysis to develop individualised patient care

BACKGROUND

Current methods for developing clinical practice guidelines have several limitations: they are characterised by the "black box" operation-a process with defined inputs and outputs but an incomplete understanding of its internal workings; they have "the integration problem"-a lack of framework for explicitly integrating factors such as patient preferences and trade-offs between benefits and harms; they generate one recommendation at a time that typically are not connected in a coherent analytical framework; and they apply to "average" patients, while clinicians and their patients seek advice tailored to individual circumstances.

METHODS

We propose augmenting the current guideline development method by converting evidence-based pathways into fast-and-frugal decision trees (FFTs) and integrating them with generalised decision curve analysis to formulate clear, individualised management recommendations.

RESULTS

We illustrate the process by developing recommendations for the management of heparin-induced thrombocytopenia (HIT). We converted evidence-based pathways for HIT, developed by the American Society of Hematology, into an FFT. Here, we consider only thrombotic complications and major bleeding. We leveraged the predictive potential of FFTs to compare the effects of argatroban, bivalirudin, fondaparinux, and direct oral anticoagulants (DOACs) using generalised decision curve analysis. We found that DOACs were superior to other treatments if the FFT-predicted probability of HIT exceeded 3%.

CONCLUSIONS

The proposed analytical framework connects guidelines, pathways, FFTs, and decision analysis, offering risk-tailored personalised recommendations and addressing current guideline development critiques.

Moving toward the Development and Effective Implementation of High-Quality Guidelines in Pediatric Surgery: A Review of the Literature

Applying evidence-based guidelines can enhance the quality of patient care. While robust guideline development methodology ensures credibility and validity, methodological variations can impact guideline quality. Besides methodological rigor, effective implementation is crucial for achieving improved health outcomes. This review provides an overview of recent literature pertaining to the development and implementation of guidelines in pediatric surgery. Literature was reviewed to provide an overview of sound guideline development methodologies and approaches to promote effective guideline implementation. Challenges specific to pediatric surgery were highlighted. A search was performed to identify published guidelines relevant to pediatric surgery from 2018 to June 2023, and their quality was collectively appraised using the AGREE II instrument. High-quality guideline development can be promoted by using methodologically sound tools such as the Guidelines 2.0 checklist, the GRADE system, and the AGREE II instrument. While implementation can be promoted during guideline development and post-publication, its effectiveness may be influenced by various factors. Challenges pertinent to pediatric surgery, such as limited evidence and difficulties with outcome selection and heterogeneity, may impact guideline quality and effective implementation. Fifteen guidelines were identified and collectively appraised as suboptimal, with a mean overall AGREE II score of 58%, with applicability being the lowest scoring domain. There are identified challenges and barriers to the development and effective implementation of high-quality guidelines in pediatric surgery. It is valuable to prioritize the identification of adapted, innovative methodological strategies and the use of implementation science to understand and achieve effective guideline implementation.

Does the format of result presentation and type of conclusion in Cochrane plain language summaries matter? A randomised controlled trial

OBJECTIVES

This study aimed to investigate whether the format and type of conclusion in Cochrane plain language summaries (PLSs) influence readers' perception of treatment benefit and decision-making.

DESIGN

An online parallel group, three-arm randomised controlled trial was conducted.

SETTING

The study was conducted online.

PARTICIPANTS

The participants were physiotherapy students.

INTERVENTIONS

The participants read two Cochrane PLSs, one with a positive conclusion (strong evidence of benefit) and another with a negative conclusion (strong evidence of non-benefit). Each participant read the results of both reviews presented in one of three formats: (1) numerical, (2) textual or (3) numerical and textual.

MAIN OUTCOME MEASURES

The primary outcome measure was the participants' perception of treatment benefit.

RESULTS

All three groups of participants perceived the treatment to have positive effects when the Cochrane PLS had a positive conclusion, regardless of the format of presentation (mean perception of treatment benefit score: textual 7.7 (SD 2.3), numerical 7.9 (SD 1.8), numerical and textual 7.7 (SD 1.7), p=0.362). However, when the Cochrane PLS had a negative conclusion, all three groups of participants failed to perceive a negative effect (mean perception of treatment benefit score: textual 5.5 (SD 3.3), numerical 5.6 (SD 2.7), numerical and textual 5.9 (SD 2.8), p=0.019).

CONCLUSIONS

The format of Cochrane PLSs does not appear to significantly impact physiotherapy students' perception of treatment benefit, understanding of evidence, persuasiveness or confidence in their decision. However, participants' perception of treatment benefit does not align with the conclusion when the Cochrane PLS indicates strong evidence of non-benefit from the intervention.

TRIAL REGISTRATION NUMBER

CTRI/2022/10/046476.

Just give the contrast? Appraisal of guidelines on intravenous iodinated contrast media use in patients with kidney disease

OBJECTIVE

To appraise the quality of guidelines on intravenous iodinated contrast media (ICM) use in patients with kidney disease, and to compare the recommendations among them.

METHODS

We searched four literature databases, eight guideline libraries, and ten homepages of radiological societies to identify English and Chinese guidelines on intravenous ICM use in patients with kidney disease published between January 2018 and June 2023. The quality of the guidelines was assessed with the Scientific, Transparent, and Applicable Rankings (STAR) tool.

RESULTS

Ten guidelines were included, with a median STAR score of 46.0 (range 28.5-61.5). The guidelines performed well in "Recommendations" domain (31/40, 78%), while poor in "Registry" (0/20, 0%) and "Protocol" domains (0/20, 0%). Nine guidelines recommended estimated glomerular filtration rate (eGFR) < 30 mL/min/1.73 m2 as the cutoff for referring patients to discuss the risk-benefit balance of ICM administration. Three guidelines further suggested that patients with an eGFR < 45 mL/min/1.73 m2 and high-risk factors also need referring. Variable recommendations were seen in the acceptable time interval between renal function test and ICM administration, and that between scan and repeated scan. Nine guidelines recommended to use iso-osmolar or low-osmolar ICM, while no consensus has been reached for the dosing of ICM. Nine guidelines supported hydration after ICM use, but their protocols varied. Drugs or blood purification therapy were not recommended as preventative means.

CONCLUSION

Guidelines on intravenous ICM use in patients with kidney disease have heterogeneous quality. The scientific societies may consider joint statements on controversial recommendations for variable timing and protocols.

CRITICAL RELEVANCE STATEMENT

The heterogeneous quality of guidelines, and their controversial recommendations, leave gaps in workflow timing, dosing, and post-administration hydration protocols of contrast-enhanced CT scans for patients with kidney diseases, calling for more evidence to establish a safer and more practicable workflow.

KEY POINTS

• Guidelines concerning iodinated contrast media use in kidney disease patients vary. • Controversy remains in workflow timing, contrast dosing, and post-administration hydration protocols. • Investigations are encouraged to establish a safer iodinated contrast media use workflow.

Competency in evidence-based medicine and associated factors among medical radiology technologists in Addis Ababa, Ethiopia

INTRODUCTION

Evidence-based medicine integrates clinical expertise, patient values and best research evidence in clinical decision-making. This study aimed to assess evidence-based medicine knowledge, attitudes, practices and associated factors among medical radiology technologists in Addis Ababa, Ethiopia.

METHODS

A cross-sectional study was conducted among 392 medical radiology technologists from May to August 2022 using a self-administered questionnaire. Bivariate and multivariate logistic regression identified factors associated with evidence-based medicine practice.

RESULTS

Most medical radiology technologists (57.7%) had moderate evidence-based medicine knowledge and 94.9% had favourable attitudes. However, 64.8% demonstrated poor evidence-based medicine practice. Factors significantly associated with better evidence-based medicine practice were moderate knowledge (AOR 1.949, 95% CI 1.155-3.291), good statistical understanding (AOR 1.824, 95% CI 1.135-2.930), sufficient time for evidence-based medicine (AOR 1.892, 95% CI 1.140-3.141), institutional support (AOR 2.093, 95% CI 1.271-3.440) and evidence-based medicine resource access (AOR 1.653, 95% CI 1.028-2.656).

CONCLUSION

Despite moderate knowledge and positive attitudes towards evidence-based medicine, most medical radiology technologists had suboptimal utilisation. Strategies to improve knowledge, ensure dedicated time, provide institutional support and resources could enhance evidence-based radiology practice.

Clinical Practice Guideline for Best Practice Management of Pediatric Patients by Chiropractors: Results of a Delphi Consensus Process

Objective: To build upon existing recommendations on best practices for chiropractic management of children by conducting a formal consensus process and best evidence synthesis. Design: Best practice guide based on recommendations from current best available evidence and formal consensus of a panel of experienced practitioners, consumers, and experts for chiropractic management of pediatric patients. Methods: Synthesis of results of a literature search to inform the development of recommendations from a multidisciplinary steering committee, including experts in pediatrics, followed by a formal Delphi panel consensus process. Results: The consensus process was conducted June to August 2022. All 60 panelists completed the process and reached at least 80% consensus on all recommendations after three Delphi rounds. Recommendations for best practices for chiropractic care for children addressed these aspects of the clinical encounter: patient communication, including informed consent; appropriate clinical history, including health habits; appropriate physical examination procedures; red flags/contraindications to chiropractic care and/or spinal manipulation; aspects of chiropractic management of pediatric patients, including infants; modifications of spinal manipulation and other manual procedures for pediatric patients; appropriate referral and comanagement; and appropriate health promotion and disease prevention practices. Conclusion: This set of recommendations represents a general framework for an evidence-informed and reasonable approach to the management of pediatric patients by chiropractors.

Evaluation of Survival Outcomes Among Black and White Patients with Metastatic Castration-resistant Prostate Cancer: A Systematic Review and Meta-analysis

Context

Data on racial disparities among patients with metastatic castration-resistant prostate cancer (mCRPC) are limited and there is no uniform conclusion on differences by race in this setting.

Objective

To provide the latest evidence on racial disparities in survival outcomes between Black and White patients receiving systemic therapies for mCRPC.

Evidence acquisition

Our study was performed according to the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) guidelines. We systematically searched the PubMed, Web of Science, and Cochrane Library databases up to September 2023 to identify potentially relevant studies. Overall survival (OS) and progression-free survival (PFS) were the outcomes of interest. Pooled hazard ratios (HRs) with 95% confidence intervals (CIs) were evaluated.

Evidence synthesis

Nine studies involving 9462 patients with mCRPC (2058 Black and 7404 White men) met the eligibility criteria and were included. Pooled estimates demonstrated significantly better OS for Black than for White men (HR 0.75, 95% CI 0.70-0.80; p < 0.0001). The results were similar in a subgroup of men receiving androgen receptor-targeted therapies (HR 0.72, 95% CI 0.66-0.78; p < 0.0001) and a subgroup of men receiving other treatments (HR 0.79, 95% CI 0.71-0.88; p < 0.0001). Likewise, significantly favorable PFS was observed for Black men receiving ARTs in comparison to their White counterparts (HR 0.84, 95% CI 0.71-0.99; p = 0.0373).

Conclusions

Overall, our meta-analysis of survival outcomes for men with mCRPC stratified by race revealed a significant survival benefit for Black men in comparison to their White counterparts, regardless of systemic therapeutic agent.

Patient summary

Both biological and nonbiological factors could account for racial differences in the efficacy of systemic treatments for metastatic prostate cancer that is resistant to hormone therapy. Our review provides the latest reliable evidence showing better survival outcomes for Black than for White men. The results will be helpful in further understanding the molecular mechanisms that might explain racial differences in this disease stage and in planning treatment.

Decision curve analysis based on summary data

BACKGROUND

To realize the potential of precision medicine, predictive models should be integrated within the framework of decision analysis, such as the decision curve analysis (DCA). To date, its application has required individual patient data (IPD) that are often unavailable. Performing DCA using aggregate data without requiring IPD may advance the goals of precision medicine.

METHODS

We present a statistical framework demonstrating that DCA can be conducted by using only the mean and standard deviation (SD) from the raw probabilities of the predictive model. We tested our theoretical framework by performing extensive simulations and comparing the aggregate-based DCA with IPD DCA. The latter was conducted using IPD from four predictive models that employed logistic regression, Cox or competing risk time-to-event modeling including (a) statins for primary prevention of cardiovascular disease (n = 4859), (b) hospice referral for terminally ill patients (n = 9104), (c) use of thromboprophylaxis for preventing venous thromboembolism in patients with cancer (n = 425) and (d) prevention of sinusoidal obstruction syndrome after hematopoietic cell transplantation (SCT) (n = 80).

RESULTS

Simulations assuming perfect calibration showed that regardless of which probability distributions informed the predictive models, the differences in DCA were negligible. Similarly, for the adequately powered models, the results of DCA based on the summary data were similar to IPD-derived DCA. The inherent instability of the predictive models, based on the smaller sample sizes, resulted in a somewhat larger discrepancy between aggregate and IPD-based DCA.

CONCLUSIONS

DCA informed by adequately powered and well-calibrated models using only summary statistical estimates (mean and SD) approximates well models using IPD. Use of aggregate data will facilitate broader integration of predictive with decision modeling toward the goals of individualized decision-making.

Treatment of primary aldosteronism: Clinical practice guidelines of the Taiwan Society of Aldosteronism

Primary aldosteronism (PA) is the most common cause of secondary hypertension and one of the few medical diseases that can be cured by surgery. Excessive aldosterone secretion is highly associated with cardiovascular complications. Many studies have shown that patients with unilateral PA treated with surgery have better survival, cardiovascular, clinical, and biochemical outcomes than those who receive medical treatment. Consequently, laparoscopic adrenalectomy is the gold standard for treating unilateral PA. Surgical methods should be individualized according to the patient's tumor size, body shape, surgical history, wound considerations, and surgeon's experience. Surgery can be performed through a transperitoneal or retroperitoneal approach, and via a single-port or multi-port laparoscopic approach. However, total or partial adrenalectomy remains controversial in treating unilateral PA. Partial excision will not completely eradicate the disease and is prone to recurrence. Mineralocorticoid receptor antagonists should be considered for patients with bilateral PA or patients who cannot undergo surgery. There are also emerging alternative interventions, including radiofrequency ablation and transarterial adrenal ablation, for which data on long-term outcomes are currently lacking. The Task Force of Taiwan Society of Aldosteronism developed these clinical practice guidelines with the aim of providing medical professionals with more updated information on the treatment of PA and improving the quality of care.

Large Language Models and Artificial Intelligence: A Primer for Plastic Surgeons on the Demonstrated and Potential Applications, Promises, and Limitations of ChatGPT

BACKGROUND

The rapidly evolving field of artificial intelligence (AI) holds great potential for plastic surgeons. ChatGPT, a recently released AI large language model (LLM), promises applications across many disciplines, including healthcare.

OBJECTIVES

The aim of this article was to provide a primer for plastic surgeons on AI, LLM, and ChatGPT, including an analysis of current demonstrated and proposed clinical applications.

METHODS

A systematic review was performed identifying medical and surgical literature on ChatGPT's proposed clinical applications. Variables assessed included applications investigated, command tasks provided, user input information, AI-emulated human skills, output validation, and reported limitations.

RESULTS

The analysis included 175 articles reporting on 13 plastic surgery applications and 116 additional clinical applications, categorized by field and purpose. Thirty-four applications within plastic surgery are thus proposed, with relevance to different target audiences, including attending plastic surgeons (n = 17, 50%), trainees/educators (n = 8, 24.0%), researchers/scholars (n = 7, 21%), and patients (n = 2, 6%). The 15 identified limitations of ChatGPT were categorized by training data, algorithm, and ethical considerations.

CONCLUSIONS

Widespread use of ChatGPT in plastic surgery will depend on rigorous research of proposed applications to validate performance and address limitations. This systemic review aims to guide research, development, and regulation to safely adopt AI in plastic surgery.

Evidence-based rehabilitation medicine: definition, foundation, practice and development

To determine the definition, foundation, practice, and development of evidence-based rehabilitation medicine (EBRM) and point out the development direction for EBRM. Retrieve the database of PubMed, Cochrane Library, Embase, China national knowledge infrastructure (CNKI), Wanfang, and China science and technology journal database (CSTJ). The search was conducted from the establishment of the database to June 2023. The key words are "rehabilitation medicine and evidence based" in Chinese and English. After reading the abstract or full text of the literature, a summary analysis is conducted to determine the definition, foundation, practice, and development of EBRM. A total of 127 articles were included. The development of 14 sub majors in EBRM are not balanced, evidence-based musculoskeletal rehabilitation medicine (EBMRM) (31 articles, mainly focuses on osteoarthritis, osteoporosis and musculoskeletal pain), evidence-based neurorehabilitation medicine (EBNM) (34 articles, mainly concentrated in stroke, traumatic brain injury and spinal cord injury) and evidence-based education rehabilitation medicine (EBEDRM) (17 articles, mainly focuses on educational methodology), evidence-based nursing rehabilitation medicine (EBNRM) (2 articles), evidence-based engineering rehabilitation medicine (EBENRM) (7 articles), evidence-based traditional Chinese rehabilitation medicine (EBTCRM) (3 articles), evidence-based internal rehabilitation medicine (EBIRM) (11 articles), evidence-based intensive care rehabilitation medicine (EBICRM) (4 articles), evidence-based oncology rehabilitation medicine (EBORM) (6 articles), evidence-based physical therapy medicine (EBPTM) (3 articles), evidence-based cardiopulmonary rehabilitation medicine (EBCRM) (6 articles), evidence-based speech therapy medicine (EBSTM)/evidence-based occupation therapy medicine (EBOTM)/evidence-based geriatric rehabilitation medicine (EBGRM) (1 article). The EBMRM, EBNM and EBEDRM are relatively well developed. The development of EBNRM, EBENRM, EBTCRM, EBIRM, EBICRM, EBGRM, EBORM, EBCRM, EBPTM, EBSTM and EBOTM is relatively slow, indicating these eleven fields should be pay more attention in future.

3D-printed and conventional provisional single crown fabrication on anterior implants: A randomized clinical trial

OBJECTIVES

The present study aims to compare provisional single crowns on anterior implants made using conventional PMMA and 3D-printed workflows. The study assessed the occurrence of failures, color variation, signs of early deterioration, operating time, and patients' satisfaction with the treatment through a randomized controlled trial.

METHODS

This study was conducted as a randomized controlled trial, following the SPIRIT and CONSORT guidelines. Patients were included in the study after meeting the eligibility criteria and were randomly assigned to one of two groups (conventional and 3D-printed). FDI criteria, visible plaque index (VPI), bleeding on probing (BOP), and color variation were considered as the primary outcomes. Operating time and patient satisfaction were also assessed as secondary outcomes. Fisher's exact test was performed to analyze the association between the primary and secondary outcomes and the study groups. Mann-Whitney test was used to compare the mean VAS satisfaction scores between the conventional PMMA and 3D-printed groups (STATA 14™, with an α = 0.05).

RESULTS

A total of 42 provisional single crowns (n = 21) were made for 33 patients. Only the fracture parameter (FDI) showed a statistically significant difference, with 3D-printed provisionals exhibiting higher rates of catastrophic failures compared to conventional ones (p = 0.05). Although the operating time for the 3D-printed group was shorter (p < 0.001), no statistical difference observed in patients' satisfaction regarding esthetics, phonetics, chewing, or comfort.

SIGNIFICANCE

3D-printed and conventional PMMA provisional single crowns showed comparable clinical performance, except for the observed fracture types. Although 3D-printed provisional restorations showed a shorter operating time, overall patients' satisfaction was not affected.

Predictors of patients' satisfaction after temporomandibular disorder treatment in a referral clinic

BACKGROUND

Evaluating patients' satisfaction after received care for temporomandibular disorders (TMD) pain provides oral health care professionals with knowledge and tools to improve their clinical procedures. However, knowledge on patient characteristics that determine satisfaction with the received care for TMD pain is lacking.

OBJECTIVE

To identify potential baseline predictors for patients' satisfaction regarding the management of TMD pain upon treatment completion in a referral clinic.

METHODS

Eligible patients, viz., individuals of ≥16 years of age, with a TMD-pain diagnosis according the diagnostic criteria for TMD (DC/TMD), and who were treated in a referral clinic, were included. As part of their standard care, a set of diagnostic questionnaires was filled in (e.g. TMD-pain screener, graded chronic pain scale (GCPS), etc.). After completion of the received care, patients filled in a custom-made questionnaire based on patient reported experience measures (PREMs) to quantify their satisfaction with their treatment results and received care. To identify potential predictors associated with patients' satisfaction, univariate and multivariate linear regression analyses were used.

RESULTS

Twenty-seven patients (mean 39.6, SD 15.0) were included in this study. Overall, the patients were satisfied with the treatment results and the received care. Depressive feelings were negatively associated with satisfaction of treatment results (p = .01) and positively associated with satisfaction of received care (p = .01), while pain intensity was negatively associated with satisfaction of the received care.

CONCLUSION

Depressive feelings are a significant negative predictor of patients' satisfaction with the treatment result for TMD pain, while average pain intensity is a significant negative predictor of patients' satisfaction with the received care.

The evolution of anesthesiology education: Embracing new technologies and teaching approaches

Background and aims

Medical education requires regular reforms to include emerging best practices and technologies, while also critically evaluating effectiveness of traditional didactic teaching methods. This manuscript examines the challenges and opportunities associated with modernizing the anesthesiology curriculum.

Methods

Narrative review of literature on innovations in medical education, with a specific emphasis on anesthesiology training.

Results

Educators face difficulties implementing new teaching approaches and evaluating their effectiveness. However, active learning methods, blended with selected traditional techniques, can enhance learner engagement and competencies. Self-directed learning and simulations prepare students for real-world practice, while flipped classrooms and online platforms increase accessibility.

Conclusions

A blended approach, integrating interactive technology alongside modified lectures and seminars, may optimize anesthesiology education. Despite the promise of improved pedagogies, further research is required to assess outcomes. By embracing innovation while retaining certain foundational methods, programs can equip anesthesiologists with modern skills. This evolution is key to meeting the needs of 21st-century anesthesia care needs. Remaining at the forefront of this transformation will be vital in preparing competent future anesthesiologists through state-of-the-art education.