Evidence-based medicine self-assessment, knowledge, and integration into daily practice: a survey among Romanian physicians and comparison between trainees and specialists

Do we really apply evidence-based-recommendations to spine surgery? Results of an international survey

OBJECTIVE

This international survey investigated Evidence-Based Medicine (EBM) in spine surgery by measuring its acceptance among spine surgeons. It assessed their understanding of EBM and how they apply it in practice by analyzing responses to various clinical scenarios..

MATERIALS AND METHODS

Following the CHERRIES guidelines, an e-survey was distributed to multiple social media forums for neurosurgeons and orthopedic surgeons on Facebook, LinkedIn, and Telegram and circulated further through email via the authors' network. Three hundred participants from Africa, Asia, Europe, North America, and Oceania completed the survey.

RESULTS

Our study revealed that 67.7% (n = 203) of respondents used EBM in their practice, and 97.3% (n = 292) believed training in research methodology and EBM was necessary for the practice of spine surgery. Despite this endorsement of using EBM in spine surgery, we observed varied responses to how EBM is applied in practice based on example scenarios. The responders who had additional training tended to obey EBM guidelines more than those who had no additional training. Most surgeons responded as always or sometimes prescribing methylprednisolone to patients with acute spinal cord injury. Other significant differences were identified between geographical regions, training, practice settings, and other factors.

CONCLUSIONS

Most respondents used EBM in practice and believed training in research methodology and EBM is necessary for spine surgery; however, there were significant variations on how to use them per case. Thus, the appropriate application of EBM in clinical settings for spinal surgery must be further studied.

Development and validation of the clinical information literacy questionnaire

BACKGROUND

Clinical Information Literacy (CIL) seems to be a prerequisite for physicians to implement Evidence-Based Medicine (EBM) effectively. This study endeavors to develop and validate a CIL questionnaire for medical residents of Isfahan University of Medical Sciences.

MATERIALS AND METHODS

This study employs sequential-exploratory mixed methods in 2019. The participants were 200 medical residents in different specialties; they are selected through the convenience sampling method. In the first (qualitative) phase, an early CIL questionnaire was designed by reviewing literature and performing complementary interviews with health professionals. In the second (validation) phase, the questionnaire's face validity and content validity were confirmed. In the third (quantitative) phase, the construct validity was examined via Item-Response Theory (IRT) model, and the factor loading was computed. The gathered data were analyzed using descriptive statistics, t-test, two-way ANOVA, as well as two-parameter IRT model in R software.

RESULTS

In the qualitative phase, the concept of CIL is initially described in seven main categories and 22 subcategories, and the items were formulated. An initial 125-item questionnaire was analyzed by the research team, leading to a 43-item. Through the content validity and face validity examination, we removed 11 and 4 items in the Content Validity Ratio (CVR) and Content Validity Index (CVI), respectively. Throughout the face validity analysis, none of the items were removed. According to the construct validity results, difficulty coefficient, discriminant coefficient, and factor loading were confirmed, most of the other questions achieved a proper factor loading value that is higher than 0.30, and a value of 0.66 was achieved for the reliability via the Kuder-Richardson method. Ultimately, the real-assessment 28-item CIL questionnaire was developed with four components.

CONCLUSIONS

The CIL questionnaire could be employed to examine the actual CIL basic knowledge. Because of using the real-assessment approach rather than self-assessment in the design, it can be claimed that this instrument can provide a more accurate assessment of the information literacy status of medical residents. This valid questionnaire is used to measure and train the skills needed by healthcare professionals in the effective implementation of EBM.

Association between self-reported evidence-based medicine competencies and prescribing of drugs without scientific evidence against mild COVID-19 among recently graduated physicians in Peru

Objective

To evaluate the association between self-rated evidence-based medicine (EBM) competencies and the prescription of drugs without scientific evidence against mild COVID-19 (present with any of the signs and symptoms of COVID-19 but who do not have shortness of breath, dyspnea, or abnormal chest imaging) among recently graduated physicians in Peru.

Methods

We conducted an analytical cross-sectional study where we evaluated a non-probability sample of recently graduated physicians during June and July 2021 (end of second wave of COVID-19 in Peru). Self-rated EBM competencies were assessed by four domains (formulation of a clinical question, search, analysis, and application) using a Likert scale with scores from zero to four ("Very inadequate" = 0, to "Very Adequate" = 4), it was considered as "Adequate" if the score was three or four. In addition, the variable "General competence on EBM" was rated as "Adequate" if in all domains evaluated it presented an adequate self-rating. For the outcome, drug prescription, we considered the use of ivermectin, azithromycin, other antibiotics, hydroxychloroquine, dexamethasone, and anticoagulants (drugs with no efficacy demonstrated for patients with mild COVID-19). To assess the association, we used Poisson regression models with robust variances and obtaining crude (cPR) and adjusted (aPR) prevalence ratios with their 95% confidence intervals (95%CI).

Results

Of a total of 239 physicians included 70.7% prescribed at least one drug without scientific evidence. A total of 51.1% reported adequate ratings in all evaluated domains of EBM. Self-rating the "Clinical Question Formulation" competency as adequate was associated with a lower frequency of prescribing medications for mild COVID-19 (aPR: 0.93; 95% CI: 0.91-0.95). While self-rating as adequate the competency of "Identify possible implications of investigations" was associated with an increase in the prescription of such drugs (aPR: 1.14; 95% CI: 1.09-1.20). Additionally, self-rating all domains as adequate were associated with less prescription (aPR: 0.93; 95% CI: 0.90-0.96).

Conclusion

Seven out of ten recently graduated physicians prescribed some type of medication without scientific evidence to treat patients with mild COVID-19. Having adequate self-perceived EBM competencies was associated with a lower frequency of prescribing medications without scientific evidence to manage patients with mild COVID-19.

Self-perceived competencies on evidence-based medicine in medical students and physicians registered in a virtual course: a cross-sectional study

BACKGROUND

Evidence-based medicine (EBM) is defined as the integration of the best available evidence from scientific studies with clinical experience (and context) and with patients' values and preferences. The objective of the present study was to describe self-perceived EBM competencies in physicians and medical students enrolled in a massive virtual EBM course.

METHODS

Analytical cross-sectional study. People interested in a free virtual EBM course fulfilled their data in a virtual form for their registration in September 2020. In this form, 22 competencies related to four dimensions of EBM were evaluated: asking a clinical question, search, analysis, and application; using a 5-option Likert scale. The resulting database was analyzed, selecting people who claimed to be physicians or medical students of 18 years or more.

RESULTS

1793 participants were included: 1130 medical students and 663 physicians; more than 80% lived in Peru. The frequency of participants who agreed or strongly agreed with feeling qualified in each competence ranged: from 39.2% to 57.8% for the competencies of the 'Asking a clinical question' dimension, from 39.2% to 56.1% for 'Search,' from 19.9% to 32.0% for 'Analysis,' and from 19.6% to 29.9% for 'Application.' Both in physicians and students, the lowest frequencies were for the competencies of interpretation of impact measures, graphs, and results of systematic reviews; as well as shared decision making and calculation of expected benefit. Physicians who graduated more recently scored better on competencies from search and analysis dimensions.

CONCLUSION

Among physicians and medical students enrolled in the course, self-perception of competencies was lower in the dimensions of analysis and application. More recently graduated physicians seem to have a greater self-perception of their research and analysis skills, probably due to curricular updates.List of abbreviations: EBM: Evidence-based medicine; CIMBE, for its acronym in Spanish: International Course on Evidence-Based Medicine; SOCIMEP, for its acronym in Spanish: Peruvian Medical Student Scientific Society.

Awareness, attitude, and practice of evidence-based medicine among primary healthcare physicians in Buraidah, Saudi Arabia

Context

Evidence-based medicine (EBM) is essential for safe and cost-effective care provision to the population.

Aims

To assess the awareness, attitude and practices and barriers among primary care physicians about EBM in Buraidah, Qassim.

Settings and Design

Cross-sectional study in Primary Health Care centers (PHCCs) of Buraidah, Qassim.

Materials and Methods

The study was conducted among physicians working in PHCCs of Buraidah. Data were collected online through Google forms.

Statistical Analysis Used

Descriptive analysis was carried out to measure the frequencies and proportions. Chi-square test was used to compare barriers based on gender, academic degree, and experience categories.

Results

A total of 96 out of 144 physicians (66.7%) responded to the invitation. About 82.3% of the participants welcomed the promotion of EBM and 92% of the physicians knew about concept of EBM. About 94.8% of the physicians agreed that EBM will improve patient outcomes. The reported barriers were; patient load (87.5%), time availability (70.8%), computer availability (33.3%), internet availability (45.8%), and 56.3% stated updated clinical letters, journals, or guidelines are not available.

Conclusions

This study found that there was high self-reported knowledge about the EBM concept; however, the knowledge about tools was poor. A number of barriers were found such as patient load, time, availability of clinical guidelines and journals and other resources such as internet and computers. Primary care physicians should be trained and facilitated for EBM.

Reliability and validity of the Persian version of the ACE tool: assessing medical trainees' competency in evidence-based medicine

BACKGROUND

Evidence-based medicine (EBM) allows users to integrate evidence into decision-making alongside clinical expertise and patient values. This study aimed to evaluate the reliability and validity of the Persian version of the Assessing Competency in EBM (ACE) tool across knowledge, skills, and attitude.

METHODS

This cross-sectional study was performed on medical residents (first-year residents and junior residents) of Shiraz University of Medical Sciences in 2019. The study instrument was the ACE tool which consists of 15 two-choice questions (yes-no) and each of these questions measures one of four steps in evidence-based medicine (1- asking the answerable question, 2- searching the literature, 3- critical appraisal, and 4- applying the evidence to scenario). This tool was translated into Persian according to international standards. To ensure that the original and translated ACE questionnaire can be matched accurately and conceptuality, content validity index (CVI) and content validity ratio (CVR) were determined. Cronbach's alpha was applied to determine the internal consistency for each scale and Confirmatory factor analysis (CFA) was used to survey the factor structure validity.

RESULTS

One hundred sixty-three questionnaires were studied, selecting 59 first-year medical residents and 104 s-year medical residents. The results showed that using the Persian translation of the ACE tools, the content validity index (CVI) values were equal to or above 0.8 for all items. The content validity ratio (CVR) value was 0.90 for the total scale. The indicators of the confirmatory factor analysis (CFA) for the ACE tool revealed that this model had an acceptable fit. Cronbach's alpha for the overall score was 0.79.

CONCLUSION

The Persian translated version of the ACE tool is a valid and reliable instrument for assessing medical trainees' competency in EBM.

Forty-year Tunisian bibliometrics of general surgery theses in the four national faculties of medicine (1980-2019)

The objective of this work was to establish the bibliometric profile of Tunisian theses in ‘general surgery’ and to describe their themes, their study designs, and their writing quality. This is a retrospective descriptive bibliometric study, covering all the theses in medicine in the specialty of ‘general surgery’, defended in the four medical faculties of Tunisia, during the forty last years from 1980 to 2019. During the study period, 739 theses in ‘general surgery’ were discussed in Tunisia, with an average of 19 theses per year. The most studied research topic was emergencies (41%), followed by common surgical pathologies (26%) and digestive oncology (21.5%). Descriptive studies and case studies represented the majority of study designs with respective proportions of 56.9% and 40.6%. Only 20.7% of these theses had a scientific writing quality deemed satisfactory. The least respected elements in writing their summaries were statistical (confidence intervals and standard deviations) and documentary (keywords). Despite the plethora of themes of Tunisian theses in ‘general surgery’, their basic methodology and their editorial non conformity require the educational reform of the dissertations, both doctoral students and supervisors, by strengthening their skills in research methodology and scientific communication written.

Formulas, Algorithms and Examples for Binomial Distributed Data Confidence Interval Calculation: Excess Risk, Relative Risk and Odds Ratio

Medical studies often involve a comparison between two outcomes, each collected from a sample. The probability associated with, and confidence in the result of the study is of most importance, since one may argue that having been wrong with a percent could be what killed a patient. Sampling is usually done from a finite and discrete population and it follows a Bernoulli trial, leading to a contingency of two binomially distributed samples (better known as 2×2 contingency table). Current guidelines recommend reporting relative measures of association (such as the relative risk and odds ratio) in conjunction with absolute measures of association (which include risk difference or excess risk). Because the distribution is discrete, the evaluation of the exact confidence interval for either of those measures of association is a mathematical challenge. Some alternate scenarios were analyzed (continuous vs. discrete; hypergeometric vs. binomial), and in the main case—bivariate binomial experiment—a strategy for providing exact p-values and confidence intervals is proposed. Algorithms implementing the strategy are given.

Validity and reliability of the Noor Evidence-Based Medicine Questionnaire: A cross-sectional study

Background

Evidence-based medicine (EBM) is a widely accepted scientific advancement in clinical settings that helps achieve better, safer, and more cost-effective healthcare. However, presently, validated instruments to evaluate healthcare professionals’ attitude and practices toward implementing EBM are not widely available. Therefore, the present study aimed to determine the validity and reliability of a newly developed knowledge, attitude, and practice (KAP) questionnaire on EBM for use among healthcare professionals.

Methods

The Noor Evidence-Based Medicine Questionnaire was tested among physicians in a government hospital between July and August 2018. Exploratory factor analysis and internal consistency reliability-based Cronbach’s alpha statistic were conducted.

Results

The questionnaire was distributed among 94 physicians, and 90 responded (response rate of 95.7%). The initial number of items in the KAP domains of the Noor Evidence-Based Medicine Questionnaire were 15, 17, and 13, respectively; however, two items in the practice domain with communalities <0.25 and factor loadings <0.4 were removed. The factor structure accounted for 52.33%, 66.29%, and 55.39% of data variance in the KAP domains, respectively. Cronbach’s alpha values were 0.81, 0.81, and 0.84 for KAP domains, respectively, indicating high reliability.

Conclusions

This questionnaire can be used to evaluate the knowledge, attitudes, and behaviour of healthcare professionals toward EBM. Future testing of this questionnaire among other medical personnel groups will help expand the scope of this tool.

Levels and Factors Associated with Resilience in Italian Healthcare Professionals during the COVID-19 Pandemic: A Web-Based Survey

Background: Resilience is defined as the capacity to cope successfully with change or adversity. The aims of our study were to investigate levels of resilience in Italian healthcare professionals (HCPs) during the Coronavirus disease 2019 (COVID-19) pandemic and to identify potential predictors of resilience. Methods: We performed a web-based survey of HCPs (n = 1009) working in Italian hospitals during the COVID-19 pandemic. The survey contained a 14-item resilience scale (RS14) and questionnaires to evaluate depression and anxiety symptoms. Non-HCP individuals (n = 375) from the general population were used for comparison. Results: HCPs showed significantly lower resilience compared to the control group (p = 0.001). No significant differences were observed after stratification for geographical area, work setting, role, or suspected/confirmed diagnosis of COVID-19. In a linear regression analysis, RS14 was inversely correlated with depression (R² = 0.227, p < 0.001) and anxiety (R² = 0.117, p < 0.001) and directly correlated with age (R² = 0.012, p < 0.001) but not with body mass index (BMI, R² = 0.002, p = 0.213). In male HCPs, higher depression score (odds ratio (OR) 1.147, p < 0.001) or BMI (OR 1.136, p = 0.011) significantly predicted having low resilience. In female HCPs, higher depression score (OR 1.111, p < 0.0001) and working in a COVID-19 free setting (OR 2.308, p = 0.002) significantly predicted having low resilience. HCPs satisfied with personal protective equipment had higher levels of resilience (p < 0.010). Conclusions: Our findings suggest that resilience was lower in Italian HCPs than in the general population after the first COVID-19 wave. Specific factors can be identified, and targeted interventions may have an important role to foster resilience of HCPs.