A pilot randomised controlled trial to assess the utility of an e-learning package that trains users in adverse drug reaction causality

Drivers of citations in social pharmacy and practice research articles

BACKGROUND

Research in Social and Administrative Pharmacy has been expanding in the last decade. The recently published Granada Statements offer key recommendations to improve the quality of research in this field.

OBJECTIVES

To identify the factors associated with the citations of articles in the field of social, administrative, clinical pharmacy and practice research.

METHODS

This study was a retrospective, observational analysis of articles published in three leading journals. Per article Google Scholar citations was the dependent variable. Predictor variables were extracted from all articles published from 2013 to 2015. The dependent variable was dichotomized using sample's median Google Scholar citations. Logistic regression analysis was performed to identify independent predictors of citations ≥ median.

RESULTS

The median number of citations per article was 17 (range 0-341), with a mean of 24.2 (SD 27.6). The number of references included in the articles (OR 1.03, CI 1.02-1.04), the year of publication (OR 0.31 CI 0.21-0.46 for articles published 2015), article social media mentions (OR = 1.01, CI 1.01-1.03 and OR 1.10 CI 1.04-1.18 for Facebook and X, respectively), the topic area of research namely pharmacy services (OR 1.65, CI 1.06-2.57) and medication adherence (OR 2.22 CI 1.13-4.33) were independently associated with article having citations ≥ median.

CONCLUSIONS

The number of references, the year of publication, social media mentions and the topic area of research, namely pharmacy services and medication adherence, were associated with citations above median in the leading journals of social and administrative pharmacy research. Authors may consider providing a thorough literature review in their articles, while researchers, editors, and publishers are advised to use social media to promote newly published work. This article complements the Granada Statements and may contribute to fostering wider dissemination of the discipline's outputs.

Examination of tools associated with the evaluation of knowledge uptake and utilization: A scoping review

Knowledge transfer and exchange (KTE) has become an integral part of organizational practice. Evaluation of KTE, as well as knowledge products generated through this process, is important for understanding the effectiveness of KTE strategies. This scoping review aimed to identify tools and frameworks used to evaluate knowledge uptake and utilization (KUU). The search strategy included review of PubMed and Scopus databases, hand searching of relevant journals, and citation tracing. Over 6500 abstracts were screened; 292 full-text articles were shortlisted by two reviewers. Seventy-two articles described tools for evaluating KUU. A total of 23 tools could be generally applied to knowledge products/processes used in different sectors; 36 evaluation tools were designed for specific knowledge products (i.e., websites); 9 tools were discipline-specific (i.e., medical field), and four articles described evaluations of knowledge products/processes using alternative methods such as Google Analytics or qualitative methods. The majority of tools (n = 40, 56 %) focused on usability of a knowledge product or process. This scoping review identified various tools being used to assess the effectiveness and impact of KTE processes/products, however, the measures were as varied as the projects, and were often not designed to evaluate KTE in particular.

Knowledge of professional healthcare providers about sickle cell disease: Impact of a distance education course

Objective

To assess the impact of the distance education course “Sickle Cell Disease: Primary Health Care Line” on knowledge acquisition of professional healthcare providers.

Methods

A cross-sectional study was conducted with a quantitative approach at the Educational and Support Center for Hemoglobinopathies (Cehmob-MG), state of Minas Gerais, Brazil, in 2016. One hundred and fifty-three out of 300 professional healthcare providers were invited to participate in the proposed distance course. Of the participating professional healthcare providers, 72 (47%) successfully concluded the course (Group A), whereas 81 (53%) did not complete their course assignments and did not meet the minimum requirements for regular attendance (Group B). Knowledge acquisition was assessed with the Knowledge of Sickle Cell Disease Instrument, DFConhecimento, applied using the web tool eSurv. Univariate analysis by Poisson regression was employed to assess the influence of sociodemographic variables on the DFConhecimento score and to select variables to compose the initial multivariate regression model (p-value < 0.20). The analysis was performed in the statistical programming environment R.

Results

The average score was 9.76 for Group A and 6.54 for Group B. The two groups were considered statistically different (p-value < 0.05) for all items with the proportion of correct items being greater in Group A. Professional healthcare providers who concluded the course had a significantly higher DFConhecimento score (45%) when compared to those who did not successfully conclude the course.

Conclusion

Participation in a distance education course on sickle cell disease had a positive impact on the acquisition of knowledge about the disease by professional healthcare providers.

Online Digital Education for Postregistration Training of Medical Doctors: Systematic Review by the Digital Health Education Collaboration

Background

Globally, online and local area network–based (LAN) digital education (ODE) has grown in popularity. Blended learning is used by ODE along with traditional learning. Studies have shown the increasing potential of these technologies in training medical doctors; however, the evidence for its effectiveness and cost-effectiveness is unclear.

Objective

This systematic review evaluated the effectiveness of online and LAN-based ODE in improving practicing medical doctors’ knowledge, skills, attitude, satisfaction (primary outcomes), practice or behavior change, patient outcomes, and cost-effectiveness (secondary outcomes).

Methods

We searched seven electronic databased for randomized controlled trials, cluster-randomized trials, and quasi-randomized trials from January 1990 to March 2017. Two review authors independently extracted data and assessed the risk of bias. We have presented the findings narratively. We mainly compared ODE with self-directed/face-to-face learning and blended learning with self-directed/face-to-face learning.

Results

A total of 93 studies (N=16,895) were included, of which 76 compared ODE (including blended) and self-directed/face-to-face learning. Overall, the effect of ODE (including blended) on postintervention knowledge, skills, attitude, satisfaction, practice or behavior change, and patient outcomes was inconsistent and ranged mostly from no difference between the groups to higher postintervention score in the intervention group (small to large effect size, very low to low quality evidence). Twenty-one studies reported higher knowledge scores (small to large effect size and very low quality) for the intervention, while 20 studies reported no difference in knowledge between the groups. Seven studies reported higher skill score in the intervention (large effect size and low quality), while 13 studies reported no difference in the skill scores between the groups. One study reported a higher attitude score for the intervention (very low quality), while four studies reported no difference in the attitude score between the groups. Four studies reported higher postintervention physician satisfaction with the intervention (large effect size and low quality), while six studies reported no difference in satisfaction between the groups. Eight studies reported higher postintervention practice or behavior change for the ODE group (small to moderate effect size and low quality), while five studies reported no difference in practice or behavior change between the groups. One study reported higher improvement in patient outcome, while three others reported no difference in patient outcome between the groups. None of the included studies reported any unintended/adverse effects or cost-effectiveness of the interventions.

Conclusions

Empiric evidence showed that ODE and blended learning may be equivalent to self-directed/face-to-face learning for training practicing physicians. Few other studies demonstrated that ODE and blended learning may significantly improve learning outcomes compared to self-directed/face-to-face learning. The quality of the evidence in these studies was found to be very low for knowledge. Further high-quality randomized controlled trials are required to confirm these findings.

Continuous Education of Basic Life Support (BLS) through Social Media; a Quasi-Experimental Study

INTRODUCTION

It is imperative, if not fundamental, for medical students to receive continuing education in Basic life support (BLS). This present study aimed to investigate the effectiveness of continuing education using social media in this regard.

METHODS

In this quasi-experimental study, a questionnaire containing 20 items about BLS awareness was completed by the interns who were trained monthly in the emergency medicine training course. Then half of the interns received distant education through Telegram software up to three months, and the other did not receive any further education. Again, both groups completed the questionnaire at the end of the third month.

RESULTS

100 medical interns with the mean age of 25.05 ± 1.26 years were allocated to two groups of 50 subjects (65.0% female). Two groups were similar regarding the mean age (p = 0.304), gender (p = 0.529), mean awareness score at the beginning of the study (p = 0.916), and average pre-internship exam score (p = 0.080). The mean awareness score of medical interns increased significantly in intervention (11.44 ± 2.37 to 14.88 ± 1.97, p < 0.0001) and control (11.38 ± 3.22 to 12.54 ± 3.04, p < 0.0001) groups at second examination. But mean difference of awareness score, before and after the education, was significantly higher in intervention group (3.44 ± 1.48 versus 1.16 ± 1.51; p < 0.0001).

CONCLUSION

The increase in the BLS awareness score was significantly higher in medical interns who were continuously educated using Telegram social media software.

Interrater agreement of two adverse drug reaction causality assessment methods: A randomised comparison of the Liverpool Adverse Drug Reaction Causality Assessment Tool and the World Health Organization-Uppsala Monitoring Centre system

Introduction

A new method to assess causality of suspected adverse drug reactions, the Liverpool Adverse Drug Reaction Causality Assessment Tool (LCAT), showed high interrater agreement when used by its developers. Our aim was to compare the interrater agreement achieved by LCAT to that achieved by another causality assessment method, the World Health Organization-Uppsala Monitoring Centre system for standardised case causality assessment (WHO-UMC system), in our setting.

Methods

Four raters independently assessed adverse drug reaction causality of 48 drug-event pairs, identified during a hospital-based survey. A randomised design ensured that no washout period was required between assessments with the two methods. We compared the methods’ interrater agreement by calculating agreement proportions, kappa statistics, and the intraclass correlation coefficient. We identified potentially problematic questions in the LCAT by comparing raters’ responses to individual questions.

Results

Overall unweighted kappa was 0.61 (95% CI 0.43 to 0.80) on the WHO-UMC system and 0.27 (95% CI 0.074 to 0.46) on the LCAT. Pairwise unweighted Cohen kappa ranged from 0.33 to 1.0 on the WHO-UMC system and from 0.094 to 0.71 on the LCAT. The intraclass correlation coefficient was 0.86 (95% CI 0.74 to 0.92) on the WHO-UMC system and 0.61 (95% CI 0.39 to 0.77) on the LCAT. Two LCAT questions were identified as significant points of disagreement.

Discussion

We were unable to replicate the high interrater agreement achieved by the LCAT developers and instead found its interrater agreement to be lower than that achieved when using the WHO-UMC system. We identified potential reasons for this and recommend priority areas for improving the LCAT.

Development of the Liverpool Adverse Drug Reaction Avoidability Assessment Tool

Aim

To develop and test a new tool to assess the avoidability of adverse drug reactions that is suitable for use in paediatrics but which is also applicable to a variety of other settings.

Methods

The study involved multiple phases. Preliminary work involved using the Hallas scale and a modification of the existing Hallas scale, to assess two different sets of adverse drug reaction (ADR) case reports. Phase 1 defined, modified and refined a new tool using multidisciplinary teams. Phase 2 involved the assessment of 50 ADR case reports from a prospective study of paediatric inpatients by individual assessors. Phase 3 compared assessments with the new tool for individuals and groups in comparison to the ‘gold standard’ (the avoidability outcome set by a panel of senior investigators: an experienced clinical pharmacologist, paediatrician and pharmacist).

Main Outcome Measures

Inter-rater reliability (IRR), measure of disagreement and utilization of avoidability categories.

Results

Preliminary work—Pilot phase: results for the original Hallas cases were fair and pairwise kappa scores ranged from 0.21 to 0.36. Results for the modified Hallas cases were poor, pairwise kappa scores ranged from 0.06 to 0.16.

Phase 1: on initial use of the new tool, agreement between the two multidisciplinary groups was found on 13/20 cases with a kappa score of 0.29 (95% CI -0.04 to 0.62).

Phase 2: the assessment of 50 ADR case reports by six individual reviewers yielded pairwise kappa scores ranging from poor to good 0.12 to 0.75 and percentage exact agreement (%EA) ranged from 52–90%.

Phase 3: Percentage exact agreement ranged from 35–70%. Overall, individuals had better agreement with the ‘gold standard’.

Conclusion

Avoidability assessment is feasible but needs careful attention to methods. The Liverpool ADR avoidability assessment tool showed mixed IRR. We have developed and validated a method for assessing the avoidability of ADRs that is transparent, more objective than previous methods and that can be used by individuals or groups.