Impact of a Journal Club Elective Course on Student Learning Measures

Utilization of the Transparent Peer Review Policy to Train Graduate Pharmacy Students on Scientific Critique

OBJECTIVES

Recognizing the importance of training graduate students in scientific critique and peer-review, we introduced an innovative instructional strategy using the transparent peer-review policy (TPRP). This study aimed to explore students' feedback on how published peer-review reports influenced their scientific critique skills.

METHODS

We used TPRP-adopting journals' publicly available peer-review reports for MSc Pharmacy students, who analyzed real cases, including author submissions, reviewer comments, rebuttals, editorial decisions, and final publications. A reflection assignment required students to share their insights on the TPRP-adopting journals' review processes and how these influenced their scientific reviewing skills. Qualitative content analysis of the submitted reflections was conducted by two instructors not involved in developing or delivering this aspect of the course.

RESULTS

Eleven students submitted reflections on their learning experiences through this public-facing peer-review process. The analysis revealed that TPRP increased students' awareness of both the peer-review process and fundamental principles of scientific critique. Five key themes emerged: understanding research content, inspiring ideas, fostering objectivity, enriching peer-review comprehension, and evaluating transparent peer-review pros and cons. Students showed a positive attitude towards this pedagogical approach for acquiring the targeted skills.

CONCLUSION

We utilized peer-review reports from TPRP-supporting journals as an educational tool, providing training on the fundamentals of peer-review and scientific critique. This study suggests recommending TPRP-supported journal reports as a valuable educational tool for teaching scientific critique and peer-review skills.

Evidence-Based Medicine and Pharmacotherapy Content Alignment

OBJECTIVE

When effectively executed, content alignment can aid student performance in associated courses. Limited research exists for content alignment of evidence-based medicine (EBM) and pharmacotherapy courses. This study assesses the impact of EBM and pharmacotherapy course alignment on student performance.

METHODS

Content alignment included assignment of 6 landmark trials in EBM coursework. The articles were identified by pharmacotherapy instructors as "landmark" to management of associated diseases in the aligned pharmacotherapy semester. Articles were the basis for quizzes over skills taught in the EBM course and were referenced during pharmacotherapy lectures.

RESULTS

During the alignment semester, students were more likely to cite specific guidelines and/or primary literature to rationalize pharmacotherapeutic plans on examinations compared with the prealignment period (54% vs 34%). Overall, pharmacotherapy case performance and plan rationale scores were significantly higher in the alignment semester compared with prealignment. Student performance on the Assessing Competency in Evidence-Based Medicine tool improved from the start of the semester (8.64, SD 1.66) to the end (9.5, SD 1.49; mean score +0.86). Comfort in applying EBM analysis to primary literature increased significantly between the first and final assignments, with 6.7% and 71.7% of students self-reporting a high degree of confidence, respectively. Students (73%) reported an enhanced understanding of pharmacotherapy due to alignment compared with a previous semester of pharmacotherapy without alignment.

CONCLUSION

The use of landmark trial assignments to align EBM and pharmacotherapy coursework demonstrated a positive impact on student rationale for clinical decision-making and student confidence in evaluating primary literature.

The impact of journal clubs on postgraduate medical education in China

PURPOSE

Journal clubs hold significant importance in medical education, with numerous studies highlighting their contributions worldwide. However, studies specifically examining their role in China, particularly among Chinese medical postgraduates categorized into academic and clinical types, remain scarce. This research aims to investigate the participation, performance, and benefits of journal clubs, and explore the influence of student type and study phase on these aspects.

METHOD

A survey encompassing demographic information, participation rates, performance evaluations, and perceived improvements was distributed to postgraduates at Tongji Medical College of Huazhong University of Science and Technology. A total of 232 completed questionnaires were included for further analysis. Statistical analysis employed the Mann-Whitney U test and Gamma tests, with statistical significance set at p-value < 0.05.

RESULTS

Overall participation and performance in journal clubs among Chinese medical postgraduates were comparable to global findings. Notably, academic postgraduates exhibited higher levels of attendance rate and gained more research assistance than clinical postgraduates, while their performance levels were similar. When considering the study phase, a downward trend in academic postgraduates' attendance rate and listening attitude and an upward trend in clinical postgraduates' participation were observed with the seniority phase. Additionally, presentation comments, post-presentation progress, and research assistance showed improvements over time for both student types.

CONCLUSIONS

This study reveals academic postgraduates' fatigue, contrasting with clinical postgraduates' enthusiasm, and underscores academic postgraduates' superior research assistance. To address these findings, we recommend supporting and encouraging scientific research training for clinical postgraduates, aiding academic postgraduates in better time management and reducing non-essential responsibilities, and implementing critical appraisal skill education.

An Online, Multi-institutional Debate on Diabetes Medications by Advanced Pharmacy Practice Experience Students

Objective. The purpose of this study was to evaluate changes in advanced pharmacy practice experience (APPE) students' knowledge and to measure student perceptions of an online, multi-institutional debate curriculum as an alternative to a journal club to improve critical thinking skills related to diabetes medications.Methods. All APPE students assigned to four faculty (n=37) at three different colleges during the 2020-2021 academic year received instruction on diabetes medication classes and their cardiovascular outcome trials. Students debated via the Lincoln-Douglas format whether the preferred second-line therapies for patients with type 2 diabetes mellitus are either glucagon-like peptide-1 receptor agonists or sodium-glucose cotransporter-2 inhibitors. Matched pre- and post-APPE knowledge scores were measured using a seven-item assessment tool. A 22-item post-debate survey measured student perceptions of the activity.Results. Pre- and post-APPE knowledge scores were compared in 32 students, yielding an 86% response rate. Knowledge scores improved 32% (59% pre vs 87% post). Thirty-three students completed the perceptions survey, yielding an 89% response rate. Students reported that the debate activity was beneficial (100%) and rated it more effective than a journal club at improving critical thinking skills and knowledge retention.Conclusion. Preliminary results suggest that incorporating an online, multi-institutional debate as an alternative to journal clubs during APPE rotations was well received. Further research is warranted on the impact of the multi-institutional debate and how to best deliver it during the APPEs of a pharmacy curriculum.

An Integrative Review of Approaches Used to Assess Course Interventions

Objective. The objectives of this review are to describe the utility of approaches used for the assessment of course interventions in pharmacy education and to provide recommendations that may guide faculty members in their scholarship of teaching and learning (SoTL) efforts that encompass assessment of course interventions.Findings. Thirty-four articles that included educational interventions published between 2016 and 2020 in the American Journal of Pharmaceutical Education and Currents in Pharmacy Teaching and Learning were selected for analysis. Those articles used various approaches for the assessment of course interventions. In the order of decreasing frequency of use, those methods were surveys, student academic performance, student evaluations, mixed quantitative and qualitative methods, pre- and posttest, and learning analytics.Summary. The use of more than one assessment approach, ie, triangulation, and multiple student cohorts are advantageous. When multiple cohorts are used, it is beneficial to present the students' demographic information. Student academic performance should be part of an assessment of course interventions whenever relevant. Surveys about student perceptions and confidence may contribute to the assessment of course interventions. However, since the information collected is subjective and is usually unrelated to student learning, such an approach should be coupled with other assessment approaches that reflect student learning, such as academic performance and/or a pre- and a posttest. Depending on the research question, qualitative methods and learning analytics may also be a part of the assessment of course interventions.

Perception of journal club seminars by medical doctoral students: results from five years of evaluation

Objectives: A journal club is one of the well-established and popular methods of post-graduate education. In this work, we were interested to understand how the participants perceive journal club as a whole and how they evaluate their personal process of acquiring new scientific knowledge and development of soft-skills as an indispensable prerequisite of the lifelong learning. Project description: This study is a survey analysis examining perception of journal club sessions by post-graduate medical students. A checklist for journal club preparation as well as a questionnaire for evaluation of the journal club session by participants has been developed to determine if the journal club had met its aims. Data were collected by summing up all answers to each question of the questionnaire for each session. Qualitative data from a five-year evaluation period were compiled and analyzed. Results: The journal club checklist served as a guideline for the preparation of a journal club session as well as an evaluation questionnaire containing 24 items. Our work presents evidence that journal club seminars are well perceived by participants. Furthermore, a high percentage of participants deemed the working atmosphere to be constructive and found it worthwhile to participate in the sessions. The topics of the presentations have been positively evaluated, however only a minority of participants found that the topics of the journal club was related to their own specific research topic. Concerning the distribution of the journal article, we could show that distributing the paper one week before the journal club event provided sufficient time for preparation. Our evaluation revealed that two-thirds of the participants found discussions during journal club sessions rich and productive. The motivation to think more critically increased during journal club sessions. From our work, it is evident that the participants perceived the speakers´ soft-skills to have improved with the practice. Finally, we show a clear trend of improved perception of the value of journal club sessions from beginning to the end of the evaluation time. Conclusion: Based on the analyzed evaluations, we can conclude that journal club events are highly valued by participants and could be a good option for the development of certain soft-skills.

Use of journal clubs and book clubs in pharmacy education: A scoping review

BACKGROUND

Journal clubs and book clubs are educational activities used in health sciences education to teach evidence-based decision-making, critical thinking, and appraisal skills, and build trainee understanding about important professional issues. The main objective of this scoping review was to identify and synthesize all research studies on journal or book clubs for pharmacy learners. A secondary objective was to identify gaps in the literature where future research would be beneficial to pharmacy educators and learners.

METHODS

A comprehensive literature search was run across five databases. Studies were screened using a two stage, blinded, independent screening process.

RESULTS

Forty-two studies met all inclusion criteria; 86% reported on journal clubs and 14% on book clubs. Of the journal club studies, 50% were in didactic courses, 33% in experiential education, and 17% were co-curricular initiatives. Of the six book club studies, 67% were within didactic courses and 33% were co-curricular initiatives, including the only interprofessional education study. Most journal clubs were used to teach evidence-based practice, drug literature evaluation, or biostatistics. Book clubs were more focused on soft skills or topics students were less likely to encounter in the core curriculum.

IMPLICATIONS

Future research on journal clubs and book clubs in pharmacy education should continue to assess student learning outcomes and abilities. Specifically, future studies should move beyond evaluating student perceptions of journal clubs to investigate effectiveness for topics other than drug literature evaluation or evidence-based practice, and the impact of journal clubs and book clubs on interprofessional knowledge, communication, and team dynamics.

Promoting the Conduct of Medical Education Journal Clubs in Teaching Medical Institutions

Background A critical appraisal of a research article as a part of journal club sessions is an essential aspect of postgraduate training across different medical institutions in varied settings. The purpose of the current review was to explore the merits of medical education journal clubs and identify the potential factors that need to be considered for conducting these journal clubs in medical institutions. Methods An extensive search of all materials related to the topic was performed in the PubMed search engine and a total of 51 studies were included in the review based on the suitability with the current review objectives. Keywords used in the search include medical education journal clubs in the title only (viz., journal club [ti] AND medical education [ti]; medical education journal clubs [ti]; journal club [ti]). The articles published in English language only were included in the review. Results Regardless of the extensive employment of the journal clubs in different medical specialties, it is quite alarming to note that not many institutions conduct journal clubs targeting the field of medical education. These sessions offer a unique opportunity to the participants to assess the literature in a supportive fashion and play a defining role in ensuring better quality health care teachings to the medical students. However, we must understand that the successful conduct of medical education journal clubs requires specific considerations and groundwork, so that the students may benefit. Conclusion In conclusion, the medical education journal clubs have not been frequently conducted, as more preference has been given to the subject-specialty journal clubs. However, considering the scope and benefits that journal clubs add to improve teaching, all medical institutions should advocate to conduct medical education journal clubs within their premises in a structured manner.

A Scoping Review of the Pharmacy Curriculum Outcomes Assessment Literature

Objective. To identify themes, gaps, and sources of evidence from the literature regarding the Pharmacy Curriculum Outcomes Assessment (PCOA) to inform practice and additional areas for research in pharmacy education.Findings. Nineteen articles describing the administration and use of PCOA were identified. Since PCOA was made a curricular requirement by the Accreditation Council of Pharmacy Education in 2016, the focus of literature related to the PCOA has shifted from administration practices (four articles published before 2016 vs two articles published since) to determining models that may predict student performance on the assessment (two vs five articles) or how the examination might be used to predict future performance (one vs seven articles), especially on the North American Pharmacist Licensing Examination. While there is a growing body of literature focused on the PCOA's utility for measuring performance, few variables have been consistently used.Summary. This review found no studies with objectives that aligned with the initial intended use of the PCOA as defined by the National Association of Boards of Pharmacy, which included tracking individual student performance throughout the curriculum, benchmarking programs against other programs, and evaluating whether a program was meeting their desired outcomes. Additionally, no consensus across the Academy was found as to the proper use of the PCOA, and a paucity of literature exists regarding how the PCOA informs schools and colleges about the effectiveness of their curriculum. There is a need for the Academy to establish a uniform application for the PCOA in pharmacy schools, assess the resources that programs need to administer this required assessment, and determine the utility of the PCOA to measure curricular effectiveness and/or student performance.

Evaluation of a journal club preparatory session on student confidence for a graded journal club

INTRODUCTION

The purpose of this project was to describe and assess the impact of a journal club preparatory session on advanced pharmacy practice experience (APPE) student confidence pre- and post-graded journal club.

METHODS

A two-hour journal club preparatory session was implemented for APPE students on rotation with two clinical faculty members. The pre-assessment instructional activity was conducted the first week of each rotation; faculty members took turns working through a randomized-controlled clinical trial, highlighting and discussing key points based on their backgrounds and training. In week three, each student completed a graded journal club assignment that required a written critique and verbal presentation. Student confidence was evaluated pre-and post-activities; the pre-survey was completed prior to the journal club preparatory session and the post-survey was completed in week six.

RESULTS

Thirty-two APPE rotation students participated in journal club activities, with 26 students providing complete data (81% response rate). Mean scores on confidence across all 11 items improved on the post-survey and were statistically significant (p < 0.05). There were no statistically significant differences on change in confidence based on gender, age, with or without an acute care rotation, and with or without previous journal club experience.

CONCLUSION

A journal club preparatory session that walks students through a process prior to a graded activity helps to increase student self-reported confidence.