Evaluating the Effectiveness of an Online Journal Club: Experience from the International Urology Journal Club

A 10-month impact evaluation of a journal club among diagnostic radiographers in a single NHS Trust: A service evaluation study

INTRODUCTION

Journal clubs (JC) have emerged as a popular tool within medical and health professions to deliver outcomes such as promotion of evidence-based practice (EBP), improvement of critical appraisal skills, as well as stimulation of research interest among participating professionals. However, the delivery of these outcomes within the diagnostic radiography profession has not been evidenced and this is the aim of this service evaluation.

METHODS

This evaluation adopted a pre- and post-evaluation survey design to explore the impact of a novel JC introduced among diagnostic radiographers in a UK NHS Trust. Impact was assessed based on four pre-determined outcomes such as Knowledge of EBP, Attitude to EBP, Critical Appraisal Skill and Research interest. Open ended questions in the post evaluation survey were also used to obtain participants feedback on JC activities attended.

RESULTS

Evaluation of the four pre-determined outcomes indicated that JC activities participated by diagnostic radiographers resulted in positive changes across all evaluated categories. Attitude to EBP was the only outcome to show a statistically significant positive change across all participants, highlighting that the JC affected EBP attitudes positively for those that attended. Furthermore, thematic analysis of open-ended questions indicated that the collaboration experienced among JC members during critical appraisal of articles was a motivation for continued participation while factors such as high clinical workload and absence of management in meetings were identified as mitigating barriers.

CONCLUSION

Participation in the JC showed positive improvements in all pre-determined categories. The collaborative nature of JC was motivating for staff, however barriers such as management absence in meetings, and high clinical workload did cause some challenges. Research is recommended to look at the longer-term impact of JC activities amongst diagnostic radiographers.

The Impact on Urology Residents' Learning of Social Media and Web Technologies after the Pandemic: A Step Forward through the Sharing of Knowledge

The COVID-19 pandemic has impacted urology residents and their training. However, several new technologies or knowledge platforms as social media (SoMe) and web-based learning solutions have filled this gap. Therefore, we aimed to analyze resident's learning curves of new learning modalities, identify the evidence that is provided in the literature, and evaluate the possible impact of such solutions in the future. We conducted a non-systematic literature search using Medline, PubMed, and Embase. In addition, online resources of national and international urology resident societies were queried. The identified paper described SoMe, webinars, podcasts, pre-recorded surgical videos, educational platforms, and mobile apps in the field of urology that are used to gain access to information, teach and provide feedback to residents, and were used under the conditions of the pandemic. The application of those technologies harbors the risk of mis- and disinformation, but have the potential to provide access to education and validated knowledge, training, and feedback and thereby might democratize training of residents in urology globally.

Social Media for Research Discourse, Dissemination, and Collaboration in Rheumatology

Social media has become an important venue for rheumatologists, patients, organizations, and other stakeholders to discuss recent research advances in diagnosis and management of rheumatic disorders. In this article, we describe the current state of how social media may enhance dissemination, discourse, and collaboration in rheumatology research. Social media may refer to social platforms like Twitter and Instagram or digital media like podcasts and other websites that are operated for providing as free, open-access medical education (FOAM). Twitter has been one of the most active social media venues and continues to host a vibrant rheumatology community. Examples of research discussions on Twitter include organic user tweets, educational threads ("tweetorials"), live-tweeting academic conferences, and journals posting recently-accepted articles. Some research collaborations have been initiated through social media interactions. Social media may also directly contribute to research by facilitating the recruitment of study participants and the collection of survey-based data. Thus, social media is an evolving and important tool to enhance research discourse, dissemination, and collaboration in rheumatology.

The Power of Hashtags in Social Media: Lessons Learnt from the Urology Tag Ontology Project

Standardisation of hashtags for urologic diseases in the Urology Tag Ontology (UTO) project has facilitated more efficient filtering of social media content. Hashtags must be recognisable and easy to understand. The UTO list should be expanded to include hashtags for urologic procedures and the hashtags could be used on social media platforms other than Twitter to reach a wider audience.

Digital Transformation of Faculty Development: Responding and Supporting Academia During Disruptions Caused by the Coronavirus Disease 2019 Pandemic

INTRODUCTION

The coronavirus disease 2019 pandemic disrupted the current practices for teaching and learning in medical and health professions education, creating challenges and opportunities for rapid transition. The authors describe how McMaster University's Program for Faculty Development (MacPFD) responded to this disruption by engaging in a digital transformation.

METHODS

The digital transformation process of MacPFD was mapped to the conceptual framework of digital transformation: Vial's building blocks of the framework. A new website was launched to host and disseminate the content. Subsequently, both the website and the content were promoted using social media tools. Content generation, Google Analytics, event registrations, and Zoom webinar attendance records were data sources for the results. Analysis of the data was based on the reach component of the RE-AIM framework.

RESULTS

Six-month data range results were reported as producer-centered and user-centered outcomes. The former consisted of 54 resources from diverse content authors, whereas the latter received 33,045 page views from 26,031 unique users from 89 countries. Live webinar events had 1484 registrants, with 312 (21%) being guests from external institutions. Before the coronavirus disease 2019 disruption, MacPFD was a local program to support its faculty.

DISCUSSION

The MacPFD's digital transformation shows a clear transition to a new "glocal" approach: an expanded global reach while still tending to our local development needs of the home institution's faculty members.

Five years of #MedRadJClub: An impact evaluation of an established twitter journal club

INTRODUCTION

Twitter journal clubs are a relatively new adaptation of an established continuing professional development (CPD) activity within healthcare. The medical radiation science (MRS) journal club 'MedRadJClub' (MRJC) was founded in March 2015 by a group of academics, researchers and clinicians as an international forum for the discussion of peer-reviewed papers. To investigate the reach and impact of MRJC, a five-year analysis was conducted.

METHODS

Tweetchat data (number of participants, tweets and impressions) for the first five years of MRJC were extracted and chat topics organised into themes. Fifth anniversary MRJC chat tweets were analysed and examples of academic and professional outputs were collated.

RESULTS

A total of 59 chats have been held over five years with a mean of 41 participants and 483,000 impressions per hour-long synchronous chat. Ten different tweetchat themes were identified, with student engagement/preceptorship the most popular. Eight posters or oral presentations at conferences, one social media workshop and four papers have been produced. Qualitative analysis revealed five core themes relating to the perceived benefits of participation in MRJC: (1) CPD and research impact, (2) professional growth and influencing practice, (3) interdisciplinary learning and inclusion, (4) networking and social support and (5) globalisation.

CONCLUSION

MRJC is a unique, multi-professional, global community with consistent engagement. It is beneficial for both CPD, research engagement, dissemination and socialisation within the MRS community.

Perception of journal club seminars by medical doctoral students: results from five years of evaluation

Objectives: A journal club is one of the well-established and popular methods of post-graduate education. In this work, we were interested to understand how the participants perceive journal club as a whole and how they evaluate their personal process of acquiring new scientific knowledge and development of soft-skills as an indispensable prerequisite of the lifelong learning. Project description: This study is a survey analysis examining perception of journal club sessions by post-graduate medical students. A checklist for journal club preparation as well as a questionnaire for evaluation of the journal club session by participants has been developed to determine if the journal club had met its aims. Data were collected by summing up all answers to each question of the questionnaire for each session. Qualitative data from a five-year evaluation period were compiled and analyzed. Results: The journal club checklist served as a guideline for the preparation of a journal club session as well as an evaluation questionnaire containing 24 items. Our work presents evidence that journal club seminars are well perceived by participants. Furthermore, a high percentage of participants deemed the working atmosphere to be constructive and found it worthwhile to participate in the sessions. The topics of the presentations have been positively evaluated, however only a minority of participants found that the topics of the journal club was related to their own specific research topic. Concerning the distribution of the journal article, we could show that distributing the paper one week before the journal club event provided sufficient time for preparation. Our evaluation revealed that two-thirds of the participants found discussions during journal club sessions rich and productive. The motivation to think more critically increased during journal club sessions. From our work, it is evident that the participants perceived the speakers´ soft-skills to have improved with the practice. Finally, we show a clear trend of improved perception of the value of journal club sessions from beginning to the end of the evaluation time. Conclusion: Based on the analyzed evaluations, we can conclude that journal club events are highly valued by participants and could be a good option for the development of certain soft-skills.

Educational benefits of the online journal club: A systematic review

INTRODUCTION

Online journal clubs (JCs) have increased during the COVID-19 pandemic with the resulting social distancing and popularity of online platforms. This systematic review aims to explore current evidence of their use/benefits for clinicians and compare their value to face-to-face (F2F) JCs.

METHODS

PubMed, Web of Science, and Scopus were searched systematically, adhering to PRISMA guidelines. Articles were included if they involved clinicians in medical/surgical populations, using an online JC assessing utility, experience and educational value. Quality assessment was undertaken using MERSQI.

RESULTS

Fifteen studies were included with findings synthesised into five themes: critical appraisal skills, satisfaction/value, accessibility/environment, evidence-based practice, and preference of online JC. Studies revealed high satisfaction and equivocal or increased preference of online JCs compared to F2F due to ease of access, diverse participation, and less time/cost spent travelling. Online JCs were found to be educationally valuable, aiding development of critical appraisal skills, and promoting change in practice. Disadvantages included lack of discussion intensity, technical issues, and limited interaction on some platforms.

DISCUSSION

Online JCs are educationally valuable with high satisfaction rates and distinct advantages/disadvantages to F2F JCs. More high-quality studies are required to elucidate the ideal format to further improve their educational value, utility, and adoption.

Running a journal club in 2020: reflections and challenges

The online environment brings both challenges and opportunities. The skills learned in journal clubs remain highly relevant where the ability to critique rapidly generated information and apply evidence to patient care is vital. Creativity and flexibility are needed to ensure that learners' needs are met and efforts are made to involve those who may not be naturally drawn to online environments. This article explores how journal clubs have been approached in the past, both in person and more recently online, considers techniques for maintaining engagement in online teaching and proposes new approaches for future journal clubs.

Model for implementation of a modern journal club in medical physics residency programs

Journal clubs are a common educational experience for medical physics residents as a forum to discuss current research within the field. While journal clubs are valued by educational programs and accrediting bodies, there are a wide variety of ways in which these sessions are conducted. Unfortunately, there are currently few studies that have assessed the effectiveness of this educational method. This review defines journal club in the context of a medical physics residency and provides historical background for the meetings. Reasons why journal clubs are valued are presented, and several methods are described for conducting journal clubs. The format of journal clubs and scaffolding methods for guiding residents in gaining independence in critical reading skills are discussed. While the traditional journal club is a meeting, an alternative online virtual journal club is also described. Finally, a model of how a journal club can be applied in a medical physics residency is presented.

COVID-19 and jeopardy of a trainee in the era of minimally invasive surgery

COVID-19 pandemic had a global impact on residency training and surgical training had seen the worst hit. In the current era, the minimal invasive surgery has become inherent component of any surgical speciality training and the COVID-19 crisis has affected the various components of this training including acquisition of knowledge, clinical judgement and technical competency. This impact, coupled with uncertainty in future training and job opportunities have jeopardized the current surgical trainees.

Twitter Use Among Departments of Surgery With General Surgery Residency Programs

OBJECTIVE

To examine patterns of Twitter use by surgery departments with residency programs and understand relevant motivations and concerns. The primary outcome was to quantify account prevalence and activity. The secondary outcomes were to identify reasons for use and perceived benefits and concerns.

DESIGN SETTING, AND PARTICIPANTS

A cross-sectional study was performed on Twitter accounts of departments of surgery with Accreditation Council of Graduate Medical Education accredited general surgery residencies. An anonymous survey was distributed to all programs with accounts. Data acquisition was completed in August 2019 and analysis was completed in February 2020.

RESULTS

Among the 319 departments of surgery, only 80 (25%) had department of surgery Twitter accounts. Mean account age was 3.5 years (range: 0-9.8), with the highest account creation in 2017 (n = 23, 29%). Median total tweets per account was 314 (range 3-21,893), and median number of followers was 454 (range 18-22,353). Having a Twitter account was associated with program type: 66/123 (54%) university-based, 1/9 (11%) military, 13/124 (11%) community/university-affiliated, and 0/63 (0%) community (p < 0.01). Survey response rate was 40% (n = 32). Only 59% had formal posting guidelines. Daily logins (78%) and daily tweeting (53%) were common. The most frequent perceived benefits were "highlighting new research and major events" (97%), "increasing visibility within the academic community" (91%), and "improving resident engagement" (75%). The most common concerns were "professionalism" (72%), "privacy" (63%), and "time commitment" (53%).

CONCLUSIONS

Though only a quarter of departments of general surgery had Twitter accounts, they were felt to be key for improving academic reach. Formal posting guidelines existed for 59% of survey respondents, although concerns about privacy and content were common. An underutilized tool for surgery departments to promote academic achievements, Twitter use represents a potential opportunity to engage the surgical community more broadly.

When residents work less, they feel better: Lessons learned from an unprecedent context of lockdown

Introduction

With the COVID-19 outbreak activities of urology departments have been limited to non-deferrable procedures impacting the daily program of residents in urology. We assessed the psychological impact of the lockdown on Belgian residents in urology and their resounding on the quality of the training.

Material and Methods

A self-administered anonymous questionnaire assessing the risk of burnout in a pandemic situation and its impact on the quality of the training was e-mailed to the members of the European Society of Residents in Urology of Belgium (ESRU-B). We used the Copenhagen Burnout Inventory score which assesses the different dimensions of burnout (personal (CBIP), professional (CBIPro), relational (CBIR)). Several questions evaluating impact on residents’ health and apprehension of the future were included. The survey lasted for 5 days. Comparison of parameters before and during the coronavirus crisis was made using paired samples t-test or Chi² test were.

Results

Fifty percent (62/126) of the ESRU-B members replied to the questionnaire. If 93% of the responders reported a negative impact on the quality of their practical training (CI95 = [0.07–1.10]; P = 0.83), 56% and 61.7% reported a positive impact of the crisis on their life and on their theoretical training respectively. Burnout risk scores were significantly reduced (P < 0.001) for each dimension 7.26 to 3.40 (CBIP), 9.02 to 4.35 (CBIPro) and 4.42 to 3.03 (CBIR) respectively.

Conclusion

Despite a negative impact on the daily work quality, the decrease in activity induced by the lockdown did not have a negative psychological impact on Belgian residents in urology but stress the opportunity to review the current training system to be better balanced between practice and theoretical formation.

Medical and Surgical Education Challenges and Innovations in the COVID-19 Era: A Systematic Review

The aim of this systematic review was to identify the challenges imposed on medical and surgical education by the COVID-19 pandemic, and the proposed innovations enabling the continuation of medical student and resident training. A systematic review on the MEDLINE and EMBASE databases was performed on April 18th, 2020, and yielded 1288 articles. Sixty-one of the included manuscripts were synthesized in a qualitative description focused on two major axes, "challenges" and "innovative solutions", and two minor axes, "mental health" and "medical students in the frontlines". Shortage of personal protective equipment, suspension of clinical clerkships and observerships and reduction in elective surgical cases unavoidably affect medical and surgical education. Interesting solutions involving the use of virtual learning, videoconferencing, social media and telemedicine could effectively tackle the sudden cease in medical education. Furthermore, trainee's mental health should be safeguarded, and medical students can be involved in the COVID-19 clinical treatment if needed.