Quality Appraisal and Assurance Techniques for Free Open Access Medical Education (FOAM) Resources: A Rapid Review

Knowledge assessment tool for pediatric parenteral nutrition: A validation study

BACKGROUND

Parenteral nutrition (PN) is a high-risk medication, and its prescription and administration requires extensive training. Difficulties inherent with bedside teaching have made teaching these concepts challenging. Currently, no knowledge assessment tools with validity evidence exist to test the effectiveness of new PN teaching interventions. We sought to develop and provide validity evidence for a pediatric PN knowledge test to measure the effectiveness of future teaching interventions.

METHODS

We created a multiple-choice question knowledge assessment tool that underwent content validation by PN experts and was emailed to potential participants. We evaluated the knowledge assessment tool for factorial validity, internal consistency reliability, and discriminant validity.

RESULTS

We enrolled 103 medical students (40%), residents and fellow trainees (55%), and attending physicians (5%) into the study between October 2021 and October 2022. Five of the 30 questions performed poorly based on their nonsignificant contribution to the primary aim of assessing pediatric PN knowledge. Following the exclusion of those questions, the knowledge assessment tool demonstrated an acceptable model fit, and the root mean squared error of approximation was <5%. The omega coefficient was 0.829, indicating acceptable levels of reliability, and using an analysis of variance test (ANOVA) demonstrated significant differences between groups, showing good discrimination between levels of experience (F[2, 80] = 39.002; P < 0.001).

CONCLUSION

We have developed and provided validity evidence for a multiple-choice question knowledge test that may be used by educators and programs to evaluate knowledge of pediatric PN in physicians and trainees.

Using social media for patient care, research, and professional development: A North American Society of Pediatric Gastroenterology, Hepatology, and Nutrition position paper

The advent of social media has changed numerous aspects of modern life, with users developing and maintaining personal and professional relationships, following and sharing breaking news and importantly, searching for and disseminating health information and medical research. In the present paper, we reviewed available literature to outline the potential uses, pitfalls and impacts of social media for providers, scientists and institutions involved in digestive health in the domains of patient care, research and professional development. We recommend that these groups become more active participants on social media platforms to combat misinformation, advocate for patients, and curate and disseminate valuable research and educational materials. We also recommend that societies such as NASPGHAN assist its members in accessing training on effective social media use and the creation and maintenance of public-facing profiles and that academic institutions incorporate substantive social media contributions into academic promotion processes.

Online learning in health professions education. Part 2: Tools and practical application: AMEE Guide No. 163

Part 1 of the AMEE Guide Online learning in health professions education focused on foundational concepts such as theory, methods, and instructional design in online learning. Part 2 builds upon Part 1, introducing technology tools and applications of these foundational concepts by exploring the various levels (from beginner to advanced) of utilisation, while describing how their usage can transform Health Professions Education. This Part covers Learning Management Systems, infographics, podcasting, videos, websites, social media, online discussion forums, simulation, virtual patients, extended and virtual reality. Intertwined are other topics, such as online small group teaching, game-based learning, FOAM, online social and collaboration learning, and virtual care teaching. We end by discussing digital scholarship and emerging technologies. Combined with Part 1, the overall aim of Part 2 is to produce a comprehensive overview to help guide effective use online learning in Health Professions Education.

Digital Impact Factor: A Quality Index for Educational Blogs and Podcasts in Emergency Medicine and Critical Care

STUDY OBJECTIVE

Given the popularity of educational blogs and podcasts in medicine, learners and educators need tools to identify trusted and impactful sites. The Social Media Index was a multi-sourced formula to rank the effect of emergency medicine and critical care blogs. In 2022, a key data point for the Social Media Index became unavailable. This bibliometric study aimed to develop a new measure, the Digital Impact Factor, as a replacement.

METHODS

The Digital Impact Factor incorporated modern measures of website authority and reach. This formula was applied to a cross-sectional study of active emergency medicine and critical care blogs and podcasts. For each website, we generated a Digital Impact Factor score based on Ahrefs Domain Rating and the follower count of the websites' pages from 8 social media platforms. A series of Spearman correlations provided evidence of association by comparing a rank-ordered list to rank lists derived from the Social Media Index over the last 5 years. The Bland-Altman analysis assessed for agreement.

RESULTS

The authors identified 88 relevant websites with a median Ahrefs Domain Rating of 28 (range 0 to 71, maximum 100) and total social media followership count across 8 platforms of 1,828,557. The Domain Rating and individual social media followership scores were normalized based on the highest recorded values to yield the Digital Impact Factor (median 4.57; range 0.02 to 9.50, maximum 10). The correlation between the 2022 Digital Impact Factor and the 2021 Social Media Index was 0.94 (95% confidence interval 0.89 to 0.97; p<.001; n=41 rankings correlated), suggesting that they measure similar constructs. The Bland-Altman plot also demonstrated fair agreement between the 2 scores.

CONCLUSION

The Digital Impact Factor is a measure of the relative effect of educational blogs and podcasts within emergency medicine and critical care.

Engagement in Free Open Access Medical Education by US Nephrology Fellows

BACKGROUND

As free open access medical education (FOAMed) use increases, it is important to characterize how and why learners are using this educational material in nephrology. We describe the frequency, purpose, and type of FOAMed usage across US nephrology fellows.

METHODS

In this cross-sectional survey, items were emailed to all US adult and pediatric nephrology fellows via the American Society of Nephrology (ASN) Fellow Survey in May 2022. The eight-item survey, developed to measure FOAMed engagement, had previously undergone instrument validation. The results were analyzed by descriptive statistics.

RESULTS

In total, 43% (359/842) adult nephrology fellows and 51% (45/88) pediatric nephrology fellows completed the survey. Seventy-four percent (300/404) of fellows reported using FOAMed, and 72% (215/300) started using FOAMed within the past 2 years. Of FOAMed users, 41% (122/300) reported viewing FOAMed and 33% (99/300) reported applying knowledge gained from these resources daily or weekly. Common purposes for FOAMed engagement included searching Twitter to learn about others' opinions in the field (43%; 130/300), reading blogs to answer clinical questions (35%; 105/300), and listening to podcasts for the most up-to-date information (39%; 116/300). Compared with traditional educational resources, fellows preferred using FOAMed for staying up to date on nephrology topics (75%) and answering clinical questions (37%). Among all fellows, the greatest barriers to FOAMed use were unfamiliarity with FOAMed (27%; 111/404), validity concerns (22%; 90/404), and a lack of a local community of FOAMed users (22%; 87/404).

CONCLUSIONS

Seventy-four percent of nephrology fellows used FOAMed resources in a variety of ways, and of them, 33% of fellows clinically applied knowledge gained from these resources. Reasons for engaging with FOAMed varied across resources.

Evolution in Congenital Cardiology Education: The Rise of Digital-Learning Tools

Technology-enhanced learning is now an established part of medical education due to its ready availability and on-demand nature. This offers new opportunities but also challenges to both learners and teachers. This review outlines the current use of social media tools and online resources in medical education with a particular emphasis on congenital cardiology. It provides strategies to the reader on how to optimize learning in the digital environment and offers guidance on how such tools can be incorporated into routine educational practice. Suggestions for developing and assessing educational material online are discussed. Lastly, the concepts of digital professionalism and digital scholarship are explored to aid medical teachers and educators employ these technologies effectively into their teaching and career development.

Assessing on-line medical education resources: A primer for acute care medical professionals and others

The internet is increasingly used to propagate medical education, debate, and even disinformation. Therefore, this primer aims to help acute care medical professionals, as well as the public. This is because we all need to be able to critically appraise digital products, appraise content producers, and reflect upon our own on-line presence. This article discusses the challenges and opportunities associated with online medical resources. We then review Free Open Access Medical Education (FOAMed) and the key tools used to assess the trustworthiness of on-line medical products. Specifically, after discussing the pros and cons of traditional academic quality metrics, we compare and contrast the Social Media Index, the ALiEM AIR score, the Revised METRIQ Score, and gestalt. We also discuss internet search engines, peer review, and the important message behind the seemingly tongue-in-cheek Kardashian Index. Hopefully, this primer bolsters basic digital literacy and helps trainees, practitioners, and the public locate useful and reliable on-line resources. Importantly, we highlight the continued importance of traditional academic medicine and primary source publications.

COVID-19 Intensive Care—Evaluation of Public Information Sources and Current Standards of Care in German Intensive Care Units: A Cross Sectional Online Survey on Intensive Care Staff in Germany

Backround: In February 2021, the first formal evidence and consensus-based (S3) guidelines for the inpatient treatment of patients with COVID-19 were published in Germany and have been updated twice during 2021. The aim of the present study is to re-evaluate the dissemination pathways and strategies for ICU staff (first evaluation in December 2020 when previous versions of consensus-based guidelines (S2k) were published) and question selected aspects of guideline adherence of standard care for patients with COVID-19 in the ICU. Methods: We conducted an anonymous online survey among German intensive care staff from 11 October 2021 to 11 November 2021. We distributed the survey via e-mail in intensive care facilities and requested redirection to additional intensive care staff (snowball sampling). Results: There was a difference between the professional groups in the number, selection and qualitative assessment of information sources about COVID-19. Standard operating procedures were most frequently used by all occupational groups and received a high quality rating. Physicians preferred sources for active information search (e.g., medical journals), while nurses predominantly used passive consumable sources (e.g., every-day media). Despite differences in usage behaviour, the sources were rated similarly in terms of the quality of the information on COVID-19. The trusted organizations have not changed over time. The use of guidelines was frequently stated and highly recommended. The majority of the participants reported guideline-compliant treatment. Nevertheless, there were certain variations in the use of medication as well as the criteria chosen for discontinuing non-invasive ventilation (NIV) compared to guideline recommendations. Conclusions: An adequate external source of information for nursing staff is lacking, the usual sources of physicians are only appropriate for the minority of nursing staff. The self-reported use of guidelines is high.

Medical Education Blog and Podcast Utilization During the COVID-19 Pandemic

Introduction The coronavirus disease 2019 (COVID-19) pandemic disrupted traditional in-person learning models. Free Open Access Medical (FOAM) education resources naturally filled this void, so we evaluated how medical blog and podcast utilization changed during the early months of the pandemic. Methods Academic medical podcast and blog producers were surveyed on blog and podcast utilization immediately before (January-March 2020) and after (April-May 2020) the COVID-19 pandemic declaration and subsequent lockdown. Utilization is quantified in terms of blog post pageviews and podcast downloads. Linear regression was used to estimate the effect of publication during the COVID-19 period on 30-day downloads or pageviews. A linear mixed model was developed to confirm this relationship after adjustment for independent predictors of higher 30-day downloads or pageviews, using the podcast or blog as a random intercept. Results Compared to the pre-pandemic period, downloads and pageviews per unique blog and podcast publication significantly increased for blogs (median 30-day pageviews 802 to 1860, p<0.0001) but not for podcasts (median 30-day downloads 2726 to 1781, p=0.27). Publications that contained COVID-19 content were strongly associated with higher monthly utilization (β=7.21, 95% CI 6.29-8.14 p<0.001), and even non-COVID-19 material had higher utilization in the early pandemic (median 30-day downloads/pageviews 868 to 1380, p<0.0001). Discussion The increased blog pageviews during the early months of the COVID-19 pandemic demonstrated the important role of blogs in rapid knowledge translation. Podcasts did not experience a similar increase in utilization.

Identifying Social Media Competencies for Health Professionals: An International Modified Delphi Study to Determine Consensus for Curricular Design

STUDY OBJECTIVE

The use of social media by health professionals is widespread. However, there is a lack of training to support the effective use of these novel platforms that account for the nuances of an effective health and research communication. We sought to identify the competencies needed by health care professionals to develop an effective social media presence as a medical professional, with the goal of building a social media curriculum.

METHODS

We conducted a modified Delphi study, utilizing Kraiger's Knowledge, Skills, and Attitudes framework to identify appropriate items for inclusion in a social media curriculum targeted at health care professionals. Experts in this space were defined as health care professionals who had delivered workshops, published papers, or developed prominent social media tools/accounts. They were recruited through a multimodal campaign to complete a series of 3 survey rounds designed to build consensus. In keeping with prior studies, a threshold of 80% endorsement was used for inclusion in the final list of items.

RESULTS

Ninety-eight participants met the expert criteria and were invited to participate in the study. Of the 98 participants, 92 (94%) experts completed the first round; of the 92 experts who completed the first round, 83 (90%) completed the second round; and of the 83 experts who completed the second round, 81 (98%) completed the third round of the Delphi study. Eighteen new items were suggested in the first survey and incorporated into the study. A total of 46 items met the 80% inclusion threshold.

CONCLUSION

We identified 46 items that were believed to be important for health care professionals using social media. This list should inform the development of curricular activities and objectives.

Going viral: A scoping review of the current state and impact of online research dissemination in emergency medicine

BACKGROUND

The use of free open-access medical education (FOAM) and other online knowledge dissemination methods has increased over the past decade. However, the role and impact of these tools in the knowledge translation continuum are poorly understood, potentially limiting the ability of knowledge generators to fully harness and exploit their potential. Here, we aim to comprehensively map and synthesize the literature describing the use of online tools for the dissemination of emergency medicine research.

METHODS

Using scoping review methodology, we searched the traditional literature via PubMed, CINAHL, EMBASE, ERIC, SCOPUS, and the gray literature for publications exploring online methods to disseminate new research findings. We synthesized the results and constructed a conceptual model of current research dissemination methods.

RESULTS

We included 79 out of 655 unique abstracts and articles identified in our search, 62 of which were from the traditional literature. We describe six primary domains: integration with traditional literature, measurement of dissemination, online organizations and communities of practice, professional development, quality assurance tools and techniques, and advantages and disadvantages of FOAM. For each domain we present an exemplar article and prevailing gaps in knowledge. Finally, we propose a current conceptual framework for dissemination of new research findings that describes both traditional and novel methods of dissemination.

CONCLUSIONS

This comprehensive review of the literature and current dissemination framework will empower researchers, research networks, and granting organizations to maximize their use of FOAM and other online methods to disseminate new knowledge as well as provide clinicians a better understanding of the tools and methods by which to access and implement new research findings.

The Journal Club 3.0: A qualitative, multisite study examining a new educational paradigm in the era of open educational resources

BACKGROUND

The journal club is a ubiquitous and time-honored tradition within medical education. However, in recent years, open educational resources (OERs) have become increasingly influential in how physicians interact with the medical literature across multiple specialties. The authors sought to explore how emergency medicine (EM) resident physicians reconcile different perspectives across OERs into their educational experience at the journal club.

METHODS

From January 2018 to September 2019, the authors enrolled 25 EM residents from four teaching sites associated with the University of British Columbia, Canada, to participate in either a focus group (seven residents) or individual interviews (18 residents). The authors used a snowball sampling technique. Using a constructivist grounded theory analysis, two investigators independently reviewed transcripts, meeting regularly to discuss themes until sufficiency was achieved.

RESULTS

The study data expand the theoretical understanding of the resident journal club experience. Residents used multiple sources including OERs to learn about new evidence in the specialty. The rise of OERs helped residents to focus on developing critical appraisal skills and social bonds during the journal club. The local journal club gained a new relevancy in acting as a quality control mechanism against the premature adoption of research findings discussed in OERs.

DISCUSSION

To date, most educators assume that residents prepare for a journal club by reading the selected articles and applying knowledge from their previous education. Instead, our findings suggest a more dynamic experience that integrates OERs. OERs enhance the journal club experience by allowing junior residents to more easily participate in discussions and to broaden the discussion to multiple clinical settings. Understanding these processes could inform future educational strategies around the journal club.

Pediatric Critical Care in Resource Limited Settings-Lessening the Gap Through Ongoing Collaboration, Advancement in Research and Technological Innovations

Pediatric critical care has continued to advance since our last article, "Pediatric Critical Care in Resource-Limited Settings-Overview and Lessons Learned" was written just 3 years ago. In that article, we reviewed the history, current state, and gaps in level of care between low- and middle-income countries (LMICs) and high-income countries (HICs). In this article, we have highlighted recent advancements in pediatric critical care in LMICs in the areas of research, training and education, and technology. We acknowledge how the COVID-19 pandemic has contributed to increasing the speed of some developments. We discuss the advancements, some lessons learned, as well as the ongoing gaps that need to be addressed in the coming decade. Continued understanding of the importance of equitable sustainable partnerships in the bidirectional exchange of knowledge and collaboration in all advancement efforts (research, technology, etc.) remains essential to guide all of us to new frontiers in pediatric critical care.

What the COVID-19 Pandemic Can Teach Health Professionals About Continuing Professional Development

The world's health care providers have realized that being agile in their thinking and growth in times of rapid change is paramount and that continuing education can be a key facet of the future of health care. As the world recovers from the COVID-19 pandemic, educators at academic health centers are faced with a crucial question: How can continuing professional development (CPD) within teams and health systems be improved so that health care providers will be ready for the next disruption? How can new information about the next disruption be collected and disseminated so that interprofessional teams will be able to effectively and efficiently manage a new disease, new information, or new procedures and keep themselves safe? Unlike undergraduate and graduate/postgraduate education, CPD does not always have an identified educational home and has had uneven and limited innovation during the pandemic. In this commentary, the authors explore the barriers to change in this sector and propose 4 principles that may serve to guide a way forward: identifying a home for interprofessional continuing education at academic health centers, improving workplace-based learning, enhancing assessment for individuals within health care teams, and creating a culture of continuous learning that promotes population health.

Planning Engaging, Remote, Synchronous Didactics in the COVID-19 Pandemic Era

As part of the Accreditation Council for Graduate Medical Education requirements, residents must participate in structured didactic activities. Traditional didactics include lectures, grand rounds, simulations, case discussions, and other forms of in-person synchronous learning. The COVID-19 pandemic has made in-person activities less feasible, as many programs have been forced to transition to remote didactics. Educators must still achieve the goals and objectives of their didactic curriculum despite the new limitations on instructional strategies. There are several strategies that may be useful for organizing and creating a remote residency didactic curriculum. Educators must master new technology, be flexible and creative, and set rules of engagement for instructors and learners. Establishing best practices for remote didactics will result in successful, remote, synchronous didactics; reduce the impact of transitioning to a remote learning environment; and keep educators and learners safe as shelter-at-home orders remain in place.