A guide for evaluation of online learning in medical education: a qualitative reflective analysis

Global prevalence of anxiety and depression among medical students during the COVID-19 pandemic: a systematic review and meta-analysis

PURPOSE

As future physicians, medical students have experienced tremendous pressure during the ongoing COVID-19 pandemic, which is associated with a high risk of depression and anxiety. We aimed to investigate an overview of the prevalence of anxiety and depression among medical students in various countries during the global COVID-19 pandemic, and discuss associated stressors.

METHODS

We systematically searched CINAHL, EMBASE, MEDLINE, PubMed, and Web of Science for relevant articles from December 1, 2019 to March 15, 2023. We performed meta-analysis using a random-effects model with REML method to calculate the pooled prevalence of anxiety and depression. Begg's and Egger's tests were used to identify the potential risk of publication bias. Meta-regression was used to explore potential sources of heterogeneity.

RESULTS

We identified 130 studies reporting anxiety and depression among 132,068 medical students during the COVID-19 pandemic. Eight screening tools were identified for anxiety and six for depression. The pooled prevalence of mental health outcomes for anxiety and depression was 45% (95% confidence interval [CI], 40%-49%) and 48% (95% CI, 43%-52%), respectively. The pooled prevalence of mental health outcomes for moderate and severe anxiety and moderate and severe depression was 28% (95% CI, 24%-32%) and 30% (95% CI, 26%-35%), respectively. There was high heterogeneity between studies, with I2 ranging from 99.58%-99.66%. Continent and survey date were included in the meta-regression model. The results of meta-regression revealed that medical students in Asia had a lower prevalence of anxiety, and depression than those in other regions. The survey date (from February to June, 2020) showed a significantly positive correlation with the prevalence of anxiety and depression.

CONCLUSIONS

We demonstrated the global prevalence of anxiety and depression among medical students during the COVID-19 pandemic. The data highlight that medical students worldwide are at high risk of experiencing anxiety and depression. The reported stressors can be categorized into personal, academic, environmental and cultural, and pandemic factors. Schools and institutions should ensure optimal alternative learning environments for uninterrupted provision of medical education. The appropriate authorities should prioritize the provision of adequate protection for medical students and establish policies to promote new methods of training and education during a disaster, such as via distance learning.

Investigating the impact of remote neuroanatomy education during the COVID-19 pandemic using online examination performance in a National Undergraduate Neuroanatomy Competition

Neuroanatomy is a notoriously challenging subject for medical students to learn. Due to the coronavirus disease-19 (COVID-19) pandemic, anatomical education transitioned to an online format. We assessed student performance in, and attitudes toward, an online neuroanatomy assessment compared to an in-person equivalent, as a marker of the efficacy of remote neuroanatomy education. Participants in the National Undergraduate Neuroanatomy Competition (NUNC) 2021 undertook two online examinations: a neuroanatomically themed multiple-choice question paper and anatomy spotter. Students completed pre- and post-examination questionnaires to gauge their attitudes toward the online competition and prior experience of online anatomical teaching/assessment. To evaluate performance, we compared scores of students who sat the online (2021) and in-person (2017) examinations, using 12 identical neuroradiology questions present in both years. Forty-six percent of NUNC 2021 participants had taken an online anatomy examination in the previous 12 months, but this did not impact examination performance significantly (p > 0.05). There was no significant difference in examination scores between in-person and online examinations using the 12 neuroradiology questions (p = 0.69). Fifty percent of participants found the online format less enjoyable, with 63% citing significantly fewer networking opportunities. The online competition was less stressful for 55% of participants. This study provides some evidence to suggest that student performance is not affected when undertaking online examinations and proposes that online neuroanatomy teaching methods, particularly for neuroradiology, may be equally as effective as in-person approaches within this context. Participants perceived online examinations as less stressful but raised concerns surrounding the networking potential and enjoyment of online events.

Need assessment of medical school curriculum for MOOCs: perspectives of instructors and students of Shiraz University of Medical Sciences

INTRODUCTION

Designing, developing, and implementing a course without assessing and prioritizing instructional needs may result in inefficiency due to the disregard for the actual needs of the target population. The present study aimed to determine and prioritize medical students' instructional needs regarding Massive Open Online Courses (MOOCs) at Shiraz University of Medical Sciences.

METHODS

This survey study was carried out in three stages (2020-2021) using the Delphi technique. Purposive and snowball sampling methods were used to select the instructors. The students were selected through simple random sampling. The first round of the Delphi technique involved a questionnaire consisting of one open-ended question, completed by 49 basic/clinical faculty members and 47 senior medical students. In the second round, a 5-point Likert scale-based questionnaire was used to prioritize the instructional needs. The reliability of the questionnaire was verified by Cronbach's alpha coefficient. In the third round, a focus group was used. A total of six expert faculty members and one senior medical student were invited to the focus group session to prioritize the needs. Data were analyzed using Friedman's non-parametric ranking test in SPSS version 26.

RESULTS

Ten instructional needs priorities were extracted, including common pharmacotherapies (antibiotics and narcotics), prescriptions, physiology, anatomy, physical examination, electrocardiography interpretation, radiography, computed tomography scans, serum electrolyte disorders, and cardiovascular and internal (endocrine and metabolic) diseases. The chi-squared calculated value (715.584) indicated a significant difference in the importance of the questionnaire's questions (P < 0.001). These questions did not have equal value, and the importance, from the respondent's point of view and the observed distribution of ranks, was not the output of a random factor.

CONCLUSIONS

The findings of this study can be used to design MOOCs, revise instructional programs, and adapt the curriculum to meet the needs of general practitioners, which will, in turn, help meet the medical needs of the general population.

Pivoting Continuing Professional Development During the COVID-19 Pandemic: A Narrative Scoping Review of Adaptations and Innovations

INTRODUCTION

Most formal continuing professional development (CPD) opportunities were offered in person until March 2020 when the COVID-19 pandemic disrupted traditional structures of CPD offerings. The authors explored the adaptations and innovations in CPD that were strengthened or newly created during the first 16 months of the pandemic.

METHODS

The objectives of the narrative review were to answer the following questions: (1) what types of adaptations to CPD innovations are described? and (2) what may shape future innovations in CPD? The following databases were searched: Medline, Embase, CINAHL, and ERIC to identify the literature published between March 2020 to July 2021. The authors conducted a comprehensive search by including all study types that described adaptations and/or innovations in CPD during the stated pandemic period.

RESULTS

Of the 8295 citations retrieved from databases, 191 satisfied the inclusion criteria. The authors found three categories to describe adaptations to CPD innovations: (1) creation of new online resources, (2) increased use of the existing online platforms/software to deliver CPD, and (3) use of simulation for teaching and learning. Reported advantages and disadvantages associated with these adaptations included logistical, interactional, and capacity building elements. The review identified five potential future CPD innovations: (1) empirical research on the effectiveness of virtual learning; (2) novel roles and ways of thinking; (3) learning from other disciplines beyond medicine; (4) formation of a global perspective; and (5) emerging wellness initiatives.

DISCUSSION

This review provided an overview of the adaptations and innovations that may shape the future of CPD beyond the pandemic.

Standards for evaluating the quality of undergraduate nursing e-learning programme in low- and middle-income countries: a modified Delphi study

BACKGROUND

The lack of standards for evaluating the quality of undergraduate nursing programmes hampers the evaluation of e-learning programmes in low- and middle-income countries. Fragmented approaches to evaluation coupled with a lack of uniform criteria have been a major deterrent to the growth of e-learning. Adopting standards from high-income countries has contextual challenges in low- and middle-income countries (LMICs). Holistic approaches coupled with uniform standards provide information to stakeholders hence the quality of the programmes is measurable. The e-learning situation in low-and middle-income countries provided an impetus to develop and validate these standards.

DESIGN

A modified Delphi technique.

REVIEW METHODS

Fourteen experts with experience and expertise in e-learning and regulation of undergraduate nursing from fourteen countries from LMICs participated in three rounds of the modified Delphi process. A pre-described set of standards was shared electronically for independent and blinded ratings. An 80% threshold was set for consensus decisions. The standards were modified based on experts' comments, and two subsequent rounds were used to refine the standards and criteria.

RESULTS

At the end of round one, the expert consensus was to keep 67, modify 39 and remove three criteria. At the end of the second round, the consensus was to modify 38 and remove one criteria. In the third round, experts agreed that the standards were feasible, usable, and practical in LMICs. A total of six broad standards with 104 criteria were developed.

CONCLUSION

The Technological bloom permeating all spheres of society, including education is an essential component in the development of e-learning programmes. E-learning in nursing education requires critical evaluation to ensure quality in undergraduate nursing programmes. The intricacies of the Low and middle-income context were taken into consideration in developing the standards to offer sustainable evaluation of the quality of e-learning in LMICs, and local solutions to local problems.

Undergraduate e-learning programmes in health professions: An integrative review of evaluation standards in low- and middle-income countries

BACKGROUND

Before the Coronavirus COVID-19, universities offered blended learning as a mode of study. However, with the closure of all educational institutions, after the pandemic, most of these institutions were required to transition to e-learning to support continuous student learning. This transition was challenging to most institutions, as there were no standards to ensure the quality of e-learning. During this literature review, the researcher aimed to explore relevant literature and provide insight into the standards for undergraduate e-learning programmes in the health professions.

DESIGN

An integrative review of literature.

DATA SOURCES

Online databases MEDLINE, CINAHL with full text, Academic search ultimate, APA PsycInfo, ERIC, Health Source: Nursing/academic edition, CAB abstracts, Africa-wide information, Sociology source ultimate, and Communication and Mass media complete were searched.

MATERIALS AND METHODS

Studies pertaining to low- and middle-income countries (LMICs) on standards in evaluating undergraduate e-learning programmes in health professions, published between January 2010 to June 2022, were considered. A two-step process was followed involving three reviewers and guided by an inclusion criteria focused on the evaluation of undergraduate e-learning programmes in the health professions. The initial hit produced 610 articles altogether, and eight articles that met the inclusion criteria were included in the study. Data was then extracted and analysed, and key themes were identified.

RESULTS

Eight Key themes related to LMIC standards emerged from the eight selected articles: curriculum planning, proficiency of educators, learner proficiency and attitude, infrastructure for learning, support and evaluation.

CONCLUSION

In this review, we synthesised standards that have been used for evaluating undergraduate e-learning programmes in health professions in LMICs. A gap in standards related to clinical teaching and learning in undergraduate e-learning programmes in the health professions was evident from all the included articles. The identification of the eight unique LMIC standards in this review could contribute to guiding towards contextually appropriate quality e-learning programmes in the health professions.

Lessons learned from a pandemic: implications for a combined exercise and educational programme for medical students

BACKGROUND

The 'MED-WELL' programme is a combined exercise and educational intervention designed to promote well-being among medical students and educate students about prescribing exercise as medicine in clinical practice. Due to COVID-19 public health restrictions of social distancing the 'MED-WELL' programme was offered online instead of in-person in 2021. The aim of this study is to compare the experiences of participants in the 'MED-WELL' programme online to those that previously participated in the same programme in-person to understand the student experience and optimize programme delivery.

METHODS

Purposive sampling was used to recruit 20 participants to a qualitative study using semi-structured interviews. Ten study participants took part in the 'MED-WELL' programme when it was offered in-person, and the other ten study participants took part in the programme when it was offered online. All interviews were audio-recorded and transcribed using Microsoft Teams. A combined inductive and deductive approach was used for analysis. An inductive thematic analysis was utilized to categorize data into higher order codes, themes, and overarching themes. The theory of online learning provided the theoretical framework for a deductive approach.

RESULTS

Analysis of the data produced five overarching themes: 'student-student', 'student-teacher', 'student-content', 'student-environment', and 'effects of a pandemic'. The first four themes detail distinct types of interaction that participants had with various entities of the 'MED-WELL' programme and the effects that these interactions had on participant experiences. 'Effects of a pandemic' refers to the context of delivering the 'MED-WELL' programme online during a pandemic and how this mode of delivery influenced participants and the programme.

CONCLUSIONS

Optimizing the 'MED-WELL' programme relies on an understanding of how participants interact with different entities of the programme and are motivated to attend and engage. Participants tended to favour an in-person mode of delivery, however certain advantages of delivering the programme online were also identified. The findings from this study can be used to inform similar experiential and educational exercise interventions, and may help plan for potential future restrictions on in-person educational and exercise-based programmes.

Online medical education in Egypt during the COVID-19 pandemic: a nationwide assessment of medical students' usage and perceptions

BACKGROUND

The coronavirus (COVID-19) pandemic required a transformation of medical education in Egypt. Public health measures necessitated a rapid shift from traditional face to face lectures to largely online platforms following campus closures. The aim of this study is to characterize medical student use and perception of online medical education in Egypt as well as exploring the efficacy of different e-learning modalities. Additionally, many barriers and opportunities as perceived by students are reviewed to inform future educational improvements.

METHODS

A 29-item online survey was created on google forms and distributed by social media to medical students across 26 Egyptian medical schools. The survey was administered from August 20th, 2021, to September 5th, 2021. The survey consisted of a mixture of questions style. The medical students were asked about their experiences with online medical education during the COVID-19 pandemic as well as medical students' anxiety, perceived academic performance, and obstacles related to online education.

RESULTS

Of the 4935 responses collected, 43.4% (n = 2140) of respondents were women; 56.6% (n = 2795) were men. Medical students from private medical schools were 13.0% (n = 644), whereas 87.0% (n = 4291) were from public medical schools. 54.6% of students reported that online education is not as effective as face-to-face education. There was a significant rise in hours spent by medical students on online medical education compared to before COVID-19 pandemic. More than half of students (63%) agreed that online recorded video tutorials (e.g., YouTube) were the most effective form of online medical education.

CONCLUSION

The shift to online education has significantly impacted medical students in Egypt. Medical students reported various limitations and challenges of online medical education, which must be addressed considering the potential benefits of online platforms over traditional face to face learning. The results of this nationwide study provide a framework for potential areas to implement change to improve the accessibility and structure of online medical education in Egypt.

A guide to best practice in faculty development for health professions schools: a qualitative analysis

BACKGROUND

This is a practice guide for the evaluation tool specifically created to objectively evaluate longitudinal faculty development programs (FDP) using the "5×2 -D backward planning faculty development model". It was necessary to create this tool as existing evaluation methods are designed to evaluate linear faculty development models with a specific endpoint. This backward planning approach is a cyclical model without an endpoint, consisting of 5 dynamic steps that are flexible and interchangeable, therefore can be a base for an evaluation tool that is objective and takes into account all the domains of the FDP in contrast to the existing, traditional, linear evaluation tools which focus on individual aspects of the program. The developed tool will target evaluation of longitudinal faculty development programs regardless of how they were planned.

METHODOLOGY

Deductive qualitative grounded theory approach was used. Evaluation questions were generated and tailored based on the 5 × 2-D model followed by 2 Delphi rounds to finalize them. Based on the finalized evaluation questions from the results of the Delphi rounds, two online focus group discussions (FGDs) were conducted to deduce the indicators, data sources and data collection method.

RESULTS

Based on the suggested additions, the authors added 1 new question to domains B, with a total of 42 modifications, such as wording changes or discarding or merging questions. Some domains received no comments, therefore, were not included in round 2. For each evaluation question, authors generated indicators, data sources and data collection methods during the FGD.

CONCLUSION

The methodology used to develop this tool takes into account expert opinions. Comprehensiveness of this tool makes it an ideal evaluation tool during self-evaluation or external quality assurance for longitudinal FDP. After its validation and testing, this practice guide can be used worldwide, along with the provided indicators which can be quantified and used to suit the local context.

Challenges and Innovations Brought about by the COVID-19 Pandemic Regarding Medical and Pharmacy Education Especially in Africa and Implications for the Future

BACKGROUND

Multiple measures introduced early to restrict COVID-19 have dramatically impacted the teaching of medical and pharmacy students, exacerbated by the lack of infrastructure and experience with e-learning at the start of the pandemic. In addition, the costs and reliability of the Internet across Africa pose challenges alongside undertaking clinical teaching and practical programmes. Consequently, there is a need to understand the many challenges and how these were addressed, given increasingly complex patients, to provide future direction.

METHOD

An exploratory study was conducted among senior-level medical and pharmacy educators across Africa, addressing four key questions, including the challenges resulting from the pandemic and how these were dealt with.

RESULTS

Staff and student members faced multiple challenges initially, including adapting to online learning. In addition, concerns with the lack of equipment (especially among disadvantaged students), the costs of Internet bundles, and how to conduct practicals and clinical teaching. Multiple activities were undertaken to address these challenges. These included training sessions, developing innovative approaches to teaching, and seeking ways to reduce Internet costs. Robust approaches to practicals, clinical teaching, and assessments have been developed.

CONCLUSIONS

Appreciable difficulties to teaching arising from the pandemic are being addressed across Africa. Research is ongoing to improve education and assessments.

Outcomes of Remote Pathology Instruction in Student Performance and Course Evaluation

The coronavirus disease 2019 (COVID-19) pandemic has disrupted undergraduate medical education, including preclinical class-based courses, by requiring social distancing and essentially eliminating in-person teaching. The aim of this study was to compare student performance and satisfaction before and after implementation of remote instruction in a first-year introductory pathology course. Assessments (3 quizzes, 1 practical exam, and 1 final) were compared between courses given before (January 2020) and during (January 2021) the COVID-19 pandemic, in terms of mean scores, degree of difficulty, and item discrimination, both overall and across different question types. Students’ evaluations of the course (Likert scale-based) were also compared between the 2 years. Significantly higher mean scores were observed during remote instruction (compared to the prior, in-person year) on verbatim-repeated questions (94.9 ± 8.8 vs 89.4 ± 12.2; P = .002) and on questions incorporating a gross specimen image (88.4 ± 7.5 vs 84.4 ± 10.3; P = .007). The percentage of questions that were determined to be moderate/hard in degree of difficulty and good/very good in item discrimination remained similar between the 2 time periods. In the practical examination, students performed significantly better during remote instruction on questions without specimen images (96.5 ± 7.0 vs 91.2 ± 15.2; P = .004). Finally, course evaluation metrics improved, with students giving a higher mean rating value in each measured end point of course quality during the year of remote instruction. In conclusion, student performance and course satisfaction generally improved with remote instruction, suggesting that the changes implemented, and their consequences, should perhaps inform future curriculum improvements.

Fully digital problem-based learning for undergraduate medical students during the COVID-19 period: Practical considerations

Digital problem-based learning (PBL) was originally introduced as a means to improve student engagement and increase flexibility. However, its use becomes mandatory during the coronavirus disease 2019 (COVID-19) period, accelerating changes in medical education. Few elaborated on the implementation details of digital PBL curricula. Technical guidance can be important but under-recognized prerequisite of a successful digital PBL session. In National Taiwan University College of Medicine, we established a digital PBL curriculum and previously validated a confidence questionnaire for surveying undergraduate students receiving digital PBL sessions. In this opinion piece, we gleaned multiple procedural details from our experiences based on students'/tutors' feedback, which we summarized in a 5″W″ recommendations (Who), timing/duration (When), location (Where), software/hardware/topics (What), and evaluation aspects (Why). Suggestions on how to optimally prepare for digital PBL session are also provided. We believe that these tips can further facilitate the wide adoption of digital PBL.