Psychometric analysis of Anatomy MCQs in Modular examination

Comparing students' performance in self-directed and directed self-learning in College of Medicine, University of Bisha

Background

Student-centered learning strategy increases the likelihood of graduation of competent, self-dependent, and problem-solving physicians. The University of Bisha, College of Medicine (UBCOM) adopted self-directed learning (SDL) represented by problem-based learning (PBL), and directed self-learning (DSL) represented by team-based learning (TBL).

Aim

To compare the students' performance in SDL and DSL among UBCOM students.

Methodology

A total of 502 multiple choice questions (MCQs) from the mid-course and final exams were collected by the relevant subject experts from nine courses during the period from September 2020 till June 2023 that adopted PBL and TBL; 247 MCQs related to PBL and 255 related to TBL. Psychometric analysis was used to determine difficult, easy, and optimum questions (≤25%, ≥90%, and 26-89%, respectively). Point biserial as <0.19, 0.20-0.29, 0.30-0.39, and >0.40 which indicate poor, marginal, good, and excellent point biserial, respectively. Finally, the number of functional distractors was attempted by >5% of the candidates.

Results

No significant differences were noted for the students' performance in MCQs related to PBL (representing self-directed, small group learning tool), and TBL (representing directed-self, large group learning tool) regarding difficulty index (DI), point biserial, and distractors functionality.

Conclusion

It has been observed that there is no difference in students' performance whether PBL or TBL is used for learning Basic Medical Science courses. Small group learning such as PBL needs more resources in comparison to large group learning as in TBL, therefore any institute can decide on the adopted learning strategy depending on its resources and the number of students.

Implications of introducing case based radiological images in anatomy on teaching, learning and assessment of medical students: a mixed-methods study

BACKGROUND

Introducing radiological anatomy in the preclinical curriculum can increase the understanding of Anatomy. Regardless of the integration when teaching anatomy, it is essential to maintain oversight as to what and how much is being taught. In addition, the knowledge requirements for preclinical students should be considered. The purpose of this kind of integration is that the student should be able to apply the knowledge which can help them better understand anatomy and not to make the course more challenging. This study aimed to understand whether adding radiological images would increase the difficulty level of the questions.

METHODS

We introduced radiological images, including X Rays, CT scans and MRIs, when teaching anatomy in the preclinical curriculum. A class of 99 students were tested using A-type MCQs (n = 84). All 84 questions were categorized on whether they were case-based with or without a radiological image. The item analysis of both groups of test questions was then compared based on their difficulty and discrimination index. A qualitative student perception regarding the inclusion of radiological images in anatomy was also measured using a questionnaire with a 5-point Likert scale.

RESULTS

The results showed that the performance level of the students was similar when comparing the test questions in both groups. The item analysis of the MCQs in the two groups revealed that by integrating radiological images when teaching anatomy, the various parameters in both groups of test questions were in the same range. More than 80% of the students felt that radiological images facilitate the achievement of learning outcomes and help to apply their knowledge in clinical contexts. The study's findings reported that the rate of satisfaction by including radiological images when teaching anatomy is high.

CONCLUSION

Recognition and interpretation of images are essential in an undergraduate medical program. Students found it helpful when radiological images were introduced to them when teaching anatomy. Since the students' performance in summative exams in both groups of questions was in the same range, the findings also point out that adding radiological images when teaching anatomy does not increase the difficulty of the subject.

Assessing the educational impact of cognitive level of MCQ and SEQ on learning approaches of dental students

Objectives:

MCQ’s and SEQ’s are the most widely used assessment tool in dental colleges across Pakistan. This study explores the impact of assessment tool: MCQ’s and SEQ’s on learning approach of dental students and also identifies correlation between these assessment tools and deep & surface learning approaches in integrated and discipline based curriculum.

Methods:

A quantitative co-relational study was conducted in 2018 on 2nd and 4th year dental students. A pre-validated “Revised Study Process Questionnaire” was used. Spearman’s rho correlation coefficient and Wilcoxon signed ranks test were applied to determine the relationship between learning approaches and assessment tools. Internal consistency was calculated by Cronbach’s alpha.

Results:

Ninety six students out of one hundred and fifty completed the questionnaire. Correlation test showed that surface approach correlates significantly with MCQ’s (0.73) while no co-relation exists with SEQ’s (-0.14) in our study. Deep approach has a strong and significant correlation with SEQ’s (0.80) as compared to MCQ’s (0.056).

Conclusion:

Assessment tool has an impact on learning approaches used by the students. It was concluded that students used to prefer deep learning approach while preparing for SEQ’s as they were designed at higher cognitive level, whereas, they preferred surface approach while preparing for MCQ’s as they were developed at low cognitive order.