Evidence of gender bias in True-False-Abstain medical examinations

Progress testing: An educational perspective exploring the rationale for progress testing and its introduction into a Diagnostic Radiography curriculum

INTRODUCTION

In March 2020, the first diagnostic radiography degree apprenticeship programme in England was launched at the authors' institution. As part of the programme development and design, the programme development team explored and then implemented progress testing into a strand of the programme. The objective of this educational perspective is to scrutinise the literature around the use of progress testing in higher education programmes, namely medicine, to explain how and why this decision was reached.

METHODS

The initial search strategy was developed using the electronic databases CINHAL Complete and SCOPUS. Key words included 'progress test' and 'medicine' or 'health' or 'education' or 'higher education'. Eliminating articles that were not relevant, and also identifying and adding additional articles by key authors and experts resulted in thirty-three key articles being considered for review.

RESULTS

The thirty-three articles were a mixture of review articles, empirical research, case studies and conference presentations. Five key themes were identified which are discussed in this article; the evolution of progress testing; advantages of progress testing, disadvantages of progress testing, developing a test framework and academic progression and student feedback.

DISCUSSION

Progress testing is now well established in pre-registration medical programmes globally. The advantages of progress testing and the use of frequent look rapid remediation appear to be undisputed. Key disadvantages with progress testing were identified as it being an administrative heavy assessment process as well as a perceived bias towards male students undertaking this type of assessment.

CONCLUSION

Now this assessment practice is established within medicine, it seems reasonable to explore its use in other areas of healthcare, such as radiography.

Prospective investigation of factors associated with success on the American College of Veterinary Emergency and Critical Care certification examination (2016-2018)

OBJECTIVE

To assess the association of candidate attributes and residency training factors with success on the American College of Veterinary Emergency and Critical Care (ACVECC) board certification examination and to develop multivariable models of first-attempt success.

DESIGN

Prospective survey-based study.

SETTING

Post-assessment ACVECC examination candidates.

ANIMALS

None.

INTERVENTIONS

None.

MEASUREMENTS AND MAIN RESULTS

Comprehensive surveys were distributed to ACVECC examination candidates in 2016 to 2018 after completion of their assessments, but prior to publication of examination results. Unique anonymous candidate identification numbers were used to match survey responses to outcome data from the office of the ACVECC Executive Secretary. After curation to retain only the first response from each candidate, there were 97 unique candidate responses available for analysis. Univariate analyses identified multiple factors associated with first-attempt success and multiple differences between academic and private practice residency programs. Multivariable logistic regression modeling suggested that 5 factors were independently associated with first-attempt success on the ACVECC examination, specifically younger age, more weeks of study prior to the examination, training at a facility with more ACVECC Diplomates, training at a facility with more ACVECC residents, and having no requirement to manage both Emergency Room (ER) and Critical Care (CC) cases simultaneously.

CONCLUSIONS

Numerous resident and training center factors are associated with success in the ACVECC board certification examination. Residents and training centers might be able to use these data to enhance training, but caution must be exercised because these data are associative only.

Interdimensional Travel: Visualisation of 3D-2D Transitions in Anatomy Learning

Clinical image interpretation is one of the most challenging activities for students when they first arrive at medical school. Interpretation of clinical images concerns the identification of three-dimensional anatomical features in two-dimensional cross-sectional computed tomography (CT) and magnetic resonance imaging (MRI) images in axial, sagittal and coronal planes, and the recognition of structures in ultrasound and plain radiographs. We propose that a cognitive transition occurs when initially attempting to interpret clinical images, which requires reconciling known 3D structures with previously unknown 2D visual information. Additionally, we propose that this 3D-2D transition is required when integrating an understanding of superficial 2D surface landmarks with an appreciation of underlying 3D anatomical structures during clinical examinations.Based on educational theory and research findings, we recommend that 3D and 2D approaches should be simultaneously combined within radiological and surface anatomy education. With a view to this, we have developed and utilised digital and art-based methods to support the 3D-2D transition. We outline our observations and evaluations, and describe our practical implementation of these approaches within medical curricula to serve as a guide for anatomy educators. Furthermore, we define the theoretical underpinnings and evidence supporting the integration of 3D-2D approaches and the value of our specific activities for enhancing the clinical image interpretation and surface anatomy learning of medical students.

Integrating 3D Visualisation Technologies in Undergraduate Anatomy Education

Anatomy forms the basis of clinical examination, surgery and radiology and it is therefore essential that a fundamental understanding of the key concepts, structures and their relationships is gained by medical and healthcare students during their undergraduate training. Anatomy involves the study of three dimensional entities relating to the human body itself and its constituent structures. In our experience, the appreciation of 3D concepts is one of the most demanding areas for medical student learning of anatomy (ben Awadh et al. 2018, unpublished observations). The ability to interpret 3D anatomical features in 2D cross-sectional clinical images can be troublesome, while the dynamic nature of embryological development is a further challenge.The aim of introducing technology enhanced-learning (TEL) approaches into our practice is with a view to enhancing undergraduate medical student learning of clinically relevant anatomy. Here we will explore the importance of visualisation and visual learning in anatomy as a scholarly basis for the integration for TEL approaches. We will then describe examples of visualisation technologies that are currently being implemented within the School of Medical Education at Newcastle University based on a research informed understanding of how students learn anatomy. We will consider the available evidence that supports best practice, identify limitations where they arise, and discuss how these visual 3D learning technologies can be effectively utilised as adjuncts and self-directed resources to supplement more established approaches to undergraduate anatomy education.

The Fellowship of the Royal College of Radiologists (FRCR) examination: a review of the evidence

The Fellowship of the Royal College of Radiologists (FRCR) examination is the professional qualification that is essential for career progression in clinical radiology within the UK. It is also important for career progression in many countries internationally. The FRCR has evolved and changed over the last decade. In this systematic review we appraise and summarise the available data relating to the FRCR emphasising the published evidence regarding the validity, reliability, and acceptability of this examination. Comparison is made to other equivalent medical examinations, as well as a more recently published commissioned external review of the FRCR examinations. The Clinical Radiology Part 2B (CR2B) examination in its pre-existing format is reliable, valid, and acceptable. Recommendations from the commissioned external review are based primarily on expert opinion, with a limited evidence base comprising data from a small sample acquired during a single examination sitting and without peer review. Unlike the CR2B examination, there is little evidence regarding assessment of the CR1 and CR2 examinations. Both the CR1 and CR2 examinations are currently in the process of undergoing major changes to their formats. Blueprinting items to the curriculum might improve acceptability. Other changes may improve transparency and reliability of these assessments. Our analysis and many aspects of the external review may provide pointers regarding how the upcoming data produced by the "automated" FRCR examinations can be further analysed to provide a more robust evaluation.

Using differential item functioning to evaluate potential bias in a high stakes postgraduate knowledge based assessment

BACKGROUND

Fairness is a critical component of defensible assessment. Candidates should perform according to ability without influence from background characteristics such as ethnicity or sex. However, performance differs by candidate background in many assessment environments. Many potential causes of such differences exist, and examinations must be routinely analysed to ensure they do not present inappropriate progression barriers for any candidate group. By analysing the individual questions of an examination through techniques such as Differential Item Functioning (DIF), we can test whether a subset of unfair questions explains group-level differences. Such items can then be revised or removed.

METHODS

We used DIF to investigate fairness for 13,694 candidates sitting a major international summative postgraduate examination in internal medicine. We compared (a) ethnically white UK graduates against ethnically non-white UK graduates and (b) male UK graduates against female UK graduates. DIF was used to test 2773 questions across 14 sittings.

RESULTS

Across 2773 questions eight (0.29%) showed notable DIF after correcting for multiple comparisons: seven medium effects and one large effect. Blinded analysis of these questions by a panel of clinician assessors identified no plausible explanations for the differences. These questions were removed from the question bank and we present them here to share knowledge of questions with DIF. These questions did not significantly impact the overall performance of the cohort. Group-level differences in performance between the groups we studied in this examination cannot be explained by a subset of unfair questions.

CONCLUSIONS

DIF helps explore fairness in assessment at the question level. This is especially important in high-stakes assessment where a small number of unfair questions may adversely impact the passing rates of some groups. However, very few questions exhibited notable DIF so differences in passing rates for the groups we studied cannot be explained by unfairness at the question level.

Comparison of formula and number-right scoring in undergraduate medical training: a Rasch model analysis

BACKGROUND

Progress testing is an assessment tool used to periodically assess all students at the end-of-curriculum level. Because students cannot know everything, it is important that they recognize their lack of knowledge. For that reason, the formula-scoring method has usually been used. However, where partial knowledge needs to be taken into account, the number-right scoring method is used. Research comparing both methods has yielded conflicting results. As far as we know, in all these studies, Classical Test Theory or Generalizability Theory was used to analyze the data. In contrast to these studies, we will explore the use of the Rasch model to compare both methods.

METHODS

A 2 × 2 crossover design was used in a study where 298 students from four medical schools participated. A sample of 200 previously used questions from the progress tests was selected. The data were analyzed using the Rasch model, which provides fit parameters, reliability coefficients, and response option analysis.

RESULTS

The fit parameters were in the optimal interval ranging from 0.50 to 1.50, and the means were around 1.00. The person and item reliability coefficients were higher in the number-right condition than in the formula-scoring condition. The response option analysis showed that the majority of dysfunctional items emerged in the formula-scoring condition.

CONCLUSIONS

The findings of this study support the use of number-right scoring over formula scoring. Rasch model analyses showed that tests with number-right scoring have better psychometric properties than formula scoring. However, choosing the appropriate scoring method should depend not only on psychometric properties but also on self-directed test-taking strategies and metacognitive skills.

Improvements in anatomy knowledge when utilizing a novel cyclical "Observe-Reflect-Draw-Edit-Repeat" learning process

Innovative educational strategies can provide variety and enhance student learning while addressing complex logistical and financial issues facing modern anatomy education. Observe-Reflect-Draw-Edit-Repeat (ORDER), a novel cyclical artistic process, has been designed based on cognitivist and constructivist learning theories, and on processes of critical observation, reflection and drawing in anatomy learning. ORDER was initially investigated in the context of a compulsory first year surface anatomy practical (ORDER-SAP) at a United Kingdom medical school in which a cross-over trial with pre-post anatomy knowledge testing was utilized and student perceptions were identified. Despite positive perceptions of ORDER-SAP, medical student (n = 154) pre-post knowledge test scores were significantly greater (P < 0.001) with standard anatomy learning methods (3.26, SD = ±2.25) than with ORDER-SAP (2.17, ±2.30). Based on these findings, ORDER was modified and evaluated in the context of an optional self-directed gross anatomy online interactive tutorial (ORDER-IT) for participating first year medical students (n = 55). Student performance was significantly greater (P < 0.001) with ORDER-IT (2.71 ± 2.17) when compared to a control tutorial (1.31 ± 2.03). Performances of students with visual and artistic preferences when using ORDER were not significantly different (P > 0.05) to those students without these characteristics. These findings will be of value to anatomy instructors seeking to engage students from diverse learning backgrounds in a research-led, innovative, time and cost-effective learning method, in the context of contrasting learning environments. Anat Sci Educ 10: 7-22. © 2016 American Association of Anatomists.

Racial and Gender Influences on Pass Rates for the UK and Ireland Specialty Board Examinations

INTRODUCTION

We explored effects of gender, ethnic origin, first language, and training status on scores in the Intercollegiate Specialty Board examinations in the UK and Ireland across the computer-marked written section and in the face-to-face oral and clinical section.

METHODS

Demographic characteristics and examination results from 9987 attempts across 177 sittings from 2009 to 2013 were analyzed in an analysis of variance by training status, gender, ethnic origin, first language, and section (computer-marked multiple-choice examination vs face-to-face oral and clinical examination).

RESULTS

We found increasing alignment between examiner and candidate characteristics during this period, with a 50% increase in examiners of Asian ethnic origin and a 60% increase in examiners whose first language is not English. The strongest factor in the analysis of variance was training status (F[2, 9818] = 27.67, p < 0.001), with candidates in training significantly outperforming others. Within "core candidates" (first attempt, in training), we found significant main effects for ethnic origin (F[5, 4809] = 2.36, p = 0.04), and first language (F[2, 4809] = 5.29, p = 0.003), but no interaction effects between these factors and section (both F < 1, p > 0.05).

CONCLUSIONS

Training status was the most important factor in candidates' results. Although the analysis showed significant effects of ethnic origin and first language within "core candidates," these differences were statistically indistinguishable between the 2 sections of the examination, suggesting that the differential attainment by these factors cannot be attributed to examiner bias in a face-to-face examination.

Negative Marking and the Student Physician--A Descriptive Study of Nigerian Medical Schools

BACKGROUND

There is considerable debate about the two most commonly used scoring methods, namely, the formula scoring (popularly referred to as negative marking method in our environment) and number right scoring methods. Although the negative marking scoring system attempts to discourage students from guessing in order to increase test reliability and validity, there is the view that it is an excessive and unfair penalty that also increases anxiety. Feedback from students is part of the education process; thus, this study assessed the perception of medical students about negative marking method for multiple choice question (MCQ) examination formats and also the effect of gender and risk-taking behavior on scores obtained with this assessment method.

METHODS

This was a prospective multicenter survey carried out among fifth year medical students in Enugu State University and the University of Nigeria. A structured questionnaire was administered to 175 medical students from the two schools, while a class test was administered to medical students from Enugu State University. Qualitative statistical methods including frequencies, percentages, and chi square were used to analyze categorical variables. Quantitative statistics using analysis of variance was used to analyze continuous variables.

RESULTS

Inquiry into assessment format revealed that most of the respondents preferred MCQs (65.9%). One hundred and thirty students (74.3%) had an unfavorable perception of negative marking. Thirty-nine students (22.3%) agreed that negative marking reduces the tendency to guess and increases the validity of MCQs examination format in testing knowledge content of a subject compared to 108 (61.3%) who disagreed with this assertion (χ² = 23.0, df = 1, P = 0.000). The median score of the students who were not graded with negative marking was significantly higher than the score of the students graded with negative marking (P = 0.001). There was no statistically significant difference in the risk-taking behavior between male and female students in their MCQ answering patterns with negative marking method (P = 0.618).

CONCLUSIONS

In the assessment of students, it is more desirable to adopt fair penalties for discouraging guessing rather than excessive penalties for incorrect answers, which could intimidate students in negative marking schemes. There is no consensus on the penalty for an incorrect answer. Thus, there is a need for continued research into an effective and objective assessment tool that will ensure that the students' final score in a test truly represents their level of knowledge.

The don't know option in progress testing

Formula scoring (FS) is the use of a don't know option (DKO) with subtraction of points for wrong answers. Its effect on construct validity and reliability of progress test scores, is subject of discussion. Choosing a DKO may not only be affected by knowledge level, but also by risk taking tendency, and may thus introduce construct-irrelevant variance into the knowledge measurement. On the other hand, FS may result in more reliable test scores. To evaluate the impact of FS on construct validity and reliability of progress test scores, a progress test for radiology residents was divided into two tests of 100 parallel items (A and B). Each test had a FS and a number-right (NR) version, A-FS, B-FS, A-NR, and B-NR. Participants (337) were randomly divided into two groups. One group took test A-FS followed by B-NR, and the second group test B-FS followed by A-NR. Evidence for impaired construct validity was sought in a hierarchical regression analysis by investigating how much of the participants' FS-score variance was explained by the DKO-score, compared to the contribution of the knowledge level (NR-score), while controlling for Group, Gender, and Training length. Cronbach's alpha was used to estimate NR and FS-score reliability per year group. NR score was found to explain 27 % of the variance of FS [F(1,332) = 219.2, p < 0.0005], DKO-score, and the interaction of DKO and Gender were found to explain 8 % [F(2,330) = 41.5, p < 0.0005], and the interaction of DKO and NR 1.6 % [F(1,329) = 16.6, p < 0.0005], supporting our hypothesis that FS introduces construct-irrelevant variance into the knowledge measurement. However, NR-scores showed considerably lower reliabilities than FS-scores (mean year-test group Cronbach's alphas were 0.62 and 0.74, respectively). Decisions about FS with progress tests should be a careful trade-off between systematic and random measurement error.

Does competition work as a motivating factor in e-learning? A randomized controlled trial

BACKGROUND AND AIMS

Examinations today are often computerized and the primary motivation and curriculum is often based on the examinations. This study aims to test if competition widgets in e-learning quiz modules improve post-test and follow-up test results and self-evaluation. The secondary aim is to evaluate improvements during the training period comparing test-results and number of tests taken.

METHODS

Two groups were randomly assigned to either a quiz-module with competition widgets or a module without. Pre-, post- and follow up test-results were recorded. Time used within the modules was measured and students reported time studying. Students were able to choose questions from former examinations in the quiz-module.

RESULTS

Students from the competing group were significantly better at both post-and follow-up-test and had a significantly better overall learning efficiency than those from the non-competing group. They were also significantly better at guessing their post-test results.

CONCLUSION

Quiz modules with competition widgets motivate students to become more active during the module and stimulate better total efficiency. They also generate improved self-awareness regarding post-test-results.

Driving deeper learning by assessment: an adaptation of the Revised Bloom's Taxonomy for medical imaging in gross anatomy

RATIONALE AND OBJECTIVES

As medical imaging continues to grow as a central modality by which physicians of all specialties visualize anatomy, so, too, is its role in medical student education. However, no study to our knowledge has attempted to categorize the necessary cognitive skills. Here, we assess a tool to identify those skills and their possible hierarchical nature that reflects deeper understanding of radiological anatomy.

MATERIALS AND METHODS

We adapted the revision of Bloom's Taxonomy of Educational Objectives to create examination questions and teaching points for normal radiological anatomy in a medical anatomy course in 2008. All six previously established levels of cognitive processes were adapted, ranging from Remembering to Create. Reliability and validity were assessed.

RESULTS

Of 102 eligible students, 98 (98%) consented to participate, and 108 examination questions were assessed. Cronbach α assessing reliability ranged from poor (.197) to moderate (.571) with most categories being moderate. Score means for the levels of cognitive processes were statistically distinct [F(4, 102) = 180.63, P < .001] and tended to decrease as the level of cognitive process increased [Spearman ρ(5) = -.800, P = .104], consistent with a valid hierarchical structure.

CONCLUSIONS

A radiological anatomy adaptation of the revised taxonomy demonstrated generally adequate reliability and acceptable validity to establish evaluations that test different depths of cognitive processes. This is a critical first step to create a fundamental curricular tool by which medical imaging education-both normal and pathological-may be taught and assessed in the future.

Negatively-marked MCQ assessments that reward partial knowledge do not introduce gender bias yet increase student performance and satisfaction and reduce anxiety

Multiple-choice question (MCQ) examinations are increasingly used as the assessment method of theoretical knowledge in large class-size modules in many life science degrees. MCQ-tests can be used to objectively measure factual knowledge, ability and high-level learning outcomes, but may also introduce gender bias in performance dependent on topic, instruction, scoring and difficulty. The 'Single Answer' (SA) test is often used in which students choose one correct answer, in which they are unable to demonstrate partial knowledge. Negatively marking eliminates the chance element of guessing but may be considered unfair. Elimination testing (ET) is an alternative form of MCQ, which discriminates between all levels of knowledge, while rewarding demonstration of partial knowledge. Comparisons of performance and gender bias in negatively marked SA and ET tests have not yet been performed in the life sciences. Our results show that life science students were significantly advantaged by answering the MCQ test in elimination format compared to single answer format under negative marking conditions by rewarding partial knowledge of topics. Importantly, we found no significant difference in performance between genders in either cohort for either MCQ test under negative marking conditions. Surveys showed that students generally preferred ET-style MCQ testing over SA-style testing. Students reported feeling more relaxed taking ET MCQ and more stressed when sitting SA tests, while disagreeing with being distracted by thinking about best tactics for scoring high. Students agreed ET testing improved their critical thinking skills. We conclude that appropriately-designed MCQ tests do not systematically discriminate between genders. We recommend careful consideration in choosing the type of MCQ test, and propose to apply negative scoring conditions to each test type to avoid the introduction of gender bias. The student experience could be improved through the incorporation of the elimination answering methods in MCQ tests via rewarding partial and full knowledge.

Preferred question types for computer-based assessment of clinical reasoning: a literature study

Clinical reasoning is a core competence of doctors. Therefore, the assessment of clinical reasoning of undergraduate students is an important part of medical education. Three medical universities in the Netherlands wish to develop a shared question database in order to assess clinical reasoning of undergraduate students in Computer-Based Assessments (CBA). To determine suitable question types for this purpose a literature study was carried out. Search of ERIC and PubMed and subsequent cross referencing yielded 30 articles which met the inclusion criteria of a focus on question types suitable to assess clinical reasoning of medical students and providing recommendations for their use. Script Concordance Tests, Extended Matching Questions, Comprehensive Integrative Puzzles, Modified Essay Questions/Short Answer Questions, Long Menu Questions, Multiple Choice Questions, Multiple True/False Questions and Virtual Patients meet the above-mentioned criteria, but for different reasons not all types can be used easily in CBA. A combination of Comprehensive Integrative Puzzles and Extended Matching Questions seems to assess most aspects of clinical reasoning and these question types can be adapted for use in CBA. Regardless of the question type chosen, patient vignettes should be used as a standard stimulus format to assess clinical reasoning. Further research is necessary to ensure that the combination of these question types produces valid assessments and reliable test results.

Knowledge transfer of spinal manipulation skills by student-teachers: a randomised controlled trial

PURPOSE

To assess the use of peer-assisted learning (PAL) of complex manipulative motor skills with respect to gender in medical students.

METHODS

In 2007-2010, 292 students in their 3rd and 4th years of medical school were randomly assigned to two groups [Staff group (SG), PAL group (PG)] led by either staff tutors or student-teachers (ST). The students were taught bimanual practical and diagnostic skills (course education module of eight separate lessons) as well as a general introduction to the theory of spinal manipulative therapy. In addition to qualitative data collection (Likert scale), evaluation was performed using a multiple-choice questionnaire in addition to an objective structured clinical examination (OSCE).

RESULTS

Complex motor skills as well as palpatory diagnostic competencies could in fact be better taught through professionals than through ST (manipulative OSCE grades/diagnostic OSCE score; SG vs. PG; male: P = 0.017/P < 0.001, female: P < 0.001/P < 0.001). The registration of theoretical knowledge showed equal results in students taught by staff or ST. In both teaching groups (SG: n = 147, PG: n = 145), no significant differences were observed between male and female students in matters of manipulative skills or theoretical knowledge. Diagnostic competencies were better in females than in males in the staff group (P = 0.041) Overall, students were more satisfied with the environment provided by professional teachers than by ST, though male students regarded the PAL system more suspiciously than their female counterparts.

CONCLUSIONS

The peer-assisted learning system does not seem to be generally qualified to transfer such complex spatiotemporal demands as spinal manipulative procedures.

Active learning on the ward: outcomes from a comparative trial with traditional methods

CONTEXT

Academic activity during internship is essentially practical and ward rounds are traditionally considered the cornerstone of clinical education. However, the efficacy and effectiveness of ward rounds for learning purposes have been under-investigated and it is necessary to assess alternative educational paradigms for this activity.

OBJECTIVES

This study aimed to compare the educational effectiveness of ward rounds conducted with two different learning methodologies.

METHODS

Student subjects were first tested on 30 true/false questions to assess their initial degree of knowledge on pneumonia and diarrhoea. Afterwards, they attended ward rounds conducted using an active and a traditional learning methodology. The participants were submitted to a second test 48hours later in order to assess knowledge acquisition and were asked to answer two questions about self-directed learning and their opinions on the two learning methodologies used.

RESULTS

Seventy-two medical students taking part in a paediatric clinic rotation were enrolled. The active methodology proved to be more effective than the traditional methodology for the three outcomes considered: knowledge acquisition (33 students [45.8%] versus 21 students [29.2%]; p=0.03); self-directed learning (38 students [52.8%] versus 11 students [15.3%]; p<0.001), and student opinion on the methods (61 students [84.7%] versus 38 students [52.8%]; p<0.001).

CONCLUSIONS

The active methodology produced better results than the traditional methodology in a ward-based context. This study seems to be valuable in terms of the new evidence it demonstrates on learning methodologies in the context of the ward round.

Analysis of short-answer question styles versus gender in pre-clinical veterinary education

One large study in medical education has reported that the choice of question format (or question content) could introduce a gender bias, with men outperforming women on questions with a true-false component or that required knowledge of anatomy or physiology. The purpose of our study was to ascertain whether this finding is also true in veterinary medical education. Two veterinary student cohorts were analyzed across four different modules over a three-year period (804 questions in total). The results of the study show that the women's and men's performance did not differ in any of the question types analyzed across any module or year. When students' (both women and men) overall average performance on different question types was compared with their performance on standard multiple-choice questions (MCQs), performance levels increased when students were asked to answer MCQs that contained an image-based prop (IMCQ) such as a photograph, X-ray image, or diagram. In contrast, students' performance was consistently lower when answering assertion-reason questions (ARQs), and this performance could not be explained by the demographic makeup of the two cohorts analyzed. When comparing standard MCQs with MCQs that contained a true-false question stem, no specific trend in the data could be determined. In conclusion, this study suggests that the short-answer question style does not bias against one gender in veterinary medical education, but that overall students do perform differently according to question type and, in particular, less well when ARQs are used in examinations.

Assessing the influence of gender, learning style, and pre-entry experience on student response to delivery of a novel veterinary curriculum

We investigated whether a novel veterinary curriculum was biased toward a particular gender, learning style, or pre-university experience (entry following undergraduate degree or direct entry from secondary school). We found no significant difference (p>0.05) in overall performance of first-year male, female, graduate-entry, or school-entry students. Students rated live-animal practical classes and facilitated problem-based learning as the most favored method of teaching, and this response was not biased by gender or pre-vet school experience. Men rated multiple-choice question (MCQ) assessment more highly than women, but there was no significant difference (p>0.05) in male or female performance on MCQ examinations. Men and women also performed comparably well in essays (both knowledge based and critical), suggesting that the retention of knowledge and depth of understanding was not gender biased. However, men performed significantly (p<0.05) better on critical essays compared with knowledge-based essays, and this trend was shown for both graduate-entry and school-entry students alike. We found no significant difference (p>0.05) in performance between groups of students with multimodal, kinesthetic, or reading-writing learning styles. Students with an auditory preference consistently performed less well in all types of assessment (p<0.05), but the number of students in this group was very small. Students whose learning style could not be specifically determined by Visual, Auditory, Read/write, Kinesthetic (VARK) tests consistently performed better than other groups, but this finding was not significant. Our results indicate that the Nottingham veterinary course does not bias for or against any of the variables we investigated.