Initiatives to improve feedback culture in the final year of a veterinary program

Feedback literacy as a model to explore how learners respond to feedback

Clinicians spend a considerable part of their time while supervising trainees providing feedback. It is generally accepted that feedback can play a major role in subsequent academic performance. Traditionally it was thought that all feedback was good feedback, that inevitably improved learner outcomes. This has been challenged and it is now understood that feedback can have a beneficial or deleterious effect on the student. A number of factors can affect a learner's response to feedback. The concept of feedback literacy is helpful to understanding these responses - this describes the processes by which a learner makes sense of feedback and subsequently uses it to enhance learning. A learner who is feedback literate can recognise when they are getting feedback and understand how it relates to their progress; they can process it effectively both cognitively and emotionally, and they can put it in to action in ways which benefit their learning. Modifiable and non-modifiable factors can influence feedback literacy, with modifiable factors including feedback standards and supervisor behaviours. Providing clear feedback expectations, ensuring accuracy of feedback messages and focusing on the relationship between the teacher and learner have the most evidence for their effect on facilitating feedback literacy.

Student Use and Perceptions of Embedded Formative Assessments in a Basic Science Veterinary Program

This work describes the implementation of online timed closed-book formative assessments across several modules of a first-year undergraduate veterinary program. This process does not require significant time investment since it can be implemented into existing programs of study. Students were surveyed on how they used these formative assessments for learning and overall, were overwhelmingly positive about the opportunity to practice and receive feedback on their performance. Quantitative statistics on preferences as well as qualitative thematic analysis of open free-text questions reveal clear preferences in how they choose to engage with the assessments for learning, as well as how they prefer assessments to be administered. Students were positive about the online nature of the exams and prefer formative assessments to be distributed across the teaching semesters without any time restrictions, allowing them to be completed as and when they choose. Immediate feedback in the form of model answers is the students' preference, although some value signposting to relevant resources for further research. Furthermore, students report that they want more questions and tests to complement their learning, and overwhelming rely on guided and structured activities for learning and revision which will need to be balanced with opportunities to develop critical thinking and independent learning skills when studying in a professional course, given students are not likely to default into such behavior. This work models a process many curriculum designers have, and continue to undergo in higher education as online, hybrid, and blended approaches to teaching have received renewed interest.

Using Learning Theories to Develop a Veterinary Student Preparedness Toolkit for Workplace Clinical Training

Learning theories are abstract descriptions which help us make sense of educational practice. Multiple theories can inform our understanding of a single concept, in this case: veterinary workplace clinical training (WCT), which occurs just prior to students' graduation as competent veterinary surgeons. The competency movement has strongly influenced reforms in veterinary education and is considered important. In reflection of this, the term “preparedness” is operationalised here as a measure of the likelihood that the veterinary student is going to be a competent learner and participant during WCT. Preparedness itself is therefore important because it directly impacts performance. Workplace clinical training is explored through the lenses of cognitivist, social constructivist and socio-culturalist learning theories and used to inform student preparedness characteristics (“tools”) in terms of their behaviours, personal attributes, knowledge and skills, and awarenesses to optimise learning and participation. These form a new conceptual framework—the “Preparedness Toolkit.”

The individual in the system: The role of affect in recent veterinary graduates' reflective activity

BACKGROUND

The transition to professional practice can be a challenging time. The Royal College of Veterinary Surgeons' (RCVS) Professional Development Phase (PDP) aims to support recent graduates through this transition, with graduates required to reflect on their experiences. This study drew on the concept of "lived experience" to explore the influence of affect (feelings, emotions and mood) on recent graduates' experience of reflective activity.

METHODS

Data comprised semi-structured interviews with 15 recent graduates from one veterinary school. Thematic analysis was used to explore the influence of three aspects of affect on reflective activity: affective valence (whether a chosen action is anticipated to result in positive or negative feelings), tacit aspects (such as tiredness) and perceptions of workplace mood.

RESULTS

Participants preferred to engage in activities associated with positive feelings. Tacit feelings, such as panic or tiredness, and perceptions of workplace mood, influenced how and with whom participants engaged in reflective activity. Participants often made different choices when reflecting primarily on affective compared to clinical aspects of situations.

CONCLUSION

These findings suggest that acknowledging and understanding aspects of affect during the professional development phase has the potential to help the profession improve support for recent graduates.

Influence of instructor-to-student ratio for teaching suturing skills with models

OBJECTIVE

To evaluate the influence of instructor to student ratio on the effectiveness and efficiency of teaching suturing skills to veterinary students.

STUDY DESIGN

Prospective randomized study.

SAMPLE POPULATION

Second-year veterinary students (N = 121).

METHODS

Students were randomly divided into three groups to participate in four 2-hour skills laboratory sessions in which suturing of the subcutaneous tissue was taught by using a simple continuous pattern, suturing of the skin was taught by using continuous patterns, suturing of the skin was taught by using interrupted patterns, and suturing of hollow organs was taught by using inverting patterns. For each laboratory, the groups were taught by using instructor-to-student ratios of 1:6, 1:8, and 1:10 on a rotating basis. Students were surveyed at the end of each laboratory, and underwent individual performance assessments at the end of each laboratory session and again at the end of the semester in an objective structured clinical examination (OSCE).

RESULTS

For each of the four in-laboratory assessments and the OSCE, no difference in performance was detected between groups. When they were surveyed, students in all groups reported that there was an adequate number of instructors in the laboratory and that they received help in a timely fashion when help was requested (median for all groups = agree).

CONCLUSION

For students with prior surgical skills education and with the use of prelaboratory instructional videos, teaching at the 1:10 instructor-to-student ratio was efficient and effective.

CLINICAL SIGNIFICANCE

Good educational outcomes may be reached with a 1:10 instructor-to-student ratio or, potentially, fewer instructors, depending on the educational aids present in the laboratory and students' prior level of experience.

Evaluation of team effectiveness and personal empathy for associations with professional quality of life and job satisfaction in companion animal practice personnel

OBJECTIVE

To examine variables of veterinary team effectiveness and personal empathy for associations with professional quality of life (ie, compassion satisfaction, burnout, and secondary traumatic stress) and job satisfaction in companion animal practice personnel.

DESIGN

Cross-sectional survey.

SAMPLE

Data from 232 surveys completed by personnel from 10 companion animal veterinary practices in 2 regions of the United States between April 7 and December 20, 2016.

PROCEDURES

Online surveys were used to collect practice-level data (eg, practice type, setting, and staffing) and individual-level data (eg, demographics, job position, and years in the position and profession). Instruments used in developing the surveys included the Team Effectiveness Instrument, Davis Interpersonal Reactivity Index, Professional Quality of Life Scale, and a measure for job satisfaction. Data were evaluated for associations with professional quality of life and job satisfaction.

RESULTS

Individual engagement was positively associated with job satisfaction, negatively associated with secondary traumatic stress, and moderated by levels of personal distress for compassion satisfaction and burnout. Toxic team environment was positively associated with burnout and negatively associated with job satisfaction. Empathetic concern and personal distress were both positively associated with secondary traumatic stress. Empathetic concern was moderated by team engagement for compassion satisfaction.

CONCLUSIONS AND CLINCAL RELEVANCE

Results indicated that variables influencing professional quality of life and job satisfaction were multimodal and included aspects of team effectiveness and empathy; therefore, workplace strategies that enhance individual and team engagement and mitigate toxic team environments could potentially improve professional quality of life and job satisfaction in veterinary personnel.

Comparison of Two Veterinary Emergency and Critical Care Clerkship Grading Protocols

Universal guidelines for evaluating veterinary students' clinical clerkship performance are unavailable. At our institution, each service determines its own grading protocol. In this study, researchers compared clinician, staff, and student perceptions of a traditional and newly devised grading practice on the Emergency and Critical Care (ECC) clerkship. ECC clinicians and technicians were asked to assess the existing grading protocol for the clerkship. The system was then revised to better align with clerkship objectives. The revised protocol evaluated students on 12 items encompassing knowledge, clinical, and communication skills. Following the assignment of values for each category, letter grades were calculated automatically. Clinicians and staff were invited to rate the revised grading system. Throughout the study period, a corresponding survey was sent to students shortly after they had received their clerkship grades. Students' open-ended comments were analyzed qualitatively to identify common themes. Clinicians and technicians reported that the revised protocol was more inclusive and better able to provide fair and accurate assessments of students' performances. Students were generally satisfied with both grading protocols, however, in the open-ended comments students' frequently expressed desire for more directed and timely feedback on their performance. The results of this study indicate that the graders' believed that the revised evaluation protocol provides opportunities to provide fair and accurate assessments of student performance. Overall, students were satisfied with the new protocol and have a desire for tailored feedback provided in a timely fashion.

Evaluating a technology supported interactive response system during the laboratory section of a histology course

Monitoring of student learning through systematic formative assessment is important for adjusting pedagogical strategies. However, traditional formative assessments, such as quizzes and written assignments, may not be sufficiently timely for making adjustments to a learning process. Technology supported formative assessment tools assess student knowledge, allow for immediate feedback, facilitate classroom dialogues, and have the potential to modify student learning strategies. As an attempt to integrate technology supported formative assessment in the laboratory section of an upper-level histology course, the interactive application Learning Catalytics^TM , a cloud-based assessment system, was used. This study conducted during the 2015 Histology courses at Cornell University concluded that this application is helpful for identifying student misconceptions "on-the-go," engaging otherwise marginalized students, and forming a new communication venue between students and instructors. There was no overall difference between grades from topics that used the application and grades from those that did not, and students reported that it only slightly helped improve their understanding of the topic (3.8 ± 0.99 on a five-point Likert scale). However, they highly recommended using it (4.2 ± 0.71). The major limitation was regarding the image display and graphical resolution of this application. Even though students embrace the use of technology, 39% reported benefits of having the traditional light microscope available. This cohort of students led instructors to conclude that the newest tools are not always better, but rather can complement traditional instruction methods. Anat Sci Educ 10: 328-338. © 2016 American Association of Anatomists.

Student-Initiated Feedback Using Clinical Encounter Cards during Clinical Rotations in Veterinary Medicine: A Feasibility Study

Despite its critical role for successful student learning, providing adequate teacher feedback is still a major issue during clinical education. In human medical education, the implementation of clinical encounter cards (CECs) has led to more frequent, timely, and structured teacher feedback. The present study aimed to introduce student-initiated CECs in a veterinary medical setting (clinical rotations). A total of 24 students were randomly assigned to a control group (standard rotations) and an intervention group where they had to ask for teacher feedback using CECs. The feasibility of implementing CECs was evaluated by examining the content of the completed CECs and by using anonymous student and teacher questionnaires. In addition, acceptance of the intervention and changes in feedback behavior were examined from both the teachers' and students' perspectives. Overall, it was shown that using CECs is not only feasible in a veterinary clinical setting but also conducive to more frequent and constructive teacher feedback. However, some teachers postponed completing the CECs due to time pressure, leading to less direct and timely feedback. Moreover, students felt more comfortable asking for feedback from less experienced, younger teachers, and teachers' quantitative ratings and open commentaries seemed to be affected by leniency bias. Finally, a focus group including teachers and students discussed these results in light of their practical experiences. This led to a streamlining of the implementation process and optimizations to facilitate future large-scale implementation. The study has implications for veterinary educators wishing to improve feedback in their institution.

Final-Year Students' and Clinical instructors' Experience of Workplace-Based Assessments Used in a Small-Animal Primary-Veterinary-Care Clinical Rotation

Final-year veterinary students must meet baseline clinical competency upon completion of their training for entry to practice. Workplace-based assessments (WBAs), widely used in human medical training to assess post-graduate students' professionalism and clinical performance, have recently been adopted in undergraduate veterinary clinical teaching environments. WBAs should support veterinary trainees' learning in a clinical teaching environment, though utility of WBAs within veterinary education may differ from that in medical training due to differences in context and in learners' stage of clinical development. We conducted focus groups with final-year veterinary students and clinical instructors following the implementation of three WBAs (Direct Observation of Procedural Skills [DOPS], the Mini-Clinical evaluation exercise [Mini-CEX], and the In-Training Evaluation Report [ITER]) during a small-animal primary-veterinary-care rotation. Students and clinical instructors viewed the DOPS and Mini-CEX as feasible and valuable learning and assessment tools that offered an overall opportunity for timely in-the-moment feedback. Instructors viewed the ITER as less feasible in the context of a service-oriented veterinary clinical teaching environment. Students believed the ITER had potential to be informative, although in its existing application the ITER had limited utility due to time constraints on instructors that prevented them from providing students with individualized and specific feedback. In service-oriented veterinary clinical teaching environments, successful implementation of WBAs requires balancing provision of feedback to students, time demands on clinical instructors, and flexibility of assessment tools.

Faculty Development for a New Curriculum: Implementing a Strategy for Veterinary Teachers within the Wider University Context

Faculty development in veterinary education is receiving increasing attention internationally and is considered of particular importance during periods of organizational or curricular change. This report outlines a faculty development strategy developed since October 2012 at the University of Bristol Veterinary School, in parallel with the development and implementation of a new curriculum. The aim of the strategy is to deliver accessible, contextual faculty development workshops for clinical and non-clinical staff involved in veterinary student training, thereby equipping staff with the skills and support to deliver high-quality teaching in a modern curriculum. In October 2014, these workshops became embedded within the new University of Bristol Continuing Professional Development scheme, Cultivating Research and Teaching Excellence. This scheme ensures that staff have a clear and structured route to achieving formal recognition of their teaching practice as well as access to a wide range of resources to further their overall professional development. The key challenges and constraints are discussed.

Challenges and Issues in the Evaluation of Teaching Quality: How Does it Affect Teachers' Professional Practice? A UK Perspective

Evaluation of the quality of higher education is undertaken for the purposes of ensuring accountability, accreditation, and improvement, all of which are highly relevant to veterinary teaching institutions in the current economic climate. If evaluation is to drive change, it needs to be able to influence teaching practice. This article reviews the literature relating to evaluation of teaching quality in higher education with a particular focus on teachers' professional practice. Student evaluation and peer observation of teaching are discussed as examples of widely used evaluation processes. These approaches clearly have the potential to influence teachers' practice. Institutions should strive to ensure the development of a supportive culture that prioritizes teaching quality while being aware of any potential consequences related to cost, faculty time, or negative emotional responses that might result from the use of different evaluation methods.