A Pilot Study of the Creation and Implementation of a Teaching Development Assessment Tool

Designing a Checklist for Directly Observing Use of One-Minute Preceptor Steps on Inpatient Rounds: A Pilot Study

BACKGROUND

"One-minute preceptor" (OMP) is a well-established educational technique; however, primary literature on OMP lacks a tool to assess behavioral change after delivery of curricula.Primary aim of this pilot study was to design a checklist for direct observation of teachers using OMP on general medicine rounds and obtain inter-rater reliability evidence for the checklist.

METHODS

This study pilots an internally designed 6-item checklist to assess change in directly observed behavior. We describe the process of developing the checklist and training the observers. We calculated a percent agreement and Cohen's kappa to assess inter-rater reliability.

RESULTS

Raters had a high percent agreement ranging from 0.8 to 0.9 for each step of OMP. Cohen's kappa ranged from 0.49 to 0.77 for the five OMP steps. The highest kappa obtained was for getting a commitment (κ = 0.77) step, whereas the lowest agreement was for correcting mistakes (κ = 0.49).

CONCLUSION

We showed a percent agreement ≥0.8 and moderate agreement based on Cohen's kappa with most steps of OMP on our checklist. A reliable OMP checklist is an important step in further improving the assessment and feedback of resident teaching skills on general medicine wards.

Effective Veterinary Clinical Teaching in a Variety of Teaching Settings

This review explores different modalities for clinical teaching of veterinary learners globally. Effective clinical teaching aims to prepare graduates for a successful career in clinical practice. Unfortunately, there is scant literature concerning clinical teaching in veterinary medicine. Our intent for this review is to stimulate and/or facilitate discussion and/or research in this important area. We discuss the different forms that veterinary clinical teaching can take, depending on their setting, which can be university-based clinical activities, work-based in commercial clinical practices, or in a traditional academic setting with little to no real-time exposure to clients and patients. We suggest that each of these modalities has a place in clinical teaching of veterinary learners at any point in the curriculum but that a mix of these approaches will likely provide an improved experience for the learner. Further, we discuss strategies to improve clinical teaching in these different settings. Potential strategies related to the teaching skills of clinical instructors could include training in delivery of clinical teaching in a variety of learning settings, and instructors’ official recognition, including opportunities for career progression. Potential strategies to improve clinical teaching in different teaching settings would vary with the learning settings. For example, in traditional academic settings, case-based learning with incorporation of simulation models is one proposed strategy. The involvement of learners in ‘teach-others’ is a strategy for both traditional academic and clinical settings. Finally, clearly addressing Day One competencies is required in any clinical teaching setting.