Constructive ways to prevent, identify, and remediate deficiencies of "challenging trainees" in experiential education

A National Survey Exploring Practices and Perceptions of Sharing Experiential Evaluations With Future Preceptors

OBJECTIVE

This study aimed to understand pharmacy programs' policies and processes of sharing Advanced Pharmacy Practice Experience (APPE) assessment information among preceptors and to determine the types of grading scales currently being used nationally.

METHODS

A 14-question survey was utilized to collect information on Experiential Education policies and practices regarding APPE evaluations and assessment data sharing. The survey was administered electronically to Experiential Education Administrators at accredited schools of pharmacy nationally and gathered information on approach to APPE assessment, information sharing with future preceptors and open-ended responses on how struggling student learners are supported. Descriptive statistics were used to analyze quantitative responses, while qualitative open-ended comments were analyzed using thematic analysis.

RESULTS

A total of 95 responses were included in the analysis (67.9% response rate). The majority of programs (83.2%) reported not sharing student performance assessments with future preceptors. Themes that emerged from the analysis of open-ended comments included concerns about bias and privacy violations, and the benefits of sharing evaluations for preceptor preparation and longitudinal student growth. The grading approach varied, with 53.7% of programs using traditional tiered letter grades and 45.3% using a pass/fail grading system.

CONCLUSION

Most pharmacy programs do not share APPE assessment information with future preceptors due to concerns about bias and protecting student privacy. However, programs may be looking for alternative processes that address the need to facilitate student growth and to support struggling learners. Examples shared may provide stimulus and insight for Experiential Education Offices to engage in programmatic discussions about the approach to assessment sharing practices.

Design, Implementation, and Outcomes of an Interprofessional Mobile Web Application for Preceptors for Challenging Issues

OBJECTIVE

The purpose of this study was to develop and assess an easily accessible interprofessional mobile web application to assist preceptors with challenging teaching and learning situations.

METHODS

Phase 1 was a modified Delphi process of 48 advanced practice nursing, dentistry, medicine, and pharmacy preceptors to determine the content of the application. Phase 2 consisted of 12 preceptors from the 4 disciplines piloting a prototype to refine the tool using design-thinking principles. Feedback was analyzed using inductive coding and thematic analysis. Phase 3 evaluated the impact of the final tool on 80 preceptors' satisfaction, knowledge, self-efficacy, and perception of behavior change.

RESULTS

Consensus on 10 topics was reached in the following 3 themes: feedback and communication, clinical and professional development of learners, and precepting efficiency. Preceptors rated the tool as efficient and applicable. Features perceived as useful included concise and applicable content that was easy to navigate with practical video examples. Features to improve included academic jargon, length of content, and lack of connectivity with other preceptors. Knowledge and self-efficacy improved after the use of the refined tool. Change in perceptions of behavior after 1 month was mixed, with a significant change in accessing resources to address challenging situations and regularly reflecting on challenging situations and no significant change in awareness, frequency, or success in managing challenging situations.

CONCLUSION

An interprofessional mobile web application for challenging teaching and learning situations developed through a modified Delphi process was deemed efficient and relevant and demonstrated positive knowledge and self-efficacy change.

Investigating preceptor experiences with cultural intelligence in pharmacy education

BACKGROUND

A culturally intelligent pharmacy workforce is critical for addressing health disparities and ensuring that healthcare teams are equipped to support the medication needs of patients. Despite the critical role of preceptors in developing aspiring pharmacists, little is known about how they create or manage cross-cultural situations for students.

OBJECTIVE

The objective of this study was to explore preceptor experiences teaching cultural intelligence within experiential pharmacy settings.

METHODS

A convergent parallel mixed methods approach was used with a 10-item survey measuring preceptor teaching self-efficacy (measured from 0-cannot do at all to 10-highly certain can do) and interviews/focus groups to further understand cultural intelligence teaching experiences. Data were analyzed according to the 4 domains of the cultural intelligence framework (i.e., cultural awareness, cultural knowledge, cultural practice, and cultural desire). Survey data were analyzed descriptively and qualitative data were analyzed deductively.

RESULTS

Participants (n = 24) were most confident Discussing factors underlying health and healthcare disparities (e.g., access, socioeconomic status, environment, racial/ethnic) (7.54 ± 2.04) and least confident in Understanding the importance of cultural desire in teaching students to be culturally intelligent healthcare practitioners (5.21 ± 2.72). All four cultural intelligence domains were identified in the qualitative data (n = 315 codes), with preceptors providing evidence of cultural awareness (n = 38, 12.1%), cultural knowledge (n = 54, 17.1%), cultural practice (n = 183 codes, 58.1%), and cultural desire (n = 40, 12.7%). Preceptors described various pedagogical strategies, such as case discussions, reflection, and simulation.

CONCLUSIONS

Participants provided insight into pedagogical strategies for cultural intelligence that could promote student learning in experiential settings and help explicate curricular gaps. Further research regarding applicability of the cultural intelligence framework is needed, including application of these strategies and opportunities for preceptor development.

Interactive Narrative Simulation as a Method for Preceptor Development

(1) Background: This proof-of-concept study assessed an interactive web-based tool simulating three challenging non-academic learning situations—student professionalism, cross-cultural interactions, and student well-being—as a means of preceptor development. (2) Methods: Three scripts focused on professionalism, cross-cultural interactions, and student well-being were developed and implemented using a commercial narrative tool with branching dialog. Delivered online, this tool presented each challenge to participants. Participants had up to four response options at each turn of the conversation; the choice of response influenced the subsequent conversation, including coaching provided at the resolution of the situation. Participants were invited to complete pre-activity, immediate post-activity, and one-month follow-up questionnaires to assess satisfaction, self-efficacy, engagement, and knowledge change with the tool. Knowledge was assessed through situational judgment tests (SJTs). (3) Results: Thirty-two pharmacist preceptors participated. The frequency of participants reflecting on challenging learning situations increased significantly one-month post-simulation. Participants affirmatively responded that the tool was time-efficient, represented similar challenges they encountered in precepting, was easily navigable, and resulted in learning. Self-efficacy with skills in managing challenging learning situations increased significantly immediately post-simulation and at a one-month follow-up. Knowledge as measured through SJTs was not significantly changed. (4) Conclusions: Preceptors found an interactive narrative simulation a relevant, time-efficient approach for preceptor development for challenging non-academic learning situations. Post-simulation, preceptors more frequently reflected on challenging learning situations, implying behavior change. Self-efficacy and self-report of knowledge increased. Future research is needed regarding knowledge assessments.

The other side of "challenging learners": Strategies for teaching and precepting the overachiever and high performer

In an effort to expedite the publication of articles , AJHP is posting manuscripts online as soon as possible after acceptance. Accepted manuscripts have been peer-reviewed and copyedited, but are posted online before technical formatting and author proofing. These manuscripts are not the final version of record and will be replaced with the final article (formatted per AJHP style and proofed by the authors) at a later time.

Developing a process to manage challenges encountered by experiential education administrators

INTRODUCTION

This study explored preceptor and student related issues reported in pharmacy experiential education settings and solutions that experiential education administrators (EEAs) applied to inform a process to manage these challenges.

METHODS

This mixed-methods study was conducted in two phases. In phase one, five EEAs from three schools of pharmacy collected quantitative and qualitative data over a two-year period on issues reported by students and preceptors and the solutions EEAs employed. Descriptive statistics and content analysis were used to analyze quantitative and qualitative data, respectively. Interviews with six EEAs from four schools were completed in phase two. An additional school was added in phase two. Open coding, pattern coding, and summative analysis were completed on interview data.

RESULTS

Preceptors and students reported 156 and 65 issues, respectively. The most common issues reported were student reliability/responsibility (22, 14%) and preceptor communication (13, 20%). The most frequently applied solutions were coach preceptor (51, 24%) and meet with student (20, 24%). Interviews revealed more information about the strategies EEAs used. Approaches included reactive responses such as talking to and coaching preceptors or students. Preventative strategies were desired, such as tracking data and training.

CONCLUSIONS

Results informed two approaches that EEAs can employ to resolve student and preceptor issues. In the proactive process, issues are tracked to inform student and preceptor development. The reactive approach involves meeting with the preceptor or student, gathering information from both parties, coaching the preceptor or student, and involving other administrators as needed for serious concerns.

Conflict between Pharmacy Preceptors and Pharmacy Learners in Experiential Education

BACKGROUND

The relationship between a preceptor and a learner is complex and can be prone to conflict. The issue of conflict in experiential education has been studied in medicine, nursing, social work, and education; however, conflict between pharmacy preceptors and learners has not been described.

OBJECTIVE

To describe types of conflict between pharmacy preceptors and learners, the outcomes of such conflict, the impacts on the preceptor-learner relationship, and conflict-resolution strategies.

METHODS

An anonymous electronic survey of pharmacist preceptors and pharmacy residents in British Columbia was conducted. The survey included various types of questions to enrich the quality of responses (e.g., Likert scale, ranking, and requests for comments). Descriptive statistics were used.

RESULTS

Forty-nine participants completed the survey from the preceptor's perspective, 12 from the learner's perspective, and 4 from both perspectives. Sixty percent of preceptors (32/53) and 75% of learners (12/16) admitted experiencing conflict. Preceptors (n = 27) cited the learner's professionalism (74%), knowledge/skills (59%), communication issues (59%), personal issues (56%), and punctuality/attendance (52%) as causes of conflict. Learners, however (n = 12), cited differing expectations (67%), teaching versus learning style preferences (50%), and communication issues (67%) as causes of conflict. The majority of preceptors and learners indicated that conflict had negatively affected the relationship; however, most preceptors (69% [18/26]) and learners (50% [6/12]) agreed or strongly agreed with the statement, "I have generally felt comfortable working with preceptors/learners after a conflict." More learners than preceptors felt that the learner's ability to perform was negatively affected by the conflict (92% [11/12] versus 52% [13/25]). Preceptors were more likely to take initiative to resolve conflict. Verbal communication was the method of conflict resolution preferred by both preceptors and learners. Most preceptors and learners indicated that they felt that conflicts were generally resolved.

CONCLUSIONS

Conflict was common in the pharmacy preceptor-learner relationship. Pharmacy preceptors and learners had different perspectives about the causes and outcomes of conflict.

Remediation and reassessment methods in pharmacy education: A systematic review

BACKGROUND

Colleges of pharmacy are currently required to implement a remediation program within their curricula, but no specifications are provided on the ideal methodology. While the need for successful remediation strategies continues to grow, literature describing positive or negative outcomes of different approaches is significantly lacking. The objective of this literature review was to describe and evaluate remediation methodologies in pharmacy education.

METHODS

This literature review was completed following PRISMA criteria. A search of the PubMed, Cochrane Library, Cumulative Index of Nursing and Allied Health, Academic Search Complete, PsycInfo, Scopus, and ProQuest Central databases was conducted in July 2019. Studies were included if they involved pharmacy student education and described either remediation or reassessment.

RESULTS

The evaluated studies discussed a range of course types being remediated, a large variety of remediation strategies and timeframes, and differing overall outcomes. No studies provided comparison of remediation techniques or provided details on the implementation of their chosen approaches. A consistent finding within the evaluated studies was the inclusion of prevention strategies to attempt to avoid the need for remediation preemptively. Overall outcomes for each remedial program were inconsistent and no clear patterns were evident other than an improvement in student performance following remediation.

IMPLICATIONS

Remediation strategies included course repetition, summer restudy, reassessment, and individualized plans. Outcomes varied significantly between studies, making methodology comparisons difficult. Future studies that include more detail and consistency in the reported outcomes would be beneficial to students and help clarify remediation for colleges of pharmacy.

Making the Transition from Student to Resident: A Method to Individualize a PGY1 Program

A Postgraduate Year One (PGY1) resident's concerns, limitations, and strengths may be self-identified early in the residency year but are reliant on self-awareness and insight. Program directors commonly find difficulty in identifying a resident's specific knowledge deficits at the beginning of the program. A standardized resident examination can identify limitations early in training and these results can be incorporated into a tailored resident development plan. A total of sixty-two PGY1 residents completed the examination pre- and post-training over a five-year timespan. Scores increased in most core disciplines in each of the five years, indicating an overall improvement in resident knowledge throughout their PGY1 year. The approach of utilizing the scores for the resident's individualized plan allows for customization to ensure that the resident addresses knowledge gaps where necessary.