A Qualitative Analysis of Narrative Preclerkship Assessment Data to Evaluate Teamwork Skills

Evidence-guided approach to portfolio-guided teaching and assessing communications, ethics and professionalism for medical students and physicians: a systematic scoping review

OBJECTIVES

Guiding the development of longitudinal competencies in communication, ethics and professionalism underlines the role of portfolios to capture and evaluate the multiple multisource appraisals and direct personalised support to clinicians. However, a common approach to these combined portfolios continues to elude medical practice. A systematic scoping review is proposed to map portfolio use in training and assessments of ethics, communication and professionalism competencies particularly in its inculcation of new values, beliefs and principles changes attitudes, thinking and practice while nurturing professional identity formation. It is posited that effective structuring of portfolios can promote self-directed learning, personalised assessment and appropriate support of professional identity formation.

DESIGN

Krishna's Systematic Evidence-Based Approach (SEBA) is employed to guide this systematic scoping review of portfolio use in communication, ethics and professionalism training and assessment.

DATA SOURCES

PubMed, Embase, PsycINFO, ERIC, Scopus and Google Scholar databases.

ELIGIBILITY CRITERIA

Articles published between 1 January 2000 and 31 December 2020 were included.

DATA EXTRACTION AND SYNTHESIS

The included articles are concurrently content and thematically analysed using the split approach. Overlapping categories and themes identified are combined using the jigsaw perspective. The themes/categories are compared with the summaries of the included articles in the funnelling process to ensure their accuracy. The domains identified form the framework for the discussion.

RESULTS

12 300 abstracts were reviewed, 946 full-text articles were evaluated and 82 articles were analysed, and the four domains identified were indications, content, design, and strengths and limitations.

CONCLUSIONS

This review reveals that when using a consistent framework, accepted endpoints and outcome measures, longitudinal multisource, multimodal assessment data fashions professional and personal development and enhances identity construction. Future studies into effective assessment tools and support mechanisms are required if portfolio use is to be maximised.

Multi-source feedback following simulated resuscitation scenarios: a qualitative study

BACKGROUND

The direct observation and assessment of learners' resuscitation skills by an attending physician is challenging due to the unpredictable and time-sensitive nature of these events. Multisource feedback (MSF) may address this challenge and improve the quality of assessments provided to learners. We aimed to describe the similarities and differences in the assessment rationale of attending physicians, registered nurses, and resident peers in the context of a simulation-based resuscitation curriculum.

METHODS

We conducted a qualitative content analysis of narrative MSF of medical residents in their first postgraduate year of training who were participating in a simulation-based resuscitation course at two Canadian institutions. Assessments included an entrustment score and narrative comments from attending physicians, registered nurses, and resident peers in addition to self-assessment. Narrative comments were transcribed and analyzed thematically using a constant comparative method.

RESULTS

All 87 residents (100%) participating in the 2017-2018 course provided consent. A total of 223 assessments were included in our analysis. Four themes emerged from the narrative data: 1) Communication, 2) Leadership, 3) Demeanor, and 4) Medical Expert. Relative to other assessor groups, feedback from nurses focused on patient-centred care and communication while attending physicians focused on the medical expert theme. Peer feedback was the most positive. Self-assessments included comments within each of the four themes.

CONCLUSIONS

In the context of a simulation-based resuscitation curriculum, MSF provided learners with different perspectives in their narrative assessment rationale and may offer a more holistic assessment of resuscitation skills within a competency-based medical education (CBME) program of assessment.

Medical Student Portfolios: A Systematic Scoping Review

PHENOMENON

Medical Student Portfolios (MSP)s allow medical students to reflect and better appreciate their clinical, research and academic experiences which promotes their individual personal and professional development. However, differences in adoption rate, content design and practice setting create significant variability in their employ. With MSPs increasingly used to evaluate professional competencies and the student's professional identity formation (PIF), this has become an area of concern.

APPROACH

We adopt Krishna's Systematic Evidence-Based Approach to carry out a Systematic Scoping Review (SSR in SEBA) on MSPs. The structured search process of six databases, concurrent use of thematic and content analysis in the Split Approach and comparisons of the themes and categories with the tabulated summaries of included articles in the Jigsaw Perspective and Funnelling Process offers enhanced transparency and reproducibility to this review.

FINDINGS

The research team retrieved 14501 abstracts, reviewed 779 full-text articles and included 96 articles. Similarities between the themes, categories and tabulated summaries allowed the identification of the following funnelled domains: Purpose of MSPs, Content and structure of MSPs, Strengths and limitations of MSPs, Methods to improve MSPs, and Use of E-portfolios.

INSIGHTS

Variability in the employ of MSPs arise as a result of a failure to recognise its different roles and uses. Here we propose additional roles of MSPs, in particular, building on a consistent set of content materials and assessments of milestones called micro-competencies. Whislt generalised micro-competencies assess achievement of general milestones expected of all medical students, personalised micro-competencies record attainment of particular skills, knowledge and attitudes balanced against the medical student's abilities, context and needs. This combination of micro-competencies in a consistent framework promises a holistic, authentic and longitudinal perspective of the medical student's development and maturing PIF.

Exploring second professional year pharmacy student reflections after an interprofessional shadowing experience with nursing students in critical care units: a qualitative study

Accreditation standards for pharmacy and nursing education require interprofessional education (IPE) as a key component in both curricula. There is increasing evidence for using interprofessional shadowing as a learning modality for IPE; reflection can be used to enhance learning from these experiences. We explored pharmacy student-reported reflections from an interprofessional shadowing experience with nursing students through qualitative content analysis of reflective statements. We found that pharmacy students gained knowledge of nursing roles and areas of expertise, awareness of how the team provides care, and awareness of the importance of communication and mutual respect to improve both team performance and patient safety. Additionally, we were able to assess interprofessional sub-competencies that were met as a result of the interprofessional shadowing experience, specifically, pharmacy students gained knowledge and skills across all four IPEC Core Competencies. Interprofessional shadowing combined with reflection can enhance learning, and thematic analysis of these reflections can be utilized to assess IPE outcomes.