A cross-sectional study exploring the different roles of individual and group assessment methods in assessing public health nutrition competence

Assessment in community settings: Is there any role for individual competency-based assessment?

BACKGROUND

Oral forms of assessment remain a common part of competency-based assessment systems, yet their feasibility is being challenged. The focus on individual competence is problematic given the need to prepare health professionals for teamwork. The present study aimed to investigate how the assessment of collective competence compares to individual assessment, and to explore whether there is a need for individual assessment at all in community or population-based practice.

METHODS

A behavioural-based interview assessment was developed and trialled and correlated to performance as a team on placement. Correlation between student performance on individual behavioural-based interview and teamwork artefacts was assessed using Spearman rho. Differences between performance on individual oral assessment and team performance on artefacts at the cohort level was determined using the Mann-Whitney U-test. Bland-Altman analysis was completed to analyse agreement between performance on the individual oral assessment and team performance at the student level.

RESULTS

Students were final year nutrition and dietetics students from 2020, 2021 and 2022 years (total sample = 216) from one Australian university. There was a difference in performance between assessment types in each year and as a total cohort (p < 0.001) with students performing better in teamwork. There was no correlation between individual oral interview and team performance across all years. The results of the Bland-Altman analysis showed little agreement between the two assessment tasks.

CONCLUSIONS

Assessment of teamwork performance as part of a program of assessment is essential. More valid and reliable tools are needed to assess collective competence.

An exploration of Irish nutrition educators' experiences of competency-based assessment in nutrition science education

BACKGROUND

Competency-based assessment (CBA) supports the development and attainment of skills required for the workforce. Little is known about educators' experience in developing or implementing CBA in nutrition science education or their opinions on how well it captures a student's preparedness for the workforce. The objective of this study was to explore educators' experience of CBA in nutrition education in Ireland.

METHOD

Grounded in interpretivism, in-depth, semi-structured, audio-recorded interviews were conducted with 13 educators from five of the ten undergraduate honours degree nutrition programmes across Ireland. Interviews explored experiences of CBA and perception of students training to prepare for the workforce. A reflexive thematic analysis approach was implemented whereby the data were transcribed, inductively coded, and themes identified.

RESULTS

A clear divide was evident between participants who were confident in their understanding of CBA and those who were unsure or had no knowledge of the term. Those with a clear understanding were more involved in programme development and evaluation. Three themes were identified: 'Assessment process' including intended learning outcomes, assessment design, and grading systems, 'Student-centred approach to assessment' focusing on work-based assessment and preparation for the workforce, and 'Upskilling educators' to equip educators with the skills and knowledge for professional development and to foster student success.

CONCLUSION

The importance of CBA as a student-centred approach, supporting them to meet standards expected to practice as a nutrition professional, was the key experience of educators. Training in CBA and inclusion of more authentic assessment may better prepare students for the workforce.

Enabling Factors for the Implementation of Competency-Based Curricula in Colleges and Schools of Pharmacy

OBJECTIVES

To review the implementation drivers of competency-based pharmacy education (CBPE) and provide recommendations for enablers.

FINDINGS

Competency-based education is an emerging model in the health professions, focusing on time-variable competency development and achievement compared with a time-bound, course-based, traditional model. CBPE is an outcomes-based organized framework of competencies enabling pharmacists to meet health care and societal needs. However, challenges need to be recognized and overcome for the successful implementation of CBPE. Competency drivers include defining the competencies and roles of stakeholders, developing transparent learning trajectories and aligned assessments, and establishing lifetime development programs for stakeholders. Organization drivers include developing support systems for stakeholders; facilitating connections between all educational experiences; and having transparent assessment plans, policies, and procedures that align with core CBPE precepts, including the sustainability of time-variability. Leadership drivers include establishing growth mindset and facilitating a culture of connection between workplace and educational environments, program advocacy by institutional leaders, accepting failures as part of the process, shifting the organizational culture away from learner differentiation toward competence, and maintaining sufficient administrative capability to support CBPE.

SUMMARY

The successful implementation of CBPE involves enabling the competency, organization, and leadership drivers that will lead to program success. More research is needed in the areas of creation, implementation, and assessment of CBPE to determine success in this model. We have reviewed and provided recommendations to enable the drivers of successful implementation of CBPE.