Evaluation of a High Stakes Physician Competency Assessment: Lessons for Assessor Training, Program Accountability, and Continuous Improvement

Recasting Assessment in Continuing Professional Development as a Person-Focused Activity

ABSTRACT

In this article, we examine assessment as conceptualized and enacted in continuing professional development (CPD). Assessment is pervasive throughout the life of an individual health professional, serving many different purposes compounded by varied and unique contexts, each with their own drivers and consequences, usually casting the person as the object of assessment. Assessment is often assumed as an included part in CPD development conceptualization. Research on assessment in CPD is often focused on systems, utility, and quality instead of intentionally examining the link between assessment and the person. We present an alternative view of assessment in CPD as person-centered, practice-informed, situated and bound by capability, and enacted in social and material contexts. With this lens of assessment as an inherently personal experience, we introduce the concept of subjectification, as described by educationalist Gert Biesta. We propose that subjectification may be a fruitful way of examining assessment in a CPD context. Although the CPD community, researchers, and educators consider this further, we offer some early implications of adopting a subjectification lens on the design and enactment of assessment in CPD.

Physician norms for the Automated Neuropsychological Assessment Metrics (ANAM)

INTRODUCTION

The development of population specific norms for the Automated Neuropsychological Assessment Metrics (ANAM) is to help expand the utility for use with other population groups. Currently, normative data are available for general military, special operations, athletic, and community populations. The current study provides normative reference values for use in assessing physicians.

MATERIALS AND METHODS

Retrospective data from a sample of 2,288 physicians who completed the ANAM were examined. The data were gathered from practicing civilian physicians serving in the National Guard or Reserves who completed the assessment as part of the mandated Department of Defense clinical testing policy. The effects of age and sex on performance were examined for all subtests. Normative tables were stratified by age (23-29, 30-34, 35-39, 40-44, 45-49, 50-54, 55-59, 60-64, 65-79) and sex. Base rates of low scores among the physician population were also examined.

RESULTS

Older age was associated with lower performance on all subtests with small-to-medium effect sizes. A mixed pattern of performance was observed as a factor of sex with females scoring better on one subtest and males scoring better on three subtests. However, effects sizes associated with sex were small and likely of minimal clinical significance. A total of 11.3% of the physician sample scored below average on two or more tests in the battery.

CONCLUSIONS

This study provides normative data for practicing physicians that can be used to help inform clinical decision-making.