A conversation about the role of medical regulators

Pediatrician Perspectives on Learning and Practice Change in the MOCA-Peds 2017 Pilot

BACKGROUND AND OBJECTIVES

This article is the second of a 2-part series examining results regarding self-reported learning and practice change from the American Board of Pediatrics 2017 pilot of an alternative to the proctored, continuing certification examination, termed the Maintenance of Certification Assessment for Pediatrics (MOCA-Peds). Because of its design, MOCA-Peds has several learning advantages compared with the proctored examination.

METHODS

Quantitative and qualitative analyses with 5081 eligible pediatricians who registered to participate in the 2017 pilot; 81.4% (n = 4016) completed a quarter 4 survey and/or the end-of-year survey (January 2018) and compose the analytic sample.

RESULTS

Nearly all (97.6%) participating pediatricians said they had learned, refreshed, or enhanced their medical knowledge, and of those, 62.0% had made a practice change related to pilot participation. Differences were noted on the basis of subspecialty status, with 68.9% of general pediatricians having made a practice change compared with 41.4% of subspecialists. Within the 1456 open-ended responses about participants' most significant practice change, responses ranged widely, including both medical care content (eg, "care for corneal abrasions altered," "better inform patients about. . .flu vaccine") and nonspecific content (eg, providing better patient education, using evidence-based medicine, increased use of resources in regular practice).

CONCLUSIONS

As a proctored examination alternative, MOCA-Peds positively influenced self-reported learning and practice change. In future evaluation of MOCA-Peds and other medical longitudinal assessments, researchers should study ways to further encourage learning and practice change and sustainability.

MOCA-Peds: Development of a New Assessment of Medical Knowledge for Continuing Certification

The American Board of Pediatrics (ABP) certifies that general and subspecialty pediatricians meet standards of excellence established by their peers. Certification helps demonstrate that a general pediatrician or pediatric subspecialist has successfully completed accredited training and fulfills continuous certification requirements (Maintenance of Certification [MOC]). One current component of the MOC program is a closed-book examination administered at a secure testing center (ie, the MOC Part 3 examination). In this article, we describe the development of an alternative to this examination termed the "Maintenance of Certification Assessment for Pediatrics" (MOCA-Peds) during 2015-2016. MOCA-Peds was conceptualized as an online, summative (ie, pass/fail), continuous assessment of a pediatrician's knowledge that would also promote learning. The system would consist of a set number of multiple-choice questions delivered each quarter, with immediate feedback on questions, rationales clarifying correct and incorrect answers, references for further learning, and peer benchmarking. Questions would be delivered quarterly and taken at any time within the quarter in a setting with Internet connectivity and on any device. As part of the development process in 2015-2016, the ABP actively recruited pediatricians to serve as members of a yearlong user panel or single-session focus groups. Refinements to MOCA-Peds were made on the basis of their feedback. MOCA-Peds is being actively piloted with pediatricians in 2017-2018. The ABP anticipates an expected launch in January 2019 of MOCA-Peds for General Pediatrics, Pediatric Gastroenterology, Child Abuse, and Pediatric Infectious Diseases with launch dates for the remaining pediatric subspecialties between 2020 and 2022.