Maintenance of Certification Part 4 Credit and recruitment for practice-based research

Exploring paediatricians' experiences with performance improvement modules and quality improvement

Objective

The American Board of Pediatrics’ (ABP) maintenance of certification (MOC) programme seeks to continue educating paediatricians throughout their careers by encouraging lifelong learning and continued improvement. The programme includes four parts, each centring on a different aspect of medical practice. Part 4 MOC centres on quality improvement (QI). Surveys by the ABP suggest that paediatricians are dissatisfied with aspects of part 4, but their reasons are unclear. This study sought to explore factors contributing to dissatisfaction with part 4 by focusing on performance improvement modules (PIMs), a popular means of achieving part 4 credit.

Methods

The study used cross-sectional purposive sampling drawing from US physicians working in a range of practice settings: private outpatient, hospital, academic and low-income clinics. The sampling frame was divided by practice characteristics and satisfaction level, derived from a five-point Likert item asking about physician satisfaction regarding a recent PIM. In-depth interviews were conducted with 21 physicians, and the interview data were coded, categorised into themes and analysed using a framework analysis approach.

Results

Paediatricians expressed nuanced views of PIMs and remain globally dissatisfied with part 4, although reasons for dissatisfaction varied. Concerns with PIMs included: (1) excessive time and effort; (2) limited improvement and (3) lack of clinically relevant topics. While most agreed that QI is important, participants felt persistently dissatisfied with the mechanics of doing PIMs, especially when QI tasks fell outside of their typical work regimen.

Conclusions

Paediatricians agreed that part 4, PIMs, and QI efforts in general still lack clinical relevance and need to be more easily incorporated into practice workflow. Clinicians specifically felt that PIMs must be directly integrated with physicians’ practice settings in terms of topic, data quality and metrics, and must address practice differences in time and monetary resources for completing large or complex projects.

Improving Outpatient Provider Communication for High-Risk Discharges From the Hospitalist Service

BACKGROUND

Patients are at risk for adverse events during inpatient-to-outpatient transitions of care. Previous improvement work has been targeted at this care transition, but gaps in discharge communication still exist. We aimed to increase documentation of 2-way communication between hospitalists and primary care providers (PCPs) for high-risk discharges from pediatric hospital medicine (PHM) services from 7% to 60% within 30 months.

METHODS

A3 improvement methodology was used. A list of high-risk discharge communication criteria was developed through engagement of PCPs and hospitalists. A driver diagram guided interventions. The outcome measure was documentation of successful 2-way communication with the PCP. Any documented 2-way discharge communication attempt was the process measure. Via a survey, hospitalist satisfaction with the discharge communication expectation served as the balancing measure. All patients discharged from PHM services meeting ≥1 high-risk criterion were included. Statistical process control charts were used to assess changes over time.

RESULTS

There were 3241 high-risk discharges (442 baseline: November 2017 to January 2018; 2799 intervention and sustain: February 2018 to June 2020). The outcome measure displayed iterative special cause variation from a mean baseline of 7% to peak of 39% but regressed and was sustained at 27%. The process measure displayed iterative special cause variation from a 13% baseline mean to a 64% peak, with regression to 41%. The balancing measure worsened from baseline of 5% dissatisfaction to 13%. Interventions temporally related to special cause improvements were education, division-level performance feedback, standardization of documentation, and offloading the task of communication coordination from hospitalists to support staff.

CONCLUSIONS

Improvement methodology resulted in modestly sustained improvements in PCP communication for high-risk discharges from the PHM services.

Engaging faculty in a workshop intervention on overcoming the influence of implicit bias

INTRODUCTION

To study the effectiveness of any educational intervention for faculty requires first that they attend the training. Using attendance as a measure of faculty engagement, this study examined factors associated with the percentage of faculty in divisions of departments of medicine who attended a workshop as part of a multisite study.

METHODS

Between October 2018 and March 2020, 1675 of 4767 faculty in 120 divisions of 14 departments of medicine attended a 3-hour in-person workshop as part of the Bias Reduction in Internal Medicine (BRIM) initiative. This paper describes the workshop development and study design. The number of faculty per division ranged from 5 to 296. Attendance rates varied from 2.7% to 90.1%. Taking a quality improvement approach, the study team brainstormed factors potentially related to variations in workshop attendance, constructed several division- and institution-level variables, and assessed the significance of factors on workshop attendance with hierarchical linear models.

RESULTS

The following were positively associated with workshop attendance rate: the division head attended the workshop, the BRIM principal investigator gave Medical Grand Rounds, and the percentage of local workshop presenters who completed training. Workshop attendance rates fell when departments identified more than five on-site study leaders.

CONCLUSIONS

Factors associated with higher workshop attendance may have increased the perceived status and value of attending the workshop, leading faculty to choose the workshop over other competing demands. For future investigators studying educational interventions that require participation of faculty in clinical departments at multiple sites, this work offers several valuable lessons.

Delivery and Impact of a Motivational Intervention for Smoking Cessation: A PROS Study

OBJECTIVES

We tested a Public Health Service 5As-based clinician-delivered smoking cessation counseling intervention with adolescent smokers in pediatric primary care practice.

METHODS

We enrolled clinicians from 120 practices and recruited youth (age ≥14) from the American Academy of Pediatrics Pediatric Research in Office Settings practice-based research network. Practices were randomly assigned to training in smoking cessation (intervention) or social media counseling (attentional control). Youth recruited during clinical visits completed confidential screening forms. All self-reported smokers and a random sample of nonsmokers were offered enrollment and interviewed by phone at 4 to 6 weeks, 6 months, and 12 months after visits. Measures included adolescents' report of clinicians' delivery of screening and counseling, current tobacco use, and cessation behaviors and intentions. Analysis assessed receipt of screening and counseling, predictors of receiving 5As counseling, and effects of interventions on smoking behaviors and cessation at 6 and 12 months.

RESULTS

Clinicians trained in the 5As intervention delivered more screening (β = 1.0605, P < .0001) and counseling (β = 0.4354, P < .0001). In both arms, clinicians more often screened smokers than nonsmokers. At 6 months, study arm was not significantly associated with successful cessation; however, smokers in the 5As group were more likely to have quit at 12 months. Addicted smokers more often were counseled, regardless of study arm, but were less likely to successfully quit smoking.

CONCLUSIONS

Adolescent smokers whose clinicians were trained in 5As were more likely to receive smoking screening and counseling than controls, but the ability of this intervention to help adolescents quit smoking was limited.

Can Maintenance of Certification Work? Associations of MOC and Improvements in Physicians' Knowledge and Practice

PURPOSE

To summarize the findings of studies, conducted by individuals both internal and external to the American Board of Medical Specialties (ABMS) Member Boards, of the associations of Maintenance of Certification (MOC) and improvements in physicians' knowledge and patient care processes or outcomes.

METHOD

The authors conducted a narrative review of studies identified by searching PubMed and Web of Science for English-language articles from the United States published between 2000 and May 2017. To be included, articles had to examine the relationship of MOC to physician knowledge, clinical practice processes, or patient care outcomes. The initial search yielded 811 articles. After two rounds of review and excluding those articles that did not fit the study criteria, 39 articles were included for analysis.

RESULTS

The 39 included studies were conducted by or included diplomates of 12 ABMS Member Boards. Twenty-two studies examined MOC processes that were developed by an ABMS Board; 17 examined interventions that were developed by nonboard entities but accepted for MOC credit by an ABMS Board. Thirty-eight studies examined a single component of MOC; 24 studied the improvement in medical practice component. Thirty-seven studies reported at least one positive outcome.

CONCLUSIONS

Most of the studies included in this review highlighted circumstances in which MOC was associated with positive impacts on physician knowledge and patient care processes or outcomes. Future collaborative research is needed to improve the relevance, helpfulness, and generalizability of continuing certification to different physicians across specialties and practice settings.

Physician Satisfaction With and Practice Changes Resulting From American Board of Family Medicine Maintenance of Certification Performance in Practice Modules

INTRODUCTION

Physician payment in the United States will be increasingly tied to quality measurement and performance. Whether participation in quality improvement (QI) through Maintenance of Certification for Family Physicians Performance in Practice Modules (PPMs) is useful and results in practice change remains unknown.

METHODS

All PPM feedback data from inception to April 2014 were analyzed using descriptive statistics by year, topic, and number of PPMs completed. Qualitative content analysis was applied to analyze responses to open-ended questions on practice changes.

RESULTS

Of note, 29,755 diplomates completed 38,201 PPMs; median 1 interquartile range (1, 1). Nearly two-thirds (65.8%, n = 25,150) of PPMs had completed feedback surveys. Of note, 78.7% of respondents indicated that they would change patient care and 90.2% indicated that they would continue QI activities after completing the PPM. Respondents endorsed high relevance to practice (90.5%), high currency of clinical information (86.4%), and high usefulness of clinical information (80.5%). When feedback was analyzed by the number of PPMs completed, respondents were less likely to change care but reported increased usefulness to practice and stable intention to continue QI efforts with more PPMs completed. Of note, 86.0% of respondents who said that they would change care provided examples: these varied by PPM topic but "doing more," focusing on patients, and education were common.

DISCUSSION

These findings suggest that QI completed through the PPMs may assist family physicians in improving the care they provide. Furthermore, ratings by the number of PPMs completed suggest that repeated exposure to QI efforts produce continued relevance and usefulness, even when changes in practice decline.

Expanding Educators' Contributions to Continuous Quality Improvement of American Board of Medical Specialties Maintenance of Certification

The American Board of Medical Specialties board certification has transformed into a career-long process of learning, assessment, and performance improvement through its Program for Maintenance of Certification (MOC). Medical educators across many medical professional organizations, specialty societies, and other institutions have played important roles in shaping MOC and tailoring its overarching framework to the needs of different specialties. This Commentary addresses potential barriers to engagement in work related to MOC for medical school (MS) and academic health center (AHC) educators and identifies reasons for, and ways to accomplish, greater involvement in this work. The authors present ways that medical and other health professions educators in these settings can contribute to the continuous improvement of the MOC program including developing educational and assessment activities, engaging in debate about MOC, linking MOC with institutional quality improvement activities, and pursuing MOC-related scholarship. MS- and AHC-based educators have much to offer this still-young and continually improving program, and their engagement is sought, necessary, and welcomed.

Adapting practice-based intervention research to electronic environments: opportunities and complexities at two institutions

BACKGROUND AND PURPOSE

Primary care practice-based research has become more complex with increased use of electronic health records (EHRs). Little has been reported about changes in study planning and execution that are required as practices change from paper-based to electronic-based environments. We describe the evolution of a pediatric practice-based intervention study as it was adapted for use in the electronic environment, to enable other practice-based researchers to plan efficient, effective studies.

METHODS

We adapted a paper-based pediatric office-level intervention to enhance parent-provider communication about subspecialty referrals for use in two practice-based research networks (PBRNs) with partially and fully electronic environments. We documented the process of adaptation and its effect on study feasibility and efficiency, resource use, and administrative and regulatory complexities, as the study was implemented in the two networks.

RESULTS

Considerable time and money was required to adapt the paper-based study to the electronic environment, requiring extra meetings with institutional EHR-, regulatory-, and administrative teams, and increased practice training. Institutional unfamiliarity with using EHRs in practice-based research, and the consequent need to develop new policies, were major contributors to delays. Adapting intervention tools to the EHR and minimizing practice disruptions was challenging, but resulted in several efficiencies as compared with a paper-based project. In particular, recruitment and tracking of subjects and data collection were easier and more efficient.

CONCLUSIONS

Practice-based intervention research in an electronic environment adds considerable cost and time at the outset of a study, especially for centers unfamiliar with such research. Efficiencies generated have the potential of easing the work of study enrollment, subject tracking, and data collection.