Using Peer Feedback to Promote Clinical Excellence in Hospital Medicine

Peer feedback: A tool to improve PA, NP, and physician collaboration and clinical practice

ABSTRACT

The increasing use of physician associates/assistants (PAs) and NPs on clinical teams creates an opportunity for colleagues to provide feedback that can drive growth and improvement in PA and NP clinical skills. Through a needs assessment, month-long pilot, and buy-in from our academic hospital medicine group, we initiated a peer feedback platform that sought to highlight individual faculty strengths, facilitate thoughtful and constructive feedback, and create effective collaboration among colleagues. Three months after implementation, results indicated that the platform provided important information on clinical skills and identified areas for growth and opportunities for additional training. Peer feedback can also improve working relationships among PAs, NPs, and physicians by highlighting the clinical skill sets and value of all team members.

Reconstructing feedback in graduate medical education: development of the REFLECT scale to measure feedback delivery in medical residency training

BACKGROUND

Feedback plays a pivotal role in graduate medical education, where medical residents are expected to acquire a wide range of practical and professional competencies. Assessing the feedback delivery status is a preliminary step for educators to enhance the quality of feedback provided. This study aims to develop an instrument to assess the various aspects of feedback delivery in medical residency training.

METHODS

The fifteen-item REFLECT (Residency Education Feedback Level Evaluation in Clinical Training) questionnaire was developed. The content validity was evaluated according to a panel member consisting of fourteen clinical professors and medical education instructors. After evaluating the test-retest reliability, the questionnaire was distributed to a sample of 154 medical residents and was further assessed in terms of internal consistency and factor analysis.

RESULTS

Content validity analysis resulted in an appropriate content validity ratio and content validity index for the final 15 items. The test-retest reliability resulted in an ICC of 0.949 (95% C.I. 0.870-0.980), indicating excellent reliability. The Cronbach's alpha for the 15-item questionnaire was α = 0.85, demonstrating good internal consistency. The factor analysis resulted in a four-factor structure: "attitude towards feedback", "quality of feedback", "perceived importance of feedback", and "reaction to feedback".

CONCLUSIONS

REFLECT proved to a reliable tool that could be utilized as a quick assessment method of feedback delivery, making it a suitable aid for educational managers and faculties to design necessary interventions aiming to enhance the quantity and quality of feedback provided.

Optimal training in communication model (OPTiCOM): A programmatic roadmap

OBJECTIVES

Teaching primary care residents patient communication skills is essential, complex, and impeded by barriers. We find no models guiding faculty how to train residents in the workplace that integrate necessary system components, the science of physician-patient communication training and competency-based medical education. The aim of this project is to create such a model.

METHODS

We created OPTiCOM using four steps: (1) communication educator interviews, analysis and theme development; (2) initial model construction; (3) model refinement using expert feedback; (4) structured literature review to validate, refine and finalize the model.

RESULTS

Our model contains ten interdependent building blocks organized into four developmental tiers. The Foundational value tier has one building block Naming relationship as a core value. The Expertize and resources tier includes four building blocks addressing: Curricular expertize, Curricular content, Leadership, and Time. The four building blocks in the Application and development tier are Observation form, Faculty development, Technology, and Formative assessment. The Language and culture tier identifies the final building block, Culture promoting continuous improvement in teaching communication.

CONCLUSIONS

OPTiCOM organizes ten interdependent systems building blocks to maximize and sustain resident learning of communication skills. Practice Implications Residency faculty can use OPTiCOM for self-assessment, program creation and revision.

Cohort study of hospitalists' procedural skills: baseline competence and durability after simulation-based training

OBJECTIVES

Hospitalists are expected to be competent in performing bedside procedures, which are associated with significant morbidity and mortality. A national decline in procedures performed by hospitalists has prompted questions about their procedural competency. Additionally, though simulation-based mastery learning (SBML) has been shown to be effective among trainees whether this approach has enduring benefits for independent practitioners who already have experience is unknown. We aimed to assess the baseline procedural skill of hospitalists already credentialed to perform procedures. We hypothesised that simulation-based training of hospitalists would result in durable skill gains after several months.

DESIGN

Prospective cohort study with pretraining and post-training measurements.

SETTING

Single, large, urban academic medical centre in the USA.

PARTICIPANTS

Twenty-two out of 38 eligible participants defined as hospitalists working on teaching services where they would supervise trainees performing procedures.

INTERVENTIONS

One-on-one, 60 min SBML of lumbar puncture (LP) and abdominal paracentesis (AP).

PRIMARY AND SECONDARY OUTCOME MEASURES

Our primary outcome was the percentage of hospitalists obtaining minimum passing scores (MPS) on LP and AP checklists; our secondary outcomes were average checklist scores and self-reported confidence.

RESULTS

At baseline, only 16% hospitalists met or exceeded the MPS for LP and 32% for AP. Immediately after SBML, 100% of hospitalists reached this threshold. Reassessment an average of 7 months later revealed that only 40% of hospitalists achieved the MPS. Confidence increased initially after training but declined over time.

CONCLUSIONS

Hospitalists may be performing invasive bedside procedures without demonstration of adequate skill. A single evidence-based training intervention was insufficient to sustain skills for the majority of hospitalists over a short period of time. More stringent practices for certifying hospitalists who perform risky procedures are warranted, as well as mechanisms to support skill maintenance, such as periodic simulation-based training and assessment.