The Clinical Competency Committee in Adult Cardiothoracic Anesthesiology-Perspectives From Program Directors Around the United States

Interventional Pulmonary Fellowship Training: End of the Beginning

Interventional pulmonology (IP) fellowship training has undergone increased popularity and growth. The Accreditation Council of Graduate Medical Education recently recognized IP medicine as a new subspecialty, which leads to new challenges and opportunities for a young subspecialty. Although the specialty-specific requirements are in progress, IP fellowship programs must plan ahead for the known common program requirements and anticipated accreditation process. The educational leadership in IP must identify and execute solutions to sustain continued excellence. This includes transitioning to a new regulatory environment with issues of funding new fellowships, keeping up to date with training/assessment of new procedures, and shaping the future through recruitment of talent to lead the young subspecialty.

Beyond summative decision making: Illuminating the broader roles of competence committees

CONTEXT

Although competence committees (CCs) are most often conceptualised as group decision-making bodies, policy documents forward a more ambitious vision and outline several additional roles for CCs that support the continuous quality improvement of education programmes and promote formative feedback. However, whether these functions are encompassed in the everyday work of CCs is currently unknown.

METHODS

This constructivist grounded theory study elaborates the range of roles taken up by CCs and illuminates the processes through which these roles are actualised. Two investigators observed 27 CC meetings (>80 hours) across seven diverse postgraduate programmes at a single Canadian institution. Following each observation, a semi-structured interview was conducted with one CC member. Data collection and analysis unfolded iteratively.

RESULTS

In this study, CCs did much more than make summative decisions about progression and entrustment; they identified a variety of problems that arose at the levels of both the individual learner and the programme, and leveraged their knowledge of assessment data to develop solutions. The problem-solving work of CCs was enabled by the in-depth data review, synthesis and analysis work that occurred before scheduled meetings, outside protected academic or administrative time. Although this work often appeared invisible to those outside the committee, the insights gleaned from data review provided committee members with essential information about how their programme of assessment was unfolding in practice.

CONCLUSIONS

Competence committees may be an untapped resource that can support assessment for learning, local evaluation of competency-based medical education (CBME) implementation and continuous quality improvement for programmes of assessment. However, the ability of CCs to engage in this work is fragile and is currently sustained by the willingness of faculty members to devote their time and energy to it. The resourcing of CCs may have profound implications for translation of the theory of programmatic assessment and CBME into practice.

Developing a dashboard to meet Competence Committee needs: a design-based research project

BACKGROUND

Competency-based programs are being adopted in medical education around the world. Competence Committees must visualize learner assessment data effectively to support their decision-making. Dashboards play an integral role in decision support systems in other fields. Design-based research allows the simultaneous development and study of educational environments.

METHODS

We utilized a design-based research process within the emergency medicine residency program at the University of Saskatchewan to identify the data, analytics, and visualizations needed by its Competence Committee, and developed a dashboard incorporating these elements. Narrative data were collected from two focus groups, five interviews, and the observation of two Competence Committee meetings. Data were qualitatively analyzed to develop a thematic framework outlining the needs of the Competence Committee and to inform the development of the dashboard.

RESULTS

The qualitative analysis identified four Competence Committee needs (Explore Workplace-Based Assessment Data, Explore Other Assessment Data, Understand the Data in Context, and Ensure the Security of the Data). These needs were described with narratives and represented through visualizations of the dashboard elements.

CONCLUSIONS

This work addresses the practical challenges of supporting data-driven decision making by Competence Committees and will inform the development of dashboards for programs, institutions, and learner management systems.