Multi-organ point-of-care ultrasound for COVID-19 (PoCUS4COVID): international expert consensus

COVID-19 has caused great devastation in the past year. Multi-organ point-of-care ultrasound (PoCUS) including lung ultrasound (LUS) and focused cardiac ultrasound (FoCUS) as a clinical adjunct has played a significant role in triaging, diagnosis and medical management of COVID-19 patients. The expert panel from 27 countries and 6 continents with considerable experience of direct application of PoCUS on COVID-19 patients presents evidence-based consensus using GRADE methodology for the quality of evidence and an expedited, modified-Delphi process for the strength of expert consensus. The use of ultrasound is suggested in many clinical situations related to respiratory, cardiovascular and thromboembolic aspects of COVID-19, comparing well with other imaging modalities. The limitations due to insufficient data are highlighted as opportunities for future research.

Use of Critical Items in Determining Point-of-Care Ultrasound Competence

We previously developed a workplace-based tool for assessing point of care ultrasound (POCUS) skills and used a modified Delphi technique to identify critical items (those that learners must successfully complete to be considered competent). We performed a standard setting procedure to determine cut scores for the full tool and a focused critical item tool. This study compared ratings by 24 experts on the two checklists versus a global entrustability rating. All experts assessed three videos showing an actor performing a POCUS exam on a patient. The performances were designed to show a range of competences and one included potentially critical errors. Interrater reliability for the critical item tool was higher than for the full tool (intraclass correlation coefficient = 0.84 [95% confidence interval [CI] 0.42-0.99] vs. 0.78 [95% CI 0.25-0.99]). Agreement with global ratings of competence was higher for the critical item tool (κ = 0.71 [95% CI 0.55-0.88] vs 0.48 [95% CI 0.30-0.67]). Although sensitivity was higher for the full tool (85.4% [95% CI 72.2-93.9%] vs. 81.3% [95% CI 67.5-91.1%]), specificity was higher for the critical item tool (70.8% [95% CI 48.9-87.4%] vs. 29.2% [95% CI 12.6-51.1%]). We recommend the use of critical item checklists for the assessment of POCUS competence.

The Potential for Remotely Mentored Patient-Performed Home Self-Monitoring for New Onset Alveolar-Interstitial Lung Disease

Purpose: Coronavirus disease 2019 (COVID-19) caused by the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) and is an acute respiratory illness. Although most infected persons are asymptomatic or have only mild symptoms, some patients progress to devastating disease; such progression is difficult to predict or identify in a timely manner. COVID-19 patients who do not require hospitalization can self-isolate at home. Calls from one disease epicenter identify the need for homebased isolation with telemedicine surveillance to monitor for impending deterioration. Methodology: Although the dominant approach for these asymptomatic/paucisymptomatic patients is to monitor oxygen saturation, we suggest additionally considering the potential merits and utility of home-based imaging. Chest computed tomography is clearly impractical, but ultrasound has shown comparable sensitivity for lung involvement, with major advantages of short and simple procedures, low cost, and excellent repeatability. Thoracic ultrasound may thus allow remotely identifying the development of pneumonitis at an early stage of illness and potentially averting the risk of insidious deterioration to severe pneumonia and critical illness while in home isolation. Conclusions: Lung sonography can be easily performed by motivated nonmedical caregivers when directed and supervised in real time by experts. Remote mentors could thus efficiently monitor, counsel, and triage multiple home-based patients from their "control center." Authors believe that this approach deserves further attention and study to reduce delays and failures in timely hospitalization of home-isolated patients.

The Canadian Medical Student Ultrasound Curriculum: A Statement From the Canadian Ultrasound Consensus for Undergraduate Medical Education Group

OBJECTIVES

This study sought to establish by expert review a consensus-based, focused ultrasound curriculum, consisting of a foundational set of focused ultrasound skills that all Canadian medical students would be expected to attain at the end of the medical school program.

METHODS

An expert panel of 21 point-of-care ultrasound and educational leaders representing 15 of 17 (88%) Canadian medical schools was formed and participated in a modified Delphi consensus method. Experts anonymously rated 195 curricular elements on their appropriateness to include in a medical school curriculum using a 5-point Likert scale. The group defined consensus as 70% or more experts agreeing to include or exclude an element. We determined a priori that no more than 3 rounds of voting would be performed.

RESULTS

Of the 195 curricular elements considered in the first round of voting, the group reached consensus to include 78 and exclude 24. In the second round, consensus was reached to include 4 and exclude 63 elements. In our final round, with 1 additional item added to the survey, the group reached consensus to include an additional 3 and exclude 8 elements. A total of 85 curricular elements reached consensus to be included, with 95 to be excluded. Sixteen elements did not reach consensus to be included or excluded.

CONCLUSIONS

By expert opinion-based consensus, the Canadian Ultrasound Consensus for Undergraduate Medical Education Group recommends that 85 curricular elements be considered for inclusion for teaching in the Canadian medical school focused ultrasound curricula.

Journey of candidates who were unmatched in the Canadian Residency Matching Service (CaRMS): A phenomenological study

BACKGROUND

Each year, a number of medical students are unmatched in the Canadian Residency Matching Service (CaRMs) match. Blog posts from previous unmatched students suggest that being unmatched is associated with significant stress. However, no studies have explored the collective experiences of candidates who are unmatched. This study seeks to explore the experiences of Canadian students who were unmatched in the first iteration of their CaRMS applications.

METHODS

This was an interview-based qualitative study using a phenomenology approach to explore the perspectives of 15 Canadian participants from seven universities who had previously experienced being unmatched between 2011 and 2017 in CaRMS. Telephone interviews were conducted using a semi-structured guide focusing on the experiences in the following domains: the overall unmatched experience; perceived reasons leading to their unmatched status; resources employed; barriers experienced; recommendations; and, their eventual career outcomes. Field notes were analyzed independently by all authors using thematic analysis and authors independently identified major themes. To reconcile divergent impressions and better situate qualitative impressions of our participants, we used publicly available quantitative data from CaRMS to calculate relevant odds ratios.

RESULTS

Our participants universally reported negative emotions, concerns regarding privacy and confidentiality breaches, and stigma faced. Systemic challenges faced by our participants included: lack of information, pressures perceived from undergraduate medical education to apply in the second iteration to specialties that they did not want, and logistical issues such as financial challenges, licensing and scheduling issues. The utility of peer support differed for individual participants, but all those who had support from other unmatched candidates felt that to be useful.

CONCLUSIONS

Our participants reported significant challenges faced after being unmatched. Based on these experiences, we identified key areas of support needed for candidates through their unmatched journey.

Performance of the Ebel standard-setting method in spring 2019 Royal College of Physicians and Surgeons of Canada internal medicine certification examination consisted of multiple-choice questions

PURPOSE

It aimed to know the performance of the Ebel standard-setting method in in spring 2019 Royal College of Physicians and Surgeons of Canada internal medicine certification examination consisted of multiple-choice questions. Specifically followings were searched: the inter-rater agreement; the correlation between Ebel scores and item facility indices; raters' knowledge of correct answers' impact on the Ebel score; and affection of rater's specialty on theinter-rater agreement and Ebel scores.

METHODS

Data were drawn from a Royal College of Physicians and Surgeons of Canada certification exam. Ebel's method was applied to 203 MCQs by 49 raters. Facility indices came from 194 candidates. We computed Fleiss' kappa and the Pearson correlation between Ebel scores and item facility indices. We investigated differences in the Ebel score (correct answers provided or not) and differences between internists and other specialists with t-tests.

RESULTS

Kappa was below 0.15 for facility and relevance. The correlation between Ebel scores and facility indices was low when correct answers were provided and negligible when they were not. The Ebel score was the same, whether the correct answers were provided or not. Inter-rater agreement and Ebel scores was not differentbetween internists and other specialists.

CONCLUSION

Inter-rater agreement and correlations between item Ebel scores and facility indices wee consistently low; furthermore, raters' knowledge of correct answer and rater specialty had no effect on Ebel scores in the present setting.

Barriers to learning and using point-of-care ultrasound: a survey of practicing internists in six North American institutions

Background

Point-of-care ultrasound (POCUS) is increasingly used in internal medicine, but a lack of trained faculty continues to limit the spread of POCUS education. Using a framework based on organizational change theories, this study sought to identify barriers and enablers for hospital-based practicing internists to learn and use POCUS in clinical practice.

Methods

We invited practicing internists at six North American institutions to participate in an electronic survey on their opinions regarding 39 barriers and enablers.

Results

Of the 342 participants invited, 170 participated (response rate 49.3%). The top barriers were lack of training (79%), lack of handheld ultrasound devices (78%), lack of direct supervision (65%), lack of time to perform POCUS during rounds (65%), and lack of quality assurance processes (53%). The majority of participants (55%) disagreed or strongly disagreed with the statement “My institution provides funding for POCUS training.” In general, participants’ attitudes towards POCUS were favourable, and future career opportunities and the potential for billing were not considered significant factors by our participants in the decision to learn or use POCUS.

Conclusions

This survey confirms the perceived importance of POCUS to practicing internists. To assist in closing faculty development gap, interventions should address training, supervision, quality assurance processes, availability of handheld devices, as well as dedicated time to perform POCUS during clinical care.

Consensus-Based Expert Development of Critical Items for Direct Observation of Point-of-Care Ultrasound Skills

BACKGROUND

Point-of-care ultrasound (POCUS) is increasingly used in a number of medical specialties. To support competency-based POCUS education, workplace-based assessments are essential.

OBJECTIVE

We developed a consensus-based assessment tool for POCUS skills and determined which items are critical for competence. We then performed standards setting to set cut scores for the tool.

METHODS

Using a modified Delphi technique, 25 experts voted on 32 items over 3 rounds between August and December 2016. Consensus was defined as agreement by at least 80% of the experts. Twelve experts then performed 3 rounds of a standards setting procedure in March 2017 to establish cut scores.

RESULTS

Experts reached consensus for 31 items to include in the tool. Experts reached consensus that 16 of those items were critically important. A final cut score for the tool was established at 65.2% (SD 17.0%). Cut scores for critical items are significantly higher than those for noncritical items (76.5% ± SD 12.4% versus 53.1% ± SD 12.2%, P < .0001).

CONCLUSIONS

We reached consensus on a 31-item workplace-based assessment tool for identifying competence in POCUS. Of those items, 16 were considered critically important. Their importance is further supported by higher cut scores compared with noncritical items.

Applicant gender and matching to first-choice discipline: a cross-sectional analysis of data from the Canadian Resident Matching Service (2013-2019)

BACKGROUND

Previous studies examining potential sex and gender bias in the Canadian Resident Matching Service (CaRMS) match have had conflicting results. We examined the results of the CaRMS match over the period 2013-2019 to determine the potential association between applicants' gender and the outcome of matching to their first-choice discipline.

METHODS

In this cross-sectional analysis, we determined the risk of matching to one's first-choice discipline in CaRMS by applicant gender and year, for all Canadian medical students who participated in the first iteration of the R-1 match for the years 2013 to 2019. We analyzed data in 3 categories of disciplines according to CaRMS classifications: family medicine, nonsurgical disciplines and surgical disciplines. We excluded disciplines with fewer than 10 applicants.

RESULTS

Match results were available for 20 033 participants, of whom 11 078 (55.3%) were female. Overall, female applicants were significantly more likely to match to their first-choice discipline (relative risk [RR] 1.03, 95% confidence interval [CI] 1.02-1.04). After adjustment for match year and stratification by discipline categories, we found that female applicants were more likely to match to family medicine as their first choice (RR 1.04, 95% CI 1.03-1.05) and less likely to match to a first-choice surgical discipline (RR 0.95, 95% CI 0.91-1.00) than their male peers. There was no significant difference between the genders in matching to one's first-choice nonsurgical discipline (RR 1.01, 95% CI 0.99-1.03).

INTERPRETATION

These results suggest an association between an applicant's gender and the probability of matching to one's first-choice discipline. The possibility of gender bias in the application process for residency programs should be further evaluated and monitored.

Correction to: Internal Medicine Point of Care Ultrasound: Indicators It's Here to Stay

This editorial, "Internal Medicine Point of Care Ultrasound: Indicators It's Here to Stay" (DOI: 10.1007/s11606-019-05268-0), was intended to accompany "Education Indicators for Internal Medicine Point-of-Care Ultrasound: a Consensus Report from the Canadian Internal Medicine Ultrasound (CIMUS) Group".

Expert Recommendations on Frequency of Utilization of Common Laboratory Tests in Medical Inpatients: a Canadian Consensus Study

BACKGROUND

Repetitive inpatient laboratory testing in the face of clinical stability is a marker of low-value care. However, for commonly encountered clinical scenarios on medical units, there are no guidelines defining appropriate use criteria for laboratory tests.

OBJECTIVE

This study seeks to establish consensus-based recommendations for the utilization of common laboratory tests in medical inpatients.

DESIGN

This study uses a modified Delphi method. Participants completed two rounds of an online survey to determine appropriate testing frequencies for selected laboratory tests in commonly encountered clinical scenarios. Consensus was defined as agreement by at least 80% of participants.

PARTICIPANTS

Participants were 36 experts in internal medicine across Canada defined as internists in independent practice for ≥ 5 years with experience in medical education, quality improvement, or both. Experts represented 8 of the 10 Canadian provinces and 13 of 17 academic institutions.

MAIN MEASURES

Laboratory tests and clinical scenarios included were those that were considered common on medical units. The final survey contained a total of 45 clinical scenarios looking at the utilization of six laboratory tests (complete blood count, electrolytes, creatinine, urea, international normalized ratio, and partial thromboplastin time). The possible frequency choices were every 2-4 h, 6-8 h, twice a day, daily, every 2-3 days, weekly, or none unless there was specific diagnostic suspicion. These scenarios were reviewed by two internists with training in quality improvement and survey methods.

KEY RESULTS

Of the 45 initial clinical scenarios included, we reached consensus on 17 scenarios. We reached weak consensus on an additional 19 scenarios by combining two adjacent frequency categories.

CONCLUSIONS

A Canadian expert panel of internists has provided frequency recommendations on the utilization of six common laboratory tests in medical inpatients. These recommendations need validation in prospective studies to assess whether restrictive versus liberal laboratory test ordering impacts patient outcomes.

The development of a provincial multidisciplinary framework of consensus-based standards for Point of Care Ultrasound at the University of Saskatchewan

OBJECTIVES

The development and adoption of Point-of-Care Ultrasound (POCUS) across disciplines have created challenges and opportunities in implementing training and utilization standards. Within the context of a large, geographically disparate province, we sought to develop a multidisciplinary POCUS framework outlining consensus-based standards.

METHODS

A core working group of local POCUS leaders from Anesthesia, Emergency Medicine, Family Medicine, Intensive Care, Internal Medicine, Pediatrics, and Trauma, in collaboration with western Canadian colleagues, developed a list of key domains for the framework along with a range of potential standards for each area. The members of the working group and the registrants for a multidisciplinary Roundtable discussion at the University of Saskatchewan's annual POCUS conference (SASKSONO19, Saskatoon, Saskatchewan, March 2nd, 2019) were invited to complete a survey on POCUS standards for each domain. The survey results were presented to and discussed by participants at the Roundtable discussion at SASKSONO19 who reached consensus on modified standards for each domain. The modified standards were considered for endorsement by all conference attendees using an audience-response system.

RESULTS

The working group proposed standards in eight domains: scope of use, credentialing and privileges, documentation, quality assurance, leadership and governance, teaching, research, and equipment maintenance. Consensus on modified standards was achieved in the 18 participant Roundtable. Each standard was then endorsed by > 90% of conference respondents.

CONCLUSION

The resulting framework will inform the utilization of POCUS within Saskatchewan. Both this process and its outcomes could inform the development of multidisciplinary POCUS standards within other jurisdictions.

Education Indicators for Internal Medicine Point-of-Care Ultrasound: a Consensus Report from the Canadian Internal Medicine Ultrasound (CIMUS) Group

BACKGROUND

Curriculum development and implementation for internal medicine point-of-care ultrasound (IM POCUS) continues to be a challenge for many residency training programs. Education indicators may provide a useful framework to support curriculum development and implementation efforts across programs in order to achieve a consistent high-quality educational experience.

OBJECTIVE

This study seeks to establish consensus-based recommendations for education indicators for IM POCUS training programs in Canada.

DESIGN

This consensus study uses a modified nominal group technique for voting in the initial round, followed by two additional rounds of online voting, with consensus defined as agreement by at least 80% of the participants.

PARTICIPANTS

Participants were 22 leaders with POCUS and/or education expertise from 13 Canadian internal medicine residency programs across 7 provinces.

MAIN MEASURES

Education indicators considered were those that related to aspects of the POCUS educational system, could be presented by a single statistical measure, were readily understood, could be reliably measured to provide a benchmark for measuring change, and represented a policy issue. We excluded a priori indicators with low feasibility, are impractical, or assess learner reactions. Candidate indicators were drafted by two academic internists with post-graduate training in POCUS and medical education. These indicators were reviewed by two internists with training in quality improvement prior to presentation to the expert participants.

KEY RESULTS

Of the 52 candidate education indicators considered, 6 reached consensus in the first round, 12 in the second, and 4 in the third round. Only 5 indicators reached consensus to be excluded; the remaining indicators did not reach consensus.

CONCLUSIONS

The Canadian Internal Medicine Ultrasound (CIMUS) group recommends 22 education indicators be used to guide and monitor internal medicine POCUS curriculum development efforts in Canada.

Transthoracic sonographic assessment of B-line scores during ascent to altitude among healthy trekkers

Sonographic B-lines can indicate pulmonary interstitial edema. We sought to determine the incidence of subclinical pulmonary edema measured by sonographic B-lines among lowland trekkers ascending to high altitude in the Nepal Himalaya. Twenty healthy trekkers underwent portable sonographic examinations and arterial blood draws during ascent to 5160 m over ten days. B-lines were identified in twelve participants and more frequent at 4240 m and 5160 m compared to lower altitudes (P < 0.03). There was a strong negative correlation between arterial oxygen saturation and the number of B-lines at 5160 m (ρ = -0.75, P = 0.008). Our study contributes to the growing body of literature demonstrating the development of asymptomatic pulmonary edema during ascent to high altitude. Portable lung sonography may have utility in fieldwork contexts such as trekking at altitude, but further research is needed in order to clarify its potential clinical applicability.

Integrating point-of-care ultrasound in the ED evaluation of patients presenting with chest pain and shortness of breath

OBJECTIVE

The differential diagnoses of patients presenting with chest pain (CP) and shortness of breath (SOB) are broad and non-specific. We aimed to 1) determine how use of point-of-care ultrasound (POCUS) impacted emergency physicians' differential diagnosis, and 2) evaluate the accuracy of POCUS when compared to chest radiograph (CXR) and composite final diagnosis.

METHODS

We conducted a prospective observational study in a convenience sample of patients presenting with CP and SOB to the Emergency Department (ED). Treating physicians selected possible diagnoses from a pre-indexed list of possible diagnoses of causes of CP and SOB. The final composite diagnosis from a chart review was determined as the reference standard for the diagnosis. The primary analysis involved calculations of sensitivity and specificity for POCUS identifiable diagnoses in detecting cause of CP and SOB. Additional comparative accuracy analysis with CXRs were conducted.

RESULTS

128 patients with a mean age of 64 ± 17 years were included in the study. Using a reference standard of composite final diagnoses, POCUS had equal or higher specificity to CXR for all indications for which it was used, except for pneumonia. POCUS correctly identified all patients with pneumothorax, pleural effusion and pericardial effusion. In patients with a normal thoracic ultrasound, CXR never provided any actionable clinical information. Adding POCUS to the initial evaluation causes a significant narrowing of the differential diagnoses in which the median differential diagnosis from 5 (IQR 3-6) to 3 (IQR 2-4) p < 0.001.

CONCLUSION

In evaluation of patients with CP and SOB, POCUS is a highly feasible diagnostic test which can assist in narrowing down the differential diagnoses. In patients with a normal thoracic ultrasound, the added value of a CXR may be minimal.

Point of care ultrasound training for internal medicine: a Canadian multi-centre learner needs assessment study

BACKGROUND

Significant gaps currently exist in the Canadian internal medicine point-of-care ultrasound (POCUS) curriculum. From a learner's perspective, it remains unknown what key POCUS skills should be prioritized. This needs assessment study seeks to establish educational priorities for POCUS for internal medicine residents at five Canadian residency training programs.

METHODS

All internal medicine trainees [postgraduate year (PGY) 1-5] from five internal medicine residency training programs in Canada (n = 598) were invited to complete an online survey on 15 diagnostic POCUS applications, 9 bedside procedures, and 18 POCUS knowledge items. For POCUS applications and procedures, participants were asked how applicable they are to patient care in internal medicine and the participants' reported skills in those domains. Self-reported knowledge and skills were rated on a 5-point Likert scale, where 1 = very poor and 5 = very good. Applicability was rated, where 1 = not at all applicable and 5 = very applicable.

RESULTS

A total of 253 of 598 residents (42%) participated in our study. Data from one centre (n = 15) was removed because of low response rate (15%) and significant baseline differences between those trainees and the remaining participants. Of the remaining analyzable data from four training programs (n = 238), participants reported highest applicability to internal medicine for the following applications and procedures: identifying ascites/free fluid [mean applicability score of 4.9 ± standard deviation (SD) 0.4]; gross left ventricular function (mean 4.8 ± SD 0.5) and pericardial effusion (mean 4.7 ± SD 0.5); thoracentesis (mean score 4.9 ± SD 0.3), central line insertion (mean 4.9 ± SD 0.3), and paracentesis (mean 4.9 ± SD 0.3), respectively. Overall reported knowledge/skills was low, with skill gaps being the highest for identifying deep vein thrombosis (mean gap 2.7 ± SD 1.1), right ventricular strain (mean 2.7 ± SD 1.1), and gross left ventricular function (mean 2.7 ± SD 1.0).

CONCLUSIONS

Many POCUS applications and procedures were felt to be applicable to the practice of internal medicine. Significant skill gaps exist in the four Canadian training programs included in the study. POCUS curriculum development efforts should target training based on these perceived skill gaps.

Comparing Physical Examination With Sonographic Versions of the Same Examination Techniques for Splenomegaly

OBJECTIVES

To determine whether sonographic versions of physical examination techniques can accurately identify splenomegaly, Castell's method (Ann Intern Med 1967; 67:1265-1267), the sonographic Castell's method, spleen tip palpation, and the sonographic spleen tip technique were compared with reference measurements.

METHODS

Two clinicians trained in bedside sonography patients recruited from an urban hematology clinic. Each patient was examined for splenomegaly using conventional percussion and palpation techniques (Castell's method and spleen tip palpation, respectively), as well as the sonographic versions of these maneuvers (sonographic Castell's method and sonographic spleen tip technique). Results were compared with a reference standard based on professional sonographer measurements.

RESULTS

The sonographic Castell's method had greater sensitivity (91.7% [95% confidence interval, 61.5% to 99.8%]) than the traditional Castell's method (83.3% [95% confidence interval, 51.6% to 97.9%]) but took longer to perform [mean ± SD, 28.8 ± 18.6 versus 18.8 ± 8.1 seconds; P = .01). Palpable and positive sonographic spleen tip results were both 100% specific, but the sonographic spleen tip method was more sensitive (58.3% [95% confidence interval, 27.7% to 84.8%] versus 33.3% [95% confidence interval, 9.9% to 65.1%]).

CONCLUSIONS

Sonographic versions of traditional physical examination maneuvers have greater diagnostic accuracy than the physical examination maneuvers from which they are derived but may take longer to perform. We recommend a combination of traditional physical examination and sonographic techniques when evaluating for splenomegaly at the bedside.

Internal Medicine Point-of-Care Ultrasound Curriculum: Consensus Recommendations from the Canadian Internal Medicine Ultrasound (CIMUS) Group

Bedside point-of-care ultrasound (POCUS) is increasingly used to assess medical patients. At present, no consensus exists for what POCUS curriculum is appropriate for internal medicine residency training programs. This document details the consensus-based recommendations by the Canadian Internal Medicine Ultrasound (CIMUS) group, comprising 39 members, representing 14 institutions across Canada. Guiding principles for selecting curricular content were determined a priori. Consensus was defined as agreement by at least 80% of the members on POCUS applications deemed appropriate for teaching and assessment of trainees in the core (internal medicine postgraduate years [PGY] 1-3) and expanded (general internal medicine PGY 4-5) training programs. We recommend four POCUS applications for the core PGY 1-3 curriculum (inferior vena cava, lung B lines, pleural effusion, and abdominal free fluid) and three ultrasound-guided procedures (central venous catheterization, thoracentesis, and paracentesis). For the expanded PGY 4-5 curriculum, we recommend an additional seven applications (internal jugular vein, lung consolidation, pneumothorax, knee effusion, gross left ventricular systolic function, pericardial effusion, and right ventricular strain) and four ultrasound-guided procedures (knee arthrocentesis, arterial line insertion, arterial blood gas sampling, and peripheral venous catheterization). These recommendations will provide a framework for training programs at a national level.

Using the Entrustable Professional Activities Framework in the Assessment of Procedural Skills

BACKGROUND

The entrustable professional activity (EPA) framework has been identified as a useful approach to assessment in competency-based education. To apply an EPA framework for assessment, essential skills necessary for entrustment to occur must first be identified.

OBJECTIVE

Using an EPA framework, our study sought to (1) define the essential skills required for entrustment for 7 bedside procedures expected of graduates of Canadian internal medicine (IM) residency programs, and (2) develop rubrics for the assessment of these procedural skills.

METHODS

An initial list of essential skills was defined for each procedural EPA by focus groups of experts at 4 academic centers using the nominal group technique. These lists were subsequently vetted by representatives from all Canadian IM training programs through a web-based survey. Consensus (more than 80% agreement) about inclusion of each item was sought using a modified Delphi exercise. Qualitative survey data were analyzed using a framework approach to inform final assessment rubrics for each procedure.

RESULTS

Initial lists of essential skills for procedural EPAs ranged from 10 to 24 items. A total of 111 experts completed the national survey. After 2 iterations, consensus was reached on all items. Following qualitative analysis, final rubrics were created, which included 6 to 10 items per procedure.

CONCLUSIONS

These EPA-based assessment rubrics represent a national consensus by Canadian IM clinician educators. They provide a practical guide for the assessment of procedural skills in a competency-based education model, and a robust foundation for future research on their implementation and evaluation.