Development of a Focused Cardiac Ultrasound Image Acquisition Assessment Tool

Directed image review technique (DIRT): A framework for ultrasound image assessment and interpretation

Use of point-of-care ultrasound (POCUS) is integral to the practice of emergency medicine, and POCUS education is a required component of emergency medicine training. Developing POCUS skills requires iterative deliberate practice of image acquisition and interpretation. Providing feedback to learners regarding ultrasound image interpretation can be challenging for emergency medicine clinician educators. We present a framework called the directed image review technique. This framework guides learner ultrasound image interpretation and provides educators with a similar structured approach to evaluate a learner's ultrasound competency and provide targeted feedback regarding image acquisition and interpretation.

Initial Development of an Automated Platform for Assessing Trainee Performance on Case Presentations

Background

Oral case presentation is a crucial skill of physicians and a key component of team-based care. However, consistent and objective assessment and feedback on presentations during training are infrequent.

Objective

To determine the potential value of applying natural language processing, computer software that extracts meaning from text, to transcripts of oral case presentations as a strategy to assess their quality automatically and objectively.

Methods

We transcribed a collection of simulated oral case presentations. The presentations were from eight critical care fellows and one critical care attending. They were instructed to review the medical charts of 11 real intensive care unit patient cases and to audio record themselves, presenting each case as if they were doing so on morning rounds. We then used natural language processing to convert the transcripts from human-readable text into machine-readable numbers. These numbers represent details of the presentation style and content. The distance between the numeric representation of two different transcripts negatively correlates with the similarity of those two transcripts. We ranked fellows on the basis of how similar their presentations were to the attending's presentations.

Results

The 99 presentations included 260 minutes of audio (mean length: 2.6 ± 1.24 min per case). On average, 23.88 ± 2.65 sentences were spoken, and each sentence had 14.10 ± 0.67 words, 3.62 ± 0.15 medical concepts, and 0.75 ± 0.09 medical adjectives. When ranking fellows on the basis of how similar their presentations were to the attending's presentation, we found a gap between the five fellows with the most similar presentations and the three fellows with the least similar presentations (average group similarity scores of 0.62 ± 0.01 and 0.53 ± 0.01, respectively). Rankings were sensitive to whether presentation style or content information were weighted more heavily when calculating transcript similarity.

Conclusion

Natural language processing enabled the ranking of case presentations on the basis of how similar they were to a reference presentation. Although additional work is needed to convert these rankings, and underlying similarity scores, into actionable feedback for trainees, these methods may support new tools for improving medical education.

National Delphi Survey on Anesthesiology Resident Training in Perioperative Ultrasound

OBJECTIVE

To establish agreement among nationwide experts through a Delphi process on the key components of perioperative ultrasound and the recommended minimum number of examinations that should be performed by a resident upon graduation.

DESIGN

A prospective cross-sectional study.

SETTING

A survey on multiinstitutional academic medical centers.

PARTICIPANTS

Anesthesiology residency program directors and/or experts in perioperative ultrasound.

INTERVENTIONS

A list of components and examinations recommended for anesthesiology resident training in perioperative ultrasound was developed based on guidelines and 2 survey rounds among a steering committee of 10 experts. A questionnaire asking for a rating of each component on a 5-point Likert scale subsequently was sent to an expert panel of 120 anesthesiology residency program directors across the United States. An agreement of at least 70% of participants, rating a component as 4 or 5, was compulsory to list a component as essential for anesthesiology resident training in perioperative ultrasound.

MEASUREMENTS AND MAIN RESULTS

The nationwide survey's response rate was 62.5%, and agreement was reached after 2 Delphi rounds. The final list included 44 essential components for basic ultrasound physics and knobology, cardiac ultrasound, lung ultrasound, and ultrasound-guided vascular access. Agreement was not reached for abdominal ultrasound, gastric ultrasound, and ultrasound-guided airway assessment. Agreement for the recommended minimum number of examinations that should be performed by a resident upon graduation included 50 each for transthoracic and transesophageal echocardiography, and 20 each for lung ultrasound, ultrasound-guided central line, and ultrasound-guided arterial line placements.

CONCLUSIONS

The recommendations outlined in this survey can be used to establish standardized training for perioperative ultrasound by anesthesiology residency programs.

Development of a multisystem point of care ultrasound skills assessment checklist

Background

Many institutions are training clinicians in point-of-care ultrasound (POCUS), but few POCUS skills checklists have been developed and validated. We developed a consensus-based multispecialty POCUS skills checklist with anchoring references for basic cardiac, lung, abdominal, and vascular ultrasound, and peripheral intravenous line (PIV) insertion.

Methods

A POCUS expert panel of 14 physicians specializing in emergency, critical care, and internal/hospital medicine participated in a modified-Delphi approach to develop a basic POCUS skills checklist by group consensus. Three rounds of voting were conducted, and consensus was defined by ≥ 80% agreement. Items achieving < 80% consensus were discussed and considered for up to two additional rounds of voting.

Results

Thirteen POCUS experts (93%) completed all three rounds of voting. Cardiac, lung, abdominal, and vascular ultrasound checklists included probe location and control, basic machine setup, image quality and optimization, and identification of anatomical structures. PIV insertion included additional items for needle tip tracking. During the first round of voting, 136 (82%) items achieved consensus, and after revision and revoting, an additional 21 items achieved consensus. A total of 153 (92%) items were included in the final checklist.

Conclusions

We have developed a consensus-based, multispecialty POCUS checklist to evaluate skills in image acquisition and anatomy identification for basic cardiac, lung, abdominal, and vascular ultrasound, and PIV insertion.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13089-022-00268-4.

Criteria, Processes, and Determination of Competence in Basic Critical Care Echocardiography Training: A Delphi Process Consensus Statement by the Learning Ultrasound in Critical Care (LUCC) Initiative

BACKGROUND

With the paucity of high-quality studies on longitudinal basic critical care echocardiography (BCCE) training, expert opinion guidelines have guided BCCE competence educational standards and processes. However, existing guidelines lack precise detail due to methodological flaws during guideline development.

RESEARCH QUESTIONS

To formulate methodologically robust guidelines on BCCE training using evidence and expert opinion, detailing specific criteria for every step, we conducted a modified Delphi process using the principles of the validated AGREE-II tool. Based on systematic reviews, the following domains were chosen: components of a longitudinal BCCE curriculum; pass-grade criteria for image-acquisition and image-interpretation; and formative/summative assessment and final competence processes.

STUDY DESIGN AND METHODS

Between April 2020 and May 2021, a total of 21 BCCE experts participated in four rounds. Rounds 1 and 2 used five web-based questionnaires, including branching-logic software for directed questions to individual panelists. In round 3 (videoconference), the panel finalized the recommendations by vote. During the journal peer-review process, Round 4 was conducted as Web-based questionnaires. Following each round, the agreement threshold for each item was determined as ≥ 80% for item inclusion and ≤ 30% for item exclusion.

RESULTS

Following rounds 1 and 2, agreement was reached on 62 of 114 items. To the 49 unresolved items, 12 additional items were added in round 3, with 56 reaching agreement and five items remaining unresolved. There was agreement that longitudinal BCCE training must include introductory training, mentored formative training, summative assessment for competence, and final cognitive assessment. Items requiring multiple rounds included two-dimensional views, Doppler, cardiac output, M-mode measurement, minimum scan numbers, and pass-grade criteria. Regarding objective criteria for image-acquisition and image-interpretation quality, the panel agreed on maintaining the same criteria for formative and summative assessment, to categorize BCCE findings as major vs minor and a standardized approach to errors, criteria for readiness for summative assessment, and supervisory options.

INTERPRETATION

In conclusion, this expert consensus statement presents comprehensive evidence-based recommendations on longitudinal BCCE training. However, these recommendations require prospective validation.

Focused Cardiac Ultrasonography in Cats

Heart disease is a common cause of morbidity and mortality in cats. Focused cardiac ultrasonography (FCU) is a useful diagnostic tool for identifying heart disease in symptomatic and asymptomatic cats when performed by trained veterinarians. When used in conjunction with other diagnostics such as physical examination, blood biomarkers, electrocardiography, Global FAST, and other point-of-care ultrasonographic examinations, FCU may improve clinical decision making and help clinicians prioritize which cats would benefit from referral for complete echocardiography and cardiac consultation. This article reviews the definition, advantages, clinical indications, limitations, training recommendations, and a protocol for FCU in cats.

Pulmonary Critical Care Fellows' Use of and Self-reported Barriers to Learning Bedside Ultrasound During Training: Results of a National Survey

BACKGROUND

Competence in ultrasonography is essential for pulmonary and critical care medicine (PCCM) fellows, but little is known about fellow-reported barriers to acquiring this crucial skill during fellowship training.

RESEARCH QUESTION

How do PCCM fellows acquire experience performing and interpreting ultrasonography during their training, what is their perspective on barriers to acquiring ultrasound expertise during fellowship, and what is their comfort with a range of ultrasound examinations?

STUDY DESIGN AND METHODS

A 20-item survey including questions about procedural training and acquisition of ultrasound skills during PCCM fellowship was developed. The survey instrument was sent to PCCM fellowship program directors to distribute to their fellows at program directors' discretion.

RESULTS

Four hundred seventy-five responses were received. The most common method of learning ultrasonography was performing it independently at the bedside. Fellows reported that the greatest barrier to acquiring ultrasound skills was the lack of trained faculty experts, followed by lack of a formal curriculum. Fellow comfort was greatest with thoracic ultrasound and least with advanced cardiac ultrasound.

INTERPRETATION

Significant barriers to ultrasound training during PCCM fellowship exist, and future educational efforts should address these barriers at both program and institutional levels.