Systemwide Clinical Ultrasound Program Development: An Expert Consensus Model

Cranial Point-of-Care Ultrasound for Neonatal Providers: A Feasibility Study

OBJECTIVE

Despite strong evidence for its utility in clinical management and diagnosis of intracranial hemorrhage (ICH), the use of neonatal cranial point-of-care ultrasound (POCUS) has not been standardized in neonatal intensive care units (NICUs) in the United States. The primary aim of this study was to evaluate the feasibility of training NICU providers to perform cranial POCUS by tracking the quality of image acquisition following training.

METHODS

Observational single-center cohort study of cranial POCUS images obtained by trained neonatal practitioners (attendings, fellows, and advanced practice providers) using a protocol developed by a radiologist and neonatologist. Exams were performed on infants born ≤1250 g and/or ≤30 weeks gestation within the first 3 days after birth. A survey to assess attitudes regarding cranial POCUS was given before each of three training sessions. Demographic and clinical data collection were portrayed with descriptive statistics. Metrics of image quality were assessed by a radiologist and sonographer independently. Analysis of trends in quality of POCUS images over time was performed using a multinomial Cochran-Armitage test.

RESULTS

Eighty-two cranial POCUS scans were performed over a 2-year period. Infant median age at exam was 14 hours (IQR 7-22 hours). Metrics of image quality depicted quarterly demonstrated a significant improvement in depth (P = .01), gain (P = .048), and quality of anatomy images captured (P < .001) over time. Providers perceived increased utility and safety of cranial POCUS over time.

CONCLUSION

Cranial POCUS image acquisition improved significantly following care team training, which may enable providers to diagnose ICH at the bedside.

Training, Competency, and Interdisciplinary Collaboration in Point-of-Care Ultrasound

Point-of-care ultrasound can provide critical diagnostic information and add to procedural safety. As with any clinical skill, however, it must be applied by an adequately trained provider, with systems to ensure safety. Training can include a mix of hands-on training with traditional didactics, online coursework, and simulation, but each carries its own costs and benefits worth of review. Following training it is essential to think about assessment of competency in point-of-care ultrasound to reflect the combination of cognitive and procedural skills that makes up the practice. Within the frameworks described, expansion can be expected across specialty and professional boundaries.

UK and Ireland Joint Advisory Group (JAG) consensus statements for training and certification in diagnostic endoscopic ultrasound (EUS)

BACKGROUND AND AIMS

International endoscopy societies vary in their approach for credentialing individuals in endoscopic ultrasound (EUS) to enable independent practice; however, there is no consensus in this or its implementation. In 2019, the Joint Advisory Group on GI Endoscopy (JAG) commissioned a working group to examine the evidence relating to this process for EUS. The aim of this was to develop evidence-based recommendations for EUS training and certification in the UK.

METHODS

Under the oversight of the JAG quality assurance team, a modified Delphi process was conducted which included major stakeholders from the UK and Ireland. A formal literature review was made, initial questions for study were proposed and recommendations for training and certification in EUS were formulated after a rigorous assessment using the Grading of Recommendation Assessment, Development and Evaluation tool and subjected to electronic voting to identify accepted statements. These were peer reviewed by JAG and relevant stakeholder societies before consensus on the final EUS certification pathway was achieved.

RESULTS

39 initial questions were proposed of which 33 were deemed worthy of assessment and finally formed the key recommendations. The statements covered four key domains, such as: definition of competence (13 statements), acquisition of competence (10), assessment of competence (5) and postcertification mentorship (5). Key recommendations include: (1) minimum of 250 hands-on cases before an assessment for competency can be made, (2) attendance at the JAG basic EUS course, (3) completing a minimum of one formative direct observation of procedural skills (DOPS) every 10 cases to allow the learning curve in EUS training to be adequately studied, (4) competent performance in summative DOPS assessments and (5) a period of mentorship over a 12-month period is recommended as minimum to support and mentor new service providers.

CONCLUSIONS

An evidence-based certification pathway has been commissioned by JAG to support and quality assure EUS training. This will form the basis to improve quality of training and safety standards in EUS in the UK and Ireland.

The 2023 Core Content of advanced emergency medicine ultrasonography

In February 2023, the American Board of Emergency Medicine (ABEM) approved modifications to the Advanced Emergency Medicine Ultrasonography (AEMUS) Core Content, which defines the areas of knowledge considered essential for the practice of AEMUS. This manuscript serves as a revision of the AEMUS Core Content originally published in 2014. The revision of the Core Content for AEMUS training aims to establish standardized education and qualifications necessary for AEMUS fellowship program leadership, clinical application, administration, quality improvement, and research. The Core Content provides the organizational framework and serves as the basis for the development of content for the Focused Practice Examination (FPE) administered by ABEM. AEMUS fellowship directors may reference the Core Content when designing AEMUS fellowship curricula to help prepare graduates for the autonomous practice of AEMUS and the FPE. In this article, an updated revision of the previously published AEMUS Core Content is detailed, and the entire development of the Core Content is presented.

[Interpretation of the clinical guideline for point-of-care ultrasonography in the neonatal intensive care unit in the United States]

In December 2022, the American Academy of Pediatrics released a clinical guideline for point-of-care ultrasonography (POCUS) in the neonatal intensive care unit (NICU). The guideline outlined the development and current status of POCUS in the NICU, and summarized the key elements and implementation guidelines for successful implementation of POCUS in the NICU. This article provides an overview of the key points of the clinical guideline and analyzes the current status of POCUS in China, providing a reference for the implementation of POCUS in neonatal care in China.

Practitioners' views on community implementation of point-of-care ultrasound (POCUS) in the UK: a qualitative interview study

BACKGROUND

Implementing Point-of-care ultrasound (POCUS) in community practice could help to decide upon and prioritise initial treatment, procedures and appropriate specialist referral or conveyance to hospital. A recent literature review suggests that image quality, portability and cost of ultrasound devices are all improving with widening indications for community POCUS, but evidence about community POCUS use is needed in the UK. We aimed to explore views of clinical practitioners, actively using ultrasound, on their experiences of using POCUS and potential facilitators and barriers to its wider implementation in community settings in the UK.

METHODS

We conducted a qualitative interview study with practitioners from community and secondary care settings actively using POCUS in practice. A convenience sample of eligible participants from different clinical specialties and settings was recruited using social media adverts, through websites of relevant research groups and snowball sampling. Individual semi-structured interviews were conducted online using Microsoft Teams. These were recorded, transcribed verbatim, and analysed using a Framework approach supported by NVivo 12.

RESULTS

We interviewed 16 practitioners aged between 40 and 62 years from different professional backgrounds, including paramedics, emergency physicians, general practitioners, and allied health professionals. Participants identified key considerations and facilitators for wider implementation of POCUS in community settings in the UK: resource requirements for deployment and support of working devices; sufficient time and a skilled workforce; attention to training, education and support needs; ensuring proper governance, guidelines and quality assurance; workforce considerations; enabling ease of use in assisting decision making with consideration of unintended consequences; and more robust evidence to support perceptions of improved patient outcomes and experience.

CONCLUSIONS

POCUS could be useful for improving patient journey and health outcomes in community care, but this requires further research to evaluate outcomes. The facilitators identified could help make community POCUS a reality.

Current risk landscape of point-of-care ultrasound in pediatric emergency medicine in medical malpractice litigation

BACKGROUND

Point-of-care ultrasound (PoCUS) is expanding as a diagnostic tool in pediatric emergency medicine. Pediatricians are apprehensive to take on the risk of malpractice from incorrect interpretation of PoCUS imaging, therefore limiting its use. Although current studies provide reassurance to this concern, none look directly at the risk for pediatric emergency medicine physicians. Our study aims to evaluate the current medicolegal risk landscape posed by PoCUS in pediatric emergency medicine.

METHODS

A search of case law was performed utilizing the LexisNexis caselaw database for the period of January 2011 through December 2021. Initial search results were reviewed by the attorney co-authors for relevance to medical malpractice surrounding PoCUS. The remaining cases were reviewed by physician co-authors to ensure their relevance to both ultrasound and the acute care setting. Identified cases were then classified into categories as per the reason for the claim.

RESULTS

No cases of malpractice litigation were identified that directly related to PoCUS. Ten cases of ultrasound in the acute care setting were identified, 7 of which were in pediatric patients. The majority of these cases related to appendicitis or testicular torsion. Of these 10 cases, 2 cases claimed failure to consider the ultimate diagnosis, but ultrasound would have been an appropriate study had the diagnosis been considered. Of the 8 remaining cases, 6 were based on failure to perform or delay performing ultrasound, 1 claimed that improper ultrasound study was initially performed, and 1 case was based on an improper diagnosis made by ultrasound.

DISCUSSION

PoCUS does not appear to pose a significant risk of malpractice litigation in pediatric emergency medicine.

Building and Maintaining an Ultrasound Program: It Takes a Village

Building and maintaining a successful point-of-care ultrasound program is a complex process that involves establishing an ecosystem between three unique but overlapping domains: ultrasound equipment, ultrasound users, and the health care system. By highlighting the different areas of focus and each of the key stakeholders and components, a group can ensure adequate attention is paid to all aspects of point-of-care ultrasound program development in nephrology.

American Society of Regional Anesthesia and Pain Medicine expert panel recommendations on point-of-care ultrasound education and training for regional anesthesiologists and pain physicians-part II: recommendations

Point-of-care ultrasound (POCUS) is a critical skill for all regional anesthesiologists and pain physicians to help diagnose relevant complications related to routine practice and guide perioperative management. In an effort to inform the regional anesthesia and pain community as well as address a need for structured education and training, the American Society of Regional Anesthesia and Pain Medicine Society (ASRA) commissioned this narrative review to provide recommendations for POCUS. The recommendations were written by content and educational experts and were approved by the guidelines committee and the Board of Directors of the ASRA. In part II of this two-part series, learning goals and objectives were identified and outlined for achieving competency in the use of POCUS, specifically, airway ultrasound, lung ultrasound, gastric ultrasound, the focus assessment with sonography for trauma exam, and focused cardiac ultrasound, in the perioperative and chronic pain setting. It also discusses barriers to POCUS education and training and proposes a list of educational resources. For each POCUS section, learning goals and specific skills were presented in the Indication, Acquisition, Interpretation, and Medical decision-making framework.

DIY AI, deep learning network development for automated image classification in a point-of-care ultrasound quality assurance program

BACKGROUND

Artificial intelligence (AI) is increasingly a part of daily life and offers great possibilities to enrich health care. Imaging applications of AI have been mostly developed by large, well-funded companies and currently are inaccessible to the comparatively small market of point-of-care ultrasound (POCUS) programs. Given this absence of commercial solutions, we sought to create and test a do-it-yourself (DIY) deep learning algorithm to classify ultrasound images to enhance the quality assurance work-flow for POCUS programs.

METHODS

We created a convolutional neural network using publicly available software tools and pre-existing convolutional neural network architecture. The convolutional neural network was subsequently trained using ultrasound images from seven ultrasound exam types: pelvis, heart, lung, abdomen, musculoskeletal, ocular, and central vascular access from 189 publicly available POCUS videos. Approximately 121,000 individual images were extracted from the videos, 80% were used for model training and 10% each for cross validation and testing. We then tested the algorithm for accuracy against a set of 160 randomly extracted ultrasound frames from ultrasound videos not previously used for training and that were performed on different ultrasound equipment. Three POCUS experts blindly categorized the 160 random images, and results were compared to the convolutional neural network algorithm. Descriptive statistics and Krippendorff alpha reliability estimates were calculated.

RESULTS

The cross validation of the convolutional neural network approached 99% for accuracy. The algorithm accurately classified 98% of the test ultrasound images. In the new POCUS program simulation phase, the algorithm accurately classified 70% of 160 new images for moderate correlation with the ground truth, α = 0.64. The three blinded POCUS experts correctly classified 93%, 94%, and 98% of the images, respectively. There was excellent agreement among the experts with α = 0.87. Agreement between experts and algorithm was good with α = 0.74. The most common error was misclassifying musculoskeletal images for both the algorithm (40%) and POCUS experts (40.6%). The algorithm took 7 minutes 45 seconds to review and classify the new 160 images. The 3 expert reviewers took 27, 32, and 45 minutes to classify the images, respectively.

CONCLUSIONS

Our algorithm accurately classified 98% of new images, by body scan area, related to its training pool, simulating POCUS program workflow. Performance was diminished with exam images from an unrelated image pool and ultrasound equipment, suggesting additional images and convolutional neural network training are necessary for fine tuning when using across different POCUS programs. The algorithm showed theoretical potential to improve workflow for POCUS program directors, if fully implemented. The implications of our DIY AI for POCUS are scalable and further work to maximize the collaboration between AI and POCUS programs is warranted.

Interpretation Accuracy and Interrater Agreement of Pediatric Skin and Soft Tissue Point-of-Care Ultrasound Images among Residents and Faculty

BACKGROUND

Point-of-care ultrasound (POCUS) is commonly used to facilitate care in the emergency department. Acquired images are often reviewed by local experts for educational and quality assurance purposes. However, no published study has examined the accuracy and reliability of POCUS image interpretation by multiple reviewers.

OBJECTIVES

We studied the accuracy and interrater agreement among expert and trainee reviewers of prerecorded pediatric skin and soft tissue (SST) POCUS images.

METHODS

POCUS faculty and emergency medicine (EM) residents blindly reviewed deidentified pediatric SST POCUS images and indicated whether a drainable fluid collection was present, absent, or indeterminate. This was then compared with the gold standard based on discharge diagnoses and telephone follow-up. Images rated as indeterminate were excluded from the initial analysis. Sensitivity analysis assuming indeterminate answers were inaccurate was subsequently conducted.

RESULTS

In phase 1, 6 pediatric EM POCUS directors reviewed 168 images. The overall accuracy was 79.7% (range 66.1-86.0%). The mean Cohen's kappa was 0.58 (range 0.24-0.84). Sensitivity analysis yielded an overall accuracy of 71.3% (range 56.5-76.9%) and a Cohen's kappa of 0.43 (range 0.20-0.59). In phase 2, 6 general EM POCUS faculty and 20 EM residents reviewed 120 images. The overall accuracy among residents was 72.2% (range 51.4-84.7%) and among faculty was 83.6% (range 77.9-88.8%). Sensitivity analysis yielded an overall resident accuracy of 63.0% (range 49.5-80.7) and an overall faculty accuracy of 73.9% (range 67.0-79.8%). Fleiss' kappa was 0.322 for residents and 0.461 for faculty.

CONCLUSIONS

We found moderate accuracy and fair to good interrater agreement among POCUS faculty and EM residents reviewing pediatric SST POCUS images.

Correlation of OSCE performance and point-of-care ultrasound scan numbers among a cohort of emergency medicine residents

Background

Point-of-care ultrasound (POCUS) is an important clinical tool for a growing number of medical specialties. The current American College of Emergency Physicians (ACEP) Ultrasound Guidelines recommend that trainees perform 150–300 ultrasound scans as part of POCUS training. We sought to assess the relationship between ultrasound scan numbers and performance on an ultrasound-focused observed structured clinical examination (OSCE).

Methods

This was a cross-sectional cohort study in which the number of ultrasound scans residents had previously performed were obtained from a prospective database and compared with their total score on an ultrasound OSCE. Ultrasound fellowship trained emergency physicians administered a previously published OSCE that consisted of standardized questions testing image acquisition and interpretation, ultrasound machine mechanics, patient positioning, and troubleshooting. Residents were observed while performing core applications including aorta, biliary, cardiac, deep vein thrombosis, Focused Assessment with Sonography in Trauma (FAST), pelvic, and thoracic ultrasound imaging.

Results

Twenty-nine postgraduate year (PGY)-3 and PGY-4 emergency medicine (EM) residents participated in the OSCE. The median OSCE score was 354 [interquartile range (IQR) 343–361] out of a total possible score of 370. Trainees had previously performed a median of 341 [IQR 289–409] total scans. Residents with more than 300 ultrasound scans had a median OSCE score of 355 [IQR 351–360], which was slightly higher than the median OSCE score of 342 [IQR 326–361] in the group with less than 300 total scans (p = 0.04). Overall, a LOWESS curve demonstrated a positive association between scan numbers and OSCE scores with graphical review of the data suggesting a plateau effect.

Conclusion

The results of this small single residency program study suggest a pattern of improvement in OSCE performance as scan numbers increased, with the appearance of a plateau effect around 300 scans. Further investigation of this correlation in diverse practice environments and within individual ultrasound modalities will be necessary to create generalizable recommendations for scan requirements as part of overall POCUS proficiency assessment.

Time to establish pillars in point-of-care ultrasound

Point of care ultrasound (PoCUS) has evolved rapidly and is used by many medical specialties. We propose five essential pillars of PoCUS that are necessary framework for hospital-based PoCUS training and credentialing programs. The pillars are: governance, infrastructure, administration, education and quality. It is time to establish these pillars to ensure the best practice in PoCUS use.