Appropriate Use and Clinical Impact of Echocardiographic “Evaluation of Murmur” in Pediatric Patients

Appropriateness of cardiovascular computed tomography and magnetic resonance imaging in patients with conotruncal defects

BACKGROUND

To promote the rational use of cardiovascular imaging in patients with congenital heart disease, the American College of Cardiology developed Appropriate Use Criteria (AUC), but its clinical application and pre-release benchmarks have not been evaluated. We aimed to evaluate the appropriateness of indications for cardiovascular magnetic resonance (CMR) and cardiovascular computed tomography (CCT) in patients with conotruncal defects and to identify factors associated with maybe or rarely appropriate (M/R) indications.

METHODS

Twelve centers each contributed a median of 147 studies performed prior to AUC publication (01/2020) on patients with conotruncal defects. To incorporate patient characteristics and center-level effects, a hierarchical generalized linear mixed model was used.

RESULTS

Of the 1753 studies (80% CMR, and 20% CCT), 16% were rated M/R. Center M/R ranged from 4 to 39%. Infants accounted for 8.4% of studies. In multivariable analyses, patient- and study-level factors associated with M/R rating included: age <1 year (OR 1.90 [1.15-3.13]), truncus arteriosus (vs. tetralogy of Fallot, OR 2.55 [1.5-4.35]), and CCT (vs. CMR, OR 2.67 [1.87-3.83]). None of the provider- or center-level factors reached statistical significance in the multivariable model.

CONCLUSIONS

Most CMRs and CCTs ordered for the follow-up care of patients with conotruncal defects were rated appropriate. However, there was significant center-level variation in appropriateness ratings. Younger age, CCT, and truncus arteriosus were independently associated with higher odds of M/R rating. These findings could inform future quality improvement initiatives and further exploration of factors resulting in center-level variation.

Physicians' clinical experience and its association with healthcare quality: a systematised review

BACKGROUND AND PURPOSE

There is conflicting evidence regarding whether physicians' clinical experience affects healthcare quality. Knowing whether an association exists and which dimensions of quality might be affected can help healthcare services close quality gaps by tailoring improvement initiatives according to physicians' clinical experience. Here, we present a systematised review that aims to assess the potential association between physicians' clinical experience and different dimensions of healthcare quality.

METHODS

We conducted a systematised literature review, including the databases MEDLINE, Embase, PsycINFO and PubMed. The search strategy involved combining predefined terms that describe physicians' clinical experience with terms that describe different dimensions of healthcare quality (ie, safety, clinical effectiveness, patient-centredness, timeliness, efficiency and equity). We included relevant, original research published from June 2004 to November 2020.

RESULTS

Fifty-two studies reporting 63 evaluations of the association between physicians' clinical experience and healthcare quality were included in the final analysis. Overall, 27 (43%) evaluations found a positive or partially positive association between physicians' clinical experience and healthcare quality; 22 (35%) found no association; and 14 (22%) evaluations reported a negative or partially negative association. We found a proportional association between physicians' clinical experience and quality regarding outcome measures that reflect safety, particularly in the surgical fields. For other dimensions of quality, no firm evidence was found.

CONCLUSION

We found no clear evidence of an association between measures of physicians' clinical experience and overall healthcare quality. For outcome measures related to safety, we found that physicians' clinical experience was proportional with safer care, particularly in surgical fields. Our findings support efforts to secure adequate training and supervision for early-career physicians regarding safety outcomes. Further research is needed to reveal the potential subgroups in which gaps in quality due to physicians' clinical experience might exist.

Factors Influencing Temporal Trends in Pediatric Inpatient Imaging Utilization

BACKGROUND

Concern exists over exponential growth in cardiac imaging in adults, but there is paucity of such data for cardiac imaging trends in pediatric patients. The aims of this study were to determine temporal trends in the use of noninvasive cardiac imaging and compare these with trends in the use of noncardiac imaging and to identify factors influencing those trends using the Pediatric Health Information Service database.

METHODS

Pediatric inpatient encounter data from January 2004 to December 2017 at 35 pediatric hospitals were extracted from the Pediatric Health Information Service database. Temporal imaging utilization trends in cardiac and noncardiac ultrasound or echocardiography, magnetic resonance imaging (MRI), and computed tomography (CT) were assessed using linear mixed-effects models. Models were adjusted for case-mix index, complex chronic conditions, patient age, length of stay, payer source, and cardiac surgical volume.

RESULTS

A total of 5,869,335 encounters over 14 years were analyzed (median encounters per center per year, 11,411; median patient age, 4 years; median length of stay, 3 days). From 2004 to 2017, the rates of pediatric inpatient cardiac and noncardiac ultrasound and MRI increased, whereas the rate of noncardiac CT decreased. Cardiac CT use increased beginning in 2014 (+0.264 cardiac CT encounters per 1,000 encounters per year), surpassing the rate of rise of cardiac MRI. Case-mix index, cardiac surgical volume, and payer source affected the largest number of imaging trends.

CONCLUSIONS

Among pediatric inpatients, utilization of cardiac and noncardiac ultrasound and MRI has steadily increased. Noncardiac CT use declined and cardiac CT use increased after 2014. Factors influencing imaging trends include case-mix index, cardiac surgical volume, and payer source. This study lays a foundation for investigations of imaging-related resource utilization and outcomes among pediatric inpatients.

Impact of Clinician Engagement on Implementation of the Pediatric Echocardiography Appropriate Use Criteria

We sought to determine whether awareness of the pediatric appropriate use criteria (AUC) affected transthoracic echocardiogram (TTE) ordering by cardiologists; evaluate for differences in classification of an encounter's AUC clinical scenario by investigator chart review compared with clinicians at the time of the encounter; and assess TTE yield by appropriateness rating. AUC clinical scenario(s) were assigned to patients without prior TTE by investigator chart review of visits in 2014 (n = 209) and 2016 (n = 199), and by clinician classification in 2016 (n = 671). Investigators documented TTE utilization and findings. Between 2014 and 2016, TTE utilization decreased from 54 to 33% (p < 0.001) of "rarely appropriate" (R) encounters, resulting in a decrease in overall TTE utilization from 73 to 55% of encounters (p < 0.001). There was only moderate agreement of AUC appropriateness by investigator chart review and clinician classification (κ = 0.533, p < 0.001). Abnormal TTE findings were detected in 18.7% of R encounters, with 21 of 24 abnormalities in infants younger than 4 months presenting with murmur. A decrease in TTE utilization for R encounters may represent a change in practice from increased awareness of the AUC. AUC scenario classification by clinicians at the time of the encounter could be superior to chart review. TTE abnormalities may be missed in infants younger than 4 months of age when evaluated for murmurs with the AUC.

Comparison of Initial Pediatric Outpatient Echocardiogram Indications between Community and Academic Practice

OBJECTIVE

To compare the appropriateness and diagnostic yield of initial outpatient transthoracic echocardiography (TTE) between a community pediatric cardiology practice and an academic children's hospital.

STUDY DESIGN

Initial outpatient pediatric TTE ordered by pediatric cardiologists between January and March 2014 at a community practice (Packard Children's Health Alliance [PCHA]; n = 238) and an academic tertiary center (Lucile Packard Children's Hospital [LPCH]; n = 76) were evaluated based on appropriate use criteria (AUC) released in December 2014. Multivariate logistic regression was used to identify predictors of "rarely appropriate" indications and abnormal TTE findings.

RESULTS

Of 314 TTEs, 165 (52.5%) were classified as "appropriate," 40 (12.7%) were classified as "may be appropriate," 100 (31.9%) were classified as "rarely appropriate," and 9 (2.9%) were unclassifiable. The proportion of abnormal findings did not differ between the 2 practice settings (5.3% for LPCH vs 7.6% for PCHA; P = .61). TTEs performed at PCHA were significantly more likely to be "rarely appropriate" (OR, 2.57; 95% CI, 1.28-5.15; P = .008). Children aged <1 year (OR, 1.90; 95% CI, 1.03-3.50; P = .04) and ordering providers with <10 years since the completion of their fellowship (OR, 2.15; 95% CI, 1.20-3.87; P = .01) were associated with "rarely appropriate" indications. "Appropriate" TTEs were associated with abnormal findings (OR, 8.69; 95% CI, 1.77-42.68; P = .008).

CONCLUSION

The community practice was independently associated with greater inappropriate ordering of initial outpatient pediatric TTEs compared with the academic practice. The assessment of practice patterns following AUC release should account for physician and practice-related factors that could influence differences in TTE ordering patterns.

Appropriateness of pediatric outpatient transthoracic echocardiogram orders following cessation of an active educational intervention

OBJECTIVE

The educational intervention (EI) through the Pediatric Appropriate Use of Echocardiography (PAUSE) multicenter study resulted in improved appropriateness of transthoracic echocardiogram (TTE) orders at our center. The current study evaluated if this pattern persisted after cessation of EI and the potential physician characteristics influencing appropriateness.

DESIGN

Outpatients (≤18 years old) seen for initial evaluation during the EI (July to October, 2015) and 6-month post-EI (May to August, 2016) phases were included. Comparison was made between TTE rates and appropriateness ratings during EI and post-EI phase. Association between TTE rate and appropriateness with physician characteristics (age, experience, patient volume, and area of practice) was determined using odds ratio.

RESULTS

The study included 7781 patients (EI: N = 4016; post-EI: N = 3765) seen by 31 physicians. Comparison of appropriateness ratings in a randomized sample (EI: N = 1270; post-EI: N = 1325 patients) showed no significant differences between the two phases (appropriate: 75.2% vs 74.9%, P = .960; rarely appropriate 4.1% vs 6.5%, P = .065). Though there was significant variability among physicians for TTE order appropriateness (P = .044) and ordering rate (P <.001), none of their characteristics were associated with appropriateness and only a higher patient volume was associated with decreased odds of TTE ordering (OR =0.7).

CONCLUSION

The PAUSE study EI resulted in maintaining appropriate utilization of TTEs at our center for 6 months following its cessation. Though not statistically significant, there was a trend toward increase in the proportion of studies for indications designated rarely appropriate (R). There was significant physician variability in TTE ordering and appropriateness during both phases. Development of EI to reduce physician variability and integration of EI with provider workflow may help sustain appropriate TTE utilization.

Appropriate Use Criteria for paediatric echocardiography in an outpatient practice: a validation study

BACKGROUND

Although transthoracic echocardiography is the dominant imaging modality in CHD, optimal utilisation is unclear. We assessed whether adherence to the paediatric Appropriate Use Criteria for outpatient transthoracic echocardiography could reduce inappropriate use without missing significant cardiac disease.

METHODS

Using the Appropriate Use Criteria, we determined the indication and appropriateness rating for each initial echocardiogram performed at our institution during calendar year 2014 (N=1383). Chart review documented ordering provider training, patient demographics, and study result, classified as normal, abnormal, or abnormal motivating treatment within a 2-year follow-up period. We tested whether provider training level or patient age correlated with echocardiographic findings or appropriateness rating.

RESULTS

We found that 83.9% of echocardiograms were normal and that 66.7% had an appropriate indication. Nearly all abnormal results and all results motivating treatment were in appropriate studies, giving an odds ratio of 2.73 for an abnormal result if an appropriate indication was present (95% confidence interval 1.92-3.89, p<0.001). None of the remaining initial abnormal results with less than appropriate indications became significant, resulting in treatment over 2 years. Results suggest a potential reduction in imaging volume of as much as 33% with application of the criteria. Cardiologists ordered nearly all studies resulting in treatment but also more echocardiograms with less appropriate indications. Most examinations were in older patients; however, most abnormal results were in patients younger than 1 year.

CONCLUSIONS

The Appropriate Use Criteria can be used to safely reduce echocardiography volume while still detecting significant heart disease.

[Heart murmur in children less than 2 years-old: looking for a safe and effective referral strategy]

INTRODUCTION

Current guidelines in Spain recommend performing transthoracic echocardiography (TTE) in all children under 2 years of age with a heart murmur. In 2014, the American Paediatric Association published the first appropriate use criteria (AUC) for outpatient paediatric transthoracic echocardiography (TTE) to promote its cost-efficient use. The aim of this article is to analyse the AUC and other clinical factors as predictors of congenital heart disease (CHD) in children less than 2 years of age with a heart murmur, and to develop a safe and efficient referral strategy.

PATIENTS AND METHOD

Case-control study conducted with children less than 2 years of age, referred from Paediatric Primary Care to Paediatric Cardiology during a 4-year study. A predictive model for CHD was determined using multivariate analysis.

RESULTS

A total of 688 patients were included, with 129 (19%) cases of CHD. An age less than 3 months (adjusted odds ratio [ORa] 3.8 [1.5-8.4], p=.030) and fulfilling AUC (ORa 16.3 [9.4-28.3], p<.001) were predictors of CHD. Concurrent infection (ORa 0.6 [0.2-0.8], p<.001) and a negative neonatal screening with pulse oximetry (ORa 0.1 [0.05-0.4], p=.001) decreased the risk of CHD. The referral strategy that included these criteria had a 98% sensitivity, 39% specificity, and positive and negative predictive values of 27% and 99%, respectively. It could not diagnose 2% of CHD (all mild), and showed a 32% TTE reduction rate compared to our current strategy.

CONCLUSION

To refer children less than 3 months old, fulfilling AUC, without a concurrent infection, or without negative neonatal pulse oximetry screening, is a safe and efficient strategy for the management of heart murmur in children under 2 years of age.

Factors Influencing Pediatric Outpatient Transthoracic Echocardiography Utilization Before Appropriate Use Criteria Release: A Multicenter Study

BACKGROUND

Although pediatric appropriate use criteria (AUC) for outpatient transthoracic echocardiography (TTE) are available, little is known about TTE utilization patterns before their release. The aims of this study were to determine the relation between AUC and TTE utilization and to identify patient and physician factors associated with discordance between the AUC and clinical practice.

METHODS

A retrospective review of 3,000 initial outpatient pediatric cardiology encounters at six centers was performed. Investigator-determined indications were classified using AUC definitions. Concordance between AUC and TTE utilization was determined. Multivariate analysis was performed to identify patient and physician factors associated with TTE's being performed for rarely appropriate and TTE's not being performed for appropriate indications.

RESULTS

Concordance between AUC and TTE utilization was 88%. TTE was performed for rarely appropriate indications in 9% and was associated with patient age < 3 months, indications of murmur, noninvasive imaging physician subspecialty, and physician volume. No TTE was ordered for appropriate indications in 3% and was associated with indications including prior test result (primarily abnormal electrocardiographic findings), older patients, and physician subspecialty other than generalist or imaging. There was high variability in TTE utilization among centers.

CONCLUSIONS

There was a reasonable degree of concordance between AUC and clinical practice before AUC publication. Several patient and physician factors were associated with discordance with the AUC. These findings should be considered in efforts to disseminate the AUC and in the development of future iterations. The causes for variation among centers deserve further exploration.

Application of Appropriate Use Criteria for Initial Transthoracic Echocardiography in an Academic Outpatient Pediatric Cardiology Program

Transthoracic echocardiography (TTE) is a non-invasive diagnostic modality for children with suspected heart disease. The American College of Cardiology published Appropriate Use Criteria (AUC) for an initial outpatient pediatric TTE in 2014 to promote effective care and improve resource utilization. The objective was to determine the appropriateness of TTE per the published AUC in a single academic pediatric cardiology clinic as a baseline performance quality measure. The echocardiography database was used to identify initial outpatient TTE in children during January-March 2014. TTE indications (appropriate [A], may be appropriate [M], or rarely appropriate [R]) and findings (normal, incidental, or abnormal) were recorded. The effect of AUC and age groups on yield of abnormal TTE findings was analyzed. Of the 2166 screened studies, our study cohort consisted of 247 TTEs. Indications rated A, M, and R were found in 129, 27, and 90, respectively, and 1 was unclassifiable. Majority of TTE (n = 183) were normal, although incidental findings were noted in 32 and abnormal findings in 32 cases. Abnormal findings were noted in 26/129 of A, 2/27 of M, and 4/90 of R. Indications rated A were significantly associated with yield of abnormal TTE findings, adjusted by age group. Infants and adolescents were more likely to have abnormal TTE findings compared to young children. Recently published AUC were validated for initial TTE in the outpatient pediatric cardiology clinic. Appropriateness rated by AUC was highly associated with yield of abnormal TTE findings and worked best in infants and adolescent.