1
|
Kling SMR, Kalwani NM, Winget M, Gupta K, Saliba-Gustafsson EA, Baratta J, Garvert DW, Veruttipong D, Brown-Johnson CG, Vilendrer S, Gaspar C, Levin E, Tsai S. An initiative to promote value-based stress test selection in primary care and cardiology clinics: A mixed methods evaluation. J Eval Clin Pract 2024; 30:107-118. [PMID: 37459156 DOI: 10.1111/jep.13896] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/06/2023] [Revised: 06/29/2023] [Accepted: 06/30/2023] [Indexed: 03/01/2024]
Abstract
OBJECTIVES Exercise stress echocardiograms (stress echos) are overused, whereas exercise stress electrocardiograms (stress ECGs) can be an appropriate, lower-cost substitute. In this post hoc, mixed methods evaluation, we assessed an initiative promoting value-based, guideline-concordant ordering practices in primary care (PC) and cardiology clinics. METHODS Change in percent of stress ECGs ordered of all exercise stress tests (stress ECGs and echos) was calculated between three periods: baseline (January 2019-February 2020); Period 1 with reduced stress ECG report turnaround time + PC-targeted education (began June 2020); and Period 2 with the addition of electronic health record-based alternative alert (AA) providing point-of-care clinical decision support. The AA was deployed in two of five PC clinics in July 2020, two additional PC clinics in January 2021, and one of four cardiology clinics in February 2021. Nineteen primary care providers (PCPs) and five cardiologists were interviewed in Period 2. RESULTS Clinicians reported reducing ECG report turnaround time was crucial for adoption. PCPs specifically reported that value-based education helped change their practice. In PC, the percent of stress ECGs ordered increased by 38% ± 6% (SE) (p < 0.0001) from baseline to Period 1. Most PCPs identified the AA as the most impactful initiative, yet stress ECG ordering did not change (6% ± 6%; p = 0.34) between Periods 1 and 2. In contrast, cardiologists reportedly relied on their expertise rather than AAs, yet their stress ECGs orders increased from Period 1 to 2 to a larger degree in the cardiology clinic with the AA (12% ± 5%; p = 0.01) than clinics without the AA (6% ± 2%; p = 0.01). The percent of stress ECGs ordered was higher in Period 2 than baseline for both specialties (both p < 0.0001). CONCLUSIONS This initiative influenced ordering behaviour in PC and cardiology clinics. However, clinicians' perceptions of the initiative varied between specialties and did not always align with the observed behaviour change.
Collapse
Affiliation(s)
- Samantha M R Kling
- Evaluation Sciences Unit, Division of Primary Care and Population Health, Department of Medicine, Stanford University School of Medicine, Stanford, California, USA
| | - Neil M Kalwani
- Veterans Affairs Palo Alto Health Care System, Palo Alto, California, USA
- Division of Cardiovascular Medicine, Department of Medicine, Stanford University School of Medicine, Stanford, California, USA
| | - Marcy Winget
- Evaluation Sciences Unit, Division of Primary Care and Population Health, Department of Medicine, Stanford University School of Medicine, Stanford, California, USA
| | - Kush Gupta
- Stanford University School of Medicine, Stanford, California, USA
| | - Erika A Saliba-Gustafsson
- Evaluation Sciences Unit, Division of Primary Care and Population Health, Department of Medicine, Stanford University School of Medicine, Stanford, California, USA
| | - Juliana Baratta
- Evaluation Sciences Unit, Division of Primary Care and Population Health, Department of Medicine, Stanford University School of Medicine, Stanford, California, USA
| | - Donn W Garvert
- Evaluation Sciences Unit, Division of Primary Care and Population Health, Department of Medicine, Stanford University School of Medicine, Stanford, California, USA
| | - Darlene Veruttipong
- Evaluation Sciences Unit, Division of Primary Care and Population Health, Department of Medicine, Stanford University School of Medicine, Stanford, California, USA
| | - Cati G Brown-Johnson
- Evaluation Sciences Unit, Division of Primary Care and Population Health, Department of Medicine, Stanford University School of Medicine, Stanford, California, USA
| | - Stacie Vilendrer
- Evaluation Sciences Unit, Division of Primary Care and Population Health, Department of Medicine, Stanford University School of Medicine, Stanford, California, USA
- Stanford Health Care, Stanford, California, USA
| | | | - Eleanor Levin
- Division of Cardiovascular Medicine, Department of Medicine, Stanford University School of Medicine, Stanford, California, USA
- Stanford Health Care, Stanford, California, USA
| | - Sandra Tsai
- Evaluation Sciences Unit, Division of Primary Care and Population Health, Department of Medicine, Stanford University School of Medicine, Stanford, California, USA
- Stanford Health Care, Stanford, California, USA
| |
Collapse
|
2
|
Al-Sadawi M, Tao M, Frye J, Dianati-Maleki N, Mann N. The Use of Quality Improvement Interventions in Reducing Rarely Appropriate Cardiac Imaging. Am J Cardiol 2023; 207:349-355. [PMID: 37774477 DOI: 10.1016/j.amjcard.2023.08.188] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/04/2023] [Revised: 08/30/2023] [Accepted: 08/31/2023] [Indexed: 10/01/2023]
Abstract
The use of cardiac imaging has become increasingly prevalent over the last decade. Approximately 10% to 15% of noninvasive cardiac imaging is ordered for rarely appropriate indications. The appropriate use criteria (AUC) for cardiac imaging were issued to decrease unnecessary testing and reduce health care costs. However, it remains unclear whether these efforts have been successful. This meta-analysis evaluates whether AUC quality improvement (QI) interventions effectively reduce inappropriate cardiac imaging. Databases were searched for studies reporting QI intervention effect aiming to reduce rarely appropriate noninvasive cardiac imaging based on AUC. Imaging modalities assessed include transthoracic echocardiography, stress echocardiography, and myocardial perfusion imaging. We searched Ovid MEDLINE, EMBASE, Scopus, Web of Science, Google Scholar, and EBSCO CINAHL. The primary end point was a decrease of rarely appropriate testing. The search was not restricted to time or publication status. The literature search identified 2,391 possible studies, 13 studies and 26,557 patients were included. Mean follow-up was 12 months (1 to 60 months). QI interventions were statistically significant in reducing rarely appropriate tests after the intervention compared with the control group (odds ratio [OR] 0.51, 95% confidence interval [CI] 0.41 to 0.64, p <0.01). The QI interventions were also assessed for persistence based on short-term (<3 months) and long-term (>3 months) efficacy. Both the short-term effect and long-term effect were persistent (OR 0.6, 95% CI 0.47 to 0.77, p <0.01 and OR 0.47, 95% CI 0.37 to 0.61, p <0.01, respectively). AUC QI interventions are associated with the successful decrease of inappropriate noninvasive cardiac testing with these effects persisting over time.
Collapse
Affiliation(s)
- Mohammed Al-Sadawi
- Department of Cardiovascular Medicine, University of Michigan Hospital, Ann Arbor, Michigan.
| | - Michael Tao
- Department of Cardiology, Stony Brook University Hospital, Stony Brook, New York
| | - Jesse Frye
- Department of Cardiology, Stony Brook University Hospital, Stony Brook, New York
| | - Neda Dianati-Maleki
- Department of Cardiology, Stony Brook University Hospital, Stony Brook, New York
| | - Noelle Mann
- Department of Cardiology, Stony Brook University Hospital, Stony Brook, New York
| |
Collapse
|
3
|
Tao M, Al-Sadawi M, Ahmed N, Dianati-Maleki N, Mann N, Kort S. The use of quality improvement interventions in reducing rarely appropriate echocardiograms: A systematic review and meta-analysis. Echocardiography 2023; 40:916-924. [PMID: 37464949 DOI: 10.1111/echo.15653] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2023] [Revised: 06/18/2023] [Accepted: 07/07/2023] [Indexed: 07/20/2023] Open
Abstract
BACKGROUND The volume of cardiac imaging continues to increase, with many tests performed for rarely appropriate indications. Appropriate use criteria (AUC) documents were published by the American Society of Echocardiography and American College of Cardiology, with quality improvement (QI) interventions developed in various institutions. However, the effectiveness of these interventions has not been assessed in a systematic fashion. METHODS We searched Ovid MEDLINE, EMBASE, Scopus, Web of Science, Google Scholar, and EBSCO CINAHL for studies reporting association between cardiac imaging, AUC and QI. The search was not restricted to time or publication status. We selected studies assessing the effect of QI interventions on performance of rarely appropriate echocardiograms. The primary endpoint was reduction of rarely appropriate testing. RESULTS Nine studies with 22,070 patients met inclusion criteria. Mean follow up was 15 months (1-60 months). QI interventions resulted in statistically significant reduction in rarely appropriate tests (OR 0.52, 95% CI: .41-.66; p < .01). The effects of QI interventions were analyzed over both the short (<3 months) and long-term (>3 months) post intervention (OR 0.62, 95% CI: .49-.79; p < .01 in the short term, and OR 0.47, 95% CI: .35-.62; p < .01 in the long term). Subgroup analysis of the type of intervention, classified as education tools or decision support tools showed both significantly reduced rarely appropriate testing (OR 0.54, 95% CI: .41-.73; p < .01; OR .47, 95% CI: .36-.61; p < .01). Adding a feedback tool did not change the effect compared to not using a feedback tool (OR 0.49 vs. 0.57, 95% CI: .36-.68 vs. 39-.84; p > .05). CONCLUSION QI interventions are associated with a significant reduction in performance of rarely appropriate echocardiography testing, the effects of which persist over time. Both education and decision support tools were effective, while adding feedback tools did not result in further reduction of ordering rarely appropriate studies.
Collapse
Affiliation(s)
- Michael Tao
- Stony Brook University Hospital, 101 Nicolls Rd., Stony Brook, New York, USA
| | - Mohammed Al-Sadawi
- Stony Brook University Hospital, 101 Nicolls Rd., Stony Brook, New York, USA
| | - Navid Ahmed
- Stony Brook University Hospital, 101 Nicolls Rd., Stony Brook, New York, USA
| | - Neda Dianati-Maleki
- Stony Brook University Hospital, 101 Nicolls Rd., Stony Brook, New York, USA
| | - Noelle Mann
- Stony Brook University Hospital, 101 Nicolls Rd., Stony Brook, New York, USA
| | - Smadar Kort
- Stony Brook University Hospital, 101 Nicolls Rd., Stony Brook, New York, USA
| |
Collapse
|
4
|
Kjelle E, Andersen ER, Soril LJJ, van Bodegom-Vos L, Hofmann BM. Interventions to reduce low-value imaging - a systematic review of interventions and outcomes. BMC Health Serv Res 2021; 21:983. [PMID: 34537051 PMCID: PMC8449221 DOI: 10.1186/s12913-021-07004-z] [Citation(s) in RCA: 29] [Impact Index Per Article: 9.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2021] [Accepted: 09/02/2021] [Indexed: 12/24/2022] Open
Abstract
BACKGROUND It is estimated that 20-50% of all radiological examinations are of low value. Many attempts have been made to reduce the use of low-value imaging. However, the comparative effectiveness of interventions to reduce low-value imaging is unclear. Thus, the objective of this systematic review was to provide an overview and evaluate the outcomes of interventions aimed at reducing low-value imaging. METHODS An electronic database search was completed in Medline - Ovid, Embase-Ovid, Scopus, and Cochrane Library for citations between 2010 and 2020. The search was built from medical subject headings for Diagnostic imaging/Radiology, Health service misuse or medical overuse, and Health planning. Keywords were used for the concept of reduction and avoidance. Reference lists of included articles were also hand-searched for relevant citations. Only articles written in English, German, Danish, Norwegian, Dutch, and Swedish were included. The Mixed Methods Appraisal Tool was used to appraise the quality of the included articles. A narrative synthesis of the final included articles was completed. RESULTS The search identified 15,659 records. After abstract and full-text screening, 95 studies of varying quality were included in the final analysis, containing 45 studies found through hand-searching techniques. Both controlled and uncontrolled before-and-after studies, time series, chart reviews, and cohort studies were included. Most interventions were aimed at referring physicians. Clinical practice guidelines (n = 28) and education (n = 28) were most commonly evaluated interventions, either alone or in combination with other components. Multi-component interventions were often more effective than single-component interventions showing a reduction in the use of low-value imaging in 94 and 74% of the studies, respectively. The most addressed types of imaging were musculoskeletal (n = 26), neurological (n = 23) and vascular (n = 16) imaging. Seventy-seven studies reported reduced low-value imaging, while 3 studies reported an increase. CONCLUSIONS Multi-component interventions that include education were often more effective than single-component interventions. The contextual and cultural factors in the health care systems seem to be vital for successful reduction of low-value imaging. Further research should focus on assessing the impact of the context in interventions reducing low-value imaging and how interventions can be adapted to different contexts.
Collapse
Affiliation(s)
- Elin Kjelle
- Institute for the Health Sciences at the Norwegian University of Science and Technology (NTNU) at Gjøvik, NTNU Gjøvik, Postbox 191, 2802 Gjøvik, Norway
| | - Eivind Richter Andersen
- Institute for the Health Sciences at the Norwegian University of Science and Technology (NTNU) at Gjøvik, NTNU Gjøvik, Postbox 191, 2802 Gjøvik, Norway
| | - Lesley J. J. Soril
- Department of Community Health Sciences and The Health Technology Assessment Unit, O’Brien Institute for Public Health, University of Calgary, 3280 Hospital Dr NW, Calgary, Alberta T2N 4Z6 Canada
| | - Leti van Bodegom-Vos
- Medical Decision making, Department of Biomedical Data Sciences, Leiden University Medical Center, P.O. Box 9600, 2300 RC, Leiden, the Netherlands
| | - Bjørn Morten Hofmann
- Institute for the Health Sciences at the Norwegian University of Science and Technology (NTNU) at Gjøvik, NTNU Gjøvik, Postbox 191, 2802 Gjøvik, Norway
- Centre of Medical Ethics, University of Oslo, Postbox 1130, Blindern, 0318 Oslo, Norway
| |
Collapse
|
5
|
Winchester DE, Merritt J, Waheed N, Norton H, Manja V, Shah NR, Helfrich CD. Implementation of appropriate use criteria for cardiology tests and procedures: a systematic review and meta-analysis. EUROPEAN HEART JOURNAL. QUALITY OF CARE & CLINICAL OUTCOMES 2021; 7:34-41. [PMID: 32232436 DOI: 10.1093/ehjqcco/qcaa029] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/21/2020] [Revised: 03/23/2020] [Accepted: 03/26/2020] [Indexed: 11/13/2022]
Abstract
AIMS The American College of Cardiology appropriate use criteria (AUC) provide clinicians with evidence-informed recommendations for cardiac care. Adopting AUC into clinical workflows may present challenges, and there may be specific implementation strategies that are effective in promoting effective use of AUC. We sought to assess the effect of implementing AUC in clinical practice. METHODS AND RESULTS We conducted a meta-analysis of studies found through a systematic search of the MEDLINE, Web of Science, Cochrane, or CINAHL databases. Peer-reviewed manuscripts published after 2005 that reported on the implementation of AUC for a cardiovascular test or procedure were included. The main outcome was to determine if AUC implementation was associated with a reduction in inappropriate/rarely appropriate care. Of the 18 included studies, the majority used pre/post-cohort designs; few (n = 3) were randomized trials. Most studies used multiple strategies (n = 12, 66.7%). Education was the most common individual intervention strategy (n = 13, 72.2%), followed by audit and feedback (n = 8, 44.4%) and computerized physician order entry (n = 6, 33.3%). No studies reported on formal use of stakeholder engagement or 'nudges'. In meta-analysis, AUC implementation was associated with a reduction in inappropriate/rarely appropriate care (odds ratio 0.62, 95% confidence interval 0.49-0.78). Funnel plot suggests the possibility of publication bias. CONCLUSION We found most published efforts to implement AUC observed reductions in inappropriate/rarely appropriate care. Studies rarely explored how or why the implementation strategy was effective. Because interventions were infrequently tested in isolation, it is difficult to make observations about their effectiveness as stand-alone strategies. STUDY REGISTRATION PROSPERO 2018 CRD42018091602. Available from https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42018091602.
Collapse
Affiliation(s)
- David E Winchester
- Cardiology Section, Malcom Randall VAMC, 1601 SW Archer Rd 111-D, Gainesville, FL, USA.,Division of Cardiovascular Medicine, University of Florida College of Medicine, 1600 SW Archer Rd, Gainesville, FL 32610, USA
| | - Justin Merritt
- Division of Cardiovascular Medicine, University of Florida College of Medicine, 1600 SW Archer Rd, Gainesville, FL 32610, USA
| | - Nida Waheed
- Department of Internal Medicine, University of Florida College of Medicine, 1600 SW Archer Rd, Gainesville, FL 32610, USA
| | - Hannah Norton
- University of Florida College of Medicine, Health Science Center Library, 1600 SW Archer Rd, Gainesville, FL 32610, USA
| | - Veena Manja
- Department of Surgery, University of California Davis, 2315 Stockton Blvd, Sacramento, CA 95817, USA.,VA Northern California Health Care System, 10535 Hospital Way, Mather, CA 95655, USA
| | - Nishant R Shah
- Department of Medicine, Providence VA Medical Center, Brown University Warren Alpert Medical School, 830 Chalkstone Ave, Providence, RI 02908, USA.,Department of Health Services, Policy & Practice, Brown University School of Public Health, 121 S Main St, Providence, RI 02903, USA
| | - Christian D Helfrich
- Seattle-Denver Center for Innovation in Veteran-Centered and Value-Driven Care, 1660 S. Columbian Way Mailstop S-152 Seattle, WA 98108, USA
| |
Collapse
|
6
|
Effects of an Electronic Medical Record Intervention on Appropriateness of Transthoracic Echocardiograms: A Prospective Study. J Am Soc Echocardiogr 2020; 34:176-184. [PMID: 33139140 DOI: 10.1016/j.echo.2020.09.010] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/30/2020] [Revised: 09/04/2020] [Accepted: 09/12/2020] [Indexed: 11/22/2022]
Abstract
BACKGROUND Transthoracic echocardiograms (TTEs) account for approximately half of U.S. spending on cardiac imaging. We developed an electronic medical record (EMR)-based decision-support algorithm for TTE ordering and hypothesized that it would increase the appropriateness of TTE orders. METHODS This prospective observational study was performed at the Veterans Affairs Ann Arbor Healthcare System. From October to December 2016 (preintervention), consecutive TTEs ordered in the inpatient, outpatient, and emergency department settings were included. In May 2017, a decision-support algorithm was incorporated into the EMR, giving immediate feedback to providers. Chart review was performed for TTEs ordered from June to August 2017 (early intervention) and from June to August 2018 (late intervention). Appropriateness was determined based on the 2011 appropriate use criteria for echocardiography. RESULTS Appropriate TTE orders increased from 87.6% preintervention to 94.5% at early intervention (z = 0.00018) but decreased to 90.0% at late intervention (z = 0.51, compared with preintervention). Among patients with no previous TTEs in our system, 95.3% of TTEs were appropriate, compared with 87.7% of TTEs for patients with prior TTEs within 30 days prior (odds ratio = 2.85; 95% CI, 1.18-6.31; P = .005). CONCLUSIONS The EMR algorithm initially increased the percentage of appropriate TTEs, but this effect decayed over time. Further study is needed to develop EMR-based interventions that will have lasting impacts on provider ordering patterns.
Collapse
|
7
|
Tharmaratnam T, Bouck Z, Sivaswamy A, Wijeysundera HC, Chu C, Yin CX, Nesbitt GC, Edwards J, Yared K, Wong B, Weinerman A, Thavendiranathan P, Rakowski H, Dorian P, Anderson G, Austin PC, Dudzinski DM, Ko DT, Weiner RB, Bhatia RS. Association Between Physicians' Appropriate Use of Echocardiography and Subsequent Healthcare Use and Outcomes in Patients With Heart Failure. J Am Heart Assoc 2020; 9:e013360. [PMID: 31870231 PMCID: PMC6988149 DOI: 10.1161/jaha.119.013360] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/12/2023]
Abstract
Background There is little understanding of whether a physician's tendency to order an inappropriate cardiac service is associated with the use of other cardiac services and clinical outcomes in their patients with heart failure (HF). Methods and Results We conducted a secondary analysis of 35 Ontario‐based cardiologists who participated in the control arm of the Echo WISELY (Will Inappropriate Scenarios for Echocardiography Lessen Significantly) trial. Transthoracic echocardiograms, ordered during the trial, were classified as rarely appropriate (rA), appropriate, or maybe appropriate on the basis of the 2011 appropriate use criteria. Cardiologists were grouped into tertiles of rA transthoracic echocardiogram ordering frequency: low ordering (bottom tertile), n=11; moderate ordering, n=12; or high ordering (top tertile), n=12. The main outcomes were measures of cardiac service use, including cardiology‐related physician visits, tests, and medications. Among 1677 patients with heart failure and an outpatient visit to 1 of 35 cardiologists, we found no significant association between rA transthoracic echocardiogram ordering frequency (by tertile) and cardiac testing use, although patients of cardiologists in the high ordering group had fewer physician visits, on average, than patients seen by low ordering cardiologists. In addition, patients of cardiologists in the highest rA ordering tertile had significantly lower odds of receiving potentially effective interventions, such as β blockers (odds ratio, 0.62; 95% CI, 0.43–0.89), than the low ordering group. Conclusions Although patients of cardiologists who frequently order rA transthoracic echocardiograms do not appear more (or less) likely to have subsequent cardiac tests, these patients have fewer follow‐up visits and lower odds of receiving evidence‐based medications. Clinical Trial Registration URL: http://www.clinicaltrials.gov. Unique identifier: NCT02038101.
Collapse
Affiliation(s)
- Tharmegan Tharmaratnam
- School of Medicine Royal College of Surgeons Ireland Dublin Ireland.,Institute for Health Systems Solutions and Virtual Care Women's College Hospital Toronto Ontario Canada
| | - Zachary Bouck
- Institute for Health Systems Solutions and Virtual Care Women's College Hospital Toronto Ontario Canada.,Dalla Lana School of Public Health University of Toronto Ontario Canada
| | | | - Harindra C Wijeysundera
- ICES Toronto Ontario Canada.,Institute for Health Policy, Management, and Evaluation University of Toronto Ontario Canada.,Schulich Heart Centre Sunnybrook Health Sciences Centre University of Toronto Ontario Canada.,Department of Medicine University of Toronto Ontario Canada.,Sunnybrook Research Institute Sunnybrook Health Sciences Centre Toronto Ontario Canada
| | - Cherry Chu
- Institute for Health Systems Solutions and Virtual Care Women's College Hospital Toronto Ontario Canada
| | - Cindy X Yin
- Institute for Health Systems Solutions and Virtual Care Women's College Hospital Toronto Ontario Canada
| | | | - Jeremy Edwards
- Division of Cardiology St. Michael's Hospital Toronto Ontario Canada
| | - Kibar Yared
- The Scarborough Hospital Toronto Ontario Canada
| | - Brian Wong
- Department of Medicine University of Toronto Ontario Canada.,Sunnybrook Research Institute Sunnybrook Health Sciences Centre Toronto Ontario Canada
| | - Adina Weinerman
- Department of Medicine University of Toronto Ontario Canada.,Sunnybrook Research Institute Sunnybrook Health Sciences Centre Toronto Ontario Canada
| | | | - Harry Rakowski
- Peter Munk Cardiac Centre University Health Network Toronto Ontario Canada
| | - Paul Dorian
- Division of Cardiology St. Michael's Hospital Toronto Ontario Canada
| | - Geoff Anderson
- Institute for Health Policy, Management, and Evaluation University of Toronto Ontario Canada
| | - Peter C Austin
- ICES Toronto Ontario Canada.,Institute for Health Policy, Management, and Evaluation University of Toronto Ontario Canada
| | - David M Dudzinski
- Division of Cardiology Massachusetts General Hospital Harvard Medical School Boston MA
| | - Dennis T Ko
- ICES Toronto Ontario Canada.,Institute for Health Policy, Management, and Evaluation University of Toronto Ontario Canada.,Schulich Heart Centre Sunnybrook Health Sciences Centre University of Toronto Ontario Canada.,Department of Medicine University of Toronto Ontario Canada.,Sunnybrook Research Institute Sunnybrook Health Sciences Centre Toronto Ontario Canada
| | - Rory B Weiner
- Division of Cardiology Massachusetts General Hospital Harvard Medical School Boston MA
| | - R Sacha Bhatia
- Institute for Health Systems Solutions and Virtual Care Women's College Hospital Toronto Ontario Canada.,ICES Toronto Ontario Canada.,Institute for Health Policy, Management, and Evaluation University of Toronto Ontario Canada.,Peter Munk Cardiac Centre University Health Network Toronto Ontario Canada
| |
Collapse
|
8
|
Gandhi S, Ho EC, Ong G, Zahrani M, Lu J, Leong-Poi H, Edwards J, Bhatia SRS, Levitt K, Chow CM, Connelly KA. A Physician Education Tool to Improve Appropriate Use Criteria for Stress Echocardiography: Long-Term Follow-Up of a Single-Center Study. J Am Soc Echocardiogr 2019; 32:1255-1257. [PMID: 31311701 DOI: 10.1016/j.echo.2019.05.017] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/07/2019] [Revised: 05/12/2019] [Accepted: 05/19/2019] [Indexed: 10/26/2022]
Affiliation(s)
- Sumeet Gandhi
- Keenan Research Center, Li Ka Shing Knowledge Institute, St. Michael's Hospital, University of Toronto, Toronto, Ontario, Canada; Trillium Health Partners, University of Toronto, Mississauga, Ontario, Canada
| | - Edwin C Ho
- Keenan Research Center, Li Ka Shing Knowledge Institute, St. Michael's Hospital, University of Toronto, Toronto, Ontario, Canada
| | - Geraldine Ong
- Keenan Research Center, Li Ka Shing Knowledge Institute, St. Michael's Hospital, University of Toronto, Toronto, Ontario, Canada
| | - Mohammed Zahrani
- Keenan Research Center, Li Ka Shing Knowledge Institute, St. Michael's Hospital, University of Toronto, Toronto, Ontario, Canada
| | - Jonathan Lu
- Keenan Research Center, Li Ka Shing Knowledge Institute, St. Michael's Hospital, University of Toronto, Toronto, Ontario, Canada
| | - Howard Leong-Poi
- Keenan Research Center, Li Ka Shing Knowledge Institute, St. Michael's Hospital, University of Toronto, Toronto, Ontario, Canada
| | - Jeremy Edwards
- Keenan Research Center, Li Ka Shing Knowledge Institute, St. Michael's Hospital, University of Toronto, Toronto, Ontario, Canada
| | - Sacha R S Bhatia
- Institute for Health System Solutions and Virtual Care, Women's College Hospital, Toronto, Ontario, Canada
| | - Kevin Levitt
- Institute for Health System Solutions and Virtual Care, Women's College Hospital, Toronto, Ontario, Canada; Michael Garron Hospital, Toronto, Ontario, Canada
| | - Chi-Ming Chow
- Keenan Research Center, Li Ka Shing Knowledge Institute, St. Michael's Hospital, University of Toronto, Toronto, Ontario, Canada
| | - Kim A Connelly
- Keenan Research Center, Li Ka Shing Knowledge Institute, St. Michael's Hospital, University of Toronto, Toronto, Ontario, Canada
| |
Collapse
|
9
|
Stern KWD, Gulesserian T, Choi J, Lang SM, Statile CJ, Michelfelder EC, McLaughlin ES, Nguyen T, Lopez L, Verghese GR, Hsu DT, Sachdeva R. Factors Influencing Pediatric Outpatient Transthoracic Echocardiography Utilization Before Appropriate Use Criteria Release: A Multicenter Study. J Am Soc Echocardiogr 2017; 30:1225-1233. [PMID: 29202952 DOI: 10.1016/j.echo.2017.08.015] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/20/2017] [Indexed: 10/18/2022]
Abstract
BACKGROUND Although pediatric appropriate use criteria (AUC) for outpatient transthoracic echocardiography (TTE) are available, little is known about TTE utilization patterns before their release. The aims of this study were to determine the relation between AUC and TTE utilization and to identify patient and physician factors associated with discordance between the AUC and clinical practice. METHODS A retrospective review of 3,000 initial outpatient pediatric cardiology encounters at six centers was performed. Investigator-determined indications were classified using AUC definitions. Concordance between AUC and TTE utilization was determined. Multivariate analysis was performed to identify patient and physician factors associated with TTE's being performed for rarely appropriate and TTE's not being performed for appropriate indications. RESULTS Concordance between AUC and TTE utilization was 88%. TTE was performed for rarely appropriate indications in 9% and was associated with patient age < 3 months, indications of murmur, noninvasive imaging physician subspecialty, and physician volume. No TTE was ordered for appropriate indications in 3% and was associated with indications including prior test result (primarily abnormal electrocardiographic findings), older patients, and physician subspecialty other than generalist or imaging. There was high variability in TTE utilization among centers. CONCLUSIONS There was a reasonable degree of concordance between AUC and clinical practice before AUC publication. Several patient and physician factors were associated with discordance with the AUC. These findings should be considered in efforts to disseminate the AUC and in the development of future iterations. The causes for variation among centers deserve further exploration.
Collapse
Affiliation(s)
- Kenan W D Stern
- Division of Pediatric Cardiology, Children's Hospital at Montefiore, Bronx, New York.
| | - Talin Gulesserian
- Division of Pediatric Cardiology, Children's Hospital at Montefiore, Bronx, New York
| | - Jaeun Choi
- Department of Epidemiology and Population Health, Albert Einstein College of Medicine, Bronx, New York
| | - Sean M Lang
- Pediatric Cardiology Section, Arkansas Children's Hospital, University of Arkansas for Medical Sciences College of Medicine, Little Rock, Arkansas
| | - Christopher J Statile
- Cincinnati Children's Heart Institute, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio
| | - Erik C Michelfelder
- Cincinnati Children's Heart Institute, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio
| | - Ericka S McLaughlin
- Department of Pediatrics, Division of Pediatric Cardiology, Emory University School of Medicine and Sibley Heart Center Cardiology, Children's Healthcare of Atlanta, Atlanta, Georgia
| | - Tuan Nguyen
- Division of Pediatric Cardiology, Nicklaus Children's Hospital, Florida International University College of Medicine, Miami, Florida
| | - Leo Lopez
- Division of Pediatric Cardiology, Nicklaus Children's Hospital, Florida International University College of Medicine, Miami, Florida
| | - George R Verghese
- Section of Pediatric Cardiology, Brenner Children's Hospital, Wake Forest School of Medicine, Winston-Salem, North Carolina
| | - Daphne T Hsu
- Division of Pediatric Cardiology, Children's Hospital at Montefiore, Bronx, New York
| | - Ritu Sachdeva
- Department of Pediatrics, Division of Pediatric Cardiology, Emory University School of Medicine and Sibley Heart Center Cardiology, Children's Healthcare of Atlanta, Atlanta, Georgia
| |
Collapse
|
10
|
Romano MMD, Branco M, Moreira HT, Schmidt A, Kisslo J, Maciel BC. Appropriate use of echocardiography and relation to clinical decision making in both inpatients and outpatients in a developing country. Echocardiography 2017; 35:9-16. [PMID: 28994142 DOI: 10.1111/echo.13725] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/02/2023] Open
Abstract
BACKGROUND Use of echocardiography (echo) has exponentially increased in recent decades. Concerned about this scientific society developed appropriate use criteria (AUC). Clinical management still suffers geographical variations, and no objective data are available about echo AUC in developing countries. We aimed to evaluate (1) the appropriateness of referrals and (2) their relation to changes in clinical decision management. METHODS Prospective analysis of referrals from January to December 2014. Appropriateness and endpoints analyzed in different time points from medical archives. ENDPOINTS (1) change in the diagnosis, (2) indication for another method to complete the diagnosis, (3) change in clinical treatment, (4) indication for a treatment intervention, or (5) no change in management. Descriptive statistical analysis, Fisher's or chi-square tests, and Cox regression used as appropriate (significance if P < .05). RESULTS One thousand one hundred referrals were analyzed (55.5 ± 16.1 years, 44.6% male). 80.5% of referrals were appropriate (A), 11.2% "Rarely Appropriate" (RA), and 8.3% "May Be Appropriate" (MBA). Proportion of (A) did not differ between modalities (TTE-80.5% vs TEE-87.7% vs STR-81.2%, P = .67). (A) referrals were more related to clinical decision than (RA)+(MBA) (38.9% [A] vs 15% [RA]+[MBA], P < .001). The most frequent clinical indications of (RA) and (MBA) TTE were reevaluation of ventricular function without clinical change (AUC 10 and 11) and search of infectious endocarditis when low clinical probability (53). CONCLUSIONS In a developing country, appropriateness of echo was similar to the United States and Europe. However, a significant proportion of referrals were still (RA) or (MBA), with no effect in clinical management. Controlling referrals 10, 11, and 53 can optimize echo use in developing countries.
Collapse
Affiliation(s)
- Minna Moreira Dias Romano
- Cardiology Center of the Medical School of Ribeirão Preto, University of São Paulo (USP), Ribeirão Preto, São Paulo, Brazil
| | - Marina Branco
- Cardiology Center of the Medical School of Ribeirão Preto, University of São Paulo (USP), Ribeirão Preto, São Paulo, Brazil
| | - Henrique Turin Moreira
- Cardiology Center of the Medical School of Ribeirão Preto, University of São Paulo (USP), Ribeirão Preto, São Paulo, Brazil
| | - André Schmidt
- Cardiology Center of the Medical School of Ribeirão Preto, University of São Paulo (USP), Ribeirão Preto, São Paulo, Brazil
| | - Joseph Kisslo
- Division of Cardiology, Department of Medicine, Duke University, Durham, NC, USA
| | - Benedito Carlos Maciel
- Cardiology Center of the Medical School of Ribeirão Preto, University of São Paulo (USP), Ribeirão Preto, São Paulo, Brazil
| |
Collapse
|
11
|
Singh A, Ward RP. Appropriate Use Criteria for Echocardiography: Evolving Applications in the Era of Value-Based Healthcare. Curr Cardiol Rep 2017; 18:93. [PMID: 27553788 DOI: 10.1007/s11886-016-0758-1] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/29/2022]
Abstract
The current climate in healthcare is increasingly emphasizing a value-based approach to diagnostic testing. Cardiac imaging, including echocardiography, has been a primary target of ongoing reforms in healthcare delivery and reimbursement. The Appropriate Use Criteria (AUC) for echocardiography is a physician-derived tool intended to guide utilization in optimal patient care. To date, the AUC have primarily been employed solely as justification for reimbursement, though evolving broader applications to guide clinical decision-making suggest a far more valuable role in the delivery of high-quality and high-value healthcare.
Collapse
Affiliation(s)
- Amita Singh
- Section of Cardiology, University of Chicago Medicine, 5841 S. Maryland Ave, MC6080, Chicago, IL, 60637, USA
| | - R Parker Ward
- Section of Cardiology, University of Chicago Medicine, 5841 S. Maryland Ave, MC6080, Chicago, IL, 60637, USA.
| |
Collapse
|
12
|
Bouma BJ, Riezenbos R, Voogel AJ, Veldhorst MH, Jaarsma W, Hrudova J, Cernohorsky B, Chamuleau S, van den Brink RBA, Breedveld R, Reichert C, Kamp O, Braam R, van Melle JP. Appropriate use criteria for echocardiography in the Netherlands. Neth Heart J 2017; 25:330-334. [PMID: 28247246 PMCID: PMC5405027 DOI: 10.1007/s12471-017-0960-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022] Open
Abstract
Introduction Appropriate use criteria (AUC) for echocardiography based on clinical scenarios were previously published by an American Task Force. We determined whether members of the Dutch Working Group on Echocardiography (WGE) would rate these scenarios in a similar way. Methods All 32 members of the WGE were invited to judge clinical scenarios independently using a blanked version of the previously published American version of AUC for echocardiography. During a face-to-face meeting, consensus about the final rating was reached by open discussion for each indication. For reasons of simplicity, the scores were reduced from a 9-point scale to a 3-point scale (indicating an appropriate, uncertain or inappropriate echo indication, respectively). Results Nine cardiologist members of the WGE reported their judgment on the echo cases (n = 153). Seventy-one indications were rated as appropriate, 35 were rated as uncertain, and 47 were rated as inappropriate. In 5% of the cases the rating was opposite to that in the original (appropriate compared with inappropriate and vice versa), whereas in 20% judgements differed by 1 level of appropriateness. After the consensus meeting, the appropriateness of 7 (5%) cases was judged differently compared with the original paper. Conclusions Echocardiography was rated appropriate when it is applied for an initial diagnosis, a change in clinical status or a change in patient management. However, in about 5% of the listed clinical scenarios, members of the Dutch WGE rated the AUC for echocardiography differently as compared with their American counterparts. Further research is warranted to analyse this decreased external validity. Electronic supplementary material The online version of this article (doi: 10.1007/s12471-017-0960-9) contains supplementary material, which is available to authorized users.
Collapse
Affiliation(s)
- B J Bouma
- Department of Cardiology, AMC, Amsterdam, The Netherlands.
| | - R Riezenbos
- Department of Cardiology, OLVG, Amsterdam, The Netherlands
| | - A J Voogel
- Department of Cardiology, Spaarne Hospital, Hoofddorp, The Netherlands
| | - M H Veldhorst
- Department of Cardiology, Isala, Zwolle, The Netherlands
| | - W Jaarsma
- Department of Cardiology, St. Antonius Hospital, Nieuwegein, The Netherlands
| | - J Hrudova
- Department of Cardiology, St Antonius Hospital, Sneek, The Netherlands
| | - B Cernohorsky
- Department of Cardiology, St Antonius Hospital, Sneek, The Netherlands
| | - S Chamuleau
- Department of Cardiology, University Medical Center, Utrecht, The Netherlands
| | | | - R Breedveld
- Department of Cardiology, MCL, Leeuwarden, The Netherlands
| | - C Reichert
- Department of Cardiology, MCA, Alkmaar, The Netherlands
| | - O Kamp
- Department of Cardiology, VUmc and AMC, Amsterdam, The Netherlands
| | - R Braam
- Department of Cardiology, Gelre Hospitals, Apeldoorn, The Netherlands
| | - J P van Melle
- Department of Cardiology, University Medical Center Groningen, Groningen, The Netherlands
| |
Collapse
|
13
|
Bhatia RS, Alabousi M, Dudzinski DM, Weiner RB. Appropriate use criteria: a review of need, development and applications. Expert Rev Cardiovasc Ther 2016; 14:281-90. [DOI: 10.1586/14779072.2016.1131125] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/04/2023]
|