1
|
Photopoulos GS, Wilson DS, Clarke SE, Costa AF. Reinterpretation of Hepatopancreaticobiliary Imaging Exams: Assessment of Clinical Impact, Peer Learning, and Physician Satisfaction. Acad Radiol 2024; 31:1870-1877. [PMID: 38052671 DOI: 10.1016/j.acra.2023.10.047] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2023] [Revised: 10/25/2023] [Accepted: 10/25/2023] [Indexed: 12/07/2023]
Abstract
OBJECTIVES To assess the impact on clinical management, potential for peer learning, and referring physician satisfaction with subspecialist reinterpretations of hepatopancreaticobiliary (HPB) imaging examinations. MATERIALS AND METHODS HPB CTs and MRIs from outside hospitals were reinterpreted by two subspecialty radiologists between March 2021 and August 2022. Reinterpretation reports were mailed to radiologists that issued primary reports. The electronic record was reviewed to assess for changes in clinical management based on the reinterpretations (yes/no/unavailable). To assess the potential for peer learning, a survey using a 5-point Likert scale was sent to radiologists who issued primary reports. A separate survey was sent to referring physicians to assess satisfaction with reinterpretations. RESULTS Two hundred fifty imaging examinations (122 CT, 128 MRI) were reinterpreted at the request of 19 referring physicians. Ninety-six radiologists issued primary reports. RADPEER scores 1-3 were assigned to 131/250 (52%), 86/250 (34%), and 33/250 (13%) examinations, respectively. Of 213 reinterpretations with adequate records for assessment, 75/213 (35%) were associated with a change in management; of these, 71/75 (95%) were classified as RADPEER 2 or 3. Most radiologists agreed or strongly agreed with the following: prefer to receive reinterpretations (34/36, 94%); reinterpretations changed practice of reporting HPB imaging examinations (23/36, 64%); and reinterpretations offer opportunities for peer learning (34/36, 94%). Referring physicians agreed or strongly agreed (7/7, 100%) that reinterpretations are valuable and often change or clarify management of patients with complex HPB disease, and offer an opportunity for peer learning. CONCLUSION Radiologists and referring physicians strongly agree that HPB imaging reinterpretations help support peer learning and patient management, respectively.
Collapse
Affiliation(s)
- Gregory S Photopoulos
- Faculty of Medicine, Dalhousie University, 5849 University Avenue, Halifax, NS B3H 4R2, Canada (G.S.P., D.S.W., S.E.C., A.F.C.)
| | - Darcie S Wilson
- Faculty of Medicine, Dalhousie University, 5849 University Avenue, Halifax, NS B3H 4R2, Canada (G.S.P., D.S.W., S.E.C., A.F.C.)
| | - Sharon E Clarke
- Faculty of Medicine, Dalhousie University, 5849 University Avenue, Halifax, NS B3H 4R2, Canada (G.S.P., D.S.W., S.E.C., A.F.C.); Department of Diagnostic Radiology, Queen Elizabeth II Health Sciences Centre, Victoria General Building, 3rd floor, 1276 South Park Street, Halifax, NS B3H 2Y9, Canada (S.E.C., A.F.C.)
| | - Andreu F Costa
- Faculty of Medicine, Dalhousie University, 5849 University Avenue, Halifax, NS B3H 4R2, Canada (G.S.P., D.S.W., S.E.C., A.F.C.); Department of Diagnostic Radiology, Queen Elizabeth II Health Sciences Centre, Victoria General Building, 3rd floor, 1276 South Park Street, Halifax, NS B3H 2Y9, Canada (S.E.C., A.F.C.).
| |
Collapse
|
2
|
Venkatakrishna SSB, Ghosh A, Sharma P, Miranda-Schaeubinger M, Prakash AV, Addisu L, Sze RW, Andronikou S. Frequency and classification of addenda in paediatric neuroradiological reports as part of quality assurance. Clin Radiol 2024; 79:303-311. [PMID: 38310059 DOI: 10.1016/j.crad.2023.12.025] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2023] [Revised: 11/29/2023] [Accepted: 12/31/2023] [Indexed: 02/05/2024]
Abstract
AIM To determine the frequency and classification of addenda seen in paediatric brain magnetic resonance imaging (MRI) reports. MATERIALS AND METHODS A retrospective review of the addenda of brain MRI reports from a large tertiary children's hospital was undertaken between January 2013 to December 2021 and a subset of above radiology reports was used to classify addenda over 6-month periods, October to March, spanning 2018 to 2021. A radiology fellow and a medical doctor classified the addenda into previously published categories using their best judgement. RESULTS Out of 73,643 brain MRI reports over 9 years (108 months) included in the study, only 923 reports (1.25%) had addenda. There was a total of 13,615 brain MRI reports from 6-month periods, of which only 179 reports (1.31%) had an addendum. The number of errors according to categories were: observational 88/13,615 (0.65%); interpretational 16/13,615 (0.12%); non-observational and non-interpretative 82/13,615 (0.6%). Notifications to referring physician made in 29/13,615 (0.21%). CONCLUSIONS The overall proportion of addenda to the brain MRI reports of children in the present study was low, at 1.25%. Categorisation of different addenda revealed the most common errors to be observational in 0.65%, including under-reading in the region of interest in 0.25%. Appropriate measures can now be introduced to minimise the error-based addenda further and improve MRI diagnosis in children. Other paediatric practices may choose to follow suit in evaluating their addenda and errors to improve practice.
Collapse
Affiliation(s)
- S S B Venkatakrishna
- Department of Radiology, Children's Hospital of Philadelphia, 3401 Civic Center Blvd, Philadelphia, PA 19104, USA
| | - A Ghosh
- Cincinnati Children's Hospital Medical Center, Cincinnati, OH, USA.
| | - P Sharma
- Department of Radiology, Children's Hospital of Philadelphia, 3401 Civic Center Blvd, Philadelphia, PA 19104, USA
| | - M Miranda-Schaeubinger
- Department of Radiology, Children's Hospital of Philadelphia, 3401 Civic Center Blvd, Philadelphia, PA 19104, USA
| | - A V Prakash
- Department of Internal Medicine, St Vincent Hospital, Worcester, MA, USA
| | - L Addisu
- Department of Radiology, Children's Hospital of Philadelphia, 3401 Civic Center Blvd, Philadelphia, PA 19104, USA
| | - R W Sze
- Department of Radiology, University of California San Francisco, Benioff Children's Hospital Oakland, Oakland, CA, USA
| | - S Andronikou
- Department of Radiology, Children's Hospital of Philadelphia, 3401 Civic Center Blvd, Philadelphia, PA 19104, USA; Perelman School of Medicine, University of Pennsylvania, 3400 Civic Center Blvd, Philadelphia, PA 19104, USA
| |
Collapse
|
3
|
Donnelly LF, Guimaraes CV. Event-Based Learning and Improvement: Radiology's Move From Peer Review to Peer Learning. Semin Ultrasound CT MR 2024; 45:161-169. [PMID: 38373672 DOI: 10.1053/j.sult.2024.02.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/21/2024]
Abstract
Over the past 15 years, the radiology community has made great progress moving from a system of score-based peer review to one of peer learning. Much has been learned along the way. In peer learning, cases in which learning opportunities are identified are reviewed solely for the purpose of fostering learning and improvement. This article defines peer learning and peer review and emphasizes the difference; looks back at the 20-year history of score-based peer review and transition to peer learning; outlines the problems with score-based peer review and the key elements of peer learning; discusses the current state of peer learning; and outlines future challenges and opportunities.
Collapse
Affiliation(s)
- Lane F Donnelly
- Department of Radiology, University of North Carolina School of Medicine, Chapel Hill, NC; Department of Pediatrics, University of North Carolina School of Medicine, Chapel Hill, NC.
| | - Carolina V Guimaraes
- Department of Radiology, University of North Carolina School of Medicine, Chapel Hill, NC
| |
Collapse
|
4
|
Tiwari A, Hirschhaut M, Perez-Garcia A, Flores-Mir C. Unmasking unconstructive online feedback in orthodontics. Angle Orthod 2024; 94:258-259. [PMID: 38381803 PMCID: PMC10893919 DOI: 10.2319/1945-7103-94.2.258] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/23/2024] Open
|
5
|
Siewert B, Brook OR, Kruskal JB. Peer learning in abdominal radiology: iterative process improvements over a 20-year experience. Abdom Radiol (NY) 2024; 49:662-677. [PMID: 38093102 DOI: 10.1007/s00261-023-04118-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2023] [Revised: 10/23/2023] [Accepted: 10/26/2023] [Indexed: 02/01/2024]
Abstract
PURPOSE After a slow and challenging transition period, peer learning and improvement (PLI) is now being more widely adopted by practices as an option for continuous personal and practice performance improvement. In addition to gaps that exist in the understanding of what PLI is and how it should be practiced, wide variation exists in how the process is implemented, administered, how outcomes are measured, and what strategies are employed to engage radiologists. This report aims to describe lessons learned from our 20-year experience with the design, implementation, and continuous improvements of a PLI program in a large academic program. METHODS Since initial implementation in 2004, an oversight team prospectively documented iterative process improvements and data submission trends in our PLI process. Process data included strategies for engaging radiologists in the PLI process (fostering case submission, PLI meeting participation), steps for achieving regulatory compliance, and template content for facilitating the value and impact of PLI meetings (case analysis, review of contributing factors, identification of improvement opportunities). RESULTS Submission trends, submitted case content, and improvement opportunities varied by clinical section. Process improvements that fostered engagement included closing the loop with participants, expanding criteria for case submission beyond interpretive disagreements (e.g., great pickups, near misses), minimizing impacts to workflow, and using evidence-based templates for case and contributor categorization, bias analysis, and identification of improvement opportunities. CONCLUSION Implementing an effective PLI program requires sustained communication, education, and continuous process improvement. While PLI can certainly lead to process and individual performance improvement, the program requires trained champions, designated time, effort, resources, education, and patience to be effectively implemented.
Collapse
Affiliation(s)
- Bettina Siewert
- Department of Radiology, Beth Israel Deaconess Medical Center, 1 Deaconess Rd, Boston, MA, 02215, USA
| | - Olga R Brook
- Department of Radiology, Beth Israel Deaconess Medical Center, 1 Deaconess Rd, Boston, MA, 02215, USA
| | - Jonathan B Kruskal
- Department of Radiology, Beth Israel Deaconess Medical Center, 1 Deaconess Rd, Boston, MA, 02215, USA.
| |
Collapse
|
6
|
Panagides JC, Hancel K, Kalva S, Schenker M, Saini S, Glazer DI, Khorasani R, Daye D. Interventional Radiology Peer Learning Platform and Adverse Event Reporting (IR-PEER): Initial Experience Implementing a Team-based Novel Peer Learning System in Interventional Radiology. J Am Coll Radiol 2024; 21:93-102. [PMID: 37659453 DOI: 10.1016/j.jacr.2023.07.022] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2023] [Revised: 07/21/2023] [Accepted: 07/26/2023] [Indexed: 09/04/2023]
Abstract
Although the transition from peer review to peer learning has had favorable outcomes in diagnostic radiology, experience with implementing a team-based peer review system in interventional radiology (IR) remains limited. Peer learning systems benefit diverse IR teams composed of multiple clinical roles and could contribute value in archiving events that have potential educational value. With multiple stakeholder input from clinical roles within the IR division at our institution (ie, radiologic technologists, nurses, advanced practice providers, residents, fellows, and attending physicians), we launched a HIPAA-compliant secure IR complication and learning opportunity reporting platform in April 2022. Case submissions were monitored over the subsequent 24 weeks, with monthly dashboard reports provided to departmental leadership. Preintervention and postintervention surveys were used to assess the impact of the peer learning platform and adverse event reporting in IR (IR-PEER) on perceptions of complication reporting in the IR division across clinical roles. Ninety-two peer learning submissions were collected for a weekly average ± standard error of 3.8 ± 0.6 submissions per week, and an additional 26 submissions were collected as part of the division's ongoing monthly complication review conference, for a total of 98 unique total case references. A total of 64.1% of submissions (59 of 92) involved a complication and/or adverse event, and 35.9% of submissions (33 of 92) identified a learning opportunity (no complication or adverse event). Nurses reported that IR-PEER made the complication-reporting process easier (P = .01), and all clinical roles reported that IR-PEER improved the overall process of complication reporting. Peer learning frameworks such as IR-PEER provide a more equitable communication platform for multidisciplinary teams to capture and archive learning opportunities that support quality and safety improvement efforts.
Collapse
Affiliation(s)
| | - Kayesha Hancel
- Department of Interventional Radiology, Massachusetts General Hospital, Boston, Massachusetts
| | - Sanjeeva Kalva
- Department of Interventional Radiology, Massachusetts General Hospital, Boston, Massachusetts
| | - Matthew Schenker
- Department of Radiology, Brigham and Women's Hospital, Boston, Massachusetts
| | - Sanjay Saini
- Department of Radiology, Brigham and Women's Hospital, Boston, Massachusetts
| | - Daniel I Glazer
- Department of Radiology, Brigham and Women's Hospital, Boston, Massachusetts
| | - Ramin Khorasani
- Department of Radiology, Brigham and Women's Hospital, Boston, Massachusetts
| | - Dania Daye
- Department of Interventional Radiology, Massachusetts General Hospital, Boston, Massachusetts.
| |
Collapse
|
7
|
Krueger D, Tanner SB, Szalat A, Malabanan A, Prout T, Lau A, Rosen HN, Shuhart C. DXA Reporting Updates: 2023 Official Positions of the International Society for Clinical Densitometry. J Clin Densitom 2024; 27:101437. [PMID: 38011777 DOI: 10.1016/j.jocd.2023.101437] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/29/2023]
Abstract
INTRODUCTION Professional guidance and standards assist radiologic interpreters in generating high quality reports. Initially DXA reporting Official Positions were provided by the ISCD in 2003; however, as the field has progressed, some of the current recommendations require revision and updating. This manuscript details the research approach and provides updated DXA reporting guidance. METHODS Key Questions were proposed by ISCD established protocols and approved by the Position Development Conference Steering Committee. Literature related to each question was accumulated by searching PubMed, and existing guidelines from other organizations were extracted from websites. Modifications and additions to the ISCD Official Positions were determined by an expert panel after reviewing the Task Force proposals and position papers. RESULTS Since most DXA is now performed in radiology departments, an approach was endorsed that better aligns with standard radiologic reports. To achieve this, reporting elements were divided into required minimum or optional. Collectively, required components comprise a standard diagnostic report and are considered the minimum necessary to generate an acceptable report. Additional elements were retained and categorized as optional. These optional components were considered relevant but tailored to a consultative, clinically oriented report. Although this information is beneficial, not all interpreters have access to sufficient clinical information, or may not have the clinical expertise to expand beyond a diagnostic report. Consequently, these are not required for an acceptable report. CONCLUSION These updated ISCD positions conform with the DXA field's evolution over the past 20 years. Specifically, a basic diagnostic report better aligns with radiology standards, and additional elements (which are valued by treating clinicians) remain acceptable but are optional and not required. Additionally, reporting guidance for newer elements such as fracture risk assessment are incorporated. It is our expectation that these updated Official Positions will improve compliance with required standards and generate high quality DXA reports that are valuable to the recipient clinician and contribute to best patient care.
Collapse
Affiliation(s)
- Diane Krueger
- School of Medicine and Public Health, Osteoporosis Clinical Research Program, University of Wisconsin-Madison, Madison, WI, USA.
| | - S Bobo Tanner
- Department of Medicine, Divisions of Rheumatology, Allergy & Immunology, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Auryan Szalat
- Osteoporosis Center, Internal Medicine Ward, Hadassah Medical Center, Faculty of Medicine, Hebrew University of Jerusalem, Jerusalem, Israel
| | - Alan Malabanan
- Bone Health Clinic, Boston Medical Center, Boston, MA, USA
| | - Tyler Prout
- Radiology Department, University of Wisconsin, Madison, WI, USA
| | - Adrian Lau
- Division of Endocrinology and Metabolism, Department of Medicine, Women's College Hospital, University of Toronto, Toronto, Ontario, Canada
| | - Harold N Rosen
- Osteoporosis Prevention and Treatment Center, Beth Israel Deaconess Medical Center, Boston, MA, USA
| | - Christopher Shuhart
- Bone Health and Osteoporosis Center, Swedish Medical Group, Seattle, WA, USA
| |
Collapse
|
8
|
Donnelly LF, Podberesky DJ, Towbin AJ, Loh L, Basta KH, Platchek TS, Vossmeyer MT, Shook JE. The Joint Commission's Ongoing Professional Practice Evaluation Process: Costly, Ineffective, and Potentially Harmful to Safety Culture. J Am Coll Radiol 2024; 21:61-69. [PMID: 37683817 DOI: 10.1016/j.jacr.2023.08.031] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2023] [Revised: 08/14/2023] [Accepted: 08/30/2023] [Indexed: 09/10/2023]
Abstract
OBJECTIVE To evaluate the estimated labor costs and effectiveness of Ongoing Professional Practice Evaluation (OPPE) processes at identifying outlier performers in a large sample of providers across multiple health care systems and to extrapolate costs and effectiveness nationally. METHODS Six hospital systems partnered to evaluate their labor expenses related to conducting OPPE. Estimates for mean labor hours and wages were created for the following: data analysts, medical staff office professionals, department physician leaders, and administrative assistants. The total number of outlier performers who were identified by OPPE metrics alone and that resulted in lack of renewal, limitation, or revoking of hospital privileges during the past annual OPPE cycle (2022) was recorded. National costs of OPPE were extrapolated. Literature review of the effect of OPPE on safety culture in radiology was performed. RESULTS The evaluated systems had 12,854 privileged providers evaluated by OPPE. The total estimated annual recurring labor cost per provider was $50.20. Zero of 12,854 providers evaluated were identified as outlier performers solely through the OPPE process. The total estimated annual recurring cost of administering OPPE nationally was $78.54 million. In radiology over the past 15 years, the use of error rates based on score-based peer review as an OPPE metric has been perceived as punitive and had an adverse effect on safety culture. CONCLUSION OPPE is expensive to administer, inefficient at identifying outlier performers, diverts human resources away from potentially more effective improvement work, and has been associated with an adverse impact on safety culture in radiology.
Collapse
Affiliation(s)
- Lane F Donnelly
- Professor of Radiology and Pediatrics, Departments of Radiology and Pediatrics, University of North Carolina School of Medicine, Chapel Hill, North Carolina; Executive Medical Director, Pediatric Population Health and Quality, UNC Health; Director of Quality, UNC Children's Hospital; member, ACR Peer Learning Committee.
| | - Daniel J Podberesky
- Vice President and Chief Medical Officer, Nemours Children's Health, Orlando, Florida, and Professor of Radiology, University of Central Florida, College of Medicine, Orlando, Florida
| | - Alexander J Towbin
- Associate Chief, Associate Chief Medical Information Officer, and Neil D. Johnson Chair of Radiology Informatics, Department of Radiology, Cincinnati Children's Hospital, Cincinnati, Ohio; Professor of Radiology, Department of Radiology, University of Cincinnati College of Medicine, Cincinnati, Ohio; ACR Roles: Informatics Commission, Councilor-at-Large (2023), Data Science Institute Non-Interpretive Panel Cochair, LI-RADS Steering Committee-Pediatric LI-RADS, Relevance and Impact Workgroup, Pediatric Measures Committee, ACR Annual Meeting Abstract Reviewers, Pediatric AI Workgroup
| | - Ling Loh
- Director, Analytics and Clinical Effectiveness, Center for Pediatric and Maternal Value, Stanford Medicine Children's Health, Palo Alto, California
| | - Kathryne H Basta
- Assistant Director, Quality and Patient Safety, Department of Quality and Safety, Texas Children's Hospital, Houston, Texas
| | - Terry S Platchek
- Vice President for Performance Improvement and Associate Chief Quality Officer, Center for Pediatric and Maternal Value, Stanford Medicine Children's Health, Palo Alto, California; Professor, Pediatrics and Internal Medicine, and Fellowship Director, Clinical Excellence Research Center, Department of Pediatrics, Stanford University School of Medicine, Palo Alto, California
| | - Michael T Vossmeyer
- Department of Pediatrics, Cincinnati Children's Hospital, Cincinnati, Ohio; Associate Professor, Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, Ohio; Chair, Utilization Review Committee; Chair, Focused Professional Practice Evaluation/OPPE Committee; member, Credentials Committee; member, Medical Executive Committee, Cincinnati Children's Hospital
| | - Joan E Shook
- Center for Pediatric and Maternal Value, Stanford Medicine Children's Health, Palo Alto, California; Professor of Pediatrics-Emergency Medicine, Department of Pediatrics, Baylor College of Medicine, Houston, Texas; Chief Safety Officer, Deputy Chief Quality Officer, Texas Children's Hospital
| |
Collapse
|
9
|
Goldberg-Stein S, Bhargavan-Chatfield M, Donnelly LF, Hernandez D, Kunst MM, Sharpe RE, Broder J. Applying Implementation Science Principles to Design the ACR Peer Learning Pathway: A Case Study. J Am Coll Radiol 2024; 21:103-106. [PMID: 37944877 DOI: 10.1016/j.jacr.2023.11.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2023] [Revised: 11/01/2023] [Accepted: 11/03/2023] [Indexed: 11/12/2023]
Affiliation(s)
- Shlomit Goldberg-Stein
- Associate Professor at Northwell Health of Hofstra Medical School, New York, New York; Chair, ACR Quality and Safety & Informatics Annual Conference Committee; Co-Chair of New York State Radiological Society Quality and Safety Committee.
| | | | - Lane F Donnelly
- Executive Medical Director of Pediatric Population Health and Quality, and Director of Children's Quality, University of North Carolina, Chapel Hill, North Carolina
| | - Dina Hernandez
- Senior Director for Accreditation, American College of Radiology, Reston, Virginia
| | - Mara M Kunst
- Neuroradiology Section Head, Beth Israel Lahey Health, Burlington, Massachusetts
| | - Richard E Sharpe
- Division Chair of Breast Imaging, Mayo Clinic, Phoenix, Arizona. https://twitter.com/RichSharpeJr
| | - Jennifer Broder
- Vice Chair, Radiology Quality and Safety, Lahey Hospital and Medical Center, Burlington, Massachusetts; Vice Chair, ACR Commission on Quality and Safety; and Chair, ACR Peer Learning Committee. https://twitter.com/jcbroderMD
| |
Collapse
|
10
|
Glazer DI, Schenker MP, Burk KS, Vetrano N, Glynn D, Daye D, Kalva SP, Khorasani R. Initial Experience with a PACS-Embedded Peer Learning Tool for Interventional Radiology. J Am Coll Radiol 2023; 20:1233-1236. [PMID: 37423352 DOI: 10.1016/j.jacr.2023.07.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2023] [Revised: 06/29/2023] [Accepted: 07/03/2023] [Indexed: 07/11/2023]
Affiliation(s)
- Daniel I Glazer
- Medical Director of CT; Director, Cross-Sectional Interventional Radiology (CSIR); Department of Radiology, Brigham and Women's Hospital, Harvard Medical School; and Department of Radiology, Center for Evidence-Based Imaging, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts.
| | - Matthew P Schenker
- Chief, Division of Interventional Radiology; Associate Chair of Finance; Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts
| | - Kristine S Burk
- Quality and Safety Officer, Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, and Department of Radiology, Center for Evidence-Based Imaging, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts
| | - Nicole Vetrano
- Department of Radiology, Center for Evidence-Based Imaging, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts
| | - David Glynn
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts; Department of Radiology, Boston Medical Center, Boston University School of Medicine, Boston, Massachusetts
| | - Dania Daye
- Quality Director, Division of Interventional Radiology, Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts
| | - Sanjeeva P Kalva
- Chief, Division of Interventional Radiology, Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts; Chair, Vascular Panel, ACR Appropriateness Criteria
| | - Ramin Khorasani
- Vice Chair, Radiology Quality and Safety; Vice Chair, Department of Radiology; Distinguished Chair, Medical Informatics; Director, Center for Evidence-Based Imaging; Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, and the Department of Radiology, Center for Evidence-Based Imaging, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts
| |
Collapse
|
11
|
Mani K, Shah K, Kadom N, Seidenwurm D, Nemeth AJ. Peer Learning in Neuroradiology: Not as Easy as It Sounds. AJNR Am J Neuroradiol 2023; 44:1109-1115. [PMID: 37793783 PMCID: PMC10549937 DOI: 10.3174/ajnr.a7973] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2023] [Accepted: 07/21/2023] [Indexed: 10/06/2023]
Affiliation(s)
- K Mani
- University Radiology GroupRutgers University School of MedicineNewark, New Jersey
| | - K Shah
- MD Anderson Cancer CenterHouston, Texas
| | - N Kadom
- Emory University School of MedicineChildren's Healthcare of AtlantaAtlanta, Georgia
| | | | - A J Nemeth
- Northwestern University, Feinberg School of MedicineNorthwestern Memorial HospitalChicago, Illinois
| |
Collapse
|
12
|
Kunst MM, Gautam A, Pisa M, Wald C, Broder JC. Get With the Guidelines on MS Imaging by Leveraging Peer Learning. Curr Probl Diagn Radiol 2023; 52:322-326. [PMID: 37069020 DOI: 10.1067/j.cpradiol.2023.03.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2023] [Accepted: 03/16/2023] [Indexed: 04/03/2023]
Abstract
OBJECTIVES To achieve consensus on the performance, interpretation and reporting of MS imaging according to up-to-date guidelines using the Peer Learning Methodology. MATERIALS AND METHODS We utilized the Peer Learning Methodology to engage our clinical and radiology colleagues, review the current guidelines, acheive consensus on imaging techniques and reporting standards. After implementing changes, we collected radiologist feedback on the impact of the optimized images on their interpretation. RESULTS Survey responders indicated a strong preference for the new protocol in terms of overall image quality, individual lesions conspicuity and confidence in the ability to detect an MS lesion. The new protocol was preferred for both MS diagnosis and MS surveillance in 25 of 28 responses. CONCLUSION The Peer Learning Methodology is an effective tool to standardize and improve MR imaging quality, interpretation and reporting for Multiple Sclerosis in accordance with current guidelines.
Collapse
Affiliation(s)
- Mara M Kunst
- Deptartment of Radiology, Lahey Hospital and Medical Center, Burlington, MA.
| | - Anirudh Gautam
- Deptartment of Radiology, Lahey Hospital and Medical Center, Burlington, MA
| | - Michelle Pisa
- Deptartment of Radiology, Lahey Hospital and Medical Center, Burlington, MA
| | - Christoph Wald
- Deptartment of Radiology, Lahey Hospital and Medical Center, Burlington, MA
| | - Jennifer C Broder
- Deptartment of Radiology, Lahey Hospital and Medical Center, Burlington, MA
| |
Collapse
|
13
|
Parrott EH, Saeedipour S, Walker CM, Best SR, Harn NR, Ash RM. Transition from Peer Review to Peer Learning: Lessons Learned. Curr Probl Diagn Radiol 2023; 52:223-229. [PMID: 37069021 DOI: 10.1067/j.cpradiol.2023.03.003] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2023] [Accepted: 03/16/2023] [Indexed: 03/30/2023]
Abstract
Landmark publications, such as To Err is Human, confronted the healthcare community with the egregious toll medical errors played in both patient safety and overall healthcare costs. This heralded a paradigm shift and a call for action by professional organizations to enact methods to ensure physician competency and quality assurance. The American College of Radiology similarly convened a task force to discuss these concerns and how best to address quality assurance in radiology practice, leading to the development of RADPEER, a score-based peer review system. However, critics were quick to point out the deficiencies of this model, highlighting it as punitive and a poor evaluator of physician performance. The recognized deficiencies in score-based peer review prompted the pursuit of an alternate model that would instead emphasize learning and improvement. Peer learning was proposed and highlighted the necessity of an inclusive and collaborative environment where colleagues could discuss case errors as learning opportunities without fear of punitive consequence. This paper explores peer learning, its benefits and challenges, as well as how to identify specific learning opportunities by utilizing case examples.
Collapse
|
14
|
DiPiro PJ, Licaros A, Zhao AH, Glazer DI, Healey MJ, Curley PJ, Giess CS, Khorasani R. Frequency and Clinical Utility of Alerts for Intra-Institutional Radiologist Discrepant Opinions. J Am Coll Radiol 2023; 20:431-437. [PMID: 36841320 DOI: 10.1016/j.jacr.2022.12.021] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2022] [Revised: 12/15/2022] [Accepted: 12/17/2022] [Indexed: 02/26/2023]
Abstract
OBJECTIVE Determine the rate of documented notification, via an alert, for intra-institutional discrepant radiologist opinions and addended reports and resulting clinical management changes. METHODS This institutional review board-exempt, retrospective study was performed at a large academic medical center. We defined an intra-institutional discrepant opinion as when a consultant radiologist provides a different interpretation from that formally rendered by a colleague at our institution. We implemented a discrepant opinion policy requiring closed-loop notification of the consulting radiologist's second opinion to the original radiologist, who must acknowledge this alert within 30 days. This study included all discrepant opinion alerts created December 1, 2019, to December 31, 2021, of which two radiologists and an internal medicine physician performed consensus review. Primary outcomes were degree of discrepancy and percent of discrepant opinions leading to change in clinical management. Secondary outcome was report addendum rate compared with an existing peer learning program using Fisher's exact test. RESULTS Of 114 discrepant opinion alerts among 1,888,147 reports generated during the study period (0.006%), 58 alerts were categorized as major (50.9%), 41 as moderate (36.0%), and 15 as minor discrepancies (13.1%). Clinical management change occurred in 64 of 114 cases (56.1%). Report addendum rate for discrepant opinion alerts was 4-fold higher than for peer learning alerts at our institution (66 of 315 = 21% versus 432 of 8,273 =5.2%; P < .0001). DISCUSSION Although discrepant intra-institutional radiologist second opinions were rare, they frequently led to changes in clinical management. Capturing these discrepancies by encouraging alert use may help optimize patient care and document what was communicated to the referring or consulting care team by consulting radiologists.
Collapse
Affiliation(s)
- Pamela J DiPiro
- Radiology Quality and Safety Officer, Department of Radiology, Center for Evidence-Based Imaging, Brigham and Women's Hospital, Boston, Massachusetts; Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts; and Department of Imaging, Dana-Farber Cancer Institute, Harvard Medical School, Boston, Massachusetts.
| | - Andro Licaros
- Department of Radiology, Center for Evidence-Based Imaging, Brigham and Women's Hospital, Boston, Massachusetts; and Oncologic Imaging Fellow, Department of Imaging, Dana-Farber Cancer Institute, Harvard Medical School, Boston, Massachusetts
| | - Anna H Zhao
- Department of Radiology, Center for Evidence-Based Imaging, Brigham and Women's Hospital, Boston, Massachusetts; and Radiology Resident, Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts
| | - Daniel I Glazer
- Department of Radiology, Center for Evidence-Based Imaging, Brigham and Women's Hospital, Boston, Massachusetts; Medical Director of CT and Director, Cross-Sectional Interventional Radiology (CSIR), Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts; and Department of Imaging, Dana-Farber Cancer Institute, Harvard Medical School, Boston, Massachusetts
| | - Michael J Healey
- Department of Radiology, Center for Evidence-Based Imaging, Brigham and Women's Hospital, Boston, Massachusetts; and Associate Chief Medical Officer, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts
| | - Patrick J Curley
- Executive Director, Quality, Safety, Equity & Experience, Enterprise Radiology, Department of Radiology, Center for Evidence-Based Imaging, Brigham and Women's Hospital, Boston, Massachusetts
| | - Catherine S Giess
- Department of Radiology, Center for Evidence-Based Imaging, Brigham and Women's Hospital, Boston, Massachusetts; Deputy Chair, Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts; and Department of Imaging, Dana-Farber Cancer Institute, Harvard Medical School, Boston, Massachusetts
| | - Ramin Khorasani
- Vice Chair, Radiology Quality and Safety, Mass General Brigham; Vice Chair, Department of Radiology; Distinguished Chair, Medical Informatics; Director, Center for Evidence Based Imaging; Department of Radiology, Center for Evidence-Based Imaging, Brigham and Women's Hospital, Boston, Massachusetts; Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts; and Department of Imaging, Dana-Farber Cancer Institute, Harvard Medical School, Boston, Massachusetts
| |
Collapse
|
15
|
Abdominal peer learning: advantages and lessons learned. Abdom Radiol (NY) 2023; 48:1526-1535. [PMID: 36801958 DOI: 10.1007/s00261-023-03846-9] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2022] [Revised: 02/01/2023] [Accepted: 02/02/2023] [Indexed: 02/21/2023]
Abstract
In 2017, our tertiary hospital-based imaging practice transitioned from score-based peer review to the peer learning methodology for learning and improvement. In our subspecialized practice, peer learning submissions are reviewed by domain experts, who then provide feedback to individual radiologists, curate cases for group learning sessions, and develop associated improvement initiatives. In this paper, we share lessons learned from our abdominal imaging peer learning submissions with the assumption that trends in our practice likely mimic others', and hope that other practices can avoid future errors and elevate the level of the quality of their own performance. Adoption of a nonjudgmental and efficient method to share peer "learning opportunities" and "great calls" has increased participation in this activity and increased transparency into our practice, thus allowing for visualization of trends in performance. Peer learning allows us to bring our own individual knowledge and practices together for group review in a collegial and safe environment. We learn from each other and decide how to improve together.
Collapse
|
16
|
Mojtahed A, Kilcoyne A, Crowley C, Furtado F, Anderson MA, Catalano OA, Gee MS, Kambadakone A, Saini S, Pandharipande PV. Introduction of a daily peer learning process with added value for faculty and trainees. Clin Imaging 2022; 92:83-87. [DOI: 10.1016/j.clinimag.2022.10.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2022] [Revised: 09/25/2022] [Accepted: 10/02/2022] [Indexed: 11/03/2022]
|
17
|
Kadom N, Reddy KM, Khanna G, Simoneaux SF, Allen JW, Heilbrun ME. Peer Learning Program Metrics: A Pediatric Neuroradiology Example. AJNR Am J Neuroradiol 2022; 43:1680-1684. [PMID: 36229162 PMCID: PMC9731238 DOI: 10.3174/ajnr.a7673] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2022] [Accepted: 09/12/2022] [Indexed: 02/01/2023]
Abstract
BACKGROUND AND PURPOSE The American College of Radiology is now offering an accreditation pathway for programs that use peer learning. Here, we share feasibility and outcome data from a pilot peer learning program in a pediatric neuroradiology section that, in its design, follows the American College of Radiology peer learning accreditation pathway criteria. MATERIALS AND METHODS We retrospectively reviewed metrics from a peer learning program with 5 participating full-time pediatric neuroradiologists during 1 year: 1) number of cases submitted, 2) percentage of radiologists meeting targets, 3) monthly attendance, 4) number of cases reviewed, 5) learning points, and 6) improvement actions. In addition, a faculty survey was conducted and is reported here. RESULTS Three hundred twenty-four cases were submitted (mean, 7 cases/faculty/month). The faculty never met the monthly submission target. Peer learning meeting attendance was 100%. One hundred seventy-nine cases were reviewed during the peer learning meetings. There were 22 learning points throughout the year and 30 documented improvement actions. The faculty survey yielded the highest ratings (4.8 of 5) for ease of meeting the 100% attendance requirement and for the learning value of the peer learning sessions. The lowest rating (4.2 of 5) was given for the effectiveness of improvements as a result of peer learning discussions. CONCLUSIONS Implementing a peer learning program that follows the American College of Radiology peer learning accreditation pathway criteria is feasible. Program metric documentation can be time-consuming. Participant feedback led to meaningful program improvement, such as improving trust, expanding case submission categories, and delegating tasks to administrative staff. Effort to make peer learning operations more efficient and more effective is underway.
Collapse
Affiliation(s)
- N Kadom
- From the Department of Radiology and Imaging Sciences (N.K., K.M.R., G.K., S.F.S., J.W.A., M.E.H.), Emory University School of Medicine, Atlanta, Georgia
- Department of Radiology (N.K., K.M.R., G.K., S.F.S.), Children's Healthcare of Atlanta, Atlanta, Georgia
| | - K M Reddy
- From the Department of Radiology and Imaging Sciences (N.K., K.M.R., G.K., S.F.S., J.W.A., M.E.H.), Emory University School of Medicine, Atlanta, Georgia
- Department of Radiology (N.K., K.M.R., G.K., S.F.S.), Children's Healthcare of Atlanta, Atlanta, Georgia
| | - G Khanna
- From the Department of Radiology and Imaging Sciences (N.K., K.M.R., G.K., S.F.S., J.W.A., M.E.H.), Emory University School of Medicine, Atlanta, Georgia
- Department of Radiology (N.K., K.M.R., G.K., S.F.S.), Children's Healthcare of Atlanta, Atlanta, Georgia
| | - S F Simoneaux
- From the Department of Radiology and Imaging Sciences (N.K., K.M.R., G.K., S.F.S., J.W.A., M.E.H.), Emory University School of Medicine, Atlanta, Georgia
- Department of Radiology (N.K., K.M.R., G.K., S.F.S.), Children's Healthcare of Atlanta, Atlanta, Georgia
| | - J W Allen
- From the Department of Radiology and Imaging Sciences (N.K., K.M.R., G.K., S.F.S., J.W.A., M.E.H.), Emory University School of Medicine, Atlanta, Georgia
| | - M E Heilbrun
- From the Department of Radiology and Imaging Sciences (N.K., K.M.R., G.K., S.F.S., J.W.A., M.E.H.), Emory University School of Medicine, Atlanta, Georgia
| |
Collapse
|
18
|
Burk KS, Zhao AH, Glazer DI, Giess C, Boland GW, Khorasani R. Assessment of a Large-Scale Peer Learning Program's Value by Manual Review of Case Submissions. J Am Coll Radiol 2022; 19:1138-1150. [PMID: 35809618 DOI: 10.1016/j.jacr.2022.04.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2021] [Revised: 04/04/2022] [Accepted: 04/22/2022] [Indexed: 11/17/2022]
Abstract
OBJECTIVE Prior studies used submission numbers or report addendum rates to measure peer learning programs' (PLP) impact. We assessed the educational value of a PLP by manually reviewing cases submitted to identify factors correlating with meaningful learning opportunities (MLOs). METHODS This institutional review board-exempted, retrospective study was performed in a large academic radiology department generating >800,000 reports annually. A PLP facilitating radiologist-to-radiologist feedback was implemented May 1, 2017, with subsequent pay-for-performance initiatives encouraging increasing submissions, >18,000 by 2019. Two radiologists blinded to submitter and receiver identity categorized 336 randomly selected submissions as a MLO, not meaningful, or equivocal, resolving disagreements in consensus review. Primary outcome was proportion of MLOs. Secondary outcomes included percent engagement by subspecialty clinical division and comparing MLO and report addendum rates via Fisher's exact tests. We assessed association between peer learning category, pay-for-performance interventions, and subspecialty division with MLOs using logistic regression. RESULTS Of 336 PLP submissions, 65.2% (219 of 336) were categorized as meaningful, 27.4% (92 of 336) not meaningful, and 7.4% (25 of 336) equivocal, with substantial reviewer agreement (86.0% [289 of 336], κ = 0.71, 95% confidence interval 0.64-0.78). MLO rate (65.2% [219 of 336]) was five times higher than addendum rate (12.9% [43 of 333]) for the cohort. MLO proportion (adjusted odds ratios 0.05-1.09) and percent engagement (0.5%-3.6%) varied between subspecialty divisions, some submitting significantly fewer MLOs (P < .01). MLO proportion did not vary between peer learning categories. CONCLUSION Educational value of a large-scale PLP, estimated through manual review of case submissions, is likely a more accurate measure of program impact. Incentives to enhance PLP use did not diminish the program's educational value.
Collapse
Affiliation(s)
- Kristine S Burk
- Quality and Safety Officer, Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts; Center for Evidence-Based Imaging, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts.
| | - Anna H Zhao
- Center for Evidence-Based Imaging, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts
| | - Daniel I Glazer
- Center for Evidence-Based Imaging, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts; Director of CT and Cross-Sectional Interventional Radiology, Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts
| | - Catherine Giess
- Center for Evidence-Based Imaging, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts; Deputy Division Chief and Enterprise Chief of Breast Imaging, Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts
| | - Giles W Boland
- Center for Evidence-Based Imaging, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts; President of the Brigham and Women's Physician Organization, Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts
| | - Ramin Khorasani
- Vice Chair, Quality and Safety, Department of Radiology and Director, Center for Evidence-Based Imaging, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts
| |
Collapse
|
19
|
Schmidt E, Lo HS, Saghir A. Peer learning in emergency radiology: effects on learning, error identification, and radiologist experience. Emerg Radiol 2022; 29:655-661. [PMID: 35391565 DOI: 10.1007/s10140-022-02040-6] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2022] [Accepted: 03/29/2022] [Indexed: 11/24/2022]
Abstract
PURPOSE We established and evaluated a peer learning program in an emergency radiology (ER) division. Peer learning is an alternative to peer review focusing on non-punitive error reporting to mitigate consequences of inevitable human error. The central component is the peer learning conference, where cases are presented, key teaching points are discussed, and process improvement ideas are solicited. METHODS We established a prior imaging-based case identification system and a bimonthly remote videoconference where ER faculty discuss 5-15 cases selected for learning or process improvement opportunities. Case identification and conference characteristics were captured. A survey focused on learning and performance outcomes was administered to faculty initially and showed improved scores after 6 months. RESULTS Cases selected for conference favored perception errors (46%), with great calls (17%) and process improvement (15%) the next most common categories. A variety of anatomical regions were represented, with abdominal (35%) and musculoskeletal (29%) most common. Error detection was improved over peer review. All participants find the system easy to use and prefer peer learning to peer review for learning and process improvement. CONCLUSION A peer learning program can be successfully implemented within a busy academic emergency radiology division, as evidenced by increasing buy-in and engagement scores over time. When tied to a departmental peer learning infrastructure, interdisciplinary expertise and robust case identification can be leveraged to increase learning opportunities.
Collapse
Affiliation(s)
- Eric Schmidt
- Department of Radiology, University of Massachusetts Medical School, Worcester, MA, 01605, USA
| | - Hao S Lo
- Department of Radiology, University of Massachusetts Medical School, Worcester, MA, 01605, USA
| | - Amina Saghir
- Department of Radiology, University of Massachusetts Medical School, Worcester, MA, 01605, USA.
| |
Collapse
|
20
|
Sayyouh MMH, Sella EC, Shankar PR, Marshall GE, Quint LE, Agarwal PP. Lessons Learned from Peer Learning Conference in Cardiothoracic Radiology. Radiographics 2022; 42:579-593. [PMID: 35148241 DOI: 10.1148/rg.210125] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
Medical errors may lead to patient harm and may also have a devastating effect on medical providers, who may suffer from guilt and the personal impact of a given error (second victim experience). While it is important to recognize and remedy errors, it should be done in a way that leads to long-standing practice improvement and focuses on systems-level opportunities rather than in a punitive fashion. Traditional peer review systems are score based and have some undesirable attributes. The authors discuss the differences between traditional peer review systems and peer learning approaches and offer practical suggestions for transitioning to peer learning conferences. Peer learning conferences focus on learning opportunities and embrace errors as an opportunity to learn. The authors also discuss various types and sources of errors relevant to the practice of radiology and how discussions in peer learning conferences can lead to widespread system improvement. In the authors' experience, these strategies have resulted in practice improvement not only at a division level in radiology but in a broader multidisciplinary setting as well. The online slide presentation from the RSNA Annual Meeting is available for this article. ©RSNA, 2022.
Collapse
Affiliation(s)
- Mohamed M H Sayyouh
- From the Cardiothoracic Imaging Division, Department of Radiology, University of Michigan, Taubman Center B1-132D, 1500 E Medical Center Dr, Ann Arbor, MI 48109-5302 (M.M.H.S., E.C.S., G.E.M., L.E.Q., P.P.A.); and Abdominal Imaging Division and Michigan Radiology Quality Collaborative, Department of Radiology, University of Michigan, Ann Arbor, Mich (P.R.S.)
| | - Edith C Sella
- From the Cardiothoracic Imaging Division, Department of Radiology, University of Michigan, Taubman Center B1-132D, 1500 E Medical Center Dr, Ann Arbor, MI 48109-5302 (M.M.H.S., E.C.S., G.E.M., L.E.Q., P.P.A.); and Abdominal Imaging Division and Michigan Radiology Quality Collaborative, Department of Radiology, University of Michigan, Ann Arbor, Mich (P.R.S.)
| | - Prasad R Shankar
- From the Cardiothoracic Imaging Division, Department of Radiology, University of Michigan, Taubman Center B1-132D, 1500 E Medical Center Dr, Ann Arbor, MI 48109-5302 (M.M.H.S., E.C.S., G.E.M., L.E.Q., P.P.A.); and Abdominal Imaging Division and Michigan Radiology Quality Collaborative, Department of Radiology, University of Michigan, Ann Arbor, Mich (P.R.S.)
| | - Giselle E Marshall
- From the Cardiothoracic Imaging Division, Department of Radiology, University of Michigan, Taubman Center B1-132D, 1500 E Medical Center Dr, Ann Arbor, MI 48109-5302 (M.M.H.S., E.C.S., G.E.M., L.E.Q., P.P.A.); and Abdominal Imaging Division and Michigan Radiology Quality Collaborative, Department of Radiology, University of Michigan, Ann Arbor, Mich (P.R.S.)
| | - Leslie E Quint
- From the Cardiothoracic Imaging Division, Department of Radiology, University of Michigan, Taubman Center B1-132D, 1500 E Medical Center Dr, Ann Arbor, MI 48109-5302 (M.M.H.S., E.C.S., G.E.M., L.E.Q., P.P.A.); and Abdominal Imaging Division and Michigan Radiology Quality Collaborative, Department of Radiology, University of Michigan, Ann Arbor, Mich (P.R.S.)
| | - Prachi P Agarwal
- From the Cardiothoracic Imaging Division, Department of Radiology, University of Michigan, Taubman Center B1-132D, 1500 E Medical Center Dr, Ann Arbor, MI 48109-5302 (M.M.H.S., E.C.S., G.E.M., L.E.Q., P.P.A.); and Abdominal Imaging Division and Michigan Radiology Quality Collaborative, Department of Radiology, University of Michigan, Ann Arbor, Mich (P.R.S.)
| |
Collapse
|
21
|
Phalak KA, Gerlach K, Parikh JR. Peer learning in breast imaging. Clin Imaging 2022; 85:60-63. [PMID: 35247790 DOI: 10.1016/j.clinimag.2022.02.027] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2021] [Revised: 02/11/2022] [Accepted: 02/25/2022] [Indexed: 11/17/2022]
Abstract
With the increasing focus on quality and safety in medicine, radiology practices are increasingly transitioning from traditional score-based peer review to peer learning. Participation in a peer learning program can increase learning, practice improvement, and cultivation of interpersonal relationships in a non-punitive environment. As breast imaging errors are the most cited in medical malpractice cases, learning and attention to and reduction of these errors in breast imaging are especially important. We describe the strengths of a peer learning program, implementation process in a breast imaging program, challenges to overcome, and strategies to support success.
Collapse
Affiliation(s)
- Kanchan A Phalak
- Department of Radiology, University MD Anderson Cancer Center, Houston, TX, USA.
| | - Karen Gerlach
- Department of Radiology, University MD Anderson Cancer Center, Houston, TX, USA.
| | - Jay R Parikh
- Department of Radiology, University MD Anderson Cancer Center, Houston, TX, USA.
| |
Collapse
|
22
|
Torres FS, Costa AF, Kagoma Y, Arrigan M, Scott M, Yemen B, Hurrell C, Kielar A. CAR Peer Learning Guide. Can Assoc Radiol J 2022; 73:491-498. [PMID: 35077247 DOI: 10.1177/08465371211065454] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
Peer learning is a quality initiative used to identify potential areas of practice improvement, both on a patient level and on a systemic level. Opportunities for peer learning include review of prior imaging studies, evaluation of cases from multidisciplinary case conferences, and review of radiology trainees' call cases. Peer learning is non-punitive and focuses on promoting life-long learning. It seeks to identify and disseminate learning opportunities and areas for systems improvement compared to traditional peer review. Learning opportunities arise from peer learning through both individual communication of cases reviewed for routine work, as well as through anonymous presentation of aggregate cases in an educational format. In conjunction with other tools such as root cause analysis, peer learning can be used to guide future practice improvement opportunities. This guide provides definitions of terms and a synthetic evidence review regarding peer review and peer learning, as well as medicolegal and jurisdictional considerations. Important aspects of what makes an effective peer learning program and best practices for implementing such a program are presented. The guide is intended to be a living document that will be updated regularly as new data emerges and peer learning continues to evolve in radiology practices.
Collapse
Affiliation(s)
- Felipe Soares Torres
- Joint Department of Medical Imaging, Toronto General Hospital, 7938University of Toronto, Toronto, ON, Canada
| | - Andreu F Costa
- Department of Radiology, Queen Elizabeth II Health Sciences Centre, Dalhousie University, Halifax, NS, Canada
| | - Yoan Kagoma
- Hamilton Health Sciences, McMaster University Faculty of Health Sciences, Hamilton, ON, Canada
| | | | - Malcolm Scott
- Misericordia Community Hospital, University of Alberta, Edmonton, AB, Canada
| | - Brian Yemen
- Hamilton Health Sciences, 3710McMaster University, Hamilton, ON, Canada
| | - Casey Hurrell
- Canadian Association of Radiologists, Ottawa, ON, Canada
| | - Ania Kielar
- Joint Department of Medical Imaging, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
23
|
Bowman AW, Tan N, Adamo DA, Chen F, Venkatesh SK, Baumgarten DA. Implementation of peer learning conferences throughout a multi-site abdominal radiology practice. Abdom Radiol (NY) 2021; 46:5489-5499. [PMID: 33999282 DOI: 10.1007/s00261-021-03114-8] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2021] [Revised: 04/25/2021] [Accepted: 04/30/2021] [Indexed: 11/28/2022]
Abstract
PURPOSE To initiate a peer learning conference for our abdominal radiology division across multiple geographically separated sites and different time zones, and to determine radiologist preference for peer learning versus traditional score-based peer review. METHODS We implemented a monthly peer learning videoconference for our abdominal radiology division. Surveys regarding radiologist opinion regarding traditional peer review and the new peer learning conferences were conducted before and after 6 months of conferences. RESULTS Peer learning conferences were well attended across our multiple sites, with an average of 43 participants per conference. Radiologist opinion regarding peer review was poor, with survey radiologists responding positively to only 1 out of 12 process questions. Opinion regarding peer learning was extremely favorable, with radiologists responding positively to 12 out of the same 12 process questions. After 6 months of peer learning conferences, 87.9% of surveyed radiologists wished to continue them in some fashion, and no one preferred to return to score-based peer review alone. CONCLUSION We successfully implemented a peer learning conference for our abdominal radiology division spread out over multiple geographic sites. Our radiologists strongly preferred peer learning conferences over our traditional peer review system for quality control.
Collapse
Affiliation(s)
- Andrew W Bowman
- Department of Radiology, Mayo Clinic, 4500 San Pablo Rd, Jacksonville, FL, 32224, USA.
| | - Nelly Tan
- Department of Radiology, Mayo Clinic, 5777 Mayo Blvd, Phoenix, AZ, 85054, USA
| | - Daniel A Adamo
- Department of Radiology, Mayo Clinic, 200 First St SW, Rochester, MN, 55905, USA
| | - Frederick Chen
- Department of Radiology, Mayo Clinic, 5777 Mayo Blvd, Phoenix, AZ, 85054, USA
| | - Sudhakar K Venkatesh
- Department of Radiology, Mayo Clinic, 200 First St SW, Rochester, MN, 55905, USA
| | - Deborah A Baumgarten
- Department of Radiology, Mayo Clinic, 4500 San Pablo Rd, Jacksonville, FL, 32224, USA
| |
Collapse
|
24
|
Glazer DI, Zhao AH, Lacson R, Burk KS, DiPiro PJ, Kapoor N, Khorasani R. Use of a PACS Embedded System for Communicating Radiologist to Technologist Learning Opportunities and Patient Callbacks. Curr Probl Diagn Radiol 2021; 51:511-516. [PMID: 34836721 DOI: 10.1067/j.cpradiol.2021.09.007] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2021] [Revised: 09/07/2021] [Accepted: 09/19/2021] [Indexed: 12/19/2022]
Abstract
OBJECTIVE This study aimed to determine effect of modality, care setting, and radiology subspecialty on frequency of diagnostic image quality issues identified by radiologists during image interpretation. METHODS This Institutional Review Board-exempt retrospective study was performed 10/1/18-6/30/20 at an academic radiology practice performing 700,000+ examinations annually. A closed-loop communication tool integrated in PACS workflow enabled radiologists to alert technologists to image quality issues. Radiologists categorized communications as requiring patient callback, or as technologist learning opportunities if image quality was adequate to generate a diagnostic report. Fisher's exact test assessed impact of imaging modality, radiology subspecialty, and care setting on radiologist-identified image quality issues. RESULTS 976,915 imaging examinations were performed during the study period. Radiologists generated 1,935 technologist learning opportunities (0.20%) and 208 callbacks (0.02%). Learning opportunity rates were highest for MRI (0.60%) when compared to CT (0.26%) and radiography (0.08%) (p<0.0001). The same was true for patient callbacks (MRI 0.13%, CT 0.02%, radiography 0.0006%; p<0.0001). Outpatient examinations generated more learning opportunities (1479/637,092; 0.23%) vs. inpatient (305/200,206; 0.15%) and Emergency Department (151/139,617; 0.11%) (p<0.0001). Abdominal subspecialists were most likely to generate learning opportunities when compared to other subspecialists and cardiovascular imagers were most likely to call a patient back. CONCLUSIONS Image quality issues identified by radiologists during the interpretation process were rare and 10 times more commonly categorized as learning opportunities not interfering with a clinically adequate report than as requiring patient callback. Further work is necessary to determine if creating learning opportunities leads to fewer patients requiring repeat examinations.
Collapse
Affiliation(s)
- Daniel I Glazer
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA.; Center for Evidence-Based Imaging, Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Brookline, MA..
| | - Anna H Zhao
- Center for Evidence-Based Imaging, Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Brookline, MA
| | - Ronilda Lacson
- Center for Evidence-Based Imaging, Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Brookline, MA
| | - Kristine S Burk
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA.; Center for Evidence-Based Imaging, Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Brookline, MA
| | - Pamela J DiPiro
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA.; Center for Evidence-Based Imaging, Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Brookline, MA
| | - Neena Kapoor
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA.; Center for Evidence-Based Imaging, Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Brookline, MA
| | - Ramin Khorasani
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA.; Center for Evidence-Based Imaging, Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Brookline, MA
| |
Collapse
|
25
|
Perspective: in pursuit of a learning culture. Abdom Radiol (NY) 2021; 46:5017-5020. [PMID: 34075467 DOI: 10.1007/s00261-021-03156-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2021] [Revised: 05/13/2021] [Accepted: 05/26/2021] [Indexed: 10/21/2022]
Abstract
Transitioning from peer review to peer learning is an important step forward in developing a learning culture. Additional measures are going to be required to meet this goal. Ideas toward establishing a learning culture are detailed in this perspective.
Collapse
|
26
|
Virarkar M, Morani AC, Bhosale P, Wagner-Bartak NA, Carter BW, Lano E. Peer Learning and Operationalizing During COVID-19 Pandemic and Beyond. Cureus 2021; 13:e16568. [PMID: 34430170 PMCID: PMC8378281 DOI: 10.7759/cureus.16568] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/22/2021] [Indexed: 11/23/2022] Open
Abstract
The main objective of the article is to describe the changes in managing the peer learning system in the Department of Abdominal Imaging at our institution during the pandemic and its restrictions. The pandemic poses diverse challenges to academic institutions across the country including radiology education and peer learning. The health sector in some areas of the country has been stretched by the number of coronavirus disease 2019 (COVID-19) patients. In March 2020, our institution cancelled all in-person conferences as per guidelines from the Center of Disease Control and Prevention to mitigate the spread of COVID-19 and the conferences were shifted to virtual platforms. Our recent peer learning approach allowed us to practice appropriate social distancing while following the institutional and national guidelines with minimal disruption. Other institutions that are facing similar challenges can adopt or modify our framework of a successful and efficient virtual peer learning process.
Collapse
Affiliation(s)
- Mayur Virarkar
- Radiology, The University of Texas Health Science Center at Houston, Houston, USA
| | - Ajaykumar C Morani
- Abdominal Imaging, The University of Texas MD Anderson Cancer Center, Houston, USA
| | - Priya Bhosale
- Abdominal Imaging, The University of Texas MD Anderson Cancer Center, Houston, USA
| | | | - Brett W Carter
- Thoracic Imaging, The University of Texas MD Anderson Cancer Center, Houston, USA
| | - Elizabeth Lano
- Abdominal Imaging, The University of Texas MD Anderson Cancer Center, Houston, USA
| |
Collapse
|
27
|
Kruskal JB, Shanafelt T. Radiologist Well-Being and Professional Fulfillment in the COVID-19 Era: Fostering Posttraumatic Growth. J Am Coll Radiol 2021; 18:1198-1207. [PMID: 33865755 DOI: 10.1016/j.jacr.2021.03.016] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2021] [Revised: 03/08/2021] [Accepted: 03/10/2021] [Indexed: 10/24/2022]
Abstract
The acute consequences of the COVID-19 pandemic have impacted wellness strategies aimed at mitigating the pre-existing epidemic of burnout in radiology. Specifically, safety measures including social distancing requirements, effective communications, supporting remote and distributed work teams, and newly exposed employment and treatment inequities have challenged many major efforts at fostering professional fulfillment. To get our wellness efforts back on track and to achieve a new and perhaps even a better "normal" will require refocusing and reconsidering ways to foster and build a culture of wellness, implementing practices that improve work efficiencies, and supporting personal health, wellness behaviors, and resilience. Optimizing meaning in work is also critical for well-being and professional fulfillment. In addition to these earlier approaches, organizations and leaders will need to reprioritize efforts to build high-functioning cohesive and connected teams; to train, implement, and manage peer-support practices; and to support posttraumatic growth. This growth represents the positive psychological changes that can occur after highly challenging life circumstances and, when successful, allows individuals to achieve a higher level of functioning by addressing and learning from the precipitating event. Our practices can support this growth through education, emotional regulation, and disclosure, by developing a narrative that reimagines a hoped-for better future and by finding meaning through services that benefit others.
Collapse
Affiliation(s)
- Jonathan B Kruskal
- Melvin E. Clouse, Professor of Radiology, Harvard Medical School, Chair, Department of Radiology, Beth Israel Deaconess Medical Center, Boston, Massachusetts.
| | - Tait Shanafelt
- Chief Wellness Officer, Stanford Medicine, Associate Dean, Stanford University School of Medicine, Stanford, California
| |
Collapse
|
28
|
Broder JC, Scheirey CD, Wald C. Step by Step: A Structured Approach for Proposing, Developing and Implementing a Radiology Peer Learning Program. Curr Probl Diagn Radiol 2021; 50:457-460. [PMID: 33663894 DOI: 10.1067/j.cpradiol.2021.02.007] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2020] [Revised: 01/12/2021] [Accepted: 02/01/2021] [Indexed: 11/22/2022]
Abstract
Similar to the experiences of other radiology practices, our radiology staff members felt that scored peer review identified few errors/learning opportunities while undermining team collegiality. They desired a more effective way to promote team collegiality and foster lifelong learning. We describe the steps our department took to transition from a peer review system to a peer learning program.
Collapse
Affiliation(s)
- Jennifer C Broder
- Vice Chair Quality and Safety, Department of Radiology, Lahey Hospital and Medical Center, Burlington, MA.
| | - Christopher D Scheirey
- Vice Chair Operations, Department of Radiology, Lahey Hospital and Medical Center, Burlington, MA
| | - Christoph Wald
- Chair, Department of Radiology, Lahey Hospital and Medical Center, Burlington, MA
| |
Collapse
|