Development of minimum data set and dashboard for monitoring adverse events in radiology departments

Background

To reduce the risk of errors, patient safety monitoring in the medical imaging department is crucial. Interventions are required and these can be provided as a framework for documenting, reporting, evaluating, and recognizing events that pose a threat to patient safety. The aim of this study was to develop minimum data set and dashboard for monitoring adverse events in radiology departments.

Material and methods

This developmental research was conducted in multiple phases, including content determination using the Delphi technique; database designing using SQL Server; user interface (UI) building using PHP; and dashboard evaluation in three aspects: the accuracy of calculating; UI requirements; and usability.

Results

This study identified 26 patient safety (PS) performance metrics and 110 PS-related significant data components organized into 14 major groupings as the system contents. The UI was built with three tabs: pre-procedure, intra-procedure, and post-procedure. The evaluation results proved the technical feasibility of the dashboard. Finally, the dashboard's usability was highly rated (76.3 out of 100).

Conclusion

The dashboard can be used to supplement datasets to obtain a more accurate picture of the PS condition and to draw attention to characteristics that professionals might otherwise overlook or undervalue.

Event-Based Learning and Improvement: Radiology's Move From Peer Review to Peer Learning

Over the past 15 years, the radiology community has made great progress moving from a system of score-based peer review to one of peer learning. Much has been learned along the way. In peer learning, cases in which learning opportunities are identified are reviewed solely for the purpose of fostering learning and improvement. This article defines peer learning and peer review and emphasizes the difference; looks back at the 20-year history of score-based peer review and transition to peer learning; outlines the problems with score-based peer review and the key elements of peer learning; discusses the current state of peer learning; and outlines future challenges and opportunities.

The Joint Commission's Ongoing Professional Practice Evaluation Process: Costly, Ineffective, and Potentially Harmful to Safety Culture

OBJECTIVE

To evaluate the estimated labor costs and effectiveness of Ongoing Professional Practice Evaluation (OPPE) processes at identifying outlier performers in a large sample of providers across multiple health care systems and to extrapolate costs and effectiveness nationally.

METHODS

Six hospital systems partnered to evaluate their labor expenses related to conducting OPPE. Estimates for mean labor hours and wages were created for the following: data analysts, medical staff office professionals, department physician leaders, and administrative assistants. The total number of outlier performers who were identified by OPPE metrics alone and that resulted in lack of renewal, limitation, or revoking of hospital privileges during the past annual OPPE cycle (2022) was recorded. National costs of OPPE were extrapolated. Literature review of the effect of OPPE on safety culture in radiology was performed.

RESULTS

The evaluated systems had 12,854 privileged providers evaluated by OPPE. The total estimated annual recurring labor cost per provider was $50.20. Zero of 12,854 providers evaluated were identified as outlier performers solely through the OPPE process. The total estimated annual recurring cost of administering OPPE nationally was $78.54 million. In radiology over the past 15 years, the use of error rates based on score-based peer review as an OPPE metric has been perceived as punitive and had an adverse effect on safety culture.

CONCLUSION

OPPE is expensive to administer, inefficient at identifying outlier performers, diverts human resources away from potentially more effective improvement work, and has been associated with an adverse impact on safety culture in radiology.

Transition from Peer Review to Peer Learning: Lessons Learned

Landmark publications, such as To Err is Human, confronted the healthcare community with the egregious toll medical errors played in both patient safety and overall healthcare costs. This heralded a paradigm shift and a call for action by professional organizations to enact methods to ensure physician competency and quality assurance. The American College of Radiology similarly convened a task force to discuss these concerns and how best to address quality assurance in radiology practice, leading to the development of RADPEER, a score-based peer review system. However, critics were quick to point out the deficiencies of this model, highlighting it as punitive and a poor evaluator of physician performance. The recognized deficiencies in score-based peer review prompted the pursuit of an alternate model that would instead emphasize learning and improvement. Peer learning was proposed and highlighted the necessity of an inclusive and collaborative environment where colleagues could discuss case errors as learning opportunities without fear of punitive consequence. This paper explores peer learning, its benefits and challenges, as well as how to identify specific learning opportunities by utilizing case examples.

Causes and diagnostic utility of musculoskeletal MRI recall examinations

AIM

To determine the causes and diagnostic utility of musculoskeletal (MSK) magnetic resonance imaging (MRI) recall examinations.

MATERIALS AND METHODS

An institutional review board-approved retrospective review was conducted of all MSK MRI examinations performed at a single academic institution over 10 years where radiologists requested the patient return for additional imaging. The reason for the recall was documented. Recalls were reviewed in consensus by two MSK radiologists to determine whether additional sequences resulted in a change in the final report. Recall causes were divided into four categories: (1) radiologist-related: incorrect field of view (FOV) or incorrect protocol; (2) technologist-related: incorrect FOV or incorrect/incomplete protocol performed, or technically poor-quality images; (3) patient-related motion artefact; (4) unexpected lesion discovered. Fisher's exact test was used to assess for statistical significance.

RESULTS

The recall rate was 0.25% (156/62,930). Of the total 129 recalls returning for imaging, 42 (33%) were radiologist-related, 45 (35%) were technologist-related, six (5%) were patient-related, and 36 (28%) had an unexpected lesion requiring additional sequences. For clinical utility, 42% resulted in a change from the initial report. Recalls due to radiologist error, incorrect FOV, or unexpected lesion caused a significant change in the final report; however, recalls due to technologist error, patient motion artefact, or incorrect protocol did not.

CONCLUSION

MRI MSK recalls are uncommon, and the most common reasons are incorrect FOV, incorrect protocol, and unexpected lesion. Radiologist-related errors in protocols and FOV led to a significant change in the final report and should be targeted as areas for improvement to reduce recall examinations.

Results of a Virtual Multi-Institutional Program for Quality Improvement Training and Project Facilitation

OBJECTIVE

The purpose of this project was to describe the results of a multi-institutional quality improvement (QI) program conducted in a virtual format.

METHODS

Developed at Stanford in 2016, the Realizing Improvement Through Team Empowerment program uses a team-based, project-based improvement approach to QI. The program was planned to be replicated at two other institutions through respective on-site programs but was converted to a multi-institutional virtual format in 2020 in response to the COVID-19 pandemic. The virtual program began in July 2020 and ended in December 2020. The two institutions participated jointly in the cohort, with 10 2-hour training sessions every 2 weeks for a total of 18 weeks. Project progress was monitored using a predetermined project progress scale by the program manager, who provided more direct project support as needed.

RESULTS

The cohort consisted of six teams (37 participants) from two institutions. Each team completed a QI project in subjects including MRI, ultrasound, CT, diagnostic radiography, and ACR certification. All projects reached levels of between 3.0 (initial test cycles begun with evidence of modest improvement) and 4.0 (performance data meeting goal and statistical process control criteria for improvement) and met graduation criteria for program completion.

DISCUSSION

We found the structured problem-solving method, along with timely focused QI education materials via a virtual platform, to be effective in simultaneously facilitating improvement projects from multiple institutions. The combination of two institutions fostered encouragement and shared learning across institutions.

Quality Assurance of a Cross-Border and Sub-Specialized Teleradiology Service

Background: The current literature discusses aspects of quality assurance (QA) and sub-specialization. However, the challenges of these topics in a teleradiology network have been less explored. In a project report, we aimed to review the development and enforcement of sub-specialized radiology at Telemedicine Clinic (TMC), one of the largest teleradiology providers in Europe, and to describe each step of its QA. Evaluation: The company-specific background was provided by the co-authors—current and former staff members of TMC. Detailed descriptions of the structures of sub-specialization and QA at TMC are provided. Exemplary quantitative evaluation of caseloads and disagreement rates of secondary reviews are illustrated. Description of Sub-specialization and Quality Assurance at TMC: Sub-specialization at TMC is divided into musculoskeletal radiology, neuroradiology, head and neck, a body, and an emergency section operating at local daytime in Europe and Australia. Quality assurance is based on a strict selection process of radiologists, specific reporting guidelines, feedback through the secondary reading of 100% of all radiology reports for new starters, and a minimum of 5% of radiology reports on a continuous basis for all other radiologists, knowledge sharing activities and ongoing training. The level of sub-specialization of each radiologist is monitored continuously on an individual basis in detail. After prospective secondary readings, the mean disagreement rate at TMC indicating at least possibly clinically relevant findings was 4% in 2021. Conclusion: With continuing and current developments in radiology in mind, the essential features of sub-specialization and innovative QA are relevant for further expansion of teleradiology services and for most radiology departments worldwide to respond to the increasing demand for value-based radiology.

Public Health Radiography: A Scoping Review of Benefits, and Growth Opportunities for Radiographers

INTRODUCTION

There is growing adoption of radiographic techniques in public health to improve outcomes of chronic and communicable diseases. This review examines the applications, benefits, and implications of radiography in public health. It also examines the challenges and potential advanced practice roles for radiographers in public health radiography (PHR).

METHODOLOGY

Preferred Reporting Items for Systematic Reviews and Meta-Analyses - Scoping review extension (PRISMA- ScR) checklist was employed, and the search was conducted using PubMed, Medline, Web of Science, ScienceDirect, and Google Scholar to identify relevant articles that explored the concept of radiography in public health. Evidence was analysed using an inductive iterative approach.

RESULTS

Radiographic imaging modalities such as ultrasound, computed tomography, and plain X-ray had wide applicability in public health fields of preventive cardiology, preventive oncology, maternal health, infectious disease epidemiology, and radiographic informatics. PHR effectively reduced mortality, improved outcomes, informed lifestyle changes to mitigate the risk of impending disease. PHR also helped in monitoring disease progression and predicting treatment outcomes. However, evidence establishing a competency framework that supports PHR is scarce.

CONCLUSION

Radiography makes a significant contribution to public health in reducing mortality and morbidity. Therefore, developing a PHR competency framework can accentuate the contribution Radiographers make to solving public health issues.

CIRSE Clinical Practice Manual

Background

Interventional radiology (IR) has come a long way to a nowadays UEMS-CESMA endorsed clinical specialty. Over the last decades IR became an essential part of modern medicine, delivering minimally invasive patient-focused care.

Purpose

To provide principles for delivering high quality of care in IR.

Methods

Systematic description of clinical skills, principles of practice, organizational standards and infrastructure needed for the provision of professional IR services.

Results

There are IR procedures for almost all body parts and organs, covering a broad range of medical conditions. In many cases IR procedures are the mainstay of therapy, e.g. in the treatment of hepatocellular carcinoma. In parallel the specialty moved from the delivery of a procedure towards taking care for a patient’s condition with the interventional radiologists taking ultimate responsibility for the patient’s outcomes.

Conclusions

The evolution from a technical specialty to a clinical specialty goes along with changing demands on how clinical care in IR is provided. The CIRSE Clinical Practice Manual provides interventional radiologist with a starting point for developing his or her IR practice as a clinician.

Establishing Quality and Safety in Hospital-based 3D Printing Programs: Patient-first Approach

The adoption of three-dimensional (3D) printing is rapidly spreading across hospitals, and the complexity of 3D-printed models and devices is growing. While exciting, the rapid growth and increasing complexity also put patients at increased risk for potential errors and decreased quality of the final product. More than ever, a strong quality management system (QMS) must be in place to identify potential errors, mitigate those errors, and continually enhance the quality of the product that is delivered to patients. The continuous repetition of the traditional processes of care, without insight into the positive or negative impact, is ultimately detrimental to the delivery of patient care. Repetitive tasks within a process can be measured, refined, and improved and translate into high levels of quality, and the same is true within the 3D printing process. The authors share their own experiences and growing pains in building a QMS into their 3D printing processes. They highlight errors encountered along the way, how they were addressed, and how they have strived to improve consistency, facilitate communication, and replicate successes. They also describe the vital intersection of health care providers, regulatory groups, and traditional manufacturers, who contribute essential elements to a common goal of providing quality and safety to patients. ©RSNA, 2021.

Handoffs in Radiology: Minimizing Communication Errors and Improving Care Transitions

Handoffs are essential to achieving safe care transitions. In radiology practice, frequent transitions of care responsibility among clinicians, radiologists, and patients occur between moments of care such as determining protocol, imaging, interpreting, and consulting. Continuity of care is maintained across these transitions with handoffs, which are the process of communicating patient information and transferring decision-making responsibility. As a leading cause of medical error, handoffs are a major communication challenge that is exceedingly common in both diagnostic and interventional radiology practice. The frequency of handoffs in radiology underscores the importance of using evidence-based strategies to improve patient safety in the radiology department. In this article, reliability science principles and handoff improvement tools are adapted to provide radiology-focused strategies at individual, team, and organizational levels with the goal of minimizing handoff errors and improving care transitions.

Consensus survey on pre-procedural safety practices in radiological examinations: a multicenter study in seven Asian regions

OBJECTIVE

To understand the status of pre-procedural safety practices in radiological examinations at radiology residency training institutions in various Asian regions.

METHODS

A questionnaire based on the Joint Commission International Accreditation Standards was electronically sent to 3 institutions each in 10 geographical regions across 9 Asian countries. Questions addressing 45 practices were divided into 3 categories. A five-tier scale with numerical scores was used to evaluate safety practices in each institution. Responses obtained from three institutions in the United States were used to validate the execution rate of each surveyed safety practice.

RESULTS

The institutional response rate was 70.0% (7 Asian regions, 21 institutions). 44 practices (all those surveyed except for the application of wrist tags for identifying patients with fall risks) were validated using the US participants. Overall, the Asian participants reached a consensus on 89% of the safety practices. Comparatively, most Asian participants did not routinely perform three pre-procedural practices in the examination appropriateness topic.

CONCLUSION

Based on the responses from 21 participating Asian institutions, most routinely perform standard practices during radiological examinations except when it comes to examination appropriateness. This study can provide direction for safety policymakers scrutinizing and improving regional standards of care.

ADVANCES IN KNOWLEDGE

This is the first multicenter survey study to elucidate pre-procedural safety practices in radiological examinations in seven Asian regions.

Reducing Errors in Radiology Specimen Labeling Through Use of a Two-person Check

Improper specimen labeling of biopsy samples can cause substantial harm to patients through diagnostic delays, administration of inappropriate treatments, and can result in a loss of trust in the healthcare system. Specimen labeling errors are considered a relevant safety metric in our department and tracked on a rolling basis. One imaging section was noted to have nearly completely eliminated these errors through implementation of a 2-person check prior to submission to pathology. The purpose of this intervention was to identify the causes of continued specimen labeling errors in radiology and to standardize the specimen labeling workflow across the department of radiology to include the best practice identified in breast imaging utilizing a 2-person check. Preintervention, 31 specimen labeling errors were reported by the procedural staff over a period of 149 weeks resulting in an error rate of 0.21 errors per week. Postintervention, 3 specimen labeling errors occurred in the next 46 weeks resulting in a rate of 0.07 errors per week, a 68.8% decrease in the specimen labeling error rate. This quality improvement project highlights the process flaws which contribute to medical errors and demonstrates a potential pathway to try and reduce these errors and patient harm without significant investment in capital or new technology.

Acing the Joint Commission Regulatory Visit: Running an Effective and Compliant Safety Program

Ensuring the safety of patients and staff is a core effort of all health care organizations. Many regulatory agencies, from The Joint Commission to the Occupational Safety and Health Administration, provide policies and guidelines, with relevant metrics to be achieved. Data on safety can be obtained through a variety of mechanisms, including gemba walks, team discussion during safety huddles, audits, and individual employee entries in safety reporting systems. Data can be organized on a scorecard that provides an at-a-glance view of progress and early warning signs of practice drift. In this article, relevant policies are outlined, and instruction on how to achieve compliance with national patient safety goals and regulations that ensure staff safety and Joint Commission ever-readiness are described. Additional critical components of a safety program, such as department commitment, a just culture, and human factors engineering, are discussed. ^©RSNA, 2018.

Vision to improve: quality improvement in ophthalmology

Improving quality of care and patient outcomes is a professional duty of all health care workers. Quality improvement is a part of health policy, an accreditation requirement of residency programs, and a recognized sub-specialty in academic medicine. Given the increasing need for ophthalmological services with our aging population, it is critical for ophthalmologists and their staff to develop the necessary skills in quality improvement to ensure access to care that is safe, patient-centered, effective, efficient, equitable, and timely. This narrative review outlines tools that are used in a recognized framework, including the creation of an aim statement, Ishikawa diagram, Pareto analysis, process maps, Plan-Do-Study-Act cycles, and run charts. We also discuss common challenges that occur when conducting quality initiatives. Two quality improvement projects conducted in the Department of Ophthalmology at University of Toronto are used as examples to illustrate these tools. The aim of the first project was to improve visual field test reliability and the aim of the second was to ensure secure email communication between residents and staff in caring for emergency patients. This primer provides the foundations ophthalmologists and their staff can use to support and guide their quality improvement efforts.

Accreditation, Credentialing, and Quality Improvement in Diagnostic Medical Sonography: A Literature Review

There are few regulations regarding facility accreditation and individual credentialing in diagnostic medical sonography (DMS), although it is known that the quality of examinations in the field can vary based by the operator. This literature review summarizes the findings from 19 research studies on accreditation, credentialing, and quality improvement and includes illustrative quotes from 23 position papers and 42 editorials. The review uncovered large differences in facility accreditation status based on sonography specialty and geographical area. The findings included many examples of positive correlations between accreditation and improved quality and also a positive correlation between credentialing and improved image quality. The survey studies revealed overwhelming support for accreditation and credentialing. Many articles raised concerns about the unknown quality of sonograms performed in nonaccredited facilities or by uncredentialed sonographers. If facility accreditation and/or individual credentialing could be implemented nationwide in DMS, it may lead to increased quality within the field.

Improving the quality of radiological examinations: effectiveness of an internal participatory approach

Quality problem or issue

To assess the quality of radiological examinations (REs) and to evaluate the effectiveness of a participatory continuous improvement approach to ensure best practices in a Portuguese hospital imaging department.

Initial assessment

At baseline, we found 232 (10.2%) non-compliances, mostly related to the criteria image centering and framing in chest radiography (CXR), proper use of radiological protection equipment in other conventional RE (CR) and X-ray beam collimation (CXR/CR).

Choice of solution

A baseline and three consecutive evaluations of the RE quality were conducted. Each assessment was followed by participatory focused interventions for improvement.

Implementation

For each evaluation, we selected a random sample (n = 60) of cases for four types of examination (total n = 240 for each assessment, and 960 for the whole project). Both the building of quality criteria and the design of interventions for improvement were participatory, involving the radiology technicians. Estimates of criteria compliance were calculated with 95% confidence intervals. The statistical significance of absolute and relative improvements was tested using one-tail z-tests.

Evaluation

After the intervention, non-compliances decreased to 48 (2.1%). Compliance estimates improved in 25 of 38 criteria assessed, with statistical significance for 5 criteria in CXR and 3 in CR and digestive examination.

Lessons learned

The internal participatory approach enabled the identification of existing quality problems and, by focusing on the more frequent quality defects, was effective in improving the quality of RE.

A Comprehensive Approach Towards Quality and Safety in Diagnostic Imaging Services: Our Experience at a Rural Tertiary Health Care Center

INTRODUCTION

An organization's transformation from imple-mentation of small, distinct Quality Improvement (QI) efforts to complete incorporation of Quality Improvement Program (QIP) into its culture occurs through a process of churning the foundational elements over time.

AIM

To develop a quality culture across the employees, identify measurable indicators and various tools to impart effective quality care and develop a learning culture for continuous quality improvement in the field of imaging services.

MATERIALS AND METHODS

To establish a QIP, the bare minimum requirement started with forming a quality committee. The committee identified the areas of improvement and ascertaining the core principle of Quality Management System (QMS) by having a Quality Manual, Standard Operating Procedures (SOP's), work-instructions, identification and monitoring of quality indicators and a training calendar. Appropriate tools like formatted daily registers, periodic check lists, run charts etc., were developed to collect the data followed by multiple PDSA cycles (Plan, Do, Study and Act) which helped identify the process bottlenecks, followed by implementing solutions and reanalysis.

RESULTS

A total of 17 measurable key performance indicators were identified from the four major quality tasks namely Safety, Process Improvement, Professional Outcome and Satisfaction, to assess the performance measures and targets of QIP.

CONCLUSION

Diagnostic services should evaluate how to choose the most appropriate method and develop a comprehensive QIP to meet the needs of the staff and the end users, thus, creating a working environment, where people constitutes the intrinsic value in attaining the ultimate quality and safety.

Implementation of a Point-of-Care Radiologist-Technologist Communication Tool in a Quality Assurance Program

OBJECTIVE

We implemented an Image Quality Reporting and Tracking Solution (IQuaRTS), directly linked from the PACS, to improve communication between radiologists and technologists.

MATERIALS AND METHODS

IQuaRTS launched in May 2015. We compared MRI issues filed in the period before IQuaRTS implementation (May-September 2014) using a manual system with MRI issues filed in the IQuaRTS period (May-September 2015). The unpaired t test was used for analysis. For assessment of overall results in the IQuaRTS period alone, all issues filed across all modalities were included. Summary statistics and charts were generated using Excel and Tableau.

RESULTS

For MRI issues, the number of issues filed during the IQuaRTS period was 498 (2.5% of overall MRI examination volume) compared with 78 issues filed during the period before IQuaRTS implementation (0.4% of total examination volume) (p = 0.0001), representing a 625% relative increase. Tickets that documented excellent work were 8%. Other issues included images not pushed to PACS (20%), film library issues (19%), and documentation or labeling (8%). Of the issues filed, 55% were MRI-related and 25% were CT-related. The issues were stratified across six sites within our institution. Staff requiring additional training could be readily identified, and 80% of the issues were resolved within 72 hours.

CONCLUSION

IQuaRTS is a cost-effective online issue reporting tool that enables robust data collection and analytics to be incorporated into quality improvement programs. One limitation of the system is that it must be implemented in an environment where staff are receptive to quality improvement.

Radiology Workflow Dynamics: How Workflow Patterns Impact Radiologist Perceptions of Workplace Satisfaction

RATIONALE AND OBJECTIVES

The study aimed to assess perceptions of reading room workflow and the impact separating image-interpretive and nonimage-interpretive task workflows can have on radiologist perceptions of workplace disruptions, workload, and overall satisfaction.

MATERIALS AND METHODS

A 14-question survey instrument was developed to measure radiologist perceptions of workplace interruptions, satisfaction, and workload prior to and following implementation of separate image-interpretive and nonimage-interpretive reading room workflows. The results were collected over 2 weeks preceding the intervention and 2 weeks following the end of the intervention. The results were anonymized and analyzed using univariate analysis.

RESULTS

A total of 18 people responded to the preintervention survey: 6 neuroradiology fellows and 12 attending neuroradiologists. Fifteen people who were then present for the 1-month intervention period responded to the postintervention survey. Perceptions of workplace disruptions, image interpretation, quality of trainee education, ability to perform nonimage-interpretive tasks, and quality of consultations (P < 0.0001) all improved following the intervention. Mental effort and workload also improved across all assessment domains, as did satisfaction with quality of image interpretation and consultative work.

CONCLUSION

Implementation of parallel dedicated image-interpretive and nonimage-interpretive workflows may improve markers of radiologist perceptions of workplace satisfaction.

Radiology Research in Quality and Safety: Current Trends and Future Needs

Promoting quality and safety research is now essential for radiology as reimbursement is increasingly tied to measures of quality, patient safety, efficiency, and appropriateness of imaging. This article provides an overview of key features necessary to promote successful quality improvement efforts in radiology. Emphasis is given to current trends and future opportunities for directing research. Establishing and maintaining a culture of safety is paramount to organizations wishing to improve patient care. The correct culture must be in place to support quality initiatives and create accountability for patient care. Focused educational curricula are necessary to teach quality and safety-related skills and behaviors to trainees, staff members, and physicians. The increasingly complex healthcare landscape requires that organizations build effective data infrastructures to support quality and safety research. Incident reporting systems designed specifically for medical imaging will benefit quality improvement initiatives by identifying and learning from system errors, enhancing knowledge about safety, and creating safer systems through the implementation of standardized practices and standards. Finally, validated performance measures must be developed to accurately reflect the value of the care we provide for our patients and referring providers. Common metrics used in radiology are reviewed with focus on current and future opportunities for investigation.

The Daily Readiness Huddle: a process to rapidly identify issues and foster improvement through problem-solving accountability

BACKGROUND

Because of the increasing complexities of providing imaging for pediatric health care services, a more reliable process to manage the daily delivery of care is necessary. Objective We describe our Daily Readiness Huddle and the effects of the process on problem identification and improvement.

MATERIALS AND METHODS

Our Daily Readiness Huddle has four elements: metrics review, clinical volume review, daily readiness assessment, and problem accountability. It is attended by radiologists, directors, managers, front-line staff with concerns, representatives from support services (information technology [IT] and biomedical engineering [biomed]), and representatives who join the meeting in a virtual format from off-site locations. Data are visually displayed on erasable whiteboards. The daily readiness assessment uses queues to determine whether anyone has concerns or outlier data in regard to S-MESA (Safety, Methods, Equipment, Supplies or Associates). Through this assessment, problems are identified and categorized as quick hits (will be resolved in 24-48 h, not requiring project management) and complex issues. Complex issues are assigned an owner, quality coach and report-back date. Additionally, projects are defined as improvements that are often strategic, are anticipated to take more than 60 days, and do not necessarily arise out of identified issues during the Daily Readiness Huddle. We tracked and calculated the mean, median and range of days to resolution and completion for complex issues and for projects during the first full year of implementing this process.

RESULTS

During the first 12 months, 91 complex issues were identified and resolved, 11 projects were in progress and 33 completed, with 23 other projects active or in planning. Time to resolution of complex issues (in days) was mean 37.5, median 34.0, and range 1-105. For projects, time to completion (in days) was mean 86.0, median 84.0, and range 5-280.

CONCLUSION

The Daily Readiness Huddle process has given us a framework to rapidly identify issues, bring accountability to problem-solving, and foster improvement. It has also had a positive effect on team-building and coordination.

Patient safety during radiological examinations: a nationwide survey of residency training hospitals in Taiwan

OBJECTIVES

Variations in radiological examination procedures and patient load lead to variations in standards of care related to patient safety and healthcare quality. To understand the status of safety measures to protect patients undergoing radiological examinations at residency training hospitals in Taiwan, a follow-up survey evaluating the full spectrum of diagnostic radiology procedures was conducted.

DESIGN

Questionnaires covering 12 patient safety-related themes throughout the examination procedures were mailed to the departments of diagnostic radiology with residency training programmes in 19 medical centres (with >500 beds) and 17 smaller local institutions in Taiwan. After receiving the responses, all themes in 2014 were compared between medical centres and local institutions by using χ(2) or 2-sample t-tests.

PARTICIPANTS

Radiology Directors or Technology Chiefs of medical centres and local institutions in Taiwan participated in this survey by completing and returning the questionnaires.

RESULTS

The response rates of medical centres and local institutions were 95% and 100%, respectively. As indicated, large medical centres carried out more frequent clinically ordered, radiologist-guided patient education to prepare patients for specific examinations (CT, 28% vs 6%; special procedures, 78% vs 44%) and incident review and analysis (89% vs 47%); however, they required significantly longer access time for MRI examinations (7.00±29.50 vs 3.50±3.50 days), had more yearly incidents of large-volume contrast-medium extravasation (2.75±1.00 vs 1.00±0.75 cases) and blank radiographs (41% vs 8%), lower monthly rates of suboptimal (but interpretable) radiographs (0.00±0.01% vs 0.64±1.84%) and high-risk reminder reporting (0.01±0.16% vs 1.00±1.75%) than local institutions.

CONCLUSIONS

Our study elucidates the status of patient safety in diagnostic radiology in Taiwan, thereby providing helpful information to improve patient safety guidelines needed for medical imaging in the future.

Pediatric interventional radiology clinic - how are we doing?

BACKGROUND

Development of a pediatric interventional radiology clinic is a necessary component of providing a pediatric interventional radiology service. Patient satisfaction is important when providing efficient, high-quality care.

OBJECTIVE

To analyze the care provided by a pediatric interventional radiology clinic from the perspective of efficiency and parent satisfaction, so as to identify areas for improvement.

MATERIALS AND METHODS

The prospective study was both quantitative and qualitative. The quantitative component measured clinic efficiency (waiting times, duration of clinic visit, nurse/physician time allocation and assessments performed; n = 91). The qualitative component assessed parental satisfaction with their experience with the pediatric interventional radiology clinic, using a questionnaire (5-point Likert scale) and optional free text section for feedback (n = 80). Questions explored the family's perception of relevance of information provided, consent process and overall satisfaction with their pediatric interventional radiology clinic experience.

RESULTS

Families waited a mean of 11 and 10 min to meet the physician and nurse, respectively. Nurses and physicians spent a mean of 28 and 21 min with the families, respectively. The average duration of the pediatric interventional radiology clinic consultation was 56 min. Of 80 survey participants, 83% were satisfied with their experience and 94% said they believed providing consent before the day of the procedure was helpful. Only 5% of respondents were not satisfied with the time-efficiency of the interventional radiology clinic.

CONCLUSION

Results show the majority of patients/parents are very satisfied with the pediatric interventional radiology clinic visit. The efficiency of the pediatric interventional radiology clinic is satisfactory; however, adherence to stricter scheduling can be improved.

Performance results for a workstation-integrated radiology peer review quality assurance program

OBJECTIVE

To assess review completion rates, RADPEER score distribution, and sources of disagreement when using a workstation-integrated radiology peer review program, and to evaluate radiologist perceptions of the program.

DESIGN

Retrospective review of prospectively collected data.

SETTING

Large private outpatient radiology practice.

PARTICIPANTS

Radiologists (n = 66) with a mean of 16.0 (standard deviation, 9.2) years of experience.

INTERVENTIONS

Prior studies and reports of cases being actively reported were randomly selected for peer review using the RADPEER scoring system (a 4-point scale, with a score of 1 indicating agreement and scores of 2-4 indicating increasing levels of disagreement).

MAIN OUTCOME MEASURES

Assigned peer review completion rates, review scores, sources of disagreement and radiologist survey responses.

RESULTS

Of 31 293 assigned cases, 29 044 (92.8%; 95% CI 92.5-93.1%) were reviewed. Discrepant scores (score = 2, 3 or 4) were given in 0.69% (95% CI 0.60-0.79%) of cases and clinically significant discrepancy (score = 3 or 4) was assigned in 0.42% (95% CI 0.35-0.50%). The most common cause of disagreement was missed diagnosis (75.2%; 95% CI 66.8-82.1%). By anonymous survey, 94% of radiologists felt that peer review was worthwhile, 90% reported that the scores they received were appropriate and 78% felt that the received feedback was valuable.

CONCLUSION

Workstation-based peer review can increase completion rates and levels of radiologist acceptance while producing RADPEER scores similar to those previously reported. This approach may be one way to increase radiologist engagement in peer review quality assurance.

A data-driven approach for quality assessment of radiologic interpretations

Given the increasing emphasis on delivering high-quality, cost-efficient healthcare, improved methodologies are needed to measure the accuracy and utility of ordered diagnostic examinations in achieving the appropriate diagnosis. Here, we present a data-driven approach for performing automated quality assessment of radiologic interpretations using other clinical information (e.g., pathology) as a reference standard for individual radiologists, subspecialty sections, imaging modalities, and entire departments. Downstream diagnostic conclusions from the electronic medical record are utilized as "truth" to which upstream diagnoses generated by radiology are compared. The described system automatically extracts and compares patient medical data to characterize concordance between clinical sources. Initial results are presented in the context of breast imaging, matching 18 101 radiologic interpretations with 301 pathology diagnoses and achieving a precision and recall of 84% and 92%, respectively. The presented data-driven method highlights the challenges of integrating multiple data sources and the application of information extraction tools to facilitate healthcare quality improvement.

Active Learning in Context-Driven Stream Mining With an Application to Image Mining

We propose an image stream mining method in which images arrive with contexts (metadata) and need to be processed in real time by the image mining system (IMS), which needs to make predictions and derive actionable intelligence from these streams. After extracting the features of the image by preprocessing, IMS determines online the classifier to use on the extracted features to make a prediction using the context of the image. A key challenge associated with stream mining is that the prediction accuracy of the classifiers is unknown, since the image source is unknown; thus, these accuracies need to be learned online. Another key challenge of stream mining is that learning can only be done by observing the true label, but this is costly to obtain. To address these challenges, we model the image stream mining problem as an active, online contextual experts problem, where the context of the image is used to guide the classifier selection decision. We develop an active learning algorithm and show that it achieves regret sublinear in the number of images that have been observed so far. To further illustrate and assess the performance of our proposed methods, we apply them to diagnose breast cancer from the images of cellular samples obtained from the fine needle aspirate of breast mass. Our findings show that very high diagnosis accuracy can be achieved by actively obtaining only a small fraction of true labels through surgical biopsies. Other applications include video surveillance and video traffic monitoring.

Imaging in the Age of Precision Medicine: Summary of the Proceedings of the 10th Biannual Symposium of the International Society for Strategic Studies in Radiology

During the past decade, with its breakthroughs in systems biology, precision medicine (PM) has emerged as a novel health-care paradigm. Challenging reductionism and broad-based approaches in medicine, PM is an approach for disease treatment and prevention that takes into account individual variability in genes, environment, and lifestyle. It involves integrating information from multiple sources in a holistic manner to achieve a definitive diagnosis, focused treatment, and adequate response assessment. Biomedical imaging and imaging-guided interventions, which provide multiparametric morphologic and functional information and enable focused, minimally invasive treatments, are key elements in the infrastructure needed for PM. The emerging discipline of radiogenomics, which links genotypic information to phenotypic disease manifestations at imaging, should also greatly contribute to patient-tailored care. Because of the growing volume and complexity of imaging data, decision-support algorithms will be required to help physicians apply the most essential patient data for optimal management. These innovations will challenge traditional concepts of health care and business models. Reimbursement policies and quality assurance measures will have to be reconsidered and adapted. In their 10th biannual symposium, which was held in August 2013, the members of the International Society for Strategic Studies in Radiology discussed the opportunities and challenges arising for the imaging community with the transition to PM. This article summarizes the discussions and central messages of the symposium.

Impact of an electronic alert notification system embedded in radiologists' workflow on closed-loop communication of critical results: a time series analysis

INTRODUCTION

Optimal critical test result communication is a Joint Commission national patient safety goal and requires documentation of closed-loop communication among care providers in the medical record. Electronic alert notification systems can facilitate an auditable process for creating alerts for transmission and acknowledgement of critical test results. We evaluated the impact of a patient safety initiative with an alert notification system on reducing critical results lacking documented communication, and assessed potential overuse of the alerting system for communicating results.

METHODS

We implemented an alert notification system-Alert Notification of Critical Results (ANCR)-in January 2010. We reviewed radiology reports finalised in 2009-2014 which lacked documented communication between the radiologist and another care provider, and assessed the impact of ANCR on the proportion of such reports with critical findings, using trend analysis over 10 semiannual time periods. To evaluate potential overuse of ANCR, we assessed the proportion of reports with non-critical results among provider-communicated reports.

RESULTS

The proportion of reports with critical results among reports without documented communication decreased significantly over 4 years (2009-2014) from 0.19 to 0.05 (p<0.0001, Cochran-Armitage trend test). The proportion of provider-communicated reports with non-critical results remained unchanged over time before and after ANCR implementation (0.20 to 0.15, p=0.45, Cochran-Armitage trend test).

CONCLUSIONS

A patient safety initiative with an alert notification system reduced the proportion of critical results among reports lacking documented communication between care providers. We observed no change in documented communication of non-critical results, suggesting the system did not promote overuse. Future studies are needed to evaluate whether such systems prevent subsequent patient harm.

Peer Review: Lessons Learned in A Pediatric Radiology Department

The purpose of this article is to illustrate types of diagnostic errors and feedback given to radiologists, using cases to support and clarify these categories. A comment-enhanced peer review system may be leveraged to generate a comprehensive feedback categorization scheme. These include errors of observation, errors of interpretation, inadequate patient data gathering, errors of communication, interobserver variability, informational feedback, and compliments. Much of this feedback is captured through comments associated with interpretative agreements.

Four-year impact of an alert notification system on closed-loop communication of critical test results

OBJECTIVE

One of the patient safety goals proposed by the Joint Commission urges hospitals to develop a policy for communicating critical test results and to measure adherence to that policy. We evaluated the impact of an alert notification system on policy adherence for communicating critical imaging test results to referring providers and assessed system adoption over the first 4 years after implementation.

MATERIALS AND METHODS

This study was performed in a 753-bed academic medical center. The intervention, an automated alert notification system for critical results, was implemented in January 2010. The primary outcome was adherence to institutional policy for timely closed-loop communication of critical imaging results, and the secondary outcome was system adoption. Policy adherence was determined through manual review of a random sample of radiology reports from the first 4 years after the intervention (n = 37,604) compared with baseline outcomes 1 year before the intervention (n = 9430). Adoption was evaluated by quantifying the use of the system overall and the proportion of alerts that used noninterruptive communication as a percentage of all reports generated by 320 radiologists (n = 1,538,059). A statistical analysis of the trend at 6-month intervals over 4 years was performed using a chi-square trend test.

RESULTS

Adherence to the policy increased from 91.3% before the intervention to 95.0% after the intervention (p < 0.0001). There was a ninefold increase in the critical results communicated via the system (chi-square trend test, p < 0.0001). During the first 4 years after the intervention, 41,445 alerts (41% of the total number of alerts) used the system's noninterruptive process for communicating less urgent critical results, which was substantially unchanged over the 4 years postintervention, thus reducing unnecessary paging interruptions.

CONCLUSION

An automated alert notification system for communicating critical imaging results was successfully adopted and was associated with increased adherence to institutional policy for communicating critical test results and with reduced workflow interruptions.

Journal club: Renal masses detected at abdominal CT: radiologists' adherence to guidelines regarding management recommendations and communication of critical results

OBJECTIVE

The purpose of this study was to assess radiologists' adherence to published guidelines for managing renal masses detected at abdominal CT at one institution and to a critical results communication policy.

MATERIALS AND METHODS

A validated natural language processing tool supplemented by manual review was used to randomly assemble a cohort of 97 radiology reports from all abdominal CT reports (n = 11,952) generated from July 2010 to June 2011. Critical renal mass findings warranted consideration for surgery, intervention, or imaging follow-up and required direct, separate, and timely communication to the referrer in addition to the radiology report. Primary outcomes were adherence to guidelines and institutional policy for communicating critical results. Sample size allowed a 95% CI ± 5% for primary outcome. Pearson chi-square test was performed to assess whether radiology subspecialization was predictive of the primary outcome.

RESULTS

Of all abdominal CT reports, 35.6% contained at least one renal mass finding (4.3% critical). Guideline adherence was lower for patients with critical than for those with noncritical findings (48/57 [84.2%] vs 40/40 [100%]; p = 0.01). Adherence to critical result communication policy was 73.7% (42/57). For critical findings, abdominal radiologists had higher guideline adherence (40/43 [93.0%] vs 8/14 [57.1%]; p = 0.001) and critical result communication policy adherence (36/43 [83.7%] vs 6/14 [42.9%]; p = 0.002) than nonabdominal radiologists.

CONCLUSION

In reporting renal masses detected at abdominal CT, radiologists largely adhered to management guidelines but did not adhere to the critical results communication policy in one of four reports. Subspecialization improved adherence to both management guidelines and the institution's critical result communication policy.