Quality initiatives: Key performance indicators for measuring and improving radiology department performance

Precision Workforce Management for Radiographers: Monitoring and Managing Competences with an Automatic Tool

Optimizing work shifts in healthcare is crucial for maintaining high standards of service delivery and fostering professional development. This study delves into the emerging field of skill-oriented work shift optimization, focusing specifically on radiographers within the healthcare sector. Through the development of Skills Retention Monitoring (SRH), this research aims to enhance skill monitoring, workload management, and organizational performance. In this study, several key highlights emerged: (a) Introduction of the SRH tool: The SRH tool represents a resource-efficient solution that harnesses existing software infrastructure. A preliminary version, focusing on the radiographers' professional profile, was released, and after several months of use, it demonstrated effectiveness in optimizing work based on competency monitoring. (b) The SRH tool has thus demonstrated the capacity to generate actionable insights in the organizational context of radiographers. By generating weekly reports, the SRH tool streamlines activity management and optimizes resource allocation within healthcare settings. (c) Application of a Computer-Assisted Web Interviewing (CAWI) tool for pre-release feedback during a training event. (d) Strategic importance of a maintenance and monitoring plan: This plan, rooted in a continuous quality improvement approach and key performance indicators, ensures the sustained effectiveness of the SRH tool. (e) Strategic importance of a transfer plan: Involving professional associations and employing targeted questionnaires, this plan ensures the customization of the tool from the perspective of each profession involved. This is a crucial point, as it will enable the release of tool versions tailored to various professions operating within the hospital sector. As a side result, the tool could allow for a more tailored and personalized medicine both by connecting the insights gathered through the SRH tool with the right competencies for healthcare professionals and with individual patient data. This integration could lead to better-informed decision making, optimizing treatment strategies based on both patient needs and the specific expertise of the healthcare provider. Future directions include deploying the SRH tool within the Pisa hospital network and exploring integration with AI algorithms for further optimization. Overall, this research contributes to advancing work shift optimization strategies and promoting excellence in healthcare service delivery.

Development of minimum data set and dashboard for monitoring adverse events in radiology departments

Background

To reduce the risk of errors, patient safety monitoring in the medical imaging department is crucial. Interventions are required and these can be provided as a framework for documenting, reporting, evaluating, and recognizing events that pose a threat to patient safety. The aim of this study was to develop minimum data set and dashboard for monitoring adverse events in radiology departments.

Material and methods

This developmental research was conducted in multiple phases, including content determination using the Delphi technique; database designing using SQL Server; user interface (UI) building using PHP; and dashboard evaluation in three aspects: the accuracy of calculating; UI requirements; and usability.

Results

This study identified 26 patient safety (PS) performance metrics and 110 PS-related significant data components organized into 14 major groupings as the system contents. The UI was built with three tabs: pre-procedure, intra-procedure, and post-procedure. The evaluation results proved the technical feasibility of the dashboard. Finally, the dashboard's usability was highly rated (76.3 out of 100).

Conclusion

The dashboard can be used to supplement datasets to obtain a more accurate picture of the PS condition and to draw attention to characteristics that professionals might otherwise overlook or undervalue.

Development of Quality Indicators for the Ultrasound Department through a Modified Delphi Method

This study aims to establish precise quality indicators for evaluating and enhancing ultrasound performance, employing a methodology based on a comprehensive review of the literature, expert insights, and practical application experiences. We conducted a thorough review of both the domestic and international literature on ultrasound quality control to identify potential indicators. A dedicated team was formed to oversee the complete indicator development process. Utilizing a three-round modified Delphi method, we sought expert opinions through personalized email correspondence. Subsequently, data from diverse hospital indicators were collected to validate and assess feasibility. A novel set of seven indicators was compiled initially, followed by the convening of a 36-member nationally representative expert panel. After three rounds of meticulous revisions, consensus was reached on 13 indicators across three domains. These finalized indicators underwent application in various hospital settings, demonstrating their initial validity and feasibility. The development of thirteen ultrasound quality indicators represents a significant milestone in evaluating ultrasound performance. These indicators empower hospitals to monitor changes in quality effectively, fostering efficient quality management practices.

Impact of a Targeted Project for Shortening of Imaging Diagnostic Waiting Time in Patients with Suspected Oncological Diseases in Hungary

Background and Objectives: Medical imaging is a key element in the clinical workup of patients with suspected oncological disease. In Hungary, due to the high number of patients, waiting lists for Computed Tomography (CT) and Magnetic Resonance Imaging (MRI) were created some years ago. The Municipality of Budapest and Semmelweis University signed a cooperation agreement with an extra budget in 2020 (HBP: Healthy Budapest Program) to reduce the waiting lists for these patients. The aim of our study was to analyze the impact of the first experiences with the HBP. Material and Methods: The study database included all the CT/MRI examinations conducted at Semmelweis University with a referral diagnosis of suspected oncological disease within the first 13 months of the HBP (6804 cases). In our retrospective, two-armed, comparative clinical study, different components of the waiting times in the oncology diagnostics pathway were analyzed. Using propensity score matching, we compared the data of the HBP-funded patients (n = 450) to those of the patients with regular care provided by the National Health Insurance Fund (NHIF) (n = 450). Results: In the HBP-funded vs. the NHIF-funded patients, the time interval from the first suspicion of oncological disease to the request for imaging examinations was on average 15.2 days shorter (16.1 vs. 31.3 days), and the mean waiting time for the CT/MRI examination was reduced by 13.0 days (4.2 vs. 17.2 days, respectively). In addition, the imaging medical records were prepared on average 1.7 days faster for the HBP-funded patients than for the NHIF-funded patients (3.4 vs. 5.1 days, respectively). No further shortening of the different time intervals during the subsequent oncology diagnostic pathway (histological investigation and multidisciplinary team decision) or in the starting of specific oncological therapy (surgery, irradiation, and chemotherapy) was observed in the HBP-funded vs. the NHIF-funded patients. We identified a moderately strong negative correlation (r = -0.5736, p = 0.0350) between the CT/MR scans requested and the active COVID-19 case rates during the pandemic waves. Conclusion: The waiting lists for diagnostic CT/MR imaging can be effectively shortened with a targeted project, but a more comprehensive intervention is needed to shorten the time from the radiological diagnosis, through the decisions of the oncoteam, to the start of the oncological treatment.

Applying the Balanced Scorecard to Build Service Performance Measurements of Medical Institutions: An AHP-DEMATEL Approach

The main purpose of this study is to explore the application of the balanced scorecard (BSC) to service performance measurements of medical institutions using the analytic hierarchy process (AHP) and decision making and trial evaluation laboratory (DEMATEL). According to the concept of BSC, a total of four evaluation dimensions and twenty-two indicators of medical service performance measurements were developed. To collect data, this study delivered expert questionnaires to medical-related professional supervisors, deans, and heads of medical institutions in Taiwan. By combining the AHP and DEMATEL, the priority and causality of service performance standards in medical institutions were obtained. The results of this study show that the customer dimension is the most important service performance measurement dimension for medical institutions. The seven key service performance measurement indicators that are most important for medical institutions, in order, are "complete and comfortable equipment", "competitiveness of the medical profession", "continuity of patient-to-hospital treatment", "classification of medical profession according to customers (VIP system)", "complete medical service", "complete salary, remuneration, and policy", and "medical incomes of institutions". In terms of causality, provided the complete services of medical institutions are improved, the continuity of patient-to-hospital treatment, the competitiveness of the medical profession, and the medical incomes of institutions would be influenced.

Observational Trends in Publicly Reported Quality Measures of Hospital Outpatient Quality Reporting Program, 2013-2019

In 2011, the Centers for Medicare & Medicaid Services (CMS) implemented the Hospital Outpatient Quality Reporting Program to assess the quality of outpatient imaging efficiency (OIE). In this study, trends in hospital performance on these national hospital OIE measures a year after inception and public reporting were described. An observational trend analysis was conducted using 2013-2019 data from CMS 6 OIE measures. The trend analysis of metric scores indicates year-to-year variability in all 6 OIE variables. The reporting of these measures appears to have effectively improved the efficiency of most of the measures since the inception of the program.

Assessing Hospital Resource Utilization with Application to Imaging for Patients Diagnosed with Prostate Cancer

Resource utilization measures are typically modeled by relying on clinical characteristics. However, in some settings, those clinical markers are not available, and hospitals are unable to explore potential inefficiencies or resource misutilization. We propose a novel approach to exploring misutilization that solely relies on administrative data in the form of patient characteristics and competing resource utilization, with the latter being a novel addition. We demonstrate this approach in a 2019 patient cohort diagnosed with prostate cancer (n = 51,111) across 1056 U.S. healthcare facilities using Premier, Inc.’s (Charlotte, NC, USA) all payor databases. A multivariate logistic regression model was fitted using administrative information and competing resources utilization. A decision curve analysis informed by industry average standards of utilization allows for a definition of misutilization with regards to these industry standards. Odds ratios were extracted at the patient level to demonstrate differences in misutilization by patient characteristics, such as race; Black individuals experienced higher under-utilization compared to White individuals (p < 0.0001). Volume-adjusted Poisson rate regression models allow for the identification and ranking of facilities with large departures in utilization. The proposed approach is scalable and easily generalizable to other diseases and resources and can be complemented with clinical information from electronic health record information, when available.

Key Performance Indicators for Quality Imaging Practice: Why, What, and How

A common trend across health care organizations is the development of key performance indicators (KPIs) for characterizing quality, identifying areas in need of change, and quantifying the impact of change. This article outlines a list of KPIs that can be used to quantify, target, and optimize value and value delivery in medical imaging practice. Of particular focus here is the aspect of practice that should be overseen and informed by the work of medical physicists, along the trajectory and expectations of a Medical Physics 3.0 model. The authors offer a framework for developing site-specific KPIs and several demonstrative clinical examples.

An International Survey of Quality and Safety Programs in Radiology

PURPOSE

The aim of this study was to determine the status of radiology quality improvement programs in a variety of selected nations worldwide.

METHODS

A survey was developed by select members of the International Economics Committee of the American College of Radiology on quality programs and was distributed to committee members. Members responded on behalf of their country. The 51-question survey asked about 12 different quality initiatives which were grouped into 4 themes: departments, users, equipment, and outcomes. Respondents reported whether a designated type of quality initiative was used in their country and answered subsequent questions further characterizing it.

RESULTS

The response rate was 100% and represented Australia, Canada, China, England, France, Germany, India, Israel, Japan, the Netherlands, Russia, and the United States. The most frequently reported quality initiatives were imaging appropriateness (91.7%) and disease registries (91.7%), followed by key performance indicators (83.3%) and morbidity and mortality rounds (83.3%). Peer review, equipment accreditation, radiation dose monitoring, and structured reporting were reported by 75.0% of respondents, followed by 58.3% of respondents for quality audits and critical incident reporting. The least frequently reported initiatives included Lean/Kaizen exercises and physician performance assessments, implemented by 25.0% of respondents.

CONCLUSION

There is considerable diversity in the quality programs used throughout the world, despite some influence by national and international organizations, from whom further guidance could increase uniformity and optimize patient care in radiology.

Performance indicators for radiation protection management: suggestions from the European Society of Radiology

In 2013, the new European Basic Safety Standards Directive 2013/59/Euratom (BSS Directive), which defines the new legal framework for the use of ionising radiation in medical imaging and radiotherapy, was published. In 2014, the ESR EuroSafe Imaging Initiative was founded with a goal in mind “to support and strengthen medical radiation protection across Europe following a holistic, inclusive approach”. To support radiology departments in developing a programme of clinical audit, the ESR developed a Guide to Clinical Audit and an accompanying audit tool in 2017, with an expanded second edition released in 2019 and published under the name of Esperanto – ESR Guide to Clinical Audit in Radiology and the ESR Clinical Audit Tool, 2019. Audits represent specific aspects at a certain point in time, usually with retrospective evaluation of data. Key performance indicators (KPIs), on the other hand, are intended to enable continuous monitoring of relevant parameters, for example to provide warnings or a dashboard. KPIs, which can, for example, be recorded automatically and visualised in dashboards, are suitable for this purpose. This paper will discuss a selection of indicators covering different areas and include suggestions for their implementation.

Post-Structuring Radiology Reports of Breast Cancer Patients for Clinical Quality Assurance

Hospitals often set protocols based on well defined standards to maintain the quality of patient reports. To ensure that the clinicians conform to the protocols, quality assurance of these reports is needed. Patient reports are currently written in free-text format, which complicates the task of quality assurance. In this paper, we present a machine learning based natural language processing system for automatic quality assurance of radiology reports on breast cancer. This is achieved in three steps: we i) identify the top-level structure (headings) of the report, ii) classify the report content into the top-level headings, and iii) convert the free-text detailed findings in the report to a semi-structured format (post-structuring). Top level structure and content of report were predicted with an F1 score of 0.97 and 0.94, respectively, using Support Vector Machine (SVM) classifiers. For automatic structuring, our proposed hierarchical Conditional Random Field (CRF) outperformed the baseline CRF with an F1 score of 0.78 versus 0.71. The determined structure of the report is represented in semi-structured XML format of the free-text report, which helps to easily visualize the conformance of the findings to the protocols. This format also allows easy extraction of specific information for other purposes such as search, evaluation, and research.

Barriers to Quality Care in Medical Imaging at a Teaching Hospital in Ghana: Staff Perspective

BACKGROUND

The goal of quality care is to ensure that the health care services provided to individuals and patient populations improve desired health outcomes. However, as medical imaging services increase in Ghana, empirical evidence show a low level of care. Despite this, there exists no study in the public domain on the barriers to quality care. This study, therefore, sought to identify barriers to quality care in medical imaging at a teaching hospital to provide evidence that will enable optimization of care and in improving the overall medical imaging care delivery system.

METHODS

This research was a descriptive, cross-sectional study using a mixed method approach based on the dimensions of quality of care of medical imaging services from medical imaging professionals' perspective: capacity and sustainability, timeliness, safety, equity, patient-centeredness, effective communication, and appropriateness of examination.

QUANTITATIVE METHOD

A 5-point Likert scale questionnaire was used. The study population included all medical imaging professionals (n = 47) at the imaging department of the hospital. However, a total of 36 agreed to participate in the study. Data were analyzed using Stata Version 13. Descriptive analyses were carried out.

QUALITATIVE METHODS

Purposive sampling strategy was applied to recruit 12 management team members and key staff with vast experience in medical imaging for the study. Data collection was done using a reflective in-depth interview guide. Data were analyzed using thematic analysis.

QUANTITATIVE RESULTS

The quantitative findings show more than half of the respondents (n = 23, 63.9%) currently play supervisory roles, 10 (27.8%) work more than 40 hours a week, a minority group (n = 7, 19.4%) examine more than 100 patients per week, and 21 (58.5%) reported quality improvement programs are not carried out. Overall, half (50.0%) of the respondents are unaware of the availability of standard operating procedures, 28 (77.7%) reported imaging machines are not always functional, 34 (94.5%) reported lack of adherence to equipment servicing practices, and 27 (75%) agreed that broken-down equipment are left for more than 3 months before being fixed. In addition, 26 respondents (80.5%) reported staff number is inadequate compared with the workload, whereas only 11 (30.6%) stated supervision by management is adequate. Furthermore, 12 respondents (33.4%) reported management seem interested in quality of care only after adverse event, only 5 (38.5%) of the radiologists stated they are able to meet image reporting deadlines for clients, and only 8 (22.2%) of the respondents reported the availability of means of communicating results to referring clinicians aside the normal report.

QUALITATIVE RESULTS

The qualitative findings show a lack of commitment to equipment servicing, frequent nonfunctionality of imaging machines, and an undue delay in repairs of broken-down machines. In addition, there exists inadequate human resource, inadequate supervision, a lack of quality improvement programs, and educational advancement opportunities for staff. The findings further show inadequacy of hospital gowns for patients, a lack of equity, and a poor organizational culture. In addition, the study identified a lack of means of communicating urgent imaging findings and a lack of promptness and timeliness to care from the consultant radiologists.

CONCLUSION

The low level of care of medical imaging services observed in Ghana is reflected in the large number of barriers to quality care identified in this study. Most barriers identified are in the capacity and sustainability, timeliness, and effective communication dimensions of quality of care. The findings have important implications for policy makers. Improvement in these areas will enable optimization of care and in improving the overall medical imaging care delivery system.

Quality of Care of Medical Imaging Services at a Teaching Hospital in Ghana: Clients' Perspective

BACKGROUND

The Ministry of Health of Ghana is committed to delivering client-focused, quality-driven, and results-oriented medical imaging services. However, there remained a lack of empirical evidence regarding the state of the various dimensions of quality needed to establish evidence-based strategies to strengthen the medical imaging system. This study assessed the quality of care of medical imaging services from clients' perspective at a teaching hospital in order to inform policy.

METHODS

This research was a descriptive cross-sectional study using a mixed method approach based on the dimensions of quality of care in medical imaging: capacity and sustainability, timeliness, safety, equity, patient centeredness, and effective communication.

QUANTITATIVE METHOD

A 5-point Likert scale questionnaire was used. A total of 191 clients aged ≥18 years were recruited during medical imaging services at the imaging department of the hospital. A simple random sampling technique was used to select participants. Data were analyzed using Stata version 13. Descriptive analyses were carried out.

QUALITATIVE METHODS

Purposive sampling strategy was applied to recruit 12 in-depth interview participants. Reflective interview guide starting with demographic characteristics and followed by the dimensions of quality of care was used. Qualitative data were analyzed using thematic analysis.

QUANTITATIVE RESULTS

Overall, there is low quality of care 2.8 (standard deviation [SD] = 0.6). There is low quality with regards to timeliness 2.8 (SD = 0.4), patient centeredness 2.7 (SD = 0.7), equity 2.8 (SD = 0.2), effective communication 2.7 (SD = 0.7), and safety 2.5 (SD = 0.3). Quality of care in relation to capacity and sustainability is high 3.4 (0.6). Only 73 (38.2%) of the clients are currently satisfied with the quality of care, and only 39.8% will recommend others to access care at the imaging department. Only 66 (34.6%) of clients are of the view that staff behavior instills confidence.

QUALITATIVE RESULTS

The qualitative study shows a lack of equity, timeliness, and patient-centeredness in terms of care and privacy. There is a perceived lack of compliance with radiation protection protocols, and there exist wide communication gaps between clients and staff. Furthermore, there is a lack of capacity and sustainability in relation to the reliability and availability of functional equipment. There is, however, high appraisal from clients regarding the neatness and availability of staff.

CONCLUSION

A majority of clients are not satisfied with the quality of care of the medical imaging services. Improved interaction with clients, availability of functional equipment, and effective communication during the care process between the patients and the imaging professionals such as provision of timely information during the waiting period and explanation of procedure will help enhance the quality of care.

'It is just part of life': patient perspectives and experiences of diagnostic imaging referrals

Referral for a medical imaging examination is an integral part of the medical consultation; however, not much is known about patients' experience of these referrals. The life-world experiences and perspectives of patients as 'persons' referred for an imaging investigation are explored through the lens of person-centred and whole-person care. Individual interviews were conducted with 22 patients referred for an imaging investigation. The findings were interpreted in terms of the journey of a patient; that is, the processes the patient undergoes as a person in the course of a referral for a diagnostic imaging investigation as part of the disease and its treatment. Participants' life and health journeys are described in terms of three themes: (1) events leading to an imaging examination; (2) the imaging referral experience embedded within the medical encounter; and (3) the integration of the findings of the imaging examination into their everyday life. Health practitioners should be mindful of the complexity of medical consultations that include a referral for an imaging investigation.

Identification of Key Performance Indicators for Hospital Management Using an Extended Hesitant Linguistic DEMATEL Approach

Performance analysis is of great significance to increase the operational efficiency of healthcare organizations. Healthcare performance is influenced by numerous indicators, but it is unrealistic for administrators to improve all of them due to the restriction of resources. To solve this problem, we integrated double hierarchy hesitant fuzzy linguistic term sets (DHHFLTSs) with the decision-making trial and evaluation laboratory (DEMATEL) and proposed a DHHFL– DEMATEL method to identify key performance indicators (KPIs) in healthcare management. For the developed approach, the judgments of experts on the inter-relationships among indicators were represented by DHHFLTSs, and a novel combination weighting approach was proposed to obtain experts’ weights in line with hesitant degree and consensus degree. Then, the normal DEMATEL method was extended and used for examining the cause and effect relationships between indicators; the technique for the order of preference by similarity to the ideal solution (TOPSIS) method was utilized to generate the ranking of performance indicators. Finally, the feasibility and effectiveness of the proposed DHHFL–DEMATEL approach were illustrated by a practical example in a rehabilitation hospital.

Acing the Joint Commission Regulatory Visit: Running an Effective and Compliant Safety Program

Ensuring the safety of patients and staff is a core effort of all health care organizations. Many regulatory agencies, from The Joint Commission to the Occupational Safety and Health Administration, provide policies and guidelines, with relevant metrics to be achieved. Data on safety can be obtained through a variety of mechanisms, including gemba walks, team discussion during safety huddles, audits, and individual employee entries in safety reporting systems. Data can be organized on a scorecard that provides an at-a-glance view of progress and early warning signs of practice drift. In this article, relevant policies are outlined, and instruction on how to achieve compliance with national patient safety goals and regulations that ensure staff safety and Joint Commission ever-readiness are described. Additional critical components of a safety program, such as department commitment, a just culture, and human factors engineering, are discussed. ^©RSNA, 2018.

Fostering a Healthy AI Ecosystem for Radiology: Conclusions of the 2018 RSNA Summit on AI in Radiology

The 2018 RSNA Summit on AI in Radiology brought together a diverse group of stakeholders to identify and prioritize areas of need related to artificial intelligence in radiology. This article presents the proceedings of the summit with emphasis on RSNA's role in leading, organizing, and catalyzing change during this important time in radiology. © RSNA, 2019.

Preference-Sensitive Management of Post-Mammography Decisions in Breast Cancer Diagnosis

Decision models representing the clinical situations where treatment options entail a significant risk of morbidity or mortality should consider the variations in risk preferences of individuals. In this study, we develop a stochastic modeling framework that optimizes risk-sensitive diagnostic decisions after a mammography exam. For a given patient, our objective is to find the utility maximizing diagnostic decisions where we define the utility over quality-adjusted survival duration. We use real data from a private mammography database to numerically solve our model for various utility functions. Our choice of utility functions for the numerical analysis is driven by actual patient behavior encountered in clinical practice. We find that invasive diagnostic procedures such as biopsies are more aggressively used than what the optimal risk-neutral policy would suggest, implying a far-sighted (or equivalently risk-seeking) behavior. When risk preferences are incorporated into the clinical practice, policy makers should bear in mind that a welfare loss in terms of survival duration is inevitable as evidenced by our structural and empirical results.

Quality and Efficiency Improvement Tools for Every Radiologist

In an era of value-based medicine, data-driven quality improvement is more important than ever to ensure safe and efficient imaging services. Familiarity with high-value tools enables all radiologists to successfully engage in quality and efficiency improvement. In this article, we review the model for improvement, strategies for measurement, and common practical tools with real-life examples that include Run chart, Control chart (Shewhart chart), Fishbone (Cause-and-Effect or Ishikawa) diagram, Pareto chart, 5 Whys, and Root Cause Analysis.

Applying Systems Engineering Reduces Radiology Transport Cycle Times in the Emergency Department

INTRODUCTION

Emergency department (ED) crowding is widespread, and can result in care delays, medical errors, increased costs, and decreased patient satisfaction. Simultaneously, while capacity constraints on EDs are worsening, contributing factors such as patient volume and inpatient bed capacity are often outside the influence of ED administrators. Therefore, systems engineering approaches that improve throughput and reduce waste may hold the most readily available gains. Decreasing radiology turnaround times improves ED patient throughput and decreases patient waiting time. We sought to investigate the impact of systems engineering science targeting ED radiology transport delays and determine the most effective techniques.

METHODS

This prospective, before-and-after analysis of radiology process flow improvements in an academic hospital ED was exempt from institutional review board review as a quality improvement initiative. We hypothesized that reorganization of radiology transport would improve radiology cycle time and reduce waste. The intervention included systems engineering science-based reorganization of ED radiology transport processes, largely using Lean methodologies, and adding no resources. The primary outcome was average transport time between study order and complete time. All patients presenting between 8/2013-3/2016 and requiring plain film imaging were included. We analyzed electronic medical record data using Microsoft Excel and SAS version 9.4, and we used a two-sample t-test to compare data from the pre- and post-intervention periods.

RESULTS

Following the intervention, average transport time decreased significantly and sustainably. Average radiology transport time was 28.7 ± 4.2 minutes during the three months pre-intervention. It was reduced by 15% in the first three months (4.4 minutes [95% confidence interval [CI] 1.5-7.3]; to 24.3 ± 3.3 min, P=0.021), 19% in the following six months (5.4 minutes, 95% CI [2.7-8.2]; to 23.3 ± 3.5 min, P=0.003), and 26% one year following the intervention (7.4 minutes, 95% CI [4.8-9.9]; to 21.3 ± 3.1 min, P=0.0001). This result was achieved without any additional resources, and demonstrated a continual trend towards improvement. This innovation demonstrates the value of systems engineering science to increase efficiency in ED radiology processes.

CONCLUSION

In this study, reorganization of the ED radiology transport process using systems engineering science significantly increased process efficiency without additional resource use.

Quality metrics currently used in academic radiology departments: results of the QUALMET survey

OBJECTIVE

We present the results of the 2015 quality metrics (QUALMET) survey, which was designed to assess the commonalities and variability of selected quality and productivity metrics currently employed by a large sample of academic radiology departments representing all regions in the USA.

METHODS

The survey of key radiology metrics was distributed in March-April of 2015 via personal e-mail to 112 academic radiology departments.

RESULTS

There was a 34.8% institutional response rate. We found that most academic departments of radiology commonly utilize metrics of hand hygiene, report turn around time (RTAT), relative value unit (RVU) productivity, patient satisfaction and participation in peer review. RTAT targets were found to vary widely. The implementation of radiology peer review and the variety of ways in which peer review results are used within academic radiology departments, the use of clinical decision support tools and requirements for radiologist participation in Maintenance of Certification also varied. Policies for hand hygiene and critical results communication were very similar across all institutions reporting, and most departments utilized some form of missed case/difficult case conference as part of their quality and safety programme, as well as some form of periodic radiologist performance reviews.

CONCLUSION

Results of the QUALMET survey suggest many similarities in tracking and utilization of the selected quality and productivity metrics included in our survey. Use of quality indicators is not a fully standardized process among academic radiology departments. Advances in knowledge: This article examines the current quality and productivity metrics in academic radiology.

Key Principles in Quality and Safety in Radiology

OBJECTIVE

The purpose of this article is to introduce the reader to basic concepts of quality and safety in radiology.

CONCLUSION

Concepts are introduced that are keys to identifying, understanding, and utilizing certain quality tools with the aim of making process improvements. Challenges, opportunities, and change drivers can be mapped from the radiology quality perspective. Best practices, informatics, and benchmarks can profoundly affect the outcome of the quality improvement initiative we all aim to achieve.

From Information Management to Information Visualization: Development of Radiology Dashboards

OBJECTIVE

The development and implementation of a dashboard of medical imaging department (MID) performance indicators.

METHOD

Several articles discussing performance measures of imaging departments were searched for this study. All the related measures were extracted. Then, a panel of imaging experts were asked to rate these measures with an open ended question to seek further potential indicators. A second round was performed to confirm the performance rating. The indicators and their ratings were then reviewed by an executive panel. Based on the final panel's rating, a list of indicators to be used was developed. A team of information technology consultants were asked to determine a set of user interface requirements for the building of the dashboard. In the first round, based on the panel's rating, a list of main features or requirements to be used was determined. Next, Qlikview was utilized to implement the dashboard to visualize a set of selected KPI metrics. Finally, an evaluation of the dashboard was performed.

RESULTS

92 MID indicators were identified. On top of this, 53 main user interface requirements to build of the prototype of dashboard were determined. Then, the project team successfully implemented a prototype of radiology management dashboards into study site. The visual display that was designed was rated highly by users.

CONCLUSION

To develop a dashboard, management of information is essential. It is recommended that a quality map be designed for the MID. It can be used to specify the sequence of activities, their related indicators and required data for calculating these indicators. To achieve both an effective dashboard and a comprehensive view of operations, it is necessary to design a data warehouse for gathering data from a variety of systems. Utilizing interoperability standards for exchanging data among different systems can be also effective in this regard.

Imaging in the Age of Precision Medicine: Summary of the Proceedings of the 10th Biannual Symposium of the International Society for Strategic Studies in Radiology

During the past decade, with its breakthroughs in systems biology, precision medicine (PM) has emerged as a novel health-care paradigm. Challenging reductionism and broad-based approaches in medicine, PM is an approach for disease treatment and prevention that takes into account individual variability in genes, environment, and lifestyle. It involves integrating information from multiple sources in a holistic manner to achieve a definitive diagnosis, focused treatment, and adequate response assessment. Biomedical imaging and imaging-guided interventions, which provide multiparametric morphologic and functional information and enable focused, minimally invasive treatments, are key elements in the infrastructure needed for PM. The emerging discipline of radiogenomics, which links genotypic information to phenotypic disease manifestations at imaging, should also greatly contribute to patient-tailored care. Because of the growing volume and complexity of imaging data, decision-support algorithms will be required to help physicians apply the most essential patient data for optimal management. These innovations will challenge traditional concepts of health care and business models. Reimbursement policies and quality assurance measures will have to be reconsidered and adapted. In their 10th biannual symposium, which was held in August 2013, the members of the International Society for Strategic Studies in Radiology discussed the opportunities and challenges arising for the imaging community with the transition to PM. This article summarizes the discussions and central messages of the symposium.

Reconciling quality and cost: A case study in interventional radiology

OBJECTIVES

To provide a method to calculate delay cost and examine the relationship between quality and total cost.

METHODS

The total cost including capacity, supply and delay cost for running an interventional radiology suite was calculated. The capacity cost, consisting of labour, lease and overhead costs, was derived based on expenses per unit time. The supply cost was calculated according to actual procedural material use. The delay cost and marginal delay cost derived from queueing models was calculated based on waiting times of inpatients for their procedures.

RESULTS

Quality improvement increased patient safety and maintained the outcome. The average daily delay costs were reduced from 1275 € to 294 €, and marginal delay costs from approximately 2000 € to 500 €, respectively. The one-time annual cost saved from the transfer of surgical to radiological procedures was approximately 130,500 €. The yearly delay cost saved was approximately 150,000 €. With increased revenue of 10,000 € in project phase 2, the yearly total cost saved was approximately 290,000 €. Optimal daily capacity of 4.2 procedures was determined.

CONCLUSIONS

An approach for calculating delay cost toward optimal capacity allocation was presented. An overall quality improvement was achieved at reduced costs.

KEY POINTS

• Improving quality in terms of safety, outcome, efficiency and timeliness reduces cost. • Mismatch of demand and capacity is detrimental to quality and cost. • Full system utilization with random demand results in long waiting periods and increased cost.

The effectiveness of service delivery initiatives at improving patients' waiting times in clinical radiology departments: a systematic review

We reviewed the literature for the impact of service delivery initiatives (SDIs) on patients' waiting times within radiology departments. We searched MEDLINE, EMBASE, CINAHL, INSPEC and The Cochrane Library for relevant articles published between 1995 and February, 2013. The Cochrane EPOC risk of bias tool was used to assess the risk of bias on studies that met specified design criteria. Fifty-seven studies met the inclusion criteria. The types of SDI implemented included extended scope practice (ESP, three studies), quality management (12 studies), productivity-enhancing technologies (PETs, 29 studies), multiple interventions (11 studies), outsourcing and pay-for-performance (one study each). The uncontrolled pre- and post-intervention and the post-intervention designs were used in 54 (95%) of the studies. The reporting quality was poor: many of the studies did not test and/or report the statistical significance of their results. The studies were highly heterogeneous, therefore meta-analysis was inappropriate. The following type of SDIs showed promising results: extended scope practice; quality management methodologies including Six Sigma, Lean methodology, and continuous quality improvement; productivity-enhancing technologies including speech recognition reporting, teleradiology and computerised physician order entry systems. We have suggested improved study design and the mapping of the definitions of patient waiting times in radiology to generic timelines as a starting point for moving towards a situation where it becomes less restrictive to compare and/or pool the results of future studies in a meta-analysis.

A design protocol to develop radiology dashboards

Aim:

The main objective of this descriptive and development research was to introduce a design protocol to develop radiology dashboards.

Material and methods:

The first step was to determine key performance indicators for radiology department. The second step was to determine required infrastructure for implementation of radiology dashboards. Infrastructure was extracted from both data and technology perspectives. The third step was to determine main features of the radiology dashboards. The fourth step was to determine the key criteria for evaluating the dashboards. In all these steps, non-probability sampling methods including convenience and purposive were employed and sample size determined based on a persuasion model.

Results:

Results showed that there are 92 KPIs, 10 main features for designing dashboards and 53 key criteria for dashboards evaluation. As well as, a Prototype of radiology management dashboards in four aspects including services, clients, personnel and cost-income were implemented and evaluated. Applying such dashboards could help managers to enhance performance, productivity and quality of services in radiology department.

Key Performance Indicators for Comparing the Performance of Portable Radiography: Direct Digital Radiography versus Conventional Machine Computed Radiography-A Study in a Nonacute Hospital

INTRODUCTION

Portable radiography traditionally has been performed with a conventional portable x-ray unit with computed radiography (CR) system (conventional-CR combo), and off-site processing of the exposed CR cassettes was time-consuming. The direct digital radiography (DDR) portable x-ray system, with the digital image immediately available for review and wireless transmission as the key merits, is newly installed for portable radiography. Thus, the work flow of portable radiography is changed. This study was performed to quantitatively investigate the performance of portable radiography using the DDR portable x-ray system and conventional-CR combo in terms of efficiency and work flow enhancement.

METHODS

One hundred ninety portable x-ray examinations were timed for each procedural step using conventional-CR combo (n=97) and the DDR portable x-ray system. The following key performance indicators were designed for measuring the performance of portable radiography quantitatively: "examination duration," "time for image becoming available in PACS," "postacquisition processing time," and "manpower deployment time."

RESULTS

Productivity was raised by 96% using the DDR portable x-ray system. "Examination duration" using the DDR portable system was significantly faster (P < .0001), with a mean calculated time of 13.4 ± 7.6 minutes for the DDR portable system and 25.2 ± 10.9 minutes for conventional-CR combo. The "time for image becoming available in PACS" was significantly shorter than that of conventional-CR combo (P < .0001), with a mean time of 6.8 ± 2.6 minutes for the DDR portable system and 19.2 ± 9.7 minutes for conventional-CR combo. The "postacquisition processing time" was measured with slight differences, with a mean time of 2.2 ± 1.1 minutes for the DDR portable system and 1.9 ± 1.0 minutes for conventional-CR combo (P = .1064). Because more portable x-ray examinations could be performed when using the DDR portable x-ray system in each round of service, the mean "manpower deployment time" when using the DDR portable x-ray system was longer (ie, 82.6 ± 46.8 minutes for the DDR portable system and 24.5 ± 11.9 minutes for conventional-CR combo).

CONCLUSIONS

By using the new DDR portable x-ray system with work flow changes, the performance of portable radiography was improved in efficiency and work flow was enhanced. Furthermore, the four defined key performance indicators in this study may help provide a framework for measuring the performance of portable radiography in other institutions.

Interrater agreement in the evaluation of discrepant imaging findings with the Radpeer system

OBJECTIVE

The Radpeer system is central to the quality assurance process in many radiology practices. Previous studies have shown poor agreement between physicians in the evaluation of their peers. The purpose of this study was to assess the reliability of the Radpeer scoring system.

MATERIALS AND METHODS

A sample of 25 discrepant cases was extracted from our quality assurance database. Images were made anonymous; associated reports and identities of interpreting radiologists were removed. Indications for the studies and descriptions of the discrepancies were provided. Twenty-one subspecialist attending radiologists rated the cases using the Radpeer scoring system. Multirater kappa statistics were used to assess interrater agreement, both with the standard scoring system and with dichotomized scores to reflect the practice of further review for cases rated 3 and 4. Subgroup analyses were conducted to assess subspecialist evaluation of cases.

RESULTS

Interrater agreement was slight to fair compared with that expected by chance. For the group of 21 raters, the kappa values were 0.11 (95% CI, 0.06-0.16) with the standard scoring system and 0.20 (95% CI, 0.13-0.27) with dichotomized scores. There was disagreement about whether a discrepancy had occurred in 20 cases. Subgroup analyses did not reveal significant differences in the degree of interrater agreement.

CONCLUSION

The identification of discrepant interpretations is valuable for the education of individual radiologists and for larger-scale quality assurance and quality improvement efforts. Our results show that a ratings-based peer review system is unreliable and subjective for the evaluation of discrepant interpretations. Resources should be devoted to developing more robust and objective assessment procedures, particularly those with clear quality improvement goals.

Indices of work quality for specialized medical institutions of the dermatovenerology profile aimed at syphilis diagnostics (a review of literature)

The authors present the results of a study of literature sources for such indices as assessment of the efficacy and quality of medical services in medical care institutions based on quantitative parameters being quality indices. The authors demonstrate that indices for assessing the quality of work at medical institutions can involve information about materials, technical and other resources and personnel available at institutions, state statistics accounting forms, data from information and analytical systems and patient registers as well as additional indices developed by experts. Incidence indices are currently the key indicator for assessing the work quality of institutions dealing with syphilis diagnostics. No indicators and criteria for assessing the quality of laboratory assistance rendered to syphilitic patients have been developed yet.

Assessing the performance of medical personnel involved in the diagnostic imaging processes in mulago hospital, kampala, Uganda

Objectives:

Uganda, has limited health resources and improving performance of personnel involved in imaging is necessary for efficiency. The objectives of the study were to develop and pilot imaging user performance indices, document non-tangible aspects of performance, and propose ways of improving performance.

Materials and Methods:

This was a cross-sectional survey employing triangulation methodology, conducted in Mulago National Referral Hospital over a period of 3 years from 2005 to 2008. The qualitative study used in-depth interviews, focus group discussions, and self-administered questionnaires, to explore clinicians’ and radiologists’ performancerelated views.

Results:

The study came up with following indices: appropriate service utilization (ASU), appropriateness of clinician's nonimaging decisions (ANID), and clinical utilization of imaging results (CUI). The ASU, ANID, and CUI were: 94%, 80%, and 97%, respectively. The clinician's requisitioning validity was high (positive likelihood ratio of 10.6) contrasting with a poor validity for detecting those patients not needing imaging (negative likelihood ratio of 0.16). Some requisitions were inappropriate and some requisition and reports lacked detail, clarity, and precision.

Conclusion:

Clinicians perform well at imaging requisition-decisions but there are issues in imaging requisitioning and reporting that need to be addressed to improve performance.

Assessing the performance of imaging health systems in five selected hospitals in Uganda

OBJECTIVES

The first objective of the study was to develop an index termed as the 'Imaging Coverage' (IC), for measuring the performance of the imaging health systems. This index together with the Hospital-Based Utilization (HBU) would then be calculated for five Ugandan hospitals. Second, was to relate the financial resources and existing health policy to the performance of the imaging systems.

MATERIALS AND METHODS

This was a cross-sectional survey employing the triangulation methodology, conducted in Mulago National Referral Hospital. The qualitative study used cluster sampling, in-depth interviews, focus group discussions, and self-administered questionnaires to explore the non-measurable aspects of the imaging systems' performances.

RESULTS

The IC developed and tested as an index for the imaging system's performance was 36%. General X-rays had the best IC followed by ultrasound. The Hospital-Based Utilization for the five selected hospitals was 186 per thousand and was the highest for general radiography followed by ultrasound.

CONCLUSION

The IC for the five selected hospitals was 36% and the HBU was 186 per thousand, reflecting low performance levels, largely attributable to inadequate funding. There were shortfalls in imaging requisitions and inefficiencies in the imaging systems, financing, and health policy. Although the proportion of inappropriate imaging was small, reducing this inappropriateness even further would lead to a significant total saving, which could be channeled into investigating more patients. Financial resources stood out as the major limitation in attaining the desired performance and there is a need to increase budget funding so as to improve the performance of the imaging health systems.

Quality initiatives: Quality improvement in radiology: basic principles and tools required to achieve success

All imaging departments are expected to establish and maintain effective quality, safety, and performance improvement programs. Essential components of such programs include adherence to the basic principles of quality management and appropriate utilization of quality tools. The initial step is the gathering of relevant information, followed by the collection and analysis of quality and performance data; analysis and ranking of causes that likely contributed to a process failure, error, or adverse event; and prioritization and local implementation of solutions, with careful monitoring of newly implemented processes and wider dissemination of the tools when a process proves to be successful. Quality improvement requires a careful, dedicated, and continuously planned effort by a number of skilled and committed team members, with the goal being to do the right thing in a timely fashion in every case. This process can be sustained by offering rewards and celebrating successes, with all lessons learned disseminated throughout the department or organization.