Impact of filmless imaging on the frequency of clinician review of radiology images

Augmentation of the think aloud method with users' perspectives for the selection of a picture archiving and communication system

OBJECTIVES

Users attitude toward a picture archiving and communication system (PACS) and their interaction with this system are among the most important factors that influence its acceptance. This study aimed to augment the user's interaction with the user's perspective to select a usable PACS among three systems available on the market.

METHODS

We augmented the think aloud (TA) usability evaluation method with the Post-Study System Usability Questionnaire (PSSUQ) to compare user interaction problems of three PACS user interfaces. Four radiologists and four internist physicians participated in this study. Usability characteristics including efficiency, effectiveness, learnability, error, and satisfaction were used to assess the usability of each PACS.

RESULTS

There was a significant difference in efficiency (p = 0.01), effectiveness (p = 0.005), learnability (p = 0.001), and satisfaction (p = 0.009). However, no significant difference in the number of errors (p = 0.18), mouse clicks and keystrokes (p = 0.12), and the number of usability problems (p = 0.6) were observed among the three PACS systems studied.

CONCLUSIONS

This study showed that applying the proposed approach to augment TA with the user's perspective addresses almost all of the theoretical aspects of usability and can be employed to select the most usable PACS.

The impact of PACS on clinician work practices in the intensive care unit: a systematic review of the literature

OBJECTIVE

To assess evidence of the impact of Picture Archiving and Communication Systems (PACS) on clinicians' work practices in the intensive care unit (ICU).

METHODS

We searched Medline, Pre-Medline, CINAHL, Embase, and the SPIE Digital Library databases for English-language publications between 1980 and September 2010 using Medical Subject Headings terms and keywords.

RESULTS

Eleven studies from the USA and UK were included. All studies measured aspects of time associated with the introduction of PACS, namely the availability of images, the time a physician took to review an image, and changes in viewing patterns. Seven studies examined the impact on clinical decision-making, with the majority measuring the time to image-based clinical action. The effect of PACS on communication modes was reported in five studies.

DISCUSSION

PACS can impact on clinician work practices in three main areas. Most of the evidence suggests an improvement in the efficiency of work practices. Quick image availability can impact on work associated with clinical decision-making, although the results were inconsistent. PACS can change communication practices, particularly between the ICU and radiology; however, the evidence base is insufficient to draw firm conclusions in this area.

CONCLUSION

The potential for PACS to impact positively on clinician work practices in the ICU and improve patient care is great. However, the evidence base is limited and does not reflect aspects of contemporary PACS technology. Performance measures developed in previous studies remain relevant, with much left to investigate to understand how PACS can support new and improved ways of delivering care in the intensive care setting.

Mapping turnaround times (TAT) to a generic timeline: a systematic review of TAT definitions in clinical domains

BACKGROUND

Assessing turnaround times can help to analyse workflows in hospital information systems. This paper presents a systematic review of literature concerning different turnaround time definitions. Our objectives were to collect relevant literature with respect to this kind of process times in hospitals and their respective domains. We then analysed the existing definitions and summarised them in an appropriate format.

METHODS

Our search strategy was based on Pubmed queries and manual reviews of the bibliographies of retrieved articles. Studies were included if precise definitions of turnaround times were available. A generic timeline was designed through a consensus process to provide an overview of these definitions.

RESULTS

More than 1000 articles were analysed and resulted in 122 papers. Of those, 162 turnaround time definitions in different clinical domains were identified. Starting and end points vary between these domains. To illustrate those turnaround time definitions, a generic timeline was constructed using preferred terms derived from the identified definitions. The consensus process resulted in the following 15 terms: admission, order, biopsy/examination, receipt of specimen in laboratory, procedure completion, interpretation, dictation, transcription, verification, report available, delivery, physician views report, treatment, discharge and discharge letter sent. Based on this analysis, several standard terms for turnaround time definitions are proposed.

CONCLUSION

Using turnaround times to benchmark clinical workflows is still difficult, because even within the same clinical domain many different definitions exist. Mapping of turnaround time definitions to a generic timeline is feasible.

Impact of picture archiving communication systems on rates of duplicate imaging: a before-after study

Background

Electronic health information systems, such as picture archiving communication systems (PACS), are commonly believed to reduce the need for duplicate testing. However, empirical data to support this belief are not available.

Methods

Before-after study using administrative claims data from the Ontario Health Insurance Plan to determine whether the introduction of PACS at 10 hospitals in the Thames Valley region of southwestern Ontario, Canada between June 2004 and December 2005 reduced the frequency of duplicate imaging examinations. The imaging modalities studied were: chest and abdominal X-ray; computed tomography of the abdomen/pelvis, head, and chest. The frequency of duplicate testing was examined at 3 different time frames: 7 days, 30 days, and 60 days after a given index test.

Results

Overall frequencies of duplicate imaging were: 2.7% within 7 days of an index imaging test, 6.7% within 30 days, and 9.8% within 60 days. Comparing the 12 months before and 12 months after PACS, absolute reductions in the frequency of duplicate X-rays using 7-day, 30-day, and 60-day time frames were: 0.2% (P = 0.01), 0.6% (P < 0.001), and 0.9% (P < 0.001), respectively. In contrast, there were absolute increases in the frequency of duplicate CT scans after PACS of 0.0% (P = 0.92), 0.5% (P = 0.01), and 0.5% (P = 0.01), respectively.

Conclusion

The frequency of duplicate imaging is relatively low and we did not find large reductions in duplicate imaging after the introduction of PACS. Independent evaluation of electronic medical systems should be conducted to confirm widely held beliefs of their potential benefits.

Optimizing physicians' instruction of PACS through e-learning: cognitive load theory applied

This article outlines the strategy used by our hospital to maximize the knowledge transfer to referring physicians on using a picture archiving and communication system (PACS). We developed an e-learning platform underpinned by the cognitive load theory (CLT) so that in depth knowledge of PACS' abilities becomes attainable regardless of the user's prior experience with computers. The application of the techniques proposed by CLT optimizes the learning of the new actions necessary to obtain and manipulate radiological images. The application of cognitive load reducing techniques is explained with several examples. We discuss the need to safeguard the physicians' main mental processes to keep the patient's interests in focus. A holistic adoption of CLT techniques both in teaching and in configuration of information systems could be adopted to attain this goal. An overview of the advantages of this instruction method is given both on the individual and organizational level.

Improving the ICU: part 2

ICUs are a vital but troubled component of modern health-care systems. Improving ICU performance requires that we shift from a paradigm that concentrates on individual performance, to a systems-oriented approach that emphasizes the need to assess and improve the ICU systems and processes that hinder the ability of individuals to perform their jobs well. This second part of a two-part treatise establishes a practical framework for performance improvement and examines specific strategies to improve ICU performance, including the use of information systems.

Implementation of a radiology information system/picture archiving and communication system and an image transfer system at a large public teaching hospital--assessment of success of adoption by clinicians

In 2001 a radiology information system/picture archiving and communication system (RIS/PACS) was installed at the Princess Alexandra Hospital (PAH) in Brisbane, with electronic image transfer links to other major hospitals in Queensland. An assessment study is being performed of the effect of the ready availability of radiology results on clinicians, clinical decision making and the time taken to treat patients. A series of structured interviews with senior clinicians at the PAH began in July 2002. Administrative data are being collected from the PAH computer system. Preliminary results from the first six months of the study suggest that the introduction of the RIS/PACS at the PAH has been well received by senior clinicians and has been helpful in clinical decision making. Patient management has been improved and the time taken to arrive at clinical decisions has been reduced, particularly in neurosurgery. The RIS/PACS has significantly improved access to imaging resources for teaching, owing to the ability to retrieve reference images and to project high-quality images during teaching sessions. However, the introduction of the RIS/PACS has not reduced patient length of stay.

Establishing benchmarks for creation of a pro-forma economic model to evaluate filmless PACS operation

The purpose of this study was to establish data points (benchmarks) to incorporate into a pro-forma cost analysis model, comparing film-based and filmless modes of operation. Prospective data were collected over a 6-year period at the Baltimore VA Medical Center (BVAMC) immediately before and after implementation of a hospital-wide PACS. These data were in turn compared with local and national VA centers during comparable time periods, to establish reference data between manual film-based (without PACS) and filmless operations (using PACS). Benchmarks utilized for the study fell into 2 broad categories: operational costs and revenues generated. Factors contributing to operational costs include space requirements, equipment, supplies, personnel, and maintenance. Factors contributing to revenues generated included examination volume, modality mix, and reimbursement rates. Collectively, these data points were incorporated into a pro-forma model that allows prospective PACS customers to compare total cost of ownership for film-based and filmless operations dependent on the unique variables of the respective institution.

Radiology in the intensive care unit (Part I)

The increasing complexity of the intensive care patient combined with the recent advances in imaging technology has generated a new perspective on intensive care radiology. The purpose of this 2-part review article is to describe the contribution of radiology to the management of these critically ill patients. The first article will discuss the impact of picture archiving and communication system (PACS) on critical care management and utility of the portable chest radiograph in the detection and evaluation of pulmonary disease with correlation to computed tomography (CT). The second article describes in more detail the increasing role of CT in diagnosis and therapeutic procedures. In particular, the implementation of CT pulmonary angiography in the evaluation of pulmonary emboli and the introduction of the new multislice detector CT scanners that allow even the most dyspneic patient to be evaluated. Pleural complications in the intensive care unit and image-guided intervention will also be discussed.

Evolution of the digital revolution: a radiologist perspective

The transformation from film-based to filmless operation has become more and more challenging, as imaging studies expand in size and complexity. To adapt to these changes, radiologists must proactively develop new workflow strategies to compensate for increasing work demands and the existing workforce shortage. This article addresses the evolutionary changes underway in the radiology interpretation process and reviews changes that have occurred in the past decade. These include a number of developments in soft-copy interpretation, which is migrating from a relatively static process, duplicating film-based interpretation, to a dynamic process, using multi-planar reconstructions, volumetric navigation, and electronic decision support tools. The result is optimization of the human-computer interface with improved productivity, diagnostic confidence, and interpretation accuracy.

Radiology goes filmless. What does this mean for primary care physicians?

Technical advances over the past few years have rapidly increased the possibilities for filmless radiology services provided by PACS. Such systems are also financially feasible for many healthcare practices, primarily because of the goals achieved through increased efficiency and improved patient care. In coming years, most medical facilities are likely to either convert or begin to convert to PACS as conventional film-based systems fade into the annals of medical history.

Integration of radiographic images with an electronic medical record

Radiographic images are important and expensive diagnostic tests. However, the provider caring for the patient often does not review the images directly due to time constraints. Institutions can use picture archiving and communications systems to make images more available to the provider, but this may not be the best solution. We integrated radiographic image review into the Regenstrief Medical Record System in order to address this problem. To achieve adequate performance, we store JPEG compressed images directly in the RMRS. Currently, physicians review about 5% of all radiographic studies using the RMRS image review function.

Understanding financing options for PACS implementation. Picture archiving and communication systems

The acquisition of expensive equipment such as picture archiving and communication systems (PACS) becomes increasingly difficult as capital budgets become tighter. Traditional ownership financing options in the form of direct purchase or financing (loan) have several limitations including technology obsolescence, higher fixed pricing, limited options for equipment disposal, and the need to tie up valuable capital. Alternative financing options, in the form of conventional lease and risk sharing arrangements, offer several theoretical advantages including technology obsolescence protection in the form of built-in upgrades, preservation of borrowing power, multiple end-of-term options, and payment flexibility (which can be directly tied to realized productivity and operational efficiency gains). These options are discussed, with emphasis on the acquisition of PACS.

Effect of filmless imaging on the utilization of radiologic services

PURPOSE

To determine the effect of a large-scale picture archiving and communication system (PACS) on in- and outpatient utilization of radiologic services.

MATERIALS AND METHODS

Data were collected at the Baltimore Veterans Affairs (VA) Medical Center (BVAMC) before and after implementation of an enterprise-wide PACS; the numbers and types of imaging examinations performed for fiscal years 1993 and 1996 were evaluated. These data were compared with those from a similar academic medical center, the Philadelphia VA Medical Center (PVAMC), and with aggregate data obtained nationally for all VA hospitals over comparable periods.

RESULTS

Inpatient utilization, defined as the number of examinations per inpatient day, increased by 82% (from 0.265 to 0.483 examinations per patient day) after a transition to filmless operation at BVAMC. This is substantially greater than the increases of 38% (from 0.263 to 0.362 examinations per patient day) and 11% (from 0.190 to 0.211 examinations per patient day) at the film-based PVAMC and nationally, respectively. Outpatient utilization, defined as the number of examinations per visit, increased by 21% (from 0.108 to 0.131 examinations per visit) at BVAMC, compared with a 1% increase (from 0.087 to 0.088 examinations per visit) at PVAMC and a net decrease of 19% (from 0. 148 to 0.120 examinations per visit) nationally.

CONCLUSION

The transition to filmless operation was associated with increases in inpatient and outpatient utilization of radiologic services, which substantially exceeded changes at PVAMC and nationally over the same interval.

Development of an electronic radiologist's office in a private institute

A computer system that improves the quality, user-friendliness, accessibility, and management of radiology data (images, reports, databases, knowledge) was implemented at a private institute. A picture archiving and communication system (PACS) was integrated with the radiology information system (RIS). Two servers and 12 personal computers form the integrated system. The first server is dedicated to management and archiving of Digital Imaging and Communications in Medicine (DICOM) images. The second server is dedicated to management of the RIS and archiving of patient data (Structured Query Language database), reports (hypertext markup language [HTML]), and images in the Joint Photographic Experts Group (JPEG) format (mini-PACS). There are three main client-server networks: a common network of imaging modalities (magnetic resonance imaging, computed tomography, ultrasonography, digital radiography) and two fast Ethernet networks (the PACS network and the RIS network). The RIS-PACS is linked remotely with other workstations and servers via Integrated Services Digital Network (ISDN). Images and reports can be distributed to referring physicians in the form of multimedia HTML and JPEG documents, which can also be used for quick and easy archiving, distribution, and reviewing within the institute. However, referring physicians have been reluctant to use electronic reports and images.

Clinical input into designing a PACS

The purpose of this study was to evaluate clinical attitudes and expectations in the implementation of a neuroradiology picture archiving and communication system (PACS). A 1-page survey of expectations and clinical attitudes toward a neuroradiology mini-PACS was distributed to 49 full-time faculty members in the departments of neurosurgery, neurology, and otorhinolaryngology at an academic center. Interest in viewing soft-copy images was moderate to very high for over 89% of clinicians. All clinicians were comfortable with phone consultations with radiologists while viewing soft-copy images. Clinicians preferred retrieving images from personal computers over workstations and film libraries by 72.9%, 27.1%, and 0%, respectively. However, 38.5% of surgeons felt the need for hard copy in the operating room. Clinicians estimated that in 18.3% of cases, patients took their in-house films to outside institutions for consultations. Clinicians were enthusiastic about implementing PACS. Although acceptance of soft-copy viewing among clinicians is high, some provision for supplying hard-copy images appears to be necessary.

Impact of electronic imaging on clinician behavior in the urgent care setting

Although it is intuitively valuable that more expedient delivery of radiographic images and reports to clinicians would improve patient care, it is important to document these outcomes to validate further advances in these areas. We evaluated the care of 215 patients seen at a walk-in clinic to determine what benefit digital imaging is to the patient. Cohorts consisted of all patients for whom specified radiology examinations were ordered during a 7-day period. The first cohort was recruited when analog films were used. The second cohort received examinations performed with computed radiography (CR) acquisition and computer display, which had been in use for 2 years. Patients were categorized as to the type of study they received, as well as whether a staff radiologist was immediately available to read the study. Clinical behavior was characterized by outcome measures of time to final diagnosis, time to final treatment, and need for follow-up. Our analysis demonstrated a reduction in time to final diagnosis that was better appreciated during the times when a staff radiologist was not immediately available. It also suggested that greater time reductions were seen for patients who received extremity examinations than those who received chest, sinus, or rib films. These data suggest that digital imaging is a useful tool to improve clinical outcome of patients seen in the acute care setting.