From Information Management to Information Visualization: Development of Radiology Dashboards

Development of minimum data set and dashboard for monitoring adverse events in radiology departments

Background

To reduce the risk of errors, patient safety monitoring in the medical imaging department is crucial. Interventions are required and these can be provided as a framework for documenting, reporting, evaluating, and recognizing events that pose a threat to patient safety. The aim of this study was to develop minimum data set and dashboard for monitoring adverse events in radiology departments.

Material and methods

This developmental research was conducted in multiple phases, including content determination using the Delphi technique; database designing using SQL Server; user interface (UI) building using PHP; and dashboard evaluation in three aspects: the accuracy of calculating; UI requirements; and usability.

Results

This study identified 26 patient safety (PS) performance metrics and 110 PS-related significant data components organized into 14 major groupings as the system contents. The UI was built with three tabs: pre-procedure, intra-procedure, and post-procedure. The evaluation results proved the technical feasibility of the dashboard. Finally, the dashboard's usability was highly rated (76.3 out of 100).

Conclusion

The dashboard can be used to supplement datasets to obtain a more accurate picture of the PS condition and to draw attention to characteristics that professionals might otherwise overlook or undervalue.

Requirements and challenges of hospital dashboards: a systematic literature review

Background

Today, the use of data in administrative and clinical processes is quite challenging due to the large volume of data, data collection from various sources, and lack of data structure. As a data management tool, dashboards play an important role in timely visual display of critical information on key performances.

Objectives

This systematic review aimed to identify functional and non-functional requirements, as well as challenges of using dashboards in hospitals.

Methods

In this systematic review, four databases, including the Web of Science, PubMed, EMBASE, and Scopus, were searched to find relevant articles from 2000 until May 30, 2020. The final search was conducted on May 30, 2020. Data collection was performed using a data extraction form and reviewing the content of relevant studies on the potentials and challenges of dashboard implementation.

Results

Fifty-four out of 1254 retrieved articles were selected for this study based on the inclusion and exclusion criteria. The functional requirements for dashboards included reporting, reminders, customization, tracking, alert creation, and assessment of performance indicators. On the other hand, the non-functional requirements included the dashboard speed, security, ease of use, installation on different devices (e.g., PCs and laptops), integration with other systems, web-based design, inclusion of a data warehouse, being up-to-data, and use of data visualization elements based on the user’s needs. Moreover, the identified challenges were categorized into four groups: data sources, dashboard content, dashboard design, implementation, and integration in other systems at the hospital level.

Conclusion

Dashboards, by providing information in an appropriate manner, can lead to the proper use of information by users. In order for a dashboard to be effective in clinical and managerial processes, particular attention must be paid to its capabilities, and the challenges of its implementation need to be addressed.

Digital dashboards: a speech pathology case study

The introduction of electronic medical records has created vast opportunities in relation to data storage, visibility and extraction. In Allied Health the collection, storage, display and reporting of service statistics is a key opportunity to utilise the capabilities of the electronic medical record to reduce clinician time completing data entry, improve accuracy and visibility of available data and maximise opportunities to view and utilise service statistic information in clinical and operational decision making. This case study describes service statistic capture and extraction for a speech pathology department, pre- and post- the introduction of a digital dashboard. A new Allied Health digital dashboard was created via clinicians and informaticians working collaboratively to define service delivery elements for data extraction and design dashboard functionality. Descriptive comparison of data capture pre- and post- dashboard implementation was undertaken. The integration of service statistic information into a digital dashboard was found to support service statistic reporting, improve ease of access, and provide greater visibility and timeliness of service information.

Emergency Department Quality Dashboard; a Systematic Review of Performance Indicators, Functionalities, and Challenges

Introduction:

Effective information management in the emergency department (ED) can improve the control and management of ED processes. Dashboards, known as data management tools, efficiently provide information and contribute greatly to control and management of ED. This study aimed to identify performance indicators quality dashboard functionalities, and analyze the challenges associated with dashboard implementation in the ED.

Methods:

This systematic review began with a search in four databases (Web of Science, PubMed, Embase, and Scopus) from 2000 to May 30, 2020, when the final search for papers was conducted. The data were collected using a data extraction form and the contents of the extracted papers were analyzed through ED performance indicators, dashboard functionalities, and implementation challenges.

Results:

Performance indicators reported in the reviewed papers were classified as the quality of care, patient flow, timeliness, costs, and resources. The main dashboard functionalities noted in the papers included reporting, customization, alert creation, resource management, and real-time information display. The dashboard implementation challenges included data sources, data quality, integration with other systems, adaptability of dashboard functionalities to user needs, and selection of appropriate performance indicators.

Conclusions:

Quality dashboards facilitate processes, communication, and situation awareness in the ED; hence, they can improve care provision in this department. To enhance the effectiveness and efficiency of ED dashboards, officials should set performance indicators and consider the conformity of dashboard functionalities with user needs. They should also integrate dashboards with other relevant systems at the departmental and hospital levels.

Development, implementation and preliminary evaluation of clinical dashboards in a department of anesthesia

Clinical dashboards summarize indicators of high-volume patient data in a concise, user-friendly visual format. There are few studies of the use of dashboards to improve professional practice in anesthesiology. The objective of the present study was to describe the user-centered development, implementation and preliminary evaluation of clinical dashboards dealing with anesthesia unit management and quality assessment in a French university medical center. User needs and technical requirements were identified in end user interviews and then synthesized. Several representations were then developed (according to good visualization practice) and submitted to end users for appraisal. Lastly, dashboards were implemented and made accessible for everyday use via the medical center’s network. After a period of use, end user feedback on the dashboard platform was collected as a system usability score (range 0 to 100). Seventeen themes (corresponding to 29 questions and 42 indicators) were identified. After prioritization and feasibility assessment, 10 dashboards were ultimately implemented and deployed. The dashboards variously addressed the unit’s overall activity, compliance with guidelines on intraoperative hemodynamics, ventilation and monitoring, and documentation of the anesthesia procedure. The mean (standard deviation) system usability score was 82.6 (11.5), which corresponded to excellent usability. We developed clinical dashboards for a university medical center’s anesthesia units. The dashboards’ deployment was well received by the center’s anesthesiologists. The dashboards’ impact on activity and practice after several months of use will now have to be assessed.

Usability Testing of an Interactive Dashboard for Surgical Quality Improvement in a Large Congenital Heart Center

BACKGROUND

Interactive data visualization and dashboards can be an effective way to explore meaningful patterns in large clinical data sets and to inform quality improvement initiatives. However, these interactive dashboards may have usability issues that undermine their effectiveness. These usability issues can be attributed to mismatched mental models between the designers and the users. Unfortunately, very few evaluation studies in visual analytics have specifically examined such mismatches between these two groups.

OBJECTIVES

We aimed to evaluate the usability of an interactive surgical dashboard and to seek opportunities for improvement. We also aimed to provide empirical evidence to demonstrate the mismatched mental models between the designers and the users of the dashboard.

METHODS

An interactive dashboard was developed in a large congenital heart center. This dashboard provides real-time, interactive access to clinical outcomes data for the surgical program. A mixed-method, two-phase study was conducted to collect user feedback. A group of designers (N = 3) and a purposeful sample of users (N = 12) were recruited. The qualitative data were analyzed thematically. The dashboards were compared using the System Usability Scale (SUS) and qualitative data.

RESULTS

The participating users gave an average SUS score of 82.9 on the new dashboard and 63.5 on the existing dashboard (p = 0.006). The participants achieved high task accuracy when using the new dashboard. The qualitative analysis revealed three opportunities for improvement. The data analysis and triangulation provided empirical evidence to the mismatched mental models.

CONCLUSION

We conducted a mixed-method usability study on an interactive surgical dashboard and identified areas of improvements. Our study design can be an effective and efficient way to evaluate visual analytics systems in health care. We encourage researchers and practitioners to conduct user-centered evaluation and implement education plans to mitigate potential usability challenges and increase user satisfaction and adoption.

A Visual Analytics Dashboard to Summarize Serial Anesthesia Records in Pediatric Radiation Treatment

BACKGROUND

Young children who undergo radiation therapy may require general anesthesia to remain still during weeks of radiation sessions. On a typical day at our hospital, an anesthesia team will care for 10 patients in the radiation therapy suite, and each patient will have multiple prior anesthetic records. Daily review of prior anesthesia records is important to maintain anesthetic consistency and to identify potential improvement, yet our electronic health record (EHR) made such review time-consuming and cumbersome.

OBJECTIVES

This article aims to design a visual analytics interface that simultaneously displays data from multiple anesthesia encounters to support clinical consistency in medications and airway management.

METHODS

Documentation from the EHR is available in the clinical data warehouse following daily backups. A visual analytics interface was built to aggregate important components of multiple anesthesia encounters in pediatric radiation oncology on a single screen. The application was embedded in the EHR's anesthesia module and updated daily.

RESULTS

Each anesthesia encounter was represented by a vertical line with the date at the bottom of the screen. Each vertical line was divided into sections corresponding to the medications, type of airway device, type of radiation oncology procedure, days between treatments, and recovery score and time. Information about the medications, airways, and procedures was shown with icon legends. This layout enabled users to quickly see the key components of multiple anesthetics and make inferences between, for example, the medications used and the recovery score.

CONCLUSION

The dashboard provides a high-level summary of all radiation therapy anesthesia records for children receiving recurrent treatments. In this clinical scenario, it is desirable to replicate an optimal anesthetic approach for daily or near-daily treatments or adjust the anesthetic based on observed patterns.

Semantic Web Technologies for Sharing Clinical Information in Health Care Systems

Introduction:

Semantic Web (SW) technologies is capable of facilitating the management and sharing of knowledge and promote semantic interoperability among healthcare information systems.

Aim:

This article is designed to provide an overview of the SW technologies.

Methods:

This article was performed based on a literature review and Internet search through scientific databases such as PubMed, Scopus, Web of Science and Google Scholar.

Result:

The literature on SW addresses the technical and content aspects of SW technologies including description of ontology, interoperability standards in SW, creating ontology, types of ontologies, ontology editors, ontologies in healthcare.

Discussion:

The discussion on this forum aims to help understand the benefits of SW technologies in healthcare.

Conclusion:

SW promotes a shift from the “syntactic” level to the “semantic” level of services, applications, and people and finally to pragmatic level by sharing knowledge among clinicians, researchers and healthcare providers.

Ontology-Based Interactive Visualization of Patient-Generated Research Questions

BACKGROUND

Crohn's disease and colitis are chronic conditions that affect every facet of patients' lives (e.g., social interaction, family, work, diet, and sleep). Thus, treatment consists largely of disease management. The University of North Carolina at Chapel Hill chapter of the Crohn's and Colitis Foundation-IBD Partners-has created an interactive website that, in addition to providing helpful information and disease management tools, provides a discussion forum for patients to talk about their experiences and suggest new lines of research into Crohn's disease and colitis.

OBJECTIVES

The primary objective of this work is to enable researchers to more effectively browse the forum content. Researchers wish to identify important/popular patient-suggested research topics, appreciate the full breadth of the research topics, and see connections between them, in order to more effectively prioritize research agendas.

METHODS

To help structure the forum content we have developed an ontology describing the major themes in the discussion forum. We have also created a prototype interactive visualization tool that leverages the ontology to help researchers identify common themes and related patient-generated research topics via linked views of (1) the ontology, (2) a research topic overview clustered by relevant ontology terms, and (3) a detailed view of the discussion forum content.

RESULTS

We discuss visualizations and interactions enabled by the visualization tool, provide an example scenario using the tool, and discuss limitations and future work based on feedback from potential users.

CONCLUSION

The integration of a user-community specific ontology with an interactive visualization tool is a promising approach for enabling researchers to more effectively study user-generated research questions.

Developing a hospital-wide quality and safety dashboard: a qualitative research study

Background

Several countries have national policies and programmes requiring hospitals to use quality and safety (QS) indicators. To present an overview of these indicators, hospital-wide QS (HWQS) dashboards are designed. There is little evidence how these dashboards are developed. The challenges faced to develop these dashboards in Dutch hospitals were retrospectively studied.

Methods

24 focus group interviews were conducted: 12 with hospital managers (n=25; 39.7%) and 12 support staff (n=38; 60.3%) in 12 of the largest Dutch hospitals. Open and axial codings were applied consecutively to analyse the data collected.

Results

A heuristic tool for the general development process for HWQS dashboards containing five phases was identified. In phase 1, hospitals make inventories to determine the available data and focus too much on quantitative data relevant for accountability. In phase 2, hospitals develop dashboard content by translating data into meaningful indicators for different users, which is not easy due to differing demands. In phase 3, hospitals search for layouts that depict the dashboard content suited for users with different cognitive abilities and analytical skills. In phase 4, hospitals try to integrate dashboards into organisational structures to ensure that data are systematically reviewed and acted on. In phase 5, hospitals want to improve the flexibility of their dashboards to make this adaptable under differing circumstances.

Conclusion

The literature on dashboards addresses the technical and content aspects of dashboards, but overlooks the organisational development process. This study shows how technical and organisational aspects are relevant in development processes.

Translational Radiomics: Defining the Strategy Pipeline and Considerations for Application-Part 1: From Methodology to Clinical Implementation

Enterprise imaging has channeled various technological innovations to the field of clinical radiology, ranging from advanced imaging equipment and postacquisition iterative reconstruction tools to image analysis and computer-aided detection tools. More recently, the advancements in the field of quantitative image analysis coupled with machine learning-based data analytics, classification, and integration have ushered us into the era of radiomics, which has tremendous potential in clinical decision support as well as drug discovery. There are important issues to consider to incorporate radiomics as a clinically applicable system and a commercially viable solution. In this two-part series, we offer insights into the development of the translational pipeline for radiomics from methodology to clinical implementation (Part 1) and from that to enterprise development (Part 2).

Evaluation of Effective Dashboards: Key Concepts and Criteria

OBJECTIVE

The aim of this study is to offer appropriate criteria to evaluate effective dashboards for healthcare organizations.

METHOD

In a Delphi study, a team of information technology consultants were asked to determine a set of user interface requirements for evaluating, building or selecting the dashboard. In the first round, a list of main features or criteria to be used was determined based on the panel's rating,.

RESULTS

In this study, it was revealed that a set of key criteria for evaluating the dashboards can be used for all types of dashboards. These criteria were classified into 7 main categories including user customization, knowledge discovery, security, information delivery, alerting, visual design, and integration and system connectivity.

CONCLUSION

Choosing good criteria for selecting effective dashboards for healthcare organizations is very critical because these organizations follow a data-intensive and technology-driven environment. This study revealed the importance of key criteria which can guarantee development of an evaluation checklist.

Information management in Iranian Maternal Mortality Surveillance System

BACKGROUND

Maternal mortality is preventable by proper information management and is the main target of the Maternal Mortality Surveillance System (MMSS).

AIM

This study aimed to determine the status of information management in the Iranian Maternal Mortality Surveillance System (IMMSS).

METHODS

The population of this descriptive and analytical study, which was conducted in 2016, included 96 administrative staff of health and treatment deputies of universities of medical sciences and the Ministry of Health in Iran. Data were gathered by a five-part questionnaire with confirmed validity and reliability. A total of 76 questionnaires were completed, and data were analyzed using SPSS software, version 19, by descriptive and inferential statistics. The relationship between variables "organizational unit" and the four studied axes was studied using Kendall's correlation coefficient test.

RESULTS

The status of information management in IMMSS was desirable. Data gathering and storage axis and data processing and compilation axis achieved the highest (2.7±0.46) and the lowest (2.4±0.49) mean scores, respectively. The data-gathering method, control of a sample of women deaths in reproductive age in the universities of medical sciences, use of international classification of disease, and use of this system information by management teams to set resources allocation achieved the lowest mean scores in studied axes. Treatment deputy staff had a more positive attitude toward the status of information management of IMMSS than the health deputy staff (p=0.004).

CONCLUSION

Although the status of information management in IMMSS was desirable, it could be improved by modification of the data-gathering method; creating communication links between different data resources; a periodic sample control of women deaths in reproductive age in the universities of medical sciences; and implementing ICD-MM and integration of its rules on a unified system of death.