1
|
Almasi S, Bahaadinbeigy K, Ahmadi H, Sohrabei S, Rabiei R. Usability Evaluation of Dashboards: A Systematic Literature Review of Tools. BIOMED RESEARCH INTERNATIONAL 2023; 2023:9990933. [PMID: 36874923 PMCID: PMC9977530 DOI: 10.1155/2023/9990933] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/01/2023] [Revised: 01/16/2023] [Accepted: 02/04/2023] [Indexed: 02/25/2023]
Abstract
Introduction In recent years, the use of dashboards in healthcare has been considered an effective approach for the visual presentation of information to support clinical and administrative decisions. Effective and efficient use of dashboards in clinical and managerial processes requires a framework for the design and development of tools based on usability principles. Objectives The present study is aimed at investigating the existing questionnaires used for the usability evaluation framework of dashboards and at presenting more specific usability criteria for evaluating dashboards. Methods This systematic review was conducted using PubMed, Web of Science, and Scopus, without any time restrictions. The final search of articles was performed on September 2, 2022. Data collection was performed using a data extraction form, and the content of selected studies was analyzed based on the dashboard usability criteria. Results After reviewing the full text of relevant articles, a total of 29 studies were selected according to the inclusion criteria. Regarding the questionnaires used in the selected studies, researcher-made questionnaires were used in five studies, while 25 studies applied previously used questionnaires. The most widely used questionnaires were the System Usability Scale (SUS), Technology Acceptance Model (TAM), Situation Awareness Rating Technique (SART), Questionnaire for User Interaction Satisfaction (QUIS), Unified Theory of Acceptance and Use of Technology (UTAUT), and Health Information Technology Usability Evaluation Scale (Health-ITUES), respectively. Finally, dashboard evaluation criteria, including usefulness, operability, learnability, ease of use, suitability for tasks, improvement of situational awareness, satisfaction, user interface, content, and system capabilities, were suggested. Conclusion General questionnaires that were not specifically designed for dashboard evaluation were mainly used in reviewed studies. The current study suggested specific criteria for measuring the usability of dashboards. When selecting the usability evaluation criteria for dashboards, it is important to pay attention to the evaluation objectives, dashboard features and capabilities, and context of use.
Collapse
Affiliation(s)
- Sohrab Almasi
- Department of Health Information Technology and Management, School of Allied Medical Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Kambiz Bahaadinbeigy
- Digital Health Team, Australian College of Rural and Remote Medicine, Brisbane, QLD, Australia
- Medical Informatics Research Center, Institute for Futures Studies in Health, Kerman University of Medical Sciences, Kerman, Iran
| | - Hossein Ahmadi
- Centre for Health Technology, Faculty of Health, University of Plymouth, Plymouth PL4 8AA, UK
| | - Solmaz Sohrabei
- Department of Health Information Technology and Management, School of Allied Medical Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Reza Rabiei
- Department of Health Information Technology and Management, School of Allied Medical Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| |
Collapse
|
2
|
Rabiei R, Almasi S. Requirements and challenges of hospital dashboards: a systematic literature review. BMC Med Inform Decis Mak 2022; 22:287. [DOI: 10.1186/s12911-022-02037-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2022] [Accepted: 11/01/2022] [Indexed: 11/09/2022] Open
Abstract
Abstract
Background
Today, the use of data in administrative and clinical processes is quite challenging due to the large volume of data, data collection from various sources, and lack of data structure. As a data management tool, dashboards play an important role in timely visual display of critical information on key performances.
Objectives
This systematic review aimed to identify functional and non-functional requirements, as well as challenges of using dashboards in hospitals.
Methods
In this systematic review, four databases, including the Web of Science, PubMed, EMBASE, and Scopus, were searched to find relevant articles from 2000 until May 30, 2020. The final search was conducted on May 30, 2020. Data collection was performed using a data extraction form and reviewing the content of relevant studies on the potentials and challenges of dashboard implementation.
Results
Fifty-four out of 1254 retrieved articles were selected for this study based on the inclusion and exclusion criteria. The functional requirements for dashboards included reporting, reminders, customization, tracking, alert creation, and assessment of performance indicators. On the other hand, the non-functional requirements included the dashboard speed, security, ease of use, installation on different devices (e.g., PCs and laptops), integration with other systems, web-based design, inclusion of a data warehouse, being up-to-data, and use of data visualization elements based on the user’s needs. Moreover, the identified challenges were categorized into four groups: data sources, dashboard content, dashboard design, implementation, and integration in other systems at the hospital level.
Conclusion
Dashboards, by providing information in an appropriate manner, can lead to the proper use of information by users. In order for a dashboard to be effective in clinical and managerial processes, particular attention must be paid to its capabilities, and the challenges of its implementation need to be addressed.
Collapse
|
3
|
Schwarz M, Ward EC, Coccetti A, Burton K, Seabrook M, Newnham S, McCamley J, Hartley C. Digital dashboards: a speech pathology case study. AUST HEALTH REV 2022; 46:501-508. [PMID: 35831027 DOI: 10.1071/ah22011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2022] [Accepted: 06/23/2022] [Indexed: 11/23/2022]
Abstract
The introduction of electronic medical records has created vast opportunities in relation to data storage, visibility and extraction. In Allied Health the collection, storage, display and reporting of service statistics is a key opportunity to utilise the capabilities of the electronic medical record to reduce clinician time completing data entry, improve accuracy and visibility of available data and maximise opportunities to view and utilise service statistic information in clinical and operational decision making. This case study describes service statistic capture and extraction for a speech pathology department, pre- and post- the introduction of a digital dashboard. A new Allied Health digital dashboard was created via clinicians and informaticians working collaboratively to define service delivery elements for data extraction and design dashboard functionality. Descriptive comparison of data capture pre- and post- dashboard implementation was undertaken. The integration of service statistic information into a digital dashboard was found to support service statistic reporting, improve ease of access, and provide greater visibility and timeliness of service information.
Collapse
Affiliation(s)
- Maria Schwarz
- Logan Hospital, Metro South Hospital and Health Service, Queensland Health, Qld, Australia
| | - Elizabeth C Ward
- School of Health and Rehabilitation Sciences, University of Queensland, Qld, Australia; and Centre for Functioning and Health Research, Metro South Hospital and Health Service, Queensland Health, Qld, Australia
| | - Anne Coccetti
- Logan Hospital, Metro South Hospital and Health Service, Queensland Health, Qld, Australia
| | - Kate Burton
- Logan Hospital, Metro South Hospital and Health Service, Queensland Health, Qld, Australia
| | - Marnie Seabrook
- Logan Hospital, Metro South Hospital and Health Service, Queensland Health, Qld, Australia
| | - Siobhan Newnham
- Logan Hospital, Metro South Hospital and Health Service, Queensland Health, Qld, Australia
| | - Jordan McCamley
- Logan Hospital, Metro South Hospital and Health Service, Queensland Health, Qld, Australia
| | - Carina Hartley
- Logan Hospital, Metro South Hospital and Health Service, Queensland Health, Qld, Australia
| |
Collapse
|
4
|
Opie J, Bellio M, Williams R, Sussman M, Voegele P, Welch J, Blandford A. Requirements for a Dashboard to Support Quality Improvement Teams in Pain Management. Front Big Data 2021; 4:654914. [PMID: 34746769 PMCID: PMC8567310 DOI: 10.3389/fdata.2021.654914] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2021] [Accepted: 04/07/2021] [Indexed: 11/18/2022] Open
Abstract
Pain management is often considered lower priority than many other aspects of health management in hospitals. However, there is potential for Quality Improvement (QI) teams to improve pain management by visualising and exploring pain data sets. Although dashboards are already used by QI teams in hospitals, there is limited evidence of teams accessing visualisations to support their decision making. This study aims to identify the needs of the QI team in a UK Critical Care Unit (CCU) and develop dashboards that visualise longitudinal data on the efficacy of patient pain management to assist the team in making informed decisions to improve pain management within the CCU. This research is based on an analysis of transcripts of interviews with healthcare professionals with a variety of roles in the CCU and their evaluation of probes. We identified two key uses of pain data: direct patient care (focusing on individual patient data) and QI (aggregating data across the CCU and over time); in this paper, we focus on the QI role. We have identified how CCU staff currently interpret information and determine what supplementary information can better inform their decision making and support sensemaking. From these, a set of data visualisations has been proposed, for integration with the hospital electronic health record. These visualisations are being iteratively refined in collaboration with CCU staff and technical staff responsible for maintaining the electronic health record. The paper presents user requirements for QI in pain management and a set of visualisations, including the design rationale behind the various methods proposed for visualising and exploring pain data using dashboards.
Collapse
Affiliation(s)
- Jeremy Opie
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS), University College London (UCL), London, United Kingdom
| | - Maura Bellio
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS), University College London (UCL), London, United Kingdom
| | - Rachel Williams
- University College London Interaction Centre (UCLIC), London, United Kingdom
| | - Maya Sussman
- Critical Care Unit, University College London Hospital (UCLH), London, United Kingdom
| | - Petra Voegele
- Critical Care Unit, University College London Hospital (UCLH), London, United Kingdom
| | - John Welch
- Critical Care Unit, University College London Hospital (UCLH), London, United Kingdom
| | - Ann Blandford
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS), University College London (UCL), London, United Kingdom
| |
Collapse
|
5
|
Schiro J, Pelayo S, Martinot A, Dubos F, Beuscart-Zéphir MC, Marcilly R. Applying a Human-Centered Design to Develop a Patient Prioritization Tool for a Pediatric Emergency Department: Detailed Case Study of First Iterations. JMIR Hum Factors 2020; 7:e18427. [PMID: 32886071 PMCID: PMC7501580 DOI: 10.2196/18427] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2020] [Revised: 06/06/2020] [Accepted: 06/07/2020] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND Overcrowding in the emergency departments has become an increasingly significant problem. Patient triage strategies are acknowledged to help clinicians manage patient flow and reduce patients' waiting time. However, electronic patient triage systems are not developed so that they comply with clinicians' workflow. OBJECTIVE This case study presents the development of a patient prioritization tool (PPT) and of the related patient prioritization algorithm (PPA) for a pediatric emergency department (PED), relying on a human-centered design process. METHODS We followed a human-centered design process, wherein we (1) performed a work system analysis through observations and interviews in an academic hospital's PED; (2) deduced design specifications; (3) designed a mock PPT and the related PPA; and (4) performed user testing to assess the intuitiveness of the icons, the effectiveness in communicating patient priority, the fit between the prioritization model implemented and the participants' prioritization rules, and the participants' satisfaction. RESULTS The workflow analysis identified that the PPT interface should meet the needs of physicians and nurses, represent the stages of patient care, and contain patient information such as waiting time, test status (eg, prescribed, in progress), age, and a suggestion for prioritization. The mock-up developed gives the status of patients progressing through the PED; a strip represents the patient and the patient's characteristics, including a delay indicator that compares the patient's waiting time to the average waiting time of patients with a comparable reason for emergency. User tests revealed issues with icon intuitiveness, information gaps, and possible refinements in the prioritization algorithm. CONCLUSIONS The results of the user tests have led to modifications to improve the usability and usefulness of the PPT and its PPA. We discuss the value of integrating human factors into the design process for a PPT for PED. The PPT/PPA has been developed and installed in Lille University Hospital's PED. Studies are carried out to evaluate the use and impact of this tool on clinicians' situation awareness and prioritization-related cognitive load, prioritization of patients, waiting time, and patients' experience.
Collapse
Affiliation(s)
- Jessica Schiro
- Inserm, CIC-IT 1403/Evalab, F-59000, Lille, France.,Univ Lille, CHU Lille, ULR 2694 - METRICS : Évaluation des technologies de santé et des pratiques médicales, F-59000, Lille, France
| | - Sylvia Pelayo
- Inserm, CIC-IT 1403/Evalab, F-59000, Lille, France.,Univ Lille, CHU Lille, ULR 2694 - METRICS : Évaluation des technologies de santé et des pratiques médicales, F-59000, Lille, France
| | - Alain Martinot
- Univ Lille, CHU Lille, ULR 2694 - METRICS : Évaluation des technologies de santé et des pratiques médicales, F-59000, Lille, France.,Paediatric Emergency Unit & Infectious Diseases, CHU Lille, Lille, France
| | - François Dubos
- Univ Lille, CHU Lille, ULR 2694 - METRICS : Évaluation des technologies de santé et des pratiques médicales, F-59000, Lille, France.,Paediatric Emergency Unit & Infectious Diseases, CHU Lille, Lille, France
| | - Marie-Catherine Beuscart-Zéphir
- Inserm, CIC-IT 1403/Evalab, F-59000, Lille, France.,Univ Lille, CHU Lille, ULR 2694 - METRICS : Évaluation des technologies de santé et des pratiques médicales, F-59000, Lille, France
| | - Romaric Marcilly
- Inserm, CIC-IT 1403/Evalab, F-59000, Lille, France.,Univ Lille, CHU Lille, ULR 2694 - METRICS : Évaluation des technologies de santé et des pratiques médicales, F-59000, Lille, France
| |
Collapse
|
6
|
Fischer MJ, Kourany WM, Sovern K, Forrester K, Griffin C, Lightner N, Loftus S, Murphy K, Roth G, Palevsky PM, Crowley ST. Development, implementation and user experience of the Veterans Health Administration (VHA) dialysis dashboard. BMC Nephrol 2020; 21:136. [PMID: 32299383 PMCID: PMC7160999 DOI: 10.1186/s12882-020-01798-6] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2019] [Accepted: 04/06/2020] [Indexed: 11/17/2022] Open
Abstract
BACKGROUND Adults with end-stage renal disease (ESRD) requiring chronic dialysis continue to suffer from poor health outcomes and represent a population rightfully targeted for quality improvement. Electronic dashboards are increasingly used in healthcare to facilitate quality measurement and improvement. However, detailed descriptions of the creation of healthcare dashboards are uncommonly available and formal inquiry into perceptions, satisfaction, and utility by clinical users has been rarely conducted, particularly in the context of dialysis care. Therefore, we characterized the development, implementation and user experience with Veterans Health Administration (VHA) dialysis dashboard. METHODS A clinical-quality dialysis dashboard was implemented, which displays clinical performance measures (CPMs) for Veterans with ESRD receiving chronic hemodialysis at all VHA facilities. Data on user experience and perceptions were collected via an e-mail questionnaire to dialysis medical directors and nurse managers at these facilities. RESULTS Since 2016 the dialysis dashboard reports monthly on CPMs for approximately 3000 Veterans receiving chronic hemodialysis across 70 VHA dialysis facilities. Of 141 dialysis medical directors and nurse managers, 61 completed the questionnaire. Sixty-six percent of respondents did not find the dashboard difficult to access, 64% agreed that it is easy to use, 59% agreed that its layout is good, and the majority agreed that presentation of data is clear (54%), accurate (56%), and up-to-date (54%). Forty-eight percent of respondents indicated that it helped them improve patient care while 12% did not. Respondents indicated that they used the dialysis dashboard for clinical reporting (71%), quality assessment/performance improvement (QAPI) (62%), and decision-making (23%). CONCLUSIONS Most users of the VHA dialysis dashboard found it accurate, up-to-date, easy to use, and helpful in improving patient care. It meets diverse user needs, including administrative reporting, clinical benchmarking and decision-making, and quality assurance and performance improvement (QAPI) activities. Moreover, the VHA dialysis dashboard affords national-, regional- and facility-level assessments of quality of care, guides and motivates best clinical practices, targets QAPI efforts, and informs and promotes population health management improvement efforts for Veterans receiving chronic hemodialysis.
Collapse
Affiliation(s)
- Michael J Fischer
- Jesse Brown VA Medical Center, Chicago, IL, USA.
- Center of Innovation for Complex Chronic Healthcare, Edward Hines Jr. VA Hospital, 5000 S. 5th Avenue (151H), Hines, IL, 60141, USA.
- University of Illinois Hospital and Health Sciences Center, Chicago, IL, USA.
| | - Wissam M Kourany
- Veteran Affairs Durham Healthcare System, Durham, NC, USA
- Duke University, Durham, NC, USA
| | - Karen Sovern
- Cincinnati VA Medical Center, Cincinnati, OH, USA
| | | | | | - Nancy Lightner
- Veterans Management Services, Inc., Indianapolis VA, Indianapolis, IN, USA
| | - Shawn Loftus
- , Department of Veterans Affairs, Washington DC, USA
| | | | - Greg Roth
- Cincinnati VA Medical Center, Cincinnati, OH, USA
| | - Paul M Palevsky
- VA Pittsburgh Healthcare System, Pittsburgh, PA, USA
- University of Pittsburgh School of Medicine, Pittsburgh, PA, USA
| | - Susan T Crowley
- VA Connecticut Healthcare System, West Haven, CT, USA
- Yale University School of Medicine, New Haven, CT, USA
| |
Collapse
|
7
|
Wong T, Brovman EY, Rao N, Tsai MH, Urman RD. A Dashboard Prototype for Tracking the Impact of Diabetes on Hospital Readmissions Using a National Administrative Database. J Clin Med Res 2020; 12:18-25. [PMID: 32010418 PMCID: PMC6968923 DOI: 10.14740/jocmr4029] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2019] [Accepted: 12/03/2019] [Indexed: 01/05/2023] Open
Abstract
Background Over the past several decades, diabetes mellitus has contributed to a significant disease burden in the general population. Evidence suggests that patients with a coexisting diabetes diagnosis consume more hospital resources, and have higher readmission rates compared to those who do not. Against the backdrop of bundled-payment programs, healthcare systems cannot underestimate the importance of monitoring patient health information at the population level. Methods Using the data from the Centers for Medicare and Medicaid Services (CMS) administrative claims database, we created a dashboard prototype to enable hospitals to examine the impact of diabetes on their all-cause readmission rates and financial implications if diabetes was present at the index hospitalization. The technical design involved loading the relevant 10th revision of International Classification of Diseases (ICD-10) codes provided by the medical team and flagging diabetes patients at the claim. These patients were then tagged for readmissions within the same database. The odds ratios were determined based on data from two groups: those with diabetes at index hospitalization which include type 1 only, type 2 only, and type 1 and type 2 diabetes, plus those without diabetes at index hospitalization. Results The dashboard presents summary data of diabetes readmissions quality metrics at a national level. Users can visualize summary data of each state and compare odds ratios for readmissions as well as raw hospitalization data at their facility. Dashboard users can also view data classified by a diagnosis-related group (DRG) system. In addition to a “national” data view, for users who inquire about data specific to demographic regions, the DRG view can be further stratified at the state level or county level. At the DRG level, users can view data about the cost per readmissions for all index hospitalization with and without diabetes. Conclusions The dashboard prototype offers users a virtual interface which displays visual data for quick interpretation, monitors changes at a population level, and enables administrators to benchmark facility data against local and national trends. This is an important step in using data analytics to drive population level decision making to ultimately improve medical systems.
Collapse
Affiliation(s)
- Timothy Wong
- Department of Anesthesiology, University of Vermont College of Medicine, Burlington, VT, USA
| | - Ethan Y Brovman
- Department of Anesthesiology, Perioperative and Pain Medicine, Brigham and Women's Hospital, Boston, MA, USA
| | | | - Mitchell H Tsai
- Department of Anesthesiology, University of Vermont College of Medicine, Burlington, VT, USA.,Department of Orthopaedics and Rehabilitation, University of Vermont College of Medicine, Burlington, VT, USA.,Department of Surgery, University of Vermont College of Medicine, Burlington, VT, USA
| | - Richard D Urman
- Department of Anesthesiology, Perioperative and Pain Medicine, Brigham and Women's Hospital, Boston, MA, USA
| |
Collapse
|
8
|
Dagliati A, Sacchi L, Tibollo V, Cogni G, Teliti M, Martinez-Millana A, Traver V, Segagni D, Posada J, Ottaviano M, Fico G, Arredondo MT, De Cata P, Chiovato L, Bellazzi R. A dashboard-based system for supporting diabetes care. J Am Med Inform Assoc 2019; 25:538-547. [PMID: 29409033 DOI: 10.1093/jamia/ocx159] [Citation(s) in RCA: 37] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2017] [Accepted: 12/29/2017] [Indexed: 11/14/2022] Open
Abstract
Objective To describe the development, as part of the European Union MOSAIC (Models and Simulation Techniques for Discovering Diabetes Influence Factors) project, of a dashboard-based system for the management of type 2 diabetes and assess its impact on clinical practice. Methods The MOSAIC dashboard system is based on predictive modeling, longitudinal data analytics, and the reuse and integration of data from hospitals and public health repositories. Data are merged into an i2b2 data warehouse, which feeds a set of advanced temporal analytic models, including temporal abstractions, care-flow mining, drug exposure pattern detection, and risk-prediction models for type 2 diabetes complications. The dashboard has 2 components, designed for (1) clinical decision support during follow-up consultations and (2) outcome assessment on populations of interest. To assess the impact of the clinical decision support component, a pre-post study was conducted considering visit duration, number of screening examinations, and lifestyle interventions. A pilot sample of 700 Italian patients was investigated. Judgments on the outcome assessment component were obtained via focus groups with clinicians and health care managers. Results The use of the decision support component in clinical activities produced a reduction in visit duration (P ≪ .01) and an increase in the number of screening exams for complications (P < .01). We also observed a relevant, although nonstatistically significant, increase in the proportion of patients receiving lifestyle interventions (from 69% to 77%). Regarding the outcome assessment component, focus groups highlighted the system's capability of identifying and understanding the characteristics of patient subgroups treated at the center. Conclusion Our study demonstrates that decision support tools based on the integration of multiple-source data and visual and predictive analytics do improve the management of a chronic disease such as type 2 diabetes by enacting a successful implementation of the learning health care system cycle.
Collapse
Affiliation(s)
- Arianna Dagliati
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Pavia, Italy.,Manchester Molecular Pathology Innovation Centre, Division of Informatics, Imaging & Data Sciences, University of Manchester, Manchester, UK.,Laboratorio Informatica Sistemistica Ricerca Clinica, ICS Maugeri, Pavia, Italy
| | - Lucia Sacchi
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Pavia, Italy
| | - Valentina Tibollo
- Laboratorio Informatica Sistemistica Ricerca Clinica, ICS Maugeri, Pavia, Italy
| | - Giulia Cogni
- UO di Medicina Interna e Endocrinologia, ICS Maugeri, Pavia, Italy
| | - Marsida Teliti
- UO di Medicina Interna e Endocrinologia, ICS Maugeri, Pavia, Italy
| | | | - Vicente Traver
- ITACA. Universitat Politècnica de València, Valencia, Spain
| | - Daniele Segagni
- Laboratorio Informatica Sistemistica Ricerca Clinica, ICS Maugeri, Pavia, Italy
| | - Jorge Posada
- Integrated Health Solutions, Medtronic Ibérica, Madrid, Spain
| | - Manuel Ottaviano
- Departamento de Tecnología Fotónica y Bioingeniería, Universidad Politècnica de Madrid, Madrid, Spain
| | - Giuseppe Fico
- Departamento de Tecnología Fotónica y Bioingeniería, Universidad Politècnica de Madrid, Madrid, Spain
| | - Maria Teresa Arredondo
- Departamento de Tecnología Fotónica y Bioingeniería, Universidad Politècnica de Madrid, Madrid, Spain
| | - Pasquale De Cata
- UO di Medicina Interna e Endocrinologia, ICS Maugeri, Pavia, Italy
| | - Luca Chiovato
- UO di Medicina Interna e Endocrinologia, ICS Maugeri, Pavia, Italy.,Dipartimento di Medicina Interna e Terapia medica, University of Pavia, Pavia, Italy
| | - Riccardo Bellazzi
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Pavia, Italy.,Laboratorio Informatica Sistemistica Ricerca Clinica, ICS Maugeri, Pavia, Italy
| |
Collapse
|
9
|
Gong Z, Han Z, Li X, Yu C, Reinhardt JD. Factors Influencing the Adoption of Online Health Consultation Services: The Role of Subjective Norm, Trust, Perceived Benefit, and Offline Habit. Front Public Health 2019; 7:286. [PMID: 31637229 PMCID: PMC6787145 DOI: 10.3389/fpubh.2019.00286] [Citation(s) in RCA: 35] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2019] [Accepted: 09/19/2019] [Indexed: 11/13/2022] Open
Abstract
The cyberspace plays an important role in improving the quality, equity, and efficiency of health services. Studying people's adoption of online health services, such as online health consultation services (OHCS) can benefit both industry and policy in the health service sector. This paper investigates influencing factors and paths of people's intention of adopting OHCS by employing the extended valence framework, with our new contribution of integrating subjective norm and offline habit into the model. Five hundred forty-three university students participated in the survey. Structural equation models and Sobel-Goodman tests were applied to test the models. The results show that subjective norm (β = 0.077, p = 0.041), trust in providers (β = 0.194, p = 0.002) and perceived benefit (β = 0.463, p < 0.001) positively affect the intention to adopt OHCS, while offline habit (β = -0.111, p = 0.026) has a negative effect. However, the association of perceived risk (β = -0.062, p = 0.315) and adoption is not supported. Moreover, trust in providers plays a mediating role between subjective norm and the intention of adopting, while perceived benefit mediates the relationship between trust in providers and the intention of adopting. This study highlights the importance of trust, subjective norm, perceived benefit, and persisting habits in promoting the adoption of OHCS.
Collapse
Affiliation(s)
- Zepeng Gong
- Institute for Disaster Management and Reconstruction, Sichuan University, Chengdu, China.,West China School of Public Health and West China Fourth Hospital, Sichuan University, Chengdu, China
| | - Ziqiang Han
- School of Political Science and Public Administration, Shandong University, Qingdao, China
| | - Xudan Li
- Institute for Disaster Management and Reconstruction, Sichuan University, Chengdu, China.,West China School of Public Health and West China Fourth Hospital, Sichuan University, Chengdu, China
| | - Chao Yu
- School of Public Administration, Sichuan University, Chengdu, China
| | - Jan D Reinhardt
- Institute for Disaster Management and Reconstruction, Sichuan University, Chengdu, China.,Swiss Paraplegic Research, Nottwil, Switzerland.,Department of Health Sciences and Health Policy, University of Lucerne, Lucerne, Switzerland
| |
Collapse
|
10
|
Rivas C, Tkacz D, Antao L, Mentzakis E, Gordon M, Anstee S, Giordano R. Automated analysis of free-text comments and dashboard representations in patient experience surveys: a multimethod co-design study. HEALTH SERVICES AND DELIVERY RESEARCH 2019. [DOI: 10.3310/hsdr07230] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
BackgroundPatient experience surveys (PESs) often include informative free-text comments, but with no way of systematically, efficiently and usefully analysing and reporting these. The National Cancer Patient Experience Survey (CPES), used to model the approach reported here, generates > 70,000 free-text comments annually.Main aimTo improve the use and usefulness of PES free-text comments in driving health service changes that improve the patient experience.Secondary aims(1) To structure CPES free-text comments using rule-based information retrieval (IR) (‘text engineering’), drawing on health-care domain-specific gazetteers of terms, with in-built transferability to other surveys and conditions; (2) to display the results usefully for health-care professionals, in a digital toolkit dashboard display that drills down to the original free text; (3) to explore the usefulness of interdisciplinary mixed stakeholder co-design and consensus-forming approaches in technology development, ensuring that outputs have meaning for all; and (4) to explore the usefulness of Normalisation Process Theory (NPT) in structuring outputs for implementation and sustainability.DesignA scoping review, rapid review and surveys with stakeholders in health care (patients, carers, health-care providers, commissioners, policy-makers and charities) explored clinical dashboard design/patient experience themes. The findings informed the rules for the draft rule-based IR [developed using half of the 2013 Wales CPES (WCPES) data set] and prototype toolkit dashboards summarising PES data. These were refined following mixed stakeholder, concept-mapping workshops and interviews, which were structured to enable consensus-forming ‘co-design’ work. IR validation used the second half of the WCPES, with comparison against its manual analysis; transferability was tested using further health-care data sets. A discrete choice experiment (DCE) explored which toolkit features were preferred by health-care professionals, with a simple cost–benefit analysis. Structured walk-throughs with NHS managers in Wessex, London and Leeds explored usability and general implementation into practice.Key outcomesA taxonomy of ranked PES themes, a checklist of key features recommended for digital clinical toolkits, rule-based IR validation and transferability scores, usability, and goal-oriented, cost–benefit and marketability results. The secondary outputs were a survey, scoping and rapid review findings, and concordance and discordance between stakeholders and methods.Results(1) The surveys, rapid review and workshops showed that stakeholders differed in their understandings of the patient experience and priorities for change, but that they reached consensus on a shortlist of 19 themes; six were considered to be core; (2) the scoping review and one survey explored the clinical toolkit design, emphasising that such toolkits should be quick and easy to use, and embedded in workflows; the workshop discussions, the DCE and the walk-throughs confirmed this and foregrounded other features to form the toolkit design checklist; and (3) the rule-based IR, developed using noun and verb phrases and lookup gazetteers, was 86% accurate on the WCPES, but needs modification to improve this and to be accurate with other data sets. The DCE and the walk-through suggest that the toolkit would be well accepted, with a favourable cost–benefit ratio, if implemented into practice with appropriate infrastructure support.LimitationsSmall participant numbers and sampling bias across component studies. The scoping review studies mostly used top-down approaches and focused on professional dashboards. The rapid review of themes had limited scope, with no second reviewer. The IR needs further refinement, especially for transferability. New governance restrictions further limit immediate use.ConclusionsUsing a multidisciplinary, mixed stakeholder, use of co-design, proof of concept was shown for an automated display of patient experience free-text comments in a way that could drive health-care improvements in real time. The approach is easily modified for transferable application.Future workFurther exploration is needed of implementation into practice, transferable uses and technology development co-design approaches.FundingThe National Institute for Health Research Health Services and Delivery Research programme.
Collapse
Affiliation(s)
- Carol Rivas
- Faculty of Health Sciences, University of Southampton, Southampton, UK
- Department of Social Science Research Unit, University College London, London, UK
| | - Daria Tkacz
- Faculty of Health Sciences, University of Southampton, Southampton, UK
| | - Laurence Antao
- Faculty of Health Sciences, University of Southampton, Southampton, UK
| | - Emmanouil Mentzakis
- Economics within Social Sciences, University of Southampton, Southampton, UK
| | | | - Sydney Anstee
- Faculty of Health Sciences, University of Southampton, Southampton, UK
| | - Richard Giordano
- Faculty of Health Sciences, University of Southampton, Southampton, UK
| |
Collapse
|
11
|
Dowding D, Merrill JA, Onorato N, Barrón Y, Rosati RJ, Russell D. The impact of home care nurses' numeracy and graph literacy on comprehension of visual display information: implications for dashboard design. J Am Med Inform Assoc 2019; 25:175-182. [PMID: 28460091 DOI: 10.1093/jamia/ocx042] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2016] [Accepted: 03/31/2017] [Indexed: 12/17/2022] Open
Abstract
Objective To explore home care nurses' numeracy and graph literacy and their relationship to comprehension of visualized data. Materials and Methods A multifactorial experimental design using online survey software. Nurses were recruited from 2 Medicare-certified home health agencies. Numeracy and graph literacy were measured using validated scales. Nurses were randomized to 1 of 4 experimental conditions. Each condition displayed data for 1 of 4 quality indicators, in 1 of 4 different visualized formats (bar graph, line graph, spider graph, table). A mixed linear model measured the impact of numeracy, graph literacy, and display format on data understanding. Results In all, 195 nurses took part in the study. They were slightly more numerate and graph literate than the general population. Overall, nurses understood information presented in bar graphs most easily (88% correct), followed by tables (81% correct), line graphs (77% correct), and spider graphs (41% correct). Individuals with low numeracy and low graph literacy had poorer comprehension of information displayed across all formats. High graph literacy appeared to enhance comprehension of data regardless of numeracy capabilities. Discussion and Conclusion Clinical dashboards are increasingly used to provide information to clinicians in visualized format, under the assumption that visual display reduces cognitive workload. Results of this study suggest that nurses' comprehension of visualized information is influenced by their numeracy, graph literacy, and the display format of the data. Individual differences in numeracy and graph literacy skills need to be taken into account when designing dashboard technology.
Collapse
Affiliation(s)
- Dawn Dowding
- Columbia University School of Nursing, New York, NY, USA.,Center for Home Care Policy and Research, Visiting Nurse Service of New York, New York, NY, USA
| | | | - Nicole Onorato
- Center for Home Care Policy and Research, Visiting Nurse Service of New York, New York, NY, USA
| | - Yolanda Barrón
- Center for Home Care Policy and Research, Visiting Nurse Service of New York, New York, NY, USA
| | | | - David Russell
- Center for Home Care Policy and Research, Visiting Nurse Service of New York, New York, NY, USA
| |
Collapse
|
12
|
Yoo J, Jung KY, Kim T, Lee T, Hwang SY, Yoon H, Shin TG, Sim MS, Jo IJ, Paeng H, Choi JS, Cha WC. A Real-Time Autonomous Dashboard for the Emergency Department: 5-Year Case Study. JMIR Mhealth Uhealth 2018; 6:e10666. [PMID: 30467100 PMCID: PMC6284143 DOI: 10.2196/10666] [Citation(s) in RCA: 20] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2018] [Revised: 07/02/2018] [Accepted: 08/10/2018] [Indexed: 01/23/2023] Open
Abstract
Background The task of monitoring and managing the entire emergency department (ED) is becoming more important due to increasing pressure on the ED. Recently, dashboards have received the spotlight as health information technology to support these tasks. Objective This study aimed to describe the development of a real-time autonomous dashboard for the ED and to evaluate perspectives of clinical staff on its usability. Methods We developed a dashboard based on three principles—“anytime, anywhere, at a glance;” “minimal interruption to workflow;” and “protect patient privacy”—and 3 design features—“geographical layout,” “patient-level alert,” and “real-time summary data.” Items to evaluate the dashboard were selected based on the throughput factor of the conceptual model of ED crowding. Moreover, ED physicians and nurses were surveyed using the system usability scale (SUS) and situation awareness index as well as a questionnaire we created on the basis of the construct of the Situation Awareness Rating Technique. Results The first version of the ED dashboard was successfully launched in 2013, and it has undergone 3 major revisions since then because of geographical changes in ED and modifications to improve usability. A total of 52 ED staff members participated in the survey. The average SUS score of the dashboard was 67.6 points, which indicates “OK-to-Good” usability. The participants also reported that the dashboard provided efficient “concentration support” (4.15 points), “complexity representation” (4.02 points), “variability representation” (3.96 points), “information quality” (3.94 points), and “familiarity” (3.94 points). However, the “division of attention” was rated at 2.25 points. Conclusions We developed a real-time autonomous ED dashboard and successfully used it for 5 years with good evaluation from users.
Collapse
Affiliation(s)
- Junsang Yoo
- SAIHST, Department of Digital Health, Sungkyunkwan University, Seoul, Republic of Korea
| | - Kwang Yul Jung
- Department of Emergency Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea
| | - Taerim Kim
- Department of Emergency Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea
| | - Taerim Lee
- Department of Emergency Medicine, Chamjoeun Hospital, Gwangju, Republic of Korea
| | - Sung Yeon Hwang
- Department of Emergency Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea
| | - Hee Yoon
- Department of Emergency Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea
| | - Tae Gun Shin
- Department of Emergency Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea
| | - Min Seob Sim
- Department of Emergency Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea
| | - Ik Joon Jo
- Department of Emergency Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea
| | - Hansol Paeng
- Human Understanding Design Center (HUDC), Seoul Medical Center, Seoul, Republic of Korea
| | - Jong Soo Choi
- SAIHST, Department of Digital Health, Sungkyunkwan University, Seoul, Republic of Korea.,Health Information Center, Samsung Medical Center, Seoul, Republic of Korea
| | - Won Chul Cha
- Department of Emergency Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea.,Health Information Center, Samsung Medical Center, Seoul, Republic of Korea.,Department of Digital Health, Samsung Advanced Institute of Health Sciences and Technology, Sungkyunkwan University, Seoul, Republic of Korea
| |
Collapse
|
13
|
An Electronic Dashboard to Monitor Patient Flow at the Johns Hopkins Hospital: Communication of Key Performance Indicators Using the Donabedian Model. J Med Syst 2018; 42:133. [PMID: 29915933 DOI: 10.1007/s10916-018-0988-4] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2018] [Accepted: 06/07/2018] [Indexed: 10/14/2022]
Abstract
Efforts to monitoring and managing hospital capacity depend on the ability to extract relevant time-stamped data from electronic medical records and other information technologies. However, the various characterizations of patient flow, cohort decisions, sub-processes, and the diverse stakeholders requiring data visibility create further overlying complexity. We use the Donabedian model to prioritize patient flow metrics and build an electronic dashboard for enabling communication. Ten metrics were identified as key indicators including outcome (length of stay, 30-day readmission, operating room exit delays, capacity-related diversions), process (timely inpatient unit discharge, emergency department disposition), and structural metrics (occupancy, discharge volume, boarding, bed assignation duration). Dashboard users provided real-life examples of how the tool is assisting capacity improvement efforts, and user traffic data revealed an uptrend in dashboard utilization from May to October 2017 (26 to 148 views per month, respectively). Our main contributions are twofold. The former being the results and methods for selecting key performance indicators for a unit, department, and across the entire hospital (i.e., separating signal from noise). The latter being an electronic dashboard deployed and used at The Johns Hopkins Hospital to visualize these ten metrics and communicate systematically to hospital stakeholders. Integration of diverse information technology may create further opportunities for improved hospital capacity.
Collapse
|
14
|
Information architecture for a patient-specific dashboard in head and neck tumor boards. Int J Comput Assist Radiol Surg 2018; 13:1283-1290. [PMID: 29594852 DOI: 10.1007/s11548-018-1741-7] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2018] [Accepted: 03/19/2018] [Indexed: 01/20/2023]
Abstract
PURPOSE Overcoming the flaws of current data management conditions in head and neck oncology could enable integrated information systems specifically tailored to the needs of medical experts in a tumor board meeting. Clinical dashboards are a promising method to assist various aspects of the decision-making process in such cognitively demanding scenarios. However, in order to provide extensive and intuitive assistance to the participating physicians, the design and development of such a system have to be user-centric. To accomplish this task, conceptual methods need to be performed prior to the technical development and integration stages. METHODS We have conducted a qualitative survey including eight clinical experts with different levels of expertise in the field of head and neck oncology. According to the principles of information architecture, the survey focused on the identification and causal interconnection of necessary metrics for information assessment in the tumor board. RESULTS Based on the feedback by the clinical experts, we have constructed a detailed map of the required information items for a tumor board dashboard in head and neck oncology. Furthermore, we have identified three distinct groups of metrics (patient, disease and therapy metrics) as well as specific recommendations for their structural and graphical implementation. CONCLUSION By using the information architecture, we were able to gather valuable feedback about the requirements and cognitive processes of the tumor board members. Those insights have helped us to develop a dashboard application that closely adapts to the specified needs and characteristics, and thus is primarily user-centric.
Collapse
|
15
|
Ellsworth MA, Dziadzko M, O'Horo JC, Farrell AM, Zhang J, Herasevich V. An appraisal of published usability evaluations of electronic health records via systematic review. J Am Med Inform Assoc 2017; 24:218-226. [PMID: 27107451 PMCID: PMC7654077 DOI: 10.1093/jamia/ocw046] [Citation(s) in RCA: 66] [Impact Index Per Article: 9.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2015] [Revised: 02/25/2016] [Accepted: 03/01/2016] [Indexed: 02/07/2023] Open
Abstract
OBJECTIVE In this systematic review, we aimed to evaluate methodological and reporting trends present in the current literature by investigating published usability studies of electronic health records (EHRs). METHODS A literature search was conducted for articles published through January 2015 using MEDLINE (Ovid), EMBASE, Scopus, and Web of Science, supplemented by citation and reference list reviews. Studies were included if they tested the usability of hospital and clinic EHR systems in the inpatient, outpatient, emergency department, or operating room setting. RESULTS A total of 4848 references were identified for title and abstract screening. Full text screening was performed for 197 articles, with 120 meeting the criteria for study inclusion. CONCLUSION A review of the literature demonstrates a paucity of quality published studies describing scientifically valid and reproducible usability evaluations at various stages of EHR system development. A lack of formal and standardized reporting of EHR usability evaluation results is a major contributor to this knowledge gap, and efforts to improve this deficiency will be one step of moving the field of usability engineering forward.
Collapse
Affiliation(s)
- Marc A Ellsworth
- Division of Neonatal Medicine, Mayo Clinic, Rochester, MN, USA
- Multidisciplinary Epidemiology and Translational Research in Critical Care, Emergency and Perioperative Medicine (METRIC-PM) Group, Mayo Clinic, Rochester, MN, USA
| | - Mikhail Dziadzko
- Multidisciplinary Epidemiology and Translational Research in Critical Care, Emergency and Perioperative Medicine (METRIC-PM) Group, Mayo Clinic, Rochester, MN, USA
- Department of Anesthesiology, Mayo Clinic, Rochester, MN, USA
| | - John C O'Horo
- Multidisciplinary Epidemiology and Translational Research in Critical Care, Emergency and Perioperative Medicine (METRIC-PM) Group, Mayo Clinic, Rochester, MN, USA
- Division of Infectious Diseases, Mayo Clinic, Rochester, MN, USA
| | - Ann M Farrell
- Mayo Clinic Libraries, Mayo Clinic, Rochester, MN, USA
| | - Jiajie Zhang
- School of Health Information Sciences, University of Texas Health Science Center at Houston, Houston, TX, USA
| | - Vitaly Herasevich
- Multidisciplinary Epidemiology and Translational Research in Critical Care, Emergency and Perioperative Medicine (METRIC-PM) Group, Mayo Clinic, Rochester, MN, USA
- Department of Anesthesiology, Mayo Clinic, Rochester, MN, USA
| |
Collapse
|
16
|
Lee K, Jung SY, Hwang H, Yoo S, Baek HY, Baek RM, Kim S. A novel concept for integrating and delivering health information using a comprehensive digital dashboard: An analysis of healthcare professionals' intention to adopt a new system and the trend of its real usage. Int J Med Inform 2016; 97:98-108. [PMID: 27919400 DOI: 10.1016/j.ijmedinf.2016.10.001] [Citation(s) in RCA: 27] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2016] [Revised: 09/21/2016] [Accepted: 10/01/2016] [Indexed: 11/17/2022]
Abstract
OBJECTIVE To introduce a new concept of medical dashboard system called BESTBoard. Such a system was implemented in all wards in a tertiary academic hospital to explore the development process, core designs, functions, usability and feasibility. METHODS The task-force team made user interface designs for 6 months based on a need analysis. Hardware configuration and software development was carried out for 3 months. We conducted a survey of 383 physicians and nurses to determine the usability and feasibility of the system. RESULTS In March 2012, the system was installed in all wards, including the intensive care units, emergency rooms, operation rooms, and even delivery rooms. Healthcare professionals had access to all information of EHRs optimized for a large 55-inch touchscreen. The satisfaction rate of BESTBoard users was high, with a mean of 3.3 points. Voluntary users tended to consider BESTBoard as a good system that is useful for team round visits, interdisciplinary team approach, and collecting the status of the hospital rooms. Elderly users didn't tend to think of BESTBoard as a useful tool for interdisciplinary team approach and collecting the status of the hospital rooms. Greater expectations regarding work performance affected the users' attitudes positively. A positive attitude toward using the system resulted in consistent real usage and health care professionals' satisfaction with the new dashboard system. CONCLUSIONS A new concept of hospital dashboard system proved to be feasible and useful in delivering health information to healthcare professionals. A positive attitude and an expectation regarding work performance were important factors for intention to use the system. This finding can serve for developing new systems to present health information effectively. Further studies will be needed to evaluate the extent to which BESTBoard can have a positive impact on clinical care outcomes and work performance.
Collapse
Affiliation(s)
- Keehyuck Lee
- Center for Medical Informatics, Seoul National University Bundang Hospital, Seongnam, South Korea; Department of Family Medicine, Seoul National University Bundang Hospital, Seongnam, South Korea; Department of Orthopedics, Seoul National University Bundang Hospital, Seongnam, South Korea.
| | - Se Young Jung
- Department of Family Medicine, Seoul National University Bundang Hospital, Seongnam, South Korea; Department of Orthopedics, Seoul National University Bundang Hospital, Seongnam, South Korea.
| | - Hee Hwang
- Center for Medical Informatics, Seoul National University Bundang Hospital, Seongnam, South Korea; Department of Orthopedics, Seoul National University Bundang Hospital, Seongnam, South Korea; Department of Pediatrics, Seoul National University Bundang Hospital, Seongnam, South Korea.
| | - Sooyoung Yoo
- Center for Medical Informatics, Seoul National University Bundang Hospital, Seongnam, South Korea; Department of Orthopedics, Seoul National University Bundang Hospital, Seongnam, South Korea.
| | - Hyun Young Baek
- Center for Medical Informatics, Seoul National University Bundang Hospital, Seongnam, South Korea; Department of Orthopedics, Seoul National University Bundang Hospital, Seongnam, South Korea.
| | - Rong-Min Baek
- Department of Plastic Surgery, Seoul National University Bundang Hospital, Seongnam, South Korea; Department of Orthopedics, Seoul National University Bundang Hospital, Seongnam, South Korea.
| | - Seok Kim
- Center for Medical Informatics, Seoul National University Bundang Hospital, Seongnam, South Korea; Department of Orthopedics, Seoul National University Bundang Hospital, Seongnam, South Korea.
| |
Collapse
|
17
|
Abstract
Dashboards are data-driven clinical decision support tools used to analyze data from multiple databases using easy-to-read, color-coded graphical displays, much like the dashboards of automobiles. Dashboards can be used to promote data-driven decision making and improve adherence to evidence-based practice guidelines. The purpose of this article was to provide a review of dashboards used to query electronic health records for the purpose of guiding clinical practice and research. An inductive content analysis approach was used to identify emerging themes directly from the literature. Five basic dashboard properties identified include the type of database integration, visual properties, purpose, time focus (ie, retrospective, real time, or predictive), and type of process monitored. These dashboard properties are determined by the characteristics of the specific organization, user, and purpose of data analysis. Using dashboards to perform automated analytical reviews of clinical data will prove more efficient when data elements stored in electronic health records become standardized. Other limitations of dashboard use include user anxiety, information overload, and technology overload. The increased use of electronic documentation in healthcare settings will provide a wealth of data, and dashboards will play a pivotal role in converting these data into actionable knowledge.
Collapse
Affiliation(s)
- Bryan A Wilbanks
- Author Affiliations: School of Nursing, The University of Alabama at Birmingham (Dr Wilbanks); and Huntsville Hospital (Ms Langford), AL
| | | |
Collapse
|
18
|
Dashboards for improving patient care: review of the literature. Int J Med Inform 2014; 84:87-100. [PMID: 25453274 DOI: 10.1016/j.ijmedinf.2014.10.001] [Citation(s) in RCA: 198] [Impact Index Per Article: 19.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2014] [Revised: 09/26/2014] [Accepted: 10/03/2014] [Indexed: 11/20/2022]
Abstract
AIM This review aimed to provide a comprehensive overview of the current state of evidence for the use of clinical and quality dashboards in health care environments. METHODS A literature search was performed for the dates 1996-2012 on CINAHL, Medline, Embase, Cochrane Library, PsychInfo, Science Direct and ACM Digital Library. A citation search and a hand search of relevant papers were also conducted. RESULTS One hundred and twenty two full text papers were retrieved of which 11 were included in the review. There was considerable heterogeneity in implementation setting, dashboard users and indicators used. There was evidence that in contexts where dashboards were easily accessible to clinicians (such as in the form of a screen saver) their use was associated with improved care processes and patient outcomes. CONCLUSION There is some evidence that implementing clinical and/or quality dashboards that provide immediate access to information for clinicians can improve adherence to quality guidelines and may help improve patient outcomes. However, further high quality detailed research studies need to be conducted to obtain evidence of their efficacy and establish guidelines for their design.
Collapse
|
19
|
Callen J, Paoloni R, Li J, Stewart M, Gibson K, Georgiou A, Braithwaite J, Westbrook J. Perceptions of the Effect of Information and Communication Technology on the Quality of Care Delivered in Emergency Departments: A Cross-Site Qualitative Study. Ann Emerg Med 2013; 61:131-44. [DOI: 10.1016/j.annemergmed.2012.08.032] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2012] [Revised: 08/22/2012] [Accepted: 08/29/2012] [Indexed: 10/27/2022]
|