The clinician in the Driver's Seat: part 1 - a drag/drop user-composable electronic health record platform

Impact of a Disease-Focused Electronic Health Record Dashboard on Clinical Staff Efficiency in Previsit Patient Review in an Ambulatory Pulmonary Hypertension Care Clinic

OBJECTIVES

 We aimed to improve the operational efficiency of clinical staff, including physicians and allied health professionals, in the previsit review of patients by implementing a disease-focused dashboard within the electronic health record system. The dashboard was tailored to the unique requirements of the clinic and patient population.

METHODS

 A prospective quality improvement study was conducted at an accredited pulmonary hypertension (PH) clinic within a large academic center, staffed by two full time physicians and two allied health professionals. Physicians' review time before and after implementation of the PH dashboard was measured using activity log data derived from an EHR database. The review time for clinic staff was measured through direct observation, with review method-either conventional or newly implemented dashboard-randomly assigned.

RESULTS

 Over the study period, the median number of patients reviewed by physicians per day increased slightly from 5.50 (interquartile range [IQR]: 1.35) before to 5.95 (IQR: 0.85) after the implementation of the PH dashboard (p = 0.535). The median review time for the physicians decreased with the use of the dashboard, from 7.0 minutes (IQR: 1.55) to 4.95 minutes (IQR: 1.35; p < 0.001). Based on the observed timing of 70 patient encounters among allied clinical staff, no significant difference was found for experienced members (4.65 minutes [IQR: 2.02] vs. 4.43 minutes [IQR: 0.69], p = 0.752), while inexperienced staff saw a significant reduction in review time after familiarization with the dashboard (5.06 minutes [IQR: 1.51] vs. 4.12 minutes [IQR: 1.99], p = 0.034). Subjective feedback highlighted the need for further optimization of the dashboard to align with the workflow of allied health staff to achieve similar efficiency benefits.

CONCLUSION

 A disease-focused dashboard significantly reduced physician previsit review time while that for clinic staff remained unchanged. Validation studies are necessary with our patient populations to explore further qualitative impacts on patient care efficiency and long-term benefits on workflow.

Efficiency, efficacy and subjective user satisfaction of alternative laboratory report formats. An investigation on behalf of the Working Group for Postanalytical Phase (WG-POST), of the European Federation of Clinical Chemistry and Laboratory Medicine (EFLM)

OBJECTIVES

Although laboratory result presentation may lead to information overload and subsequent missed or delayed diagnosis, little has been done in the past to improve this post-analytical issue. We aimed to investigate the efficiency, efficacy and user satisfaction of alternative report formats.

METHODS

We redesigned cumulative (sparkline format) and single reports (improved tabular and z-log format) and tested these on 46 physicians, nurses and medical students in comparison to the classical tabular formats, by asking standardized questions on general items on the reports as well as on suspected diagnosis and follow-up treatment or diagnostics.

RESULTS

Efficacy remained at a very high level both in the new formats as well as in the classical formats. We found no significant difference in any of the groups. Efficiency improved in all groups when using the sparkline cumulative format and marginally when showing the improved tabular format. When asking medical questions, efficiency and efficacy remained similar between report formats and groups. All alternative reports were subjectively more attractive to the majority of participants.

CONCLUSIONS

Showing cumulative reports as a graphical display led to faster detection of general information on the report with the same level of correctness. Considering the familiarity bias of the classical single report formats, the borderline-significant improvement of the alternative tabular format and the non-inferiority of the z-log format, suggests that single reports might benefit from some improvements derived from basic information design.

Development and Validation of a Useful Taxonomy of Patient Portals Based on Characteristics of Patient Engagement

Objective  Taxonomies are classification systems used to reduce complexity and better understand a domain. The present research aims to develop a useful taxonomy for health information managers to classify and compare patient portals based on characteristics appropriate to promote patient engagement. As a result, the taxonomy should contribute to understanding the differences and similarities of the portals. Further, the taxonomy shall support health information managers to more easily define which general type and functionalities of patient portals they need and to select the most suitable solution offered on the market.

Methods  We followed the formal taxonomy-building method proposed by Nickerson et al. Based on a literature review, we created a preliminary taxonomy following the conceptional approach of the model. We then evaluated each taxa's appropriateness by analyzing and classifying 17 patient portals offered by software vendors and 11 patient portals offered by health care providers. After each iteration, we examined the achievement of the determined objective and subjective ending conditions.

Results  After two conceptional approaches to create our taxonomy, and two empirical approaches to evaluate it, the final taxonomy consists of 20 dimensions and 49 characteristics. To make the taxonomy easy to comprehend, we assigned to the dimensions seven aspects related to patient engagement. These aspects are (1) portal design, (2) management, (3) communication, (4) instruction, (5) self-management, (6) self-determination, and (7) data management. The taxonomy is considered finished and useful after all ending conditions that defined beforehand have been fulfilled. We demonstrated that the taxonomy serves to understand the differences and similarities by comparing patient portals. We call our taxonomy “Taxonomy of Patient Portals based on Characteristics of Patient Engagement (TOPCOP).”

Conclusion  We developed the first useful taxonomy for health information managers to classify and compare patient portals. The taxonomy is based on characteristics promoting patient engagement. With 20 dimensions and 49 characteristics, our taxonomy is particularly suitable to discriminate among patient portals and can easily be applied to compare portals. The TOPCOP taxonomy enables health information managers to better understand the differences and similarities of patient portals. Further, the taxonomy may help them to define the type and general functionalities needed. But it also supports them in searching and comparing patient portals offered on the market to select the most suitable solution.

Presentation and formatting of laboratory results: a narrative review on behalf of the European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) Working Group "postanalytical phase" (WG-POST)

In laboratory medicine, much effort has been put into analytical quality in the past decades, making this medical profession one of the most standardized with the lowest rates of error. However, even the best analytical quality cannot compensate for errors or low quality in the pre or postanalytical phase of the total testing process. Guidelines for data reporting focus solely on defined data elements, which have to be provided alongside the analytical test results. No guidelines on how to format laboratory reports exist. The habit of reporting as much diagnostic data as possible, including supplemental information, may lead to an information overload. Considering the multiple tasks physicians have to do simultaneously, unfiltered data presentation may contribute to patient risk, as important information may be overlooked, or juxtaposition errors may occur. As laboratories should aim to answer clinical questions, rather than providing sole analytical results, optimizing formatting options may help improve the effectiveness and efficiency of medical decision-making. In this narrative review, we focus on the underappreciated topic of laboratory result reporting. We present published literature, focusing on the impact of laboratory result report formatting on medical decisions as well as approaches, potential benefits, and limitations for alternative report formats. We discuss influencing variables such as, for example, the type of patient (e.g. acute versus chronic), the medical specialty of the recipient of the report, the display of reference intervals, the medium or platform on which the laboratory report is presented (printed paper, within electronic health record systems, on handheld devices, etc.), the context in which the report is viewed in, and difficulties in formatting single versus cumulative reports. Evidence on this topic, especially experimental studies, is scarce. When considering the medical impact, it is of utmost importance that laboratories focus not only on the analytical aspects but on the total testing process. The achievement of high analytical quality may be of minor value if essential results get lost in overload or scattering of information by using a non-formatted tabular design. More experimental studies to define guidelines and to standardize effective and efficient reporting are most definitely needed.

Characterizing and Visualizing Display and Task Fragmentation in the Electronic Health Record: Mixed Methods Design

BACKGROUND

The complexity of health care data and workflow presents challenges to the study of usability in electronic health records (EHRs). Display fragmentation refers to the distribution of relevant data across different screens or otherwise far apart, requiring complex navigation for the user's workflow. Task and information fragmentation also contribute to cognitive burden.

OBJECTIVE

This study aims to define and analyze some of the main sources of fragmentation in EHR user interfaces (UIs); discuss relevant theoretical, historical, and practical considerations; and use granular microanalytic methods and visualization techniques to help us understand the nature of fragmentation and opportunities for EHR optimization or redesign.

METHODS

Sunburst visualizations capture the EHR navigation structure, showing levels and sublevels of the navigation tree, allowing calculation of a new measure, the Display Fragmentation Index. Time belt visualizations present the sequences of subtasks and allow calculation of proportion per instance, a measure that quantifies task fragmentation. These measures can be used separately or in conjunction to compare EHRs as well as tasks and subtasks in workflows and identify opportunities for reductions in steps and fragmentation. We present an example use of the methods for comparison of 2 different EHR interfaces (commercial and composable) in which subjects apprehend the same patient case.

RESULTS

Screen transitions were substantially reduced for the composable interface (from 43 to 14), whereas clicks (including scrolling) remained similar.

CONCLUSIONS

These methods can aid in our understanding of UI needs under complex conditions and tasks to optimize EHR workflows and redesign.

Data summarization method for chronic disease tracking

OBJECTIVES

Bearing in mind the rising prevalence of chronic medical conditions, the chronic disease management is one of the key features required by medical information systems used in primary healthcare. Our research group paid a particular attention to this specific area by offering a set of custom data collection forms and reports in order to improve medical professionals' daily routine. The main idea was to provide an overview of history for chronic diseases, which, as it seems, had not been properly supported in previous administrative workflows. After five years of active use of medical information systems in more than 25 primary healthcare institutions, we were able to identify several scenarios that were often end-user-action dependent and could result in the data related to chronic diagnoses being loosely connected. An additional benefit would be a more effective identification of potentially new patients suffering from chronic diseases.

METHODS

For this particular reason, we introduced an extension of the existing data structures and a summarizing method along with a specific tool that should help in connecting all the data related to a patient and a diagnosis. The summarization method was based on the principle of connecting all of the records pertaining to a specific diagnosis for the selected patient, and it was envisaged to work in both automatic and on-demand mode. The expected results were a more effective identification of new potential patients and a completion of the existing histories of diseases associated with chronic diagnoses.

RESULTS

The current system usage analysis shows that a small number of doctors used functionalities specially designed for chronic diseases affecting less than 6% of the total population (around 11,500 out of more than 200,000 patients). In initial tests, the on-demand data summarization mode was applied in general practice and 89 out of 155 users identified more than 3000 new patients with a chronic disease over a three-month test period. During the tests, more than 100,000 medical documents were paired up with the existing histories of diseases. Furthermore, a significant number of physicians that accepted the standard history of disease helped with the identification of the additional 22% of the population. Applying the automatic summarization would help identify all patients with at least one record related to the diagnosis usually marked as chronic, but ultimately, this data had to be filtered and medical professionals should have the final say. Depending on the data filter definition, the total percentage of newly discovered patients with a chronic disease is between 35% and 53%, as expected.

CONCLUSIONS

Although the medical practitioner should have the final say about any medical record changes, new, innovative methods which can help in the data summarization are welcome. In addition to being focused on the summarization in relation to the patient, or to the diagnosis, this proposed method and tool can be effectively used when the patient-diagnosis relation is not one-to-one but many-to-many. The proposed summarization principles were tested on a single type of the medical information system, but can easily be applied to other medical software packages, too. Depending on the existing data structure of the target system, as well as identified use cases, it is possible to extend the data and customize the proposed summarization method.

Mind the Gap. A systematic review to identify usability and safety challenges and practices during electronic health record implementation

OBJECTIVE

Decisions made during electronic health record (EHR) implementations profoundly affect usability and safety. This study aims to identify gaps between the current literature and key stakeholders' perceptions of usability and safety practices and the challenges encountered during the implementation of EHRs.

MATERIALS AND METHODS

Two approaches were used: a literature review and interviews with key stakeholders. We performed a systematic review of the literature to identify usability and safety challenges and best practices during implementation. A total of 55 articles were reviewed through searches of PubMed, Web of Science and Scopus. We used a qualitative approach to identify key stakeholders' perceptions; semi-structured interviews were conducted with a diverse set of health IT stakeholders to understand their current practices and challenges related to usability during implementation. We used a grounded theory approach: data were coded, sorted, and emerging themes were identified. Conclusions from both sources of data were compared to identify areas of misalignment.

RESULTS

We identified six emerging themes from the literature and stakeholder interviews: cost and resources, risk assessment, governance and consensus building, customization, clinical workflow and usability testing, and training. Across these themes, there were misalignments between the literature and stakeholder perspectives, indicating major gaps.

DISCUSSION

Major gaps identified from each of six emerging themes are discussed as critical areas for future research, opportunities for new stakeholder initiatives, and opportunities to better disseminate resources to improve the implementation of EHRs.

CONCLUSION

Our analysis identified practices and challenges across six different emerging themes, illustrated important gaps, and results suggest critical areas for future research and dissemination to improve EHR implementation.

Methods for Addressing Technology-induced Errors: The Current State

OBJECTIVES

The objectives of this paper are to review and discuss the methods that are being used internationally to report on, mitigate, and eliminate technology-induced errors.

METHODS

The IMIA Working Group for Health Informatics for Patient Safety worked together to review and synthesize some of the main methods and approaches associated with technology- induced error reporting, reduction, and mitigation. The work involved a review of the evidence-based literature as well as guideline publications specific to health informatics.

RESULTS

The paper presents a rich overview of current approaches, issues, and methods associated with: (1) safe HIT design, (2) safe HIT implementation, (3) reporting on technology-induced errors, (4) technology-induced error analysis, and (5) health information technology (HIT) risk management. The work is based on research from around the world.

CONCLUSIONS

Internationally, researchers have been developing methods that can be used to identify, report on, mitigate, and eliminate technology-induced errors. Although there remain issues and challenges associated with the methodologies, they have been shown to improve the quality and safety of HIT. Since the first publications documenting technology-induced errors in healthcare in 2005, we have seen in a short 10 years researchers develop ways of identifying and addressing these types of errors. We have also seen organizations begin to use these approaches. Knowledge has been translated into practice in a short ten years whereas the norm for other research areas is of 20 years.

Natural Language Processing-Enabled and Conventional Data Capture Methods for Input to Electronic Health Records: A Comparative Usability Study

Background

The process of documentation in electronic health records (EHRs) is known to be time consuming, inefficient, and cumbersome. The use of dictation coupled with manual transcription has become an increasingly common practice. In recent years, natural language processing (NLP)–enabled data capture has become a viable alternative for data entry. It enables the clinician to maintain control of the process and potentially reduce the documentation burden. The question remains how this NLP-enabled workflow will impact EHR usability and whether it can meet the structured data and other EHR requirements while enhancing the user’s experience.

Objective

The objective of this study is evaluate the comparative effectiveness of an NLP-enabled data capture method using dictation and data extraction from transcribed documents (NLP Entry) in terms of documentation time, documentation quality, and usability versus standard EHR keyboard-and-mouse data entry.

Methods

This formative study investigated the results of using 4 combinations of NLP Entry and Standard Entry methods (“protocols”) of EHR data capture. We compared a novel dictation-based protocol using MediSapien NLP (NLP-NLP) for structured data capture against a standard structured data capture protocol (Standard-Standard) as well as 2 novel hybrid protocols (NLP-Standard and Standard-NLP). The 31 participants included neurologists, cardiologists, and nephrologists. Participants generated 4 consultation or admission notes using 4 documentation protocols. We recorded the time on task, documentation quality (using the Physician Documentation Quality Instrument, PDQI-9), and usability of the documentation processes.

Results

A total of 118 notes were documented across the 3 subject areas. The NLP-NLP protocol required a median of 5.2 minutes per cardiology note, 7.3 minutes per nephrology note, and 8.5 minutes per neurology note compared with 16.9, 20.7, and 21.2 minutes, respectively, using the Standard-Standard protocol and 13.8, 21.3, and 18.7 minutes using the Standard-NLP protocol (1 of 2 hybrid methods). Using 8 out of 9 characteristics measured by the PDQI-9 instrument, the NLP-NLP protocol received a median quality score sum of 24.5; the Standard-Standard protocol received a median sum of 29; and the Standard-NLP protocol received a median sum of 29.5. The mean total score of the usability measure was 36.7 when the participants used the NLP-NLP protocol compared with 30.3 when they used the Standard-Standard protocol.

Conclusions

In this study, the feasibility of an approach to EHR data capture involving the application of NLP to transcribed dictation was demonstrated. This novel dictation-based approach has the potential to reduce the time required for documentation and improve usability while maintaining documentation quality. Future research will evaluate the NLP-based EHR data capture approach in a clinical setting. It is reasonable to assert that EHRs will increasingly use NLP-enabled data entry tools such as MediSapien NLP because they hold promise for enhancing the documentation process and end-user experience.

Electronic Health Records: Then, Now, and in the Future

OBJECTIVES

Describe the state of Electronic Health Records (EHRs) in 1992 and their evolution by 2015 and where EHRs are expected to be in 25 years. Further to discuss the expectations for EHRs in 1992 and explore which of them were realized and what events accelerated or disrupted/derailed how EHRs evolved.

METHODS

Literature search based on "Electronic Health Record", "Medical Record", and "Medical Chart" using Medline, Google, Wikipedia Medical, and Cochrane Libraries resulted in an initial review of 2,356 abstracts and other information in papers and books. Additional papers and books were identified through the review of references cited in the initial review.

RESULTS

By 1992, hardware had become more affordable, powerful, and compact and the use of personal computers, local area networks, and the Internet provided faster and easier access to medical information. EHRs were initially developed and used at academic medical facilities but since most have been replaced by large vendor EHRs. While EHR use has increased and clinicians are being prepared to practice in an EHR-mediated world, technical issues have been overshadowed by procedural, professional, social, political, and especially ethical issues as well as the need for compliance with standards and information security. There have been enormous advancements that have taken place, but many of the early expectations for EHRs have not been realized and current EHRs still do not meet the needs of today's rapidly changing healthcare environment.

CONCLUSION

The current use of EHRs initiated by new technology would have been hard to foresee. Current and new EHR technology will help to provide international standards for interoperable applications that use health, social, economic, behavioral, and environmental data to communicate, interpret, and act intelligently upon complex healthcare information to foster precision medicine and a learning health system.

User-composable Electronic Health Record Improves Efficiency of Clinician Data Viewing for Patient Case Appraisal: A Mixed-Methods Study

Background:

Challenges in the design of electronic health records (EHRs) include designing usable systems that must meet the complex, rapidly changing, and high-stakes information needs of clinicians. The ability to move and assemble elements together on the same page has significant human-computer interaction (HCI) and efficiency advantages, and can mitigate the problems of negotiating multiple fixed screens and the associated cognitive burdens.

Objective:

We compare MedWISE—a novel EHR that supports user-composable displays—with a conventional EHR in terms of the number of repeat views of data elements for patient case appraisal.

Design and Methods:

The study used mixed-methods for examination of clinical data viewing in four patient cases. The study compared use of an experimental user-composable EHR with use of a conventional EHR, for case appraisal. Eleven clinicians used a user-composable EHR in a case appraisal task in the laboratory setting. This was compared with log file analysis of the same patient cases in the conventional EHR. We investigated the number of repeat views of the same clinical information during a session and across these two contexts, and compared them using Fisher’s exact test.

Results:

There was a significant difference (p<.0001) in proportion of cases with repeat data element viewing between the user-composable EHR (14.6 percent) and conventional EHR (72.6 percent).

Discussion and Conclusion:

Users of conventional EHRs repeatedly viewed the same information elements in the same session, as revealed by log files. Our findings are consistent with the hypothesis that conventional systems require that the user view many screens and remember information between screens, causing the user to forget information and to have to access the information a second time. Other mechanisms (such as reduction in navigation over a population of users due to interface sharing, and information selection) may also contribute to increased efficiency in the experimental system. Systems that allow a composable approach that enables the user to gather together on the same screen any desired information elements may confer cognitive support benefits that can increase productive use of systems by reducing fragmented information. By reducing cognitive overload, it can also enhance the user experience.

Development and Preliminary Evaluation of a Prototype of a Learning Electronic Medical Record System

Electronic medical records (EMRs) are capturing increasing amounts of data per patient. For clinicians to efficiently and accurately understand a patient's clinical state, better ways are needed to determine when and how to display EMR data. We built a prototype system that records how physicians view EMR data, which we used to train models that predict which EMR data will be relevant in a given patient. We call this approach a Learning EMR (LEMR). A physician used the prototype to review 59 intensive care unit (ICU) patient cases. We used the data-access patterns from these cases to train logistic regression models that, when evaluated, had AUROC values as high as 0.92 and that averaged 0.73, supporting that the approach is promising. A preliminary usability study identified advantages of the system and a few concerns about implementation. Overall, 3 of 4 ICU physicians were enthusiastic about features of the prototype.

The clinician in the driver's seat: part 2 - intelligent uses of space in a drag/drop user-composable electronic health record

User-composable approaches provide clinicians with the control to design and assemble information elements on screen via drag/drop. They hold considerable promise for enhancing the electronic-health-records (EHRs) user experience. We previously described this novel approach to EHR design and our illustrative system, MedWISE. The purpose of this paper is to describe clinician users' intelligent uses of space during completion of real patient case studies in a laboratory setting using MedWISE. Thirteen clinicians at a quaternary academic medical center used the system to review four real patient cases. We analyzed clinician utterances, behaviors, screen layouts (i.e., interface designs), and their perceptions associated with completing patient case studies. Clinicians effectively used the system to review all cases. Two coding schemata pertaining to human-computer interaction and diagnostic reasoning were used to analyze the data. Users adopted three main interaction strategies: rapidly gathering items on screen and reviewing ('opportunistic selection' approach); creating highly structured screens ('structured' approach); and interacting with small groups of items in sequence as their case review progressed ('dynamic stage' approach). They also used spatial arrangement in ways predicted by theory and research on workplace spatial arrangement. This includes assignment of screen regions for particular purposes (24% of spatial codes), juxtaposition to facilitate calculation or other cognitive tasks ('epistemic action'), and grouping elements with common meanings or relevance to the diagnostic facets of the case (20.3%). A left-to-right progression of orienting materials, data, and action items or reflection space was a commonly observed pattern. Widget selection was based on user assessment of what information was useful or relevant. We developed and tested an illustrative system that gives clinicians greater control of the EHR, and demonstrated its feasibility for case review by typical clinicians. Producing the simplifying inventions, such as user-composable platforms that shift control to the user, may serve to promote productive EHR use and enhance its value as an instrument of patient care.