Brainstorming about next-generation computer-based documentation: an AMIA clinical working group survey

Evaluation and comparison of errors on nursing notes created by online and offline speech recognition technology and handwritten: an interventional study

BACKGROUND

Despite the rapid expansion of electronic health records, the use of computer mouse and keyboard, challenges the data entry into these systems. Speech recognition software is one of the substitutes for the mouse and keyboard. The objective of this study was to evaluate the use of online and offline speech recognition software on spelling errors in nursing reports and to compare them with errors in handwritten reports.

METHODS

For this study, online and offline speech recognition software were selected and customized based on unrecognized terms by these softwares. Two groups of 35 nurses provided the admission notes of hospitalized patients upon their arrival using three data entry methods (using the handwritten method or two types of speech recognition software). After at least a month, they created the same reports using the other methods. The number of spelling errors in each method was determined. These errors were compared between the paper method and the two electronic methods before and after the correction of errors.

RESULTS

The lowest accuracy was related to online software with 96.4% and accuracy. On the average per report, the online method 6.76, and the offline method 4.56 generated more errors than the paper method. After correcting the errors by the participants, the number of errors in the online reports decreased by 94.75% and the number of errors in the offline reports decreased by 97.20%. The highest number of reports with errors was related to reports created by online software.

CONCLUSION

Although two software had relatively high accuracy, they created more errors than the paper method that can be lowered by optimizing and upgrading these softwares. The results showed that error correction by users significantly reduced the documentation errors caused by the software.

Generating Clinical Notes for Electronic Health Record Systems

Clinical notes summarize interactions that occur between patients and healthcare providers. With adoption of electronic health record (EHR) and computer-based documentation (CBD) systems, there is a growing emphasis on structuring clinical notes to support reusing data for subsequent tasks. However, clinical documentation remains one of the most challenging areas for EHR system development and adoption. The current manuscript describes the Vanderbilt experience with implementing clinical documentation with an EHR system. Based on their experience rolling out an EHR system that supports multiple methods for clinical documentation, the authors recommend that documentation method selection be made on the basis of clinical workflow, note content standards and usability considerations, rather than on a theoretical need for structured data.

An electronic documentation system improves the quality of admission notes: a randomized trial

OBJECTIVE

There are concerns that structured electronic documentation systems can limit expressivity and encourage long and unreadable notes. We assessed the impact of an electronic clinical documentation system on the quality of admission notes for patients admitted to a general medical unit.

METHODS

This was a prospective randomized crossover study comparing handwritten paper notes to electronic notes on different patients by the same author, generated using a semistructured electronic admission documentation system over a 2-month period in 2014. The setting was a 4-team, 80-bed general internal medicine clinical teaching unit at a large urban academic hospital. The quality of clinical documentation was assessed using the QNOTE instrument (best possible score = 100), and word counts were assessed for free-text sections of notes.

RESULTS

Twenty-one electronic-paper note pairs (42 notes) written by 21 authors were randomly drawn from a pool of 303 eligible notes. Overall note quality was significantly higher in electronic vs paper notes (mean 90 vs 69, P < .0001). The quality of free-text subsections (History of Present Illness and Impression and Plan) was significantly higher in the electronic vs paper notes (mean 93 vs 78, P < .0001; and 89 vs 77, P = .001, respectively). The History of Present Illness subsection was significantly longer in electronic vs paper notes (mean 172.4 vs 92.4 words, P = .0001).

CONCLUSIONS

An electronic admission documentation system improved both the quality of free-text content and the overall quality of admission notes. Authors wrote more in the free-text sections of electronic documents as compared to paper versions.

A comparative observational study of inpatient clinical note-entry and reading/retrieval styles adopted by physicians

OBJECTIVE

The objective of this study is to understand physicians' usage of inpatient notes by (i) ascertaining different clinical note-entry and reading/retrieval styles in two different and widely used Electronic Health Record (EHR) systems, (ii) extrapolating potential factors leading to adoption of various note-entry and reading/retrieval styles and (iii) determining the amount of time to task associated with documenting different types of clinical notes.

METHODS

In order to answer "what" and "why" questions on physicians' adoption of certain-note-entry and reading/retrieval styles, an ethnographic study entailing Internal Medicine residents, with a mixed data analysis approach was performed. Participants were observed interacting with two different EHR systems in inpatient settings. Data was collected around the use and creation of History and Physical (H&P) notes, progress notes and discharge summaries.

RESULTS

The highest variability in template styles was observed with progress notes and the least variability was within discharge summaries, while note-writing styles were most consistent for H&P notes. The first sections to be read in a H&P and progress note were the Chief Complaint and Assessment & Plan sections, respectively. The greatest note retrieval variability, with respect to the order of how note sections were reviewed, was observed with H&P and progress notes. Physician preference for adopting a certain reading/retrieval order appeared to be a function of what best fits their workflow while fulfilling the stimulus demands. The time spent entering H&P, discharge summaries and progress notes were similar in both EHRs.

CONCLUSION

This research study unveils existing variability in clinical documentation processes and provides us with important information that could help in designing a next generation EHR Graphical User Interface (GUI) that is more congruent with physicians' mental models, task performance needs, and workflow requirements.

Electronic health records improve clinical note quality

BACKGROUND AND OBJECTIVE

The clinical note documents the clinician's information collection, problem assessment, clinical management, and its used for administrative purposes. Electronic health records (EHRs) are being implemented in clinical practices throughout the USA yet it is not known whether they improve the quality of clinical notes. The goal in this study was to determine if EHRs improve the quality of outpatient clinical notes.

MATERIALS AND METHODS

A five and a half year longitudinal retrospective multicenter quantitative study comparing the quality of handwritten and electronic outpatient clinical visit notes for 100 patients with type 2 diabetes at three time points: 6 months prior to the introduction of the EHR (before-EHR), 6 months after the introduction of the EHR (after-EHR), and 5 years after the introduction of the EHR (5-year-EHR). QNOTE, a validated quantitative instrument, was used to assess the quality of outpatient clinical notes. Its scores can range from a low of 0 to a high of 100. Sixteen primary care physicians with active practices used QNOTE to determine the quality of the 300 patient notes.

RESULTS

The before-EHR, after-EHR, and 5-year-EHR grand mean scores (SD) were 52.0 (18.4), 61.2 (16.3), and 80.4 (8.9), respectively, and the change in scores for before-EHR to after-EHR and before-EHR to 5-year-EHR were 18% (p<0.0001) and 55% (p<0.0001), respectively. All the element and grand mean quality scores significantly improved over the 5-year time interval.

CONCLUSIONS

The EHR significantly improved the overall quality of the outpatient clinical note and the quality of all its elements, including the core and non-core elements. To our knowledge, this is the first study to demonstrate that the EHR significantly improves the quality of clinical notes.

A qualitative analysis evaluating the purposes and practices of clinical documentation

OBJECTIVES

An important challenge for biomedical informatics researchers is determining the best approach for healthcare providers to use when generating clinical notes in settings where electronic health record (EHR) systems are used. The goal of this qualitative study was to explore healthcare providers' and administrators' perceptions about the purpose of clinical documentation and their own documentation practices.

METHODS

We conducted seven focus groups with a total of 46 subjects composed of healthcare providers and administrators to collect knowledge, perceptions and beliefs about documentation from those who generate and review notes, respectively. Data were analyzed using inductive analysis to probe and classify impressions collected from focus group subjects.

RESULTS

We observed that both healthcare providers and administrators believe that documentation serves five primary domains: clinical, administrative, legal, research, education. These purposes are tied closely to the nature of the clinical note as a document shared by multiple stakeholders, which can be a source of tension for all parties who must use the note. Most providers reported using a combination of methods to complete their notes in a timely fashion without compromising patient care. While all administrators reported relying on computer-based documentation tools to review notes, they expressed a desire for a more efficient method of extracting relevant data.

CONCLUSIONS

Although clinical documentation has utility, and is valued highly by its users, the development and successful adoption of a clinical documentation tool largely depends on its ability to be smoothly integrated into the provider's busy workflow, while allowing the provider to generate a note that communicates effectively and efficiently with multiple stakeholders.

Possibilities and Implications of Using the ICF and Other Vocabulary Standards in Electronic Health Records

There is now widespread recognition of the powerful potential of electronic health record (EHR) systems to improve the health-care delivery system. The benefits of EHRs grow even larger when the health data within their purview are seamlessly shared, aggregated and processed across different providers, settings and institutions. Yet, the plethora of idiosyncratic conventions for identifying the same clinical content in different information systems is a fundamental barrier to fully leveraging the potential of EHRs. Only by adopting vocabulary standards that provide the lingua franca across these local dialects can computers efficiently move, aggregate and use health data for decision support, outcomes management, quality reporting, research and many other purposes. In this regard, the International Classification of Functioning, Disability, and Health (ICF) is an important standard for physiotherapists because it provides a framework and standard language for describing health and health-related states. However, physiotherapists and other health-care professionals capture a wide range of data such as patient histories, clinical findings, tests and measurements, procedures, and so on, for which other vocabulary standards such as Logical Observation Identifiers Names and Codes and Systematized Nomenclature Of Medicine Clinical Terms are crucial for interoperable communication between different electronic systems. In this paper, we describe how the ICF and other internationally accepted vocabulary standards could advance physiotherapy practise and research by enabling data sharing and reuse by EHRs. We highlight how these different vocabulary standards fit together within a comprehensive record system, and how EHRs can make use of them, with a particular focus on enhancing decision-making. By incorporating the ICF and other internationally accepted vocabulary standards into our clinical information systems, physiotherapists will be able to leverage the potent capabilities of EHRs and contribute our unique clinical perspective to other health-care providers within the emerging electronic health information infrastructure.

Quality of outpatient clinical notes: a stakeholder definition derived through qualitative research

BACKGROUND

There are no empirically-grounded criteria or tools to define or benchmark the quality of outpatient clinical documentation. Outpatient clinical notes document care, communicate treatment plans and support patient safety, medical education, medico-legal investigations and reimbursement. Accurately describing and assessing quality of clinical documentation is a necessary improvement in an increasingly team-based healthcare delivery system. In this paper we describe the quality of outpatient clinical notes from the perspective of multiple stakeholders.

METHODS

Using purposeful sampling for maximum diversity, we conducted focus groups and individual interviews with clinicians, nursing and ancillary staff, patients, and healthcare administrators at six federal health care facilities between 2009 and 2011. All sessions were audio-recorded, transcribed and qualitatively analyzed using open, axial and selective coding.

RESULTS

The 163 participants included 61 clinicians, 52 nurse/ancillary staff, 31 patients and 19 administrative staff. Three organizing themes emerged: 1) characteristics of quality in clinical notes, 2) desired elements within the clinical notes and 3) system supports to improve the quality of clinical notes. We identified 11 codes to describe characteristics of clinical notes, 20 codes to describe desired elements in quality clinical notes and 11 codes to describe clinical system elements that support quality when writing clinical notes. While there was substantial overlap between the aspects of quality described by the four stakeholder groups, only clinicians and administrators identified ease of translation into billing codes as an important characteristic of a quality note. Only patients rated prioritization of their medical problems as an aspect of quality. Nurses included care and education delivered to the patient, information added by the patient, interdisciplinary information, and infection alerts as important content.

CONCLUSIONS

Perspectives of these four stakeholder groups provide a comprehensive description of quality in outpatient clinical documentation. The resulting description of characteristics and content necessary for quality notes provides a research-based foundation for assessing the quality of clinical documentation in outpatient health care settings.

Documentation quality and time costs

The Department of Veterans Affairs (VA) performs over 800,000 disability exams and distributes over $37 billion in disability benefits per year. VA developed and deployed a computer-based disability exam documentation system in order to improve exam report quality and timeliness. We conducted a randomized controlled trial comparing joint disability examinations supported by computerized templates to the examinations documented via dictation, to determine if the system met the intended goals or had unintended consequences. Consenting veterans were randomized to undergo exams documented using computerized templates or via dictation. We compared exam report quality, documentation time costs, encounter length, total time to fulfill an exam request with a finalized exam report, and veteran satisfaction. Computer-based templates resulted in disability exam reports that had higher quality scores (p. 0.042) and were returned to the requesting office faster than exam reports created via dictation (p. 0.02).

Documentation time and veteran satisfaction were similar for both the documentation techniques. Encounter length was significantly longer for the template group. Computer-based templates impacted the VA disability evaluation system by improving report quality scores and production time and lengthening encounter times. Oversight bodies have called for mandated use of computer-based templates nationwide. We believe mandates regarding use of health information technology should be guided by data regarding its positive and negative impacts.

Informatics technology mimics ecology: dense, mutualistic collaboration networks are associated with higher publication rates

Information technology (IT) adoption enables biomedical research. Publications are an accepted measure of research output, and network models can describe the collaborative nature of publication. In particular, ecological networks can serve as analogies for publication and technology adoption. We constructed network models of adoption of bioinformatics programming languages and health IT (HIT) from the literature.

We selected seven programming languages and four types of HIT. We performed PubMed searches to identify publications since 2001. We calculated summary statistics and analyzed spatiotemporal relationships. Then, we assessed ecological models of specialization, cooperativity, competition, evolution, biodiversity, and stability associated with publications.

Adoption of HIT has been variable, while scripting languages have experienced rapid adoption. Hospital systems had the largest HIT research corpus, while Perl had the largest language corpus. Scripting languages represented the largest connected network components. The relationship between edges and nodes was linear, though Bioconductor had more edges than expected and Perl had fewer. Spatiotemporal relationships were weak. Most languages shared a bioinformatics specialization and appeared mutualistic or competitive. HIT specializations varied. Specialization was highest for Bioconductor and radiology systems. Specialization and cooperativity were positively correlated among languages but negatively correlated among HIT. Rates of language evolution were similar. Biodiversity among languages grew in the first half of the decade and stabilized, while diversity among HIT was variable but flat. Compared with publications in 2001, correlation with publications one year later was positive while correlation after ten years was weak and negative.

Adoption of new technologies can be unpredictable. Spatiotemporal relationships facilitate adoption but are not sufficient. As with ecosystems, dense, mutualistic, specialized co-habitation is associated with faster growth. There are rapidly changing trends in external technological and macroeconomic influences. We propose that a better understanding of how technologies are adopted can facilitate their development.

Data from clinical notes: a perspective on the tension between structure and flexible documentation

Clinical documentation is central to patient care. The success of electronic health record system adoption may depend on how well such systems support clinical documentation. A major goal of integrating clinical documentation into electronic heath record systems is to generate reusable data. As a result, there has been an emphasis on deploying computer-based documentation systems that prioritize direct structured documentation. Research has demonstrated that healthcare providers value different factors when writing clinical notes, such as narrative expressivity, amenability to the existing workflow, and usability. The authors explore the tension between expressivity and structured clinical documentation, review methods for obtaining reusable data from clinical notes, and recommend that healthcare providers be able to choose how to document patient care based on workflow and note content needs. When reusable data are needed from notes, providers can use structured documentation or rely on post-hoc text processing to produce structured data, as appropriate.

Electronic medical record use in pediatric primary care

OBJECTIVES

To characterize patterns of electronic medical record (EMR) use at pediatric primary care acute visits.

DESIGN

Direct observational study of 529 acute visits with 27 experienced pediatric clinician users.

MEASUREMENTS

For each 20 s interval and at each stage of the visit according to the Davis Observation Code, we recorded whether the physician was communicating with the family only, using the computer while communicating, or using the computer without communication. Regression models assessed the impact of clinician, patient and visit characteristics on overall visit length, time spent interacting with families, and time spent using the computer while interacting.

RESULTS

The mean overall visit length was 11:30 (min:sec) with 9:06 spent in the exam room. Clinicians used the EMR during 27% of exam room time and at all stages of the visit (interacting, chatting, and building rapport; history taking; formulation of the diagnosis and treatment plan; and discussing prevention) except the physical exam. Communication with the family accompanied 70% of EMR use. In regression models, computer documentation outside the exam room was associated with visits that were 11% longer (p=0.001), and female clinicians spent more time using the computer while communicating (p=0.003).

LIMITATIONS

The 12 study practices shared one EMR.

CONCLUSIONS

Among pediatric clinicians with EMR experience, conversation accompanies most EMR use. Our results suggest that efforts to improve EMR usability and clinician EMR training should focus on use in the context of doctor-patient communication. Further study of the impact of documentation inside versus outside the exam room on productivity is warranted.

Cognitive factors influencing perceptions of clinical documentation tools

Identifying healthcare providers' perceptions of clinical documentation methods can inform the design of computer-based documentation tools. The authors investigated the cognitive factors underlying such perceptions by performing a qualitative analysis that included open-ended in-depth interviews of a convenience sample of healthcare providers who use a variety of documentation methods. A total of 16 providers participated in the study; subjects included physicians and nurse practitioners from medical and surgical specialties who used paper- and computer-based documentation tools. Based on interview data, authors identified five factors that influenced satisfaction with clinical documentation tools: document system time efficiency, availability, expressivity, structure, and quality. These factors, if validated by subsequent investigations, can be used to develop a formal conceptual model of providers' perceptions of their satisfaction with various documentation systems.