Adoption of clinical data exchange in community settings: a comparison of two approaches

Adoption of electronic clinical data exchange (CDE) across disparate healthcare organizations remains low in community settings despite demonstrated benefits. To expand CDE in communities, New York State funded sixteen community-based organizations to implement point-to-point directed exchange (n=8) and multi-site query-based health information exchange (HIE) (n=8). We conducted a cross-sectional study to compare adoption of directed exchange versus query-based HIE. From 2008 to 2011, 66% (n=1,747) of providers targeted for directed exchange and 21% (n=5,427) of providers targeted for query-based HIE adopted CDE. Funding per provider adoptee was almost two times greater for directed exchange (median (interquartile range): $25,535 ($17,391-$42,240)) than query-based HIE ($14,649 ($9,897-$28,078)), although the difference was not statistically significant. Because its infrastructure can cover larger populations using similar levels of public funding, query-based HIE may scale more broadly than directed exchange. To our knowledge, this is among the first studies to compare directed exchange versus query-based HIE.

Changing the research landscape: the New York City Clinical Data Research Network

The New York City Clinical Data Research Network (NYC-CDRN), funded by the Patient-Centered Outcomes Research Institute (PCORI), brings together 22 organizations including seven independent health systems to enable patient-centered clinical research, support a national network, and facilitate learning healthcare systems. The NYC-CDRN includes a robust, collaborative governance and organizational infrastructure, which takes advantage of its participants' experience, expertise, and history of collaboration. The technical design will employ an information model to document and manage the collection and transformation of clinical data, local institutional staging areas to transform and validate data, a centralized data processing facility to aggregate and share data, and use of common standards and tools. We strive to ensure that our project is patient-centered; nurtures collaboration among all stakeholders; develops scalable solutions facilitating growth and connections; chooses simple, elegant solutions wherever possible; and explores ways to streamline the administrative and regulatory approval process across sites.

Implementing a Clinical Research Management System: One Institution's Successful Approach Following Previous Failures

Clinical research management systems (CRMSs) can facilitate research billing compliance and clinician awareness of study activities when integrated with practice management and electronic health record systems. However, adoption of CRMSs remains low, and optimal approaches to implementation are unknown. This case report describes one institution's successful approach to organization, technology, and workflow for CRMS implementation following previous failures. Critical factors for CRMS success included organizational commitment to clinical research, a dedicated research information technology unit, integration of research data across disparate systems, and centralized system usage workflows. In contrast, previous failed approaches at the institution lacked a mandate and mechanism for change, received support as a business rather than research activity, maintained data in separate systems, and relied on inconsistent distributed system usage workflows. To our knowledge, this case report is the first to describe CRMS implementation success and failures, which can assist practitioners and academic evaluators.

Using a health information exchange system for imaging information: patterns and predictors

Health information exchange (HIE) systems may address the challenges that prevent easy access to patients' existing radiological information at the point of care. However, little is known about the factors associated with usage of HIE for radiology reports, nor about how reports are shared with an exchange network. We analyzed the system log files from a regional health information organization in upstate New York matched with insurance claims files using network analysis and regression modeling. The exchange network was dominated by a few key information sources. Outpatient users overall accessed 17 times more radiology reports than inpatient and ED users combined. Additionally, as the number of exchange partners increased per organization, the average number of reports exchanged by that organization also increased. Radiology reports were most likely to be accessed by physicians and other clinical users. These findings have implications for those operating and fostering exchange activity.

Patient encounters and care transitions in one community supported by automated query-based health information exchange

Care transitions from one facility to another threaten patient safety due to the potential loss of critical clinical information. Electronic clinical data exchange may address the problem. Approaches to exchange range from manual directed exchange, or sending point-to-point messages, to automated query-based health information exchange (HIE), or aggregating data from multiple sources. In this study, we measured the extent to which automated query-based HIE supported patient encounters and care transitions in one community. During the 23-month study period, 41% (n=33,219) of affirmatively consented patients had at least one encounter supported by automated query-based HIE. Of these patients, 41% (n=13,685) visited two or more facilities and accounted for 68% of total encounters. Of total encounters, 28% (n=40,828) were care transitions from one facility to another. Findings suggest that automated query-based HIE may support care transitions with efficient information sharing and assist United States providers in achieving stage two of meaningful use.

Push and pull: physician usage of and satisfaction with health information exchange

Federal policy toward health information exchange (HIE), the electronic transfer of patient data across organizations, has evolved to support two forms-push, or point-to-point data transmission, and pull, or multisource data aggregation. HIE usage is associated with user satisfaction, but existing quantitative research is limited to settings where only pull HIE is available. To address this gap, we surveyed 99 physicians regarding usage of and satisfaction with push HIE and pull HIE available in their communities as well as effects of HIE on practice and overall HIE satisfaction. In five of nine measures, respondents reported being very satisfied with push HIE more often than pull HIE (p < 0.05). Physicians were at least four times as likely to report being very satisfied with HIE overall if they were pediatricians, were very satisfied with push HIE, or noted that HIE improved their access to complete information. Findings have implications for HIE implementation and policy.

Barriers and facilitators to the use of computer-based intensive insulin therapy

PURPOSE

Computerized clinical decision support systems (CDSSs) for intensive insulin therapy (IIT) are increasingly common. However, recent studies question IIT's safety and mortality benefit. Researchers have identified factors influencing IIT performance, but little is known about how workflow affects computer-based IIT. We used ethnographic methods to evaluate IIT CDSS with respect to other clinical information systems and care processes.

METHODS

We conducted direct observation of and unstructured interviews with nurses using IIT CDSS in the surgical and trauma intensive care units at an academic medical center. We observed 49h of intensive care unit workflow including 49 instances of nurses using IIT CDSS embedded in a provider order entry system. Observations focused on the interaction of people, process, and technology. By analyzing qualitative field note data through an inductive approach, we identified barriers and facilitators to IIT CDSS use.

RESULTS

Barriers included (1) workload tradeoffs between computer system use and direct patient care, especially related to electronic nursing documentation, (2) lack of IIT CDSS protocol reminders, (3) inaccurate user interface design assumptions, and (4) potential for error in operating medical devices. Facilitators included (1) nurse trust in IIT CDSS combined with clinical judgment, (2) nurse resilience, and (3) paper serving as an intermediary between patient bedside and IIT CDSS.

CONCLUSION

This analysis revealed sociotechnical interactions affecting IIT CDSS that previous studies have not addressed. These issues may influence protocol performance at other institutions. Findings have implications for IIT CDSS user interface design and alerts, and may contribute to nascent general CDSS theory.

Increasing blood glucose variability heralds hypoglycemia in the critically ill

BACKGROUND

Control of hyperglycemia improves outcomes, but increases the risk of hypoglycemia. Recent evidence suggests that blood glucose variability (BGV) is more closely associated with mortality than either isolated or mean BG. We hypothesized that differences in BGV over time are associated with hypoglycemia and can be utilized to estimate risk of hypoglycemia (<50 mg/dL).

MATERIALS AND METHODS

Patients treated with intravenous insulin in the Surgical Intensive Care Unit of a tertiary care center formed the retrospective cohort. Exclusion criteria included death within 24 h of admission. We describe BGV in patients over time and its temporal relationship to hypoglycemic events. The risk of hypoglycemia for each BG measurement was estimated in a multivariable regression model. Predictors were measures of BGV, infusions of dextrose and vasopressors, patient demographics, illness severity, and BG measurements.

RESULTS

A total of 66,592 BG measurements were collected on 1392 patients. Hypoglycemia occurred in 154 patients (11.1%). Patient BGV fluctuated over time, and increased in the 24 h preceding a hypoglycemic event. In crude and adjusted analyses, higher BGV was positively associated with a hypoglycemia (OR 1.41, P < 0.001). Previous hypoglycemic events and time since previous BG measurement were also positively associated with hypoglycemic events. Severity of illness, vasopressor use, and diabetes were not independently associated with hypoglycemia.

CONCLUSIONS

BGV increases in the 24 h preceding hypoglycemia, and patients are at increased risk during periods of elevated BG variability. Prospective measurement of variability may identify periods of increased risk for hypoglycemia, and provide an opportunity to mitigate this risk.

Characteristics and effects of nurse dosing over-rides on computer-based intensive insulin therapy protocol performance

OBJECTIVE

To determine characteristics and effects of nurse dosing over-rides of a clinical decision support system (CDSS) for intensive insulin therapy (IIT) in critical care units.

DESIGN

Retrospective analysis of patient database records and ethnographic study of nurses using IIT CDSS.

MEASUREMENTS

The authors determined the frequency, direction-greater than recommended (GTR) and less than recommended (LTR)- and magnitude of over-rides, and then compared recommended and over-ride doses' blood glucose (BG) variability and insulin resistance, two measures of IIT CDSS associated with mortality. The authors hypothesized that rates of hypoglycemia and hyperglycemia would be greater for recommended than over-ride doses. Finally, the authors observed and interviewed nurse users.

RESULTS

5.1% (9075) of 179,452 IIT CDSS doses were over-rides. 83.4% of over-ride doses were LTR, and 45.5% of these were ≥ 50% lower than recommended. In contrast, 78.9% of GTR doses were ≤ 25% higher than recommended. When recommended doses were administered, the rate of hypoglycemia was higher than the rate for GTR (p = 0.257) and LTR (p = 0.033) doses. When recommended doses were administered, the rate of hyperglycemia was lower than the rate for GTR (p = 0.003) and LTR (p < 0.001) doses. Estimates of patients' insulin requirements were higher for LTR doses than recommended and GTR doses. Nurses reported trusting IIT CDSS overall but appeared concerned about recommendations when administering LTR doses.

CONCLUSION

When over-riding IIT CDSS recommendations, nurses overwhelmingly administered LTR doses, which emphasized prevention of hypoglycemia but interfered with hyperglycemia control, especially when BG was >150 mg/dl. Nurses appeared to consider the amount of a recommended insulin dose, not a patient's trend of insulin resistance, when administering LTR doses overall. Over-rides affected IIT CDSS protocol performance.

Peers, regulators, and professions: the influence of organizations in health information technology adoption

According to the U.S. National Research Council, current health information technology (HIT) efforts are insufficient and arguably detrimental to healthcare transformation. Many hospitals have already implemented HIT, and federal stimulus funding will further adoption efforts. Organizations become more similar through the adoption of innovations like HIT, but the effects of the changes do not necessarily improve efficiency. This view from sociology and organizational studies, called institutional isomorphism, suggests that organizations pursue changes endorsed by peers, regulators, and professional societies through mimetic, coercive, and normative mechanisms, respectively, that improve legitimacy, a socially constructed value that determines an organization's ability to obtain resources and survive. In this paper we examine mimetic, coercive, and normative influences in the adoption of three HIT innovations as well as evidence of resulting inefficiency. Institutional isomorphism provides a useful framework for researchers and practitioners to examine variation in HIT adoption.

Effects of blood glucose transcription mismatches on a computer-based intensive insulin therapy protocol

PURPOSE

Computerized clinical decision support systems (CDSS) for intensive insulin therapy (IIT) generate recommendations using blood glucose (BG) values manually transcribed from testing devices to computers, a potential source of error. We quantified the frequency and effect of blood glucose transcription mismatches on IIT protocol performance.

METHODS

We examined 38 months of retrospective data for patients treated with CDSS IIT in two intensive care units at one teaching hospital. A manually transcribed BG value not equal to a corresponding device value was deemed mismatched. For mismatches we recalculated CDSS recommendations using device BG values. We compared matched and mismatched data in terms of CDSS alerts, blood glucose variability, and dosing.

RESULTS

Of 189,499 CDSS IIT instances, 5.3% contained mismatched BG values. Mismatched data triggered 93 false alerts and failed to issue 170 alerts for nurses to notify physicians. Four of six BG variability measures differed between matched and mismatched data. Overall insulin dose was greater for matched than mismatched [matched 3.8 (1.6-6.0), median (interquartile range, IQR), versus 3.6 (1.6-5.7); p < 0.001], but recalculated and actual dose were similar. In mismatches preceding hypoglycemia, recalculated insulin dose was significantly lower than actual dose [recalculated 2.7 (0.4-5.0), median (IQR), versus 3.5 (1.4-5.6)]. In mismatches preceding hyperglycemia, recalculated insulin dose was significantly greater than actual dose [recalculated 4.7 (3.3-6.2), median (IQR), versus 3.3 (2.4-4.3); p < 0.001]. Administration of recalculated doses might have prevented blood glucose excursions.

CONCLUSIONS

Mismatched blood glucose values can influence CDSS IIT protocol performance.

Social, organizational, and contextual characteristics of clinical decision support systems for intensive insulin therapy: a literature review and case study

INTRODUCTION

Evaluations of computerized clinical decision support systems (CDSS) typically focus on clinical performance changes and do not include social, organizational, and contextual characteristics explaining use and effectiveness. Studies of CDSS for intensive insulin therapy (IIT) are no exception, and the literature lacks an understanding of effective computer-based IIT implementation and operation.

RESULTS

This paper presents (1) a literature review of computer-based IIT evaluations through the lens of institutional theory, a discipline from sociology and organization studies, to demonstrate the inconsistent reporting of workflow and care process execution and (2) a single-site case study to illustrate how computer-based IIT requires substantial organizational change and creates additional complexity with unintended consequences including error.

DISCUSSION

Computer-based IIT requires organizational commitment and attention to site-specific technology, workflow, and care processes to achieve intensive insulin therapy goals. The complex interaction between clinicians, blood glucose testing devices, and CDSS may contribute to workflow inefficiency and error. Evaluations rarely focus on the perspective of nurses, the primary users of computer-based IIT whose knowledge can potentially lead to process and care improvements.

CONCLUSION

This paper addresses a gap in the literature concerning the social, organizational, and contextual characteristics of CDSS in general and for intensive insulin therapy specifically. Additionally, this paper identifies areas for future research to define optimal computer-based IIT process execution: the frequency and effect of manual data entry error of blood glucose values, the frequency and effect of nurse overrides of CDSS insulin dosing recommendations, and comprehensive ethnographic study of CDSS for IIT.

Analysis of a computerized sign-out tool: identification of unanticipated uses and contradictory content

A computerized tool designed to facilitate physician sign-out has been in use at Vanderbilt University Hospital and Children's Hospital for close to a decade. The authors produced descriptive statistics of sign-out tool use by hospital unit, user's professional role, and time of day. Results showed anticipated use by resident physicians and nurse practitioners to generate and print notes, as well as unanticipated use by nurses, case managers, and medical receptionists/care partners to print providers' notes. Additionally, the authors categorized the content of sign-out notes having possible discrepancies and identified contradictory content. Findings have implications for workflow and redesign of the sign-out tool.

Blogs, wikis, and discussion forums: attributes and implications for clinical information systems

Informaticians increasingly view clinical information systems as asynchronous communication systems instead of data processing tools. Outside of health care, popular web technologies like blogs, wikis, and discussion forums have proven to be platforms for effective asynchronous communication. These popular technologies have implications for improving the coordination of clinical care and social support. In order to appropriately evaluate these webbased tools for use in clinical information systems, it will be essential for the informatics community to formally identify the distinguishing attributes of these communication methodologies. The authors propose seven interpersonal and informational attributes to compare and contrast the purposes of blogs, wikis, and discussion forums. This attribute-based approach to analyzing emerging web technologies will lead to a better understanding of the design choices involved in web-based information systems. Two case studies demonstrate how informatics researchers and developers can consider these attributes in the design and evaluation of clinical information systems.

The Success Factor Profile for clinical computer innovation

Fifty to seventy percent of information system projects fail. Most of the failures are not the victims of flawed technology, but rather organizational and people related issues. When Vanderbilt University Medical Center began an intensive electronic health record (EHR) effort, a process was carefully designed to select the clinical areas where new tools could be developed and pilot tested. The Success Factor Profile was created to guide the selection of sites most likely to have innovation success. This paper describes both the tools and the processes used to select clinical sites for new computer tools development and pilot implementation. Early results demonstrated that the tools provided structure for the decision making process, permitting side-by-side comparison of "apples and oranges." Selecting the site most likely to succeed with computer application innovation and early implementation has broad applicability in healthcare informatics. Failure to succeed with early system users is not only costly, but also discourages users and developers alike, and may damage the reputation of the tools and systems across the institution.