Creating and sharing clinical decision support content with Web 2.0: Issues and examples

A survey of computable biomedical knowledge repositories

Introduction

While data repositories are well-established in clinical and research enterprises, knowledge repositories with shareable computable biomedical knowledge (CBK) are relatively new entities to the digital health ecosystem. Trustworthy knowledge repositories are necessary for learning health systems, but the policies, standards, and practices to promote trustworthy CBK artifacts and methods to share, and safely and effectively use them are not well studied.

Methods

We conducted an online survey of 24 organizations in the United States known to be involved in the development or deployment of CBK. The aim of the survey was to assess the current policies and practices governing these repositories and to identify best practices. Descriptive statistics methods were applied to data from 13 responding organizations, to identify common practices and policies instantiating the TRUST principles of Transparency, Responsibility, User Focus, Sustainability, and Technology.

Results

All 13 respondents indicated to different degrees adherence to policies that convey TRUST. Transparency is conveyed by having policies pertaining to provenance, credentialed contributors, and provision of metadata. Repositories provide knowledge in machine-readable formats, include implementation guidelines, and adhere to standards to convey Responsibility. Repositories report having Technology functions that enable end-users to verify, search, and filter for knowledge products. Less common TRUST practices are User Focused procedures that enable consumers to know about user licensing requirements or query the use of knowledge artifacts. Related to Sustainability, less than a majority post describe their sustainability plans. Few organizations publicly describe whether patients play any role in their decision-making.

Conclusion

It is essential that knowledge repositories identify and apply a baseline set of criteria to lay a robust foundation for their trustworthiness leading to optimum uptake, and safe, reliable, and effective use to promote sharing of CBK. Identifying current practices suggests a set of desiderata for the CBK ecosystem in its continued evolution.

Conceptualizing clinical decision support as complex interventions: a meta-analysis of comparative effectiveness trials

OBJECTIVES

Complex interventions with multiple components and behavior change strategies are increasingly implemented as a form of clinical decision support (CDS) using native electronic health record functionality. Objectives of this study were, therefore, to (1) identify the proportion of randomized controlled trials with CDS interventions that were complex, (2) describe common gaps in the reporting of complexity in CDS research, and (3) determine the impact of increased complexity on CDS effectiveness.

MATERIALS AND METHODS

To assess CDS complexity and identify reporting gaps for characterizing CDS interventions, we used the Preferred Reporting Items for Systematic Reviews and Meta-Analyses reporting tool for complex interventions. We evaluated the effect of increased complexity using random-effects meta-analysis.

RESULTS

Most included studies evaluated a complex CDS intervention (76%). No studies described use of analytical frameworks or causal pathways. Two studies discussed use of theory but only one fully described the rationale and put it in context of a behavior change. A small but positive effect (standardized mean difference, 0.147; 95% CI, 0.039-0.255; P < .01) in favor of increasing intervention complexity was observed.

DISCUSSION

While most CDS studies should classify interventions as complex, opportunities persist for documenting and providing resources in a manner that would enable CDS interventions to be replicated and adapted. Unless reporting of the design, implementation, and evaluation of CDS interventions improves, only slight benefits can be expected.

CONCLUSION

Conceptualizing CDS as complex interventions may help convey the careful attention that is needed to ensure these interventions are contextually and theoretically informed.

Examination of a Canada-Wide Collaboration Platform for Order Sets: Retrospective Analysis

BACKGROUND

Knowledge translation and dissemination are some of the main challenges that affect evidence-based medicine. Web 2.0 platforms promote the sharing and collaborative development of content. Executable knowledge tools, such as order sets, are a knowledge translation tool whose localization is critical to its effectiveness but a challenge for organizations to develop independently.

OBJECTIVE

This paper describes a Web 2.0 resource, referred to as the collaborative network (TCN), for order set development designed to share executable knowledge (order sets). This paper also analyzes the scope of its use, describes its use through network analysis, and examines the provision and use of order sets in the platform by organizational size.

METHODS

Data were collected from Think Research's TxConnect platform. We measured interorganization sharing across Canadian hospitals using descriptive statistics. A weighted chi-square analysis was used to evaluate institutional size to share volumes based on institution size, with post hoc Cramer V score to measure the strength of association.

RESULTS

TCN consisted of 12,495 order sets across 683 diagnoses or processes. Between January 2010 and March 2015, a total of 131 health care organizations representing 360 hospitals in Canada downloaded order sets 105,496 times. Order sets related to acute coronary syndrome, analgesia, and venous thromboembolism were most commonly shared. COVID-19 order sets were among the most actively shared, adjusting for order set lifetime. A weighted chi-square analysis showed nonrandom downloading behavior (P<.001), with medium-sized institutions downloading content from larger institutions acting as the most significant driver of this variance (chi-gram=124.70).

CONCLUSIONS

In this paper, we have described and analyzed a Web 2.0 platform for the sharing of order set content with significant network activity. The robust use of TCN to access customized order sets reflects its value as a resource for health care organizations when they develop or update their own order sets.

Intention to Use Wiki-Based Knowledge Tools: Survey of Quebec Emergency Health Professionals

BACKGROUND

Clinical decision support systems are information technologies that assist clinicians in making better decisions. Their adoption has been limited because their content is difficult to adapt to local contexts and slow to adapt to emerging evidence. Collaborative writing applications such as wikis have the potential to increase access to existing and emerging evidence-based knowledge at the point of care, standardize emergency clinical decision making, and quickly adapt this knowledge to local contexts. However, little is known about the factors influencing health professionals' use of wiki-based knowledge tools.

OBJECTIVE

This study aims to measure emergency physicians' (EPs) and other acute care health professionals' (ACHPs) intentions to use wiki-based knowledge tools in trauma care and identify determinants of this intention that can be used in future theory-based interventions for promoting the use of wiki-based knowledge tools in trauma care.

METHODS

In total, 266 EPs and 907 ACHPs (nurses, respiratory therapists, and pharmacists) from 12 Quebec trauma centers were asked to answer a survey based on the theory of planned behavior (TPB). The TPB constructs were measured using a 7-point Likert scale. Descriptive statistics and Pearson correlations between the TPB constructs and intention were calculated. Multiple linear regression analysis was conducted to identify the salient beliefs.

RESULTS

Among the eligible participants, 57.1% (152/266) of EPs and 31.9% (290/907) of ACHPs completed the questionnaire. For EPs, we found that attitude, perceived behavioral control (PBC), and subjective norm (SN) were significant determinants of the intention to use wiki-based knowledge tools and explained 62% of its variance. None of the sociodemographic variables were related to EPs' intentions to use wiki-based knowledge tools. The regression model identified two normative beliefs ("approval by physicians" and "approval by patients") and two behavioral beliefs ("refreshes my memory" and "reduces errors"). For ACHPs, attitude, PBC, SN, and two sociodemographic variables (profession and the previous personal use of a wiki) were significantly related to the intention to use wiki-based knowledge tools and explained 60% of the variance in behavioral intention. The final regression model for ACHPs included two normative beliefs ("approval by the hospital trauma team" and "people less comfortable with information technology"), one control belief ("time constraints"), and one behavioral belief ("access to evidence").

CONCLUSIONS

The intentions of EPs and ACHPs to use wiki-based knowledge tools to promote best practices in trauma care can be predicted in part by attitude, SN, and PBC. We also identified salient beliefs that future theory-based interventions should promote for the use of wiki-based knowledge tools in trauma care. These interventions will address the barriers to using wiki-based knowledge tools, find ways to ensure the quality of their content, foster contributions, and support the exploration of wiki-based knowledge tools as potential effective knowledge translation tools in trauma care.

The decision-making and learning roles of a professional social network: The case of a family physicians' network

PURPOSE

This research was aimed at studying the evolution and roles of the Israeli physicians' professional social network as perceived by the members of the network.

METHODOLOGY

The research examined a case study of RAMBAM/KEHILA professional networks, applying both qualitative and quantitative methods for establishing a grounded theory.

FINDINGS

Physicians want to be part of their professional community and consider the network as a place where the "wisdom of the crowd" exists. They seek approval for their initial line of reasoning regarding their clinical cases but will consider other approaches if such are suggested by persons of professional repute or if answers are based on evidence-based medicine. The evolved network constitutes an a-political space which has gained the trust of the community and enables physicians of various ranks to share experiences and thoughts. Moreover, the network fosters learning opportunities and the network dynamics have impact on physicians' professional development.

DISCUSSION

This unique ten-year longitudinal research examined the evolution of a professional social network. The research findings have practical and social implications. Practically, the study shows the values of professional network as an instrument for clinicians' lifelong learning and professional development. Socially, the study presents the professional network social role in facilitating social interactions when the network participants are involved in determining its roles and gain trust by avoiding any political or commercial interference.

An Evidence-Based Health Care Knowledge Integration System: Assessment Protocol

BACKGROUND

The rapid advancements in health care can make it difficult for general physicians and specialists alike to keep their knowledge up to date. In medicine today, there are deficiencies in the application of knowledge translation (KT) in clinical practice. Some medical procedures are not required, and therefore, no value is added to the patient's care. These unnecessary procedures increase pressures on the health care system's resources, reduce the quality of care, and expose the patients to stress and to other potential risks. KT tools and better access to medical recommendations can lead to improvements in physicians' decision-making processes depending on the patient's specific clinical situation. These tools can provide the physicians with the available options and promote an efficient professional practice. Software for the Evolution of Knowledge in MEDicine (SEKMED) is a technological solution providing access to high-quality evidence, based on just-in-time principles, in the application of medical recommendations for clinical decision-making processes recognized by community members, accreditation bodies, the recommendations from medical specialty societies made available through campaigns such as Choosing Wisely, and different standards or accreditive bodies.

OBJECTIVE

The main objective of this protocol is to assess the usefulness of the SEKMED platform used within a real working clinical practice, specifically the Centre intégré de santé et des services sociaux de l'Outaouais in Quebec, Canada. To achieve our main objective, 20 emergency physicians from the Hull and Gatineau Hospitals participate in the project as well as 20 patient care unit physicians from the Hull Hospital. In addition, 10 external students or residents studying family medicine from McGill University will also participate in our study.

METHODS

The project is divided into 4 phases: (1) orientation; (2) data synthesis; (3) develop and validate the recommendations; and (4) implement, monitor, and update the recommendations. These phases will enable us to meet our 6 specific research objectives that aim to measure the integration of recommendations in clinical practices, the before and after improvements in practices, the value attributed by physicians to recommendations, the user's platform experience, the educational benefits according to medical students, and the organizational benefits according to stakeholders. The knowledge gained during each phase will be applied on an iterative and continuous basis to all other phases over a period of 2 years.

RESULTS

This project was funded in April 2018 by the Fonds de soutien à l'innovation en santé et en services sociaux for 24 months. Ethics approval has been attained, the study began in June 2018, the data collection will be complete at the end of December 2019, and the data analysis will start in winter 2020. Both major city hospitals in the Outaouais region, Quebec, Canada, have agreed to participate in the project.

CONCLUSIONS

If results show preliminary efficacy and usability of the system, a large-scale implementation will be conducted.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/11754.

Best practices for preventing malfunctions in rule-based clinical decision support alerts and reminders: Results of a Delphi study

OBJECTIVE

Developing effective and reliable rule-based clinical decision support (CDS) alerts and reminders is challenging. Using a previously developed taxonomy for alert malfunctions, we identified best practices for developing, testing, implementing, and maintaining alerts and avoiding malfunctions.

MATERIALS AND METHODS

We identified 72 initial practices from the literature, interviews with subject matter experts, and prior research. To refine, enrich, and prioritize the list of practices, we used the Delphi method with two rounds of consensus-building and refinement. We used a larger than normal panel of experts to include a wide representation of CDS subject matter experts from various disciplines.

RESULTS

28 experts completed Round 1 and 25 completed Round 2. Round 1 narrowed the list to 47 best practices in 7 categories: knowledge management, designing and specifying, building, testing, deployment, monitoring and feedback, and people and governance. Round 2 developed consensus on the importance and feasibility of each best practice.

DISCUSSION

The Delphi panel identified a range of best practices that may help to improve implementation of rule-based CDS and avert malfunctions. Due to limitations on resources and personnel, not everyone can implement all best practices. The most robust processes require investing in a data warehouse. Experts also pointed to the issue of shared responsibility between the healthcare organization and the electronic health record vendor.

CONCLUSION

These 47 best practices represent an ideal situation. The research identifies the balance between importance and difficulty, highlights the challenges faced by organizations seeking to implement CDS, and describes several opportunities for future research to reduce alert malfunctions.

Clinical decision support alert malfunctions: analysis and empirically derived taxonomy

Objective

To develop an empirically derived taxonomy of clinical decision support (CDS) alert malfunctions.

Materials and Methods

We identified CDS alert malfunctions using a mix of qualitative and quantitative methods: (1) site visits with interviews of chief medical informatics officers, CDS developers, clinical leaders, and CDS end users; (2) surveys of chief medical informatics officers; (3) analysis of CDS firing rates; and (4) analysis of CDS overrides. We used a multi-round, manual, iterative card sort to develop a multi-axial, empirically derived taxonomy of CDS malfunctions.

Results

We analyzed 68 CDS alert malfunction cases from 14 sites across the United States with diverse electronic health record systems. Four primary axes emerged: the cause of the malfunction, its mode of discovery, when it began, and how it affected rule firing. Build errors, conceptualization errors, and the introduction of new concepts or terms were the most frequent causes. User reports were the predominant mode of discovery. Many malfunctions within our database caused rules to fire for patients for whom they should not have (false positives), but the reverse (false negatives) was also common.

Discussion

Across organizations and electronic health record systems, similar malfunction patterns recurred. Challenges included updates to code sets and values, software issues at the time of system upgrades, difficulties with migration of CDS content between computing environments, and the challenge of correctly conceptualizing and building CDS.

Conclusion

CDS alert malfunctions are frequent. The empirically derived taxonomy formalizes the common recurring issues that cause these malfunctions, helping CDS developers anticipate and prevent CDS malfunctions before they occur or detect and resolve them expediently.

Best Practices in Clinical Decision Support: the Case of Preventive Care Reminders

BACKGROUND: Evidence demonstrates that clinical decision support (CDS) is a powerful tool for improving healthcare quality and ensuring patient safety. However, implementing and maintaining effective decision support interventions presents multiple technical and organizational challenges. PURPOSE: To identify best practices for CDS, using the domain of preventive care reminders as an example. METHODS: We assembled a panel of experts in CDS and held a series of facilitated online and in-person discussions. We analyzed the results of these discussions using a grounded theory method to elicit themes and best practices. RESULTS: Eight best practice themes were identified as important: deliver CDS in the most appropriate ways, develop effective governance structures, consider use of incentives, be aware of workflow, keep content current, monitor and evaluate impact, maintain high quality data, and consider sharing content. Keys themes within each of these areas were also described. CONCLUSION: Successful implementation of CDS requires consideration of both technical and socio-technical factors. The themes identified in this study provide guidance on crucial factors that need consideration when CDS is implemented across healthcare settings. These best practice themes may be useful for developers, implementers, and users of decision support.

Collaborative writing applications in healthcare: effects on professional practice and healthcare outcomes

BACKGROUND

Collaborative writing applications (CWAs), such as wikis and Google Documents, hold the potential to improve the use of evidence in both public health and healthcare. Although a growing body of literature indicates that CWAs could have positive effects on healthcare, such as improved collaboration, behavioural change, learning, knowledge management, and adaptation of knowledge to local context, this has never been assessed systematically. Moreover, several questions regarding safety, reliability, and legal aspects exist.

OBJECTIVES

The objectives of this review were to (1) assess the effects of the use of CWAs on process (including the behaviour of healthcare professionals) and patient outcomes, (2) critically appraise and summarise current evidence on the use of resources, costs, and cost-effectiveness associated with CWAs to improve professional practices and patient outcomes, and (3) explore the effects of different CWA features (e.g. open versus closed) and different implementation factors (e.g. the presence of a moderator) on process and patient outcomes.

SEARCH METHODS

We searched CENTRAL, MEDLINE, Embase, and 11 other electronic databases. We searched the grey literature, two trial registries, CWA websites, individual journals, and conference proceedings. We also contacted authors and experts in the field. We did not apply date or language limits. We searched for published literature to August 2016, and grey literature to September 2015.

SELECTION CRITERIA

We included randomised controlled trials (RCTs), non-randomised controlled trials (NRCTs), controlled before-and-after (CBA) studies, interrupted time series (ITS) studies, and repeated measures studies (RMS), in which CWAs were used as an intervention to improve the process of care, patient outcomes, or healthcare costs.

DATA COLLECTION AND ANALYSIS

Teams of two review authors independently assessed the eligibility of studies. Disagreements were resolved by discussion, and when consensus was not reached, a third review author was consulted.

MAIN RESULTS

We screened 11,993 studies identified from the electronic database searches and 346 studies from grey literature sources. We analysed the full text of 99 studies. None of the studies met the eligibility criteria; two potentially relevant studies are ongoing.

AUTHORS' CONCLUSIONS

While there is a high number of published studies about CWAs, indicating that this is an active field of research, additional studies using rigorous experimental designs are needed to assess their impact and cost-effectiveness on process and patient outcomes.

Semantic Health Knowledge Graph: Semantic Integration of Heterogeneous Medical Knowledge and Services

With the explosion of healthcare information, there has been a tremendous amount of heterogeneous textual medical knowledge (TMK), which plays an essential role in healthcare information systems. Existing works for integrating and utilizing the TMK mainly focus on straightforward connections establishment and pay less attention to make computers interpret and retrieve knowledge correctly and quickly. In this paper, we explore a novel model to organize and integrate the TMK into conceptual graphs. We then employ a framework to automatically retrieve knowledge in knowledge graphs with a high precision. In order to perform reasonable inference on knowledge graphs, we propose a contextual inference pruning algorithm to achieve efficient chain inference. Our algorithm achieves a better inference result with precision and recall of 92% and 96%, respectively, which can avoid most of the meaningless inferences. In addition, we implement two prototypes and provide services, and the results show our approach is practical and effective.

-Omic and Electronic Health Record Big Data Analytics for Precision Medicine

OBJECTIVE

Rapid advances of high-throughput technologies and wide adoption of electronic health records (EHRs) have led to fast accumulation of -omic and EHR data. These voluminous complex data contain abundant information for precision medicine, and big data analytics can extract such knowledge to improve the quality of healthcare.

METHODS

In this paper, we present -omic and EHR data characteristics, associated challenges, and data analytics including data preprocessing, mining, and modeling.

RESULTS

To demonstrate how big data analytics enables precision medicine, we provide two case studies, including identifying disease biomarkers from multi-omic data and incorporating -omic information into EHR.

CONCLUSION

Big data analytics is able to address -omic and EHR data challenges for paradigm shift toward precision medicine.

SIGNIFICANCE

Big data analytics makes sense of -omic and EHR data to improve healthcare outcome. It has long lasting societal impact.

Clinical Decision Support: a 25 Year Retrospective and a 25 Year Vision

OBJECTIVE

The objective of this review is to summarize the state of the art of clinical decision support (CDS) circa 1990, review progress in the 25 year interval from that time, and provide a vision of what CDS might look like 25 years hence, or circa 2040.

METHOD

Informal review of the medical literature with iterative review and discussion among the authors to arrive at six axes (data, knowledge, inference, architecture and technology, implementation and integration, and users) to frame the review and discussion of selected barriers and facilitators to the effective use of CDS.

RESULT

In each of the six axes, significant progress has been made. Key advances in structuring and encoding standardized data with an increased availability of data, development of knowledge bases for CDS, and improvement of capabilities to share knowledge artifacts, explosion of methods analyzing and inferring from clinical data, evolution of information technologies and architectures to facilitate the broad application of CDS, improvement of methods to implement CDS and integrate CDS into the clinical workflow, and increasing sophistication of the end-user, all have played a role in improving the effective use of CDS in healthcare delivery.

CONCLUSION

CDS has evolved dramatically over the past 25 years and will likely evolve just as dramatically or more so over the next 25 years. Increasingly, the clinical encounter between a clinician and a patient will be supported by a wide variety of cognitive aides to support diagnosis, treatment, care-coordination, surveillance and prevention, and health maintenance or wellness.

Impact of Implementing a Wiki to Develop Structured Electronic Order Sets on Physicians' Intention to Use Wiki-Based Order Sets

BACKGROUND

Wikis have the potential to promote best practices in health systems by sharing order sets with a broad community of stakeholders. However, little is known about the impact of using a wiki on clinicians' intention to use wiki-based order sets.

OBJECTIVE

The aims of this study were: (1) to describe the use of a wiki to create structured order sets for a single emergency department; (2) to evaluate whether the use of this wiki changed emergency physicians' future intention to use wiki-based order sets; and (3) to understand the impact of using the wiki on the behavioral determinants for using wiki-based order sets.

METHODS

This was a pre/post-intervention mixed-methods study conducted in one hospital in Lévis, Quebec. The intervention was comprised of receiving access to and being motivated by the department head to use a wiki for 6 months to create electronic order sets designed to be used in a computer physician order entry system. Before and after our intervention, we asked participants to complete a previously validated questionnaire based on the Theory of Planned Behavior. Our primary outcome was the intention to use wiki-based order sets in clinical practice. We also assessed participants' attitude, perceived behavioral control, and subjective norm to use wiki-based order sets. Paired pre- and post-Likert scores were compared using Wilcoxon signed-rank tests. The post-questionnaire also included open-ended questions concerning participants' comments about the wiki, which were then classified into themes using an existing taxonomy.

RESULTS

Twenty-eight emergency physicians were enrolled in the study (response rate: 100%). Physicians' mean intention to use a wiki-based reminder was 5.42 (SD 1.04) before the intervention, and increased to 5.81 (SD 1.25) on a 7-point Likert scale (P =.03) after the intervention. Participants' attitude towards using a wiki-based order set also increased from 5.07 (SD 0.90) to 5.57 (SD 0.88) (P =.003). Perceived behavioral control and subjective norm did not change. Easier information sharing was the most frequently positive impact raised. In order of frequency, the three most important facilitators reported were: ease of use, support from colleagues, and promotion by the departmental head. Although participants did not mention any perceived negative impacts, they raised the following barriers in order of frequency: poor organization of information, slow computers, and difficult wiki access.

CONCLUSIONS

Emergency physicians' intention and attitude to use wiki-based order sets increased after having access to and being motivated to use a wiki for 6 months. Future studies need to explore if this increased intention will translate into sustained actual use and improve patient care. Certain barriers need to be addressed before implementing a wiki for use on a larger scale.

Supporting Healthcare Executive Managers’ Decisions Through Dashboards

Information visualisation plays an important role for executives in order to drive business effectively and efficiently. Dashboard design, which is one of the best tools of visualization to meet the information needs at adequate levels, is becoming more important parallel to advances in information processing technologies. This study aims to provide a conceptual framework for developing a dashboard for executives. Healthcare management was chosen to demonstrate the methodology of research design, data gathering and visualisation examples. Results show that the study is applicable to other areas as well to meet the information requirements of top and mid-level managers.

Applying artificial intelligence technology to support decision-making in nursing: A case study in Taiwan

This study applied artificial intelligence to help nurses address problems and receive instructions through information technology. Nurses make diagnoses according to professional knowledge, clinical experience, and even instinct. Without comprehensive knowledge and thinking, diagnostic accuracy can be compromised and decisions may be delayed. We used a back-propagation neural network and other tools for data mining and statistical analysis. We further compared the prediction accuracy of the previous methods with an adaptive-network-based fuzzy inference system and the back-propagation neural network, identifying differences in the questions and in nurse satisfaction levels before and after using the nursing information system. This study investigated the use of artificial intelligence to generate nursing diagnoses. The percentage of agreement between diagnoses suggested by the information system and those made by nurses was as much as 87 percent. When patients are hospitalized, we can calculate the probability of various nursing diagnoses based on certain characteristics.

Influencing Anesthesia Provider Behavior Using Anesthesia Information Management System Data for Near Real-Time Alerts and Post Hoc Reports

In this review article, we address issues related to using data from anesthesia information management systems (AIMS) to deliver near real-time alerts via AIMS workstation popups and/or alphanumeric pagers and post hoc reports via e-mail. We focus on reports and alerts for influencing the behavior of anesthesia providers (i.e., anesthesiologists, anesthesia residents, and nurse anesthetists). Multiple studies have shown that anesthesia clinical decision support (CDS) improves adherence to protocols and increases financial performance through facilitation of billing, regulatory, and compliance documentation; however, improved clinical outcomes have not been demonstrated. We inform developers and users of feedback systems about the multitude of concerns to consider during development and implementation of CDS to increase its effectiveness and to mitigate its potentially disruptive aspects. We discuss the timing and modalities used to deliver messages, implications of outlier-only versus individualized feedback, the need to consider possible unintended consequences of such feedback, regulations, sustainability, and portability among systems. We discuss statistical issues related to the appropriate evaluation of CDS efficacy. We provide a systematic review of the published literature (indexed in PubMed) of anesthesia CDS and offer 2 case studies of CDS interventions using AIMS data from our own institution illustrating the salient points. Because of the considerable expense and complexity of maintaining near real-time CDS systems, as compared with providing individual reports via e-mail after the fact, we suggest that if the same goal can be accomplished via delayed reporting versus immediate feedback, the former approach is preferable. Nevertheless, some processes require near real-time alerts to produce the desired improvement. Post hoc e-mail reporting from enterprise-wide electronic health record systems is straightforward and can be accomplished using system-independent pathways (e.g., via built-in e-mail support provided by the relational database management system). However, for some of these enterprise-wide systems, near real-time data access, necessary for CDS that generates concurrent alerts, has been challenging to implement.

Comparative outcome studies of clinical decision support software: limitations to the practice of evidence-based system acquisition

Clinical decision support systems (CDSSs) assist clinicians with patient diagnosis and treatment. However, inadequate attention has been paid to the process of selecting and buying systems. The diversity of CDSSs, coupled with research obstacles, marketplace limitations, and legal impediments, has thwarted comparative outcome studies and reduced the availability of reliable information and advice for purchasers. We review these limitations and recommend several comparative studies, which were conducted in phases; studies conducted in phases and focused on limited outcomes of safety, efficacy, and implementation in varied clinical settings. Additionally, we recommend the increased availability of guidance tools to assist purchasers with evidence-based purchases. Transparency is necessary in purchasers' reporting of system defects and vendors' disclosure of marketing conflicts of interest to support methodologically sound studies. Taken together, these measures can foster the evolution of evidence-based tools that, in turn, will enable and empower system purchasers to make wise choices and improve the care of patients.

Implementation and Evaluation of a Wiki Involving Multiple Stakeholders Including Patients in the Promotion of Best Practices in Trauma Care: The WikiTrauma Interrupted Time Series Protocol

Background

Trauma is the most common cause of mortality among people between the ages of 1 and 45 years, costing Canadians 19.8 billion dollars a year (2004 data), yet half of all patients with major traumatic injuries do not receive evidence-based care, and significant regional variation in the quality of care across Canada exists. Accordingly, our goal is to lead a research project in which stakeholders themselves will adapt evidence-based trauma care knowledge tools to their own varied institutional contexts and cultures. We will do this by developing and assessing the combined impact of WikiTrauma, a free collaborative database of clinical decision support tools, and Wiki101, a training course teaching participants how to use WikiTrauma. WikiTrauma has the potential to ensure that all stakeholders (eg, patients, clinicians, and decision makers) can all contribute to, and benefit from, evidence-based clinical knowledge about trauma care that is tailored to their own needs and clinical setting.

Objective

Our main objective will be to study the combined effect of WikiTrauma and Wiki101 on the quality of care in four trauma centers in Quebec.

Methods

First, we will pilot-test the wiki with potential users to create a version ready to test in practice. A rapid, iterative prototyping process with 15 health professionals from nonparticipating centers will allow us to identify and resolve usability issues prior to finalizing the definitive version for the interrupted time series. Second, we will conduct an interrupted time series to measure the impact of our combined intervention on the quality of care in four trauma centers that will be selected—one level I, one level II, and two level III centers. Participants will be health care professionals working in the selected trauma centers. Also, five patient representatives will be recruited to participate in the creation of knowledge tools destined for their use (eg, handouts). All participants will be invited to complete the Wiki101 training and then use, and contribute to, WikiTrauma for 12 months. The primary outcome will be the change over time of a validated, composite, performance indicator score based on 15 process performance indicators found in the Quebec Trauma Registry.

Results

This project was funded in November 2014 by the Canadian Medical Protective Association. We expect to start this trial in early 2015 and preliminary results should be available in June 2016. Two trauma centers have already agreed to participate and two more will be recruited in the next months.

Conclusions

We expect that this study will add important and unique evidence about the effectiveness, safety, and cost savings of using collaborative platforms to adapt knowledge implementation tools across jurisdictions.

Building blocks for a clinical imaging informatics environment

Over the past 20 years, imaging informatics has been driven by the widespread adoption of radiology information and picture archiving and communication and speech recognition systems. These three clinical information systems are commonplace and are intuitive to most radiologists as they replicate familiar paper and film workflow. So what is next? There is a surge of innovation in imaging informatics around advanced workflow, search, electronic medical record aggregation, dashboarding, and analytics tools for quality measures (Nance et al., AJR Am J Roentgenol 200:1064-1070, 2013). The challenge lies in not having to rebuild the technological wheel for each of these new applications but instead attempt to share common components through open standards and modern development techniques. The next generation of applications will be built with moving parts that work together to satisfy advanced use cases without replicating databases and without requiring fragile, intense synchronization from clinical systems. The purpose of this paper is to identify building blocks that can position a practice to be able to quickly innovate when addressing clinical, educational, and research-related problems. This paper is the result of identifying common components in the construction of over two dozen clinical informatics projects developed at the University of Maryland Radiology Informatics Research Laboratory. The systems outlined are intended as a mere foundation rather than an exhaustive list of possible extensions.

Development and validation of questionnaires exploring health care professionals' intention to use wiki-based reminders to promote best practices in trauma

BACKGROUND

Little is known about factors influencing professionals' use of wikis.

OBJECTIVE

We developed and validated two questionnaires to assess health care professionals' intention to use wiki-based reminders for the management of trauma patients.

METHODS

We developed questionnaires for emergency physicians (EPs) and allied health professions (AHPs) based on the Theory of Planned Behavior and adapted them to the salient beliefs of each, identified in an earlier study. Items measured demographics and direct and indirect theoretical constructs. We piloted the questionnaires with 2 focus groups (5 EPs and 5 AHPs) to identify problems of wording and length. Based on feedback, we adjusted the wording and combined certain items. A new convenience sample of 25 EPs and 26 AHPs then performed a test-retest of the questionnaires at a 2-week interval. We assessed internal consistency using Cronbach alpha coefficients and temporal stability of items with an agreement intraclass correlation coefficient (ICC).

RESULTS

Five EPs and 5 AHPs (3 nurses, 1 respiratory therapist, and 1 pharmacist) formed 2 focus groups; 25 EPs and 26 AHPs (12 nurses, 7 respiratory therapists, and 7 pharmacists) completed the test and retest. The EP questionnaire test-retest scores for consistency (Cronbach alpha) and stability (ICC) were intention (test: Cronbach alpha=.94; retest: Cronbach alpha=.98; ICC=.89), attitude (.74, .72, .70), subjective norm (.79, .78, .75), perceived behavioral control (.67, .65, .66), attitudinal beliefs (.94, .86, .60), normative beliefs (.83, .87, .79), and control beliefs barriers (.58, .67, .78) and facilitators (.97, .85, .30). The AHP questionnaire scores for consistency and stability were: intention (test Cronbach alpha=.69, retest Cronbach alpha=.81, ICC=.48), attitude (.85, .87, .83), subjective norm (.47, .82, .62), perceived behavioral control (.55, .62, .60), attitudinal beliefs (.92, .91, .82), normative beliefs (.85, .90, .74), and control beliefs barriers (.58, .55, .66) and facilitators (.72, .94, -.05). To improve the psychometric properties of both questionnaires, we reformulated poorly consistent or unstable items.

CONCLUSIONS

Our new theory-based questionnaires to measure health care professionals' intention to use wiki-based reminders have adequate validity and reliability for use in large surveys. In the long run, they can be used to develop a theory-based implementation intervention for a wiki promoting best practices in trauma care.

The clinician in the Driver's Seat: part 1 - a drag/drop user-composable electronic health record platform

Creating electronic health records that support the uniquely complex and varied needs of healthcare presents formidable challenges. To address some of these challenges we created a new model for healthcare information systems, embodied in MedWISE,(2) a widget-based highly configurable electronic health record (EHR) platform. Founded on the idea that providing clinician users with greater control of the EHR may result in greater fit to user needs and preferences, MedWISE allows drag/drop user configurations and the sharing of user-created elements such as custom laboratory result panels and user-created interface tabs. After reviewing the current state of EHR configurability, we describe the philosophical, theoretical and practical rationales for our model, and the specific functionality of MedWISE. The alternative approach may have several advantages for human-computer interaction, efficiency, cognition, and fit of EHR tools to different contexts and tasks. We discuss potential issues raised by this approach.

Engaging with a Wiki related to knowledge translation: a survey of WhatisKT Wiki users

Background

In 2008, WhatisKT wiki was launched as a collaborative platform for knowledge translation (KT) researchers and stakeholders to debate the use and definitions of KT-related terms. The wiki has definitions for over 110 terms from disciplines including health care, information technology, education, accounting, and business. WhatisKT wiki has over 115 registered users. Approximately 73,000 unique visitors have visited the wiki since 2008. Despite annual increases in visitors and regular maintenance of the wiki, no visitors have contributed content or started a discussion.

Objective

We surveyed wiki users to gain an understanding of the perceived value of the website, reasons for not engaging in the wiki, and suggestions to facilitate collaboration and improve the usability of the wiki.

Methods

We surveyed three cohorts: KT Canada members who were previously invited to join the wiki, registered wiki members, and unregistered visitors. The first two cohorts completed a Web-based survey that included the System Usability Scale (SUS) questionnaire to assess usability; additionally 3 participants were interviewed. Unregistered wiki visitors were surveyed with polls posted on the wiki. The study received ethics approval from the McMaster University Faculty of Health Sciences Research Ethics Board.

Results

Twenty-three participants completed the Web-based and SUS surveys; 15 participants indicated that they would collaborate on the wiki. The mean SUS score of 67 (95% CI 56-77) indicated that the wiki could be considered for design improvements. Study participants indicated that the wiki could be improved by email notification regarding new terms, better grouping of terms, user friendly interface, and training for users interested in editing content.

Conclusions

The findings from this survey will be used to enhance the design and content of WhatisKT wiki. Further feedback from participants will be used to make the wiki an ideal collaboration platform for KT researchers interested in terminology.

The influence of a professional physician network on clinical decision making

OBJECTIVE

The aim of this study was to examine the role of physicians' professional networks in decision-making processes.

METHODS

A professional network was examined in three stages: content analysis and categorization of discussions concerning decision-making processes, in-depth interviews, and a questionnaire.

RESULTS

The RAMBAM network has professional as well as social roles. On a professional level, physicians seek approval of their initial line of reasoning regarding their clinical cases, but will consider other approaches if such are suggested by persons of professional repute or if answers are based on evidence-based medicine and include referral to a relevant source. On a social level, physicians want to be part of their professional community and share information and experiences.

CONCLUSION

Physicians' professional networks have a social role that is expressed by a feeling of belonging to a community, as well as a professional role of capturing and disseminating medical knowledge during physicians' decision-making processes. Professional networks constitute a unique source of tacit knowledge that extends existing formal knowledge resources.

PRACTICE IMPLICATIONS

The study can increase physicians' awareness of professional networks as a unique source of tacit knowledge and can assist in the future design of medical professional networks as knowledge resources for medical decision making.

Wikis and collaborative writing applications in health care: a scoping review

BACKGROUND

Collaborative writing applications (eg, wikis and Google Documents) hold the potential to improve the use of evidence in both public health and health care. The rapid rise in their use has created the need for a systematic synthesis of the evidence of their impact as knowledge translation (KT) tools in the health care sector and for an inventory of the factors that affect their use.

OBJECTIVE

Through the Levac six-stage methodology, a scoping review was undertaken to explore the depth and breadth of evidence about the effective, safe, and ethical use of wikis and collaborative writing applications (CWAs) in health care.

METHODS

Multiple strategies were used to locate studies. Seven scientific databases and 6 grey literature sources were queried for articles on wikis and CWAs published between 2001 and September 16, 2011. In total, 4436 citations and 1921 grey literature items were screened. Two reviewers independently reviewed citations, selected eligible studies, and extracted data using a standardized form. We included any paper presenting qualitative or quantitative empirical evidence concerning health care and CWAs. We defined a CWA as any technology that enables the joint and simultaneous editing of a webpage or an online document by many end users. We performed qualitative content analysis to identify the factors that affect the use of CWAs using the Gagnon framework and their effects on health care using the Donabedian framework.

RESULTS

Of the 111 studies included, 4 were experimental, 5 quasi-experimental, 5 observational, 52 case studies, 23 surveys about wiki use, and 22 descriptive studies about the quality of information in wikis. We classified them by theme: patterns of use of CWAs (n=26), quality of information in existing CWAs (n=25), and CWAs as KT tools (n=73). A high prevalence of CWA use (ie, more than 50%) is reported in 58% (7/12) of surveys conducted with health care professionals and students. However, we found only one longitudinal study showing that CWA use is increasing in health care. Moreover, contribution rates remain low and the quality of information contained in different CWAs needs improvement. We identified 48 barriers and 91 facilitators in 4 major themes (factors related to the CWA, users' knowledge and attitude towards CWAs, human environment, and organizational environment). We also found 57 positive and 23 negative effects that we classified into processes and outcomes.

CONCLUSIONS

Although we found some experimental and quasi-experimental studies of the effectiveness and safety of CWAs as educational and KT interventions, the vast majority of included studies were observational case studies about CWAs being used by health professionals and patients. More primary research is needed to find ways to address the different barriers to their use and to make these applications more useful for different stakeholders.

Understanding the factors that influence the adoption and meaningful use of social media by physicians to share medical information

Background

Within the medical community there is persistent debate as to whether the information available through social media is trustworthy and valid, and whether physicians are ready to adopt these technologies and ultimately embrace them as a format for professional development and lifelong learning.

Objective

To identify how physicians are using social media to share and exchange medical information with other physicians, and to identify the factors that influence physicians’ use of social media as a component of their lifelong learning and continuing professional development.

Methods

We developed a survey instrument based on the Technology Acceptance Model, hypothesizing that technology usage is best predicted by a physician’s attitudes toward the technology, perceptions about the technology’s usefulness and ease of use, and individual factors such as personal innovativeness. The survey was distributed via email to a random sample of 1695 practicing oncologists and primary care physicians in the United States in March 2011. Responses from 485 physicians were analyzed (response rate 28.61%).

Results

Overall, 117 of 485 (24.1%) of respondents used social media daily or many times daily to scan or explore medical information, whereas 69 of 485 (14.2%) contributed new information via social media on a daily basis. On a weekly basis or more, 296 of 485 (61.0%) scanned and 223 of 485 (46.0%) contributed. In terms of attitudes toward the use of social media, 279 of 485 respondents (57.5%) perceived social media to be beneficial, engaging, and a good way to get current, high-quality information. In terms of usefulness, 281 of 485 (57.9%) of respondents stated that social media enabled them to care for patients more effectively, and 291 of 485 (60.0%) stated it improved the quality of patient care they delivered. The main factors influencing a physician’s usage of social media to share medical knowledge with other physicians were perceived ease of use and usefulness. Respondents who had positive attitudes toward the use of social media were more likely to use social media and to share medical information with other physicians through social media. Neither age nor gender had a significant impact on adoption or usage of social media.

Conclusions

Based on the results of this study, the use of social media applications may be seen as an efficient and effective method for physicians to keep up-to-date and to share newly acquired medical knowledge with other physicians within the medical community and to improve the quality of patient care. Future studies are needed to examine the impact of the meaningful use of social media on physicians’ knowledge, attitudes, skills, and behaviors in practice.

Use of order sets in inpatient computerized provider order entry systems: a comparative analysis of usage patterns at seven sites

BACKGROUND

Many computerized provider order entry (CPOE) systems include the ability to create electronic order sets: collections of clinically related orders grouped by purpose. Order sets promise to make CPOE systems more efficient, improve care quality and increase adherence to evidence-based guidelines. However, the development and implementation of order sets can be expensive and time-consuming and limited literature exists about their utilization.

METHODS

Based on analysis of order set usage logs from a diverse purposive sample of seven sites with commercially and internally developed inpatient CPOE systems, we developed an original order set classification system. Order sets were categorized across seven non-mutually exclusive axes: admission/discharge/transfer (ADT), perioperative, condition-specific, task-specific, service-specific, convenience, and personal. In addition, 731 unique subtypes were identified within five axes: four in ADT (S=4), three in perioperative, 144 in condition-specific, 513 in task-specific, and 67 in service-specific.

RESULTS

Order sets (n=1914) were used a total of 676,142 times at the participating sites during a one-year period. ADT and perioperative order sets accounted for 27.6% and 24.2% of usage respectively. Peripartum/labor, chest pain/acute coronary syndrome/myocardial infarction and diabetes order sets accounted for 51.6% of condition-specific usage. Insulin, angiography/angioplasty and arthroplasty order sets accounted for 19.4% of task-specific usage. Emergency/trauma, obstetrics/gynecology/labor delivery and anesthesia accounted for 32.4% of service-specific usage. Overall, the top 20% of order sets accounted for 90.1% of all usage. Additional salient patterns are identified and described.

CONCLUSION

We observed recurrent patterns in order set usage across multiple sites as well as meaningful variations between sites. Vendors and institutional developers should identify high-value order set types through concrete data analysis in order to optimize the resources devoted to development and implementation.

Health care professionals' beliefs about using wiki-based reminders to promote best practices in trauma care

Background

Wikis are knowledge translation tools that could help health professionals implement best practices in acute care. Little is known about the factors influencing professionals’ use of wikis.

Objectives

To identify and compare the beliefs of emergency physicians (EPs) and allied health professionals (AHPs) about using a wiki-based reminder that promotes evidence-based care for traumatic brain injuries.

Methods

Drawing on the theory of planned behavior, we conducted semistructured interviews to elicit EPs’ and AHPs’ beliefs about using a wiki-based reminder. Previous studies suggested a sample of 25 EPs and 25 AHPs. We purposefully selected participants from three trauma centers in Quebec, Canada, to obtain a representative sample. Using univariate analyses, we assessed whether our participants’ gender, age, and level of experience were similar to those of all eligible individuals. Participants viewed a video showing a clinician using a wiki-based reminder, and we interviewed participants about their behavioral, control, and normative beliefs—that is, what they saw as advantages, disadvantages, barriers, and facilitators to their use of a reminder, and how they felt important referents would perceive their use of a reminder. Two reviewers independently analyzed the content of the interview transcripts. We considered the 75% most frequently mentioned beliefs as salient. We retained some less frequently mentioned beliefs as well.

Results

Of 66 eligible EPs and 444 eligible AHPs, we invited 55 EPs and 39 AHPs to participate, and 25 EPs and 25 AHPs (15 nurses, 7 respiratory therapists, and 3 pharmacists) accepted. Participating AHPs had more experience than eligible AHPs (mean 14 vs 11 years; P = .04). We noted no other significant differences. Among EPs, the most frequently reported advantage of using a wiki-based reminder was that it refreshes the memory (n = 14); among AHPs, it was that it provides rapid access to protocols (n = 16). Only 2 EPs mentioned a disadvantage (the wiki added stress). The most frequently reported favorable referent was nurses for EPs (n = 16) and EPs for AHPs (n = 19). The most frequently reported unfavorable referents were people resistant to standardized care for EPs (n = 8) and people less comfortable with computers for AHPs (n = 11). The most frequent facilitator for EPs was ease of use (n = 19); for AHPs, it was having a bedside computer (n = 20). EPs’ most frequently reported barrier was irregularly updated wiki-based reminders (n = 18); AHPs’ was undetermined legal responsibility (n = 10).

Conclusions

We identified EPs’ and AHPs’ salient beliefs about using a wiki-based reminder. We will draw on these beliefs to construct a questionnaire to measure the importance of these determinants to EPs’ and AHPs’ intention to use a wiki-based reminder promoting evidence-based care for traumatic brain injuries.

WikiBuild: a new application to support patient and health care professional involvement in the development of patient support tools

Active patient and public involvement as partners in their own health care and in the development of health services is key to achieving a health care system that is responsive to patients’ needs and values. It promotes better use of the health care system, and improves health outcomes, quality of life and patient satisfaction. By involving patients and health care professionals as partners in the creation and updating of patient health support tools, wikis—highly accessible, interactive vehicles of communication—have the potential to empower users to implement these support tools in daily life. Acknowledging the potential of wikis, and recognizing that they capitalize on the free and open access to information, scientists, opinion leaders and patient advocates have suggested that wikis could help decision-making constituencies improve the delivery of health care. They might also decrease its cost and improve access to knowledge within developing countries. However, little is known about the efficacy of wikis in helping to attain these goals. There is also a need to know more about the intention of patients and health care workers to use wikis, in what circumstances and what factors will influence their use of wikis. In this issue of the Journal of Medical Internet Research, Gupta et al describe how they developed and tested a new wiki-inspired application to improve asthma care. The researchers involved patients with asthma, primary care physicians, pulmonologists and certified asthma educators in the construction of an asthma action plan. Their paper—entitled “WikiBuild: a new online collaboration process for multistakeholder tool development and consensus building”—is the first description of a wiki-inspired technology built to involve patients and health care professionals in the development of a patient support tool. This innovative study has made important contributions toward how wikis could be generalized to involve multiple stakeholders in the development of other knowledge translation tools such as clinical practice guidelines or decision aids. More specifically, Gupta et al have uncovered potential action mechanisms toward increasing usage of these tools by patients and health care professionals. These are decreasing hierarchical influences, increasing usability and adapting a tool to local context. More research is now needed to determine if the use of the resulting wiki-developed plan will actually be higher than a plan developed using other methods. Furthermore, there is also a need to assess the intention of participants to continue using wiki-based processes on an ongoing basis. It is in this dynamic and continuous retroaction loop that the support tool users—both patients and health care professionals—can adapt and improve the product after its real-life shortcomings are revealed and as new evidence becomes available. As such, a wiki would be more than a simple patient support development tool, but could also become a dynamic and interactive repository and delivery tool that would facilitate ongoing and sustainable patient and professional engagement.

Pharmacist use of social media

INTRODUCTION

The rapid emergence and exploding usage of social media (also called Web 2.0) present pharmacists with new professional, ethical and time management challenges.

OBJECTIVES

To describe social media use among pharmacists in West Virginia, USA.

METHODS

A survey was administered during the West Virginia Pharmacist Association 102nd Annual Convention held in October 2009. The meeting participants were pharmacists practising in the different regions of West Virginia. All conference attendees were eligible to participate.

RESULTS

The survey was completed by all 50 pharmacists in attendance, yielding a response rate of 100%. Social media use was found to be common among West Virginia pharmacists, with the most frequently used applications including: YouTube (74%), Wikipedia (72%), Facebook (50%), and blogs (26%). However, there were some tools that pharmacists barely used such as Bebo, Hi5, Flickr and Friendster. Given the widespread use of Facebook by respondent pharmacists, it is noteworthy that they indicated the main purposes for using it were for chatting, uploading pictures and keeping touch with friends rather than for professional and educational purposes.

DISCUSSION

Presently, pharmacists utilize social media primarily for personal purposes. As social media becomes more sophisticated and widely adopted in the healthcare arena, it is probable that pharmacists will also increasingly utilize it for professional and educational purposes.

Analysis of content legibility for smartphones of websites of the korean urological association and other urological societies in Korea

PURPOSE

We performed an analysis of the smartphone legibility of the websites of the Korean Urological Association (KUA) and other urological societies.

MATERIALS AND METHODS

This study was conducted on the websites of the KUA and nine other urological societies. Each website was accessed via iPhone Safari and Android Chrome, respectively, to evaluate the establishment and readability of the mobile web pages. The provision of Really Simple Syndication (RSS) feeds by the websites and whether the websites had Twitter and Facebook accounts were evaluated. In addition, a validation test on the web standards was performed by using the World Wide Web Consortium (W3C®) Markup Validation Service, and subsequently the numbers of errors and warnings that occurred were analyzed.

RESULTS

When accessed via Safari, two websites were legible, four were somewhat legible, and four were somewhat illegible. When accessed via Chrome, two websites were legible, six were somewhat legible, and two were somewhat illegible. One website provided an RSS feed and two websites managed members via separate Twitter accounts. No website supported mobile web pages. The result of the W3C® Markup Validation test on 10 websites showed a mean error rate of 221.6 (range, 13-1,477) and a mean warning rate of 127.13 (range, 0-655).

CONCLUSIONS

The smartphone legibility level of the websites of urological societies was relatively low. Improved smartphone legibility and web standard compliance of the websites of urological societies are required to keep up with the popularity of smartphones.

Comparison of clinical knowledge management capabilities of commercially-available and leading internally-developed electronic health records

BACKGROUND

We have carried out an extensive qualitative research program focused on the barriers and facilitators to successful adoption and use of various features of advanced, state-of-the-art electronic health records (EHRs) within large, academic, teaching facilities with long-standing EHR research and development programs. We have recently begun investigating smaller, community hospitals and out-patient clinics that rely on commercially-available EHRs. We sought to assess whether the current generation of commercially-available EHRs are capable of providing the clinical knowledge management features, functions, tools, and techniques required to deliver and maintain the clinical decision support (CDS) interventions required to support the recently defined "meaningful use" criteria.

METHODS

We developed and fielded a 17-question survey to representatives from nine commercially available EHR vendors and four leading internally developed EHRs. The first part of the survey asked basic questions about the vendor's EHR. The second part asked specifically about the CDS-related system tools and capabilities that each vendor provides. The final section asked about clinical content.

RESULTS

All of the vendors and institutions have multiple modules capable of providing clinical decision support interventions to clinicians. The majority of the systems were capable of performing almost all of the key knowledge management functions we identified.

CONCLUSION

If these well-designed commercially-available systems are coupled with the other key socio-technical concepts required for safe and effective EHR implementation and use, and organizations have access to implementable clinical knowledge, we expect that the transformation of the healthcare enterprise that so many have predicted, is achievable using commercially-available, state-of-the-art EHRs.

Governance for clinical decision support: case studies and recommended practices from leading institutions

OBJECTIVE

Clinical decision support (CDS) is a powerful tool for improving healthcare quality and ensuring patient safety; however, effective implementation of CDS requires effective clinical and technical governance structures. The authors sought to determine the range and variety of these governance structures and identify a set of recommended practices through observational study.

DESIGN

Three site visits were conducted at institutions across the USA to learn about CDS capabilities and processes from clinical, technical, and organizational perspectives. Based on the results of these visits, written questionnaires were sent to the three institutions visited and two additional sites. Together, these five organizations encompass a variety of academic and community hospitals as well as small and large ambulatory practices. These organizations use both commercially available and internally developed clinical information systems.

MEASUREMENTS

Characteristics of clinical information systems and CDS systems used at each site as well as governance structures and content management approaches were identified through extensive field interviews and follow-up surveys.

RESULTS

Six recommended practices were identified in the area of governance, and four were identified in the area of content management. Key similarities and differences between the organizations studied were also highlighted.

CONCLUSION

Each of the five sites studied contributed to the recommended practices presented in this paper for CDS governance. Since these strategies appear to be useful at a diverse range of institutions, they should be considered by any future implementers of decision support.

Exploring the potential of Web 2.0 to address health disparities

This article addresses use of the Internet and Web 2.0 technologies by racial and ethnic minorities and explores the potential opportunities and challenges in leveraging Web 2.0 approaches to impact health disparities. These opportunities and challenges include developing approaches and methods to (a) identify strategies for integrating social media into health promotion interventions focused on major health-related issues that affect members of medically underserved groups; (b) amalgamate techniques to leverage and connect social-media technologies to other evidence-informed online resources; (c) integrate health communication best practices, including addressing health literacy issues; (d) capitalize on social networking to enhance access and communication with health care providers; and (e) advance current efforts and ongoing expansion of research participation by individuals from underserved communities.

Clinical decision support: progress and opportunities

In 2005, the American Medical Informatics Association undertook a set of activities relating to clinical decision support (CDS), with support from the office of the national coordinator and the Agency for Healthcare Research and Quality. They culminated in the release of the roadmap for national action on CDS in 2006. This article assesses progress toward the short-term goals within the roadmap, and recommends activities to continue to improve CDS adoption throughout the United States. The report finds that considerable progress has been made in the past four years, although significant work remains. Healthcare quality organizations are increasingly recognizing the role of health information technology in improving care, multi-site CDS demonstration projects are under way, and there are growing incentives for adoption. Specific recommendations include: (1) designating a national entity to coordinate CDS work and collaboration; (2) developing approaches to monitor and track CDS adoption and use; (3) defining and funding a CDS research agenda; and (4) updating the CDS 'critical path'.

Healthcare professionals' intentions to use wiki-based reminders to promote best practices in trauma care: a survey protocol

BACKGROUND

Healthcare professionals are increasingly using wikis as collaborative tools to create, synthesize, share, and disseminate knowledge in healthcare. Because wikis depend on collaborators to keep content up-to-date, healthcare professionals who use wikis must adopt behaviors that foster this collaboration. This protocol describes the methods we will use to develop and test the metrological qualities of a questionnaire that will assess healthcare professionals' intentions and the determinants of those intentions to use wiki-based reminders that promote best practices in trauma care.

METHODS

Using the Theory of Planned Behavior, we will conduct semi-structured interviews of healthcare professionals to identify salient beliefs that may affect their future use of wikis. These beliefs will inform our questionnaire on intended behavior. A test-retest of the survey will verify the questionnaire's stability over time. We will interview 50 healthcare professionals (25 physicians and 25 allied health professionals) working in the emergency departments of three trauma centers in Quebec, Canada. We will analyze the content of the interviews and construct and pilot a questionnaire. We will then test the revised questionnaire with 30 healthcare professionals (15 physicians and 15 allied health professionals) and retest it two weeks later. We will assess the internal consistency of the questionnaire constructs using Cronbach's alpha coefficients and determine their stability with the intra-class correlation (ICC).

DISCUSSION

To our knowledge, this study will be the first to develop and test a theory-based survey that measures healthcare professionals' intentions to use a wiki-based intervention. This study will identify professionals' salient beliefs qualitatively and will quantify the psychometric capacities of the questionnaire based on those beliefs.

Biomedical informatics and translational medicine

Biomedical informatics involves a core set of methodologies that can provide a foundation for crossing the "translational barriers" associated with translational medicine. To this end, the fundamental aspects of biomedical informatics (e.g., bioinformatics, imaging informatics, clinical informatics, and public health informatics) may be essential in helping improve the ability to bring basic research findings to the bedside, evaluate the efficacy of interventions across communities, and enable the assessment of the eventual impact of translational medicine innovations on health policies. Here, a brief description is provided for a selection of key biomedical informatics topics (Decision Support, Natural Language Processing, Standards, Information Retrieval, and Electronic Health Records) and their relevance to translational medicine. Based on contributions and advancements in each of these topic areas, the article proposes that biomedical informatics practitioners ("biomedical informaticians") can be essential members of translational medicine teams.

The state of the art in clinical knowledge management: an inventory of tools and techniques

PURPOSE

To explore the need for, and use of, high-quality, collaborative, clinical knowledge management (CKM) tools and techniques to manage clinical decision support (CDS) content.

METHODS

In order to better understand the current state of the art in CKM, we developed a survey of potential CKM tools and techniques. We conducted an exploratory study by querying a convenience sample of respondents about their use of specific practices in CKM.

RESULTS

The following tools and techniques should be priorities in organizations interested in developing successful computer-based provider order entry (CPOE) and CDS implementations: (1) a multidisciplinary team responsible for creating and maintaining the clinical content; (2) an external organizational repository of clinical content with web-based viewer that allows anyone in the organization to review it; (3) an online, collaborative, interactive, Internet-based tool to facilitate content development; (4) an enterprise-wide tool to maintain the controlled clinical terminology concepts. Even organizations that have been successfully using computer-based provider order entry with advanced clinical decision support features for well over 15 years are not using all of the CKM tools or practices that we identified.

CONCLUSIONS

If we are to further stimulate progress in the area of clinical decision support, we must continue to develop and refine our understanding and use of advanced CKM capabilities.

[Medicine 2.0: the stakes of participatory medicine]

Web 2.0: interactive, collaborative tools (wikis, social networks, blogs, virtual worlds) make Internet users active participants rather than simple consumers. Medicine 2.0: mentalities, approaches, and medical practices are changing, thanks to greater access to information, communal exchanges, and the comparison of personal experiences. Beyond the many wikis, blogs, and other collaborative tools, the site PatientsLikeMe.com stands out from the 2.0 crowd by its graphic representation of the clinical results entered by patients. Various European Web 2.0 sites exist as well. The risks reside in the reliability of information and the privacy of patient data. The challenges are to use these new resources to improve the quality of care and participate in the profound change they are bringing to the healthcare system.

Clinical decision support capabilities of commercially-available clinical information systems

BACKGROUND

The most effective decision support systems are integrated with clinical information systems, such as inpatient and outpatient electronic health records (EHRs) and computerized provider order entry (CPOE) systems. Purpose The goal of this project was to describe and quantify the results of a study of decision support capabilities in Certification Commission for Health Information Technology (CCHIT) certified electronic health record systems.

METHODS

The authors conducted a series of interviews with representatives of nine commercially available clinical information systems, evaluating their capabilities against 42 different clinical decision support features.

RESULTS

Six of the nine reviewed systems offered all the applicable event-driven, action-oriented, real-time clinical decision support triggers required for initiating clinical decision support interventions. Five of the nine systems could access all the patient-specific data items identified as necessary. Six of the nine systems supported all the intervention types identified as necessary to allow clinical information systems to tailor their interventions based on the severity of the clinical situation and the user's workflow. Only one system supported all the offered choices identified as key to allowing physicians to take action directly from within the alert. Discussion The principal finding relates to system-by-system variability. The best system in our analysis had only a single missing feature (from 42 total) while the worst had eighteen.This dramatic variability in CDS capability among commercially available systems was unexpected and is a cause for concern.

CONCLUSIONS

These findings have implications for four distinct constituencies: purchasers of clinical information systems, developers of clinical decision support, vendors of clinical information systems and certification bodies.

Junior physician's use of Web 2.0 for information seeking and medical education: a qualitative study

BACKGROUND

Web 2.0 internet tools and methods have attracted considerable attention as a means to improve health care delivery. Despite evidence demonstrating their use by medical professionals, there is no detailed research describing how Web 2.0 influences physicians' daily clinical practice. Hence this study examines Web 2.0 use by 35 junior physicians in clinical settings to further understand their impact on medical practice.

METHOD

Diaries and interviews encompassing 177 days of internet use or 444 search incidents, analyzed via thematic analysis.

RESULTS

Results indicate that 53% of internet visits employed user-generated or Web 2.0 content, with Google and Wikipedia used by 80% and 70% of physicians, respectively. Despite awareness of information credibility risks with Web 2.0 content, it has a role in information seeking for both clinical decisions and medical education. This is enabled by the ability to cross check information and the diverse needs for background and non-verified information.

CONCLUSION

Web 2.0 use represents a profound departure from previous learning and decision processes which were normally controlled by senior medical staff or medical schools. There is widespread concern with the risk of poor quality information with Web 2.0 use, and the manner in which physicians are using it suggest effective use derives from the mitigating actions by the individual physician. Three alternative policy options are identified to manage this risk and improve efficiency in Web 2.0's use.