Usability evaluation of a clinical decision support tool for osteoporosis disease management

Design and validation of a new Healthcare Systems Usability Scale (HSUS) for clinical decision support systems: a mixed-methods approach

OBJECTIVE

To develop and validate a questionnaire to assess the usability of clinical decision support systems (CDSS) and to assist in the early identification of usability issues that may impact patient safety and quality of care.

DESIGN

Mixed research methods were used to develop and validate the questionnaire. The qualitative study involved scale item development, content and face validity. Pilot testing established construct validity using factor analysis and facilitated estimates for reliability and internal consistency using the Cronbach's alpha coefficient.

SETTING

Two hospitals within a single National Health Service Trust.

PARTICIPANTS

We recruited a panel of 7 experts in usability and questionnaire writing for health purposes to test content validity; 10 participants to assess face validity and 78 participants for the pilot testing. To be eligible for this last phase, participants needed to be health professionals with at least 3 months experience using the local hospital electronic patient record system.

RESULTS

Feedback from the face and content validity phases contributed to the development and improvement of scale items. The final Healthcare Systems Usability Scale (HSUS) proved quick to complete, easy to understand and was mostly worded by potential users. Exploratory analysis revealed four factors related to patient safety, task execution, alerts or recommendations accuracy, the effects of the system on workflow and ease of system use. These separate into four subscales: patient safety and decision effectiveness (seven items), workflow integration (six items), work effectiveness (five items) and user control (four items). These factors affect the quality of care and clinician's ability to make informed and timely decisions when using CDSS. The HSUS has a very good reliability with global Cronbach's alpha 0.914 and between 0.702 and 0.926 for the four subscales.

CONCLUSION

The HSUS is a valid and reliable tool for usability testing of CDSS and early identification of usability issues that may cause medical adverse events.

Real-Time User Feedback to Support Clinical Decision Support System Improvement

OBJECTIVES

To improve clinical decision support (CDS) by allowing users to provide real-time feedback when they interact with CDS tools and by creating processes for responding to and acting on this feedback.

METHODS

Two organizations implemented similar real-time feedback tools and processes in their electronic health record and gathered data over a 30-month period. At both sites, users could provide feedback by using Likert feedback links embedded in all end-user facing alerts, with results stored outside the electronic health record, and provide feedback as a comment when they overrode an alert. Both systems are monitored daily by clinical informatics teams.

RESULTS

The two sites received 2,639 Likert feedback comments and 623,270 override comments over a 30-month period. Through four case studies, we describe our use of end-user feedback to rapidly respond to build errors, as well as identifying inaccurate knowledge management, user-interface issues, and unique workflows.

CONCLUSION

Feedback on CDS tools can be solicited in multiple ways, and it contains valuable and actionable suggestions to improve CDS alerts. Additionally, end users appreciate knowing their feedback is being received and may also make other suggestions to improve the electronic health record. Incorporation of end-user feedback into CDS monitoring, evaluation, and remediation is a way to improve CDS.

The impact of users' cognitive function on evaluator perceptions of usability

To explore the association between the user’s cognitive function and usability reported by the evaluator. A cross-sectional study was conducted with a community-based sample. Data about participants’ age, sex, education, sleep quantity, subjective memory complaints, and cognitive function were collected. A usability session was conducted to evaluate a digital solution called Brain on Track. Independent linear-regression analyses were used to explore univariable and multivariable associations between evaluator-reported usability assessment and the users’ cognitive function, age, sex, education, sleep quantity, and subjective memory complaints. A total of 238 participants entered this study, of which 161 (67.6%) were females and the mean age was 42 (SD 12.9) years old. All variables (age, education, sleep quantity, subjective memory complaints and cognitive function) except sex were significantly associated with evaluator-reported usability in the univariable analysis (p < 0.05). Cognitive function, age, education, and subjective memory complaints remained significant in the multivariable model (F = 38.87, p < 0.001) with an adjusted R2 of 0.391. Cognition scores alone showed an adjusted R² of 0.288. This work suggests that cognitive function impacts evaluator reported usability, alongside other users’ characteristics and needs to be considered in the usability evaluation.

Web-Based Tool (FH Family Share) to Increase Uptake of Cascade Testing for Familial Hypercholesterolemia: Development and Evaluation

Background

Familial hypercholesterolemia, a prevalent genetic disorder, remains significantly underdiagnosed in the United States. Cascade testing, wherein individuals diagnosed with familial hypercholesterolemia— probands—contact their family members to inform them of their risk for familial hypercholesterolemia, has low uptake in the United States. Digital tools are needed to facilitate communication between familial hypercholesterolemia probands and their family members and to promote sharing of familial hypercholesterolemia–related risk information.

Objective

We aimed to create and evaluate a web-based tool designed to enhance familial communication and promote cascade testing for familial hypercholesterolemia.

Methods

A hybrid type 1 implementation science framework and a user-centered design process were used to develop an interactive web-based tool—FH Family Share—that enables familial hypercholesterolemia probands to communicate information about their familial hypercholesterolemia diagnosis with at-risk relatives. Probands can also use the tool to draw a family pedigree and learn more about familial hypercholesterolemia through education modules and curated knowledge resources. Usability guidelines and standards were taken into account during the design and development of the tool. The initial prototype underwent a cognitive walkthrough, which was followed by usability testing with key stakeholders including genetic counselors and patients with familial hypercholesterolemia. Participants navigated the prototype using the think-aloud technique, and their feedback was used to refine features of the tool.

Results

Key themes that emerged from the cognitive walkthrough were design, format, navigation, terminology, instructions, and learnability. Expert feedback from the cognitive walkthrough resulted in a rebuild of the web-based tool to align it with institutional standards. Usability testing with genetic counselors and patients with familial hypercholesterolemia provided insights on user experience, satisfaction and interface design and highlighted specific modifications that were made to refine the features of FH Family Share. Genetic counselors and patients with familial hypercholesterolemia suggested inclusion of the following features in the web-based tool: (1) a letter-to-family-member email template, (2) education modules, and (3) knowledge resources. Surveys revealed that 6 of 9 (67%) genetic counselors found information within FH Family Share very easy to find, and 5 of 9 (56%) genetic counselors found information very easy to understand; 5 of 9 (56%) patients found information very easy to find within the website, and 7 of 9 (78%) patients found information very easy to understand. All genetic counselors and patients indicated that FH Family Share was a resource worth returning to.

Conclusions

FH Family Share facilitates communication between probands and their relatives. Once informed, at-risk family members have the option to seek testing and treatment for familial hypercholesterolemia.

Comparison of Methods for Alcohol and Drug Screening in Primary Care Clinics

IMPORTANCE

Guidelines recommend that adult patients receive screening for alcohol and drug use during primary care visits, but the adoption of screening in routine practice remains low. Clinics frequently struggle to choose a screening approach that is best suited to their resources, workflows, and patient populations.

OBJECTIVE

To evaluate how to best implement electronic health record (EHR)-integrated screening for substance use by comparing commonly used screening methods and examining their association with implementation outcomes.

DESIGN, SETTING, AND PARTICIPANTS

This article presents the outcomes of phases 3 and 4 of a 4-phase quality improvement, implementation feasibility study in which researchers worked with stakeholders at 6 primary care clinics in 2 large urban academic health care systems to define and implement their optimal screening approach. Site A was located in New York City and comprised 2 clinics, and site B was located in Boston, Massachusetts, and comprised 4 clinics. Clinics initiated screening between January 2017 and October 2018, and 93 114 patients were eligible for screening for alcohol and drug use. Data used in the analysis were collected between January 2017 and October 2019, and analysis was performed from July 13, 2018, to March 23, 2021.

INTERVENTIONS

Clinics integrated validated screening questions and a brief counseling script into the EHR, with implementation supported by the use of clinical champions (ie, clinicians who advocate for change, motivate others, and use their expertise to facilitate the adoption of an intervention) and the training of clinic staff. Clinics varied in their screening approaches, including the type of visit targeted for screening (any visit vs annual examinations only), the mode of administration (staff-administered vs self-administered by the patient), and the extent to which they used practice facilitation and EHR usability testing.

MAIN OUTCOMES AND MEASURES

Data from the EHRs were extracted quarterly for 12 months to measure implementation outcomes. The primary outcome was screening rate for alcohol and drug use. Secondary outcomes were the prevalence of unhealthy alcohol and drug use detected via screening, and clinician adoption of a brief counseling script.

RESULTS

Patients of the 6 clinics had a mean (SD) age ranging from 48.9 (17.3) years at clinic B2 to 59.1 (16.7) years at clinic B3, were predominantly female (52.4% at clinic A1 to 64.6% at clinic A2), and were English speaking. Racial diversity varied by location. Of the 93,114 patients with primary care visits, 71.8% received screening for alcohol use, and 70.5% received screening for drug use. Screening at any visit (implemented at site A) in comparison with screening at annual examinations only (implemented at site B) was associated with higher screening rates for alcohol use (90.3%-94.7% vs 24.2%-72.0%, respectively) and drug use (89.6%-93.9% vs 24.6%-69.8%). The 5 clinics that used a self-administered screening approach had a higher detection rate for moderate- to high-risk alcohol use (14.7%-36.6%) compared with the 1 clinic that used a staff-administered screening approach (1.6%). The detection of moderate- to high-risk drug use was low across all clinics (0.5%-1.0%). Clinics with more robust practice facilitation and EHR usability testing had somewhat greater adoption of the counseling script for patients with moderate-high risk alcohol or drug use (1.4%-12.5% vs 0.1%-1.1%).

CONCLUSIONS AND RELEVANCE

In this quality improvement study, EHR-integrated screening was feasible to implement in all clinics and unhealthy alcohol use was detected more frequently when self-administered screening was used at any primary care visit. The detection of drug use was low at all clinics, as was clinician adoption of counseling. These findings can be used to inform the decision-making of health care systems that are seeking to implement screening for substance use.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT02963948.

User-centered and theory-based design of a professional training program on shared decision-making with older adults living with neurocognitive disorders: a mixed-methods study

BACKGROUND

We know little about the best approaches to design training for healthcare professionals. We thus studied how user-centered and theory-based design contribute to the development of a distance learning program for professionals, to increase their shared decision-making (SDM) with older adults living with neurocognitive disorders and their caregivers.

METHODS

In this mixed-methods study, healthcare professionals who worked in family medicine clinics and homecare services evaluated a training program in a user-centered approach with several iterative phases of quantitative and qualitative evaluation, each followed by modifications. The program comprised an e-learning activity and five evidence summaries. A subsample assessed the e-learning activity during semi-structured think-aloud sessions. A second subsample assessed the evidence summaries they received by email. All participants completed a theory-based questionnaire to assess their intention to adopt SDM. Descriptive statistical analyses and qualitative thematic analyses were integrated at each round to prioritize training improvements with regard to the determinants most likely to influence participants' intention.

RESULTS

Of 106 participants, 98 completed their evaluations of either the e-learning activity or evidence summary (93%). The professions most represented were physicians (60%) and nurses (15%). Professionals valued the e-learning component to gain knowledge on the theory and practice of SDM, and the evidence summaries to apply the knowledge gained through the e-learning activity to diverse clinical contexts. The iterative design process allowed addressing most weaknesses reported. Participants' intentions to adopt SDM and to use the summaries were high at baseline and remained positive as the rounds progressed. Attitude and social influence significantly influenced participants' intention to use the evidence summaries (P < 0.0001). Despite strong intention and the tailoring of tools to users, certain factors external to the training program can still influence the effective use of these tools and the adoption of SDM in practice.

CONCLUSIONS

A theory-based and user-centered design approach for continuing professional development interventions on SDM with older adults living with neurocognitive disorders and their caregivers appeared useful to identify the most important determinants of learners' intentions to use SDM in their practice, and validate our initial interpretations of learners' assessments during the subsequent evaluation round.

Primary Care Pre-Visit Electronic Patient Questionnaire for Asthma: Uptake Analysis and Predictor Modeling

Background

mHealth tablet-based interventions are increasingly being studied and deployed in various health care settings, yet little knowledge exists regarding patient uptake and acceptance or how patient demographics influence these important implementation metrics.

Objective

To determine which factors influence the uptake and successful completion of an mHealth tablet questionnaire by analyzing its implementation in a primary care setting.

Methods

We prospectively studied a patient-facing electronic touch-tablet asthma questionnaire deployed as part of the Electronic Asthma Management System. We describe tablet uptake and completion rates and corresponding predictor models for these behaviors.

Results

The tablet was offered to and accepted by patients in 891/1715 (52.0%) visits. Patients refused the tablet in 33.0% (439/1330) visits in which it was successfully offered. Patients aged older than 65 years of age (odds ratio [OR] 2.30, 95% CI 1.33-3.95) and with concurrent chronic obstructive pulmonary disease (OR 2.22, 95% CI 1.05-4.67) were more likely to refuse the tablet, and those on an asthma medication (OR 0.55, 95% CI 0.30-0.99) were less likely to refuse it. Once accepted, the questionnaire was completed in 784/891 (88.0%) instances, with those on an asthma medication (OR 0.53, 95% CI 0.32-0.88) being less likely to leave it incomplete.

Conclusions

Older age predicted initial tablet refusal but not tablet questionnaire completion, suggesting that perceptions of mHealth among older adults may negatively impact uptake, independent of usability. The influence of being on an asthma medication suggests that disease severity may also mediate mHealth acceptance. Although use of mHealth questionnaires is growing rapidly across health care settings and diseases, few studies describe their real-world acceptance and its predictors. Our results should be complemented by qualitative methods to identify barriers and enablers to uptake and may inform technological and implementation strategies to drive successful usage.

An Implementation Science Framework to Develop a Clinical Decision Support Tool for Familial Hypercholesterolemia

Electronic health record (EHR)-based clinical decision support (CDS) can address the low awareness and undertreatment of familial hypercholesterolemia (FH), a disorder associated with a markedly increased risk of coronary heart disease. We aimed to incorporate provider perspectives into the development and implementation of a CDS tool for FH. An implementation science framework and a user-centered design process were used to create a CDS tool for FH. Primary care physicians and specialist physicians participated in qualitative interviews, usability testing and an implementation survey. The CDS was configured in two formats—a best practice alert (BPA) and an in-basket message and subsequently deployed in the EHR in silent mode. The key themes that emerged from the analysis of interview transcripts included understanding and awareness of FH, clinical workflow, physician preferences and value of CDS tools, perspectives on patient needs and values and dissemination and implementation. Recommendations related to usability included preferred CDS format and placement, content, timing and frequency, and level of alert urgency/prioritization. In response to the survey, 84.6% of physicians agreed that the CDS would improve early FH diagnosis and 92.3% agreed that it would help them identify and manage FH patients. Physician feedback led to iterative CDS refinement. In summary, we developed a CDS tool for FH using an implementation science framework and physician feedback. Initial deployment revealed a significant burden of FH and the potential for the CDS tool to have a large impact.

Improving Team-Based Decision Making Using Data Analytics and Informatics: Protocol for a Collaborative Decision Support Design

Background

According to the September 2015 Institute of Medicine report, Improving Diagnosis in Health Care, each of us is likely to experience one diagnostic error in our lifetime, often with devastating consequences. Traditionally, diagnostic decision making has been the sole responsibility of an individual clinician. However, diagnosis involves an interaction among interprofessional team members with different training, skills, cultures, knowledge, and backgrounds. Moreover, diagnostic error is prevalent in the interruption-prone environment, such as the emergency department, where the loss of information may hinder a correct diagnosis.

Objective

The overall purpose of this protocol is to improve team-based diagnostic decision making by focusing on data analytics and informatics tools that improve collective information management.

Methods

To achieve this goal, we will identify the factors contributing to failures in team-based diagnostic decision making (aim 1), understand the barriers of using current health information technology tools for team collaboration (aim 2), and develop and evaluate a collaborative decision-making prototype that can improve team-based diagnostic decision making (aim 3).

Results

Between 2019 to 2020, we are collecting data for this study. The results are anticipated to be published between 2020 and 2021.

Conclusions

The results from this study can shed light on improving diagnostic decision making by incorporating diagnostics rationale from team members. We believe a positive direction to move forward in solving diagnostic errors is by incorporating all team members, and using informatics.

International Registered Report Identifier (IRRID)

DERR1-10.2196/16047

Learning from usability testing of an arts-based knowledge translation tool for parents of a child with asthma

Aim

Digital, art‐ and story‐based resources can be viable and engaging knowledge translation strategies in health care. Understanding the usability of these approaches can help maximize their impact. The aim of this work is to understand what aspects of ‘My Asthma Diary’, an art‐based digital knowledge translation tool for parents of children with asthma, has an impact on usability.

Design

Sequential explanatory mixed methods pilot study.

Methods

Eighteen parents of children with asthma reviewed ‘My Asthma Diary’ in a paediatric emergency department and completed a usability questionnaire. Follow‐up interviews were conducted with five parents and analysed with qualitative description.

Results

We identified four themes which complemented the quantitative results: (a) the eBooks are relatable and mirror personal experience; (b) the digital format is convenient and easy to navigate; (c) the narrative structure aids learning; and (d) the narrative and illustrations are synergistic. We summarize core usability considerations for subsequent research and creative knowledge translation tool development in other contexts.

Live Usability Testing of Two Complex Clinical Decision Support Tools: Observational Study

BACKGROUND

Potential of the electronic health records (EHR) and clinical decision support (CDS) systems to improve the practice of medicine has been tempered by poor design and the resulting burden they place on providers. CDS is rarely tested in the real clinical environment. As a result, many tools are hard to use, placing strain on providers and resulting in low adoption rates. The existing CDS usability literature relies primarily on expert opinion and provider feedback via survey. This is the first study to evaluate CDS usability and the provider-computer-patient interaction with complex CDS in the real clinical environment.

OBJECTIVE

This study aimed to further understand the barriers and facilitators of meaningful CDS usage within a real clinical context.

METHODS

This qualitative observational study was conducted with 3 primary care providers during 6 patient care sessions. In patients with the chief complaint of sore throat, a CDS tool built with the Centor Score was used to stratify the risk of group A Streptococcus pharyngitis. In patients with a chief complaint of cough or upper respiratory tract infection, a CDS tool built with the Heckerling Rule was used to stratify the risk of pneumonia. During usability testing, all human-computer interactions, including audio and continuous screen capture, were recorded using the Camtasia software. Participants' comments and interactions with the tool during clinical sessions and participant comments during a postsession brief interview were placed into coding categories and analyzed for generalizable themes.

RESULTS

In the 6 encounters observed, primary care providers toggled between addressing either the computer or the patient during the visit. Minimal time was spent listening to the patient without engaging the EHR. Participants mostly used the CDS tool with the patient, asking questions to populate the calculator and discussing the results of the risk assessment; they reported the ability to do this as the major benefit of the tool. All providers were interrupted during their use of the CDS tool by the need to refer to other sections of the chart. In half of the visits, patients' clinical symptoms challenged the applicability of the tool to calculate the risk of bacterial infection. Primary care providers rarely used the incorporated incentives for CDS usage, including progress notes and patient instructions.

CONCLUSIONS

Live usability testing of these CDS tools generated insights about their role in the patient-provider interaction. CDS may contribute to the interaction by being simultaneously viewed by the provider and patient. CDS can improve usability and lessen the strain it places on providers by being short, flexible, and customizable to unique provider workflow. A useful component of CDS is being as widely applicable as possible and ensuring that its functions represent the fastest way to perform a particular task.

Development process and patient usability preferences for a touch screen tablet-based questionnaire

We sought to design a touch tablet asthma questionnaire while identifying patient preferences for usability features of such questionnaires. We created an evidence-based prototype and employed rapid-cycle design (semi-structured focus group testing, analysis, corresponding modifications, re-testing) with asthma patients aged ⩾16 years. We analyzed transcripts using deductive and inductive content analysis. Quantitative measures included Likert-type-scale responses, the System Usability Scale, and questionnaire completion times. There were 20 participants across five focus groups (15/20 female, age 49.1 ± 15.6 years). Usability-related themes included (1) "Touch Technology" (hygiene, touch technology familiarity, ease of use) and (2) "Questionnaire Design" (visual characteristics, navigation). Completion time was 11.7 ± 5.9 min. Summative Likert-type scale responses suggested high system usability, as did a System Usability Scale score of 84.2 ± 14.7. In summary, Attention to specific technology- and design-related preferences can result in a highly usable patient-facing touch tablet questionnaire. Our findings can inform touch questionnaire design across other diseases.

Enhancing the uptake of systematic reviews of effects: what is the best format for health care managers and policy-makers? A mixed-methods study

BACKGROUND

Systematic reviews are infrequently used by health care managers (HCMs) and policy-makers (PMs) in decision-making. HCMs and PMs co-developed and tested novel systematic review of effects formats to increase their use.

METHODS

A three-phased approach was used to evaluate the determinants to uptake of systematic reviews of effects and the usability of an innovative and a traditional systematic review of effects format. In phase 1, survey and interviews were conducted with HCMs and PMs in four Canadian provinces to determine perceptions of a traditional systematic review format. In phase 2, systematic review format prototypes were created by HCMs and PMs via Conceptboard©. In phase 3, prototypes underwent usability testing by HCMs and PMs.

RESULTS

Two hundred two participants (80 HCMs, 122 PMs) completed the phase 1 survey. Respondents reported that inadequate format (Mdn = 4; IQR = 4; range = 1-7) and content (Mdn = 4; IQR = 3; range = 1-7) influenced their use of systematic reviews. Most respondents (76%; n = 136/180) reported they would be more likely to use systematic reviews if the format was modified. Findings from 11 interviews (5 HCMs, 6 PMs) revealed that participants preferred systematic reviews of effects that were easy to access and read and provided more information on intervention effectiveness and less information on review methodology. The mean System Usability Scale (SUS) score was 55.7 (standard deviation [SD] 17.2) for the traditional format; a SUS score < 68 is below average usability. In phase 2, 14 HCMs and 20 PMs co-created prototypes, one for HCMs and one for PMs. HCMs preferred a traditional information order (i.e., methods, study flow diagram, forest plots) whereas PMs preferred an alternative order (i.e., background and key messages on one page; methods and limitations on another). In phase 3, the prototypes underwent usability testing with 5 HCMs and 7 PMs, 11 out of 12 participants co-created the prototypes (mean SUS score 86 [SD 9.3]).

CONCLUSIONS

HCMs and PMs co-created prototypes for systematic review of effects formats based on their needs. The prototypes will be compared to a traditional format in a randomized trial.

Complex interventions can increase osteoporosis investigations and treatment: a systematic review and meta-analysis

Osteoporosis is affecting over 200 million people worldwide. Despite available guidelines, care for these patients remains sub-optimal. We developed an osteoporosis tool to address the multiple dimensions of chronic disease management. Findings from its evaluation showed a significant increase from baseline in osteoporosis investigations and treatment, so we are revising this tool to include multiple chronic conditions including an update of evidence about osteoporosis. Our objectives were to conduct a systematic review of osteoporosis interventions in adults at risk for osteoporosis. We searched bibliometric databases for randomized controlled trials (RCTs) in any language evaluating osteoporosis disease management interventions in adults at risk for osteoporosis. Reviewer pairs independently screened citations and full-text articles, extracted data, and assessed risk of bias. Analysis included random effects meta-analysis. Primary outcomes were osteoporosis investigations and treatment, and fragility fractures. Fifty-five RCTs and one companion report were included in the analysis representing 165,703 patients. Our findings from 55 RCTs and 18 sub-group meta-analyses showed that complex implementation interventions with multiple components consisting of at least education + feedback + follow-up significantly increased the initiation of osteoporosis medications, and interventions with at least education + follow-up significantly increased the initiation of osteoporosis investigations. No significant impact was found for any type of intervention to reduce fracture. Complex interventions that include at least education + follow-up or feedback have the most potential for increasing osteoporosis investigations and treatment. Patient education appears to be an important component in osteoporosis disease management.

Educational software usability: Artifact or Design?

Online educational technologies and e-learning tools are providing new opportunities for students to learn worldwide, and they continue to play an important role in anatomical sciences education. Yet, as we shift to teaching online, particularly within the anatomical sciences, it has become apparent that e-learning tool success is based on more than just user satisfaction and preliminary learning outcomes-rather it is a multidimensional construct that should be addressed from an integrated perspective. The efficiency, effectiveness and satisfaction with which a user can navigate an e-learning tool is known as usability, and represents a construct which we propose can be used to quantitatively evaluate e-learning tool success. To assess the usability of an e-learning tool, usability testing should be employed during the design and development phases (i.e., prior to its release to users) as well as during its delivery (i.e., following its release to users). However, both the commercial educational software industry and individual academic developers in the anatomical sciences have overlooked the added value of additional usability testing. Reducing learner frustration and anxiety during e-learning tool use is essential in ensuring e-learning tool success, and will require a commitment on the part of the developers to engage in usability testing during all stages of an e-learning tool's life cycle. Anat Sci Educ 10: 190-199. © 2016 American Association of Anatomists.

Telemonitoring and Protocolized Case Management for Hypertensive Community-Dwelling Seniors With Diabetes: Protocol of the TECHNOMED Randomized Controlled Trial

Background

Diabetes and hypertension are devastating, deadly, and costly conditions that are very common in seniors. Controlling hypertension in seniors with diabetes dramatically reduces hypertension-related complications. However, blood pressure (BP) must be lowered carefully because seniors are also susceptible to low BP and attendant harms. Achieving “optimal BP control” (ie, avoiding both undertreatment and overtreatment) is the ultimate therapeutic goal in such patients. Regular BP monitoring is required to achieve this goal. BP monitoring at home is cheap, convenient, widely used, and guideline endorsed. However, major barriers prevent proper use. These may be overcome through use of BP telemonitoring—the secure teletransmission of BP readings to a health portal, where BP data are summarized for provider and patient use, with or without protocolized case management.

Objective

To examine the incremental effectiveness, safety, cost-effectiveness, usability, and acceptability of home BP telemonitoring, used with or without protocolized case management, compared with “enhanced usual care” in community-dwelling seniors with diabetes and hypertension.

Methods

A 300-patient, 3-arm, pragmatic randomized controlled trial with blinded outcome ascertainment will be performed in seniors with diabetes and hypertension living independently in seniors’ residences in greater Edmonton. Consenting patients will be randomized to usual care, home BP telemonitoring alone, or home BP telemonitoring plus protocolized pharmacist case management. Usual care subjects will receive a home BP monitor but neither they nor their providers will have access to teletransmitted data. In both telemonitored arms, providers will receive telemonitored BP data summaries. In the case management arm, pharmacist case managers will be responsible for reviewing teletransmitted data and initiating guideline-concordant and protocolized changes in BP management.

Results

Outcomes will be ascertained at 6 and 12 months. Within-study-arm change scores will be calculated and compared between study arms. These include: (1) clinical outcomes: proportion of subjects with a mean 24-hour ambulatory systolic BP in the optimal range (110-129 mmHg in patients 65-79 years and 110-139 mmHg in those ≥80 years: primary outcome); additional ambulatory and home BP outcomes; A1c and lipid profile; medications, cognition, health care use, cardiovascular events, and mortality. (2) Safety outcomes: number of serious episodes of hypotension, syncope, falls, and electrolyte disturbances (requiring third party assistance or medical attention). (3) Humanistic outcomes: quality of life, satisfaction, and medication adherence. (4) Economic outcomes: incremental costs, incremental cost-utility, and cost per mmHg change in BP of telemonitoring ± case management compared with usual care (health payor and societal perspectives). (5) Intervention usability and acceptability to patients and providers.

Conclusion

The potential benefits of telemonitoring remain largely unstudied and unproven in seniors. This trial will comprehensively assess the impact of home BP telemonitoring across a range of outcomes. Results will inform the value of implementing home-based telemonitoring within supportive living residences in Canada.

Trial Registration

Clinicaltrials.gov NCT02721667; https://clinicaltrials.gov/ct2/show/NCT02721667 (Archived by Webcite at http://www.webcitation.org/6i8tB20Mc)

Clinical Decision Support Tool for Parental Tobacco Treatment in Hospitalized Children

OBJECTIVES

To create and evaluate the feasibility, acceptability, and usability of a clinical decision support (CDS) tool within the electronic health record (EHR) to help pediatricians provide smoking cessation counseling and treatment to parents of hospitalized children exposed to secondhand smoke (SHS).

METHODS

Mixed method study of first-year pediatric residents on one inpatient unit. Residents received training in smoking cessation counseling, nicotine replacement therapy (NRT) prescribing, and use of a CDS tool to aid in this process. The tool, which alerted when a patient was identified as exposed to SHS based on the history taken on admission or during a prior encounter, had the following capabilities: adding SHS exposure to the patient's problem list; referral to Free Quitline through discharge instructions; and linking to a printable NRT prescription form. We measured feasibility by EHR utilization data. We measured acceptability and usability of the tool by administering questionnaires to residents.

RESULTS

From June-August 2015, the alert triggered for 106 patients, and the tool was used for 52 (49%) patients. 41 (39%) patients had SHS exposure added to the problem list, 34 (32%) parents were referred to the Quitline through discharge instructions, and 15 (14%) parents were prescribed NRT. 10 out of 15 (67%) eligible pediatricians used the tool. All clinicians surveyed (9 out of 10) found the tool acceptable and rated its usability good to excellent (average System Usability Scale score was 85 out of 100, 95% CI, 76-93).

CONCLUSIONS

A non-interruptive CDS tool to help residents provide smoking cessation counseling in the hospital was feasible, acceptable, and usable. Future work will investigate impacts on patient outcomes.

Clinical Decision Support Tool for Parental Tobacco Treatment in Primary Care

OBJECTIVES

We created a clinical decision support (CDS) tool and evaluated its feasibility, acceptability, usability, and clinical impact within the electronic health record to help primary care pediatricians provide smoking cessation treatment to parents/caregivers who smoke.

METHODS

This prospective study of pediatric clinicians and parents was conducted at 1 urban primary care site. Clinicians received training in smoking cessation counseling, nicotine replacement therapy (NRT) prescribing, referral to an adult treatment program, and use of the CDS tool. The tool prompted clinicians to ask about secondhand smoke exposure, provide an electronic NRT prescription, and refer. Feasibility was measured by using electronic health record utilization data, and acceptability and usability were assessed with the use of clinician surveys. Parents reported clinical impact, including NRT accepted and used.

RESULTS

From June to August 2015, clinicians used the tool to screen for secondhand smoke exposure at 2286 (76%) of 3023 visits. Parent smokers were identified at 308 visits, and 165 parents (55% of smokers) were interested in and offered treatment. Twenty-four (80%) of 30 eligible pediatric clinicians used the tool. Ninety-four percent of clinicians surveyed (n = 17) were satisfied with the tool, and the average system usability scale score was 83 of 100 (good to excellent range). We reached 69 of 100 parents sampled who received treatment; 44 (64%) received NRT, and 17 (25%) were currently using NRT.

CONCLUSIONS

A CDS tool to help urban primary care pediatric clinicians provide smoking cessation treatment was feasible, acceptable, usable, and influenced clinical care. A larger scale investigation in varied practice settings is warranted.

Ready, Set, Change! Development and usability testing of an online readiness for change decision support tool for healthcare organizations

Background

To address challenges related to selecting a valid, reliable, and appropriate readiness assessment measure in practice, we developed an online decision support tool to aid frontline implementers in healthcare settings in this process. The focus of this paper is to describe a multi-step, end-user driven approach to developing this tool for use during the planning stages of implementation.

Methods

A multi-phase, end-user driven approach was used to develop and test the usability of a readiness decision support tool. First, readiness assessment measures that are valid, reliable, and appropriate for healthcare settings were identified from a systematic review. Second, a mapping exercise was performed to categorize individual items of included measures according to key readiness constructs from an existing framework. Third, a modified Delphi process was used to collect stakeholder ratings of the included measures on domains of feasibility, relevance, and likelihood to recommend. Fourth, two versions of a decision support tool prototype were developed and evaluated for usability.

Results

Nine valid and reliable readiness assessment measures were included in the decision support tool. The mapping exercise revealed that of the nine measures, most measures (78 %) focused on assessing readiness for change at the organizational versus the individual level, and that four measures (44 %) represented all constructs of organizational readiness. During the modified Delphi process, stakeholders rated most measures as feasible and relevant for use in practice, and reported that they would be likely to recommend use of most measures. Using data from the mapping exercise and stakeholder panel, an algorithm was developed to link users to a measure based on characteristics of their organizational setting and their readiness for change assessment priorities. Usability testing yielded recommendations that were used to refine the Ready, Set, Change! decision support tool .

Conclusions

Ready, Set, Change! decision support tool is an implementation support that is designed to facilitate the routine incorporation of a readiness assessment as an early step in implementation. Use of this tool in practice may offer time and resource-saving implications for implementation.

Electronic supplementary material

The online version of this article (doi:10.1186/s12911-016-0262-y) contains supplementary material, which is available to authorized users.

Qualitative Insights from the Osteoporosis Research: A Narrative Review of the Literature

Purpose. Much of the research on osteoporosis has been generated quantitatively. However, the qualitative osteoporosis literature provides valuable information on patient and clinician experiences and perspectives, informing the design and implementation of health research and healthcare services. To identify knowledge gaps and inform the design of future qualitative research, a narrative review was conducted to consolidate and synthesize the existing insights available within the qualitative osteoporosis research. Methods. Search terms reflecting the domains of osteoporosis and qualitative research were entered into the Scopus database to generate a comprehensive survey of qualitative research in the area of osteoporosis. Articles were thematically analysed and the results are presented in the form of a narrative review. Results. Forty-four articles were included in the narrative review. Qualitative research in the field of osteoporosis research can be summarized by 3 thematic areas: the meaning of osteoporosis for patients and the public, the lived experience of an osteoporosis diagnosis, and the programmatic approach to osteoporosis prevention and treatment. Conclusions. Qualitative studies provide clinically valuable insights in how osteoporosis is conceptualized and managed and programmatic aspects of osteoporosis treatment. The findings of this narrative review suggest the need for balance between presenting osteoporosis as a serious health condition and producing unwarranted anxiety and inactivity so as to ensure the best possible outcomes for individuals with osteoporosis.

A systematic review of mixed methods research on human factors and ergonomics in health care

This systematic literature review provides information on the use of mixed methods research in human factors and ergonomics (HFE) research in health care. Using the PRISMA methodology, we searched four databases (PubMed, PsycInfo, Web of Science, and Engineering Village) for studies that met the following inclusion criteria: (1) field study in health care, (2) mixing of qualitative and quantitative data, (3) HFE issues, and (4) empirical evidence. Using an iterative and collaborative process supported by a structured data collection form, the six authors identified a total of 58 studies that primarily address HFE issues in health information technology (e.g., usability) and in the work of healthcare workers. About two-thirds of the mixed methods studies used the convergent parallel study design where quantitative and qualitative data were collected simultaneously. A variety of methods were used for collecting data, including interview, survey and observation. The most frequent combination involved interview for qualitative data and survey for quantitative data. The use of mixed methods in healthcare HFE research has increased over time. However, increasing attention should be paid to the formal literature on mixed methods research to enhance the depth and breadth of this research.

Evidence summaries (decision boxes) to prepare clinicians for shared decision-making with patients: a mixed methods implementation study

Background

Decision boxes (Dboxes) provide clinicians with research evidence about management options for medical questions that have no single best answer. Dboxes fulfil a need for rapid clinical training tools to prepare clinicians for clinician-patient communication and shared decision-making. We studied the barriers and facilitators to using the Dbox information in clinical practice.

Methods

We used a mixed methods study with sequential explanatory design. We recruited family physicians, residents, and nurses from six primary health-care clinics. Participants received eight Dboxes covering various questions by email (one per week). For each Dbox, they completed a web questionnaire to rate clinical relevance and cognitive impact and to assess the determinants of their intention to use what they learned from the Dbox to explain to their patients the advantages and disadvantages of the options, based on the theory of planned behaviour (TPB). Following the 8-week delivery period, we conducted focus groups with clinicians and interviews with clinic administrators to explore contextual factors influencing the use of the Dbox information.

Results

One hundred clinicians completed the web surveys. In 54% of the 496 questionnaires completed, they reported that their practice would be improved after having read the Dboxes, and in 40%, they stated that they would use this information for their patients. Of those who would use the information for their patients, 89% expected it would benefit their patients, especially in that it would allow the patient to make a decision more in keeping with his/her personal circumstances, values, and preferences. They intended to use the Dboxes in practice (mean 5.6 ± 1.2, scale 1–7, with 7 being “high”), and their intention was significantly related to social norm, perceived behavioural control, and attitude according to the TPB (P < 0.0001). In focus groups, clinicians mentioned that co-interventions such as patient decision aids and training in shared decision-making would facilitate the use of the Dbox information. Some participants would have liked a clear “bottom line” statement for each Dbox and access to printed Dboxes in consultation rooms.

Conclusions

Dboxes are valued by clinicians. Tailoring of Dboxes to their needs would facilitate their implementation in practice.

Electronic supplementary material

The online version of this article (doi:10.1186/s13012-014-0144-6) contains supplementary material, which is available to authorized users.

A knowledge translation tool improved osteoporosis disease management in primary care: an interrupted time series analysis

BACKGROUND

Osteoporosis affects over 200 million people worldwide at a high cost to healthcare systems, yet gaps in management still exist. In response, we developed a multi-component osteoporosis knowledge translation (Op-KT) tool involving a patient-initiated risk assessment questionnaire (RAQ), which generates individualized best practice recommendations for physicians and customized education for patients at the point of care. The objective of this study was to evaluate the effectiveness of the Op-KT tool for appropriate disease management by physicians.

METHODS

The Op-KT tool was evaluated using an interrupted time series design. This involved multiple assessments of the outcomes 12 months before (baseline) and 12 months after tool implementation (52 data points in total). Inclusion criteria were family physicians and their patients at risk for osteoporosis (women aged ≥ 50 years, men aged ≥ 65 years). Primary outcomes were the initiation of appropriate osteoporosis screening and treatment. Analyses included segmented linear regression modeling and analysis of variance.

RESULTS

The Op-KT tool was implemented in three family practices in Ontario, Canada representing 5 family physicians with 2840 age eligible patients (mean age 67 years; 76% women). Time series regression models showed an overall increase from baseline in the initiation of screening (3.4%; P < 0.001), any osteoporosis medications (0.5%; P = 0.006), and calcium or vitamin D (1.2%; P = 0.001). Improvements were also observed at site level for all the three sites considered, but these results varied across the sites. Of 351 patients who completed the RAQ unprompted (mean age 64 years, 77% women), the mean time for completing the RAQ was 3.43 minutes, and 56% had any disease management addressed by their physician. Study limitations included the inherent susceptibility of our design compared with a randomized trial.

CONCLUSIONS

The multicomponent Op-KT tool significantly increased osteoporosis investigations in three family practices, and highlights its potential to facilitate patient self-management. Next steps include wider implementation and evaluation of the tool in primary care.

The development of an online decision support tool for organizational readiness for change

Background

Much importance has been placed on assessing readiness for change as one of the earliest steps of implementation, but measuring it can be a complex and daunting task. Organizations and individuals struggle with how to reliably and accurately measure readiness for change. Several measures have been developed to help organizations assess readiness, but these are often underused due to the difficulty of selecting the right measure. In response to this challenge, we will develop and test a prototype of a decision support tool that is designed to guide individuals interested in implementation in the selection of an appropriate readiness assessment measure for their setting.

Methods

A multi-phase approach will be used to develop the decision support tool. First, we will identify key measures for assessing organizational readiness for change from a recently completed systematic review. Included measures will be those developed for healthcare settings (e.g., acute care, public health, mental health) and that have been deemed valid and reliable. Second, study investigators and field experts will engage in a mapping exercise to categorize individual items of included measures according to key readiness constructs from an existing framework. Third, a stakeholder panel will be recruited and consulted to determine the feasibility and relevance of the selected measures using a modified Delphi process. Fourth, findings from the mapping exercise and stakeholder consultation will inform the development of a decision support tool that will guide users in appropriately selecting change readiness measures. Fifth, the tool will undergo usability testing.

Discussion

Our proposed decision support tool will address current challenges in the field of organizational change readiness by aiding individuals in selecting a valid and reliable assessment measure that is relevant to user needs and practice settings. We anticipate that implementers and researchers who use our tool will be more likely to conduct readiness for change assessments in their settings when planning for implementation. This, in turn, may contribute to more successful implementation outcomes. We will test this tool in a future study to determine its efficacy and impact on implementation processes.

Clinical decision support must be useful, functional is not enough: a qualitative study of computer-based clinical decision support in primary care

Background

Health information technology, particularly electronic decision support systems, can reduce the existing gap between evidence-based knowledge and health care practice but professionals have to accept and use this information. Evidence is scant on which features influence the use of computer-based clinical decision support (eCDS) in primary care and how different professional groups experience it. Our aim was to describe specific reasons for using or not using eCDS among primary care professionals.

Methods

The setting was a Finnish primary health care organization with 48 professionals receiving patient-specific guidance at the point of care. Multiple data (focus groups, questionnaire and spontaneous feedback) were analyzed using deductive content analysis and descriptive statistics.

Results

The content of the guidance is a significant feature of the primary care professional’s intention to use eCDS. The decisive reason for using or not using the eCDS is its perceived usefulness. Functional characteristics such as speed and ease of use are important but alone these are not enough. Specific information technology, professional, patient and environment features can help or hinder the use.

Conclusions

Primary care professionals have to perceive eCDS guidance useful for their work before they use it.

Application of the Knowledge-to-Action and Medical Research Council frameworks in the development of an osteoporosis clinical decision support tool

OBJECTIVE

Informatics-based knowledge translation interventions have the potential to address clinical practice and patient care, but evidence shows that they can fail, have the potential to be ineffective, function poorly, and result in medical or technology-induced errors if rushed to become an integral part of health care systems and practices. In an attempt to meet these challenges and advance the science of developing knowledge translation interventions, the objective of this study was to apply two theoretical frameworks (the Knowledge-to-Action and the Medical Research Council frameworks for complex interventions) in the development of an osteoporosis clinical decision support tool.

STUDY DESIGN AND SETTING

Descriptive analysis of how the Knowledge-to-Action and Medical Research Council frameworks can be applied in the development of an osteoporosis tool.

RESULTS

An osteoporosis tool was developed using a seven-phase process by collapsing the "action" steps of the Knowledge-to-Action cycle and phases of the Medical Research Council framework. Analysis of this procedure informed a proposed seven-step process that may be applied by others in the development of knowledge translation tools and complex interventions.

CONCLUSIONS

The combined frameworks can be used to map the process for translating evidence into practice by addressing potential barriers, and anticipating how knowledge will be sustained and disseminated.

Arriba-lib: association of an evidence-based electronic library of decision aids with communication and decision-making in patients and primary care physicians

AIM

In shared decision-making, patients are empowered to actively ask questions and participate in decisions about their healthcare based on their preferences and values. Decision aids should help patients make informed choices among diagnostic or treatment options by delivering evidence-based information on options and outcomes; however, they have rarely been field tested, especially in the primary care context. We therefore evaluated associations between the use of an interactive, transactional and evidence-based library of decision aids (arriba-lib) and communication and decision-making in patients and physicians in the primary care context.

METHODS

Our electronic library of decision aids ('arriba-lib') includes evidence-based modules for cardiovascular prevention, diabetes, coronary heart disease, atrial fibrillation and depression. Twenty-nine primary care physicians recruited 192 patients. We used questionnaires to ask patients and physicians about their experiences with and attitudes towards the programme. Patients were interviewed via telephone 2 months after the consultation. Data were analysed by general estimation equations, cross tab analyses and by using effect sizes.

RESULTS

Only a minority (8.9%) of the consultations were felt to be too long because physicians said consultations were unacceptably extended by arriba-lib. We found a negative association between the detailedness of the discussion of the clinical problem's definition and the age of the patients. Physicians discuss therapeutic options in less detail with patients who have a formal education of less than 8 years. Patients who were counselled by a physician with no experience in using a decision aid more often reported that they do not remember being counselled with the help of a decision aid or do not wish to be counselled again with a decision aid.

CONCLUSIONS

Arriba-lib has positive associations to the decision-making process in patients and physicians. It can also be used with older age groups and patients with less formal education. Physicians seem to adapt their counselling strategy to different patient groups. Prior experience with the use of decision aids has an influence on the acceptance of arriba-lib in patients but not on their decision-making or decision implementation.

Arriba-lib: evaluation of an electronic library of decision aids in primary care physicians

Background

The successful implementation of decision aids in clinical practice initially depends on how clinicians perceive them. Relatively little is known about the acceptance of decision aids by physicians and factors influencing the implementation of decision aids from their point of view. Our electronic library of decision aids (arriba-lib) is to be used within the encounter and has a modular structure containing evidence-based decision aids for the following topics: cardiovascular prevention, atrial fibrillation, coronary heart disease, oral antidiabetics, conventional and intensified insulin therapy, and unipolar depression. The aim of our study was to evaluate the acceptance of arriba-lib in primary care physicians.

Methods

We conducted an evaluation study in which 29 primary care physicians included 192 patients. The physician questionnaire contained information on which module was used, how extensive steps of the shared decision making process were discussed, who made the decision, and a subjective appraisal of consultation length. We used generalised estimation equations to measure associations within patient variables and traditional crosstab analyses.

Results

Only a minority of consultations (8.9%) was considered to be unacceptably extended. In 90.6% of consultations, physicians said that a decision could be made. A shared decision was perceived by physicians in 57.1% of consultations. Physicians said that a decision was more likely to be made when therapeutic options were discussed “detailed”. Prior experience with decision aids was not a critical variable for implementation within our sample of primary care physicians.

Conclusions

Our study showed that it might be feasible to apply our electronic library of decision aids (arriba-lib) in the primary care context. Evidence-based decision aids offer support for physicians in the management of medical information. Future studies should monitor the long-term adoption of arriba-lib in primary care physicians.

A pilot study on usability analysis of emergency department information system by nurses

OBJECTIVES

Employing new health information technologies while concurrently providing quality patient care and reducing risk is a major challenge in all health care sectors. In this study, we investigated the usability gaps in the Emergency Department Information System (EDIS) as ten nurses differentiated by two experience levels, namely six expert nurses and four novice nurses, completed two lists of nine scenario-based tasks.

METHODS

Standard usability tests using video analysis, including four sets of performance measures, a task completion survey, the system usability scale (SUS), and sub-task analysis were conducted in order to analyze usability gaps between the two nurse groups.

RESULTS

A varying degree of usability gaps were observed between the expert and novice nurse groups, as novice nurses completed the tasks both less efficiently, and expressed less satisfaction with the EDIS. The most interesting finding in this study was the result of 'percent task success rate,' the clearest performance measure, with no substantial difference observed between the two nurse groups. Geometric mean values between expert and novice nurse groups for this measure were 60% vs. 62% in scenario 1 and 66% vs. 55% in scenario 2 respectively, while there were some marginal to substantial gaps observed in other performance measures. In addition to performance measures and the SUS, sub-task analysis highlighted navigation pattern differences between users, regardless of experience level.

CONCLUSION

This study will serve as a baseline study for a future comparative usability evaluation of EDIS in other institutions with similar clinical settings.

WikiBuild: a new online collaboration process for multistakeholder tool development and consensus building

BACKGROUND

Production of media such as patient education tools requires methods that can integrate multiple stakeholder perspectives. Existing consensus techniques are poorly suited to design of visual media, can be expensive and logistically demanding, and are subject to caveats arising from group dynamics such as participant hierarchies.

OBJECTIVE

Our objective was to develop a method that enables multistakeholder tool building while averting these difficulties.

METHODS

We developed a wiki-inspired method and tested this through the collaborative design of an asthma action plan (AAP). In the development stage, we developed the Web-based tool by (1) establishing AAP content and format options, (2) building a Web-based application capable of representing each content and format permutation, (3) testing this tool among stakeholders, and (4) revising this tool based on stakeholder feedback. In the wiki stage, groups of participants used the revised tool in three separate 1-week "wiki" periods during which each group collaboratively authored an AAP by making multiple online selections.

RESULTS

In the development stage, we recruited 16 participants (9/16 male) (4 pulmonologists, 4 primary care physicians, 3 certified asthma educators, and 5 patients) for system testing. The mean System Usability Scale (SUS) score for the tool used in testing was 72.2 (SD 10.2). In the wiki stage, we recruited 41 participants (15/41 male) (9 pulmonologists, 6 primary care physicians, 5 certified asthma educators, and 21 patients) from diverse locations. The mean SUS score for the revised tool was 75.9 (SD 19.6). Users made 872, 466, and 599 successful changes to the AAP in weeks 1, 2, and 3, respectively. The site was used actively for a mean of 32.0 hours per week, of which 3.1 hours per week (9.7%) constituted synchronous multiuser use (2-4 users at the same time). Participants averaged 23 (SD 33) minutes of login time and made 7.7 (SD 15) changes to the AAP per day. Among participants, 28/35 (80%) were satisfied with the final AAP, and only 3/34 (9%) perceived interstakeholder group hierarchies.

CONCLUSION

Use of a wiki-inspired method allowed for effective collaborative design of content and format aspects of an AAP while minimizing logistical requirements, maximizing geographical representation, and mitigating hierarchical group dynamics. Our method faced unique software and hardware challenges, and raises certain questions regarding its effect on group functioning. Potential uses of our method are broad, and further studies are required.

Quality of human-computer interaction--results of a national usability survey of hospital-IT in Germany

Background

Due to the increasing functionality of medical information systems, it is hard to imagine day to day work in hospitals without IT support. Therefore, the design of dialogues between humans and information systems is one of the most important issues to be addressed in health care. This survey presents an analysis of the current quality level of human-computer interaction of healthcare-IT in German hospitals, focused on the users' point of view.

Methods

To evaluate the usability of clinical-IT according to the design principles of EN ISO 9241-10 the IsoMetrics Inventory, an assessment tool, was used. The focus of this paper has been put on suitability for task, training effort and conformity with user expectations, differentiated by information systems. Effectiveness has been evaluated with the focus on interoperability and functionality of different IT systems.

Results

4521 persons from 371 hospitals visited the start page of the study, while 1003 persons from 158 hospitals completed the questionnaire. The results show relevant variations between different information systems.

Conclusions

Specialised information systems with defined functionality received better assessments than clinical information systems in general. This could be attributed to the improved customisation of these specialised systems for specific working environments. The results can be used as reference data for evaluation and benchmarking of human computer engineering in clinical health IT context for future studies.

Evaluation of a clinical decision support tool for osteoporosis disease management: protocol for an interrupted time series design

Background

Osteoporosis affects over 200 million people worldwide at a high cost to healthcare systems. Although guidelines on assessing and managing osteoporosis are available, many patients are not receiving appropriate diagnostic testing or treatment. Findings from a systematic review of osteoporosis interventions, a series of mixed-methods studies, and advice from experts in osteoporosis and human-factors engineering were used collectively to develop a multicomponent tool (targeted to family physicians and patients at risk for osteoporosis) that may support clinical decision making in osteoporosis disease management at the point of care.

Methods

A three-phased approach will be used to evaluate the osteoporosis tool. In phase 1, the tool will be implemented in three family practices. It will involve ensuring optimal functioning of the tool while minimizing disruption to usual practice. In phase 2, the tool will be pilot tested in a quasi-experimental interrupted time series (ITS) design to determine if it can improve osteoporosis disease management at the point of care. Phase 3 will involve conducting a qualitative postintervention follow-up study to better understand participants' experiences and perceived utility of the tool and readiness to adopt the tool at the point of care.

Discussion

The osteoporosis tool has the potential to make several contributions to the development and evaluation of complex, chronic disease interventions, such as the inclusion of an implementation strategy prior to conducting an evaluation study. Anticipated benefits of the tool may be to increase awareness for patients about osteoporosis and its associated risks and provide an opportunity to discuss a management plan with their physician, which may all facilitate patient self-management.

Acceptance of shared decision making with reference to an electronic library of decision aids (arriba-lib) and its association to decision making in patients: an evaluation study

Background

Decision aids based on the philosophy of shared decision making are designed to help patients make informed choices among diagnostic or treatment options by delivering evidence-based information on options and outcomes. A patient decision aid can be regarded as a complex intervention because it consists of several presumably relevant components. Decision aids have rarely been field tested to assess patients' and physicians' attitudes towards them. It is also unclear what effect decision aids have on the adherence to chosen options.

Methods

The electronic library of decision aids (arriba-lib) to be used within the clinical encounter has a modular structure and contains evidence-based decision aids for the following topics: cardiovascular prevention, atrial fibrillation, coronary heart disease, oral antidiabetics, conventional and intensified insulin therapy, and unipolar depression. We conducted an evaluation study in which 29 primary care physicians included 192 patients. After the consultation, patients filled in questionnaires and were interviewed via telephone two months later. We used generalised estimation equations to measure associations within patient variables and traditional crosstab analyses.

Results

Patients were highly satisfied with arriba-lib and the process of shared decision making. Two-thirds of patients reached in the telephone interview wanted to be counselled again with arriba-lib. There was a high congruence between preferred and perceived decision making. Of those patients reached in the telephone interview, 80.7% said that they implemented the decision, independent of gender and education. Elderly patients were more likely to say that they implemented the decision.

Conclusions

Shared decision making with our multi-modular electronic library of decision aids (arriba-lib) was accepted by a high number of patients. It has positive associations to general aspects of decision making in patients. It can be used for patient groups with a wide range of individual characteristics.