User-centered design to improve clinical decision support in primary care

Clinical Decision Support for Surgery: A Mixed Methods Study on Design and Implementation Perspectives From Urologists

OBJECTIVE

To assess urologist attitudes toward clinical decision support (CDS) embedded into the electronic health record (EHR) and define design needs to facilitate implementation and impact. With recent advances in big data and artificial intelligence (AI), enthusiasm for personalized, data-driven tools to improve surgical decision-making has grown, but the impact of current tools remains limited.

METHODS

A sequential explanatory mixed methods study from 2019 to 2020 was performed. First, survey responses from the 2019 American Urological Association Annual Census evaluated attitudes toward an automatic CDS tool that would display risk/benefit data. This was followed by the purposeful sampling of 25 urologists and qualitative interviews assessing perspectives on CDS impact and design needs. Bivariable, multivariable, and coding-based thematic analysis were applied and integrated.

RESULTS

Among a weighted sample of 12,366 practicing urologists, the majority agreed CDS would help decision-making (70.9%, 95% CI 68.7%-73.2%), aid patient counseling (78.5%, 95% CI 76.5%-80.5%), save time (58.1%, 95% CI 55.7%-60.5%), and improve patient outcomes (42.9%, 95% CI 40.5%-45.4%). More years in practice was negatively associated with agreement (P <.001). Urologists described how CDS could bolster evidence-based care, personalized medicine, resource utilization, and patient experience. They also identified multiple implementation barriers and provided suggestions on form, functionality, and visual design to improve usefulness and ease of use.

CONCLUSION

Urologists have favorable attitudes toward the potential for clinical decision support in the EHR. Smart design will be critical to ensure effective implementation and impact.

Human-Centered Design and Development of a Fall Prevention Exercise App for Older Adults in Primary Care Settings

BACKGROUND

 Falls in older adults are a serious public health problem that can lead to reduced quality of life or death. Patients often do not receive fall prevention guidance from primary care providers (PCPs), despite evidence that falls can be prevented. Mobile health technologies may help to address this disparity and promote evidence-based fall prevention.

OBJECTIVE

 Our main objective was to use human-centered design to develop a user-friendly, fall prevention exercise app using validated user requirements. The app features evidence-based behavior change strategies and exercise content to support older people initiating and adhering to a progressive fall prevention exercise program.

METHODS

 We organized our multistage, iterative design process into three phases: gathering user requirements, usability evaluation, and refining app features. Our methods include focus groups, usability testing, and subject-matter expert meetings.

RESULTS

 Focus groups (total n = 6), usability testing (n = 30) including a posttest questionnaire [Health-ITUES score: mean (standard deviation [SD]) = 4.2 (0.9)], and subject-matter expert meetings demonstrate participant satisfaction with the app concept and design. Overall, participants saw value in receiving exercise prescriptions from the app that would be recommended by their PCP and reported satisfaction with the content of the app.

CONCLUSION

 This study demonstrates the development, refinement, and usability testing of a fall prevention exercise app and corresponding tools that PCPs may use to prescribe tailored exercise recommendations to their older patients as an evidence-based fall prevention strategy accessible in the context of busy clinical workflows.

Application of a user experience design approach for an EHR-based clinical decision support system

Objective

We applied a user experience (UX) design approach to clinical decision support (CDS) tool development for the specific use case of pediatric asthma. Our objective was to understand physicians' workflows, decision-making processes, barriers (ie, pain points), and facilitators to increase usability of the tool.

Materials and methods

We used a mixed-methods approach with semi-structured interviews and surveys. The coded interviews were synthesized into physician-user journey maps (ie, visualization of a process to accomplish goals) and personas (ie, user types). Interviews were conducted via video. We developed physician journey maps and user personas informed by their goals, systems interactions, and experiences with pediatric asthma management.

Results

The physician end-user personas identified were: efficiency, relationship, and learning. Features of a potential asthma CDS tool sought varied by physician practice type and persona. It was important to the physician end-user that the asthma CDS tool demonstrate value by lowering workflow friction (ie, difficulty or obstacles), improving the environment surrounding physicians and patients, and using it as a teaching tool. Customizability versus standardization were important considerations for uptake.

Discussion

Different values and motivations of physicians influence their use and interaction with the EHR and CDS tools. These different perspectives can be captured by applying a UX design approach to the development process. For example, with the importance of customizability, one approach may be to build a core module with variations depending on end-user preference.

Conclusion

A UX approach can drive design to help understand physician-users and meet their needs; ultimately with the goal of increased uptake.

Provider Perceptions of an Electronic Health Record Prostate Cancer Screening Tool

OBJECTIVES

 We conducted a focus group to assess the attitudes of primary care physicians (PCPs) toward prostate-specific antigen (PSA)-screening algorithms, perceptions of using decision support tools, and features that would make such tools feasible to implement.

METHODS

 A multidisciplinary team (primary care, urology, behavioral sciences, bioinformatics) developed the decision support tool that was presented to a focus group of 10 PCPs who also filled out a survey. Notes and audio-recorded transcripts were analyzed using Thematic Content Analysis.

RESULTS

 The survey showed that PCPs followed different guidelines. In total, 7/10 PCPs agreed that engaging in shared decision-making about PSA screening was burdensome. The majority (9/10) had never used a decision aid for PSA screening. Although 70% of PCPs felt confident about their ability to discuss PSA screening, 90% still felt a need for a provider-facing platform to assist in these discussions. Three major themes emerged: (1) confirmatory reactions regarding the importance, innovation, and unmet need for a decision support tool embedded in the electronic health record; (2) issues around implementation and application of the tool in clinic workflow and PCPs' own clinical bias; and (3) attitudes/reflections regarding discrepant recommendations from various guideline groups that cause confusion.

CONCLUSION

 There was overwhelmingly positive support for the need for a provider-facing decision support tool to assist with PSA-screening decisions in the primary care setting. PCPs appreciated that the tool would allow flexibility for clinical judgment and documentation of shared decision-making. Incorporation of suggestions from this focus group into a second version of the tool will be used in subsequent pilot testing.

Development and Usability Testing of an Exercise-Based Primary Care Fall Prevention Clinical Decision Support Tool

For older patients, falls are the leading cause offatal and nonfatal injuries. Guidelines recommend that at-risk older adults are referred to appropriate fall-prevention exercise programs, but many do not receive support for fall-risk management in the primary care setting. Advances in health information technology may be able to address this gap. This article describes the development and usability testing of a clinical decision support (CDS) tool for fall prevention exercise. Using rapid qualitative analysis and human-centered design, our team developed and tested the usability of our CDS prototype with primary care team members. Across 31 Health-Information Technology Usability Evaluation Scale surveys, our CDS prototype received a median score of 5.0, mean (SD) of 4.5 (0.8), and a range of 4.1-4.9. This study highlights the features and usability offall prevention CDS for helping primary care providers deliver patient-centeredfall prevention care.

Frontline perspectives on adoption and non-adoption of care management tools for high-risk patients in primary care

BACKGROUND

Population health management tools (PHMTs) embedded within electronic health records (EHR) could improve management of high-risk patients and reduce costs associated with potentially avoidable emergency department visits or hospitalizations. Adoption of PHMTs across the Veterans Health Administration (VA) has been variable and previous research suggests that understaffed primary care (PC) teams might not be using the tools.

METHODS

We conducted a retrospective content analysis of open-text responses (n = 1804) from the VA's 2018 national primary care personnel survey to, 1) identify system-level and individual-level factors associated with why clinicians are not using the tools, and 2) to document clinicians' recommendations to improve tool adoption.

RESULTS

We found three themes pertaining to low adoption and/or tool use: 1) IT burden and administrative tasks (e.g., manually mailing letters to patients), 2) staffing shortages (e.g., nurses covering multiple teams), and 3) no training or difficulty using the tools (e.g., not knowing how to access the tools or use the data). Frontline clinician recommendations included automating some tasks, reconfiguring team roles to shift administrative work away from providers and nurses, consolidating PHMTs into a centralized, easily accessible repository, and providing training.

CONCLUSIONS

Healthcare system-level factors (staffing) and individual-level factors (lack of training) can limit adoption of PHMTs that could be useful for reducing costs and improving patient outcomes. Future research, including qualitative interviews with clinicians who use/don't use the tools, could help develop interventions to address barriers to adoption.

IMPLICATIONS

Shifting more administrative tasks to clerical staff would free up clinician time for population health management but may not be possible for understaffed PC teams. Additionally, healthcare systems may be able to increase PHMT use by making them more easily accessible through the electronic health record and providing training in their use.

Evaluation of a Novel Question Prompt List in Pediatric Surgical Oncology

INTRODUCTION

Parents of children with cancer describe interactions with clinicians as emotionally distressing. Patient engagement in treatment discussions decreases decisional conflict and improves decision quality which may limit such distress. We have shown that parents prefer to engage surgeons by asking questions, but parents may not know what to ask. Question Prompt Lists (QPLs), structured lists of questions designed to help patients ask important questions, have not been studied in pediatric surgery. We developed a QPL designed to empower parents to ask meaningful questions during pediatric surgical oncology discussions. We conducted a mixed methods analysis to assess the acceptability, appropriateness, and feasibility of using the QPL.

METHODS

Key stakeholders at an academic children's hospital participated in focus groups to discuss the QPL. Focus groups were recorded and transcribed. Participants were surveyed regarding QPL acceptability, appropriateness, and feasibility. Thematic content analysis of transcripts was performed.

RESULTS

Four parents, five nurses, five nurse practitioners, five oncologists, and four surgeons participated. Seven key themes were identified: (1) QPL as a tool of empowerment; (2) stick to the surgical details; (3) QPLs can impact discussion quality; (4) time consuming, but not overly disruptive; (5) parental emotion may impact QPL use; (6) provide QPLs prior to surgical consultation in both print and digital formats; and (7) expansion of QPLs to other disciplines. Over 70% of participants agreed that the QPL was acceptable, appropriate, and feasible.

CONCLUSIONS

Our novel QPL is acceptable, appropriate, and feasible to use with parents of pediatric surgical oncology patients.

Development of a lumbar puncture virtual simulator for medical students training: A preliminary evaluation

BACKGROUND

Lumbar puncture is an essential medical procedure whose objective is to obtain cerebrospinal fluid. Lumbar puncture is considered a complex procedure, mainly for novice residents who suffer from stress and low confidence, which may result in harm to the patient.

METHODS

The LPVirSim, has been developed in four stages: i) requirements analysis through user-centred design; ii) prototyping of the virtual environment and the haptic component; iii) preliminary tests with Ph.D. students and physicians using two haptic devices (Omega.7 and Sigma.7); iv) a user study where physicians evaluated the usability and user experience.

RESULTS

The LPVirSim integrates non-technical skills and the possibility of representing different patients for training. Usability increased from 61.76 to 68.75 in the preliminary tests to 71.43 in the user study.

CONCLUSIONS

All the results showed good usability and demonstrated that the simulator arouses interest and realistically represents a Lumbar puncture, through the force and visual feedback.

Comparative effectiveness of generic commercial versus locally customized clinical decision support tools to reduce prescription of nonsteroidal anti-inflammatory drugs for patients with heart failure

OBJECTIVE

To compare the effectiveness of 2 clinical decision support (CDS) tools to avoid prescription of nonsteroidal anti-inflammatory drugs (NSAIDs) in patients with heart failure (HF): a "commercial" and a locally "customized" alert.

METHODS

We conducted a retrospective cohort study of 2 CDS tools implemented within a large integrated health system. The commercial CDS tool was designed according to third-party drug content and EHR vendor specifications. The customized CDS tool underwent a user-centered design process informed by implementation science principles, with input from a cross disciplinary team. The customized CDS tool replaced the commercial CDS tool. Data were collected from the electronic health record via analytic reports and manual chart review. The primary outcome was effectiveness, defined as whether the clinician changed their behavior and did not prescribe an NSAID.

RESULTS

A random sample of 366 alerts (183 per CDS tool) was evaluated that represented 355 unique patients. The commercial CDS tool was effective for 7 of 172 (4%) patients, while the customized CDS tool was effective for 81 of 183 (44%) patients. After adjusting for age, chronic kidney disease, ejection fraction, NYHA class, concurrent prescription of an opioid or acetaminophen, visit type (inpatient or outpatient), and clinician specialty, the customized alerts were at 24.3 times greater odds of effectiveness compared to the commercial alerts (OR: 24.3 CI: 10.20-58.06).

CONCLUSION

Investing additional resources to customize a CDS tool resulted in a CDS tool that was more effective at reducing the total number of NSAID orders placed for patients with HF compared to a commercially available CDS tool.

Usability and Acceptability of Clinical Dashboards in Aged Care: Systematic Review

BACKGROUND

The use of clinical dashboards in aged care systems to support performance review and improve outcomes for older adults receiving care is increasing.

OBJECTIVE

Our aim was to explore evidence from studies of the acceptability and usability of clinical dashboards including their visual features and functionalities in aged care settings.

METHODS

A systematic review was conducted using 5 databases (MEDLINE, Embase, PsycINFO, Cochrane Library, and CINAHL) from inception to April 2022. Studies were included in the review if they were conducted in aged care environments (home-based community care, retirement villages, and long-term care) and reported a usability or acceptability evaluation of a clinical dashboard for use in aged care environments, including specific dashboard visual features (eg, a qualitative summary of individual user experience or metrics from a usability scale). Two researchers independently reviewed the articles and extracted the data. Data synthesis was performed via narrative review, and the risk of bias was measured using the Mixed Methods Appraisal Tool.

RESULTS

In total, 14 articles reporting on 12 dashboards were included. The quality of the articles varied. There was considerable heterogeneity in implementation setting (home care 8/14, 57%), dashboard user groups (health professionals 9/14, 64%), and sample size (range 3-292). Dashboard features included a visual representation of information (eg, medical condition prevalence), analytic capability (eg, predictive), and others (eg, stakeholder communication). Dashboard usability was mixed (4 dashboards rated as high), and dashboard acceptability was high for 9 dashboards. Most users considered dashboards to be informative, relevant, and functional, highlighting the use and intention of using this resource in the future. Dashboards that had the presence of one or more of these features (bar charts, radio buttons, checkboxes or other symbols, interactive displays, and reporting capabilities) were found to be highly acceptable.

CONCLUSIONS

A comprehensive summary of clinical dashboards used in aged care is provided to inform future dashboard development, testing, and implementation. Further research is required to optimize visualization features, usability, and acceptability of dashboards in aged care.

Barriers and facilitators of electronic patient portal uptake for asthma management

OBJECTIVE

An active patient-practitioner partnership is a key aspect of asthma management and patient-reported data helps with shared decision making. Technological advances such as the electronic patient portal can facilitate partnership, with the goal of improved asthma outcomes. However, uptake of portals by end-users for asthma management has been low. We studied portal-based asthma interventions to understand barriers and facilitators to its use.

DATA SOURCES

We searched within the PubMed, Web of Science, Scopus, MEDLINE, and Google Scholar databases.

STUDY SELECTIONS

We used the PRISMA extension for scoping reviews to guide our analysis of studies related to asthma and patient portals. We summarized relevant studies in terms of barriers and facilitators as well as study characteristics.

RESULTS

Sixteen studies were included in our final analysis. Common barriers to patient portal use for asthma management were lack of perceived value by the end-user, low end-user technological literacy, and limited resources. Facilitators of portal use included ease of use, personalization, and adequate technical support. Patient portals in these studies were used for a variety of applications related to core asthma management concepts of assessment and monitoring, education for a partnership in asthma care, environmental factors, co-morbidities, and medications.

CONCLUSIONS

Patient portal use for asthma management can be encouraged by ensuring the portal is easy to access and navigate, demonstrates values, as well as has readily available technical support. Involving end-users closely in the design process and implementation may help address barriers. Special attention is needed for groups with technological resource limitations.

Human-Centered Design of a Clinical Decision Support for Anemia Screening in Children with Inflammatory Bowel Disease

BACKGROUND

Inflammatory bowel disease (IBD) commonly leads to iron deficiency anemia (IDA). Rates of screening and treatment of IDA are often low. A clinical decision support system (CDSS) embedded in an electronic health record could improve adherence to evidence-based care. Rates of CDSS adoption are often low due to poor usability and fit with work processes. One solution is to use human-centered design (HCD), which designs CDSS based on identified user needs and context of use and evaluates prototypes for usefulness and usability.

OBJECTIVES

this study aimed to use HCD to design a CDSS tool called the IBD Anemia Diagnosis Tool, IADx.

METHODS

Interviews with IBD practitioners informed creation of a process map of anemia care that was used by an interdisciplinary team that used HCD principles to create a prototype CDSS. The prototype was iteratively tested with "Think Aloud" usability evaluation with clinicians as well as semi-structured interviews, a survey, and observations. Feedback was coded and informed redesign.

RESULTS

Process mapping showed that IADx should function at in-person encounters and asynchronous laboratory review. Clinicians desired full automation of clinical information acquisition such as laboratory trends and analysis such as calculation of iron deficit, less automation of clinical decision selection such as laboratory ordering, and no automation of action implementation such as signing medication orders. Providers preferred an interruptive alert over a noninterruptive reminder.

CONCLUSION

Providers preferred an interruptive alert, perhaps due to the low likelihood of noticing a noninterruptive advisory. High levels of desire for automation of information acquisition and analysis with less automation of decision selection and action may be generalizable to other CDSSs designed for chronic disease management. This underlines the ways in which CDSSs have the potential to augment rather than replace provider cognitive work.

Ethics of the algorithmic prediction of goal of care preferences: from theory to practice

Artificial intelligence (AI) systems are quickly gaining ground in healthcare and clinical decision-making. However, it is still unclear in what way AI can or should support decision-making that is based on incapacitated patients' values and goals of care, which often requires input from clinicians and loved ones. Although the use of algorithms to predict patients' most likely preferred treatment has been discussed in the medical ethics literature, no example has been realised in clinical practice. This is due, arguably, to the lack of a structured approach to the epistemological, ethical and pragmatic challenges arising from the design and use of such algorithms. The present paper offers a new perspective on the problem by suggesting that preference predicting AIs be viewed as sociotechnical systems with distinctive life-cycles. We explore how both known and novel challenges map onto the different stages of development, highlighting interdisciplinary strategies for their resolution.

Provider perspectives on clinical decision support to improve HIV prevention in pediatric primary care: a multiple methods study

BACKGROUND

Clinical decision support (CDS) is a promising intervention for improving uptake of HIV testing and pre-exposure prophylaxis (PrEP). However, little is known regarding provider perspectives on acceptability, appropriateness, and feasibility of CDS for HIV prevention in pediatric primary care, a key implementation setting.

METHODS

This was a cross-sectional multiple methods study utilizing surveys and in-depth interviews with pediatricians to assess acceptability, appropriateness, and feasibility of CDS for HIV prevention, as well as to identify contextual barriers and facilitators to CDS. Qualitative analysis utilized work domain analysis and a deductive coding approach grounded in the Consolidated Framework of Implementation Research. Quantitative and qualitative data were merged to develop an Implementation Research Logic Model to conceptualize implementation determinants, strategies, mechanisms, and outcomes of potential CDS use.

RESULTS

Participants (n = 26) were primarily white (92%), female (88%), and physicians (73%). Using CDS to improve HIV testing and PrEP delivery was perceived as highly acceptable (median score 5), IQR [4-5]), appropriate (5, IQR [4-5]), and feasible (4, IQR [3.75-4.75]) using a 5-point Likert scale. Providers identified confidentiality and time constraints as two key barriers to HIV prevention care spanning every workflow step. With respect to desired CDS features, providers sought interventions that were integrated into the primary care workflow, standardized to promote universal testing yet adaptable to the level of a patient's HIV risk, and addressed providers' knowledge gaps and bolstered self-efficacy in providing HIV prevention services.

CONCLUSIONS

This multiple methods study indicates that clinical decision support in the pediatric primary care setting may be an acceptable, feasible, and appropriate intervention for improving the reach and equitable delivery of HIV screening and PrEP services. Design considerations for CDS in this setting should include deploying CDS interventions early in the visit workflow and prioritizing standardized but flexible designs.

User-Centered Design to Reduce Inappropriate Blood Transfusion Orders

BACKGROUND

To improve blood transfusion practices, we applied user-centered design (UCD) to evaluate potential changes to blood transfusion orders.

OBJECTIVES

The aim of the study is to build effective transfusion orders with different designs to improve guideline adherence.

METHODS

We developed three different versions of transfusion orders that varied how information was presented to clinicians ordering blood transfusions. We engaged 14 clinicians (residents, advanced practice providers [APPs], and attending physicians) from different specialties. We used the think aloud technique and rapid qualitative analysis to generate themes to incorporate into our modified orders.

RESULTS

Most end-users who participated in the semi-structured interviews preferred the interruptive alert design plus behavioral nudges (n = 8/14, 57%). The predominant rationale was that the in-line alert was not visually effective in capturing the end-user's attention, while the interruptive alert forced a brief stop in the workflow to consider the guidelines. All users supported the general improvements, though for different reasons, and as a result, the general improvements remained in the designs for the forthcoming trial.

CONCLUSION

The user experience uncovered through the think aloud approach produced a clear and rich understanding of potentially confounding factors in the initial design of different intervention versions. Input from end-users guided the creation of all three designs so each was addressing human factors with parity, which ensured that the results of our study reflected differences in interruptive properties of the alerts and not differences in design.

Transition to a new nursing information system embedded with clinical decision support: a mixed-method study using the HOT-fit framework

BACKGROUND

Nursing information systems embedded with standardized nursing language and clinical decision support have been increasingly introduced in health care settings. User experience is key to the adoption of health information technologies. Despite extensive research into the user experience with nursing information systems, few studies have focused on the interaction between user, technology and organizational attributes during its implementation. Guided by the human, organization and technology-fit framework, this study aimed to investigate nurses' perceptions and experiences with transition to a new nursing information system (Care Direct) 2 years after its first introduction.

METHODS

This is a mixed-method study using an embedded design. An online survey was launched to collect nurses' self-reported use of the new system, perceived system effectiveness and experience of participation in system optimization. Twenty-two semi structured interviews were conducted with twenty nurses with clinical or administrative roles. The quantitative and qualitative data were merged using the Pillar Integration Process.

RESULTS

The average score of system use behavior was 3.76 ± 0.79. Regarding perceived system effectiveness, the score of each dimension ranged 3.07-3.34 out of 5. Despite large variations in approaches to participating in system optimization, nurses had generally positive experiences with management and technical support. Eight main categories emerged from the integrated findings, which were further condensed into three themes: perceptions on system content, structure, and functionality; perceptions on interdisciplinary and cross-level cooperation; and embracing and accepting the change.

CONCLUSIONS

Effective collaboration between clinicians, administrators and technical staff is required during system promotion to enhance system usability and user experience. Clear communication of organizational missions to staff and support from top management is needed to smooth the system implementation process and achieve broader system adoption.

Combined Expert and User-Driven Usability Assessment of Trauma Decision Support Systems Improves User-Centered Design

BACKGROUND

Trauma clinical decision support systems improve adherence with evidence-based practice but suffer from poor usability and the lack of a user-centered design. The objective of this study was to compare the effectiveness of user and expert-driven usability testing methods to detect usability issues in a rib fracture clinical decision support system and identify guiding principles for trauma clinical decision support systems.

METHODS

A user-driven and expert-driven usability investigation was conducted using a clinical decision support system developed for patients with rib fractures. The user-driven usability evaluation was as follows: 10 clinicians were selected for simulation-based usability testing using snowball sampling, and each clinician completed 3 simulations using a video-conferencing platform. End-users participated in a novel team-based approach that simulated realistic clinical workflows. The expert-driven heuristic evaluation was as follows: 2 usability experts conducted a heuristic evaluation of the clinical decision support system using 10 common usability heuristics. Usability issues were identified, cataloged, and ranked for severity using a 4-level ordinal scale. Thematic analysis was utilized to categorize the identified usability issues.

RESULTS

Seventy-nine usability issues were identified; 63% were identified by experts and 48% by end-users. Notably, 58% of severe usability issues were identified by experts alone. Only 11% of issues were identified by both methods. Five themes were identified that could guide the design of clinical decision support systems-transparency, functionality and integration into workflow, automated and noninterruptive, flexibility, and layout and appearance. Themes were preferentially identified by different methods.

CONCLUSION

We found that a dual-method usability evaluation involving usability experts and end-users drastically improved detection of usability issues over single-method alone. We identified 5 themes to guide trauma clinical decision support system design. Performing usability testing via a remote video-conferencing platform facilitated multi-site involvement despite a global pandemic.

Barriers and facilitators to implementing a nursing clinical decision support system in a tertiary hospital setting: A qualitative study using the FITT framework

OBJECTIVE

Clinical decision support systems (CDSSs) have been increasingly introduced to health care settings; however, their adoption is far from ideal. Guided by the FITT framework, this study aims to explore barriers and facilitators to the implementation of a CDSS from the perspective of nurses.

METHODS

A qualitative study with 200 h of participatory observation and 21 semi structured interviews was conducted from February to August 2021 in four medical-surgical wards in a 2000-bed tertiary hospital in Shanghai, China. The field notes were typed and the audio-recorded interviews were transcribed to texts verbatim and were coded with a four-step approach. We used the FITT framework to interpret our findings based on the technology, individual and task attributes and the fit between them.

RESULTS

A total of twelve categories were identified, which were integrated into two themes: barriers and facilitators to system implementation. All categories but one can be mapped to the three attributes of the FITT framework: technology, individual and task. We assumed that management has a vital role to play in the following areas: addressing user resistance, improving system usability, setting standards on practice and, finally, building connectivity between nurses and the technical staff to improve the fit between the technology, individual and task attribute and thus promote system implementation.

CONCLUSION

Barriers and facilitators to CDSS implementation include system-related, user-related and organizational factors which can largely be fit io the FITT framework. There is potential to extend the FITT framework to represent management intervention on inter-disciplinary collaboration. Future empirical studies on facilitating strategies from the management to improve user experience and willingness of CDSS adoption are needed.

Human-centered design of clinical decision support for management of hypertension with chronic kidney disease

Background

Primary care providers face challenges in recognizing and controlling hypertension in patients with chronic kidney disease (CKD). Clinical decision support (CDS) has the potential to aid clinicians in identifying patients who could benefit from medication changes. This study designed an alert to control hypertension in CKD patients using an iterative human-centered design process.

Methods

In this study, we present a human-centered design process employing multiple methods for gathering user requirements and feedback on design and usability. Initially, we conducted contextual inquiry sessions to gather user requirements for the CDS. This was followed by group design sessions and one-on-one formative think-aloud sessions to validate requirements, obtain feedback on the design and layout, uncover usability issues, and validate changes.

Results

This study included 20 participants. The contextual inquiry produced 10 user requirements which influenced the initial alert design. The group design sessions revealed issues related to several themes, including recommendations and clinical content that did not match providers' expectations and extraneous information on the alerts that did not provide value. Findings from the individual think-aloud sessions revealed that participants disagreed with some recommended clinical actions, requested additional information, and had concerns about the placement in their workflow. Following each step, iterative changes were made to the alert content and design.

Discussion

This study showed that participation from users throughout the design process can lead to a better understanding of user requirements and optimal design, even within the constraints of an EHR alerting system. While raising awareness of design needs, it also revealed concerns related to workflow, understandability, and relevance.

Conclusion

The human-centered design framework using multiple methods for CDS development informed the creation of an alert to assist in the treatment and recognition of hypertension in patients with CKD.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12911-022-01962-y.

Contribution of Synthetic Data Generation towards an Improved Patient Stratification in Palliative Care

AI model development for synthetic data generation to improve Machine Learning (ML) methodologies is an integral part of research in Computer Science and is currently being transferred to related medical fields, such as Systems Medicine and Medical Informatics. In general, the idea of personalized decision-making support based on patient data has driven the motivation of researchers in the medical domain for more than a decade, but the overall sparsity and scarcity of data are still major limitations. This is in contrast to currently applied technology that allows us to generate and analyze patient data in diverse forms, such as tabular data on health records, medical images, genomics data, or even audio and video. One solution arising to overcome these data limitations in relation to medical records is the synthetic generation of tabular data based on real world data. Consequently, ML-assisted decision-support can be interpreted more conveniently, using more relevant patient data at hand. At a methodological level, several state-of-the-art ML algorithms generate and derive decisions from such data. However, there remain key issues that hinder a broad practical implementation in real-life clinical settings. In this review, we will give for the first time insights towards current perspectives and potential impacts of using synthetic data generation in palliative care screening because it is a challenging prime example of highly individualized, sparsely available patient information. Taken together, the reader will obtain initial starting points and suitable solutions relevant for generating and using synthetic data for ML-based screenings in palliative care and beyond.

Clinical Decision Support for Fall Prevention: Defining End-User Needs

BACKGROUND AND SIGNIFICANCE

Falls in community-dwelling older adults are common, and there is a lack of clinical decision support (CDS) to provide health care providers with effective, individualized fall prevention recommendations.

OBJECTIVES

The goal of this research is to identify end-user (primary care staff and patients) needs through a human-centered design process for a tool that will generate CDS to protect older adults from falls and injuries.

METHODS

Primary care staff (primary care providers, care coordinator nurses, licensed practical nurses, and medical assistants) and community-dwelling patients aged 60 years or older associated with Brigham & Women's Hospital-affiliated primary care clinics and the University of Florida Health Archer Family Health Care primary care clinic were eligible to participate in this study. Through semi-structured and exploratory interviews with participants, our team identified end-user needs through content analysis.

RESULTS

User needs for primary care staff (n = 24) and patients (n = 18) were categorized under the following themes: workload burden; systematic communication; in-person assessment of patient condition; personal support networks; motivational tools; patient understanding of fall risk; individualized resources; and evidence-based safe exercises and expert guidance. While some of these themes are specific to either primary care staff or patients, several address needs expressed by both groups of end-users.

CONCLUSION

Our findings suggest that there are many care gaps in fall prevention management in primary care and that personalized, actionable, and evidence-based CDS has the potential to address some of these gaps.

A Participatory Design Approach to Develop Visualization of Wearable Actigraphy Data for Health Care Professionals: Case Study in Qatar

Background

Several tools have been developed for health care professionals to monitor the physical activity of their patients, but most of these tools have been considering only the needs of users in North American and European countries and applicable for only specific analytic tasks. To our knowledge, no research study has utilized the participatory design (PD) approach in the Middle East region to develop such tools, involving all the stakeholders in the product development phases, and no clear use cases have been derived from such studies that could serve future development in the field.

Objective

This study aims to develop an interactive visualization tool (ActiVis) to support local health care professionals in monitoring the physical activity of their patients measured through wearable sensors, with the overall objective of improving the health of the Qatari population.

Methods

We used PD and user-centered design methodologies to develop ActiVis, including persona development, brainwriting, and heuristic walkthrough as part of user evaluation workshops; and use cases, heuristic walkthrough, interface walkthrough, and survey as part of expert evaluation sessions.

Results

We derived and validated 6 data analysis use cases targeted at specific health care professionals from a collaborative design workshop and an expert user study. These use cases led to improving the design of the ActiVis tool to support the monitoring of patients’ physical activity by nurses and family doctors. The ActiVis research prototype (RP) compared favorably with the Fitbit Dashboard, showing the importance of design tools specific to end users’ needs rather than relying on repurposing existing tools designed for other types of users. The use cases we derived happen to be culturally agnostic, despite our assumption that the local Muslim and Arabic culture could impact the design of such visualization tools. At last, taking a step back, we reflect on running collaborative design sessions in a multicultural environment and oil-based economy.

Conclusions

Beyond the development of the ActiVis tool, this study can serve other visualization and human–computer interaction designers in the region to prepare their design projects and encourage health care professionals to engage with designers and engineers to improve the tools they use for supporting their daily routine. The development of the ActiVis tool for nurses, and other visualization tools specific to family doctors and clinician researchers, is still ongoing and we plan to integrate them into an operational platform for health care professionals in Qatar in the near future.

Barriers to and Facilitators for Acceptance of Comprehensive Clinical Decision Support System-Driven Care Maps for Patients With Thoracic Trauma: Interview Study Among Health Care Providers and Nurses

BACKGROUND

Comprehensive clinical decision support (CDS) care maps can improve the delivery of care and clinical outcomes. However, they are frequently plagued by usability problems and poor user acceptance.

OBJECTIVE

This study aims to characterize factors influencing successful design and use of comprehensive CDS care maps and identify themes associated with end-user acceptance of a thoracic trauma CDS care map earlier in the process than has traditionally been done. This was a planned adaptive redesign stage of a User Acceptance and System Adaptation Design development and implementation strategy for a CDS care map. This stage was based on a previously developed prototype CDS care map guided by the Unified Theory of Acceptance and Use of Technology.

METHODS

A total of 22 multidisciplinary end users (physicians, advanced practice providers, and nurses) were identified and recruited using snowball sampling. Qualitative interviews were conducted, audio-recorded, and transcribed verbatim. Generation of prespecified codes and the interview guide was informed by the Unified Theory of Acceptance and Use of Technology constructs and investigative team experience. Interviews were blinded and double-coded. Thematic analysis of interview scripts was conducted and yielded descriptive themes about factors influencing the construction and potential use of an acceptable CDS care map.

RESULTS

A total of eight dominant themes were identified: alert fatigue (theme 1), automation (theme 2), redundancy (theme 3), minimalistic design (theme 4), evidence based (theme 5), prevent errors (theme 6), comprehensive across the spectrum of disease (theme 7), and malleability (theme 8). Themes 1 to 4 addressed factors directly affecting end users, and themes 5 to 8 addressed factors affecting patient outcomes. More experienced providers prioritized a system that is easy to use. Nurses prioritized a system that incorporated evidence into decision support. Clinicians across specialties, roles, and ages agreed that the amount of extra work generated should be minimal and that the system should help them administer optimal care efficiently.

CONCLUSIONS

End user feedback reinforces attention toward factors that improve the acceptance and use of a CDS care map for patients with thoracic trauma. Common themes focused on system complexity, the ability of the system to fit different populations and settings, and optimal care provision. Identifying these factors early in the development and implementation process may facilitate user-centered design and improve adoption.

Web-Based Tool (FH Family Share) to Increase Uptake of Cascade Testing for Familial Hypercholesterolemia: Development and Evaluation

BACKGROUND

Familial hypercholesterolemia, a prevalent genetic disorder, remains significantly underdiagnosed in the United States. Cascade testing, wherein individuals diagnosed with familial hypercholesterolemia- probands-contact their family members to inform them of their risk for familial hypercholesterolemia, has low uptake in the United States. Digital tools are needed to facilitate communication between familial hypercholesterolemia probands and their family members and to promote sharing of familial hypercholesterolemia-related risk information.

OBJECTIVE

We aimed to create and evaluate a web-based tool designed to enhance familial communication and promote cascade testing for familial hypercholesterolemia.

METHODS

A hybrid type 1 implementation science framework and a user-centered design process were used to develop an interactive web-based tool-FH Family Share-that enables familial hypercholesterolemia probands to communicate information about their familial hypercholesterolemia diagnosis with at-risk relatives. Probands can also use the tool to draw a family pedigree and learn more about familial hypercholesterolemia through education modules and curated knowledge resources. Usability guidelines and standards were taken into account during the design and development of the tool. The initial prototype underwent a cognitive walkthrough, which was followed by usability testing with key stakeholders including genetic counselors and patients with familial hypercholesterolemia. Participants navigated the prototype using the think-aloud technique, and their feedback was used to refine features of the tool.

RESULTS

Key themes that emerged from the cognitive walkthrough were design, format, navigation, terminology, instructions, and learnability. Expert feedback from the cognitive walkthrough resulted in a rebuild of the web-based tool to align it with institutional standards. Usability testing with genetic counselors and patients with familial hypercholesterolemia provided insights on user experience, satisfaction and interface design and highlighted specific modifications that were made to refine the features of FH Family Share. Genetic counselors and patients with familial hypercholesterolemia suggested inclusion of the following features in the web-based tool: (1) a letter-to-family-member email template, (2) education modules, and (3) knowledge resources. Surveys revealed that 6 of 9 (67%) genetic counselors found information within FH Family Share very easy to find, and 5 of 9 (56%) genetic counselors found information very easy to understand; 5 of 9 (56%) patients found information very easy to find within the website, and 7 of 9 (78%) patients found information very easy to understand. All genetic counselors and patients indicated that FH Family Share was a resource worth returning to.

CONCLUSIONS

FH Family Share facilitates communication between probands and their relatives. Once informed, at-risk family members have the option to seek testing and treatment for familial hypercholesterolemia.

An Emergency Department Delirium Screening and Management Initiative: The Development and Refinement of the SCREENED-ED Intervention

The current article describes an intervention aimed at emergency department (ED) nurses and physicians that was designed to address the challenges of managing delirium in the ED environment. The intervention development process followed the Medical Research Council principles paired with a user-centered design perspective. Expert clinicians and nursing staff were involved in the development process. As a result, the SCREENED-ED intervention includes four major components: screening for delirium, informing providers, an acronym (ALTERED), and documentation in the electronic health record. The acronym "ALTERED" includes seven key elements of delirium management that were considered the most evidence-based, relevant, and practical for the ED. Nurses are at the frontline of delirium recognition and management and the SCREENED-ED intervention with the ALTERED acronym holds the potential to improve nursing care in this complex clinical setting. [Journal of Gerontological Nursing, 47(12), 13-17.].

Clinical Decision Support Systems for Diagnosis in Primary Care: A Scoping Review

Diagnosis is one of the crucial tasks performed by primary care physicians; however, primary care is at high risk of diagnostic errors due to the characteristics and uncertainties associated with the field. Prevention of diagnostic errors in primary care requires urgent action, and one of the possible methods is the use of health information technology. Its modes such as clinical decision support systems (CDSS) have been demonstrated to improve the quality of care in a variety of medical settings, including hospitals and primary care centers, though its usefulness in the diagnostic domain is still unknown. We conducted a scoping review to confirm the usefulness of the CDSS in the diagnostic domain in primary care and to identify areas that need to be explored. Search terms were chosen to cover the three dimensions of interest: decision support systems, diagnosis, and primary care. A total of 26 studies were included in the review. As a result, we found that the CDSS and reminder tools have significant effects on screening for common chronic diseases; however, the CDSS has not yet been fully validated for the diagnosis of acute and uncommon chronic diseases. Moreover, there were few studies involving non-physicians.

Pharmaceutical mobile application for visually-impaired people in Thailand: development and implementation

BACKGROUND

Most mobile pharmaceutical applications produced for people with visual disabilities in Thailand fail to meet the required standard due to poor-quality regulations, defective design, lack of user support and impracticality; as a result, visually-impaired people are unable to use them. This research is motivated by the limited use of this technology in primary medical services and its aim is to enable people with disabilities to access effective digital health information. The research objective is to analyse, design and develop a mobile pharmaceutical application with functions that are appropriate for visually-impaired users, and test its usability.

RESULTS

Based on the design and development of the application, it contained five necessary functions. When testing the usability and users' satisfaction, it was found that the input or fill of information in the application was of low usability. According to the test results, the medicinal database function was missing 71 times and the voice command function was missing 34 times. Based on users' satisfaction results, users who had the highest level of usage gave higher average scores to users' attitude, users' confidence, user interface and system performance than those with lower levels of usage. The scores of both groups were found to be the same when discussing the implementation of the development.

CONCLUSIONS

This mobile application, which was developed based on the use of smart technology, will play an important role in supporting visually-impaired people in Thailand by enhancing the efficacy of self-care. The design and development of the application will ensure the suitability of many functions for visually-impaired users. However, despite the high functional capacity of the application, the gap in healthcare services between the general public and disabled groups will still exist if users have inadequate IT skills.

Developing an Ophthalmology Clinical Decision Support System to Identify Patients for Low Vision Rehabilitation

Purpose

The purpose of this study was to develop and evaluate an electronic health record (EHR) clinical decision support system to identify patients meeting criteria for low vision rehabilitation (LVR) referral.

Methods

In this quality improvement project, we applied a user-centered design approach to develop an interactive electronic alert for LVR referral within the Johns Hopkins Wilmer Eye Institute. We invited 15 ophthalmology physicians from 8 subspecialties to participate in the design and implementation, and to provide user experience feedback. The three project phases incorporated development evaluation, feedback analysis, and system refinement. We report on the final alert design, firing accuracy, and user experiences.

Results

The alert was designed as physician-centered and patient-specific. Alert firing relied on visual acuity and International Classification of Diseases (ICD)-10 diagnosis (hemianopia/quadrantanopia) criteria. The alert suppression considerations included age < 5 years, recent surgeries, prior LVR visit, and related alert actions. False positive rate (firing when alert should have been suppressed or when firing criteria not met) was 0.2%. The overall false negative rate (alert not firing when visual acuity or encounter diagnosis criteria met) was 5.6%. Of the 13 physicians who completed the survey, 8 agreed that the alert is easy to use, and 12 would consider ongoing usage.

Conclusions

This EHR-based clinical decision support system shows reliable firing metrics in identifying patients with vision impairment and promising acceptance by ophthalmologist users to facilitate care and LVR referral.

Translational Relevance

The use of real-time data offers an opportunity to translate ophthalmic guidelines and best practices into systematic action for clinical care and research purposes across subspecialties.

Understanding User Acceptance of Clinical Decision Support Systems to Promote Increased Cancer Screening Rates in a Primary Care Practice

OBJECTIVE

Clinical decision support systems (CDDSs) in the electronic medical record (EMR) have been implemented in primary care settings to identify patients due for cancer screening tests, while functioning as a real time reminder system. There is little known about primary care providers (PCPs) perspective or user acceptance of CDSS. The purpose of this study was to investigate primary care provider perceptions of utilizing CDSS alerts in the EMR to promote increased screening rates for breast cancer, cervical cancer, and colorectal cancer.

METHODS

An electronic survey was administered to PCPs in a Midwest Health Institution community internal medicine practice from September 25, 2019 through November 27, 2019.

RESULTS

Among 37 participants (9 NP/Pas and 28 MD/DOs), the NP/PA group was more likely to agree that alerts were helpful (50%; P-value = .0335) and the number of alerts (89%; P = .0227) in the EMR was appropriate. The NP/PA group also was more likely to find alerts straightforward to use (78%, P = .0239). Both groups agreed about feeling comfortable using the health maintenance alerts (MD/DO = 79%; NP/PA = 100%).

CONCLUSION

CDSSs can promote and facilitate ordering of cancer screening tests. The use of technology can promptly identify patients due for a test and act as a reminder to the PCP. PCPs identify these alerts to be a beneficial tool in the EMR when they do not interrupt workflow and provide value to patient care. More work is needed to identify factors that could optimize alerts to be even more helpful, particularly to MD/DO groups.

Barriers and facilitators influencing medication-related CDSS acceptance according to clinicians: A systematic review

BACKGROUND

A medication-related Clinical Decision Support System (CDSS) is an application that analyzes patient data to provide assistance in medication-related care processes. Despite its potential to improve the clinical decision-making process, evidence shows that clinicians do not always use CDSSs in such a way that their potential can be fully realized. This systematic literature review provides an overview of frequently-reported barriers and facilitators for acceptance of medication-related CDSS.

MATERIALS AND METHODS

Search terms and MeSH headings were developed in collaboration with a librarian, and database searches were conducted in Medline, Scopus, Embase and Web of Science Conference Proceedings. After screening 5404 records and 140 full papers, 63 articles were included in this review. Quality assessment was performed for all 63 included articles. The identified barriers and facilitators are categorized within the Human, Organization, Technology fit (HOT-fit) model.

RESULTS

A total of 327 barriers and 291 facilitators were identified. Results show that factors most often reported were related to (a lack of) usefulness and relevance of information, and ease of use and efficiency of the system.

DISCUSSION

This review provides a valuable insight into a broad range of barriers and facilitators for using a medication-related CDSS as perceived by clinicians. The results can be used as a stepping stone in future studies developing medication-related CDSSs.

Special Commentary: Using Clinical Decision Support Systems to Bring Predictive Models to the Glaucoma Clinic

Advances in the field of predictive modeling using artificial intelligence and machine learning have the potential to improve clinical care and outcomes, but only if the results of these models are presented appropriately to clinicians at the time they make decisions for individual patients. Clinical decision support (CDS) systems could be used to accomplish this. Modern CDS systems are computer-based tools designed to improve clinician decision making for individual patients. However, not all CDS systems are effective. Four principles that have been shown in other medical fields to be important for successful CDS system implementation are (1) integration into clinician workflow, (2) user-centered interface design, (3) evaluation of CDS systems and rules, and (4) standards-based development so the tools can be deployed across health systems.

Diagnosis of Rare Diseases: a scoping review of clinical decision support systems

BACKGROUND

Rare Diseases (RDs), which are defined as diseases affecting no more than 5 out of 10,000 people, are often severe, chronic and life-threatening. A main problem is the delay in diagnosing RDs. Clinical decision support systems (CDSSs) for RDs are software systems to support clinicians in the diagnosis of patients with RDs. Due to their clinical importance, we conducted a scoping review to determine which CDSSs are available to support the diagnosis of RDs patients, whether the CDSSs are available to be used by clinicians and which functionalities and data are used to provide decision support.

METHODS

We searched PubMed for CDSSs in RDs published between December 16, 2008 and December 16, 2018. Only English articles, original peer reviewed journals and conference papers describing a clinical prototype or a routine use of CDSSs were included. For data charting, we used the data items "Objective and background of the publication/project", "System or project name", "Functionality", "Type of clinical data", "Rare Diseases covered", "Development status", "System availability", "Data entry and integration", "Last software update" and "Clinical usage".

RESULTS

The search identified 636 articles. After title and abstracting screening, as well as assessing the eligibility criteria for full-text screening, 22 articles describing 19 different CDSSs were identified. Three types of CDSSs were classified: "Analysis or comparison of genetic and phenotypic data," "machine learning" and "information retrieval". Twelve of nineteen CDSSs use phenotypic and genetic data, followed by clinical data, literature databases and patient questionnaires. Fourteen of nineteen CDSSs are fully developed systems and therefore publicly available. Data can be entered or uploaded manually in six CDSSs, whereas for four CDSSs no information for data integration was available. Only seven CDSSs allow further ways of data integration. thirteen CDSS do not provide information about clinical usage.

CONCLUSIONS

Different CDSS for various purposes are available, yet clinicians have to determine which is best for their patient. To allow a more precise usage, future research has to focus on CDSSs RDs data integration, clinical usage and updating clinical knowledge. It remains interesting which of the CDSSs will be used and maintained in the future.

From sensitization to adoption? A qualitative study of the implementation of a digitally supported intervention for clinical decision making in polypharmacy

OBJECTIVE

Formative evaluation of the implementation process for a digitally supported intervention in polypharmacy in Germany. Qualitative research was conducted within a cluster randomized controlled trial (C-RCT). It focused on understanding how the intervention influences behavior-related outcomes in the prescription and medication review process.

METHODS/SETTING

Twenty-seven general practitioners (GPs) were included in the study in the two groups of the C-RCT, the intervention, and the wait list control group. Behavior-related outcomes were investigated using three-step data analysis (content analytic approach, documentary method, and design of a model of implementation pathways).

RESULTS

Content analysis showed that physicians were more intensely aware of polypharmacy-related risks, described positive learning effects of the digital technology on their prescribing behavior, and perceived a change in communication with patients and pharmacists. Conversely, they felt uncertain about their own responsibility when prescribing. Three main dimensions were discovered which influenced adoption behavior: (1) the physicians' interpretation of the relevance of pharmaceutical knowledge provided by the intervention in changing decision-making situations in polypharmacy; (2) their medical code of ethics for clinical decision making in the context of progressing digitalization; and (3) their concepts of evidence-based medicine on the basis of professional experiences with polypharmacy in primary care settings. In our sample, both simple and complex pathways from sensitization to adoption were observed. The resulting model on adoption behavior includes a paradigmatic description of different pathways and a visualization of different observed levels and applied methodological approaches. We assumed that the GP habitus can weaken or strengthen interventional effects towards intervention uptake. This formative evaluation strategy is beneficial for the identification of behavior-related implementation barriers and facilitators.

CONCLUSION

Our analyses of the adoption behavior of a digitally supported intervention in polypharmacy revealed both simple and complex pathways from awareness to adoption, which may impact the implementation of the intervention and therefore, its effectiveness. Future consideration of adoption behavior in the planning and evaluation of digitally supported interventions may enhance uptake and support the interpretation of effects.

TRIAL REGISTRATION

NCT03430336 , 12 February 2018.

Interviews with experts in rare diseases for the development of clinical decision support system software - a qualitative study

BACKGROUND

Patients with rare diseases (RDs) are often diagnosed too late or not at all. Clinical decision support systems (CDSSs) could support the diagnosis in RDs. The MIRACUM (Medical Informatics in Research and Medicine) consortium, which is one of four funded consortia in the German Medical Informatics Initiative, will develop a CDSS for RDs based on distributed clinical data from ten university hospitals. This qualitative study aims to investigate (1) the relevant organizational conditions for the operation of a CDSS for RDs when diagnose patients (e.g. the diagnosis workflow), (2) which data is necessary for decision support, and (3) the appropriate user group for such a CDSS.

METHODS

Interviews were carried out with RDs experts. Participants were recruited from staff physicians at the Rare Disease Centers (RDCs) at the MIRACUM locations, which offer diagnosis and treatment of RDs. An interview guide was developed with a category-guided deductive approach. The interviews were recorded on an audio device and then transcribed into written form. We continued data collection until all interviews were completed. Afterwards, data analysis was performed using Mayring's qualitative content analysis approach.

RESULTS

A total of seven experts were included in the study. The results show that medical center guides and physicians from RDC B-centers (with a focus on different RDs) are involved in the diagnostic process. Furthermore, interdisciplinary case discussions between physicians are conducted. The experts explained that RDs exist which cannot be fully differentiated, but rather described only by their overall symptoms or findings: diagnosis is dependent on the disease or disease group. At the end of the diagnostic process, most centers prepare a summary of the patient case. Furthermore, the experts considered both physicians and experts from the B-centers to be potential users of a CDSS. The experts also have different experiences with CDSS for RDs.

CONCLUSIONS

This qualitative study is a first step towards establishing the requirements for the development of a CDSS for RDs. Further research is necessary to create solutions by also including the experts on RDs.

Electronic clinical decision support to facilitate a change in clinical practice: Small details can make or break success

BACKGROUND

The use of electronic clinical decision support (CDS) is becoming common to change historically common clinical practices considered outdated by current guidelines. Preimplementation design of CDS tools is key to their success in changing clinical behaviors. Unfortunately, there are no established protocols for CDS tool development, and CDS failure can result from even small design flaws. This paper describes an example of a design oversight and how correction resulted in CDS success.

STUDY DESIGN AND METHODS

We performed a retrospective review of compliance with a CDS tool to encourage the use of prothrombin complex concentrate over plasma transfusion for the emergent reversal of warfarin. We identified a potential design flaw, made the necessary modifications, and repeated the compliance review.

RESULTS

After CDS, plasma orders declined by 150 units/mo; however, 48% of orders placed for non-warfarin coagulopathy were still for warfarin reversal. Hospital-wide, this noncompliance was 36% and was 80% in the emergency department. By simply relocating the qualifier "NOT on warfarin" from the end to the beginning of the order, noncompliance for warfarin reversal was reduced to 5% (P < .0001 by chi-square).

CONCLUSIONS

The successful use of electronic clinical decision support in the electronic medical record can depend on optimal design. Missing even small design elements such as the positioning of key terms within the tool can result in an ineffective CDS. Important design strategies to avoid poor performance are discussed as they relate to the CDS tool we describe.

User-Centered App Design for Acutely Ill Children and Adolescents

Background and Objectives: The high level of acceptance and consistent use of smartphones by children and adolescents present new opportunities to monitor and collect health data. For acutely ill children and adolescents, collecting symptom data via smartphone applications (apps) provides patient-reported data that can be collected daily and offers the potential to provide a more comprehensive picture of the symptom experience. The purpose of this study was to employ user-centered design principles and medical professional input in order to obtain feedback and insight into redesigning our Technology Recordings for better Understanding Blood and Marrow Transplant (TRU-PBMT) app. This redesigned app will be used for children and adolescents with cancer or undergoing blood and marrow transplantation. Method: We interviewed six pediatric blood and marrow transplant patients (ages 10-17 years) who had pilot tested the app, and we surveyed 30 pediatric oncology clinicians. Results: Interview feedback from previous app users and survey feedback from clinicians guided the app redesign. We incorporated suggestions to make the app more engaging, meaningful, personal, and motivating in order to increase symptom reporting. We added emojis to the symptom tracker, a mood scale, and personalized symptom graphs. Conclusion: Leveraging mobile health technologies may be a useful and acceptable approach to obtain symptom data; however, design and software development needs to be evidenced-based and informed by user needs. Our approach using patient and clinician feedback was valuable in the redesign of the TRU-PBMT app and will contribute to symptom research for acutely ill children and adolescents.

Veterans Health Administration Primary Care Provider Adherence to Prescribing Guidelines for Systemic Hormone Therapy in Menopausal Women

BACKGROUND

Systemic hormone therapy (HT) is effective for treating menopausal symptoms but also confers risks. Therefore, experts have developed clinical guidelines for its use.

PURPOSE

We assessed primary care guideline adherence in prescribing systemic HT, and associations between adherence and provider characteristics, in four Veterans Health Administration (VA) facilities.

METHODS

We abstracted medical records associated with new and renewal systemic HT prescriptions examining adherence to guidelines for documenting indications and contraindications; prescribing appropriate dosages; and prescribing progesterone.

RESULTS

Average guideline adherence was 58%. Among new prescriptions, 74% documented a guideline-adherent indication and 28% documented absence of contraindications. Among renewals, 39% documented a guideline-adherent indication. In prescribing an appropriate dose, 45% of new prescriptions were guideline-adherent. Among renewal prescriptions with conjugated equine estrogen doses ≥0.625 mg or equivalent, 16% documented the dosing rationale. Among 116 prescriptions for systemic estrogen in women with a uterus, progesterone was not prescribed in 8.

CONCLUSIONS

Guideline adherence in prescribing systemic HT was low among VA primary care providers. Failures to coprescribe progesterone put women at increased risk for endometrial cancer.

IMPLICATIONS

Intervention development is urgently needed to improve guideline adherence among primary care prescribers of systemic HT for menopause. Similar assessments should be conducted in community settings.

Advanced informatics understanding of clinician-patient communication: A mixed-method approach to oral health literacy talk in interpreter-mediated pediatric dentistry

Background

In the clinical dental consultation, multi-party configurations predominate with the presence of parents/ primary caregivers in pediatric dentistry adding another layer of complexity. In managing child oral healthcare, parents/ primary caregivers are critical, especially in dental caries prevention. This study aimed (1) to identify the structure of oral health literacy (OHL) talk in interpreter-mediated pediatric dentistry and (2) to analyze interpreter contributions to the communication strategies: patient-centered direct interpreting (PC-DI), patient-centered mediated interpreting (PC-MI), clinician-centered direct interpreting (CC-DI), and clinician-centered mediated interpreting (CC-MI).

Methods

Visual text analysis (VTA) of video recorded pediatric clinical consultations in Hong Kong utilized Discursis^™ software to illustrate temporal and topical structures and their distribution across turns-at-talk. Conversation analysis (CA) was applied to analyze turn-taking of the identified OHL talk qualitatively. The mixed-method approach of combining VTA and CA was applied to analyze the patterns and features of the recorded OHL talk.

Results

The conceptual recurrences of the 77 transcribed video recordings were plotted visually. CC- and PC-OHL talk were identified by the recurrence patterns of monochromatic and multi-colored triangular clusters formed by off-diagonal boxes, respectively. CA of interpreter-mediated turns supported earlier findings regarding patterns of MI in multilingual adult dental consultations; however, the role of the interpreter in parent/ primary caregiver education and patient management was more distinctive in the pediatric dentistry.

Conclusions

The mixed-method approach assisted in unpacking the complexities of the multi-party interactions, supported identification of effective communication strategies, and illustrated the roles of the dental professionals in initiating CC- and PC-OHL talk in pediatric dentistry. The intervention showed the implication of the professional education of evidence-based practices for clinicians in balancing agenda management and the communicative dimension of OHL with the help of VTA and CA in multilingual consultations.

Social rhythm therapy-A potentially translatable psychosocial intervention for bipolar disorder

INTRODUCTION

The aim of this paper was to present Social Rhythm Therapy, which has been modified from Interpersonal and Social Rhythm Therapy, by drawing on implementation science to describe a process that for integrating this into routine clinical practice.

METHOD

On the basis of the principles of user-centred design, we aimed to modify an existing psychosocial therapy for bipolar disorder to make this readily translatable into a range of clinical practice models which could be further modified based on feedback from end users.

RESULTS

Social Rhythm Therapy has been adapted from Interpersonal and Social Rhythm Therapy which has demonstrated efficacy in research settings. The adaptation was developed in order to facilitate implementation of some of the key components in routine clinical practice. It is short, relatively simple, easily learned and intended to be flexible.

CONCLUSIONS

Social rhythm therapy for bipolar disorder has many characteristics which may make it translatable into clinical practice in different settings. There is a need for studies into the clinical effectiveness of this intervention that has been modified from an evidence-based intervention.

Joint Design with Providers of Clinical Decision Support for Value-Based Advanced Shoulder Imaging

BACKGROUND

Provider orders for inappropriate advanced imaging, while rarely altering patient management, contribute enough to the strain on available health care resources, and therefore the United States Congress established the Appropriate Use Criteria Program.

OBJECTIVES

To examine whether co-designing clinical decision support (CDS) with referring providers will reduce barriers to adoption and facilitate more appropriate shoulder ultrasound (US) over magnetic resonance imaging (MRI) in diagnosing Veteran shoulder pain, given similar efficacies and only 5% MRI follow-up rate after shoulder US.

METHODS

We used a theory-driven, convergent parallel mixed-methods approach to prospectively (1) determine medical providers' reasons for selecting MRI over US in diagnosing shoulder pain and identify barriers to ordering US, (2) co-design CDS, informed by provider interviews, to prompt appropriate US use, and (3) assess CDS impact on shoulder imaging use. CDS effectiveness in guiding appropriate shoulder imaging was evaluated through monthly monitoring of ordering data at our quaternary care Veterans Hospital. Key outcome measures were appropriate MRI/US use rates and transition to ordering US by both musculoskeletal specialist and generalist providers. We assessed differences in ordering using a generalized estimating equations logistic regression model. We compared continuous measures using mixed effects analysis of variance with log-transformed data.

RESULTS

During December 2016 to March 2018, 569 (395 MRI, 174 US) shoulder advanced imaging examinations were ordered by 111 providers. CDS "co-designed" in collaboration with providers increased US from 17% (58/335) to 50% (116/234) of all orders (p < 0.001), with concomitant decrease in MRI. Ordering appropriateness more than doubled from 31% (105/335) to 67% (157/234) following CDS (p < 0.001). Interviews confirmed that generalist providers want help in appropriately ordering advanced imaging.

CONCLUSION

Partnering with medical providers to co-design CDS reduced barriers and prompted appropriate transition to US from MRI for shoulder pain diagnosis, promoting evidence-based practice. This approach can inform the development and implementation of other forms of CDS.

Utilizing a user-centered approach to develop and assess pharmacogenomic clinical decision support for thiopurine methyltransferase

Background

A pharmacogenomic clinical decision support tool (PGx-CDS) for thiopurine medications can help physicians incorporate pharmacogenomic results into prescribing decisions by providing up-to-date, real-time decision support. However, the PGx-CDS user interface may introduce errors and promote alert fatigue. The objective of this study was to develop and evaluate a prototype of a PGx-CDS user interface for thiopurine medications with user-centered design methods.

Methods

This study had two phases: In phase I, we conducted qualitative interviews to assess providers’ information needs. Interview transcripts were analyzed through a combination of inductive and deductive qualitative analysis to develop design requirements for a PGx-CDS user interface. Using these requirements, we developed a user interface prototype and evaluated its usability (phase II).

Results

In total, 14 providers participated: 10 were interviewed in phase I, and seven providers completed usability testing in phase II (3 providers participated in both phases). Most (90%) participants were interested in PGx-CDS systems to help improve medication efficacy and patient safety. Interviews yielded 11 themes sorted into two main categories: 1) health care providers’ views on PGx-CDS and 2) important design features for PGx-CDS. We organized these findings into guidance for PGx-CDS content and display. Usability testing of the PGx-CDS prototype showed high provider satisfaction.

Conclusion

This is one of the first studies to utilize a user-centered design approach to develop and assess a PGx-CDS interface prototype for Thiopurine Methyltransferase (TPMT). This study provides guidance for the development of a PGx-CDS, and particularly for biomarkers such as TPMT.

Identifying Frameworks for Validation and Monitoring of Consensual Behavioral Intervention Technologies: Narrative Review

BACKGROUND

Changing health behaviors, such as smoking, unhealthy eating, inactivity, and alcohol abuse, may have a greater impact on population health than any curative strategy. One of the suggested strategies is the use of behavioral intervention technologies (BITs). They open up new opportunities in the area of prevention and therapy and have begun to show benefits in the durable change of health behaviors in patients or those at risk. A consensual and international paradigm was adopted by health authorities for drugs 50 years ago. It guides their development from research units to their authorization and surveillance. BITs' generalization brings into question their upstream evaluation before being placed on the market and their downstream monitoring once on the market; this is especially the case in view of the marketing information provided by manufacturers and the scarcity and methodological limits of scientific studies on these tools.

OBJECTIVE

This study aims to identify and categorize the frameworks for the validation and monitoring of BITs proposed in the literature.

METHODS

We conducted a narrative literature review using MEDLINE, PsycINFO, and Web of Science. The review items included the following: name, publication year, name of the creator (ie, first author), country, funding organization, health focus, target group, and design (ie, linear, iterative, evolutive, and/or concurrent). The frameworks were then categorized based on (1) translational research thanks to a continuum of steps and (2) the three paradigms that may have inspired the frameworks: biomedical, engineering, and/or behavioral.

RESULTS

We identified 46 frameworks besides the classic US Food and Drug Administration (FDA) five-phase drug development model. A total of 57% (26/46) of frameworks were created in the 2010s and 61% (28/46) involved the final user in an early and systematic way. A total of 4% (2/46) of frameworks had a linear-only sequence of their phases, 37% (17/46) had a linear and iterative structure, 33% (15/46) added an evolutive structure, and 24% (11/46) were associated with a parallel process. Only 12 out of 46 (26%) frameworks covered the continuum of steps and 12 (26%) relied on the three paradigms.

CONCLUSIONS

To date, 46 frameworks of BIT validation and surveillance coexist, besides the classic FDA five-phase drug development model, without the predominance of one of them or convergence in a consensual model. Their number has increased exponentially in the last three decades. Three dangerous scenarios are possible: (1) anarchic continuous development of BITs that depend on companies amalgamating health benefits and usability (ie, user experience, data security, and ergonomics) and limiting implementation to several countries; (2) the movement toward the type of framework for drug evaluation centered on establishing its effectiveness before marketing authorization to guarantee its safety for users, which is heavy and costly; and (3) the implementation of a framework reliant on big data analysis based on a posteriori research and an autoregulation of a market, but that does not address the safety risk for the health user, as the market will not regulate safety or efficacy issues. This paper recommends convergence toward an international validation and surveillance framework based on the specificities of BITs, not equivalent to medical devices, to guarantee their effectiveness and safety for users.

User-Centered Development of an Online Platform for Drug Dosing Recommendations in Pediatrics

BACKGROUND

Drug therapy in pediatric patients is a complex process. Children are subject to continuous growth and variation in drug-metabolizing enzyme activity, requiring continuous adaption of dosages. In Germany, currently no publicly available database exists that provides evidence-based information on drug dosages in pediatrics. For local drug dosing support, a prototype database has been developed within the Children's Hospital, Erlangen. A user-centered development process was initiated to establish an online platform for evidence-based dosing recommendations, as well as pharmacological and pharmaceutical drug information in pediatrics.

OBJECTIVES

The objectives of the study were to survey the demand for such a platform and to assess the usability of the different versions of the developed system.

METHODS

The developed prototype was evaluated in a pluralistic walkthrough with prospective end users. After a redesign, the second prototype of the online platform underwent an online usability testing based on a tailored questionnaire and the System Usability Scale (SUS) (n = 12).

RESULTS

Eleven of 12 participants expressed a demand for an online platform for pediatric dosing recommendations. The majority of the participants requested the integration of extended features, such as drug-drug interaction alerts, or information on adverse effects, pharmacokinetics, and pharmacodynamics. Particularly noteworthy is the demand for an online calculator; 5 of a total of 15 participants explicitly requested a calculator for dosages (based on age, weight, body surface) and glomerular filtration rate. The usability of the second prototype was rated "good to excellent" with a median SUS of 81.25.

CONCLUSION

Local domain experts demand an online platform for pediatric dosing recommendations. The application of the user-centered design approach enabled the development of a prototype suitable for practical use. Multiple additional required functionalities have been identified, whereby the importance of an online calculator for patient-individual dosing recommendations was particularly emphasized.

Human Factors and Usability for Health Information Technology: Old and New Challenges

OBJECTIVES

Despite national mandates, incentives, and other programs, the design of health information technology (IT) remains problematic and usability problems continue to be reported. This paper reviews recent literature on human factors and usability of health IT, with a specific focus on research aimed at applying human factors methods and principles to improve the actual design of health IT, its use, and associated patient and clinician outcomes.

METHODS

We reviewed recent literature on human factors and usability problems of health IT and research on human-centered design of health IT for clinicians and patients.

RESULTS

Studies continue to show usability problems of health IT experienced by multiple groups of health care professionals (e.g., physicians and nurses) as well as patients. Recent research shows that usability is influenced by both designers (e.g., IT vendors) and implementers in health care organizations, and that the application of human-centered design practices needs to be further improved and extended. We welcome emerging research on the design of health IT for teams as team-based care is increasingly implemented throughout health care.

CONCLUSIONS

Progress in the application of human factors methods and principles to the design of health IT is occurring, with important information provided on their actual impact on care processes and patient outcomes. Future research should examine the work of health IT designers and implementers, which would help to develop strategies for further embedding human factors engineering in IT design processes.

A User-Centered design and usability testing of a web-based medication reconciliation application integrated in an eHealth network

BACKGROUND

Medication discrepancies, which are a threat to patient safety, can be reduced by medication reconciliation (MedRec). MedRec is a complex process that can be supported by the use of information technology and patient engagement. Therefore, the SEAMPAT project aims to develop a MedRec IT platform based on two applications. The application for the professionals is called: the "MedRec app".

OBJECTIVE

In the present study, we aimed to describe the development and usability testing of the MedRec app, reporting results of a three iterations user-centered usability evaluation.

METHODS

We used a three phase iterative user-centered study spread over 16 months. At each phase, the usability evaluation included several methods (observations, questionnaires, and follow-up discussions with participants) to collect quantitative and qualitative data in order to improve the current prototype and evolve to the next prototype.

RESULTS

In total, 48 healthcare professionals (25 general practitioners and 23 hospital clinicians) participated to the MedRec app evaluation. There were 14, 32 and 5 participants for phases 1, 2 and 3 respectively. At each phase, many design modifications were done to strengthen usability. Concerning usability, participants considered the prototypes as an acceptable interface with a median System Usability Score of 73 at phase 2 and 75 at phase 3. Participants emphasized the need for improvements concerning workflow integration, usefulness and interoperability.

CONCLUSION

The MedRec app was perceived as being useful, usable and satisfying. However, further improvements are required in several usability aspects. Our study demonstrates the importance of conducting usability assessments before investing time and resources in a large study evaluating the effect of an eMedRec approach on clinical outcomes. Our findings may also increase the chances of acceptability and sustained use over time by clinicians.

Moving beyond static survivorship care plans: A systems engineering approach to population health management for cancer survivors

The American cancer survivor population is ever-growing, with necessary follow-up primarily accomplished in a high-touch fashion-adding to unsustainability and fragmentation of care. Given the complexities of the health care system processes needed to support survivorship, engineering approaches may best address performance deficits and facilitate the provision of patient-centered care. Such collaboration between health care and engineering is recommended for redesigning health care delivery systems. By using Systems Engineering Initiative for Patient Safety (SEIPS), a systems engineering model widely used to improve health care quality and delivery, the authors examine the work system to identify the barriers and facilitators to necessary care in the presence of a survivorship care plan and visit. Recommendations for future improvement include ensuring that care-planning processes are dynamic, clearly assigned, resilient, and integrated with electronic health record systems.