Towards Usable E-Health. A Systematic Review of Usability Questionnaires

Usability testing of the Set Brave Goals app, a continence goal-selection app for children with spina bifida

INTRODUCTION

The Set Brave Goals app is the first digital health app (DHA) aimed at helping children with spina bifida (SB) aged 8-17 years old to select and track their urinary and fecal continence goals. Developed by children, parents, providers and researchers, its usability, or appropriateness to a purpose ("user-friendliness"), remains unknown. In an alpha testing stage, our aim was to determine the usability of the app prior to clinical use.

METHODS

We recruited children with SB and their parents in clinic and via social media. A recruitment goal of 10 children exceeded industry standard of 5 participants (10 participants are expected to identify approximately 96% of usability problems). Participants downloaded and used the app for a week. They completed a questionnaire, including the System Usability Scale (SUS) and closed and open-ended questions. The SUS is a 10-item validated usability questionnaire most widely used in DHA usability testing (scores range from 0 to 100, 100 representing greatest usability). Median/mean SUS scores for DHAs are 68. Mann-Whitney-U and t-tests were used.

RESULTS

Ten children with SB participated (median age: 14 years old, 6 female, 8 shunted, 8 using bladder catheterizations). Twenty parents participated (17 mothers, median age: 42 years old). Median SUS score was 77.5 for children and 73.8 for parents, corresponding to "good" to "excellent" usability (Summary Figure). There were no significant differences between child/parent scores (p = 0.69) or those for other DHAs (p = 0.11). It took a median 5-10 min to go through the app (2 parents felt it took too much time). All participants felt the app was easy to understand and use (100%). Most participants would recommend it to children and parents (children: 89%, parents: 80%), and believed it would be valuable to children (90%, 75%) and urologists (80%, 80%). Free text responses related to more varied color schemes, keeping free-text notes within the app and more flexible goal/alarm setting. These changes were incorporated into the app.

COMMENT

Usability testing prior to clinical launch identified areas for app improvement. Although this study sample met industry standards, findings are limited by a small group of participants. The app will undergo further refinement during prospective beta testing.

CONCLUSIONS

The Set Brave Goals app for children with SB has acceptable usability parameters. This justifies proceeding with wider use to formalize children's continence goal setting/tracking and testing its value to children with SB and their healthcare providers.

Usability and usefulness of (electronic) patient identification systems-A cross-sectional evaluation in German-speaking radiation oncology departments

PURPOSE

Patient misidentification in radiation oncology (RO) is a significant concern due to the potential harm to patient health and the burden on healthcare systems. Electronic patient identification systems (ePIS) are increasingly being used as an alternative or supplement to organizational systems (oPIS). The objective of this study was to assess the usability and usefulness of ePIS and oPIS in German-speaking countries.

METHODS

A cross-sectional survey was designed by a group of experts from various professional backgrounds in RO. The survey consisted of 38 questions encompassing quantitative and qualitative data on usability, user experience, and usefulness of PIS. It was available between August and October 2022.

RESULTS

Of 118 eligible participants, 37% had implemented some kind of ePIS. Overall, 22% of participants who use an oPIS vs. 10% of participants who use an ePIS reported adverse events in terms of patients' misidentification in the past 5 years. Frequent or very frequent drop-outs of electronic systems were reported by 31% of ePIS users. Users of ePIS significantly more often affirmed a positive cost-benefit ratio of ePIS as well as an improvement of workflow, whereas users of oPIS more frequently apprehended a decrease in staffs' attention through ePIS. The response rate was 8%.

CONCLUSION

The implementation of ePIS can contribute to efficient PI and improved processes. Apprehensions by oPIS users and assessments of ePIS users differ significantly in aspects of the perceived usefulness of ePIS. However, technical problems need to be addressed to ensure the reliability of ePIS. Further research is needed to assess the impact of different PIS on patient safety in RO.

Codesigning an E-Health Intervention for Surgery Preparation and Recovery

Surgery is a significant part of healthcare, but its demand is increasing, leading to challenges in managing patient care. Inefficient perioperative practices and traditional linear models contribute to adverse outcomes and patient anxiety. E-health interventions show promise in improving surgical care, but more research is needed. The purpose of this study was to involve patients and healthcare workers during the design phase of an e-health intervention that aims to support the perioperative care of elective surgery preparation and recovery. This study used an Information Systems Research Framework to guide collaborative codesign through semistructured interviews and cocreation workshops. Semistructured interviews collected insights on the perioperative journey and e-health needs from healthcare workers and consumers, resulting in the creation of a patient surgery journey map, experience map, and a stakeholder needs table. Collaborative work between consumers and healthcare workers in the cocreation workshops identified priority perioperative journey issues and proposed solutions, as well as prioritizing application software needs, guiding the development of the wireframe. The development of an e-health application aimed at supporting surgery preparation and recovery is a significant step toward improving patient engagement, satisfaction, and postsurgical health outcomes.

Evaluating the Usability of the Wellness School Assessment Tool Whole School, Whole Community, Whole Child (WellSAT WSCC): A School Wellness Policy Assessment Tool

BACKGROUND

Adoption of the Whole School, Whole Community, Whole Child (WSCC) model has been slowed by a lack of available tools to support implementation. The Wellness School Assessment Tool (WellSAT) WSCC is an online assessment tool that allows schools to evaluate the alignment of their policies with the WSCC model. This study assesses the usability of the WellSAT WSCC.

METHODS

Using a convergent mixed methods design, we collected qualitative and quantitative data from 5 school-based participants with roles in development and evaluation of policy. Participants explored the platform while engaging in a think-aloud procedure and scored a sample policy using the platform. They also completed the System Usability Scale and responded to open-ended questions about the usability of the platform.

RESULTS

Participants rated the WellSAT WSCC as an above-average user experience, but data suggested several areas for improvement, including improved instructions, enhanced visual design of the platform, and guidance for subsequent policy changes.

CONCLUSION

The WellSAT WSCC provides an above-average user experience but can be improved to increase user experience. These improvements increase the potential for greater use to facilitate integration of the WSCC model into school policy.

Utility and usability of a wearable system and progressive-challenge cued exercise program for encouraging use of the more involved arm at-home after stroke-a feasibility study with case reports

BACKGROUND

Understanding the role of adherence to home exercise programs for survivors of stroke is critical to ensure patients perform prescribed exercises and maximize effectiveness of recovery.

METHODS

Survivors of hemiparetic stroke with impaired motor function were recruited into a 7-day study designed to test the utility and usability of a low-cost wearable system and progressive-challenge cued exercise program for encouraging graded-challenge exercise at-home. The wearable system comprised two wrist-worn MetaMotionR+ activity monitors and a custom smartphone app. The progressive-challenge cued exercise program included high-intensity activities (one repetition every 30 s) dosed at 1.5 h per day, embedded within 8 h of passive activity monitoring per day. Utility was assessed using measures of system uptime and cue response rate. Usability and user experience were assessed using well-validated quantitative surveys of system usability and user experience. Self-efficacy was assessed at the end of each day on a visual analog scale that ranged from 0 to 100.

RESULTS

The system and exercise program had objective utility: system uptime was 92 ± 6.9% of intended hours and the rate of successful cue delivery was 99 ± 2.7%. The system and program also were effective in motivating cued exercise: activity was detected within 5-s of the cue 98 ± 3.1% of the time. As shown via two case studies, accelerometry data can accurately reflect graded-challenge exercise instructions and reveal differentiable activity levels across exercise stages. User experience surveys indicated positive overall usability in the home settings, strong levels of personal motivation to use the system, and high degrees of satisfaction with the devices and provided training. Self-efficacy assessments indicated a strong perception of proficiency across participants (95 ± 5.0).

CONCLUSIONS

This study demonstrates that a low-cost wearable system providing frequent haptic cues to encourage graded-challenge exercise after stroke can have utility and can provide an overall positive user experience in home settings. The study also demonstrates how combining a graded exercise program with all-day activity monitoring can provide insight into the potential for wearable systems to assess adherence to-and effectiveness of-home-based exercise programs on an individualized basis.

A Physical Activity and Diet Just-in-Time Adaptive Intervention to Reduce Blood Pressure: The myBPmyLife Study Rationale and Design

BACKGROUND

Smartphone applications and wearable devices are promising mobile health interventions for hypertension self-management. However, most mobile health interventions fail to use contextual data, potentially diminishing their impact. The myBPmyLife Study is a just-in-time adaptive intervention designed to promote personalized self-management for patients with hypertension.

METHODS AND RESULTS

The study is a 6-month prospective, randomized-controlled, remotely administered trial. Participants were recruited from the University of Michigan Health in Ann Arbor, Michigan or the Hamilton Community Health Network, a federally qualified health center network in Flint, Michigan. Participants were randomized to a mobile application with a just-in-time adaptive intervention promoting physical activity and lower-sodium food choices as well as weekly goal setting or usual care. The mobile study application encourages goal attainment through a central visualization displaying participants' progress toward their goals for physical activity and lower-sodium food choices. Participants in both groups are followed for up for 6 months with a primary end point of change in systolic blood pressure. Exploratory analyses will examine the impact of notifications on step count and self-reported lower-sodium food choices. The study launched on December 9, 2021, with 484 participants enrolled as of March 31, 2023. Enrollment of participants was completed on July 3, 2023. After 6 months of follow-up, it is expected that results will be available in the spring of 2024.

CONCLUSIONS

The myBPmyLife study is an innovative mobile health trial designed to evaluate the effects of a just-in-time adaptive intervention focused on improving physical activity and dietary sodium intake on blood pressure in diverse patients with hypertension.

REGISTRATION

URL: https://www.clinicaltrials.gov; Unique identifier: NCT05154929.

Evaluation of Endo 10 mobile application as diagnostic tool in endodontics

Background

Endodontic diagnosis can be compared to a puzzle, requiring the interpretation of a series of clinical and imaging data. Mobile health, especially mobile application (apps), can assist professionals in endodontic diagnosis. This work aims to evaluate an app - Endo 10 app, designed to assist pulpal and periapical diagnosis based on the patient's signs and symptoms and radiographic data.

Material and Methods

A total of 41 dental students and dentists with different levels of expertise (10 multi-specialty clinic professors, 17 residents in endodontics and 14 dental students) were included. The System Usability Scale (SUS) was used to evaluate usability and the Davis' technology acceptance model was used to evaluate usefulness of Endo 10 app. The Mann-Whitney test was performed to compare SUS scores between professors and undergraduate dental students and to compare questions 6 and 7 of the utility test and verify whether participants who understood that the technology was useful also better understood the concepts of endodontic diagnosis. The agreement between professor's diagnosis with the app and professor without the app, and between professor and residents in endodontics with the app were evaluated.

Results

The SUS score at the 50th percentile was 77.5, graded as acceptable. No significant difference was observed in the SUS scores when analyzing professors and dental students separately (p = 0.442). Usefulness test showed positive responses ranging between 72% - 100%. No statistically significant difference was observed between questions 6 and 7 of the utility test (p = 0.206), indicating that the group of participants who understood that the technology was useful in endodontic diagnosis was associated with the agreement that the application helped to better understand the concepts related. The diagnosis agreement between professor in the common diagnosis process and professor with app was 100% (31) of cases. The concordance between professor and residents in endodontics with the app was 71% (22) of cases. The differences were associated with resident's misinterpreting the patient's data.

Conclusions

The Endo 10 app reached the usability and usefulness requirements. It proved accurate in diagnosing pulpal and periapical pathologies. Key words:Dental education, endodontics, diagnosis, smartphone, dental informatics.

eHealth in Geriatric Rehabilitation: An International Survey of the Experiences and Needs of Healthcare Professionals

While eHealth can help improve outcomes for older patients receiving geriatric rehabilitation, the implementation and integration of eHealth is often complex and time-consuming. To use eHealth effectively in geriatric rehabilitation, it is essential to understand the experiences and needs of healthcare professionals. In this international multicentre cross-sectional study, we used a web-based survey to explore the use, benefits, feasibility and usability of eHealth in geriatric rehabilitation settings, together with the needs of working healthcare professionals. Descriptive statistics were used to summarize quantitative findings. The survey was completed by 513 healthcare professionals from 16 countries. Over half had experience with eHealth, although very few (52 of 263 = 20%) integrated eHealth into daily practice. Important barriers to the use or implementation of eHealth included insufficient resources, lack of an organization-wide implementation strategy and lack of knowledge. Professionals felt that eHealth is more complex for patients than for themselves, and also expressed a need for reliable information concerning available eHealth interventions and their applications. While eHealth has clear benefits, important barriers hinder successful implementation and integration into healthcare. Tailored implementation strategies and reliable information on effective eHealth applications are needed to overcome these barriers.

Rationale and development of an e-health application to deliver patient-centered care during treatment for recently diagnosed multiple myeloma patients: pilot study of the MM E-coach

BACKGROUND

Patients with multiple myeloma (MM) increasingly face complicated treatment regimens. E-health may support patients and healthcare providers in enhancing a patient-centered healthcare approach. Therefore, we aimed to develop a patient-centered multi-modality e-health application, to assess the application for usability and end-user experiences.

METHODS

The application was developed following an iterative "action-based" methodology using the design thinking approach. Key end users participated, and relevant stakeholders were consulted in the development process. First, the care pathway was evaluated, the focus of development was determined, and a solution ideated during recurring multidisciplinary meetings. Second, a prototype was tested and improved. Third, a subsequent prototype was evaluated during a pilot study with patients and healthcare professionals on usability, usage, and experiences.

RESULTS

The multi-modality application, named the "MM E-coach," consisted of a newly developed medication module, patient-reported outcome (PRO) questionnaire assessments, a messaging service, alerts, information provision, and a personal care plan. The median system usability score was 60 on a scale of 0-100. Patients appreciated the medication overview, healthcare professionals appreciated the outpatient clinic preparation module, and both appreciated the messaging service. Additional recommendations for improvement mostly revolved around the flexibility of functionalities and look and feel of the application.

CONCLUSIONS

The MM E-coach has the potential to provide patient-centered care by supporting patients and caregivers during MM treatment and is a promising application to be implemented in the MM care pathway. A randomized clinical trial was initiated to study its clinical effectiveness.

Quality, Usability, and Effectiveness of mHealth Apps and the Role of Artificial Intelligence: Current Scenario and Challenges

The use of artificial intelligence (AI) and big data in medicine has increased in recent years. Indeed, the use of AI in mobile health (mHealth) apps could considerably assist both individuals and health care professionals in the prevention and management of chronic diseases, in a person-centered manner. Nonetheless, there are several challenges that must be overcome to provide high-quality, usable, and effective mHealth apps. Here, we review the rationale and guidelines for the implementation of mHealth apps and the challenges regarding quality, usability, and user engagement and behavior change, with a special focus on the prevention and management of noncommunicable diseases. We suggest that a cocreation-based framework is the best method to address these challenges. Finally, we describe the current and future roles of AI in improving personalized medicine and provide recommendations for developing AI-based mHealth apps. We conclude that the implementation of AI and mHealth apps for routine clinical practice and remote health care will not be feasible until we overcome the main challenges regarding data privacy and security, quality assessment, and the reproducibility and uncertainty of AI results. Moreover, there is a lack of both standardized methods to measure the clinical outcomes of mHealth apps and techniques to encourage user engagement and behavior changes in the long term. We expect that in the near future, these obstacles will be overcome and that the ongoing European project, Watching the risk factors (WARIFA), will provide considerable advances in the implementation of AI-based mHealth apps for disease prevention and health promotion.

System Integrated Digital Empowering and teleRehabilitation to promote patient Activation and well-Being in chronic disabilities: A usability and acceptability study

Introduction

Telerehabilitation systems represent a promising way for the management of chronic disability, delivering technology-enabled rehabilitation outside the hospital setting. However, usability and acceptability assessment with users represents a critical starting point when using digital healthcare solutions. This study aims at evaluating the user experience with a Telerehabilitation system (SIDERA^∧B) from the end-user side.

Methods

SIDERA^∧B consists of an asynchronous delivery of rehabilitation activities through multimedia digital contents and tele-monitoring of vital parameters with technological devices for individualized, home-based management of chronic conditions. Usability (with the System Usability Scale, SUS) and acceptability (using the Technology Acceptance Model, TAM - and The Service User Technology Acceptance Questionnaire, SUTAQ) data were analyzed from the dataset of the SIDERA^∧B project (N = 112 patients with Chronic Heart Failure, Parkinson's Disease and Chronic Obstructive Pulmonary Disease). The possible influence of five external factors (i.e., technological expertise, education, sex, age, and level of disability) on TAM domains was tested using Spearman's Correlation analysis.

Results

Results showed a satisfactory level of technological usability (SUS Median = 77.5) and good scores in usability and learnability SUS subdomains (mean scores > 2.5). Regarding technological acceptability, participants showed high scores (Median > 4) in "Behavioral Intention", "Perceived Usefulness", and "Perceived Ease of Use" TAM domains. Finally, results from the SUTAQ scale highlighted that the SIDERA^∧B system obtained optimal scores in all domains, especially in "Increased accessibility," "Care personnel concerns," and "Satisfaction." Age (rho = -0.291, p = 0.002) and disability level (WHODAS Total score: rho = -0.218, p = 0.021) were the two external factors inversely associated with the Perceived Ease of Use.

Discussion

The age of digital transformation requires everyone to understand, accept and master the changes affecting modern-day healthcare. The usability and acceptability of the SIDERA^∧B system were high across all end-users, despite the medium-low level of the technological expertise of the sample. These findings support the efficiency and the suitability of these digital solutions in the modern digital age transition of rehabilitation from inside to outside the clinic.

Fact or Fiction? The Development and Evaluation of a Tobacco Virtual Health Tool

The virtual setting is an important setting for health promotion as individuals increasingly go online for health information and support. Yet, users can have difficulty finding valid, trustworthy, and user-friendly health information online. In 2022, we launched an interactive Fact or Fiction Tobacco virtual health tool. The virtual health tool uses evidence-informed tailored content to engage users and refer them to local tobacco cessation resources. The present paper describes the development, user testing, and evaluation of this tool. The Fact or Fiction virtual health tool was designed by tobacco cessation and health marketing experts and informed by health behaviour theories of change. The tool captures data on who is seeking health information, the user's stage of readiness to quit tobacco products, and whether they act by accessing referred resources. In 2021, we conducted two phases of user testing prior to marketing the tool publicly. After 7 weeks of marketing, we collected data on user interactions with the tool and evaluated the reach of the tool. Results from user testing found the tool to be engaging, easy to use, and quick to complete. Adaptations were made to simplify and condense text and include additional animations. During the first seven weeks of the tool being live, it reached 2306 users, and 38.7% of those users were current or occasional tobacco users. Users were classified based on their intention to quit. Bivariate analysis found that the tool was successful in driving tobacco users towards action as 21.2% tobacco users who were looking to quit and 8.8% of tobacco users who were not looking to quit clicked on local tobacco cessation resources. This virtual health tool is reaching the targeted population and providing tailored information needed at each stage of the continuum of health behaviour change. Among tobacco users looking to quit, this virtual health tool acts as a quick referral to local tobacco cessation resources.

Usability Evaluation of Dashboards: A Systematic Literature Review of Tools

Introduction

In recent years, the use of dashboards in healthcare has been considered an effective approach for the visual presentation of information to support clinical and administrative decisions. Effective and efficient use of dashboards in clinical and managerial processes requires a framework for the design and development of tools based on usability principles.

Objectives

The present study is aimed at investigating the existing questionnaires used for the usability evaluation framework of dashboards and at presenting more specific usability criteria for evaluating dashboards.

Methods

This systematic review was conducted using PubMed, Web of Science, and Scopus, without any time restrictions. The final search of articles was performed on September 2, 2022. Data collection was performed using a data extraction form, and the content of selected studies was analyzed based on the dashboard usability criteria.

Results

After reviewing the full text of relevant articles, a total of 29 studies were selected according to the inclusion criteria. Regarding the questionnaires used in the selected studies, researcher-made questionnaires were used in five studies, while 25 studies applied previously used questionnaires. The most widely used questionnaires were the System Usability Scale (SUS), Technology Acceptance Model (TAM), Situation Awareness Rating Technique (SART), Questionnaire for User Interaction Satisfaction (QUIS), Unified Theory of Acceptance and Use of Technology (UTAUT), and Health Information Technology Usability Evaluation Scale (Health-ITUES), respectively. Finally, dashboard evaluation criteria, including usefulness, operability, learnability, ease of use, suitability for tasks, improvement of situational awareness, satisfaction, user interface, content, and system capabilities, were suggested.

Conclusion

General questionnaires that were not specifically designed for dashboard evaluation were mainly used in reviewed studies. The current study suggested specific criteria for measuring the usability of dashboards. When selecting the usability evaluation criteria for dashboards, it is important to pay attention to the evaluation objectives, dashboard features and capabilities, and context of use.

Workflow assessment of an augmented reality application for planning of perforator flaps in plastic reconstructive surgery: Game or game changer?

Objective

In contrast to the rising amount of financial investments for research and development in medical technology worldwide is the lack of usability and clinical readiness of the produced systems. We evaluated an augmented reality (AR) setup under development for preoperative perforator vessel mapping for elective autologous breast reconstruction.

Methods

In this grant-supported research pilot, we used magnetic resonance angiography data (MR-A) of the trunk to superimpose the scans on the corresponding patients with hands-free AR goggles to identify regions-of-interest for surgical planning. Perforator location was assessed using MR-A imaging (MR-A projection) and Doppler ultrasound data (3D distance) and confirmed intraoperatively in all cases. We evaluated usability (System Usability Scale, SUS), data transfer load and documented personnel hours for software development, correlation of image data, as well as processing duration to clinical readiness (time from MR-A to AR projections per scan).

Results

All perforator locations were confirmed intraoperatively, and we found a strong correlation between MR-A projection and 3D distance measurements (Spearman r = 0.894). The overall usability (SUS) was 67 ± 10 (=moderate to good). The presented setup for AR projections took 173 min to clinical readiness (=availability on AR device per patient).

Conclusion

In this pilot, we calculated development investments based on project-approved grant-funded personnel hours with a moderate to good usability outcome resulting from some limitations: assessment was based on one-time testing with no previous training, a time lag of AR visualizations on the body and difficulties in spatial AR orientation. The use of AR systems can provide new opportunities for future surgical planning, but has more potential for educational (e.g., patient information) or training purposes of medical under- and postgraduates (spatial recognition of imaging data associated with anatomical structures and operative planning). We expect future usability improvements with refined user interfaces, faster AR hardware and artificial intelligence-enhanced visualization techniques.

Piloting of the virtual telecare technology 'Addison Care' to promote self-management in persons with chronic diseases in a community setting: protocol for a mixed-methods user experience, user engagement and usability pilot study

INTRODUCTION

Chronic diseases in older adults are one of the major epidemiological challenges of current times and leading cause of disability, poor quality of life, high healthcare costs and death. Self-management of chronic diseases is essential to improve health behaviours and health outcomes. Technology-assisted interventions have shown to improve self-management of chronic diseases. Virtual avatars can be a key factor for the acceptance of these technologies. Addison Care is a home-based telecare solution equipped with a virtual avatar named Addison, connecting older persons with their caregivers via an easy-to-use technology. A central advantage is that Addison Care provides access to self-management support for an up-to-now highly under-represented population-older persons with chronic disease(s), which enables them to profit from e-health in everyday life.

METHODS AND ANALYSIS

A pragmatic, non-randomised, one-arm pilot study applying an embedded mixed-methods approach will be conducted to examine user experience, usability and user engagement of the virtual avatar Addison. Participants will be at least 65 years and will be recruited between September 2022 and November 2022 from hospitals during the discharge process to home care. Standardised instruments, such as the User Experience Questionnaire, System Usability Scale, Instrumental Activities of Daily Living scale, Short-Form-8-Questionnaire, UCLA Loneliness Scale, Geriatric Depression Scale, Stendal Adherence with Medication Score and Self-Efficacy for Managing Chronic Diseases Scale, as well as survey-based assessments, semistructured interviews and think-aloud protocols, will be used. The study seeks to enrol 20 patients that meet the criteria.

ETHICS AND DISSEMINATION

The study protocol has been approved by the ethic committee of the German Society for Nursing Science (21-037). The results are intended to be published in peer-reviewed journals and disseminated through conference papers.

TRIAL REGISTRATION NUMBER

DRKS00025992.

Usability Methods and Attributes Reported in Usability Studies of Mobile Apps for Health Care Education: Scoping Review

BACKGROUND

Mobile devices can provide extendable learning environments in higher education and motivate students to engage in adaptive and collaborative learning. Developers must design mobile apps that are practical, effective, and easy to use, and usability testing is essential for understanding how mobile apps meet users' needs. No previous reviews have investigated the usability of mobile apps developed for health care education.

OBJECTIVE

The aim of this scoping review is to identify usability methods and attributes in usability studies of mobile apps for health care education.

METHODS

A comprehensive search was carried out in 10 databases, reference lists, and gray literature. Studies were included if they dealt with health care students and usability of mobile apps for learning. Frequencies and percentages were used to present the nominal data, together with tables and graphical illustrations. Examples include a figure of the study selection process, an illustration of the frequency of inquiry usability evaluation and data collection methods, and an overview of the distribution of the identified usability attributes. We followed the Arksey and O'Malley framework for scoping reviews.

RESULTS

Our scoping review collated 88 articles involving 98 studies, mainly related to medical and nursing students. The studies were conducted from 22 countries and were published between 2008 and 2021. Field testing was the main usability experiment used, and the usability evaluation methods were either inquiry-based or based on user testing. Inquiry methods were predominantly used: 1-group design (46/98, 47%), control group design (12/98, 12%), randomized controlled trials (12/98, 12%), mixed methods (12/98, 12%), and qualitative methods (11/98, 11%). User testing methods applied were all think aloud (5/98, 5%). A total of 17 usability attributes were identified; of these, satisfaction, usefulness, ease of use, learning performance, and learnability were reported most frequently. The most frequently used data collection method was questionnaires (83/98, 85%), but only 19% (19/98) of studies used a psychometrically tested usability questionnaire. Other data collection methods included focus group interviews, knowledge and task performance testing, and user data collected from apps, interviews, written qualitative reflections, and observations. Most of the included studies used more than one data collection method.

CONCLUSIONS

Experimental designs were the most commonly used methods for evaluating usability, and most studies used field testing. Questionnaires were frequently used for data collection, although few studies used psychometrically tested questionnaires. The usability attributes identified most often were satisfaction, usefulness, and ease of use. The results indicate that combining different usability evaluation methods, incorporating both subjective and objective usability measures, and specifying which usability attributes to test seem advantageous. The results can support the planning and conduct of future usability studies for the advancement of mobile learning apps in health care education.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/19072.

Usability evaluation of the Computer-Based Health Evaluation System (CHES) eDiary for patients with faecal incontinence: a pilot study

Background

Faecal incontinence (FI) is prevalent in 15–20% of elderly individuals and is frequently monitored in clinical trials and practice. Bowel diaries are the most common way to document FI, but, in clinical practice, are mainly used as paper-based versions. Electronic diaries (eDiaries) offer many potential benefits over paper-based diaries. The aim of this study was to develop and test an eDiary to document FI.

Methods

We migrated a paper FI diary to an eDiary app based on the Computer-based Health Evaluation System (CHES). To assess usability, we conducted functionality and usability tests at two time points in a sample of patients with FI. In the first assessment, the eDiary functionalities were tested, patients completed the System Usability Scale (SUS, range 0–100) and compared the paper diary with the eDiary. We set a threshold for minimum acceptable average usability at 70 points. Patients were then instructed to use the eDiary for 2 days at home and contacted to report on their usage and completed the SUS a second time.

Results

We recruited a sample of N = 14 patients to use the eDiary. All patients were able to use all functionalities of the eDiary and only a few patients with lower technological literacy or access to devices (n = 3) needed initial assistance. The mean usability rating given at the first time point was high with 88 points (SD 18, 95% CI 78.2–96.8) and most patients (n = 10) reported they would prefer the eDiary over the paper-based version. Nine patients (n = 9) participated in the follow-up assessment and the mean SUS rating at the second time point was 97 points (SD 7, 95% CI 92.8–100).

Conclusion

The eDiary showed excellent usability scores for the assessment of FI at both assessments. Generally, patients preferred the eDiary over the paper-based version. We recommend the eDiary for usage with patients who own and use a smartphone and discuss potential solutions for patients with lower technological literacy or access.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12911-022-01818-5.

Usability Testing and Technology Acceptance of an mHealth App at the Point of Care During Simulated Pediatric In- and Out-of-Hospital Cardiopulmonary Resuscitations: Study Nested Within 2 Multicenter Randomized Controlled Trials

BACKGROUND

Mobile apps are increasingly being used in various domains of medicine. Few are evidence-based, and their benefits can only be achieved if end users intend to adopt and use them. To date, only a small fraction of mobile apps have published data on their field usability and end user acceptance results, especially in emergency medicine.

OBJECTIVE

This study aims to determine the usability and acceptance of an evidence-based mobile app while safely preparing emergency drugs at the point of care during pediatric in- and out-of-hospital cardiopulmonary resuscitations by frontline caregivers.

METHODS

In 2 multicenter randomized controlled parent trials conducted at 6 pediatric emergency departments from March 1 to December 31, 2017, and 14 emergency medical services from September 3, 2019, to January 21, 2020, the usability and technology acceptance of the PedAMINES (Pediatric Accurate Medication in Emergency Situations) app were evaluated among skilled pediatric emergency nurses and advanced paramedics when preparing continuous infusions of vasoactive drugs and direct intravenous emergency drugs at pediatric dosages during standardized, simulation-based, pediatric in- and out-of-hospital cardiac arrest scenarios, respectively. Usability was measured using the 10-item System Usability Scale. A 26-item technology acceptance self-administered survey (5-point Likert-type scales), adapted from the Unified Theory of Acceptance and Use of Technology model, was used to measure app acceptance and intention to use.

RESULTS

All 100% (128/128) of nurses (crossover trial) and 49.3% (74/150) of paramedics (parallel trial) were assigned to the mobile app. Mean total scores on the System Usability Scale were excellent and reached 89.5 (SD 8.8; 95% CI 88.0-91.1) for nurses and 89.7 (SD 8.7; 95% CI 87.7-91.7) for paramedics. Acceptance of the technology was very good and rated on average >4.5/5 for 5 of the 8 independent constructs evaluated. Only the image construct scored between 3.2 and 3.5 by both participant populations.

CONCLUSIONS

The results provide evidence that dedicated mobile apps can be easy to use and highly accepted at the point of care during in- and out-of-hospital cardiopulmonary resuscitations by frontline emergency caregivers. These findings can contribute to the implementation and valorization of studies aimed at evaluating the usability and acceptance of mobile apps in the field by caregivers, even in critical situations.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03021122; https://clinicaltrials.gov/ct2/show/NCT03021122. ClinicalTrials.gov NCT03921346; https://clinicaltrials.gov/ct2/show/NCT03921346.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.1186/s13063-019-3726-4.

Improving usability benchmarking for the eHealth domain: The development of the eHealth UsaBility Benchmarking instrument (HUBBI)

Background

Currently, most usability benchmarking tools used within the eHealth domain are based on re-classifications of old usability frameworks or generic usability surveys. This makes them outdated and not well suited for the eHealth domain. Recently, a new ontology of usability factors was developed for the eHealth domain. It consists of eight categories: Basic System Performance (BSP), Task-Technology Fit (TTF), Accessibility (ACC), Interface Design (ID), Navigation & Structure (NS), Information & Terminology (IT), Guidance & Support (GS) and Satisfaction (SAT).

Objective

The goal of this study is to develop a new usability benchmarking tool for eHealth, the eHealth UsaBility Benchmarking Instrument (HUBBI), that is based on a new ontology of usability factors for eHealth.

Methods

First, a large item pool was generated containing 66 items. Then, an online usability test was conducted, using the case study of a Dutch website for general health advice. Participants had to perform three tasks on the website, after which they completed the HUBBI. Using Partial Least Squares Structural Equation Modelling (PLS-SEM), we identified the items that assess each factor best and that, together, make up the HUBBI.

Results

A total of 148 persons participated. Our selection of items resulted in a shortened version of the HUBBI, containing 18 items. The category Accessibility is not included in the final version, due to the wide range of eHealth services and their heterogeneous populations. This creates a constantly different role of Accessibility, which is a problem for a uniform benchmarking tool.,

Conclusions

The HUBBI is a new and comprehensive usability benchmarking tool for the eHealth domain. It assesses usability on seven domains (BSP, TTF, ID, NS, IT, GS, SAT) in which a score per domain is generated. This can help eHealth developers to quickly determine which areas of the eHealth system’s usability need to be optimized.

Technology Acceptance of Home-Based Cardiac Telerehabilitation Programs in Patients With Coronary Heart Disease: Systematic Scoping Review

Background

An understanding of the technology acceptance of home-based cardiac telerehabilitation programs is paramount if they are to be designed and delivered to target the needs and preferences of patients with coronary heart disease; however, the current state of technology acceptance of home-based cardiac telerehabilitation has not been systematically evaluated in the literature.

Objective

We aimed to provide a comprehensive summary of home-based cardiac telerehabilitation technology acceptance in terms of (1) the timing and approaches used and (2) patients’ perspectives on its usability, utility, acceptability, acceptance, and external variables.

Methods

We searched PubMed, CENTRAL, Embase, CINAHL, PsycINFO, and Scopus (inception to July 2021) for English-language papers that reported empirical evidence on the technology acceptance of early-phase home-based cardiac telerehabilitation in patients with coronary heart disease. Content analysis was undertaken.

Results

The search identified 1798 studies, of which 18 studies, with 14 unique home-based cardiac telerehabilitation programs, met eligibility criteria. Technology acceptance (of the home-based cardiac telerehabilitation programs) was mostly evaluated at intra- and posttrial stages using questionnaires (n=10) and usage data (n=11). The least used approach was evaluation through qualitative interviews (n=3). Usability, utility, acceptability, and acceptance were generally favored. External variables that influenced home-based cardiac telerehabilitation usage included component quality, system quality, facilitating conditions, and intrinsic factors.

Conclusions

Home-based cardiac telerehabilitation usability, utility, acceptability, and acceptance were high; yet, a number of external variables influenced acceptance. Findings and recommendations from this review can provide guidance for developing and evaluating patient-centered home-based cardiac telerehabilitation programs to stakeholders and clinicians.

Assessing cognition in people with severe mental disorders in low- and middle-income countries: a systematic review of assessment measures

BACKGROUND

Cognitive difficulties are common in people with severe mental disorders (SMDs) and various measures of cognition are of proven validity. However, there is a lack of systematic evidence regarding the psychometric properties of these measures in low- and middle-income countries (LMICs).

OBJECTIVE

To systematically review the psychometric properties of cognitive measures validated in people with SMDs in LMICs.

METHODS

We conducted a systematic review of the literature by searching from four electronic databases. Two authors independently screened studies for their eligibility. Measurement properties of measures in all included studies were extracted. All eligible measures were assessed against criteria set for clinical and research recommendations. Results are summarized narratively and measures were grouped by measurement type and population.

RESULTS

We identified 23 unique measures from 28 studies. None of these was from low-income settings. Seventeen of the measures were performance-based. The majority (n = 16/23) of the measures were validated in people with schizophrenia. The most commonly reported measurement properties were: known group, convergent, and divergent validity (n = 25/28). For most psychometric property, studies of methodological qualities were found to be doubtful. Among measures evaluated in people with schizophrenia, Brief Assessment of Cognition in Schizophrenia, Cognitive Assessment Interview, MATRICS Consensus Cognitive Battery, and CogState Schizophrenia Battery were with the highest scores for clinical and research recommendation.

CONCLUSIONS

Studies included in our review provide only limited quality evidence and future studies should consider adapting and validating measures using stronger designs and methods. Nonetheless, validated assessments of cognition could help in the management and allocating therapy in people with SMDs in LMICs.

Aliviado Mobile App for Hospice Providers: A Usability Study

CONTEXT

Evaluation of usability and mobile health content is critical for ensuring effective implementation of technology utilizing interventions tailored to the needs of hospice care providers for people living with dementia in community-based settings.

OBJECTIVES

To evaluate the usability, content, and "readiness to launch" of the Aliviado mobile health app for interdisciplinary team members participating in the Hospice Advanced Dementia Symptom Management and Quality of Life.

METHODS

Usability of the Aliviado app was assessed in 86 respondents with an adapted IBM Computer Usability Satisfaction Questionnaire following Hospice Advanced Dementia Symptom Management and Quality of Life training and implementation of the mobile app.

RESULTS

More than half of users receiving training employed the mobile app in practice. Users reported use as: Daily-6.3%, Weekly-39.6%, monthly-54.2%. The highest measured attributes were usefulness, value, and effectiveness. Over 90% deemed the app "ready to launch" with no or minimal problems.

CONCLUSION

This study shows that a newly-developed mobile app is usable and can be successfully adopted for care of people living with dementia.

A mobile application for wound and symptom surveillance after colorectal surgery: a feasibility randomized controlled trial protocol

Background

Surgical site infections (SSIs) are the most common nosocomial infection and occur in 16.3% of patients undergoing colorectal surgery at our institution (The Ottawa Hospital), the majority of which are identified after discharge from hospital. Patients who suspect having an SSI generally present to the emergency department or surgery clinic. Both options for in-person interaction are costly to the health care system and patients. A mobile app, how2trak, has proven to be beneficial for patients with complex wounds at our institution by facilitating at-home monitoring and virtual consultations.

Objective

This study aims to assess the feasibility of a randomized controlled trial to assess if how2trak can improve patients’ experience and increase detection of SSIs after colorectal surgery while reducing patients’ risk of COVID-19 exposure.

Methods

In this single-center prospective feasibility trial, eligible patients undergoing colorectal surgery will be randomized to either standard care or how2trak postoperative monitoring of their incision, symptoms, and ostomy function. Patient self-assessments will be monitored by a nurse specialized in wound and ostomy care who will follow-up with patients with a suspected SSI. The primary outcome is feasibility as measured by enrollment, randomization, app usability, data extraction, and resource capacity.

Results

This study was approved by our institution’s ethics board on February 26, 2021, and received support from The Ottawa Hospital Innovation and Care Funding on November 12, 2021. Recruitment started June 3, 2021, and 29 were patients enrolled as of September 2021. We expect to publish results in spring 2022.

Conclusions

This study will determine the feasibility of using a mobile app to monitor patients’ wounds and detect SSIs after colorectal surgery. If feasible, we plan to assess if this mobile app facilitates SSI detection, enhances patient experience, and optimizes their care.

Trial Registration

ClinicalTrials.gov NCT04869774; https://clinicaltrials.gov/ct2/show/NCT04869774

International Registered Report Identifier (IRRID)

DERR1-10.2196/26717

Sociodemographic Characteristics Associated with an eHealth System Designed to Reduce Depressive Symptoms among Patients with Breast or Prostate Cancer: Prospective Study (Preprint)

Background

eHealth interventions have become a topic of interest in the field of mental health owing to their increased coordination and integration of different elements of care, in treating and preventing mental ill health in patients with somatic illnesses. However, poor usability, learnability, and user engagement might affect the effectiveness of an eHealth intervention. Identifying different sociodemographic characteristics that might be associated with higher perceived usability can help improve the usability of eHealth interventions.

Objective

This study aimed to identify the sociodemographic characteristics that might be associated with the perceived usability of the NEVERMIND (Neurobehavioural Predictive and Personalised Modelling of Depressive Symptoms During Primary Somatic Diseases) eHealth system, comprising a mobile app and a sensorized shirt, in reducing comorbid depressive symptoms in patients with breast or prostate cancer.

Methods

The study included a total of 129 patients diagnosed with breast (n=80, 62%) or prostate (n=49, 38%) cancer, who received a fully automated mobile app and sensorized shirt (NEVERMIND system). Sociodemographic data on age, sex, marital status, education level, and employment status were collected at baseline. Usability outcomes included the System Usability Scale (SUS), a subjective measure that covers different aspects of system usability; the user version of the Mobile App Rating Scale (uMARS), a user experience questionnaire; and a usage index, an indicator calculated from the number of days patients used the NEVERMIND system during the study period.

Results

The analysis was based on 108 patients (n=68, 63%, patients with breast cancer and n=40, 37%, patients with prostate cancer) who used the NEVERMIND system for an average of 12 weeks and completed the study. The overall mean SUS score at 12 weeks was 73.4 (SD 12.5), which indicates that the NEVERMIND system has good usability, with no statistical differences among different sociodemographic characteristics. The global uMARS score was 3.8 (SD 0.3), and women rated the app higher than men (β=.16; P=.03, 95% CI 0.02-0.3), after adjusting for other covariates. No other sociodemographic characteristics were associated with higher uMARS scores. There was a statistical difference in the use of the NEVERMIND system between women and men. Women had significantly lower use (β=–0.13; P=.04, 95% CI −0.25 to −0.01), after adjusting for other covariates.

Conclusions

The findings suggest that the NEVERMIND system has good usability according to the SUS and uMARS scores. There was a higher favorability of mobile apps among women than among men. However, men had significantly higher use of the NEVERMIND system. Despite the small sample size and low variability, there is an indication that the NEVERMIND system does not suffer from the digital divide, where certain sociodemographic characteristics are more associated with higher usability.

Trial Registration

German Clinical Trials Register RKS00013391; https://www.drks.de/drks_web/navigate.do?navigationId=trial.HTML&TRIAL_ID=DRKS00013391

Impact of a Mobile App on Paramedics' Perceived and Physiologic Stress Response During Simulated Prehospital Pediatric Cardiopulmonary Resuscitation: Study Nested Within a Multicenter Randomized Controlled Trial

BACKGROUND

Out-of-hospital cardiac arrests (OHCAs) are stressful, high-stake events that are associated with low survival rates. Acute stress experienced in this situation is associated with lower cardiopulmonary resuscitation performance in calculating drug dosages by emergency medical services. Children are particularly vulnerable to such errors. To date, no app has been validated to specifically support emergency drug preparation by paramedics through reducing the stress level of this procedure and medication errors.

OBJECTIVE

This study aims to determine the effectiveness of an evidence-based mobile app compared with that of the conventional preparation methods in reducing acute stress in paramedics at the psychological and physiological levels while safely preparing emergency drugs during simulated pediatric OHCA scenarios.

METHODS

In a parent, multicenter, randomized controlled trial of 14 emergency medical services, perceived and physiologic stress of advanced paramedics with drug preparation autonomy was assessed during a 20-minute, standardized, fully video-recorded, and highly realistic pediatric OHCA scenario in an 18-month-old child. The primary outcome was participants' self-reported psychological stress perceived during sequential preparations of 4 intravenous emergency drugs (epinephrine, midazolam, 10% dextrose, and sodium bicarbonate) with the support of the PedAMINES (Pediatric Accurate Medication in Emergency Situations) app designed to help pediatric drug preparation (intervention) or conventional methods (control). The State-Trait Anxiety Inventory and Visual Analog Scale questionnaires were used to measure perceived stress. The secondary outcome was physiologic stress, measured by a single continuous measurement of the participants' heart rate with optical photoplethysmography.

RESULTS

From September 3, 2019, to January 21, 2020, 150 advanced paramedics underwent randomization. A total of 74 participants were assigned to the mobile app (intervention group), and 76 did not use the app (control group). A total of 600 drug doses were prepared. Higher State-Trait Anxiety Inventory-perceived stress increase from baseline was observed during the scenario using the conventional methods (mean 35.4, SD 8.2 to mean 49.8, SD 13.2; a 41.3%, 35.0 increase) than when using the app (mean 36.1, SD 8.1 to mean 39.0, SD 8.4; a 12.3%, 29.0 increase). This revealed a 30.1% (95% CI 20.5%-39.8%; P<.001) lower relative change in stress response in participants who used the app. On the Visual Analog Scale questionnaire, participants in the control group reported a higher increase in stress at the peak of the scenario (mean 7.1, SD 1.8 vs mean 6.4, SD 1.9; difference: -0.8, 95% CI -1.3 to -0.2; P=.005). Increase in heart rate during the scenario and over the 4 drugs was not different between the 2 groups.

CONCLUSIONS

Compared with the conventional method, dedicated mobile apps can reduce acute perceived stress during the preparation of emergency drugs in the prehospital setting during critical situations. These findings can help advance the development and evaluation of mobile apps for OHCA management and should be encouraged.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03921346; https://clinicaltrials.gov/ct2/show/NCT03921346.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.1186/s13063-019-3726-4.

Multiple Sclerosis Progression Discussion Tool Usability and Usefulness in Clinical Practice: Cross-sectional, Web-Based Survey

Background

A digital tool, Multiple Sclerosis Progression Discussion Tool (MSProDiscuss), was developed to facilitate discussions between health care professionals (HCPs) and patients in evaluating early, subtle signs of multiple sclerosis (MS) disease progression.

Objective

The aim of this study is to report the findings on the usability and usefulness of MSProDiscuss in a real-world clinical setting.

Methods

In this cross-sectional, web-based survey, HCPs across 34 countries completed an initial individual questionnaire (comprising 7 questions on comprehensibility, usability, and usefulness after using MSProDiscuss during each patient consultation) and a final questionnaire (comprising 13 questions on comprehensibility, usability, usefulness, and integration and adoption into clinical practice to capture the HCPs’ overall experience of using the tool). The responses were provided on a 5-point Likert scale. All analyses were descriptive, and no statistical comparisons were made.

Results

In total, 301 HCPs tested the tool in 6974 people with MS, of whom 77% (5370/6974) had relapsing-remitting MS, including those suspected to be transitioning to secondary progressive MS. The time taken to complete MSProDiscuss was reported to be in the range of 1 to 4 minutes in 97.3% (6786/6974; initial) to 98.2% (269/274; final) of the cases. In 93.54% (6524/6974; initial) to 97.1% (266/274; final) of the cases, the HCPs agreed (4 or 5 on the Likert scale) that patients were able to comprehend the questions in the tool. The HCPs were willing to use the tool again in the same patient, 90.47% (6310/6974; initial) of the cases. The HCPs reported MSProDiscuss to be useful in discussing MS symptoms and their impact on daily activities (6121/6974, 87.76% initial and 252/274, 92% final) and cognitive function (5482/6974, 78.61% initial and 271/274, 79.2% final), as well as in discussing progression in general (6102/6974, 87.49% initial and 246/274, 89.8% final). While completing the final questionnaire, 94.9% (260/274) of the HCPs agreed that the questions were similar to those asked in regular consultation, and the tool helped to better understand the impact of MS symptoms on daily activities (249/274, 90.9%) and cognitive function (220/274, 80.3%). Overall, 92% (252/274) of the HCPs reported that they would recommend MSProDiscuss to a colleague, and 85.8% (235/274) were willing to integrate it into their clinical practice.

Conclusions

MSProDiscuss is a usable and useful tool to facilitate a physician-patient discussion on MS disease progression in daily clinical practice. Most of the HCPs agreed that the tool is easy to use and were willing to integrate MSProDiscuss into their daily clinical practice.

Effect of educational intervention on clinical reasoning skills in nursing: A quasi-experimental study

This study evaluated the effect of an educational intervention based on virtual clinical simulation and problem-based learning using a mobile application in a clinical nursing education context as a tool to improve clinical reasoning skills of students on the second year of nursing graduation. A prospective quasi-experimental study was conducted in the year 2018, and assessments were performed before and after the educational intervention. A random convenience sample (n = 32) of nursing students in the second year of a public university in Brazil was divided equally into experimental and control groups. The experimental group underwent educational intervention about clinical reasoning skills and measured the quality of the Diagnostician Nurse software by LORI 2.0 instrument. The control group experienced the conventional class on clinical reasoning skills. Four clinical cases were used to assess reasoning skills before and after the educational intervention. The data were analyzed using descriptive and inferential statistics. The experimental group showed a statistically significant difference regarding the prioritization of nursing diagnoses (p = 0.014) and a higher final score. There was a statistically significant difference in performance between the pre- and post-test in the grades of the students who participated in the intervention (p = 0.003). The control group also showed statistical significance in the score attributed to the clinical reasoning process (p = 0.015). In addition, the Diagnostician Nurse software had excellent usability and quality evaluations (SUS 87.81 and LORI 4.66, respectively). It is concluded that educational intervention based on virtual clinical simulation and learning problems using the Diagnostician Nurse software is effective as a tool to improve clinical reasoning skills and can support early detection of patients. The educational intervention developed was of high quality and attractive and improved students' motivation for the teaching-learning process.

Usability Evaluation by Nurses of a Knowledge-Based System of Care Plans for People Hospitalized by COVID-19

The aim of this study is to analyze the usability by nurses of the Knowledge-Based System "Diagnostics care for COVID-19." A convenience sample of 16 nurses was selected, among hospital workers and external experts. The group was divided into three subgroups intentionally to obtain different usability perspectives. Usability was evaluated by the System Usability Scale questionnaire. The participants completed the questionnaire on general usability, data inputs, and information output, after completing a minimum of 12 care plans. The first subgroup used real cases and the "think aloud" technique, the second simulated cases from the same hospital, and the third subgroup performed the external simulation. The highest scores were obtained in data inputs (94.38-97.50); and the lowest, in general usability (90.00-95.00). The subgroup of external experts scored the highest (93.13-95.63), and the first subgroup, which carried out real cases, gave the lowest score (90.00-94.38). The "think aloud" technique found an improvement in including more diagnoses and being able to carry out several plans for one person at the same time. The usability obtained was "excellent" in all subgroups and questionnaires, although the application showed limitations related to its characteristics imposed in the requirements specification.

My hip journey: A qualitative study of patients' experiences of an eHealth program for patient preparation and recovery from hip replacement surgery

AIM AND OBJECTIVE

To explore patient experiences, perceived benefits and suggestions of an eHealth program for pre- and post-operative education for total hip arthroplasty.

BACKGROUND

eHealth programs for surgical patients can facilitate the delivery of information, provide individualised rehabilitation plans and enable communication with health professionals to promote overall patient recovery.

DESIGN

A qualitative descriptive study was conducted following the COREQ guidelines. A convenience sample of nine patients who had total hip arthroplasty and used the My Hip Journey eHealth program were recruited and participated in individual semi-structured telephone interviews. Interviews were audio recorded, transcribed verbatim and analysed using inductive thematic analysis.

RESULTS

The participant group were aged between 53 and 70 years. The results are described in three overarching themes and sub-themes: (1) Supported surgical journey-how the My Hip Journey eHealth program supported them in their preparation and recovery from their surgery, and how the program provided information and encouraged engagement; (2) Motivated recovery-how patients found the program motivational, facilitated their self-management and enabled communication with the healthcare team if they had any concern; and (3) Functionality-how the program related to ease of use, its interactivity with the patient and suggestions for future use.

CONCLUSIONS

The patients reported that using the eHealth program for pre- and post-operative education was helpful to their overall surgical experience and recovery. It was found to engage patients in their care, enabled self-management, encouraged communication with health professionals and motivated them with their recovery. These findings identify the potential for eHealth programs to support patients in the preparation and post-operative stages, and in their post-discharge self-care for other surgical and orthopaedic journeys.

RELEVANCE TO CLINICAL PRACTICE

Patient experiences of eHealth education can inform nurses of the benefits of eHealth and the development of future eHealth education programs.

eHealth in Geriatric Rehabilitation: Systematic Review of Effectiveness, Feasibility, and Usability

BACKGROUND

eHealth has the potential to improve outcomes such as physical activity or balance in older adults receiving geriatric rehabilitation. However, several challenges such as scarce evidence on effectiveness, feasibility, and usability hinder the successful implementation of eHealth in geriatric rehabilitation.

OBJECTIVE

The aim of this systematic review was to assess evidence on the effectiveness, feasibility, and usability of eHealth interventions in older adults in geriatric rehabilitation.

METHODS

We searched 7 databases for randomized controlled trials, nonrandomized studies, quantitative descriptive studies, qualitative research, and mixed methods studies that applied eHealth interventions during geriatric rehabilitation. Included studies investigated a combination of effectiveness, usability, and feasibility of eHealth in older patients who received geriatric rehabilitation, with a mean age of ≥70 years. Quality was assessed using the Mixed Methods Appraisal Tool and a narrative synthesis was conducted using a harvest plot.

RESULTS

In total, 40 studies were selected, with clinical heterogeneity across studies. Of 40 studies, 15 studies (38%) found eHealth was at least as effective as non-eHealth interventions (56% of the 27 studies with a control group), 11 studies (41%) found eHealth interventions were more effective than non-eHealth interventions, and 1 study (4%) reported beneficial outcomes in favor of the non-eHealth interventions. Of 17 studies, 16 (94%) concluded that eHealth was feasible. However, high exclusion rates were reported in 7 studies of 40 (18%). Of 40 studies, 4 (10%) included outcomes related to usability and indicated that there were certain aging-related barriers to cognitive ability, physical ability, or perception, which led to difficulties in using eHealth.

CONCLUSIONS

eHealth can potentially improve rehabilitation outcomes for older patients receiving geriatric rehabilitation. Simple eHealth interventions were more likely to be feasible for older patients receiving geriatric rehabilitation, especially, in combination with another non-eHealth intervention. However, a lack of evidence on usability might hamper the implementation of eHealth. eHealth applications in geriatric rehabilitation show promise, but more research is required, including research with a focus on usability and participation.

Evaluation of e-health (Seha) application: a cross-sectional study in Saudi Arabia

BACKGROUND

The Ministry of Health in Saudi Arabia is expanding the country's telemedicine services by using advanced technology in health services. In doing so, an e-health application (app), Seha, was introduced in 2018 that allows individuals to have face-to-face visual medical consultations with their doctors on their smartphones.

OBJECTIVE

This study evaluated the effectiveness of the app in improving healthcare delivery by ensuring patient satisfaction with the care given, increasing access to care, and improving efficiency in the healthcare system.

METHODS

A cross-sectional study design was used to assess the perceptions of users of the Seha app and non-users who continued with traditional health services. The data were collected using an online survey via Google Forms between June 2020 and September 2020. Independent t tests and chi-square (χ2) tests were conducted to answer the research questions.

RESULTS

There was a significant difference between users and non-users in terms of ease of access to health services (t =  - 9.38, p < 0.05), with app users having a higher mean score (4.19 ± 0.91) than non-users (3.41 ± 1.00); satisfaction with health services (t =  - 6.33, p < 0.05), with users having a higher mean score (3.96 ± 0.91) than non-users (3.45 ± 0.94); and efficiency (only one visit needed for treatment) (t =  - 3.20, p < 0.05), with users having a higher mean score (3.71 ± 0.93) than non-users (3.45 ± 0.93). There were significant associations between the use of the Seha app and age (χ2 = 8.79, p < 0.05), gender (χ2 = 22.19, p < 0.05), region (χ2 = 19.74, p < 0.05), and occupation (χ2 = 22.05, p < 0.05). There were significant relationships between the three items (on access, satisfaction, and efficiency) and experiencing technical issues (t = 4.47, t = 8.11, and t = 3.24, respectively, p < 0.05), with users who faced technical problems having significantly lower mean scores for all three items.

CONCLUSION

This study provided evidence that the Seha app improved the delivery of healthcare in Saudi Arabia. Users of the app had a better health experience in terms of their perceived ease of access to healthcare services; their satisfaction with healthcare services; and the efficiency of the system, measured by the number of required doctor visits. Other factors that appeared to influence the use of the app included age, gender, usual source of care, and technical difficulties.

Comparing an eHealth Program (My Hip Journey) With Standard Care for Total Hip Arthroplasty: Randomized Controlled Trial

Background

The role of eHealth programs to support patients through surgical pathways, including total hip arthroplasty (THA), is rapidly growing and offers the potential to improve patient engagement, self-care, and outcomes.

Objective

The aim of this study is to compare the effects of an eHealth program (intervention) versus standard care for pre- and postoperative education on patient outcomes for primary THA.

Methods

A prospective parallel randomized controlled trial with two arms (standard care and standard care plus access to the eHealth education program) was conducted. Participants included those who underwent THA. Outcome measures were collected preadmission, at 6 weeks, and at 3 and 6 months after surgery. The primary outcome was the Hip Dysfunction and Osteoarthritis Outcome Score. Secondary outcomes were a 5-level 5-dimension quality of life measure and the self-efficacy for managing chronic disease scale. Demographic and clinical characteristics were also collected. A satisfaction survey was completed by all participants 6 weeks after surgery, and those in the intervention arm completed an additional survey specific to the eHealth program.

Results

A total of 99 patients were recruited: 50 in the eHealth program (intervention) and 49 in standard care (control). Clinical improvements were demonstrated in both groups across all time points. Per-protocol analysis demonstrated no differences between the groups for all outcome measures across all time points. Participants in the eHealth program reported that the program was accessible, that they felt comfortable using it, and that the information was helpful.

Conclusions

This study demonstrated that the eHealth program, in addition to standard care, had no additional benefit to THA recovery compared with standard care alone. The study found that the eHealth program was highly valued by participants, and it supported the preoperative preparation, recovery, and postoperative rehabilitation of participants.

Trial Registration

Australian New Zealand Clinical Trial Registry ACTRN12617001433392; http://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=373657

Procedures of User-Centered Usability Assessment for Digital Solutions: Scoping Review of Reviews Reporting on Digital Solutions Relevant for Older Adults

BACKGROUND

The assessment of usability is a complex process that involves several steps and procedures. It is important to standardize the evaluation and reporting of usability procedures across studies to guide researchers, facilitate comparisons across studies, and promote high-quality usability studies. The first step to standardizing is to have an overview of how usability study procedures are reported across the literature.

OBJECTIVE

This scoping review of reviews aims to synthesize the procedures reported for the different steps of the process of conducting a user-centered usability assessment of digital solutions relevant for older adults and to identify potential gaps in the present reporting of procedures. The secondary aim is to identify any principles or frameworks guiding this assessment in view of a standardized approach.

METHODS

This is a scoping review of reviews. A 5-stage scoping review methodology was used to identify and describe relevant literature published between 2009 and 2020 as follows: identify the research question, identify relevant studies, select studies for review, chart data from selected literature, and summarize and report results. The research was conducted on 5 electronic databases: PubMed, ACM Digital Library, IEEE, Scopus, and Web of Science. Reviews that met the inclusion criteria (reporting on user-centered usability evaluation procedures for any digital solution that could be relevant for older adults and were published in English) were identified, and data were extracted for further analysis regarding study evaluators, study participants, methods and techniques, tasks, and test environment.

RESULTS

A total of 3958 articles were identified. After a detailed screening, 20 reviews matched the eligibility criteria. The characteristics of the study evaluators and participants and task procedures were only briefly and differently reported. The methods and techniques used for the assessment of usability are the topics that were most commonly and comprehensively reported in the reviews, whereas the test environment was seldom and poorly characterized.

CONCLUSIONS

A lack of a detailed description of several steps of the process of assessing usability and no evidence on good practices of performing it suggests that there is a need for a consensus framework on the assessment of user-centered usability evaluation. Such a consensus would inform researchers and allow standardization of procedures, which are likely to result in improved study quality and reporting, increased sensitivity of the usability assessment, and improved comparability across studies and digital solutions. Our findings also highlight the need to investigate whether different ways of assessing usability are more sensitive than others. These findings need to be considered in light of review limitations.

Feasibility of a mHealth survey application for incarcerated and postrelease people living with HIV in a low-resource setting

Mobile health (mHealth) holds considerable promise as a way to give people greater control of their health information, privacy, and sharing in the context of HIV research and clinical services. The purpose of this study was to determine the feasibility of an mHealth research application from the perspective of three stakeholder groups involved in an HIV clinical trial in Jakarta, Indonesia: (a) incarcerated people living with HIV (PLWH), (b) research assistants (RAs), and (c) research investigators. Incarcerated PLWH (n = 150) recruited from two large all-male prisons completed questionnaires, including questions about mHealth acceptability, on an mHealth survey application using a proprietary data collection software development platform. RAs who administered questionnaires (n = 8) rated the usability of the software application using the system usability scale (SUS) and open-ended questions. Research investigators (n = 2) completed in-depth interviews, that were coded and analyzed using the technology acceptance model (TAM) as a conceptual framework. Over 90% of incarcerated PLWH felt the mHealth application offered adequate comfort, privacy, and accuracy in recording their responses. RAs' SUS scores ranged from 60% to 90% (M = 76.25) and they found the mHealth survey application challenging to learn, but highly satisfying. Compared with paper-based data collection, researchers felt that electronic data collection led to improved accuracy and efficiency of data collection and the ability to monitor data collection remotely and in real time. The researchers perceived the learnability of the application as acceptable but required self-instruction.

Standards, Processes and Tools Used to Evaluate Health Information Systems Quality: A Systematic Literature Review (Preprint)

Background

Evaluating health information system (HIS) quality is strategically advantageous for improving the quality of patient care. Nevertheless, few systematic studies have reported what methods, such as standards, processes, and tools, were proposed to evaluate HIS quality.

Objective

This study aimed to identify and discuss the existing literature that describes standards, processes, and tools used to evaluate HIS quality.

Methods

We conducted a systematic literature review using review guidelines focused on software and systems. We examined seven electronic databases—Scopus, ACM (Association for Computing Machinery), ScienceDirect, Google Scholar, IEEE Xplore, Web of Science, and PubMed—to search for and select primary studies.

Results

Out of 782 papers, we identified 17 (2.2%) primary studies. We found that most of the primary studies addressed quality evaluation from a management perspective. On the other hand, there was little explicit and pragmatic evidence on the processes and tools that allowed for the evaluation of HIS quality.

Conclusions

To promote quality evaluation of HISs, it is necessary to define mechanisms and methods that operationalize the standards in HISs. Additionally, it is necessary to create metrics that measure the quality of the most critical components and processes of HISs.

Use of online knowledge base in primary health care and correlation to health care quality: an observational study

Background

Evidence-based information available at the point of care improves patient care outcomes. Online knowledge bases can increase the application of evidence-based medicine and influence patient outcome data which may be captured in quality registries. The aim of this study was to explore the effect of use of an online knowledge base on patient experiences and health care quality.

Methods

The study was conducted as a retrospective, observational study of 24 primary health care centers in Sweden exploring their use of an online knowledge base. Frequency of use was compared to patient outcomes in two national quality registries. A socio-economic Care Need Index was applied to assess whether the burden of care influenced the results from those quality registries. Non-parametric statistical methods and linear regression were used.

Results

Frequency of knowledge base use showed two groups: frequent and non-frequent users, with a significant use difference between the groups (p < 0.001). Outcome data showed significant higher values for all seven National Primary Care Patient Survey dimensions in the frequent compared to the non-frequent knowledge base users (p < 0.001), whereas 10 out of 11 parameters in the National Diabetes Register showed no differences between the groups (p > 0.05). Adjusting for Care Need Index had almost no effect on the outcomes for the groups.

Conclusions

Frequent users of a national online knowledge base received higher ratings on patient experiences, but figures on health care quality in diabetes showed near to no correlation. The findings indicate that some effects may be attributed to the use of knowledge bases and requires a controlled evaluation.

Usability and utility of eHealth for physical activity counselling in primary health care: a scoping review

Background

Physical activity (PA) counselling is an effective approach to promote PA in primary health care (PHC). Barriers to PA counselling in PHC include time constraints, lack of knowledge and skills of providers, and systemic barriers. Using electronic health (eHealth) has the potential to promote PA. This scoping review aimed to identify usability and utility of eHealth for tailored PA counselling introduced in PHC settings.

Methods

A scoping review included primary research articles. The authors systematically searched six databases (Cochrane Library, CINAHL Complete, Embase, PubMed, Scopus and Web of Science) from the inception of the databases. The search terms consisted of three search components: intervention (PA counselling), platform (eHealth), and setting (PHC). Additional articles were included through reference lists. The inclusion criteria were research or original articles with any study designs in adult participants.

Results

Of 2501 articles after duplicate removal, 2471 articles were excluded based on the title and abstract screening and full text review. A total of 30 articles were included for synthesis. The eHealth tools had a wide range of counselling domains as a stand-alone PA domain and multiple health behaviours. The included articles presented mixed findings of usability and utility of eHealth for PA counselling among patients and providers in PHC settings. Technical problems and the complexity of the programmes were highlighted as barriers to usability. The majority of articles reported effective utility, however, several articles stated unfavourable outcomes.

Conclusions

eHealth has the potential to support PA counselling in PHC. Facilitators and barriers to eHealth usability should be considered and adapted to particular settings and contexts. The utility of eHealth for promoting PA among patients should be based on the pragmatic basis to optimise resources.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12875-020-01304-9.

Evaluating Usability of a Touchless Image Viewer in the Operating Room

BACKGROUND

Availability of patient-specific image data, gathered from preoperatively conducted studies, like computed tomography scans and magnetic resonance imaging studies, during a surgical procedure is a key factor for surgical success and patient safety. Several alternative input methods, including recognition of hand gestures, have been proposed for surgeons to interact with medical image viewers during an operation. Previous studies pointed out the need for usability evaluation of these systems.

OBJECTIVES

We describe the accuracy and usability of a novel software system, which integrates gesture recognition via machine learning into an established image viewer.

METHODS

This pilot study is a prospective, observational trial, which asked surgeons to interact with software to perform two standardized tasks in a sterile environment, modeled closely to a real-life situation in an operating room. To assess usability, the validated "System Usability Scale" (SUS) was used. On a technical level, we also evaluated the accuracy of the underlying neural network.

RESULTS

The neural network reached 98.94% accuracy while predicting the gestures during validation. Eight surgeons with an average of 6.5 years of experience participated in the usability study. The system was rated on average with 80.25 points on the SUS.

CONCLUSION

The system showed good overall usability; however, additional areas of potential improvement were identified and further usability studies are needed. Because the system uses standard PC hardware, it made for easy integration into the operating room.

Evaluation of user satisfaction and usability of a mobile app for smoking cessation

BACKGROUND

Mobile apps have a great potential to support patients in healthcare, and to encourage healthy behavioral changes such as smoking cessation. Nevertheless, the user rejection levels are still high. A set of factors that has impact on the app effectiveness is related to the quality of those features that lead to positive user experiences when using the app. This work aims to evaluate the user experience, and more specifically the usability and the user satisfaction with a mobile application for smoking cessation. This will also provide a basis for future improvements.

METHODS

We provided a smoking cessation mobile Android app to two different user cohorts, the smokers as valid users and the experts, for three weeks. The app featured usual functionalities to help quit smoking, including an achieved benefits section, mini-games to distract during cravings, and supportive motivational messages. We collected information about user experience, through game playability and message satisfaction questionnaires, and the experts' opinions. We also considered usage of app sections, the duration of the mini-game sessions, and the user ratings for motivational messages.

RESULTS

We included 45 valid users and 25 experts in this study. The questionnaire indicated 80% satisfaction rate for the motivational messages. According to game questionnaires, over 69% of the participants agreed that the games have good usability features, however, for questions related to mobility and gameplay heuristics, agreements were below 67%. The most accessed app sections were achieved benefits and the one with motivational messages. The experts described issues that could help to improve the application.

CONCLUSIONS

The combination of questionnaires with expert reports allowed to identify several problems and possible corrections. Our study showed that motivational messages have a good satisfaction rate, although it is necessary to consider technical features of some mobile devices that may hinder message reception. Games have good usability and it's expected that the addition of difficulty levels and a better accessibility to the game menu could make them more attractive and increase its usage. Future development of mHealth apps based on gamification and motivational messages need to consider these factors for better user satisfaction and usability.

An Electronic Health Tool to Prepare for the First Orthopedic Consultation: Use and Usability Study

Background

The use of electronic health (eHealth) technology to prepare patients with hip or knee osteoarthritis (OA) for their first orthopedic consultation seems promising. Exploration of the use and usability of an educational eHealth tool may highlight potential modifications that could increase patient engagement and effectiveness.

Objective

This study aimed to (1) identify the use and usability of a stand-alone educational eHealth tool for patients with suspected hip or knee OA, (2) explore whether the recorded questions in the eHealth tool were in line with an existing widely used question prompt list, and (3) investigate whether user characteristics are related to use and usability.

Methods

We used data from 144 participants in the intervention group of a randomized controlled trial, who were asked to use the educational eHealth tool to prepare for their upcoming first orthopedic consultation. We defined users and nonusers based on whether they had opened the tool at least once. Users were characterized as active or superficial depending on the extent of their use of the tool. The recorded questions for the consultation preparation were categorized into themes fitting 3 predefined questions or in a remaining category. Usability was measured using the System Usability Scale (SUS, 0-100). Data were collected including the patient demographic and clinical characteristics, knowledge of OA, and internet and smartphone usage in daily life. The characteristics associated with users and nonusers were analyzed using a multivariable logistic regression analysis.

Results

A total of 116/144 (80.6%) participants used the educational eHealth tool, of whom 87/116 (75.0%) were active users. Of the three components of the tool (information, my consultation, and medication), medication was the least used (34%). On the basis of recorded questions of the users, the fourth predefined question could be proposed. The mean (SD) SUS score was 64.8 (16.0). No difference was found between the SUS scores of superficial and active users (mean difference 0.04, 95% CI −7.69 to 7.77). Participants with a higher baseline knowledge of OA (odds ratio [OR] 1.2, 95% CI 1.0 to 1.4) and who used the internet less frequently in their daily life (OR 0.6, 95% CI 0.5 to 0.9) were more likely to use the educational eHealth tool. We found no differences between the demographics and clinical characteristics of the superficial and active users.

Conclusions

Based on the results of this study, it can be concluded that the use of an educational eHealth tool to prepare patients with hip and knee OA for the first orthopedic consultation is feasible. Our results suggest some improvements that should be made to the content of the tool to improve its usability. No clear practical implications were found to support the implementation of the educational eHealth tool in specific subgroups.

Trial Registration

Netherlands Trial Register NTR6262; https://www.trialregister.nl/trial/6262

Efficiency and Patient-Reported Outcome Measures From Clinic to Home: The Human Empowerment Aging and Disability Program for Digital-Health Rehabilitation

Background: The recent exponential growth of Digital Health (DH) in the healthcare system provides a crucial transformation in healthcare, answering to alarming threats related to the increasing number of Chronic Neurological Diseases (CNDs). New long-term integrated DH-care approaches, including rehabilitation, are warranted to address these concerns.

Methods: The Human Empowerment Aging and Disability (HEAD) rehabilitation program, a new long-term integrated care including DH-care system, was evaluated in terms of efficiency and patient-reported outcome measures (PROMs) in 107 CND patients (30 with Parkinson's Disease, PD; 32 with Multiple Sclerosis, MS; 45 with stroke in chronic stage). All participants followed 1-month of HEAD rehabilitation in clinic (ClinicHEAD: 12 sessions, 3/week), then 1:3 patient was consecutively allocated to 3-months telerehabilitation at home (HomeHEAD: 60 sessions, 5/week). Efficiency (i.e., adherence, usability, and acceptability) and PROMs (i.e., perceived functioning in real-world) were analyzed.

Results: The rate of adherence to HEAD treatment in clinic (≥90%) and at home (77%) was high. Usability of HEAD system was judged as good (System Usability Scale, median 70.00) in clinic and even more at home (median 80.00). Similarly, administering the Technology Acceptance Model 3 questionnaire we found high scores both in clinic/at home (Usefulness, mean 5.39 ± 1.41 SD/mean 5.33 ± 1.29 SD; Ease of use, mean 5.55 ± 1.05 SD/ mean 5.45 ± 1.17 SD, External Control, mean 4.94 ± 1.17 SD/mean 5.07 ± 1.01 SD, Relevance, mean 5.68 ± 1.29 SD/mean 5.70 ± 1.13 SD and Enjoyment, mean 5.70 ± 1.40 SD/mean 6.01 ± 1.08 SD). After ClinicHEAD, participation and autonomy in daily routine was maintained or even ameliorated (PD and stroke > MS). Whereas, increased functionality and participation in the MS group was found only after HomeHEAD intervention.

Discussion: Our results suggest that a tele-health-based approach is both feasible and efficient in providing rehabilitation care to CNDs from clinic to home. Increasing and maintaining participation as well as autonomy in daily routine are promising findings that open up scenarios for the continuity of care at home through DH-care for CNDs.

A Scale to Assess the Methodological Quality of Studies Assessing Usability of Electronic Health Products and Services: Delphi Study Followed by Validity and Reliability Testing

BACKGROUND

The usability of electronic health (eHealth) and mobile health apps is of paramount importance as it impacts the quality of care. Methodological quality assessment is a common practice in the field of health for different designs and types of studies. However, we were unable to find a scale to assess the methodological quality of studies on the usability of eHealth products or services.

OBJECTIVE

This study aimed to develop a scale to assess the methodological quality of studies assessing usability of mobile apps and to perform a preliminary analysis of of the scale's feasibility, reliability, and construct validity on studies assessing usability of mobile apps, measuring aspects of physical activity.

METHODS

A 3-round Delphi panel was used to generate a pool of items considered important when assessing the quality of studies on the usability of mobile apps. These items were used to write the scale and the guide to assist its use. The scale was then used to assess the quality of studies on usability of mobile apps for physical activity, and it assessed in terms of feasibility, interrater reliability, and construct validity.

RESULTS

A total of 25 experts participated in the Delphi panel, and a 15-item scale was developed. This scale was shown to be feasible (time of application mean 13.10 [SD 2.59] min), reliable (intraclass correlation coefficient=0.81; 95% CI 0.55-0.93), and able to discriminate between low- and high-quality studies (high quality: mean 9.22 [SD 0.36]; low quality: mean 6.86 [SD 0.80]; P=.01).

CONCLUSIONS

The scale that was developed can be used both to assess the methodological quality of usability studies and to inform its planning.

Using Heuristic Evaluation to Improve Sepsis Alert Usability

Sepsis, life-threatening organ dysfunction in response to infection, is an alarmingly common and aggressive illness in US hospitals, especially for intensive care patients. Preventing sepsis deaths rests on the clinicians' ability to promptly recognize and treat sepsis. To aid early recognition, many organizations have employed clinician-facing electronic sepsis alert systems. However, the effectiveness of the alert relies on heavily on the visual interface, textual information, and overall usability. This article reports a usability inspection of a sepsis alert system. The authors found violations in 12 of the 14 usability principles and promote use of this method in practice to systematically identify usability problems.

Advocating for Greater Usability in Clinical Technologies: The Role of the Practicing Nurse

Health care, especially ICUs, rely on multiple types of technology to promote the best patient outcomes. Unfortunately, too often these technologies are poorly designed, causing errors, additional workload, and unnecessary frustration. The purpose of this article is to (1) empower nurses with the needed usability and usability testing vocabulary to identify and articulate clinical technology usability problems and (2) provide ideas on ways nurses can advocate to have an impact on positive change related to technology usability within a health care organization.

Facilitating Factors and Barriers to the Use of Emerging Technologies for Suicide Prevention in Europe: Multicountry Exploratory Study

BACKGROUND

This study provides an analysis on the use of emerging technologies for the prevention of suicide in 8 different European countries.

OBJECTIVE

The objective of this study was to analyze the potentiality of using emerging technologies in the area of suicide prevention based on the opinion of different professionals involved in suicide prevention.

METHODS

Opinions of 3 groups of stakeholders (ie, relevant professionals in suicide field) were gathered using a specifically designed questionnaire to explore dimensions underlying perceptions of facilitating factors and barriers in relation to the use of emerging technologies for suicide prevention.

RESULTS

Goal 1 involved facilitating factors for the use of emerging technologies in suicide prevention. Northern European countries, except for Belgium, attach greater relevance to those that optimize implementation and benefits. On the other hand, Southern European countries attach greater importance to professionally oriented and user-centered facilitating factors. According to different stakeholders, the analysis of these facilitating factors suggest that professionals in the field of social work attach greater relevance to those that optimize implementation and benefits. However, professionals involved in the area of mental health, policy makers, and political decision makers give greater importance to professionally oriented and user-centered facilitating factors. Goal 2 was related to barriers to the usability of emerging technologies for suicide prevention. Both countries and stakeholders attach greater importance to barriers associated with resource constraints than to those centered on personal limitations. There are no differences between countries or between stakeholders. Nevertheless, there is a certain stakeholders-countries interaction that indicates that the opinions on resource constraints expressed by different stakeholders do not follow a uniform pattern in different countries, but they differ depending on the country.

CONCLUSIONS

Although all countries and stakeholders agree in identifying resource constraints as the main barrier to the use of emerging technologies, factors facilitating their use in suicide prevention differ among countries and among stakeholders.