Evaluation of Healthcare IT Applications: The User Acceptance Perspective

Protecting Older Adult Residents in Care Facilities Against Influenza and COVID-19 Using the Influenza Communication, Advice and Reporting (FluCARE) App: Prospective Cohort Mixed Methods Study

BACKGROUND

Early detection and response to influenza and COVID-19 outbreaks in aged care facilities (ACFs) are critical to minimizing health impacts. The Sydney Local Health District (SLHD) Public Health Unit (PHU) has developed and implemented a novel web-based app with integrated functions for online line listings, detection algorithms, and automatic notifications to responders, to assist ACFs in outbreak response. The goal of the Influenza Outbreak Communication, Advice and Reporting (FluCARE) app is to reduce time delays to notifications, which we hope will reduce the spread, duration, and health impacts of an influenza or COVID-19 outbreak, as well as ease workload burdens on ACF staff.

OBJECTIVE

The specific aims of the study were to (1) evaluate the acceptability and user satisfaction of the implementation and use of FluCARE in helping ACFs recognize, notify, and manage influenza and COVID-19 outbreaks in their facility; (2) identify the safety of FluCARE and any potential adverse outcomes of using the app; and (3) identify any perceived barriers or facilitators to the implementation and use of FluCARE from the ACF user perspective.

METHODS

The FluCARE app was piloted from September 2019 to December 2020 in the SLHD. Associated implementation included promotion and engagement, user training, and operational policies. Participating ACF staff were invited to complete a posttraining survey. Staff were also invited to complete a postpilot evaluation survey that included the user Mobile Application Rating Scale (uMARS) measuring app acceptance, utility, and barriers and facilitators to use. An issues log was also prospectively maintained to assess safety. Survey data were analyzed descriptively or via content analysis where appropriate.

RESULTS

Surveys were completed by 31 consenting users from 27 ACFs. FluCARE was rated 3.91 of 5 overall on the uMARS. Of the 31 users, 25 (80%) would definitely use FluCARE for future outbreaks, and all users agreed that the app was useful for identifying influenza and COVID-19 outbreaks at their facilities. There were no reported critical issues with incorrect or missed outbreak detection. User training, particularly online training modules, and technical support were identified as key facilitators to FluCARE use.

CONCLUSIONS

FluCARE is an acceptable, useful, and safe app to assist ACF staff with early detection and response to influenza and COVID-19 outbreaks. This study supports feasibility for ongoing implementation and efficacy evaluation, followed by scale-up into other health districts in New South Wales.

Acceptability Among Community Healthcare Nurses of Intelligent Wireless Sensor-system Technology for the Rapid Detection of Health Issues in Home-dwelling Older Adults

Background:

The effective care and support of community healthcare nurses (CHNs) contribute greatly to the healthy aging of older adults living at home. Integrating innovative technologies into CHNs’ daily practice offers new opportunities and perspectives for early detection of health issues and interventions among home-dwelling older adults.

Aim:

To explore the perception of acceptability among CHNs of an intelligent wireless sensor system (IWSS) for use in daily practice for the detection of health issues in home-dwelling older adults receiving home healthcare.

Method:

Descriptive and qualitative data were sourced from a pilot randomized controlled trial involving 17 CHNs using an IWSS in their daily practice to rapidly detect falls and other health issues in patients’ homes. IWSS alerts indicating behavior changes were sent to CHNs. Their perceived usefulness (PU) and perceived ease of use (PEOU) were assessed. The acceptability of IWSS technology was explored using a questionnaire and focus group discussions.

Results:

The PU and PEOU of the IWSS technology were low to moderate. A majority of the CHNs were dissatisfied with its performance and intrusiveness; they reported multiple obstacles in the usefulness and ease of use of the IWSS technology in daily practice.

Conclusion:

To improve the IWSS technology’s low to moderate acceptability among CHNs, we recommend a more user-centered implementation strategy and an embedded model of nursing care.

A tailored Web-based psychoeducational intervention for cancer patients and their family caregivers

BACKGROUND

Most programs addressing psychosocial concerns of cancer survivors are in-person programs that are expensive to deliver, have limited availability, and seldom deal with caregivers' concerns.

OBJECTIVE

This study examined the feasibility of translating an efficacious nurse-delivered program (FOCUS Program) for patients and their caregivers to a tailored, dyadic Web-based format. Specific aims were to (1) test the preliminary effects of the Web-based intervention on patient and caregiver outcomes, (2) examine participants' program satisfaction, and (3) determine the feasibility of using a Web-based delivery format.

METHODS

A phase 2 feasibility study was conducted with cancer patients (lung, breast, colorectal, prostate) and their family caregivers (N = 38 dyads). The Web-based intervention provided information and support tailored to the unique characteristics of each patient, caregiver, and their dyadic relationship. Primary outcomes were emotional distress and quality of life. Secondary outcomes were benefits of illness/caregiving, communication, support, and self-efficacy. Analyses included descriptive statistics and repeated-measures analysis of variance.

RESULTS

Dyads had a significant decrease in emotional distress, increase in quality of life, and perceived more benefits of illness/caregiving. Caregivers also had significant improvement in self-efficacy. There were no changes in communication. Participants were satisfied with program usability, but recommended additional content.

CONCLUSIONS

It was possible to translate a clinician-delivered program to a Web-based format that was easy to use and had positive effects on dyadic outcomes.

IMPLICATIONS FOR PRACTICE

The Web-based program is a promising way to provide psychosocial care to more patients and caregivers using fewer personnel. It needs further testing in a larger randomized clinical trial.

Factors affecting compliance with use of online healthcare services among adults in Israel

BACKGROUND

The use of online health services (henceforth, OHS) among middle-aged to older adults can make health-related actions more accessible to this population group as well as help reduce the burden on the health system and avoid unnecessary costs. The study's objectives were to examine the responsiveness and willingness of individuals aged 45+ to use different OHS and to characterize the attitudes and main factors influencing that responsiveness.

METHODS

We conducted a telephone survey among a sample of 703 individuals constituting a representative sample of the Israeli population of individuals aged 45+. The research questionnaire integrates the principles of the Adopting Medical Information Technologies model and includes socio-demographic attributes.

RESULTS

The results indicate that 78 % of internet users claimed to use at least one OHS (79 % of the Jewish sector and 66 % of the non-Jewish sector). Nevertheless, 22 % of internet users do not use OHS. Most online use is on Health Maintenance Organizations (HMO) websites to obtain administrative information. Frequency of OHS use increases as the following factors increase: perceived ease of online use; extent of encouragement for online use; perceived reliability of online health services; and extent of advertisement exposure. The study found that OHS use is much more prevalent among wealthy populations. In addition, individuals' attitudes and the extent of their exposure to advertisement influence their use and intention to use OHS.

CONCLUSIONS

A number of recommendations emerge from the study: 1) For OHS use to increase online health websites should be made more accessible to middle aged-older adults individuals and those of different languages and cultures. 2) Programs should be developed to teach HMO staff to encourage patients to use OHS. 3) Media advertising that encourages the use of OHS should be expanded.

An Integrated Model for Patient Care and Clinical Trials (IMPACT) to support clinical research visit scheduling workflow for future learning health systems

We describe a clinical research visit scheduling system that can potentially coordinate clinical research visits with patient care visits and increase efficiency at clinical sites where clinical and research activities occur simultaneously. Participatory Design methods were applied to support requirements engineering and to create this software called Integrated Model for Patient Care and Clinical Trials (IMPACT). Using a multi-user constraint satisfaction and resource optimization algorithm, IMPACT automatically synthesizes temporal availability of various research resources and recommends the optimal dates and times for pending research visits. We conducted scenario-based evaluations with 10 clinical research coordinators (CRCs) from diverse clinical research settings to assess the usefulness, feasibility, and user acceptance of IMPACT. We obtained qualitative feedback using semi-structured interviews with the CRCs. Most CRCs acknowledged the usefulness of IMPACT features. Support for collaboration within research teams and interoperability with electronic health records and clinical trial management systems were highly requested features. Overall, IMPACT received satisfactory user acceptance and proves to be potentially useful for a variety of clinical research settings. Our future work includes comparing the effectiveness of IMPACT with that of existing scheduling solutions on the market and conducting field tests to formally assess user adoption.

Innovative health care delivery system--a questionnaire survey to evaluate the influence of behavioral factors on individuals' acceptance of telecare

The purpose of this research is to explore people's intention to use telecare and evaluate the degree of influence that behavioral factors on individuals' acceptance of telecare. The subjects are residents of Taiwan. The Structural Equation Modeling (SEM) technique was used to analyze the forecasting model applied to telecare. The results show that this model has good explanatory power for the behavioral intentions of using telecare. Among factors influencing the behavioral intentions of using telecare, the strongest factor is attitude, followed by the perceived usefulness, the perceived ease of use, subjective norms, and personal innovativeness, respectively. The findings of this study may serve as a reference to future studies.

Development and validation of a survey instrument for assessing prescribers' perception of computerized drug-drug interaction alerts

OBJECTIVE

To develop a theoretically informed and empirically validated survey instrument for assessing prescribers' perception of computerized drug-drug interaction (DDI) alerts.

MATERIALS AND METHODS

The survey is grounded in the unified theory of acceptance and use of technology and an adapted accident causation model. Development of the instrument was also informed by a review of the extant literature on prescribers' attitude toward computerized medication safety alerts and common prescriber-provided reasons for overriding. To refine and validate the survey, we conducted a two-stage empirical validation study consisting of a pretest with a panel of domain experts followed by a field test among all eligible prescribers at our institution.

RESULTS

The resulting survey instrument contains 28 questionnaire items assessing six theoretical dimensions: performance expectancy, effort expectancy, social influence, facilitating conditions, perceived fatigue, and perceived use behavior. Satisfactory results were obtained from the field validation; however, a few potential issues were also identified. We analyzed these issues accordingly and the results led to the final survey instrument as well as usage recommendations.

DISCUSSION

High override rates of computerized medication safety alerts have been a prevalent problem. They are usually caused by, or manifested in, issues of poor end user acceptance. However, standardized research tools for assessing and understanding end users' perception are currently lacking, which inhibits knowledge accumulation and consequently forgoes improvement opportunities. The survey instrument presented in this paper may help fill this methodological gap.

CONCLUSION

We developed and empirically validated a survey instrument that may be useful for future research on DDI alerts and other types of computerized medication safety alerts more generally.