Usability evaluation of an eHealth intervention for family carers of individuals affected by psychosis: A mixed-method study

Usability of Self-Management for Amputee Rehabilitation using Technology (SMART): An online self-management program for users with lower limb loss

BACKGROUND

Individuals with lower limb loss (LLL) need education to adapt to their amputation. Self-management programs provide education and supportive skills to manage health-related physical and psychological challenges. eHealth technologies, such as online platforms, are increasing access to educational resources. We designed an online self-management program for individuals with LLL called Self-Management for Amputee Rehabilitation using Technology (SMART); however, before evaluating its efficacy, we wanted to understand its appropriateness in the target population.

OBJECTIVE

To assess the usability of SMART among individuals with LLL.

STUDY DESIGN

The study used a concurrent and retrospective think-aloud process.

METHODS

Individuals with LLL, aged 18 years or older (n = 9), reviewed the modules during an online video conferencing session with an assessor. SMART included four stakeholder-informed modules with 18 total sections. Participants were asked to think aloud while completing 11 SMART tasks, such as entering SMART, goal setting, finding skin care, and reading the content of 10 sections, including limb care, diet, fatigue, and energy. The interviews were transcribed verbatim and analyzed using directed content analysis.

RESULTS

The median age was 58 (range: 30-69) years. Overall, SMART was perceived as straightforward, easy to navigate, and an accessible resource for education and skills. Difficulties were identified with navigation (e.g. skipping the "Foot care for diabetes" section), presentation (e.g. unclear audio), and language (e.g. pistoning and contracture).

CONCLUSIONS

SMART was redesigned to address the usability issues. The next step is to explore the perceived usefulness of SMART for content and intention to use.

Operationalising a Recovery-Oriented Support and Information Programme Online: The EOLAS Programme

Evidence demonstrates that psychoeducation interventions have clinical and recovery-related benefits for people experiencing psychosis and their family members. The EOLAS programmes are one example of recovery-oriented psychoeducation programmes for psychosis. They differ from other programmes in that they are co-designed and co-facilitated (peer and clinician) group programmes. Due to the COVID-19 pandemic, EOLAS went online using a videoconferencing platform. The study examined the feasibility, acceptability and usefulness of EOLAS-Online and explored whether some of the positive recovery outcomes reported by attendees regarding the in-person programmes were replicated online. Data were collected through an online survey and semi-structured interviews. Quantitative data were analysed using descriptive statistics. Thematic analysis was used for qualitative data. Fifteen attendees (40% of attendees) completed the surveys and eight participated in interviews. A total of 80% were satisfied/very satisfied with the programme. The programme was rated highly for increased knowledge of mental health, coping strategies, and engaging with peers. The use of technology was mostly unproblematic, although some audio and video-related challenges were identified. Engaging with the online programme was experienced positively, including facilitator support to engage. The overall findings indicate that EOLAS-Online is feasible, acceptable and useful in supporting attendees' recovery journeys.

Continuous User Experience Monitoring of a Patient-Completed Preoperative Assessment System in the United Kingdom: Cross-sectional Study

BACKGROUND

Anesthetic preoperative assessment (POA) is now a common part of the surgical care pathway, and guidelines support its routine use. MyPreOp (Ultramed Ltd) is a web-based POA system that enables remote assessments. Usability is a key factor in the success of digital health solutions.

OBJECTIVE

This study aims to assess the usability of the MyPreOp system through patient feedback, investigate the amount of time it took for patients to complete the POA questionnaire and the factors that influenced completion time, and explore the effect on completion times of implementing a validated eHealth usability scale, as compared to using a simple but unvalidated usability evaluation scale, and to test the feasibility of administering a more detailed usability evaluation scale in a staggered manner so as not to unduly increase completion times.

METHODS

In this cross-sectional study, anonymized data sets were extracted from the MyPreOp system. The participants were adults (aged ≥18 years), scheduled for nonurgent surgical procedures performed in hospitals in the United Kingdom, who gave consent for their anonymized data to be analyzed. Data collected included age, gender, American Society of Anesthesiology (ASA) physical classification status, and completion time. Two user experience evaluations were used: in Phase 1, 2 questions asking about overall experience and ease of use, and in Phase 2, a previously validated usability questionnaire, with its 20 questions equally distributed among 5 succeeding patient cohorts. There were 2593 respondents in total (Phase 1: n=1193; Phase 2: n=1400). The median age of the participants was 46 years, and 1520 (58.62%) of the 2593 respondents were female. End points measured were the median completion times in Phase I and Phase II. The data were collected by extracting a subset of records from the database and exported to a spreadsheet for analysis (Excel, Microsoft Corporation). The data were analyzed for differences in completion times between Phase I and Phase II, as well as for differences between age groups, genders, and ASA classifications.

RESULTS

MyPreOp scored well in usability in both phases. In Phase 1, 81.64% (974/1193) of respondents had a good or better experience, and 93.8% (1119/1193) found it easy to use. The usability rating in Phase 2 was 4.13 out of a maximum of 5, indicating high usability. The median completion time was 40.4 minutes. The implementation of the longer usability evaluation scale in Phase 2 did not negatively impact the completion times. Age and ASA physical status were found to be moderately associated with increased completion times.

CONCLUSIONS

MyPreOp rates high in both user experience and usability. The method of dividing the questionnaire into 5 blocks is valid and does not negatively affect completion times. Further research into the factors affecting completion time is recommended.

A bibliometric analysis on global eHealth

Background

The current coronavirus disease 2019 pandemic highlights the potential of eHealth. Drawing the knowledge map of eHealth research through data mining and visual analysis technology was helpful to systematically present the research status and future trends of global academic circles.

Methods

Based on the web of Science Core Collection (SCIE/SSCI) database, using bibliometric theory and visual analysis technology, this work analyzed the global eHealth research publications from 2000 to 2021, and introduced the interdisciplinary characteristics, hot topics and future trends in this field.

Results

A total of 10188 authors, 891 journals, 3586 institutions, 98 countries using 12 languages had conducted eHealth research in the world. The United States, the Netherlands, Australia and the United Kingdom were the main forces and international cooperation. However, the international co-operation between Eastern and Western countries was still relatively few. The frontier of global eHealth research mainly focused on #0eHealth innovation, #1physical activity, #2generalised anxiety disorder, #3lightweight authentication protocol, #4 eHealth information, #5technology readiness, #6 ehealth literacy scale, #7family carer, #8citance analysis, #9 guiding patient. Clusters #3 lightweight authentication protocol and #9 guiding patient were the latest clusters, indicating the research trend and direction of eHealth in the future.

Conclusions

Cooperation network framework at the regional, national and global levels and the cooperation of multidisciplinary teams with complementary backgrounds and expertise were needed to realize the in-depth popularization and application of eHealth knowledge. Interdisciplinary international cooperation should be the trend of eHealth research in the future.

A Mobile Health Salt Reduction Intervention for People With Hypertension: Results of a Feasibility Randomized Controlled Trial

BACKGROUND

A high-salt diet is a risk factor for hypertension and cardiovascular disease; therefore, reducing dietary salt intake is a key part of prevention strategies. There are few effective salt reduction interventions suitable for delivery in the primary care setting, where the majority of the management and diagnosis of hypertension occurs.

OBJECTIVE

The aim of this study is to assess the feasibility of a complex behavioral intervention to lower salt intake in people with elevated blood pressure and test the trial procedures for a randomized controlled trial to investigate the intervention's effectiveness.

METHODS

This feasibility study was an unblinded, randomized controlled trial of a mobile health intervention for salt reduction versus an advice leaflet (control). The intervention was developed using the Behavior Change Wheel and comprised individualized, brief advice from a health care professional with the use of the SaltSwap app. Participants with an elevated blood pressure recorded in the clinic were recruited through primary care practices in the United Kingdom. Primary outcomes assessed the feasibility of progression to a larger trial, including follow-up attendance, fidelity of intervention delivery, and app use. Secondary outcomes were objectively assessed using changes in salt intake (measured via 24-hour urine collection), salt content of purchased foods, and blood pressure. Qualitative outcomes were assessed using the think-aloud method, and the process outcomes were evaluated.

RESULTS

A total of 47 participants were randomized. All progression criteria were met: follow-up attendance (45/47, 96%), intervention fidelity (25/31, 81%), and app use (27/31, 87%). There was no evidence that the intervention significantly reduced the salt content of purchased foods, salt intake, or blood pressure; however, this feasibility study was not powered to detect changes in secondary outcomes. Process and qualitative outcomes demonstrated that the trial design was feasible and the intervention was acceptable to both individuals and practitioners and positively influenced salt intake behaviors.

CONCLUSIONS

The intervention was acceptable and feasible to deliver within primary care; the trial procedures were practicable, and there was sufficient signal of potential efficacy to change salt intake. With some improvements to the intervention app, a larger trial to assess intervention effectiveness for reducing salt intake and blood pressure is warranted.

TRIAL REGISTRATION

International Standard Randomized Controlled Trial Number (ISRCTN): 20910962; https://www.isrctn.com/ISRCTN20910962.

Mobile Health to Improve Hypertension and Diabetes Health Literacy Among Asian Indian Migrants to Hong Kong

The use of mobile technologies to improve health outcomes or mobile health is rapidly evolving, and culturally relevant resources are needed to address health disparities among vulnerable populations. Noncommunicable disease health disparities among Asian Indian migrants to Hong Kong are prevalent. A mobile health application designed to improve hypertension and type 2 diabetes mellitus health literacy was tested using a mixed-methods design to determine its impact on improving health literacy among this subpopulation. Quantitative findings indicated the mobile health application was effective in improving health literacy. Qualitative findings revealed participant perceptions about the application explored its informative nature, usability and likability of application components, and its ability to initiate intentionality for a healthier lifestyle among users. This feedback was valuable to ensure future modifications that will promote the application's scalability and sustainability.

Ensuring patient and public involvement in the transition to AI-assisted mental health care: A systematic scoping review and agenda for design justice

Background

Machine‐learning algorithms and big data analytics, popularly known as ‘artificial intelligence’ (AI), are being developed and taken up globally. Patient and public involvement (PPI) in the transition to AI‐assisted health care is essential for design justice based on diverse patient needs.

Objective

To inform the future development of PPI in AI‐assisted health care by exploring public engagement in the conceptualization, design, development, testing, implementation, use and evaluation of AI technologies for mental health.

Methods

Systematic scoping review drawing on design justice principles, and (i) structured searches of Web of Science (all databases) and Ovid (MEDLINE, PsycINFO, Global Health and Embase); (ii) handsearching (reference and citation tracking); (iii) grey literature; and (iv) inductive thematic analysis, tested at a workshop with health researchers.

Results

The review identified 144 articles that met inclusion criteria. Three main themes reflect the challenges and opportunities associated with PPI in AI‐assisted mental health care: (a) applications of AI technologies in mental health care; (b) ethics of public engagement in AI‐assisted care; and (c) public engagement in the planning, development, implementation, evaluation and diffusion of AI technologies.

Conclusion

The new data‐rich health landscape creates multiple ethical issues and opportunities for the development of PPI in relation to AI technologies. Further research is needed to understand effective modes of public engagement in the context of AI technologies, to examine pressing ethical and safety issues and to develop new methods of PPI at every stage, from concept design to the final review of technology in practice. Principles of design justice can guide this agenda.

Feasibility of a Web-Based Psychoeducation Course and Experiences of Caregivers Living With a Person With Schizophrenia Spectrum Disorder: Mixed Methods Study

BACKGROUND

Schizophrenia is a severe mental illness that burdens both patients and caregivers.

OBJECTIVE

The aim of this study is to examine the feasibility of a web-based psychoeducation course targeted at caregivers of persons with schizophrenia spectrum disorders (SSDs) and to describe their experiences of living with a person with SSD based on the material caregivers produced during the web-based course.

METHODS

A convergent, parallel, mixed methods study design was used. First, caregivers' engagement in the course was evaluated quantitatively. Second, the overview of the course feedback was evaluated using quantitative and qualitative methods. Third, the experiences of being a caregiver to a person with SSD were analyzed qualitatively with the thematic analysis of the writings caregivers produced during the web-based course.

RESULTS

A total of 30 caregivers participated in the study and a web-based psychoeducation course. Less than two-thirds (18/30, 60%) completed the course. Content was most often logged for the first module, Orientation (3465 log-ins), and the lowest number of log-ins was recorded for the Daily life module (1061 log-ins). Feedback on the course varied; over half (10/17, 59%) of the caregivers considered the content to be very good or good, about half (9/17, 53%) considered the website layout to be good, only 6% (1/17) felt that the usability of the website was poor, and no one felt that it was very poor. From the reported experiences of being a caregiver to a person with SSD, 3 themes were formed: the caregiver's own well-being, relationship with the person with SSD, and experience of health care services.

CONCLUSIONS

The web-based psychoeducation course for caregivers living with a person with SSD seems to be especially suitable for those who have little experience as a caregiver. In the future, more planning and the consideration of aspects related to the needs of specific target groups, course content, practical arrangements, and scheduling should be taken into account. In addition, although caregivers can improve their own well-being in different ways, they need regular support and cooperation from health care professionals.

COPe-support - a multi-component digital intervention for family carers for people affected by psychosis: study protocol for a randomized controlled trial

BACKGROUND

Psychosis often causes significant distress and impacts not only in the individuals, but also those close to them. Many relatives and friends ('carers') provide long-term support and need resources to assist them. We have co-produced a digital mental health intervention called COPe-support (Carers fOr People with Psychosis e-support) to provide carers with flexible access to high quality psychoeducation and interactive support from experts and peers. This study evaluates the effectiveness of COPe-support to promote mental wellbeing and caregiving experiences in carers.

METHODS

This study is a single-blind, parallel arm, individually randomized controlled trial (RCT) comparing COPe-support, with attention control. Both groups continue to receive usual care. COPe-support provides interactive web-based psychoeducation on psychosis-related issues, wellbeing-promotion and network support through forums. The attention-control is a non-interactive online information resource pack. Carers living in England are eligible if they provide at least weekly support to a family member or close friend affected by psychosis, and use internet communication (including emails) daily. All trial procedures are run online, including collection of outcome measurements which participants will directly input into our secure platform. Following baseline assessment, a web-based randomization system will be used to allocate 360 carers to either arm. Participants have unlimited access to the allocated condition for 40 weeks. Data collection is at three time points (10, 20, and 40 weeks after randomization). Analyses will be conducted by trial statisticians blinded to allocation. The primary outcome is mental wellbeing measured by Warwick Edinburgh Mental Wellbeing Scale (WEMWBS), at 20 weeks. As well as an intention-to-treat analysis, a complier average causal effect (CACE) analysis will be conducted to estimate the intervention effect in participants who have accessed COPe-support content twice or more. The secondary objectives and analysis will examine other health and caregiving-related outcomes and explore mechanisms. In a process evaluation, we will interview 20% of the intervention arm participants regarding the acceptability of COPe-support. We will explore in detail participants' usage patterns.

DISCUSSION

The results of this trial will provide valuable information about the effectiveness of COPe-support in promoting wellbeing and caregiving experiences in carers.

TRIAL REGISTRATION

The RCT is registered with the Current Controlled Trials registration (ISRCTN 89563420, registration date: 02/03/2018).