Detecting user experience issues from mHealth apps that support stroke caregiver needs: an analysis of user reviews

Background

Existing research has demonstrated the potential of mHealth apps in improving the caregiving outcomes of stroke. Since most of the apps were published in commercially available app stores without explaining their design and evaluation processes, it is necessary to identify the user experience issues to promote long-term adherence and usage.

Objective

The purpose of this study was to utilize published user reviews of commercially available apps to determine the user experience issues to guide future app development in stroke caregiving.

Methods

User reviews were extracted from the previously identified 46 apps that support stroke caregiving needs using a python-scraper. The reviews were pre-processed and filtered using python scripts to consider English reviews that described issues faced by the user. The final corpus was categorized based on TF-IDF vectorization and k-means clustering technique, and the issues extracted from the various topics were classified based on the seven dimensions of user experience to highlight factors that may affect the usage of the app.

Results

A total of 117,364 were extracted from the two app stores. After filtration, 13,368 reviews were included and classified based on the user experience dimensions. Findings highlight critical issues that affect the usability, usefulness, desirability, findability, accessibility, credibility, and value of the app that contribute to decreased satisfaction and increased frustration.

Conclusion

The study identified several user experience issues due to the inability of the app developers to understand the needs of the user. Further, the study describes the inclusion of a participatory design approach to promote an improved understanding of user needs; therefore, limiting any issues and ensuring continued use.

Information, involvement, self-care and support-The needs of caregivers of people with stroke: A grounded theory approach

BACKGROUND

Globally, stroke is a leading cause of death and disability, with most care undertaken by caregivers who are generally family and friends without prior experience of care. The lack of experience or unpreparedness results in feelings of uncertainty, burnout, anxiety, burden, etc. Hence, it is necessary to identify the needs of caregivers to better support them in their caregiving journey and improve the quality of care delivered.

METHODS

The study employed a grounded theory methodology that utilizes information gathered from literature reviews and social media to represent the needs and create a storyline visually. The storyline is further refined and evaluated using an online survey of 72 participants recruited through online stroke caregiving communities.

RESULTS

The study identified four core categories of needs: (i) Information: sufficient information delivered in layman's terms based on the individual situation of the caregiver and survivor through oral and hands-on demonstrations, (ii) Involvement: inclusion in the decision-making processes at different stages of recovery through face-to-face communication at the hospital, (iii) Self-care: ability to engage in work and leisure activities, (iv) Support: receive support in the form of resources, services and finances from different other stakeholders.

CONCLUSIONS

There is a need to create a caregiver-centered approach in stroke recovery to ensure limited obstruction to care and reduced uncertainty in stroke recovery. Moreover, through the inclusion of caregivers in stroke recovery, it may be possible to reduce the burden of care to the caregiver and ensure the satisfaction of the healthcare system throughout stroke recovery.

Qualitative study of the views of people living with cardiovascular disease, and healthcare professionals, towards the use of a digital platform to support cardiovascular disease self-management

OBJECTIVES

This paper focuses on formative research as part of a broader study to develop and evaluate an innovative digital health platform for the self-management of cardiovascular disease (CVD). The primary objective is to better understand the perceptions of key stakeholders towards the proposed platform (Salvio) and to identify the development considerations they may prioritise based on their own experiences of CVD management.

DESIGN

A qualitative research study using thematic analysis to explore patterns and themes within the various participant contributions.

SETTING

Triangulation of data collection methods were used to generate data, including focus group discussions, semistructured interviews and guided conversations.

PARTICIPANTS

Participants (n=26) were people with a diagnosis of CVD (n=18) and relevant healthcare professionals (n=8).

RESULTS

Findings indicate that the proposed platform would be a beneficial solution for certain groups whose health behaviour change is not currently supported by discrete solutions. Both participant groups perceive the digital health platform more trustworthy than accessing multiple interventions through unsupported digital repositories. Healthcare professionals agreed that they would endorse an evidence-based platform that had been rigorously developed and evaluated. CVD participants prioritised a decision support tool to guide them through the platform, as they perceive an unstructured approach as overly complex. Both participant groups perceived data sharing with certain self-selected individuals (eg, spouse) to be a useful method for gaining support with their health behaviour change.

CONCLUSIONS

A digital health platform offering a variety of existing, evidence-based interventions would provide users with suitable self-management solution(s) based on their own individual needs and preferences. Salvio could be enhanced by providing adequate support to platform users, guiding the diverse CVD population through a host of digital solutions, ensuring that Salvio is endorsed by trusted healthcare professionals and maintaining connections with usual care. Such a platform would augment existing self-management and secondary prevention services.

Technology-based support for stroke caregiving: A rapid review of evidence

AIM

This rapid review examines the technology-based interventions for caregivers of stroke proposed in the literature while also identifying the acceptance, effectiveness and satisfaction of the implemented approaches.

BACKGROUND

The increasing burden of supporting stroke survivors has resulted in caregivers searching for innovative solutions, such as technology-based interventions, to provide better care. Hence, its potential to support caregivers throughout the disease trajectory needs to be assessed.

EVALUATION

Five electronic databases were systematically searched for articles related to stroke caregiving technologies based on well-defined inclusion and exclusion criteria.

KEY ISSUE(S)

Fifteen articles met the inclusion criteria that focused on supporting caregivers through functionalities such as education, therapy and support, remote consultations, health assessments and logs and reminders using different devices. The majority of interventions demonstrated positive conclusions for caregiving impact, acceptance, effectiveness and satisfaction.

CONCLUSION

Findings highlight the influences of technology in improving stroke caregiving and the need to include user-centred design principles to create a meaningful, actionable and feasible system for caregivers.

IMPLICATIONS FOR NURSING MANAGEMENT

Technology can educate and support stroke caregivers, thereby minimizing uncertainty and ensuring better care for the survivor.

Utilization of social media communities for caregiver information support in stroke recovery: An analysis of content and interactions

Background

Caregivers often use the internet to access information related to stroke care to improve preparedness, thereby reducing uncertainty and enhancing the quality of care.

Method

Social media communities used by caregivers of people affected by stroke were identified using popular keywords searched for using Google. Communities were filtered based on their ability to provide support to caregivers. Data from the included communities were extracted and analysed to determine the content and level of interaction.

Results

There was a significant rise in the use of social media by caregivers of people affected by stroke. The most popular social media communities were charitable and governmental organizations with the highest user interaction–this was for topics related to stroke prevention, signs and symptoms, and caregiver self-care delivered through video-based resources.

Conclusion

Findings show the ability of social media to support stroke caregiver needs and practices that should be considered to increase their interaction and support.

mHealth intervention for carers of individuals with a history of stroke: Heuristic evaluation and user perspectives

Background

Caregiving in stroke is complex, with most carers having little to no preparation to care for individuals with a history of stroke, leading to emotional impact. Technologies such as Mobile Health can provide the carer with real-time support and prepare the carer to assume their new roles and responsibilities.

Objectives

To perform a heuristic evaluation of mHealth interventions designed to support carers of individuals with a history of stroke and determine the user preferences in stroke caregiving technology to inform future researchers and developers regarding the best practices to support these individuals.

Methods

Twenty adults (i.e. 10 usability experts and 10 carers) participated in an iterative user-centred design study that focused on developing and modifying the mHealth intervention (StrokeCaregiver (SeCr)) created to support stroke caregiving. The intervention was repeated in four cycles, including two cycles with five usability experts each and five carers each.

Results

SeCr was iteratively improved to develop a highly usable product in multiple cycles. Participants demonstrated critical needs in personalized information support, communication with their healthcare needs, and the trust of the user, content, and developer. These critical needs are required to be met to promote long-term acceptance and adherence.

Conclusions

While SeCr was developed to address the needs of carers of individuals with a history of stroke, several considerations must be made to ensure it can be used in a real-world setting. Researchers and developers can use co-design or living lab approaches to further meet the needs and expectations of the carer and enable these individuals to be better prepared for stroke caregiving.

Caregiver Engagement in Stroke Care: Opportunities and Challenges in Australia and Denmark

Globally, there is a rise in incident cases of stroke, particularly in low- and middle-income countries, due to obesity-related and lifestyle risk factors, including health issues such as high cholesterol, diabetes and hypertension. Since the early 20th century, stroke mortality has declined due to proper management of the risk factors and improved treatment practices. However, despite the decline in mortality, there is an increase in the levels of disability that requires long-term support. In countries such as Australia and Denmark, where most care is provided within the community; family members, generally spouses, assume the role of caregiver, with little to no preparation that affects the quality of care provided to the person living with stroke. While past research has highlighted aspects to improve caregiver preparedness of stroke and its impact on care; health planning, recovery, and public health policies rarely consider these factors, reducing engagement and increasing uncertainty. Hence, there is a need to focus on improving strategies during recovery to promote caregiver engagement. In this study, we, therefore, try to understand the needs of the caregiver in stroke that limit engagement, and processes employed in countries such as Australia and Denmark to provide care for the person with stroke. Based on our understanding of these factors, we highlight the potential opportunities and challenges to promote caregiving engagement in these countries.

Understanding the Methodological Issues and Solutions in the Research Design of Stroke Caregiving Technology

The rise in the number of cases of stroke has resulted in a significant burden on the healthcare system. As a result, the majority of care for the person living with stroke occurs within the community, resulting in caregivers being a central and challenged agent in care. To better support caregivers during the recovery trajectory poststroke, we investigated the role of health technologies to promote education and offer various kinds of support. However, the introduction of any new technology comes with challenges due to the growing need for more user-centric systems. The integration of user-centric systems in stroke caregiving has the potential to ensure long-term acceptance, success, and engagement with the technology, thereby ensuring better care for the person living with stroke. We first briefly characterize the affordances of available technologies for stroke caregiving. We then discuss key methodological issues related to the acceptance to such technologies. Finally, we suggest user-centered design strategies for mitigating such challenges.

mHealth applications to support caregiver needs and engagement during stroke recovery: A content review

Caregiving in stroke results in severe physical, psychological, and social impacts on the caregiver. Over the past few years, researchers have explored the use of mHealth technologies to support healthcare-related activities due to their ability to provide real-time care at any given place or time. The purpose of this content review is to investigate mHealth apps in supporting stroke caregiving engagement based on three aspects: motivation, value, and satisfaction. We searched app stores and repositories for apps related to stroke caregiving published up to September 2020. Extracted apps were reviewed and filtered using inclusion criteria, and then downloaded onto compatible devices to determine eligibility. Results were compared with evidence-based frameworks to identify the ability of these apps in engaging and supporting the caregiver. Forty-seven apps were included in this review that enabled caregivers to support their needs, such as adjustment to new roles and relationships, involvement in care and caring for oneself using several different functionalities. These functionalities include information resources, risk assessment, remote monitoring, data sharing, reminders and so on. However, no single app was identified that focuses on all aspects of stroke caregiving. We also identified several challenges faced by users through their reviews and the factors associated with value and satisfaction. Our findings can add to the knowledge of existing mHealth technologies and their functionalities to support stroke caregiving needs, and the importance of considering user engagement in the design. They can be used by developers and researchers looking to design better mHealth apps for stroke caregiving.

Toward a Digital Platform for the Self-Management of Noncommunicable Disease: Systematic Review of Platform-Like Interventions

BACKGROUND

Digital interventions are effective for health behavior change, as they enable the self-management of chronic, noncommunicable diseases (NCDs). However, they often fail to facilitate the specific or current needs and preferences of the individual. A proposed alternative is a digital platform that hosts a suite of discrete, already existing digital health interventions. A platform architecture would allow users to explore a range of evidence-based solutions over time to optimize their self-management and health behavior change.

OBJECTIVE

This review aims to identify digital platform-like interventions and examine their potential for supporting self-management of NCDs and health behavior change.

METHODS

A literature search was conducted in January 2020 using EBSCOhost, PubMed, Scopus, and EMBASE. No digital platforms were identified, so criteria were broadened to include digital platform-like interventions. Eligible platform-like interventions offered a suite of discrete, evidence-based health behavior change features to optimize self-management of NCDs in an adult population and provided digitally supported guidance for the user toward the features best suited to their needs and preferences. Data collected on interventions were guided by the CONSORT-EHEALTH (Consolidated Standards of Reporting Trials of Electronic and Mobile Health Applications and Online Telehealth) checklist, including evaluation data on effectiveness and process outcomes. The quality of the included literature was assessed using the Mixed Methods Appraisal Tool.

RESULTS

A total of 7 studies were included for review. Targeted NCDs included cardiovascular diseases (CVD; n=3), diabetes (n=3), and chronic obstructive pulmonary disease (n=1). The mean adherence (based on the number of follow-up responders) was 69% (SD 20%). Of the 7 studies, 4 with the highest adherence rates (80%) were also guided by behavior change theories and took an iterative, user-centered approach to development, optimizing intervention relevance. All 7 interventions presented algorithm-supported user guidance tools, including electronic decision support, smart features that interact with patterns of use, and behavior change stage-matching tools. Of the 7 studies, 6 assessed changes in behavior. Significant effects in moderate-to-vigorous physical activity were reported, but for no other specific health behaviors. However, positive behavior change was observed in studies that focused on comprehensive behavior change measures, such as self-care and self-management, each of which addresses several key lifestyle risk factors (eg, medication adherence). No significant difference was found for psychosocial outcomes (eg, quality of life). Significant changes in clinical outcomes were predominately related to disease-specific, multifaceted measures such as clinical disease control and cardiovascular risk score.

CONCLUSIONS

Iterative, user-centered development of digital platform structures could optimize user engagement with self-management support through existing, evidence-based digital interventions. Offering a palette of interventions with an appropriate degree of guidance has the potential to facilitate disease-specific health behavior change and effective self-management among a myriad of users, conditions, or stages of care.

Testing a Smartphone App (Young with Diabetes) to Improve Self-Management of Diabetes Over 12 Months: Randomized Controlled Trial

Background

Young people often struggle to self-manage type 1 diabetes during the transition from childhood to adulthood. Mobile health (mHealth) apps may have the potential to support self-management, but evidence is limited and randomized controlled trials are needed.

Objective

We assessed whether the mHealth app “Young with Diabetes” improved young people’s self-management measured by glycated hemoglobin (HbA_1c) and three self-reported psychometric scales.

Methods

Young people (14-22 years) with inadequate glycemic control and their parents were enrolled in a randomized controlled trial and assigned either to Young with Diabetes and usual care (Young with Diabetes group) or to usual care alone (control). Young with Diabetes use was monitored; functions included a chat room, contact the health care provider, reminders, tips, information about the diabetes department and type 1 diabetes topics, carbohydrate counting, and a parents’ section. Outcomes included HbA_1c and three self-reported psychometric scales: Perceived Competence in Diabetes Scale; Health Care Climate Questionnaire; and Problem Areas In Diabetes care survey. Data were collected at baseline and at 2, 7, and 12 months.

Results

A total of 151 young people were randomized (Young with Diabetes group=76, control=75) and 49 parents agreed to participate. At 12 months, HbA_1c was significantly higher (4.1 mmol/mol; 0.4 %) in the Young with Diabetes group, compared to the control group (P=.04); this finding did not occur when comparing app users (Young with Diabetes use ≥5 days) with nonusers. Young people used Young with Diabetes on a mean of 10.5 days. They spent the most time chatting about alcohol and searching for information about sex. Most young people and half of the parents reported that Young with Diabetes helped them. More than 80% would recommend Young with Diabetes to peers.

Conclusions

Young with Diabetes did not improve HbA_1c, but it may be a useful complement to self-management. Qualitative evaluation is needed to explore benefits and shortcomings of Young with Diabetes. Health care providers should address young peoples’ knowledge about sensitive topics, provide them with peer support, and be aware of parents’ need for information about how to support

Trial Registration

ClinicalTrials.gov NCT02632383; https://clinicaltrials.gov/ct2/show/NCT02632383 (Archived by WebCite at http://www.webcitation.org/6zCK2u7xM)

Designing a Self-Management App for Young People With Type 1 Diabetes: Methodological Challenges, Experiences, and Recommendations

Background

Young people with type 1 diabetes often struggle to self-manage their disease. Mobile health (mHealth) apps show promise in supporting self-management of chronic conditions such as type 1 diabetes. Many health care providers become involved in app development. Unfortunately, limited information is available to guide their selection of appropriate methods, techniques, and tools for a participatory design (PD) project in health care.

Objective

The aim of our study was to develop an mHealth app to support young people in self-managing type 1 diabetes. This paper presents our methodological recommendations based on experiences and reflections from a 2-year research study.

Methods

A mixed methods design was used to identify user needs before designing the app and testing it in a randomized controlled trial. App design was based on qualitative, explorative, interventional, and experimental activities within an overall iterative PD approach. Several techniques and tools were used, including workshops, a mail panel, think-aloud tests, and a feasibility study.

Results

The final mHealth solution was “Young with Diabetes” (YWD). The iterative PD approach supported researchers and designers in understanding the needs of end users (ie, young people, parents, and health care providers) and their assessment of YWD, as well as how to improve app usability and feasibility. It is critical to include all end user groups during all phases of a PD project and to establish a multidisciplinary team to provide the wide range of expertise required to build a usable and useful mHealth app.

Conclusions

Future research is needed to develop and evaluate more efficient PD techniques. Health care providers need guidance on what tools and techniques to choose for which subgroups of users and guidance on how to introduce an app to colleagues to successfully implement an mHealth app in health care organizations. These steps are important for anyone who wants to design an mHealth app for any illness.

Isolated thoughts and feelings and unsolved concerns: adolescents' and parents' perspectives on living with type 1 diabetes - a qualitative study using visual storytelling

AIMS AND OBJECTIVES

To explore and describe the experiences of adolescents and their parents living with type 1 diabetes, to identify their needs for support to improve adolescents' self-management skills in the transition from child- to adulthood.

BACKGROUND

Adolescents with type 1 diabetes often experience deteriorating glycaemic control and distress. Parents are important in adolescents' ability to self-manage type 1 diabetes, but they report anxiety and frustrations. A better understanding of the challenges adolescents and parents face, in relation to the daily self-management of type 1 diabetes, is important to improve clinical practice.

DESIGN

A qualitative explorative study using visual storytelling as part of individual interviews.

METHODS

A purposive sample of nine adolescents and their parents (seven mothers, six fathers) took photographs illustrating their experiences living with type 1 diabetes. Subsequently, participants were interviewed individually guided by participants' photographs and a semistructured interview guide. Interviews were analysed using thematic analysis.

RESULTS

Four major themes were consistent across adolescents and their parents: (1) striving for safety, (2) striving for normality, (3) striving for independence and (4) worrying about future. Although adolescents and parents had same concerns and challenges living with type 1 diabetes, they were experienced differently. Their thoughts and feelings mostly remained isolated and their concerns and challenges unsolved.

CONCLUSIONS

The concerns and challenges adolescents and their parents face in the transition from child- to adulthood are still present despite new treatment modalities. Parents are fundamental in supporting the adolescents' self-management-work; however, the parties have unspoken concerns and challenges.

RELEVANCE TO CLINICAL PRACTICE

Healthcare providers should address the parties' challenges and concerns living with type 1 diabetes to diminish worries about future including fear of hypoglycaemia, the burden of type 1 diabetes and the feeling of being incompetent in diabetes self-management. It is important to focus on supporting both adolescents and their parents, and to provide a shared platform for communication.

From Prototype to Product: Making Participatory Design of mHealth Commercially Viable

This paper delves into the challenges of engaging patients, clinicians and industry stakeholders in the participatory design of an mHealth platform for patient-clinician collaboration. It follows the process from the development of a research prototype to a commercial software product. In particular, we draw attention to four major challenges of (a) aligning the different concerns of patients and clinicians, (b) designing according to clinical accountability, (c) ensuring commercial interest, and (d) dealing with regulatory constraints when prototyping safety critical health Information Technology. Using four illustrative cases, we discuss what these challenges entail and the implications they pose to Participatory Design. We conclude the paper by presenting lessons learned.

From Research Prototypes to a Marketable eHealth System

This paper presents three distinct challenges to research and development (R&D) of marketable eHealth systems and suggests strategies to mitigate them. The eHealth system in question is designed to improve self-care and collaboration between remotely monitored heart failure patients and clinicians. By way of introspection and reflection on a current and a previous project, the authors propose solutions for mitigating the central challenges.

Personal health records

The paper addresses the complex interplay between patients, healthcare professionals, and technology in relation to the treatment of chronic patients. It reflects on an ongoing interdisciplinary action research project striving to design and implement IT support for communication and collaboration in the distributed heterogeneous network of chronic patients and the healthcare professionals that take care of them. An interactive personal health record (PHR) has been designed as part of the project. As such it is part of a trend to find ways to include patients in their own care process. This has been motivated by expected health benefits for the patients as well as promises to lead to reduced costs for a burdened healthcare system.

Designing for collaborative interpretation in telemonitoring: re-introducing patients as diagnostic agents

PURPOSE

We investigate why clinicians experience problems interpreting implantable cardioverter-defibrillator (ICD) data when the patient is absent, and we explore how to re-introduce patients into the socio-technical setup of telemonitored interpretation practices.

METHOD

An action research study with a design interventionist perspective was conducted to investigate the telemonitoring arrangement for chronic heart patients with ICDs and to identify the nature of the collaborative practices involved in ICD data interpretation. We diagnose the main challenges involved in collaborative interpretation practices. These insights were used to re-design the socio-technical setup of the telemonitoring practices by designing and building a web-based, patient-centric, collaborative application, myRecord, to re-introduce the patients as active participants into the telemonitoring setup. Finally, we introduce myRecord at Copenhagen University Hospital and evaluate the new practices and the collaborative technology related to the transformed role of the patients.

RESULTS

The interpretation of ICD data is a collaborative practice engaging clinicians and patients and involving three separate collaborative processes: interpretation of numbers; interpretation of general condition; and patient's interpretation of own condition and ICD data. In a collocated setup, these three interpretation processes are entangled and seamlessly interrelated. However, in the current telemonitoring setup, only the interpretation of numbers process is fully supported, neglecting the two other processes, and, in particular, the role of the patient. By re-introducing patients into the socio-technical setup of telemonitoring through myRecord, our design acknowledges the collaborative nature of the interpretation process. However, re-introducing patients transforms their role, and leads to new transformed telemonitoring practices, different from both the current telemonitoring setup as well as from the collocated setup.

CONCLUSION

Telemonitoring practices of patients with ICDs involve three entangled collaborative processes, whereas the existing socio-technical setup only mediate one. myRecord is designed as an add-on collaborative technology to mediate the two remaining collaborative processes. We argue that myRecord solves some of the problems with ICD data interpretation inherent in telemonitoring practices by providing a collaborative, asynchronous space for healthcare practitioners and patients to mediate the two processes that are otherwise lost. Our new socio-technical design also transforms the role of patients considerably, thus new studies should take these insights into consideration.

MUST--a participatory method for designing sustainable health IT

Several important issues in designing sustainable health IT, such as coherent visions for change and genuine user involvement, are too often neglected or not paid enough attention to in practice. The MUST method addresses the early stages in the design of sustainable IT applications. The method highlights how those issues can be dealt with as it provides practical recommendations in terms of principles, tools and techniques. The method has proven helpful in assisting project participants to focus on and combine issues that are also crucial when designing health IT. MUST has been developed and tested in commercial settings. Here however, we illustrate the method's potential for health IT as it was recently used for the evaluation of a faulty health IT project intended to support shared care in relation to pregnancy.

Make room for ethnography in design!

Cultural analysis, especially in its ethnographic form/variant, has been applied for some years now within the Computer Supported Cooperative Work (CSCW), the Human Computer Interaction (HCI), and the Participatory Design (PD) communities. These communities attract academics and practitioners who are concerned about the use-quality of computer based systems. Nevertheless, Bader and Nyce argue that cultural analysis "will probably not play a significant role in the development process at the least as it is presently defined." We argue that since the design and use of technology is socially constructed, cultural analysis will only play a role if its proponents strive to make room for it. The argument builds on our own experiences, being computer scientists who have integrated an ethnographic style of working with the design of computer based systems, and on the experiences of colleagues within the above mentioned communities. Some of us have gained our experience from projects in private and public organizations, and those of us also working in academia have included ethnographic techniques in our teaching. Such initiatives represent alternatives neglected by Bader and Nyce, whose assumptions seem to be that the role of cultural analysis is limited to assessments of a development process, to enlarging our understanding of the social nature of development and use, or to providing feedback to developers. We argue that ethnography can play a more proactive role within design. (Bader and Nyce use the terms 'cultural analysis' and 'ethnography'. In our argumentation we use only the term 'ethnography' with which we are most familiar.)