1
|
Aspelund A, Valkonen P, Viitanen J, Rauta V. Designing for Improved Patient Experiences in Home Dialysis: Usability and User Experience Findings From User-Based Evaluation Study With Patients With Chronic Conditions. JMIR Hum Factors 2024; 11:e53691. [PMID: 38743476 PMCID: PMC11134248 DOI: 10.2196/53691] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2023] [Revised: 02/21/2024] [Accepted: 03/28/2024] [Indexed: 05/16/2024] Open
Abstract
BACKGROUND Chronic kidney disease affects 10% of the population worldwide, and the number of patients receiving treatment for end-stage kidney disease is forecasted to increase. Therefore, there is a pressing need for innovative digital solutions that increase the efficiency of care and improve patients' quality of life. The aim of the eHealth in Home Dialysis project is to create a novel eHealth solution, called eC4Me, to facilitate predialysis and home dialysis care for patients with chronic kidney disease. OBJECTIVE Our study aimed to evaluate the usability, user experience (UX), and patient experience (PX) of the first version of the eC4Me solution. METHODS We used a user-based evaluation approach involving usability testing, questionnaire, and interview methods. The test sessions were conducted remotely with 10 patients with chronic kidney disease, 5 of whom had used the solution in their home environment before the tests, while the rest were using it for the first time. Thematic analysis was used to analyze user test and questionnaire data, and descriptive statistics were calculated for the UMUX (Usability Metric for User Experience) scores. RESULTS Most usability problems were related to navigation, the use of terminology, and the presentation of health-related data. Despite usability challenges, UMUX ratings of the solution were positive overall. The results showed noteworthy variation in the expected benefits and perceived effort of using the solution. From a PX perspective, it is important that the solution supports patients' own health-related goals and fits with the needs of their everyday lives with the disease. CONCLUSIONS A user-based evaluation is a useful and necessary part of the eHealth solution development process. Our study findings can be used to improve the usability and UX of the evaluated eC4Me solution. Patients should be actively involved in the solution development process when specifying what information is relevant for them. Traditional usability tests complemented with questionnaire and interview methods can serve as a meaningful methodological approach for gaining insight not only into usability but also into UX- and PX-related aspects of digital health solutions.
Collapse
Affiliation(s)
- Anna Aspelund
- Department of Computer Science, Aalto University, Espoo, Finland
| | - Paula Valkonen
- Department of Computer Science, Aalto University, Espoo, Finland
| | - Johanna Viitanen
- Department of Computer Science, Aalto University, Espoo, Finland
| | - Virpi Rauta
- Department of Nephrology, Helsinki University Central Hospital, University of Helsinki, Helsinki, Finland
- Abdominal Center, Nephrology, Helsinki University Hospital, Helsinki, Finland
| |
Collapse
|
2
|
Martins AI, Silva AG, Pais J, Cruz VT, Rocha NP. The impact of users' cognitive function on evaluator perceptions of usability. Sci Rep 2022; 12:13753. [PMID: 35962003 PMCID: PMC9374702 DOI: 10.1038/s41598-022-17441-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2022] [Accepted: 07/25/2022] [Indexed: 12/03/2022] Open
Abstract
To explore the association between the user’s cognitive function and usability reported by the evaluator. A cross-sectional study was conducted with a community-based sample. Data about participants’ age, sex, education, sleep quantity, subjective memory complaints, and cognitive function were collected. A usability session was conducted to evaluate a digital solution called Brain on Track. Independent linear-regression analyses were used to explore univariable and multivariable associations between evaluator-reported usability assessment and the users’ cognitive function, age, sex, education, sleep quantity, and subjective memory complaints. A total of 238 participants entered this study, of which 161 (67.6%) were females and the mean age was 42 (SD 12.9) years old. All variables (age, education, sleep quantity, subjective memory complaints and cognitive function) except sex were significantly associated with evaluator-reported usability in the univariable analysis (p < 0.05). Cognitive function, age, education, and subjective memory complaints remained significant in the multivariable model (F = 38.87, p < 0.001) with an adjusted R2 of 0.391. Cognition scores alone showed an adjusted R2 of 0.288. This work suggests that cognitive function impacts evaluator reported usability, alongside other users’ characteristics and needs to be considered in the usability evaluation.
Collapse
Affiliation(s)
- Ana Isabel Martins
- Center for Health Technology and Services Research-CINTESIS@RISE, University of Aveiro, Aveiro, Portugal.
| | - Anabela G Silva
- Center for Health Technology and Services Research-CINTESIS@RISE, School of Health Sciences, University of Aveiro, Aveiro, Portugal
| | - Joana Pais
- EPIUnit - Institute of Public Health, Laboratory for Integrative and Translational Research in Population Health (ITR), Neuroinova, University of Porto, Vila Nova de Gaia, Portugal
| | - Vítor Tedim Cruz
- Unidade Local de Saúde de Matosinhos, EPIUnit - Institute of Public Health, Laboratory for Integrative and Translational Research in Population Health (ITR), University of Porto, Porto, Portugal
| | - Nelson P Rocha
- Institute of Electronics and Informatics Engineering of Aveiro, Medical Sciences Department, University of Aveiro, Aveiro, Portugal
| |
Collapse
|
3
|
Te Kampe R, Boonen A, Jansen TL, Elling JM, Flendrie M, van Eijk-Hustings Y, Janssen M, van Durme C, de Vries H. Development and usability of a web-based patient-tailored tool to support adherence to urate-lowering therapy in gout. BMC Med Inform Decis Mak 2022; 22:95. [PMID: 35392890 PMCID: PMC8991610 DOI: 10.1186/s12911-022-01833-6] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2021] [Accepted: 03/28/2022] [Indexed: 01/09/2023] Open
Abstract
BACKGROUND The aim of this study is to develop and assess usability of a web-based patient-tailored tool to support adherence to urate-lowering therapy (ULT) among gout patients in a clinical setting. METHODS The content of the tool was based on the Integrated Change (I-Change) model. This model combines various socio-cognitive theories and assumes behavioral change is a result of becoming aware of the necessity of change by integrating pre-motivational, motivational, and post-motivational factors. An expert group (five gout experts, three health services researchers, and one health behavior expert) was assembled that decided in three meetings on the tool's specific content (assessments and personalized feedback) using information from preparatory qualitative studies and literature reviews. Usability was tested by a think aloud approach and validated usability questionnaires. RESULTS The I-Change Gout tool contains three consecutive sessions comprising 80 questions, 66 tailored textual feedback messages, and 40 tailored animated videos. Navigation through the sessions was determined by the patients' intention to adapt suboptimal ULT adherence. After the sessions, patients receive an overview of the personalized advices and plans to support ULT adherence. Usability testing among 20 gout patients that (ever) used ULT and seven healthcare professionals revealed an overall score for the tool of 8.4 ± 0.9 and 7.7 ± 1.0 (scale 1-10). Furthermore, participants reported a high intention to use and/or recommend the tool to others. Participants identified some issues for further improvement (e.g. redundant questions, technical issues, and text readability). If relevant, these were subsequently implemented in the I-Change Gout tool, to allow further testing among the following participants. CONCLUSION This study provides initial support for the usability by patients and healthcare professionals of the I-Change Gout tool to support ULT adherence behavior.
Collapse
Affiliation(s)
- Ritch Te Kampe
- Division of Rheumatology, Department of Internal Medicine, Maastricht University Medical Center, Maastricht, The Netherlands.
- Care and Public Health Research Institute (CAPHRI), Maastricht University, Maastricht, The Netherlands.
- Department of Rheumatology, VieCuri Medical Center, Venlo, The Netherlands.
| | - Annelies Boonen
- Division of Rheumatology, Department of Internal Medicine, Maastricht University Medical Center, Maastricht, The Netherlands
- Care and Public Health Research Institute (CAPHRI), Maastricht University, Maastricht, The Netherlands
| | - Tim L Jansen
- Department of Rheumatology, VieCuri Medical Center, Venlo, The Netherlands
| | - Jan Mathis Elling
- Care and Public Health Research Institute (CAPHRI), Maastricht University, Maastricht, The Netherlands
- Department of Health Promotion, Maastricht University, Maastricht, The Netherlands
| | - Marcel Flendrie
- Department of Rheumatology, Sint Maartenskliniek, Nijmegen, The Netherlands
| | - Yvonne van Eijk-Hustings
- Department of Clinical Epidemiology and Medical Technology Assessment, Maastricht University Medical Center, Maastricht, The Netherlands
| | - Matthijs Janssen
- Department of Rheumatology, VieCuri Medical Center, Venlo, The Netherlands
| | - Caroline van Durme
- Division of Rheumatology, Department of Internal Medicine, Maastricht University Medical Center, Maastricht, The Netherlands
- Centre Hospitalier Chrétien, Liège, Belgium
| | - Hein de Vries
- Care and Public Health Research Institute (CAPHRI), Maastricht University, Maastricht, The Netherlands
- Department of Health Promotion, Maastricht University, Maastricht, The Netherlands
| |
Collapse
|
4
|
Broekhuis M, van Velsen L, Peute L, Halim M, Hermens H. Conceptualizing Usability for the eHealth Context: Content Analysis of Usability Problems of eHealth Applications. JMIR Form Res 2021; 5:e18198. [PMID: 34313594 PMCID: PMC8367108 DOI: 10.2196/18198] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2020] [Revised: 09/02/2020] [Accepted: 05/31/2021] [Indexed: 01/22/2023] Open
Abstract
BACKGROUND Usability tests can be either formative (where the aim is to detect usability problems) or summative (where the aim is to benchmark usability). There are ample formative methods that consider user characteristics and contexts (ie, cognitive walkthroughs, interviews, and verbal protocols). This is especially valuable for eHealth applications, as health conditions can influence user-system interactions. However, most summative usability tests do not consider eHealth-specific factors that could potentially affect the usability of a system. One of the reasons for this is the lack of fine-grained frameworks or models of usability factors that are unique to the eHealth domain. OBJECTIVE In this study, we aim to develop an ontology of usability problems, specifically for eHealth applications, with patients as primary end users. METHODS We analyzed 8 data sets containing the results of 8 formative usability tests for eHealth applications. These data sets contained 400 usability problems that could be used for analysis. Both inductive and deductive coding were used to create an ontology from 6 data sets, and 2 data sets were used to validate the framework by assessing the intercoder agreement. RESULTS We identified 8 main categories of usability factors, including basic system performance, task-technology fit, accessibility, interface design, navigation and structure, information and terminology, guidance and support, and satisfaction. These 8 categories contained a total of 21 factors: 14 general usability factors and 7 eHealth-specific factors. Cohen κ was calculated for 2 data sets on both the category and factor levels, and all Cohen κ values were between 0.62 and 0.67, which is acceptable. Descriptive analysis revealed that approximately 69.5% (278/400) of the usability problems can be considered as general usability factors and 30.5% (122/400) as eHealth-specific usability factors. CONCLUSIONS Our ontology provides a detailed overview of the usability factors for eHealth applications. Current usability benchmarking instruments include only a subset of the factors that emerged from our study and are therefore not fully suited for summative evaluations of eHealth applications. Our findings support the development of new usability benchmarking tools for the eHealth domain.
Collapse
Affiliation(s)
- Marijke Broekhuis
- Roessingh Research and Development, Enschede, Netherlands
- Biomedical Signals and Systems, Faculty of Electrical Engineering, Mathematics and Computer Science (EEMCS), University of Twente, Enschede, Netherlands
| | - Lex van Velsen
- Roessingh Research and Development, Enschede, Netherlands
- Biomedical Signals and Systems, Faculty of Electrical Engineering, Mathematics and Computer Science (EEMCS), University of Twente, Enschede, Netherlands
| | - Linda Peute
- Center for Human Factor Engineering of Health Information technology, Department of Medical Informatics, Amsterdam UMC, University of Amsterdam, Amsterdam, Netherlands
| | - Meilani Halim
- Communication Sciences, Faculty of Behavioural, Management and Social Sciences (BMS), University of Twente, Enschede, Netherlands
| | - Hermie Hermens
- Roessingh Research and Development, Enschede, Netherlands
- Biomedical Signals and Systems, Faculty of Electrical Engineering, Mathematics and Computer Science (EEMCS), University of Twente, Enschede, Netherlands
| |
Collapse
|
5
|
de Vries H, Vluggen S. Persoonlijke gezondheidscounseling via e-health. ACTA ACUST UNITED AC 2020; 63:50-53. [PMID: 33191946 PMCID: PMC7652052 DOI: 10.1007/s12445-020-0930-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
Zowel in de huisartsenpraktijk als in de klinische setting krijgt een gezonde leefstijl en trouw medicijngebruik meer aandacht bij chronische patiënten. Naast face-to-face-counseling kan leefstijl- en medicatieadvies ook via e-health plaatsvinden. E-health-interventies zijn effectief én kosten-effectief gebleken. Wanneer onderbouwd met een gedegen theoretisch gedragsmodel, kan e-health een zinvolle en waardevolle aanvulling zijn op face-to-facecounseling.
Collapse
Affiliation(s)
- Hein de Vries
- Hoogleraar Gezondheidscommunicatie, Universiteit Maastricht, Care and Public Health Research Institute (CAPHRI), Vakgroep Gezondheidsbevordering, Maastricht, Nederland
| | - Stan Vluggen
- Postdoc onderzoeker, Universiteit Maastricht, Care and Public Health Research Institute (CAPHRI), Vakgroep Gezondheidsbevordering, Maastricht, Nederland
| |
Collapse
|
6
|
Tighe SA, Ball K, Kensing F, Kayser L, Rawstorn JC, Maddison R. Toward a Digital Platform for the Self-Management of Noncommunicable Disease: Systematic Review of Platform-Like Interventions. J Med Internet Res 2020; 22:e16774. [PMID: 33112239 PMCID: PMC7657720 DOI: 10.2196/16774] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2019] [Revised: 05/25/2020] [Accepted: 09/14/2020] [Indexed: 12/21/2022] Open
Abstract
BACKGROUND Digital interventions are effective for health behavior change, as they enable the self-management of chronic, noncommunicable diseases (NCDs). However, they often fail to facilitate the specific or current needs and preferences of the individual. A proposed alternative is a digital platform that hosts a suite of discrete, already existing digital health interventions. A platform architecture would allow users to explore a range of evidence-based solutions over time to optimize their self-management and health behavior change. OBJECTIVE This review aims to identify digital platform-like interventions and examine their potential for supporting self-management of NCDs and health behavior change. METHODS A literature search was conducted in January 2020 using EBSCOhost, PubMed, Scopus, and EMBASE. No digital platforms were identified, so criteria were broadened to include digital platform-like interventions. Eligible platform-like interventions offered a suite of discrete, evidence-based health behavior change features to optimize self-management of NCDs in an adult population and provided digitally supported guidance for the user toward the features best suited to their needs and preferences. Data collected on interventions were guided by the CONSORT-EHEALTH (Consolidated Standards of Reporting Trials of Electronic and Mobile Health Applications and Online Telehealth) checklist, including evaluation data on effectiveness and process outcomes. The quality of the included literature was assessed using the Mixed Methods Appraisal Tool. RESULTS A total of 7 studies were included for review. Targeted NCDs included cardiovascular diseases (CVD; n=3), diabetes (n=3), and chronic obstructive pulmonary disease (n=1). The mean adherence (based on the number of follow-up responders) was 69% (SD 20%). Of the 7 studies, 4 with the highest adherence rates (80%) were also guided by behavior change theories and took an iterative, user-centered approach to development, optimizing intervention relevance. All 7 interventions presented algorithm-supported user guidance tools, including electronic decision support, smart features that interact with patterns of use, and behavior change stage-matching tools. Of the 7 studies, 6 assessed changes in behavior. Significant effects in moderate-to-vigorous physical activity were reported, but for no other specific health behaviors. However, positive behavior change was observed in studies that focused on comprehensive behavior change measures, such as self-care and self-management, each of which addresses several key lifestyle risk factors (eg, medication adherence). No significant difference was found for psychosocial outcomes (eg, quality of life). Significant changes in clinical outcomes were predominately related to disease-specific, multifaceted measures such as clinical disease control and cardiovascular risk score. CONCLUSIONS Iterative, user-centered development of digital platform structures could optimize user engagement with self-management support through existing, evidence-based digital interventions. Offering a palette of interventions with an appropriate degree of guidance has the potential to facilitate disease-specific health behavior change and effective self-management among a myriad of users, conditions, or stages of care.
Collapse
Affiliation(s)
- Sarah A Tighe
- Institute for Physical Activity and Nutrition (IPAN), School of Exercise and Nutrition Sciences, Deakin University, Burwood, Australia
- Department of Public Health, Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark
| | - Kylie Ball
- Institute for Physical Activity and Nutrition (IPAN), School of Exercise and Nutrition Sciences, Deakin University, Burwood, Australia
| | - Finn Kensing
- Department of Computer Science, Faculty of Science, University of Copenhagen, Copenhagen, Denmark
| | - Lars Kayser
- Department of Public Health, Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark
| | - Jonathan C Rawstorn
- Institute for Physical Activity and Nutrition (IPAN), School of Exercise and Nutrition Sciences, Deakin University, Burwood, Australia
| | - Ralph Maddison
- Institute for Physical Activity and Nutrition (IPAN), School of Exercise and Nutrition Sciences, Deakin University, Burwood, Australia
| |
Collapse
|
7
|
Pot M, Paulussen TG, Ruiter RA, Mollema L, Hofstra M, Van Keulen HM. Dose-Response Relationship of a Web-Based Tailored Intervention Promoting Human Papillomavirus Vaccination: Process Evaluation of a Randomized Controlled Trial. J Med Internet Res 2020; 22:e14822. [PMID: 32520718 PMCID: PMC7395256 DOI: 10.2196/14822] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2019] [Revised: 11/04/2019] [Accepted: 05/14/2020] [Indexed: 01/17/2023] Open
Abstract
Background In the Netherlands, human papillomavirus (HPV) vaccination uptake remains low. To improve informed decision making (IDM) and HPV vaccination acceptability, we systematically developed an interactive, web-based tailored intervention to which mothers of Dutch girls were invited to participate. Objective The aim of this study was to provide insight into the intervention’s working mechanisms by evaluating (1) program use, (2) program acceptability, and (3) the relationship of program use with program acceptability and intervention effects (ie, dose-response relationship). Methods Only mothers from the intervention arm of a randomized controlled trial that assessed the effectiveness of the web-based, tailored intervention were included in this study. They were invited to visit the website of the web-based intervention between baseline (January 2015, just before access to the intervention) and follow up (March 2015, prior to the first HPV vaccination). Indicators for program use were time of website use (ie, duration of intervention exposure) and completeness (ie, proportion of all available web pages visited). HPV vaccination uptake registered by Praeventis was used as the primary outcome. Secondary outcomes were IDM, decisional conflict, and social-psychological determinants of HPV vaccination uptake. Results Among the 3995 invited mothers, 2509 (62.80%) logged on to the website, 2239 of whom (89.24%) visited at least one page of the intervention components. On average, mothers spent 21.39 minutes (SD 12.41) on the website and completed 50.04% (SD 26.18%) of the website components. Participants rated the website 7.64 (SD 1.39) on a 10-point scale. Program acceptability was significantly associated with completeness (β=4.36, P<.001), but not with time of website use (β=–.07, P=.77). Intention-to-treat analysis (N=3995) showed a significant positive effect of completeness on all outcome measures (all P<.003; Bonferroni-corrected α=.05/15 factors), including on HPV vaccination uptake. Time of website use had a significant positive effect on all outcomes (all P<.003), except for uptake (P=.20), risk perception when not vaccinated (P=.14), subjective norms (P=.03), and habit (P=.01). Conclusions Program use and acceptability of the intervention were adequate. Completeness was positively associated with acceptability. Furthermore, positive effects (ie, dose-response effects) were found for completeness and time of website use on the mothers’ IDM, decisional conflict, and almost all of the social-psychological determinants of HPV vaccination acceptability. In addition, the extent to which mothers completed the intervention had a positive impact on their daughters’ vaccination uptake. This indicates that the web-based, tailored intervention fits well with the mothers’ needs, and that completeness of use is essential for improving HPV vaccination uptake, acceptability, and IDM. Program use should therefore be promoted. Trial Registration Netherlands Trial Register NTR4795; https://www.trialregister.nl/trial/4795
Collapse
Affiliation(s)
- Mirjam Pot
- Child Health, Netherlands Organization for Applied Scientific Research (TNO), Leiden, Netherlands
| | - Theo Gwm Paulussen
- Child Health, Netherlands Organization for Applied Scientific Research (TNO), Leiden, Netherlands
| | - Robert Ac Ruiter
- Department of Work and Social Psychology, Maastricht University, Maastricht, Netherlands
| | - Liesbeth Mollema
- National Institute for Public Health and the Environment (RIVM), Centre for Infectious Disease Control, Bilthoven, Netherlands
| | - Miranda Hofstra
- Child Health, Netherlands Organization for Applied Scientific Research (TNO), Leiden, Netherlands
| | - Hilde M Van Keulen
- Child Health, Netherlands Organization for Applied Scientific Research (TNO), Leiden, Netherlands
| |
Collapse
|
8
|
Murta SG, Parada PDO, da Silva Meneses S, Medeiros JVV, Balbino A, Rodrigues MC, Miura MA, Dos Santos TAA, de Vries H. Dating SOS: a systematic and theory-based development of a web-based tailored intervention to prevent dating violence among Brazilian youth. BMC Public Health 2020; 20:391. [PMID: 32216764 PMCID: PMC7098149 DOI: 10.1186/s12889-020-08487-x] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2020] [Accepted: 03/09/2020] [Indexed: 11/12/2022] Open
Abstract
BACKGROUND Dating violence has an alarming prevalence among Brazilian adolescents. School-based preventive programs have been implemented, but remain isolated initiatives with low reach. Health communication strategies based on innovative technologies with a high potential of diffusion are urgent. This study aimed to develop a computer-tailored intervention to prevent victimization and perpetration of dating violence among Brazilian youth. METHODS The intervention, called Dating SOS (SOS Namoro), is based on the I-Change Model and attachment theory and is a comprehensive preventive program targeted to young people with a current partner. The intervention design included the stages of needs assessment; definition of objectives of change; development of the library of messages; elaboration of a questionnaire for tailoring feedbacks according to the relevant variables; integration of the content in the software Tailor Builder; pre-testing; and usability and efficacy evaluation planning. Dating SOS is composed of four online sessions. The first session gives a tailored orientation on attachment style and risk perception of violence. The second session addresses knowledge on conflict management, positive and negative social models of intimate relationships and an action plan to improve everyday interactions. The third session covers social norms, self-efficacy and an action plan to cope with conflicts. The fourth session discusses attitudes, social support and an action plan to protect from violence. Improvements on the interface and tailoring refinement was done after pre-testing to improve attractiveness and decrease risk of iatrogenic effects. DISCUSSION The principal merit of the present study resides in the development of an innovative strategy based on the qualified use of the internet for education surrounding romantic relationships and the prevention of dating violence among adolescent and young Brazilians, a hitherto unaddressed need in the field. The intervention usability and efficacy should be investigated in further studies. TRIAL REGISTRATION Brazilian Registry of Clinical Trials. RBR-9frj8q. Prospectively registered on July 25, 2019. http://www.ensaiosclinicos.gov.br/rg/RBR-9frj8q/.
Collapse
Affiliation(s)
- Sheila Giardini Murta
- Department of Clinical Psychology, Institute of Psychology, University of Brasília, Campus Darcy Ribeiro, Brasília, DF, CEP 70910-900, Brazil.
| | - Priscila de Oliveira Parada
- Department of Clinical Psychology, Institute of Psychology, University of Brasília, Campus Darcy Ribeiro, Brasília, DF, CEP 70910-900, Brazil
| | - Sara da Silva Meneses
- Department of Clinical Psychology, Institute of Psychology, University of Brasília, Campus Darcy Ribeiro, Brasília, DF, CEP 70910-900, Brazil
| | - João Victor Venâncio Medeiros
- Department of Clinical Psychology, Institute of Psychology, University of Brasília, Campus Darcy Ribeiro, Brasília, DF, CEP 70910-900, Brazil
| | - Amanda Balbino
- Department of Clinical Psychology, Institute of Psychology, University of Brasília, Campus Darcy Ribeiro, Brasília, DF, CEP 70910-900, Brazil
| | - Marina Caricatti Rodrigues
- Department of Clinical Psychology, Institute of Psychology, University of Brasília, Campus Darcy Ribeiro, Brasília, DF, CEP 70910-900, Brazil
| | - Marco Akira Miura
- Department of Design, Institute of Arts, University of Brasília, Brasília, Brazil
| | | | - Hein de Vries
- Department of Health Promotion, CAPHRI School for Public Health and Primary Care, Maastricht University, Maastricht, the Netherlands
| |
Collapse
|
9
|
Alwashmi MF, Hawboldt J, Davis E, Fetters MD. The Iterative Convergent Design for Mobile Health Usability Testing: Mixed Methods Approach. JMIR Mhealth Uhealth 2019; 7:e11656. [PMID: 31025951 PMCID: PMC6658163 DOI: 10.2196/11656] [Citation(s) in RCA: 40] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2018] [Revised: 11/05/2018] [Accepted: 03/24/2019] [Indexed: 01/12/2023] Open
Abstract
Although patients express an interest in using mobile health (mHealth) interventions to manage their health and chronic conditions, many current mHealth interventions are difficult to use. Usability testing is critical for the success of novel mHealth interventions. Researchers recognize the utility of using qualitative and quantitative approaches for usability testing, but many mHealth researchers lack the awareness of integration approaches from advances in mixed methods research that can add value to mHealth technology. As efficient usability testing proceeds iteratively, we introduce a novel mixed methods design developed specifically for mHealth researchers. The iterative convergent mixed methods design involves simultaneous qualitative and quantitative data collection and analysis that continues cyclically through multiple rounds of mixed methods data collection and analysis until the mHealth technology under evaluation is found to work to the satisfaction of the researcher. In cyclical iterations, early development is more qualitatively driven but progressively becomes more quantitatively driven. Using this design, mHealth researchers can leverage mixed methods integration procedures in the research question, data collection, data analysis, interpretation, and dissemination dimensions. This study demonstrates how the iterative convergent mixed methods design provides a novel framework for generating unique insights into multifaceted phenomena impacting mHealth usability. Understanding these practices can help developers and researchers leverage the strengths of an integrated mixed methods design.
Collapse
Affiliation(s)
| | | | - Erin Davis
- Memorial University, St John's, NL, Canada
| | - Michael D Fetters
- Department of Family Medicine, University of Michigan, Ann Arbor, MI, United States
| |
Collapse
|
10
|
Tanaka R, Banerjee A, Surikova J, Tracey J, Payne A, Ross H, Nolan R. A Moderated e-Forum for Adults With Cardiovascular Disease: Usability Study. JMIR Hum Factors 2018; 5:e20. [PMID: 29776901 PMCID: PMC5984275 DOI: 10.2196/humanfactors.8820] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2017] [Revised: 02/07/2018] [Accepted: 02/27/2018] [Indexed: 11/23/2022] Open
Abstract
Background Self-care behaviors are commonly prescribed to manage both cardiovascular disease and hypertension to reduce modifiable risk factors and improve quality of life. Nevertheless, long-term adherence to self-care recommendations for cardiac patients has been problematic. In cardiac patients, moderated online forums have been found to be particularly useful in supporting maintenance of heart-healthy diet and fewer hospital visits. As such, we developed the e-Forum, a Web-based moderated forum designed to promote continued user engagement and long-term self-care adherence. Objective The objective of this study was to assess the usability of the user interface for the newly designed e-Forum. In addition to overall user satisfaction, we obtained feedback from our target users on the key features of this newly developed interface. Methods An iterative design tested the usability of the e-Forum. On the basis of the user feedback, adjustments were made to the design of our e-Forum, and these changes were then tested in the succeeding group. Participants were recruited from the Heart Function Clinic at the Peter Munk Cardiac Center, University Health Network. After consenting to participate in our study, patients were asked to complete a set of goal-oriented tasks and a feedback interview for the e-Forum. A content analysis of the transcripts from the set of goal-oriented tasks and feedback interviews identified several themes, including general feedback and comments regarding 3 key areas of the e-Forum: layout, navigation, and content. Results Overall, 13 cardiac patients (aged 32-81 years) participated in 3 rounds of testing. Participants across all 3 rounds were highly satisfied with our e-Forum and indicated that they would find such a forum useful in managing their health. Expressions of overall satisfaction with the e-Forum and positive comments regarding layout increased between the initial and the final round. As improvements were made to the e-Forum based on participant feedback, potential barriers, negative comments related to the content, and the number of navigation errors decreased between rounds 1 and 3. Conclusions We found evidence to support the usability of the user interface for our e-Forum. These results indicate that the e-Forum will likely be a successful tool to support an online community of cardiac patients in their efforts to sustain long-term lifestyle behavior change.
Collapse
Affiliation(s)
- Rika Tanaka
- Cardiac eHealth and Behavioural Cardiology Research Unit, Peter Munk Cardiac Centre, University Health Network, Toronto, ON, Canada
| | - Anita Banerjee
- Cardiac eHealth and Behavioural Cardiology Research Unit, Peter Munk Cardiac Centre, University Health Network, Toronto, ON, Canada
| | - Jelena Surikova
- Cardiac eHealth and Behavioural Cardiology Research Unit, Peter Munk Cardiac Centre, University Health Network, Toronto, ON, Canada
| | - Jacqueline Tracey
- Cardiac eHealth and Behavioural Cardiology Research Unit, Peter Munk Cardiac Centre, University Health Network, Toronto, ON, Canada
| | - Ada Payne
- Models of Care, Clinical Programs and Quality Initiatives, Cancer Care Ontario, Toronto, ON, Canada
| | - Heather Ross
- Faculty of Medicine, University of Toronto, Toronto, ON, Canada.,Ted Rogers Centre of Excellence in Heart Function, Peter Munk Cardiac Centre, University Health Network, Toronto, ON, Canada
| | - Robert Nolan
- Cardiac eHealth and Behavioural Cardiology Research Unit, Peter Munk Cardiac Centre, University Health Network, Toronto, ON, Canada.,Faculty of Medicine, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
11
|
Yeager CM, Shoji K, Luszczynska A, Benight CC. Engagement With a Trauma Recovery Internet Intervention Explained With the Health Action Process Approach (HAPA): Longitudinal Study. JMIR Ment Health 2018; 5:e29. [PMID: 29636323 PMCID: PMC5938690 DOI: 10.2196/mental.9449] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/18/2017] [Revised: 02/03/2018] [Accepted: 02/12/2018] [Indexed: 11/23/2022] Open
Abstract
BACKGROUND There has been a growing trend in the delivery of mental health treatment via technology (ie, electronic health, eHealth). However, engagement with eHealth interventions is a concern, and theoretically based research in this area is sparse. Factors that influence engagement are poorly understood, especially in trauma survivors with symptoms of posttraumatic stress. OBJECTIVE The aim of this study was to examine engagement with a trauma recovery eHealth intervention using the Health Action Process Approach theoretical model. Outcome expectancy, perceived need, pretreatment self-efficacy, and trauma symptoms influence the formation of intentions (motivational phase), followed by planning, which mediates the translation of intentions into engagement (volitional phase). We hypothesized the mediational effect of planning would be moderated by level of treatment self-efficacy. METHODS Trauma survivors from around the United States used the eHealth intervention for 2 weeks. We collected baseline demographic, social cognitive predictors, and distress symptoms and measured engagement subjectively and objectively throughout the intervention. RESULTS The motivational phase model explained 48% of the variance, and outcome expectations (beta=.36), perceived need (beta=.32), pretreatment self-efficacy (beta=.13), and trauma symptoms (beta=.21) were significant predictors of intention (N=440). In the volitional phase, results of the moderated mediation model indicated for low levels of treatment self-efficacy, planning mediated the effects of intention on levels of engagement (B=0.89, 95% CI 0.143-2.605; N=115). CONCLUSIONS Though many factors can affect engagement, these results offer a theoretical framework for understanding engagement with an eHealth intervention. This study highlighted the importance of perceived need, outcome expectations, self-efficacy, and baseline distress symptoms in the formation of intentions to use the intervention. For those low in treatment self-efficacy, planning may play an important role in the translation of intentions into engagement. Results of this study may help bring some clarification to the question of what makes eHealth interventions work.
Collapse
Affiliation(s)
- Carolyn M Yeager
- Department of Psychology, University of Colorado Colorado Springs, Colorado Springs, CO, United States.,Trauma Health and Hazards Center, University of Colorado Colorado Springs, Colorado Springs, CO, United States
| | - Kotaro Shoji
- Trauma Health and Hazards Center, University of Colorado Colorado Springs, Colorado Springs, CO, United States
| | - Aleksandra Luszczynska
- Trauma Health and Hazards Center, University of Colorado Colorado Springs, Colorado Springs, CO, United States.,SWPS University of Social Sciences & Humanities, Wroclaw, Poland
| | - Charles C Benight
- Department of Psychology, University of Colorado Colorado Springs, Colorado Springs, CO, United States.,Trauma Health and Hazards Center, University of Colorado Colorado Springs, Colorado Springs, CO, United States
| |
Collapse
|
12
|
OPTIMIZING USABILITY OF AN ECONOMIC DECISION SUPPORT TOOL: PROTOTYPE OF THE EQUIPT TOOL. Int J Technol Assess Health Care 2018; 34:68-77. [PMID: 29455684 DOI: 10.1017/s0266462317004470] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
OBJECTIVES Economic decision-support tools can provide valuable information for tobacco control stakeholders, but their usability may impact the adoption of such tools. This study aims to illustrate a mixed-method usability evaluation of an economic decision-support tool for tobacco control, using the EQUIPT ROI tool prototype as a case study. METHODS A cross-sectional mixed methods design was used, including a heuristic evaluation, a thinking aloud approach, and a questionnaire testing and exploring the usability of the Return of Investment tool. RESULTS A total of sixty-six users evaluated the tool (thinking aloud) and completed the questionnaire. For the heuristic evaluation, four experts evaluated the interface. In total twenty-one percent of the respondents perceived good usability. A total of 118 usability problems were identified, from which twenty-six problems were categorized as most severe, indicating high priority to fix them before implementation. CONCLUSIONS Combining user-based and expert-based evaluation methods is recommended as these were shown to identify unique usability problems. The evaluation provides input to optimize usability of a decision-support tool, and may serve as a vantage point for other developers to conduct usability evaluations to refine similar tools before wide-scale implementation. Such studies could reduce implementation gaps by optimizing usability, enhancing in turn the research impact of such interventions.
Collapse
|
13
|
Voncken-Brewster V, Amoureus M, de Vries H, Nagykaldi Z, Winkens B, van der Weijden T, Tange H. The Impact of Participant Characteristics on Use and Satisfaction of a Web-Based Computer-Tailored Chronic Obstructive Pulmonary Disease Self-Management Intervention: A Process Evaluation. JMIR Form Res 2017; 1:e1. [PMID: 30684399 PMCID: PMC6334693 DOI: 10.2196/formative.6585] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2016] [Revised: 07/18/2017] [Accepted: 07/21/2017] [Indexed: 05/11/2023] Open
Abstract
BACKGROUND A randomized controlled trial (RCT) showed that a Web-based computer-tailored self-management intervention for people with or at risk for chronic obstructive pulmonary disease (COPD) did not have a significant treatment effect. Process evaluation measures such as application use and satisfaction with the intervention can help understand these results. OBJECTIVES The aim of this paper is to uncover reasons for suboptimal application use, evaluate satisfaction with the intervention, and investigate which participant characteristics predict application use and user satisfaction. METHODS Participants were recruited through 2 different channels: an online panel and general practice. The intervention group received the intervention, which consisted of 2 modules (smoking cessation and physical activity). The control group received no intervention. The study employed a mixed methods design. Quantitative and qualitative data were gathered assessing participant characteristics, application use, reasons for not using the application, and satisfaction with the intervention. RESULTS The RCT included 1325 participants. The proportion of individuals who participated was significantly higher in the online group (4072/6844, 59.5%) compared to the general practice group (43/335, 12.8%) (P<.001). Application use was low. Of all participants in the intervention group, 52.9% (348/658) initiated use of one or both modules, 36.0% (237/658) completed an intervention component (prolonged use), and 16.6% (109/658) revisited one of the modules after completing an intervention component (sustained use). Older age, established diagnosis of COPD, or experiencing breathlessness predicted sustained use. Participant satisfaction with the 2 modules was 6.7 (SD 1.6) on a scale from 0 to 10. The interviews revealed that a computer application was believed not to be sufficient and the help of a health care professional was necessary. Participants with a greater intention to change were more satisfied with the application. CONCLUSIONS The application was not used sufficiently. Study materials should be further tailored to younger individuals, those at risk for COPD, and those who do not experience breathlessness in order to increase sustained use among them. Involvement of a health care professional could improve satisfaction with the intervention and potentially increase engagement with the intervention materials. However, to make this possible, recruitment in general practice needs to be improved. Recommendations are made for improving the study design, strengthening the intervention (eg, practice facilitation), and linking the computer application to interaction with a health care provider.
Collapse
Affiliation(s)
- Viola Voncken-Brewster
- Department of Family Medicine, Care and Public Health Research Institute, Maastricht University Medical Center, Maastricht, Netherlands
| | - Mylène Amoureus
- Institute of Health Policy and Management, Erasmus University Rotterdam, Rotterdam, Netherlands
| | - Hein de Vries
- Department of Health Promotion, Care and Public Health Research Institute, Maastricht University Medical Center, Maastricht, Netherlands
| | - Zsolt Nagykaldi
- Department of Family and Preventive Medicine, University of Oklahoma Health Sciences Center, University of Oklahoma, Oklahoma, OK, United States
| | - Bjorn Winkens
- Department of Methodology and Statistics, Care and Public Health Research Institute, Maastricht University Medical Center, Maastricht, Netherlands
| | - Trudy van der Weijden
- Department of Family Medicine, Care and Public Health Research Institute, Maastricht University Medical Center, Maastricht, Netherlands
| | - Huibert Tange
- Department of Family Medicine, Care and Public Health Research Institute, Maastricht University Medical Center, Maastricht, Netherlands
| |
Collapse
|
14
|
Voncken-Brewster V, Amoureus M, de Vries H, Nagykaldi Z, Winkens B, van der Weijden T, Tange H. The Impact of Participant Characteristics on Use and Satisfaction of a Web-Based Computer-Tailored Chronic Obstructive Pulmonary Disease Self-Management Intervention: A Process Evaluation. JMIR Form Res 2017. [PMID: 30684399 PMCID: PMC6334693 DOI: 10.2196//formative.6585] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND A randomized controlled trial (RCT) showed that a Web-based computer-tailored self-management intervention for people with or at risk for chronic obstructive pulmonary disease (COPD) did not have a significant treatment effect. Process evaluation measures such as application use and satisfaction with the intervention can help understand these results. OBJECTIVES The aim of this paper is to uncover reasons for suboptimal application use, evaluate satisfaction with the intervention, and investigate which participant characteristics predict application use and user satisfaction. METHODS Participants were recruited through 2 different channels: an online panel and general practice. The intervention group received the intervention, which consisted of 2 modules (smoking cessation and physical activity). The control group received no intervention. The study employed a mixed methods design. Quantitative and qualitative data were gathered assessing participant characteristics, application use, reasons for not using the application, and satisfaction with the intervention. RESULTS The RCT included 1325 participants. The proportion of individuals who participated was significantly higher in the online group (4072/6844, 59.5%) compared to the general practice group (43/335, 12.8%) (P<.001). Application use was low. Of all participants in the intervention group, 52.9% (348/658) initiated use of one or both modules, 36.0% (237/658) completed an intervention component (prolonged use), and 16.6% (109/658) revisited one of the modules after completing an intervention component (sustained use). Older age, established diagnosis of COPD, or experiencing breathlessness predicted sustained use. Participant satisfaction with the 2 modules was 6.7 (SD 1.6) on a scale from 0 to 10. The interviews revealed that a computer application was believed not to be sufficient and the help of a health care professional was necessary. Participants with a greater intention to change were more satisfied with the application. CONCLUSIONS The application was not used sufficiently. Study materials should be further tailored to younger individuals, those at risk for COPD, and those who do not experience breathlessness in order to increase sustained use among them. Involvement of a health care professional could improve satisfaction with the intervention and potentially increase engagement with the intervention materials. However, to make this possible, recruitment in general practice needs to be improved. Recommendations are made for improving the study design, strengthening the intervention (eg, practice facilitation), and linking the computer application to interaction with a health care provider.
Collapse
Affiliation(s)
- Viola Voncken-Brewster
- Department of Family Medicine, Care and Public Health Research Institute, Maastricht University Medical Center, Maastricht, Netherlands
| | - Mylène Amoureus
- Institute of Health Policy and Management, Erasmus University Rotterdam, Rotterdam, Netherlands
| | - Hein de Vries
- Department of Health Promotion, Care and Public Health Research Institute, Maastricht University Medical Center, Maastricht, Netherlands
| | - Zsolt Nagykaldi
- Department of Family and Preventive Medicine, University of Oklahoma Health Sciences Center, University of Oklahoma, Oklahoma, OK, United States
| | - Bjorn Winkens
- Department of Methodology and Statistics, Care and Public Health Research Institute, Maastricht University Medical Center, Maastricht, Netherlands
| | - Trudy van der Weijden
- Department of Family Medicine, Care and Public Health Research Institute, Maastricht University Medical Center, Maastricht, Netherlands
| | - Huibert Tange
- Department of Family Medicine, Care and Public Health Research Institute, Maastricht University Medical Center, Maastricht, Netherlands
| |
Collapse
|
15
|
Wilansky P, Eklund JM, Milner T, Kreindler D, Cheung A, Kovacs T, Shooshtari S, Astell A, Ohinmaa A, Henderson J, Strauss J, Mills RS. Cognitive Behavior Therapy for Anxious and Depressed Youth: Improving Homework Adherence Through Mobile Technology. JMIR Res Protoc 2016; 5:e209. [PMID: 27833071 PMCID: PMC5122719 DOI: 10.2196/resprot.5841] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2016] [Revised: 09/26/2016] [Accepted: 10/12/2016] [Indexed: 01/18/2023] Open
Abstract
Background Anxiety and mood disorders are the most common mental illnesses, peaking during adolescence and affecting approximately 25% of Canadians aged 14-17 years. If not successfully treated at this age, they often persist into adulthood, exerting a great social and economic toll. Given the long-term impact, finding ways to increase the success and cost-effectiveness of mental health care is a pressing need. Cognitive behavior therapy (CBT) is an evidence-based treatment for mood and anxiety disorders throughout the lifespan. Mental health technologies can be used to make such treatments more successful by delivering them in a format that increases utilization. Young people embrace technologies, and many want to actively manage their mental health. Mobile software apps have the potential to improve youth adherence to CBT and, in turn, improve outcomes of treatment. Objective The purpose of this project is to improve homework adherence in CBT for youth anxiety and/or depression. The objectives are to (1) design and optimize the usability of a mobile app for delivering the homework component of CBT for youth with anxiety and/or depression, (2) assess the app’s impact on homework completion, and (3) implement the app in CBT programs. We hypothesize that homework adherence will be greater in the app group than in the no-app group. Methods Phase 1: exploratory interviews will be conducted with adolescents and therapists familiar with CBT to obtain views and perspectives on the requirements and features of a usable app and the challenges involved in implementation. The information obtained will guide the design of a prototype. The prototype will be optimized via think-aloud procedures involving an iterative process of evaluation, modification, and re-evaluation, culminating in a fully functional version of the prototype that is ready for optimization in a clinical context. Phase 2: a usability study will be conducted to optimize the prototype in the context of treatment at clinics that provide CBT treatment for youth with anxiety and/or depression. This phase will result in a usable app that is ready to be tested for its effectiveness in increasing homework adherence. Phase 3: a pragmatic clinical trial will be conducted at several clinics to evaluate the impact of the app on homework adherence. Participants in the app group are expected to show greater homework completion than those in the no-app group. Results Phase 3 will be completed by September 2019. Conclusions The app will be a unique adjunct to treatment for adolescents in CBT, focusing on both anxiety and depression, developed in partnership with end users at every stage from design to implementation, customizable for different cognitive profiles, and designed with depression symptom tracking measures for youth made interoperable with electronic medical records.
Collapse
Affiliation(s)
- Pamela Wilansky
- Child, Youth and Family Services, Centre for Addiction and Mental Health, University of Toronto, Toronto, ON, Canada
| | - J Mikael Eklund
- Department of Electrical, Computer and Software Engineering, University of Ontario Institute of Technology, Oshawa, ON, Canada
| | | | - David Kreindler
- Division of Youth Psychiatry, Sunnybrook Health Sciences Centre, University of Toronto, Toronto, ON, Canada.,Centre for Mobile Computing in Mental Health, Sunnybrook Health Sciences Centre, University of Toronto, Toronto, ON, Canada
| | - Amy Cheung
- Division of Youth Psychiatry, Sunnybrook Health Sciences Centre, University of Toronto, Toronto, ON, Canada
| | - Tim Kovacs
- Department of Computer Science, Faculty of Engineering, University of Bristol, Bristol, United Kingdom
| | - Shahin Shooshtari
- Department of Community Health Sciences, Max Rady College of Medicine, Rady Faculty of Health Sciences, University of Manitoba, Winnipeg, MB, Canada
| | - Arlene Astell
- Ontario Shores Centre for Mental Health Sciences, Whitby, ON, Canada.,School of Health and Related Research, University of Sheffield, Sheffield, United Kingdom
| | - Arto Ohinmaa
- School of Public Health, University of Alberta, Edmonton, AB, Canada
| | - Joanna Henderson
- Child, Youth and Family Services, Centre for Addiction and Mental Health, University of Toronto, Toronto, ON, Canada
| | - John Strauss
- Shannon Centennial Informatics Lab, Centre for Addiction and Mental Health, University of Toronto, Toronto, ON, Canada
| | - Rosemary Sl Mills
- Department of Community Health Sciences, Max Rady College of Medicine, Rady Faculty of Health Sciences, University of Manitoba, Winnipeg, MB, Canada
| |
Collapse
|
16
|
de Ruijter D, Smit ES, de Vries H, Hoving C. Web-based computer-tailoring for practice nurses aimed to improve smoking cessation guideline adherence: A study protocol for a randomized controlled effectiveness trial. Contemp Clin Trials 2016; 48:125-32. [PMID: 27103232 DOI: 10.1016/j.cct.2016.04.007] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2016] [Revised: 04/05/2016] [Accepted: 04/10/2016] [Indexed: 11/16/2022]
Abstract
BACKGROUND Dutch practice nurses sub-optimally adhere to evidence-based smoking cessation guidelines. Web-based computer-tailoring could be effective in improving their guideline adherence. Therefore, this paper aims to describe the development of a web-based computer-tailored program and the design of a randomized controlled trial testing its (cost-)effectiveness. METHODS Theoretically grounded in the I-Change Model and Self-Determination Theory, and based on the results of a qualitative needs assessment among practice nurses, a web-based computer-tailored program was developed including three modules with tailored advice, an online forum, modules with up-to-date information about smoking cessation, Frequently Asked Questions (FAQs) and project information, and a counseling checklist. The program's effects are assessed by comparing an intervention group (access to all modules) with a control group (access to FAQs, project information and counseling checklist only). Smoking cessation guideline adherence and behavioral predictors (i.e. intention, knowledge, attitude, self-efficacy, social influence, action and coping planning) are measured at baseline and at 6- and 12-month follow-up. Additionally, the program's indirect effects on smokers' quit rates and the number of quit attempts are assessed after 6 and 12months. DISCUSSION This paper describes the development of a web-based computer-tailored adherence support program for practice nurses and the study design of a randomized controlled trial testing its (cost-)effectiveness. This program potentially contributes to improving the quality of smoking cessation care in Dutch general practices. If proven effective, the program could be adapted for use by other healthcare professionals, increasing the public health benefits of improved smoking cessation counseling for smokers.
Collapse
Affiliation(s)
- D de Ruijter
- Department of Health Promotion, Maastricht University, Maastricht, the Netherlands.
| | - E S Smit
- Department of Communication Science, University of Amsterdam, Amsterdam, the Netherlands.
| | - H de Vries
- Department of Health Promotion, Maastricht University, Maastricht, the Netherlands.
| | - C Hoving
- Department of Health Promotion, Maastricht University, Maastricht, the Netherlands.
| |
Collapse
|
17
|
Nitsch M, Dimopoulos CN, Flaschberger E, Saffran K, Kruger JF, Garlock L, Wilfley DE, Taylor CB, Jones M. A Guided Online and Mobile Self-Help Program for Individuals With Eating Disorders: An Iterative Engagement and Usability Study. J Med Internet Res 2016; 18:e7. [PMID: 26753539 PMCID: PMC4726867 DOI: 10.2196/jmir.4972] [Citation(s) in RCA: 43] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2015] [Revised: 10/28/2015] [Accepted: 11/11/2015] [Indexed: 11/20/2022] Open
Abstract
Background Numerous digital health interventions have been developed for mental health promotion and intervention, including eating disorders. Efficacy of many interventions has been evaluated, yet knowledge about reasons for dropout and poor adherence is scarce. Most digital health intervention studies lack appropriate research design and methods to investigate individual engagement issues. User engagement and program usability are inextricably linked, making usability studies vital in understanding and improving engagement. Objective The aim of this study was to explore engagement and corresponding usability issues of the Healthy Body Image Program—a guided online intervention for individuals with body image concerns or eating disorders. The secondary aim was to demonstrate the value of usability research in order to investigate engagement. Methods We conducted an iterative usability study based on a mixed-methods approach, combining cognitive and semistructured interviews as well as questionnaires, prior to program launch. Two separate rounds of usability studies were completed, testing a total of 9 potential users. Thematic analysis and descriptive statistics were used to analyze the think-aloud tasks, interviews, and questionnaires. Results Participants were satisfied with the overall usability of the program. The average usability score was 77.5/100 for the first test round and improved to 83.1/100 after applying modifications for the second iteration. The analysis of the qualitative data revealed five central themes: layout, navigation, content, support, and engagement conditions. The first three themes highlight usability aspects of the program, while the latter two highlight engagement issues. An easy-to-use format, clear wording, the nature of guidance, and opportunity for interactivity were important issues related to usability. The coach support, time investment, and severity of users’ symptoms, the program’s features and effectiveness, trust, anonymity, and affordability were relevant to engagement. Conclusions This study identified salient usability and engagement features associated with participant motivation to use the Healthy Body Image Program and ultimately helped improve the program prior to its implementation. This research demonstrates that improvements in usability and engagement can be achieved by testing and adjusting intervention design and content prior to program launch. The results are consistent with related research and reinforce the need for further research to identify usage patterns and effective means for reducing dropout. Digital health research should include usability studies prior to efficacy trials to help create more user-friendly programs that have a higher likelihood of “real-world” adoption.
Collapse
Affiliation(s)
- Martina Nitsch
- Ferdinand Porsche Distance Learning University of Applied Sciences, Vienna, Austria.
| | | | | | | | | | | | | | | | | |
Collapse
|
18
|
Kopanitsa G. Evaluation Study for an ISO 13606 Archetype Based Medical Data Visualization Method. J Med Syst 2015; 39:82. [PMID: 26160021 DOI: 10.1007/s10916-015-0270-y] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2015] [Accepted: 06/29/2015] [Indexed: 11/28/2022]
Abstract
The objective of this evaluation study is to assess a method for standard based medical data visualization. The method allows flexible and customizable visualization for ISO 13606 archetype based medical data. The chosen evaluation concept is based the Guideline for Good Evaluation Practice in Health Informatics (GEP-HI). The stages of the study were identified. Each stage got a detailed description. We also identified the participants and their required qualifications and responsibilities. The evaluation location was described in details. The evaluation metrics were defined. The questionnaires for doctors, patients and experts were developed to fulfill the requirements of the evaluation study. The study was performed in Tomsk, Russia. 30 patients and 5 doctors participated in the study. The overall performance of the users reached the expert level by the end of the study. Patients as well as medical staff stated in their comments that the usability of the system was high, and they preferred it to the previously used paper-based and computer based systems. This was also shown by the high level of satisfaction measured within our study. The visualization approach, integrated into the electronic health record, was well accepted in our pilot setting with high usability scores from patients and doctors alike. The results showed the efficiency for both modeling and visualization part of the system.
Collapse
Affiliation(s)
- Georgy Kopanitsa
- Institute Cybernetic Center, Tomsk Polytechnic University, Lenina 30, 634050, Tomsk, Russia,
| |
Collapse
|
19
|
Voncken-Brewster V, Tange H, de Vries H, Nagykaldi Z, Winkens B, van der Weijden T. A randomized controlled trial evaluating the effectiveness of a web-based, computer-tailored self-management intervention for people with or at risk for COPD. Int J Chron Obstruct Pulmon Dis 2015; 10:1061-73. [PMID: 26089656 PMCID: PMC4467652 DOI: 10.2147/copd.s81295] [Citation(s) in RCA: 41] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022] Open
Abstract
Introduction COPD is a leading cause of morbidity and mortality. Self-management interventions are considered important in order to limit the progression of the disease. Computer-tailored interventions could be an effective tool to facilitate self-management. Methods This randomized controlled trial tested the effectiveness of a web-based, computer-tailored COPD self-management intervention on physical activity and smoking behavior. Participants were recruited from an online panel and through primary care practices. Those at risk for or diagnosed with COPD, between 40 and 70 years of age, proficient in Dutch, with access to the Internet, and with basic computer skills (n=1,325), were randomly assigned to either the intervention group (n=662) or control group (n=663). The intervention group received the web-based self-management application, while the control group received no intervention. Participants were not blinded to group assignment. After 6 months, the effect of the intervention was assessed for the primary outcomes, smoking cessation and physical activity, by self-reported 7-day point prevalence abstinence and the International Physical Activity Questionnaire – Short Form. Results Of the 1,325 participants, 1,071 (80.8%) completed the 6-month follow-up questionnaire. No significant treatment effect was found on either outcome. The application however, was used by only 36% of the participants in the experimental group. Conclusion A possible explanation for the nonsignificant effect on the primary outcomes, smoking cessation and physical activity, could be the low exposure to the application as engagement with the program has been shown to be crucial for the effectiveness of computer-tailored interventions. (Netherlands Trial Registry number: NTR3421.)
Collapse
Affiliation(s)
- Viola Voncken-Brewster
- Department of Family Medicine, School for Public Health and Primary Care (CAPHRI), Maastricht University Medical Center, Maastricht, Netherlands
| | - Huibert Tange
- Department of Family Medicine, School for Public Health and Primary Care (CAPHRI), Maastricht University Medical Center, Maastricht, Netherlands
| | - Hein de Vries
- Department of Health Promotion, School for Public Health and Primary Care (CAPHRI), Maastricht University Medical Center, Maastricht, Netherlands
| | - Zsolt Nagykaldi
- Department of Family and Preventive Medicine, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
| | - Bjorn Winkens
- Department of Methodology and Statistics, CAPHRI, Maastricht University Medical Center, Maastricht, Netherlands
| | - Trudy van der Weijden
- Department of Family Medicine, School for Public Health and Primary Care (CAPHRI), Maastricht University Medical Center, Maastricht, Netherlands
| |
Collapse
|
20
|
Payne AY, Surikova J, Liu S, Ross H, Mechetiuc T, Nolan RP. Usability Testing of an Internet-Based e-Counseling Platform for Adults With Chronic Heart Failure. JMIR Hum Factors 2015; 2:e7. [PMID: 27026267 PMCID: PMC4797699 DOI: 10.2196/humanfactors.4125] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2014] [Revised: 03/06/2015] [Accepted: 03/22/2015] [Indexed: 11/13/2022] Open
Abstract
Background Chronic heart failure (CHF) is a major cause of hospitalization and mortality. In order to maintain heart function and quality of life, patients with CHF need to follow recommended self-care guidelines (ie, eating a heart healthy diet, exercising regularly, taking medications as prescribed, monitoring their symptoms, and living a smoke-free life). Yet, adherence to self-care is poor. We have developed an Internet-based e-Counseling platform, Canadian e-Platform to Promote Behavioral Self-Management in Chronic Heart Failure (CHF-CePPORT), that aims to improve self-care adherence and quality of life in people with CHF. Before assessing the efficacy of this e-platform in a multisite, double-blind, randomized controlled trial, we evaluated the usability of the prototype website. Objective The objective of the study was to assess the usability of the CHF-CePPORT e-Counseling platform in terms of navigation, content, and layout. Methods CHF patients were purposively sampled from the Heart Function Clinic at the Peter Munk Cardiac Center, University Health Network, to participate in this study. We asked the consented participants to perform specific tasks on the website. These tasks included watching self-help videos and reviewing content as directed. Their interactions with the website were captured using the “think aloud” protocol. After completing the tasks, research personnel conducted a semi-structured interview with each participant to assess their experience with the website. Content analysis of the transcripts from the “think aloud” sessions and the interviews was conducted to identify themes related to navigation, content, and layout of the website. Descriptive statistics were used to summarize the satisfaction data. Results A total of 7 men and women (ages 39-77) participated in 2 iterative rounds of testing. Overall, all participants were very satisfied with the content and layout of the website. They reported that the content was helpful to their management of CHF and that it reflected their experiences in coping with CHF. The layout was professional and friendly. The use of videos made the learning process entertaining. However, they experienced many navigation errors in the first round of testing. For example, some participants were not sure how to navigate across a series of Web pages. Based on the experiences that were reported in the first round, we made several changes to the navigation structure. This included using large navigation buttons to direct users to each section and providing tutorial videos to familiarize users with our website. We assessed whether these changes improved user navigation in the second round of testing. The major finding is that participants made fewer navigation errors and they did not identify any new problems. Conclusions We found evidence to support the usability of our CHF-CePPORT e-Counseling platform. Our findings highlight the importance of a clear and easy-to-follow navigation structure on user experience.
Collapse
Affiliation(s)
- Ada Ym Payne
- Cardiac eHealth, Peter Munk Cardiac Centre, University Health Network, Toronto, ON, Canada.
| | | | | | | | | | | |
Collapse
|
21
|
Vassilev I, Rowsell A, Pope C, Kennedy A, O'Cathain A, Salisbury C, Rogers A. Assessing the implementability of telehealth interventions for self-management support: a realist review. Implement Sci 2015; 10:59. [PMID: 25906822 PMCID: PMC4424965 DOI: 10.1186/s13012-015-0238-9] [Citation(s) in RCA: 85] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2014] [Accepted: 03/26/2015] [Indexed: 11/28/2022] Open
Abstract
Background There is a substantial and continually growing literature on the effectiveness and implementation of discrete telehealth interventions for health condition management. However, it is difficult to predict which technologies are likely to work and be used in practice. In this context, identifying the core mechanisms associated with successful telehealth implementation is relevant to consolidating the likely elements for ensuring a priori optimal design and deployment of telehealth interventions for supporting patients with long-term conditions (LTCs). Methods We adopted a two-stage realist synthesis approach to identify the core mechanisms underpinning telehealth interventions. In the second stage of the review, we tested inductively and refined our understanding of the mechanisms. We reviewed qualitative papers focused on COPD, heart failure, diabetes, and behaviours and complications associated with these conditions. The review included 15 papers published 2009 to 2014. Results Three concepts were identified, which suggested how telehealth worked to engage and support health-related work. Whether or not and how a telehealth intervention enables or limits the possibility for relationships with professionals and/or peers. Telehealth has the potential to reshape and extend existing relationships, acting as a partial substitute for the role of health professionals. The second concept is fit: successful telehealth interventions are those that can be well integrated into everyday life and health care routines and the need to be easy to use, compatible with patients’ existing environment, skills, and capacity, and that do not significantly disrupt patients’ lives and routines. The third concept is visibility: visualisation of symptoms and feedback has the capacity to improve knowledge, motivation, and a sense of empowerment; engage network members; and reinforce positive behaviour change, prompts for action and surveillance. Conclusions Upfront consideration should be given to the mechanisms that are most likely to ensure the successful development and implementation of telehealth interventions. These include considerations about whether and how the telehealth intervention enables or limits the possibility for relationships with professionals and peers, how it fits with existing environment and capacities to self-manage, and visibility-enabling-enhanced awareness to self and others.
Collapse
Affiliation(s)
- Ivaylo Vassilev
- Faculty of Health Sciences, University of Southampton, Building 67, University Road, Highfield, Southampton, SO17 1BJ, UK.
| | - Alison Rowsell
- University of Southampton, Building 44, Highfield Campus, Highfield, Southampton, SO17 1BJ, UK. A.C.O'
| | - Catherine Pope
- Faculty of Health Sciences, University of Southampton, Building 67, University Road, Highfield, Southampton, SO17 1BJ, UK.
| | - Anne Kennedy
- Faculty of Health Sciences, University of Southampton, Building 67, University Road, Highfield, Southampton, SO17 1BJ, UK.
| | - Alicia O'Cathain
- Health Services Research Section, Medical Care Research Unit, ScHARR, University of Sheffield, 30 Regent Street, Sheffield, S1 4DA, UK.
| | - Chris Salisbury
- , Office Room 1.01b, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS, UK.
| | - Anne Rogers
- Faculty of Health Sciences, University of Southampton, Building 67, University Road, Highfield, Southampton, SO17 1BJ, UK.
| |
Collapse
|
22
|
Revenäs Å, Opava CH, Martin C, Demmelmaier I, Keller C, Åsenlöf P. Development of a web-based and mobile app to support physical activity in individuals with rheumatoid arthritis: results from the second step of a co-design process. JMIR Res Protoc 2015; 4:e22. [PMID: 25665589 PMCID: PMC4342685 DOI: 10.2196/resprot.3795] [Citation(s) in RCA: 28] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2014] [Accepted: 12/23/2014] [Indexed: 01/07/2023] Open
Abstract
Background Long-term adherence to physical activity recommendations remains challenging for most individuals with rheumatoid arthritis (RA) despite evidence for its health benefits. Objective The aim of this study was to provide basic data on system requirement specifications for a Web-based and mobile app to self-manage physical activity. More specifically, we explored the target user group, features of the future app, and correlations between the system requirements and the established behavior change techniques (BCTs). Methods We used a participatory action research design. Qualitative data were collected using multiple methods in four workshops. Participants were 5 individuals with RA, a clinical physiotherapist, an officer from the Swedish Rheumatism Association, a Web designer, and 2 physiotherapy researchers. A taxonomy was used to determine the degree of correlation between the system requirements and established BCTs. Results Participants agreed that the future Web-based and mobile app should be based on two major components important for maintaining physical activity: (1) a calendar feature for goal setting, planning, and recording of physical activity performance and progress, and (2) a small community feature for positive feedback and support from peers. All system requirements correlated with established BCTs, which were coded as 24 different BCTs. Conclusions To our knowledge, this study is the first to involve individuals with RA as co-designers, in collaboration with clinicians, researchers, and Web designers, to produce basic data to generate system requirement specifications for an eHealth service. The system requirements correlated to the BCTs, making specifications of content and future evaluation of effectiveness possible.
Collapse
Affiliation(s)
- Åsa Revenäs
- Division of Physiotherapy, Department of Neurobiology, Care Sciences and Society, Karolinska Institutet, Huddinge, Sweden.
| | | | | | | | | | | |
Collapse
|
23
|
Stellefson M, Chaney B, Chaney D, Paige S, Payne-Purvis C, Tennant B, Walsh-Childers K, Sriram P, Alber J. Engaging community stakeholders to evaluate the design, usability, and acceptability of a chronic obstructive pulmonary disease social media resource center. JMIR Res Protoc 2015; 4:e17. [PMID: 25630449 PMCID: PMC4336200 DOI: 10.2196/resprot.3959] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2014] [Revised: 12/05/2014] [Accepted: 01/05/2015] [Indexed: 12/31/2022] Open
Abstract
Background Patients with chronic obstructive pulmonary disease (COPD) often report inadequate access to comprehensive patient education resources. Objective The purpose of this study was to incorporate community-engagement principles within a mixed-method research design to evaluate the usability and acceptability of a self-tailored social media resource center for medically underserved patients with COPD. Methods A multiphase sequential design (qual → QUANT → quant + QUAL) was incorporated into the current study, whereby a small-scale qualitative (qual) study informed the design of a social media website prototype that was tested with patients during a computer-based usability study (QUANT). To identify usability violations and determine whether or not patients found the website prototype acceptable for use, each patient was asked to complete an 18-item website usability and acceptability questionnaire, as well as a retrospective, in-depth, semistructured interview (quant + QUAL). Results The majority of medically underserved patients with COPD (n=8, mean 56 years, SD 7) found the social media website prototype to be easy to navigate and relevant to their self-management information needs. Mean responses on the 18-item website usability and acceptability questionnaire were very high on a scale of 1 (strongly disagree) to 5 (strongly agree) (mean 4.72, SD 0.33). However, the majority of patients identified several usability violations related to the prototype’s information design, interactive capabilities, and navigational structure. Specifically, 6 out of 8 (75%) patients struggled to create a log-in account to access the prototype, and 7 out of 8 patients (88%) experienced difficulty posting and replying to comments on an interactive discussion forum. Conclusions Patient perceptions of most social media website prototype features (eg, clickable picture-based screenshots of videos, comment tools) were largely positive. Mixed-method stakeholder feedback was used to make design recommendations, categorize usability violations, and prioritize potential solutions for improving the usability of a social media resource center for COPD patient education.
Collapse
Affiliation(s)
- Michael Stellefson
- Center for Digital Health and Wellness, Department of Health Education and Behavior, University of Florida, Gainesville, FL, United States.
| | | | | | | | | | | | | | | | | |
Collapse
|
24
|
Horvath KJ, Ecklund AM, Hunt SL, Nelson TF, Toomey TL. Developing Internet-based health interventions: a guide for public health researchers and practitioners. J Med Internet Res 2015; 17:e28. [PMID: 25650702 PMCID: PMC4319079 DOI: 10.2196/jmir.3770] [Citation(s) in RCA: 43] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2014] [Revised: 11/28/2014] [Accepted: 12/15/2014] [Indexed: 11/13/2022] Open
Abstract
Background Researchers and practitioners interested in developing online health interventions most often rely on Web-based and print resources to guide them through the process of online intervention development. Although useful for understanding many aspects of best practices for website development, missing from these resources are concrete examples of experiences in online intervention development for health apps from the perspective of those conducting online health interventions. Objective This study aims to serve as a series of case studies in the development of online health interventions to provide insights for researchers and practitioners who are considering technology-based interventional or programmatic approaches. Methods A convenience sample of six study coordinators and five principal investigators at a large, US-based land grant university were interviewed about the process of developing online interventions in the areas of alcohol policy, adolescent health, medication adherence, and human immunodeficiency virus prevention in transgender persons and in men who have sex with men. Participants were asked questions that broadly addressed each of the four phases of the User-Centered Design Process Map from the US Department of Health and Human Services' Research-Based Web Design & Usability Guidelines. Interviews were audio recorded and transcribed. Qualitative codes were developed using line-by-line open coding for all transcripts, and all transcripts were coded independently by at least 2 authors. Differences among coders were resolved with discussion. Results We identified the following seven themes: (1) hire a strong (or at least the right) research team, (2) take time to plan before beginning the design process, (3) recognize that vendors and researchers have differing values, objectives, and language, (4) develop a detailed contract, (5) document all decisions and development activities, (6) use a content management system, and (7) allow extra time for testing and debugging your intervention. Each of these areas is discussed in detail, with supporting quotations from principal investigators and study coordinators. Conclusions The values held by members of each participating organization involved in the development of the online intervention or program, as well as the objectives that are trying to be met with the website, must be considered. These defined values and objectives should prompt an open and explicit discussion about the scope of work, budget, and other needs from the perspectives of each organization. Because of the complexity of developing online interventions, researchers and practitioners should become familiar with the process and how it may differ from the development and implementation of in-person interventions or programs. To assist with this, the intervention team should consider expanding the team to include experts in computer science or learning technologies, as well as taking advantage of institutional resources that will be needed for successful completion of the project. Finally, we describe the tradeoff between funds available for online intervention or program development and the complexity of the project.
Collapse
Affiliation(s)
- Keith J Horvath
- Division of Epidemiology and Community Health, University of Minnesota, Minneapolis, MN, United States.
| | | | | | | | | |
Collapse
|
25
|
Cristancho-Lacroix V, Moulin F, Wrobel J, Batrancourt B, Plichart M, De Rotrou J, Cantegreil-Kallen I, Rigaud AS. A web-based program for informal caregivers of persons with Alzheimer's disease: an iterative user-centered design. JMIR Res Protoc 2014; 3:e46. [PMID: 25263541 PMCID: PMC4180326 DOI: 10.2196/resprot.3607] [Citation(s) in RCA: 29] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2014] [Revised: 07/24/2014] [Accepted: 07/25/2014] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND Web-based programs have been developed for informal caregivers of people with Alzheimer's disease (PWAD). However, these programs can prove difficult to adopt, especially for older people, who are less familiar with the Internet than other populations. Despite the fundamental role of usability testing in promoting caregivers' correct use and adoption of these programs, to our knowledge, this is the first study describing this process before evaluating a program for caregivers of PWAD in a randomized clinical trial. OBJECTIVE The objective of the study was to describe the development process of a fully automated Web-based program for caregivers of PWAD, aiming to reduce caregivers' stress, and based on the user-centered design approach. METHODS There were 49 participants (12 health care professionals, 6 caregivers, and 31 healthy older adults) that were involved in a double iterative design allowing for the adaptation of program content and for the enhancement of website usability. This process included three component parts: (1) project team workshops, (2) a proof of concept, and (3) two usability tests. The usability tests were based on a mixed methodology using behavioral analysis, semistructured interviews, and a usability questionnaire. RESULTS The user-centered design approach provided valuable guidelines to adapt the content and design of the program, and to improve website usability. The professionals, caregivers (mainly spouses), and older adults considered that our project met the needs of isolated caregivers. Participants underlined that contact between caregivers would be desirable. During usability observations, the mistakes of users were also due to ergonomics issues from Internet browsers and computer interfaces. Moreover, negative self-stereotyping was evidenced, when comparing interviews and results of behavioral analysis. CONCLUSIONS Face-to-face psycho-educational programs may be used as a basis for Web-based programs. Nevertheless, a user-centered design approach involving targeted users (or their representatives) remains crucial for their correct use and adoption. For future user-centered design studies, we recommend to involve end-users from preconception stages, using a mixed research method in usability evaluations, and implementing pilot studies to evaluate acceptability and feasibility of programs.
Collapse
Affiliation(s)
- Victoria Cristancho-Lacroix
- Assistance Publique des Hôpitaux de Paris (APHP), Hôpital Broca, Service de Gérontologie, Pôle de Gériatrie, Paris, France.
| | | | | | | | | | | | | | | |
Collapse
|
26
|
|
27
|
Mira JJ, Navarro I, Botella F, Borrás F, Nuño-Solinís R, Orozco D, Iglesias-Alonso F, Pérez-Pérez P, Lorenzo S, Toro N. A Spanish pillbox app for elderly patients taking multiple medications: randomized controlled trial. J Med Internet Res 2014; 16:e99. [PMID: 24705022 PMCID: PMC4004137 DOI: 10.2196/jmir.3269] [Citation(s) in RCA: 113] [Impact Index Per Article: 10.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2014] [Revised: 03/04/2014] [Accepted: 03/13/2014] [Indexed: 11/18/2022] Open
Abstract
Background Nonadherence and medication errors are common among patients with complex drug regimens. Apps for smartphones and tablets are effective for improving adherence, but they have not been tested in elderly patients with complex chronic conditions and who typically have less experience with this type of technology. Objective The objective of this study was to design, implement, and evaluate a medication self-management app (called ALICE) for elderly patients taking multiple medications with the intention of improving adherence and safe medication use. Methods A single-blind randomized controlled trial was conducted with a control and an experimental group (N=99) in Spain in 2013. The characteristics of ALICE were specified based on the suggestions of 3 nominal groups with a total of 23 patients and a focus group with 7 professionals. ALICE was designed for Android and iOS to allow for the personalization of prescriptions and medical advice, showing images of each of the medications (the packaging and the medication itself) together with alerts and multiple reminders for each alert. The randomly assigned patients in the control group received oral and written information on the safe use of their medications and the patients in the experimental group used ALICE for 3 months. Pre and post measures included rate of missed doses and medication errors reported by patients, scores from the 4-item Morisky Medication Adherence Scale (MMAS-4), level of independence, self-perceived health status, and biochemical test results. In the experimental group, data were collected on their previous experience with information and communication technologies, their rating of ALICE, and their perception of the level of independence they had achieved. The intergroup intervention effects were calculated by univariate linear models and ANOVA, with the pre to post intervention differences as the dependent variables. Results Data were obtained from 99 patients (48 and 51 in the control and experimental groups, respectively). Patients in the experimental group obtained better MMAS-4 scores (P<.001) and reported fewer missed doses of medication (P=.02). ALICE only helped to significantly reduce medication errors in patients with an initially higher rate of errors (P<.001). Patients with no experience with information and communication technologies reported better adherence (P<.001), fewer missed doses (P<.001), and fewer medication errors (P=.02). The mean satisfaction score for ALICE was 8.5 out of 10. In all, 45 of 51 patients (88%) felt that ALICE improved their independence in managing their medications. Conclusions The ALICE app improves adherence, helps reduce rates of forgetting and of medication errors, and increases perceived independence in managing medication. Elderly patients with no previous experience with information and communication technologies are capable of effectively using an app designed to help them take their medicine more safely. Trial Registration Clinicaltrials.gov NCT02071498; http://clinicaltrials.gov/ct2/show/NCT02071498 (Archived by WebCite at http://www.webcitation.org/6OJjdHVhD).
Collapse
Affiliation(s)
- José Joaquín Mira
- Sant Joan-Alicante Health District, Consellería Sanidad, Alicante, Spain
| | | | | | | | | | | | | | | | | | | |
Collapse
|
28
|
Voncken-Brewster V, Tange H, Moser A, Nagykaldi Z, de Vries H, van der Weijden T. Integrating a tailored e-health self-management application for chronic obstructive pulmonary disease patients into primary care: a pilot study. BMC FAMILY PRACTICE 2014; 15:4. [PMID: 24400676 PMCID: PMC3907149 DOI: 10.1186/1471-2296-15-4] [Citation(s) in RCA: 28] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/24/2013] [Accepted: 01/06/2014] [Indexed: 11/13/2022]
Abstract
Background Changes in reimbursement have been compelling for Dutch primary care practices to apply a disease management approach for patients with chronic obstructive pulmonary disease (COPD). This approach includes individual patient consultations with a practice nurse, who coaches patients in COPD management. The aim of this study was to gauge the feasibility of adding a web-based patient self-management support application, by assessing patients’ self-management, patients’ health status, the impact on the organization of care, and the level of application use and appreciation. Methods The study employed a mixed methods design. Six practice nurses recruited COPD patients during a consultation. The e-Health application included a questionnaire that captured information on demographics, self-management related behaviors (smoking cessation, physical activity and medication adherence) and their determinants, and nurse recommendations. The application provided tailored feedback messages to patients and provided the nurse with reports. Data were collected through questionnaires and medical record abstractions at baseline and one year later. Semi-structured interviews with patients and nurses were conducted. Descriptive statistics were calculated for quantitative data and content analysis was used to analyze the qualitative data. Results Eleven patients, recruited by three nurses, used the application 1 to 7 times (median 4). Most patients thought that the application supported self-management, but their interest diminished after multiple uses. Impact on patients’ health could not be determined due to the small sample size. Nurses reported benefits for the organization of care and made suggestions to optimize the use of the reports. Conclusion Results suggest that it is possible to integrate a web-based COPD self-management application into the current primary care disease management process. The pilot study also revealed opportunities to improve the application and reports, in order to increase technology use and appreciation.
Collapse
Affiliation(s)
- Viola Voncken-Brewster
- CAPHRI, Department of Family Medicine, Maastricht University Medical Center, Maastricht, Netherlands.
| | | | | | | | | | | |
Collapse
|
29
|
Beaujean D, van Velsen L, van Gemert-Pijnen JE, Maat A, van Steenbergen JE, Crutzen R. Using risk group profiles as a lightweight qualitative approach for intervention development: an example of prevention of tick bites and lyme disease. JMIR Res Protoc 2013; 2:e45. [PMID: 24172875 PMCID: PMC3841373 DOI: 10.2196/resprot.2760] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2013] [Revised: 09/13/2013] [Accepted: 09/16/2013] [Indexed: 12/11/2022] Open
Abstract
BACKGROUND Many public health campaigns use a one-size-fits-all strategy to achieve their desired effect. Public health campaigns for tick bites and Lyme disease (LD) in many countries convey all relevant preventive measures to all members of the public. Although preventing tick bites (eg, by wearing protective clothing or using repellants) and checking for tick bites after visiting a risk area are effective and cost-efficient methods to prevent an individual from contracting a tick-borne disease, public compliance to these methods is low. OBJECTIVE We aimed to identify the group of individuals within the general Dutch population that are at high risk of being bitten by a tick or developing LD and to describe their characteristics, knowledge, and perceptions. The incidence of patients visiting their general practitioner for tick bites and erythema migrans (the first sign of LD) has increased tremendously in the last decades in the Netherlands and other European countries; therefore, our efforts can be used to counter this troubling trend. METHODS We conducted in-depth semi-structured interviews to identify individuals belonging to the average risk group. Participants were recruited in two ways. Patients who visited two municipal health services travel health clinics (one in a high-endemic area and one in a low-endemic area) were asked to participate. This resulted in 18 interviews. Further, parents were recruited using the convenience sampling method, which resulted in 7 interviews. We discontinued interviewing when the point of data saturation was reached. We analyzed the results immediately after each interview to identify the point of data saturation. Data saturation is when the new interviews provided no new information compared to the previous interviews. The interviews were transcribed and analyzed using inductive thematic analysis. RESULTS We identified four groups at risk of being bitten by ticks and developing LD among the general Dutch population. The groups were as follows: (1) outdoor people that check for tick bites, (2) outdoor people that do not check for tick bites, (3) parents that check their children for tick bites, and (4) parents that do not check their children for tick bites. Previous experience with ticks or LD was the main denominator between the groups. Checking for tick bites is a more easily adopted measure than preventing tick bites. Therefore, for all groups, public health efforts in the future should primarily emphasize on the importance of checking for tick bites. CONCLUSIONS The lightweight qualitative approach presented in this paper is highly relevant in tailoring public health efforts toward specific groups. The profiles of members in each risk group and the motivations underlying the behaviors of the members in each risk group can be used to determine the features and content of a targeted communication strategy about ticks and LD.
Collapse
Affiliation(s)
- Desiree Beaujean
- National Institute for Public Health and the Environment, National Coordination Centre for Outbreak Management (LCI), Bilthoven, Netherlands.
| | | | | | | | | | | |
Collapse
|
30
|
Voncken-Brewster V, Tange H, de Vries H, Nagykaldi Z, Winkens B, van der Weijden T. A randomised controlled trial testing a web-based, computer-tailored self-management intervention for people with or at risk for chronic obstructive pulmonary disease: a study protocol. BMC Public Health 2013; 13:557. [PMID: 23742208 PMCID: PMC3691773 DOI: 10.1186/1471-2458-13-557] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2013] [Accepted: 06/03/2013] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Chronic Obstructive Pulmonary Disease (COPD) is a major cause of morbidity and mortality. Effective self-management support interventions are needed to improve the health and functional status of people with COPD or at risk for COPD. Computer-tailored technology could be an effective way to provide this support. METHODS/DESIGN This paper presents the protocol of a randomised controlled trial testing the effectiveness of a web-based, computer-tailored self-management intervention to change health behaviours of people with or at risk for COPD. An intervention group will be compared to a usual care control group, in which the intervention group will receive a web-based, computer-tailored self-management intervention. Participants will be recruited from an online panel and through general practices. Outcomes will be measured at baseline and at 6 months. The primary outcomes will be smoking behaviour, measuring the 7-day point prevalence abstinence and physical activity, measured in minutes. Secondary outcomes will include dyspnoea score, quality of life, stages of change, intention to change behaviour and alternative smoking behaviour measures, including current smoking behaviour, 24-hour point prevalence abstinence, prolonged abstinence, continued abstinence and number of quit attempts. DISCUSSION To the best of our knowledge, this will be the first randomised controlled trial to test the effectiveness of a web-based, computer-tailored self-management intervention for people with or at risk for COPD. The results will be important to explore the possible benefits of computer-tailored interventions for the self-management of people with or at risk for COPD and potentially other chronic health conditions. DUTCH TRIAL REGISTER NTR3421.
Collapse
Affiliation(s)
- Viola Voncken-Brewster
- School for Public Health and Primary Care (CAPHRI), Department of General Practice, Maastricht University Medical Centre, PO Box 616, 6200MD, Maastricht, Netherlands.
| | | | | | | | | | | |
Collapse
|