1
|
Podda J, Tacchino A, Ponzio M, Di Antonio F, Susini A, Pedullà L, Battaglia MA, Brichetto G. Mobile Health App (DIGICOG-MS) for Self-Assessment of Cognitive Impairment in People With Multiple Sclerosis: Instrument Validation and Usability Study. JMIR Form Res 2024; 8:e56074. [PMID: 38900535 PMCID: PMC11224705 DOI: 10.2196/56074] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2024] [Revised: 05/06/2024] [Accepted: 05/08/2024] [Indexed: 06/21/2024] Open
Abstract
BACKGROUND Mobile health (mHealth) apps have proven useful for people with multiple sclerosis (MS). Thus, easy-to-use digital solutions are now strongly required to assess and monitor cognitive impairment, one of the most disturbing symptoms in MS that is experienced by almost 43% to 70% of people with MS. Therefore, we developed DIGICOG-MS (Digital assessment of Cognitive Impairment in Multiple Sclerosis), a smartphone- and tablet-based mHealth app to self-assess cognitive impairment in MS. OBJECTIVE This study aimed to test the validity and usability of the novel mHealth app with a sample of people with MS. METHODS DIGICOG-MS includes 4 digital tests assumed to evaluate the most affected cognitive domains in MS (visuospatial memory [VSM], verbal memory [VM], semantic fluency [SF], and information processing speed [IPS]) and inspired by traditional paper-based tests that assess the same cognitive functions (10/36 Spatial Recall Test, Rey Auditory Verbal Learning Test, Word List Generation, Symbol Digit Modalities Test). Participants were asked to complete both digital and traditional assessments in 2 separate sessions. Convergent validity was analyzed using the Pearson correlation coefficient to determine the strength of the associations between digital and traditional tests. To test the app's reliability, the agreement between 2 repeated measurements was assessed using intraclass correlation coefficients (ICCs). Usability of DIGICOG-MS was evaluated using the System Usability Scale (SUS) and mHealth App Usability Questionnaire (MAUQ) administered at the conclusion of the digital session. RESULTS The final sample consisted of 92 people with MS (60 women) followed as outpatients at the Italian Multiple Sclerosis Society (AISM) Rehabilitation Service of Genoa (Italy). They had a mean age of 51.38 (SD 11.36) years, education duration of 13.07 (SD 2.74) years, disease duration of 12.91 (SD 9.51) years, and a disability level (Expanded Disability Status Scale) of 3.58 (SD 1.75). Relapsing-remitting MS was most common (68/92, 74%), followed by secondary progressive (15/92, 16%) and primary progressive (9/92, 10%) courses. Pearson correlation analyses indicated significantly strong correlations for VSM, VM, SF, and IPS (all P<.001), with r values ranging from 0.58 to 0.78 for all cognitive domains. Test-retest reliability of the mHealth app was excellent (ICCs>0.90) for VM and IPS and good for VSM and SF (ICCs>0.80). Moreover, the SUS score averaged 84.5 (SD 13.34), and the mean total MAUQ score was 104.02 (SD 17.69), suggesting that DIGICOG-MS was highly usable and well appreciated. CONCLUSIONS The DIGICOG-MS tests were strongly correlated with traditional paper-based evaluations. Furthermore, people with MS positively evaluated DIGICOG-MS, finding it highly usable. Since cognitive impairment poses major limitations for people with MS, these findings open new paths to deploy digital cognitive tests for MS and further support the use of a novel mHealth app for cognitive self-assessment by people with MS in clinical practice.
Collapse
Affiliation(s)
- Jessica Podda
- Scientific Research Area, Italian Multiple Sclerosis Foundation, Genoa, Italy
| | - Andrea Tacchino
- Scientific Research Area, Italian Multiple Sclerosis Foundation, Genoa, Italy
| | - Michela Ponzio
- Scientific Research Area, Italian Multiple Sclerosis Foundation, Genoa, Italy
| | - Federica Di Antonio
- Scientific Research Area, Italian Multiple Sclerosis Foundation, Genoa, Italy
| | - Alessia Susini
- Scientific Research Area, Italian Multiple Sclerosis Foundation, Genoa, Italy
| | - Ludovico Pedullà
- Scientific Research Area, Italian Multiple Sclerosis Foundation, Genoa, Italy
| | - Mario Alberto Battaglia
- Department of Physiopathology, Experimental Medicine and Public Health, University of Siena, Siena, Italy
| | - Giampaolo Brichetto
- Scientific Research Area, Italian Multiple Sclerosis Foundation, Genoa, Italy
| |
Collapse
|
2
|
A smartphone app for the prevention and early intervention of body dysmorphic disorder: Development and evaluation of the content, usability, and aesthetics. Internet Interv 2022; 28:100521. [PMID: 35281703 PMCID: PMC8907679 DOI: 10.1016/j.invent.2022.100521] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/01/2021] [Revised: 02/28/2022] [Accepted: 03/01/2022] [Indexed: 11/23/2022] Open
Abstract
Body dysmorphic disorder (BDD) is an impairing condition characterized by excessive appearance concerns that frequently begin in adolescence, thus making this phase an eminent target for prevention and early intervention. We developed a cognitive-behavioral app-based program (AINA) intended for prevention and early intervention of BDD. As part of the iterative development process, perceptions of usability, aesthetics, and content were investigated. A sample of 38 adolescents and young adults aged between 14 and 21 years tested the app in a laboratory setting and completed a survey of diagnostic and user experience questionnaires. Overall, usability, aesthetics, and content of the app received positive evaluations. Regression analyses did not point to any large effects of age, gender, years of education, self-esteem, or BDD symptom severity on user evaluations. On average, participants had no concerns about privacy or data security of the app, indicating that these aspects will presumably not act as barriers to usage. Altogether, the present results are encouraging. Future research needs to examine whether AINA is an efficacious measure for prevention and early intervention of BDD.
Collapse
|
3
|
Domingos C, Costa P, Santos NC, Pêgo JM. Usability, Acceptability, and Satisfaction of a Wearable Activity Tracker in Older Adults: Observational Study in a Real-Life Context in Northern Portugal. J Med Internet Res 2022; 24:e26652. [PMID: 35080503 PMCID: PMC8829694 DOI: 10.2196/26652] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2020] [Revised: 03/24/2021] [Accepted: 07/05/2021] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND The use of activity trackers has significantly increased over the last few years. This technology has the potential to improve the levels of physical activity and health-related behaviors in older adults. However, despite the potential benefits, the rate of adoption remains low among older adults. Therefore, understanding how technology is perceived may potentially offer insight to promote its use. OBJECTIVE This study aimed to (1) assess acceptability, usability, and user satisfaction with the Xiaomi Mi Band 2 in Portuguese community-dwelling older adults in a real-world context; (2) explore the mediating effect of the usability on the relationship between user characteristics and satisfaction; and (3) examine the moderating effect of user characteristics on the relationship between usability and user satisfaction. METHODS Older adults used the Xiaomi Mi Band 2 over 15 days. The user experience was evaluated through the Technology Acceptance Model 3, System Usability Scale, and User Satisfaction Evaluation Questionnaire. An integrated framework for usability and user satisfaction was used to explore user experience. Statistical data analysis included descriptive data analysis, reliability analysis, confirmatory factor analysis, and mediation and moderation analyses. RESULTS A sample of 110 older adults with an average age of 68.41 years (SD 3.11) completed the user experience questionnaires. Mean user acceptance was very high-perceived ease of use: 6.45 (SD 0.78); perceptions of external control: 6.74 (SD 0.55); computer anxiety: 6.85 (SD 0.47); and behavioral intention: 6.60 (SD 0.97). The usability was excellent with an average score of 92.70 (SD 10.73), and user satisfaction was classified as a good experience 23.30 (SD 2.40). The mediation analysis confirmed the direct positive effect of usability on satisfaction (β=.530; P<.01) and the direct negative effect of depression on usability (β=-.369; P<.01). Lastly, the indirect effect of usability on user satisfaction was higher in individuals with lower Geriatric Depression Scale levels. CONCLUSIONS Findings demonstrate that the Xiaomi Mi Band 2 is suitable for older adults. Furthermore, the results confirmed usability as a determinant of satisfaction with the technology and extended the existing knowledge about wearable activity trackers in older adults.
Collapse
Affiliation(s)
- Célia Domingos
- Life and Health Sciences Research Institute (ICVS), School of Medicine, University of Minho, Braga, Portugal.,ICVS/3B's, PT Government Associate Laboratory, Braga/Guimarães, Portugal.,iCognitus4ALL - IT Solutions, Braga, Portugal.,Clinical Academic Center - 2CA-B, Braga, Portugal
| | - Patrício Costa
- Life and Health Sciences Research Institute (ICVS), School of Medicine, University of Minho, Braga, Portugal.,ICVS/3B's, PT Government Associate Laboratory, Braga/Guimarães, Portugal.,Clinical Academic Center - 2CA-B, Braga, Portugal
| | - Nadine Correia Santos
- Life and Health Sciences Research Institute (ICVS), School of Medicine, University of Minho, Braga, Portugal.,ICVS/3B's, PT Government Associate Laboratory, Braga/Guimarães, Portugal.,Clinical Academic Center - 2CA-B, Braga, Portugal.,Associação Centro de Medicina P5, School of Medicine, University of Minho, Braga, Portugal
| | - José Miguel Pêgo
- Life and Health Sciences Research Institute (ICVS), School of Medicine, University of Minho, Braga, Portugal.,ICVS/3B's, PT Government Associate Laboratory, Braga/Guimarães, Portugal.,iCognitus4ALL - IT Solutions, Braga, Portugal.,Clinical Academic Center - 2CA-B, Braga, Portugal
| |
Collapse
|
4
|
Domingos C, Costa PS, Santos NC, Pêgo JM. European Portuguese Version of the User Satisfaction Evaluation Questionnaire (USEQ): Transcultural Adaptation and Validation Study. JMIR Mhealth Uhealth 2021; 9:e19245. [PMID: 34185018 PMCID: PMC8278297 DOI: 10.2196/19245] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2020] [Revised: 09/24/2020] [Accepted: 10/10/2020] [Indexed: 01/18/2023] Open
Abstract
BACKGROUND Wearable activity trackers have the potential to encourage users to adopt healthier lifestyles by tracking daily health information. However, usability is a critical factor in technology adoption. Older adults may be more resistant to accepting novel technologies. Understanding the difficulties that older adults face when using activity trackers may be useful for implementing strategies to promote their use. OBJECTIVE The purpose of this study was to conduct a transcultural adaptation of the User Satisfaction Evaluation Questionnaire (USEQ) into European Portuguese and validate the adapted questionnaire. Additionally, we aimed to provide information about older adults' satisfaction regarding the use of an activity tracker (Xiaomi Mi Band 2). METHODS The USEQ was translated following internationally accepted guidelines. The psychometric evaluation of the final version of the translated USEQ was assessed based on structural validity using exploratory and confirmatory factor analyses. Construct validity was examined using divergent and discriminant validity analysis, and internal consistency was evaluated using Cronbach α and McDonald ω coefficients. RESULTS A total of 110 older adults completed the questionnaire. Confirmatory factor analysis supported the conceptual unidimensionality of the USEQ (χ24=7.313, P=.12, comparative fit index=0.973, Tucker-Lewis index=0.931, goodness of fit index=0.977, root mean square error of approximation=0.087, standardized root mean square residual=0.038). The internal consistency showed acceptable reliability (Cronbach α=.677, McDonald ω=0.722). Overall, 90% of the participants reported excellent satisfaction with the Xiaomi Mi Band 2. CONCLUSIONS The findings support the use of this translated USEQ as a valid and reliable tool for measuring user satisfaction with wearable activity trackers in older adults, with psychometric properties consistent with the original version.
Collapse
Affiliation(s)
- Célia Domingos
- Life and Health Sciences Research Institute, School of Medicine, University of Minho, Braga, Portugal.,ICVS/3B's, PT Government Associate Laboratory, Braga, Portugal.,iCognitus4ALL - IT Solutions, Braga, Portugal.,Clinical Academic Center - Braga, Braga, Portugal
| | - Patrício Soares Costa
- Life and Health Sciences Research Institute, School of Medicine, University of Minho, Braga, Portugal.,ICVS/3B's, PT Government Associate Laboratory, Braga, Portugal.,Faculty of Psychology and Education Sciences, University of Porto, Braga, Portugal
| | - Nadine Correia Santos
- Life and Health Sciences Research Institute, School of Medicine, University of Minho, Braga, Portugal.,ICVS/3B's, PT Government Associate Laboratory, Braga, Portugal.,Associação Centro de Medicina Digital P5, Braga, Portugal
| | - José Miguel Pêgo
- Life and Health Sciences Research Institute, School of Medicine, University of Minho, Braga, Portugal.,ICVS/3B's, PT Government Associate Laboratory, Braga, Portugal.,iCognitus4ALL - IT Solutions, Braga, Portugal.,Clinical Academic Center - Braga, Braga, Portugal
| |
Collapse
|
5
|
Sauer J, Sonderegger A, Schmutz S. Usability, user experience and accessibility: towards an integrative model. ERGONOMICS 2020; 63:1207-1220. [PMID: 32450782 DOI: 10.1080/00140139.2020.1774080] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/22/2019] [Accepted: 05/13/2020] [Indexed: 06/11/2023]
Abstract
Within the field of ergonomics, the concepts of usability, user experience and accessibility have played an increasingly important role. The present paper examined the meaning of these concepts and their relationship to each other, which included an analysis of the definitions, methods, and typical outcome measures employed. Despite some concerns in the literature about the utility of usability, user experience and accessibility as umbrella terms, we provide arguments for their continued use. The article proposes how the three concepts and their different perspectives can be integrated. We propose the term 'interaction experience' (IX) as a higher-level concept. Due to the multi-facetted nature of umbrella concepts, we suggest using spider charts as a means to report the results of evaluating artefacts with regard to usability, user experience and accessibility. Practitioner Summary: A better integration of the concepts of usability, user experience and accessibility is expected to provide some benefits to practitioners. We propose employing spider charts for reporting the outcome of artefact evaluations regarding the three concepts. This may help practitioners interpret the characteristics of a device at a glance. Abbreviations: IX: interaction experience; UX: user experience; ISO: International Standard Organisation.
Collapse
Affiliation(s)
- Juergen Sauer
- Department of Psychology, University of Fribourg, Fribourg, Switzerland
| | - Andreas Sonderegger
- EPFL+ECAL Lab, École polytechnique fédérale de Lausanne, Renens, Switzerland
| | - Sven Schmutz
- Department of Cardiology, Cardiac Psychology, Bern University Hospital, Bern, Switzerland
| |
Collapse
|
6
|
Nutzung und User Experience einer gamifizierten Webanwendung zur Förderung der körperlichen Aktivität im betrieblichen Setting. PRÄVENTION UND GESUNDHEITSFÖRDERUNG 2018. [DOI: 10.1007/s11553-018-0649-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/28/2022]
|