1
|
Arthurs N, Browne S, Boardman R, O'Donnell S, Doyle G, Kechadi T, Shahid A, Tully L, O’Malley G. Usability of the BigO system in pediatric obesity treatment: A mixed-methods evaluation of clinical end-users. Comput Struct Biotechnol J 2024; 24:507-522. [PMID: 39184872 PMCID: PMC11342072 DOI: 10.1016/j.csbj.2024.06.034] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2024] [Revised: 06/25/2024] [Accepted: 06/26/2024] [Indexed: 08/27/2024] Open
Abstract
Objective To assess technical usability of the BigO app and clinical portal among diverse participants and explore the overall user experiences of both. Methods Methods included technical usability testing by measuring the relative user efficiency score (RUS) for the app and measuring Relative User Efficiency (RUE) using the 'think aloud' method with the clinical portal. Qualitative approaches involved focus groups with adolescent app users and semi-structured one-to-one interviews with clinician participants. Thematic analysis was applied to analyze qualitative data. Participants Clinical participants consisted of adolescents seeking treatment for severe obesity and were invited via telephone/face to face to attend technical usability testing and a focus group. Healthcare professionals (HCPs) and researchers using the BigO clinical portal interface were invited to participate in usability testing and semi-structured interviews. Results From 14 families invited to attend, seven consented to join the study and four adolescents (mean age=13.8 (SD 0.8) years) participated. Additionally, six HCPs and one pediatric obesity researcher took part. RUS for adolescents indicated that the tasks required of them via myBigO app were feasible, and technically efficient. No user-related errors were observed during tasks. Technical barriers reported by adolescents included notifications of battery optimization, misunderstanding image annotation language, and compatibility challenges with certain phone models. RUS for the HCPs and researcher indicated that basic technical skills are a potential barrier for clinical portal use and qualitative findings revealed that clinical users wanted a logging option for monitoring goals and providing feedback on the portal. Conclusion Our study provided valuable formative findings from clinical end-users in Ireland indicating that adolescents being treated for obesity rated myBigO app as usable, acceptable and that it may assist other key stakeholders to understand food marketing and to monitor dietary and physical activity behaviors. Several key suggestions for future iterations of the clinical portal were provided to enhance its value in pediatric obesity treatment.
Collapse
Affiliation(s)
- Niamh Arthurs
- Child and Adolescent Obesity Service, Children’s Health Ireland (CHI) at Temple Street Children’s Hospital, Dublin, Ireland
- Obesity Research and Care Group, School of Physiotherapy, RCSI University of Medicine and Health Sciences, Royal College of Surgeons in Ireland, Ireland
- School of Public Health, Physiotherapy & Sports Science, University College Dublin, Dublin 4, Ireland
| | - Sarah Browne
- Obesity Research and Care Group, School of Physiotherapy, RCSI University of Medicine and Health Sciences, Royal College of Surgeons in Ireland, Ireland
- School of Public Health, Physiotherapy & Sports Science, University College Dublin, Dublin 4, Ireland
| | - Rebekah Boardman
- School of Public Health, Physiotherapy & Sports Science, University College Dublin, Dublin 4, Ireland
| | - Shane O'Donnell
- Insight Centre for Data Analytics, School of Computer Science, University College Dublin, Dublin 4, Ireland
| | - Gerardine Doyle
- UCD College of Business, Michael Smurfit Graduate Business School, University College Dublin, Dublin 4, Ireland
- UCD Geary Institute for Public Policy, University College Dublin, Dublin 4, Ireland
| | - Tahar Kechadi
- Insight Centre for Data Analytics, School of Computer Science, University College Dublin, Dublin 4, Ireland
| | - Arsalan Shahid
- Insight Centre for Data Analytics, School of Computer Science, University College Dublin, Dublin 4, Ireland
| | - Louise Tully
- Obesity Research and Care Group, School of Physiotherapy, RCSI University of Medicine and Health Sciences, Royal College of Surgeons in Ireland, Ireland
| | - Grace O’Malley
- Child and Adolescent Obesity Service, Children’s Health Ireland (CHI) at Temple Street Children’s Hospital, Dublin, Ireland
- Obesity Research and Care Group, School of Physiotherapy, RCSI University of Medicine and Health Sciences, Royal College of Surgeons in Ireland, Ireland
| |
Collapse
|
2
|
Maity A, Wang AW, Dreier MJ, Wallace V, Orchard F, Schleider JL, Loades ME, Hamilton JL. How do adolescents experience a newly developed Online Single Session Sleep Intervention? A Think-Aloud Study. Clin Child Psychol Psychiatry 2024; 29:1137-1158. [PMID: 37978949 PMCID: PMC11188559 DOI: 10.1177/13591045231205475] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/19/2023]
Abstract
BACKGROUND Sleep problems are common in adolescents and have detrimental impacts on physical and mental health and daily functioning. Evidence-based treatment like cognitive behaviour therapy for insomnia (CBT-I) is often hard to access, and adolescents may not engage in and adhere to longer, clinician-delivered interventions. Brief, self-guided, and accessible sleep interventions are needed. OBJECTIVE To explore the user experience of a prototype online self-help single session sleep intervention developed for adolescents. METHODS Eleven participants aged 17-19 years (8 females, 3 males) took part in online retrospective think-aloud interviews. Participants first completed the prototype intervention independently and were then shown the intervention page by page and asked to verbalise their thoughts and experiences. Transcripts were analyzed thematically. RESULTS Participants found the intervention helpful. Four themes were generated - 'Educative: Learning, but more fun', 'Effortless: Quicker and Easier', 'Personalization: Power of Choice', and 'Positivity: Just Good Vibes'. The theme 'Educative: Learning, but more fun' encompassed two sub-themes 'Opportunity to Learn' and 'Aesthetics and Learning'. These themes reflected participants' views that the intervention was educative, personalised, solution-oriented and easy to use, but could incorporate more graphics and visuals to aid in learning and could be made more effortless and positive through modifications to its design. CONCLUSIONS Findings convey the importance of ensuring educative well-designed content, personalization, a positive tone, and ease of use while designing interventions targeting adolescents's sleep and mental health. They also indicate areas for further developing the intervention.
Collapse
Affiliation(s)
- Ananya Maity
- Department of Psychology, University of Bath, Bath, UK
| | - Angela W Wang
- Department of Psychology, Rutgers University, New Brunswick, USA
| | - Melissa J Dreier
- Department of Psychology, Rutgers University, New Brunswick, USA
| | | | - Faith Orchard
- School of Psychology, University of Sussex, Brighton, UK
| | | | | | | |
Collapse
|
3
|
Haag S, Kepros J. Head Protection Device for Individuals at Risk for Head Injury due to Ground-Level Falls: Single Trauma Center User Experience Investigation. JMIR Hum Factors 2024; 11:e54854. [PMID: 38502170 PMCID: PMC10988374 DOI: 10.2196/54854] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2023] [Revised: 02/08/2024] [Accepted: 02/18/2024] [Indexed: 03/20/2024] Open
Abstract
BACKGROUND Falls represent a large percentage of hospitalized patients with trauma as they may result in head injuries. Brain injury from ground-level falls (GLFs) in patients is common and has substantial mortality. As fall prevention initiatives have been inconclusive, we changed our strategy to injury prevention. We identified a head protection device (HPD) with impact-resistant technology, which meets head impact criteria sustained in a GLF. HPDs such as helmets are ubiquitous in preventing head injuries in sports and industrial activities; yet, they have not been studied for daily activities. OBJECTIVE We investigated the usability of a novel HPD on patients with head injury in acute care and home contexts to predict future compliance. METHODS A total of 26 individuals who sustained head injuries, wore an HPD in the hospital, while ambulatory and were evaluated at baseline and 2 months post discharge. Clinical and demographic data were collected; a usability survey captured HPD domains. This user experience design revealed patient perceptions, satisfaction, and compliance. Nonparametric tests were used for intragroup comparisons (Wilcoxon signed rank test). Differences between categorical variables including sex, race, and age (age group 1: 55-77 years; age group 2: 78+ years) and compliance were tested using the chi-square test. RESULTS Of the 26 patients enrolled, 12 (46%) were female, 18 (69%) were on anticoagulants, and 25 (96%) were admitted with a head injury due to a GLF. The median age was 77 (IQR 55-92) years. After 2 months, 22 (85%) wore the device with 0 falls and no GLF hospital readmissions. Usability assessment with 26 patients revealed positive scores for the HPD post discharge regarding satisfaction (mean 4.8, SD 0.89), usability (mean 4.23, SD 0.86), effectiveness (mean 4.69, SD 0.54), and relevance (mean 4.12, SD 1.10). Nonparametric tests showed positive results with no significant differences between 2 observations. One issue emerged in the domain of aesthetics; post discharge, 8 (30%) patients had a concern about device weight. Analysis showed differences in patient compliance regarding age (χ12=4.27; P=.04) but not sex (χ12=1.58; P=.23) or race (χ12=0.75; P=.60). Age group 1 was more likely to wear the device for normal daily activities. Patients most often wore the device ambulating, and protection was identified as the primary benefit. CONCLUSIONS The HPD intervention is likely to have reasonably high compliance in a population at risk for GLFs as it was considered usable, protective, and relevant. The feasibility and wearability of the device in patients who are at risk for GLFs will inform future directions, which includes a multicenter study to evaluate device compliance and effectiveness. Our work will guide other institutions in pursuing technologies and interventions that are effective in mitigating injury in the event of a fall in this high-risk population.
Collapse
Affiliation(s)
- Susan Haag
- Scottsdale Osborn Medical Center, Scottsdale, AZ, United States
| | - John Kepros
- Scottsdale Osborn Medical Center, Scottsdale, AZ, United States
| |
Collapse
|
4
|
Broese JMC, van der Kleij RMJJ, Verschuur EML, Kerstjens HAM, Bronkhorst EM, Chavannes NH, Engels Y. External Validation and User Experiences of the ProPal-COPD Tool to Identify the Palliative Phase in COPD. Int J Chron Obstruct Pulmon Dis 2022; 17:3129-3138. [PMID: 36579356 PMCID: PMC9792220 DOI: 10.2147/copd.s387716] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2022] [Accepted: 11/24/2022] [Indexed: 12/24/2022] Open
Abstract
Background Difficulty predicting prognosis is a major barrier to timely palliative care provision for patients with COPD. The ProPal-COPD tool, combining six clinical indicators and the Surprise Question (SQ), aims to predict 1-year mortality as a proxy for palliative care needs. It appeared to be a promising tool for healthcare providers to identify patients with COPD who could benefit from palliative care. Objective To externally validate the ProPal-COPD tool and to assess user experiences. Methods Patients admitted with an acute exacerbation COPD were recruited across 10 hospitals. Demographics, clinical characteristics and survival status were collected. Sensitivity, specificity, positive and negative predictive values of the tool using two cut-off values were calculated. Also, predictive properties of the SQ were calculated. In monitoring meetings and interviews, healthcare providers shared their experiences with the tool. Transcripts were deductively coded using six user experience domains: Acceptability, Satisfaction, Credibility, Usability, User-reported adherence and Perceived impact. Results A total of 523 patients with COPD were included between May 2019 and August 2020, of whom 100 (19.1%) died within 12 months. The ProPal-COPD tool had an AUC of 0.68 and a low sensitivity (55%) and moderate specificity (74%) for predicting 1-year all-cause mortality. Using a lower cut-off value, sensitivity was higher (74%), but specificity lower (46%). Sensitivity and specificity of the SQ were 56% and 73%, respectively (AUC 0.65). However, healthcare providers generally appreciated using the tool because it increased awareness of the palliative phase and provided a shared understanding of prognosis, although they considered its outcome not always correct. Conclusion The accuracy of the ProPal-COPD tool to predict 1-year mortality is limited, although screening patients with its indicators increases healthcare providers' awareness of palliative care needs and encourages them to timely initiate appropriate care.
Collapse
Affiliation(s)
- Johanna M C Broese
- Public Health & Primary Care, Leiden University Medical Center, Leiden, the Netherlands
- Lung Alliance Netherlands, Amersfoort, the Netherlands
| | | | | | - Huib A M Kerstjens
- Respiratory Medicine & Tuberculosis, University of Groningen and University Medical Center Groningen, Groningen, the Netherlands
| | - Ewald M Bronkhorst
- Health Evidence, Radboud University Medical Center, Nijmegen, the Netherlands
| | - Niels H Chavannes
- Public Health & Primary Care, Leiden University Medical Center, Leiden, the Netherlands
| | - Yvonne Engels
- Anesthesiology, Pain & Palliative Medicine, Radboud University Medical Center, Nijmegen, the Netherlands
| |
Collapse
|
5
|
Arthurs N, Tully L, O’Malley G, Browne S. Usability and Engagement Testing of mHealth Apps in Paediatric Obesity: A Narrative Review of Current Literature. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:1453. [PMID: 35162470 PMCID: PMC8834793 DOI: 10.3390/ijerph19031453] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/27/2021] [Revised: 01/07/2022] [Accepted: 01/19/2022] [Indexed: 02/01/2023]
Abstract
Mobile health (mHealth) platforms have become increasingly popular for delivering health interventions in recent years and particularly in light of the COVID-19 pandemic. Childhood obesity treatment is an area where mHealth interventions may be useful due to the multidisciplinary nature of interventions and the need for long-term care. Many mHealth apps targeting youth exist but the evidence base underpinning the methods for assessing technical usability, user engagement and user satisfaction of such apps with target end-users or among clinical populations is unclear, including for those aimed at paediatric overweight and obesity management. This review aims to examine the current literature and provide an overview of the scientific methods employed to test usability and engagement with mHealth apps in children and adolescents with obesity. A narrative literature review was undertaken following a systematic search. Four academic databases were searched. Inclusion criteria were studies describing the usability of mHealth interventions for childhood obesity treatment. Following the application of inclusion and exclusion criteria, fifty-nine articles were included for full-text review, and seven studies met the criteria for usability and engagement in a clinical paediatric population with obesity. Six apps were tested for usability and one for engagement in childhood obesity treatment. Sample sizes ranged from 6-1120 participants. The included studies reported several heterogenous measurement instruments, data collection approaches, and outcomes. Recommendations for future research include the standardization and validation of instruments to measure usability and engagement within mHealth studies in this population.
Collapse
Affiliation(s)
- Niamh Arthurs
- W82GO Child and Adolescent Obesity Service, Children’s Health Ireland at Temple Street, D01 XD99 Dublin, Ireland;
- School Public Health, Physiotherapy & Sports Science, University College Dublin, D04 V1W8 Dublin, Ireland;
| | - Louise Tully
- School of Physiotherapy, Division of Population Health Sciences, RCSI University of Medicine and Health Sciences, D02 YN77 Dublin, Ireland;
| | - Grace O’Malley
- W82GO Child and Adolescent Obesity Service, Children’s Health Ireland at Temple Street, D01 XD99 Dublin, Ireland;
- School of Physiotherapy, Division of Population Health Sciences, RCSI University of Medicine and Health Sciences, D02 YN77 Dublin, Ireland;
| | - Sarah Browne
- School Public Health, Physiotherapy & Sports Science, University College Dublin, D04 V1W8 Dublin, Ireland;
- School of Physiotherapy, Division of Population Health Sciences, RCSI University of Medicine and Health Sciences, D02 YN77 Dublin, Ireland;
| |
Collapse
|