Development and Pilot Evaluation of a Tablet-Based Application to Improve Quality of Care in Child Mental Health Treatment

Children and young people's preferences and needs when using health technology to self-manage a long-term condition: a scoping review

BACKGROUND

The use of patient-facing health technologies to manage long-term conditions (LTCs) is increasing; however, children and young people (CYP) may have preferences about health technologies which they interact or engage with, that influence their decision to use these technologies.

AIMS

To identify CYP's reported preferences about health technologies to self-manage LTCs.

METHODS

We undertook a scoping review, searching MEDLINE, PsycINFO and CINAHL in July 2021. Searches were limited to papers published between January 2015 and July 2021. We included any health technologies used to manage physical and mental LTCs. Qualitative content analysis of study data was undertaken to categorise data into themes and quantitative data were described and visually represented. We engaged CYP with LTCs to support the review design, interpretation of findings and development of recommendations.

RESULTS

161 journal articles were included, describing preferences of CYP. Most included studies were undertaken in high-income countries. CYP's main preferences and needs were: design and functionality; privacy and sharing; customisation and personalisation of the technology; and interaction options within the technology.

CONCLUSIONS

This review highlights important preferences and needs that CYP may have before using technologies to self-manage their LTC. These should be considered when developing technology for this population. Future research should involve CYP throughout the development of the technologies, from identifying their unmet needs through to final design, development, evaluation and implementation of the intervention.

Development and Usability Testing of an mHealth Tool for Trauma-Informed Prevention of Substance Use, HIV Acquisition, and Risky Sexual Behaviors Among Adolescents: Mixed Methods Study

BACKGROUND

Youth who experience traumatic events are at a substantially higher risk of engaging in substance use and sexual risk behaviors and problems (eg, HIV acquisition) than their non-trauma-exposed counterparts. Evidence-based substance use and risky sexual behavior prevention may reduce the risk of these outcomes. Trauma-focused mental health treatment provides a window of opportunity for the implementation of such preventive work with these youth. However, overburdened clinicians face challenges in adding prevention content while implementing evidence-based treatments. Mobile health (mHealth) tools can help reduce this burden in delivering prevention curricula. Trauma-Informed Prevention for Substance Use and Risky Sexual Behavior (TIPS) is an mHealth app that was developed to aid trauma-focused cognitive behavioral therapy (TF-CBT) clinicians in the implementation of an evidence-based risk behavior prevention curriculum.

OBJECTIVE

The goal of this paper is to describe the rationale for and development of the TIPS app and present the results of a mixed methods approach for the initial evaluation of its usability.

METHODS

Participants included clinicians (n=11), adolescents (n=11), and caregivers (n=10) who completed qualitative interviews and an adapted version of the Website Analysis and Measurement Inventory.

RESULTS

In total, 4 overarching themes emerged from the participants' answers to the qualitative interview questions, demonstrating a generally positive response to the app. The themes were (1) strength of app content, (2) suggestions about app content, (3) esthetics and usability, and (4) benefits to the patient and session implementation. Clinicians, adolescents, and caregivers all agreed that the content was very relevant to adolescents and used examples and language that adolescents could relate to. All 3 groups also discussed that the content was comprehensive and addressed issues often faced by adolescents. All 3 groups of users made suggestions about the esthetics, which mostly comprised suggestions to change the font, color, or pictures within the app. Of all the groups, adolescents were most positive about the esthetics and usability of the app. Results from the Website Analysis and Measurement Inventory further illustrated the users' favorable reaction to the TIPS app, with 100% (11/11) of clinicians, 100% (10/10) of caregivers, and most adolescents (7/11, 64%) selecting strongly agree or somewhat agree to the following statement: "This app has much that is of interest to me." Adolescents generally found the app easier to use than did caregivers and clinicians.

CONCLUSIONS

The TIPS app shows promise as an mHealth tool for TF-CBT clinicians to integrate evidence-based substance use, risky sexual behavior, and HIV prevention during treatment. Future research, including a randomized controlled trial comparing TF-CBT implementation with and without the inclusion of the app, is necessary to evaluate the feasibility and efficacy of the app in reducing the risk of substance use and risky sexual behavior among trauma-exposed adolescents.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03710720; https://clinicaltrials.gov/study/NCT03710720.

Design, development, utility and usability testing of the EMPOWER-SUSTAIN Self-Management Mobile App© among primary care physicians and patients with metabolic syndrome

Objective

This study aimed to design, develop, assess and refine the EMPOWER-SUSTAIN Self-Management Mobile App© among primary care physicians (PCP) and patients with metabolic syndrome (MetS) in primary care.

Methodology

Using the software-development-life-cycle (SDLC) iterative model, storyboard and wireframe were drafted; and a mock prototype was designed to illustrate the content and function graphically. Subsequently, a working prototype was developed. Qualitative studies using the 'think-aloud' and cognitive-task-analysis methods were conducted for the utility and usability testing. Topic guide was based on the 10-Nielsen's-Heuristic-Principles. Utility testing was conducted among PCP in which they 'thought-aloud' while performing tasks using the mobile app. Usability testing was conducted among MetS patients after they were given the app for 3 weeks. They 'thought-aloud' while performing tasks using the app. Interviews were audio- and video-recorded, and transcribed verbatim. Thematic content analysis was performed.

Result

Seven PCP and nine patients participated in the utility and usability testing, respectively. Six themes (efficiency of use, user control and freedom, appearance and aesthetic features, clinical content, error prevention, and help and documentation) emerged. PCP found the mobile app attractive and relevant sections were easy to find. They suggested adding 'zoom/swipe' functions and some parts needed bigger fonts. Patients commented that the app was user-friendly, has nice interface, and straightforward language. It helped them understand their health better. Based on these findings, the mobile app was refined.

Conclusion

This app was produced using a robust SDLC method to increase users' satisfaction and sustainability of its use. It could potentially improve self-management behaviour among MetS patients in primary care.

Environmental conditions, mobile digital culture, mobile usability, knowledge of app in COVID-19 risk mitigation: A structural equation model analysis

INTRODUCTION

The mobile digital culture (MDC) supports individual lives, communities, and real-time organizational surveillance during COVID-19 emergencies. Hence, the study examined the advancement in smart health devices evidence in smartphone apps technologies in surveillance, control, and tracking potential virus areas among high-risk populations.

OBJECTIVE

The study explored how environmental condition and MDC mediates between knowledge of App and mobile usability in the prevention of COVID-19 infection in high-risk areas.

METHODS

Using the concept of UTAUT, the study conceptualized that mobile usability, MDC, knowledge of App and environmental condition, are essential for COVID-19 mitigation. A cross-sectional method was adopted through an online survey to assess data from n = 459 mobile users. The association of the study models was appraised through structural equation models (Amos v.24.0).

RESULT

We found mobile usability, knowledge of App, and MDC were statistically significant to COVID-19 mitigation. Environment condition as mediator had no effect in the study models. However, moderating effect of MDC shows a negative influence on the association between COVID-19 mitigation and knowledge of apps.

CONCLUSION

Future policies should consider the development of mHealth technology to improve end-user experience. Also, future policies should entail data privacy to reduce the infringement of data collected. This approach will lead to a confidential, high acceptance of usability of mHealth apps infectious disease prevention.

Trajectories of mental health services for youth in foster care with attention deficit hyperactivity disorder

Youth in foster care with Attention Deficit Hyperactivity Disorder (ADHD) often have significant needs for mental health services. The degree to which youth taking medication for ADHD use mental health services in relation to sibling co-placement and their level of need over time is unclear. To examine these issues, caregivers (N = 54) provided information on youth mental health service use across an 18-month study period. Results show that siblings living apart had a higher probability of mental health service use. For youth with higher CBCL scores, probability of mental health service use was both high and stable over time. However, youth with lower CBCL scores showed a decrease in probability of mental health service use over time. The sustained commitment to receipt of mental health services among youth with ADHD is something all behavioral health providers who work with foster care involved youth can benefit from, as well as the youth themselves.

Assessing the Feasibility of a Multicenter Transition Intervention Model Across Adolescent Secure Services in England (MOVING FORWARD): Protocol for a Feasibility Cluster Randomized Controlled Trial

BACKGROUND

Young people moving from adolescent secure inpatient units to adult care in the United Kingdom have multiple and complex needs and are more likely to experience poor transition outcomes. Poorly managed transitions can lead to enduring use and dependency on mental health services. However, there is a lack of knowledge about the feasibility of transitional care models.

OBJECTIVE

This paper presents the protocol for a study that aims to test a feasibility cluster randomized controlled trial for young people transitioning from adolescent secure services to adult-oriented settings. The overarching aim of the MOVING FORWARD study is to provide a preliminary estimate of the effectiveness and cost-effectiveness of a new transition intervention model and to inform a future full-scale cluster randomized controlled trial.

METHODS

The design of the study is a 3-arm feasibility cluster randomized controlled trial comparing the MOVING FORWARD intervention against standard transition preparation conducted at 6 adolescent secure services, of which 4 units will receive the intervention and 2 will serve as controls. Eligible young people between 17-19 years, their parents/carers, and key workers will be invited to participate. Young people and parents/carers will be allocated to two conditions (young people alone and young people with a parent/carer) and will receive 4 transition preparation workshops across 6 months. Six adolescent secure hospitals will be randomly allocated, stratified by area and service type. Data will be collected at 3 time points: baseline (T0), 6-12 months postintervention (T1), and 18-24 months postbaseline (T2). Primary and secondary outcomes will be based on assessment measures and interviews conducted at T1 and T2.

RESULTS

A total of 13 young people and 17 staff members have contributed to the intervention design through online advisory groups on the design of the study and important themes for transition. We have also consulted members of the public (a steering group) including 2 young people who have transitioned to the community and 2 parents/carers. Common identified themes included appropriateness of module content and support during delayed transitions. The content of the intervention will be finalized during the first 6 months of the study. Participants will be recruited over the course of 6 months. An intraclass correlation coefficient will be calculated to inform the power of the sample size for a further large-scale trial. With a sample size of 50, we will be able to estimate a dropout rate of 80% (95% CI -11% to 11%).

CONCLUSIONS

This research will provide practitioners and policy makers with an evidence-based framework of how training and familiarization with the prospective transitions can yield positive outcomes. This study will test whether a psychosocial intervention can be implemented in adolescent secure hospitals. The results will identify barriers and facilitators to the proposed intervention and will enable services to reflect on the quality of transitional care delivery.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/29273.

Applying Digital Information Delivery to Convert Habits of Antibiotic Use in Primary Care in Germany: Mixed-Methods Study

BACKGROUND

Antimicrobial resistance is an important global health issue. In Germany, the national agenda supports various interventions to convert habits of antibiotic use. In the CHANGE-3 (Converting Habits of Antibiotic Use for Respiratory Tract Infections in German Primary Care) study, digital tools were applied for information delivery: tablet computers in primary care practices, e-learning platforms for medical professionals, and a public website to promote awareness and health literacy among primary care physicians, their teams, and their patients.

OBJECTIVE

This study is embedded in the process evaluation of the CHANGE-3 study. The aim of this study was to evaluate the acceptance and uptake of digital devices for the delivery of health-related information to enhance awareness and change habits of antibiotic use in primary care in Germany.

METHODS

This study used a convergent-parallel mixed-methods design. Audio-recorded semistructured telephone interviews were conducted with physicians, nonphysician health professionals, and patients in the CHANGE-3 program. Pseudonymized verbatim transcripts were coded using thematic analysis. In-depth analysis was performed based on the inductive category of information provision via digital information tools. Identified themes were related to the main postulates of Diffusion of Innovations theory (DIT) to provide an explanatory frame. In addition, data generated through a structured survey with physicians and nonphysician health professionals in the program were analyzed descriptively and integrated with the qualitative data to explore the complementarity of the findings.

RESULTS

Findings regarding the acceptance and uptake of digital devices were related to three postulates of DIT: innovation characteristics, communication channels, and unanticipated consequences. Participants considered the provided digital educative solutions to be supportive for promoting health literacy regarding conversion of habits of antibiotic use. However, health care professionals found it challenging to integrate these solutions into existing routines in primary care and to align them with their professional values. Low technology affinity was a major barrier to the use of digital information in primary care. Patients welcomed the general idea of introducing health-related information in digital formats; however, they expressed concerns about device-related hygiene and the appropriateness of the digital tools for older patients.

CONCLUSIONS

Patients and medical professionals in German primary care are reluctant to use digital devices for information and education. Using a Diffusion of Innovations approach can support assessment of existing barriers and provide information about setting-specific preconditions that are necessary for future tailoring of implementation strategies.

TRIAL REGISTRATION

International Standard Randomized Controlled Trial Number (ISRCTN) 15061174; http://www.isrctn.com/ISRCTN15061174.

The EMPOWER-SUSTAIN e-Health Intervention to improve patient activation and self-management behaviours among individuals with Metabolic Syndrome in primary care: study protocol for a pilot randomised controlled trial

Background

Epidemiological studies conducted in various parts of the world have clearly demonstrated that metabolic syndrome (MetS) is an increasing global health problem, not only in Western societies but also in Asian populations. Web-based and mobile phone-based self-management applications have been proven to be effective in improving self-management behaviour of patients with MetS components (i.e., diabetes or hypertension). However, evidence is lacking in terms of their effectiveness specifically for patients with MetS. The aim of this pilot study is to evaluate the feasibility and potential effectiveness of the EMPOWER-SUSTAIN Self-Management e-Health Intervention in improving activation and self-management behaviours among patients with MetS. This paper presents the study protocol.

Methods

A pilot randomised controlled trial will be conducted in a university primary care clinic. A total of 232 patients aged 18–60 years with MetS will be recruited; 116 will be randomised to receive the EMPOWER-SUSTAIN intervention for 6 months, and another 116 patients will continue with usual care. The EMPOWER-SUSTAIN intervention is a multifaceted chronic disease management strategy based on the Chronic Care Model and persuasive technology theory. It consists of training primary care physicians, nurses and patients to use the EMPOWER-SUSTAIN web-based self-management mobile app, strengthening the patient–physician relationship and reinforcing the use of relevant clinical practice guidelines to guide management and prescribing. The primary outcome is the mean change in patient activation score using the Patient Activation Measure short form Malay version (PAM-13-M) questionnaire. The secondary outcomes include the changes in waist circumference, body mass index, blood pressure, patient physical activity level, eating behaviour, perception of chronic illness care, satisfaction with patient–physician interaction, and perceived absolute 10-year cardiovascular disease risk. Feasibility of implementing the intervention will be evaluated. This includes acceptability of the intervention, estimating the likely rate of participant recruitment and retention, appropriateness of the outcome measures, calculation of sample size, and the intervention’s potential effectiveness.

Conclusion

To our knowledge, this is the first study in Malaysia that aims to determine the feasibility of a multifaceted e-health intervention, as well as to indicate more useful aspects of this intervention for further exploration in a larger trial.

Trial registration

ClinicalTrials.gov, NCT04120779. Registered on 9 October 2019, protocol version 1.

Usability Evaluations of Mobile Mental Health Technologies: Systematic Review

Background

Many mobile health (mHealth) apps for mental health have been made available in recent years. Although there is reason to be optimistic about their effect on improving health and increasing access to care, there is a call for more knowledge concerning how mHealth apps are used in practice.

Objective

This study aimed to review the literature on how usability is being addressed and measured in mHealth interventions for mental health problems.

Methods

We conducted a systematic literature review through a search for peer-reviewed studies published between 2001 and 2018 in the following electronic databases: EMBASE, CINAHL, PsycINFO, PubMed, and Web of Science. Two reviewers independently assessed all abstracts against the inclusion and exclusion criteria, following the Preferred Reporting Items for Systematic Review and Meta-Analysis guidelines.

Results

A total of 299 studies were initially identified based on the inclusion keywords. Following a review of the title, abstract, and full text, 42 studies were found that fulfilled the criteria, most of which evaluated usability with patients (n=29) and health care providers (n=11) as opposed to healthy users (n=8) and were directed at a wide variety of mental health problems (n=24). Half of the studies set out to evaluate usability (n=21), and the remainder focused on feasibility (n=10) or acceptability (n=10). Regarding the maturity of the evaluated systems, most were either prototypes or previously tested versions of the technology, and the studies included few accounts of sketching and participatory design processes. The most common reason referred to for developing mobile mental health apps was the availability of mobile devices to users, their popularity, and how people in general became accustomed to using them for various purposes.

Conclusions

This study provides a detailed account of how evidence of usability of mHealth apps is gathered in the form of usability evaluations from the perspective of computer science and human-computer interaction, including how users feature in the evaluation, how the study objectives and outcomes are stated, which research methods and techniques are used, and what the notion of mobility features is for mHealth apps. Most studies described their methods as trials, gathered data from a small sample size, and carried out a summative evaluation using a single questionnaire, which indicates that usability evaluation was not the main focus. As many studies described using an adapted version of a standard usability questionnaire, there may be a need for developing a standardized mHealth usability questionnaire.

Enhancing the Delivery of an Empirically-Supported Trauma-Focused Treatment for Adolescents: Providers' Views of the Role of Technology and Web-Based Resources

This mixed-methods study assessed providers' views of the use of technology in the delivery of an empirically supported mental health treatment for adolescents (Trauma-Focused Cognitive Behavioral Therapy; TF-CBT). Thematic qualitative interviews were conducted with nine experienced providers. Emerging themes served as the basis for the creation of a quantitative web-based survey, completed by 56 TF-CBT experts, to assess the perceived helpfulness of the recommendations. Technology was perceived as a useful, appealing, and familiar tool that could greatly enhance the delivery of this treatment modality with adolescents. Main recommendations included the creation of a mobile application targeting all of the treatment components and a website with developmentally appropriate resources for providers, caregivers, and teens. Technology may be a useful tool for enhancing service delivery and promoting engagement among youth receiving trauma-focused mental health treatment.

Pilot Evaluation of a Tablet-Based Application to Improve Quality of Care in Child Mental Health Treatment

Mental health systems need scalable solutions that can reduce the efficacy-effectiveness gap and improve mental health outcomes in community mental health service settings. Two major challenges to delivery of high-quality care are providers' fidelity to evidence-based treatment models and children's and caregivers' engagement in the treatment process. We developed a novel, tablet-based application designed to enhance via technology the quality of delivery of trauma-focused cognitive-behavioral therapy (TF-CBT). We piloted its use in four community mental health service organizations using a blocked randomized controlled trial to examine the feasibility of implementing tablet-facilitated TF-CBT versus standard TF-CBT with 13 providers and 27 families. Provider fidelity and child engagement in treatment were observationally measured via session audio recording. Parent and child perceptions of the tablet application were assessed using structured interviews and mixed-method analyses. Providers actively and appropriately used tablet TF-CBT to facilitate treatment activities. Providers and families expressed high satisfaction with its use, demonstrating acceptability of this approach. Youth and caregivers in both conditions reported high alliance with their providers. Overall, we found that tablet-facilitated treatment is accepted by providers and families and may be integrated into mental health treatment with minimal training. Further study is needed to examine the extent to which technology-based applications may enhance the reach, quality, and clinical outcomes of mental health treatment delivered to children and families.

Description, utilisation and results from a telehealth primary care weight management intervention for adults with obesity in South Carolina

Introduction

In the US, obesity rates are higher in rural areas than in urban areas. Rural access to treatment of obesity is limited by a lack of qualified clinicians and by transportation and financial barriers. We describe a telemedicine weight management programme, Wellness Connect, developed through a partnership of academic clinicians and rural primary care providers in South Carolina, and present utilisation and weight outcomes from seven patient cohorts.

Methods

Eight bi-weekly sessions were provided via telemedicine videoconferencing for groups of patients at these rural primary care clinics. Protocol-based sessions were led by registered dietitians, exercise physiologists and clinical psychologists at a central urban location.

Results

Of 138 patients who started the programme, 62% ( N = 86) of patients met the criteria for completion. Completers lost an average of 3.5% (standard deviation (SD) = 3.9%) body weight, which was statistically significant ( p < .001) and corresponded with an average loss of 3.8 kg (SD = 4.5 kg). There were no differences in weight change among clinics ( p = .972). Overall, patients and providers reported satisfaction with the programme and identified several challenges to sustainability.

Discussion

The use of innovative telemedicine interventions continues to be necessary to alleviate barriers to accessing evidence-based services to reduce chronic diseases and decrease obesity rates among rural populations.