Feasibility of a Mobile Health App for Routine Outcome Monitoring and Feedback in Mutual Support Groups Coordinated by SMART Recovery Australia: Protocol for a Pilot Study

An After-Hours Virtual Care Service for Children With Medical Complexity and New Medical Technology: Mixed Methods Feasibility Study

BACKGROUND

Family caregivers (FCs) of children with medical complexity require specialized support to promote the safe management of new medical technologies (eg, gastrostomy tubes) during hospital-to-home transitions. With limited after-hours services available to families in home and community care, medical device complications that arise often lead to increased FC stress and unplanned emergency department (ED) visits. To improve FC experiences, enable safer patient discharge, and reduce after-hours ED visits, this study explores the feasibility of piloting a 24/7 virtual care service (Connected Care Live) with families to provide real-time support by clinicians expert in the use of pediatric home care technologies.

OBJECTIVE

This study aims to establish the economic, operational, and technical feasibility of piloting the expansion of an existing nurse-led after-hours virtual care service offered to home and community care providers to FCs of children with newly inserted medical devices after hospital discharge at Toronto's Hospital for Sick Children (SickKids).

METHODS

This exploratory study, conducted from October 2020 to August 2021, used mixed data sources to inform service expansion feasibility. Semistructured interviews were conducted with FCs, nurses, and hospital leadership to assess the risks, benefits, and technical and operational requirements for sustainable and cost-effective future service operations. Time and travel savings were estimated using ED visit data in SickKids' electronic medical records (Epic) with a chief complaint of "medical device problems," after-hours medical device inquiries from clinician emails and voicemails, and existing service operational data.

RESULTS

A total of 30 stakeholders were interviewed and voiced the need for the proposed service. Safer and more timely management of medical device complications, improved caregiver and provider experiences, and strengthened partnerships were identified as expected benefits, while service demand, nursing practice, and privacy and security were identified as potential risks. A total of 47 inquiries were recorded over 2 weeks from March 26, 2021, to April 8, 2021, with 51% (24/47) assessed as manageable via service expansion. This study forecasted annual time and travel savings of 558 hours for SickKids and 904 hours and 22,740 km for families. Minimal technical and operational requirements were needed to support service expansion by leveraging an existing platform and clinical staff. Of the 212 ED visits related to "medical device problems" over 6 months from September 1, 2020, to February 28, 2021, enteral feeding tubes accounted for nearly two-thirds (n=137, 64.6%), with 41.6% (57/137) assessed as virtually manageable.

CONCLUSIONS

Our findings indicate that it is feasible to pilot the expansion of Connected Care Live to FCs of children with newly inserted enteral feeding tubes. This nurse-led virtual caregiver service is a promising tool to promote safe hospital-to-home transitions, improve FC experiences, and reduce after-hours ED visits.

Supporting people affected by problematic alcohol, substance use and other behaviours under pandemic conditions: A pragmatic evaluation of how SMART recovery Australia responded to COVID-19

BACKGROUND

The COVID-19 pandemic prompted rapid, reflexive transition from face-to-face to online healthcare. For group-based addiction services, evidence for the impact on service delivery and participant experience is limited.

METHODS

A 12-month (plus 2-month follow-up) pragmatic evaluation of the upscaling of online mutual-help groups by SMART Recovery Australia (SRAU) was conducted using The Reach Effectiveness Adoption Implementation Maintenance (RE-AIM) framework. Data captured by SRAU between 1st July 2020 and 31st August 2021 included participant questionnaires, Zoom Data Analytics and administrative logs.

RESULTS

Reach: The number of online groups increased from just 6 pre-COVID-19 to 132. These groups were delivered on 2786 (M = 232.16, SD = 42.34 per month) occasions, to 41,752 (M = 3479.33, SD = 576.34) attendees.

EFFECTIVENESS

Participants (n = 1052) reported finding the online group meetings highly engaging and a positive, recovery supportive experience. 91 % of people with experience of face-to-face group meetings rated their online experience as equivalent or better. Adoption: Eleven services (including SRAU) and five volunteers delivered group meetings for the entire 12-months.

IMPLEMENTATION

SRAU surpassed their goal of establishing 100 groups. Maintenance: The average number of meetings delivered [t(11.14) = -1.45, p = 0.1737] and attendees [t(1.95) = -3.28, p = 0.1880] per month were maintained across a two-month follow-up period.

CONCLUSIONS

SRAU scaled-up the delivery of online mutual-help groups in response to the COVID-19 pandemic. Findings support the accessibility, acceptability and sustainability of delivering SMART Recovery mutual-help groups online. Not only are these findings important in light of the global pandemic and public safety, but they demonstrate the potential for reaching and supporting difficult and under-served populations.

Online SMART Recovery mutual support groups: Characteristics and experience of adults seeking treatment for methamphetamine compared to those seeking treatment for other addictive behaviours

INTRODUCTION

The COVID-19 pandemic prompted the transition of Australian Self-Management and Recovery Training (SMART) Recovery mutual support groups to virtual delivery. This study examined the self-reported experience of online SMART Recovery groups for people seeking support for methamphetamine use (alone or in combination with other behaviours) compared to those who did not endorse methamphetamine use as a reason for seeking support.

METHODS

An online survey invitation was embedded in the post-group exit page. Items assessed participant demographic characteristics, experience, engagement and perceived contribution of the online group to recovery. Unique responses (n = 1414) were analysed using chi-square.

RESULTS

After alcohol, methamphetamine use was the second most common behaviour to prompt online SMART Recovery group attendance (n = 205, 14.5%). People attending for methamphetamine use were more likely to endorse multiple addictive behaviours (n = 137, 66.8% vs. n = 371, 30.7%, p < 0.001). Irrespective of whether people attended for methamphetamine use or not, participant ratings of experience, engagement and perceived contribution to recovery were positive and largely comparable. People attending for methamphetamine use were significantly less likely to set a 7-day plan (72.7% vs. 81.9%; χ²  = 9.47, p = 0.002).

DISCUSSION AND CONCLUSIONS

Findings support the acceptability of online SMART Recovery groups for people experiencing addictive behaviours, including methamphetamine use. To maximise the benefits of these groups, further evidence on how best to support people to develop a change plan within a time-limited, online group setting is needed. Online mutual support groups may help to reach and support people who might not otherwise engage in treatment and support, including people who use methamphetamine.

Feasibility of a Mobile Health App for Routine Outcome Monitoring and Feedback in SMART Recovery Mutual Support Groups: Stage 1 Mixed Methods Pilot Study

Background

Mutual support groups are an important source of long-term help for people impacted by addictive behaviors. Routine outcome monitoring (ROM) and feedback are yet to be implemented in these settings. SMART Recovery mutual support groups focus on self-empowerment and use evidence-based techniques (eg, motivational and behavioral strategies). Trained facilitators lead all SMART Recovery groups, providing an opportunity to implement ROM.

Objective

The aim of this stage 1 pilot study is to explore the feasibility, acceptability, and preliminary outcomes of a novel, purpose-built mobile health ROM and feedback app (SMART Track) in mutual support groups coordinated by SMART Recovery Australia (SRAU) over 8 weeks.

Methods

SMART Track was developed during phase 1 of this study using participatory design methods and an iterative development process. During phase 2, 72 SRAU group participants were recruited to a nonrandomized, prospective, single-arm trial of the SMART Track app. Four modes of data collection were used: ROM data directly entered by participants into the app; app data analytics captured by Amplitude Analytics (number of visits, number of unique users, visit duration, time of visit, and user retention); baseline, 2-, and 8-week follow-up assessments conducted through telephone; and qualitative telephone interviews with a convenience sample of study participants (20/72, 28%) and facilitators (n=8).

Results

Of the 72 study participants, 68 (94%) created a SMART Track account, 64 (88%) used SMART Track at least once, and 42 (58%) used the app for more than 5 weeks. During week 1, 83% (60/72) of participants entered ROM data for one or more outcomes, decreasing to 31% (22/72) by the end of 8 weeks. The two main screens designed to provide personal feedback data (Urges screen and Overall Progress screen) were the most frequently visited sections of the app. Qualitative feedback from participants and facilitators supported the acceptability of SMART Track and the need for improved integration into the SRAU groups. Participants reported significant reductions between the baseline and 8- week scores on the Severity of Dependence Scale (mean difference 1.93, SD 3.02; 95% CI 1.12-2.73) and the Kessler Psychological Distress Scale-10 (mean difference 3.96, SD 8.31; 95% CI 1.75-6.17), but no change on the Substance Use Recovery Evaluator (mean difference 0.11, SD 7.97; 95% CI –2.02 to 2.24) was reported.

Conclusions

Findings support the feasibility, acceptability, and utility of SMART Track. Given that sustained engagement with mobile health apps is notoriously difficult to achieve, our findings are promising. SMART Track offers a potential solution for ROM and personal feedback, particularly for people with substance use disorders who attend mutual support groups.

Trial Registration

Australian New Zealand Clinical Trials Registry ACTRN12619000686101; https://anzctr.org.au/Trial/Registration/TrialReview.aspx?id=377336

International Registered Report Identifier (IRRID)

RR2-10.2196/15113

Developing a mHealth Routine Outcome Monitoring and Feedback App ("SMART Track") to Support Self-Management of Addictive Behaviours

Background: Routine outcome monitoring (ROM) has been implemented across a range of addiction treatment services, settings and organisations. Mutual support groups are a notable exception. Innovative solutions are needed. SMART Track is a purpose built smartphone app designed to capture ROM data and provide tailored feedback to adults attending Australian SMART Recovery groups for addictive behaviour(s). Objective: Details regarding the formative stage of app development is essential, but often neglected. Improved consideration of the end-user is vital for curtailing app attrition and enhancing engagement. This paper provides a pragmatic example of how principles embedded in published frameworks can be operationalised to address these priorities during the design and development of the SMART Track app. Methods: Three published frameworks for creating digital health technologies ("Person-Based Approach," "BIT" Model and IDEAS framework) were integrated and applied across two stages of research to inform the development, design and content of SMART Track. These frameworks were chosen to ensure that SMART Track was informed by the needs and preferences of the end-user ("Person-Based"); best practise recommendations for mHealth development ("BIT" Model) and a collaborative, iterative development process between the multi-disciplinary research team, app developers and end-users (IDEAS framework). Results: Stage one of the research process generated in-depth knowledge to inform app development, including a comprehensive set of aims (clinical, research/organisation, and usage); clear articulation of the target behaviour (self-monitoring of recovery related behaviours and experiences); relevant theory (self-determination and social control); appropriate behavioural strategies (e.g., behaviour change taxonomy and process motivators) and key factors that may influence engagement (e.g., transparency, relevance and trust). These findings were synthesised into guiding principles that were applied during stage two in an iterative approach to app design, content and development. Conclusions: This paper contributes new knowledge on important person-centred and theoretical considerations that underpin a novel ROM and feedback app for people with addictive behaviour(s). Although person-centred design and best-practise recommendations were employed, further research is needed to determine whether this leads to improved usage outcomes. Clinical Trial Registration: Pilot Trial: http://anzctr.org.au/Trial/Registration/TrialReview.aspx?id=377336.