Technology-Enabled Mental Health Service Reform for Open Arms - Veterans and Families Counselling: Participatory Design Study

What have been the clinical outcomes of the Project Synergy/InnoWell digital health platform?

Project Synergy is a digital mental health tool for assessment, referral and follow-up of people with mental health problems. The Australian federal government Department of Health entered an AUD33 million formal funding arrangement with InnoWell, a proprietary company vehicle (primarily the consultancy firm PwC and University of Sydney) to continue development of Project Synergy. This followed an initial federal National Health and Medical Research Council grant of AUD5.5 million over the previous 3 years. However, based on the assessment of peer-reviewed research data, the Project Synergy/InnoWell platform does not seem to have demonstrated clinical outcomes of healthcare value to date.

Developing a Parenting App to Support Young Children’s Socioemotional and Cognitive Development in Culturally Diverse Low- and Middle-Income Countries: Protocol for a Co-design Study

Background

Digital technologies are widely recognized for their equalizing effect, improving access to affordable health care regardless of gender, ethnicity, socioeconomic status, or geographic region. The Thrive by Five app is designed to promote positive interactions between children and their parents, extended family, and trusted members of the community to support socioemotional and cognitive development in the first 5 years of life and to strengthen connections to culture and community.

Objective

This paper aims to describe the iterative co-design process that underpins the development and refinement of Thrive by Five’s features, functions, and content. Minderoo Foundation commissioned this work as a quality improvement activity to support an engaging user experience and inform the development of culturally appropriate and relevant content for parents and caregivers in each country where the app is implemented.

Methods

The app content, referred to as Collective Actions, comprises “The Why,” that presents scientific principles that underpin socioemotional and cognitive development in early childhood. The scientific information is coupled with childrearing activities for parents, extended family, and members of the community to engage in with the children to support their healthy development and to promote positive connections between parents, families, and communities and these young children. Importantly, the initial content is designed and iteratively refined in collaboration with a subject matter expert group from each country (ie, alpha testing). This content is then configured into the app (either a beta version or localized version) for testing (ie, beta testing) by local parents and caregivers as well as experts who are invited to provide their feedback and suggestions for improvements in app content, features, and functions via a brief web-based survey and a series of co-design workshops. The quantitative survey data will be analyzed using descriptive statistics, whereas the analysis of qualitative data from the workshops will follow established thematic techniques.

Results

To date, the co-design protocol has been completed with subject matter experts, parents, and caregivers from 9 countries, with the first results expected to be published by early 2023. The protocol will be implemented serially in the remaining 21 countries.

Conclusions

Mobile technologies are the primary means of internet connection in many countries worldwide, which underscores the potential for mobile health programs to improve access to valuable, evidence-based, and previously unavailable parenting information. However, for maximum impact, it is critically important to ensure that mobile health programs are designed in collaboration with the target audience to support the alignment of content with parents’ cultural values and traditions and its relevance to their needs and circumstances.

International Registered Report Identifier (IRRID)

DERR1-10.2196/39225

Rapid systematic review on developing web-based interventions to support people affected by cancer

OBJECTIVE

To systematically identify and explore the existing evidence to inform the development of web-based interventions to support people affected by cancer (PABC).

DESIGN

A rapid review design was employed in accordance with the guidance produced by the Cochrane Rapid Reviews Methods Group and reported using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses checklist. A rapid review was chosen due to the need for a timely evidence synthesis to underpin the subsequent development of a digital resource (Shared Lives: Cancer) as part of an ongoing funded project.

METHODS AND OUTCOMES

Keyword searches were performed in MEDLINE to identify peer-reviewed literature that reported primary data on the development of web-based interventions designed to support PABC. The review included peer-reviewed studies published in English with no limits set on publication date or geography. Key outcomes included any primary data that reported on the design, usability, feasibility, acceptability, functionality and user experience of web-based resource development.

RESULTS

Ten studies were identified that met the pre-specified eligibility criteria. All studies employed an iterative, co-design approach underpinned by either quantitative, qualitative or mixed methods. The findings were grouped into the following overarching themes: (1) exploring current evidence, guidelines and theory, (2) identifying user needs and preferences and (3) evaluating the usability, feasibility and acceptability of resources. Resources should be informed by the experiences of a wide range of end-users taking into consideration current guidelines and theory early in the design process. Resource design and content should be developed around the user's needs and preferences and evaluated through usability, feasibility or acceptability testing using quantitative, qualitative or mixed methods.

CONCLUSION

The findings of this rapid review provide novel methodological insights into the approaches used to design web-based interventions to support PABC. Our findings have the potential to inform and guide researchers when considering the development of future digital health resources.

TRIAL REGISTRATION NUMBER

The review protocol was registered on the Open Science Framework (https://osf.io/ucvsz).

Co-design tensions between families and children around mobile health technology design needs and decisions: A case study (Preprint)

BACKGROUND

Just-in-time adaptive interventions (JITAIs) in mobile health are an intervention design that provides behavior change support based on an individual's changing and dynamic contextual state. However, few studies have documented how end users of JITAI technologies are involved in their development, particularly from historically marginalized families and children. Less is known for public health researchers and designers of the tensions that occur as families negotiate their needs.

OBJECTIVE

We aimed to broaden our understanding of how historically marginalized families are included in co-design from a public health perspective. We sought to address research questions surrounding JITAIs; co-design; and working with historically marginalized families, including Black, Indigenous, and people of color (BIPOC) children and adults, regarding improving sun protection behaviors. We sought to better understand value tensions in parents' and children's needs regarding mobile health technologies and how design decisions are made.

METHODS

We examined 2 sets of co-design data (local and web-based) pertaining to a larger study on mobile SunSmart JITAI technologies with families in Los Angeles, California, United States, who were predominantly of Latinx and multiracial backgrounds. In these co-design sessions, we conducted stakeholder analysis through perceptions of harms and benefits and an assessment of stakeholder views and values. We open coded the data and compared the developed themes using a value-sensitive design framework by examining value tensions to help organize our qualitative data. Our study is formatted through a narrative case study that captures the essential meanings and qualities that are difficult to present, such as quotes in isolation.

RESULTS

We presented 3 major themes from our co-design data: different experiences with the sun and protection, misconceptions about the sun and sun protection, and technological design and expectations. We also provided value flow (opportunities for design), value dam (challenges to design), or value flow or dam (a hybrid problem) subthemes. For each subtheme, we provided a design decision and a response we ended up making based on what was presented and the kinds of value tensions we observed.

CONCLUSIONS

We provide empirical data to show what it is like to work with multiple BIPOC stakeholders in the roles of families and children. We demonstrate the use of the value tension framework to explain the different needs of multiple stakeholders and technology development. Specifically, we demonstrate that the value tension framework helps sort our participants' co-design responses into clear and easy-to-understand design guidelines. Using the value tension framework, we were able to sort the tensions between children and adults, family socioeconomic and health wellness needs, and researchers and participants while being able to make specific design decisions from this organized view. Finally, we provide design implications and guidance for the development of JITAI mobile interventions for BIPOC families.

Developing an mHealth App for Empowering Cancer Survivors With Disabilities: Co-design Study

Background

The transition from active treatment to long-term cancer survivorship leaves the needs of many cancer survivors unaddressed as they struggle with physical, cognitive, psychological, and social consequences of cancer and its treatment. The lack of guidance after treatment has forced cancer survivors to manage long-term effects on their own, which has an impact on their overall health, quality of life, and social participation. Mobile health (mHealth) interventions can be used to promote self-management and evidence-informed education.

Objective

This study aims to design an mHealth app for cancer survivors with disabilities that will offer interventions to improve their quality of life and increase their self-efficacy to manage cancer as a chronic condition.

Methods

We organized 3 co-design workshops with cancer survivors (n=5). These workshops included persona development based on data from 25 interviews with cancer survivors with disabilities; prototype ideation, where we sketched ideas for the prototype; and prototype development, where participants critiqued, and suggested improvements for, the wireframes.

Results

These workshops helped us to define the challenges that cancer survivors with disabilities face as well as important considerations when designing an mHealth app for cancer survivors with disabilities, such as the need for including flexibility, engagement, socialization, and a minimalistic design. We also outline guidelines for other researchers to follow when planning their own co-design workshops, which include allowing more time for discussion among participants, having small participant groups, keeping workshops engaging and inclusive, and letting participants dream big.

Conclusions

Using a co-design process aided us in developing a prototype of an mHealth app for cancer survivors with disabilities as well as a list of guidelines that other researchers can use to develop their own co-design workshops and design their app. Furthermore, working together with cancer survivors ensured that the design team had a deeper sense of empathy toward the target users and kept the focus on our ultimate goal: creating something that cancer survivors would want to use and benefit from. Future work will include usability testing of a high-fidelity prototype based on the results of these workshops.

eHealth Tools That Assess and Track Health and Well-being in Children and Young People: Systematic Review

Background

eHealth tools that assess and track health outcomes in children or young people are an emerging type of technology that has the potential to reform health service delivery and facilitate integrated, interdisciplinary care.

Objective

The aim of this review is to summarize eHealth tools that have assessed and tracked health in children or young people to provide greater clarity around the populations and settings in which they have been used, characteristics of digital devices (eg, health domains, respondents, presence of tracking, and connection to care), primary outcomes, and risks and challenges of implementation.

Methods

A search was conducted in PsycINFO, PubMed or MEDLINE, and Embase in April 2020. Studies were included if they evaluated a digital device whose primary purpose was to assess and track health, focused on children or young people (birth to the age of 24 years), reported original research, and were published in peer-reviewed journals in English.

Results

A total of 39 papers were included in this review. The sample sizes ranged from 7 to 149,329 participants (median 163, mean 5155). More studies were conducted in urban (18/39, 46%) regions than in rural (3/39, 8%) regions or a combination of urban and rural areas (8/39, 21%). Devices were implemented in three main settings: outpatient health clinics (12/39, 31%), hospitals (14/39, 36%), community outreach (10/39, 26%), or a combination of these settings (3/39, 8%). Mental and general health were the most common health domains assessed, with a single study assessing multiple health domains. Just under half of the devices tracked children’s health over time (16/39, 41%), and two-thirds (25/39, 64%) connected children or young people to clinical care. It was more common for information to be collected from a single informant (ie, the child or young person, trained health worker, clinician, and parent or caregiver) than from multiple informants. The health of children or young people was assessed as a primary or secondary outcome in 36% (14/39) of studies; however, only 3% (1/39) of studies assessed whether using the digital tool improved the health of users. Most papers reported early phase research (formative or process evaluations), with fewer outcome evaluations and only 3 randomized controlled trials. Identified challenges or risks were related to accessibility, clinical utility and safety, uptake, data quality, user interface or design aspects of the device, language proficiency or literacy, sociocultural barriers, and privacy or confidentiality concerns; ways to address these barriers were not thoroughly explored.

Conclusions

eHealth tools that assess and track health in children or young people have the potential to enhance health service delivery; however, a strong evidence base validating the clinical utility, efficacy, and safety of tools is lacking, and more thorough investigation is needed to address the risks and challenges of using these emerging technologies in clinical care. At present, there is greater potential for the tools to facilitate multi-informant, multidomain assessments and longitudinally track health over time and room for further implementation in rural or remote regions and community settings around the world.

Informing the Future of Integrated Digital and Clinical Mental Health Care: Synthesis of the Outcomes From Project Synergy

BACKGROUND

Globally, there are fundamental shortcomings in mental health care systems, including restricted access, siloed services, interventions that are poorly matched to service users' needs, underuse of personal outcome monitoring to track progress, exclusion of family and carers, and suboptimal experiences of care. Health information technologies (HITs) hold great potential to improve these aspects that underpin the enhanced quality of mental health care.

OBJECTIVE

Project Synergy aimed to co-design, implement, and evaluate novel HITs, as exemplified by the InnoWell Platform, to work with standard health care organizations. The goals were to deliver improved outcomes for specific populations under focus and support organizations to enact significant system-level reforms.

METHODS

Participating health care organizations included the following: Open Arms-Veterans & Families Counselling (in Sydney and Lismore, New South Wales [NSW]); NSW North Coast headspace centers for youth (Port Macquarie, Coffs Harbour, Grafton, Lismore, and Tweed Heads); the Butterfly Foundation's National Helpline for eating disorders; Kildare Road Medical Centre for enhanced primary care; and Connect to Wellbeing North Coast NSW (administered by Neami National), for population-based intake and assessment. Service users, families and carers, health professionals, and administrators of services across Australia were actively engaged in the configuration of the InnoWell Platform to meet service needs, identify barriers to and facilitators of quality mental health care, and highlight potentially the best points in the service pathway to integrate the InnoWell Platform. The locally configured InnoWell Platform was then implemented within the respective services. A mixed methods approach, including surveys, semistructured interviews, and workshops, was used to evaluate the impact of the InnoWell Platform. A participatory systems modeling approach involving co-design with local stakeholders was also undertaken to simulate the likely impact of the platform in combination with other services being considered for implementation within the North Coast Primary Health Network to explore resulting impacts on mental health outcomes, including suicide prevention.

RESULTS

Despite overwhelming support for integrating digital health solutions into mental health service settings and promising impacts of the platform simulated under idealized implementation conditions, our results emphasized that successful implementation is dependent on health professional and service readiness for change, leadership at the local service level, the appropriateness and responsiveness of the technology for the target end users, and, critically, funding models being available to support implementation. The key places of interoperability of digital solutions and a willingness to use technology to coordinate health care system use were also highlighted.

CONCLUSIONS

Although the COVID-19 pandemic has resulted in the widespread acceptance of very basic digital health solutions, Project Synergy highlights the critical need to support equity of access to HITs, provide funding for digital infrastructure and digital mental health care, and actively promote the use of technology-enabled, coordinated systems of care.

Privacy Practices of Health Information Technologies: Privacy Policy Risk Assessment Study and Proposed Guidelines

Background

Along with the proliferation of health information technologies (HITs), there is a growing need to understand the potential privacy risks associated with using such tools. Although privacy policies are designed to inform consumers, such policies have consistently been found to be confusing and lack transparency.

Objective

This study aims to present consumer preferences for accessing privacy information; develop and apply a privacy policy risk assessment tool to assess whether existing HITs meet the recommended privacy policy standards; and propose guidelines to assist health professionals and service providers with understanding the privacy risks associated with HITs, so that they can confidently promote their safe use as a part of care.

Methods

In phase 1, participatory design workshops were conducted with young people who were attending a participating headspace center, their supportive others, and health professionals and service providers from the centers. The findings were knowledge translated to determine participant preferences for the presentation and availability of privacy information and the functionality required to support its delivery. Phase 2 included the development of the 23-item privacy policy risk assessment tool, which incorporated material from international privacy literature and standards. This tool was then used to assess the privacy policies of 34 apps and e-tools. In phase 3, privacy guidelines, which were derived from learnings from a collaborative consultation process with key stakeholders, were developed to assist health professionals and service providers with understanding the privacy risks associated with incorporating HITs as a part of clinical care.

Results

When considering the use of HITs, the participatory design workshop participants indicated that they wanted privacy information to be easily accessible, transparent, and user-friendly to enable them to clearly understand what personal and health information will be collected and how these data will be shared and stored. The privacy policy review revealed consistently poor readability and transparency, which limited the utility of these documents as a source of information. Therefore, to enable informed consent, the privacy guidelines provided ensure that health professionals and consumers are fully aware of the potential for privacy risks in using HITs to support health and well-being.

Conclusions

A lack of transparency in privacy policies has the potential to undermine consumers’ ability to trust that the necessary measures are in place to secure and protect the privacy of their personal and health information, thus precluding their willingness to engage with HITs. The application of the privacy guidelines will improve the confidence of health professionals and service providers in the privacy of consumer data, thus enabling them to recommend HITs to provide or support care.

Evaluation of the Usability and Acceptability of the InnoWell Platform as Rated by Older Adults: Survey Study

Background

As the global population ages, there is increased interest in developing strategies to promote health and well-being in later life, thus enabling continued productivity, social engagement, and independence. As older adults use technologies with greater frequency, proficiency, and confidence, health information technologies (HITs) now hold considerable potential as a means to enable broader access to tools and services for the purposes of screening, treatment, monitoring, and ongoing maintenance of health for this group. The InnoWell Platform is a digital tool co-designed with lived experience to facilitate better outcomes by enabling access to a comprehensive multidimensional assessment, the results of which are provided in real time to enable consumers to make informed decisions about clinical and nonclinical care options independently or in collaboration with a health professional.

Objective

This study aims to evaluate the usability and acceptability of a prototype of the InnoWell Platform, co-designed and configured with and for older adults, using self-report surveys.

Methods

Participants were adults 50 years and older who were invited to engage with the InnoWell Platform naturalistically (ie, at their own discretion) for a period of 90 days. In addition, they completed short web-based surveys at baseline regarding their background, health, and mental well-being. After 90 days, participants were asked to complete the System Usability Scale to evaluate the usability and acceptability of the prototyped InnoWell Platform, with the aim of informing the iterative redesign and development of this digital tool before implementation within a health service setting.

Results

A total of 19 participants consented to participate in the study; however, only the data from the 16 participants (mean age 62.8 years, SD 7.5; range 50-72) who completed at least part of the survey at 90 days were included in the analyses. Participants generally reported low levels of psychological distress and good mental well-being. In relation to the InnoWell Platform, the usability scores were suboptimal. Although the InnoWell Platform was noted to be easy to use, participants had difficulty identifying the relevance of the tool for their personal circumstances. Ease of use, the comprehensive nature of the assessment tools, and the ability to track progress over time were favored features of the InnoWell Platform, whereas the need for greater personalization and improved mobile functionality were cited as areas for improvement.

Conclusions

HITs such as the InnoWell Platform have tremendous potential to improve access to cost-effective and low-intensity interventions at scale to improve and maintain mental health and well-being in later life. However, to promote adoption of and continued engagement with such tools, it is essential that these HITs are personalized and relevant for older adult end users, accounting for differences in background, clinical profiles, and levels of need.

Technology-Enabled Reform in a Nontraditional Mental Health Service for Eating Disorders: Participatory Design Study

BACKGROUND

The recent Australian National Agenda for Eating Disorders highlights the role technology can play in improving accessibility and service development through web-based prevention, early access pathways, self-help, and recovery assistance. However, engagement with the eating disorders community to co-design, build, and evaluate these much-needed technology solutions through participatory design processes has been lacking and, until recently, underresourced.

OBJECTIVE

This study aims to customize and configure a technology solution for a nontraditional (web-based, phone, email) mental health service that provides support for eating disorders and body image issues through the use of participatory design processes.

METHODS

Participants were recruited chiefly through the Butterfly National Helpline 1800 ED HOPE (Butterfly's National Helpline), an Australian-wide helpline supporting anyone concerned by an eating disorder or body image issue. Participants included individuals with lived experience of eating disorders and body image issues, their supportive others (such as family, health professionals, support workers), and staff of the Butterfly Foundation. Participants took part in participatory design workshops, running up to four hours, which were held nationally in urban and regional locations. The workshop agenda followed an established process of discovery, evaluation, and prototyping. Workshop activities included open and prompted discussion, reviewing working prototypes, creating descriptive artifacts, and developing user journeys. Workshop artifacts were used in a knowledge translation process, which identified key learnings to inform user journeys, user personas, and the customization and configuration of the InnoWell Platform for Butterfly's National Helpline. Further, key themes were identified using thematic techniques and coded in NVivo 12 software.

RESULTS

Six participatory design workshops were held, of which 45 participants took part. Participants highlighted that there is a critical need to address some of the barriers to care, particularly in regional and rural areas. The workshops highlighted seven overarching qualitative themes: identified barriers to care within the current system; need for people to be able to access the right care anywhere, anytime; recommendations for the technological solution (ie, InnoWell Platform features and functionality); need for communication, coordination, and integration of a technological solution embedded in Butterfly's National Helpline; need to consider engagement and tone within the technological solution; identified challenges and areas to consider when implementing a technological solution in the Helpline; and potential outcomes of the technological solution embedded in the Helpline relating to system and service reform. Ultimately, this technology solution should ensure that the right care is provided to individuals the first time.

CONCLUSIONS

Our findings highlight the value of actively engaging stakeholders in participatory design processes for the customization and configuration of new technologies. End users can highlight the critical areas of need, which can be used as a catalyst for reform through the implementation of these technologies in nontraditional services.

Optimising the integration of technology-enabled solutions to enhance primary mental health care: a service mapping study

Background

Despite the widely acknowledged potential for health information technologies to improve the accessibility, quality and clinical safety of mental health care, implementation of such technologies in services is frequently unsuccessful due to varying consumer, health professional, and service-level factors. The objective of this co-design study was to use process mapping (i.e. service mapping) to illustrate the current consumer journey through primary mental health services, identify barriers to and facilitators of quality mental health care, and highlight potential points at which to integrate the technology-enabled solution to optimise the provision of care based on key service performance indicators.

Methods

Interactive, discussion-based workshops of up to six hours were conducted with representative stakeholders from each participating service, including health professionals, service managers and administrators from Open Arms – Veterans & Families Counselling Service (Sydney), a counselling service for veterans and their families, and five headspace centres in the North Coast Primary Health Network, primary youth mental health services. Service maps were drafted and refined in real time during the workshops. Through both group discussion and the use of post-it notes, participants worked together to evaluate performance indicators (e.g. safety) at each point in the consumer journey (e.g. intake) to indicate points of impact for the technology-enabled solution, reviewing and evaluating differing opinions in order to reach consensus.

Results

Participants (n=84 across participating services) created service maps illustrating the current consumer journey through the respective services and highlighting barriers to and facilitators of quality mental health care. By consensus, the technology-enabled solution as facilitated by the InnoWell Platform was noted to enable the early identification of risk, reduce or eliminate lengthy intake processes, enable routine outcome monitoring to revise treatment plans in relation to consumer response, and serve as a personal data record for consumers, driving person-centred, coordinated care.

Conclusions

Service mapping was shown to be an effective methodology to understand the consumer’s journey through a service and served to highlight how the co-designed technology-enabled solution can optimise service pathways to improve the accessibility, quality and clinical safety of care relative to key service performance indicators, facilitating the delivery of the right care.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-021-06069-0.

Understanding Technology Preferences and Requirements for Health Information Technologies Designed to Improve and Maintain the Mental Health and Well-Being of Older Adults: Participatory Design Study

Background

Worldwide, the population is aging rapidly; therefore, there is a growing interest in strategies to support and maintain health and well-being in later life. Although familiarity with technology and digital literacy are increasing among this group, some older adults still lack confidence in their ability to use web-based technologies. In addition, age-related changes in cognition, vision, hearing, and perception may be barriers to adoption and highlight the need for digital tools developed specifically to meet the unique needs of older adults.

Objective

The aim of this study is to understand the use of technology by older adults in general and identify the potential barriers to and facilitators of the adoption of health information technologies (HITs) to support the health and well-being of older adults to facilitate implementation and promote user uptake. In addition, this study aims to co-design and configure the InnoWell Platform, a digital tool designed to facilitate better outcomes for people seeking mental health services, to meet the needs of adults 50 years and older and their supportive others (eg, family members, caregivers) to ensure the accessibility, engagement, and appropriateness of the technology.

Methods

Participants were adults 50 years and older and those who self-identified as a supportive other (eg, family member, caregiver). Participants were invited to participate in a 3-hour participatory design workshop using a variety of methods, including prompted discussion, creation of descriptive artifacts, and group-based development of user journeys.

Results

Four participatory design workshops were conducted, including a total of 21 participants, each attending a single workshop. Technology use was prevalent, with a preference indicated for smartphones and computers. Factors facilitating the adoption of HITs included personalization of content and functionality to meet and be responsive to a consumer’s needs, access to up-to-date information from reputable sources, and integration with standard care practices to support the relationship with health professionals. Concerns regarding data privacy and security were the primary barriers to the use of technology to support mental health and well-being.

Conclusions

Although HITs have the potential to improve access to cost-effective and low-intensity interventions at scale for improving and maintaining mental health and well-being, several strategies may improve the uptake and efficacy of technologies by the older adult community, including the use of co-design methodologies to ensure usability, acceptability, and appropriateness of the technology; support in using and understanding the clinical applications of the technology by a digital navigator; and ready availability of education and training materials.

Using Digital Technologies to Facilitate Care Coordination Between Youth Mental Health Services: A Guide for Implementation

Enhanced care coordination is essential to improving access to and navigation between youth mental health services. By facilitating better communication and coordination within and between youth mental health services, the goal is to guide young people quickly to the level of care they need and reduce instances of those receiving inappropriate care (too much or too little), or no care at all. Yet, it is often unclear how this goal can be achieved in a scalable way in local regions. We recommend using technology-enabled care coordination to facilitate streamlined transitions for young people across primary, secondary, more specialised or hospital-based care. First, we describe how technology-enabled care coordination could be achieved through two fundamental shifts in current service provisions; a model of care which puts the person at the centre of their care; and a technology infrastructure that facilitates this model. Second, we detail how dynamic simulation modelling can be used to rapidly test the operational features of implementation and the likely impacts of technology-enabled care coordination in a local service environment. Combined with traditional implementation research, dynamic simulation modelling can facilitate the transformation of real-world services. This work demonstrates the benefits of creating a smart health service infrastructure with embedded dynamic simulation modelling to improve operational efficiency and clinical outcomes through participatory and data driven health service planning.

Recommendations for Implementing Gamification for Mental Health and Wellbeing

Gamification is increasingly being proposed as a strategy to increase engagement for mental health and wellbeing technologies. However, its implementation has been criticized as atheoretical, particularly in relation to behavior change theory and game studies theories. Definitions of the term “gamification” vary, sometimes widely, between and within academic fields and the effectiveness of gamification is yet to be empirically established. Despite this, enthusiasm for developing gamified mental health technologies, such as interventions, continues to grow. There is a need to examine how best to implement gamification in mental health and wellbeing technologies in a way that takes quick production cycles into account while still emphasizing empirical investigation and building a rigorous evidence base. With reference to game studies and the medical (eHealth/mHealth) literature, this article interrogates gamification for mental health and wellbeing by examining core properties of the game form. It then explores how gamification can best be conceptualized and implemented for mental health and wellbeing goals from conceptualization through to iterative co-development and evaluation that accommodates software development schedules. Finally, it summarizes its conceptual analysis into recommendations for researchers and designers looking to do so. These recommendations are: (1) assess suitability, (2) implement to support, (3) assess acceptability, (4) evaluate impact, and (5) document comprehensively. These recommendations aim to encourage clear language, unified terminology, the application and evaluation of theory, comprehensive and constant documentation, and transparent evaluation of outcomes.

Technology-Enabled Solutions for Australian Mental Health Services Reform: Impact Evaluation

Background

Health information technologies (HITs) are becoming increasingly recognized for their potential to provide innovative solutions to improve the delivery of mental health services and drive system reforms for better outcomes.

Objective

This paper describes the baseline results of a study designed to systematically monitor and evaluate the impact of implementing an HIT, namely the InnoWell Platform, into Australian mental health services to facilitate the iterative refinement of the HIT and the service model in which it is embedded to meet the needs of consumers and their supportive others as well as health professionals and service providers.

Methods

Data were collected via web-based surveys, semistructured interviews, and a workshop with staff from the mental health services implementing the InnoWell Platform to systematically monitor and evaluate its impact. Descriptive statistics, Fisher exact tests, and a reliability analysis were used to characterize the findings from the web-based surveys, including variability in the results between the services. Semistructured interviews were coded using a thematic analysis, and workshop data were coded using a basic content analysis.

Results

Baseline data were collected from the staff of 3 primary youth mental health services (n=18), a counseling service for veterans and their families (n=23), and a helpline for consumers affected by eating disorders and negative body image issues (n=6). As reported via web-based surveys, staff members across the services consistently agreed or strongly agreed that there was benefit associated with using technology as part of their work (38/47, 81%) and that the InnoWell Platform had the potential to improve outcomes for consumers (27/45, 60%); however, there was less certainty as to whether their consumers’ capability to use technology aligned with how the InnoWell Platform would be used as part of their mental health care (11/45, 24% of the participants strongly disagreed or disagreed; 15/45, 33% were neutral; and 19/45, 42% strongly agreed or agreed). During the semistructured interviews (n=3) and workshop, participants consistently indicated that the InnoWell Platform was appropriate for their respective services; however, they questioned whether the services’ respective consumers had the digital literacy required to use the technology. Additional potential barriers to implementation included health professionals’ digital literacy and service readiness for change.

Conclusions

Despite agreement among participants that HITs have the potential to result in improved outcomes for consumers and services, service readiness for change (eg, existing technology infrastructure and the digital literacy of staff and consumers) was noted to potentially impact the success of implementation, with less than half (20/45, 44%) of the participants indicating that their service was ready to implement new technologies to enhance mental health care. Furthermore, participants reported mixed opinions as to whether it was their responsibility to recommend technology as part of standard care.

Generative Participatory Design Methodology to Develop Electronic Health Interventions: Systematic Literature Review

BACKGROUND

Generative participatory design (PD) may help in developing electronic health (eHealth) interventions. PD is characterized by the involvement of all stakeholders in creative activities. This is different from the traditional user-centered design, where users are less involved. When looking at PD from a research through design perspective, it is important to summarize the reasons for choosing a certain form of generative PD to further develop its methodology. However, the scientific literature is currently unclear about which forms of PD are used to develop eHealth and which arguments are used to substantiate the decision to use a certain form of generative PD.

OBJECTIVE

This study aimed to explore the reporting and substantiation of generative PD methodologies in empirical eHealth studies published in scientific journals to further develop PD methodology in the field of eHealth.

METHODS

A systematic literature review following the Cochrane guidelines was conducted in several databases (EMBASE, MEDLINE Ovid, Web of Science, and CINAHL EBSCOhost). Data were extracted on the recruitment and management of stakeholders, the use of tools, and the use of outcome measures.

RESULTS

Of the 3131 studies initially identified, 69 were selected for qualitative synthesis. The reporting was very variable, depending to a large extent on whether the study stated that reporting on the PD process was a major aim. The different levels of reporting and substantiation of the choices of a recruitment strategy, stakeholder management, and tools and outcome measures are presented. Only a few authors explicitly used arguments directly related to PD guiding principles such as democratic, mutual learning, tacit and latent knowledge, and collective creativity. Even though PD principles were not always explicitly discussed in the method descriptions of the studies, they were implicitly present, mostly in the descriptions of the use of PD tools. The arguments used to substantiate the choices made in stakeholder management, PD tools, and the type of outcome measures adopted point to the involvement of PD principles.

CONCLUSIONS

Studies that have used a PD research methodology to develop eHealth primarily substantiate the choice of tools made and much less the use of stakeholders and outcome measures.

Technology-Enabled Person-Centered Mental Health Services Reform: Strategy for Implementation Science

BACKGROUND

Health information technologies are being rapidly developed to improve the delivery of mental health care; however, a range of facilitators, barriers, and contextual conditions can impact the adoption and sustainment of these solutions. An implementation science protocol supports researchers to achieve primary effectiveness goals in relation to mental health services reform and aids in the optimization of implementation processes to promote quality health care, prolonging sustainability.

OBJECTIVE

The aim of this paper is to describe our implementation science protocol, which serves as a foundation by which to systematically guide the implementation of technology-enabled solutions in traditional face-to-face and Web-based mental health services, allowing for revisions over time on the basis of retrospective review and constructive feedback from the services in which the technology-enabled solutions are implemented.

METHODS

Our implementation science protocol comprises four phases. The primary objective of the scoping and feasibility phase (Phase 1) is to determine the alignment between the service partner and the quality improvement goals supported by the technology-enabled solution. This is followed by Phase 2, the local co-design and preimplementation phase, which aims to utilize co-design methodologies, including service pathway modelling, participatory design, and user (acceptance) testing, to determine how the solutions could be used to enhance the service. In Phase 3, implementation, the accepted solution is embedded in the mental health service to achieve better outcomes for consumers and their families as well as health professionals and service managers. Using iterative evaluative processes throughout Phase 3, the solution is continuously developed, designed, and refined during implementation to adapt to the changing needs of the stakeholders, including consumers with lived experience and their families as well as the service. Thus, the primary outcome of Phase 3 is the optimized technology-enabled solution that can be maintained in a service during the sustainment and scalability phase (Phase 4) for the purposes of mental health services reform.

RESULTS

Funding for the protocol was provided by the Australian Government Department of Health in June of 2017 for a period of 3 years. At the time of this publication, the protocol had been initiated in 11 services, serving three populations, all of which are currently operating in Phase 3. The first results are expected to be submitted for publication in 2020.

CONCLUSIONS

With the aim of improving mental health service quality, our implementation science protocol aids in the identification of factors that predict the likelihood of implementation success, as well as the development of strategies to proactively mitigate potential barriers to achieve better implementation outcomes. Putting in place a theoretically sound implementation science protocol is essential to facilitate the uptake of novel technology-enabled solutions and evidence-based practices into routine clinical practice for the purposes of improved outcomes.