Lessons Learned From Using Focus Groups to Refine Digital Interventions

The development of a smartphone app to enhance post-traumatic stress disorder treatment in high-risk workers

Objective

Post-traumatic stress disorder (PTSD) is highly prevalent in certain populations. However, evidence indicates that many individuals do not respond to treatment. Digital supports hold promise for increasing service provision and engagement but there is a lack of evidence on blended care options and still less research guiding the development of such tools. This study details the development and overarching framework used to build a smartphone app to support PTSD treatment.

Methods

The app was developed in line with the Integrate, Design, Assess, and Share (IDEAS) framework for the development of digital health interventions and involved clinicians (n=3), frontline worker clients (n=5) and trauma-exposed frontline workers (n=19). Integrated iterative rounds of testing were conducted via in-depth interviews, surveys, prototype testing and workshops, alongside app and content development.

Results

Clinicians and frontline workers both expressed a clear preference for the app to augment but not replace face-to-face therapy, with the aim of increasing between-session support, and facilitating homework completion. Content was adapted for app delivery from manualised therapy (trauma-focused cognitive behavioural therapy (CBT). Prototype versions of the app were well received, with both clinicians and clients reporting the app was easy to use, understandable, appropriate and highly recommendable. System Usability Scale (SUS) scores were on average in the excellent range (82/100).

Conclusions

This is one of the first studies to document the development of a blended care app designed specifically to augment clinical care for PTSD, and the first within a frontline worker population. Through a systematic framework with active end user consultation, a highly usable app was built to undergo subsequent evaluation.

Beyond consumption: a qualitative investigation of hospital clinician attitudes to receiving feedback on antimicrobial prescribing quality

BACKGROUND

Feedback on optimal antimicrobial prescribing to clinicians is an important strategy to ensure antimicrobial stewardship (AMS) in the hospital setting.

OBJECTIVE

To explore the perceptions of antimicrobial prescribing feedback among clinicians in acute care.

STUDY DESIGN

Prospective qualitative design.

SETTING

A large inner-city tertiary referral center in Dublin, Ireland.

PARTICIPANTS

Clinicians were recruited from the hospital clinician population.

METHODS

A qualitative study was conducted with a purposive sample of multidisciplinary clinicians. Focus groups and semistructured interviews were used to collect data that were analyzed inductively to identify themes.

RESULTS

In total, 30 clinicians from medical, surgical, nursing and pharmacy professions participated in the study. We identified 5 themes: (1) antimicrobial consumption perceived as a proxy measure for prescribing quality; (2) lack of connection between antimicrobial prescribing and patient outcomes; (3) relevance and impact of antimicrobial prescribing feedback associated with professional role; (4) attitudes regarding feedback as an AMS strategy; and (5) knowledge regarding AMS, including antimicrobial prescribing quality measures.

CONCLUSIONS

Focused feedback on antimicrobial prescribing, with clear goals for improvement, could serve as a useful AMS strategy among clinicians in the acute-care setting. The need for further education and training in AMS was also identified.

Perceptions on mobile health use for health education in an Indigenous population

Introduction

Indigenous peoples in Canada face numerous health needs and challenges and often have poor health status due to inequitable access to care. Providing culturally appropriate support for health conditions, particularly chronic conditions that require self-management, can assist in averting complications and morbidity. Mobile health is a useful medium for delivering health education across different populations. However, meaningful user involvement is necessary because mobile health interventions suitable for one population may not be appropriate for another. Indigenous people’s views will inform the use of mobile health interventions in Indigenous communities.

Objective

The study explored the perception of Indigenous women on using mobile health as a tool for receiving health information.

Methods

This was a qualitative study, and participants comprised of 22 Indigenous women (First Nations and Métis) with or at risk of diabetes, aged 18–69 years in Saskatoon, Canada. After 12 weeks of disseminating diabetic eye care information via text messaging, data were collected via sharing circle discussions and analyzed using thematic analysis.

Results

Participants indicated that the nature of messages such as the use of Indigenous languages, the message content, frequency of messages, group activities, and delivery formats such as voice messages, mobile applications, Internet, two-way messaging, and text messages were essential considerations in using mobile health as a tool for receiving health information.

Conclusion

Different factors need to be considered in using mobile health as a tool for health education among Indigenous peoples. These factors could be applicable in implementing mobile health solutions in other populations for the management of health conditions.

Aesthetically Designing Video-Call Technology With Care Home Residents: A Focus Group Study

Background

Video-calls have proven to be useful for older care home residents in improving socialization and reducing loneliness. Nonetheless, to facilitate the acceptability and usability of a new technological intervention, especially among people with dementia, there is a need for user-led design improvements. The current study conducted focus groups with an embedded activity with older people to allow for a person-centered design of a video-call intervention.

Methods

Twenty-eight residents across four care homes in the South West of England participated in focus groups to aesthetically personalize and ‘dress-up’ the equipment used in a video-call intervention. Each care home was provided with a ‘Skype on Wheels’ (SoW) device, a wheelable ‘chassis’ comprising an iPad or tablet for access to Skype, and a telephone handset. During the focus group, residents were encouraged to participate in an activity using colorful materials to ‘dress-up’ SoW. Comments before, during and after the ‘dress up’ activity were audio recorded. Framework analysis was used to analyze the focus group data.

Results

Older people, including seven with dementia were able to interact with and implement design changes to SoW through aesthetic personalization. Themes arising from the data included estrangement, anthropomorphism, reminiscence, personalization, need for socialization versus fear of socialization and attitudes toward technology. After this brief exposure to SoW, residents expressed the likelihood of using video-calls for socialization in the future.

Conclusion

Care home residents enjoy engaging with new technologies when given the opportunity to interact with it, to personalize it and to understand its purpose. Low cost aesthetic personalization of technologies can improve their acceptability, usability, and implementation within complex care environments.

A Focus Group Study of Provider and Patient Perceptions of Communicating Advanced Care Planning Wishes Using Digital Storytelling

Advanced care planning (ACP) and end-of-life discussions are especially difficult among persons living with human immunodeficiency virus (HIV)/acquired immunodeficiency syndrome (AIDS) as a result of patients' lack of trust in family and providers, HIV-related stigma, misunderstood spirituality concerns, social isolation, and other factors. Previous research has demonstrated that relatively few persons living with HIV/AIDS engage in ACP, yet developing culturally sensitive methods of ACP is imperative. One such method is digital storytelling, a video narrative that can be used to share ideas or aspects of a life story.The aim of this study was to examine perspectives from providers and persons living with HIV/AIDS about the acceptability, benefits, and technological challenges of and barriers to using digital storytelling for ACP. A qualitative descriptive design was employed using focus groups of 21 participants in South Central Appalachia. Transcribed data were analyzed using qualitative content analysis. Findings revealed patient and provider ideas about ACP, factors related to digital story acceptability, stigma against persons living with HIV/AIDS, and concern for the legality of ACPs expressed in digital story format. Future research should focus on the process of creating digital stories as an intervention to improve ACP in this unique aggregate.

Involving stakeholders in the design of ecological momentary assessment research: An example from smoking cessation

Ecological momentary assessment (EMA) is a data collection method that involves repeated sampling of participants’ real-time experience and behavior as they unfold in context. A primary challenge in EMA research is to design surveys that adequately assess constructs of interest while minimizing participant burden. To achieve this balance, researchers must make decisions regarding which constructs should be included and how those constructs should be assessed. To date, a dearth of direction exists for how to best design and carry out EMA studies. The lack of guidelines renders it difficult to systematically compare findings across EMA studies. Study design decisions may be improved by including input from potential research participants (stakeholders). The goal of the present paper is to introduce a general approach for including stakeholders in the development of EMA research design. Rather than suggesting rigid prescriptive guidelines (e.g., the correct number of survey items), we present a systematic and reproducible process through which extant research and stakeholder experience can be leveraged to make design decisions. To that end, we report methods and results for a series of focus group discussions with current tobacco users that were conducted to inform the design of an EMA study aimed at identifying person-specific mechanisms driving tobacco use. We conclude by providing recommendations for item-selection procedures in EMA studies.

Proposing a standardized, step-by-step model for creating post-traumatic stress disorder (PTSD) related mobile mental health apps in a framework based on technical and medical norms

Background: Prevalence of post-traumatic stress disorder (PTSD) is a problem all over the world. There are high barriers for entry into formal psychotherapy, which results in a lack of mental health care for a significant part of the population. Mobile mental Health (mMHealth) applications (apps) seem to be a promising new development for countering this lack of care, building on the success of mHealth (Mobile Health) apps in general. Unfortunately, the overall quality of such apps stands in high contrast to their number. The aim of this manuscript is to propose a standard for creating PTSD-related mMHealth apps incorporating a process for evaluation and assessment of their usability and impact. Methods: This is done by first defining each step of the process and its relation to the other steps. The steps themselves, divided into those concerned with development, evaluation and implementation, are bound to the established medical and technical norms pertaining to them. Existing protocols from recent literature have been integrated into these steps. Results: As a result, a comprehensive model covering the process of creating, assessing and implementing an mMHealth app from start to finish was developed. The model may be adapted to other disorders or specialized for certain symptoms of PTSD. Conclusion: Adopting such a model could result in a 'blueprint' for creating mMHealth apps in a standardized way, thereby facilitating the testing and comparing of such apps.

Multidisciplinary Smartphone-Based Interventions to Empower Patients With Acute Coronary Syndromes: Qualitative Study on Health Care Providers' Perspectives

Background

Postdischarge interventions are limited in patients with acute coronary syndrome (ACS) due to few scheduled visits to outpatient clinics and travel from remote areas. Smartphones have become a viable lifestyle technology to deliver educational and health interventions following discharge from hospital.

Objective

The purpose of this study was to identify the requirements for the delivery of a mobile health intervention for the postdischarge management of patients with ACS via a multidisciplinary focus group.

Methods

We conducted a focus group among health care professionals (n=10) from a large metropolitan hospital in May 2017. These participants from a multidisciplinary team contributed to a 1-hour discussion by responding to 8 questions relating to the applicability of smartphone-based educational and health interventions. Descriptive statistics of the focus group data were analyzed using SPSS. The qualitative data were analyzed according to relevant themes extracted from the focus group transcription, using a qualitative description software program (NVivo 11) and an ontology-based concept mapping approach.

Results

The mean age of the participants was 47 (SD 8) years: 3 cardiologists; 2 nurse practitioners; 2 clinical nurses; 2 research scientists; and 1 physiotherapist. Of these participants, 70% (7/10) had experience using electronic health intervention during their professional practice. A total of 7 major themes and their subthemes emerged from the qualitative analysis. Health care providers indicated that comprehensive education on diet, particularly providing daily meal plans, is critical for patients with ACS. In terms of ACS symptoms, a strong recommendation was to focus on educating patients instead of daily monitoring of chest pain and shortness of breathing due to subjectivity and insufficient information for clinicians. Participants pointed that monitoring health measures such as blood pressure and body weight may result in increased awareness of patient physical health, yet may not be sufficient to support patients with ACS via the smartphone-based intervention. Therefore, monitoring pain and emotional status along with other health measures was recommended. Real-time support via FaceTime or video conferencing was indicated as motivational and supportive for patient engagement and self-monitoring. The general demographics of patients with ACS being older, having a low educational level, and a lack of computer skills were identified as potential barriers for engagement with the smartphone-based intervention.

Conclusions

A smartphone-based program that incorporates the identified educational materials and health interventions would motivate patients with ACS to engage in the multidisciplinary intervention and improve their health outcomes following discharge from hospital.

An Assessment Framework for e-Mental Health Apps in Canada: Results of a Modified Delphi Process

Background

The number of e-mental health apps is increasing rapidly. Studies have shown that the use of some apps is beneficial, whereas others are ineffective or do not meet users’ privacy expectations. Individuals and organizations that curate, recommend, host, use, or pay for apps have an interest in categorizing apps according to the consensus criteria of usability and effectiveness. Others have previously published recommendations for assessing health-related apps; however, the extent to which these recommendations can be generalized across different population groups (eg, culture, gender, and language) remains unclear. This study describes an attempt by Canadian stakeholders to develop an e-mental health assessment framework that responds to the unique needs of people living in Canada in an evidence-based manner.

Objective

The objective of our study was to achieve consensus from a broad group of Canadian stakeholders on guiding principles and criteria for a framework to assess e-mental health apps in Canada.

Methods

We developed an initial set of guiding principles and criteria from a rapid review and environmental scan of pre-existing app assessment frameworks. The initial list was refined through a two-round modified Delphi process. Participants (N=25) included app developers and users, health care providers, mental health advocates, people with lived experience of a mental health problem or mental illness, policy makers, and researchers. Consensus on each guideline or criterion was defined a priori as at least 70% agreement. The first round of voting was conducted electronically. Prior to Round 2 voting, in-person presentations from experts and a persona empathy mapping process were used to explore the perspectives of diverse stakeholders.

Results

Of all respondents, 68% (17/25) in Round 1 and 100% (13/13) in Round 2 agreed that a framework for evaluating health apps is needed to help Canadian consumers identify high-quality apps. Consensus was reached on 9 guiding principles: evidence based, gender responsive, culturally appropriate, user centered, risk based, internationally aligned, enabling innovation, transparent and fair, and based on ethical norms. In addition, 15 informative and evaluative criteria were defined to assess the effectiveness, functionality, clinical applicability, interoperability, usability, transparency regarding security and privacy, security or privacy standards, supported platforms, targeted users, developers’ transparency, funding transparency, price, user desirability, user inclusion, and meaningful inclusion of a diverse range of communities.

Conclusions

Canadian mental health stakeholders reached the consensus on a framework of 9 guiding principles and 15 criteria important in assessing e-mental health apps. What differentiates the Canadian framework from other scales is explicit attention to user inclusion at all stages of the development, gender responsiveness, and cultural appropriateness. Furthermore, an empathy mapping process markedly influenced the development of the framework. This framework may be used to inform future mental health policies and programs.

Participants' Perceptions on the Use of Wearable Devices to Reduce Sitting Time: Qualitative Analysis

Background

Recent epidemiological evidence indicates that, on average, people are sedentary for approximately 7.7 hours per day. There are deleterious effects of prolonged sedentary behavior that are separate from participation in physical activity and include increased risk of weight gain, cancer, metabolic syndrome, diabetes, and heart disease. Previous trials have used wearable devices to increase physical activity in studies; however, additional research is needed to fully understand how this technology can be used to reduce sitting time.

Objective

The purpose of this study was to explore the potential of wearable devices as an intervention tool in a larger sedentary behavior study through a general inductive and deductive analysis of focus group discussions.

Methods

We conducted four focus groups with 15 participants to discuss 7 different wearable devices with sedentary behavior capabilities. Participants recruited for the focus groups had previously participated in a pilot intervention targeting sedentary behavior over a 3-week period and were knowledgeable about the challenges of reducing sitting time. During the focus groups, participants commented on the wearability, functionality, and feedback mechanism of each device and then identified their two favorite and two least favorite devices. Finally, participants designed and described their ideal or dream wearable device. Two researchers, who have expertise analyzing qualitative data, coded and analyzed the data from the focus groups. A thematic analysis approach using Dedoose software (SocioCultural Research Consultants, LLC version 7.5.9) guided the organization of themes that reflected participants’ perspectives.

Results

Analysis resulted in 14 codes that we grouped into themes. Three themes emerged from our data: (1) features of the device, (2) data the device collected, and (3) how data are displayed.

Conclusions

Current wearable devices for increasing physical activity are insufficient to intervene on sitting time. This was especially evident when participants voted, as several participants reported using a “process of elimination” as opposed to choosing favorites because none of the devices were ideal for reducing sitting time. To overcome the limitations in current devices, future wearable devices designed to reduce sitting time should include the following features: waterproof, long battery life, accuracy in measuring sitting time, real time feedback on progress toward sitting reduction goals, and flexible options for prompts to take breaks from sitting.

Conducting online focus groups on Facebook to inform health behavior change interventions: Two case studies and lessons learned

BACKGROUND

Online social media offer great potential for research participant recruitment and data collection. We conducted synchronous (real-time) online focus groups (OFGs) through Facebook with the target population of young adult substance users to inform development of Facebook health behavior change interventions. In this paper we report methods and lessons learned for future studies.

METHODS

In the context of two research studies participants were recruited through Facebook and assigned to one of five 90-minute private Facebook OFGs. Study 1 recruited for two OFGs with young adult sexual and/or gender minority (SGM) smokers (range: 9 to 18 participants per group); Study 2 recruited for three groups of young adult smokers who also engage in risky drinking (range: 5 to 11 participants per group).

RESULTS

Over a period of 11 (Study 1) and 22 days (Study 2), respectively, we recruited, assessed eligibility, collected baseline data, and assigned a diverse sample of participants from all over the US to Facebook groups. For Study 1, 27 of 35 (77%) participants invited attended the OFGs, and 25 of 32 (78%) for Study 2. Participants in Study 1 contributed an average of 30.9 (SD=8.9) comments with an average word count of 20.1 (SD=21.7) words, and 36.0 (SD=12.3) comments with 11.9 (SD=13.5) words on average in Study 2. Participants generally provided positive feedback on the study procedures.

CONCLUSIONS

Facebook can be a feasible and efficient medium to conduct synchronous OFGs with young adults. This data collection strategy has the potential to inform health behavior change intervention development.

Design of a Mobile App for Nutrition Education (TreC-LifeStyle) and Formative Evaluation With Families of Overweight Children

BACKGROUND

Nutrition and diet apps represent today a popular area of mobile health (mHealth), offering the possibility of delivering behavior change (BC) interventions for healthy eating and weight management in a scalable and cost-effective way. However, if commercial apps for pediatric weight management fail to retain users because of a lack of theoretical background and evidence-based content, mHealth apps that are more evidence-based are found less engaging and popular among consumers. Approaching the apps development process from a multidisciplinary and user-centered design (UCD) perspective is likely to help overcome these limitations, raising the chances for an easier adoption and integration of nutrition education apps within primary care interventions.

OBJECTIVE

The aim of this study was to describe the design and development of the TreC-LifeStyle nutrition education app and the results of a formative evaluation with families.

METHODS

The design of the nutrition education intervention was based on a multidisciplinary UCD approach, involving a team of BC experts, working with 2 nutritionists and 3 pediatricians from a primary care center. The app content was derived from evidence-based knowledge founded on the Food Pyramid and Mediterranean Diet guidelines used by pediatricians in primary care. A formative evaluation of the TreC-LifeStyle app involved 6 families of overweight children (aged 7-12 years) self-reporting daily food intake of children for 6 weeks and providing feedback on the user experience with the mHealth intervention. Analysis of the app's usage patterns during the intervention and of participants' feedback informed the refinement of the app design and a tuning of the nutrition education strategies to improve user engagement and compliance with the intervention.

RESULTS

Design sessions with the contribution of pediatricians and nutritionists helped define the nutrition education app and intervention, providing an effective human and virtual coaching approach to raise parents' awareness about children's eating behavior and lifestyle. The 6 families participating in the pilot study found the app usable and showed high compliance with the intervention over the 6 weeks, but analysis of their interaction and feedback showed the need for improving some of the app features related to the BC techniques "monitoring of the behavior" and "information provision."

CONCLUSIONS

The UCD and formative evaluation of TreC-LifeStyle show that nutrition education apps are feasible and acceptable solutions to support health promotion interventions in primary care.

Understanding Dutch practice nurses' adherence to evidence-based smoking cessation guidelines and their needs for web-based adherence support: results from semistructured interviews

OBJECTIVES

Practice nurses in general practices suboptimally adhere to smoking cessation guidelines. Since the effectiveness of their smoking cessation support is greatest when full adherence to these guidelines is achieved, interventions need to be developed to improve practice nurses' guideline adherence, for example, by tailoring their content to adherence determinants. However, the sociocognitive determinants explaining adherence have not yet been investigated. Therefore, this qualitative needs assessment aimed to explore practice nurses' current counselling practices, as well as their sociocognitive beliefs related to their smoking cessation guideline adherence and their needs regarding web-based adherence support.

SETTING

Primary care; general practices in the Netherlands.

PARTICIPANTS

19 practice nurses, actively involved in smoking cessation counselling.

METHODS

Semistructured individual interviews, based on the I-Change Model and the Diffusion of Innovations Theory, were conducted from May to September 2014. Data were systematically analysed using the Framework Method and considered reliable (κ 0.77; % agreement 99%).

RESULTS

Respondents felt able to be empathic and collaborative during smoking cessation consultations. They also reported psychological (eg, low self-efficacy to increase patient motivation and arranging adequate follow-up consultations) and practical barriers (eg, outdated information on quit support compensation and a perceived lack of high-quality trainings for practice nurses) to smoking cessation guideline adherence. Most respondents were interested in web-based adherence support to overcome these barriers.

CONCLUSIONS

Sociocognitive determinants influence practice nurses' smoking cessation guideline adherence. To improve their adherence, web-based tailored adherence support can provide practice nurses with personally relevant feedback tailored to individually perceived barriers to smoking cessation guideline adherence. More specifically, low self-efficacy levels can be increased by peer modelling (eg, presenting narratives of colleagues) and up-to-date information can be presented online, enabling practice nurses to use it during patient consultations, resulting in more effective communication with their smoking patients.

TRIAL REGISTRATION NUMBER

NTR4436; Pre-results.

The Development and Refinement of an e-Health Screening, Brief Intervention, and Referral to Treatment for Parents to Prevent Childhood Obesity in Primary Care

BACKGROUND

Nearly one-third of Canadian children can be categorized as overweight or obese. There is a growing interest in applying e-health approaches to prevent unhealthy weight gain in children, especially in settings that families access regularly. Our objective was to develop and refine an e-health screening, brief intervention, and referral to treatment (SBIRT) for parents to help prevent childhood obesity in primary care.

MATERIALS AND METHODS

Our SBIRT, titled the Resource Information Program for Parents on Lifestyle and Education (RIPPLE), was developed by our research team and an e-health intervention development company. RIPPLE was based on existing SBIRT models and contemporary literature on children's lifestyle behaviors. Refinements to RIPPLE were guided by feedback from five focus groups (6-10 participants per group) that documented perceptions of the SBIRT by participants (healthcare professionals [n = 20], parents [n = 10], and researchers and graduate trainees [n = 8]). Focus group commentaries were transcribed in real time using a court reporter. Data were analyzed thematically.

RESULTS

Participants viewed RIPPLE as a practical, well-designed, and novel tool to facilitate the prevention of childhood obesity in primary care. However, they also perceived that RIPPLE may elicit negative reactions from some parents and suggested improvements to specific elements (e.g., weight-related terms).

CONCLUSIONS

RIPPLE may enhance parents' awareness of children's weight status and motivation to change their children's lifestyle behaviors but should be improved prior to implementation. Findings from this research directly informed revisions to our SBIRT, which will undergo preliminary testing in a randomized controlled trial.