Integrating User-Centered Design and Behavioral Science to Design a Mobile Intervention for Obesity and Binge Eating: Mixed Methods Analysis

Evaluation of the Parkinson's Remote Interactive Monitoring System in a Clinical Setting: Usability Study

BACKGROUND

The fastest-growing neurological disorder is Parkinson disease (PD), a progressive neurodegenerative disease that affects 10 million people worldwide. PD is typically treated with levodopa, an oral pill taken to increase dopamine levels, and other dopaminergic agonists. As the disease advances, the efficacy of the drug diminishes, necessitating adjustments in treatment dosage according to the patient's symptoms and disease progression. Therefore, remote monitoring systems that can provide more detailed and accurate information on a patient's condition regularly are a valuable tool for clinicians and patients to manage their medication. The Parkinson's Remote Interactive Monitoring System (PRIMS), developed by PragmaClin Research Inc, was designed on the premise that it will be an easy-to-use digital system that can accurately capture motor and nonmotor symptoms of PD remotely.

OBJECTIVE

We performed a usability evaluation in a simulated clinical environment to assess the ease of use of the PRIMS and determine whether the product offers suitable functionality for users in a clinical setting.

METHODS

Participants were recruited from a user sign-up web-based database owned by PragmaClin Research Inc. A total of 11 participants were included in the study based on the following criteria: (1) being diagnosed with PD and (2) not being diagnosed with dementia or any other comorbidities that would make it difficult to complete the PRIMS assessment safely and independently. Patient users completed a questionnaire that is based on the Movement Disorder Society-sponsored revision of the Unified Parkinson's Disease Rating Scale. Interviews and field notes were analyzed for underlying themes and topics.

RESULTS

In total, 11 people with PD participated in the study (female individuals: n=5, 45%; male individuals: n=6, 55%; age: mean 66.7, SD 7.77 years). Thematic analysis of the observer's notes revealed 6 central usability issues associated with the PRIMS. These were the following: (1) the automated voice prompts are confusing, (2) the small camera is problematic, (3) the motor test exhibits excessive sensitivity to the participant's orientation and position in relation to the cameras, (4) the system poses mobility challenges, (5) navigating the system is difficult, and (6) the motor test exhibits inconsistencies and technical issues. Thematic analysis of qualitative interview responses revealed four central themes associated with participants' perspectives and opinions on the PRIMS, which were (1) admiration of purpose, (2) excessive system sensitivity, (3) video instructions preferred, and (4) written instructions disliked. The average system usability score was calculated to be 69.2 (SD 4.92), which failed to meet the acceptable system usability score of 70.

CONCLUSIONS

Although multiple areas of improvement were identified, most of the participants showed an affinity for the overarching objective of the PRIMS. This feedback is being used to upgrade the current PRIMS so that it aligns more with patients' needs.

Development of an eHealth Tool for Capturing and Analyzing the Immune-related Adverse Events (irAEs) in Cancer Treatment

Introduction

Immunotherapy has revolutionized the treatment of many different types of cancer, but it is associated with a myriad of immune-related adverse events (irAEs). Patient-reported outcome (PRO) measures have been identified as valuable tools for continuously collecting patient-centered data and are frequently used in oncology trials. However, few studies still research an ePRO follow-up approach on patients treated with Immunotherapy, potentially reflecting a lack of support services for this population.

Methods

The team co-developed a digital platform (V-Care) using ePROs to create a new follow-up pathway for cancer patients receiving immunotherapy. To operationalize the first 3 phases of the CeHRes roadmap, we employed multiple methods that were integrated throughout the development process, rather than being performed in a linear fashion. The teams employed an agile approach in a dynamic and iterative manner, engaging key stakeholders throughout the process.

Results

The development of the application was categorized into 2 phases: "user interface" (UI) and "user experience" (UX) designs. In the first phase, the pages of the application were segmented into general categories, and feedback from all stakeholders was received and used to modify the application. In phase 2, mock-up pages were developed and sent to the Figma website. Moreover, the Android Package Kit (APK) of the application was installed and tested multiple times on a mobile phone to proactively detect and fix any errors. After resolving some technical issues and adjusting errors on the Android version to improve the user experience, the iOS version of the application was developed.

Discussion

By incorporating the latest technological developments, V-Care has enabled cancer patients to have access to more comprehensive and personalized care, allowing them to better manage their condition and be better informed about their health decisions. These advances have also enabled healthcare professionals to be better equipped with the knowledge and tools to provide more effective and efficient care. In addition, the advances in V-Care technology have allowed patients to connect with their healthcare providers more easily, providing a platform to facilitate communication and collaboration. Although usability testing is necessary to evaluate the efficacy and user experience of the app, it can be a significant investment of time and resources.

Conclusion

The V-Care platform can be used to investigate the reported symptoms experienced by cancer patients receiving Immune checkpoint inhibitors (ICIs) and to compare them with the results from clinical trials. Furthermore, the project will utilize ePRO tools to collect symptoms from patients and provide insight into whether the reported symptoms are linked to the treatment.

Clinical Relevance

V-Care provides a secure, easy-to-use interface for patient-clinician communication and data exchange. Its clinical system stores and manages patient data in a secure environment, while its clinical decision support system helps clinicians make decisions that are more informed, efficient, and cost-effective. This system has the potential to improve patient safety and quality of care, while also helping to reduce healthcare costs.

Weight Loss Expectations of Adults With Binge Eating: Cross-sectional Study With a Human-Centered Design Approach

BACKGROUND

People tend to overestimate their expectations for weight loss relative to what is achievable in a typical evidence-based behavioral weight management program, which can impact treatment satisfaction and outcomes. We are engaged in formative research to design a digital intervention that addresses binge eating and weight management; thus, understanding expectations among this group can inform more engaging intervention designs to produce a digital intervention that can achieve greater clinical success. Studies examining weight loss expectations have primarily focused on people who have overweight or obesity. Only one study has investigated weight loss expectations among people with binge eating disorder, a population that frequently experiences elevated weight and shape concerns and often presents to treatment with the goal of losing weight.

OBJECTIVE

The aim of the study is to investigate differences in weight loss expectations among people with varying levels of binge eating to inform the design of a digital intervention for binge eating and weight management. Such an evaluation may be crucial for people presenting for a digital intervention, given that engagement and dropout are notable problems for digital behavior change interventions. We tested the hypotheses that (1) people who endorsed some or recurrent binge eating would expect to lose more weight than those who did not endorse binge eating and (2) people who endorsed a more severe versus a low or moderate overvaluation of weight and shape would have higher weight loss expectations.

METHODS

A total of 760 adults (n=504, 66% female; n=441, 58% non-Hispanic White) completed a web-based screening questionnaire. One-way ANOVAs were conducted to explore weight loss expectations for binge eating status as well as overvaluation of shape and weight.

RESULTS

Weight loss expectations significantly differed by binge eating status. Those who endorsed some and recurrent binge eating expected to lose more weight than those who endorsed no binge eating. Participants with severe overvaluation of weight or shape expected to lose the most weight compared to those with low or moderate levels of overvaluation of weight and shape.

CONCLUSIONS

In the sample, people interested in a study to inform a digital intervention for binge eating and weight management overestimated their expectations for weight loss. Given that weight loss expectations can impact treatment completion and success, it may be important to assess and modify weight loss expectations among people with binge eating prior to enrolling in a digital intervention. Future work should design and test features that can modify these expectations relative to individuals' intended treatment goals to facilitate engagement and successful outcomes in a digital intervention.

"You get what you need when you need it": A mixed methods examination of the feasibility and acceptability of a tailored digital tool to promote physical activity among women in midlife

During midlife (ages 40-60), women experience myriad changes that elevate their risk for cardiovascular disease (CVD), including decreased physical activity (PA). Women cite lack of social support for PA and lack of active peers who can serve as role models as key barriers. Digital tools such as web applications can provide exposure to these social inputs; they are also accessible in daily life and require modest time investment. However, as few tools have been designed to meet the unique needs of women in midlife with CVD risk, our research team previously built a web application that is tailored for this population. In the present study, we used a convergent mixed methods design to develop a deep understanding of the feasibility, usability, and acceptability of this web application in a sample of identified end users. Participants (N = 27, MAge = 53 years, MBMI = 32.6 kg/m2) used the web application at the start of each day for 7 days and completed a 1-hour qualitative interview at the end of this test period. Integration of findings from two-level multilevel models (quantitative) and thematic analysis (qualitative) indicated support for the feasibility, usability, and acceptability of the new web application among women in midlife with CVD risk conditions and identified critical opportunities for improving the user experience. Findings also speak to the utility of options for content selection that can meet women's needs in daily life and highlight women's desire for PA resources that prioritize their perspectives.

Learning experience design of an mHealth self-management intervention for adolescents with type 1 diabetes

Type 1 diabetes (T1D) is a lifelong and chronic condition that can cause severely compromised health. The T1D treatment regimen is complex, and is a particular challenge for adolescents, who frequently experience a number of treatment adherence barriers (e.g., forgetfulness, planning and organizational challenges, stress). Diabetes Journey is a gamified mHealth program designed to improve T1D self-management through a specific focus on decreasing adherence barriers and improving executive functioning skills for adolescents. Grounded in situativity theory and guided by a sociotechnical-pedagogical usability framework, Diabetes Journey was designed, developed, and evaluated using a learning experience design approach. This approach applied design thinking methods within a Successive Approximation Model design process. Iterative design and formative evaluation were conducted across three design phases, and improvements were implemented following each phase. Findings from the user testing phase indicate Diabetes Journey is a user-friendly mHealth program with high usability that holds promise for enhancing adolescents' T1D self-management. Implications for future designers and researchers are discussed regarding the social dimension of the sociotechnical-pedagogical usability framework. An extension to the framework is proposed to extend the social dimension to include socio-cultural and contextual considerations when designing mHealth applications. Consideration of the pedagogical and sociocultural dimensions of learning is imperative when developing psychoeducational interventions.

Developing a Provincial Surveillance and Support System for Childhood Cancer Survivors: Multiphase User-Centered Design Study

Background

Survivors of childhood cancer are at lifelong risk of morbidity (such as new cancers or heart failure) and premature mortality due to their cancer treatment. These are termed late effects. Therefore, they require lifelong, risk-tailored surveillance. However, most adult survivors of childhood cancer do not complete recommended surveillance tests such as mammograms or echocardiograms.

Objective

In partnership with survivors, family physicians, and health system partners, we are designing a provincial support system for high-priority tests informed by principles of implementation science, behavioral science, and design thinking.

Methods

Our multiphase process was structured as follows. Step 1 consisted of a qualitative study to explore intervention components essential to accessing surveillance tests. Step 2 comprised a workshop with childhood cancer survivors, family physicians, and health system stakeholders that used the Step 1 findings and “personas” (a series of fictional but data-informed characters) to develop and tailor the intervention for different survivor groups. Step 3 consisted of intervention prototype development, and Step 4 involved iterative user testing.

Results

The qualitative study of 30 survivors and 7 family physicians found a high desire for information on surveillance for late effects. Respondents indicated that the intervention should help patients book appointments when they are due in addition to providing personalized information. Insights from the workshop included the importance of partnering with both family physicians and survivorship clinics and providing emotional support for survivors who may experience distress upon learning of their risk for late effects. In our user-testing process, prototypes went through iterations that incorporated feedback from users regarding acceptability, usability, and functionality. We sought to address the needs of survivors and physicians while balancing the capacity and infrastructure available for a lifelong intervention via our health system partners.

Conclusions

In partnership with childhood cancer survivors, family physicians, and health system partners, we elucidated the barriers and enablers to accessing guideline-recommended surveillance tests and designed a multifaceted solution that will support survivors and their family physicians. The next step is to evaluate the intervention in a pragmatic randomized controlled trial.

Understanding self-monitoring to inform a mobile intervention for binge eating and weight management: A proof-of-concept randomized trial

OBJECTIVE

This study explored consumers' perspectives on self-monitoring, a common feature in behavioral interventions that helps inform consumers' progress and answer their questions, to learn what outcome metrics matter to consumers and whether self-selection of these metrics leads to greater engagement (i.e., compliance, satisfaction) in self-monitoring than monitoring only default options.

METHODS

In a proof-of-concept randomized trial, 48 adult participants were randomly assigned to "clinician-determined monitoring" or "clinician + self-determined monitoring" conditions. Before starting monitoring, all participants shared outcomes that would matter to them in a mobile intervention for binge eating and weight management. Then, for 3 weeks, participants in the "clinician-determined" condition monitored their weight and binge-eating episodes, and participants in the "clinician + self-determined" condition monitored these and another metric of their choosing. After, satisfaction and compliance were assessed.

RESULTS

Participants identified 116 metrics, grouped into 12 themes, that mattered to them. During monitoring, participants in the "clinician + self-determined" condition monitored 41 metrics. Surprisingly, participants in the "clinician-determined" condition also monitored metrics besides weight and binge eating. This resulted in a failure of our experimental manipulation, which represents a significant limitation of this research. No significant differences emerged in satisfaction or compliance between conditions.

DISCUSSION

Although our proof-of-concept trial yielded null quantitative results, findings also suggested binge eating and weight management interventions may benefit from including an individually customizable monitoring option in addition to default metrics, warranting testing in future research.

PUBLIC SIGNIFICANCE

Examining consumers' self-monitoring preferences for a mobile intervention for binge eating and weight management revealed a variety of metrics that matter to consumers, although binge eating and weight were still most valued. Findings from our proof-of-concept trial suggest design implications of encouraging an individually customizable monitoring option, in addition to default metrics, which needs to be tested in future research over a longer period and during actual mobile intervention delivery.

Communicating Risk for Obesity in Early Life: Engaging Parents Using Human-Centered Design Methodologies

OBJECTIVE

Pediatricians are well positioned to discuss early life obesity risk, but optimal methods of communication should account for parent preferences. To help inform communication strategies focused on early life obesity prevention, we employed human-centered design methodologies to identify parental perceptions, concerns, beliefs, and communication preferences about early life obesity risk.

METHODS

We conducted a series of virtual human-centered design research sessions with 31 parents of infants <24 months old. Parents were recruited with a human intelligence task posted on Amazon's Mechanical Turk, via social media postings on Facebook and Reddit, and from local community organizations. Human-centered design techniques included individual short-answer activities derived from personas and empathy maps as well as group discussion.

RESULTS

Parents welcomed a conversation about infant weight and obesity risk, but concerns about health were expressed in relation to the future. Tone, context, and collaboration emerged as important for obesity prevention discussions. Framing the conversation around healthy changes for the entire family to prevent adverse impacts of excess weight may be more effective than focusing on weight loss.

CONCLUSIONS

Our human-centered design approach provides a model for developing and refining messages and materials aimed at increasing parent/provider communication about early life obesity prevention. Motivating families to engage in obesity prevention may require pediatricians and other health professionals to frame the conversation within the context of other developmental milestones, involve the entire family, and provide practical strategies for behavioral change.

Characterizing behavior change techniques used in the self-management of binge eating and weight: Applying a user-centered design approach

User-centered design methods aim to increase intervention engagement by focusing on consumers' needs and preferences. We conducted a needs assessment (the first step in user-centered design) via a digital diary study to understand how individuals with recurrent binge eating (≥12 episodes in 3 months) and obesity (BMI ≥30 kg/m2) manage these problems in their day-to-day lives and the approaches they use to change their behavior. Specifically, we applied the Behavior Change Technique (BCT)-Taxonomy to characterize which standardized BCTs individuals use to change binge eating and health-related behaviors and their motivations to use them, to inform the design of a mobile intervention. We analyzed qualitative data from 22 adults (64% female, 32% White) who submitted 176 diary entries. For each entry, we coded the BCTs used, motivation for use, and whether the BCT(s) were perceived as beneficial for behavior change. Across participants, investigators identified 50 of the 93 standardized BCTs (54%). Each participant used an average of 12 (SD = 4) BCTs, most commonly Behavior Substitution (72.3%), Distraction (68.2%), Goal Setting (Behavior) (63.6%), Action Planning (59.1%) and Adding Objects to the Environment (59.1%). More BCTs were coded as beneficial (49%) versus detrimental (24%) or neutral (27%). Techniques were most commonly motivated by preventing binge eating (95.5%), losing weight (95.5%), reducing unhealthy food choices (90.9%), or managing stress (59.1%). Results help inform how interventions could be designed to support consumers in changing binge eating and weight-related behaviors, although such designs would need to be tested for their impact on engagement and outcomes.

The Effects of Behavioral Economics-based Nudge on Online Scheduling and Appointment Completion: Observational Study (Preprint)

Background

Behavioral economics–based techniques have been an increasingly utilized method in health care to influence behavior change by modifying language in patient communication (through choice architecture and the framing of words). Patient portals are a key tool for facilitating patient engagement in their health, and interventions deployed via patient portals have been effective in improving utilization of preventive health services.

Objective

We examined the impacts of behavioral economics–based nudge health maintenance reminders on appointment scheduling through a patient portal and appointment completion for 2 preventive services: Medicare wellness visits and Pap smear.

Methods

We conducted a retrospective observational study using electronic health record data from an integrated health care system in Northern California. Nudge health maintenance reminders with behavioral economics–based language were implemented for all sites in November 2017 for Medicare wellness visits and for selected sites in February 2018 for Pap smears. We analyzed 125,369 health maintenance reminders for Medicare wellness visits, and 585,358 health maintenance reminders for Pap smear sent between January 2017 and February 2020. The primary outcomes were rate of appointments scheduled through the patient portal and appointment completion rate. We compared the outcomes between those who received the new, behavioral economics–based health maintenance reminders (the nudge group) and those who received the original, standard health maintenance reminders (the control group). We used segmented regression with interrupted time series to assess the immediate and gradual effect of the nudge for Medicare wellness visits, and we used logistic regression to assess the association of nudge health maintenance reminders, adjusting for the propensity to receive a nudge health maintenance reminder, for Pap smear.

Results

The rates of appointments scheduled through the patient portal were higher for nudge health maintenance reminder recipients than those for control health maintenance reminder recipients (Medicare wellness visits—nudge: 12,537/96,839, 13.0%; control: 2,769/28,530, 9.7%, P<.001; Pap smear—nudge: 8,239/287,149, 2.9%; control: 1,868/120,047, 1.6%; P<.001). Rates of appointment completion were higher for nudge health maintenance reminders for Pap smear (nudge: 67,399/287,149, 23.5% control: 20,393/120,047, 17.0%; P<.001) but were comparable for Medicare wellness visits (nudge: 49,835/96,839, 51.5% control: 14,781/28,530, 51.8%; P=.30). There was a marginally gradual effect of nudge on number of appointments scheduled through the patient portal for the overall Medicare wellness visits sample (at a monthly rate of 0.26%, P=.09), and a significant gradual effect among scheduled appointments (at a monthly rate of 0.46%, P=.04). For Pap smear, nudge health maintenance reminders were positively associated with number of appointments scheduled through the patient portal (overall sample: propensity adjusted odds ratio [OR] 1.62; 95% CI 1.50-1.74; among scheduled appointments: propensity adjusted OR 1.61, 95% CI 1.47-1.76) and with appointment completion (propensity adjusted OR 1.07; 1.04-1.10).

Conclusions

Nudges, a behavioral economics–based approach to providing health maintenance reminders, increased the number of appointments scheduled through the patient portal for Medicare wellness visits and Pap smear. Our study demonstrates that a simple approach—framing and modifying language in an electronic message—can have a significant and long-term impact on patient engagement and access to care.

Mobile app helps trainees manage emergencies at the bedside

BACKGROUND

Although emergency departments (ED) have standardized guidelines for low-frequency, high-acuity diagnoses, they are not immediately accessible at the bedside, and this can cause anxiety in trainees and delay patient care. This problem is exacerbated during events like COVID-19 that require the rapid creation, iteration, and dissemination of new guidelines.

METHODS

Physician innovators used design thinking principles to develop EM Protocols (EMP), a mobile application that clinicians can use to immediately view guidelines, contact consultants (e.g., cath lab activation), and access code-running tools. The project became an institutional high priority, because it helps EM trainees and off-service rotators manage low-frequency, high-acuity emergencies at the point of care, and its COVID-19 guidelines can be rapidly updated and disseminated in real time.

RESULTS

This intervention was deployed across two academic medical centers during the COVID-19 surge. Nearly 300 ED clinicians have downloaded EMP, and they have interacted with the app over 5,400 times. It continues to be used regularly, over 12 months after the initial surge. Since the app was received positively, there are efforts to build in additional adult and pediatric guidelines.

DISCUSSION

Digital health tools like EMP can serve as invaluable adjuncts for managing acute, life-threatening emergencies at the point of care. They can benefit trainees during normal day-to-day operations as well as scenarios that cause large-scale operational disruptions, such as natural disasters, mass casualty events, and future pandemics.

Perceived Facilitators and Barriers to Engaging with a Digital Intervention among Those with Food Insecurity, Binge Eating, and Obesity

Interventions that address binge eating and food insecurity are needed. Engaging people with lived experience to understand their needs and preferences could yield important design considerations for such interventions. In this study, people with food insecurity, recurrent binge eating, and obesity completed an interview-based needs assessment to learn facilitators and barriers that they perceive would impact their engagement with a digital intervention for managing binge eating and weight. Twenty adults completed semi-structured interviews. Responses were analyzed using thematic analysis. Three themes emerged. Participants shared considerations that impact their ability to access the intervention (e.g., cost of intervention, cost of technology, accessibility across devices), ability to complete intervention recommendations (e.g., affordable healthy meals, education to help stretch groceries, food vouchers, rides to grocery stores, personalized to budget), and preferred intervention features for education, self-monitoring, personalization, support, and motivation/rewards. Engaging people with lived experiences via user-centered design methods revealed important design considerations for a digital intervention to meet this population's needs. Future research is needed to test whether a digital intervention that incorporates these recommendations is engaging and effective for people with binge eating and food insecurity. Findings may have relevance to designing digital interventions for other health problems as well.