Measuring Criterion Validity of Microinteraction Ecological Momentary Assessment (Micro-EMA): Exploratory Pilot Study With Physical Activity Measurement

Implementing Ecological Momentary Assessment in Audiological Research: Opportunities and Challenges

Ecological momentary assessment (EMA) is a way to evaluate experiences in everyday life. It is a powerful research tool but can be complex and challenging for beginners. Application of EMA in audiological research brings with it opportunities and challenges that differ from other research disciplines. This tutorial discusses important considerations when conducting EMA studies in hearing care. While more research is needed to develop specific guidelines for the various potential applications of EMA in hearing research, we hope this article can alert hearing researchers new to EMA to pitfalls when using EMA and help strengthen their study design. The current article elaborates study design details, such as choice of participants, representativeness of the study period for participants' lives, and balancing participant burden with data requirements. Mobile devices and sensors to collect objective data on the acoustic situation are reviewed alongside different possibilities for EMA setups ranging from online questionnaires paired with a timer to proprietary apps that also have access to parameters of a hearing device. In addition to considerations for survey design, a list of questionnaire items from previous studies is provided. For each item, an example and a list of references are given. EMA typically provides data sets that are rich but also challenging in that they are noisy, and there is often unequal amount of data between participants. After recommendations on how to check the data for compliance, reactivity, and careless responses, methods for statistical analysis on the individual level and on the group level are discussed including special methods for direct comparison of hearing device programs.

Ecological momentary assessment of physical activity and sedentary behaviour in shift workers and non-shift workers: Validation study

This study examined the criterion validity of an ecological momentary assessment (EMA)-reported physical activity and sedentary time compared with accelerometry in shift workers and non-shift workers. Australian workers (n = 102) received prompts through a mobile EMA app and wore the Actigraph accelerometer on the right hip for 7-10 days. Participants received five EMA prompts per day at 3-hour intervals on their mobile phones. EMA prompts sent to shift workers (SW-T) were tailored according to their work schedule. Non-shift workers (NSW-S) received prompts at standardised times. To assess criterion validity, the association of EMA-reported activities and the Actigraph accelerometer activity counts and number of steps were used. Participants were 36 ± 11 years and 58% were female. On occasions where participants reported physical activity, acceleration counts per minute (CPM) and steps were significantly higher (β = 1184 CPM, CI 95%: 1034, 1334; β = 20.9 steps, CI 95%: 18.2, 23.6) than each of the other EMA activities. Acceleration counts and steps were lower when sitting was reported than when no sitting was reported by EMA. Our study showed that EMA-reported physical activity and sedentary time was significantly associated with accelerometer-derived data. Therefore, EMA can be considered to assess shift workers' movement-related behaviours with accelerometers to provide rich contextual data.

Mobile Crowdsensing in Ecological Momentary Assessment mHealth Studies: A Systematic Review and Analysis

As mobile devices have become a central part of our daily lives, they are also becoming increasingly important in research. In the medical context, for example, smartphones are used to collect ecologically valid and longitudinal data using Ecological Momentary Assessment (EMA), which is mostly implemented through questionnaires delivered via smart notifications. This type of data collection is intended to capture a patient's condition on a moment-to-moment and longer-term basis. To collect more objective and contextual data and to understand patients even better, researchers can not only use patients' input via EMA, but also use sensors as part of the Mobile Crowdsensing (MCS) approach. In this paper, we examine how researchers have embraced the topic of MCS in the context of EMA through a systematic literature review. This PRISMA-guided review is based on the databases PubMed, Web of Science, and EBSCOhost. It is shown through the results that both EMA research in general and the use of sensors in EMA research are steadily increasing. In addition, most of the studies reviewed used mobile apps to deliver EMA to participants, used a fixed-time prompting strategy, and used signal-contingent or interval-contingent self-assessment as sampling/assessment strategies. The most commonly used sensors in EMA studies are the accelerometer and GPS. In most studies, these sensors are used for simple data collection, but sensor data are also commonly used to verify study participant responses and, less commonly, to trigger EMA prompts. Security and privacy aspects are addressed in only a subset of mHealth EMA publications. Moreover, we found that EMA adherence was negatively correlated with the total number of prompts and was higher in studies using a microinteraction-based EMA (μEMA) approach as well as in studies utilizing sensors. Overall, we envision that the potential of the technological capabilities of smartphones and sensors could be better exploited in future, more automated approaches.

Leveraging Emerging Technologies to Expand Accessibility and Improve Precision in Rehabilitation and Exercise for People with Disabilities

Physical rehabilitation and exercise training have emerged as promising solutions for improving health, restoring function, and preserving quality of life in populations that face disparate health challenges related to disability. Despite the immense potential for rehabilitation and exercise to help people with disabilities live longer, healthier, and more independent lives, people with disabilities can experience physical, psychosocial, environmental, and economic barriers that limit their ability to participate in rehabilitation, exercise, and other physical activities. Together, these barriers contribute to health inequities in people with disabilities, by disproportionately limiting their ability to participate in health-promoting physical activities, relative to people without disabilities. Therefore, there is great need for research and innovation focusing on the development of strategies to expand accessibility and promote participation in rehabilitation and exercise programs for people with disabilities. Here, we discuss how cutting-edge technologies related to telecommunications, wearables, virtual and augmented reality, artificial intelligence, and cloud computing are providing new opportunities to improve accessibility in rehabilitation and exercise for people with disabilities. In addition, we highlight new frontiers in digital health technology and emerging lines of scientific research that will shape the future of precision care strategies for people with disabilities.

Convergent Validity of the Patient Reported Outcome Measurement Information System-Pediatric Physical Activity Instrument (PROMIS®-PA) with Wearable Devices in Adolescents

The study was conducted mainly to examine the convergent validity of the Patient Reported Outcome Measurement Information System-Pediatric Physical Activity instrument (PROMIS^®®®-PA) with step counts from wearable devices and another validated self-reported outcome measure. As a secondary aim, we explored the effect of different recall time frames (7-day, end-of-day [EoD], and ecological momentary assessment [EMA] time frames during the day) in terms of their feasibility and associations with each other and with step counts. This was a prospective cohort study that examined the associations between measures of PA in school-age children and adolescents (n = 84, aged 10-20). The participants wore Fitbit devices for 7 consecutive days, and then completed the 7-day-recall PROMIS-PA short form and Youth Activity Profile (YAP). Additional analyses were completed in a sub-sample (n = 25, aged 11-18 years) using the PROMIS-PA for the EMA at five intervals during the day (shorter form) and at the EoD. In the total sample, the PROMIS-PA results showed positive moderate correlations with the YAP and average daily steps (r = 0.533, p < 0.001 and r = 0.346, p = 0.002, respectively). In the sub-sample, the 7-day PROMIS-PA was highly correlated with the averaged EMA or EoD ratings for the week, and moderately correlated with the daily step counts. These findings support the validity of the PROMIS-PA as a measure of self-reported physical activity. Adolescents demonstrated higher compliance rates and preference for the 7-day recall and EoD assessments compared to more frequent EMA reporting.

Dose-response relations between the frequency of two types of momentary feedback prompts and daily physical activity

OBJECTIVE

Self-monitoring and behavioral feedback are widely used to help people monitor progress toward daily physical activity goals. Little information exists about the optimal dosing parameters for these techniques or if they are interchangeable in digital physical activity interventions. This study used a within-person experimental design to evaluate associations between the frequency of two different prompt types (one for each technique) and daily physical activity.

METHOD

Insufficiently active young adults were assigned monthly physical activity goals and wore smartwatches with activity trackers for 3 months. They received zero to six randomly selected and timed watch-based prompts each day, with individual prompts either providing behavioral feedback or prompting the participant to self-monitor.

RESULTS

Physical activity increased significantly over the 3-month period (step counts d = 1.03; moderate-to-vigorous physical activity duration d = 0.99). Mixed linear models revealed that daily step counts were positively associated with the frequency of daily self-monitoring prompts up to approximately three prompts/day (d = 0.22) after which additional prompts provided minimal or reduced benefit. Daily step counts were not associated with the frequency of behavioral feedback prompts. Daily moderate-to-vigorous physical activity was not associated with the frequency of either prompt.

CONCLUSIONS

Self-monitoring and behavioral feedback are not interchangeable behavior change techniques in digital physical activity interventions, and only self-monitoring prompts show signs of a dose-response association with physical activity volume. Activity trackers, such as smartwatches and mobile apps, should provide an option to replace behavioral feedback prompts with self-monitoring prompts to promote physical activity among insufficiently active young adults. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

The Feasibility of a Text-Messaging Intervention Promoting Physical Activity in Shift Workers: A Process Evaluation

Workplace health promotion programs (WHPPs) can improve shift workers' physical activity. The purpose of this paper is to present the process evaluation of a text messaging health promotion intervention for mining shift workers during a 24-day shift cycle. Data collected from intervention participants with a logbook (n = 25) throughout the intervention, exit interviews (n = 7) and online surveys (n = 17) examined the WHPP using the RE-AIM (Reach, Efficacy, Adoption, Implementation and Maintenance) framework. The program reached 66% of workers across three departments, with 15% of participants dropping out. The program showed the potential to be adopted if the recruitment strategies are improved to reach more employees, especially when involving work managers for recruitment. A few changes were made to the program, and participant adherence was high. Facilitators to adopt and implement the health promotion program included the use of text messaging to improve physical activity, feedback on behaviour, and providing incentives. Work-related fatigue was reported as a barrier to implementing the program. Participants reported that they would recommend the program to other workers and use the Mi fitness band to continue monitoring and improving their health behaviour. This study showed that shift workers were optimistic about health promotion. Allowing for long-term evaluation and involving the company management to determine scale-up should be considered for future programs.

Understanding health behaviours in context: A systematic review and meta-analysis of ecological momentary assessment studies of five key health behaviours

Ecological Momentary Assessment (EMA) involves repeated, real-time sampling of health behaviours in context. We present the state-of-knowledge in EMA research focused on five key health behaviours (physical activity and sedentary behaviour, dietary behaviour, alcohol consumption, tobacco smoking, sexual health), summarising theoretical (e.g., psychological and contextual predictors) and methodological aspects (e.g., study characteristics, EMA adherence). We searched Ovid MEDLINE, Embase, PsycINFO and Web of Science until February 2021. We included studies focused on any of the aforementioned health behaviours in adult, non-clinical populations that assessed ≥1 psychological/contextual predictor and reported a predictor-behaviour association. A narrative synthesis and random-effects meta-analyses of EMA adherence were conducted. We included 633 studies. The median study duration was 14 days. The most frequently assessed predictors were 'negative feeling states' (21%) and 'motivation and goals' (16.5%). The pooled percentage of EMA adherence was high at 81.4% (95% CI = 80.0%, 82.8%, k = 348) and did not differ by target behaviour but was somewhat higher in student (vs. general population) samples, when EMAs were delivered via mobile phones/smartphones (vs. handheld devices), and when event contingent (vs. fixed) sampling was used. This review showcases how the EMA method has been applied to improve understanding and prediction of health behaviours in context.

Ecological Momentary Assessment: A Systematic Review of Validity Research

Ecological momentary assessment (EMA) is a self-report method that involves intensive longitudinal assessment of behavior and environmental conditions during everyday activities. EMA has been used extensively in health and clinical psychology to investigate a variety of health behaviors, including substance use, eating, medication adherence, sleep, and physical activity. However, it has not been widely implemented in behavior analytic research. This is likely an example of the empirically based skepticism with which behavioral scientists view self-report measures. We reviewed studies comparing electronic, mobile EMA (mEMA) to more objective measures of health behavior to explore the validity of mEMA as a measurement tool, and to identify procedures and factors that may promote the accuracy of mEMA. We identified 32 studies that compared mEMA to more objective measures of health behavior or environmental events (e.g., biochemical measures or automated devices such as accelerometers). Results showed that the correspondence rates varied considerably across individuals, behavior, and studies (agreement rates ranged from 1.8%-100%), and no unifying variables could be identified across the studies that found high correspondence. The findings suggest that mEMA can be an accurate measurement tool, but further research should be conducted to identify procedures and variables that promote accurate responding.

Intensive Longitudinal Data Collection Using Microinteraction Ecological Momentary Assessment: Pilot and Preliminary Results

Background

Ecological momentary assessment (EMA) uses mobile technology to enable in situ self-report data collection on behaviors and states. In a typical EMA study, participants are prompted several times a day to answer sets of multiple-choice questions. Although the repeated nature of EMA reduces recall bias, it may induce participation burden. There is a need to explore complementary approaches to collecting in situ self-report data that are less burdensome yet provide comprehensive information on an individual’s behaviors and states. A new approach, microinteraction EMA (μEMA), restricts EMA items to single, cognitively simple questions answered on a smartwatch with single-tap assessments using a quick, glanceable microinteraction. However, the viability of using μEMA to capture behaviors and states in a large-scale longitudinal study has not yet been demonstrated.

Objective

This paper describes the μEMA protocol currently used in the Temporal Influences on Movement & Exercise (TIME) Study conducted with young adults, the interface of the μEMA app used to gather self-report responses on a smartwatch, qualitative feedback from participants after a pilot study of the μEMA app, changes made to the main TIME Study μEMA protocol and app based on the pilot feedback, and preliminary μEMA results from a subset of active participants in the TIME Study.

Methods

The TIME Study involves data collection on behaviors and states from 246 individuals; measurements include passive sensing from a smartwatch and smartphone and intensive smartphone-based hourly EMA, with 4-day EMA bursts every 2 weeks. Every day, participants also answer a nightly EMA survey. On non–EMA burst days, participants answer μEMA questions on the smartwatch, assessing momentary states such as physical activity, sedentary behavior, and affect. At the end of the study, participants describe their experience with EMA and μEMA in a semistructured interview. A pilot study was used to test and refine the μEMA protocol before the main study.

Results

Changes made to the μEMA study protocol based on pilot feedback included adjusting the single-question selection method and smartwatch vibrotactile prompting. We also added sensor-triggered questions for physical activity and sedentary behavior. As of June 2021, a total of 81 participants had completed at least 6 months of data collection in the main study. For 662,397 μEMA questions delivered, the compliance rate was 67.6% (SD 24.4%) and the completion rate was 79% (SD 22.2%).

Conclusions

The TIME Study provides opportunities to explore a novel approach for collecting temporally dense intensive longitudinal self-report data in a sustainable manner. Data suggest that μEMA may be valuable for understanding behaviors and states at the individual level, thus possibly supporting future longitudinal interventions that require within-day, temporally dense self-report data as people go about their lives.

Perspective: A Framework for Addressing Dynamic Food Consumption Processes

The study of food consumption, diet, and related concepts is motivated by diverse goals, including understanding why food consumption impacts our health, and why we eat the foods we do. These varied motivations can make it challenging to define and measure consumption, as it can be specified across nearly infinite dimensions-from micronutrients to carbon footprint to food preparation. This challenge is amplified by the dynamic nature of food consumption processes, with the underlying phenomena of interest often based on the nature of repeated interactions with food occurring over time. This complexity underscores a need to not only improve how we measure food consumption but is also a call to support theoreticians in better specifying what, how, and why food consumption occurs as part of processes, as a prerequisite step to rigorous measurement. The purpose of this Perspective article is to offer a framework, the consumption process framework, as a tool that researchers in a theoretician role can use to support these more robust definitions of consumption processes. In doing so, the framework invites theoreticians to be a bridge between practitioners who wish to measure various aspects of food consumption and methodologists who can develop measurement protocols and technologies that can support measurement when consumption processes are clearly defined. In the paper we justify the need for such a framework, introduce the consumption process framework, illustrate the framework via a use case, and discuss existing technologies that enable the use of this framework and, by extension, more rigorous study of consumption. This consumption process framework demonstrates how theoreticians could fundamentally shift how food consumption is defined and measured towards more rigorous study of what, how, and why food is eaten as part of dynamic processes and a deeper understanding of linkages between behavior, food, and health.

Validation of an ecological momentary assessment to measure processing speed and executive function in schizophrenia

Cognitive impairments are a core feature of schizophrenia that have negative impacts on functional outcomes. However, it remains challenging to assess these impairments in clinical settings. Smartphone apps provide the opportunity to measure cognitive impairments in an accessible way; however, more research is needed to validate these cognitive assessments in schizophrenia. We assessed the initial accessibility, validity, and reliability of a smartphone-based cognitive test to measure cognition in schizophrenia. A total of 29 individuals with schizophrenia and 34 controls were included in the analyses. Participants completed the standard pen-and-paper Trail Making Tests (TMT) A and B, and smartphone-based versions, Jewels Trail Tests (JTT) A and B, at the single in-lab visit. Participants were asked to complete the JTT remotely once per week for three months. We also investigated how subjective sleep quality and mood may affect cognitive performance longitudinally. In-lab and remote JTT scores moderately and positively correlated with in-lab TMT scores. Moderate test-retest reliability was observed across the in-lab, first remote, and last remote completion times of the JTT. Additionally, individuals with schizophrenia had significantly lower performance compared to controls on both the in-lab JTT and TMT. Self-reported mood had a significant effect on JTT A performance over time but no other significant relationships were found remotely. Our results support the initial accessibility, validity and reliability of using the JTT to measure cognition in schizophrenia. Future research to develop additional smartphone-based cognitive tests as well as with larger samples and in other psychiatric populations are warranted.