Are We There Yet? Feasibility of Continuous Stress Assessment via Wireless Physiological Sensors

RRDetection: Respiration Rate Estimation Using Earbuds During Physical Activities

In modern times, earbuds have become both popular and essential accessories for people to use with a wide range of devices in their everyday lives. Moreover, the respiration rate is a crucial vital sign that is sensitive to various pathological conditions. Many earbuds now come equipped with multiple sensing capabilities, including inertial and acoustic sensors. These sensors can be used by researchers to passively monitor users' vital signs, such as respiration rates. While current earbud-based breath rate estimation algorithms mostly focus on resting conditions, recent studies have demonstrated that respiration rates during physical activities can predict cardio-respiratory fitness for healthy individuals and pulmonary conditions for respiratory patients. To address this gap, we propose a novel algorithm called RRDetection that leverages the motion sensors in ordinary earbuds to detect respiration rates during light to moderate physical activities.

I feel good? Anhedonia might not mean "without pleasure" for people treated for opioid use disorder

Anhedonia is usually defined as partial or total loss of the capacity for pleasure. People with anhedonia in the context of major depressive disorder may have an unexpected capacity for event-related mood brightening, observable when mood is assessed dynamically (with smartphone-based ecological momentary assessment [EMA]) rather than only statically via questionnaire. We used EMA to monitor mood and pleasant events for 4 weeks in 54 people being treated with opioid agonist medication for opioid-use disorder (OUD), which is also associated with anhedonia, said to manifest especially as loss of pleasure from nondrug reward. We compared OUD patients' EMA reports with those of 47 demographically similar controls. Background positive mood was lower in OUD patients than in controls, as we hypothesized (Cohen ds = .85 to 1.32, 95% CIs [.66, 1.55]), although, contrary to our hypothesis, background negative mood was also lower (ds = .82 to .85, 95% CIs [.73, .94]). As hypothesized, instances of nondrug pleasure were as frequent in OUD patients as in controls-and were not rated much less pleasurable (d = .18, 95% CI [-.03, .35]). Event-related mood brightening occurred in both abstinent and nonabstinent OUD patients (ds = .18 to .37, CIs [-.01, .57]) and controls (ds = .04 to .60, CIs [-.17, .79]), brightening before each event began earlier for controls than OUD patients, but faded similarly postevent across groups. Our findings add to the evidence that anhedonia does not rule out reactive mood brightening, which, for people with OUD being treated on opioid agonist medication, can be elicited by nondrug activities. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Automated Detection of Stressful Conversations Using Wearable Physiological and Inertial Sensors

Stressful conversation is a frequently occurring stressor in our daily life. Stressors not only adversely affect our physical and mental health but also our relationships with family, friends, and coworkers. In this paper, we present a model to automatically detect stressful conversations using wearable physiological and inertial sensors. We conducted a lab and a field study with cohabiting couples to collect ecologically valid sensor data with temporally-precise labels of stressors. We introduce the concept of stress cycles, i.e., the physiological arousal and recovery, within a stress event. We identify several novel features from stress cycles and show that they exhibit distinguishing patterns during stressful conversations when compared to physiological response due to other stressors. We observe that hand gestures also show a distinct pattern when stress occurs due to stressful conversations. We train and test our model using field data collected from 38 participants. Our model can determine whether a detected stress event is due to a stressful conversation with an F1-score of 0.83, using features obtained from only one stress cycle, facilitating intervention delivery within 3.9 minutes since the start of a stressful conversation.

Toward Emotion Recognition From Physiological Signals in the Wild: Approaching the Methodological Issues in Real-Life Data Collection

Emotion, mood, and stress recognition (EMSR) has been studied in laboratory settings for decades. In particular, physiological signals are widely used to detect and classify affective states in lab conditions. However, physiological reactions to emotional stimuli have been found to differ in laboratory and natural settings. Thanks to recent technological progress (e.g., in wearables) the creation of EMSR systems for a large number of consumers during their everyday activities is increasingly possible. Therefore, datasets created in the wild are needed to insure the validity and the exploitability of EMSR models for real-life applications. In this paper, we initially present common techniques used in laboratory settings to induce emotions for the purpose of physiological dataset creation. Next, advantages and challenges of data collection in the wild are discussed. To assess the applicability of existing datasets to real-life applications, we propose a set of categories to guide and compare at a glance different methodologies used by researchers to collect such data. For this purpose, we also introduce a visual tool called Graphical Assessment of Real-life Application-Focused Emotional Dataset (GARAFED). In the last part of the paper, we apply the proposed tool to compare existing physiological datasets for EMSR in the wild and to show possible improvements and future directions of research. We wish for this paper and GARAFED to be used as guidelines for researchers and developers who aim at collecting affect-related data for real-life EMSR-based applications.

Using consumer-wearable technology for remote assessment of physiological response to stress in the naturalistic environment

Psychosocial stress is a major risk factor for morbidity and mortality related to a wide range of health conditions and has a significant negative impact on public health. Quantifying exposure to stress in the naturalistic environment can help to better understand its health effects and identify strategies for timely intervention. The objective of the current project was to develop and test the infrastructure and methods necessary for using wearable technology to quantify individual response to stressful situations and to determine if popular and accessible fitness trackers such as Fitbit® equipped with an optical heart rate (HR) monitor could be used to detect physiological response to psychosocial stress in everyday life. The participants in this study were University of Minnesota students (n = 18) that owned a Fitbit® tracker and had at least one upcoming examination. Continuous HR and activity measurements were obtained during a 7-day observation period containing examinations self-reported by the participants. Participants responded to six ecological momentary assessment surveys per day (~ 2 hour intervals) to indicate occurrence of stressful events. We compared HR during stressful events (e.g., exams) to baseline HR during periods indicated as non-stressful using mixed effects modeling. Our results show that HR was elevated by 8.9 beats per minute during exams and by 3.2 beats per minute during non-exam stressors. These results are consistent with prior laboratory findings and indicate that consumer wearable fitness trackers could serve as a valuable source of information on exposure to psychosocial stressors encountered in the naturalistic environment.

Just-in-Time Adaptive Interventions (JITAIs) in Mobile Health: Key Components and Design Principles for Ongoing Health Behavior Support

Background

The just-in-time adaptive intervention (JITAI) is an intervention design aiming to provide the right type/amount of support, at the right time, by adapting to an individual's changing internal and contextual state. The availability of increasingly powerful mobile and sensing technologies underpins the use of JITAIs to support health behavior, as in such a setting an individual's state can change rapidly, unexpectedly, and in his/her natural environment.

Purpose

Despite the increasing use and appeal of JITAIs, a major gap exists between the growing technological capabilities for delivering JITAIs and research on the development and evaluation of these interventions. Many JITAIs have been developed with minimal use of empirical evidence, theory, or accepted treatment guidelines. Here, we take an essential first step towards bridging this gap.

Methods

Building on health behavior theories and the extant literature on JITAIs, we clarify the scientific motivation for JITAIs, define their fundamental components, and highlight design principles related to these components. Examples of JITAIs from various domains of health behavior research are used for illustration.

Conclusions

As we enter a new era of technological capacity for delivering JITAIs, it is critical that researchers develop sophisticated and nuanced health behavior theories capable of guiding the construction of such interventions. Particular attention has to be given to better understanding the implications of providing timely and ecologically sound support for intervention adherence and retention.

Towards detecting cocaine use using smartwatches in the NIDA clinical trials network: Design, rationale, and methodology

Cocaine use in clinical trials is often measured via self-report, which can be inaccurate, or urine drug screens, which can be intrusive and burdensome. Devices that can automatically detect cocaine use and can be worn conveniently in daily life may provide several benefits. AutoSense is a wearable, physiological-monitoring suite that can detect cocaine use, but it may be limited as a method for monitoring cocaine use because it requires wearing a chestband with electrodes. This paper describes the design, rationale, and methodology of a project that seeks to build upon and extend previous work in the development of methods to detect cocaine use via wearable, unobtrusive mobile sensor technologies. To this end, a wrist-worn sensor suite (i.e., MotionSense HRV) will be developed and evaluated. Participants who use cocaine (N = 25) will be asked to wear MotionSense HRV and AutoSense for two weeks during waking hours. Drug use will be assessed via thrice-weekly urine drug screens and self-reports, and will be used to isolate periods of cocaine use that will be differentiated from other drug use. The present study will provide information on the feasibility and acceptability of using a wrist-worn device to detect cocaine use.

Automated sensing of daily activity: A new lens into development

Rapidly maturing technologies for sensing and activity recognition can provide unprecedented access to the complex structure daily activity and interaction, promising new insight into the mechanisms by which experience shapes developmental outcomes. Motion data, autonomic activity, and "snippets" of audio and video recordings can be conveniently logged by wearable sensors (Lazer et al., 2009). Machine learning algorithms can process these signals into meaningful markers, from child and parent behavior to outcomes such as depression or teenage drinking. Theoretically motivated aspects of daily activity can be combined and synchronized to examine reciprocal effects between children's behaviors and their environments or internal processes. Captured over longitudinal time, such data provide a new opportunity to study the processes by which individual differences emerge and stabilize. This paper introduces the reader to developments in sensing and activity recognition with implications for developmental phenomena across the lifespan, sketching a framework for leveraging mobile sensors for transactional analyses that bridge micro- and longitudinal- timescales of development. It finishes by detailing resources and best practices to facilitate the next generation of developmentalists to contribute to this emerging area.

Large-scale wearable data reveal digital phenotypes for daily-life stress detection

Physiological signals have shown to be reliable indicators of stress in laboratory studies, yet large-scale ambulatory validation is lacking. We present a large-scale cross-sectional study for ambulatory stress detection, consisting of 1002 subjects, containing subjects' demographics, baseline psychological information, and five consecutive days of free-living physiological and contextual measurements, collected through wearable devices and smartphones. This dataset represents a healthy population, showing associations between wearable physiological signals and self-reported daily-life stress. Using a data-driven approach, we identified digital phenotypes characterized by self-reported poor health indicators and high depression, anxiety and stress scores that are associated with blunted physiological responses to stress. These results emphasize the need for large-scale collections of multi-sensor data, to build personalized stress models for precision medicine.

Combining ecological momentary assessment with objective, ambulatory measures of behavior and physiology in substance-use research

Whereas substance-use researchers have long combined self-report with objective measures of behavior and physiology inside the laboratory, developments in mobile/wearable electronic technology are increasingly allowing for the collection of both subjective and objective information in participants' daily lives. For self-report, ecological momentary assessment (EMA), as implemented on contemporary smartphones or personal digital assistants, can provide researchers with near-real-time information on participants' behavior and mood in their natural environments. Data from portable/wearable electronic sensors measuring participants' internal and external environments can be combined with EMA (e.g., by timestamps recorded on questionnaires) to provide objective information useful in determining the momentary context of behavior and mood and/or validating participants' self-reports. Here, we review three objective ambulatory monitoring techniques that have been combined with EMA, with a focus on detecting drug use and/or measuring the behavioral or physiological correlates of mental events (i.e., emotions, cognitions): (1) collection and processing of biological samples in the field to measure drug use or participants' physiological activity (e.g., hypothalamic-pituitary-adrenal axis activity); (2) global positioning system (GPS) location information to link environmental characteristics (disorder/disadvantage, retail drug outlets) to drug use and affect; (3) ambulatory electronic physiological monitoring (e.g., electrocardiography) to detect drug use and mental events, as advances in machine learning algorithms make it possible to distinguish target changes from confounds (e.g., physical activity). Finally, we consider several other mobile/wearable technologies that hold promise to be combined with EMA, as well as potential challenges faced by researchers working with multiple mobile/wearable technologies simultaneously in the field.

Exacerbated Craving in the Presence of Stress and Drug Cues in Drug-Dependent Patients

In addiction, risk factors for craving and use include stress and drug-related cues. Stress and cues have additive or more-than-additive effects on drug seeking in laboratory animals, but, surprisingly, seem to compete with one another (ie, exert less-than-additive effects) in human laboratory studies of craving. We sought heretofore elusive evidence that human drug users could show additive (or more-than-additive) effects of stress and cues on craving, using ecological momentary assessment (EMA). Outpatients (N=182) maintained on daily buprenorphine or methadone provided self-reports of stress, craving, mood, and behavior on electronic diaries for up to 16 weeks. In three randomly prompted entries (RPs) per day, participants reported the severity of stress and craving and whether they had seen or been offered opioids, cocaine, cannabis, methamphetamine, alcohol, or tobacco. In random-effects models controlling for between-person differences, we tested effects of momentary drug-cue exposure and stress (and their interaction) on momentary ratings of cocaine and heroin craving. For cocaine craving, the Stress × Cue interaction term had a positive mean effect across participants (M=0.019; CL95 0.001-0.036), denoting a more-than-additive effect. For heroin, the mean was not significantly greater than 0, but the confidence interval was predominantly positive (M=0.019; CL95 -0.007-0.044), suggesting at least an additive effect. Heterogeneity was substantial; qualitatively, the Stress × Cue effect appeared additive for most participants, more than additive for a sizeable minority, and competitive in very few. In the field, unlike in human laboratory studies to date, craving for cocaine and heroin is greater with the combination of drug cues and stress than with either alone. For a substantial minority of users, the combined effect may be more than additive.

Chronodes: Interactive Multifocus Exploration of Event Sequences

The advent of mobile health (mHealth) technologies challenges the capabilities of current visualizations, interactive tools, and algorithms. We present Chronodes, an interactive system that unifies data mining and human-centric visualization techniques to support explorative analysis of longitudinal mHealth data. Chronodes extracts and visualizes frequent event sequences that reveal chronological patterns across multiple participant timelines of mHealth data. It then combines novel interaction and visualization techniques to enable multifocus event sequence analysis, which allows health researchers to interactively define, explore, and compare groups of participant behaviors using event sequence combinations. Through summarizing insights gained from a pilot study with 20 behavioral and biomedical health experts, we discuss Chronodes's efficacy and potential impact in the mHealth domain. Ultimately, we outline important open challenges in mHealth, and offer recommendations and design guidelines for future research.

mCerebrum: A Mobile Sensing Software Platform for Development and Validation of Digital Biomarkers and Interventions

The development and validation studies of new multisensory biomarkers and sensor-triggered interventions requires collecting raw sensor data with associated labels in the natural field environment. Unlike platforms for traditional mHealth apps, a software platform for such studies needs to not only support high-rate data ingestion, but also share raw high-rate sensor data with researchers, while supporting high-rate sense-analyze-act functionality in real-time. We present mCerebrum, a realization of such a platform, which supports high-rate data collections from multiple sensors with realtime assessment of data quality. A scalable storage architecture (with near optimal performance) ensures quick response despite rapidly growing data volume. Micro-batching and efficient sharing of data among multiple source and sink apps allows reuse of computations to enable real-time computation of multiple biomarkers without saturating the CPU or memory. Finally, it has a reconfigurable scheduler which manages all prompts to participants that is burden- and context-aware. With a modular design currently spanning 23+ apps, mCerebrum provides a comprehensive ecosystem of system services and utility apps. The design of mCerebrum has evolved during its concurrent use in scientific field studies at ten sites spanning 106,806 person days. Evaluations show that compared with other platforms, mCerebrum's architecture and design choices support 1.5 times higher data rates and 4.3 times higher storage throughput, while causing 8.4 times lower CPU usage.

CCS CONCEPTS

• Human-centered computing → Ubiquitous and mobile computing; Ubiquitous and mobile computing systems and tools; • Computer systems organization → Embedded and cyber-physical systems.

ACM REFERENCE FORMAT

Syed Monowar Hossain, Timothy Hnat, Nazir Saleheen, Nusrat Jahan Nasrin, Joseph Noor, Bo-Jhang Ho, Tyson Condie, Mani Srivastava, and Santosh Kumar. 2017. mCerebrum: A Mobile Sensing Software Platform for Development and Validation of Digital Biomarkers and Interventions. In Proceedings of SenSys '17, Delft, Netherlands, November 6-8, 2017, 14 pages.

Context and craving during stressful events in the daily lives of drug-dependent patients

RATIONALE

Knowing how stress manifests in the lives of people with substance-use disorders could help inform mobile "just in time" treatment.

OBJECTIVES

The purpose of this paper is to examine discrete episodes of stress, as distinct from the fluctuations in background stress assessed in most EMA studies.

METHODS

For up to 16 weeks, outpatients on opioid-agonist treatment carried smartphones on which they initiated an entry whenever they experienced a stressful event (SE) and when randomly prompted (RP) three times daily. Participants reported the severity of stress and craving and the context of the report (location, activities, companions). Decomposition of covariance was used to separate within-person from between-person effects; r _effect sizes below are within-person.

RESULTS

Participants (158 of 182; 87%) made 1787 stress-event entries. Craving for opioids increased with stress severity (r _effect = 0.50). Stress events tended to occur in social company (with acquaintances, 0.63, friends, 0.17, or on the phone, 0.41) rather than with family (spouse, -0.14; child, -0.18), and in places with more overall activity (bars, 0.32; outside, 0.28; walking, 0.28) and more likelihood of unexpected experiences (with strangers, 0.17). Being on the internet was slightly protective (-0.22). Our prior finding that being at the workplace protects against background stress in our participants was partly supported in these stressful-event data.

CONCLUSIONS

The contexts of specific stressful events differ from those we have seen in prior studies of ongoing background stress. However, both are associated with drug craving.

mSieve: Differential Behavioral Privacy in Time Series of Mobile Sensor Data

Differential privacy concepts have been successfully used to protect anonymity of individuals in population-scale analysis. Sharing of mobile sensor data, especially physiological data, raise different privacy challenges, that of protecting private behaviors that can be revealed from time series of sensor data. Existing privacy mechanisms rely on noise addition and data perturbation. But the accuracy requirement on inferences drawn from physiological data, together with well-established limits within which these data values occur, render traditional privacy mechanisms inapplicable. In this work, we define a new behavioral privacy metric based on differential privacy and propose a novel data substitution mechanism to protect behavioral privacy. We evaluate the efficacy of our scheme using 660 hours of ECG, respiration, and activity data collected from 43 participants and demonstrate that it is possible to retain meaningful utility, in terms of inference accuracy (90%), while simultaneously preserving the privacy of sensitive behaviors.

Domain Adaptation Methods for Improving Lab-to-field Generalization of Cocaine Detection using Wearable ECG

Mobile health research on illicit drug use detection typically involves a two-stage study design where data to learn detectors is first collected in lab-based trials, followed by a deployment to subjects in a free-living environment to assess detector performance. While recent work has demonstrated the feasibility of wearable sensors for illicit drug use detection in the lab setting, several key problems can limit lab-to-field generalization performance. For example, lab-based data collection often has low ecological validity, the ground-truth event labels collected in the lab may not be available at the same level of temporal granularity in the field, and there can be significant variability between subjects. In this paper, we present domain adaptation methods for assessing and mitigating potential sources of performance loss in lab-to-field generalization and apply them to the problem of cocaine use detection from wearable electrocardiogram sensor data.

Finding Significant Stress Episodes in a Discontinuous Time Series of Rapidly Varying Mobile Sensor Data

Management of daily stress can be greatly improved by delivering sensor-triggered just-in-time interventions (JITIs) on mobile devices. The success of such JITIs critically depends on being able to mine the time series of noisy sensor data to find the most opportune moments. In this paper, we propose a time series pattern mining method to detect significant stress episodes in a time series of discontinuous and rapidly varying stress data. We apply our model to 4 weeks of physiological, GPS, and activity data collected from 38 users in their natural environment to discover patterns of stress in real-life. We find that the duration of a prior stress episode predicts the duration of the next stress episode and stress in mornings and evenings is lower than during the day. We then analyze the relationship between stress and objectively rated disorder in the surrounding neighborhood and develop a model to predict stressful episodes.

Some of the people, some of the time: field evidence for associations and dissociations between stress and drug use

RATIONALE

Stress's role in drug use is supported by retrospective interview and laboratory studies, but prospective data confirming the association in daily life are sparse.

OBJECTIVES

This study aims to assess the relationship between drug use and stress in real time with ambulatory monitoring.

METHODS

For up to 16 weeks, 133 outpatients on opiate agonist treatment used smartphones to report each time they used drugs or felt more stressed than usual. They rated stress-event severity on a 10-point scale and as a hassle, day spoiler, or more than a day spoiler. For analysis, stress reports made within 72 h before a reported use of cocaine or opioid were binned into 24-h periods.

RESULTS

Of 52 participants who reported stress events in the 72-h timeframe, 41 reported stress before cocaine use and 26 before opioid use. For cocaine use, the severity of stressors, rated numerically (r effect = 0.42, CL95 0.17-0.62, p = 0.00061) and percent rated as "more than a day spoiler" (r effect = 0.34, CL95 0.07-0.56, p = 0.0292)], increased linearly across the three days preceding use. The number of stressors did not predict cocaine use, and no measure of stress predicted opioid use. In ecological momentary assessment (EMA) from the whole sample of 133, stress and drug use occurred independently and there was no overall relationship.

CONCLUSIONS

EMA did not support the idea that stress is a necessary or sufficient trigger for cocaine or heroin use after accounting for the base rates of stress and use. But EMA did show that stressful events can increase in severity in the days preceding cocaine use.

Visualization of Time-Series Sensor Data to Inform the Design of Just-In-Time Adaptive Stress Interventions

We investigate needs, challenges, and opportunities in visualizing time-series sensor data on stress to inform the design of just-in-time adaptive interventions (JITAIs). We identify seven key challenges: massive volume and variety of data, complexity in identifying stressors, scalability of space, multifaceted relationship between stress and time, a need for representation at multiple granularities, interperson variability, and limited understanding of JITAI design requirements due to its novelty. We propose four new visualizations based on one million minutes of sensor data (n=70). We evaluate our visualizations with stress researchers (n=6) to gain first insights into its usability and usefulness in JITAI design. Our results indicate that spatio-temporal visualizations help identify and explain between- and within-person variability in stress patterns and contextual visualizations enable decisions regarding the timing, content, and modality of intervention. Interestingly, a granular representation is considered informative but noise-prone; an abstract representation is the preferred starting point for designing JITAIs.

puffMarker: A Multi-Sensor Approach for Pinpointing the Timing of First Lapse in Smoking Cessation

Recent researches have demonstrated the feasibility of detecting smoking from wearable sensors, but their performance on real-life smoking lapse detection is unknown. In this paper, we propose a new model and evaluate its performance on 61 newly abstinent smokers for detecting a first lapse. We use two wearable sensors - breathing pattern from respiration and arm movements from 6-axis inertial sensors worn on wrists. In 10-fold cross-validation on 40 hours of training data from 6 daily smokers, our model achieves a recall rate of 96.9%, for a false positive rate of 1.1%. When our model is applied to 3 days of post-quit data from 32 lapsers, it correctly pinpoints the timing of first lapse in 28 participants. Only 2 false episodes are detected on 20 abstinent days of these participants. When tested on 84 abstinent days from 28 abstainers, the false episode per day is limited to 1/6.

Building new computational models to support health behavior change and maintenance: new opportunities in behavioral research

Adverse and suboptimal health behaviors and habits are responsible for approximately 40 % of preventable deaths, in addition to their unfavorable effects on quality of life and economics. Our current understanding of human behavior is largely based on static "snapshots" of human behavior, rather than ongoing, dynamic feedback loops of behavior in response to ever-changing biological, social, personal, and environmental states. This paper first discusses how new technologies (i.e., mobile sensors, smartphones, ubiquitous computing, and cloud-enabled processing/computing) and emerging systems modeling techniques enable the development of new, dynamic, and empirical models of human behavior that could facilitate just-in-time adaptive, scalable interventions. The paper then describes concrete steps to the creation of robust dynamic mathematical models of behavior including: (1) establishing "gold standard" measures, (2) the creation of a behavioral ontology for shared language and understanding tools that both enable dynamic theorizing across disciplines, (3) the development of data sharing resources, and (4) facilitating improved sharing of mathematical models and tools to support rapid aggregation of the models. We conclude with the discussion of what might be incorporated into a "knowledge commons," which could help to bring together these disparate activities into a unified system and structure for organizing knowledge about behavior.

cStress: Towards a Gold Standard for Continuous Stress Assessment in the Mobile Environment

Recent advances in mobile health have produced several new models for inferring stress from wearable sensors. But, the lack of a gold standard is a major hurdle in making clinical use of continuous stress measurements derived from wearable sensors. In this paper, we present a stress model (called cStress) that has been carefully developed with attention to every step of computational modeling including data collection, screening, cleaning, filtering, feature computation, normalization, and model training. More importantly, cStress was trained using data collected from a rigorous lab study with 21 participants and validated on two independently collected data sets - in a lab study on 26 participants and in a week-long field study with 20 participants. In testing, the model obtains a recall of 89% and a false positive rate of 5% on lab data. On field data, the model is able to predict each instantaneous self-report with an accuracy of 72%.