Real-world behavioral dataset from two fully remote smartphone-based randomized clinical trials for depression

Most people with mental health disorders cannot receive timely and evidence-based care despite billions of dollars spent by healthcare systems. Researchers have been exploring using digital health technologies to measure behavior in real-world settings with mixed results. There is a need to create accessible and computable digital mental health datasets to advance inclusive and transparently validated research for creating robust real-world digital biomarkers of mental health. Here we share and describe one of the largest and most diverse real-world behavior datasets from over two thousand individuals across the US. The data were generated as part of the two NIMH-funded randomized clinical trials conducted to assess the effectiveness of delivering mental health care continuously remotely. The longitudinal dataset consists of self-assessment of mood, depression, anxiety, and passively gathered phone-based behavioral data streams in real-world settings. This dataset will provide a timely and long-term data resource to evaluate analytical approaches for developing digital behavioral markers and understand the effectiveness of mental health care delivered continuously and remotely.

Indicators of retention in remote digital health studies: a cross-study evaluation of 100,000 participants

Digital technologies such as smartphones are transforming the way scientists conduct biomedical research. Several remotely conducted studies have recruited thousands of participants over a span of a few months allowing researchers to collect real-world data at scale and at a fraction of the cost of traditional research. Unfortunately, remote studies have been hampered by substantial participant attrition, calling into question the representativeness of the collected data including generalizability of outcomes. We report the findings regarding recruitment and retention from eight remote digital health studies conducted between 2014-2019 that provided individual-level study-app usage data from more than 100,000 participants completing nearly 3.5 million remote health evaluations over cumulative participation of 850,000 days. Median participant retention across eight studies varied widely from 2-26 days (median across all studies = 5.5 days). Survival analysis revealed several factors significantly associated with increase in participant retention time, including (i) referral by a clinician to the study (increase of 40 days in median retention time); (ii) compensation for participation (increase of 22 days, 1 study); (iii) having the clinical condition of interest in the study (increase of 7 days compared with controls); and (iv) older age (increase of 4 days). Additionally, four distinct patterns of daily app usage behavior were identified by unsupervised clustering, which were also associated with participant demographics. Most studies were not able to recruit a sample that was representative of the race/ethnicity or geographical diversity of the US. Together these findings can help inform recruitment and retention strategies to enable equitable participation of populations in future digital health research.

Differential item functioning in a Spanish translation of the Beck Depression Inventory

Brief and culturally compatible measures of depression are necessary, yet most depression scales are translated without regard for cultural biases. In this study, 292 medical outpatients completed an English or a Spanish-translated and back-translated version of the Beck Depression Inventory (BDI). The BDI items were analyzed for bias between Spanish and English-speaking patients to determine the equivalence of the scale. A Differential Item Function (DIF) using a Mantel Haenszel Approach for Ordered Response Categories was used to analyze how likely subjects in the two ethnic groups were to endorse each response category. The results suggest that regardless of level of depression, Latinos are more likely to endorse items reflecting tearfulness and punishment, and less likely to endorse inability to work. Cultural interpretations and recommendations for use of the BDI are discussed.