1
|
Sîrbu V, David OA. Efficacy of app-based mobile health interventions for stress management: A systematic review and meta-analysis of self-reported, physiological, and neuroendocrine stress-related outcomes. Clin Psychol Rev 2024; 114:102515. [PMID: 39522422 DOI: 10.1016/j.cpr.2024.102515] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2023] [Revised: 09/04/2024] [Accepted: 10/25/2024] [Indexed: 11/16/2024]
Abstract
Stress is a significant mental health concern for the general population, highlighting the need for effective and scalable solutions, such as mobile health (mHealth) app interventions. This systematic review and meta-analysis aimed to investigate the effects of mHealth apps designed primarily to reduce stress and distress in non-clinical and subclinical populations. A comprehensive literature search was conducted up to August 2024, including studies that measured both self-reported and physiological stress outcomes. 80 studies were analyzed. A small but significant effect size (g = 0.33) was found for self-reported stress outcomes, with studies that used specific active controls, operated in naturalistic contexts, and had a low risk of bias showing significantly lower effect sizes. A similarly small effect size was observed for physiological outcomes (g = 0.24). Notably, studies that employed muscle and breathing relaxation, meditation strategies, personalized guidance, experimental usage settings, and measured acute stress responses demonstrated significantly higher effect sizes. Further analysis of specific physiological systems revealed small effect sizes for autonomic (g = 0.32) and cardiac outcomes (g = 0.36). The significant effects observed across both psychological and physiological outcomes support the efficacy and potential of mHealth apps for the self-management of stress responses in the broader population.
Collapse
Affiliation(s)
- Vasile Sîrbu
- Evidence-Based Psychological Assessment and Interventions Doctoral School, Babes-Bolyai University, Cluj-Napoca, Romania
| | - Oana Alexandra David
- DATA Lab, International Institute for Advanced Studies in Psychotherapy and Applied Mental Health, Babes-Bolyai University, Cluj-Napoca, Romania; Department of Clinical Psychology and Psychotherapy, Babes-Bolyai University, Cluj-Napoca, Romania.
| |
Collapse
|
2
|
Musial S, Burns Z, Bertman J, Fitzgibbon M, Mashek R, Risica PM. One Month Whole Food Plant-Based Nutrition Educational Program Lowers LDL, A1C, and Decreases Inflammatory Markers. Am J Lifestyle Med 2024:15598276241291490. [PMID: 39540160 PMCID: PMC11556590 DOI: 10.1177/15598276241291490] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2024] Open
Abstract
Lifestyle-related chronic disease increases in the United States have led to the need for innovative programs targeting dietary choices. Based on growing evidence supporting whole food plant-based (WFPB) nutrition to improve overall health, we devised a one-month WFPB intervention program, Jumpstart Your Health! (JYH), to introduce and encourage adoption of the WFPB dietary lifestyle. This paper investigates its effects on various health indicators associated with cardiovascular and metabolic diseases. Among the total of 150 participants, before and after physical measurements and blood chemistries demonstrate significant (p< 0.05) decreases in weight (-4.2 pounds), cholesterol (-25.3 mg/dl), LDL (-19.0 mg/dl), HDL (-5.6 mg/dl), hemoglobin A1c (-0.2%), and hsCRP (-1.9 mg/L). Among the high-risk participants, we found significant decreases in systolic blood pressure (-10 mmHg), diastolic blood pressure (-8.7 mmHg), weight (-4.3 pounds), cholesterol (-38.8 mg/dl), LDL (-22.7 mg/dl), HDL (-2.8 mg/dl), hemoglobin A1c (-0.2 %), and hsCRP (-2.3 mg/L). We demonstrate that a simple WFPB intervention implemented over one month resulted in significant reductions in physical measurements and blood chemistries that could translate to lowered risk or improvement for obesity, cardiovascular disease, and type-2 diabetes.
Collapse
Affiliation(s)
| | - Zachary Burns
- Department of Family Medicine, Brown University Warren Alpert Medical School, Providence, RI, USA
| | | | - Molly Fitzgibbon
- Physician Assistant School, South University in West Palm Beach, Royal Palm Beach, FL, USA
| | - Rachel Mashek
- Brown University School of Public Health, Providence, RI, USA
| | - Patricia Markham Risica
- Department of Epidemiology, Brown University School of Public Health, Providence, RI, USA
- Department of Behavioral and Social Sciences, Brown University School of Public Health, Providence, RI, USA
- Center for Health Promotion and Health Equity, Brown University School of Public Health, Providence, RI, USA
| |
Collapse
|
3
|
De La Torre SA, El Mistiri M, Hekler E, Klasnja P, Marlin B, Pavel M, Spruijt-Metz D, Rivera DE. Modeling engagement with a digital behavior change intervention (HeartSteps II): An exploratory system identification approach. J Biomed Inform 2024; 158:104721. [PMID: 39265816 DOI: 10.1016/j.jbi.2024.104721] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/29/2024] [Revised: 08/29/2024] [Accepted: 09/02/2024] [Indexed: 09/14/2024]
Abstract
OBJECTIVE Digital behavior change interventions (DBCIs) are feasibly effective tools for addressing physical activity. However, in-depth understanding of participants' long-term engagement with DBCIs remains sparse. Since the effectiveness of DBCIs to impact behavior change depends, in part, upon participant engagement, there is a need to better understand engagement as a dynamic process in response to an individual's ever-changing biological, psychological, social, and environmental context. METHODS The year-long micro-randomized trial (MRT) HeartSteps II provides an unprecedented opportunity to investigate DBCI engagement among ethnically diverse participants. We combined data streams from wearable sensors (Fitbit Versa, i.e., walking behavior), the HeartSteps II app (i.e. page views), and ecological momentary assessments (EMAs, i.e. perceived intrinsic and extrinsic motivation) to build the idiographic models. A system identification approach and a fluid analogy model were used to conduct autoregressive with exogenous input (ARX) analyses that tested hypothesized relationships between these variables inspired by Self-Determination Theory (SDT) with DBCI engagement through time. RESULTS Data from 11 HeartSteps II participants was used to test aspects of the hypothesized SDT dynamic model. The average age was 46.33 (SD=7.4) years, and the average steps per day at baseline was 5,507 steps (SD=6,239). The hypothesized 5-input SDT-inspired ARX model for app engagement resulted in a 31.75 % weighted RMSEA (31.50 % on validation and 31.91 % on estimation), indicating that the model predicted app page views almost 32 % better relative to the mean of the data. Among Hispanic/Latino participants, the average overall model fit across inventories of the SDT fluid analogy was 34.22 % (SD=10.53) compared to 22.39 % (SD=6.36) among non-Hispanic/Latino Whites, a difference of 11.83 %. Across individuals, the number of daily notification prompts received by the participant was positively associated with increased app page views. The weekend/weekday indicator and perceived daily busyness were also found to be key predictors of the number of daily application page views. CONCLUSIONS This novel approach has significant implications for both personalized and adaptive DBCIs by identifying factors that foster or undermine engagement in an individual's respective context. Once identified, these factors can be tailored to promote engagement and support sustained behavior change over time.
Collapse
Affiliation(s)
- Steven A De La Torre
- The Herbert Wertheim School of Public Health and Human Longevity Science, University of California, San Diego, La Jolla, CA, United States.
| | - Mohamed El Mistiri
- Control Systems Engineering Laboratory, School for Engineering of Matter, Transport, Energy, Arizona State University, Tempe, AZ 85287, United States
| | - Eric Hekler
- Herbert Wertheim School of Public Health and Human Longevity Science, University of California, San Diego, CA 92093, United States; Design Laboratory, University of California, San Diego, CA 92093, United States; Center for Wireless and Population Health Systems, University of California, San Diego, CA 92093, United States
| | - Predrag Klasnja
- School of Information, University of Michigan, Ann Arbor, MI 48109, United States
| | - Benjamin Marlin
- Manning College of Information and Computer Sciences, University of Massachusetts Amherst, Amherst, MA 01003, United States
| | - Misha Pavel
- Khoury College of Computer Sciences, Northeastern University, Boston, MA 02115, United States; Bouve College of Health Sciences, Northeastern University, Boston, MA 02115, United States
| | - Donna Spruijt-Metz
- Dornsife Center for Economic and Social Research, Department of Psychology, University of Southern California, Los Angeles, CA, United States
| | - Daniel E Rivera
- Control Systems Engineering Laboratory, School for Engineering of Matter, Transport, Energy, Arizona State University, Tempe, AZ 85287, United States
| |
Collapse
|
4
|
Yan Y, Sankar BS, Mirza B, Ng DCM, Pelletier AR, Huang SD, Wang W, Watson K, Wang D, Ping P. Missing Values in Longitudinal Proteome Dynamics Studies: Making a Case for Data Multiple Imputation. J Proteome Res 2024; 23:4151-4162. [PMID: 39189460 PMCID: PMC11385379 DOI: 10.1021/acs.jproteome.4c00263] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/28/2024]
Abstract
Temporal proteomics data sets are often confounded by the challenges of missing values. These missing data points, in a time-series context, can lead to fluctuations in measurements or the omission of critical events, thus hindering the ability to fully comprehend the underlying biomedical processes. We introduce a Data Multiple Imputation (DMI) pipeline designed to address this challenge in temporal data set turnover rate quantifications, enabling robust downstream analysis to gain novel discoveries. To demonstrate its utility and generalizability, we applied this pipeline to two use cases: a murine cardiac temporal proteomics data set and a human plasma temporal proteomics data set, both aimed at examining protein turnover rates. This DMI pipeline significantly enhanced the detection of protein turnover rate in both data sets, and furthermore, the imputed data sets captured new representation of proteins, leading to an augmented view of biological pathways, protein complex dynamics, as well as biomarker-disease associations. Importantly, DMI exhibited superior performance in benchmark data sets compared to single imputation methods (DSI). In summary, we have demonstrated that this DMI pipeline is effective at overcoming challenges introduced by missing values in temporal proteome dynamics studies.
Collapse
Affiliation(s)
- Yu Yan
- Departments of Physiology and Medicine, University of California, Los Angeles (UCLA) School of Medicine, Los Angeles, California 90095, United States
- NHLBI Integrated Cardiovascular Data Science Training Program, UCLA, Los Angeles, California 90095, United States
- NIH BRIDGE2AI Center & NHLBI Integrated Cardiovascular Data Science Training Program, UCLA, Suite 1-609, MRL Building, 675 Charles E. Young Drive South, Los Angeles, California 90095, United States
| | - Baradwaj Simha Sankar
- Departments of Physiology and Medicine, University of California, Los Angeles (UCLA) School of Medicine, Los Angeles, California 90095, United States
- NIH BRIDGE2AI Center & NHLBI Integrated Cardiovascular Data Science Training Program, UCLA, Suite 1-609, MRL Building, 675 Charles E. Young Drive South, Los Angeles, California 90095, United States
| | - Bilal Mirza
- Departments of Physiology and Medicine, University of California, Los Angeles (UCLA) School of Medicine, Los Angeles, California 90095, United States
- NHLBI Integrated Cardiovascular Data Science Training Program, UCLA, Los Angeles, California 90095, United States
| | - Dominic C M Ng
- Departments of Physiology and Medicine, University of California, Los Angeles (UCLA) School of Medicine, Los Angeles, California 90095, United States
- NHLBI Integrated Cardiovascular Data Science Training Program, UCLA, Los Angeles, California 90095, United States
- NIH BRIDGE2AI Center & NHLBI Integrated Cardiovascular Data Science Training Program, UCLA, Suite 1-609, MRL Building, 675 Charles E. Young Drive South, Los Angeles, California 90095, United States
| | - Alexander R Pelletier
- NHLBI Integrated Cardiovascular Data Science Training Program, UCLA, Los Angeles, California 90095, United States
- Department of Computer Science and Scalable Analytics Institute, UCLA School of Engineering, Los Angeles, California 90095, United States
| | - Sarah D Huang
- Departments of Physiology and Medicine, University of California, Los Angeles (UCLA) School of Medicine, Los Angeles, California 90095, United States
- NHLBI Integrated Cardiovascular Data Science Training Program, UCLA, Los Angeles, California 90095, United States
| | - Wei Wang
- NHLBI Integrated Cardiovascular Data Science Training Program, UCLA, Los Angeles, California 90095, United States
- Department of Computer Science and Scalable Analytics Institute, UCLA School of Engineering, Los Angeles, California 90095, United States
| | - Karol Watson
- Departments of Physiology and Medicine, University of California, Los Angeles (UCLA) School of Medicine, Los Angeles, California 90095, United States
- NIH BRIDGE2AI Center & NHLBI Integrated Cardiovascular Data Science Training Program, UCLA, Suite 1-609, MRL Building, 675 Charles E. Young Drive South, Los Angeles, California 90095, United States
| | - Ding Wang
- Departments of Physiology and Medicine, University of California, Los Angeles (UCLA) School of Medicine, Los Angeles, California 90095, United States
- NHLBI Integrated Cardiovascular Data Science Training Program, UCLA, Los Angeles, California 90095, United States
- NIH BRIDGE2AI Center & NHLBI Integrated Cardiovascular Data Science Training Program, UCLA, Suite 1-609, MRL Building, 675 Charles E. Young Drive South, Los Angeles, California 90095, United States
| | - Peipei Ping
- Departments of Physiology and Medicine, University of California, Los Angeles (UCLA) School of Medicine, Los Angeles, California 90095, United States
- NHLBI Integrated Cardiovascular Data Science Training Program, UCLA, Los Angeles, California 90095, United States
- NIH BRIDGE2AI Center & NHLBI Integrated Cardiovascular Data Science Training Program, UCLA, Suite 1-609, MRL Building, 675 Charles E. Young Drive South, Los Angeles, California 90095, United States
- Department of Computer Science and Scalable Analytics Institute, UCLA School of Engineering, Los Angeles, California 90095, United States
| |
Collapse
|
5
|
Bourke M, Bruijns BA, Vanderloo LM, Irwin J, Heydon R, Carson V, Naylor PJ, Johnson AM, Adamo KB, Burke SM, Timmons BW, Tucker P. The efficacy of the TEACH e-Learning course at improving early childhood educators' physical activity and sedentary behaviour self-efficacy, knowledge, intentions, and perceived behavioural control: a randomized controlled trial. Int J Behav Nutr Phys Act 2024; 21:79. [PMID: 39039543 PMCID: PMC11265122 DOI: 10.1186/s12966-024-01628-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2023] [Accepted: 07/12/2024] [Indexed: 07/24/2024] Open
Abstract
BACKGROUND Early childhood educators play a critical role in promoting physical activity and reducing sedentary time in childcare centres. However, early childhood educators receive limited specialised pre- and in-service learning opportunities relating to these behaviours and may lack the capacity to effectively engage children in healthy movement behaviours. This study aimed to examine the efficacy of an e-Learning course on increasing early childhood educators' physical activity and sedentary behaviour-related capacities. METHODS A two-group parallel randomized controlled trial was conducted with early childhood educators in Canada (Mage = 41.78, 97% female). Participants randomized to the intervention group were asked to complete a physical activity and sedentary behaviour e-Learning course within a 4-week period. Participants randomized to the waitlist control condition were assigned to a waitlist to receive the intervention after the testing period. Participants reported on their self-efficacy, knowledge, intentions, and perceived behavioural control relating to physical activity and sedentary behaviours at baseline, post-intervention, and 3 months follow-up. Linear mixed effects models were estimated to determine difference in changes in outcomes from baseline to post-intervention, and follow-up. RESULTS A total of 209 early childhood educators participated in the study (intervention n = 98; control n = 111). The TEACH e-Learning course was found to be efficacious at improving all of the examined outcomes, with standardized effect sizes ranging from d = 0.58 to d = 0.65 for self-efficacy outcomes, d = 0.66 to d = 1.20 for knowledge outcomes, d = 0.50 to d = 0.65 for intention outcomes, and d = 0.33 to d = 0.69 for perceived behavioural control outcomes post-intervention. The intervention effects were sustained at follow-up for all outcomes apart from perceived behavioural control to limit screen time. Additionally, the magnitude of the effect for knowledge outcomes decreased at follow-up, with standardized effect sizes ranging from d = 0.49 to d = 0.67. CONCLUSIONS The e-Learning course was highly successful at improving early childhood educators' capacity pertaining to physical activity and sedentary behaviours. Providing training content through e-Learning may be an efficacious approach to providing continual professional learning opportunities relating to physical activity and sedentary time to early childhood educators on a large scale.
Collapse
Affiliation(s)
- Matthew Bourke
- School of Occupational Therapy, Faculty of Health Sciences, University of Western Ontario, 1201 Western Road, Elborn College, Room 2547, London, ON, N6G 1H1, Canada
| | - Brianne A Bruijns
- School of Occupational Therapy, Faculty of Health Sciences, University of Western Ontario, 1201 Western Road, Elborn College, Room 2547, London, ON, N6G 1H1, Canada
| | - Leigh M Vanderloo
- School of Occupational Therapy, Faculty of Health Sciences, University of Western Ontario, 1201 Western Road, Elborn College, Room 2547, London, ON, N6G 1H1, Canada
- ParticipACTION, Toronto, ON, Canada
| | - Jennifer Irwin
- School of Health Studies, Faculty of Health Sciences, University of Western Ontario, London, ON, Canada
| | - Rachel Heydon
- Faculty of Education, University of Western Ontario, London, ON, Canada
| | - Valerie Carson
- Faculty of Kinesiology, Sport, and Recreation, University of Alberta, Edmonton, AB, Canada
| | - Patti-Jean Naylor
- School of Exercise Science, Physical and Health Education, University of Victoria, Victoria, BC, Canada
| | - Andrew M Johnson
- School of Health Studies, Faculty of Health Sciences, University of Western Ontario, London, ON, Canada
| | - Kristi B Adamo
- School of Human Kinetics, Faculty of Health Sciences, University of Ottawa, Ottawa, ON, Canada
| | - Shauna M Burke
- School of Health Studies, Faculty of Health Sciences, University of Western Ontario, London, ON, Canada
| | - Brian W Timmons
- Child Health and Exercise Medicine Program, McMaster University, Hamilton, ON, Canada
| | - Patricia Tucker
- School of Occupational Therapy, Faculty of Health Sciences, University of Western Ontario, 1201 Western Road, Elborn College, Room 2547, London, ON, N6G 1H1, Canada.
- Children's Health Research Institute, London, ON, Canada.
| |
Collapse
|
6
|
Ulrich S, Lienhard N, Künzli H, Kowatsch T. A Chatbot-Delivered Stress Management Coaching for Students (MISHA App): Pilot Randomized Controlled Trial. JMIR Mhealth Uhealth 2024; 12:e54945. [PMID: 38922677 PMCID: PMC11237786 DOI: 10.2196/54945] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Revised: 04/05/2024] [Accepted: 05/03/2024] [Indexed: 06/27/2024] Open
Abstract
BACKGROUND Globally, students face increasing mental health challenges, including elevated stress levels and declining well-being, leading to academic performance issues and mental health disorders. However, due to stigma and symptom underestimation, students rarely seek effective stress management solutions. Conversational agents in the health sector have shown promise in reducing stress, depression, and anxiety. Nevertheless, research on their effectiveness for students with stress remains limited. OBJECTIVE This study aims to develop a conversational agent-delivered stress management coaching intervention for students called MISHA and to evaluate its effectiveness, engagement, and acceptance. METHODS In an unblinded randomized controlled trial, Swiss students experiencing stress were recruited on the web. Using a 1:1 randomization ratio, participants (N=140) were allocated to either the intervention or waitlist control group. Treatment effectiveness on changes in the primary outcome, that is, perceived stress, and secondary outcomes, including depression, anxiety, psychosomatic symptoms, and active coping, were self-assessed and evaluated using ANOVA for repeated measure and general estimating equations. RESULTS The per-protocol analysis revealed evidence for improvement of stress, depression, and somatic symptoms with medium effect sizes (Cohen d=-0.36 to Cohen d=-0.60), while anxiety and active coping did not change (Cohen d=-0.29 and Cohen d=0.13). In the intention-to-treat analysis, similar results were found, indicating reduced stress (β estimate=-0.13, 95% CI -0.20 to -0.05; P<.001), depressive symptoms (β estimate=-0.23, 95% CI -0.38 to -0.08; P=.003), and psychosomatic symptoms (β estimate=-0.16, 95% CI -0.27 to -0.06; P=.003), while anxiety and active coping did not change. Overall, 60% (42/70) of the participants in the intervention group completed the coaching by completing the postintervention survey. They particularly appreciated the quality, quantity, credibility, and visual representation of information. While individual customization was rated the lowest, the target group fitting was perceived as high. CONCLUSIONS Findings indicate that MISHA is feasible, acceptable, and effective in reducing perceived stress among students in Switzerland. Future research is needed with different populations, for example, in students with high stress levels or compared to active controls. TRIAL REGISTRATION German Clinical Trials Register DRKS 00030004; https://drks.de/search/en/trial/DRKS00030004.
Collapse
Affiliation(s)
- Sandra Ulrich
- School of Applied Psychology, Zurich University of Applied Sciences, Zurich, Switzerland
| | - Natascha Lienhard
- School of Applied Psychology, Zurich University of Applied Sciences, Zurich, Switzerland
| | - Hansjörg Künzli
- School of Applied Psychology, Zurich University of Applied Sciences, Zurich, Switzerland
| | - Tobias Kowatsch
- Institute for Implementation Science in Health Care, University of Zurich, Zurich, Switzerland
- School of Medicine, University of St. Gallen, St.Gallen, Switzerland
- Centre for Digital Health Interventions, Department of Management, Technology and Economics, ETH Zurich, Zurich, Switzerland
| |
Collapse
|
7
|
Fowler C, Cai X, Baker JT, Onnela JP, Valeri L. Testing unit root non-stationarity in the presence of missing data in univariate time series of mobile health studies. J R Stat Soc Ser C Appl Stat 2024; 73:755-773. [PMID: 38883261 PMCID: PMC11175825 DOI: 10.1093/jrsssc/qlae010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2023] [Revised: 11/29/2023] [Accepted: 02/01/2024] [Indexed: 06/18/2024]
Abstract
The use of digital devices to collect data in mobile health studies introduces a novel application of time series methods, with the constraint of potential data missing at random or missing not at random (MNAR). In time-series analysis, testing for stationarity is an important preliminary step to inform appropriate subsequent analyses. The Dickey-Fuller test evaluates the null hypothesis of unit root non-stationarity, under no missing data. Beyond recommendations under data missing completely at random for complete case analysis or last observation carry forward imputation, researchers have not extended unit root non-stationarity testing to more complex missing data mechanisms. Multiple imputation with chained equations, Kalman smoothing imputation, and linear interpolation have also been used for time-series data, however such methods impose constraints on the autocorrelation structure and impact unit root testing. We propose maximum likelihood estimation and multiple imputation using state space model approaches to adapt the augmented Dickey-Fuller test to a context with missing data. We further develop sensitivity analyses to examine the impact of MNAR data. We evaluate the performance of existing and proposed methods across missing mechanisms in extensive simulations and in their application to a multi-year smartphone study of bipolar patients.
Collapse
Affiliation(s)
- Charlotte Fowler
- Department of Biostatistics, Mailman School of Public Health, Columbia University, New York, NY, USA
| | - Xiaoxuan Cai
- Department of Statistics, The Ohio State University, Columbus, OH, USA
| | - Justin T Baker
- Institute for Technology in Psychiatry, McLean Hospital, Harvard Medical School, Belmont, MA, USA
| | - Jukka-Pekka Onnela
- Department of Biostatistics, Harvard TH Chan School of Public Health, Harvard University, Boston, MA, USA
| | - Linda Valeri
- Department of Biostatistics, Mailman School of Public Health, Columbia University, New York, NY, USA
| |
Collapse
|
8
|
Jabir AI, Lin X, Martinengo L, Sharp G, Theng YL, Tudor Car L. Attrition in Conversational Agent-Delivered Mental Health Interventions: Systematic Review and Meta-Analysis. J Med Internet Res 2024; 26:e48168. [PMID: 38412023 PMCID: PMC10933752 DOI: 10.2196/48168] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2023] [Revised: 09/21/2023] [Accepted: 12/04/2023] [Indexed: 02/28/2024] Open
Abstract
BACKGROUND Conversational agents (CAs) or chatbots are computer programs that mimic human conversation. They have the potential to improve access to mental health interventions through automated, scalable, and personalized delivery of psychotherapeutic content. However, digital health interventions, including those delivered by CAs, often have high attrition rates. Identifying the factors associated with attrition is critical to improving future clinical trials. OBJECTIVE This review aims to estimate the overall and differential rates of attrition in CA-delivered mental health interventions (CA interventions), evaluate the impact of study design and intervention-related aspects on attrition, and describe study design features aimed at reducing or mitigating study attrition. METHODS We searched PubMed, Embase (Ovid), PsycINFO (Ovid), Cochrane Central Register of Controlled Trials, and Web of Science, and conducted a gray literature search on Google Scholar in June 2022. We included randomized controlled trials that compared CA interventions against control groups and excluded studies that lasted for 1 session only and used Wizard of Oz interventions. We also assessed the risk of bias in the included studies using the Cochrane Risk of Bias Tool 2.0. Random-effects proportional meta-analysis was applied to calculate the pooled dropout rates in the intervention groups. Random-effects meta-analysis was used to compare the attrition rate in the intervention groups with that in the control groups. We used a narrative review to summarize the findings. RESULTS The systematic search retrieved 4566 records from peer-reviewed databases and citation searches, of which 41 (0.90%) randomized controlled trials met the inclusion criteria. The meta-analytic overall attrition rate in the intervention group was 21.84% (95% CI 16.74%-27.36%; I2=94%). Short-term studies that lasted ≤8 weeks showed a lower attrition rate (18.05%, 95% CI 9.91%- 27.76%; I2=94.6%) than long-term studies that lasted >8 weeks (26.59%, 95% CI 20.09%-33.63%; I2=93.89%). Intervention group participants were more likely to attrit than control group participants for short-term (log odds ratio 1.22, 95% CI 0.99-1.50; I2=21.89%) and long-term studies (log odds ratio 1.33, 95% CI 1.08-1.65; I2=49.43%). Intervention-related characteristics associated with higher attrition include stand-alone CA interventions without human support, not having a symptom tracker feature, no visual representation of the CA, and comparing CA interventions with waitlist controls. No participant-level factor reliably predicted attrition. CONCLUSIONS Our results indicated that approximately one-fifth of the participants will drop out from CA interventions in short-term studies. High heterogeneities made it difficult to generalize the findings. Our results suggested that future CA interventions should adopt a blended design with human support, use symptom tracking, compare CA intervention groups against active controls rather than waitlist controls, and include a visual representation of the CA to reduce the attrition rate. TRIAL REGISTRATION PROSPERO International Prospective Register of Systematic Reviews CRD42022341415; https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42022341415.
Collapse
Affiliation(s)
- Ahmad Ishqi Jabir
- Lee Kong Chian School of Medicine, Nanyang Technological University Singapore, Singapore, Singapore
- Future Health Technologies, Singapore-ETH Centre, Campus for Research Excellence And Technological Enterprise, Singapore, Singapore
| | - Xiaowen Lin
- Lee Kong Chian School of Medicine, Nanyang Technological University Singapore, Singapore, Singapore
| | - Laura Martinengo
- Lee Kong Chian School of Medicine, Nanyang Technological University Singapore, Singapore, Singapore
| | - Gemma Sharp
- Department of Neuroscience, Monash University, Melbourne, Australia
| | - Yin-Leng Theng
- Centre for Healthy and Sustainable Cities, Wee Kim Wee School of Communication and Information, Nanyang Technological University Singapore, Singapore, Singapore
| | - Lorainne Tudor Car
- Lee Kong Chian School of Medicine, Nanyang Technological University Singapore, Singapore, Singapore
- Department of Primary Care and Public Health, School of Public Health, Imperial College London, London, United Kingdom
| |
Collapse
|
9
|
Bourguignon L, Lukas LP, Guest JD, Geisler FH, Noonan V, Curt A, Brüningk SC, Jutzeler CR. Studying missingness in spinal cord injury data: challenges and impact of data imputation. BMC Med Res Methodol 2024; 24:5. [PMID: 38184529 PMCID: PMC10770973 DOI: 10.1186/s12874-023-02125-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2023] [Accepted: 12/08/2023] [Indexed: 01/08/2024] Open
Abstract
BACKGROUND In the last decades, medical research fields studying rare conditions such as spinal cord injury (SCI) have made extensive efforts to collect large-scale data. However, most analysis methods rely on complete data. This is particularly troublesome when studying clinical data as they are prone to missingness. Often, researchers mitigate this problem by removing patients with missing data from the analyses. Less commonly, imputation methods to infer likely values are applied. OBJECTIVE Our objective was to study how handling missing data influences the results reported, taking the example of SCI registries. We aimed to raise awareness on the effects of missing data and provide guidelines to be applied for future research projects, in SCI research and beyond. METHODS Using the Sygen clinical trial data (n = 797), we analyzed the impact of the type of variable in which data is missing, the pattern according to which data is missing, and the imputation strategy (e.g. mean imputation, last observation carried forward, multiple imputation). RESULTS Our simulations show that mean imputation may lead to results strongly deviating from the underlying expected results. For repeated measures missing at late stages (> = 6 months after injury in this simulation study), carrying the last observation forward seems the preferable option for the imputation. This simulation study could show that a one-size-fit-all imputation strategy falls short in SCI data sets. CONCLUSIONS Data-tailored imputation strategies are required (e.g., characterisation of the missingness pattern, last observation carried forward for repeated measures evolving to a plateau over time). Therefore, systematically reporting the extent, kind and decisions made regarding missing data will be essential to improve the interpretation, transparency, and reproducibility of the research presented.
Collapse
Affiliation(s)
- Lucie Bourguignon
- Department of Health Sciences and Technology (D-HEST), ETH Zurich, Universitätstrasse 2, 8092, Zürich, Switzerland.
- Schulthess Klinik, Lengghalde 2, 8008, Zürich, Switzerland.
- SIB Swiss Institute of Bioinformatics, Lausanne, Switzerland.
| | - Louis P Lukas
- Department of Health Sciences and Technology (D-HEST), ETH Zurich, Universitätstrasse 2, 8092, Zürich, Switzerland
- Schulthess Klinik, Lengghalde 2, 8008, Zürich, Switzerland
- SIB Swiss Institute of Bioinformatics, Lausanne, Switzerland
| | - James D Guest
- Neurological Surgery and the Miami Project to Cure Paralysis, U Miami, Miami, FL, 33136, USA
| | - Fred H Geisler
- Department of Medical Imaging, College of Medicine, University of Saskatchewan, Saskatoon, Saskatchewan, Canada
| | - Vanessa Noonan
- Praxis Spinal Cord Institute, Vancouver, British Columbia, Canada
| | - Armin Curt
- Spinal Cord Injury Center, University Hospital Balgrist, University of Zurich, Lengghalde 2, 8006, Zürich, Switzerland
| | - Sarah C Brüningk
- Department of Health Sciences and Technology (D-HEST), ETH Zurich, Universitätstrasse 2, 8092, Zürich, Switzerland
- Schulthess Klinik, Lengghalde 2, 8008, Zürich, Switzerland
- SIB Swiss Institute of Bioinformatics, Lausanne, Switzerland
| | - Catherine R Jutzeler
- Department of Health Sciences and Technology (D-HEST), ETH Zurich, Universitätstrasse 2, 8092, Zürich, Switzerland
- Schulthess Klinik, Lengghalde 2, 8008, Zürich, Switzerland
- SIB Swiss Institute of Bioinformatics, Lausanne, Switzerland
| |
Collapse
|
10
|
Hernández-Pacheco R, Steiner UK, Rosati AG, Tuljapurkar S. Advancing methods for the biodemography of aging within social contexts. Neurosci Biobehav Rev 2023; 153:105400. [PMID: 37739326 PMCID: PMC10591901 DOI: 10.1016/j.neubiorev.2023.105400] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2022] [Revised: 08/10/2023] [Accepted: 09/18/2023] [Indexed: 09/24/2023]
Abstract
Several social dimensions including social integration, status, early-life adversity, and their interactions across the life course can predict health, reproduction, and mortality in humans. Accordingly, the social environment plays a fundamental role in the emergence of phenotypes driving the evolution of aging. Recent work placing human social gradients on a biological continuum with other species provides a useful evolutionary context for aging questions, but there is still a need for a unified evolutionary framework linking health and aging within social contexts. Here, we summarize current challenges to understand the role of the social environment in human life courses. Next, we review recent advances in comparative biodemography and propose a biodemographic perspective to address socially driven health phenotype distributions and their evolutionary consequences using a nonhuman primate population. This new comparative approach uses evolutionary demography to address the joint dynamics of populations, social dimensions, phenotypes, and life history parameters. The long-term goal is to advance our understanding of the link between individual social environments, population-level outcomes, and the evolution of aging.
Collapse
Affiliation(s)
- Raisa Hernández-Pacheco
- Department of Biological Sciences, California State University, Long Beach, 1250 N Bellflower Blvd, Long Beach, CA 90840-0004, USA.
| | - Ulrich K Steiner
- Freie Universität Berlin, Biological Institute, Königin-Luise Str. 1-3, 14195 Berlin, Germany
| | - Alexandra G Rosati
- Departments of Psychology and Anthropology, University of Michigan, 530 Church St, Ann Arbor, MI 48109, USA
| | | |
Collapse
|
11
|
Maciejewski J, Smoktunowicz E. Low-effort internet intervention to reduce students' stress delivered with Meta's Messenger chatbot (Stressbot): A randomized controlled trial. Internet Interv 2023; 33:100653. [PMID: 37575678 PMCID: PMC10413073 DOI: 10.1016/j.invent.2023.100653] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/21/2023] [Revised: 07/11/2023] [Accepted: 07/19/2023] [Indexed: 08/15/2023] Open
Abstract
In order to be more accessible and overcome the challenges of low adherence and high dropout, self-guided internet interventions need to seek new delivery formats. In this study, we tested whether a widely-adopted social media app - Meta's (Facebook) Messenger - would be a suitable conveyor of such an internet intervention. Specifically, we verified the efficacy of Stressbot: a Messenger chatbot-delivered intervention focused on enhancing coping self-efficacy to reduce stress and improve quality of life in university students. Participants (N = 372) were randomly assigned to two conditions: (1) an experimental group with access to the Stressbot intervention, and (2) a waitlist control group. Three outcomes, namely coping self-efficacy, stress, and quality of life, were assessed at three time points: a baseline, post-test, and one-month follow-up. Linear Mixed Effects Models were used to analyze the data. At post-test, we found improvements in the Stressbot condition compared to the control condition for stress (d = -0.33) and coping self-efficacy (d = 0.50), but not for quality of life. A sensitivity analysis revealed that the positive short-term intervention effects were robust. At the follow-up, there were no differences between groups, indicating that the intervention was effective only in the short term. In sum, the results suggest that the Messenger app is a viable means to deliver a self-guided internet intervention. However, modifications such as a more engaging design or boosters are required for the effects to persist.
Collapse
Affiliation(s)
| | - Ewelina Smoktunowicz
- StresLab Research Centre, Institute of Psychology, SWPS University, Warsaw, Poland
| |
Collapse
|
12
|
Linardon J, Shatte A, Messer M, McClure Z, Fuller-Tyszkiewicz M. Effects of Participant's Choice of Different Digital Interventions on Outcomes for Binge-Spectrum Eating Disorders: A Pilot Doubly Randomized Preference Trial. Behav Ther 2023; 54:303-314. [PMID: 36858761 DOI: 10.1016/j.beth.2022.09.007] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/09/2022] [Revised: 09/12/2022] [Accepted: 09/13/2022] [Indexed: 11/02/2022]
Abstract
It is unclear whether offering individuals a choice between different digital intervention programs affects treatment outcomes. To generate initial insights, we conducted a pilot doubly randomized preference trial to test whether offering individuals with binge-spectrum eating disorder a choice between two digital interventions is causally linked with superior outcomes than random assignment to these interventions. Participants with recurrent binge eating were randomized to either a choice (n = 77) or no-choice (n = 78) group. Those in the choice group could choose one of the two digital programs, while those in the no-choice group were assigned a program at random. The two digital interventions (a broad and a focused program) took 4 weeks to complete, were based on cognitive-behavioral principles and have demonstrated comparable efficacy, but differ in scope, content, and targeted change mechanisms. Most participants (79%) allocated to the choice condition chose the broad program. While both groups experienced improvements in primary (Eating Disorder Examination Questionnaire global scores and number of binge eating episodes over the past month) and secondary outcomes (dietary restraint, body image concerns, etc.), no significant between-group differences were observed. The two groups did not differ on dropout rates, nor on most indices of intervention engagement. Findings provide preliminary insights towards the role of client preferences in digital mental health interventions for eating disorders. Client preferences may not determine outcomes when digital interventions are based on similar underlying principles, although larger trials are needed to confirm this.
Collapse
Affiliation(s)
- Jake Linardon
- Deakin University; Center for Social and Early Emotional Development, Deakin University.
| | - Adrian Shatte
- Federation University, School of Engineering, Information Technology & Physical Sciences
| | | | | | | |
Collapse
|
13
|
Papini NM, Mason TB, Herrmann SD, Lopez NV. Self-compassion and body image in pregnancy and postpartum: A randomized pilot trial of a brief self-compassion meditation intervention. Body Image 2022; 43:264-274. [PMID: 36206649 DOI: 10.1016/j.bodyim.2022.09.010] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/19/2021] [Revised: 09/13/2022] [Accepted: 09/22/2022] [Indexed: 11/15/2022]
Abstract
The current study evaluated the efficacy of a three-week self-compassion (SC) meditation intervention in improving body image and SC during pregnancy and postpartum. Participants (n = 71; age = 31.92 ± 3.98 years; white = 61, 85.9%; intervention = 35, 49.3%; pregnant = 33, 46.5%; postpartum = 38, 53.5%) were recruited from a health coaching program and 35 were randomly assigned into a three-week SC meditation intervention while 36 were randomly assigned to a waitlist control condition. Linear regressions using full-information maximum likelihood estimation examined the effect of intervention group on body image and SC outcomes controlling for baseline level of outcome, pregnancy or postpartum status, previous meditation experience, and physical activity. Results indicated women in the intervention group reported significantly reduced body shame and body dissatisfaction and improved body appreciation and self-compassion compared to women in the control group. Implementation of a brief SC meditation intervention during pregnancy and postpartum has potential to improve mental health outcomes related to body image. Future work should replicate this study with a larger, more diverse sample of women.
Collapse
Affiliation(s)
- Natalie M Papini
- Northern Arizona University, Department of Health Sciences, Flagstaff, AZ, USA.
| | - Tyler B Mason
- University of Southern California, Department of Preventive Medicine, Los Angeles, CA, USA
| | - Stephen D Herrmann
- University of Kansas Medical Center, Department of Internal Medicine, Kansas City, KS, USA
| | - Nanette V Lopez
- Northern Arizona University, Department of Health Sciences, Flagstaff, AZ, USA
| |
Collapse
|
14
|
Tung K, De La Torre S, El Mistiri M, Braga De Braganca R, Hekler E, Pavel M, Rivera D, Klasnja P, Spruijt-Metz D, Marlin BM. BayesLDM: A Domain-specific Modeling Language for Probabilistic Modeling of Longitudinal Data. ...IEEE...INTERNATIONAL CONFERENCE ON CONNECTED HEALTH: APPLICATIONS, SYSTEMS AND ENGINEERING TECHNOLOGIES. IEEE INTERNATIONAL CONFERENCE ON CONNECTED HEALTH: APPLICATIONS, SYSTEMS AND ENGINEERING TECHNOLOGIES 2022; 2022:78-90. [PMID: 37736024 PMCID: PMC10512697] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Subscribe] [Scholar Register] [Indexed: 09/23/2023]
Abstract
In this paper we present BayesLDM, a library for Bayesian longitudinal data modeling consisting of a high-level modeling language with specific features for modeling complex multivariate time series data coupled with a compiler that can produce optimized probabilistic program code for performing inference in the specified model. BayesLDM supports modeling of Bayesian network models with a specific focus on the efficient, declarative specification of dynamic Bayesian Networks (DBNs). The BayesLDM compiler combines a model specification with inspection of available data and outputs code for performing Bayesian inference for unknown model parameters while simultaneously handling missing data. These capabilities have the potential to significantly accelerate iterative modeling workflows in domains that involve the analysis of complex longitudinal data by abstracting away the process of producing computationally efficient probabilistic inference code. We describe the BayesLDM system components, evaluate the efficiency of representation and inference optimizations and provide an illustrative example of the application of the system to analyzing heterogeneous and partially observed mobile health data.
Collapse
Affiliation(s)
- Karine Tung
- University of Massachusetts Amherst, Amherst, MA, USA
| | | | | | | | - Eric Hekler
- University of California San Diego, San Diego, CA, USA
| | | | | | | | | | | |
Collapse
|
15
|
Hirshberg MJ, Frye C, Dahl CJ, Riordan KM, Vack NJ, Sachs J, Goldman R, Davidson RJ, Goldberg SB. A Randomized Controlled Trial of a Smartphone-Based Well-Being Training in Public School System Employees During the COVID-19 Pandemic. JOURNAL OF EDUCATIONAL PSYCHOLOGY 2022; 114:1895-1911. [PMID: 36387982 PMCID: PMC9642982 DOI: 10.1037/edu0000739] [Citation(s) in RCA: 17] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2023]
Abstract
While the extraordinary pressures of the COVID-19 pandemic on student mental health have received considerable attention, less attention has been placed on educator well-being. School system employees play a vital role in society, and teacher levels of well-being are associated with the educational outcomes of young people. We extend extant research on the prevalence and correlates of educator distress during the pandemic by reporting on a pragmatic randomized wait-list controlled trial (N=662; 64% teachers) of an innovative mental health promotion strategy implemented during the pandemic; a free four-week smartphone-based meditation app designed to train key constituents of well-being (Healthy Minds Program; HMP). Following our preregistered analysis plan and consistent with hypotheses, assignment to the HMP predicted significantly larger reductions in psychological distress, our primary outcome, at post-intervention (Cohen's d=-0.52, 95% confidence interval [-0.68, -0.37], p<.001) and at the three-month follow-up (d=-0.33 [-0.48, -0.18], p<.001). Also consistent with hypotheses, we observed similar indications of immediate and sustained benefit following the HMP on all six preregistered secondary outcomes selected to tap skills targeted in the app (e.g., perseverative thinking, social connection, well-being; absolute ds=0.19-0.42, all ps<.031 corrected except mindful action at follow-up). We found no evidence for elevated adverse events and the HMP was equally effective among participants with elevated baseline anxiety and depressive symptoms. These data suggest that the HMP may be an effective and scalable approach to supporting the mental health and well-being of teachers and other school system employees, with implications for employee retention and performance, and student outcomes.
Collapse
Affiliation(s)
| | - Corrina Frye
- Center for Healthy Minds, University of Wisconsin–Madison
| | - Cortland J. Dahl
- Center for Healthy Minds, University of Wisconsin–Madison
- Healthy Minds Innovations Inc
| | - Kevin M. Riordan
- Center for Healthy Minds, University of Wisconsin–Madison
- Department of Counseling Psychology, University of Wisconsin-Madison
| | - Nathan J. Vack
- Center for Healthy Minds, University of Wisconsin–Madison
| | - Jane Sachs
- Center for Healthy Minds, University of Wisconsin–Madison
| | - Robin Goldman
- Center for Healthy Minds, University of Wisconsin–Madison
| | - Richard J. Davidson
- Center for Healthy Minds, University of Wisconsin–Madison
- Healthy Minds Innovations Inc
| | - Simon B. Goldberg
- Center for Healthy Minds, University of Wisconsin–Madison
- Department of Counseling Psychology, University of Wisconsin-Madison
| |
Collapse
|
16
|
Lam SU, Kirvin-Quamme A, Goldberg SB. Overall and Differential Attrition in Mindfulness-Based Interventions: A Meta-Analysis. Mindfulness (N Y) 2022; 13:2676-2690. [PMID: 36506616 PMCID: PMC9728563 DOI: 10.1007/s12671-022-01970-z] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 08/24/2022] [Indexed: 12/15/2022]
Abstract
Objectives Attrition is very common in longitudinal research, including randomized controlled trials (RCTs) testing psychological interventions. Establishing rates and predictors of attrition in mindfulness-based interventions (MBIs) can assist clinical trialists and intervention developers. Differential attrition in RCTs that compared MBIs with structure and intensity matched active control conditions also provides an objective metric of relative treatment acceptability. Methods We aimed to evaluate rates and predictors of overall and differential attrition in RCTs of MBIs compared with matched active control conditions. Attrition was operationalized as loss to follow-up at post-test. Six online databases were searched. Results Across 114 studies (n = 11,288), weighted mean attrition rate was 19.1% (95% CI [.16, .22]) in MBIs and 18.6% ([.16, .21]) in control conditions. In the primary model, no significant difference was found in attrition between MBIs and controls (i.e., differential attrition; odds ratio [OR] = 1.05, [0.92, 1.19]). However, in sensitivity analyses with trim-and-fill adjustment, without outliers, and when using different estimation methods (Peto and Mantel-Haenszel), MBIs yielded slightly higher attrition (ORs = 1.10 to 1.25, ps < .050). Despite testing numerous moderators of overall and differential attrition, very few significant predictors emerged. Conclusions Results support efforts to increase the acceptability of MBIs, active controls, and/or RCTs, and highlight the possibility that for some individuals, MBIs may be less acceptable than alternative interventions. Further research including individual patient data meta-analysis is warranted to identify predictors of attrition and to characterize instances where MBIs may or may not be recommended. Meta-Analysis Review Registration: Open Science Framework (https://osf.io/c3u7a/).
Collapse
Affiliation(s)
- Sin U Lam
- Department of Counseling Psychology, University of Wisconsin-Madison, Madison, WI, USA
- Center for Healthy Minds, University of Wisconsin-Madison, Madison, WI, USA
| | | | - Simon B. Goldberg
- Department of Counseling Psychology, University of Wisconsin-Madison, Madison, WI, USA
- Center for Healthy Minds, University of Wisconsin-Madison, Madison, WI, USA
| |
Collapse
|
17
|
Staudt A, Freyer-Adam J, Ittermann T, Meyer C, Bischof G, John U, Baumann S. Sensitivity analyses for data missing at random versus missing not at random using latent growth modelling: a practical guide for randomised controlled trials. BMC Med Res Methodol 2022; 22:250. [PMID: 36153489 PMCID: PMC9508724 DOI: 10.1186/s12874-022-01727-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2022] [Accepted: 09/13/2022] [Indexed: 12/02/2022] Open
Abstract
BACKGROUND Missing data are ubiquitous in randomised controlled trials. Although sensitivity analyses for different missing data mechanisms (missing at random vs. missing not at random) are widely recommended, they are rarely conducted in practice. The aim of the present study was to demonstrate sensitivity analyses for different assumptions regarding the missing data mechanism for randomised controlled trials using latent growth modelling (LGM). METHODS Data from a randomised controlled brief alcohol intervention trial was used. The sample included 1646 adults (56% female; mean age = 31.0 years) from the general population who had received up to three individualized alcohol feedback letters or assessment-only. Follow-up interviews were conducted after 12 and 36 months via telephone. The main outcome for the analysis was change in alcohol use over time. A three-step LGM approach was used. First, evidence about the process that generated the missing data was accumulated by analysing the extent of missing values in both study conditions, missing data patterns, and baseline variables that predicted participation in the two follow-up assessments using logistic regression. Second, growth models were calculated to analyse intervention effects over time. These models assumed that data were missing at random and applied full-information maximum likelihood estimation. Third, the findings were safeguarded by incorporating model components to account for the possibility that data were missing not at random. For that purpose, Diggle-Kenward selection, Wu-Carroll shared parameter and pattern mixture models were implemented. RESULTS Although the true data generating process remained unknown, the evidence was unequivocal: both the intervention and control group reduced their alcohol use over time, but no significant group differences emerged. There was no clear evidence for intervention efficacy, neither in the growth models that assumed the missing data to be at random nor those that assumed the missing data to be not at random. CONCLUSION The illustrated approach allows the assessment of how sensitive conclusions about the efficacy of an intervention are to different assumptions regarding the missing data mechanism. For researchers familiar with LGM, it is a valuable statistical supplement to safeguard their findings against the possibility of nonignorable missingness. TRIAL REGISTRATION The PRINT trial was prospectively registered at the German Clinical Trials Register (DRKS00014274, date of registration: 12th March 2018).
Collapse
Affiliation(s)
- Andreas Staudt
- Department of Methods in Community Medicine, Institute of Community Medicine, University Medicine Greifswald, Walther-Rathenau-Str. 48, 17475 Greifswald, Germany
- Institute and Policlinic of Occupational and Social Medicine, Faculty of Medicine, TU Dresden, Fetscherstr. 74, 01307 Dresden, Germany
| | - Jennis Freyer-Adam
- Institute for Medical Psychology, University Medicine Greifswald, Walther-Rathenau-Str. 48, 17475 Greifswald, Germany
- German Centre for Cardiovascular Research (DZHK), Partner site Greifswald, Fleischmannstr. 8, 17475 Greifswald, Germany
| | - Till Ittermann
- Department SHIP-KEF, Institute of Community Medicine, University Medicine Greifswald, Walther-Rathenau-Str. 48, 17475 Greifswald, Germany
| | - Christian Meyer
- German Centre for Cardiovascular Research (DZHK), Partner site Greifswald, Fleischmannstr. 8, 17475 Greifswald, Germany
- Department of Prevention Research and Social Medicine, Institute of Community Medicine, University Medicine Greifswald, Walther-Rathenau-Str. 48, 17475 Greifswald, Germany
| | - Gallus Bischof
- Department of Psychiatry and Psychotherapy, University of Lübeck, Ratzeburger Allee 160, 23538 Lübeck, Germany
| | - Ulrich John
- German Centre for Cardiovascular Research (DZHK), Partner site Greifswald, Fleischmannstr. 8, 17475 Greifswald, Germany
- Department of Prevention Research and Social Medicine, Institute of Community Medicine, University Medicine Greifswald, Walther-Rathenau-Str. 48, 17475 Greifswald, Germany
| | - Sophie Baumann
- Department of Methods in Community Medicine, Institute of Community Medicine, University Medicine Greifswald, Walther-Rathenau-Str. 48, 17475 Greifswald, Germany
| |
Collapse
|
18
|
Hirshberg MJ, Colaianne BA, Greenberg MT, Inkelas KK, Davidson RJ, Germano D, Dunne JD, Roeser RW. Can the Academic and Experiential Study of Flourishing Improve Flourishing in College Students? A Multi-University Study. Mindfulness (N Y) 2022; 13:2243-2256. [PMID: 36405632 PMCID: PMC9667904 DOI: 10.1007/s12671-022-01952-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 07/14/2022] [Indexed: 10/16/2022]
Abstract
Objectives Significant concerns have been raised about the "mental health crisis" on college campuses, with attention turning to what colleges can do beyond counseling services to address students' mental health and well-being. We examined whether primarily first-year (89.1%) undergraduate students (n=651) who enrolled in the Art and Science of Human Flourishing (ASHF), a novel academic and experiential for-credit elective course on human flourishing, would demonstrate improved mental health and strengthen skills, perspectives, and behaviors associated with flourishing relative to students who did not enroll in this course. Methods In a two-wave, multi-site, propensity-score matched controlled trial (ASHF n=217, Control n=434; N=651), we used hierarchal linear models and false discovery rate corrected doubly robust estimates to evaluate the impact of the ASHF on attention and social-emotional skill development, flourishing perspectives, mental health, health, and risk behavior outcomes. Results ASHF participants reported significantly improved mental health (i.e., reduced depression) and flourishing, improvements on multiple attention and social-emotional skills (e.g., attention function, self-compassion), and increases in prosocial attitudes (empathic concern, shared humanity; Cohen's ds= 0.18-0.46) compared to controls. There was no evidence for ASHF course impacts on health or risk behaviors, raising the possibility that these outcomes take more time to change. Conclusions This research provides initial evidence that the ASHF course may be a promising curricular approach to reduce and potentially prevent poor mental health while promoting flourishing in college students. Continued research is needed to confirm these conclusions.
Collapse
Affiliation(s)
- Matthew J. Hirshberg
- Center for Healthy Minds, University of Wisconsin–Madison, 625 W. Washington Ave., Madison, Wisconsin USA 53703
| | - Blake A. Colaianne
- The Pennsylvania State University, Human Development and Family Studies, HHD Building, University Park, Pennsylvania USA 16801
| | - Mark T. Greenberg
- The Pennsylvania State University, Human Development and Family Studies, HHD Building, University Park, Pennsylvania USA 16801
| | - Karen Kurotsuchi Inkelas
- University of Virginia, School of Education and Human Development, 405 Emmet St S, Charlottesville, Virginia USA 22904
- Contemplative Science Center, University of Virginia, 102 Cresap Rd, Charlottesville, Virginia USA 22903
| | - Richard J. Davidson
- Center for Healthy Minds, University of Wisconsin–Madison, 625 W. Washington Ave., Madison, Wisconsin USA 53703
| | - David Germano
- Contemplative Science Center, University of Virginia, 102 Cresap Rd, Charlottesville, Virginia USA 22903
| | - John D. Dunne
- Center for Healthy Minds, University of Wisconsin–Madison, 625 W. Washington Ave., Madison, Wisconsin USA 53703
| | - Robert W. Roeser
- The Pennsylvania State University, Human Development and Family Studies, HHD Building, University Park, Pennsylvania USA 16801
| |
Collapse
|
19
|
Abstract
BACKGROUND Smartphones can facilitate patients completing surveys and collecting sensor data to gain insight into their mental health conditions. However, the utility of sensor data is still being explored. Prior studies have reported a wide range of correlations between passive data and survey scores. AIMS To explore correlations in a large data-set collected with the mindLAMP app. Additionally, we explored whether passive data features could be used in models to predict survey results. METHOD Participants were asked to complete daily and weekly mental health surveys. After screening for data quality, our sample included 147 college student participants and 270 weeks of data. We examined correlations between six weekly surveys and 13 metrics derived from passive data features. Finally, we trained logistic regression models to predict survey scores from passive data with and without daily surveys. RESULTS Similar to other large studies, our correlations were lower than prior reports from smaller studies. We found that the most useful features came from GPS, call, and sleep duration data. Logistic regression models performed poorly with only passive data, but when daily survey scores were included, performance greatly increased. CONCLUSIONS Although passive data alone may not provide enough information to predict survey scores, augmenting this data with short daily surveys can improve performance. Therefore, it may be that passive data can be used to refine survey score predictions and clinical utility may be derived from the combination of active and passive data.
Collapse
Affiliation(s)
- Danielle Currey
- Division of Digital Psychiatry, Beth Israel Deaconess Medical Center, Harvard Medical School, Massachusetts, USA
| | - John Torous
- Division of Digital Psychiatry, Beth Israel Deaconess Medical Center, Harvard Medical School, Massachusetts, USA
| |
Collapse
|