1
|
Henry TR, Slipetz LR, Falk A, Qiu J, Chen M. Ordinal Outcome State-Space Models for Intensive Longitudinal Data. PSYCHOMETRIKA 2024:10.1007/s11336-024-09984-3. [PMID: 38861220 DOI: 10.1007/s11336-024-09984-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/30/2023] [Accepted: 05/30/2024] [Indexed: 06/12/2024]
Abstract
Intensive longitudinal (IL) data are increasingly prevalent in psychological science, coinciding with technological advancements that make it simple to deploy study designs such as daily diary and ecological momentary assessments. IL data are characterized by a rapid rate of data collection (1+ collections per day), over a period of time, allowing for the capture of the dynamics that underlie psychological and behavioral processes. One powerful framework for analyzing IL data is state-space modeling, where observed variables are considered measurements for underlying states (i.e., latent variables) that change together over time. However, state-space modeling has typically relied on continuous measurements, whereas psychological data often come in the form of ordinal measurements such as Likert scale items. In this manuscript, we develop a general estimation approach for state-space models with ordinal measurements, specifically focusing on a graded response model for Likert scale items. We evaluate the performance of our model and estimator against that of the commonly used "linear approximation" model, which treats ordinal measurements as though they are continuous. We find that our model resulted in unbiased estimates of the state dynamics, while the linear approximation resulted in strongly biased estimates of the state dynamics. Finally, we develop an approximate standard error, termed slice standard errors and show that these approximate standard errors are more liberal than true standard errors (i.e., smaller) at a consistent bias.
Collapse
Affiliation(s)
- Teague R Henry
- Department of Psychology and School of Data Science, University of Virginia, Charlottesville, USA.
| | - Lindley R Slipetz
- Department of Psychology, University of Virginia, Charlottesville, USA
| | - Ami Falk
- Department of Psychology, University of Virginia, Charlottesville, USA
| | - Jiaxing Qiu
- School of Data Science, University of Virginia, Charlottesville, USA
| | - Meng Chen
- Health Sciences Center, University of Oklahoma, Charlottesville, USA
| |
Collapse
|
2
|
Ulm C, Chen S, Fleshman B, Benson L, Kendzor DE, Frank-Pearce S, Neil JM, Vidrine D, Businelle MS. Smartphone-Based Survey and Message Compliance in Adults Initially Unready to Quit Smoking: Secondary Analysis of a Randomized Controlled Trial. JMIR Form Res 2024; 8:e56003. [PMID: 38848557 PMCID: PMC11193076 DOI: 10.2196/56003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2024] [Revised: 04/04/2024] [Accepted: 04/29/2024] [Indexed: 06/09/2024] Open
Abstract
BACKGROUND Efficacy of smartphone-based interventions depends on intervention content quality and level of exposure to that content. Smartphone-based survey completion rates tend to decline over time; however, few studies have identified variables that predict this decline over longer-term interventions (eg, 26 weeks). OBJECTIVE This study aims to identify predictors of survey completion and message viewing over time within a 26-week smoking cessation trial. METHODS This study examined data from a 3-group pilot randomized controlled trial of adults who smoke (N=152) and were not ready to quit smoking within the next 30 days. For 182 days, two intervention groups received smartphone-based morning and evening messages based on current readiness to quit smoking. The control group received 2 daily messages unrelated to smoking. All participants were prompted to complete 26 weekly smartphone-based surveys that assessed smoking behavior, quit attempts, and readiness to quit. Compliance was operationalized as percentages of weekly surveys completed and daily messages viewed. Linear regression and mixed-effects models were used to identify predictors (eg, intervention group, age, and sex) of weekly survey completion and daily message viewing and decline in compliance over time. RESULTS The sample (mean age 50, SD 12.5, range 19-75 years; mean years of education 13.3, SD 1.6, range 10-20 years) was 67.8% (n=103) female, 74.3% (n=113) White, 77% (n=117) urban, and 52.6% (n=80) unemployed, and 61.2% (n=93) had mental health diagnoses. On average, participants completed 18.3 (71.8%) out of 25.5 prompted weekly surveys and viewed 207.3 (60.6%) out of 345.1 presented messages (31,503/52,460 total). Age was positively associated with overall weekly survey completion (P=.003) and daily message viewing (P=.02). Mixed-effects models indicated a decline in survey completion from 77% (114/148) in the first week of the intervention to 56% (84/150) in the last week of the intervention (P<.001), which was significantly moderated by age, sex, ethnicity, municipality (ie, rural/urban), and employment status. Similarly, message viewing declined from 72.3% (1533/2120) in the first week of the intervention to 44.6% (868/1946) in the last week of the intervention (P<.001). This decline in message viewing was significantly moderated by age, sex, municipality, employment status, and education. CONCLUSIONS This study demonstrated the feasibility of a 26-week smartphone-based smoking cessation intervention. Study results identified subgroups that displayed accelerated rates in the decline of survey completion and message viewing. Future research should identify ways to maintain high levels of interaction with mobile health interventions that span long intervention periods, especially among subgroups that have demonstrated declining rates of intervention engagement over time. TRIAL REGISTRATION ClinicalTrials.gov NCT03405129; https://clinicaltrials.gov/ct2/show/NCT03405129.
Collapse
Affiliation(s)
- Clayton Ulm
- Department of Health Behavior, Gillings School of Global Public Health, University of North Carolina at Chapel Hill, Chapel Hill, NC, United States
- TSET Health Promotion Research Center, Stephenson Cancer Center, University of Oklahoma Heatlh Sciences Center, Oklahoma City, OK, United States
| | - Sixia Chen
- Department of Biostatistics and Epidemiology, Hudson College of Public Health, The University of Oklahoma Health Sciences Center, Oklahoma City, OK, United States
| | - Brianna Fleshman
- TSET Health Promotion Research Center, Stephenson Cancer Center, University of Oklahoma Heatlh Sciences Center, Oklahoma City, OK, United States
| | - Lizbeth Benson
- TSET Health Promotion Research Center, Stephenson Cancer Center, University of Oklahoma Heatlh Sciences Center, Oklahoma City, OK, United States
| | - Darla E Kendzor
- TSET Health Promotion Research Center, Stephenson Cancer Center, University of Oklahoma Heatlh Sciences Center, Oklahoma City, OK, United States
- Department of Family and Preventive Medicine, University of Oklahoma Health Sciences Center, Oklahoma City, OK, United States
| | - Summer Frank-Pearce
- TSET Health Promotion Research Center, Stephenson Cancer Center, University of Oklahoma Heatlh Sciences Center, Oklahoma City, OK, United States
- Department of Biostatistics and Epidemiology, Hudson College of Public Health, The University of Oklahoma Health Sciences Center, Oklahoma City, OK, United States
| | - Jordan M Neil
- TSET Health Promotion Research Center, Stephenson Cancer Center, University of Oklahoma Heatlh Sciences Center, Oklahoma City, OK, United States
- Department of Family and Preventive Medicine, University of Oklahoma Health Sciences Center, Oklahoma City, OK, United States
| | - Damon Vidrine
- Department of Health Outcomes and Behavior, Moffitt Cancer Center, Tampa, FL, United States
| | - Michael S Businelle
- TSET Health Promotion Research Center, Stephenson Cancer Center, University of Oklahoma Heatlh Sciences Center, Oklahoma City, OK, United States
- Department of Family and Preventive Medicine, University of Oklahoma Health Sciences Center, Oklahoma City, OK, United States
| |
Collapse
|
3
|
Rutter LA, ten Thij M, Lorenzo-Luaces L, Valdez D, Bollen J. Negative affect variability differs between anxiety and depression on social media. PLoS One 2024; 19:e0272107. [PMID: 38381769 PMCID: PMC10881019 DOI: 10.1371/journal.pone.0272107] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2022] [Accepted: 10/23/2023] [Indexed: 02/23/2024] Open
Abstract
OBJECTIVE Negative affect variability is associated with increased symptoms of internalizing psychopathology (i.e., depression, anxiety). The Contrast Avoidance Model (CAM) suggests that individuals with anxiety avoid negative emotional shifts by maintaining pathological worry. Recent evidence also suggests that the CAM can be applied to major depression and social phobia, both characterized by negative affect changes. Here, we compare negative affect variability between individuals with a variety of anxiety and depression diagnoses by measuring the levels and degree of change in the sentiment of their online communications. METHOD Participants were 1,853 individuals on Twitter who reported that they had been clinically diagnosed with an anxiety disorder (A cohort, n = 896) or a depressive disorder (D cohort, n = 957). Mean negative affect (NA) and negative affect variability were calculated using the Valence Aware Dictionary for Sentiment Reasoning (VADER), an accurate sentiment analysis tool that scores text in terms of its negative affect content. RESULTS Findings showed differences in negative affect variability between the D and A cohort, with higher levels of NA variability in the D cohort than the A cohort, U = 367210, p < .001, r = 0.14, d = 0.25. Furthermore, we found that A and D cohorts had different average NA, with the D cohort showing higher NA overall, U = 377368, p < .001, r = 0.12, d = 0.21. LIMITATIONS Our sample is limited to individuals who disclosed their diagnoses online, which may involve bias due to self-selection and stigma. Our sentiment analysis of online text may not completely capture all nuances of individual affect. CONCLUSIONS Individuals with depression diagnoses showed a higher degree of negative affect variability compared to individuals with anxiety disorders. Our findings support the idea that negative affect variability can be measured using computational approaches on large-scale social media data and that social media data can be used to study naturally occurring mental health effects at scale.
Collapse
Affiliation(s)
- Lauren A. Rutter
- Center for Social and Biomedical Complexity, Indiana University Bloomington, Bloomington, IN, United States of America
- Department of Psychological and Brain Sciences, Indiana University Bloomington, Bloomington, IN, United States of America
| | - Marijn ten Thij
- Center for Social and Biomedical Complexity, Indiana University Bloomington, Bloomington, IN, United States of America
- Department of Advanced Computing Sciences, Maastricht University, Maastricht, NL, United States of America
- Luddy School of Informatics, Computing, and Engineering, Indiana University Bloomington, Bloomington, IN, United States of America
| | - Lorenzo Lorenzo-Luaces
- Center for Social and Biomedical Complexity, Indiana University Bloomington, Bloomington, IN, United States of America
- Department of Psychological and Brain Sciences, Indiana University Bloomington, Bloomington, IN, United States of America
| | - Danny Valdez
- Center for Social and Biomedical Complexity, Indiana University Bloomington, Bloomington, IN, United States of America
- Department of Applied Health Science, School of Public Health, Indiana University Bloomington, Bloomington, IN, United States of America
| | - Johan Bollen
- Center for Social and Biomedical Complexity, Indiana University Bloomington, Bloomington, IN, United States of America
- Luddy School of Informatics, Computing, and Engineering, Indiana University Bloomington, Bloomington, IN, United States of America
| |
Collapse
|
4
|
Yang M, Schick MR, Sullivan TP, Weiss NH. Predicting Completion of Ecological Momentary Assessments Among Substance-Using Women Experiencing Intimate Partner Violence. Assessment 2024:10731911231216948. [PMID: 38174693 DOI: 10.1177/10731911231216948] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/05/2024]
Abstract
Noncompletion of ecological momentary assessment (EMA) surveys is a common issue and may yield bias in results if not properly handled. Using data observed at scheduled times as well as data retrieved later to fill missing responses, this study aims to investigate predictors of EMA completion, including demographic characteristics, time-related factors, and momentary experiences/behaviors. Data were from a 30-day EMA study including 145 women currently experiencing intimate partner violence (IPV) and using substances. The average rate of EMA completion was initially 51.4% at the scheduled times and increased to 72.6% after incorporating data from later-retrieved surveys. Participants who were younger, had more children, or had lower mean levels of negative affect dysregulation showed lower completion rates. At the momentary survey level, more days into the study and afternoon/evening reports (vs. morning reports) were associated with lower completion; lower levels of negative affect dysregulation, less smoking or alcohol use, and experiencing IPV were linked to lower momentary completion. Implications of the results for handling missing data in EMA are discussed and have important ramifications for future research, practice, and theory.
Collapse
|
5
|
Liu C, Chen H, Zhang A, Gong X, Wu K, Liu CY, Chiou WK. The effects of short video app-guided loving-kindness meditation on college students' mindfulness, self-compassion, positive psychological capital, and suicide ideation. PSICOLOGIA-REFLEXAO E CRITICA 2023; 36:32. [PMID: 37902928 PMCID: PMC10616025 DOI: 10.1186/s41155-023-00276-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2023] [Accepted: 10/18/2023] [Indexed: 11/01/2023] Open
Abstract
OBJECTIVE The study investigated the effects of a short video app guided loving-kindness meditation (LKM) on college students' mindfulness, self-compassion, positive psychological capital, and suicide ideation. The purpose of the study is to investigate the intervention effect of LKM training on suicidal ideation among college students with the help of the short video application and to provide an empirical basis for the exploration of early suicide intervention strategies for college students. METHODS We recruited 80 college students from a university in China. The final 74 eligible participants were divided into two groups: app use group (n = 37) and the control group (n = 37). The app group accepted an 8-week app use interference, while the control group underwent no interference. We measured four major variable factors (mindfulness, self-compassion, positive psychological capital, and suicide ideation) before and after the app use intervention. RESULTS In the app group, self-compassion and positive psychological capital were significantly higher, and suicide ideation was significantly lower than the control group. In the control group, there were no noticeable differences in any of the four variables between the pre-test and post-test. CONCLUSIONS Our findings demonstrate that the short video app guided LKM may help to improve self-compassion, and positive psychological capital, and reduce suicide ideation. The finding of the short video app-guided LKM's effect extends our understanding of the integrative effects of positive psychology and digital media on the reduction of suicide ideation.
Collapse
Affiliation(s)
- Chao Liu
- School of Journalism and Communication, Hua Qiao University, Xiamen, 361021, China
- Business Analytics Research Center, Chang Gung University, Taoyuan, 33302, Taiwan
| | - Hao Chen
- Business Analytics Research Center, Chang Gung University, Taoyuan, 33302, Taiwan
- School of Film Television & Communication, Xiamen University of Technology, Xiamen, China
| | - Ayuan Zhang
- Teachers College, Beijing Union University, Beijing, 100101, China
| | - XiaoGang Gong
- College of Special Education, Beijing, 100101, China
| | - Kan Wu
- Business Analytics Research Center, Chang Gung University, Taoyuan, 33302, Taiwan
| | - Chia-Yih Liu
- Department of Psychiatry, Chang Gung Memorial Hospital, Taoyuan, Taiwan
| | - Wen-Ko Chiou
- Department of Psychiatry, Chang Gung Memorial Hospital, Taoyuan, Taiwan.
- Department of Industrial Engineering and Management, Ming Chi University of Technology, New Taipei, Taiwan.
- Department of Industrial Design, Chang Gung University, Taoyuan, Taiwan.
| |
Collapse
|
6
|
Dauber S, Beacham A, West A, Devkota J, Barrie K, Thrul J. Ecological Momentary Assessment of Heavy Episodic Drinking in the Early Postpartum Period: A Feasibility Study. DRUG AND ALCOHOL DEPENDENCE REPORTS 2023; 7:100146. [PMID: 37012980 PMCID: PMC10066518 DOI: 10.1016/j.dadr.2023.100146] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/22/2022] [Revised: 03/14/2023] [Accepted: 03/14/2023] [Indexed: 03/18/2023]
Abstract
Background Postpartum mothers are at heightened risk for heavy episodic drinking (HED). Research with this population is critical to developing acceptable and effective tailored interventions, but new mothers who use alcohol are often reluctant to engage in research due to stigma and fear of child removal. This study examined feasibility of recruitment and ecological momentary assessment (EMA) in early postpartum mothers with histories of HED. Methods Participants were recruited via Facebook and Reddit and completed 14 days of EMA surveys. Baseline characteristics, recruitment feasibility, and EMA feasibility and acceptability were examined. Participants attended focus groups to further inform quantitative data. Results Reddit yielded a larger proportion of eligible individuals than Facebook, and 86% of the final enroled sample was recruited via Reddit. The average compliance rate of 75% is in line with other studies of similar populations. Half the sample reported alcohol use, and 78% reported the urge to drink at least once, supporting feasibility of EMA for collecting alcohol use data. Participants reported low burden and high acceptability of the study on both quantitative and qualitative measures. Baseline low maternal self-efficacy was associated with greater EMA compliance, and first-time mothers reported lower EMA burden compared to veteran mothers. College graduates, and participants with lower drinking refusal self-efficacy and greater alcohol severity were more likely to report alcohol use on EMA. Conclusions Future studies should consider Reddit as a recruitment strategy. Findings generally support feasibility and acceptability of EMA to assess HED in postpartum mothers.
Collapse
Affiliation(s)
- Sarah Dauber
- Partnership to End Addiction, 711 Third Avenue, 5th floor, New York, NY 10017, USA
- Corresponding author.
| | - Alexa Beacham
- Partnership to End Addiction, 711 Third Avenue, 5th floor, New York, NY 10017, USA
| | - Allison West
- Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA
| | - Janardan Devkota
- Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA
| | - Kadjatu Barrie
- Partnership to End Addiction, 711 Third Avenue, 5th floor, New York, NY 10017, USA
| | - Johannes Thrul
- Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA
- Sidney Kimmel Comprehensive Cancer Center at Johns Hopkins, Baltimore, MD, USA
- Centre for Alcohol Policy Research, La Trobe University, Melbourne, Australia
| |
Collapse
|