1
|
Langener AM, Siepe BS, Elsherif M, Niemeijer K, Andresen PK, Akre S, Bringmann LF, Cohen ZD, Choukas NR, Drexl K, Fassi L, Green J, Hoffmann T, Jagesar RR, Kas MJH, Kurten S, Schoedel R, Stulp G, Turner G, Jacobson NC. A template and tutorial for preregistering studies using passive smartphone measures. Behav Res Methods 2024; 56:8289-8307. [PMID: 39112740 PMCID: PMC11525430 DOI: 10.3758/s13428-024-02474-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/26/2024] [Indexed: 09/05/2024]
Abstract
Passive smartphone measures hold significant potential and are increasingly employed in psychological and biomedical research to capture an individual's behavior. These measures involve the near-continuous and unobtrusive collection of data from smartphones without requiring active input from participants. For example, GPS sensors are used to determine the (social) context of a person, and accelerometers to measure movement. However, utilizing passive smartphone measures presents methodological challenges during data collection and analysis. Researchers must make multiple decisions when working with such measures, which can result in different conclusions. Unfortunately, the transparency of these decision-making processes is often lacking. The implementation of open science practices is only beginning to emerge in digital phenotyping studies and varies widely across studies. Well-intentioned researchers may fail to report on some decisions due to the variety of choices that must be made. To address this issue and enhance reproducibility in digital phenotyping studies, we propose the adoption of preregistration as a way forward. Although there have been some attempts to preregister digital phenotyping studies, a template for registering such studies is currently missing. This could be problematic due to the high level of complexity that requires a well-structured template. Therefore, our objective was to develop a preregistration template that is easy to use and understandable for researchers. Additionally, we explain this template and provide resources to assist researchers in making informed decisions regarding data collection, cleaning, and analysis. Overall, we aim to make researchers' choices explicit, enhance transparency, and elevate the standards for studies utilizing passive smartphone measures.
Collapse
Affiliation(s)
- Anna M Langener
- Groningen Institute for Evolutionary Life Sciences, University of Groningen, Groningen, The Netherlands.
- Department of Psychometrics and Statistics, Faculty of Behavioural and Social Sciences, University of Groningen, Groningen, The Netherlands.
- Faculty of Science and Engineering, Nijenborgh 7, 9747 AG, Groningen, The Netherlands.
| | - Björn S Siepe
- Psychological Methods Lab, Department of Psychology, University of Marburg, Marburg, Germany
| | - Mahmoud Elsherif
- Department of Psychology, University of Birmingham, Birmingham, UK
| | - Koen Niemeijer
- Faculty of Psychology and Educational Sciences, KU Leuven, Louvain, Belgium
| | - Pia K Andresen
- Department for Methodology and Statistics, Utrecht University, Utrecht, The Netherlands
| | - Samir Akre
- Medical Informatics Home Area, University of California, Los Angeles, CA, USA
| | - Laura F Bringmann
- Department of Psychometrics and Statistics, Faculty of Behavioural and Social Sciences, University of Groningen, Groningen, The Netherlands
- Interdisciplinary Center Psychopathology and Emotion Regulation, (ICPE), University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Zachary D Cohen
- Department of Psychology, University of Arizona, Tucson, AZ, USA
| | | | - Konstantin Drexl
- Division of Child and Adolescent Psychiatry, Department of Psychiatry, Lausanne University Hospital, Lausanne, Switzerland
| | - Luisa Fassi
- School of Clinical Medicine, University of Cambridge, Cambridge, UK
| | - James Green
- School of Allied Health, Physical Activity for Health Research Centre, Health Research Institute, University of Limerick, Limerick, Ireland
| | - Tabea Hoffmann
- Department of Marketing, Faculty of Economics and Business, University of Groningen, Groningen, The Netherlands
- Department of Planning, Faculty of Spatial Sciences, University of Groningen, Groningen, The Netherlands
| | - Raj R Jagesar
- Groningen Institute for Evolutionary Life Sciences, University of Groningen, Groningen, The Netherlands
| | - Martien J H Kas
- Groningen Institute for Evolutionary Life Sciences, University of Groningen, Groningen, The Netherlands
| | - Sebastian Kurten
- School of Clinical Medicine, University of Cambridge, Cambridge, UK
- Department of Interdisciplinary Social Science, Utrecht University, Utrecht, The Netherlands
| | - Ramona Schoedel
- Charlotte Fresenius Hochschule, University of Psychology, Munich, Germany
- Department of Psychology, Ludwig-Maximilians-Universität München, Munich, Germany
| | - Gert Stulp
- Department of Sociology & Inter-University Center for Social Science Theory and Methodology, Grote Rozenstraat 31, 9712 TS, Groningen, The Netherlands
| | - Georgia Turner
- School of Clinical Medicine, University of Cambridge, Cambridge, UK
| | - Nicholas C Jacobson
- Department of Sociology & Inter-University Center for Social Science Theory and Methodology, Grote Rozenstraat 31, 9712 TS, Groningen, The Netherlands
- Center for Technology and Behavioral Health, Geisel School of Medicine, Dartmouth College, Lebanon, NH, USA
- Department of Psychiatry, Geisel School of Medicine, Dartmouth College, Lebanon, NH, USA
- Department of Computer Science, Dartmouth College, Lebanon, NH, USA
| |
Collapse
|
2
|
Langener AM, Bringmann LF, Kas MJ, Stulp G. Predicting Mood Based on the Social Context Measured Through the Experience Sampling Method, Digital Phenotyping, and Social Networks. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2024; 51:455-475. [PMID: 38200262 PMCID: PMC11196304 DOI: 10.1007/s10488-023-01328-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/22/2023] [Indexed: 01/12/2024]
Abstract
Social interactions are essential for well-being. Therefore, researchers increasingly attempt to capture an individual's social context to predict well-being, including mood. Different tools are used to measure various aspects of the social context. Digital phenotyping is a commonly used technology to assess a person's social behavior objectively. The experience sampling method (ESM) can capture the subjective perception of specific interactions. Lastly, egocentric networks are often used to measure specific relationship characteristics. These different methods capture different aspects of the social context over different time scales that are related to well-being, and combining them may be necessary to improve the prediction of well-being. Yet, they have rarely been combined in previous research. To address this gap, our study investigates the predictive accuracy of mood based on the social context. We collected intensive within-person data from multiple passive and self-report sources over a 28-day period in a student sample (Participants: N = 11, ESM measures: N = 1313). We trained individualized random forest machine learning models, using different predictors included in each model summarized over different time scales. Our findings revealed that even when combining social interactions data using different methods, predictive accuracy of mood remained low. The average coefficient of determination over all participants was 0.06 for positive and negative affect and ranged from - 0.08 to 0.3, indicating a large amount of variance across people. Furthermore, the optimal set of predictors varied across participants; however, predicting mood using all predictors generally yielded the best predictions. While combining different predictors improved predictive accuracy of mood for most participants, our study highlights the need for further work using larger and more diverse samples to enhance the clinical utility of these predictive modeling approaches.
Collapse
Affiliation(s)
- Anna M Langener
- Groningen Institute for Evolutionary Life Sciences, University of Groningen, Groningen, The Netherlands.
- Department of Psychometrics and Statistics, Faculty of Behavioural and Social Sciences, University of Groningen, Groningen, The Netherlands.
- Faculty of Science and Engineering, Nijenborgh 7, 9747 AG, Groningen, The Netherlands.
| | - Laura F Bringmann
- Department of Psychometrics and Statistics, Faculty of Behavioural and Social Sciences, University of Groningen, Groningen, The Netherlands
- Interdisciplinary Center Psychopathology and Emotion Regulation, (ICPE), University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Martien J Kas
- Groningen Institute for Evolutionary Life Sciences, University of Groningen, Groningen, The Netherlands
| | - Gert Stulp
- Department of Sociology & Inter-University Center for Social Science Theory and Methodology, Grote Rozenstraat 31, 9712 TS, Groningen, The Netherlands
| |
Collapse
|
3
|
Stadel M, Stulp G, Langener AM, Elmer T, van Duijn MAJ, Bringmann LF. Feedback About a Person's Social Context - Personal Networks and Daily Social Interactions. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2024; 51:476-489. [PMID: 37615808 PMCID: PMC11196300 DOI: 10.1007/s10488-023-01293-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/02/2023] [Indexed: 08/25/2023]
Abstract
The social context of a person, meaning their social relationships and daily social interactions, is an important factor for understanding their mental health. However, personalised feedback approaches to psychotherapy do not consider this factor sufficiently yet. Therefore, we developed an interactive feedback prototype focusing specifically on a person's social relationships as captured with personal social networks (PSN) and daily social interactions as captured with experience sampling methodology (ESM). We describe the development of the prototype as well as two evaluation studies: Semi-structured interviews with students (N = 23) and a focus group discussion with five psychotherapy patients. Participants from both studies considered the prototype useful. The students considered participation in our study, which included social context assessment via PSN and ESM as well as a feedback session, insightful. However, it remains unclear how much insight the feedback procedure generated for the students beyond the insights they already gained from the assessments. The focus group patients indicated that in a clinical context, (social context) feedback may be especially useful to generate insight for the clinician and facilitate collaboration between patient and clinician. Furthermore, it became clear that the current feedback prototype requires explanations by a researcher or trained clinician and cannot function as a stand-alone intervention. As such, we discuss our feedback prototype as a starting point for future research and clinical implementation.
Collapse
Affiliation(s)
- Marie Stadel
- Department of Sociology, University of Groningen, Groningen, The Netherlands.
- Department of Psychometrics and Statistics, University of Groningen, Groningen, The Netherlands.
| | - Gert Stulp
- Department of Sociology, University of Groningen, Groningen, The Netherlands
- Inter-University Center for Social Science Theory and Methodology, University of Groningen, Groningen, the Netherlands
| | - Anna M Langener
- Department of Sociology, University of Groningen, Groningen, The Netherlands
- Department of Psychometrics and Statistics, University of Groningen, Groningen, The Netherlands
- Groningen Institute for Evolutionary Life Sciences, University of Groningen, Groningen, The Netherlands
| | - Timon Elmer
- Department of Psychology, University of Zurich, Zurich, Switzerland
| | - Marijtje A J van Duijn
- Department of Sociology, University of Groningen, Groningen, The Netherlands
- Inter-University Center for Social Science Theory and Methodology, University of Groningen, Groningen, the Netherlands
| | - Laura F Bringmann
- Department of Psychometrics and Statistics, University of Groningen, Groningen, The Netherlands
| |
Collapse
|
4
|
Elmer T. Computational social science is growing up: why puberty consists of embracing measurement validation, theory development, and open science practices. EPJ DATA SCIENCE 2023; 12:58. [PMID: 38098785 PMCID: PMC10716103 DOI: 10.1140/epjds/s13688-023-00434-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/24/2023] [Accepted: 11/30/2023] [Indexed: 12/17/2023]
Abstract
Puberty is a phase in which individuals often test the boundaries of themselves and surrounding others and further define their identity - and thus their uniqueness compared to other individuals. Similarly, as Computational Social Science (CSS) grows up, it must strike a balance between its own practices and those of neighboring disciplines to achieve scientific rigor and refine its identity. However, there are certain areas within CSS that are reluctant to adopt rigorous scientific practices from other fields, which can be observed through an overreliance on passively collected data (e.g., through digital traces, wearables) without questioning the validity of such data. This paper argues that CSS should embrace the potential of combining both passive and active measurement practices to capitalize on the strengths of each approach, including objectivity and psychological quality. Additionally, the paper suggests that CSS would benefit from integrating practices and knowledge from other established disciplines, such as measurement validation, theoretical embedding, and open science practices. Based on this argument, the paper provides ten recommendations for CSS to mature as an interdisciplinary field of research.
Collapse
Affiliation(s)
- Timon Elmer
- Department of Psychology, Applied Social and Health Psychology, University of Zurich, Binzmühlestrasse 14/14, 8050 Zurich, Switzerland
| |
Collapse
|