1
|
Zech H, Waltmann M, Lee Y, Reichert M, Bedder RL, Rutledge RB, Deeken F, Wenzel J, Wedemeyer F, Aguilera A, Aslan A, Bach P, Bahr NS, Ebrahimi C, Fischbach PC, Ganz M, Garbusow M, Großkopf CM, Heigert M, Hentschel A, Belanger M, Karl D, Pelz P, Pinger M, Riemerschmid C, Rosenthal A, Steffen J, Strehle J, Weiss F, Wieder G, Wieland A, Zaiser J, Zimmermann S, Liu S, Goschke T, Walter H, Tost H, Lenz B, Andoh J, Ebner-Priemer U, Rapp MA, Heinz A, Dolan R, Smolka MN, Deserno L. Measuring self-regulation in everyday life: Reliability and validity of smartphone-based experiments in alcohol use disorder. Behav Res Methods 2023; 55:4329-4342. [PMID: 36508108 PMCID: PMC10700450 DOI: 10.3758/s13428-022-02019-8] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/03/2022] [Indexed: 12/14/2022]
Abstract
Self-regulation, the ability to guide behavior according to one's goals, plays an integral role in understanding loss of control over unwanted behaviors, for example in alcohol use disorder (AUD). Yet, experimental tasks that measure processes underlying self-regulation are not easy to deploy in contexts where such behaviors usually occur, namely outside the laboratory, and in clinical populations such as people with AUD. Moreover, lab-based tasks have been criticized for poor test-retest reliability and lack of construct validity. Smartphones can be used to deploy tasks in the field, but often require shorter versions of tasks, which may further decrease reliability. Here, we show that combining smartphone-based tasks with joint hierarchical modeling of longitudinal data can overcome at least some of these shortcomings. We test four short smartphone-based tasks outside the laboratory in a large sample (N = 488) of participants with AUD. Although task measures indeed have low reliability when data are analyzed traditionally by modeling each session separately, joint modeling of longitudinal data increases reliability to good and oftentimes excellent levels. We next test the measures' construct validity and show that extracted latent factors are indeed in line with theoretical accounts of cognitive control and decision-making. Finally, we demonstrate that a resulting cognitive control factor relates to a real-life measure of drinking behavior and yields stronger correlations than single measures based on traditional analyses. Our findings demonstrate how short, smartphone-based task measures, when analyzed with joint hierarchical modeling and latent factor analysis, can overcome frequently reported shortcomings of experimental tasks.
Collapse
Affiliation(s)
- Hilmar Zech
- Department of Psychiatry, Technische Universität Dresden, Dresden, Germany.
- Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Centre of Mental Health, University of Würzburg, Margarete-Höppel-Platz 1, 97080, Würzburg, Germany.
| | - Maria Waltmann
- Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Centre of Mental Health, University of Würzburg, Margarete-Höppel-Platz 1, 97080, Würzburg, Germany
- Max Planck Institute for Human Cognitive and Brain Sciences, Stephanstraße 1, 04103, Leipzig, Germany
| | - Ying Lee
- Department of Psychiatry, Technische Universität Dresden, Dresden, Germany
- Max Planck University College London Centre for Computational Psychiatry and Ageing Research, London, UK
- Wellcome Centre for Neuroimaging (WCHN), University College London, London, UK
| | - Markus Reichert
- Department of eHealth and Sports Analytics, Faculty of Sport Science, Ruhr-Universität Bochum (RUB), Bochum, Germany
- Mental mHealth Lab, Institute of Sports and Sports Science, Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany
- Department of Psychiatry and Psychotherapy, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
| | - Rachel L Bedder
- Max Planck University College London Centre for Computational Psychiatry and Ageing Research, London, UK
- Wellcome Centre for Neuroimaging (WCHN), University College London, London, UK
- Neuroscience Institute & Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Robb B Rutledge
- Max Planck University College London Centre for Computational Psychiatry and Ageing Research, London, UK
- Wellcome Centre for Neuroimaging (WCHN), University College London, London, UK
- Department of Psychology, Yale University, New Haven, CT, USA
| | - Friederike Deeken
- Social and Preventive Medicine, Department of Sports and Health Sciences, Intra-faculty unit "Cognitive Sciences", Faculty of Human Science, and Faculty of Health Sciences Brandenburg, Research Area Services Research and e-Health, University of Potsdam, Potsdam, Germany
| | - Julia Wenzel
- Department of Psychiatry and Neurosciences | CCM, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Department of Pediatric Surgery, Augustenburger Platz 1, 13353, Berlin, Germany
| | - Friederike Wedemeyer
- Department of Psychiatry and Neurosciences | CCM, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Department of Pediatric Surgery, Augustenburger Platz 1, 13353, Berlin, Germany
| | - Alvaro Aguilera
- Center for Information Services and High Performance Computing (ZIH), Technische Universität Dresden, Dresden, Germany
| | - Acelya Aslan
- Department of Addictive Behavior and Addiction Medicine, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
| | - Patrick Bach
- Department of Addictive Behavior and Addiction Medicine, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
| | - Nadja S Bahr
- Department of Psychiatry and Neurosciences | CCM, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Department of Pediatric Surgery, Augustenburger Platz 1, 13353, Berlin, Germany
| | - Claudia Ebrahimi
- Department of Psychiatry and Neurosciences | CCM, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Department of Pediatric Surgery, Augustenburger Platz 1, 13353, Berlin, Germany
| | | | - Marvin Ganz
- Department of Addictive Behavior and Addiction Medicine, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
| | - Maria Garbusow
- Department of Psychiatry and Neurosciences | CCM, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Department of Pediatric Surgery, Augustenburger Platz 1, 13353, Berlin, Germany
| | | | - Marie Heigert
- Department of Psychiatry and Neurosciences | CCM, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Department of Pediatric Surgery, Augustenburger Platz 1, 13353, Berlin, Germany
| | - Angela Hentschel
- Department of Psychiatry, Technische Universität Dresden, Dresden, Germany
| | - Matthew Belanger
- Department of Psychiatry, Technische Universität Dresden, Dresden, Germany
| | - Damian Karl
- Department of Addictive Behavior and Addiction Medicine, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
| | - Patricia Pelz
- Department of Psychiatry and Neurosciences | CCM, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Department of Pediatric Surgery, Augustenburger Platz 1, 13353, Berlin, Germany
| | - Mathieu Pinger
- Department of Clinical Psychology, Central Institute of Mental Health, Medical Faculty Mannheim, University of Heidelberg, Mannheim, Germany
| | - Carlotta Riemerschmid
- Department of Psychiatry and Neurosciences | CCM, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Department of Pediatric Surgery, Augustenburger Platz 1, 13353, Berlin, Germany
| | - Annika Rosenthal
- Department of Psychiatry and Neurosciences | CCM, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Department of Pediatric Surgery, Augustenburger Platz 1, 13353, Berlin, Germany
| | - Johannes Steffen
- Department of Psychiatry, Technische Universität Dresden, Dresden, Germany
| | - Jens Strehle
- Center for Information Services and High Performance Computing (ZIH), Technische Universität Dresden, Dresden, Germany
| | - Franziska Weiss
- Department of Clinical Psychology, Central Institute of Mental Health, Medical Faculty Mannheim, University of Heidelberg, Mannheim, Germany
| | - Gesine Wieder
- Center for Information Services and High Performance Computing (ZIH), Technische Universität Dresden, Dresden, Germany
| | - Alfred Wieland
- Department of Addictive Behavior and Addiction Medicine, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
| | - Judith Zaiser
- Department of Addictive Behavior and Addiction Medicine, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
| | - Sina Zimmermann
- Department of Addictive Behavior and Addiction Medicine, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
| | - Shuyan Liu
- Department of Psychiatry and Neurosciences | CCM, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Department of Pediatric Surgery, Augustenburger Platz 1, 13353, Berlin, Germany
| | - Thomas Goschke
- Department of Psychology, Technische Universität Dresden, Dresden, Germany
| | - Henrik Walter
- Department of Psychiatry and Neurosciences | CCM, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Department of Pediatric Surgery, Augustenburger Platz 1, 13353, Berlin, Germany
| | - Heike Tost
- Department of Psychiatry and Psychotherapy, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
| | - Bernd Lenz
- Department of Addictive Behavior and Addiction Medicine, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
| | - Jamila Andoh
- Department of Psychiatry and Psychotherapy, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
| | - Ulrich Ebner-Priemer
- Mental mHealth Lab, Institute of Sports and Sports Science, Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany
- Department of Psychiatry and Psychotherapy, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
| | - Michael A Rapp
- Social and Preventive Medicine, Department of Sports and Health Sciences, Intra-faculty unit "Cognitive Sciences", Faculty of Human Science, and Faculty of Health Sciences Brandenburg, Research Area Services Research and e-Health, University of Potsdam, Potsdam, Germany
| | - Andreas Heinz
- Department of Psychiatry and Neurosciences | CCM, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Department of Pediatric Surgery, Augustenburger Platz 1, 13353, Berlin, Germany
| | - Ray Dolan
- Max Planck University College London Centre for Computational Psychiatry and Ageing Research, London, UK
- Wellcome Centre for Neuroimaging (WCHN), University College London, London, UK
- State Key Laboratory of Cognitive Neuroscience and Learning, IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
- BIH Visiting Professor, Stiftung Charité, Department of Psychiatry and Psychotherapy, Charité - Universitätsmedizin, Berlin, Germany
| | - Michael N Smolka
- Department of Psychiatry, Technische Universität Dresden, Dresden, Germany
| | - Lorenz Deserno
- Department of Psychiatry, Technische Universität Dresden, Dresden, Germany.
- Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Centre of Mental Health, University of Würzburg, Margarete-Höppel-Platz 1, 97080, Würzburg, Germany.
- Max Planck Institute for Human Cognitive and Brain Sciences, Stephanstraße 1, 04103, Leipzig, Germany.
| |
Collapse
|