1
|
Henninger F, Kieslich PJ, Fernández-Fontelo A, Greven S, Kreuter F. Privacy Attitudes toward Mouse-Tracking Paradata Collection. Public Opin Q 2023; 87:602-618. [PMID: 37705922 PMCID: PMC10496572 DOI: 10.1093/poq/nfad034] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/15/2023]
Abstract
Survey participants' mouse movements provide a rich, unobtrusive source of paradata, offering insight into the response process beyond the observed answers. However, the use of mouse tracking may require participants' explicit consent for their movements to be recorded and analyzed. Thus, the question arises of how its presence affects the willingness of participants to take part in a survey at all-if prospective respondents are reluctant to complete a survey if additional measures are recorded, collecting paradata may do more harm than good. Previous research has found that other paradata collection modes reduce the willingness to participate, and that this decrease may be influenced by the specific motivation provided to participants for collecting the data. However, the effects of mouse movement collection on survey consent and participation have not been addressed so far. In a vignette experiment, we show that reported willingness to participate in a survey decreased when mouse tracking was part of the overall consent. However, a larger proportion of the sample indicated willingness to both take part and provide mouse-tracking data when these decisions were combined, compared to an independent opt-in to paradata collection, separated from the decision to complete the study. This suggests that survey practitioners may face a trade-off between maximizing their overall participation rate and maximizing the number of participants who also provide mouse-tracking data. Explaining motivations for paradata collection did not have a positive effect and, in some cases, even reduced participants' reported willingness to take part in the survey.
Collapse
Affiliation(s)
- Felix Henninger
- Graduate Student at the Chair for Statistics and Data Science in Social Sciences and the Humanities, Faculty of Mathematics, Informatics and Statistics, Ludwig-Maximilians-Universität München, Munich, Germany; and Research Affiliate, Mannheim Centre for European Social Research, University of Mannheim, Mannheim, Germany
| | - Pascal J Kieslich
- Research Affiliate, Mannheim Centre for European Social Research, University of Mannheim, Mannheim, Germany
| | - Amanda Fernández-Fontelo
- Postdoctoral Researcher, Departament de Matemàtiques, Universitat Autònoma de Barcelona, Barcelona, Spain; and Research Affiliate with Chair of Statistics, School of Business and Economics, Humboldt-Universität zu Berlin, Berlin, Germany
| | - Sonja Greven
- Professor at the Chair of Statistics, School of Business and Economics, Humboldt-Universität zu Berlin, Berlin, Germany
| | - Frauke Kreuter
- Professor at the Chair for Statistics and Data Science in Social Sciences and the Humanities, Ludwig-Maximilians-Universität München, Munich, Germany; and Professor, Joint Program in Survey Methodology, University of Maryland, College Park, MD, US
| |
Collapse
|
2
|
Abraham M, Collischon M, Grimm V, Kreuter F, Moser K, Niessen C, Schnabel C, Stephan G, Trappmann M, Wolbring T. COVID-19, normative attitudes and pluralistic ignorance in employer-employee relationships. J Labour Mark Res 2022; 56:19. [PMID: 36408440 PMCID: PMC9660097 DOI: 10.1186/s12651-022-00325-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/20/2022] [Accepted: 10/18/2022] [Indexed: 06/16/2023]
Abstract
Employment relationships are embedded in a network of social norms that provide an implicit framework for desired behaviour, especially if contractual solutions are weak. The COVID-19 pandemic has brought about major changes that have led to situations, such as the scope of short-time work or home-based work in a firm. Against this backdrop, our study addresses three questions: first, are there social norms dealing with these changes; second, are there differences in attitudes between employees and supervisors (misalignment); and third, are there differences between respondents' average attitudes and the attitudes expected to exist in the population (pluralistic ignorance). We find that for the assignment of short-time work and of work at home, there are shared normative attitudes with only small differences between supervisors and nonsupervisors. Moreover, there is evidence for pluralistic ignorance; asked for the perceived opinion of others, respondents over- or underestimated the consensus in the (survey) population. Such pluralistic ignorance can contribute to the upholding of a norm even if individuals do not support the norm, with potentially far-reaching consequences for the quality of the employment relationship and the functioning of the organization. Our results show that, especially in times of change, social norms should be considered for the analysis of labour markets.
Collapse
Affiliation(s)
- Martin Abraham
- School of Business, Economics and Society, Friedrich-Alexander-Universität Erlangen-Nürnberg, Findelgasse 7, 90402 Nürnberg, Germany
| | | | - Veronika Grimm
- School of Business, Economics and Society, Friedrich-Alexander-Universität Erlangen-Nürnberg, Findelgasse 7, 90402 Nürnberg, Germany
| | - Frauke Kreuter
- Department of Statistics, Ludwig-Maximilians-Universität München, Munich, Germany
| | - Klaus Moser
- School of Business, Economics and Society, Friedrich-Alexander-Universität Erlangen-Nürnberg, Findelgasse 7, 90402 Nürnberg, Germany
| | - Cornelia Niessen
- Department of Psychology, Friedrich-Alexander-Universität Erlangen-Nürnberg, Nürnberg, Germany
| | - Claus Schnabel
- School of Business, Economics and Society, Friedrich-Alexander-Universität Erlangen-Nürnberg, Findelgasse 7, 90402 Nürnberg, Germany
| | - Gesine Stephan
- School of Business, Economics and Society, Friedrich-Alexander-Universität Erlangen-Nürnberg, Findelgasse 7, 90402 Nürnberg, Germany
- Institute for Employment Research, Nürnberg, Germany
| | | | - Tobias Wolbring
- School of Business, Economics and Society, Friedrich-Alexander-Universität Erlangen-Nürnberg, Findelgasse 7, 90402 Nürnberg, Germany
| |
Collapse
|
3
|
Kuppler M, Kern C, Bach RL, Kreuter F. From fair predictions to just decisions? Conceptualizing algorithmic fairness and distributive justice in the context of data-driven decision-making. Front Sociol 2022; 7:883999. [PMID: 36299413 PMCID: PMC9589041 DOI: 10.3389/fsoc.2022.883999] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/25/2022] [Accepted: 09/20/2022] [Indexed: 06/16/2023]
Abstract
Prediction algorithms are regularly used to support and automate high-stakes policy decisions about the allocation of scarce public resources. However, data-driven decision-making raises problems of algorithmic fairness and justice. So far, fairness and justice are frequently conflated, with the consequence that distributive justice concerns are not addressed explicitly. In this paper, we approach this issue by distinguishing (a) fairness as a property of the algorithm used for the prediction task from (b) justice as a property of the allocation principle used for the decision task in data-driven decision-making. The distinction highlights the different logic underlying concerns about fairness and justice and permits a more systematic investigation of the interrelations between the two concepts. We propose a new notion of algorithmic fairness called error fairness which requires prediction errors to not differ systematically across individuals. Drawing on sociological and philosophical discourse on local justice, we present a principled way to include distributive justice concerns into data-driven decision-making. We propose that allocation principles are just if they adhere to well-justified distributive justice principles. Moving beyond the one-sided focus on algorithmic fairness, we thereby make a first step toward the explicit implementation of distributive justice into data-driven decision-making.
Collapse
Affiliation(s)
- Matthias Kuppler
- Department of Social Sciences, University of Siegen, Siegen, Germany
| | - Christoph Kern
- School of Social Sciences, University of Mannheim, Mannheim, Germany
- Joint Program in Survey Methodology, University of Maryland, College Park, MD, United States
| | - Ruben L. Bach
- School of Social Sciences, University of Mannheim, Mannheim, Germany
| | - Frauke Kreuter
- Joint Program in Survey Methodology, University of Maryland, College Park, MD, United States
- Department of Statistics, LMU Munich, Munich, Germany
| |
Collapse
|
4
|
Balogh A, Harman A, Kreuter F. Real-Time Analysis of Predictors of COVID-19 Infection Spread in Countries in the European Union Through a New Tool. Int J Public Health 2022; 67:1604974. [PMID: 36275432 PMCID: PMC9582119 DOI: 10.3389/ijph.2022.1604974] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2022] [Accepted: 09/20/2022] [Indexed: 11/13/2022] Open
Abstract
Objectives: Real-time data analysis during a pandemic is crucial. This paper aims to introduce a novel interactive tool called Covid-Predictor-Tracker using several sources of COVID-19 data, which allows examining developments over time and across countries. Exemplified here by investigating relative effects of vaccination to non-pharmaceutical interventions on COVID-19 spread. Methods: We combine >100 indicators from the Global COVID-19 Trends and Impact Survey, Johns Hopkins University, Our World in Data, European Centre for Disease Prevention and Control, National Centers for Environmental Information, and Eurostat using random forests, hierarchical clustering, and rank correlation to predict COVID-19 cases. Results: Between 2/2020 and 1/2022, we found among the non-pharmaceutical interventions “mask usage” to have strong effects after the percentage of people vaccinated at least once, followed by country-specific measures such as lock-downs. Countries with similar characteristics share ranks of infection predictors. Gender and age distribution, healthcare expenditures and cultural participation interact with restriction measures. Conclusion: Including time-aware machine learning models in COVID-19 infection dashboards allows to disentangle and rank predictors of COVID-19 cases per country to support policy evaluation. Our open-source tool can be updated daily with continuous data streams, and expanded as the pandemic evolves.
Collapse
Affiliation(s)
- Aniko Balogh
- School of Social Sciences and Mannheim Business School, University of Mannheim, Mannheim, Germany
- TÁRKI Social Research Institute, Budapest, Hungary
- *Correspondence: Aniko Balogh,
| | - Anna Harman
- School of Social Sciences and Mannheim Business School, University of Mannheim, Mannheim, Germany
| | - Frauke Kreuter
- Joint Program in Survey Methodology, University of Maryland, College Park, MD, United States
- Statistics and Data Science in Social Sciences and the Humanities at the Ludwig-Maximilians-University of Munich, Munich, Germany
| |
Collapse
|
5
|
Kern C, Gerdon F, Bach RL, Keusch F, Kreuter F. Humans versus machines: Who is perceived to decide fairer? Experimental evidence on attitudes toward automated decision-making. Patterns 2022; 3:100591. [PMID: 36277823 PMCID: PMC9583126 DOI: 10.1016/j.patter.2022.100591] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/20/2022] [Revised: 07/25/2022] [Accepted: 08/30/2022] [Indexed: 11/04/2022]
Abstract
Human perceptions of fairness in (semi-)automated decision-making (ADM) constitute a crucial building block toward developing human-centered ADM solutions. However, measuring fairness perceptions is challenging because various context and design characteristics of ADM systems need to be disentangled. Particularly, ADM applications need to use the right degree of automation and granularity of data input to achieve efficiency and public acceptance. We present results from a large-scale vignette experiment that assessed fairness perceptions and the acceptability of ADM systems. The experiment varied context and design dimensions, with an emphasis on who makes the final decision. We show that automated recommendations in combination with a final human decider are perceived as fair as decisions made by a dominant human decider and as fairer than decisions made only by an algorithm. Our results shed light on the context dependence of fairness assessments and show that semi-automation of decision-making processes is often desirable. Investigates public acceptance of automated decision-making across four contexts Experimentally varies degree of automation, used data, and decision type and context Uses experimental data from a probability-based sample with large sample size Finds that respondents overall prefer human involvement
Public institutions and businesses increasingly rely on algorithmic support to make decisions about citizens. Promising enhanced efficiency, organizations use automated decision-making (ADM) for purposes ranging from content recommendations to credit or bail decisions. However, algorithms may potentially worsen social inequities by reproducing biases they find in the data. Moreover, citizens may feel uncomfortable being judged by a “machine,” but they also may distrust, e.g., the objectivity of human deciders. We present a survey experiment on citizens’ preferences for the degree of involvement of algorithms and human deciders across four highly relevant ADM contexts, while varying two other situational parameters. We find that respondents prefer the involvement of a human decider to purely automated decisions. Depending on context, ADM designers should therefore consider involving a human decider in the process.
Collapse
|
6
|
Lane J, Kim B, Kreuter F, Nunez A. The Value of Science: Special Theme. Harvard Data Science Review 2022. [DOI: 10.1162/99608f92.4a01213d] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022] Open
Affiliation(s)
- Julia Lane
- New York University, New York City, New York, United States of America
| | - Brian Kim
- Joint Program in Survey Methodology, College of Behavioral and Social Sciences, University of Maryland, College Park, Maryland, United States of America; Department of Electrical and Computer Engineering, A. Kames Clark School of Engineering, University of Maryland, College Park, Maryland, United States of America
| | - Frauke Kreuter
- Department of Statistics, Ludwig Maximilians University of Munich, Munich, Germany; Joint Program in Survey Methodology, College of Behavioral and Social Sciences, University of Maryland, College Park, Maryland, United States of America; Social Data Science Center, College of Information Studies and College of Behavioral and Social Sciences, University of Maryland, College Park, Maryland, United States of America
| | - Allison Nunez
- The State University of New York at Albany, Albany, New York, United States of America
| |
Collapse
|
7
|
Riehm KE, Badillo Goicoechea E, Wang FM, Kim E, Aldridge LR, Lupton-Smith CP, Presskreischer R, Chang TH, LaRocca S, Kreuter F, Stuart EA. Association of Non-Pharmaceutical Interventions to Reduce the Spread of SARS-CoV-2 With Anxiety and Depressive Symptoms: A Multi-National Study of 43 Countries. Int J Public Health 2022; 67:1604430. [PMID: 35308051 PMCID: PMC8927027 DOI: 10.3389/ijph.2022.1604430] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2021] [Accepted: 01/31/2022] [Indexed: 01/26/2023] Open
Abstract
Objectives: To examine the association of non-pharmaceutical interventions (NPIs) with anxiety and depressive symptoms among adults and determine if these associations varied by gender and age. Methods: We combined survey data from 16,177,184 adults from 43 countries who participated in the daily COVID-19 Trends and Impact Survey via Facebook with time-varying NPI data from the Oxford COVID-19 Government Response Tracker between 24 April 2020 and 20 December 2020. Using logistic regression models, we examined the association of [1] overall NPI stringency and [2] seven individual NPIs (school closures, workplace closures, cancellation of public events, restrictions on the size of gatherings, stay-at-home requirements, restrictions on internal movement, and international travel controls) with anxiety and depressive symptoms. Results: More stringent implementation of NPIs was associated with a higher odds of anxiety and depressive symptoms, albeit with very small effect sizes. Individual NPIs had heterogeneous associations with anxiety and depressive symptoms by gender and age. Conclusion: Governments worldwide should be prepared to address the possible mental health consequences of stringent NPI implementation with both universal and targeted interventions for vulnerable groups.
Collapse
Affiliation(s)
- Kira E. Riehm
- Department of Mental Health, Johns Hopkins University, Baltimore, MD, United States,*Correspondence: Kira E. Riehm,
| | | | - Frances M. Wang
- Department of Mental Health, Johns Hopkins University, Baltimore, MD, United States
| | | | - Luke R. Aldridge
- Department of Mental Health, Johns Hopkins University, Baltimore, MD, United States
| | | | | | - Ting-Hsuan Chang
- Department of Mental Health, Johns Hopkins University, Baltimore, MD, United States
| | | | - Frauke Kreuter
- Joint Program in Survey Methodology, University of Maryland, College Park, MD, United States,School of Social Sciences, University of Mannheim, Mannheim, Germany,Statistical Methods Group, Institute for Employment Research, Nuremberg, Germany
| | - Elizabeth A. Stuart
- Department of Mental Health, Johns Hopkins University, Baltimore, MD, United States
| |
Collapse
|
8
|
Nordeck CD, Riehm KE, Smail EJ, Holingue C, Kane JC, Johnson RM, Veldhuis CB, Kalb LG, Stuart EA, Kreuter F, Thrul J. Changes in drinking days among United States adults during the COVID-19 pandemic. Addiction 2022; 117:331-340. [PMID: 34159674 PMCID: PMC8441933 DOI: 10.1111/add.15622] [Citation(s) in RCA: 35] [Impact Index Per Article: 17.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/06/2020] [Revised: 12/30/2020] [Accepted: 06/09/2021] [Indexed: 12/11/2022]
Abstract
AIMS To examine changes in drinking behavior among United States (US) adults between March 10 and July 21, 2020, a critical period during the COVID-19 pandemic. DESIGN Longitudinal, internet-based panel survey. SETTING The Understanding America Study (UAS), a nationally representative panel of US adults age 18 or older. PARTICIPANTS A total of 4298 US adults who reported alcohol use. MEASUREMENTS Changes in number of reported drinking days from March 11, 2020 through July 21, 2020 in the overall sample and stratified by sex, age, race/ethnicity, household structure, poverty status, and census region. FINDINGS Compared with March 11, the number of drinking days per week was significantly higher on April 1 by an average of 0.36 days (95% CI = 0.30, 0.43), on May 1 by an average of 0.55 days (95% CI = 0.47, 0.63), on June 1 by an average of 0.41 days (95% CI = 0.33, 0.49), and on July 1 by an average of 0.39 days (95% CI = 0.31, 0.48). Males, White participants, and older adults reported sustained increases in drinking days, whereas female participants and individuals living under the federal poverty line had attenuated drinking days in the latter part of the study period. CONCLUSIONS Between March and mid-July 2020, adults in the United States reported increases in the number of drinking days, with sustained increases observed among males, White participants, and older adults.
Collapse
Affiliation(s)
- Courtney D. Nordeck
- Department of Mental Health, Bloomberg School of Public HealthJohns Hopkins UniversityBaltimoreMDUSA
| | - Kira E. Riehm
- Department of Mental Health, Bloomberg School of Public HealthJohns Hopkins UniversityBaltimoreMDUSA
| | - Emily J. Smail
- Department of Mental Health, Bloomberg School of Public HealthJohns Hopkins UniversityBaltimoreMDUSA
| | - Calliope Holingue
- Department of Mental Health, Bloomberg School of Public HealthJohns Hopkins UniversityBaltimoreMDUSA
- Department of Neuropsychology, Kennedy Krieger InstituteJohns Hopkins UniversityBaltimoreMDUSA
| | - Jeremy C. Kane
- Department of Epidemiology, Mailman School of Public HealthColumbia UniversityNew YorkNYUSA
| | - Renee M. Johnson
- Department of Mental Health, Bloomberg School of Public HealthJohns Hopkins UniversityBaltimoreMDUSA
| | | | - Luther G. Kalb
- Department of Mental Health, Bloomberg School of Public HealthJohns Hopkins UniversityBaltimoreMDUSA
- Department of Neuropsychology, Kennedy Krieger InstituteJohns Hopkins UniversityBaltimoreMDUSA
| | - Elizabeth A. Stuart
- Department of Mental Health, Bloomberg School of Public HealthJohns Hopkins UniversityBaltimoreMDUSA
| | - Frauke Kreuter
- Joint Program in Survey MethodologyUniversity of MarylandMDUSA
- Department of StatisticsLudwig Maximilian University of MunichMunichGermany
- Statistical Methods GroupInstitute for Employment ResearchNurembergGermany
| | - Johannes Thrul
- Department of Mental Health, Bloomberg School of Public HealthJohns Hopkins UniversityBaltimoreMDUSA
- Centre for Alcohol Policy ResearchLa Trobe UniversityBundooraVICAustralia
| |
Collapse
|
9
|
Kim MP, Kern C, Goldwasser S, Kreuter F, Reingold O. Universal adaptability: Target-independent inference that competes with propensity scoring. Proc Natl Acad Sci U S A 2022; 119:e2108097119. [PMID: 35046023 PMCID: PMC8794832 DOI: 10.1073/pnas.2108097119] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2021] [Accepted: 12/02/2021] [Indexed: 11/20/2022] Open
Abstract
The gold-standard approaches for gleaning statistically valid conclusions from data involve random sampling from the population. Collecting properly randomized data, however, can be challenging, so modern statistical methods, including propensity score reweighting, aim to enable valid inferences when random sampling is not feasible. We put forth an approach for making inferences based on available data from a source population that may differ in composition in unknown ways from an eventual target population. Whereas propensity scoring requires a separate estimation procedure for each different target population, we show how to build a single estimator, based on source data alone, that allows for efficient and accurate estimates on any downstream target data. We demonstrate, theoretically and empirically, that our target-independent approach to inference, which we dub "universal adaptability," is competitive with target-specific approaches that rely on propensity scoring. Our approach builds on a surprising connection between the problem of inferences in unspecified target populations and the multicalibration problem, studied in the burgeoning field of algorithmic fairness. We show how the multicalibration framework can be employed to yield valid inferences from a single source population across a diverse set of target populations.
Collapse
Affiliation(s)
- Michael P Kim
- Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, CA 94720
- Miller Institute for Basic Research in Science, Berkeley, CA 94720
| | - Christoph Kern
- School of Social Sciences, University of Mannheim, 68159 Mannheim, Germany
| | - Shafi Goldwasser
- Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, CA 94720;
- Simons Institute for the Theory of Computation, Berkeley, CA 94720
| | - Frauke Kreuter
- Joint Program in Survey Methodology, University of Maryland, College Park, MD 20742
- Department of Statistics, Ludwig-Maximilians-Universität München, 80539 München, Germany
| | - Omer Reingold
- Department of Computer Science, Stanford University, Stanford, CA 94305
| |
Collapse
|
10
|
Astley CM, Tuli G, Mc Cord KA, Cohn EL, Rader B, Varrelman TJ, Chiu SL, Deng X, Stewart K, Farag TH, Barkume KM, LaRocca S, Morris KA, Kreuter F, Brownstein JS. Global monitoring of the impact of the COVID-19 pandemic through online surveys sampled from the Facebook user base. Proc Natl Acad Sci U S A 2021; 118:e2111455118. [PMID: 34903657 PMCID: PMC8713788 DOI: 10.1073/pnas.2111455118] [Citation(s) in RCA: 24] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/08/2021] [Indexed: 11/18/2022] Open
Abstract
Simultaneously tracking the global impact of COVID-19 is challenging because of regional variation in resources and reporting. Leveraging self-reported survey outcomes via an existing international social media network has the potential to provide standardized data streams to support monitoring and decision-making worldwide, in real time, and with limited local resources. The University of Maryland Global COVID-19 Trends and Impact Survey (UMD-CTIS), in partnership with Facebook, has invited daily cross-sectional samples from the social media platform's active users to participate in the survey since its launch on April 23, 2020. We analyzed UMD-CTIS survey data through December 20, 2020, from 31,142,582 responses representing 114 countries/territories weighted for nonresponse and adjusted to basic demographics. We show consistent respondent demographics over time for many countries/territories. Machine Learning models trained on national and pooled global data verified known symptom indicators. COVID-like illness (CLI) signals were correlated with government benchmark data. Importantly, the best benchmarked UMD-CTIS signal uses a single survey item whereby respondents report on CLI in their local community. In regions with strained health infrastructure but active social media users, we show it is possible to define COVID-19 impact trajectories using a remote platform independent of local government resources. This syndromic surveillance public health tool is the largest global health survey to date and, with brief participant engagement, can provide meaningful, timely insights into the global COVID-19 pandemic at a local scale.
Collapse
Affiliation(s)
- Christina M Astley
- Division of Endocrinology, Boston Children's Hospital, Boston, MA 02115;
- Computational Epidemiology Lab, Boston Children's Hospital, Boston, MA 02115
- Harvard Medical School, Boston, MA 02115
- Broad Institute of Harvard and MIT, Cambridge, MA 02142
| | - Gaurav Tuli
- Computational Epidemiology Lab, Boston Children's Hospital, Boston, MA 02115
| | - Kimberly A Mc Cord
- Computational Epidemiology Lab, Boston Children's Hospital, Boston, MA 02115
| | - Emily L Cohn
- Computational Epidemiology Lab, Boston Children's Hospital, Boston, MA 02115
| | - Benjamin Rader
- Computational Epidemiology Lab, Boston Children's Hospital, Boston, MA 02115
- Department of Epidemiology, Boston University, Boston, MA 02118
| | - Tanner J Varrelman
- Computational Epidemiology Lab, Boston Children's Hospital, Boston, MA 02115
| | - Samantha L Chiu
- Joint Program in Survey Methodology, University of Maryland, College Park, MD 20742
| | - Xiaoyi Deng
- Joint Program in Survey Methodology, University of Maryland, College Park, MD 20742
| | - Kathleen Stewart
- Center for Geospatial Information Science, University of Maryland, College Park, MD 20742
| | | | | | | | | | - Frauke Kreuter
- Joint Program in Survey Methodology, University of Maryland, College Park, MD 20742
- Department of Statistics, Ludwig-Maximilians-Universität, Munich 80539, Germany
| | - John S Brownstein
- Computational Epidemiology Lab, Boston Children's Hospital, Boston, MA 02115
- Harvard Medical School, Boston, MA 02115
| |
Collapse
|
11
|
|
12
|
Badillo-Goicoechea E, Chang TH, Kim E, LaRocca S, Morris K, Deng X, Chiu S, Bradford A, Garcia A, Kern C, Cobb C, Kreuter F, Stuart EA. Global trends and predictors of face mask usage during the COVID-19 pandemic. BMC Public Health 2021; 21:2099. [PMID: 34781917 PMCID: PMC8667772 DOI: 10.1186/s12889-021-12175-9] [Citation(s) in RCA: 46] [Impact Index Per Article: 15.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2021] [Accepted: 11/01/2021] [Indexed: 11/12/2022] Open
Abstract
Background Guidelines and recommendations from public health authorities related to face masks have been essential in containing the COVID-19 pandemic. We assessed the prevalence and correlates of mask usage during the pandemic. Methods We examined a total of 13,723,810 responses to a daily cross-sectional online survey in 38 countries of people who completed from April 23, 2020 to October 31, 2020 and reported having been in public at least once during the last 7 days. The outcome was individual face mask usage in public settings, and the predictors were country fixed effects, country-level mask policy stringency, calendar time, individual sociodemographic factors, and health prevention behaviors. Associations were modeled using survey-weighted multivariable logistic regression. Results Mask-wearing varied over time and across the 38 countries. While some countries consistently showed high prevalence throughout, in other countries mask usage increased gradually, and a few other countries remained at low prevalence. Controlling for time and country fixed effects, sociodemographic factors (older age, female gender, education, urbanicity) and stricter mask-related policies were significantly associated with higher mask usage in public settings. Crucially, social behaviors considered risky in the context of the pandemic (going out to large events, restaurants, shopping centers, and socializing outside of the household) were associated with lower mask use. Conclusion The decision to wear a face mask in public settings is significantly associated with sociodemographic factors, risky social behaviors, and mask policies. This has important implications for health prevention policies and messaging, including the potential need for more targeted policy and messaging design. Supplementary Information The online version contains supplementary material available at 10.1186/s12889-021-12175-9.
Collapse
Affiliation(s)
- Elena Badillo-Goicoechea
- Department of Mental Health, Johns Hopkins Bloomberg School of Public Health, 615 N. Wolfe St. W1033, Baltimore, MD, 21205, USA
| | - Ting-Hsuan Chang
- Department of Biostatistics, Johns Hopkins Bloomberg School of Public Health, 615 N. Wolfe St. W1033, Baltimore, MD, 21205, USA
| | - Esther Kim
- Facebook Research, Menlo Park, California, USA
| | | | | | - Xiaoyi Deng
- Joint Program in Survey Methodology, University of Maryland College Park, College Park, MD, USA
| | - Samantha Chiu
- Joint Program in Survey Methodology, University of Maryland College Park, College Park, MD, USA
| | - Adrianne Bradford
- Joint Program in Survey Methodology, University of Maryland College Park, College Park, MD, USA
| | - Andres Garcia
- Joint Program in Survey Methodology, University of Maryland College Park, College Park, MD, USA
| | | | | | - Frauke Kreuter
- Joint Program in Survey Methodology, University of Maryland College Park, College Park, MD, USA.,Department of Statistics, Ludwig Maximilians University, Munich, Germany.,Institute for Employment Research, Nuremberg, Germany
| | - Elizabeth A Stuart
- Department of Mental Health, Johns Hopkins Bloomberg School of Public Health, 615 N. Wolfe St. W1033, Baltimore, MD, 21205, USA. .,Department of Biostatistics, Johns Hopkins Bloomberg School of Public Health, 615 N. Wolfe St. W1033, Baltimore, MD, 21205, USA.
| |
Collapse
|
13
|
Galesic M, Bruine de Bruin W, Dalege J, Feld SL, Kreuter F, Olsson H, Prelec D, Stein DL, van der Does T. Human social sensing is an untapped resource for computational social science. Nature 2021; 595:214-222. [PMID: 34194037 DOI: 10.1038/s41586-021-03649-2] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2021] [Accepted: 05/17/2021] [Indexed: 02/06/2023]
Abstract
The ability to 'sense' the social environment and thereby to understand the thoughts and actions of others allows humans to fit into their social worlds, communicate and cooperate, and learn from others' experiences. Here we argue that, through the lens of computational social science, this ability can be used to advance research into human sociality. When strategically selected to represent a specific population of interest, human social sensors can help to describe and predict societal trends. In addition, their reports of how they experience their social worlds can help to build models of social dynamics that are constrained by the empirical reality of human social systems.
Collapse
Affiliation(s)
- Mirta Galesic
- Santa Fe Institute, Santa Fe, NM, USA. .,Complexity Science Hub Vienna, Vienna, Austria. .,Vermont Complex Systems Center, University of Vermont, Burlington, VT, USA. .,Harding Center for Risk Literacy, University of Potsdam, Potsdam, Germany.
| | - Wändi Bruine de Bruin
- Sol Price School of Public Policy, University of South California, Los Angeles, CA, USA
| | | | - Scott L Feld
- Department of Sociology, Purdue University, West Lafayette, IN, USA
| | - Frauke Kreuter
- Joint Program in Survey Methodology, University of Maryland, Maryland, MD, USA.,Ludwig Maximilians Universität München, München, Germany
| | | | - Drazen Prelec
- Sloan School of Management, MIT, Cambridge, MA, USA.,Department of Economics, MIT, Cambridge, MA, USA.,Department of Brain and Cognitive Sciences, MIT, Cambridge, MA, USA
| | - Daniel L Stein
- Department of Physics and Courant Institute of Mathematical Sciences, New York University, New York, NY, USA
| | | |
Collapse
|
14
|
Gerdon F, Nissenbaum H, Bach RL, Kreuter F, Zins S. Individual Acceptance of Using Health Data for Private and Public Benefit: Changes During the COVID-19 Pandemic. Harvard Data Science Review 2021. [DOI: 10.1162/99608f92.edf2fc97] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022] Open
|
15
|
Riehm KE, Holingue C, Smail EJ, Kapteyn A, Bennett D, Thrul J, Kreuter F, McGinty EE, Kalb LG, Veldhuis CB, Johnson RM, Fallin MD, Stuart EA. Trajectories of Mental Distress Among U.S. Adults During the COVID-19 Pandemic. Ann Behav Med 2021; 55:93-102. [PMID: 33555336 PMCID: PMC7929474 DOI: 10.1093/abm/kaaa126] [Citation(s) in RCA: 73] [Impact Index Per Article: 24.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
Background Cross-sectional studies have found that the coronavirus disease 2019 (COVID-19) pandemic has negatively affected population-level mental health. Longitudinal studies are necessary to examine trajectories of change in mental health over time and identify sociodemographic groups at risk for persistent distress. Purpose To examine the trajectories of mental distress between March 10 and August 4, 2020, a key period during the COVID-19 pandemic. Methods Participants included 6,901 adults from the nationally representative Understanding America Study, surveyed at baseline between March 10 and 31, 2020, with nine follow-up assessments between April 1 and August 4, 2020. Mixed-effects logistic regression was used to examine the association between date and self-reported mental distress (measured with the four-item Patient Health Questionnaire) among U.S. adults overall and among sociodemographic subgroups defined by sex, age, race/ethnicity, household structure, federal poverty line, and census region. Results Compared to March 11, the odds of mental distress among U.S. adults overall were 1.84 (95% confidence interval [CI] = 1.65–2.07) times higher on April 1 and 1.92 (95% CI = 1.62–2.28) times higher on May 1; by August 1, the odds of mental distress had returned to levels comparable to March 11 (odds ratio [OR] = 0.80, 95% CI = 0.66–0.96). Females experienced a sharper increase in mental distress between March and May compared to males (females: OR = 2.29, 95% CI = 1.85–2.82; males: OR = 1.53, 95% CI = 1.15–2.02). Conclusions These findings highlight the trajectory of mental health symptoms during an unprecedented pandemic, including the identification of populations at risk for sustained mental distress.
Collapse
Affiliation(s)
- Kira E Riehm
- Department of Mental Health, Bloomberg School of Public Health, Johns Hopkins University, 624 N Broadway, Room 798, Baltimore, MD, USA
| | - Calliope Holingue
- Department of Mental Health, Bloomberg School of Public Health, Johns Hopkins University, 624 N Broadway, Room 798, Baltimore, MD, USA.,Department of Neuropsychology, Kennedy Krieger Institute, Johns Hopkins University, Baltimore, MD, USA
| | - Emily J Smail
- Department of Mental Health, Bloomberg School of Public Health, Johns Hopkins University, 624 N Broadway, Room 798, Baltimore, MD, USA
| | - Arie Kapteyn
- Center for Economic and Social Research, University of Southern California, Los Angeles, CA, USA
| | - Daniel Bennett
- Center for Economic and Social Research, University of Southern California, Los Angeles, CA, USA
| | - Johannes Thrul
- Department of Mental Health, Bloomberg School of Public Health, Johns Hopkins University, 624 N Broadway, Room 798, Baltimore, MD, USA.,Centre for Alcohol Policy Research, La Trobe University, Bundoora, VIC, Australia
| | - Frauke Kreuter
- Joint Program in Survey Methodology, University of Maryland, College Park, College Park, MD, USA.,School of Social Sciences, University of Mannheim, Mannheim, Germany.,Statistical Methods Group, Institute for Employment Research, Nuremberg, Germany
| | - Emma E McGinty
- Department of Health Policy and Management, Bloomberg School of Public Health, Johns Hopkins University, Baltimore, MD, USA
| | - Luther G Kalb
- Department of Mental Health, Bloomberg School of Public Health, Johns Hopkins University, 624 N Broadway, Room 798, Baltimore, MD, USA.,Department of Neuropsychology, Kennedy Krieger Institute, Johns Hopkins University, Baltimore, MD, USA
| | | | - Renee M Johnson
- Department of Mental Health, Bloomberg School of Public Health, Johns Hopkins University, 624 N Broadway, Room 798, Baltimore, MD, USA
| | - M Daniele Fallin
- Department of Mental Health, Bloomberg School of Public Health, Johns Hopkins University, 624 N Broadway, Room 798, Baltimore, MD, USA
| | - Elizabeth A Stuart
- Department of Mental Health, Bloomberg School of Public Health, Johns Hopkins University, 624 N Broadway, Room 798, Baltimore, MD, USA
| |
Collapse
|
16
|
Riehm KE, Holingue C, Kalb LG, Bennett D, Kapteyn A, Jiang Q, Veldhuis CB, Johnson RM, Fallin MD, Kreuter F, Stuart EA, Thrul J. Associations Between Media Exposure and Mental Distress Among U.S. Adults at the Beginning of the COVID-19 Pandemic. Am J Prev Med 2020; 59:630-638. [PMID: 33011008 PMCID: PMC7351429 DOI: 10.1016/j.amepre.2020.06.008] [Citation(s) in RCA: 74] [Impact Index Per Article: 18.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/16/2020] [Revised: 06/24/2020] [Accepted: 06/26/2020] [Indexed: 01/10/2023]
Abstract
INTRODUCTION Exposure to disaster-related media may be a risk factor for mental distress, but this has not been examined in the context of the COVID-19 pandemic. This study assesses whether exposure to social and traditional media during the rise of the COVID-19 pandemic was associated with mental distress among U.S. adults. METHODS Data came from the Understanding America Study, conducted with a cross-sectional, nationally representative sample of adults who completed surveys online. Participants included 6,329 adults surveyed between March 10 and March 31, 2020. Regression analyses examined the associations of (1) self-reported average time spent on social media in a day (hours) and (2) number of traditional media sources (radio, TV, and newspaper) consulted to learn about COVID-19 with self-reported mental distress (4-item Patient Health Questionnaire). Data were analyzed in April 2020. RESULTS Participants responding at later survey dates reported more time spent on social media (β=0.02, 95% CI=0.01, 0.03), a greater number of traditional media sources consulted to learn about COVID-19 (β=0.01, 95% CI=0.01, 0.02), and greater mental distress (β=0.07, 95% CI=0.04, 0.09). Increased time spent on social media and consulting a greater number of traditional media sources to learn about COVID-19 were independently associated with increased mental distress, even after adjusting for potential confounders (social media: β=0.14, 95% CI=0.05, 0.23; traditional media: β=0.14, 95% CI=0.08, 0.20). CONCLUSIONS Exposure to a greater number of traditional media sources and more hours on social media was modestly associated with mental distress during the rise of the COVID-19 pandemic in the U.S.
Collapse
Affiliation(s)
- Kira E Riehm
- Department of Mental Health, Bloomberg School of Public Health, Johns Hopkins University, Baltimore, Maryland.
| | - Calliope Holingue
- Department of Mental Health, Bloomberg School of Public Health, Johns Hopkins University, Baltimore, Maryland; Department of Neuropsychology, Kennedy Krieger Institute, Johns Hopkins University, Baltimore, Maryland
| | - Luther G Kalb
- Department of Mental Health, Bloomberg School of Public Health, Johns Hopkins University, Baltimore, Maryland; Department of Neuropsychology, Kennedy Krieger Institute, Johns Hopkins University, Baltimore, Maryland
| | - Daniel Bennett
- Center for Economic and Social Research, University of Southern California, Los Angeles, California
| | - Arie Kapteyn
- Center for Economic and Social Research, University of Southern California, Los Angeles, California
| | - Qin Jiang
- Center for Economic and Social Research, University of Southern California, Los Angeles, California
| | | | - Renee M Johnson
- Department of Mental Health, Bloomberg School of Public Health, Johns Hopkins University, Baltimore, Maryland
| | - M Daniele Fallin
- Department of Mental Health, Bloomberg School of Public Health, Johns Hopkins University, Baltimore, Maryland
| | - Frauke Kreuter
- Joint Program in Survey Methodology, University of Maryland, College Park, Maryland; School of Social Sciences, University of Mannheim, Mannheim, Germany; Statistical Methods Group, Institute for Employment Research, Nuremberg, Germany
| | - Elizabeth A Stuart
- Department of Mental Health, Bloomberg School of Public Health, Johns Hopkins University, Baltimore, Maryland
| | - Johannes Thrul
- Department of Mental Health, Bloomberg School of Public Health, Johns Hopkins University, Baltimore, Maryland
| |
Collapse
|
17
|
Holingue C, Kalb LG, Riehm KE, Bennett D, Kapteyn A, Veldhuis CB, Johnson RM, Fallin MD, Kreuter F, Stuart EA, Thrul J. Mental Distress in the United States at the Beginning of the COVID-19 Pandemic. Am J Public Health 2020; 110:1628-1634. [PMID: 32941066 PMCID: PMC7542294 DOI: 10.2105/ajph.2020.305857] [Citation(s) in RCA: 112] [Impact Index Per Article: 28.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/21/2020] [Indexed: 11/04/2022]
Abstract
Objectives. To assess the impact of the COVID-19 pandemic on mental distress in US adults.Methods. Participants were 5065 adults from the Understanding America Study, a probability-based Internet panel representative of the US adult population. The main exposure was survey completion date (March 10-16, 2020). The outcome was mental distress measured via the 4-item version of the Patient Health Questionnaire.Results. Among states with 50 or more COVID-19 cases as of March 10, each additional day was significantly associated with an 11% increase in the odds of moving up a category of distress (odds ratio = 1.11; 95% confidence interval = 1.01, 1.21; P = .02). Perceptions about the likelihood of getting infected, death from the virus, and steps taken to avoid infecting others were associated with increased mental distress in the model that included all states. Individuals with higher consumption of alcohol or cannabis or with history of depressive symptoms were at significantly higher risk for mental distress.Conclusions. These data suggest that as the COVID-19 pandemic continues, mental distress may continue to increase and should be regularly monitored. Specific populations are at high risk for mental distress, particularly those with preexisting depressive symptoms.
Collapse
Affiliation(s)
- Calliope Holingue
- Calliope Holingue and Luther G. Kalb are with the Department of Neuropsychology, Kennedy Krieger Institute, Baltimore, MD. Kira E. Riehm, Renee M. Johnson, M. Daniele Fallin, Elizabeth A. Stuart, and Johannes Thrul are with the Department of Mental Health, Johns Hopkins Bloomberg School of Public Health, Baltimore. Daniel Bennett and Arie Kapteyn are with the Center for Economic and Social Research, University of Southern California, Los Angeles. Cindy B. Veldhuis is with the School of Nursing, Columbia University, New York, NY. Frauke Kreuter is with the Maryland Population Research Center, University of Maryland, College Park
| | - Luther G Kalb
- Calliope Holingue and Luther G. Kalb are with the Department of Neuropsychology, Kennedy Krieger Institute, Baltimore, MD. Kira E. Riehm, Renee M. Johnson, M. Daniele Fallin, Elizabeth A. Stuart, and Johannes Thrul are with the Department of Mental Health, Johns Hopkins Bloomberg School of Public Health, Baltimore. Daniel Bennett and Arie Kapteyn are with the Center for Economic and Social Research, University of Southern California, Los Angeles. Cindy B. Veldhuis is with the School of Nursing, Columbia University, New York, NY. Frauke Kreuter is with the Maryland Population Research Center, University of Maryland, College Park
| | - Kira E Riehm
- Calliope Holingue and Luther G. Kalb are with the Department of Neuropsychology, Kennedy Krieger Institute, Baltimore, MD. Kira E. Riehm, Renee M. Johnson, M. Daniele Fallin, Elizabeth A. Stuart, and Johannes Thrul are with the Department of Mental Health, Johns Hopkins Bloomberg School of Public Health, Baltimore. Daniel Bennett and Arie Kapteyn are with the Center for Economic and Social Research, University of Southern California, Los Angeles. Cindy B. Veldhuis is with the School of Nursing, Columbia University, New York, NY. Frauke Kreuter is with the Maryland Population Research Center, University of Maryland, College Park
| | - Daniel Bennett
- Calliope Holingue and Luther G. Kalb are with the Department of Neuropsychology, Kennedy Krieger Institute, Baltimore, MD. Kira E. Riehm, Renee M. Johnson, M. Daniele Fallin, Elizabeth A. Stuart, and Johannes Thrul are with the Department of Mental Health, Johns Hopkins Bloomberg School of Public Health, Baltimore. Daniel Bennett and Arie Kapteyn are with the Center for Economic and Social Research, University of Southern California, Los Angeles. Cindy B. Veldhuis is with the School of Nursing, Columbia University, New York, NY. Frauke Kreuter is with the Maryland Population Research Center, University of Maryland, College Park
| | - Arie Kapteyn
- Calliope Holingue and Luther G. Kalb are with the Department of Neuropsychology, Kennedy Krieger Institute, Baltimore, MD. Kira E. Riehm, Renee M. Johnson, M. Daniele Fallin, Elizabeth A. Stuart, and Johannes Thrul are with the Department of Mental Health, Johns Hopkins Bloomberg School of Public Health, Baltimore. Daniel Bennett and Arie Kapteyn are with the Center for Economic and Social Research, University of Southern California, Los Angeles. Cindy B. Veldhuis is with the School of Nursing, Columbia University, New York, NY. Frauke Kreuter is with the Maryland Population Research Center, University of Maryland, College Park
| | - Cindy B Veldhuis
- Calliope Holingue and Luther G. Kalb are with the Department of Neuropsychology, Kennedy Krieger Institute, Baltimore, MD. Kira E. Riehm, Renee M. Johnson, M. Daniele Fallin, Elizabeth A. Stuart, and Johannes Thrul are with the Department of Mental Health, Johns Hopkins Bloomberg School of Public Health, Baltimore. Daniel Bennett and Arie Kapteyn are with the Center for Economic and Social Research, University of Southern California, Los Angeles. Cindy B. Veldhuis is with the School of Nursing, Columbia University, New York, NY. Frauke Kreuter is with the Maryland Population Research Center, University of Maryland, College Park
| | - Renee M Johnson
- Calliope Holingue and Luther G. Kalb are with the Department of Neuropsychology, Kennedy Krieger Institute, Baltimore, MD. Kira E. Riehm, Renee M. Johnson, M. Daniele Fallin, Elizabeth A. Stuart, and Johannes Thrul are with the Department of Mental Health, Johns Hopkins Bloomberg School of Public Health, Baltimore. Daniel Bennett and Arie Kapteyn are with the Center for Economic and Social Research, University of Southern California, Los Angeles. Cindy B. Veldhuis is with the School of Nursing, Columbia University, New York, NY. Frauke Kreuter is with the Maryland Population Research Center, University of Maryland, College Park
| | - M Daniele Fallin
- Calliope Holingue and Luther G. Kalb are with the Department of Neuropsychology, Kennedy Krieger Institute, Baltimore, MD. Kira E. Riehm, Renee M. Johnson, M. Daniele Fallin, Elizabeth A. Stuart, and Johannes Thrul are with the Department of Mental Health, Johns Hopkins Bloomberg School of Public Health, Baltimore. Daniel Bennett and Arie Kapteyn are with the Center for Economic and Social Research, University of Southern California, Los Angeles. Cindy B. Veldhuis is with the School of Nursing, Columbia University, New York, NY. Frauke Kreuter is with the Maryland Population Research Center, University of Maryland, College Park
| | - Frauke Kreuter
- Calliope Holingue and Luther G. Kalb are with the Department of Neuropsychology, Kennedy Krieger Institute, Baltimore, MD. Kira E. Riehm, Renee M. Johnson, M. Daniele Fallin, Elizabeth A. Stuart, and Johannes Thrul are with the Department of Mental Health, Johns Hopkins Bloomberg School of Public Health, Baltimore. Daniel Bennett and Arie Kapteyn are with the Center for Economic and Social Research, University of Southern California, Los Angeles. Cindy B. Veldhuis is with the School of Nursing, Columbia University, New York, NY. Frauke Kreuter is with the Maryland Population Research Center, University of Maryland, College Park
| | - Elizabeth A Stuart
- Calliope Holingue and Luther G. Kalb are with the Department of Neuropsychology, Kennedy Krieger Institute, Baltimore, MD. Kira E. Riehm, Renee M. Johnson, M. Daniele Fallin, Elizabeth A. Stuart, and Johannes Thrul are with the Department of Mental Health, Johns Hopkins Bloomberg School of Public Health, Baltimore. Daniel Bennett and Arie Kapteyn are with the Center for Economic and Social Research, University of Southern California, Los Angeles. Cindy B. Veldhuis is with the School of Nursing, Columbia University, New York, NY. Frauke Kreuter is with the Maryland Population Research Center, University of Maryland, College Park
| | - Johannes Thrul
- Calliope Holingue and Luther G. Kalb are with the Department of Neuropsychology, Kennedy Krieger Institute, Baltimore, MD. Kira E. Riehm, Renee M. Johnson, M. Daniele Fallin, Elizabeth A. Stuart, and Johannes Thrul are with the Department of Mental Health, Johns Hopkins Bloomberg School of Public Health, Baltimore. Daniel Bennett and Arie Kapteyn are with the Center for Economic and Social Research, University of Southern California, Los Angeles. Cindy B. Veldhuis is with the School of Nursing, Columbia University, New York, NY. Frauke Kreuter is with the Maryland Population Research Center, University of Maryland, College Park
| |
Collapse
|
18
|
Holingue C, Badillo-Goicoechea E, Riehm KE, Veldhuis CB, Thrul J, Johnson RM, Fallin MD, Kreuter F, Stuart EA, Kalb LG. Mental distress during the COVID-19 pandemic among US adults without a pre-existing mental health condition: Findings from American trend panel survey. Prev Med 2020; 139:106231. [PMID: 32758507 PMCID: PMC7846292 DOI: 10.1016/j.ypmed.2020.106231] [Citation(s) in RCA: 117] [Impact Index Per Article: 29.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/05/2020] [Revised: 07/11/2020] [Accepted: 08/02/2020] [Indexed: 10/23/2022]
Abstract
Most individuals in the United States have no history of a mental health condition yet are at risk for psychological distress due to the COVID-19 pandemic. The objective of this study was to assess the frequency and risk and protective factors of psychological distress, during the beginning of the COVID-19 pandemic, in this group. Data comes from the Pew Research Center's American Trends Panel (ATP), a probability-based online survey panel representative of the US adult population. The analytic sample consisted of 9687 individuals with no prior history of a mental health condition who completed the survey between March 19-24, 2020. Explanatory variables included sociodemographic factors and items related to behavior, perceptions, and experiences surrounding the pandemic. The outcome was psychological distress, measured by five items on symptoms of anxiety, depression, loneliness, sleep difficulties, and hyperarousal. A multivariable linear regression model was used to identify risk and protective factors for psychological distress. Fifteen percent of the sample experienced 2 psychological distress symptoms for at least 3 days over the past week; 13% had three or more symptoms. Risk factors for higher distress included searching online or using social media to post about coronavirus, reporting that the outbreak caused major changes to personal life, and perception that the virus was a threat to the US economy, the individual's personal health or finances. This has important implications for mental health service delivery.
Collapse
Affiliation(s)
- Calliope Holingue
- Department of Mental Health, Johns Hopkins Bloomberg School of Public Health, United States of America; Department of Neuropsychology, Kennedy Krieger Institute, United States of America.
| | - Elena Badillo-Goicoechea
- Department of Mental Health, Johns Hopkins Bloomberg School of Public Health, United States of America
| | - Kira E Riehm
- Department of Mental Health, Johns Hopkins Bloomberg School of Public Health, United States of America
| | | | - Johannes Thrul
- Department of Mental Health, Johns Hopkins Bloomberg School of Public Health, United States of America
| | - Renee M Johnson
- Department of Mental Health, Johns Hopkins Bloomberg School of Public Health, United States of America
| | - M Daniele Fallin
- Department of Mental Health, Johns Hopkins Bloomberg School of Public Health, United States of America
| | - Frauke Kreuter
- University of Maryland, College Park, United States of America; University of Mannheim, Germany; Institute for Employment Research, Nuremberg, Germany
| | - Elizabeth A Stuart
- Department of Mental Health, Johns Hopkins Bloomberg School of Public Health, United States of America
| | - Luther G Kalb
- Department of Mental Health, Johns Hopkins Bloomberg School of Public Health, United States of America; Department of Neuropsychology, Kennedy Krieger Institute, United States of America
| |
Collapse
|
19
|
Gilan* D, Röthke* N, Blessin M, Kunzler A, Stoffers-Winterling J, Müssig M, S. L. Yuen K, Tüscher O, Thrul J, Kreuter F, Sprengholz P, Betsch C, Dieter Stieglitz R, Lieb K. Psychomorbidity, Resilience, and Exacerbating and Protective Factors During the SARS-CoV-2 Pandemic. Dtsch Arztebl Int 2020; 117:625-630. [PMID: 33200744 PMCID: PMC7817784 DOI: 10.3238/arztebl.2020.0625] [Citation(s) in RCA: 36] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/11/2020] [Revised: 05/11/2020] [Accepted: 07/28/2020] [Indexed: 12/19/2022]
Abstract
BACKGROUND The SARS-CoV-2 pandemic has caused mental stress in a number of ways: overstrain of the health care system, lockdown of the economy, restricted opportunities for interpersonal contact and excursions outside the home and workplace, and quarantine measures where necessary. In this article, we provide an overview of psychological distress in the current pandemic, identifying protective factors and risk factors. METHODS The PubMed, PsycINFO, and Web of Science databases were systematically searched for relevant publications (1 January 2019 - 16 April 2020). This study was registered in OSF Registries (osf.io/34j8g). Data on mental stress and resilience in Germany were obtained from three surveys carried out on more than 1000 participants each in the framework of the COSMO study (24 March, 31 March, and 21 April 2020). RESULTS 18 studies from China and India, with a total of 79 664 participants, revealed increased stress in the general population, with manifestations of depression and anxiety, post-traumatic stress, and sleep disturbances. Stress was more marked among persons working in the health care sector. Risk factors for stress included patient contact, female sex, impaired health status, worry about family members and significant others, and poor sleep quality. Protective factors included being informed about the increasing number of persons who have recovered from COVID, social support, and a lower perceived infectious risk. The COSMO study, though based on an insufficiently representative population sample because of a low questionnaire return rate (<20%), revealed increased rates of despondency, loneliness, and hopelessness in the German population as compared to norm data, with no change in estimated resilience. CONCLUSION Stress factors associated with the current pandemic probably increase stress by causing anxiety and depression. Once the protective factors and risk factors have been identified, these can be used to develop psychosocial interventions. The informativeness of the results reported here is limited by the wide variety of instruments used to acquire data and by the insufficiently representative nature of the population samples.
Collapse
Affiliation(s)
- Donya Gilan*
- * These two authors share first authorship
- Leibniz Institute for Resilience Research, Mainz, Germany
- Department of Psychiatry and Psychotherapy, University Medical Center Mainz, Germany
| | - Nikolaus Röthke*
- * These two authors share first authorship
- Department of Psychiatry and Psychotherapy, University Medical Center Mainz, Germany
| | | | - Angela Kunzler
- Leibniz Institute for Resilience Research, Mainz, Germany
| | - Jutta Stoffers-Winterling
- Leibniz Institute for Resilience Research, Mainz, Germany
- Department of Psychiatry and Psychotherapy, University Medical Center Mainz, Germany
| | - Markus Müssig
- Leibniz Institute for Resilience Research, Mainz, Germany
| | - Kenneth S. L. Yuen
- Leibniz Institute for Resilience Research, Mainz, Germany
- Human Neuroimaging Center, Focus Program Translational Neurosciences (FTN) of the Johannes Gutenberg University Mainz, University Medical Center Mainz, Germany
| | - Oliver Tüscher
- Leibniz Institute for Resilience Research, Mainz, Germany
- Department of Psychiatry and Psychotherapy, University Medical Center Mainz, Germany
| | - Johannes Thrul
- Department of mental Health, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA
| | | | - Philipp Sprengholz
- Institute of media and communication sciences, University of Erfurt, Germany
| | - Cornelia Betsch
- Institute of media and communication sciences, University of Erfurt, Germany
| | | | - Klaus Lieb
- Leibniz Institute for Resilience Research, Mainz, Germany
- Department of Psychiatry and Psychotherapy, University Medical Center Mainz, Germany
| |
Collapse
|
20
|
Altmann S, Milsom L, Zillessen H, Blasone R, Gerdon F, Bach R, Kreuter F, Nosenzo D, Toussaert S, Abeler J. Acceptability of App-Based Contact Tracing for COVID-19: Cross-Country Survey Study. JMIR Mhealth Uhealth 2020; 8:e19857. [PMID: 32759102 PMCID: PMC7458659 DOI: 10.2196/19857] [Citation(s) in RCA: 166] [Impact Index Per Article: 41.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2020] [Revised: 06/29/2020] [Accepted: 07/24/2020] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND The COVID-19 pandemic is the greatest public health crisis of the last 100 years. Countries have responded with various levels of lockdown to save lives and stop health systems from being overwhelmed. At the same time, lockdowns entail large socioeconomic costs. One exit strategy under consideration is a mobile phone app that traces the close contacts of those infected with COVID-19. Recent research has demonstrated the theoretical effectiveness of this solution in different disease settings. However, concerns have been raised about such apps because of the potential privacy implications. This could limit the acceptability of app-based contact tracing in the general population. As the effectiveness of this approach increases strongly with app uptake, it is crucial to understand public support for this intervention. OBJECTIVE The objective of this study is to investigate the user acceptability of a contact-tracing app in five countries hit by the pandemic. METHODS We conducted a largescale, multicountry study (N=5995) to measure public support for the digital contact tracing of COVID-19 infections. We ran anonymous online surveys in France, Germany, Italy, the United Kingdom, and the United States. We measured intentions to use a contact-tracing app across different installation regimes (voluntary installation vs automatic installation by mobile phone providers) and studied how these intentions vary across individuals and countries. RESULTS We found strong support for the app under both regimes, in all countries, across all subgroups of the population, and irrespective of regional-level COVID-19 mortality rates. We investigated the main factors that may hinder or facilitate uptake and found that concerns about cybersecurity and privacy, together with a lack of trust in the government, are the main barriers to adoption. CONCLUSIONS Epidemiological evidence shows that app-based contact tracing can suppress the spread of COVID-19 if a high enough proportion of the population uses the app and that it can still reduce the number of infections if uptake is moderate. Our findings show that the willingness to install the app is very high. The available evidence suggests that app-based contact tracing may be a viable approach to control the diffusion of COVID-19.
Collapse
Affiliation(s)
| | - Luke Milsom
- University of Oxford, Oxford, United Kingdom
| | | | | | | | - Ruben Bach
- University of Mannheim, Mannheim, Germany
| | - Frauke Kreuter
- University of Mannheim, Mannheim, Germany
- University of Maryland, College Park, MD, United States
- Institute for Employment Research, Nürnberg, Germany
| | - Daniele Nosenzo
- Aarhus University, Aarhus, Denmark
- University of Nottingham, Nottingham, United Kingdom
| | | | | |
Collapse
|
21
|
Altmann S, Milsom L, Zillessen H, Blasone R, Gerdon F, Bach R, Kreuter F, Nosenzo D, Toussaert S, Abeler J. Acceptability of App-Based Contact Tracing for COVID-19: Cross-Country Survey Study. JMIR Mhealth Uhealth 2020. [PMID: 32759102 DOI: 10.1101/2020.05.05.20091587v1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/18/2023] Open
Abstract
BACKGROUND The COVID-19 pandemic is the greatest public health crisis of the last 100 years. Countries have responded with various levels of lockdown to save lives and stop health systems from being overwhelmed. At the same time, lockdowns entail large socioeconomic costs. One exit strategy under consideration is a mobile phone app that traces the close contacts of those infected with COVID-19. Recent research has demonstrated the theoretical effectiveness of this solution in different disease settings. However, concerns have been raised about such apps because of the potential privacy implications. This could limit the acceptability of app-based contact tracing in the general population. As the effectiveness of this approach increases strongly with app uptake, it is crucial to understand public support for this intervention. OBJECTIVE The objective of this study is to investigate the user acceptability of a contact-tracing app in five countries hit by the pandemic. METHODS We conducted a largescale, multicountry study (N=5995) to measure public support for the digital contact tracing of COVID-19 infections. We ran anonymous online surveys in France, Germany, Italy, the United Kingdom, and the United States. We measured intentions to use a contact-tracing app across different installation regimes (voluntary installation vs automatic installation by mobile phone providers) and studied how these intentions vary across individuals and countries. RESULTS We found strong support for the app under both regimes, in all countries, across all subgroups of the population, and irrespective of regional-level COVID-19 mortality rates. We investigated the main factors that may hinder or facilitate uptake and found that concerns about cybersecurity and privacy, together with a lack of trust in the government, are the main barriers to adoption. CONCLUSIONS Epidemiological evidence shows that app-based contact tracing can suppress the spread of COVID-19 if a high enough proportion of the population uses the app and that it can still reduce the number of infections if uptake is moderate. Our findings show that the willingness to install the app is very high. The available evidence suggests that app-based contact tracing may be a viable approach to control the diffusion of COVID-19.
Collapse
Affiliation(s)
| | - Luke Milsom
- University of Oxford, Oxford, United Kingdom
| | | | | | | | - Ruben Bach
- University of Mannheim, Mannheim, Germany
| | - Frauke Kreuter
- University of Mannheim, Mannheim, Germany
- University of Maryland, College Park, MD, United States
- Institute for Employment Research, Nürnberg, Germany
| | - Daniele Nosenzo
- Aarhus University, Aarhus, Denmark
- University of Nottingham, Nottingham, United Kingdom
| | | | | |
Collapse
|
22
|
Sakshaug JW, Stegmaier J, Trappmann M, Kreuter F. Does Benefit Framing Improve Record Linkage Consent Rates? A Survey Experiment. Surv Res Methods 2019; 13:289-304. [PMID: 32849920 PMCID: PMC7447194] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Survey researchers are increasingly seeking opportunities to link interview data with administrative records. However, obtaining consent from all survey respondents (or certain subgroups) remains a barrier to performing record linkage in many studies. We experimentally investigated whether emphasizing different benefits of record linkage to respondents in a telephone survey of employee working conditions improves respondents' willingness to consent to linkage of employment administrative records relative to a neutral consent request. We found that emphasizing linkage benefits related to "time savings" yielded a small, albeit statistically significant, improvement in the overall linkage consent rate (86.0) relative to the neutral consent request (83.8 percent). The time savings argument was particularly effective among "busy" respondents. A second benefit argument related to "improved study value" did not yield a statistically significant improvement in the linkage consent rate (84.4 percent) relative to the neutral request. This benefit argument was also ineffective among the subgroup of respondents considered to be most likely to have a self-interest in the study outcomes. The article concludes with a brief discussion of the practical implications of these findings and offers suggestions for possible research extensions.
Collapse
Affiliation(s)
- Joseph W Sakshaug
- Institute for Employment Research (IAB), Ludwig Maximilian University of Munich, and University of Mannheim
| | | | - Mark Trappmann
- Institute for Employment Research (IAB), and University of Bamberg
| | - Frauke Kreuter
- Institute for Employment Research (IAB), University of Mannheim, and University of Maryland
| |
Collapse
|
23
|
Abstract
Trust is praised by many social scientists as the foundation of functioning social systems owing to its assumed connection to cooperative behavior. The existence of such a link is still subject to debate. In the present study, we first highlight important conceptual issues within this debate. Second, we examine previous evidence, highlighting several issues. Third, we present findings from an original experiment, in which we tried to identify a “real” situation that allowed us to measure both trust and cooperation. People’s expectations and behavior when they decide to share (or not) their data represents such a situation, and we make use of corresponding data. We found that there is no relationship between trust and cooperation. This non-relationship may be rationalized in different ways which, in turn, provides important lessons for the study of the trust—behavior nexus beyond the particular situation we study empirically.
Collapse
Affiliation(s)
- Paul C. Bauer
- Mannheim Centre for European Social Research (MZES), University of Mannheim, Mannheim, Germany
- * E-mail:
| | - Florian Keusch
- Department of Sociology, University of Mannheim, Mannheim, Germany
| | - Frauke Kreuter
- Department of Sociology, University of Mannheim, Mannheim, Germany
- Joint Program in Survey Methodology, University of Maryland, College Park, Maryland, United States of America
- Institute for Employment Research, Nuremberg, Germany
| |
Collapse
|
24
|
Abstract
Numerous surveys link interview data to administrative records, conditional on respondent consent, in order to explore new and innovative research questions. Optimizing the linkage consent rate is a critical step toward realizing the scientific advantages of record linkage and minimizing the risk of linkage consent bias. Linkage consent rates have been shown to be particularly sensitive to certain design features, such as where the consent question is placed in the questionnaire and how the question is framed. However, the interaction of these design features and their relative contributions to the linkage consent rate have never been jointly studied, raising the practical question of which design feature (or combination of features) should be prioritized from a consent rate perspective. We address this knowledge gap by reporting the results of a placement and framing experiment embedded within separate telephone and Web surveys. We find a significant interaction between placement and framing of the linkage consent question on the consent rate. The effect of placement was larger than the effect of framing in both surveys, and the effect of framing was only evident in the Web survey when the consent question was placed at the end of the questionnaire. Both design features had negligible impact on linkage consent bias for a series of administrative variables available for consenters and non-consenters. We conclude this research note with guidance on the optimal administration of the linkage consent question.
Collapse
Affiliation(s)
- Joseph W Sakshaug
- Address correspondence to Joseph W. Sakshaug, Statistical Methods Research Department, Institute for Employment Research, 104 Regensburger Strasse, Nuremberg 90478, Germany;
| | | | | | | | | |
Collapse
|
25
|
Keusch F, Struminskaya B, Antoun C, Couper MP, Kreuter F. Willingness to Participate in Passive Mobile Data Collection. Public Opin Q 2019; 83:210-235. [PMID: 31337924 PMCID: PMC6639765 DOI: 10.1093/poq/nfz007] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/27/2023]
Abstract
The rising penetration of smartphones now gives researchers the chance to collect data from smartphone users through passive mobile data collection via apps. Examples of passively collected data include geolocation, physical movements, online behavior and browser history, and app usage. However, to passively collect data from smartphones, participants need to agree to download a research app to their smartphone. This leads to concerns about nonconsent and nonparticipation. In the current study, we assess the circumstances under which smartphone users are willing to participate in passive mobile data collection. We surveyed 1,947 members of a German nonprobability online panel who own a smartphone using vignettes that described hypothetical studies where data are automatically collected by a research app on a participant's smartphone. The vignettes varied the levels of several dimensions of the hypothetical study, and respondents were asked to rate their willingness to participate in such a study. Willingness to participate in passive mobile data collection is strongly influenced by the incentive promised for study participation but also by other study characteristics (sponsor, duration of data collection period, option to switch off the app) as well as respondent characteristics (privacy and security concerns, smartphone experience).
Collapse
Affiliation(s)
- Florian Keusch
- School of Social Sciences at the University of Mannheim, Mannheim, Germany
- Joint Program in Survey Methodology at the University of Maryland, College Park, MD, USA
| | - Bella Struminskaya
- Department of Methodology and Statistics at Utrecht University, Utrecht, the Netherlands
| | - Christopher Antoun
- College of Information Studies and the Joint Program in Survey Methodology at the University of Maryland, College Park, MD, USA
| | - Mick P Couper
- Survey Research Center, Institute for Social Research, University of Michigan, Ann Arbor, MI, USA
- Joint Program in Survey Methodology, University of Maryland, College Park, MD, USA
| | - Frauke Kreuter
- University of Mannheim, Mannheim, Germany, and head of the Statistical Methods Research Department at IAB, Nuremberg, Germany
| |
Collapse
|
26
|
Kern C, Klausch T, Kreuter F. Tree-based Machine Learning Methods for Survey Research. Surv Res Methods 2019; 13:73-93. [PMID: 32802211 PMCID: PMC7425836] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Predictive modeling methods from the field of machine learning have become a popular tool across various disciplines for exploring and analyzing diverse data. These methods often do not require specific prior knowledge about the functional form of the relationship under study and are able to adapt to complex non-linear and non-additive interrelations between the outcome and its predictors while focusing specifically on prediction performance. This modeling perspective is beginning to be adopted by survey researchers in order to adjust or improve various aspects of data collection and/or survey management. To facilitate this strand of research, this paper (1) provides an introduction to prominent tree-based machine learning methods, (2) reviews and discusses previous and (potential) prospective applications of tree-based supervised learning in survey research, and (3) exemplifies the usage of these techniques in the context of modeling and predicting nonresponse in panel surveys.
Collapse
|
27
|
Marlar J, Chattopadhyay M, Jones J, Marken S, Kreuter F. Within-Household Selection and Dual-Frame Telephone Surveys: A Comparative Experiment of Eleven Different Selection Methods. ACTA ACUST UNITED AC 2018. [DOI: 10.29115/sp-2018-0031] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
28
|
West BT, Kreuter F. Strategies for Increasing the Accuracy of Interviewer Observations of Respondent Features: Evidence from the U.S. National Survey of Family Growth. Methodology (Gott) 2018; 14:16-29. [PMID: 29731702 DOI: 10.1027/1614-2241/a000142] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022] Open
Abstract
Because survey response rates are consistently declining worldwide, survey researchers strive to obtain as much auxiliary information on sampled units as possible. Surveys using in-person interviewing often request that interviewers collect observations on key features of all sampled units, given that interviewers are the eyes and ears of the survey organization. Unfortunately, these observations are prone to error, which decreases the effectiveness of nonresponse adjustments based on the observations. No studies have investigated the strategies being used by interviewers tasked with making these observations, or examined whether certain strategies improve observation accuracy. This study is the first to examine the associations of observational strategies used by survey interviewers with the accuracy of observations collected by those interviewers. A qualitative analysis followed by multilevel models of observation accuracy show that focusing on relevant correlates of the feature being observed and considering a diversity of cues are associated with increased observation accuracy.
Collapse
Affiliation(s)
- Brady T West
- Survey Research Center, Institute for Social Research, 426 Thompson Street, Ann Arbor, MI, 48104
| | - Frauke Kreuter
- Joint Program in Survey Methodology, 1218 LeFrak Hall, College Park, MD, 20742 and University of Mannheim, Mannheim, Germany and Institute for Employment Research, Nuremberg, Germany
| |
Collapse
|
29
|
Oberski DL, Kirchner A, Eckman S, Kreuter F. Evaluating the Quality of Survey and Administrative Data with Generalized Multitrait-Multimethod Models. J Am Stat Assoc 2018. [DOI: 10.1080/01621459.2017.1302338] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Affiliation(s)
- D. L. Oberski
- Department of Methodology & Statistics, Utrecht University, Utrecht, The Netherlands
| | - A. Kirchner
- Survey Research Division, RTI International, NC
- University of Nebraska, Lincoln, NE
| | - S. Eckman
- Survey Research Division, RTI International, NC
| | - F. Kreuter
- Statistical Methods Group at the Institute for Employment Research, Nürnberg, Germany
- School of Social Science, University of Mannheim, Mannheim, Germany
- Joint Program in Survey Methodology, University of Maryland, College Park, MD
| |
Collapse
|
30
|
|
31
|
Casas-Cordero C, Kreuter F, Wang Y, Babey S. Assessing the measurement error properties of interviewer observations of neighbourhood characteristics. J R Stat Soc Ser A Stat Soc 2013; 176:227-249. [PMID: 24159255 PMCID: PMC3804382 DOI: 10.1111/j.1467-985x.2012.01065.x] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/02/2023]
Abstract
Interviewer observations made during the process of data collection are currently used to inform responsive design decisions, to expand the set of covariates for nonresponse adjustments, to explain participation in surveys, and to assess nonresponse bias. However, little effort has been made to assess the quality of such interviewer observations. Using data from the Los Angeles Family and Neighbourhood Survey (L.A.FANS), this paper examines measurement error properties of interviewer observations of neighbourhood characteristics. Block level and interviewer covariates are used in multilevel models to explain interviewer variation in the observations of neighbourhood features.
Collapse
|
32
|
Yan T, Kreuter F, Tourangeau R. Latent class analysis of response inconsistencies across modes of data collection. Soc Sci Res 2012; 41:1017-1027. [PMID: 23017914 DOI: 10.1016/j.ssresearch.2012.05.006] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/07/2011] [Revised: 12/15/2011] [Accepted: 05/02/2012] [Indexed: 06/01/2023]
Abstract
Latent class analysis (LCA) has been hailed as a promising technique for studying measurement errors in surveys, because the models produce estimates of the error rates associated with a given question. Still, the issue arises as to how accurate these error estimates are and under what circumstances they can be relied on. Skeptics argue that latent class models can understate the true error rates and at least one paper (Kreuter et al., 2008) demonstrates such underestimation empirically. We applied latent class models to data from two waves of the National Survey of Family Growth (NSFG), focusing on a pair of similar items about abortion that are administered under different modes of data collection. The first item is administered by computer-assisted personal interviewing (CAPI); the second, by audio computer-assisted self-interviewing (ACASI). Evidence shows that abortions are underreported in the NSFG and the conventional wisdom is that ACASI item yields fewer false negatives than the CAPI item. To evaluate these items, we made assumptions about the error rates within various subgroups of the population; these assumptions were needed to achieve an identifiable LCA model. Because there are external data available on the actual prevalence of abortion (by subgroup), we were able to form subgroups for which the identifying restrictions were likely to be (approximately) met and other subgroups for which the assumptions were likely to be violated. We also ran more complex models that took potential heterogeneity within subgroups into account. Most of the models yielded implausibly low error rates, supporting the argument that, under specific conditions, LCA models underestimate the error rates.
Collapse
Affiliation(s)
- Ting Yan
- NORC at the University of Chicago, United States
| | | | | |
Collapse
|
33
|
Abstract
Abstract. In large-scale educational assessments such as the Third International Mathematics and Sciences Study (TIMSS) or the Program for International Student Assessment (PISA), sizeable numbers of test administrators (TAs) are needed to conduct the assessment sessions in the participating schools. TA training sessions are run and administration manuals are compiled with the aim of ensuring standardized, comparable, assessment situations in all student groups. To date, however, there has been no empirical investigation of the effectiveness of these standardizing efforts. In the present article, we probe for systematic TA effects on mathematics achievement and sample attrition in a student achievement study. Multilevel analyses for cross-classified data using Markov Chain Monte Carlo (MCMC) procedures were performed to separate the variance that can be attributed to differences between schools from the variance associated with TAs. After controlling for school effects, only a very small, nonsignificant proportion of the variance in mathematics scores and response behavior was attributable to the TAs (< 1%). We discuss practical implications of these findings for the deployment of TAs in educational assessments.
Collapse
Affiliation(s)
- Oliver Lüdtke
- Max Planck Institute for Human Development, Berlin, Germany
| | | | | | - Frauke Kreuter
- Joint Program in Survey Methodology, UMD College Park, USA
| | | |
Collapse
|
34
|
Abstract
Owing to the very low economic value of brewer's spent grains, its utilisation for biogas production is very promising. The hydrolysis of ligno-cellulose is the rate limiting step in anaerobic digestion. Enzymatic pre-treatment promotes the hydrolysis of ligno-cellulose, breaking it down to lower molecular weight substances which are ready to be utilised by the bacteria. A cheap raw multi-enzyme produced by a solid state fermentation (SSF) process is a good substitute for expensive conventional enzyme. The SSF enzyme application to spent grain has been investigated by carrying out enzymatic solubility tests, hydrolytic experiments and two-step anaerobic fermentation of spent grain. Gas chromatograph analysis was conducted to quantify fatty acids concentrations, while CH(4), CO(2), O(2), H(2) and H(2)S were measured to determine biogas quality by means of a gas analyser. DS, oDS, pH were also measured to analyse the anaerobic digestion. The result shows that enzyme application promotes the hydrolysis of ligno-cellulose, indicated by higher enzymatic solubility and fatty acid concentration in a hydrolytic bioreactor. Moreover, biogas production is also increased. The quality of the gases produced is also enhanced. Since the anaerobic digestion can be operated in a stable performance, it can also be concluded that SSF enzyme is compatible with anaerobic digestion.
Collapse
Affiliation(s)
- G Bochmann
- Chair of Resource and Energy Technology, TU Munich, Weihenstephaner Steig 22, Freising, Germany.
| | | | | | | | | |
Collapse
|
35
|
Kreuter F. Numerical Issues in Statistical Computing for the Social Scientist. J Stat Softw 2005. [DOI: 10.18637/jss.v012.b05] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022] Open
|
36
|
|
37
|
Breyer-Pfaff U, Gaertner HJ, Kreuter F, Scharek G, Brinkschulte M, Wiatr R. Antidepressive effect and pharmacokinetics of amitriptyline with consideration of unbound drug and 10-hydroxynortriptyline plasma levels. Psychopharmacology (Berl) 1982; 76:240-4. [PMID: 6808544 DOI: 10.1007/bf00432553] [Citation(s) in RCA: 33] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/22/2023]
Abstract
In 27 inpatients with primary affective disorder the urinary excretion of 3-methoxy-4-hydroxyphenylglycol (MHPG) was measured prior to a 4-week treatment with 150 mg amitriptyline (AT)/day. Ratings according to the Hamilton depression scale were performed before therapy and repeated after 2 and 4 weeks. Plasma levels of AT, nortriptyline (NT), and E-10-hydroxynortriptyline (OHNT) were assayed weekly, and binding of AT to plasma proteins was determined in one sample. Better therapeutic results were obtained at intermediate, as compared to low and high concentrations of AT or AT plus NT. Independent evaluation of AT and metabolite levels revealed that patients with AT of 50--125 ng/ml responded particularly well when NT did not exceed 95 ng/ml or when NT plus OHNT was below 150 ng/ml. Outside this "therapeutic window' the outcome was markedly poorer. Interindividual variation of AT binding was much smaller than variation of total concentrations. Evaluation of free, instead of total levels did not help to clarify the relationship between clinical and pharmacokinetic variables. Plasma levels within the optimal ranges were found in more patients with high than with low MHPG excretion. The free fraction of OHNT in plasma of healthy subjects was about 35%.
Collapse
|
38
|
Gaertner HJ, Kreuter F, Scharek G, Wiatr G, Breyer-Pfaff U. Do urinary MHPG and plasma drug levels correlate with response to amitriptyline therapy? Psychopharmacology (Berl) 1982; 76:236-9. [PMID: 6808543 DOI: 10.1007/bf00432552] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/22/2023]
Abstract
Twenty-nine inpatients with primary affective disorder were treated with 150 mg amitriptyline (AT) daily for 28 days. Pretreatment urinary excretion of 3-methoxy-4-hydroxyphenylglycol (MHPG) was measured in two or three 24-h urine samples. Plasma levels of AT and nortriptyline (NT) were determined after 14, 21, and 28 days of treatment. MHPG excretion was significantly correlated with clinical response to treatment. Responders defined by two different methods showed higher pretreatment MHPG excretion than nonresponders. Correspondingly, high MHPG excretors (median split) showed significantly more improvement than low excretors. These relationships were even more apparent when possibly incomplete urine samples (creatinine excretion below 1000 mg/24h) were excluded. The high and low MHPG subgroups did not significantly differ from each other in their plasma levels of AT, NT, or AT plus NT. A significant rank correlation between clinical response and plasma levels of AT and/or NT did not exist, but there was a trend towards lower levels in responders.
Collapse
|
39
|
Neu I, Kreuter F, Prosiegel M, Pfaffenrath V, Autenrieth W, Bauer H. [Cerebrospinal fluid passage of therapeutic immunoglobulins of the IgG class in infectious inflammatory disease of the CNS]. Fortschr Med 1981; 99:1719-22. [PMID: 7319441] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 01/24/2023]
Abstract
Immunoglobulins are often used as an optimizing therapy in cases of infectious diseases of the central nervous system. To clarify the question of whether or not an intravenously administered compound of the IgG class is able to penetrate the cerebrospinal fluid barrier despite its high molecular weight, 12 anti-HBs negative patients received 20 ml each of a beta-Propiolacton treated IgG compound with a high anti-HBs titre (1 : 115 000) used as a marker. Four patients having an inconspicuous fluid condition were consulted for control. Five patients were suffering from slight disturbances and three other patients had severe disorders of the blood-cerebrospinal fluid barrier function resulting from inflammatory diseases of the central nervous systems. Cerebrospinal fluid was produced by way of lumbar puncture resp. drainage for the determination of anti-HBs. Simultaneously, the concentration of antibodies in serum was determined. In all patients having barrier disturbances, anti-HBs was evident in the cerebrospinal fluid, the transfer of intravenously administered immunoglobulins to cerebrospinal fluid increasing in correlation with the degree of the barrier disorder. The therapeutical importance of immunoglobulin therapy in treating infections of the central nervous system is pointed out.
Collapse
|
40
|
Kreuter F, Richter DW, Camerer H, Senekowitsch R. Morphological and electrical description of medullary respiratory neurons of the cat. Pflugers Arch 1977; 372:7-16. [PMID: 563586 DOI: 10.1007/bf00582200] [Citation(s) in RCA: 60] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
|