Meta-analysis in a digitalized world: A step-by-step primer

In recent years, much research and many data sources have become digital. Some advantages of digital or Internet-based research, compared to traditional lab research (e.g., comprehensive data collection and storage, availability of data) are ideal for an improved meta-analyses approach.In the meantime, in meta-analyses research, different types of meta-analyses have been developed to provide research syntheses with accurate quantitative estimations. Due to its rich and unique palette of corrections, we recommend to using the Schmidt and Hunter approach for meta-analyses in a digitalized world. Our primer shows in a step-by-step fashion how to conduct a high quality meta-analysis considering digital data and highlights the most obvious pitfalls (e.g., using only a bare-bones meta-analysis, no data comparison) not only in aggregation of the data, but also in the literature search and coding procedure which are essential steps in any meta-analysis. Thus, this primer of meta-analyses is especially suited for a situation where much of future research is headed to: digital research. To map Internet-based research and to reveal any research gap, we further synthesize meta-analyses on Internet-based research (15 articles containing 24 different meta-analyses, on 745 studies, with 1,601 effect sizes), resulting in the first mega meta-analysis of the field. We found a lack of individual participant data (e.g., age and nationality). Hence, we provide a primer for high-quality meta-analyses and mega meta-analyses that applies to much of coming research and also basic hands-on knowledge to conduct or judge the quality of a meta-analyses in a digitalized world.

Truthfulness as the basis for ethical safeguards in deceptive research: An interview study with researchers

Ethical safeguards such as debriefing are often recommended or required for research studies in which participants are deceived. However, existing guidance on these safeguards seems insufficiently coherent and precise, which may be associated with their suboptimal implementation in practice. This study aimed to contribute to a more coherent and precise framework of ethical safeguards in deceptive studies through semi-structured interviews with a diverse sample of 24 researchers who had significant experience with deception. Interviewees discussed which ethical safeguards they implemented and how, as well as their relation to the notion of truthfulness (i.e., the intentional communication of true information). Moreover, interviewees provided a variety of reasons for and against implementing these safeguards, as well as how these reasons varied with the particular context of a study. Overall, the current study contributes to a more coherent and precise understanding of ethical safeguards in deceptive research that could be useful for guiding researchers and ethics reviewers in their ethical decision-making, although certain imprecisions and incoherent aspects remain in need of further investigation and normative reflection.

Theoretical and Empirical Integration of "Dark" Traits and Socially Aversive Personality Psychopathology

Conceptual work integrating constructs from mainstream personality research (especially so-called "dark" traits) and clinical psychopathology research has been limited. Herein, we propose all socially and/or ethically aversive traits as "flavored" manifestations of the D factor of personality (D). We argue that the D framework provides the commonality of all aversive traits, including the aversive traits from the DSM-5 Alternative Model for Personality Disorders (AMPD), a more thorough theoretical foundation. Moreover, D covers aspects that are not captured by any of the aversive AMPD traits directly (e.g., greed), thus offering indications for possible expansions to the AMPD. We tested our predictions in two online studies (N = 1,781 and N = 2,006) using quota-representative samples of the German population regarding age and gender. Twelve aversive traits from mainstream personality research and eight aversive AMPD traits were assessed together with consequential behavior in an economic game. Analyses using structural equation modeling overall confirmed predictions.

Conducting organizational survey and experimental research online: From convenient to ambitious in study designs, recruiting, and data quality

Conducting organizational research via online surveys and experiments offers a host of advantages over traditional forms of data collection when it comes to sampling for more advanced study designs, while also ensuring data quality. To draw attention to these advantages and encourage researchers to fully leverage them, the present paper is structured into two parts. First, along a structure of commonly used research designs, we showcase select organizational psychology (OP) and organizational behavior (OB) research and explain how the Internet makes it feasible to conduct research not only with larger and more representative samples, but also with more complex research designs than circumstances usually allow in offline settings. Subsequently, because online data collections often also come with some data quality concerns, in the second section, we synthesize the methodological literature to outline three improvement areas and several accompanying strategies for bolstering data quality.

Plain Language Summary: These days, many theories from the fields of organizational psychology and organizational behavior are tested online simply because it is easier. The point of this paper is to illustrate the unique advantages of the Internet beyond mere convenience—specifically, how the related technologies offer more than simply the ability to mirror offline studies. Accordingly, our paper first guides readers through examples of more ambitious online survey and experimental research designs within the organizational domain. Second, we address the potential data quality drawbacks of these approaches by outlining three concrete areas of improvement. Each comes with specific recommendations that can ensure higher data quality when conducting organizational survey or experimental research online.

Web-Based Research in Psychology

Abstract. The present article reviews web-based research in psychology. It captures principles, learnings, and trends in several types of web-based research that show similar developments related to web technology and its major shifts (e.g., appearance of search engines, browser wars, deep web, commercialization, web services, HTML5…) as well as distinct challenges. The types of web-based research discussed are web surveys and questionnaire research, web-based tests, web experiments, Mobile Experience Sampling, and non-reactive web research, including big data. A number of web-based methods are presented and discussed that turned out to become important in research methodology. These are one-item-one-screen design, seriousness check, instruction manipulation and other attention checks, multiple site entry technique, subsampling technique, warm-up technique, and web-based measurement. Pitfalls and best practices are described then, especially regarding dropout and other non-response, recruitment of participants, and interaction between technology and psychological factors. The review concludes with a discussion of important concepts that have developed over 25 years and an outlook on future developments in web-based research.