1
|
Linders GM, Louwerse MM. Lingualyzer: A computational linguistic tool for multilingual and multidimensional text analysis. Behav Res Methods 2024; 56:5501-5528. [PMID: 38030922 PMCID: PMC11335911 DOI: 10.3758/s13428-023-02284-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/30/2023] [Indexed: 12/01/2023]
Abstract
Most natural language models and tools are restricted to one language, typically English. For researchers in the behavioral sciences investigating languages other than English, and for those researchers who would like to make cross-linguistic comparisons, hardly any computational linguistic tools exist, particularly none for those researchers who lack deep computational linguistic knowledge or programming skills. Yet, for interdisciplinary researchers in a variety of fields, ranging from psycholinguistics, social psychology, cognitive psychology, education, to literary studies, there certainly is a need for such a cross-linguistic tool. In the current paper, we present Lingualyzer ( https://lingualyzer.com ), an easily accessible tool that analyzes text at three different text levels (sentence, paragraph, document), which includes 351 multidimensional linguistic measures that are available in 41 different languages. This paper gives an overview of Lingualyzer, categorizes its hundreds of measures, demonstrates how it distinguishes itself from other text quantification tools, explains how it can be used, and provides validations. Lingualyzer is freely accessible for scientific purposes using an intuitive and easy-to-use interface.
Collapse
Affiliation(s)
- Guido M Linders
- Department of Cognitive Science & Artificial Intelligence, Tilburg University, Tilburg, Netherlands.
- Department of Comparative Language Science, University of Zurich, Zurich, Switzerland.
| | - Max M Louwerse
- Department of Cognitive Science & Artificial Intelligence, Tilburg University, Tilburg, Netherlands
| |
Collapse
|
2
|
Segneri L, Babina N, Hammerschmidt T, Fronzetti Colladon A, Gloor PA. Too much focus on your health might be bad for your health: Reddit user's communication style predicts their Long COVID likelihood. PLoS One 2024; 19:e0308340. [PMID: 39106232 DOI: 10.1371/journal.pone.0308340] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2023] [Accepted: 07/20/2024] [Indexed: 08/09/2024] Open
Abstract
Long Covid is a chronic disease that affects more than 65 million people worldwide, characterized by a wide range of persistent symptoms following a Covid-19 infection. Previous studies have investigated potential risk factors contributing to elevated vulnerability to Long Covid. However, research on the social traits associated with affected patients is scarce. This study introduces an innovative methodological approach that allows us to extract valuable insights directly from patients' voices. By analyzing written texts shared on social media platforms, we aim to collect information on the psychological aspects of people who report experiencing Long Covid. In particular, we collect texts of patients they wrote BEFORE they were afflicted with Long Covid. We examined the differences in communication style, sentiment, language complexity, and psychological factors of natural language use among the profiles of 6.107 Reddit users, distinguishing between those who claim they have never contracted Covid -19, those who claim to have had it, and those who claim to have experienced Long Covid symptoms. Our findings reveal that people in the Long Covid group frequently discussed health-related topics before the pandemic, indicating a greater focus on health-related concerns. Furthermore, they exhibited a more limited network of connections, lower linguistic complexity, and a greater propensity to employ emotionally charged expressions than the other groups. Using social media data, we can provide a unique opportunity to explore potential risk factors associated with Long Covid, starting from the patient's perspective.
Collapse
Affiliation(s)
- Ludovica Segneri
- Department of Engineering, University of Perugia, Perugia, Italy
| | - Nandor Babina
- Applied Information and Data Science, University of Applied Sciences Lucerne, Lucerne, Switzerland
| | | | | | - Peter A Gloor
- MIT Center for Collective Intelligence, Cambridge, MA, United States of America
| |
Collapse
|
3
|
Leung YW, Wouterloot E, Adikari A, Hong J, Asokan V, Duan L, Lam C, Kim C, Chan KP, De Silva D, Trachtenberg L, Rennie H, Wong J, Esplen MJ. Artificial Intelligence-Based Co-Facilitator (AICF) for Detecting and Monitoring Group Cohesion Outcomes in Web-Based Cancer Support Groups: Single-Arm Trial Study. JMIR Cancer 2024; 10:e43070. [PMID: 39037754 DOI: 10.2196/43070] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2022] [Revised: 07/07/2023] [Accepted: 05/08/2024] [Indexed: 07/23/2024] Open
Abstract
BACKGROUND Commonly offered as supportive care, therapist-led online support groups (OSGs) are a cost-effective way to provide support to individuals affected by cancer. One important indicator of a successful OSG session is group cohesion; however, monitoring group cohesion can be challenging due to the lack of nonverbal cues and in-person interactions in text-based OSGs. The Artificial Intelligence-based Co-Facilitator (AICF) was designed to contextually identify therapeutic outcomes from conversations and produce real-time analytics. OBJECTIVE The aim of this study was to develop a method to train and evaluate AICF's capacity to monitor group cohesion. METHODS AICF used a text classification approach to extract the mentions of group cohesion within conversations. A sample of data was annotated by human scorers, which was used as the training data to build the classification model. The annotations were further supported by finding contextually similar group cohesion expressions using word embedding models as well. AICF performance was also compared against the natural language processing software Linguistic Inquiry Word Count (LIWC). RESULTS AICF was trained on 80,000 messages obtained from Cancer Chat Canada. We tested AICF on 34,048 messages. Human experts scored 6797 (20%) of the messages to evaluate the ability of AICF to classify group cohesion. Results showed that machine learning algorithms combined with human input could detect group cohesion, a clinically meaningful indicator of effective OSGs. After retraining with human input, AICF reached an F1-score of 0.82. AICF performed slightly better at identifying group cohesion compared to LIWC. CONCLUSIONS AICF has the potential to assist therapists by detecting discord in the group amenable to real-time intervention. Overall, AICF presents a unique opportunity to strengthen patient-centered care in web-based settings by attending to individual needs. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID) RR2-10.2196/21453.
Collapse
Affiliation(s)
- Yvonne W Leung
- de Souza Institute, University Health Network, Toronto, ON, Canada
- Department of Psychiatry, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada
- College of Professional Studies, Northeastern University, Toronto, ON, Canada
| | - Elise Wouterloot
- de Souza Institute, University Health Network, Toronto, ON, Canada
| | - Achini Adikari
- Centre for Data Analytics and Cognition, La Trobe University, Melbourne, Australia
| | - Jinny Hong
- de Souza Institute, University Health Network, Toronto, ON, Canada
| | - Veenaajaa Asokan
- de Souza Institute, University Health Network, Toronto, ON, Canada
| | - Lauren Duan
- de Souza Institute, University Health Network, Toronto, ON, Canada
| | - Claire Lam
- de Souza Institute, University Health Network, Toronto, ON, Canada
| | - Carlina Kim
- de Souza Institute, University Health Network, Toronto, ON, Canada
| | - Kai P Chan
- de Souza Institute, University Health Network, Toronto, ON, Canada
| | - Daswin De Silva
- Centre for Data Analytics and Cognition, La Trobe University, Melbourne, Australia
| | - Lianne Trachtenberg
- de Souza Institute, University Health Network, Toronto, ON, Canada
- Centre for Psychology and Emotional Health, Toronto, ON, Canada
| | - Heather Rennie
- de Souza Institute, University Health Network, Toronto, ON, Canada
- BC Cancer Agency, Vancouver, BC, Canada
| | - Jiahui Wong
- de Souza Institute, University Health Network, Toronto, ON, Canada
| | - Mary Jane Esplen
- Department of Psychiatry, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
4
|
Conte Keivabu R, Widmann T. The effect of temperature on language complexity: Evidence from seven million parliamentary speeches. iScience 2024; 27:110106. [PMID: 39055607 PMCID: PMC11270029 DOI: 10.1016/j.isci.2024.110106] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2023] [Revised: 02/08/2024] [Accepted: 05/23/2024] [Indexed: 07/27/2024] Open
Abstract
Climate change carries important effects on human wellbeing and performance, and increasingly research is documenting the negative impacts of out-of-comfort temperatures on workplace performance. In this study, we investigate the plausibly causal effect of extreme temperatures, i.e., out-of-comfort, on language complexity among politicians, leveraging a fixed effects strategy. We analyze language complexity in over seven million parliamentary speeches across eight countries, connecting them with precise daily meteorological information. We find hot days reduce politicians' language complexity, but not cold days. Focusing on one country, we explore marginal effects by age and gender, suggesting high temperatures significantly impact older politicians at lower thresholds. The findings propose that political rhetoric is not only driven by political circumstances and strategic concerns but also by physiological responses to external environmental factors. Overall, the study holds important implications on how climate change could affect human cognitive performance and the quality of political discourse.
Collapse
Affiliation(s)
- Risto Conte Keivabu
- Max Planck Institute for Demographic Research (MPIDR), Konrad-Zuse-Straße 1, 18057 Rostock, Germany
| | - Tobias Widmann
- Aarhus University, Bartholins Allé 7, 8000 Aarhus C, Denmark
| |
Collapse
|
5
|
Reaume C, Thomassin K. Parental linguistic content and distancing predict beliefs about emotion and child emotion regulation. Cogn Emot 2024:1-10. [PMID: 38863205 DOI: 10.1080/02699931.2024.2362371] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2023] [Accepted: 05/27/2024] [Indexed: 06/13/2024]
Abstract
ABSTRACTEmploying a constructionist framework of emotion, this study examines whether parental language during emotion belief discussions predicts parents' self-reported beliefs about emotion and child emotion regulation (ER). 102 parents of children ages 8 through 12 participated in focus groups about emotion beliefs, and nine months later, completed questionnaires on their emotion beliefs and child ER. Focus group content was analyzed for positive and negative emotion talk, cognitive process talk, and an established linguistic marker of psychological distancing. Parents' positive emotion talk and parental linguistic distancing when discussing their child's (but not their own) emotion experiences positively predicted beliefs about children's emotional capabilities. Finally, negative emotion talk negatively predicted parental beliefs about children's capacity to control their own emotions and the value of anger expression as well as child ER. Current findings contribute to our understanding of how parental communication patterns about emotions may influence emotion beliefs and child emotion development.
Collapse
Affiliation(s)
- Chelsea Reaume
- Department of Psychology, University of Guelph, Guelph, Canada
| | | |
Collapse
|
6
|
Stoica T, Andrews ES, Deffner AM, Griffith C, Grilli MD, Andrews-Hanna JR. Speaking Well and Feeling Good: Age-Related Differences in the Affective Language of Resting State Thought. AFFECTIVE SCIENCE 2024; 5:141-159. [PMID: 39050037 PMCID: PMC11264499 DOI: 10.1007/s42761-024-00239-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/31/2023] [Accepted: 05/01/2024] [Indexed: 07/27/2024]
Abstract
Despite the prevalence and importance of resting state thought for daily functioning and psychological well-being, it remains unclear how such thoughts differ between young and older adults. Age-related differences in the affective tone of resting state thoughts, including the affective language used to describe them, could be a novel manifestation of the positivity effect, with implications for well-being. To examine this possibility, a total of 77 young adults (M = 24.9 years, 18-35 years) and 74 cognitively normal older adults (M = 68.6 years, 58-83 years) spoke their thoughts freely during a think-aloud paradigm across two studies. The emotional properties of spoken words and participants' retrospective self-reported affective experiences were computed and examined for age differences and relationships with psychological well-being. Study 1, conducted before the start of the COVID-19 pandemic, revealed that older adults exhibited more diversity of positive, but not negative, affectively tinged words compared to young adults and more positive self-reported thoughts. Despite being conducted virtually during the COVID-19 pandemic, study 2 replicated many of study 1's findings, generalizing results across samples and study contexts. In an aggregated analysis of both samples, positive diversity predicted higher well-being beyond other metrics of affective tone, and the relationship between positive diversity and well-being was not moderated by age. Considering that older adults also exhibited higher well-being, these results hint at the possibility that cognitively healthy older adults' propensity to experience more diverse positive concepts during natural periods of restful thought may partly underlie age-related differences in well-being and reveal a novel expression of the positivity effect. Supplementary Information The online version contains supplementary material available at 10.1007/s42761-024-00239-z.
Collapse
Affiliation(s)
- Teodora Stoica
- Department of Psychology, University of Arizona, 1503 E. University Blvd, Tucson, AZ 85721 USA
| | - Eric S. Andrews
- Department of Psychology, University of Arizona, 1503 E. University Blvd, Tucson, AZ 85721 USA
| | - Austin M. Deffner
- Department of Psychology, University of Arizona, 1503 E. University Blvd, Tucson, AZ 85721 USA
| | - Christopher Griffith
- Department of Psychology, University of Arizona, 1503 E. University Blvd, Tucson, AZ 85721 USA
| | - Matthew D. Grilli
- Department of Psychology, University of Arizona, 1503 E. University Blvd, Tucson, AZ 85721 USA
- Evelyn F. McKnight Brain Institute, University of Arizona, Tucso, AZ USA
- Department of Neurology, University of Arizona, Tucson, AZ USA
| | - Jessica R. Andrews-Hanna
- Department of Psychology, University of Arizona, 1503 E. University Blvd, Tucson, AZ 85721 USA
- Cognitive Science, University of Arizona, Tucson, AZ USA
- Evelyn F. McKnight Brain Institute, University of Arizona, Tucso, AZ USA
| |
Collapse
|
7
|
Kaźmierczak I, Jakubowska A, Pietraszkiewicz A, Zajenkowska A, Lacko D, Wawer A, Sarzyńska-Wawer J. Natural language sentiment as an indicator of depression and anxiety symptoms: a longitudinal mixed methods study 1. Cogn Emot 2024:1-10. [PMID: 38738660 DOI: 10.1080/02699931.2024.2351952] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2024] [Accepted: 04/30/2024] [Indexed: 05/14/2024]
Abstract
The study tested how the use of positive- (e.g. beautiful) and negative-valenced (e.g. horrible) words in natural language and its change in time affects the severity of depression and anxiety symptoms among depressed and non-depressed individuals. This longitudinal mixed methods study (N = 40 participants, n = 1440 narratives) with three measurements within a year showed that at the between-person level the use of negative-valenced words was strongly associated with the increase in anxiety and depression symptoms over time while the use of positive-valenced words was slightly associated with the decrease in anxiety and depression symptom. These effects were not supported for within-person level (i.e. changes in word usage). No significant differences were observed in the effects between depressed and non-depressed groups. Summing up, the overall use of positive- and negative-valenced words (particularly negative-valenced words) had a stronger effect on the severity of psychopathological symptoms than their change over time. The results were discussed in the context of natural language processing and its application in diagnosing depression and anxiety symptoms.
Collapse
Affiliation(s)
| | | | | | | | - David Lacko
- Institute of Psychology, Czech Academy of Sciences, Brno, Czechia
| | - Aleksander Wawer
- Institute of Computer Science, Polish Academy of Science, Warsaw, Poland
| | | |
Collapse
|
8
|
Guo A, Hirai R, Ohashi A, Chiba Y, Tsunomori Y, Higashinaka R. Personality prediction from task-oriented and open-domain human-machine dialogues. Sci Rep 2024; 14:3868. [PMID: 38366048 PMCID: PMC10873327 DOI: 10.1038/s41598-024-53989-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Accepted: 02/07/2024] [Indexed: 02/18/2024] Open
Abstract
If a dialogue system can predict the personality of a user from dialogue, it will enable the system to adapt to the user's personality, leading to better task success and user satisfaction. In a recent study, personality prediction was performed using the Myers-Briggs Type Indicator (MBTI) personality traits with a task-oriented human-machine dialogue using an end-to-end (neural-based) system. However, it is still not clear whether such prediction is generally possible for other types of systems and user personality traits. To clarify this, we recruited 378 participants, asked them to fill out four personality questionnaires covering 25 personality traits, and had them perform three rounds of human-machine dialogue with a pipeline task-oriented dialogue system or an end-to-end task-oriented dialogue system. We also had another 186 participants do the same with an open-domain dialogue system. We then constructed BERT-based models to predict the personality traits of the participants from the dialogues. The results showed that prediction accuracy was generally better with open-domain dialogue than with task-oriented dialogue, although Extraversion (one of the Big Five personality traits) could be predicted equally well for both open-domain dialogue and pipeline task-oriented dialogue. We also examined the effect of utilizing different types of dialogue on personality prediction by conducting a cross-comparison of the models trained from the task-oriented and open-domain dialogues. As a result, we clarified that the open-domain dialogue cannot be used to predict personality traits from task-oriented dialogue, and vice versa. We further analyzed the effects of system utterances, task performance, and the round of dialogue with regard to the prediction accuracy.
Collapse
Affiliation(s)
- Ao Guo
- Graduate School of Informatics, Nagoya University, Nagoya, Japan.
| | - Ryu Hirai
- Graduate School of Informatics, Nagoya University, Nagoya, Japan
| | - Atsumoto Ohashi
- Graduate School of Informatics, Nagoya University, Nagoya, Japan
| | - Yuya Chiba
- NTT Communication Science Laboratories, NTT Corporation, Chiyoda, Japan
| | - Yuiko Tsunomori
- Graduate School of Informatics, Nagoya University, Nagoya, Japan
| | | |
Collapse
|
9
|
Pipal C, Bakker BN, Schumacher G, van der Velden MACG. Tone in politics is not systematically related to macro trends, ideology, or experience. Sci Rep 2024; 14:3241. [PMID: 38331940 PMCID: PMC10853224 DOI: 10.1038/s41598-023-49618-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2023] [Accepted: 12/10/2023] [Indexed: 02/10/2024] Open
Abstract
What explains the variation in tone in politics? Different literatures argue that changes in the tone of politicians reflect changes in the economy, general language, well-being, or ideology. So far, these claims have been empirically tested only in isolation, in single country studies, or with a small subset of indicators. We offer an overarching view by modelling the use of tone in European national parliaments in 7 countries across 30 years. Using a semi-supervised sentiment-topic model to measure polarity and arousal in legislative debates, we show in a preregistered multiverse analysis that the tone in legislative debates is not systematically related to previously claimed factors. We also replicate the absence of such systematic relationships using national leader speeches and parties' election manifestos. There is also no universal trend towards more negativity or emotionality in political language. Overall, our results highlight the importance of multi-lingual and cross-country multiverse analyses for generalizing findings on emotions in politics.
Collapse
Affiliation(s)
- Christian Pipal
- Department of Communication and Media Research, University of Zurich, Zurich, Switzerland.
| | - Bert N Bakker
- Amsterdam School of Communication Research, University of Amsterdam, Amsterdam, The Netherlands
| | - Gijs Schumacher
- Department of Political Science, University of Amsterdam, Amsterdam, The Netherlands
| | | |
Collapse
|
10
|
Kennison SM, Fritz K, Hurtado Morales MA, Chan-Tin E. Emoji use in social media posts: relationships with personality traits and word usage. Front Psychol 2024; 15:1343022. [PMID: 38375105 PMCID: PMC10875039 DOI: 10.3389/fpsyg.2024.1343022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2023] [Accepted: 01/15/2024] [Indexed: 02/21/2024] Open
Abstract
Prior research has demonstrated relationships between personality traits of social media users and the language used in their posts. Few studies have examined whether there are relationships between personality traits of users and how they use emojis in their social media posts. Emojis are digital pictographs used to express ideas and emotions. There are thousands of emojis, which depict faces with expressions, objects, animals, and activities. We conducted a study with two samples (n = 76 and n = 245) in which we examined how emoji use on X (formerly Twitter) related to users' personality traits and language use in posts. Personality traits were assessed from participants in an online survey. With participants' consent, we analyzed word usage in posts. Word frequencies were calculated using the Linguistic Inquiry Word Count (LIWC). In both samples, the results showed that those who used the most emojis had the lowest levels of openness to experience. Emoji use was unrelated to the other personality traits. In sample 1, emoji use was also related to use of words related to family, positive emotion, and sadness and less frequent use of articles and words related to insight. In sample 2, more frequent use of emojis in posts was related to more frequent use of you pronouns, I pronouns, and more frequent use of negative function words and words related to time. The results support the view that social media users' characteristics may be gleaned from the content of their social media posts.
Collapse
Affiliation(s)
- Shelia M. Kennison
- Department of Psychology, Oklahoma State University, Stillwater, OK, United States
| | - Kameryn Fritz
- Department of Psychology, Oklahoma State University, Stillwater, OK, United States
| | | | - Eric Chan-Tin
- Department of Computer Science, Loyola University Chicago, Chicago, IL, United States
| |
Collapse
|
11
|
Khaleghzadegan S, Rosen M, Links A, Ahmad A, Kilcullen M, Boss E, Beach MC, Saha S. Validating computer-generated measures of linguistic style matching and accommodation in patient-clinician communication. PATIENT EDUCATION AND COUNSELING 2024; 119:108074. [PMID: 38070297 DOI: 10.1016/j.pec.2023.108074] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/06/2023] [Revised: 11/07/2023] [Accepted: 11/13/2023] [Indexed: 12/29/2023]
Abstract
OBJECTIVE To explore the validity of computer-analyzed linguistic style matching (LSM) in patient-clinician communication. METHODS Using 330 transcribed HIV patient encounters, we quantified word use with Linguistic Inquiry and Word Count (LIWC), a dictionary-based text analysis software. We measured LSM by calculating the degree to which clinicians matched patients in the use of LIWC "function words" (e.g., articles, pronouns). We tested associations of different LSM metrics with patients' perceptions that their clinicians spoke similiarly to them. RESULTS We developed 3 measures of LSM: 1) at the whole-visit level; (2) at the turn-by-turn level; and (3) using a "rolling-window" approach, measuring matching between clusters of 8 turns per conversant. None of these measures was associated with patient-rated speech similarity. However, we found that increasing trajectories of LSM, from beginning to end of the visit, were associated with higher patient-rated speech similarity (β 0.35, CI 0.06, 0.64), compared to unchanging trajectories. CONCLUSIONS Our findings point to the potential value of clinicians' adapting their communication style to match their patients, over the course of the visit. PRACTICE IMPLICATIONS With further validation, computer-based linguistic analyses may prove an efficient tool for generating data on communication patterns and providing feedback to clinicians in real time.
Collapse
Affiliation(s)
- Salar Khaleghzadegan
- Armstrong Institute for Patient Safety and Quality, Johns Hopkins University School of Medicine, Baltimore, MD, USA; The Dartmouth Institute for Health Policy and Clinical Practice, Geisel School of Medicine, Dartmouth College, Lebanon, NH, USA.
| | - Michael Rosen
- Armstrong Institute for Patient Safety and Quality, Johns Hopkins University School of Medicine, Baltimore, MD, USA; Anesthesiology and Critical Care Medicine, Johns Hopkins University School of Medicine, Baltimore, MD, USA; Department of Health Policy and Management, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA
| | - Anne Links
- Department of Otolaryngology-Head and Neck Surgery, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Alya Ahmad
- Department of Medicine, Johns Hopkins University School of Medicine, Baltimore, USA
| | - Molly Kilcullen
- Armstrong Institute for Patient Safety and Quality, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Emily Boss
- Department of Health Policy and Management, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA; Department of Otolaryngology-Head and Neck Surgery, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Mary Catherine Beach
- Department of Health Policy and Management, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA; Department of Medicine, Johns Hopkins University School of Medicine, Baltimore, USA
| | - Somnath Saha
- Department of Medicine, Johns Hopkins University School of Medicine, Baltimore, USA; Center to Improve Veteran Involvement in Care, VA Portland Health Care System, Portland, USA
| |
Collapse
|
12
|
Lian Z, Liu B, Tao J. PIRNet: Personality-Enhanced Iterative Refinement Network for Emotion Recognition in Conversation. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:2863-2874. [PMID: 35877794 DOI: 10.1109/tnnls.2022.3192469] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Emotion recognition in conversation (ERC) is important for enhancing user experience in human-computer interaction. Unlike vanilla emotion recognition in individual utterances, ERC aims to classify constituent utterances in a dialog into corresponding emotion labels, which makes contextual information crucial. In addition to contextual information, personality traits also affect emotional perception based on psychological findings. Although researchers have proposed several approaches and achieved promising results on ERC, current works in this domain rarely incorporate contextual information and personality influence. To this end, we propose a novel framework to integrate these factors seamlessly, called "Personality-enhanced Iterative Refinement Network (PIRNet)." Specifically, PIRNet is a multistage iterative method. To capture personality influence, PIRNet leverages personality traits to mimic emotional transitions and generates personality-enhanced results. Then we exploit sequence models to capture contextual information in conversations. To verify the effectiveness of our proposed method, we conduct experiments on three benchmark datasets for ERC, that is, IEMOCAP, CMU-MOSI, and CMU-MOSEI. Experimental results demonstrate that our PIRNet succeeds over currently advanced approaches to emotion recognition.
Collapse
|
13
|
Dworakowski O, Meier T, Mehl MR, Pennebaker JW, Boyd RL, Horn AB. Comparing the language style of heads of state in the US, UK, Germany and Switzerland during COVID-19. Sci Rep 2024; 14:1708. [PMID: 38242954 PMCID: PMC10799077 DOI: 10.1038/s41598-024-51362-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2023] [Accepted: 01/04/2024] [Indexed: 01/21/2024] Open
Abstract
The COVID-19 pandemic posed a global threat to nearly every society around the world. Individuals turned to their political leaders to safely guide them through this crisis. The most direct way political leaders communicated with their citizens was through official speeches and press conferences. In this report, we compare psychological language markers of four different heads of state during the early stage of the pandemic. Specifically, we collected all pandemic-related speeches and press conferences delivered by political leaders in the USA (Trump), UK (Johnson), Germany (Merkel), and Switzerland (Swiss Federal Council) between February 27th and August 31st, 2020. We used natural language analysis to examine language markers of expressed positive and negative emotions, references to the community (we-talk), analytical thinking, and authenticity and compare these language markers across the four nations. Level differences in the language markers between the leaders can be detected: Trump's language was characterized by a high expression of positive emotion, Merkel's by a strong communal focus, and Johnson's and the Swiss Federal Council by a high level of analytical thinking. Overall, these findings mirror different strategies used by political leaders to deal with the COVID-19 pandemic.
Collapse
Affiliation(s)
- Olenka Dworakowski
- URPP "Dynamics of Healthy Aging", University of Zurich, Zurich, Switzerland.
- Department of Psychology - Gerontopsychology, University of Zurich, Zurich, Switzerland.
| | - Tabea Meier
- URPP "Dynamics of Healthy Aging", University of Zurich, Zurich, Switzerland
- Department of Psychology - Gerontopsychology, University of Zurich, Zurich, Switzerland
| | - Matthias R Mehl
- Department of Psychology, University of Arizona, Tucson, USA
| | - James W Pennebaker
- Department of Psychology, The University of Texas at Austin, Austin, USA
| | - Ryan L Boyd
- Department of Computer Science, Stony Brook University, New York, USA
| | - Andrea B Horn
- URPP "Dynamics of Healthy Aging", University of Zurich, Zurich, Switzerland
- Department of Psychology - Gerontopsychology, University of Zurich, Zurich, Switzerland
- Competence Center Gerontology, University of Zurich, Zurich, Switzerland
| |
Collapse
|
14
|
Poivet R, Lopez Malet M, Pelachaud C, Auvray M. The influence of conversational agents' role and communication style on user experience. Front Psychol 2023; 14:1266186. [PMID: 38106384 PMCID: PMC10722890 DOI: 10.3389/fpsyg.2023.1266186] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2023] [Accepted: 11/07/2023] [Indexed: 12/19/2023] Open
Abstract
Conversational Agents (CAs) are characterized by their roles within a narrative and the communication style they adopt during conversations. Within computer games, users' evaluation of the narrative is influenced by their estimation of CAs' intelligence and believability. However, the impact of CAs' roles and communication styles on users' experience remains unclear. This research investigates such influence of CAs' roles and communication styles through a crime-solving textual game. Four different CAs were developed and each of them was assigned to a role of either witness or suspect and to a communication style than can be either aggressive or cooperative. Communication styles were simulated through a Wizard of Oz method. Users' task was to interact, through real-time written exchanges, with the four CAs and then to identify the culprit, assess the certainty of their judgments, and rank the CAs based on their conversational preferences. In addition, users' experience was evaluated using perceptual measures (perceived intelligence and believability scales) and behavioral measures (including analysis of users' input length, input delay, and conversation length). The results revealed that users' evaluation of CAs' intelligence and believability was primarily influenced by CAs' roles. On the other hand, users' conversational behaviors were mainly influenced by CAs' communication styles. CAs' communication styles also significantly determined users' choice of the culprit and conversational preferences.
Collapse
Affiliation(s)
- Remi Poivet
- Ubisoft Paris Studio, Paris, France
- Institut des Systèmes Intelligents et de Robotiques (ISIR), Sorbonne Université, Paris, France
| | | | - Catherine Pelachaud
- Institut des Systèmes Intelligents et de Robotiques (ISIR), Sorbonne Université, Paris, France
| | - Malika Auvray
- Institut des Systèmes Intelligents et de Robotiques (ISIR), Sorbonne Université, Paris, France
| |
Collapse
|
15
|
Bond GD, Speller LF, Cockrell LL, Webb KG, Sievers JL. 'Sleepy Joe' and 'Donald, King of Whoppers': Reality Monitoring and Verbal Deception in the 2020 U.S. Presidential Election Debates. Psychol Rep 2023; 126:3090-3103. [PMID: 35634896 DOI: 10.1177/00332941221105212] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2023]
Abstract
The 2020 U.S. Presidential election was a campaign that could be characterized as 'one of the nastiest presidential campaigns in recent memory,' partly because the general election debates were highly contentious and featured frequent interruptions and several insults and invectives between candidates. This research compared the language used in the debates to fact-checked truths and lies using a Reality Monitoring (RM) deception detection algorithm in Linguistic Inquiry and Word Count (LIWC) to investigate the veracity of real-life high-stakes verbal messages in the political context. We found that overall RM scores were lower and not significantly different between debate language and fact-checked lies, and RM scores were significantly higher in fact-checked truth statements, indicating that most debate language uttered was deceptive. This result supports the finding that the RM algorithm in LIWC distinguishes truth from lies and debate language in the context of politics. The 60.7% classification rate in this study may reflect a problem with the relatively short word counts of fact-checked lie and truth statements, but most probably reflects individual candidates' deviations in RM features used in their statements. Each individual has a style that they use in communication-'the way people talk and write have been recognized as stamps of individual identity.' Even with a corpus of many statements from the same individual candidates, they probably regularly amplify certain features of RM and diminish other features of RM in their truthful and deceptive messages. This is a fruitful area of research that could be explored in future studies.
Collapse
Affiliation(s)
- Gary D Bond
- Department of Psychology, Eastern New Mexico University, Portales, NM, USA
| | - Lassiter F Speller
- Department of Psychology, Eastern New Mexico University, Portales, NM, USA
| | - Lauren L Cockrell
- Department of Psychology, Eastern New Mexico University, Portales, NM, USA
| | - Katelynn G Webb
- Department of Psychology, Eastern New Mexico University, Portales, NM, USA
| | - Jaci L Sievers
- Department of Psychology, Eastern New Mexico University, Portales, NM, USA
| |
Collapse
|
16
|
Kyröläinen AJ, Gillett J, Karabin M, Sonnadara R, Kuperman V. Cognitive and social well-being in older adulthood: The CoSoWELL corpus of written life stories. Behav Res Methods 2023; 55:2885-2909. [PMID: 36002624 PMCID: PMC9400578 DOI: 10.3758/s13428-022-01926-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/23/2022] [Indexed: 11/30/2022]
Abstract
This paper presents the Cognitive and Social WELL-being (CoSoWELL) project that consists of two components. One is a large corpus of narratives written by over 1000 North American older adults (55+ years old) in five test sessions before and during the first year of the COVID-19 pandemic. The other component is a rich collection of socio-demographic data collected through a survey from the same participants. This paper introduces the first release of the corpus consisting of 1.3 million tokens and the survey data (CoSoWELL version 1.0). It also presents a series of analyses validating design decisions for creating the corpus of narratives written about personal life events that took place in the distant past, recent past (yesterday) and future, along with control narratives. We report results of computational topic modeling and linguistic analyses of the narratives in the corpus, which track the time-locked impact of the COVID-19 pandemic on the content of autobiographical memories before and during the COVID-19 pandemic. The main findings demonstrate a high validity of our analytical approach to unique narrative data and point to both the locus of topical shifts (narratives about recent past and future) and their detailed timeline. We make the CoSoWELL corpus and survey data available to researchers and discuss implications of our findings in the framework of research on aging and autobiographical memories under stress.
Collapse
Affiliation(s)
- Aki-Juhani Kyröläinen
- Department of Linguistics and Languages, McMaster University, Togo Salmon Hall 513, 1280 Main Street West, Hamilton, Ontario, Canada, 8S 4M2.
| | | | | | | | | |
Collapse
|
17
|
Entwistle C, Boyd RL. Uncovering the Social-Cognitive Contributors to Social Dysfunction in Borderline Personality Disorder Through Language Analysis. J Pers Disord 2023; 37:444-455. [PMID: 37721778 DOI: 10.1521/pedi.2023.37.4.444] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 09/19/2023]
Abstract
Borderline personality disorder (BPD) is characterized by severe interpersonal dysfunction, yet the underlying nature of such dysfunction remains poorly understood. The present study adopted a behavioral approach to more objectively describe the social-cognitive contributors to interpersonal dysfunction in BPD. Participants (N = 530) completed an online survey comprising validated measures of BPD features and other problematic interpersonal traits (e.g., narcissism), as well as a writing prompt where they were asked to share their personal thoughts about relationships. Computerized language analysis methods were used to quantify various psychosocial dimensions of participants' writing, which were incorporated into a principal component analysis. Analyses revealed four core social dimensions of thought: (1) Connectedness/Intimacy; (2) Immediacy; (3) Social Rumination; (4) Negative Affect. All four dimensions correlated with BPD features in intuitive ways, some of which were specific to BPD. This study highlights the value of natural language analysis to explore fundamental dimensions of personality disorder.
Collapse
Affiliation(s)
- Charlotte Entwistle
- From Department of Psychology, Lancaster University, Lancaster, UK
- Security Lancaster, Lancaster University, UK; Data Science Institute, Lancaster University, UK; and Obelus Institute, Washington, DC
| | - Ryan L Boyd
- Security Lancaster, Lancaster University, UK; Data Science Institute, Lancaster University, UK; and Obelus Institute, Washington, DC
| |
Collapse
|
18
|
Marszałek M, Miązek A, Roczniewska M. Promotion and prevention regulatory focus LIWC dictionary. Polish adaptation and validation. PLoS One 2023; 18:e0288726. [PMID: 37471322 PMCID: PMC10358899 DOI: 10.1371/journal.pone.0288726] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2022] [Accepted: 07/04/2023] [Indexed: 07/22/2023] Open
Abstract
This article describes the adaptation and validation of a Polish version of the regulatory focus (RF) Linguistic Inquiry and Word Count (LIWC) dictionary. RF theory proposes that there are two types of self-regulation: promotion (focus on gains, growth, and ideals) and prevention (focus on losses, security, and oughts). Apart from self-report questionnaires, one method to measure RF includes a linguistic analysis. LIWC counts the frequency of words from relevant categories and presents the output as a percentage of all words used in a writing sample. RF LIWC contains two categories: promotion (e.g., achieve, ideal) and prevention (e.g., afraid, fail). To test the psychometric properties of our Polish adaptation of the RF LIWC instrument, we performed three studies. In Study 1 (N = 10), experts in RF theory rated the extent to which each dictionary entry was related to promotion and prevention foci. Results showed that words from the promotion category were rated as more promotion than prevention-related, and the pattern was reversed for words from the prevention category. In Study 2 (N = 130) we examined the divergent validity of the instrument by experimentally manipulating RF and testing the writing patterns. When a promotion focus was activated, individuals wrote more words from the promotion than prevention category, and the pattern was reversed in the prevention group. Study 3 (N = 414) investigated whether the promotion and prevention scores obtained through RF LIWC are linked with results obtained using a self-report questionnaire that measures chronic RF. Promotion scores from RF LIWC correlated positively with chronic promotion RF and prevention scores from RF LIWC correlated positively with chronic prevention RF. These preliminary findings provide initial support for the validity of the Polish adaptation of the RF LIWC.
Collapse
Affiliation(s)
- Magdalena Marszałek
- Institute of Psychology, SWPS University of Social Sciences and Humanities, Warsaw, Poland
| | - Amadeusz Miązek
- Department of International Finance, Poznań University of Economics and Business, Poznań, Poland
| | - Marta Roczniewska
- Institute of Psychology, SWPS University of Social Sciences and Humanities, Warsaw, Poland
- Department of Learning, Informatics, Karolinska Institutet, Management and Ethics, Stockholm, Sweden
| |
Collapse
|
19
|
Castiglioni M, Caldiroli CL, Manzoni GM, Procaccia R. Does resilience mediate the association between mental health symptoms and linguistic markers of trauma processing? Analyzing the narratives of women survivors of intimate partner violence. Front Psychol 2023; 14:1211022. [PMID: 37384174 PMCID: PMC10296767 DOI: 10.3389/fpsyg.2023.1211022] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2023] [Accepted: 05/22/2023] [Indexed: 06/30/2023] Open
Abstract
Intimate partner violence (IPV) is a serious issue for women from all cultures and backgrounds. Studies on the negative consequences of violence suggest that women with a history of abuse are more likely to display depressive and PTSD symptoms. However, recent research has focused on the mechanisms underpinning resilience and the processing of traumatic memories, including linguistic markers and how they may reflect the mental health of traumatized individuals. In this study, we analyzed trauma narratives to investigate whether resilience mediates the impact of PTSD and depression symptoms on five trauma-processing mechanisms (cognitive processing, emotional processing, perceived threat to life, self-perspective, and integration of traumatic memories). Forty-three abused women (mean age = 38.74 years; SD = 9.41) wrote about their traumatic experiences and completed instruments assessing their levels of PTSD, depression, and resilience. We used LIWC software to analyze the women's narratives in terms of linguistic markers of psychological processing. Mediation analysis indicated that resilience fully mediated the impact of mental health symptoms on emotional processing, perceived threat to life, and integration of traumatic memories and partially mediated cognitive processing and self-perspective. We discuss the clinical implications of these findings, emphasizing the need to focus on the resources and strengths of women survivors of abuse in designing targeted psychological interventions.
Collapse
Affiliation(s)
- Marco Castiglioni
- Department of Human Sciences “R. Massa, ” University of Milano-Bicocca, Milan, Italy
| | | | | | | |
Collapse
|
20
|
O'Hara KL, Mehl MR, Sbarra DA. Spinning Your Wheels: Psychological Overinvolvement and Actigraphy-Assessed Sleep Efficiency Following Marital Separation. Int J Behav Med 2023; 30:307-319. [PMID: 35698019 PMCID: PMC9867921 DOI: 10.1007/s12529-022-10101-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/13/2022] [Indexed: 01/26/2023]
Abstract
BACKGROUND This study investigated the ways in which adults reflect on their psychological experiences amid a recent marital separation and how these patterns of thought, manifest in language, are associated with self-reported negative affect and actigraphy-assessed sleep disturbance. METHODS In a sample of 138 recently separated adults assessed three times over five months, we examined within- and between-person associations among psychological overinvolvement (operationalized using verbal immediacy derived as a function of the language participants used to discuss their relationship history and divorce experience), continued attachment to an ex-partner, negative affect, and sleep efficiency. RESULTS The association between psychological overinvolvement and negative affect operated at the within-person level, whereas the associations between psychological overinvolvement and sleep disturbance, as well as negative affect and sleep disturbance, operated at the between-person level. CONCLUSIONS These findings shed light on the intraindividual processes that may explain why some people are more susceptible to poor outcomes after separation/divorce than others. Our findings suggest that individuals who express their divorce-related thoughts and feelings in a psychologically overinvolved manner may be at greatest risk for sleep disturbances after marital separation/divorce.
Collapse
Affiliation(s)
- Karey L O'Hara
- Department of Psychology, REACH Institute, Arizona State University, 900 S, McAllister Ave, Tempe, AZ, 85287, USA.
| | - Matthias R Mehl
- Department of Psychology, University of Arizona, Tucson, USA
| | - David A Sbarra
- Department of Psychology, University of Arizona, Tucson, USA
| |
Collapse
|
21
|
Stade EC, Ungar L, Havaldar S, Ruscio AM. Perseverative thinking is associated with features of spoken language. Behav Res Ther 2023; 165:104307. [PMID: 37121016 PMCID: PMC10263193 DOI: 10.1016/j.brat.2023.104307] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2022] [Revised: 03/07/2023] [Accepted: 03/23/2023] [Indexed: 04/03/2023]
Abstract
Perseverative thinking (PT), such as rumination or worry, is a transdiagnostic process implicated in the onset and maintenance of emotional disorders. Existing measures of PT are limited by demand and expectancy effects, cognitive biases, and reflexivity, leading to calls for unobtrusive, behavioral measures. In response, we developed a behavioral measure of PT based on language. A mixed sample of 188 participants with major depressive disorder, generalized anxiety disorder, or no psychopathology completed self-report PT measures. Participants were also interviewed, providing a natural language sample. We examined language features associated with PT, then built a language-based PT model and examined its predictive power. PT was associated with multiple language features, most notably I-usage (e.g., "I", "me"; β = 0.25) and negative emotion language (e.g., "anxiety", "difficult"; β = 0.19). In machine learning analyses, language features accounted for 14% of the variance in self-reported PT. Language-based PT predicted the presence and severity of depression and anxiety, psychiatric comorbidity, and treatment seeking, with effects in the r = 0.15-0.41 range. PT has face-valid linguistic correlates and our language-based measure holds promise for assessing PT unobtrusively. With further development, this measure could be used to passively detect PT for deployment of "just-in-time" interventions.
Collapse
Affiliation(s)
- Elizabeth C Stade
- Department of Psychology, University of Pennsylvania, 425 South University Avenue, Philadelphia, PA, 19104-6018, USA.
| | - Lyle Ungar
- Department of Computer and Information Science, University of Pennsylvania, 504 Levine Hall, 3330 Walnut Street, Philadelphia, PA, 19104-6018, USA.
| | - Shreya Havaldar
- Department of Computer and Information Science, University of Pennsylvania, 504 Levine Hall, 3330 Walnut Street, Philadelphia, PA, 19104-6018, USA.
| | - Ayelet Meron Ruscio
- Department of Psychology, University of Pennsylvania, 425 South University Avenue, Philadelphia, PA, 19104-6018, USA.
| |
Collapse
|
22
|
Wei Z, Chen Y, Zhao Q, Zhang P, Zhou L, Ren J, Piao Y, Qiu B, Xie X, Wang S, Liu J, Zhang D, Kadosh RC, Zhang X. Implicit Perception of Differences between NLP-Produced and Human-Produced Language in the Mentalizing Network. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2023; 10:e2203990. [PMID: 36748300 PMCID: PMC10131862 DOI: 10.1002/advs.202203990] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/12/2022] [Revised: 01/06/2023] [Indexed: 06/18/2023]
Abstract
Natural language processing (NLP) is central to the communication with machines and among ourselves, and NLP research field has long sought to produce human-quality language. Identification of informative criteria for measuring NLP-produced language quality will support development of ever-better NLP tools. The authors hypothesize that mentalizing network neural activity may be used to distinguish NLP-produced language from human-produced language, even for cases where human judges cannot subjectively distinguish the language source. Using the social chatbots Google Meena in English and Microsoft XiaoIce in Chinese to generate NLP-produced language, behavioral tests which reveal that variance of personality perceived from chatbot chats is larger than for human chats are conducted, suggesting that chatbot language usage patterns are not stable. Using an identity rating task with functional magnetic resonance imaging, neuroimaging analyses which reveal distinct patterns of brain activity in the mentalizing network including the DMPFC and rTPJ in response to chatbot versus human chats that cannot be distinguished subjectively are conducted. This study illustrates a promising empirical basis for measuring the quality of NLP-produced language: adding a judge's implicit perception as an additional criterion.
Collapse
Affiliation(s)
- Zhengde Wei
- Department of PsychologySchool of Humanities & Social ScienceUniversity of Science & Technology of ChinaHefeiAnhui230026China
- Department of Radiologythe First Affiliated Hospital of USTCSchool of Life ScienceDivision of Life Science and MedicineUniversity of Science & Technology of ChinaHefei230027China
| | - Ying Chen
- Department of PsychologySchool of Humanities & Social ScienceUniversity of Science & Technology of ChinaHefeiAnhui230026China
| | - Qian Zhao
- Department of Radiologythe First Affiliated Hospital of USTCSchool of Life ScienceDivision of Life Science and MedicineUniversity of Science & Technology of ChinaHefei230027China
| | - Pengyu Zhang
- Department of Radiologythe First Affiliated Hospital of USTCSchool of Life ScienceDivision of Life Science and MedicineUniversity of Science & Technology of ChinaHefei230027China
| | - Longxi Zhou
- Computational Bioscience Research Center (CBRC)King Abdullah University of Science and Technology (KAUST)Thuwal4700Saudi Arabia
| | - Jiecheng Ren
- Department of Radiologythe First Affiliated Hospital of USTCSchool of Life ScienceDivision of Life Science and MedicineUniversity of Science & Technology of ChinaHefei230027China
| | - Yi Piao
- Department of Radiologythe First Affiliated Hospital of USTCSchool of Life ScienceDivision of Life Science and MedicineUniversity of Science & Technology of ChinaHefei230027China
- Application Technology Center of Physical Therapy to Brain DisordersInstitute of Advanced TechnologyUniversity of Science & Technology of ChinaHefei230026China
| | - Bensheng Qiu
- Centers for Biomedical EngineeringSchool of Information Science and TechnologyUniversity of Science & Technology of ChinaHefeiAnhui230027China
| | - Xing Xie
- Microsoft Research AsiaBeijing100080China
| | - Suiping Wang
- Philosophy and Social Science Laboratory of Reading and Development in Children and Adolescents (South China Normal University)Ministry of EducationGuangzhou510631China
| | - Jia Liu
- State Key Laboratory of Cognitive Neuroscience and LearningBeijing Normal UniversityBeijing100875China
| | - Daren Zhang
- Department of PsychologySchool of Humanities & Social ScienceUniversity of Science & Technology of ChinaHefeiAnhui230026China
- Department of Radiologythe First Affiliated Hospital of USTCSchool of Life ScienceDivision of Life Science and MedicineUniversity of Science & Technology of ChinaHefei230027China
| | - Roi Cohen Kadosh
- Faculty of Health & Medical SciencesUniversity of Surrey30AD04 Elizabeth Fry BuildingGuildfordGU2 7XHUK
| | - Xiaochu Zhang
- Department of PsychologySchool of Humanities & Social ScienceUniversity of Science & Technology of ChinaHefeiAnhui230026China
- Department of Radiologythe First Affiliated Hospital of USTCSchool of Life ScienceDivision of Life Science and MedicineUniversity of Science & Technology of ChinaHefei230027China
- Centers for Biomedical EngineeringSchool of Information Science and TechnologyUniversity of Science & Technology of ChinaHefeiAnhui230027China
- Application Technology Center of Physical Therapy to Brain DisordersInstitute of Advanced TechnologyUniversity of Science & Technology of ChinaHefei230026China
| |
Collapse
|
23
|
Brunzel J. An empirical analysis of linguistic styles in new work services: The case of Fiverr.com. EUROPEAN MANAGEMENT REVIEW 2023. [DOI: 10.1111/emre.12562] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/09/2023]
Affiliation(s)
- Johannes Brunzel
- School of Business and Economics Philipps‐Universität Marburg Marburg Germany
| |
Collapse
|
24
|
Castiglioni M, Caldiroli CL, Negri A, Manzoni GM, Procaccia R. Linguistic Predictors of Psychological Adjustment in Healthcare Workers during the COVID-19 Pandemic. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2023; 20:4482. [PMID: 36901490 PMCID: PMC10002307 DOI: 10.3390/ijerph20054482] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/27/2022] [Revised: 02/25/2023] [Accepted: 02/26/2023] [Indexed: 06/18/2023]
Abstract
COVID-19 broke out in China in December 2019 and rapidly became a worldwide pandemic that demanded an extraordinary response from healthcare workers (HCWs). Studies conducted during the pandemic observed severe depression and PTSD in HCWs. Identifying early predictors of mental health disorders in this population is key to informing effective treatment and prevention. The aim of this study was to investigate the power of language-based variables to predict PTSD and depression symptoms in HCWs. One hundred thirty-five HCWs (mean age = 46.34; SD = 10.96) were randomly assigned to one of two writing conditions: expressive writing (EW n = 73) or neutral writing (NW n = 62) and completed three writing sessions. PTSD and depression symptoms were assessed both pre- and post-writing. LIWC was used to analyze linguistic markers of four trauma-related variables (cognitive elaboration, emotional elaboration, perceived threat to life, and self-immersed processing). Changes in PTSD and depression were regressed onto the linguistic markers in hierarchical multiple regression models. The EW group displayed greater changes on the psychological measures and in terms of narrative categories deployed than the NW group. Changes in PTSD symptoms were predicted by cognitive elaboration, emotional elaboration, and perceived threat to life; changes in depression symptoms were predicted by self-immersed processing and cognitive elaboration. Linguistic markers can facilitate the early identification of vulnerability to mental disorders in HCWs involved in public health emergencies. We discuss the clinical implications of these findings.
Collapse
Affiliation(s)
- Marco Castiglioni
- Department of Human Sciences “R. Massa”, University of Milano-Bicocca, 20126 Milan, Italy
| | | | - Attà Negri
- Department of Human and Social Sciences, University of Bergamo, 24129 Bergamo, Italy
| | | | | |
Collapse
|
25
|
Panicheva PV, Mamaev ID, Litvinova TA. Towards automatic conceptual metaphor detection for psychological tasks. Inf Process Manag 2023. [DOI: 10.1016/j.ipm.2022.103191] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
|
26
|
Zhu X. Mapping Linguistic Shifts During Psychological Coping With the COVID-19 Pandemic. JOURNAL OF LANGUAGE AND SOCIAL PSYCHOLOGY 2023; 42:203-216. [PMID: 38603095 PMCID: PMC9309588 DOI: 10.1177/0261927x221116335] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/13/2024]
Abstract
How does language change reveal the psychological trajectories of people coping with a COVID-19 infection? This study examined writings on social media over 12 weeks from people who self-reported having tested positive for COVID-19. People used fewer words reflecting anxiety and distancing but more words indicating reinterpretation over time. The language patterns for describing the experience of COVID-19 infections differed from those for describing other unrelated topics. The findings reveal the temporal dynamics of psychological adjustment to an unfolding crisis.
Collapse
Affiliation(s)
- Xun Zhu
- Department of Communication, University of North
Dakota, Grand Forks, North Dakota, USA
| |
Collapse
|
27
|
Lohmann PM, Gsottbauer E, You J, Kontoleon A. Anti-social behaviour and economic decision-making: Panel experimental evidence in the wake of COVID-19. JOURNAL OF ECONOMIC BEHAVIOR & ORGANIZATION 2023; 206:136-171. [PMID: 36531911 PMCID: PMC9744689 DOI: 10.1016/j.jebo.2022.12.007] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/31/2022] [Revised: 11/18/2022] [Accepted: 12/10/2022] [Indexed: 05/28/2023]
Abstract
We systematically examine the acute impact of exposure to a public health crisis on anti-social behaviour and economic decision-making using unique experimental panel data from China, collected just before the outbreak of COVID-19 and immediately after the first wave was overcome. Exploiting plausibly exogenous geographical variation in virus exposure coupled with a dataset of longitudinal experiments, we show that participants who were more intensely exposed to the virus outbreak became more anti-social than those with lower exposure, while other aspects of economic and social preferences remain largely stable. The finding is robust to multiple hypothesis testing and a similar, yet less pronounced pattern emerges when using alternative measures of virus exposure, reflecting societal concern and sentiment, constructed using social media data. The anti-social response is particularly pronounced for individuals who experienced an increase in depression or negative affect, which highlights the important role of psychological health as a potential mechanism through which the virus outbreak affected behaviour.
Collapse
Affiliation(s)
- Paul M Lohmann
- El-Erian Institute of Behavioural Economics and Policy, Judge Business School, University of Cambridge, United Kingdom
- Centre for Environment, Energy and Natural Resource Governance, Department of Land Economy, University of Cambridge, United Kingdom
| | - Elisabeth Gsottbauer
- Institute of Public Finance, University of Innsbruck, Austria
- London School of Economics and Political Science (LSE), Grantham Research Institute on Climate Change and the Environment, United Kingdom
| | - Jing You
- School of Agricultural Economics and Rural Development, Renmin University of China, China
| | - Andreas Kontoleon
- Centre for Environment, Energy and Natural Resource Governance, Department of Land Economy, University of Cambridge, United Kingdom
- Department of Land Economy, University of Cambridge, United Kingdom
| |
Collapse
|
28
|
Ramírez-de-la-Rosa G, Jiménez-Salazar H, Villatoro-Tello E, Reyes-Meza V, Rojas-Avila J. A lexical–availability–based framework from short communications for automatic personality identification. COGN SYST RES 2023. [DOI: 10.1016/j.cogsys.2023.01.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/20/2023]
|
29
|
Scaravelli G, Fedele F, Spoletini R, Monaco S, Renzi A, Di Trani M. Toward a Personalized Psychological Counseling Service in Assisted Reproductive Technology Centers: A Qualitative Analysis of Couples' Needs. J Pers Med 2022; 13:jpm13010073. [PMID: 36675734 PMCID: PMC9867277 DOI: 10.3390/jpm13010073] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2022] [Revised: 12/22/2022] [Accepted: 12/26/2022] [Indexed: 12/30/2022] Open
Abstract
Infertility may have a very strong emotional impact on individuals, requiring adequate support, but few studies on patients' demands toward psychological support have been conducted. This study aims to explore the emotions related to the infertility and to the Assisted Reproductive Technology (ART) procedure for which patients consider useful a psychological support. A total of 324 women completed a sociodemographic and clinical questionnaire and an open-ended questionnaire on emotional needs for psychological support. The written texts were explored by the Linguistic Inquiry and Word Count (LIWC) programme and linguistic characteristics were related to sociodemographic and anamnestic variables. Specific linguistic features were connected to several individual characteristics. More specifically, differences in linguistic processes emerged comparing women with an age over or under 40 years, women undergoing their first attempts versus more attempts, women undergoing ART with or without gamete donation, and women undergoing ART for male or unknown causes, as well as those undergoing ART for female or both partners' problems. These differences seem to confirm that older age, more attempts, gamete donation, and ART for unknown or male causes are risk factors that may worsen women's psychological well-being. This study contributes to increase the knowledge about the emotional needs of patients undergoing an ART procedure to develop specific psychological intervention programs.
Collapse
Affiliation(s)
- Giulia Scaravelli
- ART Italian National Register, National Centre for Diseases Prevention and Health Promotion, Italian National Health Institute, Viale Regina Elena 299, 00161 Rome, Italy
| | - Fabiola Fedele
- ART Italian National Register, National Centre for Diseases Prevention and Health Promotion, Italian National Health Institute, Viale Regina Elena 299, 00161 Rome, Italy
| | - Roberta Spoletini
- ART Italian National Register, National Centre for Diseases Prevention and Health Promotion, Italian National Health Institute, Viale Regina Elena 299, 00161 Rome, Italy
| | - Silvia Monaco
- Department of Dynamic and Clinical Psychology and Health Studies, “Sapienza” University of Rome, Via degli Apuli 1, 00185 Rome, Italy
- Correspondence:
| | - Alessia Renzi
- Department of Dynamic and Clinical Psychology and Health Studies, “Sapienza” University of Rome, Via degli Apuli 1, 00185 Rome, Italy
| | - Michela Di Trani
- Department of Dynamic and Clinical Psychology and Health Studies, “Sapienza” University of Rome, Via degli Apuli 1, 00185 Rome, Italy
| |
Collapse
|
30
|
Ramezani M, Feizi-Derakhshi MR, Balafar MA. Text-based automatic personality prediction using KGrAt-Net: a knowledge graph attention network classifier. Sci Rep 2022; 12:21453. [PMID: 36509800 PMCID: PMC9743120 DOI: 10.1038/s41598-022-25955-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2022] [Accepted: 11/25/2022] [Indexed: 12/14/2022] Open
Abstract
Nowadays, a tremendous amount of human communications occur on Internet-based communication infrastructures, like social networks, email, forums, organizational communication platforms, etc. Indeed, the automatic prediction or assessment of individuals' personalities through their written or exchanged text would be advantageous to ameliorate their relationships. To this end, this paper aims to propose KGrAt-Net, which is a Knowledge Graph Attention Network text classifier. For the first time, it applies the knowledge graph attention network to perform Automatic Personality Prediction (APP), according to the Big Five personality traits. After performing some preprocessing activities, it first tries to acquire a knowing-full representation of the knowledge behind the concepts in the input text by building its equivalent knowledge graph. A knowledge graph collects interlinked descriptions of concepts, entities, and relationships in a machine-readable form. Practically, it provides a machine-readable cognitive understanding of concepts and semantic relationships among them. Then, applying the attention mechanism, it attempts to pay attention to the most relevant parts of the graph to predict the personality traits of the input text. We used 2467 essays from the Essays Dataset. The results demonstrated that KGrAt-Net considerably improved personality prediction accuracies (up to 70.26% on average). Furthermore, KGrAt-Net also uses knowledge graph embedding to enrich the classification, which makes it even more accurate (on average, 72.41%) in APP.
Collapse
Affiliation(s)
- Majid Ramezani
- Computerized Intelligence Systems Laboratory, Department of Computer Engineering, Faculty of Electrical and Computer Engineering, University of Tabriz, Tabriz, Iran.
| | - Mohammad-Reza Feizi-Derakhshi
- Computerized Intelligence Systems Laboratory, Department of Computer Engineering, Faculty of Electrical and Computer Engineering, University of Tabriz, Tabriz, Iran.
| | - Mohammad-Ali Balafar
- Department of Computer Engineering, Faculty of Electrical and Computer Engineering, University of Tabriz, Tabriz, Iran
| |
Collapse
|
31
|
Cohen KA, Shroff A, Nook EC, Schleider JL. Linguistic distancing predicts response to a digital single-session intervention for adolescent depression. Behav Res Ther 2022; 159:104220. [PMID: 36323056 DOI: 10.1016/j.brat.2022.104220] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2022] [Revised: 08/10/2022] [Accepted: 10/16/2022] [Indexed: 12/14/2022]
Abstract
Examining the linguistic characteristics of youths' writing may be a promising method for detecting youth who are struggling. In this study, we examined linguistic patterns of adolescent responses to writing prompts in a large, well-powered trial of an evidence-based, digital single-session intervention teaching malleability beliefs about personal traits and symptoms ("growth mindset"). Participants who completed the intervention as part of a larger randomized control trial were included in this preregistered study (n = 638, https://osf.io/zqmxt). Participants' responses were processed using Linguistic Inquiry and Word Count. We tested correlations between linguistic variables (i.e., linguistic distancing, positive affect, negative affect, insight, certainty), baseline outcome variables, post-intervention outcome variables, and 3-month post-intervention outcome variables. We also used Least Absolute Shrinkage and Selection Operator (LASSO) regression models to identify key predictors of treatment outcomes. As hypothesized, greater use of linguistic distancing was associated with lower levels of baseline hopelessness and higher levels of perceived agency. Additionally, per LASSO models including all linguistic variables, greater use of linguistic distancing predicted larger reductions in depressive symptoms from baseline to three-month follow-up. Linguistic distancing appeared to account for 27% of the variance in depression trajectories when also accounting for baseline depression. CLINICAL REGISTRATION NO: NCT04634903.
Collapse
Affiliation(s)
| | - Akash Shroff
- Department of Psychology, Stony Brook University, United States
| | - Erik C Nook
- Department of Psychology, Yale University, United States
| | | |
Collapse
|
32
|
State of Mind Assessment in Relation to Adult Attachment and Text Analysis of Adult Attachment Interviews in a Sample of Patients with Anorexia Nervosa. Eur J Investig Health Psychol Educ 2022; 12:1760-1779. [PMID: 36547025 PMCID: PMC9777650 DOI: 10.3390/ejihpe12120124] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2022] [Revised: 11/14/2022] [Accepted: 11/26/2022] [Indexed: 12/02/2022] Open
Abstract
BACKGROUND Attachment theory represents one of the most important references for the study of the development of an individual throughout their life cycle and provides the clinician with a profound key for the purposes of understanding the suffering that underlies severe psychopathologies such as eating disorders. As such, we conducted a cross-sectional study with a mixed-methods analysis on a sample of 32 young women with anorexia nervosa (AN); this study was embedded in the utilized theoretical framework with the following aims: 1. to evaluate the state of mind (SoM) in relation to adult attachment, assuming a prevalence of the dismissing (DS) SoM and 2. to analyze the linguistic attachment profile emerging from the transcripts of the AAIs. METHODS Interviews were transcribed verbatim, coded, and analyzed using the linguistic inquiry and word count (LIWC) method. RESULTS The results were observed to be consistent with the referenced literature. The prevalence of a DS SoM (68.75%) is observed in the study sample, whereas the results of the lexical analysis of the stories deviate from expectations. Notably, the lexical results indicate the coexistence of the dismissing and entangled aspects at the representational level. CONCLUSIONS The study results suggest a high level of specificity in the emotional functioning of patients with AN, with a focusing on a pervasive control of emotions that is well illustrated by the avoidant/ambivalent (A/C) strategy described in Crittenden's dynamic-maturational model. These findings and considerations have important implications for clinical work and treatment, which we believe must be structured on the basis of starting from a reappraisal of emotional content.
Collapse
|
33
|
Tiwari DA. RMCL: A deep learning based recursive malicious context learner in social networks. Comput Intell 2022. [DOI: 10.1111/coin.12552] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
Affiliation(s)
- Devisha Arunadevi Tiwari
- Department of Computer Science and Engineering GH Raisoni Institute of Engineering and Technology Nagpur Maharashtra India
- Department of Computer Science and Engineering National Institute of Technology Patna Bihar India
| |
Collapse
|
34
|
Tatebe LC, Thomas A, Regan S, Stone L, Dicker R. Language of violence: Do words matter more than we think? Trauma Surg Acute Care Open 2022; 7:e000973. [PMCID: PMC9616003 DOI: 10.1136/tsaco-2022-000973] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2022] [Accepted: 09/29/2022] [Indexed: 11/03/2022] Open
Abstract
Firearm violence is a leading cause of morbidity and mortality among young adults. Identification of intervention targets is crucial to developing and implementing effective prevention efforts. Hospital Violence Intervention Programs (HVIPs) have used a multiprong social care approach to mediate the cycle of interpersonal violence. One struggle continually encountered is how to change the conversation around the future. Speech patterns have been associated with health outcomes and overall behavior modification. During violence prevention efforts, young victims of violence say things such as ‘I’m living on borrowed time’ and ‘why should I worry about getting an education when I’ll likely die soon anyway?’ Such speech patterns may contribute to the cycle of violence and increase the likelihood of reinjury. Presented is a narrative review of the impact language has on health outcomes and how psychotherapy may be able to change thought patterns, alter language structure, and ultimately reduce risk of reinjury. The biopsychosocial model of health posits that a person’s health is dictated by a combination of biological, psychological, and social factors. By understanding that language exists in the personal context, it can serve as both an indicator and a tool for targeted interventions. Cognitive–behavioral therapy (CBT) works by retraining thought and speech patterns to affect change in emotion, physiology, and behavior. It is proposed here that CBT could be used in the HVIPs’ multidisciplinary case management model by involving trained psychotherapists. Language is an important indicator of a patient’s psychological state and approach to life-changing decisions. As such, language alteration through CBT could potentially be used as a novel method of injury prevention. This concept has not before been explored in this setting and may be an effective supplement to HVIPs’ success.
Collapse
Affiliation(s)
- Leah C Tatebe
- Department of Surgery, Northwestern University, Chicago, Illinois, USA
| | - Arielle Thomas
- Department of Surgery, Medical College of Wisconsin, Milwaukee, Wisconsin, USA
| | | | | | - Rochelle Dicker
- Department of Surgery, University of California Los Angeles, Los Angeles, California, USA
| |
Collapse
|
35
|
A Failed Cross-Validation Study on the Relationship between LIWC Linguistic Indicators and Personality: Exemplifying the Lack of Generalizability of Exploratory Studies. PSYCH 2022. [DOI: 10.3390/psych4040059] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022] Open
Abstract
(1) Background: Previous meta-analytic research found small to moderate relationships between the Big Five personality traits and different linguistic computational indicators. However, previous studies included multiple linguistic indicators to predict personality from an exploratory framework. The aim of this study was to conduct a cross-validation study analyzing the relationships between language indicators and personality traits to test the generalizability of previous results; (2) Methods: 643 Spanish undergraduate students were tasked to write a self-description in 500 words (which was evaluated with the LIWC) and to answer a standardized Big Five questionnaire. Two different analytical approaches using multiple linear regression were followed: first, using the complete data and, second, by conducting different cross-validation studies; (3) Results: The results showed medium effect sizes in the first analytical approach. On the contrary, it was found that language and personality relationships were not generalizable in the cross-validation studies; (4) Conclusions: We concluded that moderate effect sizes could be obtained when the language and personality relationships were analyzed in single samples, but it was not possible to generalize the model estimates to other samples. Thus, previous exploratory results found on this line of research appear to be incompatible with a nomothetic approach.
Collapse
|
36
|
Kučera D, Haviger J, Havigerová JM. Personality and Word Use: Study on Czech Language and the Big Five. JOURNAL OF PSYCHOLINGUISTIC RESEARCH 2022; 51:1165-1196. [PMID: 35579837 DOI: 10.1007/s10936-022-09892-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 05/02/2022] [Indexed: 06/15/2023]
Abstract
The study is a follow-up to three published anglophone researches examining the relation between the use of linguistic categories and personality characteristics as outlined in the Big Five model, with the purpose of replicating these and elaborating for the Czech language. The comparative research study in Czech focuses on analysis of both grammatical and semantic variables in six types of text (written and oral), produced by N = 200 participants. Within the study, there were six confirmed relations, however, these appear only in certain types of text. The results show not only an essential role of the text register, but they also allow us to evaluate the universality of findings of studies in English in comparison with other, especially Slavic, languages.
Collapse
Affiliation(s)
- Dalibor Kučera
- Department of Psychology, Faculty of Education, University of South Bohemia, Dukelská 245/9, 37001, České Budějovice, Czech Republic.
| | - Jiří Haviger
- Department of Informatics and Quantitative Methods, Faculty of Informatics and Management, University of Hradec Králové, Hradec Králové, Czech Republic
| | - Jana M Havigerová
- Institute of Psychology, Faculty of Arts, Masaryk University, Brno, Czech Republic
| |
Collapse
|
37
|
Gruber N. The Implicit Achievement Motive in the Writing Style. JOURNAL OF PSYCHOLINGUISTIC RESEARCH 2022; 51:1143-1164. [PMID: 35616763 DOI: 10.1007/s10936-022-09891-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 05/02/2022] [Indexed: 06/15/2023]
Abstract
Linguistic theories and research indicate that unconscious processes should influence the content, but moreover also the way how things are expressed. As the first is well researched and the second is almost neglected, I want to assess how the writing style of a person is related to the implicit achievement motive and its two components hope of success (HS) and fear of failure (FF). Therefore, thematic apperception test/picture story exercise responses of 2942 persons were analyzed regarding the three writing style features (1) syntax, (2) nominal/verbal writing, and (3) function words. According to the assumptions, the results of two independent measures (Stanford Parser and LIWC) show that a verbal fluent writing style with simple syntax is associated with HS, whereby FF-motivated people show nominal writing with interjections, conjunctions, and complex punctuations.
Collapse
Affiliation(s)
- Nicole Gruber
- Department of Culture, Speech and Language, Universität Regensburg, Universitätsstraße 31, D-93053, Regensburg, Germany.
| |
Collapse
|
38
|
Spitzley LA, Wang X, Chen X, Burgoon JK, Dunbar NE, Ge S. Linguistic measures of personality in group discussions. Front Psychol 2022; 13:887616. [PMID: 36186305 PMCID: PMC9523152 DOI: 10.3389/fpsyg.2022.887616] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2022] [Accepted: 08/15/2022] [Indexed: 11/26/2022] Open
Abstract
This investigation sought to find the relationships among multiple dimensions of personality and multiple features of language style. Unlike previous investigations, after controlling for such other moderators as culture and socio-demographics, the current investigation explored those dimensions of naturalistic spoken language that most closely align with communication. In groups of five to eight players, participants (N = 340) from eight international locales completed hour-long competitive games consisting of a series of ostensible missions. Composite measures of quantity, lexical diversity, sentiment, immediacy and negations were measured with an automated tool called SPLICE and with Linguistic Inquiry and Word Count. We also investigated style dynamics over the course of an interaction. We found predictors of extraversion, agreeableness, and neuroticism, but overall fewer significant associations than prior studies, suggesting greater heterogeneity in language style in contexts entailing interactivity, conversation rather than solitary message production, oral rather than written discourse, and groups rather than dyads. Extraverts were found to maintain greater linguistic style consistency over the course of an interaction. The discussion addresses the potential for Type I error when studying the relationship between language and personality.
Collapse
Affiliation(s)
- Lee A. Spitzley
- Department of Information Security and Digital Forensics, University at Albany, SUNY, Albany, NY, United States
- *Correspondence: Lee A. Spitzley,
| | - Xinran Wang
- Department of Management Information Systems, University of Arizona, Tucson, AZ, United States
- Center for the Management of Information Systems, University of Arizona, Tucson, AZ, United States
| | - Xunyu Chen
- Department of Management Information Systems, University of Arizona, Tucson, AZ, United States
- Center for the Management of Information Systems, University of Arizona, Tucson, AZ, United States
| | - Judee K. Burgoon
- Center for the Management of Information Systems, University of Arizona, Tucson, AZ, United States
| | - Norah E. Dunbar
- Department of Communication, University of California, Santa Barbara, Santa Barbara, CA, United States
| | - Saiying Ge
- Department of Management Information Systems, University of Arizona, Tucson, AZ, United States
- Center for the Management of Information Systems, University of Arizona, Tucson, AZ, United States
| |
Collapse
|
39
|
Brauer M, Wiersema M, Binder P. “Dear CEO and Board”: How Activist Investors’ Confidence in Tone Influences Campaign Success. ORGANIZATION SCIENCE 2022. [DOI: 10.1287/orsc.2022.1625] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
Abstract
Activist hedge funds represent the most potent form of financial activism. Yet we do not fully understand how these activist investors, despite holding only a small stake in target firms, are able to influence management and the board to acquiesce to their demands, especially given the large uncertainty that their demands will improve shareholder value. Building on impression management (IM) theory, we propose that activist investors who express their concerns and demands with high confidence in their letters to target firms are likely to be perceived as knowledgeable and competent by the firm’s other shareholders, thus influencing the response of the firm’s management and board. In support of this theoretical proposition, results of our empirical analysis of 475 U.S. activist campaigns against U.S. companies between 2007 and 2019 suggest that confidence in tone in an activist’s letter, as a form of self-promotion, is positively associated with campaign success. We also observe that the positive association between confidence in tone in activist letters and campaign success is less for activists with greater success in prior campaigns and in campaigns with multiple activists. Our paper contributes to financial activism research by showing that activists’ verbal impression management can serve as an effective influence tactic in their campaigns. Our study also contributes to the emerging research stream on verbal IM by introducing a language attribute, confidence in tone, that has not been studied in management research and is distinct from past constructs examined in verbal IM research.
Collapse
Affiliation(s)
- Matthias Brauer
- Department of Management, University of Mannheim, 68131 Mannheim, Germany
| | - Margarethe Wiersema
- The Paul Merage School of Business, University of California, Irvine, California 92697
| | - Philipp Binder
- Department of Management, University of Mannheim, 68131 Mannheim, Germany
| |
Collapse
|
40
|
Liu T, Giorgi S, Yadeta K, Schwartz HA, Ungar LH, Curtis B. Linguistic predictors from Facebook postings of substance use disorder treatment retention versus discontinuation. THE AMERICAN JOURNAL OF DRUG AND ALCOHOL ABUSE 2022; 48:573-585. [PMID: 35853250 PMCID: PMC10231268 DOI: 10.1080/00952990.2022.2091450] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/02/2021] [Revised: 06/02/2022] [Accepted: 06/15/2022] [Indexed: 01/31/2023]
Abstract
Background: Early indicators of who will remain in - or leave - treatment for substance use disorder (SUD) can drive targeted interventions to support long-term recovery.Objectives: To conduct a comprehensive study of linguistic markers of SUD treatment outcomes, the current study integrated features produced by machine learning models known to have social-psychology relevance.Methods: We extracted and analyzed linguistic features from participants' Facebook posts (N = 206, 39.32% female; 55,415 postings) over the two years before they entered a SUD treatment program. Exploratory features produced by both Linguistic Inquiry and Word Count (LIWC) and Latent Dirichlet Allocation (LDA) topic modeling and the features from theoretical domains of religiosity, affect, and temporal orientation via established AI-based linguistic models were utilized.Results: Patients who stayed in the SUD treatment for over 90 days used more words associated with religion, positive emotions, family, affiliations, and the present, and used more first-person singular pronouns (Cohen's d values: [-0.39, -0.57]). Patients who discontinued their treatment before 90 days discussed more diverse topics, focused on the past, and used more articles (Cohen's d values: [0.44, 0.57]). All ps < .05 with Benjamini-Hochberg False Discovery Rate correction.Conclusions: We confirmed the literature on protective and risk social-psychological factors linking to SUD treatment in language analysis, showing that Facebook language before treatment entry could be used to identify the markers of SUD treatment outcomes. This reflects the importance of taking these linguistic features and markers into consideration when designing and recommending SUD treatment plans.
Collapse
Affiliation(s)
- Tingting Liu
- Intramural Research Program, National Institute on Drug Abuse, Baltimore, MD, USA
- Positive Psychology Center, University of Pennsylvania, Philadelphia, PA, USA
| | - Salvatore Giorgi
- Intramural Research Program, National Institute on Drug Abuse, Baltimore, MD, USA
- Department of Computer and Information Science, University of Pennsylvania, Philadelphia, PA, USA
| | - Kenna Yadeta
- Intramural Research Program, National Institute on Drug Abuse, Baltimore, MD, USA
| | - H. Andrew Schwartz
- Positive Psychology Center, University of Pennsylvania, Philadelphia, PA, USA
- Department of Computer Science, Stony Brook University, NY, USA
| | - Lyle H. Ungar
- Positive Psychology Center, University of Pennsylvania, Philadelphia, PA, USA
- Department of Computer and Information Science, University of Pennsylvania, Philadelphia, PA, USA
| | - Brenda Curtis
- Intramural Research Program, National Institute on Drug Abuse, Baltimore, MD, USA
| |
Collapse
|
41
|
Brauer K, Sendatzki R, Proyer RT. Testing associations between language use in descriptions of playfulness and age, gender, and self-reported playfulness in German-speaking adults. Front Psychol 2022; 13:935009. [PMID: 36118454 PMCID: PMC9477000 DOI: 10.3389/fpsyg.2022.935009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2022] [Accepted: 08/04/2022] [Indexed: 11/13/2022] Open
Abstract
Adult playfulness describes individual differences in (re)framing everyday situations as personally interesting, and/or entertaining, and/or intellectually stimulating. We aimed at extending initial evidence on the interconnectedness between language use and adult playfulness by asking 264 participants (M = 26.5 years, SD = 9.7; 66.7% women) to provide written descriptions of their understanding of playfulness (mean length: 30.6 words; SD = 24.1) and collected self-reports of their playfulness. We used the Linguistic Inquiry and Word Count methodology to quantitatively analyze the language use in these descriptions and tested the associations with individual differences in participants’ age, gender, and playfulness. While higher expressions in all measures of playfulness did go along with writing more content when describing playfulness (rs = 0.13 to 0.25), facet-wise analyses revealed differential findings (e.g., intellectual playfulness relates to using words describing cognitive processes); but the effects were small. We found that being a women and younger age were related to writing longer texts (0.13 ≤ rs ≤ 0.24), and we discovered additional associations between certain LIWC categories and age and gender. Our study expands the knowledge about adult playfulness and its manifestations in natural language use. We embed our findings into previous research and discuss limitations and potential approaches for replication studies.
Collapse
|
42
|
Timakum T, Song M, Kim G. Integrated entitymetrics analysis for health information on bipolar disorder using social media data and scientific literature. ASLIB J INFORM MANAG 2022. [DOI: 10.1108/ajim-02-2022-0090] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
PurposeThis study aimed to examine the mental health information entities and associations between the biomedical, psychological and social domains of bipolar disorder (BD) by analyzing social media data and scientific literature.Design/methodology/approachReddit posts and full-text papers from PubMed Central (PMC) were collected. The text analysis was used to create a psychological dictionary. The text mining tools were applied to extract BD entities and their relationships in the datasets using a dictionary- and rule-based approach. Lastly, social network analysis and visualization were employed to view the associations.FindingsMental health information on the drug side effects entity was detected frequently in both datasets. In the affective category, the most frequent entities were “depressed” and “severe” in the social media and PMC data, respectively. The social and personal concerns entities that related to friends, family, self-attitude and economy were found repeatedly in the Reddit data. The relationships between the biomedical and psychological processes, “afraid” and “Lithium” and “schizophrenia” and “suicidal,” were identified often in the social media and PMC data, respectively.Originality/valueMental health information has been increasingly sought-after, and BD is a mental illness with complicated factors in the clinical picture. This paper has made an original contribution to comprehending the biological, psychological and social factors of BD. Importantly, these results have highlighted the benefit of mental health informatics that can be analyzed in the laboratory and social media domains.
Collapse
|
43
|
Yang Q, Farseev A, Nikolenko S, Filchenkov A. Do we behave differently on Twitter and Facebook: Multi-view social network user personality profiling for content recommendation. Front Big Data 2022; 5:931206. [PMID: 35993029 PMCID: PMC9381863 DOI: 10.3389/fdata.2022.931206] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2022] [Accepted: 06/30/2022] [Indexed: 12/03/2022] Open
Abstract
Human personality traits are key drivers behind our decision making, influencing our lives on a daily basis. Inference of personality traits, such as the Myers-Briggs personality type, as well as an understanding of dependencies between personality traits and user behavior on various social media platforms, is of crucial importance to modern research and industry applications such as recommender systems. The emergence of diverse and cross-purpose social media avenues makes it possible to perform user personality profiling automatically and efficiently based on data represented across multiple data modalities. However, research efforts on personality profiling from multi-source multi-modal social media data are relatively sparse; the impact of different social network data on profiling performance and of personality traits on applications such as recommender systems is yet to be evaluated. Furthermore, large-scale datasets are also lacking in the research community. To fill these gaps, in this work we develop a novel multi-view fusion framework PERS that infers Myers-Briggs personality type indicators. We evaluate the results not just across data modalities but also across different social networks, and also evaluate the impact of inferred personality traits on recommender systems. Our experimental results demonstrate that PERS is able to learn from multi-view data for personality profiling by efficiently leveraging highly varied data from diverse social multimedia sources. Furthermore, we demonstrate that inferred personality traits can be beneficial to other industry applications. Among other results, we show that people tend to reveal multiple facets of their personality in different social media avenues. We also release a social multimedia dataset in order to facilitate further research on this direction.
Collapse
Affiliation(s)
- Qi Yang
- Machine Learning Lab, ITMO University, St. Petersburg, Russia
- Somin Research, SoMin.AI, Singapore, Singapore
- *Correspondence: Qi Yang
| | - Aleksandr Farseev
- Machine Learning Lab, ITMO University, St. Petersburg, Russia
- Somin Research, SoMin.AI, Singapore, Singapore
| | - Sergey Nikolenko
- Somin Research, SoMin.AI, Singapore, Singapore
- Steklov Institute of Mathematics at Saint Petersburg, St. Petersburg, Russia
| | | |
Collapse
|
44
|
Zhu Y, Hu L, Ning N, Zhang W, Wu B. A lexical psycholinguistic knowledge-guided graph neural network for interpretable personality detection. Knowl Based Syst 2022. [DOI: 10.1016/j.knosys.2022.108952] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
|
45
|
Ferreira C, Lam J, Pitt L, Caruana A, Brown T. Contrasting compulsive behaviour: Computerized text analysis of compulsion narratives. J Health Psychol 2022; 27:1942-1958. [PMID: 35801352 DOI: 10.1177/13591053211017207] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
Abstract
Those who gamble compulsively, and those who shop or buy in a compulsive manner share a number of common characteristics, stemming from similar impulse-control issues. As such, it is predicted that a lexical analysis of personal narratives of compulsion would share similarities. Using secondary data from an online mental health forum, Psychforums, the research analyzed narratives of compulsive gambling (n = 199) and compulsive buying (n = 196) using the automated text analysis tool, LIWC. The results indicated that compulsive buying narratives rated significantly higher in clout and emotional tone and significantly lower in authenticity, with no significant differences noted in analytical thinking between the two compulsion narratives. Recommendations for future research include that demographic variables be incorporated and that narratives sourced from different online platforms should be contrasted.
Collapse
Affiliation(s)
- Caitlin Ferreira
- University of Cape Town, South Africa.,Luleå University of Technology, Sweden
| | | | - Leyland Pitt
- Simon Fraser University, Canada.,Hanken School of Economics, Finland
| | | | | |
Collapse
|
46
|
|
47
|
Wilson SJ, Kiecolt-Glaser JK. The Story of Us: Older and Younger Couples' Language Use and Emotional Responses to Jointly Told Relationship Narratives. J Gerontol B Psychol Sci Soc Sci 2022; 77:2192-2201. [PMID: 35738871 PMCID: PMC9799216 DOI: 10.1093/geronb/gbac080] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2022] [Indexed: 01/12/2023] Open
Abstract
OBJECTIVES Social-emotional well-being is said to improve over adulthood, and studies of couples' age differences have focused primarily on marital conflict. The way couples discuss their relationship story predicts marital quality among newlyweds and long-married couples alike, yet older and younger couples' accounts have never been compared. The current study examined age differences in couples' use of I/we-talk, emotion words, and immediacy (i.e., an urgent and unresolved style) during a relationship history discussion and their subsequent mood reactivity and appraisals. METHOD Married couples (N = 186 individuals within 93 couples, aged 22-77) recounted the story of their relationship then rated the discussion and their negative mood. Mediation models assessed the 3 linguistic features as parallel dyadic mediators linking couple age to negative mood responses and appraisals, controlling for global marital satisfaction, and baseline negative mood. Secondary analyses examined partners' concordance in language use. RESULTS Compared with younger couples, older couples used more positive than negative words and less immediacy which, in turn, was associated with husbands' and wives' less negative mood and more positive appraisals, only among husbands. Partners in older couples used more similar I/we-talk and emotional language, but these were unrelated to mood or appraisals. DISCUSSION This study extends our understanding of how marital interactions differ by age in the understudied context of relationship history discussions, which may grow increasingly important for couples' well-being with older age. Findings broadly align with social-emotional aging theories and uncover novel linguistic features relevant to the age-related emotional benefits of joint reminiscing.
Collapse
Affiliation(s)
- Stephanie J Wilson
- Address correspondence to: Stephanie J. Wilson, PhD, Psychology, Southern Methodist University, 6116 N. Central Expressway, Dallas, TX 75206, USA. E-mail:
| | - Janice K Kiecolt-Glaser
- The Institute for Behavioral Medicine Research, The Ohio State University College of Medicine, Columbus, OH, USA,Department of Psychiatry and Behavioral Health, OSUMC, Columbus, OH, USA
| |
Collapse
|
48
|
Knowledge Graph-Enabled Text-Based Automatic Personality Prediction. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:3732351. [PMID: 35769270 PMCID: PMC9236841 DOI: 10.1155/2022/3732351] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/03/2022] [Revised: 04/24/2022] [Accepted: 05/26/2022] [Indexed: 11/24/2022]
Abstract
How people think, feel, and behave primarily is a representation of their personality characteristics. By being conscious of the personality characteristics of individuals whom we are dealing with or deciding to deal with, one can competently ameliorate the relationship, regardless of its type. With the rise of Internet-based communication infrastructures (social networks, forums, etc.), a considerable amount of human communications takes place there. The most prominent tool in such communications is the language in written and spoken form that adroitly encodes all those essential personality characteristics of individuals. Text-based Automatic Personality Prediction (APP) is the automated forecasting of the personality of individuals based on the generated/exchanged text contents. This paper presents a novel knowledge graph-enabled approach to text-based APP that relies on the Big Five personality traits. To this end, given a text, a knowledge graph, which is a set of interlinked descriptions of concepts, was built by matching the input text's concepts with DBpedia knowledge base entries. Then, due to achieving a more powerful representation, the graph was enriched with the DBpedia ontology, NRC Emotion Intensity Lexicon, and MRC psycholinguistic database information. Afterwards, the knowledge graph, which is now a knowledgeable alternative for the input text, was embedded to yield an embedding matrix. Finally, to perform personality predictions, the resulting embedding matrix was fed to four suggested deep learning models independently, which are based on convolutional neural network (CNN), simple recurrent neural network (RNN), long short-term memory (LSTM), and bidirectional long short-term memory (BiLSTM). The results indicated considerable improvements in prediction accuracies in all of the suggested classifiers.
Collapse
|
49
|
|
50
|
The development and validation of the Romanian version of Linguistic Inquiry and Word Count 2015 (Ro-LIWC2015). CURRENT PSYCHOLOGY 2022. [DOI: 10.1007/s12144-020-00872-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
Abstract
AbstractToday, performing automatic language analysis to extract meaning from natural language is one of the top-notch directions in social science research, but it can be challenging. Linguistic Inquiry and Word Count 2015 (LIWC2015; Pennebaker et al. 2015) is one of the most versatile, yet easy to master instruments to transform any text into data, meeting the needs of psychologists who are not usually proficient in data science. Moreover, LIWC2015 is already available in multiple languages, which opens the door to exciting intercultural quests. The current article introduces the first Romanian version of LIWC2015, Ro-LIWC2015, and thus, contributes to the line of research concerning multilingual analysis. Throughout the paper, we describe the challenges of creating the Romanian dictionary and discuss other linguistics aspects, which could be useful for new adaptations of LIWC2015. Also, we present the results of two studies for assessing the criterion validity of Ro-LIWC2015. The first study focuses on the consistency between the Romanian and the English dictionaries in analyzing a corpus of books. The second study tests whether Ro-LIWC2015 can acquire linguistic differences in contrasting corpora. For this purpose, we analyzed posts from help-seeking forums for anxiety, depression, and health issues, and leveraged supervised learning to address several classification problems. The selected algorithm allows feature ranking, which facilitates more thorough interpretations. The linguistic markers extracted with Ro-LIWC2015 mirrored a number of disorder-specific features of depression and anxiety. Given the obtained results, this research encourages the use of Ro-LIWC2015 for hypothesis testing.
Collapse
|