1
|
Wyly S, Jinon N, Francis T, Evans H, Kao TL, Lambert S, Montgomery S, Newlove M, Mariscal H, Nguyen H, Cole H, Aispuro I, Robledo D, Tenaglia O, Weinberger N, Nguyen B, Waits H, Jorian D, Koch-Kreher L, Myrdal H, Antoniou V, Warrier M, Wunsch L, Arce I, Kirchner K, Campos E, Nguyen A, Rodriguez K, Cao L, Halmekangas A, Wilson RC. The psychophysiology of Mastermind: Characterizing response times and blinking in a high-stakes television game show. Psychophysiology 2024; 61:e14485. [PMID: 37966011 DOI: 10.1111/psyp.14485] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2023] [Revised: 10/20/2023] [Accepted: 10/21/2023] [Indexed: 11/16/2023]
Abstract
Television game shows have proven to be a valuable resource for studying human behavior under conditions of high stress and high stakes. However, previous work has focused mostly on choices-ignoring much of the rich visual information that is available on screen. Here, we take a first step to extracting more of this information by investigating the response times and blinking of contestants in the BBC show Mastermind. In Mastermind, contestants answer rapid-fire quiz questions while a camera slowly zooms in on their faces. By labeling contestants' behavior and blinks from 25 episodes, we asked how accuracy, response times, and blinking varied over the course of the game. For accuracy and response times, we tested whether contestants responded more accurately and more slowly after an error-exhibiting the "post-error increase in accuracy" and "post-error slowing" which has been repeatedly observed in the lab. For blinking, we tested whether blink rates varied according to the cognitive demands of the game-decreasing during periods of cognitive load, such as when pondering a response, and increasing at event boundaries in the task, such as the start of a question. In contrast to the lab, evidence for post-error changes in accuracy and response time was weak, with only marginal effects observed. In line with the lab, blinking varied over the course of the game much as we predicted. Overall, our findings demonstrate the potential of extracting dynamic signals from game shows to study the psychophysiology of behavior in the real world.
Collapse
Affiliation(s)
- Skyler Wyly
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Neryanne Jinon
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Timothy Francis
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Hailey Evans
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Tsai Lieh Kao
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Shelby Lambert
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Shayne Montgomery
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Marvelene Newlove
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Haley Mariscal
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Henry Nguyen
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Harrison Cole
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Israel Aispuro
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Daniela Robledo
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Olivia Tenaglia
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Nina Weinberger
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Bill Nguyen
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Hailey Waits
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Daisy Jorian
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Lucas Koch-Kreher
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Hunter Myrdal
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Victoria Antoniou
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Meghana Warrier
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Leah Wunsch
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Iram Arce
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Kayla Kirchner
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Elena Campos
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - An Nguyen
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | | | - Lanqin Cao
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Avery Halmekangas
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Robert C Wilson
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
- McKnight Brain Research Foundation, University of Arizona, Tucson, Arizona, USA
- Cognitive Science Program, University of Arizona, Tucson, Arizona, USA
| |
Collapse
|
2
|
Oh J, Lee T, Chung ES, Kim H, Cho K, Kim H, Choi J, Sim HH, Lee J, Choi IY, Kim DJ. Development of depression detection algorithm using text scripts of routine psychiatric interview. Front Psychiatry 2024; 14:1256571. [PMID: 38239906 PMCID: PMC10794729 DOI: 10.3389/fpsyt.2023.1256571] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/11/2023] [Accepted: 12/13/2023] [Indexed: 01/22/2024] Open
Abstract
Background A psychiatric interview is one of the important procedures in diagnosing psychiatric disorders. Through this interview, psychiatrists listen to the patient's medical history and major complaints, check their emotional state, and obtain clues for clinical diagnosis. Although there have been attempts to diagnose a specific mental disorder from a short doctor-patient conversation, there has been no attempt to classify the patient's emotional state based on the text scripts from a formal interview of more than 30 min and use it to diagnose depression. This study aimed to utilize the existing machine learning algorithm in diagnosing depression using the transcripts of one-on-one interviews between psychiatrists and depressed patients. Methods Seventy-seven clinical patients [with depression (n = 60); without depression (n = 17)] with a prior psychiatric diagnosis history participated in this study. The study was conducted with 24 male and 53 female subjects with the mean age of 33.8 (± 3.0). Psychiatrists conducted a conversational interview with each patient that lasted at least 30 min. All interviews with the subjects between August 2021 and November 2022 were recorded and transcribed into text scripts, and a text emotion recognition module was used to indicate the subject's representative emotions of each sentence. A machine learning algorithm discriminates patients with depression and those without depression based on text scripts. Results A machine learning model classified text scripts from depressive patients with non-depressive ones with an acceptable accuracy rate (AUC of 0.85). The distribution of emotions (surprise, fear, anger, love, sadness, disgust, neutral, and happiness) was significantly different between patients with depression and those without depression (p < 0.001), and the most contributing emotion in classifying the two groups was disgust (p < 0.001). Conclusion This is a qualitative and retrospective study to develop a tool to detect depression against patients without depression based on the text scripts of psychiatric interview, suggesting a novel and practical approach to understand the emotional characteristics of depression patients and to use them to detect the diagnosis of depression based on machine learning methods. This model could assist psychiatrists in clinical settings who conduct routine conversations with patients using text transcripts of the interviews.
Collapse
Affiliation(s)
- Jihoon Oh
- Department of Psychiatry, College of Medicine, Seoul St. Mary’s Hospital, The Catholic University of Korea, Seoul, Republic of Korea
| | - Taekgyu Lee
- College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea
| | - Eun Su Chung
- College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea
| | | | | | | | - Jihye Choi
- Department of Psychiatry, College of Medicine, Seoul St. Mary’s Hospital, The Catholic University of Korea, Seoul, Republic of Korea
| | - Hyeon-Hee Sim
- Department of Psychiatry, College of Medicine, Seoul St. Mary’s Hospital, The Catholic University of Korea, Seoul, Republic of Korea
| | - Jongseo Lee
- College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea
| | - In Young Choi
- Department of Medical Informatics, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea
| | - Dai-Jin Kim
- Department of Psychiatry, College of Medicine, Seoul St. Mary’s Hospital, The Catholic University of Korea, Seoul, Republic of Korea
- Department of Medical Informatics, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea
| |
Collapse
|
7
|
The Relationship between Stress Levels Measured by a Questionnaire and the Data Obtained by Smart Glasses and Finger Pulse Oximeters among Polish Dental Students. APPLIED SCIENCES-BASEL 2021. [DOI: 10.3390/app11188648] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
Stress is a physical, mental, or emotional response to a change and is a significant problem in modern society. In addition to questionnaires, levels of stress may be assessed by monitoring physiological signals, such as via photoplethysmogram (PPG), electroencephalogram (EEG), electrocardiogram (ECG), electrodermal activity (EDA), facial expressions, and head and body movements. In our study, we attempted to find the relationship between the perceived stress level and physiological signals, such as heart rate (HR), head movements, and electrooculographic (EOG) signals. The perceived stress level was acquired by self-assessment questionnaires in which the participants marked their stress level before, during, and after performing a task. The heart rate was acquired with a finger pulse oximeter and the head movements (linear acceleration and angular velocity) and electrooculographic signals were recorded with JINS MEME ES_R smart glasses (JINS Holdings, Inc., Tokyo, Japan). We observed significant differences between the perceived stress level, heart rate, the power of linear acceleration, angular velocity, and EOG signals before performing the task and during the task. However, except for HR, these signals were poorly correlated with the perceived stress level acquired during the task.
Collapse
|