1
|
Meyer L, Araiza-Illan G, Rachman L, Gaudrain E, Başkent D. Evaluating speech-in-speech perception via a humanoid robot. Front Neurosci 2024; 18:1293120. [PMID: 38406584 PMCID: PMC10884269 DOI: 10.3389/fnins.2024.1293120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2023] [Accepted: 01/15/2024] [Indexed: 02/27/2024] Open
Abstract
Introduction Underlying mechanisms of speech perception masked by background speakers, a common daily listening condition, are often investigated using various and lengthy psychophysical tests. The presence of a social agent, such as an interactive humanoid NAO robot, may help maintain engagement and attention. However, such robots potentially have limited sound quality or processing speed. Methods As a first step toward the use of NAO in psychophysical testing of speech- in-speech perception, we compared normal-hearing young adults' performance when using the standard computer interface to that when using a NAO robot to introduce the test and present all corresponding stimuli. Target sentences were presented with colour and number keywords in the presence of competing masker speech at varying target-to-masker ratios. Sentences were produced by the same speaker, but voice differences between the target and masker were introduced using speech synthesis methods. To assess test performance, speech intelligibility and data collection duration were compared between the computer and NAO setups. Human-robot interaction was assessed using the Negative Attitude Toward Robot Scale (NARS) and quantification of behavioural cues (backchannels). Results Speech intelligibility results showed functional similarity between the computer and NAO setups. Data collection durations were longer when using NAO. NARS results showed participants had a relatively positive attitude toward "situations of interactions" with robots prior to the experiment, but otherwise showed neutral attitudes toward the "social influence" of and "emotions in interaction" with robots. The presence of more positive backchannels when using NAO suggest higher engagement with the robot in comparison to the computer. Discussion Overall, the study presents the potential of the NAO for presenting speech materials and collecting psychophysical measurements for speech-in-speech perception.
Collapse
Affiliation(s)
- Luke Meyer
- Department of Otorhinolaryngology/Head and Neck Surgery, University Medical Center Groningen, University of Groningen, Groningen, Netherlands
- University Medical Center Groningen, W.J. Kolff Institute for Biomedical Engineering and Materials Science, University of Groningen, Groningen, Netherlands
| | - Gloria Araiza-Illan
- Department of Otorhinolaryngology/Head and Neck Surgery, University Medical Center Groningen, University of Groningen, Groningen, Netherlands
- University Medical Center Groningen, W.J. Kolff Institute for Biomedical Engineering and Materials Science, University of Groningen, Groningen, Netherlands
| | - Laura Rachman
- Department of Otorhinolaryngology/Head and Neck Surgery, University Medical Center Groningen, University of Groningen, Groningen, Netherlands
- University Medical Center Groningen, W.J. Kolff Institute for Biomedical Engineering and Materials Science, University of Groningen, Groningen, Netherlands
- Pento Audiology Centre, Zwolle, Netherlands
| | - Etienne Gaudrain
- Lyon Neuroscience Research Center, CNRS UMR 5292, INSERM UMRS 1028, Université Claude Bernard Lyon 1, Université de Lyon, Lyon, France
| | - Deniz Başkent
- Department of Otorhinolaryngology/Head and Neck Surgery, University Medical Center Groningen, University of Groningen, Groningen, Netherlands
- University Medical Center Groningen, W.J. Kolff Institute for Biomedical Engineering and Materials Science, University of Groningen, Groningen, Netherlands
| |
Collapse
|
2
|
Meyer L, Rachman L, Araiza-Illan G, Gaudrain E, Başkent D. Use of a humanoid robot for auditory psychophysical testing. PLoS One 2023; 18:e0294328. [PMID: 38091272 PMCID: PMC10718414 DOI: 10.1371/journal.pone.0294328] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2023] [Accepted: 10/31/2023] [Indexed: 12/18/2023] Open
Abstract
Tasks in psychophysical tests can at times be repetitive and cause individuals to lose engagement during the test. To facilitate engagement, we propose the use of a humanoid NAO robot, named Sam, as an alternative interface for conducting psychophysical tests. Specifically, we aim to evaluate the performance of Sam as an auditory testing interface, given its potential limitations and technical differences, in comparison to the current laptop interface. We examine the results and durations of two voice perception tests, voice cue sensitivity and voice gender categorisation, obtained from both the conventionally used laptop interface and Sam. Both tests investigate the perception and use of two speaker-specific voice cues, fundamental frequency (F0) and vocal tract length (VTL), important for characterising voice gender. Responses are logged on the laptop using a connected mouse, and on Sam using the tactile sensors. Comparison of test results from both interfaces shows functional similarity between the interfaces and replicates findings from previous studies with similar tests. Comparison of test durations shows longer testing times with Sam, primarily due to longer processing times in comparison to the laptop, as well as other design limitations due to the implementation of the test on the robot. Despite the inherent constraints of the NAO robot, such as in sound quality, relatively long processing and testing times, and different methods of response logging, the NAO interface appears to facilitate collecting similar data to the current laptop interface, confirming its potential as an alternative psychophysical test interface for auditory perception tests.
Collapse
Affiliation(s)
- Luke Meyer
- Department of Otorhinolaryngology, Head and Neck Surgery, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
- W.J. Kolff Institute for Biomedical Engineering and Materials Science, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Laura Rachman
- Department of Otorhinolaryngology, Head and Neck Surgery, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
- W.J. Kolff Institute for Biomedical Engineering and Materials Science, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Gloria Araiza-Illan
- Department of Otorhinolaryngology, Head and Neck Surgery, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
- W.J. Kolff Institute for Biomedical Engineering and Materials Science, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Etienne Gaudrain
- Lyon Neuroscience Research Center, CNRS UMR 5292, INSERM UMRS 1028, Université Claude Bernard Lyon 1, Université de Lyon, Lyon, France
| | - Deniz Başkent
- Department of Otorhinolaryngology, Head and Neck Surgery, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
- W.J. Kolff Institute for Biomedical Engineering and Materials Science, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| |
Collapse
|
3
|
Keleman AA, Chang CH, Bollinger RM, Lingler JH, Gabel M, Stark SL. Psychometric Evaluation of the Perceived Research Burden Assessment (PeRBA) in Longitudinal Studies of Alzheimer Disease Using Rasch Analysis. Alzheimer Dis Assoc Disord 2023; 37:28-34. [PMID: 36251929 PMCID: PMC9974570 DOI: 10.1097/wad.0000000000000532] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2022] [Accepted: 09/14/2022] [Indexed: 11/26/2022]
Abstract
INTRODUCTION The Perceived Research Burden Assessment (PeRBA) was developed to measure participant perceptions of burden in research studies. This study aimed to examine the psychometric properties of this assessment using Rasch analysis in participants in the longitudinal studies of the Alzheimer disease (AD) and their family members. METHODS PeRBA was administered to 443 participants in studies of AD and 212 family members across 4 Alzheimer Disease Research Centers. We used Rasch analysis to examine PeRBA's psychometric properties, and data-model fit both at item and scale levels. RESULTS PeRBA demonstrated good reliability and item and person fit for participants and family members. A few items did not fit the model for participants or family members. Areas of content redundancy were found in items assessing similar amounts of perceived research burden. Areas of content gaps were also found, with no items assessing certain levels of perceived research burden. CONCLUSION Analysis results support the good overall psychometric properties of PeRBA among research participants in studies of AD and their family members. Recommendations have been provided to improve the assessment, including rewording items and adding items that could account for a broader range of perceived research burden.
Collapse
Affiliation(s)
- Audrey A. Keleman
- Program in Occupational Therapy, Washington University School of Medicine, St. Louis, MO
| | - Chih-Hung Chang
- Program in Occupational Therapy, Washington University School of Medicine, St. Louis, MO
- Institute for Informatics, Washington University School of Medicine, St. Louis, MO
- Department of Orthopaedic Surgery, Washington University School of Medicine, St. Louis, MO
| | - Rebecca M. Bollinger
- Program in Occupational Therapy, Washington University School of Medicine, St. Louis, MO
| | - Jennifer H. Lingler
- School of Nursing, Department of Health and Community Systems University of Pittsburgh, Pittsburgh, PA
| | - Matthew Gabel
- Department of Political Science, Washington University in St. Louis, St. Louis, MO
| | - Susan L. Stark
- Program in Occupational Therapy, Washington University School of Medicine, St. Louis, MO
| |
Collapse
|
4
|
van den Berg B, Vanwinsen L, Jansen N, Buitenweg JR. Real-time estimation of perceptual thresholds based on the electroencephalogram using a deep neural network. J Neurosci Methods 2022; 374:109580. [DOI: 10.1016/j.jneumeth.2022.109580] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2021] [Revised: 02/21/2022] [Accepted: 03/21/2022] [Indexed: 10/18/2022]
|
5
|
Mašková I, Kučera D. Performance, Achievement, and Success in Psychological Research: Towards a More Transparent Use of the Still Ambiguous Terminology. Psychol Rep 2021; 125:1218-1261. [PMID: 33632018 DOI: 10.1177/0033294121996000] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
The present study focused on the terms performance, achievement, and success that have often been used in an ambiguous manner in psychological research. The way in which the meaning of the domain-specific constructs referred to with the terms was established for measurement purposes was investigated on a sample of 262 articles that stemmed from 35 randomly selected journals covering the full range of psychological research. The operational definitions of the constructs referred to with the terms performance, achievement, and success were analysed and compared in both inter- and intra-domain fashion. Additionally, we assessed the match among the observed operational definitions and general conceptual definitions available in the extant literature. The results revealed terminology-related issues in educational and occupational research. Within these domains, lack of adherence to the multidimensionality of the constructs of academic performance, academic achievement, academic success, job performance, and career success was identified as a general issue. Further, the tendency to measure job performance via indicators based on self-rating was considered inadequate given the objective nature of the term performance. In educational research, the overlap of the academic performance, academic achievement, and academic success constructs was confirmed, resulting from the tendency to use GPA as a universal indicator of academic outcomes. Based on the present findings, we provided several recommendations in order to encourage future research towards a more transparent way of dealing with the particular constructs referred to with the terms performance, achievement, and success. We suppose the present study may help researchers in the full range of psychological disciplines to add clarity to their own research.
Collapse
Affiliation(s)
- Ivana Mašková
- Department of Psychology, Faculty of Education, University of South Bohemia, České Budějovice, Czech Republic
| | - Dalibor Kučera
- Department of Psychology, Faculty of Education, University of South Bohemia, České Budějovice, Czech Republic
| |
Collapse
|
6
|
Wilkinson HR, Smid C, Morris S, Farran EK, Dumontheil I, Mayer S, Tolmie A, Bell D, Porayska-Pomsta K, Holmes W, Mareschal D, Thomas MSC. Domain-Specific Inhibitory Control Training to Improve Children's Learning of Counterintuitive Concepts in Mathematics and Science. JOURNAL OF COGNITIVE ENHANCEMENT 2019; 4:296-314. [PMID: 32832846 PMCID: PMC7410229 DOI: 10.1007/s41465-019-00161-4] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2019] [Accepted: 11/25/2019] [Indexed: 12/01/2022]
Abstract
Evidence from cognitive neuroscience suggests that learning counterintuitive concepts in mathematics and science requires inhibitory control (IC). This prevents interference from misleading perceptual cues and naïve theories children have built from their experiences of the world. Here, we (1) investigate associations between IC, counterintuitive reasoning, and academic achievement and (2) evaluate a classroom-based computerised intervention, called Stop & Think, designed to embed IC training within the learning domain (i.e. mathematics and science content from the school curricula). Cross-sectional analyses of data from 627 children in Years 3 and 5 (7- to 10-year-olds) demonstrated that IC, measured on a Stroop-like task, was associated with counterintuitive reasoning and mathematics and science achievement. A subsample (n = 456) participated either in Stop & Think as a whole-class activity (teacher-led, STT) or using individual computers (pupil-led, STP), or had teaching as usual (TAU). For Year 3 children (but not Year 5), Stop & Think led to better counterintuitive reasoning (i.e. near transfer) in STT (p < .001, ηp 2 = .067) and STP (p < .01, ηp 2 = .041) compared to TAU. Achievement data was not available for Year 3 STP or Year 5 STT. For Year 3, STT led to better science achievement (i.e. far transfer) compared to TAU (p < .05, ηp 2 = .077). There was no transfer to the Stroop-like measure of IC. Overall, these findings support the idea that IC may contribute to counterintuitive reasoning and mathematics and science achievement. Further, we provide preliminary evidence of a domain-specific IC intervention with transferable benefits to academic achievement for Year 3 children.
Collapse
Affiliation(s)
- Hannah R. Wilkinson
- Centre for Brain and Cognitive Development, Birkbeck, University of London, London, UK
- Centre for Brain and Cognitive Development, Birkbeck, University of London, London, UK
| | - Claire Smid
- Centre for Brain and Cognitive Development, Birkbeck, University of London, London, UK
- Centre for Brain and Cognitive Development, Birkbeck, University of London, London, UK
| | - Su Morris
- Centre for Brain and Cognitive Development, Birkbeck, University of London, London, UK
- UCL Institute of Education, University College of London, London, UK
| | - Emily K. Farran
- Centre for Brain and Cognitive Development, Birkbeck, University of London, London, UK
- School of Psychology, University of Surrey, Guildford, UK
| | - Iroise Dumontheil
- Centre for Brain and Cognitive Development, Birkbeck, University of London, London, UK
- Centre for Brain and Cognitive Development, Birkbeck, University of London, London, UK
| | - Sveta Mayer
- Centre for Brain and Cognitive Development, Birkbeck, University of London, London, UK
- UCL Institute of Education, University College of London, London, UK
| | - Andrew Tolmie
- Centre for Brain and Cognitive Development, Birkbeck, University of London, London, UK
- UCL Institute of Education, University College of London, London, UK
| | - Derek Bell
- Centre for Brain and Cognitive Development, Birkbeck, University of London, London, UK
- Learnus, London, UK
| | - Kaśka Porayska-Pomsta
- Centre for Brain and Cognitive Development, Birkbeck, University of London, London, UK
- UCL Institute of Education, University College of London, London, UK
| | - Wayne Holmes
- Centre for Brain and Cognitive Development, Birkbeck, University of London, London, UK
- Nesta, London, UK
| | - Denis Mareschal
- Centre for Brain and Cognitive Development, Birkbeck, University of London, London, UK
- Centre for Brain and Cognitive Development, Birkbeck, University of London, London, UK
| | - Michael S. C. Thomas
- Centre for Brain and Cognitive Development, Birkbeck, University of London, London, UK
- Centre for Brain and Cognitive Development, Birkbeck, University of London, London, UK
| | - The UnLocke Team
- Centre for Brain and Cognitive Development, Birkbeck, University of London, London, UK
- Centre for Brain and Cognitive Development, Birkbeck, University of London, London, UK
- UCL Institute of Education, University College of London, London, UK
- School of Psychology, University of Surrey, Guildford, UK
- Learnus, London, UK
- Nesta, London, UK
| |
Collapse
|
7
|
Jalali S, Martin SE, Murphy CP, Solomon JA, Yarrow K. Classification Videos Reveal the Visual Information Driving Complex Real-World Speeded Decisions. Front Psychol 2018; 9:2229. [PMID: 30524338 PMCID: PMC6256113 DOI: 10.3389/fpsyg.2018.02229] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2018] [Accepted: 10/29/2018] [Indexed: 11/13/2022] Open
Abstract
Humans can rapidly discriminate complex scenarios as they unfold in real time, for example during law enforcement or, more prosaically, driving and sport. Such decision-making improves with experience, as new sources of information are exploited. For example, sports experts are able to predict the outcome of their opponent's next action (e.g., a tennis stroke) based on kinematic cues "read" from preparatory body movements. Here, we explore the use of psychophysical classification-image techniques to reveal how participants interpret complex scenarios. We used sport as a test case, filming tennis players serving and hitting ground strokes, each with two possible directions. These videos were presented to novices and club-level amateurs, running from 0.8 s before to 0.2 s after racquet-ball contact. During practice, participants anticipated shot direction under a time limit targeting 90% accuracy. Participants then viewed videos through Gaussian windows ("bubbles") placed at random in the temporal, spatial or spatiotemporal domains. Comparing bubbles from correct and incorrect trials revealed how information from different regions contributed toward a correct response. Temporally, only later frames of the videos supported accurate responding (from ~0.05 s before ball contact to 0.1 s afterwards). Spatially, information was accrued from the ball's trajectory and from the opponent's head. Spatiotemporal bubbles again highlighted ball trajectory information, but seemed susceptible to an attentional cuing artifact, which may caution against their wider use. Overall, bubbles proved effective in revealing regions of information accrual, and could thus be applied to help understand choice behavior in a range of ecologically valid situations.
Collapse
Affiliation(s)
- Sepehr Jalali
- Department of Psychology, City, University of London, London, United Kingdom
| | - Sian E Martin
- Department of Psychology, City, University of London, London, United Kingdom
| | - Colm P Murphy
- Expert Performance and Skill Acquisition Research Group, School of Sport, Health and Applied Science, St Mary's University, Twickenham, United Kingdom
| | - Joshua A Solomon
- Centre for Applied Vision Science, City, University of London, London, United Kingdom
| | - Kielan Yarrow
- Department of Psychology, City, University of London, London, United Kingdom
| |
Collapse
|
8
|
Smith ML, Grühn D, Bevitt A, Ellis M, Ciripan O, Scrimgeour S, Papasavva M, Ewing L. Transmitting and decoding facial expressions of emotion during healthy aging: More similarities than differences. J Vis 2018; 18:10. [PMID: 30208429 DOI: 10.1167/18.9.10] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Older adults tend to perform more poorly than younger adults on emotional expression identification tasks. The goal of the present study was to test a processing mechanism that might explain these differences in emotion recognition-specifically, age-related variation in the utilization of specific visual cues. Seventeen younger and 17 older adults completed a reverse-correlation emotion categorization task (Bubbles paradigm), consisting of a large number of trials in each of which only part of the visual information used to convey an emotional facial expression was revealed to participants. The task allowed us to pinpoint the visual features each group used systematically to correctly recognize the emotional expressions shown. To address the possibility that faces of different age groups are differently processed by younger and older adults, we included younger, middle-aged, and older adult face models displaying happy, fearful, angry, disgusted, and sad facial expressions. Our results reveal strong similarity in the utilization of visual information by younger and older adult participants in decoding the emotional expressions from faces across ages-particularly for happy and fear emotions. These findings suggest that age-related differences in strategic information use are unlikely to contribute to the decline of facial expression recognition skills observed in later life.
Collapse
Affiliation(s)
- Marie L Smith
- School of Psychological Sciences, Birkbeck College, University of London, London, UK
| | - Daniel Grühn
- Department of Psychology, North Carolina State University, Raleigh, NC, USA
| | - Ann Bevitt
- School of Psychological Sciences, Birkbeck College, University of London, London, UK
| | - Mark Ellis
- School of Psychological Sciences, Birkbeck College, University of London, London, UK
| | - Oana Ciripan
- School of Psychological Sciences, Birkbeck College, University of London, London, UK
| | - Susan Scrimgeour
- School of Psychological Sciences, Birkbeck College, University of London, London, UK
| | - Michael Papasavva
- School of Psychological Sciences, Birkbeck College, University of London, London, UK
| | - Louise Ewing
- School of Psychological Sciences, Birkbeck College, University of London, London, UK.,School of Psychology, University of East Anglia, Norwich, UK.,Australian Research Council Centre of Excellence in Cognition and its Disorders, School of Psychology University of Western Australia, Crawley, Western Australia, Australia
| |
Collapse
|