1
|
Di Lernia D, Finotti G, Tsakiris M, Riva G, Naber M. Remote photoplethysmography (rPPG) in the wild: Remote heart rate imaging via online webcams. Behav Res Methods 2024:10.3758/s13428-024-02398-0. [PMID: 38632165 DOI: 10.3758/s13428-024-02398-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/12/2024] [Indexed: 04/19/2024]
Abstract
Remote photoplethysmography (rPPG) is a low-cost technique to measure physiological parameters such as heart rate by analyzing videos of a person. There has been growing attention to this technique due to the increased possibilities and demand for running psychological experiments on online platforms. Technological advancements in commercially available cameras and video processing algorithms have led to significant progress in this field. However, despite these advancements, past research indicates that suboptimal video recording conditions can severely compromise the accuracy of rPPG. In this study, we aimed to develop an open-source rPPG methodology and test its performance on videos collected via an online platform, without control of the hardware of the participants and the contextual variables, such as illumination, distance, and motion. Across two experiments, we compared the results of the rPPG extraction methodology to a validated dataset used for rPPG testing. Furthermore, we then collected 231 online video recordings and compared the results of the rPPG extraction to finger pulse oximeter data acquired with a validated mobile heart rate application. Results indicated that the rPPG algorithm was highly accurate, showing a significant degree of convergence with both datasets thus providing an improved tool for recording and analyzing heart rate in online experiments.
Collapse
Affiliation(s)
- Daniele Di Lernia
- Humane Technology Lab, Università Cattolica del Sacro Cuore, Largo Gemelli, 1, 20100, Milan, Italy.
- Applied Technology for Neuro-Psychology Lab, IRCCS Istituto Auxologico Italiano, Via Magnasco, 2, 20149, Milan, Italy.
- Department of Psychology, Università Cattolica del Sacro Cuore, Largo Gemelli, 1, 20100, Milan, Italy.
| | - Gianluca Finotti
- Lab of Action and Body, Department of Psychology, Royal Holloway, University of London, Egham Hill, Egham, TW20 0EX, UK
| | - Manos Tsakiris
- Lab of Action and Body, Department of Psychology, Royal Holloway, University of London, Egham Hill, Egham, TW20 0EX, UK
- Centre for the Politics of Feelings, School of Advanced Study, University of London, London, UK
| | - Giuseppe Riva
- Humane Technology Lab, Università Cattolica del Sacro Cuore, Largo Gemelli, 1, 20100, Milan, Italy
- Applied Technology for Neuro-Psychology Lab, IRCCS Istituto Auxologico Italiano, Via Magnasco, 2, 20149, Milan, Italy
| | - Marnix Naber
- Experimental Psychology, Helmholtz Institute, Utrecht University, Heidelberglaan 1, 3584CS, Utrecht, The Netherlands
| |
Collapse
|
2
|
Parrotta E, Bach P, Perrucci MG, Costantini M, Ferri F. Heart is deceitful above all things: Threat expectancy induces the illusory perception of increased heartrate. Cognition 2024; 245:105719. [PMID: 38278039 DOI: 10.1016/j.cognition.2024.105719] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2023] [Revised: 11/24/2023] [Accepted: 01/08/2024] [Indexed: 01/28/2024]
Abstract
It has been suggested that our perception of the internal milieu, or the body's internal state, is shaped by our beliefs and previous knowledge about the body's expected state, rather than being solely based on actual interoceptive experiences. This study investigated whether heartbeat perception could be illusorily distorted towards prior subjective beliefs, such that threat expectations suffice to induce a misperception of heartbeat frequency. Participants were instructed to focus on their cardiac activity and report their heartbeat, either tapping along to it (Experiment 1) or silently counting (Experiment 2) while ECG was recorded. While completing this task, different cues provided valid predictive information about the intensity of an upcoming cutaneous stimulation (high- vs. low- pain). Results showed that participants expected a heart rate increase over the anticipation of high- vs. low-pain stimuli and that this belief was perceptually instantiated, as suggested by their interoceptive reports. Importantly, the perceived increase was not mirrored by the real heart rate. Perceptual modulations were absent when participants executed the same task but with an exteroceptive stimulus (Experiment 3). The findings reveal, for the first time, an interoceptive illusion of increased heartbeats elicited by threat expectancy and shed new light on interoceptive processes through the lenses of Bayesian predictive processes, providing tantalizing insights into how such illusory phenomena may intersect with the recognition and regulation of people's internal states.
Collapse
Affiliation(s)
- Eleonora Parrotta
- School of Psychology, University of Aberdeen, UK; School of Psychology, University of Plymouth, UK.
| | - Patric Bach
- School of Psychology, University of Aberdeen, UK; School of Psychology, University of Plymouth, UK
| | - Mauro Gianni Perrucci
- Department of Neuroscience, Imaging and Clinical Sciences, "G. d'Annunzio" University of Chieti-Pescara, Chieti, Italy; Institute for Advanced Biomedical Technologies - ITAB, "G. d'Annunzio" University of Chieti-Pescara, Chieti, Italy
| | - Marcello Costantini
- Department of Psychological, Health and Territorial Sciences, "G. d'Annunzio" University of Chieti-Pescara, Chieti, Italy; Institute for Advanced Biomedical Technologies - ITAB, "G. d'Annunzio" University of Chieti-Pescara, Chieti, Italy
| | - Francesca Ferri
- Department of Neuroscience, Imaging and Clinical Sciences, "G. d'Annunzio" University of Chieti-Pescara, Chieti, Italy; Institute for Advanced Biomedical Technologies - ITAB, "G. d'Annunzio" University of Chieti-Pescara, Chieti, Italy
| |
Collapse
|