A novel Heart Rate Variability analysis using Lagged Poincaré plot: A study on hedonic visual elicitation

Datasets for Automated Affect and Emotion Recognition from Cardiovascular Signals Using Artificial Intelligence- A Systematic Review

Simple Summary

We reviewed the literature on the publicly available datasets used to automatically recognise emotion and affect using artificial intelligence (AI) techniques. We were particularly interested in databases with cardiovascular (CV) data. Additionally, we assessed the quality of the included papers. We searched the sources until 31 August 2020. Each step of identification was carried out independently by two reviewers to maintain the credibility of our review. In case of disagreement, we discussed them. Each action was first planned and described in a protocol that we posted on the Open Science Framework (OSF) platform. We selected 18 works focused on providing datasets of CV signals for automated affect and emotion recognition. In total, data for 812 participants aged 17 to 47 were analysed. The most frequently recorded signal was electrocardiography. The authors most often used video stimulation. Noticeably, we did not find much necessary information in many of the works, resulting in mainly low quality among included papers. Researchers in this field should focus more on how they carry out experiments.

Abstract

Our review aimed to assess the current state and quality of publicly available datasets used for automated affect and emotion recognition (AAER) with artificial intelligence (AI), and emphasising cardiovascular (CV) signals. The quality of such datasets is essential to create replicable systems for future work to grow. We investigated nine sources up to 31 August 2020, using a developed search strategy, including studies considering the use of AI in AAER based on CV signals. Two independent reviewers performed the screening of identified records, full-text assessment, data extraction, and credibility. All discrepancies were resolved by discussion. We descriptively synthesised the results and assessed their credibility. The protocol was registered on the Open Science Framework (OSF) platform. Eighteen records out of 195 were selected from 4649 records, focusing on datasets containing CV signals for AAER. Included papers analysed and shared data of 812 participants aged 17 to 47. Electrocardiography was the most explored signal (83.33% of datasets). Authors utilised video stimulation most frequently (52.38% of experiments). Despite these results, much information was not reported by researchers. The quality of the analysed papers was mainly low. Researchers in the field should concentrate more on methodology.

Quantifying the lagged Poincaré plot geometry of ultrashort heart rate variability series: automatic recognition of odor hedonic tone

The application of Poincaré plot analysis to characterize inter-beat interval dynamics has been successfully proposed in the scientific literature for the assessment of humans' physiological states and related aberrations. In this study, we proposed novel descriptors to trace the evolution of Poincaré plot shape over the lags. Their reliability in ultra-short cardiovascular series analysis was validated on synthetic inter-beat series generated through a physiologically plausible integral pulse frequency modulation model. Furthermore, we used the proposed approach for the investigation of the direct relationship between autonomic nervous system (ANS) dynamics and hedonic olfactory elicitation, in a group of 30 healthy subjects. Participants with a similar olfactory threshold were selected, and were asked to score 5-s stimuli in terms of arousal and valence levels according to the Russell's circumflex model of affect. Their ANS response was investigated in 35-s windows after the elicitation. Experimental results showed a gender-specific, high discriminant power of the proposed approach, discerning between pleasant and unpleasant odorants with an accuracy of 83.33% and 73.33% for men and for women, respectively. Graphical Abstract Olfaction plays a crucial role in our life and is strictly related to the Autonomic Nervous System (ANS) activity, which can be monitored studying Heart Rate Variability. We used the Lagged Poincare Plot approach to recognize gender-specific ANS response in 35-second windows after the elicitation through pleasant/unpleasant odorants.

Cardiovascular assessment of supportive doctor-patient communication using multi-scale and multi-lag analysis of heartbeat dynamics

Emphatic doctor-patient communication has been associated with improved psycho-physiological well-being involving cardiovascular and neuroendocrine responses. Nevertheless, a comprehensive assessment of heartbeat linear and nonlinear dynamics throughout the communication of a life-threatening disease has not been performed yet. To this extent, we studied linear heartbeat dynamics through the extraction of time-frequency domain measurements, as well as heartbeat nonlinear and complex dynamics through novel approaches to compute multi-scale and multi-lag series analyses: namely, the multi-scale distribution entropy and lagged Poincaré plot symbolic analysis. Heart rate variability series were recorded from 54 healthy female subjects who were blind to the aim of the experiment. Participants were randomly assigned into two groups: 27 subjects watched a video where an oncologist discloses the diagnosis of a cancer metastasis to a patient, whereas the remaining 27 watched the same video including four additional supportive comments by the clinician. Considering differences between the beginning and the end of each communication video, results from non-parametric Wilcoxon tests demonstrated that, at a group level, significant differences occurred in heartbeat linear and nonlinear dynamics, with lower complexity during nonsupportive communication. Furthermore, a support vector machine algorithm, validated using a leave-one-subject-out procedure, was able to discern the supportive experience at a single-subject level with an accuracy of 83.33% when nonlinear features were considered, dropping to 51.85% when using standard HRV features only. In conclusion, heartbeat nonlinear and complex dynamics can be a viable tool for the psycho-physiological evaluation of supportive doctor-patient communication. Graphical Abstract Scheme of the three main stages of the study: signal acquisition during doctor-patient communication, ECG signal processing and pattern recognition results.