1
|
Ma D, Li C, Shi W, Fan Y, Liang H, Li L, Zhang Z, Yeh CH. Benefits From Different Modes of Slow and Deep Breathing on Vagal Modulation. IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE 2024; 12:520-532. [PMID: 39050620 PMCID: PMC11268930 DOI: 10.1109/jtehm.2024.3419805] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/04/2024] [Revised: 05/18/2024] [Accepted: 06/24/2024] [Indexed: 07/27/2024]
Abstract
Slow and deep breathing (SDB) is a relaxation technique that can increase vagal activity. Respiratory sinus arrhythmia (RSA) serves as an index of vagal function usually quantified by the high-frequency power of heart rate variability (HRV). However, the low breathing rate during SDB results in deviations when estimating RSA by HRV. Besides, the impact of the inspiration-expiration (I: E) ratio and guidelines ways (fixed breathing rate or intelligent guidance) on SDB is not yet clear. In our study, 30 healthy people (mean age = 26.5 years, 17 females) participated in three SDB modes, including 6 breaths per minute (bpm) with an I:E ratio of 1:1/ 1:2, and intelligent guidance mode (I:E ratio of 1:2 with guiding to gradually lower breathing rate to 6 bpm). Parameters derived from HRV, multimodal coupling analysis (MMCA), Poincaré plot, and detrended fluctuation analysis were introduced to examine the effects of SDB exercises. Besides, multiple machine learning methods were applied to classify breathing patterns (spontaneous breathing vs. SDB) after feature selection by max-relevance and min-redundancy. All vagal-activity markers, especially MMCA-derived RSA, statistically increased during SDB. Among all SDB modes, breathing at 6 bpm with a 1:1 I:E ratio activated the vagal function the most statistically, while the intelligent guidance mode had more indicators that still significantly increased after training, including SDRR and MMCA-derived RSA, etc. About the classification of breathing patterns, the Naive Bayes classifier has the highest accuracy (92.2%) with input features including LFn, CPercent, pNN50, [Formula: see text], SDRatio, [Formula: see text], and LF. Our study proposed a system that can be applied to medical devices for automatic SDB identification and real-time feedback on the training effect. We demonstrated that breathing at 6 bpm with an I:E ratio of 1:1 performed best during the training phase, while intelligent guidance mode had a more long-lasting effect.
Collapse
Affiliation(s)
- Deshan Ma
- School of Information and ElectronicsBeijing Institute of TechnologyBeijing100811China
| | - Conghui Li
- Department of Child Rehabilitation MedicineThe Fifth Affiliated Hospital of Zhengzhou UniversityZhengzhouHenan450052China
| | - Wenbin Shi
- School of Information and ElectronicsBeijing Institute of TechnologyBeijing100811China
- Key Laboratory of Brain Health Intelligent Evaluation and InterventionMinistry of Education (Beijing Institute of Technology)Beijing100811China
| | - Yong Fan
- Centre for Artificial Intelligence in MedicineMedical Innovation Research DepartmentChinese PLA General HospitalBeijing100036China
| | - Hong Liang
- Centre for Artificial Intelligence in MedicineMedical Innovation Research DepartmentChinese PLA General HospitalBeijing100036China
| | - Lixuan Li
- Centre for Artificial Intelligence in MedicineMedical Innovation Research DepartmentChinese PLA General HospitalBeijing100036China
| | - Zhengbo Zhang
- Centre for Artificial Intelligence in MedicineMedical Innovation Research DepartmentChinese PLA General HospitalBeijing100036China
| | - Chien-Hung Yeh
- School of Information and ElectronicsBeijing Institute of TechnologyBeijing100811China
- Key Laboratory of Brain Health Intelligent Evaluation and InterventionMinistry of Education (Beijing Institute of Technology)Beijing100811China
| |
Collapse
|
2
|
EEG Signal Analysis based on machine learning in psychological balance detection of athletes. EVOLUTIONARY INTELLIGENCE 2022. [DOI: 10.1007/s12065-022-00770-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
3
|
Siddiqui HUR, Shahzad HF, Saleem AA, Khan Khakwani AB, Rustam F, Lee E, Ashraf I, Dudley S. Respiration Based Non-Invasive Approach for Emotion Recognition Using Impulse Radio Ultra Wide Band Radar and Machine Learning. SENSORS 2021; 21:s21248336. [PMID: 34960430 PMCID: PMC8707312 DOI: 10.3390/s21248336] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/02/2021] [Revised: 12/09/2021] [Accepted: 12/09/2021] [Indexed: 12/22/2022]
Abstract
Emotion recognition gained increasingly prominent attraction from a multitude of fields recently due to their wide use in human-computer interaction interface, therapy, and advanced robotics, etc. Human speech, gestures, facial expressions, and physiological signals can be used to recognize different emotions. Despite the discriminating properties to recognize emotions, the first three methods have been regarded as ineffective as the probability of human's voluntary and involuntary concealing the real emotions can not be ignored. Physiological signals, on the other hand, are capable of providing more objective, and reliable emotion recognition. Based on physiological signals, several methods have been introduced for emotion recognition, yet, predominantly such approaches are invasive involving the placement of on-body sensors. The efficacy and accuracy of these approaches are hindered by the sensor malfunctioning and erroneous data due to human limbs movement. This study presents a non-invasive approach where machine learning complements the impulse radio ultra-wideband (IR-UWB) signals for emotion recognition. First, the feasibility of using IR-UWB for emotion recognition is analyzed followed by determining the state of emotions into happiness, disgust, and fear. These emotions are triggered using carefully selected video clips to human subjects involving both males and females. The convincing evidence that different breathing patterns are linked with different emotions has been leveraged to discriminate between different emotions. Chest movement of thirty-five subjects is obtained using IR-UWB radar while watching the video clips in solitude. Extensive signal processing is applied to the obtained chest movement signals to estimate respiration rate per minute (RPM). The RPM estimated by the algorithm is validated by repeated measurements by a commercially available Pulse Oximeter. A dataset is maintained comprising gender, RPM, age, and associated emotions which are further used with several machine learning algorithms for automatic recognition of human emotions. Experiments reveal that IR-UWB possesses the potential to differentiate between different human emotions with a decent accuracy of 76% without placing any on-body sensors. Separate analysis for male and female participants reveals that males experience high arousal for happiness while females experience intense fear emotions. For disgust emotion, no large difference is found for male and female participants. To the best of the authors' knowledge, this study presents the first non-invasive approach using the IR-UWB radar for emotion recognition.
Collapse
Affiliation(s)
- Hafeez Ur Rehman Siddiqui
- Department of Computer Science, Khwaja Fareed University of Engineering and Information Technology, Rahim Yar Khan 64200, Pakistan; (H.U.R.S.); (H.F.S.); (A.A.S.); (F.R.)
| | - Hina Fatima Shahzad
- Department of Computer Science, Khwaja Fareed University of Engineering and Information Technology, Rahim Yar Khan 64200, Pakistan; (H.U.R.S.); (H.F.S.); (A.A.S.); (F.R.)
| | - Adil Ali Saleem
- Department of Computer Science, Khwaja Fareed University of Engineering and Information Technology, Rahim Yar Khan 64200, Pakistan; (H.U.R.S.); (H.F.S.); (A.A.S.); (F.R.)
| | - Abdul Baqi Khan Khakwani
- Management and Information Technology, Jubail Industrial College, Al Jubail 35718, Saudi Arabia;
| | - Furqan Rustam
- Department of Computer Science, Khwaja Fareed University of Engineering and Information Technology, Rahim Yar Khan 64200, Pakistan; (H.U.R.S.); (H.F.S.); (A.A.S.); (F.R.)
| | - Ernesto Lee
- Department of Computer Science, Broward College, Broward County, FL 33301, USA
- Correspondence: (E.L.); (I.A.)
| | - Imran Ashraf
- Department of Information and Communication Engineering, Yeungnam University, Gyeongsan 38541, Korea
- Correspondence: (E.L.); (I.A.)
| | - Sandra Dudley
- School of Engineering, London South Bank University, London SE1 0AA, UK;
| |
Collapse
|
4
|
Assessment of Cognitive Student Engagement Using Heart Rate Data in Distance Learning during COVID-19. EDUCATION SCIENCES 2021. [DOI: 10.3390/educsci11090540] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/27/2022]
Abstract
Student engagement allows educational institutions to make better decisions regarding teaching methodologies, methods for evaluating the quality of education, and ways to provide timely feedback. Due to the COVID-19 pandemic, identifying cognitive student engagement in distance learning has been a challenge in higher education institutions. In this study, we implemented a non-self-report method assessing students’ heart rate data to identify the cognitive engagement during active learning activities. Additionally, as a supplementary tool, we applied a previously validated self-report method. This study was performed in distance learning lessons on a group of university students in Bogota, Colombia. After data analysis, we validated five hypotheses and compared the results from both methods. The results confirmed that the heart rate assessment had a statistically significant difference with respect to the baseline during active learning activities, and this variance could be positive or negative. In addition, the results show that if students are previously advised that they will have to develop an a new task after a passive learning activity (such as a video projection), their heart rate will tend to increase and consequently, their cognitive engagement will also increase. We expect this study to provide input for future research assessing student cognitive engagement using physiological parameters as a tool.
Collapse
|
5
|
Reali P, Piazza C, Tacchino G, Songia L, Nazzari S, Reni G, Frigerio A, Bianchi AM. Assessing stress variations in children during the strange situation procedure: comparison of three widely used respiratory sinus arrhythmia estimation methods. Physiol Meas 2021; 42. [PMID: 34325412 DOI: 10.1088/1361-6579/ac18ff] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2021] [Accepted: 07/29/2021] [Indexed: 01/01/2023]
Abstract
Objective.The respiratory sinus arrhythmia (RSA) is a well-known marker of vagal activity that can be exploited to measure stress changes. RSA is usually estimated from heart rate variability (HRV). This study aims to compare the RSA obtained with three widely adopted methods showing their strengths and potential pitfalls.Approach.The three methods are tested on 69 healthy preschoolers undergoing a stressful protocol, the strange situation procedure (SSP). We compare the RSA estimated by the Porges method, the univariate autoregressive (AR) spectral analysis of the HRV signal, and the bivariate AR spectral analysis of HRV and respirogram signals. We examine RSA differences detected across the SSP episodes and correlation between the estimates provided by each method.Main results.The Porges and the bivariate AR approaches both detected significant differences (i.e. stress variations) in the RSA measured across the SSP. However, the latter method showed higher sensitivity to stress changes induced by the procedure, with the mean RSA variation between baseline and first separation from the mother (the most stressful condition) being significantly different among methods: Porges, -17.5%; univariate AR, -18.3%; bivariate AR, -23.7%. Moreover, the performances of the Porges algorithm were found strictly dependent on the applied preprocessing.Significance.Our findings confirm the bivariate AR analysis of the HRV and respiratory signals as a robust stress assessment tool that does not require any population-specific preprocessing of the signals and warn about using RSA estimates that neglect breath information in more natural experiments, such as those involving children, in which respiratory frequency changes are extremely likely.
Collapse
Affiliation(s)
- Pierluigi Reali
- Electronics Information and Bioengineering Department, Politecnico di Milano, Milano, Italy
| | - Caterina Piazza
- Bioengineering Laboratory, Scientific Institute IRCCS E. Medea, Bosisio Parini, LC, Italy
| | - Giulia Tacchino
- Electronics Information and Bioengineering Department, Politecnico di Milano, Milano, Italy
| | - Letizia Songia
- Electronics Information and Bioengineering Department, Politecnico di Milano, Milano, Italy
| | - Sarah Nazzari
- Child Psychopathology Unit, Scientific Institute IRCCS E. Medea, Bosisio Parini, LC, Italy
| | - Gianluigi Reni
- Bioengineering Laboratory, Scientific Institute IRCCS E. Medea, Bosisio Parini, LC, Italy
| | - Alessandra Frigerio
- Child Psychopathology Unit, Scientific Institute IRCCS E. Medea, Bosisio Parini, LC, Italy
| | - Anna Maria Bianchi
- Electronics Information and Bioengineering Department, Politecnico di Milano, Milano, Italy
| |
Collapse
|
6
|
Morales J, Moeyersons J, Armanac P, Orini M, Faes L, Overeem S, Van Gilst M, Van Dijk J, Van Huffel S, Bailon R, Varon C. Model-Based Evaluation of Methods for Respiratory Sinus Arrhythmia Estimation. IEEE Trans Biomed Eng 2021; 68:1882-1893. [PMID: 33001798 DOI: 10.1109/tbme.2020.3028204] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
OBJECTIVE Respiratory sinus arrhythmia (RSA) refers to heart rate oscillations synchronous with respiration, and it is one of the major representations of cardiorespiratory coupling. Its strength has been suggested as a biomarker to monitor different conditions, and diseases. Some approaches have been proposed to quantify the RSA, but it is unclear which one performs best in specific scenarios. The main objective of this study is to compare seven state-of-the-art methods for RSA quantification using data generated with a model proposed to simulate, and control the RSA. These methods are also compared, and evaluated on a real-life application, for their ability to capture changes in cardiorespiratory coupling during sleep. METHODS A simulation model is used to create a dataset of heart rate variability, and respiratory signals with controlled RSA, which is used to compare the RSA estimation approaches. To compare the methods objectively in real-life applications, regression models trained on the simulated data are used to map the estimates to the same measurement scale. Results, and conclusion: RSA estimates based on cross entropy, time-frequency coherence, and subspace projections showed the best performance on simulated data. In addition, these estimates captured the expected trends in the changes in cardiorespiratory coupling during sleep similarly. SIGNIFICANCE An objective comparison of methods for RSA quantification is presented to guide future analyses. Also, the proposed simulation model can be used to compare existing, and newly proposed RSA estimates. It is freely accessible online.
Collapse
|
7
|
Raheel A, Majid M, Alnowami M, Anwar SM. Physiological Sensors Based Emotion Recognition While Experiencing Tactile Enhanced Multimedia. SENSORS 2020; 20:s20144037. [PMID: 32708056 PMCID: PMC7411620 DOI: 10.3390/s20144037] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/29/2020] [Revised: 05/12/2020] [Accepted: 05/14/2020] [Indexed: 12/18/2022]
Abstract
Emotion recognition has increased the potential of affective computing by getting an instant feedback from users and thereby, have a better understanding of their behavior. Physiological sensors have been used to recognize human emotions in response to audio and video content that engages single (auditory) and multiple (two: auditory and vision) human senses, respectively. In this study, human emotions were recognized using physiological signals observed in response to tactile enhanced multimedia content that engages three (tactile, vision, and auditory) human senses. The aim was to give users an enhanced real-world sensation while engaging with multimedia content. To this end, four videos were selected and synchronized with an electric fan and a heater, based on timestamps within the scenes, to generate tactile enhanced content with cold and hot air effect respectively. Physiological signals, i.e., electroencephalography (EEG), photoplethysmography (PPG), and galvanic skin response (GSR) were recorded using commercially available sensors, while experiencing these tactile enhanced videos. The precision of the acquired physiological signals (including EEG, PPG, and GSR) is enhanced using pre-processing with a Savitzky-Golay smoothing filter. Frequency domain features (rational asymmetry, differential asymmetry, and correlation) from EEG, time domain features (variance, entropy, kurtosis, and skewness) from GSR, heart rate and heart rate variability from PPG data are extracted. The K nearest neighbor classifier is applied to the extracted features to classify four (happy, relaxed, angry, and sad) emotions. Our experimental results show that among individual modalities, PPG-based features gives the highest accuracy of 78.57% as compared to EEG- and GSR-based features. The fusion of EEG, GSR, and PPG features further improved the classification accuracy to 79.76% (for four emotions) when interacting with tactile enhanced multimedia.
Collapse
Affiliation(s)
- Aasim Raheel
- Department of Computer Engineering, University of Engineering and Technology, Taxila 47050, Pakistan;
| | - Muhammad Majid
- Department of Computer Engineering, University of Engineering and Technology, Taxila 47050, Pakistan;
- Correspondence:
| | - Majdi Alnowami
- Department of Nuclear Engineering, King Abdulaziz University, Jeddah 21589, Saudi Arabia;
| | - Syed Muhammad Anwar
- Department of Software Engineering, University of Engineering and Technology, Taxila 47050, Pakistan;
| |
Collapse
|