1
|
Davarinia F, Maleki A. Feature evaluation for myoelectric pattern recognition of multiple nearby reaching targets. Med Eng Phys 2024; 130:104198. [PMID: 39160026 DOI: 10.1016/j.medengphy.2024.104198] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2023] [Revised: 05/20/2024] [Accepted: 06/25/2024] [Indexed: 08/21/2024]
Abstract
Intention detection of the reaching movement is considerable for myoelectric human and machine collaboration applications. A comprehensive set of handcrafted features was mined from windows of electromyogram (EMG) of the upper-limb muscles while reaching nine nearby targets like activities of daily living. The feature selection-based scoring method, neighborhood component analysis (NCA), selected the relevant feature subset. Finally, the target was recognized by the support vector machine (SVM) model. The classification performance was generalized by a nested cross-validation structure that selected the optimal feature subset in the inner loop. According to the low spatial resolution of the target location on display and following the slight discrimination of signals between targets, the best classification accuracy of 77.11 % was achieved for concatenating the features of two segments with a length of 2 and 0.25 s. Due to the lack of subtle variation in EMG, while reaching different targets, a wide range of features was applied to consider additional aspects of the knowledge contained in EMG signals. Furthermore, since NCA selected features that provided more discriminant power, it became achievable to employ various combinations of features and even concatenated features extracted from different movement parts to improve classification performance.
Collapse
Affiliation(s)
| | - Ali Maleki
- Biomedical Engineering Department, Semnan University, Semnan, Iran.
| |
Collapse
|
2
|
Hernández-Mustieles MA, Lima-Carmona YE, Pacheco-Ramírez MA, Mendoza-Armenta AA, Romero-Gómez JE, Cruz-Gómez CF, Rodríguez-Alvarado DC, Arceo A, Cruz-Garza JG, Ramírez-Moreno MA, Lozoya-Santos JDJ. Wearable Biosensor Technology in Education: A Systematic Review. SENSORS (BASEL, SWITZERLAND) 2024; 24:2437. [PMID: 38676053 PMCID: PMC11054421 DOI: 10.3390/s24082437] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/07/2024] [Revised: 03/31/2024] [Accepted: 04/02/2024] [Indexed: 04/28/2024]
Abstract
Wearable Biosensor Technology (WBT) has emerged as a transformative tool in the educational system over the past decade. This systematic review encompasses a comprehensive analysis of WBT utilization in educational settings over a 10-year span (2012-2022), highlighting the evolution of this field to address challenges in education by integrating technology to solve specific educational challenges, such as enhancing student engagement, monitoring stress and cognitive load, improving learning experiences, and providing real-time feedback for both students and educators. By exploring these aspects, this review sheds light on the potential implications of WBT on the future of learning. A rigorous and systematic search of major academic databases, including Google Scholar and Scopus, was conducted in accordance with the PRISMA guidelines. Relevant studies were selected based on predefined inclusion and exclusion criteria. The articles selected were assessed for methodological quality and bias using established tools. The process of data extraction and synthesis followed a structured framework. Key findings include the shift from theoretical exploration to practical implementation, with EEG being the predominant measurement, aiming to explore mental states, physiological constructs, and teaching effectiveness. Wearable biosensors are significantly impacting the educational field, serving as an important resource for educators and a tool for students. Their application has the potential to transform and optimize academic practices through sensors that capture biometric data, enabling the implementation of metrics and models to understand the development and performance of students and professors in an academic environment, as well as to gain insights into the learning process.
Collapse
Affiliation(s)
- María A. Hernández-Mustieles
- Mechatronics Department, School of Engineering and Sciences, Monterrey Campus, Tecnologico de Monterrey, Monterrey 64700, Mexico; (M.A.H.-M.); (Y.E.L.-C.); (M.A.P.-R.); (A.A.M.-A.); (C.F.C.-G.); (D.C.R.-A.); (A.A.); (M.A.R.-M.)
| | - Yoshua E. Lima-Carmona
- Mechatronics Department, School of Engineering and Sciences, Monterrey Campus, Tecnologico de Monterrey, Monterrey 64700, Mexico; (M.A.H.-M.); (Y.E.L.-C.); (M.A.P.-R.); (A.A.M.-A.); (C.F.C.-G.); (D.C.R.-A.); (A.A.); (M.A.R.-M.)
| | - Maxine A. Pacheco-Ramírez
- Mechatronics Department, School of Engineering and Sciences, Monterrey Campus, Tecnologico de Monterrey, Monterrey 64700, Mexico; (M.A.H.-M.); (Y.E.L.-C.); (M.A.P.-R.); (A.A.M.-A.); (C.F.C.-G.); (D.C.R.-A.); (A.A.); (M.A.R.-M.)
| | - Axel A. Mendoza-Armenta
- Mechatronics Department, School of Engineering and Sciences, Monterrey Campus, Tecnologico de Monterrey, Monterrey 64700, Mexico; (M.A.H.-M.); (Y.E.L.-C.); (M.A.P.-R.); (A.A.M.-A.); (C.F.C.-G.); (D.C.R.-A.); (A.A.); (M.A.R.-M.)
| | - José Esteban Romero-Gómez
- Mechatronics Department, School of Engineering and Sciences, Guadalajara Campus, Tecnologico de Monterrey, Guadalajara 45201, Mexico;
| | - César F. Cruz-Gómez
- Mechatronics Department, School of Engineering and Sciences, Monterrey Campus, Tecnologico de Monterrey, Monterrey 64700, Mexico; (M.A.H.-M.); (Y.E.L.-C.); (M.A.P.-R.); (A.A.M.-A.); (C.F.C.-G.); (D.C.R.-A.); (A.A.); (M.A.R.-M.)
| | - Diana C. Rodríguez-Alvarado
- Mechatronics Department, School of Engineering and Sciences, Monterrey Campus, Tecnologico de Monterrey, Monterrey 64700, Mexico; (M.A.H.-M.); (Y.E.L.-C.); (M.A.P.-R.); (A.A.M.-A.); (C.F.C.-G.); (D.C.R.-A.); (A.A.); (M.A.R.-M.)
| | - Alejandro Arceo
- Mechatronics Department, School of Engineering and Sciences, Monterrey Campus, Tecnologico de Monterrey, Monterrey 64700, Mexico; (M.A.H.-M.); (Y.E.L.-C.); (M.A.P.-R.); (A.A.M.-A.); (C.F.C.-G.); (D.C.R.-A.); (A.A.); (M.A.R.-M.)
| | - Jesús G. Cruz-Garza
- Department of Neurosurgery, Houston Methodist Research Institute, Houston, TX 77030, USA;
| | - Mauricio A. Ramírez-Moreno
- Mechatronics Department, School of Engineering and Sciences, Monterrey Campus, Tecnologico de Monterrey, Monterrey 64700, Mexico; (M.A.H.-M.); (Y.E.L.-C.); (M.A.P.-R.); (A.A.M.-A.); (C.F.C.-G.); (D.C.R.-A.); (A.A.); (M.A.R.-M.)
| | - Jorge de J. Lozoya-Santos
- Mechatronics Department, School of Engineering and Sciences, Monterrey Campus, Tecnologico de Monterrey, Monterrey 64700, Mexico; (M.A.H.-M.); (Y.E.L.-C.); (M.A.P.-R.); (A.A.M.-A.); (C.F.C.-G.); (D.C.R.-A.); (A.A.); (M.A.R.-M.)
| |
Collapse
|
3
|
Luo X, Tan H, Wen W. Recent Advances in Wearable Healthcare Devices: From Material to Application. Bioengineering (Basel) 2024; 11:358. [PMID: 38671780 PMCID: PMC11048539 DOI: 10.3390/bioengineering11040358] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2024] [Revised: 04/02/2024] [Accepted: 04/04/2024] [Indexed: 04/28/2024] Open
Abstract
In recent years, the proliferation of wearable healthcare devices has marked a revolutionary shift in the personal health monitoring and management paradigm. These devices, ranging from fitness trackers to advanced biosensors, have not only made healthcare more accessible, but have also transformed the way individuals engage with their health data. By continuously monitoring health signs, from physical-based to biochemical-based such as heart rate and blood glucose levels, wearable technology offers insights into human health, enabling a proactive rather than a reactive approach to healthcare. This shift towards personalized health monitoring empowers individuals with the knowledge and tools to make informed decisions about their lifestyle and medical care, potentially leading to the earlier detection of health issues and more tailored treatment plans. This review presents the fabrication methods of flexible wearable healthcare devices and their applications in medical care. The potential challenges and future prospectives are also discussed.
Collapse
Affiliation(s)
- Xiao Luo
- Department of Physics, The Hong Kong University of Science and Technology, Hong Kong 999077, China;
- HKUST Shenzhen-Hong Kong Collaborative Innovation Research Institute (SHCIRI), Futian, Shenzhen 518060, China
| | - Handong Tan
- Department of Individualized Interdisciplinary Program (Advanced Materials), The Hong Kong University of Science and Technology, Hong Kong 999077, China;
| | - Weijia Wen
- Department of Physics, The Hong Kong University of Science and Technology, Hong Kong 999077, China;
- HKUST Shenzhen-Hong Kong Collaborative Innovation Research Institute (SHCIRI), Futian, Shenzhen 518060, China
| |
Collapse
|
4
|
Rostamzadeh S, Abouhossein A, Vosoughi S, Gendeshmin SB, Yarahmadi R. Stress influence on real-world driving identified by monitoring heart rate variability and morphologic variability of electrocardiogram signals: the case of intercity roads. INTERNATIONAL JOURNAL OF OCCUPATIONAL SAFETY AND ERGONOMICS 2024; 30:252-263. [PMID: 38083847 DOI: 10.1080/10803548.2023.2293391] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2023] [Accepted: 12/07/2023] [Indexed: 01/12/2024]
Abstract
Objectives. This study examines which of the heart rate variability (HRV) and morphologic variability (MV) metrics may have the highest accuracy in different stress detection during real-world driving. Methods. The cross-sectional study was carried out among 93 intercity mini-bus male drivers aged 22-67 years. The Trillium 5000 Holter Recorder and GARMIN Virb Elite camera were used to determine heart rate and vehicle speed measurements along the path, respectively. We considered the HRV and MV metrics of electrocardiogram (ECG) signals including the mean RR interval (mRR), mean heart rate (mHR), normalized low-frequency spectrum (nLF), normalized high-frequency spectrum (nHF), normalized very low-frequency spectrum (nVLF), difference of normalized low-frequency spectrum and normalized high-frequency spectrum (dLFHF), and sympathovagal balance index (SVI). Results. The analysis showed that the HRV metrics mHR, mRR, nVLF, nLF, nHF, dLFHF and SVI are effective in mental stress detection while driving as compared to rest time. We obtained a high accuracy of stress detection for MV metrics as compared to the traditional HRV analysis, of approximately 92%. Conclusions. Our findings indicate that driver stress could be detected with an accuracy of 92% using MV metrics as an accurate physiological index of the driver's state.
Collapse
Affiliation(s)
- Sajjad Rostamzadeh
- Occupational Health Research Center, Iran University of Medical Sciences, Iran
| | - Alireza Abouhossein
- School of Public Health and Safety, Shahid Beheshti University of Medical Sciences, Iran
| | - Shahram Vosoughi
- School of Public Health, Iran University of Medical Sciences, Iran
| | | | - Rasoul Yarahmadi
- School of Public Health, Iran University of Medical Sciences, Iran
| |
Collapse
|
5
|
Fontes L, Machado P, Vinkemeier D, Yahaya S, Bird JJ, Ihianle IK. Enhancing Stress Detection: A Comprehensive Approach through rPPG Analysis and Deep Learning Techniques. SENSORS (BASEL, SWITZERLAND) 2024; 24:1096. [PMID: 38400254 PMCID: PMC10892284 DOI: 10.3390/s24041096] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/07/2024] [Revised: 01/29/2024] [Accepted: 02/02/2024] [Indexed: 02/25/2024]
Abstract
Stress has emerged as a major concern in modern society, significantly impacting human health and well-being. Statistical evidence underscores the extensive social influence of stress, especially in terms of work-related stress and associated healthcare costs. This paper addresses the critical need for accurate stress detection, emphasising its far-reaching effects on health and social dynamics. Focusing on remote stress monitoring, it proposes an efficient deep learning approach for stress detection from facial videos. In contrast to the research on wearable devices, this paper proposes novel Hybrid Deep Learning (DL) networks for stress detection based on remote photoplethysmography (rPPG), employing (Long Short-Term Memory (LSTM), Gated Recurrent Units (GRU), 1D Convolutional Neural Network (1D-CNN)) models with hyperparameter optimisation and augmentation techniques to enhance performance. The proposed approach yields a substantial improvement in accuracy and efficiency in stress detection, achieving up to 95.83% accuracy with the UBFC-Phys dataset while maintaining excellent computational efficiency. The experimental results demonstrate the effectiveness of the proposed Hybrid DL models for rPPG-based-stress detection.
Collapse
Affiliation(s)
| | | | | | | | | | - Isibor Kennedy Ihianle
- Department of Computer Science, Nottingham Trent University, Nottingham NG1 4FQ, UK; (L.F.); (P.M.); (D.V.); (S.Y.); (J.J.B.)
| |
Collapse
|
6
|
Zhang Y, Cao Y, Proctor RW, Liu Y. Emotional experiences of service robots' anthropomorphic appearance: a multimodal measurement method. ERGONOMICS 2023; 66:2039-2057. [PMID: 36803343 DOI: 10.1080/00140139.2023.2182751] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/03/2022] [Accepted: 02/14/2023] [Indexed: 06/18/2023]
Abstract
Anthropomorphic appearance is a key factor to affect users' attitudes and emotions. This research aimed to measure emotional experience caused by robots' anthropomorphic appearance with three levels - high, moderate, and low - using multimodal measurement. Fifty participants' physiological and eye-tracker data were recorded synchronously while they observed robot images that were displayed in random order. Afterward, the participants reported subjective emotional experiences and attitudes towards those robots. The results showed that the images of the moderately anthropomorphic service robots induced higher pleasure and arousal ratings, and yielded significantly larger pupil diameter and faster saccade velocity, than did the low or high robots. Moreover, participants' facial electromyography, skin conductance, and heart-rate responses were higher when observing moderately anthropomorphic service robots. An implication of the research is that service robots' appearance should be designed to be moderately anthropomorphic; too many human-like features or machine-like features may disturb users' positive emotions and attitudes.Practitioner Summary: This research aimed to measure emotional experience caused by three types of anthropomorphic service robots using a multimodal measurement experiment. The results showed that moderately anthropomorphic service robots evoked more positive emotion than high and low anthropomorphic robots. Too many human-like features or machine-like features may disturb users' positive emotions.
Collapse
Affiliation(s)
- Yun Zhang
- School of Economics and Management, Anhui Polytechnic University, Wuhu, P. R. China
| | - Yaqin Cao
- School of Economics and Management, Anhui Polytechnic University, Wuhu, P. R. China
| | - Robert W Proctor
- Department of Psychological Sciences, Purdue University, West Lafayette, USA
| | - Yu Liu
- School of Economics and Management, Anhui Polytechnic University, Wuhu, P. R. China
| |
Collapse
|
7
|
Tseng LM, Chen PF, Wen CY. Design of Edge-IoMT Network Architecture with Weight-Based Scheduling. SENSORS (BASEL, SWITZERLAND) 2023; 23:8553. [PMID: 37896645 PMCID: PMC10611017 DOI: 10.3390/s23208553] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/31/2023] [Revised: 10/15/2023] [Accepted: 10/16/2023] [Indexed: 10/29/2023]
Abstract
Population health monitoring based on the Internet of Medical Things (IoMT) is becoming an important application trend healthcare improvement. This work aims to develop an autonomous network architecture, collecting sensor data with a cluster topology, forwarding information through relay nodes, and applying edge computing and transmission scheduling for network scalability and operational efficiency. The proposed distributed network architecture incorporates data compression technologies and effective scheduling algorithms for handling the transmission scheduling of various physiological signals. Compared to existing scheduling mechanisms, the experimental results depict the network performance and show that in analyzing the delay and jitter, the proposed WFQ-based algorithms have reduced the delay and jitter ratio by about 40% and 19.47% compared to LLQ with priority queueing scheme, respectively. The experimental results also demonstrate that the proposed network topology is more effective than the direct path transmission approach in terms of energy consumption, which suggests that the proposed network architecture may improve the development of medical applications with body area networks such that the goal of self-organizing population health monitoring can be achieved.
Collapse
Affiliation(s)
- Li-Min Tseng
- Department of Electrical Engineering, National Chung Hsing University, Taichung 402, Taiwan; (L.-M.T.); (P.-F.C.)
| | - Ping-Feng Chen
- Department of Electrical Engineering, National Chung Hsing University, Taichung 402, Taiwan; (L.-M.T.); (P.-F.C.)
| | - Chih-Yu Wen
- Department of Electrical Engineering, National Chung Hsing University, Taichung 402, Taiwan; (L.-M.T.); (P.-F.C.)
- Smart Sustainable New Agriculture Research Center (SMARTer), National Chung Hsing University, Taichung 402, Taiwan
- Innovation and Development Center of Sustainable Agriculture (IDCSA), National Chung Hsing University, Taichung 402, Taiwan
| |
Collapse
|
8
|
Francisti J, Balogh Z, Reichel J, Benko Ľ, Fodor K, Turčáni M. Identification of heart rate change during the teaching process. Sci Rep 2023; 13:16674. [PMID: 37794176 PMCID: PMC10550993 DOI: 10.1038/s41598-023-43763-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2023] [Accepted: 09/28/2023] [Indexed: 10/06/2023] Open
Abstract
Internet of Things (IoT) technology can be used in many areas of everyday life. The objective of this paper is to obtain physiological functions in a non-invasive manner using commonly available IoT devices. The aim of the research is to point out the possibility of using physiological functions as an identifier of changes in students' level of arousal during the teaching process. The motivation of the work is to find a correlation between the change in heart rate, the student's level of arousal and the student's partial and final learning results. The research was focused on the collection of physiological data, namely heart rate and the evaluation of these data in the context of identification of arousal during individual teaching activities of the teaching process. The experiment was carried out during the COVID-19 pandemic via distance learning. During the teaching process, individual activities were recorded in time and HR was assigned to them. The benefit of the research is the proposed methodology of the system, which can identify changes in students' arousal in order to increase the efficiency of the teaching process. Based on the results of the designed system, they could also alert teachers who should be able to modify their teaching style in specific situations so that it is suitable for students and provides a basis for better teaching and understanding of educational materials. The presented methodology will be able to guarantee an increase in the success of the teaching process itself in terms of students' understanding of the teaching materials.
Collapse
Affiliation(s)
- Jan Francisti
- Department of Informatics, Faculty of Natural Sciences and Informatics, Constantine the Philosopher University in Nitra, Nitra, Slovakia
| | - Zoltán Balogh
- Department of Informatics, Faculty of Natural Sciences and Informatics, Constantine the Philosopher University in Nitra, Nitra, Slovakia
- Kandó Kálmán Faculty of Electrical Engineering, Óbuda University, Budapest, Hungary
| | - Jaroslav Reichel
- Department of Informatics, Faculty of Natural Sciences and Informatics, Constantine the Philosopher University in Nitra, Nitra, Slovakia
| | - Ľubomír Benko
- Department of Informatics, Faculty of Natural Sciences and Informatics, Constantine the Philosopher University in Nitra, Nitra, Slovakia
| | - Kristián Fodor
- Kandó Kálmán Faculty of Electrical Engineering, Óbuda University, Budapest, Hungary.
| | - Milan Turčáni
- Department of Informatics, Faculty of Natural Sciences and Informatics, Constantine the Philosopher University in Nitra, Nitra, Slovakia
| |
Collapse
|
9
|
Nguyen B, Torres A, Espinola CW, Sim W, Kenny D, Campbell DM, Lou W, Kapralos B, Beavers L, Peter E, Dubrowski A, Krishnan S, Bhat V. Development of a data-driven digital phenotype profile of distress experience of healthcare workers during COVID-19 pandemic. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 240:107645. [PMID: 37352806 PMCID: PMC10258128 DOI: 10.1016/j.cmpb.2023.107645] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/27/2022] [Revised: 05/19/2023] [Accepted: 06/04/2023] [Indexed: 06/25/2023]
Abstract
BACKGROUND AND OBJECTIVE Due to the constraints of the COVID-19 pandemic, healthcare workers have reported acting in ways that are contrary to their moral values, and this may result in moral distress. This paper proposes the novel digital phenotype profile (DPP) tool, developed specifically to evaluate stress experiences within participants. The DPP tool was evaluated using the COVID-19 VR Healthcare Simulation of Stress Experience (HSSE) dataset (NCT05001542), which is composed of passive physiological signals and active mental health questionnaires. The DPP tool focuses on correlating electrocardiogram, respiration, photoplethysmography, and galvanic skin response with moral injury outcome scale (Brief MIOS). METHODS Data-driven techniques are encompassed to develop a tool for robust evaluation of distress among participants. To accomplish this, we applied pre-processing techniques which involved normalization, data sanitation, segmentation, and windowing. During feature analysis, we extracted domain-specific features, followed by feature selection techniques to rank the importance of the feature set. Prior to classification, we employed k-means clustering to group the Brief MIOS scores to low, moderate, and high moral distress as the Brief MIOS lacks established severity cut-off scores. Support vector machine and decision tree models were used to create machine learning models to predict moral distress severities. RESULTS Weighted support vector machine with leave-one-subject-out-cross-validation evaluated the separation of the Brief MIOS scores and achieved an average accuracy, precision, sensitivity, and F1 of 98.67%, 98.83%, 99.44%, and 99.13%, respectively. Various machine learning ablation tests were performed to support our results and further enhance the understanding of the predictive model. CONCLUSION Our findings demonstrate the feasibility to develop a DPP tool to predict distress experiences using a combination of mental health questionnaires and passive signals. The DPP tool is the first of its kind developed from the analysis of the HSSE dataset. Additional validation is needed for the DPP tool through replication in larger sample sizes.
Collapse
Affiliation(s)
- Binh Nguyen
- Department of Electrical, Computer, and Biomedical Engineering, Toronto Metropolitan University, Toronto, ON M5B 2K3, Canada
| | - Andrei Torres
- maxSIMhealth, Ontario Tech University, Oshawa, ON L1H 7K4, Canada
| | - Caroline W Espinola
- Department of Psychiatry, University of Toronto, Toronto, ON M5S 1A1, Canada; Interventional Psychiatry Program, St. Michael's Hospital, Toronto M5B 1W8, Canada
| | - Walter Sim
- Interventional Psychiatry Program, St. Michael's Hospital, Toronto M5B 1W8, Canada
| | - Deborah Kenny
- College of Nursing, University of Colorado Anschutz Medical Campus, Aurora 80045, United States
| | - Douglas M Campbell
- Neonatal Intensive Care Unit, St Michael's Hospital, Unity Health Toronto, Toronto, ON, Canada; Department of Pediatrics, University of Toronto, Toronto M5T 1P8, Canada; Li Ka Shing Knowledge Institute, Unity Health Toronto, Toronto, ON, Canada; Allan Waters Family Simulation Program, St Michael's Hospital, Unity Health Toronto, Toronto, ON, Canada
| | - Wendy Lou
- Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada
| | - Bill Kapralos
- maxSIMhealth, Ontario Tech University, Oshawa, ON L1H 7K4, Canada
| | - Lindsay Beavers
- Allan Waters Family Simulation Program, St Michael's Hospital, Unity Health Toronto, Toronto, ON, Canada; Department of Physical Therapy, Temerty Faculty of Medicine, University of Toronto, Toronto M5T 1P8, Canada
| | - Elizabeth Peter
- Faculty of Nursing, University of Toronto, Toronto M5T 1P8, Canada
| | - Adam Dubrowski
- maxSIMhealth, Ontario Tech University, Oshawa, ON L1H 7K4, Canada
| | - Sridhar Krishnan
- Department of Electrical, Computer, and Biomedical Engineering, Toronto Metropolitan University, Toronto, ON M5B 2K3, Canada
| | - Venkat Bhat
- Department of Psychiatry, University of Toronto, Toronto, ON M5S 1A1, Canada; Interventional Psychiatry Program, St. Michael's Hospital, Toronto M5B 1W8, Canada.
| |
Collapse
|
10
|
Lukenga MP, Billonnet L, Gaugue J, Denis J. Exploring female students' perceptions of the use of digital technologies in managing academic stress. Front Psychol 2023; 14:1199038. [PMID: 37333588 PMCID: PMC10274148 DOI: 10.3389/fpsyg.2023.1199038] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2023] [Accepted: 05/16/2023] [Indexed: 06/20/2023] Open
Abstract
Objective The purpose of this research is to explore the perceptions of female students regarding the implementation of digital technologies for academic stress management. We aim to determine if the contribution of these technologies could offer to female students a better management of the stress related to their studies and thus, a better deployment of strategies to cope with academic difficulties. Method A qualitative study using the focus group methodology was conducted. Our inductive and exploratory approach allowed us to focus on the experience and perception of eleven female students from the University of Mons. The cohort was divided into two groups according to their score on the Perceived Stress Scale-10. Results The data collected was analyzed using the thematic analysis of which allowed us to identify fourteen sub-themes divided into three axes: coping strategies used to manage academic stress, students' needs to improve their management of academic stress, and the implementation of technology for managing academic stress. Conclusion Our results show that the issues present in the academic context lead students to use various coping strategies, some of which are harmful to their physical and mental health. The implementation of digital technologies and biofeedback seems to be an approach that could help students adopt more functional coping strategies and alleviate their daily difficulties in managing academic stress.
Collapse
Affiliation(s)
| | | | - Justine Gaugue
- Department of Clinical Psychology, University of Mons, Mons, Belgium
| | - Jennifer Denis
- Department of Clinical Psychology, University of Mons, Mons, Belgium
| |
Collapse
|
11
|
Talaat FM, El-Balka RM. Stress monitoring using wearable sensors: IoT techniques in medical field. Neural Comput Appl 2023; 35:1-14. [PMID: 37362562 PMCID: PMC10237081 DOI: 10.1007/s00521-023-08681-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2023] [Accepted: 05/10/2023] [Indexed: 06/28/2023]
Abstract
The concept "Internet of Things" (IoT), which facilitates communication between linked devices, is relatively new. It refers to the next generation of the Internet. IoT supports healthcare and is essential to numerous applications for tracking medical services. By examining the pattern of observed parameters, the type of the disease can be anticipated. For people with a range of diseases, health professionals and technicians have developed an excellent system that employs commonly utilized techniques like wearable technology, wireless channels, and other remote equipment to give low-cost healthcare monitoring. Whether put in living areas or worn on the body, network-related sensors gather detailed data to evaluate the patient's physical and mental health. The main objective of this study is to examine the current e-health monitoring system using integrated systems. Automatically providing patients with a prescription based on their status is the main goal of the e-health monitoring system. The doctor can keep an eye on the patient's health without having to communicate with them. The purpose of the study is to examine how IoT technologies are applied in the medical industry and how they help to raise the bar of healthcare delivered by healthcare institutions. The study will also include the uses of IoT in the medical area, the degree to which it is used to enhance conventional practices in various health fields, and the degree to which IoT may raise the standard of healthcare services. The main contributions in this paper are as follows: (1) importing signals from wearable devices, extracting signals from non-signals, performing peak enhancement; (2) processing and analyzing the incoming signals; (3) proposing a new stress monitoring algorithm (SMA) using wearable sensors; (4) comparing between various ML algorithms; (5) the proposed stress monitoring algorithm (SMA) is composed of four main phases: (a) data acquisition phase, (b) data and signal processing phase, (c) prediction phase, and (d) model performance evaluation phase; and (6) grid search is used to find the optimal values for hyperparameters of SVM (C and gamma). From the findings, it is shown that random forest is best suited for this classification, with decision tree and XGBoost following closely behind.
Collapse
Affiliation(s)
- Fatma M. Talaat
- Faculty of Artificial Intelligence, Kafrelsheikh University, Kafrelsheikh, Egypt
| | - Rana Mohamed El-Balka
- Computers and Control Systems Engineering Department, Faculty of Engineering, Mansoura University, Mansoura, Egypt
| |
Collapse
|
12
|
Shanbhog M S, Medikonda J. A clinical and technical methodological review on stress detection and sleep quality prediction in an academic environment. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 235:107521. [PMID: 37044054 DOI: 10.1016/j.cmpb.2023.107521] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/11/2022] [Revised: 02/13/2023] [Accepted: 03/28/2023] [Indexed: 05/08/2023]
Abstract
BACKGROUND Mental health in recent times is a much talked about topic and its effects on the sleep health of the students are said to result in long-term health issues if not identified and resolved. Students who are subjected to psychological stress have often been reported to have lower sleep quality which together has affected the academic performance of the students. OBJECTIVE While stress has its adverse effect on students'quality of sleep, an effort is also made to identify standard techniques and tools to automatically assess stress levels and sleep quality in a non-invasive environment among students only. This article mainly focuses on the Clinical and technical methodology employed in stress level detection and sleep quality prediction among students. METHODS This study was conducted by examining all research studies conducted in the past with respect to students in an academic setting from year 2000 to early 2022. The papers under study where finalised based on different methodologies involved in stress level detection and sleep quality prediction considering both in unimodal and multimodal measurements. RESULTS While questionnaires and physiological signals are used as a standard measuring tool, it is mostly used in a unimodal environment to measure students' mental stress or sleep quality in academic settings. CONCLUSION This paper describes in detail the clinical aspect of the association between mental stress, sleep quality, and academic performance in students followed by technical aspects to analyse the stress levels and sleep quality both qualitatively and quantitatively in an academic environment.
Collapse
Affiliation(s)
- Sharisha Shanbhog M
- Biomedical Engineering, Manipal Institute of Technology, Manipal, Manipal Academy of Higher Education, Manipal-576104 India.
| | - Jeevan Medikonda
- Biomedical Engineering, Manipal Institute of Technology, Manipal, Manipal Academy of Higher Education, Manipal-576104 India.
| |
Collapse
|
13
|
Mitro N, Argyri K, Pavlopoulos L, Kosyvas D, Karagiannidis L, Kostovasili M, Misichroni F, Ouzounoglou E, Amditis A. AI-Enabled Smart Wristband Providing Real-Time Vital Signs and Stress Monitoring. SENSORS (BASEL, SWITZERLAND) 2023; 23:2821. [PMID: 36905025 PMCID: PMC10007366 DOI: 10.3390/s23052821] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Revised: 02/20/2023] [Accepted: 03/01/2023] [Indexed: 06/18/2023]
Abstract
This work introduces the design, architecture, implementation, and testing of a low-cost and machine-learning-enabled device to be worn on the wrist. The suggested wearable device has been developed for use during emergency incidents of large passenger ship evacuations, and enables the real-time monitoring of the passengers' physiological state, and stress detection. Based on a properly preprocessed PPG signal, the device provides essential biometric data (pulse rate and oxygen saturation level) and an efficient unimodal machine learning pipeline. The stress detecting machine learning pipeline is based on ultra-short-term pulse rate variability, and has been successfully integrated into the microcontroller of the developed embedded device. As a result, the presented smart wristband is able to provide real-time stress detection. The stress detection system has been trained with the use of the publicly available WESAD dataset, and its performance has been tested through a two-stage process. Initially, evaluation of the lightweight machine learning pipeline on a previously unseen subset of the WESAD dataset was performed, reaching an accuracy score equal to 91%. Subsequently, external validation was conducted, through a dedicated laboratory study of 15 volunteers subjected to well-acknowledged cognitive stressors while wearing the smart wristband, which yielded an accuracy score equal to 76%.
Collapse
Affiliation(s)
- Nikos Mitro
- School of Electrical & Computer Engineering, National Technical University of Athens (NTUA), 10682 Athens, Greece
| | - Katerina Argyri
- School of Electrical & Computer Engineering, National Technical University of Athens (NTUA), 10682 Athens, Greece
| | - Lampros Pavlopoulos
- Institute of Communication and Computer Systems (ICCS), 10682 Athens, Greece
| | - Dimitrios Kosyvas
- Institute of Communication and Computer Systems (ICCS), 10682 Athens, Greece
| | - Lazaros Karagiannidis
- School of Electrical & Computer Engineering, National Technical University of Athens (NTUA), 10682 Athens, Greece
| | - Margarita Kostovasili
- School of Electrical & Computer Engineering, National Technical University of Athens (NTUA), 10682 Athens, Greece
| | - Fay Misichroni
- Institute of Communication and Computer Systems (ICCS), 10682 Athens, Greece
| | - Eleftherios Ouzounoglou
- School of Electrical & Computer Engineering, National Technical University of Athens (NTUA), 10682 Athens, Greece
| | - Angelos Amditis
- School of Electrical & Computer Engineering, National Technical University of Athens (NTUA), 10682 Athens, Greece
| |
Collapse
|
14
|
Sagastibeltza N, Salazar-Ramirez A, Martinez R, Jodra JL, Muguerza J. Automatic detection of the mental state in responses towards relaxation. Neural Comput Appl 2023; 35:5679-5696. [PMID: 35698721 PMCID: PMC9178946 DOI: 10.1007/s00521-022-07435-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2021] [Accepted: 05/11/2022] [Indexed: 11/03/2022]
Abstract
Nowadays, considering society's highly demanding lifestyles, it is important to consider the usefulness of relaxation from the perspective of both psychology and clinical practice. The response towards relaxation (RResp) is a mind-body interaction that relaxes the organism or compensates for the physiological effects caused by stress. This work aims to automatically detect the different mental states (relaxation, rest and stress) in which RResps may occur so that complete feedback about the quality of the relaxation can be given to the subject itself, the psychologist or the doctor. To this end, an experiment was conducted to induce both states of stress and relaxation in a sample of 20 university students (average age of 25.76 ± 3.7 years old). The electrocardiographic and electrodermal activity signals collected from the participants produced a dataset with 1641 episodes or instances in which the previously mentioned mental states take place. This data was used to extract up to 50 features and train several supervised learning algorithms (rule-based, trees, probabilistic, ensemble classifiers, etc.) using and not using feature selection techniques. Besides, the authors synthesised the cardiac activity information into a single new feature and discretised it down to three levels. The experimentation revealed which features were most discriminating, reaching a classification average accuracy of up to 94.01 ± 1.73 % with the 6 most relevant features for the own-collected dataset. Finally, being restrictive, the same solution/subspace was tested with a dataset referenced in the bibliography (WESAD) and scored an average accuracy of 90.36 ± 1.62 %.
Collapse
Affiliation(s)
- Nagore Sagastibeltza
- grid.11480.3c0000000121671098Department of Computer Architecture and Technology, University of the Basque Country (UPV-EHU), Donostia, Spain
| | - Asier Salazar-Ramirez
- grid.11480.3c0000000121671098Department of Systems Engineering and Automation, University of the Basque Country (UPV-EHU), Bilbao, Spain
| | - Raquel Martinez
- grid.11480.3c0000000121671098Department of Systems Engineering and Automation, University of the Basque Country (UPV-EHU), Bilbao, Spain
| | - Jose Luis Jodra
- grid.11480.3c0000000121671098Department of Electronic Technology, University of the Basque Country (UPV-EHU), Donostia, Spain
| | - Javier Muguerza
- grid.11480.3c0000000121671098Department of Computer Architecture and Technology, University of the Basque Country (UPV-EHU), Donostia, Spain
| |
Collapse
|
15
|
Abromavičius V, Serackis A, Katkevičius A, Kazlauskas M, Sledevič T. Prediction of exam scores using a multi-sensor approach for wearable exam stress dataset with uniform preprocessing. Technol Health Care 2023; 31:2499-2511. [PMID: 37955074 DOI: 10.3233/thc-235015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2023]
Abstract
BACKGROUND Physiological signals, such as skin conductance, heart rate, and temperature, provide valuable insight into the physiological responses of students to stress during examination sessions. OBJECTIVE The primary objective of this research is to explore the effectiveness of physiological signals in predicting grades and to assess the impact of different models and feature selection techniques on predictive performance. METHODS We extracted a comprehensive feature vector comprising 301 distinct features from seven signals and implemented a uniform preprocessing technique for all signals. In addition, we analyzed different algorithmic selection features to design relevant features for robust and accurate predictions. RESULTS The study reveals promising results, with the highest scores achieved using 100 and 150 features. The corresponding values for accuracy, AUROC, and F1-Score are 0.9, 0.89, and 0.87, respectively, indicating the potential of physiological signals for accurate grade prediction. CONCLUSION The findings of this study suggest practical applications in the field of education, where the use of physiological signals can help students cope with exam stress and improve their academic performance. The importance of feature selection and the use of appropriate models highlight the importance of engineering relevant features for precise and reliable predictions.
Collapse
|
16
|
Wang J, Wang H, Luo Y, Tang H, Mao H, Bi S. Psychological stress recognition from heart rate variability parameters based on field programmable gate arrays. THE REVIEW OF SCIENTIFIC INSTRUMENTS 2022; 93:115107. [PMID: 36461560 DOI: 10.1063/5.0118630] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/05/2022] [Accepted: 10/19/2022] [Indexed: 06/17/2023]
Abstract
Psychological stress is a big threat to people's health. Early detection of psychological stress is important. The design of a stress recognition device based on the ECG (electrocardiograph) signal is presented in this paper. The device features intelligence, precision, portability, fast response, and low power consumption. In the design, the ECG signals are acquired by the AD8232 ECG module and processed by a low power consumption FPGA (Field Programmable Gated Array) development board PYNQ-Z2. Meanwhile, a modified Deep Forest model named Aw-Deep Forest (Adaptive Weight Deep Forest) is proposed. The Aw-Deep Forest has better performance than the Deep Forest model because it improves the fitting quality of the forests. By implementing the Aw-Deep Forest model on the FPGA, the device can assess people's state of psychological stress by analyzing the HRV (heart rate variability) parameters from ECG data. This paper mainly introduces the detailed process of ECG signal collecting, filtering, analog signal to digital signal conversion, HRV parameter analysis, and psychological stress recognition with Aw-Deep Forest. The final accuracy is 81.39%.
Collapse
Affiliation(s)
- Jian Wang
- School of Information, Mechanical and Electrical Engineering, Shanghai Normal University, Shanghai 200234, China
| | - Houqin Wang
- School of Information, Mechanical and Electrical Engineering, Shanghai Normal University, Shanghai 200234, China
| | - Yuemei Luo
- Institute for AI in Medicine, School of Artificial Intelligence, Nanjing University of Information Science and Technology, Nanjing 210044, China
| | - Hongying Tang
- School of Information, Mechanical and Electrical Engineering, Shanghai Normal University, Shanghai 200234, China
| | - Hongwei Mao
- School of Information, Mechanical and Electrical Engineering, Shanghai Normal University, Shanghai 200234, China
| | - Shubo Bi
- Jiangsu College of Engineering and Technology, Nantong 226006, China
| |
Collapse
|
17
|
Lu L, Xie Z, Wang H, Li L, Xu X. Mental stress and safety awareness during human-robot collaboration - Review. APPLIED ERGONOMICS 2022; 105:103832. [PMID: 35772289 DOI: 10.1016/j.apergo.2022.103832] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/06/2021] [Revised: 06/14/2022] [Accepted: 06/15/2022] [Indexed: 06/15/2023]
Abstract
Human-robot collaboration (HRC) is an emerging research area that has gained tremendous attention in both academia and industry. Yet, the feature that humans and robots sharing the workplace has led to safety concerns. In particular, the mental stress or safety awareness of human teammates during HRC remains unclear but is also of great importance to workplace safety. In this manuscript, we reviewed twenty-five studies for understanding the relationships between HRC and workers' mental stress or safety awareness. Specifically, we aimed to understand: (1) robot-related factors that may affect human workers' mental stress or safety awareness, (2) a number of measurements that could be used to evaluate workers' mental stress in HRC, and (3) various methods for measuring safety awareness that had been adopted or could be applied in HRC. According to our literature review, robot-related factors including robot characteristics, social touching and trajectory have relationships with workers' mental stress or safety awareness. For the measurement of mental stress and safety awareness, each method mentioned has its validity and rationality. Additionally, a discussion related to the potential co-robot actions to lower mental stress or improve safety awareness as well as future implications were provided.
Collapse
Affiliation(s)
- Lu Lu
- Edward P. Fitts Department of Industrial and Systems Engineering, North Carolina State University, Raleigh NC, 27695, USA
| | - Ziyang Xie
- Edward P. Fitts Department of Industrial and Systems Engineering, North Carolina State University, Raleigh NC, 27695, USA
| | - Hanwen Wang
- Edward P. Fitts Department of Industrial and Systems Engineering, North Carolina State University, Raleigh NC, 27695, USA
| | - Li Li
- Edward P. Fitts Department of Industrial and Systems Engineering, North Carolina State University, Raleigh NC, 27695, USA
| | - Xu Xu
- Edward P. Fitts Department of Industrial and Systems Engineering, North Carolina State University, Raleigh NC, 27695, USA.
| |
Collapse
|
18
|
Physiological reactions to and recovery from acute stressors: the roles of chronic anxiety
and stable resources. HEALTH PSYCHOLOGY REPORT 2022. [DOI: 10.5114/hpr/153968] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/12/2023] Open
Abstract
BackgroundResearch has shown that employees subjected to acute stressors at work can suffer devastating repercussions. However, little is known about how employees who are experiencing ongoing chronic anxiety or have stable resources respond to acute stressors, particularly regarding their physiological responses to these situations. This study examines the physiological effects of an acute stressor when workers are already under chronic anxiety (i.e., cognitive anxiety and somatic anxiety) or when they have a stable resource (i.e., job control).Participants and procedureData were collected from 230 full-time employees working at three major oil companies in Brazil. First, demographic, anxie-ty, and job control measures were collected via questionnaire. Later, muscle tension, skin temperature, and heart rate were collected during a simulated task to assess the physiological response to stress. Hypotheses were tested by repeated measures general linear modeling.ResultsThe findings indicated that when employees were exposed to an acute stressor, those with chronic cognitive and somatic anxiety exhibited more heightened physiological responses than those lower on chronic anxiety. Further, compared to those with low control, employees with stable, high control over their work experienced a lower physiological reaction to the acute stressor.ConclusionsChronic anxiety generates high levels of physiological arousal and hyper-responsiveness to acute environmental stressors. Also, employees possessing stable resources, such as job control, experience reduced physiological responsivity to an acute stressor.
Collapse
|
19
|
Emotional Imagery Influences the Adaptive Force in Young Women: Unpleasant Imagery Reduces Instantaneously the Muscular Holding Capacity. Brain Sci 2022; 12:brainsci12101318. [PMID: 36291257 PMCID: PMC9599475 DOI: 10.3390/brainsci12101318] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2022] [Revised: 09/23/2022] [Accepted: 09/25/2022] [Indexed: 11/17/2022] Open
Abstract
The link between emotions and motor function has been known for decades but is still not clarified. The Adaptive Force (AF) describes the neuromuscular capability to adapt to increasing forces and was suggested to be especially vulnerable to interfering inputs. This study investigated the influence of pleasant and unpleasant food imagery on the manually assessed AF of elbow and hip flexors objectified by a handheld device in 12 healthy women. The maximal isometric AF was significantly reduced during unpleasant vs. pleasant imagery and baseline (p < 0.001, dz = 0.98−1.61). During unpleasant imagery, muscle lengthening started at 59.00 ± 22.50% of maximal AF, in contrast to baseline and pleasant imagery, during which the isometric position could be maintained mostly during the entire force increase up to ~97.90 ± 5.00% of maximal AF. Healthy participants showed an immediately impaired holding function triggered by unpleasant imagery, presumably related to negative emotions. Hence, AF seems to be suitable to test instantaneously the effect of emotions on motor function. Since musculoskeletal complaints can result from muscular instability, the findings provide insights into the understanding of the causal chain of linked musculoskeletal pain and mental stress. A case example (current stress vs. positive imagery) suggests that the approach presented in this study might have future implications for psychomotor diagnostics and therapeutics.
Collapse
|
20
|
Sato W, Kochiyama T. Exploration of Emotion Dynamics Sensing Using Trapezius EMG and Fingertip Temperature. SENSORS (BASEL, SWITZERLAND) 2022; 22:s22176553. [PMID: 36081011 PMCID: PMC9460856 DOI: 10.3390/s22176553] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/16/2022] [Revised: 08/26/2022] [Accepted: 08/28/2022] [Indexed: 06/12/2023]
Abstract
Exploration of the physiological signals associated with subjective emotional dynamics has practical significance. Previous studies have reported that the dynamics of subjective emotional valence and arousal can be assessed using facial electromyography (EMG) and electrodermal activity (EDA), respectively. However, it remains unknown whether other methods can assess emotion dynamics. To investigate this, EMG of the trapezius muscle and fingertip temperature were tested. These measures, as well as facial EMG of the corrugator supercilii and zygomatic major muscles, EDA (skin conductance level) of the palm, and continuous ratings of subjective emotional valence and arousal, were recorded while participants (n = 30) viewed emotional film clips. Intra-individual subjective-physiological associations were assessed using correlation analysis and linear and polynomial regression models. Valence ratings were linearly associated with corrugator and zygomatic EMG; however, trapezius EMG was not related, linearly or curvilinearly. Arousal ratings were linearly associated with EDA and fingertip temperature but were not linearly or curvilinearly related with trapezius EMG. These data suggest that fingertip temperature can be used to assess the dynamics of subjective emotional arousal.
Collapse
Affiliation(s)
- Wataru Sato
- Psychological Process Research Team, Guardian Robot Project, RIKEN, 2-2-2 Hikaridai, Seika-cho, Soraku-gun, Kyoto 619-0288, Japan
| | - Takanori Kochiyama
- Brain Activity Imaging Center, ATR-Promotions, Inc., 2-2-2 Hikaridai, Seika-cho, Soraku-gun, Kyoto 619-0288, Japan
| |
Collapse
|
21
|
Zhang Z, Gao B. Mechanism of Hyperbaric Oxygen Combined with Astaxanthin Mediating Keap1/Nrf2/HO-1 Pathway to Improve Exercise Fatigue in Mice. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:6444747. [PMID: 35875785 PMCID: PMC9300351 DOI: 10.1155/2022/6444747] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/02/2022] [Revised: 04/25/2022] [Accepted: 06/27/2022] [Indexed: 11/25/2022]
Abstract
Objective This work aimed to explore the application and optimization of the electrophysiological monitoring system to real-time monitor the exercise-induced fatigue (EIF) animals and investigate the intervention mechanism of hyperbaric oxygen (HBO) combined with natural astaxanthin (NAX) on EIF. Methods First, a system was constructed for acquisition, processing, and feature extraction of electrocardiograph (ECG) signal and surface electromyography (EMG) signal for EIF monitoring. The mice were randomly divided into a control group (CG), EIF group (EG), HBO treatment (HBO) group, and HBO combined with NAX treatment (HBO + NAX) group. The effect of the constructed system on classification recognition of EIF was analyzed. The levels of serum antioxidative stress indicators of mice in each group were detected, including malondialdehyde (MDA), catalase (CAT), superoxide dismutase (SOD), glutathione (GSH), glutathione-peroxidation (GSH-Px), and total antioxidant capacity (T-AOC). In addition, the mRNA and protein levels of Keap1/Nrf2/HO-1 pathway related genes in liver tissue were detected. Results The results showed that the normalized least mean squares algorithm effectively removed the motion artifact interference of ECG signal and can clearly display the signal peak, and high-pass filtering and power frequency filtering effectively removed the motion and baseline drift interference of surface EMG signal. The recognition sensitivity, specificity, and accuracy of the EIF recognition model based on the long- and short-term memory network were 90.0%, 93.3%, and 92.5%, respectively. Compared with the CG, the characteristics of ECG signal and surface EMG signal of the mice in the EIF group changed greatly (P < 0.05); the serum MDA level was increased obviously; the CAT, SOD, GSH, GSH-Px, and T-AOC levels were observably reduced (P < 0.05); the expressions of Keap1 and HO-1 in the liver were reduced remarkably, while the expression of Nrf2 was increased notably (P < 0.05). Compared with the EIF group, the characteristics of ECG signal and surface EMG signal of the mice in the HBO and HBO + NAX groups were obviously improved (P < 0.05); the serum MDA level was significantly reduced; the CAT, SOD, GSH, GSH-Px, and T-AOC levels were greatly increased (P < 0.05); the expressions of Keap1 and HO-1 in the liver were greatly increased, while the expression of Nrf2 was decreased sharply (P < 0.05). Conclusion Therefore, the feature extraction and classification system of ECG signal combined with surface EMG signal could realize real-time monitoring of EIF status. HBO intervention could improve the body's ability to resist oxidative stress through the Keap1/Nrf2/HO-1 pathway and then improve the EIF state. In addition, the improvement effect of HBO + NAX was more obvious.
Collapse
Affiliation(s)
- Zheng Zhang
- School of Kinesiology, Shanghai University of Sport, Shanghai 200438, China
| | - Binghong Gao
- School of Physical Education and Sport Training, Shanghai University of Sport, Shanghai 200030, China
| |
Collapse
|
22
|
Elia R, Plastiras G, Pettemeridou E, Savva A, Theocharides T. A real‐world data collection framework for a fused dataset creation for joint human and remotely operated vehicle monitoring and anomalous command detection. CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY 2022. [DOI: 10.1049/cit2.12119] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Affiliation(s)
- Rafaella Elia
- Department of Electrical and Computer Engineering University of Cyprus Nicosia Cyprus
- KIOS Research and Innovation Center of Excellence University of Cyprus Nicosia Cyprus
| | - George Plastiras
- Department of Electrical and Computer Engineering University of Cyprus Nicosia Cyprus
| | - Eva Pettemeridou
- KIOS Research and Innovation Center of Excellence University of Cyprus Nicosia Cyprus
- Center for Applied Neuroscience (CAN) University of Cyprus Nicosia Cyprus
| | - Antonis Savva
- KIOS Research and Innovation Center of Excellence University of Cyprus Nicosia Cyprus
| | - Theocharis Theocharides
- Department of Electrical and Computer Engineering University of Cyprus Nicosia Cyprus
- KIOS Research and Innovation Center of Excellence University of Cyprus Nicosia Cyprus
| |
Collapse
|
23
|
Cognitive Computing in Mental Healthcare: a Review of Methods and Technologies for Detection of Mental Disorders. Cognit Comput 2022. [DOI: 10.1007/s12559-022-10042-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022]
|
24
|
Robles D, Benchekroun M, Zalc V, Istrate D, Taramasco C. Stress Detection from Surface Electromyography using Convolutional Neural Networks. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2022; 2022:3235-3238. [PMID: 36086008 DOI: 10.1109/embc48229.2022.9871860] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
The study of stress and its implications has been the focus of interest in various fields of science. Many automated/semi-automated stress detection systems based on physiological markers have been gaining enormous popularity and importance in recent years. Such non-voluntary physiological features exhibit unique characteristics in terms of reliability, accuracy. Combined with machine learning techniques, they offer a great field of study of stress identification and modelling. In this study, we explore the use of Convolutional Neural Networks (CNN) for stress detection through surface electromyography signals (sEMG) of the trapezius muscle. One of the main advantages of this model is the use of the sEMG signal without computed features, contrary to classical machine learning algorithms. The proposed model achieved good results, with 73% f1-score for a multi-class classification and 82% in a bi-class classification.
Collapse
|
25
|
Fu R, Chen YF, Huang Y, Chen S, Duan F, Li J, Wu J, Jiang D, Gao J, Gu J, Zhang M, Chang C. Symmetric Convolutional and Adversarial Neural Network Enables Improved Mental Stress Classification from EEG. IEEE Trans Neural Syst Rehabil Eng 2022; 30:1384-1400. [PMID: 35584065 DOI: 10.1109/tnsre.2022.3174821] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Electroencephalography (EEG) is widely used for mental stress classification, but effective feature extraction and transfer across subjects remain challenging due to its variability. In this paper, a novel deep neural network combining convolutional neural network (CNN) and adversarial theory, named symmetric deep convolutional adversarial network (SDCAN), is proposed for stress classification based on EEG. The adversarial inference is introduced to automatically capture invariant and discriminative features from raw EEG, which aims to improve the classification accuracy and generalization ability across subjects. Experiments were conducted with 22 human subjects, where each participant's stress was induced by the Trier Social Stress Test paradigm while EEG was collected. Stress states were then calibrated into four or five stages according to the changing trend of salivary cortisol concentration. The results show that the proposed network achieves improved accuracies of 87.62% and 81.45% on the classification of four and five stages, respectively, compared to conventional CNN methods. Euclidean space data alignment approach (EA) was applied and the improved generalization ability of EA-SDCAN across subjects was also validated via the leave-one-subject-out-cross-validation, with the accuracies of four and five stages being 60.52% and 48.17%, respectively. These findings indicate that the proposed SDCAN network is more feasible and effective for classifying the stages of mental stress based on EEG compared with other conventional methods.
Collapse
|
26
|
Yuan G, He W, Liu G. Is Mate Preference Recognizable Based on Electroencephalogram Signals? Machine Learning Applied to Initial Romantic Attraction. Front Neurosci 2022; 16:830820. [PMID: 35221907 PMCID: PMC8873380 DOI: 10.3389/fnins.2022.830820] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2021] [Accepted: 01/24/2022] [Indexed: 11/13/2022] Open
Abstract
Initial romantic attraction (IRA) refers to a series of positive reactions toward potential ideal partners based on individual preferences; its evolutionary value lies in facilitating mate selection. Although the EEG activities associated with IRA have been preliminarily understood; however, it remains unclear whether IRA can be recognized based on EEG activity. To clarify this, we simulated a dating platform similar to Tinder. Participants were asked to imagine that they were using the simulated dating platform to choose the ideal potential partner. Their brain electrical signals were recorded as they viewed photos of each potential partner and simultaneously assessed their initial romantic attraction in that potential partner through self-reported scale responses. Thereafter, the preprocessed EEG signals were decomposed into power-related features of different frequency bands using a wavelet transform approach. In addition to the power spectral features, feature extraction also accounted for the physiological parameters related to hemispheric asymmetries. Classification was performed by employing a random forest classifier, and the signals were divided into two categories: IRA engendered and IRA un-engendered. Based on the results of the 10-fold cross-validation, the best classification accuracy 85.2% (SD = 0.02) was achieved using feature vectors, mainly including the asymmetry features in alpha (8–13 Hz), beta (13–30 Hz), and theta (4–8 Hz) rhythms. The results of this study provide early evidence for EEG-based mate preference recognition and pave the way for the development of EEG-based romantic-matching systems.
Collapse
Affiliation(s)
- Guangjie Yuan
- College of Electronic and Information Engineering, Southwest University, Chongqing, China
- Institute of Affective Computing and Information Processing, Southwest University, Chongqing, China
- Chongqing Key Laboratory of Nonlinear Circuits and Intelligent Information Processing, Southwest University, Chongqing, China
| | - Wenguang He
- College of Psychology, Qufu Normal University, Qufu, China
| | - Guangyuan Liu
- College of Electronic and Information Engineering, Southwest University, Chongqing, China
- Institute of Affective Computing and Information Processing, Southwest University, Chongqing, China
- Chongqing Key Laboratory of Nonlinear Circuits and Intelligent Information Processing, Southwest University, Chongqing, China
- Key Laboratory of Cognition and Personality, Ministry of Education, Faculty of Psychology, Southwest University, Chongqing, China
- *Correspondence: Guangyuan Liu,
| |
Collapse
|
27
|
Effects of an incremental theory of the personality intervention on psychophysiological responses to social stress during the transition to college. CURRENT PSYCHOLOGY 2022. [DOI: 10.1007/s12144-021-02681-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022]
Abstract
AbstractThis randomized controlled trial (NCT04786496) examined the effects of a preventive intervention based on Incremental Theory of the Personality (ITP) on psychophysiological responses to social stress and evaluated whether levels of depression moderate the intervention effects. The participants, 107 first-year university students, were randomly assigned to one of three conditions: ITP intervention, ITP + a self-affirmation intervention (SA), and a control condition (CC). Indicators of the Hypothalamic–Pituitary–Adrenal axis, autonomic nervous system, and subjective mood were assessed with the Trier Social Stress Task. Participants in the ITP condition displayed a lower decline in respiratory sinus arrythmia (RSA) compared to those in the CC during the first phases of the task [Slopes: -0.08 (0.09) vs -0.21 (0.09), z = 2.86, p = .004] and a higher decrease in cortisol at recovery [β = -0.18 (0.08), z = -2.37, p = .018]. Depressive symptoms moderated the effect of ITP [β = -0.10 (0.05), z = -2.15, p =.032] and ITP+SA [β = -0.09 (0.04), z = -2.06, p =.039] in the decline during stress and recovery in RSA. In participants with low/medium levels of depressive symptoms, both interventions predicted a lower decline during stress [Slopes: -0.06 (0.09) for ITP, -0.17 (.09) for ITP+SA, and -0.26 (0.09) for CC] and higher recovery in RSA [Slopes: 0.18 (0.01) for ITP, 0.24 (0.01) for ITP+SA, and 0.30 (0.01) for CC]. The findings suggest that the ITP intervention has the potential to be an effective preventive intervention to reduce the stress response.
Collapse
|
28
|
EEG-based multi-level stress classification with and without smoothing filter. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.102881] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
29
|
Szakonyi B, Vassányi I, Schumacher E, Kósa I. Efficient methods for acute stress detection using heart rate variability data from Ambient Assisted Living sensors. Biomed Eng Online 2021; 20:73. [PMID: 34325719 PMCID: PMC8323289 DOI: 10.1186/s12938-021-00911-6] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2021] [Accepted: 07/22/2021] [Indexed: 11/17/2022] Open
Abstract
BACKGROUND Using Ambient Assisted Living sensors to detect acute stress could help people mitigate the harmful effects of everyday stressful situations. This would help both the healthy and those affected more by sudden stressors, e.g., people with diabetes or heart conditions. The study aimed to develop a method for providing reliable stress detection based on heart rate variability features extracted from portable devices. METHODS Features extracted from portable electrocardiogram sensor recordings were used for training various classification algorithms for stress detection purposes. Data were recorded in a clinical trial with 7 participants and two stressors, the Trier Social Stress Test and the Stroop colour word test, both validated by standardised questionnaires. Different heart rate variability feature sets (all, time-domain and non-linear only, frequency-domain only) were tested to investigate how classification performance is affected, in addition to various time window length setups and participant-wise training sessions. The accuracy and F1 score of the trained models were compared and analysed. RESULTS The best results were achieved with models using time-domain and non-linear heart rate variability features with 5-min-long overlapping time windows, yielding 96.31% accuracy and 96.26% F1 score. Shorter overlapping windows had slightly lower performance, with 91.62-94.55% accuracy and 91.77-94.55% F1 score ranges. Non-overlapping window configurations were less effective, with both accuracy and F1 score below 88%. For participant-wise learning, average F1 scores of 99.47%, 98.93% and 96.1% were achieved for feature sets using all, time-domain and non-linear, and frequency-domain features, respectively. CONCLUSION The tested stress detector models based on heart rate variability data recorded by a single electrocardiogram sensor performed just as well as those published in the literature working with multiple sensors, or even better. This suggests that once portable devices such as smartwatches provide reliable hear rate variability recordings, efficient stress detection can be achieved without the need for additional physiological measurements.
Collapse
Affiliation(s)
- Benedek Szakonyi
- Medical Informatics Research & Development Center, University of Pannonia, Egyetem u. 10, 8200 Veszprém, Hungary
| | - István Vassányi
- Medical Informatics Research & Development Center, University of Pannonia, Egyetem u. 10, 8200 Veszprém, Hungary
| | - Edit Schumacher
- Cardiac Rehabilitation Institute of the Military Hospital, Balatonfüred, Hungary
| | - István Kósa
- Cardiac Rehabilitation Institute of the Military Hospital, Balatonfüred, Hungary
- Department of Preventive Medicine, University of Szeged, Szeged, Hungary
| |
Collapse
|
30
|
Gao R, Yan H, Yang Z. Evaluation of tractor driving vibration fatigue based on multiple physiological parameters. PLoS One 2021; 16:e0254636. [PMID: 34260634 PMCID: PMC8279742 DOI: 10.1371/journal.pone.0254636] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2021] [Accepted: 07/01/2021] [Indexed: 12/02/2022] Open
Abstract
The vibration generated by tractor field operations will seriously affect the comfort and health of the driver. The low frequency vibration generated by the engine and ground excitation is similar to the natural frequency of human organs. Long term operation in this environment will resonate with the organs and affect drivers' health. To investigate this possibility, in this paper we carried out a collection experiment of human physiological indicators relevant to vibration fatigue. Four physiological signals of surface electromyography, skin electricity, skin temperature, and photoplethysmography signal were collected while the subjects experienced vibration. Several features of physiological signals as well as the law of signal features changing with fatigue are studied. The test results show that with the increase of human fatigue, the overall physiological parameters show the following trends: The median frequency of the human body surface electromyography and the slope of skin surface temperature decreases, the value of skin conductivity and the mean value of the photoplethysmography signal increases. Furthermore, this paper proposes a vibration comfort evaluation method based on multiple physiological parameters of the human body. An artificial neural network model is trained with test samples, and the prediction accuracy rate reaches 88.9%. Finally, the vibration conditions are changed by the shock-absorbing suspension of a tractor, verifying the effectiveness of the physiological signal changing with the vibration of the human body. The established prediction model can also be used to objectively reflect the discomfort of the human body under different working conditions and provide a basis for structural design optimization.
Collapse
Affiliation(s)
- Ruitao Gao
- College of Engineering, South China Agricultural University, Guangzhou, Guangdong, China
| | - Huachao Yan
- College of Engineering, South China Agricultural University, Guangzhou, Guangdong, China
| | - Zhou Yang
- College of Engineering, South China Agricultural University, Guangzhou, Guangdong, China
- Guangdong Provincial Key Laboratory of Conservation and Precision Utilization of Characteristic Agricultural Resources in Mountainous Areas, Jiaying University, Meizhou, China
| |
Collapse
|
31
|
Durán Acevedo CM, Carrillo Gómez JK, Albarracín Rojas CA. Academic stress detection on university students during COVID-19 outbreak by using an electronic nose and the galvanic skin response. Biomed Signal Process Control 2021; 68:102756. [PMID: 36570516 PMCID: PMC9760229 DOI: 10.1016/j.bspc.2021.102756] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2020] [Revised: 03/02/2021] [Accepted: 05/09/2021] [Indexed: 12/27/2022]
Abstract
Academic stress is an emotion that students experience during their time at the university, sometimes causing physical and mental health effects. Because of the COVID-19 pandemic, universities worldwide have left the classroom to provide the method of teaching virtually, generating challenges, adaptations, and more stress in students. In this pilot study, a methodology for academic stress detection in engineering students at the University of Pamplona (Colombia) is proposed by developing and implementing an artificial electronic nose system and the galvanic skin response. For the study, the student's stress state and characteristics were taken into account to make the data analysis where a set of measurements were acquired when the students were presenting a virtual exam. Likewise, for the non-stress state, a set of measurements were obtained in a relaxation state after the exam date. To carry out the pre-processing and data processing from the measurements obtained previously by both systems, a set of algorithms developed in Python software were used to perform the data analysis. Linear Discriminant Analysis (LDA), K-Nearest Neighbors (K-NN), and Support Vector Machine (SVM) classification methods were applied for the data classification, where a 96 % success rate of classification was obtained with the E-nose, and 100 % classification was achieved by using the Galvanic Skin Response.
Collapse
|
32
|
Pourmohammadi S, Maleki A. Continuous mental stress level assessment using electrocardiogram and electromyogram signals. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.102694] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
33
|
Vavrinsky E, Stopjakova V, Kopani M, Kosnacova H. The Concept of Advanced Multi-Sensor Monitoring of Human Stress. SENSORS (BASEL, SWITZERLAND) 2021; 21:3499. [PMID: 34067895 PMCID: PMC8157129 DOI: 10.3390/s21103499] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/30/2021] [Revised: 05/10/2021] [Accepted: 05/12/2021] [Indexed: 12/23/2022]
Abstract
Many people live under stressful conditions which has an adverse effect on their health. Human stress, especially long-term one, can lead to a serious illness. Therefore, monitoring of human stress influence can be very useful. We can monitor stress in strictly controlled laboratory conditions, but it is time-consuming and does not capture reactions, on everyday stressors or in natural environment using wearable sensors, but with limited accuracy. Therefore, we began to analyze the current state of promising wearable stress-meters and the latest advances in the record of related physiological variables. Based on these results, we present the concept of an accurate, reliable and easier to use telemedicine device for long-term monitoring of people in a real life. In our concept, we ratify with two synchronized devices, one on the finger and the second on the chest. The results will be obtained from several physiological variables including electrodermal activity, heart rate and respiration, body temperature, blood pressure and others. All these variables will be measured using a coherent multi-sensors device. Our goal is to show possibilities and trends towards the production of new telemedicine equipment and thus, opening the door to a widespread application of human stress-meters.
Collapse
Affiliation(s)
- Erik Vavrinsky
- Institute of Electronics and Photonics, Faculty of Electrical Engineering and Information Technology, Slovak University of Technology, Ilkovicova 3, 81219 Bratislava, Slovakia;
- Institute of Medical Physics, Biophysics, Informatics and Telemedicine, Faculty of Medicine, Comenius University, Sasinkova 2, 81272 Bratislava, Slovakia;
| | - Viera Stopjakova
- Institute of Electronics and Photonics, Faculty of Electrical Engineering and Information Technology, Slovak University of Technology, Ilkovicova 3, 81219 Bratislava, Slovakia;
| | - Martin Kopani
- Institute of Medical Physics, Biophysics, Informatics and Telemedicine, Faculty of Medicine, Comenius University, Sasinkova 2, 81272 Bratislava, Slovakia;
| | - Helena Kosnacova
- Department of Simulation and Virtual Medical Education, Faculty of Medicine, Comenius University, Sasinkova 4, 81272 Bratislava, Slovakia
- Department of Molecular Oncology, Cancer Research Institute, Biomedical Research Center of the Slovak Academy of Sciences, Dúbravská Cesta 9, 84505 Bratislava, Slovakia
| |
Collapse
|
34
|
Zhou R, Wang C, Zhang P, Chen X, Du L, Wang P, Zhao Z, Du M, Fang Z. ECG-based biometric under different psychological stress states. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2021; 202:106005. [PMID: 33662803 DOI: 10.1016/j.cmpb.2021.106005] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/12/2020] [Accepted: 02/11/2021] [Indexed: 06/12/2023]
Abstract
BACKGROUND AND OBJECTIVE In recent years, people have been exploring methods for biometric identification through electrocardiogram (ECG) signals. Under the same psychological pressure state, biometric identification through ECG signals is a traditional verification method. However, ECG signals are affected by changes in psychological stress, and ECG-Based biometric under different psychological stress states are still challenging. In this paper, we propose a method combining manual and automatic features for ECG-based biometric under different psychological stress states. And propose a new indicator Stress Classification Coefficient (SCC) that assesses the effect of different psychological stress on heart rate variability (HRV) features. METHODS In our method, we obtain manual features to be a three-step process: first, HRV features obtained from the ECG signals. Second, based on HRV features, the mental state of the experimental subjects is assessed by using the Gaussian mixture model (GMM). Finally, use cluster centers to process the original HRV features to reduce the Stress Classification Coefficient (SCC). Also, the one-dimensional convolutional neural network is constructed to automatically extract the implied features of ECG signals. Finally, the manual feature and the automatic feature are combined, and the final recognition result is obtained through the support vector machine (SVM) model. The major attribute of the proposed method is that it can perform ECG biometric under different psychological stress states. The combination of manual and automatic features expands the application scenarios of ECG-based biometric. RESULTS Based on this method, we used the Montreal stress model with calculation experiment in the laboratory to induce stress on 23 healthy students (10 women and 13 men, aged 20-37), and obtain their ECG signals under different stress conditions. Through this method to recognize the above data, an average recognition rate of more than 95% can be achieved, the average F1 score is 0.97. CONCLUSIONS The proposed method in this article is a promising approach to deal with the effects of different psychological stresses on ECG-Based biometric. It provides the possibility of ECG-Based biometric under different psychological stress.
Collapse
Affiliation(s)
- Ruishi Zhou
- Aerospace Information Research Institute, Chinese Academy of Sciences (AIRCAS), Beijing, China; University of Chinese Academy of Sciences, Beijing, China.
| | - Chenshuo Wang
- Aerospace Information Research Institute, Chinese Academy of Sciences (AIRCAS), Beijing, China; University of Chinese Academy of Sciences, Beijing, China.
| | - Pengfei Zhang
- Aerospace Information Research Institute, Chinese Academy of Sciences (AIRCAS), Beijing, China; University of Chinese Academy of Sciences, Beijing, China
| | - Xianxiang Chen
- Aerospace Information Research Institute, Chinese Academy of Sciences (AIRCAS), Beijing, China; Personalized Management of Chronic Respiratory Disease, Chinese Academy of Medical Sciences, China.
| | - Lidong Du
- Aerospace Information Research Institute, Chinese Academy of Sciences (AIRCAS), Beijing, China; Personalized Management of Chronic Respiratory Disease, Chinese Academy of Medical Sciences, China.
| | - Peng Wang
- Aerospace Information Research Institute, Chinese Academy of Sciences (AIRCAS), Beijing, China; Personalized Management of Chronic Respiratory Disease, Chinese Academy of Medical Sciences, China.
| | - Zhan Zhao
- Aerospace Information Research Institute, Chinese Academy of Sciences (AIRCAS), Beijing, China; Personalized Management of Chronic Respiratory Disease, Chinese Academy of Medical Sciences, China.
| | - Mingyan Du
- Beijing Luhe Hospital, Capital Medical University, Beijing, China.
| | - Zhen Fang
- Aerospace Information Research Institute, Chinese Academy of Sciences (AIRCAS), Beijing, China; Personalized Management of Chronic Respiratory Disease, Chinese Academy of Medical Sciences, China; University of Chinese Academy of Sciences, Beijing, China.
| |
Collapse
|
35
|
Recognition of the Impulse of Love at First Sight Based on Electrocardiograph Signal. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2021; 2021:6631616. [PMID: 33833790 PMCID: PMC8012126 DOI: 10.1155/2021/6631616] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/10/2020] [Revised: 02/19/2021] [Accepted: 03/10/2021] [Indexed: 11/17/2022]
Abstract
The impulse of love at first sight (ILFS) is a well known but rarely studied phenomenon. Despite the privacy of these emotions, knowing how attractive one finds a partner may be beneficial for building a future relationship in an open society, where partners are accepting each other. Therefore, this study adopted the electrocardiograph (ECG) signal collection method, which has been widely used in wearable devices, to collect signals and conduct corresponding recognition analysis. First, we used photos to induce ILFS and obtained ECG signals from 46 healthy students (24 women and 22 men) in a laboratory. Second, we extracted the time- and frequency-domain features of the ECG signals and performed a nonlinear analysis. We subsequently used a feature selection algorithm and a set of classifiers to classify the features. Combined with the sequence floating forward selection and random forest algorithms, the identification accuracy of the ILFS was 69.07%. The sensitivity, specificity, F1, and area under the curve of the other parameters were all greater than 0.6. The classification of ECG signals according to their characteristics demonstrated that the signals could be recognized. Through the information provided by the ECG signals, it can be determined whether the participant possesses the desire to fall in love, helping to determine the right partner in the fastest time; this is conducive to establishing a romantic relationship.
Collapse
|
36
|
Vaquero-Blasco MA, Perez-Valero E, Morillas C, Lopez-Gordo MA. Virtual Reality Customized 360-Degree Experiences for Stress Relief. SENSORS 2021; 21:s21062219. [PMID: 33810135 PMCID: PMC8004715 DOI: 10.3390/s21062219] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/30/2020] [Revised: 03/12/2021] [Accepted: 03/16/2021] [Indexed: 12/15/2022]
Abstract
The latest studies in virtual reality (VR) have evidenced the potential of this technology to reproduce environments from multiple domains in an immersive way. For instance, in stress relief research, VR has been presented as a portable and inexpensive alternative to chromotherapy rooms, which require an adapted space and are expensive. In this work, we propose a portable and versatile alternative to the traditional chromotherapy color-loop treatment through four different 360-degree virtual experiences. A group of 23 healthy participants (mean age 22.65 ± 5.48) were conducted through a single-session experience divided into four phases while their electroencephalography (EEG) was recorded. First, they were stressed via the Montreal imaging stress task (MIST), and then relaxed using our VR proposal. We applied the Wilcoxon test to evaluate the relaxation effect in terms of the EEG relative gamma and self-perceived stress surveys. The results that we obtained validate the effectiveness of our 360-degree proposal to significantly reduce stress (p-value = 0.0001). Furthermore, the participants deemed our proposal comfortable and immersive (score above 3.5 out of 5). These results suggest that 360-degree VR experiences can mitigate stress, reduce costs, and bring stress relief assistance closer to the general public, like in workplaces or homes.
Collapse
Affiliation(s)
- Miguel A. Vaquero-Blasco
- Department of Signal Theory, Telematics and Communications, University of Granada, Calle Periodista Daniel Saucedo Aranda, s/n, 18014 Granada, Spain;
- Research Centre for Information and Communications Technologies (CITIC), University of Granada, Calle Periodista Rafael Gómez Montero, 2, 18014 Granada, Spain; (E.P.-V.); (C.M.)
| | - Eduardo Perez-Valero
- Research Centre for Information and Communications Technologies (CITIC), University of Granada, Calle Periodista Rafael Gómez Montero, 2, 18014 Granada, Spain; (E.P.-V.); (C.M.)
- Department of Computer Architecture and Technology, University of Granada, Calle Periodista Daniel Saucedo Aranda, s/n, 18014 Granada, Spain
| | - Christian Morillas
- Research Centre for Information and Communications Technologies (CITIC), University of Granada, Calle Periodista Rafael Gómez Montero, 2, 18014 Granada, Spain; (E.P.-V.); (C.M.)
- Department of Computer Architecture and Technology, University of Granada, Calle Periodista Daniel Saucedo Aranda, s/n, 18014 Granada, Spain
| | - Miguel A. Lopez-Gordo
- Department of Signal Theory, Telematics and Communications, University of Granada, Calle Periodista Daniel Saucedo Aranda, s/n, 18014 Granada, Spain;
- Research Centre for Information and Communications Technologies (CITIC), University of Granada, Calle Periodista Rafael Gómez Montero, 2, 18014 Granada, Spain; (E.P.-V.); (C.M.)
- Correspondence: ; Tel.: +34-958-249-721
| |
Collapse
|
37
|
A Review of Biophysiological and Biochemical Indicators of Stress for Connected and Preventive Healthcare. Diagnostics (Basel) 2021; 11:diagnostics11030556. [PMID: 33808914 PMCID: PMC8003811 DOI: 10.3390/diagnostics11030556] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2021] [Revised: 03/14/2021] [Accepted: 03/17/2021] [Indexed: 12/05/2022] Open
Abstract
Stress is a known contributor to several life-threatening medical conditions and a risk factor for triggering acute cardiovascular events, as well as a root cause of several social problems. The burden of stress is increasing globally and, with that, is the interest in developing effective stress-monitoring solutions for preventive and connected health, particularly with the help of wearable sensing technologies. The recent development of miniaturized and flexible biosensors has enabled the development of connected wearable solutions to monitor stress and intervene in time to prevent the progression of stress-induced medical conditions. This paper presents a review of the literature on different physiological and chemical indicators of stress, which are commonly used for quantitative assessment of stress, and the associated sensing technologies.
Collapse
|
38
|
Chen J, Abbod M, Shieh JS. Pain and Stress Detection Using Wearable Sensors and Devices-A Review. SENSORS (BASEL, SWITZERLAND) 2021; 21:1030. [PMID: 33546235 PMCID: PMC7913347 DOI: 10.3390/s21041030] [Citation(s) in RCA: 49] [Impact Index Per Article: 16.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/25/2020] [Revised: 02/01/2021] [Accepted: 02/02/2021] [Indexed: 12/14/2022]
Abstract
Pain is a subjective feeling; it is a sensation that every human being must have experienced all their life. Yet, its mechanism and the way to immune to it is still a question to be answered. This review presents the mechanism and correlation of pain and stress, their assessment and detection approach with medical devices and wearable sensors. Various physiological signals (i.e., heart activity, brain activity, muscle activity, electrodermal activity, respiratory, blood volume pulse, skin temperature) and behavioral signals are organized for wearables sensors detection. By reviewing the wearable sensors used in the healthcare domain, we hope to find a way for wearable healthcare-monitoring system to be applied on pain and stress detection. Since pain leads to multiple consequences or symptoms such as muscle tension and depression that are stress related, there is a chance to find a new approach for chronic pain detection using daily life sensors or devices. Then by integrating modern computing techniques, there is a chance to handle pain and stress management issue.
Collapse
Affiliation(s)
- Jerry Chen
- Department of Mechanical Engineering, Yan Ze University, Taoyuan 32003, Taiwan;
| | - Maysam Abbod
- Department of Electronic and Computer Engineering, Brunel University London, Uxbridge UB8 3PH, UK
| | - Jiann-Shing Shieh
- Department of Mechanical Engineering, Yan Ze University, Taoyuan 32003, Taiwan;
| |
Collapse
|
39
|
Electronic Devices for Stress Detection in Academic Contexts during Confinement Because of the COVID-19 Pandemic. ELECTRONICS 2021. [DOI: 10.3390/electronics10030301] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
Abstract
This article studies the development and implementation of different electronic devices for measuring signals during stress situations, specifically in academic contexts in a student group of the Engineering Department at the University of Pamplona (Colombia). For the research’s development, devices for measuring physiological signals were used through a Galvanic Skin Response (GSR), the electrical response of the heart by using an electrocardiogram (ECG), the electrical activity produced by the upper trapezius muscle (EMG), and the development of an electronic nose system (E-nose) as a pilot study for the detection and identification of the Volatile Organic Compounds profiles emitted by the skin. The data gathering was taken during an online test (during the COVID-19 Pandemic), in which the aim was to measure the student’s stress state and then during the relaxation state after the exam period. Two algorithms were used for the data process, such as Linear Discriminant Analysis and Support Vector Machine through the Python software for the classification and differentiation of the assessment, achieving 100% of classification through GSR, 90% with the E-nose system proposed, 90% with the EMG system, and 88% success by using ECG, respectively.
Collapse
|
40
|
Iqbal T, Redon-Lurbe P, Simpkin AJ, Elahi A, Ganly S, Wijns W, Shahzad A. A Sensitivity Analysis of Biophysiological Responses of Stress for Wearable Sensors in Connected Health. IEEE ACCESS 2021; 9:93567-93579. [DOI: 10.1109/access.2021.3082423] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/01/2023]
|
41
|
Vaquero-Blasco MA, Perez-Valero E, Lopez-Gordo MA, Morillas C. Virtual Reality as a Portable Alternative to Chromotherapy Rooms for Stress Relief: A Preliminary Study. SENSORS 2020; 20:s20216211. [PMID: 33143361 PMCID: PMC7663593 DOI: 10.3390/s20216211] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/01/2020] [Revised: 10/27/2020] [Accepted: 10/28/2020] [Indexed: 12/16/2022]
Abstract
Chromotherapy rooms are comfortable spaces, used in places like special needs schools, where stimuli are carefully selected to cope with stress. However, these rooms are expensive and require a space that cannot be reutilized. In this article, we propose the use of virtual reality (VR) as an inexpensive and portable alternative to chromotherapy rooms for stress relief. We recreated a chromotherapy room stress relief program using a commercial head mounted display (HD). We assessed the stress level of two groups (test and control) through an EEG biomarker, the relative gamma, while they experienced a relaxation session. First, participants were stressed using the Montreal imaging stress task (MIST). Then, for relaxing, the control group utilized a chromotherapy room while the test group used virtual reality. We performed a hypothesis test to compare the self- perceived stress level at different stages of the experiment and it yielded no significant differences in reducing stress for both groups, during relaxing (p-value: 0.8379, α = 0.05) or any other block. Furthermore, according to participant surveys, the use of virtual reality was deemed immersive, comfortable and pleasant (3.9 out of 5). Our preliminary results validate our approach as an inexpensive and portable alternative to chromotherapy rooms for stress relief.
Collapse
Affiliation(s)
- Miguel A. Vaquero-Blasco
- Department of Signal Theory, Telematics and Communications, University of Granada, Calle Periodista Daniel Saucedo Aranda, s/n, 18014 Granada, Spain;
- Research Centre for Information and Communications Technologies (CITIC), University of Granada, Calle Periodista Rafael Gómez Montero, 2, 18014 Granada, Spain; (E.P.-V.); (C.M.)
| | - Eduardo Perez-Valero
- Research Centre for Information and Communications Technologies (CITIC), University of Granada, Calle Periodista Rafael Gómez Montero, 2, 18014 Granada, Spain; (E.P.-V.); (C.M.)
- Department of Computer Architecture and Technology, University of Granada, Calle Periodista Daniel Saucedo Aranda, s/n, 18014 Granada, Spain
| | - Miguel Angel Lopez-Gordo
- Department of Signal Theory, Telematics and Communications, University of Granada, Calle Periodista Daniel Saucedo Aranda, s/n, 18014 Granada, Spain;
- Nicolo Association, Churriana de la Vega, 18194 Granada, Spain
- Correspondence: ; Tel.: +34-958-249-721
| | - Christian Morillas
- Research Centre for Information and Communications Technologies (CITIC), University of Granada, Calle Periodista Rafael Gómez Montero, 2, 18014 Granada, Spain; (E.P.-V.); (C.M.)
- Department of Computer Architecture and Technology, University of Granada, Calle Periodista Daniel Saucedo Aranda, s/n, 18014 Granada, Spain
| |
Collapse
|