1
|
Ko K, Jones A, Francis D, Robidoux S, McArthur G. Physiological correlates of anxiety in childhood and adolescence: A systematic review and meta-analysis. Stress Health 2024; 40:e3388. [PMID: 38451702 DOI: 10.1002/smi.3388] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/02/2023] [Revised: 11/18/2023] [Accepted: 02/07/2024] [Indexed: 03/09/2024]
Abstract
Anxiety is one of the most prevalent problems that affects children and adolescents. The vast majority of diagnostic tools for anxiety depend on written or verbal reports from children and adolescents or their significant others. The validity and reliability of such reports can be compromised by their subjective nature. Thus, there is growing interest in whether anxiety can be indexed with objective physiological measures. The key aim of this systematic review and meta-analysis was to determine which physiological measures are most reliably associated with elevated levels of anxiety amongst children and adolescents. Online databases (e.g., PsycINFO, Embase, Medline) were searched for relevant studies according to pre-determined criteria. Twenty-five studies comprising 2502 participants (N = 1160 with high anxiety) met inclusion, identifying 11 groups of physiological measures. Our meta-analysis revealed that skin conductance level is the most sensitive measure of anxiety (d = 0.83), followed by electromyography (EMG) measures (d = 0.71) and skin conductance response (d = 0.58). However, the included studies varied in terms of subjective measures, study designs, experimental task measures, and physiological measures. Consideration of these differences in methodology offer potential directions for future research.
Collapse
Affiliation(s)
- Katherine Ko
- Macquarie University Centre for Reading, School of Psychological Sciences, Macquarie University, Sydney, New South Wales, Australia
- Lifespan Health and Wellbeing Research Centre, School of Psychological Sciences, Macquarie University, Sydney, New South Wales, Australia
| | - Alana Jones
- Macquarie University Centre for Reading, School of Psychological Sciences, Macquarie University, Sydney, New South Wales, Australia
- Lifespan Health and Wellbeing Research Centre, School of Psychological Sciences, Macquarie University, Sydney, New South Wales, Australia
| | - Deanna Francis
- Black Dog Institute, University of New South Wales, Sydney, New South Wales, Australia
| | - Serje Robidoux
- Macquarie University Centre for Reading, School of Psychological Sciences, Macquarie University, Sydney, New South Wales, Australia
| | - Genevieve McArthur
- Australian Centre for the Advancement of Literacy, Australian Catholic University, Sydney, New South Wales, Australia
- Dyslexia-SPELD Foundation Literacy and Clinical Services, South Perth, Western Australia, Australia
| |
Collapse
|
2
|
Gozzi N, Preatoni G, Ciotti F, Hubli M, Schweinhardt P, Curt A, Raspopovic S. Unraveling the physiological and psychosocial signatures of pain by machine learning. MED 2024:S2666-6340(24)00298-8. [PMID: 39116869 DOI: 10.1016/j.medj.2024.07.016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2024] [Revised: 04/12/2024] [Accepted: 07/15/2024] [Indexed: 08/10/2024]
Abstract
BACKGROUND Pain is a complex subjective experience, strongly impacting health and quality of life. Despite many attempts to find effective solutions, present treatments are generic, often unsuccessful, and present significant side effects. Designing individualized therapies requires understanding of multidimensional pain experience, considering physical and emotional aspects. Current clinical pain assessments, relying on subjective one-dimensional numeric self-reports, fail to capture this complexity. METHODS To this aim, we exploited machine learning to disentangle physiological and psychosocial components shaping the pain experience. Clinical, psychosocial, and physiological data were collected from 118 chronic pain and healthy participants undergoing 40 pain trials (4,697 trials). FINDINGS To understand the objective response to nociception, we classified pain from the physiological signals (accuracy >0.87), extracting the most important biomarkers. Then, using multilevel mixed-effects models, we predicted the reported pain, quantifying the mismatch between subjective level and measured physiological response. From these models, we introduced two metrics: TIP (subjective index of pain) and Φ (physiological index). These represent possible added value in the clinical process, capturing psychosocial and physiological pain dimensions, respectively. Patients with high TIP are characterized by frequent sick leave from work and increased clinical depression and anxiety, factors associated with long-term disability and poor recovery, and are indicated for alternative treatments, such as psychological ones. By contrast, patients with high Φ show strong nociceptive pain components and could benefit more from pharmacotherapy. CONCLUSIONS TIP and Φ, explaining the multidimensionality of pain, might provide a new tool potentially leading to targeted treatments, thereby reducing the costs of inefficient generic therapies. FUNDING RESC-PainSense, SNSF-MOVE-IT197271.
Collapse
Affiliation(s)
- Noemi Gozzi
- Laboratory for Neuroengineering, Department of Health Sciences and Technology, Institute for Robotics and Intelligent Systems, ETH Zürich, 8092 Zürich, Switzerland
| | - Greta Preatoni
- Laboratory for Neuroengineering, Department of Health Sciences and Technology, Institute for Robotics and Intelligent Systems, ETH Zürich, 8092 Zürich, Switzerland
| | - Federico Ciotti
- Laboratory for Neuroengineering, Department of Health Sciences and Technology, Institute for Robotics and Intelligent Systems, ETH Zürich, 8092 Zürich, Switzerland
| | - Michèle Hubli
- Spinal Cord Injury Center, Balgrist University Hospital, University of Zürich, 8008 Zürich, Switzerland
| | - Petra Schweinhardt
- Department of Chiropractic Medicine, Balgrist University Hospital, University of Zürich, 8008 Zürich, Switzerland
| | - Armin Curt
- Spinal Cord Injury Center, Balgrist University Hospital, University of Zürich, 8008 Zürich, Switzerland
| | - Stanisa Raspopovic
- Laboratory for Neuroengineering, Department of Health Sciences and Technology, Institute for Robotics and Intelligent Systems, ETH Zürich, 8092 Zürich, Switzerland; Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, 1090 Vienna, Austria.
| |
Collapse
|
3
|
Mercado-Diaz LR, Veeranki YR, Marmolejo-Ramos F, Posada-Quintero HF. EDA-Graph: Graph Signal Processing of Electrodermal Activity for Emotional States Detection. IEEE J Biomed Health Inform 2024; 28:4599-4612. [PMID: 38801681 DOI: 10.1109/jbhi.2024.3405491] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/29/2024]
Abstract
The continuous detection of emotional states has many applications in mental health, marketing, human-computer interaction, and assistive robotics. Electrodermal activity (EDA), a signal modulated by sympathetic nervous system activity, provides continuous insight into emotional states. However, EDA possesses intricate nonstationary and nonlinear characteristics, making the extraction of emotion-relevant information challenging. We propose a novel graph signal processing (GSP) approach to model EDA signals as graphical networks, termed EDA-graph. The GSP leverages graph theory concepts to capture complex relationships in time-series data. To test the usefulness of EDA-graphs to detect emotions, we processed EDA recordings from the CASE emotion dataset using GSP by quantizing and linking values based on the Euclidean distance between the nearest neighbors. From these EDA-graphs, we computed the features of graph analysis, including total load centrality (TLC), total harmonic centrality (THC), number of cliques (GNC), diameter, and graph radius, and compared those features with features obtained using traditional EDA processing techniques. EDA-graph features encompassing TLC, THC, GNC, diameter, and radius demonstrated significant differences (p < 0.05) between five emotional states (Neutral, Amused, Bored, Relaxed, and Scared). Using machine learning models for classifying emotional states evaluated using leave-one-subject-out cross-validation, we achieved a five-class F1 score of up to 0.68.
Collapse
|
4
|
Singaram S, Ramakrishnan K, Selvam J, Senthil M, Narayanamurthy V. Sweat gland morphology and physiology in diabetes, neuropathy, and nephropathy: a review. Arch Physiol Biochem 2024; 130:437-451. [PMID: 36063413 DOI: 10.1080/13813455.2022.2114499] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/16/2022] [Accepted: 08/02/2022] [Indexed: 11/02/2022]
Abstract
Context: Sweat glands (SGs) play a vital role in thermal regulation. The function and structure are altered during the different pathological conditions.Objective: These alterations are studied through three techniques: biopsy, sweat analytes and electrical activity of SG.Methods: The morphological study of SG through biopsy and various techniques involved in quantifying sweat analytes is focussed on here. Electrical activities of SG in diabetes, neuropathy and nephropathy cases are also discussed, highlighting their limitations and future scope.Results and Conclusion: The result of this review identified three areas of the knowledge gap. The first is wearable sensors to correlate pathological conditions. Secondly, there is no device to look for its structure and quantify its associated function. Finally, therapeutic applications of SG are explored, especially for renal failure. With these aspects, this paper provides information collection and correlates SG with pathologies related to diabetes. Hence this could help researchers develop suitable technologies for the gaps identified.
Collapse
Affiliation(s)
- Sudha Singaram
- Department of Biomedical Engineering, Rajalakshmi Engineering College, Chennai, Tamil Nadu, India
| | - Kalpana Ramakrishnan
- Department of Biomedical Engineering, Rajalakshmi Engineering College, Chennai, Tamil Nadu, India
| | - Jayashree Selvam
- Department of Biomedical Engineering, Rajalakshmi Engineering College, Chennai, Tamil Nadu, India
| | - Mallika Senthil
- Department of Biomedical Engineering, Rajalakshmi Engineering College, Chennai, Tamil Nadu, India
| | - Vigneswaran Narayanamurthy
- Faculty of Electrical and Electronic Engineering Technology, Universiti Teknikal Malaysia Melaka, Melaka, Malaysia
| |
Collapse
|
5
|
Ozek B, Lu Z, Radhakrishnan S, Kamarthi S. Uncertainty quantification in neural-network based pain intensity estimation. PLoS One 2024; 19:e0307970. [PMID: 39088473 PMCID: PMC11293669 DOI: 10.1371/journal.pone.0307970] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2023] [Accepted: 07/15/2024] [Indexed: 08/03/2024] Open
Abstract
Improper pain management leads to severe physical or mental consequences, including suffering, a negative impact on quality of life, and an increased risk of opioid dependency. Assessing the presence and severity of pain is imperative to prevent such outcomes and determine the appropriate intervention. However, the evaluation of pain intensity is a challenging task because different individuals experience pain differently. To overcome this, many researchers in the field have employed machine learning models to evaluate pain intensity objectively using physiological signals. However, these efforts have primarily focused on pain point estimation, disregarding inherent uncertainty and variability in the data and model. A point estimate, which provides only partial information, is not sufficient for sound clinical decision-making. This study proposes a neural network-based method for objective pain interval estimation, and quantification of uncertainty. Our approach, which enables objective pain intensity estimation with desired confidence probabilities, affords clinicians a better understanding of a person's pain intensity. We explored three distinct algorithms: the bootstrap method, lower and upper bound estimation (LossL) optimized by genetic algorithm, and modified lower and upper bound estimation (LossS) optimized by gradient descent algorithm. Our empirical results demonstrate that LossS outperforms the other two by providing narrower prediction intervals. For 50%, 75%, 85%, and 95% prediction interval coverage probability, LossS provides average interval widths that are 22.4%, 7.9%, 16.7%, and 9.1% narrower than those of LossL, and 19.3%, 21.1%, 23.6%, and 26.9% narrower than those of bootstrap. As LossS outperforms, we assessed its performance in three different model-building approaches: (1) a generalized approach using a single model for the entire population, (2) a personalized approach with separate models for each individual, and (3) a hybrid approach with models for clusters of individuals. Results demonstrate that the hybrid model-building approach provides the best performance.
Collapse
Affiliation(s)
- Burcu Ozek
- Mechanical and Industrial Engineering Department, Northeastern University, Boston, Massachusetts, United States of America
| | - Zhenyuan Lu
- Mechanical and Industrial Engineering Department, Northeastern University, Boston, Massachusetts, United States of America
| | - Srinivasan Radhakrishnan
- Mechanical and Industrial Engineering Department, Northeastern University, Boston, Massachusetts, United States of America
| | - Sagar Kamarthi
- Mechanical and Industrial Engineering Department, Northeastern University, Boston, Massachusetts, United States of America
| |
Collapse
|
6
|
Van Der Donckt J, Vandenbussche N, Van Der Donckt J, Chen S, Stojchevska M, De Brouwer M, Steenwinckel B, Paemeleire K, Ongenae F, Van Hoecke S. Mitigating data quality challenges in ambulatory wrist-worn wearable monitoring through analytical and practical approaches. Sci Rep 2024; 14:17545. [PMID: 39079945 PMCID: PMC11289092 DOI: 10.1038/s41598-024-67767-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2023] [Accepted: 07/15/2024] [Indexed: 08/02/2024] Open
Abstract
Chronic disease management and follow-up are vital for realizing sustained patient well-being and optimal health outcomes. Recent advancements in wearable technologies, particularly wrist-worn devices, offer promising solutions for longitudinal patient monitoring, replacing subjective, intermittent self-reporting with objective, continuous monitoring. However, collecting and analyzing data from wearables presents several challenges, such as data entry errors, non-wear periods, missing data, and wearable artifacts. In this work, we explore these data analysis challenges using two real-world datasets (mBrain21 and ETRI lifelog2020). We introduce practical countermeasures, including participant compliance visualizations, interaction-triggered questionnaires to assess personal bias, and an optimized pipeline for detecting non-wear periods. Additionally, we propose a visualization-oriented approach to validate processing pipelines using scalable tools such as tsflex and Plotly-Resampler. Lastly, we present a bootstrapping methodology to evaluate the variability of wearable-derived features in the presence of partially missing data segments. Prioritizing transparency and reproducibility, we provide open access to our detailed code examples, facilitating adaptation in future wearable research. In conclusion, our contributions provide actionable approaches for improving wearable data collection and analysis.
Collapse
Affiliation(s)
- Jonas Van Der Donckt
- IDLab, Ghent University - Imec, Technologiepark-Zwijnaarde, 9052, Ghent, Belgium.
| | - Nicolas Vandenbussche
- Department of Neurology, Ghent University Hospital, Corneel Heymanslaan 10, 9000, Ghent, Belgium
- Department of Basic and Applied Medical Sciences, Faculty of Medicine and Health Sciences, Ghent University, Ghent, Belgium
| | | | - Stephanie Chen
- IDLab, Ghent University - Imec, Technologiepark-Zwijnaarde, 9052, Ghent, Belgium
| | - Marija Stojchevska
- IDLab, Ghent University - Imec, Technologiepark-Zwijnaarde, 9052, Ghent, Belgium
| | - Mathias De Brouwer
- IDLab, Ghent University - Imec, Technologiepark-Zwijnaarde, 9052, Ghent, Belgium
| | - Bram Steenwinckel
- IDLab, Ghent University - Imec, Technologiepark-Zwijnaarde, 9052, Ghent, Belgium
| | - Koen Paemeleire
- Department of Neurology, Ghent University Hospital, Corneel Heymanslaan 10, 9000, Ghent, Belgium
- Department of Basic and Applied Medical Sciences, Faculty of Medicine and Health Sciences, Ghent University, Ghent, Belgium
| | - Femke Ongenae
- IDLab, Ghent University - Imec, Technologiepark-Zwijnaarde, 9052, Ghent, Belgium
| | - Sofie Van Hoecke
- IDLab, Ghent University - Imec, Technologiepark-Zwijnaarde, 9052, Ghent, Belgium
| |
Collapse
|
7
|
Zikos L, Degraeve B, Pinti A, Poupart J, Norberciak L, Kwiatkowski A, Donze C, Lenne B. Distinguishing the role of positivity bias, cognitive impairment and emotional reactivity in the deontological preference in multiple sclerosis during moral dilemmas: a social cognition study protocol. Front Psychol 2024; 15:1404876. [PMID: 39091703 PMCID: PMC11291456 DOI: 10.3389/fpsyg.2024.1404876] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2024] [Accepted: 07/05/2024] [Indexed: 08/04/2024] Open
Abstract
Background Multiple sclerosis (MS) is a chronic inflammatory and neurodegenerative disease of the central nervous system characterized by a broad and unpredictable range of symptoms, including cognitive and sociocognitive dysfunction. Among these social-cognitive functions, moral judgment has been explored in persons with MS (PwMS) using moral dilemmas, where participants must decide whether to sacrifice one person to save a greater number. Opting for such a sacrifice reflects utilitarian reasoning (sacrificing one for the benefit of many is deemed acceptable), while refusing reflects deontological reasoning (such sacrifice is considered morally wrong). Compared to controls, PwMS have been shown to make greater deontological moral choices in such dilemmas. Objectives While PwMS have demonstrated a higher tendency for deontological moral choices in moral dilemmas compared to controls, the underlying determinants of this reasoning pattern remain unclear. In this project, we aim to investigate cognitive, emotional, and motivational factors that may explain deontological decision-making in MS. Methods and analysis We will recruit a sample of 45 PwMS and 45 controls aged 18-55 years. The type of response, deontological or utilitarian, to a series of 20 vignettes of moral dilemmas will constitute the primary outcomes. Global cognitive performance, positivity bias, alexithymia and empathy levels as well as emotional reactivity measured by electrodermal activity (EDA) during moral dilemmas will be secondary outcomes. Ethics and dissemination Ethics approval was granted by a national ethical committee (CPP Ouest III, national number 2023-A00447-38). The project is sponsored by the ARSEP Foundation. Findings will be presented at national and international conferences, as well as published in peer-reviewed scientific journals.
Collapse
Affiliation(s)
- Laurent Zikos
- Experience, Transhumanism, Human Interactions, Care & Society (ETHICS - EA7446), Lille Catholic University, Lille, France
| | - Béatrice Degraeve
- Experience, Transhumanism, Human Interactions, Care & Society (ETHICS - EA7446), Lille Catholic University, Lille, France
| | - Antonio Pinti
- Laboratoire Science de l’Information-Communication (LSC/DeVisu), Université Polytechnique Hauts-de-France, Valenciennes, France
| | - Julien Poupart
- Neurology Department, Groupement des Hôpitaux de l’Institut Catholique de Lille (GHICL), Lille Catholic University, Lille, France
| | - Laurène Norberciak
- Neurology Department, Groupement des Hôpitaux de l’Institut Catholique de Lille (GHICL), Lille Catholic University, Lille, France
| | - Arnaud Kwiatkowski
- Neurology Department, Groupement des Hôpitaux de l’Institut Catholique de Lille (GHICL), Lille Catholic University, Lille, France
| | - Cécile Donze
- Rehabilitation Department, Groupement des Hôpitaux de l’Institut Catholique de Lille (GHICL), Lille Catholic University, Lille, France
| | - Bruno Lenne
- Neurology Department, Groupement des Hôpitaux de l’Institut Catholique de Lille (GHICL), Lille Catholic University, Lille, France
| |
Collapse
|
8
|
Nandipati KK, Pal S, Mitra R. Electrodermal Activity (EDA) Morphologies and Prediction of Engagement with Simple Moving Average Crossover: A Mixed-Method Study. SENSORS (BASEL, SWITZERLAND) 2024; 24:4565. [PMID: 39065963 PMCID: PMC11280656 DOI: 10.3390/s24144565] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/03/2024] [Revised: 07/04/2024] [Accepted: 07/10/2024] [Indexed: 07/28/2024]
Abstract
Electrodermal Activity (EDA), which primarily indicates arousal through sympathetic nervous system activity, serves as a tool to measure constructs like engagement, cognitive load, performance, and stress. Despite its potential, empirical studies have often yielded mixed results and found it of limited use. To better understand EDA, we conducted a mixed-methods study in which quantitative EDA profiles and survey data were investigated using qualitative interviews. This study furnishes an EDA dataset measuring the engagement levels of seven participants who watched three videos for 4-10 min. The subsequent interviews revealed five EDA morphologies with varying short-term signatures and long-term trends. We used this dataset to demonstrate the moving average crossover, a novel metric for EDA analysis, in predicting engagement-disengagement dynamics in such data. Our contributions include the creation of the detailed dataset, comprising EDA profiles annotated with qualitative data, the identification of five distinct EDA morphologies, and the proposition of the moving average crossover as an indicator of the beginning of engagement or disengagement in an individual.
Collapse
Affiliation(s)
| | | | - Ritayan Mitra
- Educational Technology, Indian Institute of Technology Bombay, Mumbai 400076, India; (K.K.N.); (S.P.)
| |
Collapse
|
9
|
Savard MA, Merlo R, Samithamby A, Paas A, Coffey EBJ. Approaches to studying emotion using physiological responses to spoken narratives: A scoping review. Psychophysiology 2024:e14642. [PMID: 38961524 DOI: 10.1111/psyp.14642] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/25/2023] [Revised: 06/07/2024] [Accepted: 06/12/2024] [Indexed: 07/05/2024]
Abstract
Narratives are effective tools for evoking emotions, and physiological measurements provide a means of objectively assessing emotional reactions - making them a potentially powerful pair of tools for studying emotional processes. However, extent research combining emotional narratives and physiological measurement varies widely in design and application, making it challenging to identify previous work, consolidate findings, and design effective experiments. Our scoping review explores the use of auditory emotional narratives and physiological measures in research, examining paradigms, study populations, and represented emotions. Following the PRISMA-ScR Checklist, we searched five databases for peer-reviewed experimental studies that used spoken narratives to induce emotion and reported autonomic physiological measures. Among 3466 titles screened and 653 articles reviewed, 110 studies were included. Our exploration revealed a variety of applications and experimental paradigms; emotional narratives paired with physiological measures have been used to study diverse topics and populations, including neurotypical and clinical groups. Although incomparable designs and sometimes contradictory results precluded general recommendations as regards which physiological measures to use when designing new studies, as a whole, the body of work suggests that these tools can be valuable to study emotions. Our review offers an overview of research employing narratives and physiological measures for emotion study, and highlights weaknesses in reporting practices and gaps in our knowledge concerning the robustness and specificity of physiological measures as indices of emotion. We discuss study design considerations and transparent reporting, to facilitate future using emotional narratives and physiological measures in studying emotions.
Collapse
Affiliation(s)
- Marie-Anick Savard
- Department of Psychology, Concordia University, Montreal, Quebec, Canada
- International Laboratory for Brain, Music and Sound Research (BRAMS), Montreal, Quebec, Canada
- Centre for Research on Brain, Language and Music (CRBLM), Montreal, Quebec, Canada
| | - Raphaëlle Merlo
- International Laboratory for Brain, Music and Sound Research (BRAMS), Montreal, Quebec, Canada
- Centre for Research on Brain, Language and Music (CRBLM), Montreal, Quebec, Canada
- École de Psychologie, Université Laval, Québec, Quebec, Canada
| | - Abiraam Samithamby
- Department of Psychology, Concordia University, Montreal, Quebec, Canada
- International Laboratory for Brain, Music and Sound Research (BRAMS), Montreal, Quebec, Canada
- Centre for Research on Brain, Language and Music (CRBLM), Montreal, Quebec, Canada
| | - Anita Paas
- Department of Psychology, Concordia University, Montreal, Quebec, Canada
- International Laboratory for Brain, Music and Sound Research (BRAMS), Montreal, Quebec, Canada
- Centre for Research on Brain, Language and Music (CRBLM), Montreal, Quebec, Canada
| | - Emily B J Coffey
- Department of Psychology, Concordia University, Montreal, Quebec, Canada
- International Laboratory for Brain, Music and Sound Research (BRAMS), Montreal, Quebec, Canada
- Centre for Research on Brain, Language and Music (CRBLM), Montreal, Quebec, Canada
- Montreal Neurological Institute (MNI), McGill University, Montreal, Quebec, Canada
| |
Collapse
|
10
|
Li X, Long Y, Zhang S, Yang C, Xing M, Zhang S. Experimental Study on Emergency Psychophysiological and Behavioral Reactions to Coal Mining Accidents. Appl Psychophysiol Biofeedback 2024:10.1007/s10484-024-09651-4. [PMID: 38940884 DOI: 10.1007/s10484-024-09651-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/15/2024] [Indexed: 06/29/2024]
Abstract
Effective emergency responses are crucial for preventing coal mine accidents and mitigating injuries. This paper aims to investigate the characteristics of emergency psychophysiological reactions to coal mine accidents and to explore the potential of key indicators for identifying emergency behavioral patterns. Initially, virtual reality technology facilitated a simulation experiment for emergency escape during coal mine accidents. Subsequently, the characteristics of emergency reactions were analyzed through correlation analysis, hypothesis testing, and analysis of variance. The significant changes in physiological indicators were then taken as input features and fed into the three classifiers of machine learning algorithms. These classifications ultimately led to the identification of behavioral patterns, including agility, defensiveness, panic, and rigidity, that individuals may exhibit during a coal mine accident emergency. The study results revealed an intricate relationship between the mental activities induced by accident stimuli and the resulting physiological changes and behavioral performances. During the virtual reality simulation of a coal mine accident, subjects were observed to experience significant physiological changes in electrodermal activity, heart rate variability, electromyogram, respiration, and skin temperature. The random forest classification model, based on SCR + RANGE + IBI + SDNN + LF/HF, outperformed all other models, achieving accuracies of up to 92%. These findings hold promising implications for early warning systems targeting abnormal psychophysiological and behavioral reactions to emergency accidents, potentially serving as a life-saving measure in perilous situations and fostering the sustainable growth of the coal mining industry.
Collapse
Affiliation(s)
- Xiangchun Li
- School of Emergency Management and Safety Engineering, China University of Mining and Technology-Beijing, Ding No.11 Xueyuan Road, Haidian District, Beijing, 100083, P. R. China
- State Key Laboratory of Explosion Science and Technology (Beijing Institute of Technology), Beijing, 100081, China
| | - Yuzhen Long
- School of Emergency Management and Safety Engineering, China University of Mining and Technology-Beijing, Ding No.11 Xueyuan Road, Haidian District, Beijing, 100083, P. R. China.
| | - Shuhao Zhang
- School of Emergency Management and Safety Engineering, China University of Mining and Technology-Beijing, Ding No.11 Xueyuan Road, Haidian District, Beijing, 100083, P. R. China
| | - Chunli Yang
- Occupational Hazards Assessment and Control Technology Center, Institute of Urban Safety and Environmental Science, Beijing Academy of Science and Technology, Beijing, 100054, China
| | - Mingxiu Xing
- School of Emergency Management and Safety Engineering, China University of Mining and Technology-Beijing, Ding No.11 Xueyuan Road, Haidian District, Beijing, 100083, P. R. China
| | - Shuang Zhang
- Tianjin Traffic Science Research Institute, Tianjin Municipal Transportation Commission, Tianjin, 300074, China
| |
Collapse
|
11
|
van den Bongard F, Gowik JK, Coenen J, Jakobsmeyer R, Reinsberger C. Exercise-induced central and peripheral sympathetic activity in a community-based group of epilepsy patients differ from healthy controls. Exp Brain Res 2024; 242:1301-1310. [PMID: 38551692 PMCID: PMC11108887 DOI: 10.1007/s00221-024-06792-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2023] [Accepted: 01/22/2024] [Indexed: 05/23/2024]
Abstract
Ictal and interictal activity within the autonomic nervous system is characterized by a sympathetic overshoot in people with epilepsy. This autonomic dysfunction is assumed to be driven by alterations in the central autonomic network. In this study, exercise-induced changes of the interrelation of central and peripheral autonomic activity in patients with epilepsy was assessed. 21 patients with epilepsy (16 seizure-free), and 21 healthy matched controls performed an exhaustive bicycle ergometer test. Immediately before and after the exercise test, resting state electroencephalography measurements (Brain Products GmbH, 128-channel actiCHamp) of 5 min were carried out to investigate functional connectivity assessed by phase locking value in source space for whole brain, central autonomic network and visual network. Additionally, 1-lead ECG (Brain products GmbH) was performed to analyze parasympathetic (root mean square of successive differences (RMSSD) of the heart rate variability) and sympathetic activity (electrodermal activity (meanEDA)). MeanEDA increased (p < 0.001) and RMSSD decreased (p < 0.001) from pre to post-exercise in both groups. Correlation coefficients of meanEDA and central autonomic network functional connectivity differed significantly between the groups (p = 0.004) after exercise. Both patients with epilepsy and normal control subjects revealed the expected physiological peripheral autonomic responses to acute exhaustive exercise, but alterations of the correlation between central autonomic and peripheral sympathetic activity may indicate a different sympathetic reactivity after exercise in patients with epilepsy. The clinical relevance of this finding and its modulators (seizures, anti-seizure medication, etc.) still needs to be elucidated.
Collapse
Affiliation(s)
| | - Julia Kristin Gowik
- Institute of Sports Medicine, Paderborn University, Warburger Straße 100, 33098, Paderborn, Germany
| | - Jessica Coenen
- Institute of Sports Medicine, Paderborn University, Warburger Straße 100, 33098, Paderborn, Germany
| | - Rasmus Jakobsmeyer
- Institute of Sports Medicine, Paderborn University, Warburger Straße 100, 33098, Paderborn, Germany
| | - Claus Reinsberger
- Institute of Sports Medicine, Paderborn University, Warburger Straße 100, 33098, Paderborn, Germany.
- Division of Sports Neurology & Neurosciences, Department of Neurology, Mass General Brigham, Harvard Medical School, Boston, MA, USA.
| |
Collapse
|
12
|
Mehmood I, Li H, Umer W, Ma J, Saad Shakeel M, Anwer S, Fordjour Antwi-Afari M, Tariq S, Wu H. Non-invasive detection of mental fatigue in construction equipment operators through geometric measurements of facial features. JOURNAL OF SAFETY RESEARCH 2024; 89:234-250. [PMID: 38858047 DOI: 10.1016/j.jsr.2024.01.013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/15/2023] [Revised: 10/17/2023] [Accepted: 01/26/2024] [Indexed: 06/12/2024]
Abstract
INTRODUCTION Prolonged operation of construction equipment could lead to mental fatigue, which can increase the chances of human error-related accidents as well as operators' ill-health. The objective detection of operators' mental fatigue is crucial for reducing accident risk and ensuring operator health. Electroencephalography, photoplethysmography, electrodermal activity, and eye-tracking technology have been used to mitigate this issue. These technologies are invasive and wearable sensors that can cause irritation and discomfort. Geometric measurements of facial features can serve as a noninvasive alternative approach. Its application in detecting mental fatigue of construction equipment operators has not been reported in the literature. Although the application of facial features has been widespread in other domains, such as drivers and other occupation scenarios, their ecological validity for construction excavator operators remains a knowledge gap. METHOD This study proposed employing geometric measurements of facial features to detect mental fatigue in construction equipment operators' facial features. In this study, seventeen operators performed excavation operations. Mental fatigue was labeled subjectively and objectively using NASA-TLX scores and EDA values. Based on geometric measurements, facial features (eyebrow, mouth outer, mouth corners, head motion, eye area, and face area) were extracted. RESULTS The results showed that there was significant difference in the measured metrics for high fatigue compared to low fatigue. Specifically, the most noteworthy variation was for the eye and face area metrics, with mean differences of 45.88% and 26.9%, respectively. CONCLUSIONS The findings showed that geometrical measurements of facial features are a useful, noninvasive approach for detecting the mental fatigue of construction equipment operators.
Collapse
Affiliation(s)
- Imran Mehmood
- Department of Building and Real Estate, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong Special Administrative Region.
| | - Heng Li
- Department of Building and Real Estate, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong Special Administrative Region.
| | - Waleed Umer
- Department of Architecture and Built Environment, Northumbria University, Newcastle upon Tyne NE1 8ST, United Kingdom.
| | - Jie Ma
- Department of Building and Real Estate, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong Special Administrative Region.
| | - Muhammad Saad Shakeel
- School of Automation Science and Engineering, South China University of Technology, Guangzhou, China.
| | - Shahnawaz Anwer
- Department of Building and Real Estate, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong Special Administrative Region.
| | - Maxwell Fordjour Antwi-Afari
- Department of Civil Engineering, College of Engineering and Physical Sciences, Aston University, Birmingham, B4 7ET, United Kingdom.
| | - Salman Tariq
- Department of Building and Real Estate, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong Special Administrative Region.
| | - Haitao Wu
- Department of Building and Real Estate, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong Special Administrative Region.
| |
Collapse
|
13
|
Queirolo L, Roccon A, Piovan S, Ludovichetti FS, Bacci C, Zanette G. Psychophysiological wellbeing in a class of dental students attending dental school: anxiety, burnout, post work executive performance and a 24 hours physiological investigation during a working day. Front Psychol 2024; 15:1344970. [PMID: 38845771 PMCID: PMC11154343 DOI: 10.3389/fpsyg.2024.1344970] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2023] [Accepted: 03/29/2024] [Indexed: 06/09/2024] Open
Abstract
Aim To the best of our knowledge, dental school students have never been evaluated for stress, anxiety, burnout, physiological indexes during a 24-h working day, and executive function performance post-work and post-work after returning from vacation; therefore, this research has been conducted. Methods Data were acquired at the Dental School of the University of Padua on 16 students in their 4th year, far from the exam session. While performing clinical activity on the dental chair and during a working day, electrodermal activity (EDA), heart rate variability (HRV), and heart rate (HR) were recorded. Participants' stress was measured with the Perceived Stress Scale (PSS-10 scale) and anxiety with the General Anxiety Disorder Questionnaire (GAD-7) and State-Trait Anxiety Inventory (STAI-Y-2), while burnout with the Maslach Burnout Inventory (MBI-HSS). Executive functions were evaluated using the Tower of London test (TOL-R). Results Three students (2F/1M) had a GAD-7 score ≥ 10. Five students (4F/1M) showed trait anxiety. Moderate levels of perceived stress were reported in 85% of participants. MBI-HSS showed that 7 participants scored high on emotional exhaustion and 7 on depersonalization. TOL-R performance (M = 15.85, SD = 4.01) was below the normative value p < 0.00001. A second test, after the holidays, showed normal values. EDA was higher during children's treatment (p < 0.05), ANOVA showed high HR during working time (p < 0.001), and HRV was higher in males (p < 0.001). Conclusion Based on the sample size evaluated, it is reported that being a dental student has a moderate impact on stress, anxiety, and burnout while a strong impact on executive functions buffered by rest.
Collapse
Affiliation(s)
- Luca Queirolo
- Section of Clinical Dentistry, Department of Neurosciences, University of Padua, Padua, Italy
- Department of Philosophy, Sociology, Education and Applied Psychology, University of Padua, Padua, Italy
| | - Andrea Roccon
- Section of Clinical Dentistry, Department of Neurosciences, University of Padua, Padua, Italy
| | - Silvia Piovan
- Section of Clinical Dentistry, Department of Neurosciences, University of Padua, Padua, Italy
| | | | - Christian Bacci
- Section of Clinical Dentistry, Department of Neurosciences, University of Padua, Padua, Italy
| | - Gastone Zanette
- Section of Clinical Dentistry, Department of Neurosciences, University of Padua, Padua, Italy
| |
Collapse
|
14
|
Yu X, Lu J, Liu W, Cheng Z, Xiao G. Exploring physiological stress response evoked by passive translational acceleration in healthy adults: a pilot study utilizing electrodermal activity and heart rate variability measurements. Sci Rep 2024; 14:11349. [PMID: 38762532 PMCID: PMC11102551 DOI: 10.1038/s41598-024-61656-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2024] [Accepted: 05/08/2024] [Indexed: 05/20/2024] Open
Abstract
Passive translational acceleration (PTA) has been demonstrated to induce the stress response and regulation of autonomic balance in healthy individuals. Electrodermal activity (EDA) and heart rate variability (HRV) measurements are reliable indicators of the autonomic nervous system (ANS) and can be used to assess stress levels. The objective of this study was to investigate the potential of combining EDA and HRV measurements in assessing the physiological stress response induced by PTA. Fourteen healthy subjects were randomly assigned to two groups of equal size. The experimental group underwent five trials of elevator rides, while the control group received a sham treatment. EDA and HRV indices were obtained via ultra-short-term analysis and compared between the two groups to track changes in the ANS. In addition, the complexity of the EDA time series was compared between the 4 s before and the 2-6 s after the onset of PTA to assess changes in the subjects' stress levels in the experimental group. The results revealed a significant increase in the skin conductance response (SCR) frequency and a decrease in the root mean square of successive differences (RMSSD) and high frequency (HF) components of HRV. In terms of stress assessment, the results showed an increase in the complexity of the EDA time series 2-6 s after the onset of PTA. These results indicate an elevation in sympathetic tone when healthy subjects were exposed to a translational transport scenario. Furthermore, evidence was provided for the ability of EDA complexity to differentiate stress states in individual trials of translational acceleration.
Collapse
Affiliation(s)
- Xiaoru Yu
- College of Metrology and Measurement Engineering, China Jiliang University, Hangzhou, Zhejiang, China
| | - JiaWei Lu
- College of Mechanical and Electrical Engineering, China Jiliang University, Hangzhou, Zhejiang, China
| | - Wenchao Liu
- Xizi Elevator Co., Ltd., Hangzhou, Zhejiang, China
| | - Zhenbo Cheng
- Zhejiang University of Technology, Hangzhou, Zhejiang, China
| | - Gang Xiao
- College of Mechanical and Electrical Engineering, China Jiliang University, Hangzhou, Zhejiang, China.
| |
Collapse
|
15
|
Gilmore J, Nasseri M. Human Activity Recognition Algorithm with Physiological and Inertial Signals Fusion: Photoplethysmography, Electrodermal Activity, and Accelerometry. SENSORS (BASEL, SWITZERLAND) 2024; 24:3005. [PMID: 38793858 PMCID: PMC11124986 DOI: 10.3390/s24103005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/11/2024] [Revised: 04/23/2024] [Accepted: 05/07/2024] [Indexed: 05/26/2024]
Abstract
Inertial signals are the most widely used signals in human activity recognition (HAR) applications, and extensive research has been performed on developing HAR classifiers using accelerometer and gyroscope data. This study aimed to investigate the potential enhancement of HAR models through the fusion of biological signals with inertial signals. The classification of eight common low-, medium-, and high-intensity activities was assessed using machine learning (ML) algorithms, trained on accelerometer (ACC), blood volume pulse (BVP), and electrodermal activity (EDA) data obtained from a wrist-worn sensor. Two types of ML algorithms were employed: a random forest (RF) trained on features; and a pre-trained deep learning (DL) network (ResNet-18) trained on spectrogram images. Evaluation was conducted on both individual activities and more generalized activity groups, based on similar intensity. Results indicated that RF classifiers outperformed corresponding DL classifiers at both individual and grouped levels. However, the fusion of EDA and BVP signals with ACC data improved DL classifier performance compared to a baseline DL model with ACC-only data. The best performance was achieved by a classifier trained on a combination of ACC, EDA, and BVP images, yielding F1-scores of 69 and 87 for individual and grouped activity classifications, respectively. For DL models trained with additional biological signals, almost all individual activity classifications showed improvement (p-value < 0.05). In grouped activity classifications, DL model performance was enhanced for low- and medium-intensity activities. Exploring the classification of two specific activities, ascending/descending stairs and cycling, revealed significantly improved results using a DL model trained on combined ACC, BVP, and EDA spectrogram images (p-value < 0.05).
Collapse
Affiliation(s)
- Justin Gilmore
- Department of Electrical and Computer Engineering, University of Central Florida, Orlando, FL 32816, USA
| | - Mona Nasseri
- School of Engineering, University of North Florida, Jacksonville, FL 32224, USA
| |
Collapse
|
16
|
P SK, Agastinose Ronickom JF. Optimal Electrodermal Activity Segment for Enhanced Emotion Recognition Using Spectrogram-Based Feature Extraction and Machine Learning. Int J Neural Syst 2024; 34:2450027. [PMID: 38511233 DOI: 10.1142/s0129065724500278] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/22/2024]
Abstract
In clinical and scientific research on emotion recognition using physiological signals, selecting the appropriate segment is of utmost importance for enhanced results. In our study, we optimized the electrodermal activity (EDA) segment for an emotion recognition system. Initially, we obtained EDA signals from two publicly available datasets: the Continuously annotated signals of emotion (CASE) and Wearable stress and affect detection (WESAD) for 4-class dimensional and three-class categorical emotional classification, respectively. These signals were pre-processed, and decomposed into phasic signals using the 'convex optimization to EDA' method. Further, the phasic signals were segmented into two equal parts, each subsequently segmented into five nonoverlapping windows. Spectrograms were then generated using short-time Fourier transform and Mel-frequency cepstrum for each window, from which we extracted 85 features. We built four machine learning models for the first part, second part, and whole phasic signals to investigate their performance in emotion recognition. In the CASE dataset, we achieved the highest multi-class accuracy of 62.54% using the whole phasic and 61.75% with the second part phasic signals. Conversely, the WESAD dataset demonstrated superior performance in three-class emotions classification, attaining an accuracy of 96.44% for both whole phasic and second part phasic segments. As a result, the second part of EDA is strongly recommended for optimal outcomes.
Collapse
Affiliation(s)
- Sriram Kumar P
- School of Biomedical Engineering, Indian Institute of Technology (BHU) Varanasi, Uttar Pradesh 221005, India
| | | |
Collapse
|
17
|
Lim KYT, Nguyen Thien MT, Nguyen Duc MA, Posada-Quintero HF. Application of DIY Electrodermal Activity Wristband in Detecting Stress and Affective Responses of Students. Bioengineering (Basel) 2024; 11:291. [PMID: 38534565 DOI: 10.3390/bioengineering11030291] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2024] [Revised: 03/10/2024] [Accepted: 03/17/2024] [Indexed: 03/28/2024] Open
Abstract
This paper describes the analysis of electrodermal activity (EDA) in the context of students' scholastic activity. Taking a multidisciplinary, citizen science and maker-centric approach, low-cost, bespoken wearables, such as a mini weather station and biometric wristband, were built. To investigate both physical health as well as stress, the instruments were first validated against research grade devices. Following this, a research experiment was created and conducted in the context of students' scholastic activity. Data from this experiment were used to train machine learning models, which were then applied to interpret the relationships between the environment, health, and stress. It is hoped that analyses of EDA data will further strengthen the emerging model describing the intersections between local microclimate and physiological and neurological stress. The results suggest that temperature and air quality play an important role in students' physiological well-being, thus demonstrating the feasibility of understanding the extent of the effects of various microclimatic factors. This highlights the importance of thermal comfort and air ventilation in real-life applications to improve students' well-being. We envision our work making a significant impact by showcasing the effectiveness and feasibility of inexpensive, self-designed wearable devices for tracking microclimate and electrodermal activity (EDA). The affordability of these wearables holds promising implications for scalability and encourages crowd-sourced citizen science in the relatively unexplored domain of microclimate's influence on well-being. Embracing citizen science can then democratize learning and expedite rapid research advancements.
Collapse
Affiliation(s)
- Kenneth Y T Lim
- National Institute of Education, Nanyang Technological University, Singapore 637616, Singapore
| | | | | | | |
Collapse
|
18
|
Bruin J, Stuldreher IV, Perone P, Hogenelst K, Naber M, Kamphuis W, Brouwer AM. Detection of arousal and valence from facial expressions and physiological responses evoked by different types of stressors. FRONTIERS IN NEUROERGONOMICS 2024; 5:1338243. [PMID: 38559665 PMCID: PMC10978716 DOI: 10.3389/fnrgo.2024.1338243] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/14/2023] [Accepted: 02/29/2024] [Indexed: 04/04/2024]
Abstract
Automatically detecting mental state such as stress from video images of the face could support evaluating stress responses in applicants for high risk jobs or contribute to timely stress detection in challenging operational settings (e.g., aircrew, command center operators). Challenges in automatically estimating mental state include the generalization of models across contexts and across participants. We here aim to create robust models by training them using data from different contexts and including physiological features. Fifty-one participants were exposed to different types of stressors (cognitive, social evaluative and startle) and baseline variants of the stressors. Video, electrocardiogram (ECG), electrodermal activity (EDA) and self-reports (arousal and valence) were recorded. Logistic regression models aimed to classify between high and low arousal and valence across participants, where "high" and "low" were defined relative to the center of the rating scale. Accuracy scores of different models were evaluated: models trained and tested within a specific context (either a baseline or stressor variant of a task), intermediate context (baseline and stressor variant of a task), or general context (all conditions together). Furthermore, for these different model variants, only the video data was included, only the physiological data, or both video and physiological data. We found that all (video, physiological and video-physio) models could successfully distinguish between high- and low-rated arousal and valence, though performance tended to be better for (1) arousal than valence, (2) specific context than intermediate and general contexts, (3) video-physio data than video or physiological data alone. Automatic feature selection resulted in inclusion of 3-20 features, where the models based on video-physio data usually included features from video, ECG and EDA. Still, performance of video-only models approached the performance of video-physio models. Arousal and valence ratings by three experienced human observers scores based on part of the video data did not match with self-reports. In sum, we showed that it is possible to automatically monitor arousal and valence even in relatively general contexts and better than humans can (in the given circumstances), and that non-contact video images of faces capture an important part of the information, which has practical advantages.
Collapse
Affiliation(s)
- Juliette Bruin
- TNO Human Factors, Netherlands Organization for Applied Scientific Research, Soesterberg, Netherlands
| | - Ivo V. Stuldreher
- TNO Human Factors, Netherlands Organization for Applied Scientific Research, Soesterberg, Netherlands
| | - Paola Perone
- TNO Human Factors, Netherlands Organization for Applied Scientific Research, Soesterberg, Netherlands
| | - Koen Hogenelst
- TNO Human Factors, Netherlands Organization for Applied Scientific Research, Soesterberg, Netherlands
| | - Marnix Naber
- Experimental Psychology, Helmholtz Institute, Faculty of Social and Behavioral Sciences, Utrecht University, Utrecht, Netherlands
| | - Wim Kamphuis
- TNO Human Factors, Netherlands Organization for Applied Scientific Research, Soesterberg, Netherlands
| | - Anne-Marie Brouwer
- TNO Human Factors, Netherlands Organization for Applied Scientific Research, Soesterberg, Netherlands
- Artificial Intelligence, Donders Centre, Faculty of Social Sciences, Radboud University, Nijmegen, Netherlands
| |
Collapse
|
19
|
Kappen M, Vanhollebeke G, Van Der Donckt J, Van Hoecke S, Vanderhasselt MA. Acoustic and prosodic speech features reflect physiological stress but not isolated negative affect: a multi-paradigm study on psychosocial stressors. Sci Rep 2024; 14:5515. [PMID: 38448417 PMCID: PMC10918109 DOI: 10.1038/s41598-024-55550-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2023] [Accepted: 02/25/2024] [Indexed: 03/08/2024] Open
Abstract
Heterogeneity in speech under stress has been a recurring issue in stress research, potentially due to varied stress induction paradigms. This study investigated speech features in semi-guided speech following two distinct psychosocial stress paradigms (Cyberball and MIST) and their respective control conditions. Only negative affect increased during Cyberball, while self-reported stress, skin conductance response rate, and negative affect increased during MIST. Fundamental frequency (F0), speech rate, and jitter significantly changed during MIST, but not Cyberball; HNR and shimmer showed no expected changes. The results indicate that observed speech features are robust in semi-guided speech and sensitive to stressors eliciting additional physiological stress responses, not solely decreases in negative affect. These differences between stressors may explain literature heterogeneity. Our findings support the potential of speech as a stress level biomarker, especially when stress elicits physiological reactions, similar to other biomarkers. This highlights its promise as a tool for measuring stress in everyday settings, considering its affordability, non-intrusiveness, and ease of collection. Future research should test these results' robustness and specificity in naturalistic settings, such as freely spoken speech and noisy environments while exploring and validating a broader range of informative speech features in the context of stress.
Collapse
Affiliation(s)
- Mitchel Kappen
- Department of Head and Skin, Department of Psychiatry and Medical Psychology, Ghent University, University Hospital Ghent (UZ Ghent), Ghent, Belgium.
- Ghent Experimental Psychiatry (GHEP) Lab, Ghent University, Ghent, Belgium.
- Department of Experimental Clinical and Health Psychology, Ghent University, Ghent, Belgium.
| | - Gert Vanhollebeke
- Department of Head and Skin, Department of Psychiatry and Medical Psychology, Ghent University, University Hospital Ghent (UZ Ghent), Ghent, Belgium
- Ghent Experimental Psychiatry (GHEP) Lab, Ghent University, Ghent, Belgium
- Department of Electronics and Information Systems, Ghent University, Ghent, Belgium
| | - Jonas Van Der Donckt
- IDLab, Ghent University - Imec, Ghent, Belgium
- Department of Electronics and Information Systems, Ghent University, Ghent, Belgium
| | - Sofie Van Hoecke
- IDLab, Ghent University - Imec, Ghent, Belgium
- Department of Electronics and Information Systems, Ghent University, Ghent, Belgium
| | - Marie-Anne Vanderhasselt
- Department of Head and Skin, Department of Psychiatry and Medical Psychology, Ghent University, University Hospital Ghent (UZ Ghent), Ghent, Belgium
- Ghent Experimental Psychiatry (GHEP) Lab, Ghent University, Ghent, Belgium
| |
Collapse
|
20
|
Krasnodębska P, Szkiełkowska A, Pollak A, Romaniszyn-Kania P, Bugdol MN, Bugdol MD, Mitas AW. Analysis of the relationship between emotion intensity and electrophysiology parameters during a voice examination of opera singers. Int J Occup Med Environ Health 2024; 37:84-97. [PMID: 38375631 PMCID: PMC10959272 DOI: 10.13075/ijomeh.1896.02272] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2023] [Accepted: 12/12/2023] [Indexed: 02/21/2024] Open
Abstract
OBJECTIVES Emotions and stress affect voice production. There are only a few reports in the literature on how changes in the autonomic nervous system affect voice production. The aim of this study was to examine emotions and measure stress reactions during a voice examination procedure, particularly changes in the muscles surrounding the larynx. MATERIAL AND METHODS The study material included 50 healthy volunteers (26 voice workers - opera singers, 24 control subjects), all without vocal complaints. All subjects had good voice quality in a perceptual assessment. The research procedure consisted of 4 parts: an ear, nose, and throat (ENT)‑phoniatric examination, surface electromyography, recording physiological indicators (heart rate and skin resistance) using a wearable wristband, and a psychological profile based on questionnaires. RESULTS The results of the study demonstrated that there was a relationship between positive and negative emotions and stress reactions related to the voice examination procedure, as well as to the tone of the vocal tract muscles. There were significant correlations between measures describing the intensity of experienced emotions and vocal tract muscle maximum amplitude of the cricothyroid (CT) and sternocleidomastoid (SCM) muscles during phonation and non-phonation tasks. Subjects experiencing eustress (favorable stress response) had increased amplitude of submandibular and CT at rest and phonation. Subjects with high levels of negative emotions, revealed positive correlations with SCMmax during the glissando. The perception of positive and negative emotions caused different responses not only in the vocal tract but also in the vegetative system. Correlations were found between emotions and physiological parameters, most markedly in heart rate variability. A higher incidence of extreme emotions was observed in the professional group. CONCLUSIONS The activity of the vocal tract muscles depends on the type and intensity of the emotions and stress reactions. The perception of positive and negative emotions causes different responses in the vegetative system and the vocal tract. Int J Occup Med Environ Health. 2024;37(1):84-97.
Collapse
Affiliation(s)
- Paulina Krasnodębska
- Institute of Physiology and Pathology of Hearing, Audiology and Phoniatrics Clinic, Kajetany, Poland
| | - Agata Szkiełkowska
- Institute of Physiology and Pathology of Hearing, Audiology and Phoniatrics Clinic, Kajetany, Poland
| | - Anita Pollak
- University of Silesia in Katowice, Institute of Psychology, Katowice, Poland
| | - Patrycja Romaniszyn-Kania
- Silesian University of Technology, Faculty of Biomedical Engineering, Department of Medical Informatics and Artificial Intelligence, Zabrze, Poland
| | - Monika N. Bugdol
- Silesian University of Technology, Faculty of Biomedical Engineering, Department of Medical Informatics and Artificial Intelligence, Zabrze, Poland
| | - Marcin D. Bugdol
- Silesian University of Technology, Faculty of Biomedical Engineering, Department of Medical Informatics and Artificial Intelligence, Zabrze, Poland
| | - Andrzej W. Mitas
- Silesian University of Technology, Faculty of Biomedical Engineering, Department of Medical Informatics and Artificial Intelligence, Zabrze, Poland
| |
Collapse
|
21
|
Baghestani F, Kong Y, D'Angelo W, Chon KH. Analysis of sympathetic responses to cognitive stress and pain through skin sympathetic nerve activity and electrodermal activity. Comput Biol Med 2024; 170:108070. [PMID: 38330822 DOI: 10.1016/j.compbiomed.2024.108070] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2023] [Revised: 12/28/2023] [Accepted: 01/27/2024] [Indexed: 02/10/2024]
Abstract
We explored the non-invasive evaluation of the sympathetic nervous system (SNS) by employing two distinct physiological signals: skin sympathetic nerve activity (SKNA), extracted from electrocardiogram (ECG) signals, and electrodermal activity (EDA), a well-studied marker in the context of the SNS assessment. Our investigation focused on cognitive stress and pain; two conditions closely associated with the SNS. We sought to determine if the information and dynamics of EDA could be derived from the novel SKNA signal. To this end, ECG and EDA signals were recorded simultaneously during three experiments aimed at sympathetic stimulation, Valsalva maneuver (VM), Stroop test, and thermal-grill pain test. We calculated the integral area under the rectified SKNA signal (iSKNA) and decomposed the EDA signal to its phasic component (EDAphasic). An average delay of more than 4.6 s was observed in the onset of EDAphasic bursts compared to their corresponding iSKNA bursts. After shifting the EDAphasic segments by the extent of this delay and smoothing the corresponding iSKNA bursts, our results revealed a strong average correlation coefficient of 0.85±0.14 between the iSKNA and EDAphasic bursts, indicating a noteworthy similarity between the two signals. We also reconstructed the EDA signals with time-varying sympathetic (TVSymp) and modified TVSymp (MTVSymp) methods. Then we extracted the following features from iSKNA, EDAphasic, TVSymp, and MTVSymp signals: peak amplitude, average amplitude (aSKNA), standard deviation (vSKNA), and the cumulative duration during which the signals had higher amplitudes than a specified threshold (HaSKNA). A strong average correlation of 0.89±0.18 was found between vSKNA and subjects' self-rated pain levels during the pain test. Our statistical analysis also included applying Linear Mixed-Effects Models to check if there were significant differences in features across baseline and different levels of SNS stimulation. We then assessed the discriminating power of the features using Area Under the Receiver Operating Characteristic Curve (AUROC) and Fisher's Ratio. Finally, using all the four EDA features, a multi-layer perceptron (MLP) classifier reached the classification accuracies 95.56%, 89.29%, and 67.88% for the VM, Stroop, and thermal-grill pain control and stimulation classes. On the other hand, the highest classification accuracies based on SKNA features were achieved using K-nearest neighbors (KNN) (98.89%), KNN (89.29%), and MLP (95.11%) classifiers for the same experiments. Our comparative analysis showed the feasibility of SKNA as a novel tool for assessing the SNS with accurate classification capability, with a faster onset of amplitude increase in response to SNS activity, compared to EDA.
Collapse
Affiliation(s)
- Farnoush Baghestani
- Biomedical Engineering Department, University of Connecticut, United States of America
| | - Youngsun Kong
- Biomedical Engineering Department, University of Connecticut, United States of America
| | - William D'Angelo
- Biomedical Systems Engineering and Evaluation Department, Naval Medical Research Unit Department, San Antonio, TX, United States of America
| | - Ki H Chon
- Biomedical Engineering Department, University of Connecticut, United States of America.
| |
Collapse
|
22
|
Karjalainen S, Aro T, Parviainen T. Coactivation of Autonomic and Central Nervous Systems During Processing of Socially Relevant Information in Autism Spectrum Disorder: A Systematic Review. Neuropsychol Rev 2024; 34:214-231. [PMID: 36849624 PMCID: PMC10920494 DOI: 10.1007/s11065-023-09579-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2022] [Accepted: 11/29/2022] [Indexed: 03/01/2023]
Abstract
Body-brain interaction provides a novel approach to understand neurodevelopmental conditions such as autism spectrum disorder (ASD). In this systematic review, we analyse the empirical evidence regarding coexisting differences in autonomic (ANS) and central nervous system (CNS) responses to social stimuli between individuals with ASD and typically developing individuals. Moreover, we review evidence of deviations in body-brain interaction during processing of socially relevant information in ASD. We conducted systematic literature searches in PubMed, Medline, PsychInfo, PsychArticles, and Cinahl databases (until 12.1.2022). Studies were included if individuals with ASD were compared with typically developing individuals, study design included processing of social information, and ANS and CNS activity were measured simultaneously. Out of 1892 studies identified based on the titles and abstracts, only six fulfilled the eligibility criteria to be included in synthesis. The quality of these studies was assessed using a quality assessment checklist. The results indicated that individuals with ASD demonstrate atypicalities in ANS and CNS signalling which, however, are context dependent. There were also indications for altered contribution of ANS-CNS interaction in processing of social information in ASD. However, the findings must be considered in the context of several limitations, such as small sample sizes and high variability in (neuro)physiological measures. Indeed, the methodological choices varied considerably, calling for a need for unified guidelines to improve the interpretability of results. We summarize the current experimentally supported understanding of the role of socially relevant body-brain interaction in ASD. Furthermore, we propose developments for future studies to improve incremental knowledge building across studies of ANS-CNS interaction involving individuals with ASD.
Collapse
Affiliation(s)
- Suvi Karjalainen
- Department of Psychology, University of Jyväskylä, PO Box 35, FI-40014, Jyväskylä, Finland.
- Centre for Interdisciplinary Brain Research, University of Jyväskylä, Jyväskylä, Finland.
| | - Tuija Aro
- Department of Psychology, University of Jyväskylä, PO Box 35, FI-40014, Jyväskylä, Finland
| | - Tiina Parviainen
- Department of Psychology, University of Jyväskylä, PO Box 35, FI-40014, Jyväskylä, Finland
- Centre for Interdisciplinary Brain Research, University of Jyväskylä, Jyväskylä, Finland
| |
Collapse
|
23
|
Maritsch M, Föll S, Lehmann V, Styger N, Bérubé C, Kraus M, Feuerriegel S, Kowatsch T, Züger T, Fleisch E, Wortmann F, Stettler C. Smartwatches for non-invasive hypoglycaemia detection during cognitive and psychomotor stress. Diabetes Obes Metab 2024; 26:1133-1136. [PMID: 38086545 DOI: 10.1111/dom.15402] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/03/2023] [Revised: 11/16/2023] [Accepted: 11/21/2023] [Indexed: 02/06/2024]
Affiliation(s)
- Martin Maritsch
- Department of Management, Technology and Economics, ETH Zurich, Zurich, Switzerland
| | - Simon Föll
- Department of Management, Technology and Economics, ETH Zurich, Zurich, Switzerland
| | - Vera Lehmann
- Department of Diabetes, Endocrinology, Nutritional Medicine and Metabolism, Inselspital, Bern, University Hospital, University of Bern, Bern, Switzerland
| | - Naïma Styger
- Department of Diabetes, Endocrinology, Nutritional Medicine and Metabolism, Inselspital, Bern, University Hospital, University of Bern, Bern, Switzerland
| | - Caterina Bérubé
- Department of Management, Technology and Economics, ETH Zurich, Zurich, Switzerland
| | - Mathias Kraus
- School of Business, Economics and Society, Friedrich-Alexander University Erlangen-Nürnberg, Nürnberg, Germany
| | - Stefan Feuerriegel
- Institute of AI in Management, LMU Munich, Munich, Germany
- Munich Center for Machine Learning (MCML), Munich, Germany
| | - Tobias Kowatsch
- Department of Management, Technology and Economics, ETH Zurich, Zurich, Switzerland
- Institute for Implementation Science in Health Care, University of Zurich, Zurich, Switzerland
- School of Medicine, University of St Gallen, St Gallen, Switzerland
| | - Thomas Züger
- Department of Diabetes, Endocrinology, Nutritional Medicine and Metabolism, Inselspital, Bern, University Hospital, University of Bern, Bern, Switzerland
- Department of Endocrinology and Metabolic Diseases, Kantonsspital Olten, Olten, Switzerland
| | - Elgar Fleisch
- Department of Management, Technology and Economics, ETH Zurich, Zurich, Switzerland
- Institute of Technology Management, University of St Gallen, St Gallen, Switzerland
| | - Felix Wortmann
- Institute of Technology Management, University of St Gallen, St Gallen, Switzerland
| | - Christoph Stettler
- Department of Diabetes, Endocrinology, Nutritional Medicine and Metabolism, Inselspital, Bern, University Hospital, University of Bern, Bern, Switzerland
| |
Collapse
|
24
|
Greenlee JL, Lorang E, Olson RH, Rodriquez G, Yoon DM, Hartley S. Comparative analysis of electrodermal activity metrics and their association with child behavior in autism spectrum disorder. Dev Psychobiol 2024; 66:e22461. [PMID: 38388193 PMCID: PMC10901449 DOI: 10.1002/dev.22461] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2023] [Revised: 11/07/2023] [Accepted: 01/05/2024] [Indexed: 02/24/2024]
Abstract
Researchers are increasingly utilizing physiological data like electrodermal activity (EDA) to understand how stress "gets under the skin." Results of EDA studies in autistic children are mixed, with some suggesting autistic hyperarousal, others finding hypoarousal, and yet others detecting no difference compared to non-autistics. Some of this variability likely stems from the different techniques used to assess EDA. Therefore, the purpose of this study is to investigate and compare commonly used metrics of EDA (frequency of peaks, average amplitude of peaks, and standard deviation of skin conductance level) using two data processing programs (NeuroKit2 and Ledalab) and their link to observed child behavior. EDA data were collected using Empatica E4 wristbands from 60 autistic children and adolescents (5-18 years old) during a 7-min play interaction with their primary caregiver. The play interaction was coded for a range of child behaviors including mood, social responsiveness, dysregulation, and cooperation. Results indicate a strong correlation between NeuroKit2 and Ledalab and a weak correlation between metrics within each program. Furthermore, the frequency of peaks was associated with more positive child social behaviors, and the magnitude of peaks was associated with less adaptive child behaviors. Recommendations for replication and the need for generalizability of this research are given.
Collapse
Affiliation(s)
| | - Emily Lorang
- Communicative Sciences and Disorders, Michigan State University, East Lansing, Michigan, USA
| | - Robert H Olson
- Waisman Center, University of Wisconsin-Madison, Madison, Wisconsin, USA
| | - Geovanna Rodriquez
- Department of Special Education and Clinical Sciences, University of Oregon, Eugene, Oregon, USA
| | - Dasoo Milton Yoon
- Waisman Center, University of Wisconsin-Madison, Madison, Wisconsin, USA
- School of Human Ecology, University of Wisconsin-Madison, Madison, Wisconsin, USA
| | - Sigan Hartley
- Waisman Center, University of Wisconsin-Madison, Madison, Wisconsin, USA
- School of Human Ecology, University of Wisconsin-Madison, Madison, Wisconsin, USA
| |
Collapse
|
25
|
Rykov YG, Patterson MD, Gangwar BA, Jabar SB, Leonardo J, Ng KP, Kandiah N. Predicting cognitive scores from wearable-based digital physiological features using machine learning: data from a clinical trial in mild cognitive impairment. BMC Med 2024; 22:36. [PMID: 38273340 PMCID: PMC10809621 DOI: 10.1186/s12916-024-03252-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/25/2023] [Accepted: 01/09/2024] [Indexed: 01/27/2024] Open
Abstract
BACKGROUND Continuous assessment and remote monitoring of cognitive function in individuals with mild cognitive impairment (MCI) enables tracking therapeutic effects and modifying treatment to achieve better clinical outcomes. While standardized neuropsychological tests are inconvenient for this purpose, wearable sensor technology collecting physiological and behavioral data looks promising to provide proxy measures of cognitive function. The objective of this study was to evaluate the predictive ability of digital physiological features, based on sensor data from wrist-worn wearables, in determining neuropsychological test scores in individuals with MCI. METHODS We used the dataset collected from a 10-week single-arm clinical trial in older adults (50-70 years old) diagnosed with amnestic MCI (N = 30) who received a digitally delivered multidomain therapeutic intervention. Cognitive performance was assessed before and after the intervention using the Neuropsychological Test Battery (NTB) from which composite scores were calculated (executive function, processing speed, immediate memory, delayed memory and global cognition). The Empatica E4, a wrist-wearable medical-grade device, was used to collect physiological data including blood volume pulse, electrodermal activity, and skin temperature. We processed sensors' data and extracted a range of physiological features. We used interpolated NTB scores for 10-day intervals to test predictability of scores over short periods and to leverage the maximum of wearable data available. In addition, we used individually centered data which represents deviations from personal baselines. Supervised machine learning was used to train models predicting NTB scores from digital physiological features and demographics. Performance was evaluated using "leave-one-subject-out" and "leave-one-interval-out" cross-validation. RESULTS The final sample included 96 aggregated data intervals from 17 individuals. In total, 106 digital physiological features were extracted. We found that physiological features, especially measures of heart rate variability, correlated most strongly to the executive function compared to other cognitive composites. The model predicted the actual executive function scores with correlation r = 0.69 and intra-individual changes in executive function scores with r = 0.61. CONCLUSIONS Our findings demonstrated that wearable-based physiological measures, primarily HRV, have potential to be used for the continuous assessments of cognitive function in individuals with MCI.
Collapse
Affiliation(s)
| | | | | | | | - Jacklyn Leonardo
- Dementia Research Centre, Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore
| | - Kok Pin Ng
- Department of Neurology, National Neuroscience Institute, Singapore, Singapore
- Duke-NUS Medical School, Singapore, Singapore
| | - Nagaendran Kandiah
- Dementia Research Centre, Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore
| |
Collapse
|
26
|
Hamilton RI, Garcia AA, Bowd J, Hamilton D, Mason D, Elliott M, Holt C. Utilising electrodermal activity sensor signals to quantify nociceptive response during movement activities. BMC Res Notes 2024; 17:36. [PMID: 38268014 PMCID: PMC10809522 DOI: 10.1186/s13104-024-06689-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2022] [Accepted: 01/08/2024] [Indexed: 01/26/2024] Open
Abstract
OBJECTIVE With an increasingly ageing population and osteoarthritis prevalence, the quantification of nociceptive signals responsible for painful movements and individual responses could lead to better treatment and monitoring solutions. Changes in electrodermal activity (EDA) can be detected via changes in skin conductance (SC) and measured using finger electrodes on a wearable sensor, providing objective information for increased physiological stress response. RESULTS To provide EDA response preliminary data, this was recorded with healthy volunteers on an array of activities while receiving a noxious stimulus. This provides a defined scenario that can be utilised as protocol feasibility testing. Raw signal extraction, processing and statistical analysis was performed using mean SC values on all participant data. The application of the stimuli resulted in a significant average increase (p < 0.05) in mean SC in four out of five activities with significant gender differences (p < 0.05) in SC and self-reported pain scores and large effect sizes. Though EDA parameters are a promising tool for nociceptive response indicators, limitations including motion artifact sensitivities and lack of previous movement-based EDA published data result in restricted analysis understanding. Refined processing pipelines with signal decomposition tools could be utilised in a protocol that quantifies nociceptive response clinically meaningfully.
Collapse
|
27
|
Anmella G, Mas A, Sanabra M, Valenzuela-Pascual C, Valentí M, Pacchiarotti I, Benabarre A, Grande I, De Prisco M, Oliva V, Fico G, Giménez-Palomo A, Bastidas A, Agasi I, Young AH, Garriga M, Corponi F, Li BM, de Looff P, Vieta E, Hidalgo-Mazzei D. Electrodermal activity in bipolar disorder: Differences between mood episodes and clinical remission using a wearable device in a real-world clinical setting. J Affect Disord 2024; 345:43-50. [PMID: 37865347 DOI: 10.1016/j.jad.2023.10.125] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/10/2023] [Revised: 10/16/2023] [Accepted: 10/18/2023] [Indexed: 10/23/2023]
Abstract
BACKGROUND Bipolar disorder (BD) lacks objective measures for illness activity and treatment response. Electrodermal activity (EDA) is a quantitative measure of autonomic function, which is altered in manic and depressive episodes. We aimed to explore differences in EDA (1) inter-individually: between patients with BD on acute mood episodes, euthymic states and healthy controls (HC), and (2) intra-individually: longitudinally within patients during acute mood episodes of BD and after clinical remission. METHODS A longitudinal observational study. EDA was recorded using a research-grade wearable in patients with BD during acute manic and depressive episodes and at clinical remission. Euthymic BD patients and HC were recorded during a single session. We compared EDA parameters derived from the tonic (mean EDA, mEDA) and phasic components (EDA peaks per minute, pmEDA, and EDA peaks mean amplitude, pmaEDA). Inter- and intra-individual comparisons were computed respectively with ANOVA and paired t-tests. RESULTS 49 patients with BD (15 manic, 9 depressed, and 25 euthymic), and 19 HC were included. Patients with bipolar depression showed significantly reduced mEDA (p = 0.003) and pmEDA (p = 0.001), which increased to levels similar to euthymia or HC after clinical remission (mEDA, p = 0.011; pmEDA, p < 0.001; pmaEDA, p < 0.001). Manic patients showed no differences compared to euthymic patients and HCs, but a significant reduction of tonic and phasic EDA parameters after clinical remission (mEDA, p = 0.035; pmEDA, p = 0.004). LIMITATIONS Limited sample size, high inter-individual variability of EDA parameters, limited comparability to previous studies and non-adjustment for medication. CONCLUSION EDA ecological monitoring might provide several opportunities for early detection of depressive symptoms, and might aid at assessing early response to treatments in mania and bipolar depression.
Collapse
Affiliation(s)
- Gerard Anmella
- Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clínic de Barcelona, Barcelona, Catalonia, Spain; Bipolar and Depressive Disorders Unit, Digital Innovation Group, Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Catalonia, Spain; Biomedical Research Networking Centre Consortium on Mental Health (CIBERSAM), Instituto de Salud Carlos III, Madrid, Spain; Department of Medicine, School of Medicine and Health Sciences, Institute of Neurosciences (UBNeuro), University of Barcelona (UB), Barcelona, Catalonia, Spain.
| | - Ariadna Mas
- Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clínic de Barcelona, Barcelona, Catalonia, Spain; Bipolar and Depressive Disorders Unit, Digital Innovation Group, Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Catalonia, Spain; Biomedical Research Networking Centre Consortium on Mental Health (CIBERSAM), Instituto de Salud Carlos III, Madrid, Spain; Department of Medicine, School of Medicine and Health Sciences, Institute of Neurosciences (UBNeuro), University of Barcelona (UB), Barcelona, Catalonia, Spain
| | - Miriam Sanabra
- Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clínic de Barcelona, Barcelona, Catalonia, Spain; Bipolar and Depressive Disorders Unit, Digital Innovation Group, Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Catalonia, Spain; Biomedical Research Networking Centre Consortium on Mental Health (CIBERSAM), Instituto de Salud Carlos III, Madrid, Spain; Department of Medicine, School of Medicine and Health Sciences, Institute of Neurosciences (UBNeuro), University of Barcelona (UB), Barcelona, Catalonia, Spain
| | - Clàudia Valenzuela-Pascual
- Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clínic de Barcelona, Barcelona, Catalonia, Spain; Bipolar and Depressive Disorders Unit, Digital Innovation Group, Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Catalonia, Spain; Biomedical Research Networking Centre Consortium on Mental Health (CIBERSAM), Instituto de Salud Carlos III, Madrid, Spain; Department of Medicine, School of Medicine and Health Sciences, Institute of Neurosciences (UBNeuro), University of Barcelona (UB), Barcelona, Catalonia, Spain
| | - Marc Valentí
- Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clínic de Barcelona, Barcelona, Catalonia, Spain; Bipolar and Depressive Disorders Unit, Digital Innovation Group, Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Catalonia, Spain; Biomedical Research Networking Centre Consortium on Mental Health (CIBERSAM), Instituto de Salud Carlos III, Madrid, Spain; Department of Medicine, School of Medicine and Health Sciences, Institute of Neurosciences (UBNeuro), University of Barcelona (UB), Barcelona, Catalonia, Spain
| | - Isabella Pacchiarotti
- Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clínic de Barcelona, Barcelona, Catalonia, Spain; Bipolar and Depressive Disorders Unit, Digital Innovation Group, Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Catalonia, Spain; Biomedical Research Networking Centre Consortium on Mental Health (CIBERSAM), Instituto de Salud Carlos III, Madrid, Spain; Department of Medicine, School of Medicine and Health Sciences, Institute of Neurosciences (UBNeuro), University of Barcelona (UB), Barcelona, Catalonia, Spain
| | - Antoni Benabarre
- Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clínic de Barcelona, Barcelona, Catalonia, Spain; Bipolar and Depressive Disorders Unit, Digital Innovation Group, Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Catalonia, Spain; Biomedical Research Networking Centre Consortium on Mental Health (CIBERSAM), Instituto de Salud Carlos III, Madrid, Spain; Department of Medicine, School of Medicine and Health Sciences, Institute of Neurosciences (UBNeuro), University of Barcelona (UB), Barcelona, Catalonia, Spain
| | - Iria Grande
- Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clínic de Barcelona, Barcelona, Catalonia, Spain; Bipolar and Depressive Disorders Unit, Digital Innovation Group, Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Catalonia, Spain; Biomedical Research Networking Centre Consortium on Mental Health (CIBERSAM), Instituto de Salud Carlos III, Madrid, Spain; Department of Medicine, School of Medicine and Health Sciences, Institute of Neurosciences (UBNeuro), University of Barcelona (UB), Barcelona, Catalonia, Spain
| | - Michele De Prisco
- Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clínic de Barcelona, Barcelona, Catalonia, Spain; Bipolar and Depressive Disorders Unit, Digital Innovation Group, Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Catalonia, Spain; Biomedical Research Networking Centre Consortium on Mental Health (CIBERSAM), Instituto de Salud Carlos III, Madrid, Spain; Department of Medicine, School of Medicine and Health Sciences, Institute of Neurosciences (UBNeuro), University of Barcelona (UB), Barcelona, Catalonia, Spain
| | - Vincenzo Oliva
- Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clínic de Barcelona, Barcelona, Catalonia, Spain; Bipolar and Depressive Disorders Unit, Digital Innovation Group, Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Catalonia, Spain; Biomedical Research Networking Centre Consortium on Mental Health (CIBERSAM), Instituto de Salud Carlos III, Madrid, Spain; Department of Medicine, School of Medicine and Health Sciences, Institute of Neurosciences (UBNeuro), University of Barcelona (UB), Barcelona, Catalonia, Spain; Department of Biomedical and Neuromotor Sciences, University of Bologna, Bologna, Italy
| | - Giovanna Fico
- Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clínic de Barcelona, Barcelona, Catalonia, Spain; Bipolar and Depressive Disorders Unit, Digital Innovation Group, Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Catalonia, Spain; Biomedical Research Networking Centre Consortium on Mental Health (CIBERSAM), Instituto de Salud Carlos III, Madrid, Spain; Department of Medicine, School of Medicine and Health Sciences, Institute of Neurosciences (UBNeuro), University of Barcelona (UB), Barcelona, Catalonia, Spain
| | - Anna Giménez-Palomo
- Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clínic de Barcelona, Barcelona, Catalonia, Spain; Bipolar and Depressive Disorders Unit, Digital Innovation Group, Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Catalonia, Spain; Biomedical Research Networking Centre Consortium on Mental Health (CIBERSAM), Instituto de Salud Carlos III, Madrid, Spain; Department of Medicine, School of Medicine and Health Sciences, Institute of Neurosciences (UBNeuro), University of Barcelona (UB), Barcelona, Catalonia, Spain
| | - Anna Bastidas
- Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clínic de Barcelona, Barcelona, Catalonia, Spain
| | - Isabel Agasi
- Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clínic de Barcelona, Barcelona, Catalonia, Spain
| | - Allan H Young
- Centre for Affective Disorders (CfAD), Institute of Psychiatry, Psychology and Neuroscience (IoPPN), King's College London, London, UK
| | - Marina Garriga
- Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clínic de Barcelona, Barcelona, Catalonia, Spain; Bipolar and Depressive Disorders Unit, Digital Innovation Group, Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Catalonia, Spain; Biomedical Research Networking Centre Consortium on Mental Health (CIBERSAM), Instituto de Salud Carlos III, Madrid, Spain; Department of Medicine, School of Medicine and Health Sciences, Institute of Neurosciences (UBNeuro), University of Barcelona (UB), Barcelona, Catalonia, Spain
| | | | - Bryan M Li
- School of informatics, University of Edinburgh, UK
| | - Peter de Looff
- Behavioural Science Institute, Radboud University, Nijmegen, the Netherlands; Fivoor, Science and Treatment Innovation, Expert centre "De Borg", Den Dolder, the Netherlands
| | - Eduard Vieta
- Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clínic de Barcelona, Barcelona, Catalonia, Spain; Bipolar and Depressive Disorders Unit, Digital Innovation Group, Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Catalonia, Spain; Biomedical Research Networking Centre Consortium on Mental Health (CIBERSAM), Instituto de Salud Carlos III, Madrid, Spain; Department of Medicine, School of Medicine and Health Sciences, Institute of Neurosciences (UBNeuro), University of Barcelona (UB), Barcelona, Catalonia, Spain
| | - Diego Hidalgo-Mazzei
- Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clínic de Barcelona, Barcelona, Catalonia, Spain; Bipolar and Depressive Disorders Unit, Digital Innovation Group, Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Catalonia, Spain; Biomedical Research Networking Centre Consortium on Mental Health (CIBERSAM), Instituto de Salud Carlos III, Madrid, Spain; Department of Medicine, School of Medicine and Health Sciences, Institute of Neurosciences (UBNeuro), University of Barcelona (UB), Barcelona, Catalonia, Spain; Department of Biomedical and Neuromotor Sciences, University of Bologna, Bologna, Italy.
| |
Collapse
|
28
|
Lu L, Xie Z, Wang H, Su B, Jung S, Xu X. Factors Affecting Workers' Mental Stress in Handover Activities During Human-Robot Collaboration. HUMAN FACTORS 2024:187208241226823. [PMID: 38215357 DOI: 10.1177/00187208241226823] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/14/2024]
Abstract
OBJECTIVE This study investigated the effects of different approach directions, movement speeds, and trajectories of a co-robot's end-effector on workers' mental stress during handover tasks. BACKGROUND Human-robot collaboration (HRC) is gaining attention in industry and academia. Understanding robot-related factors causing mental stress is crucial for designing collaborative tasks that minimize workers' stress. METHODS Mental stress in HRC tasks was measured subjectively through self-reports and objectively through galvanic skin response (GSR) and electromyography (EMG). Robot-related factors including approach direction, movement speed, and trajectory were analyzed. RESULTS Movement speed and approach direction had significant effects on subjective ratings, EMG, and GSR. High-speed and approaching from one side consistently resulted in higher fear, lower comfort, and predictability, as well as increased EMG and GSR signals, indicating higher mental stress. Movement trajectory affected GSR, with the sudden stop condition eliciting a stronger response compared to the constrained trajectory. Interaction effects between speed and approach direction were observed for "surprise" and "predictability" subjective ratings. At high speed, approach direction did not significantly differ, but at low speeds, approaching from the side was found to be more surprising and unpredictable compared to approaching from the front. CONCLUSION The mental stress of workers during HRC is lower when the robot's end effector (1) approaches a worker within the worker's field of view, (2) approaches at a lower speed, or (3) follows a constrained trajectory. APPLICATION The outcome of this study can serve as a guide to design HRC tasks with a low level of workers' mental stress.
Collapse
Affiliation(s)
- Lu Lu
- North Carolina State University, USA
| | | | | | - Bingyi Su
- North Carolina State University, USA
| | | | - Xu Xu
- North Carolina State University, USA
| |
Collapse
|
29
|
Šorli J, Lenasi H. The Effect of Acute Hyperglycaemia Induced by Oral Glucose Load on Heart Rate Variability and Skin Microvascular Reactivity in Young Adults. Life (Basel) 2023; 14:56. [PMID: 38255671 PMCID: PMC10817604 DOI: 10.3390/life14010056] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2023] [Revised: 12/22/2023] [Accepted: 12/26/2023] [Indexed: 01/24/2024] Open
Abstract
We aimed to elucidate the effects of acute hyperglycaemia, induced by an oral glucose tolerance test (OGTT), on the autonomic nervous system (ANS) and skin microvascular reactivity at the time point of peak plasma glucose concentration (cglc) in 20 young, healthy participants. We assessed their heart rate variability (HRV) as a measure of the ANS activity and the parameters of post-occlusive reactive hyperaemia (PORH) to estimate skin microvascular reactivity as measured by laser Doppler (LD) fluxmetry. The tests were repeated 30 min after a standard OGTT (75 g glucose dissolved in 250 mL water) and, in a separate control experiment, after drinking the same amount of water. Participants had their cglc and serum insulin measured at three consecutive time-points according to the testing protocol. The low-frequency (LF) spectral power, the LF to high-frequency (LF/HF) ratio, and the diastolic blood pressure increased significantly more after water than after OGTT, and there was a trend of the peak LD flux of PORH decreasing more after OGTT than after water. Significant correlations between some PORH and all the HRV parameters and cglc increase after OGTT were found, implying diminished vascular reactivity evoked by hyperglycaemia in healthy subjects with lower glucose tolerance.
Collapse
Affiliation(s)
- Jernej Šorli
- General Hospital Dr. Franc Derganc, 5290 Šempeter pri Gorici, Slovenia
| | - Helena Lenasi
- Institute of Physiology, Faculty of Medicine, University of Ljubljana, Zaloška 4, 1000 Ljubljana, Slovenia
| |
Collapse
|
30
|
Braun B, McDuff D, Baltrusaitis T, Holz C. Video-based sympathetic arousal assessment via peripheral blood flow estimation. BIOMEDICAL OPTICS EXPRESS 2023; 14:6607-6628. [PMID: 38420320 PMCID: PMC10898569 DOI: 10.1364/boe.507949] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/12/2023] [Revised: 10/27/2023] [Accepted: 10/27/2023] [Indexed: 03/02/2024]
Abstract
Electrodermal activity (EDA) is considered a standard marker of sympathetic activity. However, traditional EDA measurement requires electrodes in steady contact with the skin. Can sympathetic arousal be measured using only an optical sensor, such as an RGB camera? This paper presents a novel approach to infer sympathetic arousal by measuring the peripheral blood flow on the face or hand optically. We contribute a self-recorded dataset of 21 participants, comprising synchronized videos of participants' faces and palms and gold-standard EDA and photoplethysmography (PPG) signals. Our results show that we can measure peripheral sympathetic responses that closely correlate with the ground truth EDA. We obtain median correlations of 0.57 to 0.63 between our inferred signals and the ground truth EDA using only videos of the participants' palms or foreheads or PPG signals from the foreheads or fingers. We also show that sympathetic arousal is best inferred from the forehead, finger, or palm.
Collapse
Affiliation(s)
- Björn Braun
- Department of Computer Science, ETH Zürich, Switzerland
| | | | | | | |
Collapse
|
31
|
Pattyn E, Thammasan N, Lutin E, Tourolle D, Van Kraaij A, Kosunen I, De Raedt W, Van Hoof C. Simulation of ambulatory electrodermal activity and the handling of low-quality segments. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 242:107859. [PMID: 37863009 DOI: 10.1016/j.cmpb.2023.107859] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/08/2023] [Revised: 10/05/2023] [Accepted: 10/09/2023] [Indexed: 10/22/2023]
Abstract
BACKGROUND AND OBJECTIVES Monitoring electrodermal activity (EDA) in daily life requires effective handling of low-quality segments, which are common in ambulatory EDA data. Although several low-quality handling methods have been implemented, systematic comparison of these methods, which requires a large annotated dataset, is lacking. METHODS Therefore, we proposed the simulation of realistic ambulatory EDA data starting from high-quality EDA signals, which were subsequently contaminated with varying concentrations of artifacts. Subsequently, three approaches for handling low-quality data were evaluated regarding the preservation of several EDA-derived features: removing all artifacts, interpolating over removed artifacts, and retaining all artifacts. Specifically, multiple EDA features were assessed, derived from response detection (evaluated using F1, precision, recall) as well as EDA, phasic, and tonic features (assessed using absolute error), by comparing the simulated EDA data with and without the inserted artifacts, using the latter as ground truth. RESULTS For response detection, retaining artifacts resulted in the highest F1-scores, while interpolating over removed artifacts achieved the highest F1-scores for the phasic signal. The approaches did significantly differ in the mean error for the phasic but not for the tonic component and raw EDA. CONCLUSION This work generated ambulatory EDA datasets of 200 h, containing 0.125 to 3 artifacts per minute, and showed that interpolation over removed artifacts was an effective approach to reconstruct phasic-derived features up to 2 artifacts per minute. The proposed simulation and evaluation methodology, which are easily customizable, offer opportunities for future research to develop and systematically compare signal quality indicators, decomposition methods, and response detectors for processing ambulatory EDA.
Collapse
Affiliation(s)
- E Pattyn
- Department of Electrical Engineering, Elektronische Circuits en Systemen (ECS), KU Leuven, Leuven (Arenberg), Kasteelpark Arenberg 10 - bus 2443, Heverlee, Leuven 3001, Belgium; OnePlanet Research Center, Wageningen, The Netherlands.
| | | | - E Lutin
- Department of Electrical Engineering, Elektronische Circuits en Systemen (ECS), KU Leuven, Leuven (Arenberg), Kasteelpark Arenberg 10 - bus 2443, Heverlee, Leuven 3001, Belgium; OnePlanet Research Center, Wageningen, The Netherlands
| | | | | | | | - W De Raedt
- OnePlanet Research Center, Wageningen, The Netherlands
| | - C Van Hoof
- Department of Electrical Engineering, Elektronische Circuits en Systemen (ECS), KU Leuven, Leuven (Arenberg), Kasteelpark Arenberg 10 - bus 2443, Heverlee, Leuven 3001, Belgium; Imec Leuven, Leuven, Belgium; OnePlanet Research Center, Wageningen, The Netherlands
| |
Collapse
|
32
|
Cox OD, Munjal A, McCall WV, Miller BJ, Baeken C, Rosenquist PB. A review of clinical studies of electrodermal activity and transcranial magnetic stimulation. Psychiatry Res 2023; 329:115535. [PMID: 37839318 DOI: 10.1016/j.psychres.2023.115535] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/12/2023] [Revised: 10/01/2023] [Accepted: 10/07/2023] [Indexed: 10/17/2023]
Abstract
There is a growing body of evidence indicative of changes in autonomic nervous system (ANS) activity in patients with disorders of the central nervous system (CNS). Non-invasive measures of the ANS, including heart rate variability (HRV), electrodermal activity (EDA), and pupillary light reflex (PLR) may have value as markers of symptom severity, subtype, risk profile, and/or treatment response. In this paper we provide an introduction into the anatomy and physiology of EDA and review the literature published after 2007 in which EDA was an outcome measure of cortical stimulation with transcranial magnetic stimulation (TMS). Eleven studies were included and considered regarding the potential of EDA as an outcome measure reflecting ANS activity in TMS research and treatment. These studies are summarized according to study population, experimental methodology, cortical region targeted, and correlation with other measures of ANS activity. Results indicate that EDA changes vary with the frequency and target of TMS. Inhibitory TMS to the dorsolateral prefrontal cortex (dlPFC) was the most common paradigm in these studies, consistently resulting in decreased EDA.
Collapse
Affiliation(s)
- Olivia D Cox
- Department of Psychiatry and Health Behavior, Medical College of Georgia at Augusta University, Augusta, GA, USA.
| | - Ananya Munjal
- Department of Psychiatry and Health Behavior, Medical College of Georgia at Augusta University, Augusta, GA, USA
| | - William V McCall
- Department of Psychiatry and Health Behavior, Medical College of Georgia at Augusta University, Augusta, GA, USA
| | - Brian J Miller
- Department of Psychiatry and Health Behavior, Medical College of Georgia at Augusta University, Augusta, GA, USA
| | - Chris Baeken
- Ghent University, Faculty of Medicine and Health Sciences, Department of Head and Skin, Ghent Experimental Psychiatry (GHEP) lab, Ghent, Belgium; Vrije Universiteit Brussel (VUB), Department of Psychiatry, University Hospital (UZBrussel), Brussels, Belgium; Eindhoven University of Technology, Department of Electrical Engineering, Eindhoven, The Netherlands
| | - Peter B Rosenquist
- Department of Psychiatry and Health Behavior, Medical College of Georgia at Augusta University, Augusta, GA, USA
| |
Collapse
|
33
|
Ma J, Wu Y, Rong J, Zhao X. A systematic review on the influence factors, measurement, and effect of driver workload. ACCIDENT; ANALYSIS AND PREVENTION 2023; 192:107289. [PMID: 37696063 DOI: 10.1016/j.aap.2023.107289] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/04/2023] [Revised: 08/21/2023] [Accepted: 09/05/2023] [Indexed: 09/13/2023]
Abstract
Driver workload (DWL) is an important factor that needs to be considered in the study of traffic safety. The research focus on DWL has undergone certain shifts with the rapid development of scientific and technological advancements in the field of transportation in recent years. This study aims to grasp the state of research on DWL by both bibliometric analysis and individual critical literature review. The knowledge structure and development trend are described using bibliometric analysis. The knowledge mapping method is applied to mine the available literature in depth. It is discovered that one of the current research focus on DWL has shifted towards investigating its application in the field of autonomous driving. Subjective questionnaires and experimental tests (including both simulation technology and field study) are the main approaches to analyze DWL. An individual critical literature review of the influencing factors, measurement, and performance of DWL is provided. Research findings have shown that DWL was highly impacted by both intrinsic (e.g., age, temperament, driving experience) and external factors (e.g., vehicles, roads, tasks, environments). Scholars are actively exploring the combined effects of various factors and the level of vehicle automation on DWL. In addition to assess DWL by using subjective measures or physiological parameter measures separately, studies have started to improve classification accuracy by combining multiple measurement methods. Safety thresholds of DWL are not sufficiently studied due to the various interference items corresponding to different scenarios, but it is expected to quantify the DWL and find the threshold by establishing assessment models considering these intrinsic and external multiple-factors simultaneously. Driver or vehicle performance indicators are controversial to measure DWL directly, but they were suitable to reflect the impact of DWL in different driving conditions.
Collapse
Affiliation(s)
- Jun Ma
- Beijing Key Laboratory of Traffic Engineering, Beijing University of Technology, Beijing, China
| | - Yiping Wu
- Beijing Key Laboratory of Traffic Engineering, Beijing University of Technology, Beijing, China.
| | - Jian Rong
- School of Civil Engineering, Guangzhou University, Guangzhou, China
| | - Xiaohua Zhao
- Beijing Key Laboratory of Traffic Engineering, Beijing University of Technology, Beijing, China
| |
Collapse
|
34
|
Bari DS, Rammoo MNS, Aldosky HYY, Jaqsi MK, Martinsen ØG. The Five Basic Human Senses Evoke Electrodermal Activity. SENSORS (BASEL, SWITZERLAND) 2023; 23:8181. [PMID: 37837011 PMCID: PMC10575214 DOI: 10.3390/s23198181] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/04/2023] [Revised: 09/27/2023] [Accepted: 09/27/2023] [Indexed: 10/15/2023]
Abstract
Electrodermal activity (EDA) usually relates to variations in the electrical properties of palmar or plantar skin sites. EDA responses, namely skin conductance responses (SCRs), skin potential responses (SPRs) and skin susceptance responses (SSRs) are shown to be sensitive indexes of sympathetic nervous system activation and are studied in many research projects. However, the association between EDA responses and the five basic human senses has not been investigated yet. Our study aimed to explore the relationship between the three EDA responses (SCRs, SSRs and SPRs) and the five basic human senses. These three EDA responses were measured simultaneously at the same skin site on each of the 38 volunteers. The tested five senses were sight, hearing, touch, taste and smell. The results showed that the different tested senses led to different degrees of EDA responses due to activation of the sympathetic nervous system and corresponding secretion of sweat. Although a controlled study on the degree of EDA as a function of the strength of each stimulus was not performed, we noted that the largest EDA responses were typically associated with the smell sense test. We conclude that EDA responses could be utilized as measures for examining the sensitivity of the human senses. Hence, EDA devices may have important roles in sensory systems for future clinical applications.
Collapse
Affiliation(s)
- Dindar S. Bari
- Department of Physics, Faculty of Science, University of Zakho, Zakho 42002, Kurdistan Region, Iraq; (D.S.B.); (M.N.S.R.)
| | - Mohammed Noor S. Rammoo
- Department of Physics, Faculty of Science, University of Zakho, Zakho 42002, Kurdistan Region, Iraq; (D.S.B.); (M.N.S.R.)
| | - Haval Y. Y. Aldosky
- Department of Physics, College of Science, University of Duhok, Duhok 99454, Kurdistan Region, Iraq;
| | - Mohammed K. Jaqsi
- Department of Physics, Faculty of Science, University of Zakho, Zakho 42002, Kurdistan Region, Iraq; (D.S.B.); (M.N.S.R.)
| | - Ørjan G. Martinsen
- Department of Clinical and Biomedical Engineering, Oslo University Hospital, 0424 Oslo, Norway
- Department of Physics, University of Oslo, Sem Sælands vei 24, 0371 Oslo, Norway
| |
Collapse
|
35
|
Žnidarič M, Škrinjar D, Kapel A. Electrodermal activity and heart rate variability for detection of peripheral abnormalities in type 2 diabetes: A review. BIOMOLECULES & BIOMEDICINE 2023; 23:740-751. [PMID: 36803545 PMCID: PMC10494848 DOI: 10.17305/bb.2022.8561] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/28/2022] [Revised: 02/12/2023] [Accepted: 02/12/2023] [Indexed: 02/18/2023]
Abstract
Modern medicine exhibits an upward trend towards non-invasive methods for early detection of disease and long-term monitoring of patients' health. Diabetes mellitus and its complications are a promising area for implementation of new medical diagnostic devices. One of the most serious complications of diabetes is diabetic foot ulcer. The main causes responsible for diabetic foot ulcer are ischemia caused by peripheral artery disease and diabetic neuropathy caused by polyol pathway-induced oxidative stress. Autonomic neuropathy impairs function of sweat glands, which can be measured by electrodermal activity. On the other hand, autonomic neuropathy leads to changes in heart rate variability, which is used to assess autonomic regulation of the sinoatrial node. Both methods are enough sensitive to detect pathological changes caused by autonomic neuropathy and are promising screening methods for early diagnosis of diabetic neuropathy, which could prevent the onset of diabetic ulcer.
Collapse
Affiliation(s)
- Matej Žnidarič
- Faculty of Medicine, University of Maribor, Maribor, Slovenia
| | | | - Alen Kapel
- Faculty of Health and Social Sciences, Slovenj Gradec, Slovenia
- Alma Mater Europaea, Maribor, Slovenia
- Modus Medical, Maribor, Slovenia
| |
Collapse
|
36
|
Pinzon-Arenas JO, Kong Y, Chon KH, Posada-Quintero HF. Design and Evaluation of Deep Learning Models for Continuous Acute Pain Detection Based on Phasic Electrodermal Activity. IEEE J Biomed Health Inform 2023; 27:4250-4260. [PMID: 37399159 DOI: 10.1109/jbhi.2023.3291955] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/05/2023]
Abstract
The current method for assessing pain in clinical practice is subjective and relies on self-reported scales. An objective and accurate method of pain assessment is needed for physicians to prescribe the proper medication dosage, which could reduce addiction to opioids. Hence, many works have used electrodermal activity (EDA) as a suitable signal for detecting pain. Previous studies have used machine learning and deep learning to detect pain responses, but none have used a sequence-to-sequence deep learning approach to continuously detect acute pain from EDA signals, as well as accurate detection of pain onset. In this study, we evaluated deep learning models including 1-dimensional convolutional neural networks (1D-CNN), long short-term memory networks (LSTM), and three hybrid CNN-LSTM architectures for continuous pain detection using phasic EDA features. We used a database consisting of 36 healthy volunteers who underwent pain stimuli induced by a thermal grill. We extracted the phasic component, phasic drivers, and time-frequency spectrum of the phasic EDA (TFS-phEDA), which was found to be the most discerning physiomarker. The best model was a parallel hybrid architecture of a temporal convolutional neural network and a stacked bi-directional and uni-directional LSTM, which obtained a F1-score of 77.8% and was able to correctly detect pain in 15-second signals. The model was evaluated using 37 independent subjects from the BioVid Heat Pain Database and outperformed other approaches in recognizing higher pain levels compared to baseline with an accuracy of 91.5%. The results show the feasibility of continuous pain detection using deep learning and EDA.
Collapse
|
37
|
Ouyang Y, Liu M, Cheng C, Yang Y, He S, Zheng L. Monitoring Inattention in Construction Workers Caused by Physical Fatigue Using Electrocardiograph (ECG) and Galvanic Skin Response (GSR) Sensors. SENSORS (BASEL, SWITZERLAND) 2023; 23:7405. [PMID: 37687860 PMCID: PMC10490619 DOI: 10.3390/s23177405] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/24/2023] [Revised: 08/17/2023] [Accepted: 08/21/2023] [Indexed: 09/10/2023]
Abstract
Physical fatigue is frequent for heavy manual laborers like construction workers, but it causes distraction and may lead to safety incidents. The purpose of this study is to develop predictive models for monitoring construction workers' inattention caused by physical fatigue utilizing electrocardiograph (ECG) and galvanic skin response (GSR) sensors. Thirty participants were invited to complete an attention-demanding task under non-fatigued and physically fatigued conditions. Supervised learning algorithms were utilized to develop models predicting their attentional states, with heart rate variability (HRV) features derived from ECG signals and skin electric activity features derived from GSR signals as data inputs. The results demonstrate that using HRV features alone could obtain a prediction accuracy of 88.33%, and using GSR features alone could achieve an accuracy of 76.67%, both through the KNN algorithm. The accuracy increased to 96.67% through the SVM algorithm when combining HRV and GSR features. The findings indicate that ECG sensors used alone or in combination with GSR sensors can be applied to monitor construction workers' inattention on job sites. The findings would provide an approach for detecting distracted workers at job sites. Additionally, it might reveal the relationships between workers' physiological features and attention.
Collapse
Affiliation(s)
- Yewei Ouyang
- Department of Architecture and Civil Engineering, City University of Hong Kong, Kowloon, Hong Kong, China
| | - Ming Liu
- Key Laboratory of Physical Fitness and Exercise Rehabilitation of Hunan Province, College of Physical Education, Hunan Normal University, Changsha 410012, China
| | - Cheng Cheng
- Key Laboratory of Physical Fitness and Exercise Rehabilitation of Hunan Province, College of Physical Education, Hunan Normal University, Changsha 410012, China
| | - Yuchen Yang
- Key Laboratory of Physical Fitness and Exercise Rehabilitation of Hunan Province, College of Physical Education, Hunan Normal University, Changsha 410012, China
| | - Shiyi He
- Key Laboratory of Physical Fitness and Exercise Rehabilitation of Hunan Province, College of Physical Education, Hunan Normal University, Changsha 410012, China
| | - Lan Zheng
- Key Laboratory of Physical Fitness and Exercise Rehabilitation of Hunan Province, College of Physical Education, Hunan Normal University, Changsha 410012, China
| |
Collapse
|
38
|
Beermann M, Sieben A. The connection between stress, density, and speed in crowds. Sci Rep 2023; 13:13626. [PMID: 37604897 PMCID: PMC10442413 DOI: 10.1038/s41598-023-39006-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2023] [Accepted: 07/18/2023] [Indexed: 08/23/2023] Open
Abstract
Moving around in crowds is part of our daily lives, and we are used to the associated restriction of mobility. Nevertheless, little is known about how individuals experience these limitations. Such knowledge would, however, help to predict behavior, assess crowding, and improve measures for safety and comfort. To address this research gap, we conducted two studies on how constrained mobility affects physiological arousal as measured by mobile electrodermal activity (EDA) sensors. In study 1, we constrained walking speed by externally imposing a specific walking speed without physical proximity to another person, while, in study 2, we varied walking speed by increasing the number of people in a given area. In study 1, we confirmed previous findings showing that faster speeds led to statistically significantly higher levels of physiological arousal. The external limitations of walking speed, however, even if perceived as uncomfortable, did not increase physiological arousal. In the second study, subjects' speed was gradually reduced by density in a single-lane experiment. This study shows that physiological arousal increased statistically significant with increasing density and decreasing speed, suggesting that people experience more stress when their movement is restricted by proximity to others. The result of study 2 is even more significant given the results of study 1: When there are no other people around, arousal increases with walking speed due to the physiology of walking. This effect reverses when the speed must be reduced due to other people. Then the arousal increases at lower speeds.
Collapse
Affiliation(s)
- Mira Beermann
- Fakultät für Sozialwissenschaft, Lehrstuhl für Sozialtheorie und Sozialpsychologie, Ruhr-Universität Bochum, Universitätsstr. 150, Gebäude GD E1.259, Postfach 78, 44801, Bochum, Germany.
| | - Anna Sieben
- Fakultät für Sozialwissenschaft, Lehrstuhl für Sozialtheorie und Sozialpsychologie, Ruhr-Universität Bochum, Universitätsstr. 150, Gebäude GD E1.259, Postfach 78, 44801, Bochum, Germany.
- Civil Safety Research (IAS-7), Institute for Advanced Simulation, Forschungszentrum Jülich GmbH, Wilhelm-Johnen-Straße, 52425, Jülich, Germany.
- Department Psychology, School of Humanities and Social Sciences, Universität St Gallen, Dufourstrasse 50, 9000, St. Gallen, Schweiz.
| |
Collapse
|
39
|
Singaram S, Ramakrishnan K, Periyasamy S. Electrodermal signal analysis using continuous wavelet transform as a tool for quantification of sweat gland activity in diabetic kidney disease. Proc Inst Mech Eng H 2023; 237:919-927. [PMID: 37401150 DOI: 10.1177/09544119231184113] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/05/2023]
Abstract
Sympathetic innervation of the sweat gland (SG) manifests itself electrically as electrodermal activity (EDA), which can be utilized to measure sudomotor function. Since SG exhibits similarities in structure and function with kidneys, quantification of SG activity is attempted through EDA signals. A methodology is developed with electrical stimulation, sampling frequency and signal processing algorithm. One hundred twenty volunteers participated in this study belonging to controls, diabetes, diabetic nephropathy, and diabetic neuropathy. The magnitude and time duration of stimuli is arrived by trial and error in such a way it does not influence controls but triggers SG activity in other Groups. This methodology leads to a distinct EDA signal pattern with changes in frequency and amplitude. The continuous wavelet transform depicts a scalogram to retrieve this information. Further, to distinguish between Groups, time average spectrums are plotted and mean relative energy (MRE) is computed. Results demonstrate high energy value in controls, and it gradually decreases in other Groups indicating a decline in SG activity on diabetes prognosis. The correlation for the acquired results was determined to be 0.99 when compared to the standard lab procedure. Furthermore, Cohen's d value, which is less than 0.25 for all Groups indicating the minimal effect size. Hence the obtained result is validated and statistically analyzed for individual variations. Thus this has the potential to get transformed into a device and could prevent diabetic kidney disease.
Collapse
Affiliation(s)
- Sudha Singaram
- Department of Biomedical Engineering, Rajalakshmi Engineering College, Chennai, India
| | - Kalpana Ramakrishnan
- Department of Biomedical Engineering, Rajalakshmi Engineering College, Chennai, India
| | | |
Collapse
|
40
|
Mazza A, Cariola M, Capiotto F, Diano M, Schintu S, Pia L, Dal Monte O. Hedonic and autonomic responses in promoting affective touch. Sci Rep 2023; 13:11201. [PMID: 37433850 DOI: 10.1038/s41598-023-37471-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2023] [Accepted: 06/22/2023] [Indexed: 07/13/2023] Open
Abstract
Interpersonal touch is intrinsically reciprocal since it entails a person promoting and another receiving the touch. While several studies have investigated the beneficial effects of receiving affective touch, the affective experience of caressing another individual remains largely unknown. Here, we investigated the hedonic and autonomic responses (skin conductance and heart rate) in the person promoting affective touch. We also examined whether interpersonal relationship, gender, and eye contact modulate these responses. As expected, caressing the partner was perceived as more pleasant than caressing a stranger, especially if the affective touch occurred together with mutual eye contact. Promoting affective touch to the partner also resulted in a decrease of both autonomic responses and anxiety levels, suggesting the occurrence of a calming effect. Additionally, these effects were more pronounced in females compared to males, indicating that hedonic and autonomic aspects of affective touch are modulated by both social relationship and gender. These findings show for the first time that caressing a beloved one is not only pleasant but also reduces autonomic responses and anxiety in the person promoting the touch. This might suggest that affective touch has an instrumental role for romantic partners in promoting and reinforcing their affective bonding.
Collapse
Affiliation(s)
- Alessandro Mazza
- Department of Psychology, University of Turin, Via Verdi 10, Turin, Italy
| | - Monia Cariola
- Department of Psychology, University of Turin, Via Verdi 10, Turin, Italy
| | - Francesca Capiotto
- Department of Psychology, University of Turin, Via Verdi 10, Turin, Italy
| | - Matteo Diano
- Department of Psychology, University of Turin, Via Verdi 10, Turin, Italy
| | - Selene Schintu
- Center for Mind/Brain Sciences-CIMeC, University of Trento, Rovereto, Italy
- Department of Psychology, The George Washington University, Washington, DC, USA
| | - Lorenzo Pia
- Department of Psychology, University of Turin, Via Verdi 10, Turin, Italy
| | - Olga Dal Monte
- Department of Psychology, University of Turin, Via Verdi 10, Turin, Italy.
- Department of Psychology, Yale University, New Haven, CT, USA.
| |
Collapse
|
41
|
Aziz S, Khan MU, Hirachan N, Chetty G, Goecke R, Fernandez-Rojas R. "Where does it hurt?": Exploring EDA Signals to Detect and Localise Acute Pain. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2023; 2023:1-5. [PMID: 38083346 DOI: 10.1109/embc40787.2023.10341157] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2023]
Abstract
Pain is a highly unpleasant sensory experience, for which currently no objective diagnostic test exists to measure it. Identification and localisation of pain, where the subject is unable to communicate, is a key step in enhancing therapeutic outcomes. Numerous studies have been conducted to categorise pain, but no reliable conclusion has been achieved. This is the first study that aims to show a strict relation between Electrodermal Activity (EDA) signal features and the presence of pain and to clarify the relation of classified signals to the location of the pain. For that purpose, EDA signals were recorded from 28 healthy subjects by inducing electrical pain at two anatomical locations (hand and forearm) of each subject. The EDA data were preprocessed with a Discrete Wavelet Transform to remove any irrelevant information. Chi-square feature selection was used to select features extracted from three domains: time, frequency, and cepstrum. The final feature vector was fed to a pool of classification schemes where an Artificial Neural Network classifier performed best. The proposed method, evaluated through leave-one-subject-out cross-validation, provided 90% accuracy in pain detection (no pain vs. pain), whereas the pain localisation experiment (hand pain vs. forearm pain) achieved 66.67% accuracy.Clinical relevance- This is the first study to provide an analysis of EDA signals in finding the source of the pain. This research explores the viability of using EDA for pain localisation, which may be helpful in the treatment of noncommunicable patients.
Collapse
|
42
|
Ishaque S, Khan N, Krishnan S. Physiological Signal Analysis and Stress Classification from VR Simulations Using Decision Tree Methods. Bioengineering (Basel) 2023; 10:766. [PMID: 37508793 PMCID: PMC10376313 DOI: 10.3390/bioengineering10070766] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2023] [Revised: 05/31/2023] [Accepted: 06/14/2023] [Indexed: 07/30/2023] Open
Abstract
Stress is induced in response to any mental, physical or emotional change associated with our daily experiences. While short term stress can be quite beneficial, prolonged stress is detrimental to the heart, muscle tissues and immune system. In order to be proactive against these symptoms, it is important to assess the impact of stress due to various activities, which is initially determined through the change in the sympathetic (SNS) and parasympathetic (PNS) nervous systems. After acquiring physiological data wirelessly through captive electrocardiogram (ECG), galvanic skin response (GSR) and respiration (RESP) sensors, 21 time, frequency, nonlinear, GSR and respiration features were manually extracted from 15 subjects ensuing a baseline phase, virtual reality (VR) roller coaster simulation, color Stroop task and VR Bubble Bloom game. This paper presents a comprehensive physiological analysis of stress from an experiment involving a VR video game Bubble Bloom to manage stress levels. A personalized classification and regression tree (CART) model was developed using a novel Gini index algorithm in order to effectively classify binary classes of stress. A novel K-means feature was derived from 11 other features and used as an input in the Decision Tree (DT) algorithm, strong learners Ensemble Gradient Boosting (EGB) and Extreme Gradient Boosting (XGBoost (XGB)) embedded in a pipeline to classify 5 classes of stress. Results obtained indicate that heart rate (HR), approximate entropy (ApEN), low frequency and high frequency ratio (LF/HF), low frequency (LF), standard deviation (SD1), GSR and RESP all reduced and high frequency (HF) increased following the VR Bubble Bloom game phase. The personalized CART model was able to classify binary stress with 87.75% accuracy. It proved to be more effective than other related studies. EGB was able to classify binary stress with 100% accuracy, which outperformed every other related study. XGBoost and DT were able to classify five classes of stress with 72.22% using the novel K-means feature. This feature produced less error and better model performance in comparison to using all the features. Results substantiate that our proposed methods were more effective for stress classification than most related studies.
Collapse
Affiliation(s)
- Syem Ishaque
- Department of Electrical, Computer and Biomedical Engineering, Toronto Metropolitan University, Toronto, ON M5B 2K3, Canada
| | - Naimul Khan
- Department of Electrical, Computer and Biomedical Engineering, Toronto Metropolitan University, Toronto, ON M5B 2K3, Canada
| | - Sridhar Krishnan
- Department of Electrical, Computer and Biomedical Engineering, Toronto Metropolitan University, Toronto, ON M5B 2K3, Canada
| |
Collapse
|
43
|
Cittadini R, Tamantini C, Scotto di Luzio F, Lauretti C, Zollo L, Cordella F. Affective state estimation based on Russell's model and physiological measurements. Sci Rep 2023; 13:9786. [PMID: 37328550 PMCID: PMC10275929 DOI: 10.1038/s41598-023-36915-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2021] [Accepted: 06/12/2023] [Indexed: 06/18/2023] Open
Abstract
Affective states are psycho-physiological constructs connecting mental and physiological processes. They can be represented in terms of arousal and valence according to the Russel's model and can be extracted from physiological changes in human body. However, a well-established optimal feature set and a classification method effective in terms of accuracy and estimation time are not present in the literature. This paper aims at defining a reliable and efficient approach for real-time affective state estimation. To obtain this, the optimal physiological feature set and the most effective machine learning algorithm, to cope with binary as well as multi-class classification problems, were identified. ReliefF feature selection algorithm was implemented to define a reduced optimal feature set. Supervised learning algorithms, such as K-Nearest Neighbors (KNN), cubic and gaussian Support Vector Machine, and Linear Discriminant Analysis, were implemented to compare their effectiveness in affective state estimation. The developed approach was tested on physiological signals acquired on 20 healthy volunteers during the administration of images, belonging to the International Affective Picture System, conceived for inducing different affective states. ReliefF algorithm reduced the number of physiological features from 23 to 13. The performances of machine learning algorithms were compared and the experimental results showed that both accuracy and estimation time benefited from the optimal feature set use. Furthermore, the KNN algorithm resulted to be the most suitable for affective state estimation. The results of the assessment of arousal and valence states on 20 participants indicate that KNN classifier, adopted with the 13 identified optimal features, is the most effective approach for real-time affective state estimation.
Collapse
Affiliation(s)
- Roberto Cittadini
- Research Unit of Advanced Robotics and Human-Centred Technologies, Department of Engineering, Università Campus Bio-Medico di Roma, Rome, Italy.
| | - Christian Tamantini
- Research Unit of Advanced Robotics and Human-Centred Technologies, Department of Engineering, Università Campus Bio-Medico di Roma, Rome, Italy
| | - Francesco Scotto di Luzio
- Research Unit of Advanced Robotics and Human-Centred Technologies, Department of Engineering, Università Campus Bio-Medico di Roma, Rome, Italy
| | - Clemente Lauretti
- Research Unit of Advanced Robotics and Human-Centred Technologies, Department of Engineering, Università Campus Bio-Medico di Roma, Rome, Italy
| | - Loredana Zollo
- Research Unit of Advanced Robotics and Human-Centred Technologies, Department of Engineering, Università Campus Bio-Medico di Roma, Rome, Italy
| | - Francesca Cordella
- Research Unit of Advanced Robotics and Human-Centred Technologies, Department of Engineering, Università Campus Bio-Medico di Roma, Rome, Italy
| |
Collapse
|
44
|
Xie X, Cai J, Fang H, Wang B, He H, Zhou Y, Xiao Y, Yamanaka T, Li X. Affective Impressions Recognition under Different Colored Lights Based on Physiological Signals and Subjective Evaluation Method. SENSORS (BASEL, SWITZERLAND) 2023; 23:s23115322. [PMID: 37300049 DOI: 10.3390/s23115322] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/15/2023] [Revised: 05/22/2023] [Accepted: 05/25/2023] [Indexed: 06/12/2023]
Abstract
The design of the light environment plays a critical role in the interaction between people and visual objects in space. Adjusting the space's light environment to regulate emotional experience is more practical for the observers under lighting conditions. Although lighting plays a vital role in spatial design, the effects of colored lights on individuals' emotional experiences are still unclear. This study combined physiological signal (galvanic skin response (GSR) and electrocardiography (ECG)) measurements and subjective assessments to detect the changes in the mood states of observers under four sets of lighting conditions (green, blue, red, and yellow). At the same time, two sets of abstract and realistic images were designed to discuss the relationship between light and visual objects and their influence on individuals' impressions. The results showed that different light colors significantly affected mood, with red light having the most substantial emotional arousal, then blue and green. In addition, GSR and ECG measurements were significantly correlated with impressions evaluation results of interest, comprehension, imagination, and feelings in subjective evaluation. Therefore, this study explores the feasibility of combining the measurement of GSR and ECG signals with subjective evaluations as an experimental method of light, mood, and impressions, which provided empirical evidence for regulating individuals' emotional experiences.
Collapse
Affiliation(s)
- Xing Xie
- School of Art and Design, Guangdong University of Technology, Guangzhou 510000, China
| | - Jun Cai
- School of Art and Design, Guangdong University of Technology, Guangzhou 510000, China
- Academy of Arts and Design, Tsinghua University, Beijing 100086, China
| | - Hai Fang
- School of Art and Design, Guangdong University of Technology, Guangzhou 510000, China
| | - Beibei Wang
- Guangdong Provincial Key Laboratory of Nanophotonic Functional Materials and Devices, School of Information and Optoelectronic Science and Engineering, South China Normal University, Guangzhou 510006, China
| | - Huan He
- Guangdong Provincial Key Laboratory of Nanophotonic Functional Materials and Devices, School of Information and Optoelectronic Science and Engineering, South China Normal University, Guangzhou 510006, China
| | - Yuanzhi Zhou
- Guangdong Provincial Key Laboratory of Nanophotonic Functional Materials and Devices, School of Information and Optoelectronic Science and Engineering, South China Normal University, Guangzhou 510006, China
| | - Yang Xiao
- School of Physics and Telecommunication Engineering, South China Normal University, Guangzhou 510006, China
| | | | - Xinming Li
- Guangdong Provincial Key Laboratory of Nanophotonic Functional Materials and Devices, School of Information and Optoelectronic Science and Engineering, South China Normal University, Guangzhou 510006, China
| |
Collapse
|
45
|
Fernandez Rojas R, Brown N, Waddington G, Goecke R. A systematic review of neurophysiological sensing for the assessment of acute pain. NPJ Digit Med 2023; 6:76. [PMID: 37100924 PMCID: PMC10133304 DOI: 10.1038/s41746-023-00810-1] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2022] [Accepted: 03/30/2023] [Indexed: 04/28/2023] Open
Abstract
Pain is a complex and personal experience that presents diverse measurement challenges. Different sensing technologies can be used as a surrogate measure of pain to overcome these challenges. The objective of this review is to summarise and synthesise the published literature to: (a) identify relevant non-invasive physiological sensing technologies that can be used for the assessment of human pain, (b) describe the analytical tools used in artificial intelligence (AI) to decode pain data collected from sensing technologies, and (c) describe the main implications in the application of these technologies. A literature search was conducted in July 2022 to query PubMed, Web of Sciences, and Scopus. Papers published between January 2013 and July 2022 are considered. Forty-eight studies are included in this literature review. Two main sensing technologies (neurological and physiological) are identified in the literature. The sensing technologies and their modality (unimodal or multimodal) are presented. The literature provided numerous examples of how different analytical tools in AI have been applied to decode pain. This review identifies different non-invasive sensing technologies, their analytical tools, and the implications for their use. There are significant opportunities to leverage multimodal sensing and deep learning to improve accuracy of pain monitoring systems. This review also identifies the need for analyses and datasets that explore the inclusion of neural and physiological information together. Finally, challenges and opportunities for designing better systems for pain assessment are also presented.
Collapse
Affiliation(s)
- Raul Fernandez Rojas
- Human-Centred Technology Research Centre, Faculty of Science and Technology, University of Canberra, Canberra, ACT, Australia.
| | - Nicholas Brown
- Faculty of Health, Queensland University of Technology, Brisbane, QLD, Australia
| | - Gordon Waddington
- Australian Institute of Sport, Canberra, ACT, Australia
- University of Canberra Research Institute for Sport and Exercise (UCRISE), University of Canberra, Canberra, ACT, Australia
| | - Roland Goecke
- Human-Centred Technology Research Centre, Faculty of Science and Technology, University of Canberra, Canberra, ACT, Australia
| |
Collapse
|
46
|
Campanella S, Altaleb A, Belli A, Pierleoni P, Palma L. A Method for Stress Detection Using Empatica E4 Bracelet and Machine-Learning Techniques. SENSORS (BASEL, SWITZERLAND) 2023; 23:3565. [PMID: 37050625 PMCID: PMC10098696 DOI: 10.3390/s23073565] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/28/2023] [Revised: 03/18/2023] [Accepted: 03/28/2023] [Indexed: 06/19/2023]
Abstract
In response to challenging circumstances, the human body can experience marked levels of anxiety and distress. To prevent stress-related complications, timely identification of stress symptoms is crucial, necessitating the need for continuous stress monitoring. Wearable devices offer a means of real-time and ongoing data collection, facilitating personalized stress monitoring. Based on our protocol for data pre-processing, this study proposes to analyze signals obtained from the Empatica E4 bracelet using machine-learning algorithms (Random Forest, SVM, and Logistic Regression) to determine the efficacy of the abovementioned techniques in differentiating between stressful and non-stressful situations. Photoplethysmographic and electrodermal activity signals were collected from 29 subjects to extract 27 features which were then fed into three different machine-learning algorithms for binary classification. Using MATLAB after applying the chi-square test and Pearson's correlation coefficient on WEKA for features' importance ranking, the results demonstrated that the Random Forest model has the highest stability (accuracy of 76.5%) using all the features. Moreover, the Random Forest applying the chi-test for feature selection reached consistent results in terms of stress evaluation based on precision, recall, and F1-measure (71%, 60%, 65%, respectively).
Collapse
|
47
|
Kong Y, Posada-Quintero HF, Tran H, Talati A, Acquista TJ, Chen IP, Chon KH. Differentiating between stress- and EPT-induced electrodermal activity during dental examination. Comput Biol Med 2023; 155:106695. [PMID: 36805230 PMCID: PMC10062482 DOI: 10.1016/j.compbiomed.2023.106695] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2022] [Revised: 12/20/2022] [Accepted: 02/14/2023] [Indexed: 02/17/2023]
Abstract
Dental pain invokes the sympathetic nervous system, which can be measured by electrodermal activity (EDA). In the dental clinic, accurate quantification of pain is needed because it could enable optimized drug-dose treatments, thereby potentially reducing drug addiction. However, a confounding factor is that during pain there is also lingering residual stress, hence, both contribute to the EDA response. Therefore, we investigated whether EDA can differentiate stress from pain during dental examination. The use of electrical pulp test (EPT) is an ideal approach to tease out the dynamics of stress and mimic pain with lingering residual stress. Once the electrical sensation is felt and reaches a critical current threshold, the subject removes the probe from their tooth, hence, this stage of data represents largely EPT stimulus and the residual stress-induced EDA response is smaller. EPT was performed on necrotic and vital teeth in fifty-one subjects. We defined four different data groups of reactions based on each individual's EPT intensity level expectation based on the visual analog scale (VAS) of their baseline trial, as follows: mild stress, mild stress + EPT, strong stress, and strong stress + EPT. EDA-derived features exhibited significant difference between residual lingering stress + EPT groups and stress groups. We obtained 84.6% accuracy with 76.2% sensitivity and 86.8% specificity with multilayer perceptron in differentiating between pure-stress groups vs. stress + EPT groups. Moreover, EPT induced much greater EDA amplitude and faster response than stress. Our finding suggests that our machine learning approach can discriminate between stress and EPT stimulation in EDA signals.
Collapse
Affiliation(s)
- Youngsun Kong
- Biomedical Engineering, University of Connecticut, Storrs, CT, 06269, USA.
| | | | - Hanh Tran
- Department of Oral Health and Diagnostic Sciences, University of Connecticut Health, Farmington, CT, 06032, USA
| | - Ankur Talati
- Department of Oral Health and Diagnostic Sciences, University of Connecticut Health, Farmington, CT, 06032, USA
| | - Thomas J Acquista
- Biomedical Engineering, University of Connecticut, Storrs, CT, 06269, USA
| | - I-Ping Chen
- Department of Oral Health and Diagnostic Sciences, University of Connecticut Health, Farmington, CT, 06032, USA
| | - Ki H Chon
- Biomedical Engineering, University of Connecticut, Storrs, CT, 06269, USA
| |
Collapse
|
48
|
Bouhdana I, Charland P, Foisy LMB, Lapierre HG, Léger PM, Allaire-Duquette G, Potvin P, Masson S, Riopel M, Mahhou MA. Effects of reading contextualized physics problems among men and women: A psychophysiological approach. Trends Neurosci Educ 2023; 30:100199. [PMID: 36925268 DOI: 10.1016/j.tine.2023.100199] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2022] [Revised: 01/18/2023] [Accepted: 01/19/2023] [Indexed: 01/25/2023]
Abstract
To counteract declining interest in science, contextualizing course material has been suggested, despite little evidence supporting this strategy. We assessed how reading physics problems in different contexts-none, technical, or humanistic-impacted performance and implicit cognitive and affective situational interest (SI) among undergraduate men and women (n = 60). We hypothesized that contextualized problems would increase cognitive SI, boosting performance. We also investigated existing hypotheses that this influence would be stronger when contexts matched stereotypical gender interests. Pupillometric and electroencephalographic data served to indicate cognitive SI, while electrodermal activity (EDA) and valence were measures of affective SI. Significantly higher valence was observed in decontextualized than humanistic problems (p = 0.003) specifically among men (p < 0.001). Greater EDA (p = 0.019) and decontextualized problems (p < 0.001) yielded greater performance than contextualized problems for all participants. Results emphasize the importance of affective SI and of avoiding gender biases in curricular development. This study encourages caution if implementing contextualization.
Collapse
Affiliation(s)
- Isaac Bouhdana
- Département de didactique, Université du Québec à Montréal, CP 8888, Succursale Centre-Ville Montréal, QC, H3C 3P8, Canada; Faculty of Science, McGill University, 845 Sherbrooke St W, Montreal, Quebec, H3A 0G4, Canada
| | - Patrick Charland
- Département de didactique, Université du Québec à Montréal, CP 8888, Succursale Centre-Ville Montréal, QC, H3C 3P8, Canada; UNESCO Chair for Curriculum Development, Université du Québec à Montréal, CP 8888, Succursale Centre-Ville Montréal, QC, H3C 3P8, Canada.
| | - Lorie-Marlène Brault Foisy
- Département de didactique, Université du Québec à Montréal, CP 8888, Succursale Centre-Ville Montréal, QC, H3C 3P8, Canada; Laboratoire de recherche en neuroéducation, Université du Québec à Montréal, CP 8888, Succursale Centre-Ville Montréal, QC, H3C 3P8, Canada
| | - Hugo G Lapierre
- Département de didactique, Université du Québec à Montréal, CP 8888, Succursale Centre-Ville Montréal, QC, H3C 3P8, Canada
| | - Pierre-Majorique Léger
- Department of Information Technologies, HEC Montréal, 3000 Chemin de la Côte-Sainte-Catherine, Montréal, QC, H3T 2A7, Canada
| | - Geneviève Allaire-Duquette
- Laboratoire de recherche en neuroéducation, Université du Québec à Montréal, CP 8888, Succursale Centre-Ville Montréal, QC, H3C 3P8, Canada
| | - Patrice Potvin
- Département de didactique, Université du Québec à Montréal, CP 8888, Succursale Centre-Ville Montréal, QC, H3C 3P8, Canada
| | - Steve Masson
- Département de didactique, Université du Québec à Montréal, CP 8888, Succursale Centre-Ville Montréal, QC, H3C 3P8, Canada; Laboratoire de recherche en neuroéducation, Université du Québec à Montréal, CP 8888, Succursale Centre-Ville Montréal, QC, H3C 3P8, Canada
| | - Martin Riopel
- Département de didactique, Université du Québec à Montréal, CP 8888, Succursale Centre-Ville Montréal, QC, H3C 3P8, Canada
| | - Mohamed Amine Mahhou
- Département de didactique, Université du Québec à Montréal, CP 8888, Succursale Centre-Ville Montréal, QC, H3C 3P8, Canada
| |
Collapse
|
49
|
Neuroendocrine and psychophysiological investigation of the evolutionary roots of gossip. Sci Rep 2023; 13:3117. [PMID: 36813906 PMCID: PMC9946955 DOI: 10.1038/s41598-023-30126-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2022] [Accepted: 02/16/2023] [Indexed: 02/24/2023] Open
Abstract
This study investigates an evolutionary hypothesis of gossip postulating that in humans it serves a similar function as social grooming in other primates. It examines whether gossip decreases physiological markers of stress and increases markers of positive emotionality and sociability. Dyads of friends (N = 66) recruited at the university, participated in an experiment where they experienced a stressor followed by social interaction (gossip or control task). Individual levels of salivary cortisol and [Formula: see text]-endorphins were assessed at before and after social interactions. Sympathetic activity and parasympathetic activity were monitored throughout the experiment. Individual differences in Tendency and Attitude towards Gossip were investigated as potential covariates. Gossip condition was characterized with increased sympathetic and parasympathetic activity, but did not differ in cortisol or [Formula: see text]-endorphins levels. However, high Tendency to Gossip was associated with decreases in cortisol. Gossip was shown to be more emotionally salient than non-social talk, but the evidence with regard to lowering stress was not sufficient to support an analogy to social grooming.
Collapse
|
50
|
Golzari K, Kong Y, Reed SA, Posada-Quintero HF. Sympathetic Arousal Detection in Horses Using Electrodermal Activity. Animals (Basel) 2023; 13:ani13020229. [PMID: 36670768 PMCID: PMC9855141 DOI: 10.3390/ani13020229] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2022] [Revised: 01/04/2023] [Accepted: 01/05/2023] [Indexed: 01/10/2023] Open
Abstract
The continuous monitoring of stress, pain, and discomfort is key to providing a good quality of life for horses. The available tools based on observation are subjective and do not allow continuous monitoring. Given the link between emotions and sympathetic autonomic arousal, heart rate and heart rate variability are widely used for the non-invasive assessment of stress and pain in humans and horses. However, recent advances in pain and stress monitoring are increasingly using electrodermal activity (EDA), as it is a more sensitive and specific measure of sympathetic arousal than heart rate variability. In this study, for the first time, we have collected EDA signals from horses and tested the feasibility of the technique for the assessment of sympathetic arousal. Fifteen horses (six geldings, nine mares, aged 13.11 ± 5.4 years) underwent a long-lasting stimulus (Feeding test) and a short-lasting stimulus (umbrella Startle test) to elicit sympathetic arousal. The protocol was approved by the University of Connecticut. We found that EDA was sensitive to both stimuli. Our results show that EDA can capture sympathetic activation in horses and is a promising tool for non-invasive continuous monitoring of stress, pain, and discomfort in horses.
Collapse
Affiliation(s)
- Kia Golzari
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT 06269, USA
| | - Youngsun Kong
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT 06269, USA
| | - Sarah A. Reed
- Department of Animal Science, University of Connecticut, Storrs, CT 06269, USA
| | - Hugo F. Posada-Quintero
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT 06269, USA
- Correspondence: ; Tel.: +1-(860)-486-1556
| |
Collapse
|