A case study of vocal features associated with galvanic skin response to stressors in a clinical interaction

What do these sounds tell us about the therapeutic alliance: Acoustic markers as predictors of alliance

Predicting the trajectories of alliance formation that the patient is likely to establish with the therapist during treatment, even before their first meeting, can help prevent the potentially harmful consequences of deterioration in alliance, such as poor outcome and premature dropout. The present study aimed to examine the ability of four pretreatment acoustic markers to predict the alliance that is likely to be formed in the course of treatment: F0 span, speech rate, pause proportion and jitter. Data from 560 observations of 38 patients were collected as part of an ongoing randomized clinical trial of short-term psychotherapy for major depressive disorder. The acoustic markers were measured using high-quality recordings at baseline, before the patient and therapist ever met or had any type of communication. A multilevel model was used to examine the ability of the four acoustic markers to predict the slopes of alliance formation in the course of treatment, all markers being introduced in the same model. The clinical utility of the acoustic markers was explored in two case studies. The model explained 22% of the variance in alliance formation. Higher levels of both jitter and pause proportion at baseline predicted less strengthening of the alliance in the course of treatment. The findings, which should be replicated in larger samples, suggest that much of the therapeutic alliance can be predicted based on the acoustic characteristics of the patient's voice in the first 3 min of their intake, before they even meet their therapist.

Analysis of Consciousness Level Using Galvanic Skin Response during Therapeutic Effect

The neurological status of patients in the Intensive Care Units (ICU) is determined by the Glasgow Coma Scale (GCS). Patients in coma are thought to be unaware of what is happening around them. However, many studies show that the family plays an important role in the recovery of the patient and is a great emotional resource. In this study, Galvanic Skin Response (GSR) signals were analyzed from 31 patients with low consciousness levels between GCS 3 and 8 to determine relationship between consciousness level and GSR signals as a new approach. The effect of family and nurse on unconscious patients was investigated by GSR signals recorded with a new proposed protocol. The signals were recorded during conversation and touching of the patient by the nurse and their families. According to numerical results, the level of consciousness can be separated using GSR signals. Also, it was found that family and nurse had statistically significant effects on the patient. Patients with GCS 3,4, and 5 were considered to have low level of consciousness, while patients with GCS 6,7, and 8 were considered to have high level of consciousness. According to our results, it is obtained lower GSR amplitude in low GCS (3, 4, 5) compared to high GCS (7, 8). It was concluded that these patients were aware of therapeutic affect although they were unconscious. During the classification stage of this study, the class imbalance problem, which is common in medical diagnosis, was solved using Synthetic Minority Over-Sampling Technique (SMOTE), Adaptive Synthetic Sampling (ADASYN) and random oversampling methods. In addition, level of consciousness was classified with 92.7% success using various decision tree algorithms. Random Forest was the method which provides higher accuracy compared to all other methods. The obtained results showed that GSR signal analysis recorded in different stages gives very successful GCS score classification performance according to literature studies.

Comparison of the Use of Blink Rate and Blink Rate Variability for Mental State Recognition

Recent research has unearthed that blink rate variability (BRV) can be employed as a psychophysiological measure. However, its efficiency for mental state recognition (MSR) has not been investigated yet. Because BRV can indicate dynamics inherent in eye blinks, we conjectured that BRV might exhibit stronger abilities for the MSR if compared with blink rate (BR), known as the leading indicator derived from eye blinks for MSR. Therefore, in this paper, we attempted to differentiate between high and low cognitive loads of an individual through the analyses of BR and BRV, respectively, which could be viewed as a preliminary study for comparing their MSR abilities. First, an n -back experiment was performed to collect data. Then, in order to characterize the phenomenon of BRV, the features were extracted from its time and frequency domains, respectively. Finally, the area under the curve (AUC) values of BRV and BR for MSR were estimated by the ten commonly used classifiers, respectively. The results indicated that BRV achieves significantly higher AUC values than BR, which suggests its strong potentiality for MSR. In sum, the BRV may prove to be a promising method for the MSR, which should be considered in the future.

Voice Stress Analysis: A New Framework for Voice and Effort in Human Performance

People rely on speech for communication, both in a personal and professional context, and often under different conditions of physical, cognitive and/or emotional load. Since vocalization is entirely integrated within both our central (CNS) and autonomic nervous system (ANS), a mounting number of studies have examined the relationship between voice output and the impact of stress. In the current paper, we will outline the different stages of voice output, i.e., breathing, phonation and resonance in relation to a neurovisceral integrated perspective on stress and human performance. In reviewing the function of these three stages of voice output, we will give an overview of the voice parameters encountered in studies on voice stress analysis (VSA) and review the impact of the different types of physiological, cognitive and/or emotional load. In the section "Discussion," with regard to physical load, a competition for ventilation processes required to speak and those to meet metabolic demand of exercised muscles is described. With regard to cognitive and emotional load, we will present the "Model for Voice and Effort" (MoVE) that comprises the integration of ongoing top-down and bottom-up activity under different types of load and combined patterns of voice output. In the MoVE, it is proposed that the fundamental frequency (F0) values as well as jitter give insight in bottom-up/arousal activity and the effort a subject is capable to generate but that its range and variance are related to ongoing top-down processes and the amount of control a subject can maintain. Within the MoVE, a key-role is given to the anterior cingulate cortex (ACC) which is known to be involved in both the equilibration between bottom-up arousal and top-down regulation and vocal activity. Moreover, the connectivity between the ACC and the nervus vagus (NV) is underlined as an indication of the importance of respiration. Since respiration is the driving force of both stress and voice production, it is hypothesized to be the missing-link in our understanding of the underlying mechanisms of the dynamic between speech and stress.

Verona Coding Definitions of Emotional Sequences (VR-CoDES): Conceptual framework and future directions

OBJECTIVE

To discuss the theoretical and empirical framework of VR-CoDES and potential future direction in research based on the coding system.

METHODS

The paper is based on selective review of papers relevant to the construction and application of VR-CoDES.

RESULTS

VR-CoDES system is rooted in patient-centered and biopsychosocial model of healthcare consultations and on a functional approach to emotion theory. According to the VR-CoDES, emotional interaction is studied in terms of sequences consisting of an eliciting event, an emotional expression by the patient and the immediate response by the clinician. The rationale for the emphasis on sequences, on detailed classification of cues and concerns, and on the choices of explicit vs. non-explicit responses and providing vs. reducing room for further disclosure, as basic categories of the clinician responses, is described.

CONCLUSIONS

Results from research on VR-CoDES may help raise awareness of emotional sequences. Future directions in applying VR-CoDES in research may include studies on predicting patient and clinician behavior within the consultation, qualitative analyses of longer sequences including several VR-CoDES triads, and studies of effects of emotional communication on health outcomes.

PRACTICE IMPLICATIONS

VR-CoDES may be applied to develop interventions to promote good handling of patients' emotions in healthcare encounters.

Acoustic Measures of Voice and Physiologic Measures of Autonomic Arousal during Speech as a Function of Cognitive Load

OBJECTIVES/HYPOTHESIS

This study aimed to determine the relationship among cognitive load condition and measures of autonomic arousal and voice production in healthy adults.

STUDY DESIGN

A prospective study design was conducted.

METHODS

Sixteen healthy young adults (eight men, eight women) produced a sentence containing an embedded Stroop task in each of two cognitive load conditions: congruent and incongruent. In both conditions, participants said the font color of the color words instead of the word text. In the incongruent condition, font color differed from the word text, creating an increase in cognitive load relative to the congruent condition in which font color and word text matched. Three physiologic measures of autonomic arousal (pulse volume amplitude, pulse period, and skin conductance response amplitude) and four acoustic measures of voice (sound pressure level, fundamental frequency, cepstral peak prominence, and low-to-high spectral energy ratio) were analyzed for eight sentence productions in each cognitive load condition per participant.

RESULTS

A logistic regression model was constructed to predict the cognitive load condition (congruent or incongruent) using subject as a categorical predictor and the three autonomic measures and four acoustic measures as continuous predictors. It revealed that skin conductance response amplitude, cepstral peak prominence, and low-to-high spectral energy ratio were significantly associated with cognitive load condition.

CONCLUSIONS

During speech produced under increased cognitive load, healthy young adults show changes in physiologic markers of heightened autonomic arousal and acoustic measures of voice quality. Future work is necessary to examine these measures in older adults and individuals with voice disorders.