Using music as a signal for biofeedback

Designing Ecological Auditory Feedback on Lower Limb Kinematics for Hemiparetic Gait Training

Auditory feedback has earlier been explored as a tool to enhance patient awareness of gait kinematics during rehabilitation. In this study, we devised and tested a novel set of concurrent feedback paradigms on swing phase kinematics in hemiparetic gait training. We adopted a user-centered design approach, where kinematic data recorded from 15 hemiparetic patients was used to design three feedback algorithms (wading sounds, abstract, musical) based on filtered gyroscopic data from four inexpensive wireless inertial units. The algorithms were tested (hands-on) by a focus group of five physiotherapists. They recommended that the abstract and musical algorithms be discarded due to sound quality and informational ambiguity. After modifying the wading algorithm (as per their feedback), we conducted a feasibility test involving nine hemiparetic patients and seven physiotherapists, where variants of the algorithm were applied to a conventional overground training session. Most patients found the feedback meaningful, enjoyable to use, natural-sounding, and tolerable for the typical training duration. Three patients exhibited immediate improvements in gait quality when the feedback was applied. However, minor gait asymmetries were found to be difficult to perceive in the feedback, and there was variability in receptiveness and motor change among the patients. We believe that our findings can advance current research in inertial sensor-based auditory feedback for motor learning enhancement during neurorehabilitation.

Comparing heart rate variability biofeedback and simple paced breathing to inform the design of guided breathing technologies

Introduction

A goal of inbodied interaction is to explore how tools can be designed to provide external interactions that support our internal processes. One process that often suffers from our external interactions with modern computing technology is our breathing. Because of the ergonomics and low-grade-but-frequent stress associated with computer work, many people adopt a short, shallow breathing pattern that is known to have a negative effect on other parts of our physiology. Breathing guides are tools that help people match their breathing patterns to an external (most often visual) cue to practice healthy breathing exercises.However, there are two leading protocols for how breathing cues are offered by breathing guides used in non-clinical settings: simple paced breathing (SPB) and Heart Rate Variability Biofeedback (HRV-b). Although these protocols have separately been demonstrated to be effective, they differ substantially in their complexity and design. Paced breathing is a simpler protocol where a user is asked to match their breathing pattern with a cue paced at a predetermined rate and is simple enough to be completed as a secondary task during other activities. HRV-b, on the other hand, provides adaptive, real-time guidance derived from heart rate variability, a physiological signal that can be sensed through a wearable device. Although the benefits of these two protocols have been well established in clinical contexts, designers of guided breathing technology have little information about whether one is better than the other for non-clinical use.

Methods

To address this important gap in knowledge, we conducted the first comparative study of these two leading protocols in the context of end-user applications. In our N=28 between-subject design, participants were trained in either SPB or HRV-b and then completed a 10-minute session following their training protocol. Breathing rates and heart rate variability scores were recorded and compared between groups.

Results and discussion

Our findings indicate that the exercises did not significantly differ in their immediate outcomes – both resulted in significantly slower breathing rates than their baseline and both provided similar relative increases in HRV. Therefore, there were no observed differences in the acute physiological effects when using either SPB or HRV-b. Our paper contributes new findings suggesting that simple paced breathing – a straightforward, intuitive, and easy-to-design breathing exercise – provides the same immediate benefits as HRV-b, but without its added design complexities.

An Embodied Sonification Model for Sit-to-Stand Transfers

Interactive sonification of biomechanical quantities is gaining relevance as a motor learning aid in movement rehabilitation, as well as a monitoring tool. However, existing gaps in sonification research (issues related to meaning, aesthetics, and clinical effects) have prevented its widespread recognition and adoption in such applications. The incorporation of embodied principles and musical structures in sonification design has gradually become popular, particularly in applications related to human movement. In this study, we propose a general sonification model for the sit-to-stand (STS) transfer, an important activity of daily living. The model contains a fixed component independent of the use-case, which represents the rising motion of the body as an ascending melody using the physical model of a flute. In addition, a flexible component concurrently sonifies STS features of clinical interest in a particular rehabilitative/monitoring situation. Here, we chose to represent shank angular jerk and movement stoppages (freezes), through perceptually salient pitch modulations and bell sounds. We outline the details of our technical implementation of the model. We evaluated the model by means of a listening test experiment with 25 healthy participants, who were asked to identify six normal and simulated impaired STS patterns from sonified versions containing various combinations of the constituent mappings of the model. Overall, we found that the participants were able to classify the patterns accurately (86.67 ± 14.69% correct responses with the full model, 71.56% overall), confidently (64.95 ± 16.52% self-reported rating), and in a timely manner (response time: 4.28 ± 1.52 s). The amount of sonified kinematic information significantly impacted classification accuracy. The six STS patterns were also classified with significantly different accuracy depending on their kinematic characteristics. Learning effects were seen in the form of increased accuracy and confidence with repeated exposure to the sound sequences. We found no significant accuracy differences based on the participants' level of music training. Overall, we see our model as a concrete conceptual and technical starting point for STS sonification design catering to rehabilitative and clinical monitoring applications.

Efficacy of bio- and neurofeedback for depression: a meta-analysis

BACKGROUND

For many years, biofeedback and neurofeedback have been implemented in the treatment of depression. However, the effectiveness of these techniques on depressive symptomatology is still controversial. Hence, we conducted a meta-analysis of studies extracted from PubMed, Scopus, Web of Science and Embase.

METHODS

Two different strings were considered for each of the two objectives of the study: A first group comprising studies patients with major depressive disorder (MDD) and a second group including studies targeting depressive symptomatology reduction in other mental or medical conditions.

RESULTS

In the first group of studies including patients with MDD, the within-group analyses yielded an effect size of Hedges' g = 0.717, while the between-group analysis an effect size of Hedges' g = 1.050. Moderator analyses indicate that treatment efficacy is only significant when accounting for experimental design, in favor of randomized controlled trials (RCTs) in comparison to non RCTs, whereas the type of neurofeedback, trial design, year of publication, number of sessions, age, sex and quality of study did not influence treatment efficacy. In the second group of studies, a small but significant effect between groups was found (Hedges' g = 0.303) in favor of bio- and neurofeedback against control groups. Moderator analyses revealed that treatment efficacy was not moderated by any of the sociodemographic and clinical variables.

CONCLUSIONS

Heart rate variability (HRV) biofeedback and neurofeedback are associated with a reduction in self-reported depression. Despite the fact that the field has still a large room for improvement in terms of research quality, the results presented in this study suggests that both modalities may become relevant complementary strategies for the treatment of MDD and depressive symptomatology in the coming years.

Musical Auditory Alpha Wave Neurofeedback: Validation and Cognitive Perspectives

Neurofeedback through visual, auditory, or tactile sensations improves cognitive functions and alters the activities of daily living. However, some people, such as children and the elderly, have difficulty concentrating on neurofeedback for a long time. Constant stressless neurofeedback for a long time may be achieved with auditory neurofeedback using music. The primary purpose of this study was to clarify whether music-based auditory neurofeedback increases the power of the alpha wave in healthy subjects. During neurofeedback, white noise was superimposed on classical music, with the noise level inversely correlating with normalized alpha wave power. This was a single-blind, randomized control crossover trial in which 10 healthy subjects underwent, in an assigned order, normal and random feedback (NF and RF), either of which was at least 4 weeks long. Cognitive functions were evaluated before, between, and after each neurofeedback period. The secondary purpose was to assess neurofeedback-induced changes in cognitive functions. A crossover analysis showed that normalized alpha-power was significantly higher in NF than in RF; therefore, music-based auditory neurofeedback facilitated alpha wave induction. A composite category-based analysis of cognitive functions revealed greater improvements in short-term memory in subjects whose alpha-power increased in response to NF. The present study employed a long period of auditory alpha neurofeedback and achieved successful alpha wave induction and subsequent improvements in cognitive functions. Although this was a pilot study that validated a music-based alpha neurofeedback system for healthy subjects, the results obtained are encouraging for those with difficulty in concentrating on conventional alpha neurofeedback.

Trial registration: 2018077NI, date of registration: 2018/11/27

A Breathing Sonification System to Reduce Stress During the COVID-19 Pandemic

Since sound and music are powerful forces and drivers of human behavior and physiology, we propose the use of sonification to activate healthy breathing patterns in participants to induce relaxation. Sonification is often used in the context of biofeedback as it can represent an informational, non-invasive and real-time stimulus to monitor, motivate or modify human behavior. The first goal of this study is the proposal and evaluation of a distance-based biofeedback system using a tempo- and phase-aligned sonification strategy to adapt breathing patterns and induce states of relaxation. A second goal is the evaluation of several sonification stimuli on 18 participants that were recruited online and of which we analyzed psychometric and behavioral data using, respectively questionnaires and respiration rate and ratio. Sonification stimuli consisted of filtered noise mimicking a breathing sound, nature environmental sounds and a musical phrase. Preliminary results indicated the nature stimulus as most pleasant and as leading to the most prominent decrease of respiration rate. The noise sonification had the most beneficial effect on respiration ratio. While further research is needed to generalize these findings, this study and its methodological underpinnings suggest the potential of the proposed biofeedback system to perform ecologically valid experiments at participants' homes during the COVID-19 pandemic.

Towards Mindless Stress Regulation in Advanced Driver Assistance Systems: A Systematic Review

Background: Stress can frequently occur in the driving context. Its cognitive effects can be deleterious and lead to uncomfortable or risky situations. While stress detection in this context is well developed, regulation using dedicated advanced driver-assistance systems (ADAS) is still emergent. Objectives: This systematic review focuses on stress regulation strategies that can be qualified as "subtle" or "mindless": the technology employed to perform regulation does not interfere with an ongoing task. The review goal is 2-fold: establishing the state of the art on such technological implementation in the driving context and identifying complementary technologies relying on subtle regulation that could be applied in driving. Methods: A systematic review was conducted using search operators previously identified through a concept analysis. The patents and scientific studies selected provide an overview of actual and potential mindless technology implementations. These are then analyzed from a scientific perspective. A classification of results was performed according to the different stages of emotion regulation proposed by the Gross model. Results: A total of 47 publications were retrieved, including 21 patents and 26 studies. Six of the studies investigated mindless stress regulation in the driving context. Patents implemented strategies mostly linked to attentional deployment, while studies tended to investigate response modulation strategies. Conclusions: This review allowed us to identify several ADAS relying on mindless computing technologies to reduce stress and better understand the underlying mechanisms allowing stress reduction. Further studies are necessary to better grasp the effect of mindless technologies on driving safety. However, we have established the feasibility of their implementation as ADAS and proposed directions for future research in this field.

Respiration rate change induced by controlling the phasic relationship between melodic sound and respiration

It has been suggested that the phasic relationship between sound and respiration (PRSR) is important. However, the effect that the relationship has on respiration rate is rarely studied. Here, by using our invented interface, we have developed a method of systematically controlling the PRSR and show that the respiration rate can be changed by controlling the PRSR. In concrete, when realized error of PRSR is large, respiration rate significantly increased. Since the effect appears with participants listening passively to melodic sounds without any instruction, the result could be utilized as a tool for managing everyday stress.

The Encephalophone: A Novel Musical Biofeedback Device using Conscious Control of Electroencephalogram (EEG)

A novel musical instrument and biofeedback device was created using electroencephalogram (EEG) posterior dominant rhythm (PDR) or mu rhythm to control a synthesized piano, which we call the Encephalophone. Alpha-frequency (8–12 Hz) signal power from PDR in the visual cortex or from mu rhythm in the motor cortex was used to create a power scale which was then converted into a musical scale, which could be manipulated by the individual in real time. Subjects could then generate different notes of the scale by activation (event-related synchronization) or de-activation (event-related desynchronization) of the PDR or mu rhythms in visual or motor cortex, respectively. Fifteen novice normal subjects were tested in their ability to hit target notes presented within a 5-min trial period. All 15 subjects were able to perform more accurately (average of 27.4 hits, 67.1% accuracy for visual cortex/PDR signaling; average of 20.6 hits, 57.1% accuracy for mu signaling) than a random note generation (19.03% accuracy). Moreover, PDR control was significantly more accurate than mu control. This shows that novice healthy individuals can control music with better accuracy than random, with no prior training on the device, and that PDR control is more accurate than mu control for these novices. Individuals with more years of musical training showed a moderate positive correlation with more PDR accuracy, but not mu accuracy. The Encephalophone may have potential applications both as a novel musical instrument without requiring movement, as well as a potential therapeutic biofeedback device for patients suffering from motor deficits (e.g., amyotrophic lateral sclerosis (ALS), brainstem stroke, traumatic amputation).

3Mo: A Model for Music-Based Biofeedback

In the domain of sports and motor rehabilitation, it is of major importance to regulate and control physiological processes and physical motion in most optimal ways. For that purpose, real-time auditory feedback of physiological and physical information based on sound signals, often termed “sonification,” has been proven particularly useful. However, the use of music in biofeedback systems has been much less explored. In the current article, we assert that the use of music, and musical principles, can have a major added value, on top of mere sound signals, to the benefit of psychological and physical optimization of sports and motor rehabilitation tasks. In this article, we present the 3Mo model to describe three main functions of music that contribute to these benefits. These functions relate the power of music to Motivate, and to Monitor and Modify physiological and physical processes. The model brings together concepts and theories related to human sensorimotor interaction with music, and specifies the underlying psychological and physiological principles. This 3Mo model is intended to provide a conceptual framework that guides future research on musical biofeedback systems in the domain of sports and motor rehabilitation.

Influence of Music on Anxiety Induced by Fear of Heights in Virtual Reality

Music is a potent mood regulator that can induce relaxation and reduce anxiety in different situations. While several studies demonstrate that certain types of music have a subjective anxiolytic effect, the reported results from physiological responses are less conclusive. Virtual reality allows us to study diverse scenarios of real life under strict experimental control while preserving high ecological validity. We aimed to study the modulating effect of music on the anxiety responses triggered by an immersive virtual reality scenario designed to induce fear of heights. Subjects experienced a virtual scenario depicting an exterior elevator platform ascending and descending the total height of its 350 meters tall supporting structure. Participants were allocated to either a group that experienced the elevator ride with background music or without, in a between-groups design. Furthermore, each group included participants with different degrees of fear of heights, ranging from low to high fear. Recordings of heart rate, galvanic skin response, body balance, and head movements were obtained during the experiments. Subjective anxiety was measured by means of three questionnaires. The scenario produced significant changes in subjective and physiological measures, confirming its efficacy as a stressor. A significant increase in state anxiety was found between pre and post-assessment in the silence group, but not in the music group, indicating that post-stress recovery was faster in the musical group. Results suggest that music can ameliorate the subjective anxiety produced by fear of heights.