Emotion Recognition in Patients With Parkinson Disease

A Music Emotion Classification Model Based on the Improved Convolutional Neural Network

Aiming at the problems of music emotion classification, a music emotion recognition method based on the convolutional neural network is proposed. First, the mel-frequency cepstral coefficient (MFCC) and residual phase (RP) are weighted and combined to extract the audio low-level features of music, so as to improve the efficiency of data mining. Then, the spectrogram is input into the convolutional recurrent neural network (CRNN) to extract the time-domain features, frequency-domain features, and sequence features of audio. At the same time, the low-level features of audio are input into the bidirectional long short-term memory (Bi-LSTM) network to further obtain the sequence information of audio features. Finally, the two parts of features are fused and input into the softmax classification function with the center loss function to achieve the recognition of four music emotions. The experimental results based on the emotion music dataset show that the recognition accuracy of the proposed method is 92.06%, and the value of the loss function is about 0.98, both of which are better than other methods. The proposed method provides a new feasible idea for the development of music emotion recognition.

Effective Connectivity During Rest and Music Listening: An EEG Study on Parkinson's Disease

Music-based interventions seem to enhance motor, sensory and cognitive functions in Parkinson’s disease (PD), but the underlying action mechanisms are still largely unknown. This electroencephalography (EEG) study aimed to investigate the effective connectivity patterns characterizing PD in the resting state and during music listening. EEG recordings were obtained from fourteen non-demented PD patients and 12 healthy controls, at rest and while listening to three music tracks. Theta- and alpha-band power spectral density and multivariate partial directed coherence were computed. Power and connectivity measures were compared between patients and controls in the four conditions and in music vs. rest. Compared to controls, patients showed enhanced theta-band power and slightly enhanced alpha-band power, but markedly reduced theta- and alpha-band interactions among EEG channels, especially concerning the information received by the right central channel. EEG power differences were partially reduced by music listening, which induced power increases in controls but not in patients. Connectivity differences were slightly compensated by music, whose effects largely depended on the track. In PD, music enhanced the frontotemporal inter-hemispheric communication. Our findings suggest that PD is characterized by enhanced activity but reduced information flow within the EEG network, being only partially normalized by music. Nevertheless, music capability to facilitate inter-hemispheric communication might underlie its beneficial effects on PD pathophysiology and should be further investigated.

Automated Computer Vision Assessment of Hypomimia in Parkinson Disease: Proof-of-Principle Pilot Study

BACKGROUND

Facial expressions require the complex coordination of 43 different facial muscles. Parkinson disease (PD) affects facial musculature leading to "hypomimia" or "masked facies."

OBJECTIVE

We aimed to determine whether modern computer vision techniques can be applied to detect masked facies and quantify drug states in PD.

METHODS

We trained a convolutional neural network on images extracted from videos of 107 self-identified people with PD, along with 1595 videos of controls, in order to detect PD hypomimia cues. This trained model was applied to clinical interviews of 35 PD patients in their on and off drug motor states, and seven journalist interviews of the actor Alan Alda obtained before and after he was diagnosed with PD.

RESULTS

The algorithm achieved a test set area under the receiver operating characteristic curve of 0.71 on 54 subjects to detect PD hypomimia, compared to a value of 0.75 for trained neurologists using the United Parkinson Disease Rating Scale-III Facial Expression score. Additionally, the model accuracy to classify the on and off drug states in the clinical samples was 63% (22/35), in contrast to an accuracy of 46% (16/35) when using clinical rater scores. Finally, each of Alan Alda's seven interviews were successfully classified as occurring before (versus after) his diagnosis, with 100% accuracy (7/7).

CONCLUSIONS

This proof-of-principle pilot study demonstrated that computer vision holds promise as a valuable tool for PD hypomimia and for monitoring a patient's motor state in an objective and noninvasive way, particularly given the increasing importance of telemedicine.