Virtual faces as a tool to study emotion recognition deficits in schizophrenia

The role of the differential outcomes procedure and schizotypy in the recognition of dynamic facial expressions of emotions

Emotional facial expression recognition is a key ability for adequate social functioning. The current study aims to test if the differential outcomes procedure (DOP) may improve the recognition of dynamic facial expressions of emotions and to further explore whether schizotypal personality traits may have any effect on performance. 183 undergraduate students completed a task where a face morphed from a neutral expression to one of the six basic emotions at full intensity over 10 s. Participants had to press spacebar as soon as they identified the emotion and choose which had appeared. In the first block, participants received no outcomes. In the second block, a group received specific outcomes associated to each emotion (DOP group), while another group received non-differential outcomes after correctly responding (NOP group). Employing generalized linear models (GLMs) and Bayesian inference we estimated different parameters to answer our research goals. Schizotypal personality traits did not seem to affect dynamic emotional facial expression recognition. Participants of the DOP group were less likely to respond incorrectly to faces showing Fear and Surprise at fewer intensity levels. This may suggest that the DOP could lead to better identification of the main features that differentiate each facial expression of emotion.

Current development of biosensing technologies towards diagnosis of mental diseases

The biosensor is an instrument that converts the concentration of biomarkers into electrical signals for detection. Biosensing technology is non-invasive, lightweight, automated, and biocompatible in nature. These features have significantly advanced medical diagnosis, particularly in the diagnosis of mental disorder in recent years. The traditional method of diagnosing mental disorders is time-intensive, expensive, and subject to individual interpretation. It involves a combination of the clinical experience by the psychiatrist and the physical symptoms and self-reported scales provided by the patient. Biosensors on the other hand can objectively and continually detect disease states by monitoring abnormal data in biomarkers. Hence, this paper reviews the application of biosensors in the detection of mental diseases, and the diagnostic methods are divided into five sub-themes of biosensors based on vision, EEG signal, EOG signal, and multi-signal. A prospective application in clinical diagnosis is also discussed.

Dynamic Interactive Social Cognition Training in Virtual Reality (DiSCoVR) versus Virtual Reality Relaxation (VRelax) for People With a Psychotic Disorder: A Single-Blind Multicenter Randomized Controlled Trial

BACKGROUND AND HYPOTHESIS

Social cognition training (SCT), an intervention for social cognition and social functioning, might be improved by using virtual reality (VR), because VR may offer better opportunities to practice in a potentially more realistic environment. To date, no controlled studies have investigated VR-SCT. This study investigated a VR-SCT, "DiSCoVR". We hypothesized that DiSCoVR would improve social cognition and social functioning.

STUDY DESIGN

Participants were randomized to DiSCoVR (n = 41) or VR relaxation ('VRelax', n = 40), an active control condition, and completed 16 twice-weekly sessions. Three assessments (baseline, posttreatment, and 3-month follow-up) were performed by blinded assessors. The primary outcome was social cognition (emotion perception and theory of mind). Secondary outcomes included social functioning (measured with an interview and experience sampling), psychiatric symptoms, information processing, and self-esteem. Data were analyzed using mixed-models regression analysis. Treatment effects were evaluated by the time by condition interaction terms.

STUDY RESULTS

No significant time by condition interactions were found for any of the outcome variables, indicating an absence of treatment effects. Between-group effect sizes ranged from negligible to moderate (Cohen's d < |0.53|). Main effects of time were found for several outcomes.

CONCLUSIONS

These results suggest that DiSCoVR was not effective, possibly because of inadequate simulation of emotional expressions in VR. This lack of efficacy may indicate that current SCT protocols are relatively unsuitable for improving social functioning. Previous studies showed small to moderate effects on higher order social cognition, but the SCT approach may need critical reevaluation, as it may not sufficiently lead to functional improvement.

The Application of Artificial Neural Network Combined with Virtual Reality Technology in Environment Art Design

Virtual reality is a computer technology that produces a simulated environment. It is completely immersive and gives users the viewpoint that they are somewhere else. In recent times, it has become a highly interactive and visualization tool that has gained interest among educators and scholars. Art learning is a teaching-learning approach that is dependent on learning "through the arts" and "with the arts;" it can be a procedure in which art develops the medium of teaching-learning and an important model in some subjects of the curriculum. In this work, we develop a grey wolf optimization with the residual network form of virtual reality application for environmental art learning (GWORN-EAL) technique. It aims to provide metacognitive actions to improve environmental art learning for young children or adults. The GWORN-EAL technique is mainly based on the stimulation of particular features of the target painting over a default image. The color palette of the recognized image of the Fauve painter was mapped to the target image using the Fauve vision of the painter and represented by vivid colors. For optimal hyperparameter tuning of the ResNet model, the GWO algorithm is employed. The experimental results indicated that the GWORN-EAL technique has accomplished effectual outcomes in several aspects. A brief experimental study highlighted the improvement of the GWORN-EAL technique compared to existing models.

Error patterns of facial emotion recognition in patients with schizophrenia

Error patterns of facial emotion recognition (FER) indicate how individuals misinterpret others' facial expressions, which helps clinicians to manage related deficits. However, previous investigations are limited and may have been biased due to methodological issues (e.g., no consideration of response bias). This study aimed to propose a detectability index (d') for adjusting response bias and examine the error patterns of FER in patients with schizophrenia. Responses to 168 photos showing seven basic emotions, obtained from 351 patients with schizophrenia and 101 healthy adults, were extracted from a previous study. The differences in the d's between the two groups (Δd') were calculated to examine the error patterns of FER among the seven emotions. The findings were generally overlapped with those identified by the traditional confusion matrix. Four error patterns were found. First, the patients were insensitive to some negative emotions (i.e., sadness [Δd' = 0.83] and fear [Δd' = 0.72]). Second, they misrecognized happy faces as showing negative emotions (e.g., disgust [Δd' = 0.43] and sadness [Δd' = 0.37]). Third, they misinterpreted surprised faces as all the other emotions (Δd' = 0.41-0.87), except neutral. Fourth, they confused some negative emotions (e.g., misrecognizing fear as anger [Δd' = 0.87]). Our findings suggest that patients with schizophrenia show four error patterns of FER compared to healthy adults. Accordingly, interventions could be selected to improve their sensitivity to faces with negative emotions, differentiation of faces among positive and negative emotions, understanding of surprised faces, and discrimination of faces with negative emotions.

Virtual reality facial emotion recognition in social environments: An eye-tracking study

BACKGROUND

Virtual reality (VR) enables the administration of realistic and dynamic stimuli within a social context for the assessment and training of emotion recognition. We tested a novel VR emotion recognition task by comparing emotion recognition across a VR, video and photo task, investigating covariates of recognition and exploring visual attention in VR.

METHODS

Healthy individuals (n = 100) completed three emotion recognition tasks; a photo, video and VR task. During the VR task, emotions of virtual characters (avatars) in a VR street environment were rated, and eye-tracking was recorded in VR.

RESULTS

Recognition accuracy in VR (overall 75%) was comparable to the photo and video task. However, there were some differences; disgust and happiness had lower accuracy rates in VR, and better accuracy was achieved for surprise and anger in VR compared to the video task. Participants spent more time identifying disgust, fear and sadness than surprise and happiness. In general, attention was directed longer to the eye and nose areas than the mouth.

DISCUSSION

Immersive VR tasks can be used for training and assessment of emotion recognition. VR enables easily controllable avatars within environments relevant for daily life. Validated emotional expressions and tasks will be of relevance for clinical applications.

Dynamic human and avatar facial expressions elicit differential brain responses

Computer-generated characters, so-called avatars, are widely used in advertising, entertainment, human–computer interaction or as research tools to investigate human emotion perception. However, brain responses to avatar and human faces have scarcely been studied to date. As such, it remains unclear whether dynamic facial expressions of avatars evoke different brain responses than dynamic facial expressions of humans. In this study, we designed anthropomorphic avatars animated with motion tracking and tested whether the human brain processes fearful and neutral expressions in human and avatar faces differently. Our fMRI results showed that fearful human expressions evoked stronger responses than fearful avatar expressions in the ventral anterior and posterior cingulate gyrus, the anterior insula, the anterior and posterior superior temporal sulcus, and the inferior frontal gyrus. Fearful expressions in human and avatar faces evoked similar responses in the amygdala. We did not find different responses to neutral human and avatar expressions. Our results highlight differences, but also similarities in the processing of fearful human expressions and fearful avatar expressions even if they are designed to be highly anthropomorphic and animated with motion tracking. This has important consequences for research using dynamic avatars, especially when processes are investigated that involve cortical and subcortical regions.

Virtual reality-based assessment and treatment of social functioning impairments in psychosis: a systematic review

People with psychosis can experience social functioning impairments. Virtual reality (VR) has been used to assess and treat these difficulties. This systematic review (Prospero CRD42015026288) provides an evaluation of these VR applications. PsycINFO, MEDLINE, Embase, Web of Science, Cochrane Library, and Scopus were searched until May 2020. The Effective Public Health Practice Project (EPHPP) Quality Assessment Tool was used to assess studies. Database searching identified 3810 titles. Fifty-eight studies (published 2005-2020; N = 2,853), comprising twenty-six head-mounted display studies (20 assessment, 6 treatment) and thirty-two immersive 2D screen studies (23 assessment, 9 treatment), were included. There were forty-eight observational studies and ten randomised controlled trials, with 1570 participants (of which, 185 were at ultra-high risk of psychosis) in VR test groups. Nearly half the studies were published since 2016. Assessments targeted cognitive and behavioural indicators of social functioning, e.g. paranoia, eye gaze, or interpersonal distance. Treatments promoted cognitive-behavioural social skills or job interview training. Studies indicate feasibility, acceptability, and effectiveness of VR for social functioning impairments in psychosis. Limitations of studies include the narrow scope of social functioning, small sample sizes, and limited randomised controlled trials and standardised interventions. Findings suggest VR has potential to be integrated with existing psychological approaches.

Relationship between social cognition, general cognition, and risk for suicide in individuals with a psychotic disorder

OBJECTIVE

Cognitive alterations putatively contribute to the risk for suicide in individuals with psychosis. Yet, a comprehensive assessment of social- and general-cognitive abilities in a large sample is lacking.

METHODS

Seven-hundred-fifteen individuals diagnosed with a psychotic disorder performed tasks of facial emotion recognition, Theory of Mind, and general cognitive functioning (sustained attention, set-shifting, IQ-tests and verbal learning) as part of the Genetic-Risk-and-Outcome-of-Psychosis (GROUP) study. Presence of past suicide attempt/s and/or current suicidal ideation was reported by 261 individuals and 454 individuals reported no suicide attempt or ideation. We used general linear models to investigate group differences in task performance. All analysis were controlled for age, sex, education, and psychotic symptom severity.

RESULTS

Individuals with suicide attempt and/or ideation showed better performance on the facial emotion recognition task and lower performance on tasks of sustained attention and verbal learning, compared to individuals without suicide attempt and/or ideation, without a clear effect of attempt or ideation. Theory of Mind performance was also better for individuals with suicide attempt and/or ideation, with largest differences between individuals who reported both attempts and ideation compared to individuals without suicide attempt and/or ideation. No effect of suicide attempt and/or ideation was found on misperception of facial emotions, IQ and set-shifting. Overall, effect sizes were small.

CONCLUSION

Higher sensitivity to social-emotional cues together with weakened attentional control and learning capacity was observed in individuals with psychosis and suicide attempt and/or ideation. This may suggest that insufficient capacity for regulating perceived social stress contributes to suicidal thoughts and behavior.

Facial Affect Recognition by Patients with Schizophrenia Using Human Avatars

People with schizophrenia have difficulty recognizing the emotions in the facial expressions of others, which affects their social interaction and functioning in the community. Static stimuli such as photographs have been used traditionally to examine deficiencies in the recognition of emotions in patients with schizophrenia, which has been criticized by some authors for lacking the dynamism that real facial stimuli have. With the aim of overcoming these drawbacks, in recent years, the creation and validation of virtual humans has been developed. This work presents the results of a study that evaluated facial recognition of emotions through a new set of dynamic virtual humans previously designed by the research team, in patients diagnosed of schizophrenia. The study included 56 stable patients, compared with 56 healthy controls. Our results showed that patients with schizophrenia present a deficit in facial affect recognition, compared to healthy controls (average hit rate 71.6% for patients vs 90.0% for controls). Facial expressions with greater dynamism (compared to less dynamic ones), as well as those presented from frontal view (compared to profile view) were better recognized in both groups. Regarding clinical and sociodemographic variables, the number of hospitalizations throughout life did not correlate with recognition rates. There was also no correlation between functioning or quality of life and recognition. A trend showed a reduction in the emotional recognition rate as a result of increases in Positive and Negative Syndrome Scale (PANSS), being statistically significant for negative PANSS. Patients presented a learning effect during the progression of the task, slightly greater in comparison to the control group. This finding is relevant when designing training interventions for people with schizophrenia. Maintaining the attention of patients and getting them to improve in the proposed tasks is a challenge for today’s psychiatry.

Verification of using virtual reality to evaluate deficiencies in cognitive function among patients with schizophrenia in the remission stage: a cross-sectional study

BACKGROUND

Schizophrenia is associated with widespread cognitive impairment. The MATRICS Consensus Cognitive Battery (MCCB) is most frequently used to assess cognitive function. However, the MCCB test is time consuming for the clinician. Virtual reality (VR) has emerged as an adjunctive tool to overcome this limitation and provides a new means to assess cognitive function.

METHODS

The present study examined the validity and safety of using VR technology to assess cognitive function in Han Chinese patients with schizophrenia (SZs). The VR cognition training system (VRCTS) was used to simulate real-life supermarkets and assess cognitive function. Thirty-two SZs and 25 healthy controls (HCs) underwent VRCTS and MCCB assessments. An auxiliary diagnosis model was created based on the outcomes of the VRCTS to classify SZs and HCs by cognitive impairment.

RESULTS

Significant differences in completion time between the SZs and HCs were detected using the VRCTS. SZs spent more time completing tasks than HCs. The outcome of VRCTS significantly correlated with the MCCB. The auxiliary diagnosis model had a sensitivity of 88.89% and a specificity of 88.89%.

CONCLUSIONS

These results support the use of VR technology in the assessment of cognitive impairment in Han Chinese schizophrenia patients.

TRIAL REGISTRATION

China Clinical Trial Registry, ChiVTR1800016121. Registered 13 May 2018, http://www.chictr.org.cn/showproj.aspx?proj=27233.

Using virtual reality to explore differences in memory biases and cognitive insight in people with psychosis and healthy controls

Memory biases (e.g. overconfidence in false memories) are implicated in the pathogenesis of delusions. Virtual reality (VR) may provide an opportunity to observe such biases and improve cognitive insight in patients with psychosis via corrective feedback. Thirty-nine patients with psychosis and 20 healthy controls explored VR environments designed to elicit false memories and subsequently had to recollect items and faces. We used a randomised-controlled design where half of the sample received performance feedback on the recollection task in order to correct overconfidence. Changes in cognitive insight were measured using the Beck Cognitive Insight Scale. Regarding accuracy, patients performed worse on the social task (recollection of faces) only. Patients displayed overconfidence in false memories for emotions and gave more high-confident responses compared to healthy controls on the social task. Feedback did not improve cognitive insight. Patients rated their cognitive insight higher than healthy controls. Future research should address problems with subjective measurements for cognitive insight. To conclude, patients with psychosis showed impaired social cognition and there was evidence for impaired metacognition, as patients reported higher cognitive insight despite comparable or worse performance as well as overconfidence relative to controls.

Virtual reality in the assessment and treatment of psychosis: a systematic review of its utility, acceptability and effectiveness

Over the last two decades, there has been a rapid increase of studies testing the efficacy and acceptability of virtual reality in the assessment and treatment of mental health problems. This systematic review was carried out to investigate the use of virtual reality in the assessment and the treatment of psychosis. Web of Science, PsychInfo, EMBASE, Scopus, ProQuest and PubMed databases were searched, resulting in the identification of 638 articles potentially eligible for inclusion; of these, 50 studies were included in the review. The main fields of research in virtual reality and psychosis are: safety and acceptability of the technology; neurocognitive evaluation; functional capacity and performance evaluation; assessment of paranoid ideation and auditory hallucinations; and interventions. The studies reviewed indicate that virtual reality offers a valuable method of assessing the presence of symptoms in ecologically valid environments, with the potential to facilitate learning new emotional and behavioural responses. Virtual reality is a promising method to be used in the assessment of neurocognitive deficits and the study of relevant clinical symptoms. Furthermore, preliminary findings suggest that it can be applied to the delivery of cognitive rehabilitation, social skills training interventions and virtual reality-assisted therapies for psychosis. The potential benefits for enhancing treatment are highlighted. Recommendations for future research include demonstrating generalisability to real-life settings, examining potential negative effects, larger sample sizes and long-term follow-up studies. The present review has been registered in the PROSPERO register: CDR 4201507776.

Virtual Reality Objectifies the Diagnosis of Psychiatric Disorders: A Literature Review

BACKGROUND

To date, a diagnosis in psychiatry is largely based on a clinical interview and questionnaires. The retrospective and subjective nature of these methods leads to recall and interviewer biases. Therefore, there is a clear need for more objective and standardized assessment methods to support the diagnostic process. The introduction of virtual reality (VR) creates the possibility to simultaneously provoke and measure psychiatric symptoms. Therefore, VR could contribute to the objectivity and reliability in the assessment of psychiatric disorders.

OBJECTIVE

In this literature review, we will evaluate the assessment of psychiatric disorders by means of VR environments. First, we investigate if these VR environments are capable of simultaneously provoking and measuring psychiatric symptoms. Next, we compare these measures with traditional diagnostic measures.

METHODS

We performed a systematic search using PubMed, Embase, and Psycinfo; references of selected articles were checked for eligibility. We identified studies from 1990 to 2016 on VR used in the assessment of psychiatric disorders. Studies were excluded if VR was used for therapeutic purposes, if a different technique was used, or in case of limitation to a non-clinical sample.

RESULTS

A total of 39 studies were included for further analysis. The disorders most frequently studied included schizophrenia (n = 15), developmental disorders (n = 12), eating disorders (n = 3), and anxiety disorders (n = 6). In attention-deficit hyperactivity disorder, the most comprehensive measurement was used including several key symptoms of the disorder. Most of the studies, however, concerned the use of VR to assess a single aspect of a psychiatric disorder.

DISCUSSION

In general, nearly all VR environments studied were able to simultaneously provoke and measure psychiatric symptoms. Furthermore, in 14 studies, significant correlations were found between VR measures and traditional diagnostic measures. Relatively small clinical sample sizes were used, impeding definite conclusions. Based on this review, the innovative technique of VR shows potential to contribute to objectivity and reliability in the psychiatric diagnostic process.

Virtual Avatar for Emotion Recognition in Patients with Schizophrenia: A Pilot Study

Persons who suffer from schizophrenia have difficulties in recognizing emotions in others’ facial expressions, which affects their capabilities for social interaction and hinders their social integration. Photographic images have traditionally been used to explore emotion recognition impairments in schizophrenia patients, but they lack of the dynamism that is inherent to facial expressiveness. In order to overcome those inconveniences, over the last years different authors have proposed the use of virtual avatars. In this work, we present the results of a pilot study that explored the possibilities of using a realistic-looking avatar for the assessment of emotion recognition deficits in patients who suffer from schizophrenia. In the study, 20 subjects with schizophrenia of long evolution and 20 control subjects were invited to recognize a set of facial expressions of emotions showed by both the said virtual avatar and static images. Our results show that schizophrenic patients exhibit recognition deficits in emotion recognition from facial expressions regardless the type of stimuli (avatar or images), and that those deficits are related with the psychopathology. Finally, some improvements in recognition rates (RRs) for the patient group when using the avatar were observed for sadness or surprise expressions, and they even outperform the control group in the recognition of the happiness expression. This leads to conclude that, apart from the dynamism of the shown expression, the RRs for schizophrenia patients when employing animated avatars may depend on other factors which need to be further explored.

Design of a Virtual Reality System for Affect Analysis in Facial Expressions (VR-SAAFE); Application to Schizophrenia

Schizophrenia is a life-long, debilitating psychotic disorder with poor outcome that affects about 1% of the population. Although pharmacotherapy can alleviate some of the acute psychotic symptoms, residual social impairments present a significant barrier that prevents successful rehabilitation. With limited resources and access to social skills training opportunities, innovative technology has emerged as a potentially powerful tool for intervention. In this paper, we present a novel virtual reality (VR)-based system for understanding facial emotion processing impairments that may lead to poor social outcome in schizophrenia. We henceforth call it a VR System for Affect Analysis in Facial Expressions (VR-SAAFE). This system integrates a VR-based task presentation platform that can minutely control facial expressions of an avatar with or without accompanying verbal interaction, with an eye-tracker to quantitatively measure a participants real-time gaze and a set of physiological sensors to infer his/her affective states to allow in-depth understanding of the emotion recognition mechanism of patients with schizophrenia based on quantitative metrics. A usability study with 12 patients with schizophrenia and 12 healthy controls was conducted to examine processing of the emotional faces. Preliminary results indicated that there were significant differences in the way patients with schizophrenia processed and responded towards the emotional faces presented in the VR environment compared with healthy control participants. The preliminary results underscore the utility of such a VR-based system that enables precise and quantitative assessment of social skill deficits in patients with schizophrenia.

Neural Processing of Emotional Prosody across the Adult Lifespan

Emotion recognition deficits emerge with the increasing age, in particular, a decline in the identification of sadness. However, little is known about the age-related changes of emotion processing in sensory, affective, and executive brain areas. This functional magnetic resonance imaging (fMRI) study investigated neural correlates of auditory processing of prosody across adult lifespan. Unattended detection of emotional prosody changes was assessed in 21 young (age range: 18-35 years), 19 middle-aged (age range: 36-55 years), and 15 older (age range: 56-75 years) adults. Pseudowords uttered with neutral prosody were standards in an oddball paradigm with angry, sad, happy, and gender deviants (total 20% deviants). Changes in emotional prosody and voice gender elicited bilateral superior temporal gyri (STG) responses reflecting automatic encoding of prosody. At the right STG, responses to sad deviants decreased linearly with age, whereas happy events exhibited a nonlinear relationship. In contrast to behavioral data, no age by sex interaction emerged on the neural networks. The aging decline of emotion processing of prosodic cues emerges already at an early automatic stage of information processing at the level of the auditory cortex. However, top-down modulation may lead to an additional perceptional bias, for example, towards positive stimuli, and may depend on context factors such as the listener's sex.

Impairments in Negative Facial Emotion Recognition in Chinese Schizophrenia Patients Detected With a Newly Designed Task

Facial emotion recognition has been found to be impaired in schizophrenia, although overall results have been inconclusive. A new set of facial emotion stimuli with Chinese faces was developed, using static and dynamic avatars, the identification of which were subsequently validated in 562 healthy control subjects. This test was then used to identify facial emotion recognition accuracy in 44 patients with schizophrenia and 41 healthy controls. Overall, patients identified facial emotions significantly worse than healthy controls (p = 0.018) with a significant main effect for type of emotion (p = 0.016). Patients performed significantly worse in fear (p = 0.029) and sadness (p = 0.037), and marginally worse in anger (p = 0.052). No significant differences were evident in contempt (p = 0.254) or happiness (p = 0.943). Regarding error rates of misattribution, patients overidentified contempt (p = 0.035) and sadness (p = 0.01), but not anger, fear, or happiness. Conclusion, patients of Chinese ethnicity with schizophrenia may have significantly greater difficulties identifying negative, but not positive emotions.

Cognitive and neural strategies during control of the anterior cingulate cortex by fMRI neurofeedback in patients with schizophrenia

Cognitive functioning is impaired in patients with schizophrenia, leading to significant disabilities in everyday functioning. Its improvement is an important treatment target. Neurofeedback (NF) seems a promising method to address the neural dysfunctions underlying those cognitive impairments. The anterior cingulate cortex (ACC), a central hub for cognitive processing, is one of the brain regions known to be dysfunctional in schizophrenia. Here we conducted NF training based on real-time functional magnetic resonance imaging (fMRI) in patients with schizophrenia to enable them to control their ACC activity. Training was performed over 3 days in a group of 11 patients with schizophrenia and 11 healthy controls. Social feedback was provided in accordance with the evoked activity in the selected region of interest (ROI). Neural and cognitive strategies were examined off-line. Both groups learned to control the activity of their ACC but used different neural strategies: patients activated the dorsal and healthy controls the rostral subdivision. Patients mainly used imagination of music to elicit activity and the control group imagination of sports. In a stepwise regression analysis, the difference in neural control did not result from the differences in cognitive strategies but from diagnosis alone. Based on social reinforcers, patients with schizophrenia can learn to regulate localized brain activity. However, cognitive strategies and neural network location differ from healthy controls. These data emphasize that for therapeutic interventions in patients with schizophrenia compensatory strategies may emerge. Specific cognitive skills or specific dysfunctional networks should be addressed to train impaired skills. Social NF based on fMRI may be one method to accomplish precise learning targets.

Virtual reality in assessment and treatment of schizophrenia: a systematic review

Objective To conduct a systematic review about the use of virtual reality (VR) for evaluation, treatment and/or rehabilitation of patients with schizophrenia, focused on: areas, fields and objectives; methodological issues; features of the VR used; viability and efficiency of this resource. Methods Searches were performed about schizophrenia and virtual reality in PsycINFO, Academic Search Complete, MEDLINE Complete, CINAHL with Full Text, Web of Science and Business Source Premier databases, using the following keywords: [“schizophrenia”] AND [“virtual reality” OR “serious game”] AND [“treatment” OR “therapy” OR “rehabilitation”]. The search was carried out between November 2013 and June 2014 without using any search limiters. Results A total of 101 papers were identified, and after the application of exclusion criteria, 33 papers remained. The studies analysed focused on the use of VR for the evaluation of cognitive, social, perceptual and sensory skills, and the vast majority were experimental studies, with virtual reality specifically created for them. All the reviewed papers point towards a reliable and safe use of VR for evaluating and treating cognitive and social deficits in patients with schizophrenia, with different results in terms of generalisation, motivation, assertiveness and task participation rate. Some problems were highlighted, such as its high cost and a constant need for software maintenance. Conclusion The studies show that using the virtual reality may streamline traditional evaluation/rehabilitation programmes, allowing to enhance the results achieved, both in the cognitive and in the social field, helping for the legitimisation of this population’s psycho-social inclusion.

[Expression, identification and experience of emotions in mental diseases. An overview]

Several studies in clinical neuroscience have focused on the analysis of expression of emotions, identification of emotions and experience of emotions. These empirical studies produced certain insights into emotional competency in different mental diseases, most of them in schizophrenia. The current article gives a description of the scientific data about alterations in emotional competency in several mental diseases (e.g. schizophrenia, depression, bipolar and borderline diseases) and links the data, if possible, with clinical relevance with a special focus on emotional competency in prodromal schizophrenia.

Virtual reality for treatment compliance for people with serious mental illness

BACKGROUND

Virtual reality (VR) is computerised real-time technology, which can be used an alternative assessment and treatment tool in the mental health field. Virtual reality may take different forms to simulate real-life activities and support treatment.

OBJECTIVES

To investigate the effects of virtual reality to support treatment compliance in people with serious mental illness.

SEARCH METHODS

We searched the Cochrane Schizophrenia Group Trials Register (most recent, 17th September 2013) and relevant reference lists.

SELECTION CRITERIA

All relevant randomised studies comparing virtual reality with standard care for those with serious mental illnesses. We defined virtual reality as a computerised real-time technology using graphics, sound and other sensory input, which creates the interactive computer-mediated world as a therapeutic tool.

DATA COLLECTION AND ANALYSIS

All review authors independently selected studies and extracted data. For homogeneous dichotomous data the risk difference (RD) and the 95% confidence intervals (CI) were calculated on an intention-to-treat basis. For continuous data, we calculated mean differences (MD). We assessed risk of bias and created a 'Summary of findings' table using the GRADE approach.

MAIN RESULTS

We identified three short-term trials (total of 156 participants, duration five to 12 weeks). Outcomes were prone to at least a moderate risk of overestimating positive effects. We found that virtual reality had little effects regarding compliance (3 RCTs, n = 156, RD loss to follow-up 0.02 CI -0.08 to 0.12, low quality evidence), cognitive functioning (1 RCT, n = 27, MD average score on Cognistat 4.67 CI -1.76 to 11.10, low quality evidence), social skills (1 RCT, n = 64, MD average score on social problem solving SPSI-R (Social Problem Solving Inventory - Revised) -2.30 CI -8.13 to 3.53, low quality evidence), or acceptability of intervention (2 RCTs, n = 92, RD 0.05 CI -0.09 to 0.19, low quality evidence). There were no data reported on mental state, insight, behaviour, quality of life, costs, service utilisation, or adverse effects. Satisfaction with treatment - measured using an un-referenced scale - and reported as "interest in training" was better for the virtual reality group (1 RCT, n = 64, MD 6.00 CI 1.39 to 10.61,low quality evidence).

AUTHORS' CONCLUSIONS

There is no clear good quality evidence for or against using virtual reality for treatment compliance among people with serious mental illness. If virtual reality is used, the experimental nature of the intervention should be clearly explained. High-quality studies should be undertaken in this area to explore any effects of this novel intervention and variations of approach.

Virtual faces expressing emotions: an initial concomitant and construct validity study

BACKGROUND

Facial expressions of emotions represent classic stimuli for the study of social cognition. Developing virtual dynamic facial expressions of emotions, however, would open-up possibilities, both for fundamental and clinical research. For instance, virtual faces allow real-time Human-Computer retroactions between physiological measures and the virtual agent.

OBJECTIVES

The goal of this study was to initially assess concomitants and construct validity of a newly developed set of virtual faces expressing six fundamental emotions (happiness, surprise, anger, sadness, fear, and disgust). Recognition rates, facial electromyography (zygomatic major and corrugator supercilii muscles), and regional gaze fixation latencies (eyes and mouth regions) were compared in 41 adult volunteers (20 ♂, 21 ♀) during the presentation of video clips depicting real vs. virtual adults expressing emotions.

RESULTS

Emotions expressed by each set of stimuli were similarly recognized, both by men and women. Accordingly, both sets of stimuli elicited similar activation of facial muscles and similar ocular fixation times in eye regions from man and woman participants.

CONCLUSION

Further validation studies can be performed with these virtual faces among clinical populations known to present social cognition difficulties. Brain-Computer Interface studies with feedback-feedforward interactions based on facial emotion expressions can also be conducted with these stimuli.

BESST (Bochum Emotional Stimulus Set)--a pilot validation study of a stimulus set containing emotional bodies and faces from frontal and averted views

This article introduces the freely available Bochum Emotional Stimulus Set (BESST), which contains pictures of bodies and faces depicting either a neutral expression or one of the six basic emotions (happiness, sadness, fear, anger, disgust, and surprise), presented from two different perspectives (0° frontal view vs. camera averted by 45° to the left). The set comprises 565 frontal view and 564 averted view pictures of real-life bodies with masked facial expressions and 560 frontal and 560 averted view faces which were synthetically created using the FaceGen 3.5 Modeller. All stimuli were validated in terms of categorization accuracy and the perceived naturalness of the expression. Additionally, each facial stimulus was morphed into three age versions (20/40/60 years). The results show high recognition of the intended facial expressions, even under speeded forced-choice conditions, as corresponds to common experimental settings. The average naturalness ratings for the stimuli range between medium and high.

Impaired facial emotion recognition in a ketamine model of psychosis

OBJECTIVE

Social cognitive disabilities are a common feature in schizophrenia. Given the role of glutamatergic neurotransmission in schizophrenia-related cognitive impairments, we investigated the effects of the glutamatergic NMDA receptor antagonist ketamine on facial emotion recognition.

METHODS

Eighteen healthy male subjects were tested on two occasions, one without medication and one after administration with subanesthetic doses of intravenous ketamine. Emotion recognition was examined using the Ekman 60 Faces Test. In addition, attention was measured by the Continuous Performance Test (CPT), and psychopathology was rated using the Psychotomimetic States Inventory (PSI).

RESULTS

Ketamine produced a non-significant deterioration of global emotion recognition abilities. Specifically, the ability to correctly identify the facial expression of sadness was significantly reduced in the ketamine condition. These results were independent of psychotic symptoms and selective attention.

CONCLUSION

Our results point to the involvement of the glutamatergic system in the ability to recognize facial emotions.

Emotion unfolded by motion: a role for parietal lobe in decoding dynamic facial expressions

Facial expressions convey important emotional and social information and are frequently applied in investigations of human affective processing. Dynamic faces may provide higher ecological validity to examine perceptual and cognitive processing of facial expressions. Higher order processing of emotional faces was addressed by varying the task and virtual face models systematically. Blood oxygenation level-dependent activation was assessed using functional magnetic resonance imaging in 20 healthy volunteers while viewing and evaluating either emotion or gender intensity of dynamic face stimuli. A general linear model analysis revealed that high valence activated a network of motion-responsive areas, indicating that visual motion areas support perceptual coding for the motion-based intensity of facial expressions. The comparison of emotion with gender discrimination task revealed increased activation of inferior parietal lobule, which highlights the involvement of parietal areas in processing of high level features of faces. Dynamic emotional stimuli may help to emphasize functions of the hypothesized 'extended' over the 'core' system for face processing.

Supramodal representation of emotions

Supramodal representation of emotion and its neural substrates have recently attracted attention as a marker of social cognition. However, the question whether perceptual integration of facial and vocal emotions takes place in primary sensory areas, multimodal cortices, or in affective structures remains unanswered yet. Using novel computer-generated stimuli, we combined emotional faces and voices in congruent and incongruent ways and assessed functional brain data (fMRI) during an emotional classification task. Both congruent and incongruent audiovisual stimuli evoked larger responses in thalamus and superior temporal regions compared with unimodal conditions. Congruent emotions were characterized by activation in amygdala, insula, ventral posterior cingulate (vPCC), temporo-occipital, and auditory cortices; incongruent emotions activated a frontoparietal network and bilateral caudate nucleus, indicating a greater processing load in working memory and emotion-encoding areas. The vPCC alone exhibited differential reactions to congruency and incongruency for all emotion categories and can thus be considered a central structure for supramodal representation of complex emotional information. Moreover, the left amygdala reflected supramodal representation of happy stimuli. These findings document that emotional information does not merge at the perceptual audiovisual integration level in unimodal or multimodal areas, but in vPCC and amygdala.