Differentiation of stages in joke comprehension: Evidence from an ERP study

The resolution stage, not the incongruity detection stage, is related to the subjective feeling of humor: An ERP study using Japanese nazokake puns

This study examined the relationship between two cognitive stages of humor processing (i.e., detecting incongruity and resolving it) and the subjective feeling of humor, using event-related brain potentials (ERPs). Unlike traditional English jokes, Japanese nazokake puns have a structure in which the detection of incongruity and the resolution of it are separated, which enabled this study to observe the ERPs for these two stages independently. In addition, to investigate how the cognitive stages work when people subjectively find a pun funny, the ERPs elicited by funny and unfunny puns, categorized according to participants' subjective ratings, were compared. This subjective feeling has not received enough attention in previous literature. The results showed that N400 and P600 responses occurred during the incongruity detection stage and the resolution stage, respectively. Furthermore, funny puns enlarged the P600 amplitude compared to unfunny ones, but the N400 amplitude did not significantly differ between the funniness categories. These findings indicate that the resolution stage of humor processing is related to the subjective feeling of humor, rather than the incongruity detection stage.

The influence of semantic relevance on the discernment of product appearance and function

Background

This study investigated the impact of semantic relevance on the ability to comprehend the appearance and function of a product, as presented in images.

Methods

The images used the constructs of Simile, Metaphor and Analogy to correspond to congruent, related and incongruent semantic structures, and measured the amplitude of Event-Related Potentials (ERPs) to compare these images with Landscape images. Sixteen participants with design-related educational backgrounds were invited to join in the ERP experiment.

Results

The results found that the image depicting the Metaphor showed a stronger N600 amplitude in the right anterior region of the brain than the Landscape image and the Analogy image induced a stronger N600 effect in the left anterior and right anterior part of the brain than the Landscape image. However, the Simile image did not trigger the N600. The N600 was triggered when the meaning of the Metaphor and Analogy being presented could not be understood. This indicates that a greater processing effort to comprehend them than was required for Simile. Analogy has a wider N600 distribution than Metaphor in the anterior area, suggesting that Analogy would require higher-level thinking processes and more complex semantic processing mechanisms than Metaphor.

Conclusions

The N600 implicated that an assessment method to detect the semantic relationship between appearance and function of a product would assist in determining whether a symbol was suitable to be associated with a product.

An ERP index of real-time error correction within a noisy-channel framework of human communication

Recent evidence suggests that language processing is well-adapted to noise in the input (e.g., spelling or speech errors, misreading or mishearing) and that comprehenders readily correct the input via rational inference over possible intended sentences given probable noise corruptions. In the current study, we probed the processing of noisy linguistic input, asking whether well-studied ERP components may serve as useful indices of this inferential process. In particular, we examined sentences where semantic violations could be attributed to noise-for example, in "The storyteller could turn any incident into an amusing antidote", where the implausible word "antidote" is orthographically and phonologically close to the intended "anecdote". We found that the processing of such sentences-where the probability that the message was corrupted by noise exceeds the probability that it was produced intentionally and perceived accurately-was associated with a reduced (less negative) N400 effect and an increased P600 effect, compared to semantic violations which are unlikely to be attributed to noise ("The storyteller could turn any incident into an amusing hearse"). Further, the magnitudes of these ERP effects were correlated with the probability that the comprehender retrieved a plausible alternative. This work thus adds to the growing body of literature that suggests that many aspects of language processing are optimized for dealing with noise in the input, and opens the door to electrophysiologic investigations of the computations that support the processing of imperfect input.

Electrophysiological indexes of ToM and non-ToM humor in healthy adults

The cognitive processes involved in humor comprehension were analyzed by directly comparing the time course of brain activity associated with the perception of slapstick humor and that associated with the comprehension of humor requiring theory of mind (ToM). Four different comic strips (strips containing humorous scenes that required ToM, non-ToM humorous strips, non-humorous semantically coherent strips and non-humorous semantically incoherent strips) were presented to participants, while their EEG response was recorded. Results showed that both of the humorous comic strips and the semantically incongruent strip elicited an N400 effect, suggesting similar cognitive mechanisms underlying the processing of incongruent and humorous comic strips. The results also showed that the humorous ToM strips elicited a frontal late positive (LP) response, possibly reflecting the active deployment of ToM abilities such as perspective-taking and empathy that allow for the resolution and interpretation of apparently incongruent situations. In addition, the LP response was positively correlated with ratings of perceived amusement as well as individual empathy scores, suggesting that the increased LP response to ToM humorous strips reflects the combined activation of neural mechanisms involved in the experience of amusement and ToM abilities. Overall, humor comprehension appears to demand distinct cognitive steps such as the detection of incongruent semantic components, the construction of semantic coherence, and the appreciation of humoristic elements such as maladaptive emotional reactions. Our results show that the deployment of these distinct cognitive steps is at least partially dependent on individual empathic abilities.

Dynamic cognitive processes of text-picture integration revealed by event-related potentials

The integration of text and picture is the core of multimedia information processing. Relevant theories suggest that text and picture are processed through different channels in the early stage, and integrated in the late stage of processing. Based on these theories, the current study adopted measures of event-related potentials to examine the cognitive and neural processes of text-picture integration. The results showed that in the early stage of text-picture integration, picture processing evoked a more negative N1 over the occipital area and a N300 over the prefrontal area, which might reflect the discrimination process of visual stimuli and the imagery representation of the picture, respectively; in the late stage, the text-picture induced a N400 in the central area and an LPC over the central, parietal and temporal areas, which might be associated with the semantic activation and integration of text and picture, respectively. These results not only provide support for existing theories, but also further elucidate the dynamic neural processing of text-picture integration in terms of its temporal and spatial characteristics.

Humor drawings evoked temporal and spectral EEG processes

The study aimed to explore the humor processing elicited through the manipulation of artistic drawings. Using the Comprehension-Elaboration Theory of humor as the main research background, the experiment manipulated the head portraits of celebrities based on the independent variables of facial deformation (large/small) and addition of affective features (positive/negative). A 64-channel electroencephalography was recorded in 30 participants while viewing the incongruous drawings of celebrities. The electroencephalography temporal and spectral responses were measured during the three stages of humor which included incongruity detection, incongruity comprehension and elaboration of humor. Analysis of event-related potentials indicated that for humorous vs non-humorous drawings, facial deformation and the addition of affective features significantly affected the degree of humor elicited, specifically: large > small deformation; negative > positive affective features. The N170, N270, N400, N600-800 and N900-1200 components showed significant differences, particularly in the right prefrontal and frontal regions. Analysis of event-related spectral perturbation showed significant differences in the theta band evoked in the anterior cingulate cortex, parietal region and posterior cingulate cortex; and in the alpha and beta bands in the motor areas. These regions are involved in emotional processing, memory retrieval, and laughter and feelings of amusement induced by elaboration of the situation.

Neural circuit of verbal humor comprehension in schizophrenia - an fMRI study

Individuals with schizophrenia exhibit problems with understanding the figurative meaning of language. This study evaluates neural correlates of diminished humor comprehension observed in schizophrenia. The study included chronic schizophrenia (SCH) outpatients (n = 20), and sex, age and education level matched healthy controls (n = 20). The fMRI punchline based humor comprehension task consisted of 60 stories of which 20 had funny, 20 nonsensical and 20 neutral (not funny) punchlines. After the punchlines were presented, the participants were asked to indicate whether the story was comprehensible and how funny it was. Three contrasts were analyzed in both groups reflecting stages of humor processing: abstract vs neutral stories - incongruity detection; funny vs abstract - incongruity resolution and elaboration; and funny vs neutral - complete humor processing. Additionally, parametric modulation analysis was performed using both subjective ratings separately. Between-group comparisons revealed that the SCH subjects had attenuated activation in the right posterior superior temporal gyrus (BA 41) in case of irresolvable incongruity processing of nonsensical puns; in the left dorsomedial middle and superior frontal gyri (BA 8/9) in case of incongruity resolution and elaboration processing of funny puns; and in the interhemispheric dorsal anterior cingulate cortex (BA 24) in case of complete processing of funny puns. Additionally, during comprehensibility ratings the SCH group showed a suppressed activity in the left dorsomedial middle and superior frontal gyri (BA 8/9) and revealed weaker activation during funniness ratings in the left dorsal anterior cingulate cortex (BA 24). Interestingly, these differences in the SCH group were accompanied behaviorally by a protraction of time in both types of rating responses and by indicating funny punchlines less comprehensible. Summarizing, our results indicate neural substrates of humor comprehension processing impairments in schizophrenia, which is accompanied by fronto-temporal hypoactivation.

Humour processing in frontotemporal lobar degeneration: A behavioural and neuroanatomical analysis

Humour is a complex cognitive and emotional construct that is vulnerable in neurodegenerative diseases, notably the frontotemporal lobar degenerations. However, humour processing in these diseases has been little studied. Here we assessed humour processing in patients with behavioural variant frontotemporal dementia (n = 22, mean age 67 years, four female) and semantic dementia (n = 11, mean age 67 years, five female) relative to healthy individuals (n = 21, mean age 66 years, 11 female), using a joint cognitive and neuroanatomical approach. We created a novel neuropsychological test requiring a decision about the humorous intent of nonverbal cartoons, in which we manipulated orthogonally humour content and familiarity of depicted scenarios. Structural neuroanatomical correlates of humour detection were assessed using voxel-based morphometry. Assessing performance in a signal detection framework and after adjusting for standard measures of cognitive function, both patient groups showed impaired accuracy of humour detection in familiar and novel scenarios relative to healthy older controls (p < .001). Patient groups showed similar overall performance profiles; however the behavioural variant frontotemporal dementia group alone showed a significant advantage for detection of humour in familiar relative to novel scenarios (p = .045), suggesting that the behavioural variant syndrome may lead to particular difficulty decoding novel situations for humour, while semantic dementia produces a more general deficit of humour detection that extends to stock comedic situations. Humour detection accuracy was associated with grey matter volume in a distributed network including temporo-parietal junctional and anterior superior temporal cortices, with predominantly left-sided correlates of processing humour in familiar scenarios and right-sided correlates of processing novel humour. The findings quantify deficits of core cognitive operations underpinning humour processing in frontotemporal lobar degenerations and suggest a candidate brain substrate in cortical hub regions processing incongruity and semantic associations. Humour is a promising candidate tool with which to assess complex social signal processing in neurodegenerative disease.

From incoherence to mirth: neuro-cognitive processing of garden-path jokes

In so-called garden-path jokes, an initial semantic representation is violated, and semantic revision reestablishes a coherent representation. 48 jokes were manipulated in three conditions: (i) a coherent ending, (ii) a joke ending, and (iii) a discourse-incoherent ending. A reading times study (N = 24) and three studies with recordings of ERP and pupil changes (N = 21, 24, and 24, respectively) supported the hypothesized cognitive processes. Jokes showed increased reading times of the final word compared to coherent endings. ERP data mainly indicated semantic integration difficulties (N400). Larger pupil diameters to joke endings presumably reflect emotional responses. ERP evidence for increased discourse processing efforts and emotional responses, as assumed to be reflected in modulations of the late left anterior negativity (LLAN) and in an enhanced late frontal positivity (fP600), respectively, remains however incomplete. Processing of incoherent endings was also accompanied by increased reading times, a stronger and sustained N400, and context-sensitive P600 effects. Together, these findings provide evidence for a sequential, non-monotonic, and incremental discourse comprehension of garden-path jokes.