1
|
Hsiao JHW. Understanding Human Cognition Through Computational Modeling. Top Cogn Sci 2024; 16:349-376. [PMID: 38781432 DOI: 10.1111/tops.12737] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2023] [Revised: 05/07/2024] [Accepted: 05/08/2024] [Indexed: 05/25/2024]
Abstract
One important goal of cognitive science is to understand the mind in terms of its representational and computational capacities, where computational modeling plays an essential role in providing theoretical explanations and predictions of human behavior and mental phenomena. In my research, I have been using computational modeling, together with behavioral experiments and cognitive neuroscience methods, to investigate the information processing mechanisms underlying learning and visual cognition in terms of perceptual representation and attention strategy. In perceptual representation, I have used neural network models to understand how the split architecture in the human visual system influences visual cognition, and to examine perceptual representation development as the results of expertise. In attention strategy, I have developed the Eye Movement analysis with Hidden Markov Models method for quantifying eye movement pattern and consistency using both spatial and temporal information, which has led to novel findings across disciplines not discoverable using traditional methods. By integrating it with deep neural networks (DNN), I have developed DNN+HMM to account for eye movement strategy learning in human visual cognition. The understanding of the human mind through computational modeling also facilitates research on artificial intelligence's (AI) comparability with human cognition, which can in turn help explainable AI systems infer humans' belief on AI's operations and provide human-centered explanations to enhance human-AI interaction and mutual understanding. Together, these demonstrate the essential role of computational modeling methods in providing theoretical accounts of the human mind as well as its interaction with its environment and AI systems.
Collapse
|
2
|
Clauwaert A, Pinto EA, Schouppe S, Danneels L, Van Oosterwijck J, Van Damme S. Does movement preparation enhance attending to bodily sensations in the back in people with persistent low back pain? PLoS One 2024; 19:e0300421. [PMID: 38635727 PMCID: PMC11025943 DOI: 10.1371/journal.pone.0300421] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2023] [Accepted: 02/28/2024] [Indexed: 04/20/2024] Open
Abstract
Attention has been proposed to play an important role in persisting pain, with excessive attentional processes towards pain information leading to worse pain outcomes and maladaptive behaviors. Nevertheless, research on somatosensory attending during the anticipation of pain-related movements is still scarce. This study investigated if individuals with chronic and recurrent lower back pain compared to pain-free controls, show enhanced attending to somatosensory information in the back while anticipating back-recruiting movements. 43 healthy control, 33 recurrent (RLBP) and 33 chronic low back (CLBP) pain sufferers were asked to perform back-recruiting movements. Before the movement initiation cue, a task-irrelevant tactile stimulus was administered to participants' lower back to elicit somatosensory evoked potentials (SEPs), used as an index of somatosensory attending. In contrast to our hypothesis, most identified SEP components did not differ across groups. The only exception was the P175 amplitude which was larger for the CLBP group compared to individuals with RLBP and healthy controls. The current study did not find robust evidence of enhanced somatosensory attending to the back in people with persisting lower back pain. The finding that CLBP, but not RLBP individuals, had larger amplitudes to the P175 component, is discussed as possibly reflecting a higher state of emotional arousal in these patients when having to prepare the back-recruiting movements.
Collapse
Affiliation(s)
- Amanda Clauwaert
- Department of Experimental-Clinical and Health Psychology, Ghent University, Ghent, Belgium
| | - Eleana A. Pinto
- Department of Experimental-Clinical and Health Psychology, Ghent University, Ghent, Belgium
| | - Stijn Schouppe
- SPINE Research Unit Ghent, Department of Rehabilitation Sciences, Faculty of Medicine and Health Sciences, Ghent University, Gent, Belgium
| | - Lieven Danneels
- SPINE Research Unit Ghent, Department of Rehabilitation Sciences, Faculty of Medicine and Health Sciences, Ghent University, Gent, Belgium
| | - Jessica Van Oosterwijck
- SPINE Research Unit Ghent, Department of Rehabilitation Sciences, Faculty of Medicine and Health Sciences, Ghent University, Gent, Belgium
- Pain in Motion International Research Group, Departments of Human Physiology and Rehabilitation Sciences, Faculty of Physical Education & Physiotherapy, Vrije Universiteit Brussel, Brussels, Belgium
| | - Stefaan Van Damme
- Department of Experimental-Clinical and Health Psychology, Ghent University, Ghent, Belgium
| |
Collapse
|
3
|
Pickup B, Sharpe L, Todd J. Interpretation bias in endometriosis-related pain. Pain 2023; 164:2352-2357. [PMID: 37326698 DOI: 10.1097/j.pain.0000000000002946] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2022] [Accepted: 04/03/2023] [Indexed: 06/17/2023]
Abstract
ABSTRACT Endometriosis-related pain has been predominantly medically managed, which has hindered understanding of psychological factors involved in these pain experiences. Models of chronic pain highlight the biased interpretation of ambiguous information as health threat related (interpretation bias) as an important process in the development and maintenance of chronic pain. Whether interpretation bias may also be similarly implicated in endometriosis-related pain is unclear. The current study aimed to address this gap in the literature by (1) comparing interpretation biases between a sample of participants with endometriosis and a control sample of participants without medical conditions and pain, (2) exploring relationships between interpretation bias and endometriosis-related pain outcomes, and (3) exploring whether interpretation bias moderated the relationship between endometriosis-related pain severity and pain interference. The endometriosis and healthy control samples comprised 873 and 197 participants, respectively. Participants completed online surveys assessing demographics, interpretation bias, and pain-related outcomes. Analyses revealed that interpretation bias was significantly stronger among individuals with endometriosis relative to controls, with a large effect size. Within the endometriosis sample, interpretation bias was significantly associated with increases in pain-related interference, however, interpretation bias was not associated with any other pain outcomes and did not moderate the relationship between pain severity and pain interference. This study is the first to evidence biased interpretation styles among individuals with endometriosis and to show this bias is associated with pain interference. Whether interpretation bias varies over time and whether this bias can be modified through scalable and accessible interventions to alleviate pain-related interference are avenues for future research.
Collapse
Affiliation(s)
- Brydee Pickup
- School of Psychology, The University of Sydney, Camperdown, Australia
| | | | | |
Collapse
|
4
|
Lan H, Liu Z, Hsiao JH, Yu D, Chan AB. Clustering Hidden Markov Models With Variational Bayesian Hierarchical EM. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2023; 34:1537-1551. [PMID: 34464269 DOI: 10.1109/tnnls.2021.3105570] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
The hidden Markov model (HMM) is a broadly applied generative model for representing time-series data, and clustering HMMs attract increased interest from machine learning researchers. However, the number of clusters ( K ) and the number of hidden states ( S ) for cluster centers are still difficult to determine. In this article, we propose a novel HMM-based clustering algorithm, the variational Bayesian hierarchical EM algorithm, which clusters HMMs through their densities and priors and simultaneously learns posteriors for the novel HMM cluster centers that compactly represent the structure of each cluster. The numbers K and S are automatically determined in two ways. First, we place a prior on the pair (K,S) and approximate their posterior probabilities, from which the values with the maximum posterior are selected. Second, some clusters and states are pruned out implicitly when no data samples are assigned to them, thereby leading to automatic selection of the model complexity. Experiments on synthetic and real data demonstrate that our algorithm performs better than using model selection techniques with maximum likelihood estimation.
Collapse
|
5
|
Hsiao JH, An J, Hui VKS, Zheng Y, Chan AB. Understanding the role of eye movement consistency in face recognition and autism through integrating deep neural networks and hidden Markov models. NPJ SCIENCE OF LEARNING 2022; 7:28. [PMID: 36284113 PMCID: PMC9596700 DOI: 10.1038/s41539-022-00139-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/16/2022] [Accepted: 08/31/2022] [Indexed: 06/16/2023]
Abstract
Greater eyes-focused eye movement pattern during face recognition is associated with better performance in adults but not in children. We test the hypothesis that higher eye movement consistency across trials, instead of a greater eyes-focused pattern, predicts better performance in children since it reflects capacity in developing visual routines. We first simulated visual routine development through combining deep neural network and hidden Markov model that jointly learn perceptual representations and eye movement strategies for face recognition. The model accounted for the advantage of eyes-focused pattern in adults, and predicted that in children (partially trained models) consistency but not pattern of eye movements predicted recognition performance. This result was then verified with data from typically developing children. In addition, lower eye movement consistency in children was associated with autism diagnosis, particularly autistic traits in social skills. Thus, children's face recognition involves visual routine development through social exposure, indexed by eye movement consistency.
Collapse
Affiliation(s)
- Janet H Hsiao
- Department of Psychology, University of Hong Kong, Hong Kong SAR, China.
- The State Key Laboratory of Brain and Cognitive Sciences, University of Hong Kong, Hong Kong SAR, China.
- The Institute of Data Science, University of Hong Kong, Hong Kong SAR, China.
| | - Jeehye An
- Department of Psychology, University of Hong Kong, Hong Kong SAR, China
| | | | - Yueyuan Zheng
- Department of Psychology, University of Hong Kong, Hong Kong SAR, China
| | - Antoni B Chan
- Department of Computer Science, City University of Hong Kong, Hong Kong SAR, China
| |
Collapse
|
6
|
Linking interpretation bias to individual differences in pain sensitivity. CURRENT PSYCHOLOGY 2022. [DOI: 10.1007/s12144-022-03793-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022]
|
7
|
Liao W, Li STK, Hsiao JHW. Music reading experience modulates eye movement pattern in English reading but not in Chinese reading. Sci Rep 2022; 12:9144. [PMID: 35650229 PMCID: PMC9397380 DOI: 10.1038/s41598-022-12978-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2022] [Accepted: 05/19/2022] [Indexed: 11/30/2022] Open
Abstract
Here we tested the hypothesis that in Chinese-English bilinguals,
music reading experience may modulate eye movement planning in reading English but
not Chinese sentences due to the similarity in perceptual demands on processing
sequential symbol strings separated by spaces between music notation and English
sentence reading. Chinese–English bilingual musicians and non-musicians read legal,
semantically incorrect, and syntactically (and semantically) incorrect sentences in
both English and Chinese. In English reading, musicians showed more dispersed eye
movement patterns in reading syntactically incorrect sentences than legal sentences,
whereas non-musicians did not. This effect was not observed in Chinese reading.
Musicians also had shorter saccade lengths when viewing syntactically incorrect than
correct musical notations and sentences in an unfamiliar alphabetic language
(Tibetan), whereas non-musicians did not. Thus, musicians’ eye movement planning was
disturbed by syntactic violations in both music and English reading but not in
Chinese reading, and this effect was generalized to an unfamiliar alphabetic
language. These results suggested that music reading experience may modulate
perceptual processes in reading differentially in bilinguals’ two languages,
depending on their processing similarities.
Collapse
Affiliation(s)
- Weiyan Liao
- Department of Psychology, University of Hong Kong, Hong Kong SAR, China
| | - Sara Tze Kwan Li
- Department of Psychology, University of Hong Kong, Hong Kong SAR, China.,Department of Social Sciences, School of Arts and Social Sciences, Hong Kong Metropolitan University, Hong Kong SAR, China
| | - Janet Hui-Wen Hsiao
- Department of Psychology, University of Hong Kong, Hong Kong SAR, China. .,The State Key Laboratory of Brain and Cognitive Sciences, University of Hong Kong, Hong Kong SAR, China. .,The Institute of Data Science, University of Hong Kong, Hong Kong SAR, China.
| |
Collapse
|
8
|
Hsiao JHW, Liao W, Tso RVY. Impact of mask use on face recognition: an eye-tracking study. Cogn Res Princ Implic 2022; 7:32. [PMID: 35394572 PMCID: PMC8990495 DOI: 10.1186/s41235-022-00382-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2021] [Accepted: 03/21/2022] [Indexed: 12/05/2022] Open
Abstract
We examined how mask use affects performance and eye movements in face recognition and whether strategy change reflected in eye movements is associated with performance change. Eighty-eight participants performed face recognition with masked faces either during learning only, during recognition only, or during both learning and recognition. As compared with the baseline condition where faces were unmasked during both learning and recognition, participants had impaired performance in all three scenarios, with larger impairment when mask conditions during learning and recognition did not match. When recognizing unmasked faces, whether the faces were learned with or without a mask on did not change eye movement behavior. Nevertheless, when recognizing unmasked faces that were learned with a mask on, participants who adopted more eyes-focused patterns had less performance impairment as compared with the baseline condition. When recognizing masked faces, participants had more eyes-focused patterns and more consistent gaze transition behavior than recognizing unmasked faces regardless of whether the faces were learned with or without a mask on. Nevertheless, when recognizing masked faces that were learned without a mask, participants whose gaze transition behavior was more consistent had less performance impairment as compared with the baseline condition. Thus, although eye movements during recognition were mainly driven by the mask condition during recognition but not that during learning, those who adjusted their strategy according to the mask condition difference between learning and recognition had better performance. This finding has important implications for identifying populations vulnerable to the impact of mask use and potential remedial strategies.
Collapse
Affiliation(s)
- Janet Hui-Wen Hsiao
- Department of Psychology, University of Hong Kong, Pokfulam Road, Hong Kong, Hong Kong SAR, China. .,The State Key Laboratory of Brain and Cognitive Sciences, University of Hong Kong, Hong Kong, Hong Kong SAR, China.
| | - Weiyan Liao
- Department of Psychology, University of Hong Kong, Pokfulam Road, Hong Kong, Hong Kong SAR, China
| | - Ricky Van Yip Tso
- Department of Psychology, The Education University of Hong Kong, Tai Po, New Territories, Hong Kong SAR, China.,Psychological Assessment and Clinical Research Unit, The Education University of Hong Kong, Tai Po, New Territories, Hong Kong SAR, China
| |
Collapse
|
9
|
Understanding the collinear masking effect in visual search through eye tracking. Psychon Bull Rev 2021; 28:1933-1943. [PMID: 34109536 DOI: 10.3758/s13423-021-01944-7] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/03/2021] [Indexed: 11/08/2022]
Abstract
Recent research has reported that, while both orientation contrast and collinearity increase target salience in visual search, a combination of the two counterintuitively masks a local target. Through eye-tracking and eye-movement analysis with hidden Markov models (EMHMM), here we showed that this collinear masking effect was associated with reduced eye-fixation consistency (as measured in entropy) at the central fixation cross prior to the search display presentation. As a decreased precision of saccade landing position is shown to be related to attention shift away from the saccadic target, our result suggested that the collinear masking effect may be related to attention shift to a non-saccadic-goal location in expectation of the search display before saccading to the central fixation cross. This attention shift may consequently interfere with attention capture by the collinear distractor containing the target, resulting in the masking effect. In contrast, although older adults had longer response times, more dispersed eye-movement pattern, and lower eye-movement consistency than young adults during visual search, the two age groups did not differ in the masking effect, suggesting limited contribution from ageing-related cognitive decline. Thus, participants' pre-saccadic attention shift prior to search may be an important factor influencing their search behavior.
Collapse
|
10
|
Abstract
The eye movement analysis with hidden Markov models (EMHMM) method provides quantitative measures of individual differences in eye-movement pattern. However, it is limited to tasks where stimuli have the same feature layout (e.g., faces). Here we proposed to combine EMHMM with the data mining technique co-clustering to discover participant groups with consistent eye-movement patterns across stimuli for tasks involving stimuli with different feature layouts. Through applying this method to eye movements in scene perception, we discovered explorative (switching between the foreground and background information or different regions of interest) and focused (mainly looking at the foreground with less switching) eye-movement patterns among Asian participants. Higher similarity to the explorative pattern predicted better foreground object recognition performance, whereas higher similarity to the focused pattern was associated with better feature integration in the flanker task. These results have important implications for using eye tracking as a window into individual differences in cognitive abilities and styles. Thus, EMHMM with co-clustering provides quantitative assessments on eye-movement patterns across stimuli and tasks. It can be applied to many other real-life visual tasks, making a significant impact on the use of eye tracking to study cognitive behavior across disciplines.
Collapse
|