1
|
Hung SM, Adams SW, Molloy C, Wu DA, Shimojo S, Arakaki X. Practice makes imperfect: stronger implicit interference with practice in individuals at high risk of developing Alzheimer's disease. GeroScience 2024; 46:2777-2786. [PMID: 37817004 PMCID: PMC10828369 DOI: 10.1007/s11357-023-00953-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2023] [Accepted: 09/19/2023] [Indexed: 10/12/2023] Open
Abstract
Early screening to determine patient risk of developing Alzheimer's will allow better interventions and planning but necessitates accessible methods such as behavioral biomarkers. Previously, we showed that cognitively healthy older individuals whose cerebrospinal fluid amyloid/tau ratio indicates high risk of cognitive decline experienced implicit interference during a high-effort task, signaling early changes in attention. To further investigate attention's effect on implicit interference, we analyzed two experiments completed sequentially by the same high- and low-risk individuals. We hypothesized that if attention modulates interference, practice would affect the influence of implicit distractors. Indeed, while both groups experienced a strong practice effect, the association between practice and interference effects diverged between groups: stronger practice effects correlated with more implicit interference in high-risk participants, but less interference in low-risk individuals. Furthermore, low-risk individuals showed a positive correlation between implicit interference and EEG low-range alpha event-related desynchronization when switching from high- to low-load tasks. This suggests that lower attention on the task was correlated with stronger interference, a typical phenomenon in the younger population. These results demonstrate how attention impacts implicit interference and highlight early differences in perception between high- and low-risk individuals.
Collapse
Affiliation(s)
- Shao-Min Hung
- Waseda Institute for Advanced Study, Waseda University, Tokyo, Japan.
- Faculty of Science and Engineering, Waseda University, Tokyo, Japan.
- Biology and Biological Engineering, California Institute of Technology, Pasadena, CA, USA.
| | - Sara W Adams
- Biology and Biological Engineering, California Institute of Technology, Pasadena, CA, USA
| | - Cathleen Molloy
- Cognition and Brain Integration Laboratory, Department of Neurosciences, Huntington Medical Research Institutes, Pasadena, CA, USA
| | - Daw-An Wu
- Biology and Biological Engineering, California Institute of Technology, Pasadena, CA, USA
| | - Shinsuke Shimojo
- Biology and Biological Engineering, California Institute of Technology, Pasadena, CA, USA.
- Computation and Neural Systems, California Institute of Technology, Pasadena, CA, USA.
| | - Xianghong Arakaki
- Cognition and Brain Integration Laboratory, Department of Neurosciences, Huntington Medical Research Institutes, Pasadena, CA, USA.
| |
Collapse
|
2
|
Hung SM, Adams SW, Molloy C, Wu DA, Shimojo S, Arakaki X. Practice makes imperfect: stronger implicit interference with practice in individuals at high risk of developing Alzheimer's disease. bioRxiv 2023:2023.05.16.541059. [PMID: 37292951 PMCID: PMC10245765 DOI: 10.1101/2023.05.16.541059] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Early screening to determine patient risk of developing Alzheimer's will allow better interventions and planning but necessitates accessible methods such as behavioral biomarkers. Previously, we showed that cognitively healthy older individuals whose cerebrospinal fluid amyloid / tau ratio indicates high risk of cognitive decline experienced implicit interference during a high-effort task, signaling early changes in attention. To further investigate attention's effect on implicit interference, we analyzed two experiments completed sequentially by the same high- and low-risk individuals. We hypothesized that if attention modulates interference, practice would affect the influence of implicit distractors. Indeed, while both groups experienced a strong practice effect, the association between practice and interference effects diverged between groups: stronger practice effects correlated with more implicit interference in high-risk participants, but less interference in low-risk individuals. Furthermore, low-risk individuals showed a positive correlation between implicit interference and EEG low-range alpha event-related desynchronization when switching from high- to low-load tasks. These results demonstrate how attention impacts implicit interference and highlight early differences in cognition between high- and low-risk individuals.
Collapse
Affiliation(s)
- Shao-Min Hung
- Waseda Institute for Advanced Study, Waseda University, Tokyo, Japan
- Faculty of Science and Engineering, Waseda University, Tokyo, Japan
- Biology and Biological Engineering, California Institute of Technology, Pasadena, CA, USA
| | - Sara W. Adams
- Biology and Biological Engineering, California Institute of Technology, Pasadena, CA, USA
| | - Cathleen Molloy
- Cognition and Brain Integration Laboratory, Department of Neurosciences, Huntington Medical Research Institutes, Pasadena, CA, USA
| | - Daw-An Wu
- Biology and Biological Engineering, California Institute of Technology, Pasadena, CA, USA
| | - Shinsuke Shimojo
- Biology and Biological Engineering, California Institute of Technology, Pasadena, CA, USA
- Computation and Neural Systems, California Institute of Technology, Pasadena, CA, USA
| | - Xianghong Arakaki
- Cognition and Brain Integration Laboratory, Department of Neurosciences, Huntington Medical Research Institutes, Pasadena, CA, USA
| |
Collapse
|
3
|
Liang W, Guo H, Mittelstein DR, Shapiro MG, Shimojo S, Shehata M. Auditory Mondrian masks the airborne-auditory artifact of focused ultrasound stimulation in humans. Brain Stimul 2023; 16:604-606. [PMID: 36898575 PMCID: PMC10314733 DOI: 10.1016/j.brs.2023.03.002] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2023] [Accepted: 03/02/2023] [Indexed: 03/12/2023] Open
Affiliation(s)
- William Liang
- Division of Biology and Biological Engineering, California Institute of Technology, 1200 East California Boulevard, Pasadena, CA, 91125, USA.
| | - Hongsun Guo
- Division of Chemistry and Chemical Engineering, California Institute of Technology, 1200 East California Boulevard, Pasadena, CA, 91125, USA.
| | - David R Mittelstein
- Division of Chemistry and Chemical Engineering, California Institute of Technology, 1200 East California Boulevard, Pasadena, CA, 91125, USA; Keck School of Medicine of the University of Southern California, 1975 Zonal Avenue, Los Angeles, CA, 90033, USA.
| | - Mikhail G Shapiro
- Division of Chemistry and Chemical Engineering, California Institute of Technology, 1200 East California Boulevard, Pasadena, CA, 91125, USA; Howard Hughes Medical Institute, Pasadena, CA, 91125, USA.
| | - Shinsuke Shimojo
- Division of Biology and Biological Engineering, California Institute of Technology, 1200 East California Boulevard, Pasadena, CA, 91125, USA.
| | - Mohammad Shehata
- Division of Biology and Biological Engineering, California Institute of Technology, 1200 East California Boulevard, Pasadena, CA, 91125, USA; Electronics-Inspired Interdisciplinary Research Institute, Toyohashi University of Technology, 1-1 Hibarigaoka, Tempaku-cho, Toyohashi, Aichi, 441-8580, Japan.
| |
Collapse
|
4
|
Arakaki X, Arechavala RJ, Choy EH, Bautista J, Bliss B, Molloy C, Wu DA, Shimojo S, Jiang Y, Kleinman MT, Kloner RA. The connection between heart rate variability (HRV), neurological health, and cognition: A literature review. Front Neurosci 2023; 17:1055445. [PMID: 36937689 PMCID: PMC10014754 DOI: 10.3389/fnins.2023.1055445] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2022] [Accepted: 02/06/2023] [Indexed: 03/05/2023] Open
Abstract
The heart and brain have bi-directional influences on each other, including autonomic regulation and hemodynamic connections. Heart rate variability (HRV) measures variation in beat-to-beat intervals. New findings about disorganized sinus rhythm (erratic rhythm, quantified as heart rate fragmentation, HRF) are discussed and suggest overestimation of autonomic activities in HRV changes, especially during aging or cardiovascular events. When excluding HRF, HRV is regulated via the central autonomic network (CAN). HRV acts as a proxy of autonomic activity and is associated with executive functions, decision-making, and emotional regulation in our health and wellbeing. Abnormal changes of HRV (e.g., decreased vagal functioning) are observed in various neurological conditions including mild cognitive impairments, dementia, mild traumatic brain injury, migraine, COVID-19, stroke, epilepsy, and psychological conditions (e.g., anxiety, stress, and schizophrenia). Efforts are needed to improve the dynamic and intriguing heart-brain interactions.
Collapse
Affiliation(s)
- Xianghong Arakaki
- Cognition and Brain Integration Laboratory, Department of Neurosciences, Huntington Medical Research Institutes, Pasadena, CA, United States
| | - Rebecca J. Arechavala
- Department of Environmental and Occupational Health, University of California, Irvine, Irvine, CA, United States
| | - Elizabeth H. Choy
- Department of Environmental and Occupational Health, University of California, Irvine, Irvine, CA, United States
| | - Jayveeritz Bautista
- Department of Environmental and Occupational Health, University of California, Irvine, Irvine, CA, United States
| | - Bishop Bliss
- Department of Environmental and Occupational Health, University of California, Irvine, Irvine, CA, United States
| | - Cathleen Molloy
- Cognition and Brain Integration Laboratory, Department of Neurosciences, Huntington Medical Research Institutes, Pasadena, CA, United States
| | - Daw-An Wu
- Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, CA, United States
| | - Shinsuke Shimojo
- Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, CA, United States
| | - Yang Jiang
- Department of Behavioral Science, College of Medicine, University of Kentucky, Lexington, KY, United States
| | - Michael T. Kleinman
- Department of Environmental and Occupational Health, University of California, Irvine, Irvine, CA, United States
| | - Robert A. Kloner
- Cardiovascular Research, Huntington Medical Research Institutes, Pasadena, CA, United States
- Division of Cardiovascular Medicine, Department of Medicine, Keck School of Medicine of University of Southern California, Los Angeles, CA, United States
| |
Collapse
|
5
|
Noguchi M, Toma FM, Seiner EJ, Wu DAJ, Shehata MH, Shimojo S. Neural networks vs. humans in assessing trademark similarities. J Vis 2022. [DOI: 10.1167/jov.22.14.3872] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
|
6
|
Marks T, Hung SM(S, Wu DA, Adams S, Shimojo S. Saccade trajectories reflect subliminal priming. J Vis 2022. [DOI: 10.1167/jov.22.14.3843] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
|
7
|
Hung SM(S, Wu DA, Hsieh PJ(B, Shimojo S. Tracking contingency unconsciously. J Vis 2022. [DOI: 10.1167/jov.22.14.3818] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
Affiliation(s)
- Shao-Min (Sean) Hung
- Biology and Biological Engineering, California Institute of Technology, Pasadena, CA, USA
| | - Daw-An Wu
- Biology and Biological Engineering, California Institute of Technology, Pasadena, CA, USA
| | | | - Shinsuke Shimojo
- Biology and Biological Engineering, California Institute of Technology, Pasadena, CA, USA
- Computation and Neural Systems, California Institute of Technology, Pasadena, CA, USA
| |
Collapse
|
8
|
Shimojo K, Katsuragi R, Shimojo E, Akashi T, Shimojo S. Preservation of conditioned behavior based on UV light sensitivity in dissected tail halves of planarians – a proof by DNN. J Vis 2022. [DOI: 10.1167/jov.22.14.3639] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
Affiliation(s)
| | | | - Eiko Shimojo
- California Institute of Technology, Division of Biology & Biological Engineering
| | - Takuya Akashi
- Iwate University, Graduate School of Arts and Sciences
| | - Shinsuke Shimojo
- California Institute of Technology, Division of Biology & Biological Engineering
| |
Collapse
|
9
|
Hung S(S, Wu D, Shimojo S, Arakaki X. Practice makes imperfect: Positive correlation between practice and implicit distraction in asymptomatic individuals with Alzheimer’s disease pathology. Alzheimers Dement 2022. [DOI: 10.1002/alz.069470] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Affiliation(s)
| | - Daw‐An Wu
- California Institute of Technology Pasadena CA USA
| | | | | |
Collapse
|
10
|
Hung S, Wu D, Shimojo S, Arakaki X. Stronger implicit interference in cognitively healthy older participants with higher risk of Alzheimer's disease. Alzheimers Dement (Amst) 2022; 14:e12340. [PMID: 36187196 PMCID: PMC9489163 DOI: 10.1002/dad2.12340] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/14/2021] [Revised: 06/05/2022] [Accepted: 06/10/2022] [Indexed: 01/09/2023]
Abstract
Introduction Abnormal cerebrospinal fluid amyloid beta (Aβ)42 and tau levels have been revealed decades before symptoms onset in Alzheimer's disease (AD); however, the examination is usually invasive and inaccessible to most people. We thus aimed to develop a non-invasive behavioral test that targets early potential cognitive changes to gauge cognitive decline. Specifically, we hypothesized that older cognitive healthy participants would exhibit comparable performance when the task was explicit and relied on conscious cognition. However, when the task was implicit, the performance of participants at high and low risks for AD would bifurcate. That is, early changes in unconscious cognition could be linked to cognitive health. Methods We measured implicit interference elicited by an imperceptible distractor in cognitively healthy elderly participants with normal (low risk) and pathological (high risk) Aβ42/total tau ratio. Participants were required to perform a Stroop task (word-naming or color-naming on an ink-semantics inconsistent word) with a visually masked distractor presented prior to the target task. Results We found that, under a high-effort task (i.e., color-naming in the Stroop task), high-risk participants suffered interference when the imperceptible distractor and the subsequent target were incongruent in the responses they triggered. Their reaction times were slowed down by approximately 4%. This implicit interference was not found in the low-risk participants. Discussion These findings indicate that weakened inhibition of distracting implicit information can be a potential behavioral biomarker of early identification of AD pathology. Our study thus offers a new experimental paradigm to reveal early pathological aging by assessing how individuals respond to subperceptual threshold visual stimuli.
Collapse
Affiliation(s)
- Shao‐Min Hung
- Biology and Biological EngineeringCalifornia Institute of TechnologyPasadenaCaliforniaUSA,Faculty of Science and EngineeringWaseda UniversityTokyoJapan
| | - Daw‐An Wu
- Biology and Biological EngineeringCalifornia Institute of TechnologyPasadenaCaliforniaUSA
| | - Shinsuke Shimojo
- Biology and Biological EngineeringCalifornia Institute of TechnologyPasadenaCaliforniaUSA,Computation and Neural SystemsCalifornia Institute of TechnologyPasadenaCaliforniaUSA
| | | |
Collapse
|
11
|
Stiles NRB, Tanguay AR, Shimojo S. Crossmodal Postdiction: Conscious Perception as Revisionist History. J Percept Imaging 2022; 5:jpi0150. [PMID: 35464341 PMCID: PMC9028020 DOI: 10.2352/j.percept.imaging.2022.5.000403] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Postdiction occurs when later stimuli influence the perception of earlier stimuli. As the multisensory science field has grown in recent decades, the investigation of crossmodal postdictive phenomena has also expanded. Crossmodal postdiction can be considered (in its simplest form) the phenomenon in which later stimuli in one modality influence earlier stimuli in another modality (e.g., Intermodal Apparent Motion). Crossmodal postdiction can also appear in more nuanced forms, such as unimodal postdictive illusions (e.g., Apparent Motion) that are influenced by concurrent crossmodal stimuli (e.g., Crossmodal Influence on Apparent Motion), or crossmodal illusions (e.g., the Double Flash Illusion) that are influenced postdictively by a stimulus in one or the other modality (e.g., a visual stimulus in the Illusory Audiovisual Rabbit Illusion). In this review, these and other varied forms of crossmodal postdiction will be discussed. Three neuropsychological models proposed for unimodal postdiction will be adapted to the unique aspects of processing and integrating multisensory stimuli. Crossmodal postdiction opens a new window into sensory integration, and could potentially be used to identify new mechanisms of crossmodal crosstalk in the brain.
Collapse
Affiliation(s)
- Noelle R B Stiles
- Department of Ophthalmology, University of Southern California, Los Angeles, CA, 90033, USA
| | - Armand R Tanguay
- Departments of Electrical and Computer Engineering, Chemical Engineering and Materials Science, Biomedical Engineering, Ophthalmology, Physics and Astronomy, and Neuroscience Graduate Program, University of Southern California, Los Angeles, CA, 90089, USA
| | - Shinsuke Shimojo
- Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, CA, 91125, USA
| |
Collapse
|
12
|
Wu D, Adams SW, Hung S, Rossi IP, Harrington MG, Shimojo S, Arakaki X. Preliminary analysis of qEEG during a subliminally‐primed task‐switching test in pre‐symptomatic Alzheimer’s disease. Alzheimers Dement 2021. [DOI: 10.1002/alz.057869] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Affiliation(s)
- Daw‐An Wu
- California Institute of Technology Pasadena CA USA
| | | | | | | | - Michael G. Harrington
- Huntington Medical Research Institutes Pasadena CA USA
- Keck School of Medicine, University of Southern California Los Angeles CA USA
| | | | - Xianghong Arakaki
- Huntington Medical Research Institutes Pasadena CA USA
- Keck School of Medicine, University of Southern California Los Angeles CA USA
| |
Collapse
|
13
|
Arechavala RJ, Rochart R, Kloner RA, Liu A, Wu DA, Hung SM, Shimojo S, Fonteh AN, Kleinman MT, Harrington MG, Arakaki X. Task switching reveals abnormal brain-heart electrophysiological signatures in cognitively healthy individuals with abnormal CSF amyloid/tau, a pilot study. Int J Psychophysiol 2021; 170:102-111. [PMID: 34666107 PMCID: PMC8865562 DOI: 10.1016/j.ijpsycho.2021.10.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2021] [Revised: 10/03/2021] [Accepted: 10/12/2021] [Indexed: 11/07/2022]
Abstract
Electroencephalographic (EEG) alpha oscillations have been related to heart rate variability (HRV) and both change in Alzheimer’s disease (AD). We explored if task switching reveals altered alpha power and HRV in cognitively healthy individuals with AD pathology in cerebrospinal fluid (CSF) and whether HRV improves the AD pathology classification by alpha power alone. We compared low and high alpha event-related desynchronization (ERD) and HRV parameters during task switch testing between two groups of cognitively healthy participants classified by CSF amyloid/tau ratio: normal (CH-NAT, n = 19) or pathological (CH-PAT, n = 27). For the task switching paradigm, participants were required to name the color or word for each colored word stimulus, with two sequential stimuli per trial. Trials include color (cC) or word (wW) repeats with low load repeating, and word (cW) or color switch (wC) for high load switching. HRV was assessed for RR interval, standard deviation of RR-intervals (SDNN) and root mean squared successive differences (RMSSD) in time domain, and low frequency (LF), high frequency (HF), and LF/HF ratio in frequency domain. Results showed that CH-PATs compared to CH-NATs presented: 1) increased (less negative) low alpha ERD during low load repeat trials and lower word switch cost (low alpha: p = 0.008, Cohen’s d = −0.83, 95% confidence interval −1.44 to −0.22, and high alpha: p = 0.019, Cohen’s d = −0.73, 95% confidence interval −1.34 to −0.13); 2) decreasing HRV from rest to task, suggesting hyper-activated sympatho-vagal responses. 3) CH-PATs classification by alpha ERD was improved by supplementing HRV signatures, supporting a potentially compromised brain-heart interoceptive regulation in CH-PATs. Further experiments are needed to validate these findings for clinical significance.
Collapse
Affiliation(s)
| | - Roger Rochart
- Neurosciences, Huntington Medical Research Institutes, Pasadena, CA 91105, USA
| | - Robert A Kloner
- Cardiovascular Research, Huntington Medical Research Institutes, Pasadena, CA 91105, USA; Division of Cardiovascular Medicine, Dept of Medicine, Keck School of Medicine at University of Southern California, Los Angeles, CA 90033, USA
| | - Anqi Liu
- Department of Computing and Mathematical Sciences (CMS), California Institute of Technology, Pasadena, CA 91125, USA; Department of Computer Science, Whiting School of Engineering, Johns Hopkins University, Baltimore, MD 21218, USA
| | - Daw-An Wu
- Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, CA 91125, USA
| | - Shao-Min Hung
- Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, CA 91125, USA
| | - Shinsuke Shimojo
- Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, CA 91125, USA
| | - Alfred N Fonteh
- Neurosciences, Huntington Medical Research Institutes, Pasadena, CA 91105, USA
| | | | - Michael G Harrington
- Neurology, Keck School of Medicine at University of Southern California, Los Angeles, CA 90033, USA
| | - Xianghong Arakaki
- Neurosciences, Huntington Medical Research Institutes, Pasadena, CA 91105, USA.
| |
Collapse
|
14
|
Shimojo K, Shimojo E, Shimojo S. New evidence for preservation of conditioned behavior based on UV light sensitivity in dissected tail halves of planarians. J Vis 2021. [DOI: 10.1167/jov.21.9.2326] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
| | - Eiko Shimojo
- California Institute of Technology, Division of Biology & Biological Engineering
| | - Shinsuke Shimojo
- California Institute of Technology, Division of Biology & Biological Engineering / Computation & Neural Systems
| |
Collapse
|
15
|
Hung S, Wu D, Harrington MG, Shimojo S, Arakaki X. Implicit response incompatibility slowed down asymptomatic individuals with Alzheimer’s disease pathology. Alzheimers Dement 2020. [DOI: 10.1002/alz.044884] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Affiliation(s)
- Shao‐Min Hung
- California Institute of Technology Pasadena CA USA
- Huntington Medical Research Institutes Pasadena CA USA
| | - Daw‐An Wu
- California Institute of Technology Pasadena CA USA
| | | | | | | |
Collapse
|
16
|
Liao HI, Kashino M, Shimojo S. Attractiveness in the Eyes: A Possibility of Positive Loop between Transient Pupil Constriction and Facial Attraction. J Cogn Neurosci 2020; 33:315-340. [PMID: 33166194 DOI: 10.1162/jocn_a_01649] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Contrary to the long-held belief of a close linkage between pupil dilation and attractiveness, we found an early and transient pupil constriction response when participants viewed an attractive face (and the effect of luminance/contrast was controlled). While human participants were making an attractiveness judgment on faces, their pupil constricted more for the more attractive (as-to-be-rated) faces. Further experiments showed that the effect of pupil constriction to attractiveness judgment extended to intrinsically esthetic visual objects such as natural scene images (as well as faces) but not to line-drawing geometric figures. When participants were asked to judge the roundness of faces, pupil constriction still correlated with their attractiveness but not the roundness rating score, indicating the automaticity of the pupil constriction to attractiveness. When pupillary responses were manipulated implicitly by relative background luminance changes (from the prestimulus screen), the facial attractiveness ratings were in accordance with the amount of pupil constriction, which could not be explained solely by simultaneous or sequential luminance contrast. The overall results suggest that pupil constriction not only reflects but, as a part of self-monitoring and attribution mechanisms, also possibly contributes to facial attractiveness implicitly.
Collapse
Affiliation(s)
| | - Makio Kashino
- NTT Corporation, Atsugi, Kanagawa, Japan.,Tokyo Institute of Technology
| | | |
Collapse
|
17
|
Adams S, Wu DA, Shimojo S. Dynamic vision in the extreme-periphery: Perception of flicker rate. J Vis 2020. [DOI: 10.1167/jov.20.11.1714] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
- Sara Adams
- Biology and Biological Engineering, California Institute of Technology
| | - Daw-An Wu
- Biology and Biological Engineering, California Institute of Technology
| | - Shinsuke Shimojo
- Biology and Biological Engineering, California Institute of Technology
- Computation and Neural Systems, California Institute of Technology
| |
Collapse
|
18
|
Tanguay, Jr. AR, Stiles NRB, Ganguly I, Shimojo S. Mapping Audio-Visual Crossmodal Interactions in the Visually Impaired. J Vis 2020. [DOI: 10.1167/jov.20.11.1768] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
- Armand R. Tanguay, Jr.
- Departments of Electrical Engineering, Chemical Engineering and Materials Science, Biomedical Engineering, Ophthalmology, Physics and Astronomy, and Neuroscience Graduate Program, University of Southern California
- Division of Biology and Biological Engineering, California Institute of Technology
| | - Noelle R. B. Stiles
- Division of Biology and Biological Engineering, California Institute of Technology
- Department of Ophthalmology, University of Southern California
| | - Ishani Ganguly
- Division of Biology and Biological Engineering, California Institute of Technology
| | - Shinsuke Shimojo
- Division of Biology and Biological Engineering, California Institute of Technology
| |
Collapse
|
19
|
Stiles NRB, Tanguay AR, Shimojo S. The Dynamic Double Flash Illusion: Auditory Triggered Replay of Illusory Visual Expansion. Multisens Res 2020; 33:87-108. [PMID: 31648193 DOI: 10.1163/22134808-20191392] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2018] [Accepted: 07/17/2019] [Indexed: 11/19/2022]
Abstract
In the original double flash illusion, a visual flash (e.g., a sharp-edged disk, or uniformly filled circle) presented with two short auditory tones (beeps) is often followed by an illusory flash. The illusory flash has been previously shown to be triggered by the second auditory beep. The current study extends the double flash illusion by showing that this paradigm can not only create the illusory repeat of an on-off flash, but also trigger an illusory expansion (and in some cases a subsequent contraction) that is induced by the flash of a circular brightness gradient (gradient disk) to replay as well. The perception of the dynamic double flash illusion further supports the interpretation of the illusory flash (in the double flash illusion) as similar in its spatial and temporal properties to the perception of the real visual flash, likely by replicating the neural processes underlying the illusory expansion of the real flash. We show further that if a gradient disk (generating an illusory expansion) and a sharp-edged disk are presented simultaneously side by side with two sequential beeps, often only one visual stimulus or the other will be perceived to double flash. This indicates selectivity in auditory-visual binding, suggesting the usefulness of this paradigm as a psychophysical tool for investigating crossmodal binding phenomena.
Collapse
Affiliation(s)
- Noelle R B Stiles
- 1Department of Ophthalmology, University of Southern California, Los Angeles, CA, USA.,2Division of Biology and Biological Engineering, and Computation and Neural Systems Program, California Institute of Technology, Pasadena, CA, USA
| | - Armand R Tanguay
- 2Division of Biology and Biological Engineering, and Computation and Neural Systems Program, California Institute of Technology, Pasadena, CA, USA.,3Departments of Electrical Engineering-Electrophysics, Chemical Engineering and Materials Science, Biomedical Engineering, Ophthalmology, and Physics and Astronomy; Neuroscience Graduate Program, University of Southern California, Los Angeles, CA, USA
| | - Shinsuke Shimojo
- 2Division of Biology and Biological Engineering, and Computation and Neural Systems Program, California Institute of Technology, Pasadena, CA, USA
| |
Collapse
|
20
|
Shimojo S, Wu DAJ, Shimojo K, Shimojo E, Suegami T, Shehata M, Stiles NR, Berger CC, Tanguay AR. Vision in the Extreme Periphery (1a):Auditory Modulation of Flicker Perception. J Vis 2019. [DOI: 10.1167/19.10.174a] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
- Shinsuke Shimojo
- California Institute of Technology (Biology and Biological Engineering)
| | - Daw-An J Wu
- California Institute of Technology (Biology and Biological Engineering)
| | | | - Eiko Shimojo
- California Institute of Technology (Biology and Biological Engineering)
| | - Takashi Suegami
- California Institute of Technology (Biology and Biological Engineering)
- Yamaha Motor Corporation U.S.A
| | - Mohammad Shehata
- California Institute of Technology (Biology and Biological Engineering)
- Toyohashi University of Technology
| | - Noelle R Stiles
- University of Southern California (Keck School of Medicine, Institute for Biomedical Therapeutics)
| | | | - Armand R Tanguay
- California Institute of Technology (Biology and Biological Engineering)
- University of Southern California (Departments of Electrical Engineering, Chemical Engineering and Materials Science, Biomedical Engineering, Ophthalmology, and Physics and Astronomy and Neuroscience Graduate Program)
| |
Collapse
|
21
|
Shirai Y, Suegami T, Shehata M, Shimojo S, Nakauchi S. Vision in the extreme-periphery (3b): effects of eccentricity and foveal input on color perception. J Vis 2019. [DOI: 10.1167/19.10.72] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
- Yusuke Shirai
- Department of Computer Science and Engineering, Toyohashi University of Technology
| | - Takashi Suegami
- Biology & Biological Engineering, California Institute of Technology
- Yamaha Motor Corporation U.S.A
| | - Mohammad Shehata
- Department of Computer Science and Engineering, Toyohashi University of Technology
- Biology & Biological Engineering, California Institute of Technology
| | - Shinsuke Shimojo
- Department of Computer Science and Engineering, Toyohashi University of Technology
- Biology & Biological Engineering, California Institute of Technology
| | - Shigeki Nakauchi
- Department of Computer Science and Engineering, Toyohashi University of Technology
| |
Collapse
|
22
|
Zhai AJ, Hung SM(S, Shimojo S. The role of color preference under interocular suppression. J Vis 2019. [DOI: 10.1167/19.10.264b] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
- Albert J Zhai
- Computing and Mathematical Sciences, California Institute of Technology
| | - Shao-Min (Sean) Hung
- Biology and Biological Engineering, California Institute of Technology
- Huntington Medical Research Institutes
| | - Shinsuke Shimojo
- Biology and Biological Engineering, California Institute of Technology
| |
Collapse
|
23
|
Wu DA, Suegami T, Shimojo S. Vision in the extreme-periphery (1b): perception of rotation rate. J Vis 2019. [DOI: 10.1167/19.10.68] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
| | - Takashi Suegami
- California Institute of Technology
- Yamaha Motor Corporation U. S. A
| | | |
Collapse
|
24
|
Hung SM(S, Wu DA, Shimojo S. The automatic and non-automatic aspects of unconscious visual processing. J Vis 2019. [DOI: 10.1167/19.10.104] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
- Shao-Min (Sean) Hung
- Biology and Biological Engineering, California Institute of Technology
- Huntington Medical Research Institutes
| | - Daw-An Wu
- Biology and Biological Engineering, California Institute of Technology
| | - Shinsuke Shimojo
- Biology and Biological Engineering, California Institute of Technology
| |
Collapse
|
25
|
Shehata M, Suegami T, Shirai Y, Wu DA, Nakauchi S, Shimojo S. Vision in the extreme-periphery (3a): color perception is induced by foveal input. J Vis 2019. [DOI: 10.1167/19.10.71c] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
- Mohammad Shehata
- California Institute of Technology
- Toyohashi University of Technology
| | - Takashi Suegami
- California Institute of Technology
- Yamaha Motor Corporation U.S.A
| | | | | | | | - Shinsuke Shimojo
- California Institute of Technology
- Toyohashi University of Technology
| |
Collapse
|
26
|
Tanguay AR, Stiles NRB, Ganguly I, Shimojo S. Time Dependence of Predictive and Postdictive Auditory-Visual Processing: The Temporally Extended Audiovisual Rabbit Illusion. J Vis 2019. [DOI: 10.1167/19.10.19b] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
- Armand R. Tanguay
- University of Southern California, Departments of Electrical Engineering, Chemical Engineering and Materials Science, Biomedical Engineering, Ophthalmology, and Physics and Astronomy, and Neuroscience Graduate Program
- California Institute of Technology, Division of Biology and Biological Engineering
| | - Noelle R. B. Stiles
- California Institute of Technology, Division of Biology and Biological Engineering
- University of Southern California, Department of Ophthalmology
| | - Ishani Ganguly
- California Institute of Technology, Division of Biology and Biological Engineering
| | - Shinsuke Shimojo
- California Institute of Technology, Division of Biology and Biological Engineering
| |
Collapse
|
27
|
Suegami T, Berger CC, Wu DA, Changizi M, Shimojo S. Vision in the extreme-periphery (2): Concurrent auditory stimuli degrade visual detection. J Vis 2019. [DOI: 10.1167/19.10.19c] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
- Takashi Suegami
- Yamaha Motor Corporation U.S.A
- California Institute of Technology
| | | | | | | | | |
Collapse
|
28
|
Stiles NRB, Li M, Levitan CA, Kamitani Y, Shimojo S. What you saw is what you will hear: Two new illusions with audiovisual postdictive effects. PLoS One 2018; 13:e0204217. [PMID: 30281629 PMCID: PMC6169875 DOI: 10.1371/journal.pone.0204217] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2017] [Accepted: 09/05/2018] [Indexed: 11/30/2022] Open
Abstract
Neuroscience investigations are most often focused on the prediction of future perception or decisions based on prior brain states or stimulus presentations. However, the brain can also process information retroactively, such that later stimuli impact conscious percepts of the stimuli that have already occurred (called “postdiction”). Postdictive effects have thus far been mostly unimodal (such as apparent motion), and the models for postdiction have accordingly been limited to early sensory regions of one modality. We have discovered two related multimodal illusions in which audition instigates postdictive changes in visual perception. In the first illusion (called the “Illusory Audiovisual Rabbit”), the location of an illusory flash is influenced by an auditory beep-flash pair that follows the perceived illusory flash. In the second illusion (called the “Invisible Audiovisual Rabbit”), a beep-flash pair following a real flash suppresses the perception of the earlier flash. Thus, we showed experimentally that these two effects are influenced significantly by postdiction. The audiovisual rabbit illusions indicate that postdiction can bridge the senses, uncovering a relatively-neglected yet critical type of neural processing underlying perceptual awareness. Furthermore, these two new illusions broaden the Double Flash Illusion, in which a single real flash is doubled by two sounds. Whereas the double flash indicated that audition can create an illusory flash, these rabbit illusions expand audition’s influence on vision to the suppression of a real flash and the relocation of an illusory flash. These new additions to auditory-visual interactions indicate a spatio-temporally fine-tuned coupling of the senses to generate perception.
Collapse
Affiliation(s)
- Noelle R. B. Stiles
- Biology and Biological Engineering, California Institute of Technology, Pasadena, California, United States of America
- * E-mail:
| | - Monica Li
- Biology and Biological Engineering, California Institute of Technology, Pasadena, California, United States of America
| | - Carmel A. Levitan
- Cognitive Science, Occidental College, Los Angeles, California, United States of America
| | - Yukiyasu Kamitani
- Graduate School of Informatics, Kyoto University, Kyoto, Japan
- ATR Computational Neuroscience Laboratories, Seika, Soraku, Kyoto, Japan
| | - Shinsuke Shimojo
- Biology and Biological Engineering, California Institute of Technology, Pasadena, California, United States of America
| |
Collapse
|
29
|
Shiromi K, Hiroshi H, Shehata M, Shimojo S, Nakauchi S. #TheDress type of color ambiguity induced by T-shirt image based on physically-based rendering. J Vis 2018. [DOI: 10.1167/18.10.221] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
- Kai Shiromi
- Department of Computer Science and Engineering, Toyohashi University of Technology
| | - Higashi Hiroshi
- Department of Computer Science and Engineering, Toyohashi University of Technology
| | - Mohammad Shehata
- Department of Computer Science and Engineering, Toyohashi University of TechnologyBiology and Biological Engineering, California Institute of Technology
| | - Shinsuke Shimojo
- Biology and Biological Engineering, California Institute of Technology
| | - Shigeki Nakauchi
- Department of Computer Science and Engineering, Toyohashi University of Technology
| |
Collapse
|
30
|
Affiliation(s)
- Mohammad Shehata
- Division of Biology and Biological Engineering, California Institute of Technology, CADepartment of Computer Science and Engineering, Toyohashi University of Technology, Japan
| | - Salma Elnagar
- Division of Biology and Biological Engineering, California Institute of Technology, CAUniversity of Cambridge, UK
| | - Shota Yasunaga
- Division of Biology and Biological Engineering, California Institute of Technology, CAPitzer College, CA
| | - Shigeki Nakauchi
- Department of Computer Science and Engineering, Toyohashi University of Technology, Japan
| | - Shinsuke Shimojo
- Division of Biology and Biological Engineering, California Institute of Technology, CA
| |
Collapse
|
31
|
Shimojo S, Lin YJ, Liang W. Both Intra- and Supra-Modal Time Perception Mechanisms Exist: Evidence from Debut Chronostasis. J Vis 2018. [DOI: 10.1167/18.10.1130] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
- Shinsuke Shimojo
- Computation and Neural Systems / Biology & Biological Engineering, California Institute of Technology
| | - Yong-Jun Lin
- Computation and Neural Systems / Biology & Biological Engineering, California Institute of Technology
| | - William Liang
- Computation and Neural Systems / Biology & Biological Engineering, California Institute of Technology
| |
Collapse
|
32
|
Lin YJ, Shimojo S. Uncertainty of the Internal Duration Template Dilates Subjective Time. J Vis 2018. [DOI: 10.1167/18.10.332] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
- Yong-Jun Lin
- Computation and Neural Systems, California Institute of Technology
| | - Shinsuke Shimojo
- Computation and Neural Systems, California Institute of Technology
| |
Collapse
|
33
|
Date S, Kaishima T, Shimojo S, Ichikawa K. A Framework Supporting the Development of a Grid Portal for Analysis Based on ROI. Methods Inf Med 2018. [DOI: 10.1055/s-0038-1633960] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
Abstract
Summary
Objectives:
In our research on brain function analysis, users require two different simultaneous types of processing: interactive processing to a specific part of data and high-performance batch processing to an entire dataset. The difference between these two types of processing is in whether or not the analysis is for data in the region of interest (ROI). In this study, we propose a Grid portal that has a mechanism to freely assign computing resources to the users on a Grid environment according to the users’ two different types of processing requirements.
Methods:
We constructed a Grid portal which integrates interactive processing and batch processing by the following two mechanisms. First, a job steering mechanism controls job execution based on user-tagged priority among organizations with heterogeneous computing resources. Interactive jobs are processed in preference to batch jobs by this mechanism. Second, a priority-based result delivery mechanism that administrates a rank of data significance.
Results:
The portal ensures a turn-around time of interactive processing by the priority-based job controlling mechanism, and provides the users with quality of services (QoS) for interactive processing. The users can access the analysis results of interactive jobs in preference to the analysis results of batch jobs. The Grid portal has also achieved high-performance computation of MEG analysis with batch processing on the Grid environment.
Conclusion:
The priority-based job controlling mechanism has been realized to freely assign computing resources to the users’ requirements. Furthermore the achievement of high-performance computation contributes greatly to the overall progress of brain science. The portal has thus made it possible for the users to flexibly include the large computational power in what they want to analyze.
Collapse
|
34
|
Nakauchi S, Shiromi K, Higashi H, Shehata M, Shimojo S. Luminance-contrast reversal disambiguates illumination interpretation in #TheDress. J Vis 2017. [DOI: 10.1167/17.10.137] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
- Shigeki Nakauchi
- Department of Computer Science and Engineering, Toyohashi University of Technology
| | - Kai Shiromi
- Department of Computer Science and Engineering, Toyohashi University of Technology
| | - Hiroshi Higashi
- Department of Computer Science and Engineering, Toyohashi University of Technology
| | - Mohammad Shehata
- Department of Computer Science and Engineering, Toyohashi University of TechnologyBiology and Biological Engineering, California Institute of Technology
| | - Shinsuke Shimojo
- Biology and Biological Engineering, California Institute of Technology
| |
Collapse
|
35
|
Tanguay, Jr. A, Bailey B, Stiles N, Levitan C, Shimojo S. The Spatial Double Flash Illusion: Audition-Induced Spatial Displacement. J Vis 2017. [DOI: 10.1167/17.10.197] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
- Armand Tanguay, Jr.
- Departments of Electrical Engineering, Biomedical Engineering, and Ophthalmology, University of Southern CaliforniaDivision of Biology and Biological Engineering, California Institute of Technology
| | - Bolton Bailey
- Division of Biology and Biological Engineering, California Institute of Technology
| | - Noelle Stiles
- Division of Biology and Biological Engineering, California Institute of TechnologyDepartment of Ophthalmology, University of Southern California
| | - Carmel Levitan
- Division of Biology and Biological Engineering, California Institute of TechnologyDepartment of Cognitive Science, Occidental College
| | - Shinsuke Shimojo
- Division of Biology and Biological Engineering, California Institute of Technology
| |
Collapse
|
36
|
Lin YJ, Shimojo S. Task-relevant attention and repetition suppression co-determine perceived duration. J Vis 2017. [DOI: 10.1167/17.10.188] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
- Yong-Jun Lin
- Computation and Neural Systems, California Institute of Technology
| | - Shinsuke Shimojo
- Computation and Neural Systems, California Institute of Technology
| |
Collapse
|
37
|
Stiles N, Tanguay, Jr. A, Shimojo S. The Expanding and Shrinking Double Flash: An Auditory Triggered Dynamic Replay of a Visual Stimulus. J Vis 2017. [DOI: 10.1167/17.10.196] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
- Noelle Stiles
- Division of Biology and Biological Engineering, California Institute of TechnologyDepartment of Ophthalmology, University of Southern California
| | - Armand Tanguay, Jr.
- Division of Biology and Biological Engineering, California Institute of TechnologyDepartments of Electrical Engineering, Biomedical Engineering, and Ophthalmology, University of Southern California
| | - Shinsuke Shimojo
- Division of Biology and Biological Engineering, California Institute of Technology
| |
Collapse
|
38
|
Abstract
The brain constantly adjusts perceived duration based on the recent event history. One such lab phenomenon is subjective time expansion induced in an oddball paradigm ("oddball chronostasis"), where the duration of a distinct item (oddball) appears subjectively longer when embedded in a series of other repeated items (standards). Three hypotheses have been separately proposed but it remains unresolved which or all of them are true: 1) attention prolongs oddball duration, 2) repetition suppression reduces standards duration, and 3) accumulative temporal preparation (anticipation) expedites the perceived item onset so as to lengthen its duration. We thus conducted critical systematic experiments to dissociate the relative contribution of all hypotheses, by orthogonally manipulating sequences types (repeated, ordered, or random) and target serial positions. Participants' task was to judge whether a target lasts shorter or longer than its reference. The main finding was that a random item sequence still elicited significant chronostasis even though each item was odd. That is, simply being a target draws top-down attention and induces chronostasis. In Experiments 1 (digits) and 2 (orientations), top-down attention explained about half of the effect while saliency/adaptation explained the other half. Additionally, for non-repeated (ordered and random) sequence types, a target with later serial position still elicited stronger chronostasis, favoring a temporal preparation over a repetition suppression account. By contrast, in Experiment 3 (colors), top-down attention was likely the sole factor. Consequently, top-down attention is necessary and sometimes sufficient to explain oddball chronostasis; saliency/adaptation and temporal preparation are contingent factors. These critical boundary conditions revealed in our study serve as quantitative constraints for neural models of duration perception.
Collapse
Affiliation(s)
- Yong-Jun Lin
- Computation and Neural Systems, Division of Biology, California Institute of Technology, Pasadena, California, United States of America
- * E-mail:
| | - Shinsuke Shimojo
- Computation and Neural Systems, Division of Biology, California Institute of Technology, Pasadena, California, United States of America
| |
Collapse
|
39
|
Li M, Stiles N, Levitan C, Kamitani Y, Shimojo S. Audiovisual "Invisible Rabbit": Auditory Suppression of Visual Flashes in Spatiotemporal Stimuli. J Vis 2016. [DOI: 10.1167/16.12.868] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
|
40
|
Stiles N, Chib V, Shimojo S. Auditory Crossmodal Plasticity Can Activate Visual Regions Automatically and Mildly Deactivate Natural Vision. J Vis 2016. [DOI: 10.1167/16.12.539] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
|
41
|
Shimojo S, Stiles N, Li M, Levitan C, Kamitani Y. Audiovisual "Illusory Rabbit": The Role of Postdiction in Crossmodal Spatiotemporal Dynamics. J Vis 2016. [DOI: 10.1167/16.12.869] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
|
42
|
Abstract
When our visual system is confronted with ambiguous stimuli, the perceptual interpretation spontaneously alternates between the competing incompatible interpretations. The timing of such perceptual alternations is highly stochastic and the underlying neural mechanisms are poorly understood. We show that perceptual alternations can be triggered by a transient stimulus presented nearby. The induction was tested for four types of bistable stimuli: structure-from-motion, binocular rivalry, Necker cube, and ambiguous apparent motion. While underlying mechanisms may vary among them, a transient flash induced time-locked perceptual alternations in all cases. The effect showed a dependence on the adaptation to the dominant percept prior to the presentation of a flash. These perceptual alternations show many similarities to perceptual disappearances induced by transient stimuli (Kanai and Kamitani, 2003 Journal of Cognitive Neuroscience15 664–672; Moradi and Shimojo, 2004 Vision Research44 449–460). Mechanisms linking these two transient-induced phenomena are discussed.
Collapse
Affiliation(s)
- Ryota Kanai
- Psychonomics Division, Helmholtz Research Institute, Universiteit Utrecht, Heidelberglaan 2, NL-3584 CS Utrecht, The Netherlands.
| | | | | | | |
Collapse
|
43
|
Abstract
Previous investigation found that the speed of saccadic eye movements is enhanced when a temporal interval (gap) is introduced between the disappearance of a foveal fixation mark and the appearance of a peripheral target (the gap paradigm). Attention was shown to be involved in the gap paradigm. Here, we investigated relevant temporal and spatial characteristics of attention, manipulating central fixation marks and peripheral targets. Results from three experiments indicate that (i) the speed of manual and eye-movement detection is accelerated when a fixation mark changes abruptly (in less than 100 ms) before its termination in the gap paradigm; (ii) the speed is further accelerated when a peripheral target location is pre-cued; (iii) sufficient time for fixation (1000 ms) is necessary for the facilitation. These results suggest that fast and transient attention at the fixation spot facilitates attentional disengagement process that urges a spatial-orienting mechanism. Sustained attention is required in the engagement process during the fixation.
Collapse
Affiliation(s)
- Y Tanaka
- Department of Neurobiology, Brain Research, Weizmann Institute of Science, Rehovot 76100, Israel
| | | |
Collapse
|
44
|
|
45
|
Stiles NRB, Zheng Y, Shimojo S. Length and orientation constancy learning in 2-dimensions with auditory sensory substitution: the importance of self-initiated movement. Front Psychol 2015; 6:842. [PMID: 26136719 PMCID: PMC4469823 DOI: 10.3389/fpsyg.2015.00842] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2015] [Accepted: 06/03/2015] [Indexed: 12/02/2022] Open
Abstract
A subset of sensory substitution (SS) devices translate images into sounds in real time using a portable computer, camera, and headphones. Perceptual constancy is the key to understanding both functional and phenomenological aspects of perception with SS. In particular, constancies enable object externalization, which is critical to the performance of daily tasks such as obstacle avoidance and locating dropped objects. In order to improve daily task performance by the blind, and determine if constancies can be learned with SS, we trained blind (N = 4) and sighted (N = 10) individuals on length and orientation constancy tasks for 8 days at about 1 h per day with an auditory SS device. We found that blind and sighted performance at the constancy tasks significantly improved, and attained constancy performance that was above chance. Furthermore, dynamic interactions with stimuli were critical to constancy learning with the SS device. In particular, improved task learning significantly correlated with the number of spontaneous left-right head-tilting movements while learning length constancy. The improvement from previous head-tilting trials even transferred to a no-head-tilt condition. Therefore, not only can SS learning be improved by encouraging head movement while learning, but head movement may also play an important role in learning constancies in the sighted. In addition, the learning of constancies by the blind and sighted with SS provides evidence that SS may be able to restore vision-like functionality to the blind in daily tasks.
Collapse
Affiliation(s)
- Noelle R B Stiles
- Shimojo Psychophysics Laboratory, Biology and Biological Engineering, California Institute of Technology Pasadena, CA, USA ; Shimojo Psychophysics Laboratory, Computation and Neural Systems, California Institute of Technology Pasadena, CA, USA
| | - Yuqian Zheng
- Mechanical Engineering, California Institute of Technology Pasadena, CA, USA
| | - Shinsuke Shimojo
- Shimojo Psychophysics Laboratory, Biology and Biological Engineering, California Institute of Technology Pasadena, CA, USA ; Shimojo Psychophysics Laboratory, Computation and Neural Systems, California Institute of Technology Pasadena, CA, USA
| |
Collapse
|
46
|
Ito T, Matsuda T, Shimojo S. Functional connectivity of the striatum in experts of stenography. Brain Behav 2015; 5:e00333. [PMID: 25874166 PMCID: PMC4396401 DOI: 10.1002/brb3.333] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/18/2014] [Revised: 01/17/2015] [Accepted: 01/25/2015] [Indexed: 11/08/2022] Open
Abstract
INTRODUCTION Stenography, or shorthand, is a unique set of skills that involves intensive training which is nearly life-long and orchestrating various brain functional modules, including auditory, linguistic, cognitive, mnemonic, and motor. Stenography provides cognitive neuroscientists with a unique opportunity to investigate the neural mechanisms underlying the neural plasticity that enables such a high degree of expertise. However, shorthand is quickly being replaced with voice recognition technology. We took this nearly final opportunity to scan the brains of the last alive shorthand experts of the Japanese language. METHODS Thirteen right-handed stenographers and fourteen right-handed controls participated in the functional magnetic resonance imaging (fMRI) study. RESULTS The fMRI data revealed plastic reorganization of the neural circuits around the putamen. The acquisition of expert skills was accompanied by structural and functional changes in the area. The posterior putamen is known as the execution center of acquired sensorimotor skills. Compared to nonexperts, the posterior putamen in stenographers had high covariation with the cerebellum and midbrain.The stenographers' brain developed different neural circuits from those of the nonexpert brain. CONCLUSIONS The current data illustrate the vigorous plasticity in the putamen and in its connectivity to other relevant areas in the expert brain. This is a case of vigorous neural plastic reorganization in response to massive overtraining, which is rare especially considering that it occurred in adulthood.
Collapse
Affiliation(s)
- Takehito Ito
- Brain Science Institute, Tamagawa University 6-1-1 Tamagawa Gakuen, Machida, Tokyo, 194-8610, Japan ; Molecular Neuroimaging Program, Molecular Imaging Center, National Institute of Radiological Sciences 4-9-1 Anagawa, Inage-ku, Chiba-shi, Chiba, 263-8555, Japan
| | - Tetsuya Matsuda
- Brain Science Institute, Tamagawa University 6-1-1 Tamagawa Gakuen, Machida, Tokyo, 194-8610, Japan
| | - Shinsuke Shimojo
- Division of Biology and Biological Engineering/Computation and Neural Systems, California Institute of Technology 139-74, Pasadena, California, 91125
| |
Collapse
|
47
|
Abstract
Incremental learning, in which new knowledge is acquired gradually through trial and error, can be distinguished from one-shot learning, in which the brain learns rapidly from only a single pairing of a stimulus and a consequence. Very little is known about how the brain transitions between these two fundamentally different forms of learning. Here we test a computational hypothesis that uncertainty about the causal relationship between a stimulus and an outcome induces rapid changes in the rate of learning, which in turn mediates the transition between incremental and one-shot learning. By using a novel behavioral task in combination with functional magnetic resonance imaging (fMRI) data from human volunteers, we found evidence implicating the ventrolateral prefrontal cortex and hippocampus in this process. The hippocampus was selectively “switched” on when one-shot learning was predicted to occur, while the ventrolateral prefrontal cortex was found to encode uncertainty about the causal association, exhibiting increased coupling with the hippocampus for high-learning rates, suggesting this region may act as a “switch,” turning on and off one-shot learning as required. A combination of neuroimaging and computational modeling suggests that a part of ventrolateral prefrontal cortex, in cooperation with the hippocampus, is responsible for switching between incremental and one-shot strategies for learning about causal relationships. Read the Synopsis. There are at least two distinct learning strategies for identifying the relationship between a cause and its consequence: (1) incremental learning, in which we gradually acquire knowledge through trial and error, and (2) one-shot learning, in which we rapidly learn from only a single pairing of a potential cause and a consequence. Little is known about how the brain switches between these two forms of learning. In this study, we provide evidence that the amount of uncertainty about the relationship between cause and consequence mediates the transition between incremental and one-shot learning. Specifically, the more uncertainty there is about the causal relationship, the higher the learning rate that is assigned to that stimulus. By imaging the brain while participants were performing the learning task, we also found that uncertainty about the causal association is encoded in the ventrolateral prefrontal cortex and that the degree of coupling between this region and the hippocampus increases during one-shot learning. We speculate that this prefrontal region may act as a “switch,” turning on and off one-shot learning as required.
Collapse
Affiliation(s)
- Sang Wan Lee
- Computation & Neural Systems, MC228-77, California Institute of Technology, Pasadena, California, United States of America
- Behavioral & Social Neuroscience, MC228-77, California Institute of Technology, Pasadena, California, United States of America
- Division of Humanities and Social Sciences, MC228-77, California Institute of Technology, Pasadena, California, United States of America
- * E-mail:
| | - John P. O’Doherty
- Computation & Neural Systems, MC228-77, California Institute of Technology, Pasadena, California, United States of America
- Behavioral & Social Neuroscience, MC228-77, California Institute of Technology, Pasadena, California, United States of America
- Division of Humanities and Social Sciences, MC228-77, California Institute of Technology, Pasadena, California, United States of America
| | - Shinsuke Shimojo
- Computation & Neural Systems, MC228-77, California Institute of Technology, Pasadena, California, United States of America
- Behavioral & Social Neuroscience, MC228-77, California Institute of Technology, Pasadena, California, United States of America
- Division of Biology and Biological Engineering, MC228-77, California Institute of Technology, Pasadena, California, United States of America
| |
Collapse
|
48
|
Gharib A, Mier D, Adolphs R, Shimojo S. Eyetracking of social preference choices reveals normal but faster processing in autism. Neuropsychologia 2015; 72:70-9. [PMID: 25921868 DOI: 10.1016/j.neuropsychologia.2015.04.027] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2014] [Revised: 04/05/2015] [Accepted: 04/24/2015] [Indexed: 10/23/2022]
Abstract
People with Autism Spectrum Disorder (ASD) have been reported to show atypical attention and evaluative processing, in particular for social stimuli such as faces. The usual measure in these studies is an explicit, subjective judgment, which is the culmination of complex-temporally extended processes that are not typically dissected in detail. Here we addressed a neglected aspect of social decision-making in order to gain further insight into the underlying mechanisms: the temporal evolution of the choice. We investigated this issue by quantifying the alternating patterns of gaze onto faces, as well as nonsocial stimuli, while subjects had to decide which of the two stimuli they preferred. Surprisingly, the temporal profile of fixations relating to choice (the so-called "gaze cascade") was entirely normal in ASD, as were the eventual preference choices. Despite these similarities, we found two key abnormalities: people with ASD made choices more rapidly than did control subjects across the board, and their reaction times for social preference judgments were insensitive to choice difficulty. We suggest that ASD features an altered decision-making process when basing choice on social preferences. One hypothesis motivated by these data is that a choice criterion is reached in ASD regardless of the discriminability of the options.
Collapse
Affiliation(s)
- Alma Gharib
- Division of Biology & Biological Engineering, California Institute of Technology, Pasadena, CA 91125, USA.
| | - Daniela Mier
- Department of Clinical Psychology, Central Institute of Mental Health, University of Heidelberg/Medical Faculty Mannheim, Germany
| | - Ralph Adolphs
- Division of Biology & Biological Engineering, California Institute of Technology, Pasadena, CA 91125, USA; Division of Humanities & Social Sciences, California Institute of Technology, Pasadena, CA 91125, USA
| | - Shinsuke Shimojo
- Division of Biology & Biological Engineering, California Institute of Technology, Pasadena, CA 91125, USA
| |
Collapse
|
49
|
Saegusa C, Intoy J, Shimojo S. Visual attractiveness is leaky: the asymmetrical relationship between face and hair. Front Psychol 2015; 6:377. [PMID: 25914656 PMCID: PMC4390982 DOI: 10.3389/fpsyg.2015.00377] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2014] [Accepted: 03/16/2015] [Indexed: 11/13/2022] Open
Abstract
Predicting personality is crucial when communicating with people. It has been revealed that the perceived attractiveness or beauty of the face is a cue. As shown in the well-known "what is beautiful is good" stereotype, perceived attractiveness is often associated with desirable personality. Although such research on attractiveness used mainly the face isolated from other body parts, the face is not always seen in isolation in the real world. Rather, it is surrounded by one's hairstyle, and is perceived as a part of total presence. In human vision, perceptual organization/integration occurs mostly in a bottom up, task-irrelevant fashion. This raises an intriguing possibility that task-irrelevant stimulus that is perceptually integrated with a target may influence our affective evaluation. In such a case, there should be a mutual influence between attractiveness perception of the face and surrounding hair, since they are assumed to share strong and unique perceptual organization. In the current study, we examined the influence of a task-irrelevant stimulus on our attractiveness evaluation, using face and hair as stimuli. The results revealed asymmetrical influences in the evaluation of one while ignoring the other. When hair was task-irrelevant, it still affected attractiveness of the face, but only if the hair itself had never been evaluated by the same evaluator. On the other hand, the face affected the hair regardless of whether the face itself was evaluated before. This has intriguing implications on the asymmetry between face and hair, and perceptual integration between them in general. Together with data from a post hoc questionnaire, it is suggested that both implicit non-selective and explicit selective processes contribute to attractiveness evaluation. The findings provide an understanding of attractiveness perception in real-life situations, as well as a new paradigm to reveal unknown implicit aspects of information integration for emotional judgment.
Collapse
Affiliation(s)
- Chihiro Saegusa
- R & D-Kansei Science Research, Kao Corporation Tokyo, Japan ; Division of Biology and Biological Engineering, California Institute of Technology Pasadena, CA, USA ; Research Center for Advanced Science and Technology, The University of Tokyo Tokyo, Japan
| | - Janis Intoy
- Division of Engineering and Applied Sciences, California Institute of Technology Pasadena, CA, USA
| | - Shinsuke Shimojo
- Division of Biology and Biological Engineering, California Institute of Technology Pasadena, CA, USA ; Computation and Neural Systems, California Institute of Technology Pasadena, CA, USA
| |
Collapse
|
50
|
Levitan CA, Ban YHA, Stiles NRB, Shimojo S. Rate perception adapts across the senses: evidence for a unified timing mechanism. Sci Rep 2015; 5:8857. [PMID: 25748443 PMCID: PMC4894401 DOI: 10.1038/srep08857] [Citation(s) in RCA: 22] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2014] [Accepted: 02/04/2015] [Indexed: 11/09/2022] Open
Abstract
The brain constructs a representation of temporal properties of events, such as duration and frequency, but the underlying neural mechanisms are under debate. One open question is whether these mechanisms are unisensory or multisensory. Duration perception studies provide some evidence for a dissociation between auditory and visual timing mechanisms; however, we found active crossmodal interaction between audition and vision for rate perception, even when vision and audition were never stimulated together. After exposure to 5 Hz adaptors, people perceived subsequent test stimuli centered around 4 Hz to be slower, and the reverse after exposure to 3 Hz adaptors. This aftereffect occurred even when the adaptor and test were different modalities that were never presented together. When the discrepancy in rate between adaptor and test increased, the aftereffect was attenuated, indicating that the brain uses narrowly-tuned channels to process rate information. Our results indicate that human timing mechanisms for rate perception are not entirely segregated between modalities and have substantial implications for models of how the brain encodes temporal features. We propose a model of multisensory channels for rate perception, and consider the broader implications of such a model for how the brain encodes timing.
Collapse
Affiliation(s)
- Carmel A Levitan
- Cognitive Science, Occidental College, 1600 Campus Road, Los Angeles CA 90041
| | - Yih-Hsin A Ban
- Cognitive Science, Occidental College, 1600 Campus Road, Los Angeles CA 90041
| | - Noelle R B Stiles
- Computation and Neural Systems, California Institute of Technology, 1200 E. California Blvd, Pasadena, CA 91125
| | - Shinsuke Shimojo
- 1] Computation and Neural Systems, California Institute of Technology, 1200 E. California Blvd, Pasadena, CA 91125 [2] Division of Biology and Biological Engineering, California Institute of Technology, 1200 E. California Blvd, Pasadena, CA 91125
| |
Collapse
|