Luminance- and texture-defined information processing in school-aged children with autism

DeepLumina: A Method Based on Deep Features and Luminance Information for Color Texture Classification

Color texture classification is a significant computer vision task to identify and categorize textures that we often observe in natural visual scenes in the real world. Without color and texture, it remains a tedious task to identify and recognize objects in nature. Deep architectures proved to be a better method for recognizing the challenging patterns from texture images. This paper proposes a method, DeepLumina, that uses features from the deep architectures and luminance information with RGB color space for efficient color texture classification. This technique captures convolutional neural network features from the ResNet101 pretrained models and uses luminance information from the luminance (Y) channel of the YIQ color model and performs classification with a support vector machine (SVM). This approach works in the RGB-luminance color domain, exploring the effectiveness of applying luminance information along with the RGB color space. Experimental investigation and analysis during the study show that the proposed method, DeepLumina, got an accuracy of 90.15% for the Flickr Material Dataset (FMD) and 73.63% for the Describable Textures dataset (DTD), which is highly promising. Comparative analysis with other color spaces and pretrained CNN-FC models are also conducted, which throws light into the significance of the work. The method also proved the computational simplicity and obtained results in lesser computation time.

Visual Influences on Auditory Behavioral, Neural, and Perceptual Processes: A Review

In a naturalistic environment, auditory cues are often accompanied by information from other senses, which can be redundant with or complementary to the auditory information. Although the multisensory interactions derived from this combination of information and that shape auditory function are seen across all sensory modalities, our greatest body of knowledge to date centers on how vision influences audition. In this review, we attempt to capture the state of our understanding at this point in time regarding this topic. Following a general introduction, the review is divided into 5 sections. In the first section, we review the psychophysical evidence in humans regarding vision's influence in audition, making the distinction between vision's ability to enhance versus alter auditory performance and perception. Three examples are then described that serve to highlight vision's ability to modulate auditory processes: spatial ventriloquism, cross-modal dynamic capture, and the McGurk effect. The final part of this section discusses models that have been built based on available psychophysical data and that seek to provide greater mechanistic insights into how vision can impact audition. The second section reviews the extant neuroimaging and far-field imaging work on this topic, with a strong emphasis on the roles of feedforward and feedback processes, on imaging insights into the causal nature of audiovisual interactions, and on the limitations of current imaging-based approaches. These limitations point to a greater need for machine-learning-based decoding approaches toward understanding how auditory representations are shaped by vision. The third section reviews the wealth of neuroanatomical and neurophysiological data from animal models that highlights audiovisual interactions at the neuronal and circuit level in both subcortical and cortical structures. It also speaks to the functional significance of audiovisual interactions for two critically important facets of auditory perception-scene analysis and communication. The fourth section presents current evidence for alterations in audiovisual processes in three clinical conditions: autism, schizophrenia, and sensorineural hearing loss. These changes in audiovisual interactions are postulated to have cascading effects on higher-order domains of dysfunction in these conditions. The final section highlights ongoing work seeking to leverage our knowledge of audiovisual interactions to develop better remediation approaches to these sensory-based disorders, founded in concepts of perceptual plasticity in which vision has been shown to have the capacity to facilitate auditory learning.

Different luminance- and texture-defined contrast sensitivity profiles for school-aged children

Our current understanding of how the visual brain develops is based largely on the study of luminance-defined information processing. This approach, however, is somewhat limiting, since everyday scenes are composed of complex images, consisting of information characterized by physical attributes relating to both luminance and texture. Few studies have explored how contrast sensitivity to texture-defined information develops, particularly throughout the school-aged years. The current study investigated how contrast sensitivity to luminance- (luminance-modulated noise) and texture-defined (contrast-modulated noise) static gratings develops in school-aged children. Contrast sensitivity functions identified distinct profiles for luminance- and texture-defined gratings across spatial frequencies (SFs) and age. Sensitivity to luminance-defined gratings reached maturity in childhood by the ages of 9–10 years for all SFs (0.5, 1, 2, 4 and 8 cycles/degree or cpd). Sensitivity to texture-defined gratings reached maturity at 5–6 years for low SFs and 7–8 years for high SFs (i.e., 4 cpd). These results establish that the processing of luminance- and texture-defined information develop differently as a function of SF and age.

Unique Relationships Between Autistic Traits and Visual, Auditory, and Tactile Sensory Thresholds in Typically Developing Adults

Autism spectrum disorder (ASD) refers to neurodevelopmental disorders characterized by symptoms such as social deficits and restricted interests and behavior. Several studies have investigated specific sensory processing in relation to ASD traits. However, findings appear to be inconsistent and inconclusive because of variation in ASD traits among participants and differences in the tasks adopted. In this study, we investigated relationships between sensory thresholds in visual, auditory, and tactile modalities and various ASD traits to account for individual variability of traits in typically developing adults using the same experimental tasks. We estimated detection and discrimination thresholds for brightness, sound pressure, and vibrotactile stimulus strength. We also estimated the degree of ASD traits in each participant with a questionnaire. We found that higher tactile detection and visual discrimination thresholds were related to ASD traits in difficulty of communication. A lower tactile discrimination threshold and higher visual detection threshold was also related to the ASD trait of strong focus of attention. These findings suggest the existence of unique relationships between particular low-level sensory processing and specific ASD traits, indicating that irregularities in sensory processing may underlie variation in ASD traits.

The singular nature of auditory and visual scene analysis in autism

Individuals with autism spectrum disorder often have difficulty acquiring relevant auditory and visual information in daily environments, despite not being diagnosed as hearing impaired or having low vision. Resent psychophysical and neurophysiological studies have shown that autistic individuals have highly specific individual differences at various levels of information processing, including feature extraction, automatic grouping and top-down modulation in auditory and visual scene analysis. Comparison of the characteristics of scene analysis between auditory and visual modalities reveals some essential commonalities, which could provide clues about the underlying neural mechanisms. Further progress in this line of research may suggest effective methods for diagnosing and supporting autistic individuals.This article is part of the themed issue 'Auditory and visual scene analysis'.

Reduced Oblique Effect in Children with Autism Spectrum Disorders (ASD)

People are very precise in the discrimination of a line orientation relative to the cardinal (vertical and horizontal) axes, while their orientation discrimination sensitivity along the oblique axes is less refined. This difference in discrimination sensitivity along cardinal and oblique axes is called the "oblique effect." Given that the oblique effect is a basic feature of visual processing with an early developmental origin, its investigation in children with Autism Spectrum Disorder (ASD) may shed light on the nature of visual sensory abnormalities frequently reported in this population. We examined line orientation sensitivity along oblique and vertical axes in a sample of 26 boys with ASD (IQ > 68) and 38 typically developing (TD) boys aged 7-15 years, as well as in a subsample of carefully IQ-matched ASD and TD participants. Children were asked to detect the direction of tilt of a high-contrast black-and-white grating relative to vertical (90°) or oblique (45°) templates. The oblique effect was reduced in children with ASD as compared to TD participants, irrespective of their IQ. This reduction was due to poor orientation sensitivity along the vertical axis in ASD children, while their ability to discriminate line orientation along the oblique axis was unaffected. We speculate that this deficit in sensitivity to vertical orientation may reflect disrupted mechanisms of early experience-dependent learning that takes place during the critical period for orientation selectivity.

Behavioral evidence for a functional link between low- and mid-level visual perception in the autism spectrum

BACKGROUND

Most investigations of visuo-perceptual abilities in the Autism Spectrum (AS) are level-specific, using tasks that selectively solicit either lower- (i.e., spatial frequency sensitivity), mid- (i.e., pattern discrimination) or higher-level processes (i.e., face identification) along the visual hierarchy. Less is known about how alterations at one level of processing (i.e., low-level) interact with that of another (i.e., mid-level). The aim of this study was to assess whether manipulating the physical properties (luminance vs texture) of local contour elements of a mid-level, visual pattern interferes with the discrimination of that pattern in a differential manner for individuals with AS.

METHODS

Twenty-nine AS individuals and thirty control participants (range 14-27 years) were asked to discriminate between perfect circles and Radial Frequency Patterns (RFP) of two, three, five, and 10 radial frequencies (RF), or deformations along the pattern's contour. When RFP have few deformations (<five RF), a global, pattern analysis is needed for shape discrimination. Conversely, when RFP contain many deformations (≥10 RF), discrimination is dependent on the analysis of local deformations along the RFP contour. The effect of manipulating RF on RFP discrimination was assessed for RFP whose local contour elements were defined by either luminance or texture information, the latter previously found less efficiently processed in AS individuals.

RESULTS

Two separate mixed factorial ANOVAs [2 (Group)×4 (RF)] were conducted on mean deformation thresholds for luminance- and texture-defined conditions. A significant Group×RF interaction was found for the luminance-defined condition where thresholds were higher in the AS group for the two and three RF conditions; no between-group differences were found for the five and 10 RF conditions. A significant main effect of group was identified for the texture-defined condition, where mean thresholds were higher for the AS group across all RF conditions assessed (two, three, five and 10); a Group×RF interaction effect was not found. Performance for each RFP condition was not affected across group by either chronological age or intelligence, as measured by either Weschler scales or Raven Progressive Matrices.

CONCLUSIONS

The ability of AS individuals to discriminate a circular pattern is differentially affected by the availability (number of deformations along the RFP contour) and type (luminance vs texture) of local, low-level elements defining its contour. Performance is unaffected in AS when RFP discrimination is dependent on the analysis of local deformations of luminance-defined contour elements, but decreased across all RF conditions when local contour elements are texture-defined. These results suggest that efficient pattern perception in AS is functionally related to the efficacy with which its local elements are processed, indicative of an early origin for altered mid-level, pattern perception in AS.

Early childhood development of visual texture segregation in full-term and preterm children

To date, very little is known about the normal development trajectory of visual texture segregation, or how it is affected by preterm birth. The goal of this study was to characterize the development of visual texture segregation using texture segregation visual evoked potentials (tsVEPs) in children born full-term and children born preterm without major neurological impairment. Forty-five full-term and 43 preterm children were tested at either 12, 24 or 36 months of age (corrected age for prematurity at 12 and 24 months old). VEPs were obtained using two lower-level stimuli defined by orientation (oriVEP) and two higher-level stimuli defined by texture (texVEP). TsVEP was obtained by dividing by two the subtraction of oriVEP from texVEP. Results show a clear maturation of the processes underlying visual texture segregation in the full-term group, with a significant N2 latency reduction between 12 and 36 months of age for all conditions. Significant N2 amplitude reduction was observed for oriVEP between 12 and 24 months, as well as for texVEP between 12 and 24 months, and 12 and 36 months. Comparison between full-term and preterm children indicated significantly lower N2 amplitude for the preterm group at 12 months for oriVEP and texVEP. These differences were no longer apparent at 24 months of age, suggesting that children born preterm catch up with their full-term counterparts somewhere between 12 and 24 months of age. Our results appear to reflect a maturational delay in preterm children in both lower-level and higher-level visual processing during, at least, early childhood.

A greater involvement of posterior brain areas in interhemispheric transfer in autism: fMRI, DWI and behavioral evidences

A small corpus callosum (CC) is one of the most replicated neurobiological findings in autism spectrum (AS). However, its effect on interhemispheric (IH) communication is unknown. We combined structural (CC area and DWI), functional (task-related fMRI activation and connectivity analyses) as well as behavioral (Poffenberger and Purdue tasks) measures to investigate IH integration in adult AS individuals of typical intelligence. Despite similar behavioral IH transfer time and performances in bimanual tasks, the CC sub-regions connecting frontal and parietal cortical areas were smaller in AS than in non-AS individuals, while those connecting visual regions were similar. The activation of visual areas was lower in AS than in non-AS individuals during the presentation of visual stimuli. Behavioral IH performances were related to the properties of CC subregions connecting motor areas in non-AS individuals, but to the properties of posterior CC regions in AS individuals. Furthermore, there was greater functional connectivity between visual areas in the AS than in the non-AS group. Levels of connectivity were also stronger in visual than in motor regions in the autistic subjects, while the opposite was true for the non-autistic group. Thus, visual IH transfer plays an important role in visuo-motor tasks in AS individuals. These findings extend the well established enhanced role of perception in autistic cognition to visuo-motor IH information transfer.

•

The size of the corpus callosum connecting the motor region is reduced in autism.

•

The interhemispheric transfer of visuo-motor information is not impaired in autism.

•

In autism, the posterior corpus callosum is more involved than the motor sections.

•

Plastic reorganization in autism leads to atypical structure–function relationship.

•

The results agree with a greater involvement of perceptual brain areas in autism.