The place of human psychophysics in modern neuroscience

Psychophysics may be the game-changer for deep neural networks (DNNs) to imitate the human vision

Psychologically faithful deep neural networks (DNNs) could be constructed by training with psychophysics data. Moreover, conventional DNNs are mostly monocular vision based, whereas the human brain relies mainly on binocular vision. DNNs developed as smaller vision agent networks associated with fundamental and less intelligent visual activities, can be combined to simulate more intelligent visual activities done by the biological brain.

Perceptual alterations in the relationship between sensory reactivity, intolerance of uncertainty, and anxiety in autistic children with and without ADHD

Sensory differences and anxiety disorders are highly prevalent in autistic individuals with and without ADHD. Studies have shown that sensory differences and anxiety are associated and that intolerance of uncertainty (IU) plays an important role in this relationship. However, it is unclear as to how different levels of the sensory processing pathway (i.e., perceptual, affective, or behavioral) contribute. Here, we used psychophysics to assess how alterations in tactile perception contribute to questionnaire measures of sensory reactivity, IU, and anxiety. Thirty-eight autistic children (aged 8-12 years; 27 with co-occurring ADHD) were included. Consistent with previous findings, mediation analyses showed that child-reported IU fully mediated an association between parent-reported sensory reactivity and parent-reported anxiety and that anxiety partially mediated an association between sensory reactivity and IU. Of the vibrotactile thresholds, only simultaneous frequency discrimination (SFD) thresholds correlated with sensory reactivity. Interestingly, we found that sensory reactivity fully mediated an association between SFD threshold and anxiety, and between SFD threshold and IU. Taken together, those findings suggest a mechanistic pathway whereby tactile perceptual alterations contribute to sensory reactivity at the affective level, leading in turn to increased IU and anxiety. This stepwise association can inform potential interventions for IU and anxiety in autism.

Psychophysics of Pain: A Methodological Introduction

For over 100 years, psychophysics ..÷ the scientific study between physical stimuli and sensation ... has been successfully employed in numerous scientific and healthcare disciplines, as an objective measure of sensory phenomena. This manuscript provides an overview of fundamental psychophysical concepts, emphasizing pain and research application..÷defining common terms, methods, and procedures.Psychophysics can provide systematic and objective measures of sensory perception that can be used by nursing scientists to explore complex, subjective phenomena..÷such as pain perception. While there needs to be improved standardization of terms and techniques, psychophysical approaches are diverse and may be tailored to address or augment current research paradigms. The interdisciplinary nature of psychophysics..÷like nursing..÷provides a unique lens for understanding how our perceptions are influenced by measurable sensations. While the quest to understand human perception is far from complete, nursing science has an opportunity to contribute to pain research by using the techniques and methods available through psychophysical procedures.

Minimal theory of 3D vision: new approach to visual scale and visual shape

Since Kepler and Descartes in the early-1600s, vision science has been committed to a triangulation model of stereo vision. But in the early-1800s, we realized that disparities are responsible for stereo vision. And we have spent the past 200 years trying to shoe-horn disparities back into the triangulation account. The first part of this article argues that this is a mistake, and that stereo vision is a solution to a different problem: the eradication of rivalry between the two retinal images, rather than the triangulation of objects in space. This leads to a 'minimal theory of 3D vision', where 3D vision is no longer tied to estimating the scale, shape, and direction of objects in the world. The second part of this article then asks whether the other aspects of 3D vision, which go beyond stereo vision, really operate at the same level of visual experience as stereo vision? I argue they do not. Whilst we want a theory of real-world 3D vision, the literature risks giving us a theory of picture perception instead. And I argue for a two-stage theory, where our purely internal 'minimal' 3D percept (from stereo vision) is linked to the world through cognition. This article is part of a discussion meeting issue 'New approaches to 3D vision'.

A practical guide for studying human behavior in the lab

In the last few decades, the field of neuroscience has witnessed major technological advances that have allowed researchers to measure and control neural activity with great detail. Yet, behavioral experiments in humans remain an essential approach to investigate the mysteries of the mind. Their relatively modest technological and economic requisites make behavioral research an attractive and accessible experimental avenue for neuroscientists with very diverse backgrounds. However, like any experimental enterprise, it has its own inherent challenges that may pose practical hurdles, especially to less experienced behavioral researchers. Here, we aim at providing a practical guide for a steady walk through the workflow of a typical behavioral experiment with human subjects. This primer concerns the design of an experimental protocol, research ethics, and subject care, as well as best practices for data collection, analysis, and sharing. The goal is to provide clear instructions for both beginners and experienced researchers from diverse backgrounds in planning behavioral experiments.

Remarkably reproducible psychological (memory) phenomena in the classroom: some evidence for generality from small-N research

BACKGROUND

Mainstream psychology is experiencing a crisis of confidence. Many of the methodological solutions offered in response have focused largely on statistical alternatives to null hypothesis statistical testing, ignoring nonstatistical remedies that are readily available within psychology; namely, use of small-N designs. In fact, many classic memory studies that have passed the test of replicability used them. That methodological legacy warranted a retrospective look at nonexperimental data to explore the generality of the reported effects.

METHOD

Various classroom demonstrations were conducted over multiple semesters in introductory psychology courses with typical, mostly freshman students from a predominantly white private Catholic university in the US Midwest based on classic memory experiments on immediate memory span, chunking, and depth of processing.

RESULTS

Students tended to remember 7 ± 2 digits, remembered more digits of π following an attached meaningful story, and remembered more words after elaborative rehearsal than after maintenance rehearsal. These results amount to replications under uncontrolled classroom environments of the classic experiments originally conducted largely outside of null hypothesis statistical testing frameworks.

CONCLUSIONS

In light of the ongoing replication crisis in psychology, the results are remarkable and noteworthy, validating these historically important psychological findings. They are testament to the reliability of reproducible effects as the hallmark of empirical findings in science and suggest an alternative approach to commonly proffered solutions to the replication crisis.

Region-specific elevations of glutamate + glutamine correlate with the sensory symptoms of autism spectrum disorders

Individuals on the autism spectrum are often reported as being hyper- and/or hyporeactive to sensory input. These sensory symptoms were one of the key observations that led to the development of the altered excitation-inhibition (E-I) model of autism, which posits that an increase ratio of excitatory to inhibitory signaling may explain certain phenotypical expressions of autism spectrum disorders (ASD). While there has been strong support for the altered E-I model of autism, much of the evidence has come from animal models. With regard to in-vivo human studies, evidence for altered E-I balance in ASD come from studies adopting magnetic resonance spectroscopy (MRS). Spectral-edited MRS can be used to provide measures of the levels of GABA + (GABA + macromolecules) and Glx (glutamate + glutamine) in specific brain regions as proxy markers of inhibition and excitation respectively. In the current study, we found region-specific elevations of Glx in the primary sensorimotor cortex (SM1) in ASD. There were no group differences of GABA+ in either the SM1 or thalamus. Higher levels of Glx were associated with more parent reported difficulties of sensory hyper- and hyporeactivity, as well as reduced feed-forward inhibition during tactile perception in children with ASD. Critically, the finding of elevated Glx provides strong empirical support for increased excitation in ASD. Our results also provide a clear link between Glx and the sensory symptoms of ASD at both behavioral and perceptual levels.

Psychophysical evaluation of somatosensory function in oro-facial pain: achievements and challenges

AIM

This critical review describes key methodological aspects for a successful oro-facial psychophysical evaluation of the somatosensory system and highlights the diagnostic value of somatosensory assessment and management perspectives based on somatosensory profiling.

METHODS

This topical review was based on a non-systematic search for studies about somatosensory evaluation in oro-facial pain in PubMed and Embase.

RESULTS

The recent progress regarding the psychophysical evaluation of somatosensory function was largely possible due to the development and application of valid, reliable and standardised psychophysical methods. Qualitative sensory testing may be useful as a screening tool to rule out relevant somatosensory abnormalities. Nevertheless, the patient should preferably be referred to a more comprehensive assessment with the quantitative sensory testing battery if confirmation of somatosensory abnormalities is necessary. Moreover, the identification of relevant somatosensory alterations in chronic pain disorders that do not fulfil the current criteria to be regarded as neuropathic has also increased the usefulness of somatosensory evaluation as a feasible method to better characterise the patients and perhaps elucidate some underpinnings of the so-called 'nociplastic' pain disorders. Finally, an additional benefit of oro-facial pain treatment based on somatosensory profiling still needs to be demonstrated and convincing evidence of somatosensory findings as predictors of treatment efficacy in chronic oro-facial pain awaits further studies.

CONCLUSION

Psychophysical evaluation of somatosensory function in oro-facial pain is still in its infancy but with a clear potential to continue to improve the assessment, diagnosis and management of oro-facial pain patients.

The Integrated Information Theory of consciousness: A case of mistaken identity

Giulio Tononi's Integrated Information Theory (IIT) proposes explaining consciousness by directly identifying it with integrated information. We examine the construct validity of IIT's measure of consciousness, phi (Φ), by analyzing its formal properties, its relation to key aspects of consciousness, and its co-variation with relevant empirical circumstances. Our analysis shows that IIT's identification of consciousness with the causal efficacy with which differentiated networks accomplish global information transfer (which is what Φ in fact measures) is mistaken. This misidentification has the consequence of requiring the attribution of consciousness to a range of natural systems and artifacts that include, but are not limited to, large-scale electrical power grids, gene-regulation networks, some electronic circuit boards, and social networks. Instead of treating this consequence of the theory as a disconfirmation, IIT embraces it. By regarding these systems as bearers of consciousness ex hypothesi, IIT is led towards the orbit of panpsychist ideation. This departure from science as we know it can be avoided by recognizing the functional misattribution at the heart of IIT's identity claim. We show, for example, what function is actually performed, at least in the human case, by the cortical combination of differentiation with integration that IIT identifies with consciousness. Finally, we examine what lessons may be drawn from IIT's failure to provide a credible account of consciousness for progress in the very active field of research concerned with exploring the phenomenon from formal and neural points of view.

The neural basis of consciousness

Consciousness has evolved and is a feature of all animals with sufficiently complex nervous systems. It is, therefore, primarily a problem for biology, rather than physics. In this review, I will consider three aspects of consciousness: level of consciousness, whether we are awake or in a coma; the contents of consciousness, what determines how a small amount of sensory information is associated with subjective experience, while the rest is not; and meta-consciousness, the ability to reflect upon our subjective experiences and, importantly, to share them with others. I will discuss and compare current theories of the neural and cognitive mechanisms involved in producing these three aspects of consciousness and conclude that the research in this area is flourishing and has already succeeded to delineate these mechanisms in surprising detail.

How does the human visual system compare the speeds of spatially separated objects?

We measured psychophysical thresholds for discriminating the speeds of two arrays of moving dots. The arrays could be juxtaposed or could be spatially separated by up to 10 degrees of visual angle, eccentricity being held constant. We found that the precision of the judgments varied little with separation. Moreover, the function relating threshold to separation was similar whether the arrays moved in the same, in opposite or in orthogonal directions. And there was no significant difference in threshold whether the two stimuli were initially presented to the same cerebral hemisphere or to opposite ones. How are human observers able to compare stimuli that fall at well separated positions in the visual field? We consider two classes of explanation: (i) Observers' judgments might be based directly on the signals of dedicated 'comparator neurons', i.e. neurons drawing inputs of opposite sign from local regions of the visual field. (ii) Signals about local features might be transmitted to the site of comparison by a shared 'cerebral bus', where the same physical substrate carries different information from moment to moment. The minimal effects of proximity and direction (which might be expected to influence local detectors of relative motion), and the combinatorial explosion in the number of comparator neurons that would be required by (i), lead us to favor models of type (ii).

A critical review and development of a conceptual model of exclusion from social relations for older people

Social exclusion is complex and dynamic, and it leads to the non-realization of social, economic, political or cultural rights or participation within a society. This critical review takes stock of the literature on exclusion of social relations. Social relations are defined as comprising social resources, social connections and social networks. An evidence review group undertook a critical review which integrates, interprets and synthesizes information across studies to develop a conceptual model of exclusion from social relations. The resulting model is a subjective interpretation of the literature and is intended to be the starting point for further evaluations. The conceptual model identifies individual risks for exclusion from social relations (personal attributes, biological and neurological risk, retirement, socio-economic status, exclusion from material resources and migration). It incorporates the evaluation of social relations, and the influence of psychosocial resources and socio-emotional processes, sociocultural, social-structural, environmental and policy contextual influences on exclusion from social relations. It includes distal outcomes of exclusion from social relations, that is, individual well-being, health and functioning, social opportunities and social cohesion. The dynamic relationships between elements of the model are also reported. We conclude that the model provides a subjective interpretation of the data and an excellent starting point for further phases of conceptual development and systematic evaluation(s). Future research needs to consider the use of sophisticated analytical tools and an interdisciplinary approach in order to understand the underlying biological and ecopsychosocial associations that contribute to individual and dynamic differences in the experience of exclusion from social relations.

Binocular responsiveness of projection neurons of the praying mantis optic lobe in the frontal visual field

Praying mantids are the only insects proven to have stereoscopic vision (stereopsis): the ability to perceive depth from the slightly shifted images seen by the two eyes. Recently, the first neurons likely to be involved in mantis stereopsis were described and a speculative neuronal circuit suggested. Here we further investigate classes of neurons in the lobula complex of the praying mantis brain and their tuning to stereoscopically-defined depth. We used sharp electrode recordings with tracer injections to identify visual projection neurons with input in the optic lobe and output in the central brain. In order to measure binocular response fields of the cells the animals watched a vertical bar stimulus in a 3D insect cinema during recordings. We describe the binocular tuning of 19 neurons projecting from the lobula complex and the medulla to central brain areas. The majority of neurons (12/19) were binocular and had receptive fields for both eyes that overlapped in the frontal region. Thus, these neurons could be involved in mantis stereopsis. We also find that neurons preferring different contrast polarity (bright vs dark) tend to be segregated in the mantis lobula complex, reminiscent of the segregation for small targets and widefield motion in mantids and other insects.

Introduction to the special issue on physics of mind

In recent years, both fields of physics and psychology have made important scientific advances. The emergence of new instruments gave rise to a data-driven neuroscience allowing us to learn about the state of the brain supporting known mental functions and conversely. In parallel, the appearance of new mathematics allowed the development of computational models describing fundamental brain functions and implementing them in technological applications. While emphasizing the methodology of physics, the special issue aims to bring together these trends in both the experimental and theoretical sciences in order to explain some of the most basic mental processes such as perception, cognition, emotion, consciousness, and learning. In this editorial, we define unsolved problems for brain and psychological sciences, discuss possible means toward their respective solutions, and outline some collaborative initiatives aiming toward these goals. The following problems are defined in gradual order of difficulty: what are the universal properties of human behavior across conditions and cultures? What have each culture learned over historical times and why should specific elements of knowledge be accumulated over cultural evolution? Can computational psychiatry help predict, understand, and cure mental disorders? What is the function of art and cultural artifacts such as music, fiction, or poetry for the cognitive system? How to explain the relation between first-person subjective experience and third-person objective physiological data? What neural mechanisms operate on which mental content at the highest levels of organization of the hierarchical brain? How do abstract ideas emerge from sensory-motor contingencies and what are the conditions for the birth of a new concept? Could symmetry play a role in psychogenesis and support the emergence of new hierarchical layers in cognition? How can we start addressing the question of meaning scientifically, and what does it entail for the physical sciences?

Thermal Perceptual Thresholds are typical in Autism Spectrum Disorder but Strongly Related to Intra-individual Response Variability

Individuals with autism spectrum disorder (ASD) are often reported to exhibit an apparent indifference to pain or temperature. Leading models suggest that this behavior is the result of elevated perceptual thresholds for thermal stimuli, but data to support these assertions are inconclusive. An alternative proposal suggests that the sensory features of ASD arise from increased intra-individual perceptual variability. In this study, we measured method-of-limits warm and cool detection thresholds in 142 individuals (83 with ASD, 59 with typical development [TD], aged 7-54 years), testing relationships with diagnostic group, demographics, and clinical measures. We also investigated the relationship between detection thresholds and a novel measure of intra-individual (trial-to-trial) threshold variability, a putative index of "perceptual noise." This investigation found no differences in thermal detection thresholds between individuals with ASD and typical controls, despite large differences between groups in sensory reactivity questionnaires and modest group differences in intra-individual variability. Lower performance IQ, male sex, and higher intra-individual variability in threshold estimates were the most significant predictors of elevated detection thresholds. Although no psychophysical measure was significantly correlated with questionnaire measures of sensory hyporeactivity, large intra-individual variability may partially explain the elevated psychophysical thresholds seen in a subset of the ASD population.

The psychophysics of stereopsis can be explained without invoking independent ON and OFF channels

Early vision proceeds through distinct ON and OFF channels, which encode luminance increments and decrements respectively. It has been argued that these channels also contribute separately to stereoscopic vision. This is based on the fact that observers perform better on a noisy disparity discrimination task when the stimulus is a random-dot pattern consisting of equal numbers of black and white dots (a “mixed-polarity stimulus,” argued to activate both ON and OFF stereo channels), than when it consists of all-white or all-black dots (“same-polarity,” argued to activate only one). However, it is not clear how this theory can be reconciled with our current understanding of disparity encoding. Recently, a binocular convolutional neural network was able to replicate the mixed-polarity advantage shown by human observers, even though it was based on linear filters and contained no mechanisms which would respond separately to black or white dots. Here, we show that a subtle feature of the way the stimuli were constructed in all these experiments can explain the results. The interocular correlation between left and right images is actually lower for the same-polarity stimuli than for mixed-polarity stimuli with the same amount of disparity noise applied to the dots. Because our current theories suggest stereopsis is based on a correlation-like computation in primary visual cortex, this postulate can explain why performance was better for the mixed-polarity stimuli. We conclude that there is currently no evidence supporting separate ON and OFF channels in stereopsis.

Detecting changes in facial temperature induced by a sudden auditory stimulus based on deep learning-assisted face tracking

Thermal Imaging (Infrared-Imaging-IRI) is a promising new technique for psychophysiological research and application. Unlike traditional physiological measures (like skin conductance and heart rate), it is uniquely contact-free, substantially enhancing its ecological validity. Investigating facial regions and subsequent reliable signal extraction from IRI data is challenging due to head motion artefacts. Exploiting its potential thus depends on advances in analytical methods. Here, we developed a novel semi-automated thermal signal extraction method employing deep learning algorithms for facial landmark identification. We applied this method to physiological responses elicited by a sudden auditory stimulus, to determine if facial temperature changes induced by a stimulus of a loud sound can be detected. We compared thermal responses with psycho-physiological sensor-based tools of galvanic skin response (GSR) and electrocardiography (ECG). We found that the temperatures of selected facial regions, particularly the nose tip, significantly decreased after the auditory stimulus. Additionally, this response was quite rapid at around 4–5 seconds, starting less than 2 seconds following the GSR changes. These results demonstrate that our methodology offers a sensitive and robust tool to capture facial physiological changes with minimal manual intervention and manual pre-processing of signals. Newer methodological developments for reliable temperature extraction promise to boost IRI use as an ecologically-valid technique in social and affective neuroscience.

Accurate prediction of personalized olfactory perception from large-scale chemoinformatic features

Background

The olfactory stimulus-percept problem has been studied for more than a century, yet it is still hard to precisely predict the odor given the large-scale chemoinformatic features of an odorant molecule. A major challenge is that the perceived qualities vary greatly among individuals due to different genetic and cultural backgrounds. Moreover, the combinatorial interactions between multiple odorant receptors and diverse molecules significantly complicate the olfaction prediction. Many attempts have been made to establish structure-odor relationships for intensity and pleasantness, but no models are available to predict the personalized multi-odor attributes of molecules. In this study, we describe our winning algorithm for predicting individual and population perceptual responses to various odorants in the DREAM Olfaction Prediction Challenge.

Results

We find that random forest model consisting of multiple decision trees is well suited to this prediction problem, given the large feature spaces and high variability of perceptual ratings among individuals. Integrating both population and individual perceptions into our model effectively reduces the influence of noise and outliers. By analyzing the importance of each chemical feature, we find that a small set of low- and nondegenerative features is sufficient for accurate prediction.

Conclusions

Our random forest model successfully predicts personalized odor attributes of structurally diverse molecules. This model together with the top discriminative features has the potential to extend our understanding of olfactory perception mechanisms and provide an alternative for rational odorant design.

Stereopsis in animals: evolution, function and mechanisms

Stereopsis is the computation of depth information from views acquired simultaneously from different points in space. For many years, stereopsis was thought to be confined to primates and other mammals with front-facing eyes. However, stereopsis has now been demonstrated in many other animals, including lateral-eyed prey mammals, birds, amphibians and invertebrates. The diversity of animals known to have stereo vision allows us to begin to investigate ideas about its evolution and the underlying selective pressures in different animals. It also further prompts the question of whether all animals have evolved essentially the same algorithms to implement stereopsis. If so, this must be the best way to do stereo vision, and should be implemented by engineers in machine stereopsis. Conversely, if animals have evolved a range of stereo algorithms in response to different pressures, that could inspire novel forms of machine stereopsis appropriate for distinct environments, tasks or constraints. As a first step towards addressing these ideas, we here review our current knowledge of stereo vision in animals, with a view towards outlining common principles about the evolution, function and mechanisms of stereo vision across the animal kingdom. We conclude by outlining avenues for future work, including research into possible new mechanisms of stereo vision, with implications for machine vision and the role of stereopsis in the evolution of camouflage.

Summary: Stereopsis has evolved independently in different animals. We review the various functions it serves and the variety of mechanisms that could underlie stereopsis in different species.

The importance of task design and behavioral control for understanding the neural basis of cognitive functions

The success of systems neuroscience depends on the ability to forge quantitative links between neural activity and behavior. Traditionally, this process has benefited from the rigorous development and testing of hypotheses using tools derived from classical psychophysics and computational motor control. As our capacity for measuring neural activity improves, accompanied by powerful new analysis strategies, it seems prudent to remember what these traditional approaches have to offer. Here I present a perspective on the merits of principled task design and tight behavioral control, along with some words of caution about interpretation in unguided, large-scale neural recording studies. I argue that a judicious combination of new and old approaches is the best way to advance our understanding of higher brain function in health and disease.

Visual Categorization with Random Projection

Humans learn categories of complex objects quickly and from a few examples. Random projection has been suggested as a means to learn and categorize efficiently. We investigate how random projection affects categorization by humans and by very simple neural networks on the same stimuli and categorization tasks, and how this relates to the robustness of categories. We find that (1) drastic reduction in stimulus complexity via random projection does not degrade performance in categorization tasks by either humans or simple neural networks, (2) human accuracy and neural network accuracy are remarkably correlated, even at the level of individual stimuli, and (3) the performance of both is strongly indicated by a natural notion of category robustness.