On the "Strength" of Behavior

Evaluating functions of praise for children diagnosed with autism spectrum disorder

We assessed whether novel praise statements could be used to (a) maintain and increase responses with existing reinforcement histories and (b) teach a previously untaught response among children diagnosed with autism spectrum disorder across two experiments. During response-stimulus pairing, two responses resulted in preferred edibles but only one also produced a praise statement. In the absence of edibles, the response continuing to produce praise tended to persist more. Next, reversing the praise contingency tended to increase the other response. However, in no case did contingent delivery of those same praise statements result in the acquisition of untaught responses. These findings suggest that conditioning praise statements could serve different functions (antecedent or consequence) depending on the reinforcement history for particular responses.

A molar view of goal direction and habit

When we treat behavior within an evolutionary framework and as temporally extended flow, two fundamental questions arise: (a) What is an organism? and (b) What is behavior? An organism is a process that stays intact by constantly exchanging energy with the environment. It takes in resources and puts out waste. The behavior of an organism consists of those process parts of the organism process that make up the exchange. These activities serve the function of reproducing, which generally depends on surviving. Surviving and reproducing depend on responding to phylogenetically important events (PIEs). A PIE induces activities that enhance or mitigate the PIE. Organisms respond not only to a PIE but also to events that covary with the PIE. Both activities and environmental features may covary with a PIE. When either type of covariance is introduced to an organism, behavior adapts over time. The early stages of adaptation constitute what researchers call "goal direction," and the later stages constitute what researchers call "habit." Behavior and environment constitute a dynamic system, and manipulations of the covariances and environmental features of the system allow many experimental interventions. This molar approach allows experiments on goal direction and habit to be understood without appeal to everyday mentalistic terms.

Assessing human performance during contingency changes and extinction tests in reversal-learning tasks

Serial reversal-learning procedures are simple preparations that allow for a better understanding of how animals learn about environmental changes, including flexibly shifting responding to adapt to changing reinforcement contingencies. The present study examined serial reversal learning with humans by arranging both midsession and variable contingency reversals across two experiments. We also examined the effects of extinction by adding nonreinforced trials at the end of later sessions and provided the first evaluation of effects of win-stay/lose-shift versus counting strategies on accuracy and response latency of humans' reversal-learning performance. In each experiment, responding tracked contingency reversals, primarily with participants using either win-stay/lose-shift or counting strategies. Introducing variable reversal points in the second experiment resulted in near-exclusive win-stay/lose-shift responding among participants and eliminated counting of trials. Each experiment also revealed an immediate shift from S2 to S1 after experiencing extinction during the initial test trial, indicating resurgence of the initial response through a win-stay/lose-shift response pattern. Therefore, the present study replicates and extends prior findings of a win-stay/lose shift response pattern in situations of greater uncertainty. These findings suggest that differences in environmental certainty induce qualitatively different decision-making strategies.

Qualitative variations in delay discounting: A brief review and future directions

The discounting paradigm has been challenged by an increasing number of studies presenting qualitative variations in the individual discount function. Particularly, the subjective value of a loss does not necessarily systematically decrease with delay to the outcome. Qualitative variation refers to variations in shape rather than steepness of the discount function, such as positive discounting, zero discounting, unsystematic discounting, and negative discounting. Data from three previous studies were analysed in terms of qualitative variations observed in delay discounting patterns. Attention was also given to methods used and to the relationship between the results from the various levels of investigation. We found qualitative differences between discounting of monetary gains and losses on an individual level. While discounting of gains mainly took the form of conventional positive discounting, discounting of losses often took the form of zero discounting or unsystematic discounting. Further, there were more qualitative variations in discounting of both gains and losses among adolescents compared to adults. By examining verbal reports and single choices, we identified some of the rules and consequences involved in these delay discounting patterns. The different rules and consequences observed for the gain and loss scenarios, support that discounting of gains and losses may involve different combinations of reinforcing contingencies. These results point towards a possible way to explain the influences of qualitative variations in delay discounting.

Machine learning with a snapshot of data: Spiking neural network 'predicts' reinforcement histories of pigeons' choice behavior

An accumulated body of choice research has demonstrated that choice behavior can be understood within the context of its history of reinforcement by measuring response patterns. Traditionally, work on predicting choice behaviors has been based on the relationship between the history of reinforcement—the reinforcer arrangement used in training conditions—and choice behavior. We suggest an alternative method that treats the reinforcement history as unknown and focuses only on operant choices to accurately predict (more precisely, retrodict) reinforcement histories. We trained machine learning models known as artificial spiking neural networks (SNNs) on previously published pigeon datasets to detect patterns in choices with specific reinforcement histories—seven arranged concurrent variable‐interval schedules in effect for nine reinforcers. Notably, SNN extracted information from a small ‘window’ of observational data to predict reinforcer arrangements. The models' generalization ability was then tested with new choices of the same pigeons to predict the type of schedule used in training. We examined whether the amount of the data provided affected the prediction accuracy and our results demonstrated that choices made by the pigeons immediately after the delivery of reinforcers provided sufficient information for the model to determine the reinforcement history. These results support the idea that SNNs can process small sets of behavioral data for pattern detection, when the reinforcement history is unknown. This novel approach can influence our decisions to determine appropriate interventions; it can be a valuable addition to our toolbox, for both therapy design and research.

Comportamento e seleção pelas consequências: a análise do comportamento no Brasil entre o dogma e a ciência

Resumo Considerando-se as recentes discussões sobre a definição de comportamento e do modelo de seleção por consequências conduzidas por pesquisadores brasileiros, discutimos a necessidade de maior participação das contribuições da análise experimental do comportamento no debate de conceitos da área e mais interação da área com outros sistemas em Psicologia. Criticamos o isolamento em relação à produção de conhecimento de outras áreas e a adoção de figuras de autoridade a partir da qual se possa fazer a avaliação das novidades da área. Para tanto, a análise do contexto no qual Skinner propôs seu modelo de seleção por consequências precisa ser feita para clara compreensão das contribuições mais importantes dessa proposta. Mostramos que a discussão sobre a distinção operante-respondente e a pertinência da noção de metacontingências são exemplos de revisão conceitual feita com base em dados e articulação entre áreas de pesquisa com epistemologias e metodologias diferentes, mas possíveis de serem articuladas.

On Response Strength and the Concept of Response Classes

Simon et al. (2020) argue that the concept of response strength is unnecessary and potentially harmful in that it misdirects behavior analysts away from more fruitful molar analyses. I defend the term as a useful summary of the effects of reinforcement and point particularly to its utility as an interpretive tool in making sense of complex human behavior under multiple control. Physiological data suggest that the concept is not an explanatory fiction, but strength cannot be simply equated with neural conductivity; interaction with competing behaviors must be considered as well. Decisions about appropriate scales of analysis require a clarification of terms. I suggest defining behavior solely in terms of its sensitivity to behavioral principles, irrespective of locus, magnitude, or observability. Furthermore, I suggest that the term response class be restricted to units that vary together in probability in part because of overlapping topography. In contrast, functional classes are united by common consequences; they vary together with respect to motivational variables but need not share formal properties and need not covary with acquisition and extinction contingencies.

Resistance to extinction versus extinction as discrimination

The hypothesis that response strength might be measured by persistence of responding in the face of extinction was discredited in the 1960s because experiments showed that responding persists longer following intermittent reinforcers than following continuous reinforcers. Instead, researchers proposed that the longer persistence following intermittent reinforcers arises because intermittent reinforcement more closely resembles extinction-a discrimination theory. Attention to resistance to extinction revived because one observation seemed to support the persistence hypothesis: Following training on a multiple schedule with unequal components, responding usually persisted longer in the formerly richer component than in the formerly lean component. This observation represents an anomaly, however, because results with single schedules and concurrent schedules contradict it. We suggest that the difference in results arises because the multiple-schedule procedure, while including extensive training on stimulus discrimination, includes no training on discrimination between food available and food unavailable, whereas comparable single- and concurrent-schedule procedures include such training with repeated extinction. In Experiment 1, we replicated the original result, and in Experiment 2 showed that when the multiple-schedule procedure includes training on food/no-food discrimination, extinction following multiple schedules contradicts behavioral momentum theory and agrees with the discrimination theory and research with single and concurrent schedules.