The efficacy of a secondary reinforcer (clicker) during acquisition and extinction of an operant task in horses

Moving toward Fear-Free Husbandry and Veterinary Care for Horses

Husbandry and veterinary procedures have the potential to generate fear and stress in animals. In horses, the associated responses can pose a significant safety risk to the human personnel involved in the procedure, as well as to the animal itself. Traditionally, physical restraint, punishment, and/or threat of an aversive, have been the most common strategies used to achieve compliance from the horse. However, from a welfare perspective, this is less than ideal. This approach also has the potential for creating a more dangerous response from the horse in future similar situations. When caring for companion animals, and captive animals within zoological facilities, there has been a steady transition away from this approach, and toward strategies aimed at reducing fear and stress during veterinary visits and when undertaking routine husbandry procedures. This review discusses the current approaches to horse care and training, the strategies being used in other animal sectors, and potential strategies for improving human safety, as well as the horse's experience, during husbandry and veterinary procedures.

Connecting animal trainers and behavior analysts through loopy training

The communities of behavior analysts and animal trainers remain relatively disconnected, despite potentially beneficial links between behavioral principles and the practices of animal training. Describing existing links between research by behavior analysts and practices used by animal trainers may foster connections. In this paper, we describe an approach used by many clicker trainers, referred to as loopy training. Loopy training is a teaching process built around the concept of movement cycles. Interactions between the animal learner and the handler are refined into predictable, cyclical patterns that can be expanded into complex sequences. These sequences include cues, target responses, conditioned reinforcers, and consummatory responses. We link the foundations of loopy training to existing work in the experimental analysis of behavior, compare loopy training to other shaping approaches, and describe areas for future research. We conclude with a series of recommendations for further developing connections between behavior analysts and animal trainers, using loopy training as the foundation for our suggestions.

Successive approximation of horses to their first work on a treadmill: The effect of previous loading into a trailer

A horse learning about the entrance to narrow, cage-shaped places may be challenging both for the horses as well as for the owners. For some behaviors, such as loading into a trailer or climbing onto a treadmill, the final behavioral goal can be achieved by working towards it in stages. This study compared the successive approximation of horses to their first work on a treadmill with horses hardly ever loaded (HE L) and regularly loaded (R L) into a trailer. Fourteen horses were divided into two groups (HE L n = 7 and R L n = 7) based on their experiences of entering into a trailer. All horses were taught using four stages of successive approximation. The average lead time was longer in the HE L than in the R L group, both in the first (HE L: 33.8 ± 12.4 s; R L: 17.6 ± 12.9 s; p = 0.035) and last stages (HE L: 12.0 ± 10.3 s; R L: 3.7 ± 1.0 s; p = 0.032) of trials. With the subsequent repetitions of each step, the heart rate decreased in both groups. Very few behaviors indicating fear or unwillingness ("rearing," "sideways," and "backwards") were observed. Horses that were regularly loaded exhibited signs of relaxation. The successive approximation of horses to the first work on a treadmill differed and may depend on the previous experiences with loading and travelling in the confined space of a trailer.

The click is not the trick: the efficacy of clickers and other reinforcement methods in training naïve dogs to perform new tasks

Background

A handheld metal noisemaker known as a “clicker” is widely used to train new behaviors in dogs; however, evidence for their superior efficacy compared to providing solely primary reinforcement or other secondary reinforcers in the acquisition of novel behavior in dogs is largely anecdotal.

Methods

Three experiments were conducted to determine under what circumstances a clicker secondary reinforcer may result in acquisition of a novel behavior more rapidly or to a higher level compared to other readily available reinforcement methods. In Experiment 1, three groups of 30 dogs each were shaped to emit a novel sit and stay behavior of increasing duration with either the delivery of food alone, a verbal stimulus paired with food, or a clicker with food. The group that received only a primary reinforcer reached a significantly higher criterion of training success than the group trained with a verbal secondary reinforcer. Performance of the group experiencing a clicker as a secondary reinforcer was intermediate between the other two groups, but not significantly different from either. In Experiment 2, three groups of 25 dogs each were shaped to emit a nose targeting behavior and then perform that behavior at increasing distances from the experimenter using the same three methods of positive reinforcement as in Experiment 1. No statistically significant differences between the groups were found. In Experiment 3, three groups of 30 dogs each were shaped to emit a nose-targeting behavior upon an array of wooden blocks with task difficulty increasing throughout testing using the same three methods of positive reinforcement as previously tested. No statistically significant differences between the groups were found.

Results

Overall, the findings suggest that both primary reinforcement alone as well as a verbal or clicker secondary reinforcer can be used successfully in training a dog to perform a novel behavior, but that no positive reinforcement method demonstrated significantly greater efficacy than any other.

Improving dog training methods: Efficacy and efficiency of reward and mixed training methods

Dogs play an important role in our society as companions and work partners, and proper training of these dogs is pivotal. For companion dogs, training helps preventing or managing dog behavioral problems—the most frequently cited reason for relinquishing and euthanasia, and it promotes successful dog-human relationships and thus maximizes benefits humans derive from bonding with dogs. For working dogs, training is crucial for them to successfully accomplish their jobs. Dog training methods range widely from those using predominantly aversive stimuli (aversive methods), to those combining aversive and rewarding stimuli (mixed methods) and those focusing on the use of rewards (reward methods). The use of aversive stimuli in training is highly controversial and several veterinary and animal protection organizations have recommended a ban on pinch collars, e-collars and other techniques that induce fear or pain in dogs, on the grounds that such methods compromise dog welfare. At the same time, training methods based on the use of rewards are claimed to be more humane and equally or more effective than aversive or mixed methods. This important discussion, however, has not always been based in solid scientific evidence. Although there is growing scientific evidence that training with aversive stimuli has a negative impact on dog welfare, the scientific literature on the efficacy and efficiency of the different methodologies is scarce and inconsistent. Hence, the goal of the current study is to investigate the efficacy and efficiency of different dog training methods. To that end, we will apply different dog training methods in a population of working dogs and evaluate the outcome after a period of training. The use of working dogs will allow for a rigorous experimental design and control, with randomization of treatments. Military (n = 10) and police (n = 20) dogs will be pseudo-randomly allocated to two groups. One group will be trained to perform a set of tasks (food refusal, interrupted recall, dumbbell retrieval and placing items in a basket) using reward methods and the other group will be trained for the same tasks using mixed methods. Later, the dogs will perform a standardized test where they will be required to perform the trained behaviors. The reliability of the behaviors and the time taken to learn them will be assessed in order to evaluate the efficacy and efficiency, respectively, of the different training methods. This study will be performed in collaboration with the Portuguese Army and with the Portuguese Public Security Police (PSP) and integrated with their dog training programs.

What's in a Click? The Efficacy of Conditioned Reinforcement in Applied Animal Training: A Systematic Review and Meta-Analysis

Simple Summary

Conditioned reinforcement, for example, clicker training, has become increasingly popular in recent decades. Hence, questions about the effectiveness of the conditioned reinforcer have become prominent in the animal training arena. This article summarizes the scientific literature on conditioned reinforcement in applied animal training settings (e.g., homes). It was found that dogs and horses were the most frequently studied animals. Clickers and food were the most often used training stimuli. Effect size analysis found a medium effect of clicker training. The literature reviewed here shows that conditioned reinforcement is an effective approach to change animal behavior; however, sizable information potentially related to its effectiveness was not clearly reported in the studies (e.g., food preferences). Although this review fills in a gap in the literature, it also points to the need for more research to further the understanding of conditioned reinforcement phenomena.

Abstract

A conditioned reinforcer is a stimulus that acquired its effectiveness to increase and maintain a target behavior on the basis of the individual’s history—e.g., pairings with other reinforcers. This systematic review synthesized findings on conditioned reinforcement in the applied animal training field. Thirty-four studies were included in the review and six studies were eligible for a meta-analysis on the effectiveness of behavioral interventions that implemented conditioned reinforcement (e.g., clicks, spoken word, or whistles paired with food). The majority of studies investigated conditioned reinforcement with dogs (47%, n = 16) and horses (30%, n = 10) implementing click–food pairings. All other species (cats, cattle, fish, goats, and monkeys) were equally distributed across types of conditioned (e.g., clicker or spoken word) and unconditioned reinforcers (e.g., food, water, or tactile). A meta-analysis on the effectiveness of conditioned reinforcement in behavioral interventions found a medium summary effect size (Tau-U 0.77; CI_95% = [0.53, 0.89]), when comparing baseline, where no training was done, and treatment levels. Moderators of conditioned reinforcement effectiveness were species (e.g., horses) and research design (e.g., multiple-baseline designs). The small number of intervention-focused studies available limits the present findings and highlights the need for more systematic research into the effectiveness of conditioned reinforcement across species.

Clicker Training Accelerates Learning of Complex Behaviors but Reduces Discriminative Abilities of Yucatan Miniature Pigs

Simple Summary

Animal training is intended to teach specific behavioral responses to specific requests. Clicker Training (CT) is a method to train animals based on the use of a device that emits a sound to be associated as a marker that predicts the delivery of something wanted (food). It is believed that CT decreases training time compared to other types of training that use different markers, such as voice. Herein, we used two-month-old miniature piglets to assess whether CT decreased the number of repeats required to learn complex behaviors compared to voice-trained animals. Furthermore, we compared the number of correct choices of animals from both groups when tested for the discrimination of objects. The results indicated that CT decreased the number of repetitions required to learn to fetch an object but reduced the animals’ ability to make correct decisions during discriminatory trials compared to voice-trained animals. This suggests that CT is more efficient than voice in teaching complex behaviors but reduces the ability of animals to use the cognitive processes necessary to discriminate and select objects associated with reward. Animal trainers might consider our results to decide which marker is to be implemented based on the aim and purpose of the training.

Abstract

Animal training is meant to teach specific behavioral responses to specific cues. Clicker training (CT) is a popular training method based on the use of a device that emits a sound of double-click to be associated as a first-order conditioned stimulus in contingency with positive reinforcements. After some repetitions, the clicker sound gains some incentive value and can be paired with the desired behavior. Animal trainers believed that CT can decrease training time compared to other types of training. Herein, we used two-month old miniature piglets to evaluate whether CT decreased the number of repetitions required to learn complex behaviors as compared with animals trained with voice instead of the clicker. In addition, we compared the number of correct choices of animals from both groups when exposed to object discriminative tests. Results indicated that CT decreased the number of repetitions required for pigs to learn to fetch an object but reduced the ability of animals to make correct choices during the discriminate trials. This suggests that CT is more efficient than voice to teach complex behaviors but reduces the ability of animals to use cognitive processes required to discriminate and select objects associated with reward.

Function matters: a review of terminological differences in applied and basic clicker training research

In clicker training, animal trainers pair a small device (a “clicker”) with a reward when teaching or maintaining responding. Animal trainers often assume clicker training is a “science-based” way to train animals. But, the few studies that have compared clicker training to a control have not provided evidence that adding a clicker is beneficial to training. This may be because research on clicker training has studied only one of several potential functions of the clicker stimulus that have been discussed by animal trainers. A systematic approach to researching the function of the clicker in clicker training would benefit from collaboration between applied and basic researchers. However, this will require that terminological differences between animal trainers and basic researchers are reconciled. This paper reviews the few studies that have compared clicker training to a control group and then discusses how trainers and basic researchers use the same terminology in functionally different ways—suggesting the empirical support for mechanisms underlying clicker training is less robust than previously assumed. These differences highlight many opportunities to answer basic and applied research questions relative to clicker training methods. Advancements in clicker training methods will benefit animal trainers who have been using clicker training for decades as well as applied practitioners who have extended clicker training to humans in educational and clinical settings.

A conditioned reinforcer did not help to maintain an operant conditioning in the absence of a primary reinforcer in horses

The use of conditioned reinforcers is increasingly promoted in animal training. Surprisingly, the efficiency of their use remains to be demonstrated in horses. This study aimed to determine whether an auditory signal which had previously been associated with a food reward 288 times could be used as a conditioned reinforcer to replace the primary reinforcer in an unrelated operant conditioning procedure. Fourteen horses were divided into two groups of 7: No Reinforcement (NR) and Conditioned Reinforcement (CR). All horses underwent nine sessions of Pavlovian conditioning during which the word "good" was associated with food (32 associations/session). The horses then followed five sessions of operant conditioning (30 trials/session) during which they had to touch a cone signaled by an experimenter to receive a food reward. The last day, horses underwent one test session of the operant response: no reward was given, but the word "good" was said each time a CR horse touched the cone. Nothing was said in the NR group. CR horses did not achieve more correct trials than NR horses during the test. These findings again show that the conditioned reinforcement was ineffective when used instead of the primary reinforcement to maintain conditioning.

Positive reinforcement training for a trunk wash in Nepal's working elephants: demonstrating alternatives to traditional elephant training techniques

Many trainers of animals in the zoo now rely on positive reinforcement training to teach animals to voluntarily participate in husbandry and veterinary procedures in an effort to improve behavioral reliability, captive management, and welfare. However, captive elephant handlers in Nepal still rely heavily on punishment- and aversion-based methods. The aim of this project was to determine the effectiveness of secondary positive reinforcement (SPR) in training free-contact elephants in Nepal to voluntarily participate in a trunk wash for the purpose of tuberculosis testing. Five female elephants, 4 juveniles and 1 adult, were enrolled in the project. Data were collected in the form of minutes of training, number of offers made for each training task, and success rate for each task in performance tests. Four out of 5 elephants, all juveniles, successfully learned the trunk wash in 35 sessions or fewer, with each session lasting a mean duration of 12 min. The elephants' performance improved from a mean success rate of 39.0% to 89.3% during the course of the training. This study proves that it is feasible to efficiently train juvenile, free-contact, traditionally trained elephants in Nepal to voluntarily and reliably participate in a trunk wash using only SPR techniques.

Stress modulates instrumental learning performances in horses (Equus caballus) in interaction with temperament

The present study investigates how the temperament of the animal affects the influence of acute stress on the acquisition and reacquisition processes of a learning task. After temperament was assessed, horses were subjected to a stressor before or after the acquisition session of an instrumental task. Eight days later, horses were subjected to a reacquisition session without any stressor. Stress before acquisition tended to enhance the number of successes at the beginning of the acquisition session. Eight days later, during the reacquisition session, contrary to non-stressed animals, horses stressed after acquisition, and, to a lesser extent, horses stressed before acquisition, did not improve their performance between acquisition and reacquisition sessions. Temperament influenced learning performances in stressed horses only. Particularly, locomotor activity improved performances whereas fearfulness impaired them under stressful conditions. Results suggest that direct exposure to a stressor tended to increase acquisition performances, whereas a state of stress induced by the memory of a stressor, because it has been previously associated with the learning context, impaired reacquisition performances. The negative effect of a state of stress on reacquisition performances appeared to be stronger when exposure to the stressor occurred after rather than before the acquisition session. Temperament had an impact on both acquisition and reacquisition processes, but under stressful conditions only. These results suggest that stress is necessary to reveal the influence of temperament on cognitive performances.

Using differential reinforcement to improve equine welfare: shaping appropriate truck loading and feet handling

Inappropriate behavior during common handling procedures with horses is often subject to aversive treatment. The present study replicated and extended previous findings using differential reinforcement to shape appropriate equine handling behavior. In Study 1, a multiple baseline across subjects design was used with four horses to determine first the effects of shaping target-touch responses and then successive approximations of full truck loading under continuous and intermittent schedules of reinforcement. Full loading responses were shaped and maintained in all four horses and occurrences of inappropriate behaviors reduced to zero. Generalization of the loading response was also observed to both a novel trainer and trailer. In Study 2, a changing criterion design was used to increase the duration of feet handling with one horse. The horse's responding reached the terminal duration criterion of 1min and showed consistent generalization and one-week maintenance. Overall, the results of both studies support the use of applied equine training systems based on positive reinforcement for increasing appropriate behavior during common handling procedures.

Equine learning behaviour

Scientists and equestrians continually seek to achieve a clearer understanding of equine learning behaviour and its implications for training. Behavioural and learning processes in the horse are likely to influence not only equine athletic success but also the usefulness of the horse as a domesticated species. However given the status and commercial importance of the animal, equine learning behaviour has received only limited investigation. Indeed most experimental studies on equine cognitive function to date have addressed behaviour, learning and conceptualization processes at a moderately basic cognitive level compared to studies in other species. It is however, likely that the horses with the greatest ability to learn and form/understand concepts are those, which are better equipped to succeed in terms of the human-horse relationship and the contemporary training environment. Within equitation generally, interpretation of the behavioural processes and training of the desired responses in the horse are normally attempted using negative reinforcement strategies. On the other hand, experimental designs to actually induce and/or measure equine learning rely almost exclusively on primary positive reinforcement regimes. Employing two such different approaches may complicate interpretation and lead to difficulties in identifying problematic or undesirable behaviours in the horse. The visual system provides the horse with direct access to immediate environmental stimuli that affect behaviour but vision in the horse is of yet not fully investigated or understood. Further investigations of the equine visual system will benefit our understanding of equine perception, cognitive function and the subsequent link with learning and training. More detailed comparative investigations of feral or free-ranging and domestic horses may provide useful evidence of attention, stress and motivational issues affecting behavioural and learning processes in the horse. The challenge for scientists is, as always, to design and commission experiments that will investigate and provide insight into these processes in a manner that withstands scientific scrutiny.