Operant controlled neural event: formal and systematic approach to electrical coding of behavior in brain

Tracking momentary fluctuations in human attention with a cognitive brain-machine interface

Selective attention produces systematic effects on neural states. It is unclear whether, conversely, momentary fluctuations in neural states have behavioral significance for attention. We investigated this question in the human brain with a cognitive brain-machine interface (cBMI) for tracking electrophysiological steady-state visually evoked potentials (SSVEPs) in real-time. Discrimination accuracy (d') was significantly higher when target stimuli were triggered at high, versus low, SSVEP power states. Target and distractor SSVEP power was uncorrelated across the hemifields, and target d' was unaffected by distractor SSVEP power states. Next, we trained participants on an auditory neurofeedback paradigm to generate biased, cross-hemispheric competitive interactions between target and distractor SSVEPs. The strongest behavioral effects emerged when competitive SSVEP dynamics unfolded at a timescale corresponding to the deployment of endogenous attention. In sum, SSVEP power dynamics provide a reliable readout of attentional state, a result with critical implications for tracking and training human attention.

Closed-loop Modulation of the Self-regulating Brain: A Review on Approaches, Emerging Paradigms, and Experimental Designs

Closed-loop approaches, setups, and experimental designs have been applied within the field of neuroscience to enhance the understanding of basic neurophysiology principles (closed-loop neuroscience; CLNS) and to develop improved procedures for modulating brain circuits and networks for clinical purposes (closed-loop neuromodulation; CLNM). The contents of this review are thus arranged into the following sections. First, we describe basic research findings that have been made using CLNS. Next, we provide an overview of the application, rationale, and therapeutic aspects of CLNM for clinical purposes. Finally, we summarize methodological concerns and critics in clinical practice of neurofeedback and novel applications of closed-loop perspective and techniques to improve and optimize its experiments. Moreover, we outline the theoretical explanations and experimental ideas to test animal models of neurofeedback and discuss technical issues and challenges associated with implementing closed-loop systems. We hope this review is helpful for both basic neuroscientists and clinical/ translationally-oriented scientists interested in applying closed-loop methods to improve mental health and well-being.

Brain-Machine Interfaces: Powerful Tools for Clinical Treatment and Neuroscientific Investigations

Brain-machine interfaces (BMIs) have exploded in popularity in the past decade. BMIs, also called brain-computer interfaces, provide a direct link between the brain and a computer, usually to control an external device. BMIs have a wide array of potential clinical applications, ranging from restoring communication to people unable to speak due to amyotrophic lateral sclerosis or a stroke, to restoring movement to people with paralysis from spinal cord injury or motor neuron disease, to restoring memory to people with cognitive impairment. Because BMIs are controlled directly by the activity of prespecified neurons or cortical areas, they also provide a powerful paradigm with which to investigate fundamental questions about brain physiology, including neuronal behavior, learning, and the role of oscillations. This article reviews the clinical and neuroscientific applications of BMIs, with a primary focus on motor BMIs.

Real-time fMRI neurofeedback: progress and challenges

In February of 2012, the first international conference on real time functional magnetic resonance imaging (rtfMRI) neurofeedback was held at the Swiss Federal Institute of Technology Zurich (ETHZ), Switzerland. This review summarizes progress in the field, introduces current debates, elucidates open questions, and offers viewpoints derived from the conference. The review offers perspectives on study design, scientific and clinical applications, rtfMRI learning mechanisms and future outlook.

EEG operant conditioning (biofeedback) and traumatic brain injury

A review is presented of the currently sparse literature about EEG operant conditioning or biofeedback as a treatment to reduce symptomology and patient complaints following a traumatic brain injury. The paper also evaluates the general use of quantitative EEG (QEEG) to assess traumatic brain injury and to facilitate EEG biofeedback treatment. The use of an age matched reference normative QEEG database and QEEG discriminant function are presented as a method to evaluate the nature or neurological basis of a patient's complaints as well as to individualize an efficient and optimal feedback protocol and to help evaluate the efficacy of the biofeedback therapy. Univariate and multivariate statistical issues are discussed, different classes of experimental designs are described and then a "double blind" research study is proposed in an effort to encourage future research in the area of EEG biofeedback for the treatment and rehabilitation of traumatic brain injury.

In vitro analog of operant conditioning in aplysia. II. Modifications of the functional dynamics of an identified neuron contribute to motor pattern selection

Previously, an analog of operant conditioning was developed using the buccal ganglia of Aplysia, the probabilistic occurrences of a specific motor pattern (i.e., pattern I), a contingent reinforcement (i.e., stimulation of the esophageal nerve), and monotonic stimulation of a peripheral nerve (i.e., n.2,3). This analog expressed a key feature of operant conditioning (i.e., selective enhancement of the probability of occurrence of a designated motor pattern by contingent reinforcement). In addition, the training induced changes in the dynamical properties of neuron B51, an element of the buccal central pattern generator. To gain insights into the neuronal mechanisms that mediate features of operant conditioning, the present study identified a neuronal element that was critically involved in the selective enhancement of pattern I. We found that bursting activity in cell B51 contributed significantly to the expression of pattern I and that changes in the dynamical properties of this cell were associated with the selective enhancement of pattern I. These changes could be induced by an explicit association of reinforcement with random depolarization of B51. No stimulation of n.2,3 was required. These results indicate that the selection of a designated motor pattern by contingent reinforcement and the underlying neuronal plasticity resulted from the association of reinforcement with a component of central neuronal activity that contributes to a specific motor pattern. The sensory stimulus that allows for occurrences of different motor acts may not be critical for induction of plasticity that mediates the selection of a motor output by contingent reinforcement in operant conditioning.

Applied psychophysiology and biofeedback of event-related potentials (brain waves): historical perspective, review, future directions

This paper reviews the efforts of workers in the 1960s-1980s to demonstrate voluntary control of exogenously evoked (event-related) potentials in visual, somatic sensory, and auditory systems in rats, cats, and humans. The first part of the paper reviews the conceptual foundation and development of the work--it actually arose from traditional sensory coding and neural correlates of behavior studies. The second part summarizes recent applications of the method in the area of pain control. In reviewing these matters, the major effort is directed at revealing how the ideas unfolded in very human, day-to-day, anecdotal terms. There is not much of an attempt to formally review the literature, which is cited for consultation elsewhere. In the same spirit, many possible future experiments are suggested by way of elucidating the key remaining questions in the area.

Self-report during feedback regulation of slow cortical potentials

Subjects received exteroceptive feedback for bidirectional changes in slow cortical potentials or alpha power measured from the vertex. The slow potential group succeeded in shifting slow potentials toward negativity and positivity on feedback and transfer trials requiring these changes, after two sessions of training. Differentiation of negativity and positivity was accompanied by verbal reports of somatomotor activation that occurred on trials on which negative slow potentials were required (p less than .01). Vertical and lateral eye movements, chin and frontalis electromyogram, and heart rate did not differentiate between negativity and positivity trials in the slow potential negativity during feedback. Although the alpha power group did not succeed at controlling changes in alpha, evidence of a training effect appeared in verbal reports of emotional arousal (p less than .05) and focused vision (p less than .08) on alpha suppression trials in this group. We discuss the findings from the viewpoint that biofeedback tasks involving electrocortical responses are problems in the organization of action that subjects seek to solve.

Operant conditioning in motor and neural integration

Empirical and theoretical reasons were given to investigate operant conditioning in a new, integrative approach within motor control physiology. Elements of inborn and learned behavior were presented in a framework specifying their stimuli and responses. The operant was redefined as a controlling discriminative stimulus, Sd, together with the response, R, it produces, on the basis of a previous literature of operant and instrumental research. Complex motor and neural activity were reviewed in accordance with partitioning of: responses, controlling stimulation, reinforcement, and functions of movement-produced stimulation. Schematics portrayed reinforcement principles through analysis of a fast pathway from Ia muscle spindle afferents to motor outflow. Methods were suggested to minimize operant units through selective reinforcement and establish them to defined end points of learning within composite, ongoing behavior. It was argued that operant neural mechanisms can be investigated efficiently only by starting with individual operants that are thoroughly characterized.

Operant conditioning of somatosensory evoked potential (SEP) amplitude in rats. I. Specific changes in SEP amplitude and a naloxone-reversible somatotopically specific change in facial nociception

The aim of this experiment was to investigate possible endogenous opioid modulation of innocuous somatosensory activity. Somatosensory activity was measured by recording cortical somatosensory evoked potential (SEP) and reflex movement amplitude evoked by innocuous electrical stimulation of the spinal trigeminal tract in awake rats. Putative endogenous opioid activity was blocked using the opiate antagonist naloxone (1 mg/kg). The amplitude of midlatency SEP components (14-50 ms latency) increased following administration of naloxone and repeated stimulus presentations. The amplitude of these components decreased following administration of the opiate agonist morphine (3 mg/kg). An early cortical component (10 ms latency) habituated following the administration of saline but did not habituate following naloxone. Naloxone also enhanced habituation of the late SEP components (60-120 ms latency) and reflex movement evoked at higher stimulus intensities. Morphine decreased the amplitude of the early cortical component but had no consistent effect on the amplitude of the late SEP components.

Operant conditioning of the short-latency cervical somatosensory evoked potential in quadriplegics

Operant conditioning of short-latency cervical somatosensory evoked potentials (CSEP) was demonstrated in five cervical cord injury subjects. Subjects were conditioned to augment the N14 potential, thought to originate from the dorsal column nucleus. Increased N14 potential was associated with an increase in N19 and P22 potentials, and either a decrease (base) or no change (train) in the brachial plexus potential. The N19 potential was correlated with significant reductions in the sensation-twitch (S/T) ratio during conditioning sessions, indexing improved sensation to low-intensity percutaneous stimulation. Moreover, S/T ratios decreased significantly during conditioning sessions, and were reduced significantly relative to initial baseline values. The results do not appear to be associated with trivial mediating influences.

Operant conditioning of trigeminally-evoked cortical potentials: correlated effects on facial nociception

The effects of operant conditioning somatosensory evoked potential (SEP) amplitude on nociceptive sensitivity were studied in albino rats. SEPs were evoked by stimulation to the descending trigeminal tract. Rewarding medial forebrain bundle stimulation (at intensities predetermined to sustain bar pressing) was made contingent upon the animal making the amplitude of the SEP 0.5 standard deviation (S.D.) large (uptraining) or 0.5 S.D. smaller (downtraining) than the predetermined mean value. Nociceptive sensitivity was measured immediately following the conditioning session by heating the rat's face and noting the latency of a defensive face rubbing response directed at that area of the face. Increasing the amplitude of the SEP (uptraining) was associated with a decrease in noxious sensitivity. Decreasing the amplitude of the SEP (downtraining) was associated with an increase in noxious sensitivity.

Operant conditioning of trigeminal nuclear evoked potentials

The purpose of this study was to demonstrate operant conditioning of potentials in the rat's trigeminal complex evoked by stimulation of the primary descending trigeminal tract. The amplitude of the prominent component of the potential, with a peak at 10 to 22 msec after the stimulus, was conditioned. Reinforcement was electrical stimulation of the medial forebrain bundle. A bidirectional conditioning paradigm was used to control for noncontingent effects of the reinforcer. Eight of the thirteen animals demonstrated control of the evoked potential. Application of the neural conditioning paradigm to the investigation of loci of neuronal plasticity is discussed.

Operant conditioning of single-unit response patterns in visual cortex

Unit responses to photic stimuli were studied in cat visual cortex. After the baseline response pattern of a cell was determined, conditioning trials were given during which reinforcement was contingent upon increased firing during a selected segment of the poststimulus interval. Density of reinforcement increased substantially in about half the cells studied; significant increases in firing occurred within, but not outside, the criterion segment.

Operant-controlled evoked responses: discrimination of conditioned and normally occurring components

Rats were rewarded for signaling large and small sensory evoked components with appropriate bar presses. Most rats operantly generated large components and correctly signaled only these. Two rats correctly signaled successful and unsuccessful attempts to generate large waves. One rat discriminated component amplitudes without operantly attempting to generate specific wave types.

Operant control of neural events in humans

Human subjects were trained by traditional methods of instrumental conditioning to change the amplitude of a late component of the auditory evoked potential with and without oscilloscopic feedback of their performance.