Operant Conditioning

14,000,000 Leading Edge Experts on the ideXlab platform

Scan Science and Technology

Contact Leading Edge Experts & Companies

Scan Science and Technology

Contact Leading Edge Experts & Companies

The Experts below are selected from a list of 189 Experts worldwide ranked by ideXlab platform

Jonathan R. Wolpaw - One of the best experts on this subject based on the ideXlab platform.

  • retraining reflexes clinical translation of spinal reflex Operant Conditioning
    Neurotherapeutics, 2018
    Co-Authors: Amir Eftekhar, James J S Norton, Christine M Mcdonough, Jonathan R. Wolpaw
    Abstract:

    Neurological disorders, such as spinal cord injury, stroke, traumatic brain injury, cerebral palsy, and multiple sclerosis cause motor impairments that are a huge burden at the individual, family, and societal levels. Spinal reflex abnormalities contribute to these impairments. Spinal reflex measurements play important roles in characterizing and monitoring neurological disorders and their associated motor impairments, such as spasticity, which affects nearly half of those with neurological disorders. Spinal reflexes can also serve as therapeutic targets themselves. Operant Conditioning protocols can target beneficial plasticity to key reflex pathways; they can thereby trigger wider plasticity that improves impaired motor skills, such as locomotion. These protocols may complement standard therapies such as locomotor training and enhance functional recovery. This paper reviews the value of spinal reflexes and the therapeutic promise of spinal reflex Operant Conditioning protocols; it also considers the complex process of translating this promise into clinical reality.

  • Operant Conditioning of Reflexes
    Encyclopedia of Neuroscience, 2009
    Co-Authors: Jonathan R. Wolpaw, X.y. Chen
    Abstract:

    The spinal stretch reflex and its electrical analog the Hoffmann (H)-reflex are simple behaviors mediated by spinal cord pathways. Because these pathways are affected by descending activity from the brain, monkeys, humans, rats, and mice can gradually increase or decrease these reflexes when rewarded for doing so. This Operant Conditioning depends on the corticospinal tract and produces a complex hierarchy of spinal and supraspinal plasticity. It is related to processes that occur during development, during skill acquisition throughout life, and in response to trauma and disease. It is a simple model for exploring the mechanisms of skill acquisition and may be the basis for new rehabilitation methods for people with spinal cord injuries or other disorders of motor control.

  • Operant Conditioning of reciprocal inhibition in rat soleus muscle
    Journal of Neurophysiology, 2006
    Co-Authors: Xiang Yang Chen, Lu Chen, Yi Chen, Jonathan R. Wolpaw
    Abstract:

    Operant Conditioning of the H-reflex, the electrical analog of the spinal stretch reflex (SSR), induces activity-dependent plasticity in the spinal cord and might be used to improve locomotion afte...

  • H-Reflex Operant Conditioning in Mice
    Journal of neurophysiology, 2006
    Co-Authors: Jonathan S. Carp, Xiang Yang Chen, Ann M. Tennissen, Jonathan R. Wolpaw
    Abstract:

    Rats, monkeys, and humans can alter the size of their spinal stretch reflex and its electrically induced analog, the H-reflex (HR), when exposed to an Operant Conditioning paradigm. Because this co...

  • Operant Conditioning of H-reflex in spinal cord-injured rats.
    Journal of neurotrauma, 1996
    Co-Authors: Xiang Yang Chen, Jonathan R. Wolpaw, Lyn B. Jakeman, Bradford T. Stokes
    Abstract:

    Operant Conditioning of the spinal stretch reflex or its electrical analog, the H-reflex, is a new model for exploring the mechanisms of supraspinal control over spinal cord function. Both rats and primates can gradually increase (HRup Conditioning mode) or decrease (HRdown Conditioning mode) soleus H-reflex magnitude when exposed to an Operant Conditioning task. This study used H-reflex Operant Conditioning to assess and modify spinal cord function after injury. Soleus H-reflexes were elicited and recorded with chronically implanted electrodes from rats that had been subjected to calibrated contusion injuries to the spinal cord at T8. From 18 to 140 days after injury, background EMG, M response amplitude, and initial H-reflex amplitude were not significantly different from those of normal rats. HRdown Conditioning was successful in some, but not all, spinal cord-injured rats. The H-reflex decrease achieved by Conditioning was inversely correlated with the severity of the injury as assessed histologically or by time to return of bladder function. It was not correlated with the length of time between injury and the beginning of Conditioning. The results confirm the importance of descending control from supraspinal structures in mediating Operantly conditioned change in H-reflex amplitude. In conjunction with recent human studies, they suggest that H-reflex Conditioning could provide a sensitive new means for assessing spinal cord function after injury, and might also provide a method for initiating and guiding functional rehabilitation.

Xiang Yang Chen - One of the best experts on this subject based on the ideXlab platform.

  • Operant Conditioning of reciprocal inhibition in rat soleus muscle
    Journal of Neurophysiology, 2006
    Co-Authors: Xiang Yang Chen, Lu Chen, Yi Chen, Jonathan R. Wolpaw
    Abstract:

    Operant Conditioning of the H-reflex, the electrical analog of the spinal stretch reflex (SSR), induces activity-dependent plasticity in the spinal cord and might be used to improve locomotion afte...

  • H-Reflex Operant Conditioning in Mice
    Journal of neurophysiology, 2006
    Co-Authors: Jonathan S. Carp, Xiang Yang Chen, Ann M. Tennissen, Jonathan R. Wolpaw
    Abstract:

    Rats, monkeys, and humans can alter the size of their spinal stretch reflex and its electrically induced analog, the H-reflex (HR), when exposed to an Operant Conditioning paradigm. Because this co...

  • Operant Conditioning of H-reflex in spinal cord-injured rats.
    Journal of neurotrauma, 1996
    Co-Authors: Xiang Yang Chen, Jonathan R. Wolpaw, Lyn B. Jakeman, Bradford T. Stokes
    Abstract:

    Operant Conditioning of the spinal stretch reflex or its electrical analog, the H-reflex, is a new model for exploring the mechanisms of supraspinal control over spinal cord function. Both rats and primates can gradually increase (HRup Conditioning mode) or decrease (HRdown Conditioning mode) soleus H-reflex magnitude when exposed to an Operant Conditioning task. This study used H-reflex Operant Conditioning to assess and modify spinal cord function after injury. Soleus H-reflexes were elicited and recorded with chronically implanted electrodes from rats that had been subjected to calibrated contusion injuries to the spinal cord at T8. From 18 to 140 days after injury, background EMG, M response amplitude, and initial H-reflex amplitude were not significantly different from those of normal rats. HRdown Conditioning was successful in some, but not all, spinal cord-injured rats. The H-reflex decrease achieved by Conditioning was inversely correlated with the severity of the injury as assessed histologically or by time to return of bladder function. It was not correlated with the length of time between injury and the beginning of Conditioning. The results confirm the importance of descending control from supraspinal structures in mediating Operantly conditioned change in H-reflex amplitude. In conjunction with recent human studies, they suggest that H-reflex Conditioning could provide a sensitive new means for assessing spinal cord function after injury, and might also provide a method for initiating and guiding functional rehabilitation.

  • Operant Conditioning of H-reflex in freely moving rats.
    Journal of neurophysiology, 1995
    Co-Authors: Xiang Yang Chen, Jonathan R. Wolpaw
    Abstract:

    1. Primates can increase or decrease the spinal stretch reflex and its electrical analogue, the H-reflex (HR), in response to an Operant Conditioning task. This Conditioning changes the spinal cord itself and thereby provides an experimental model for defining the processes and substrates of a learned change in behavior. Because the phenomenon has been demonstrated only in primates, its generality and theoretical implications remain unclear, and its experimental use is restricted by the difficulties of primate research. In response to these issues, the present study explored Operant Conditioning of the H-reflex in the rat. 2. Seventeen Sprague-Dawley rats implanted with chronic electromyographic (EMG) recording electrodes in one soleus muscle and nerve cuff stimulating electrodes on the posterior tibial nerve were rewarded (either with medial forebrain bundle stimulation or food) for increasing (HRup Conditioning mode) or decreasing (HRdown Conditioning mode) soleus H-reflex amplitude without change in background EMG or M response (direct muscle response) amplitude. 3. H-reflex amplitude changed appropriately over 3-4 wk. Under the HRup mode, it rose to an average of 158 +/- 54% (mean +/- SD) of initial value, whereas under the HRdown mode it fell to an average of 67 +/- 11% of initial value. Background EMG and M response amplitude did not change. 4. Operant Conditioning of the H-reflex in the rat appears similar in rate and final magnitude of change to that observed in the monkey.(ABSTRACT TRUNCATED AT 250 WORDS)

Xiaogang Ruan - One of the best experts on this subject based on the ideXlab platform.

  • Operant Conditioning learning model based on BP network
    Proceedings of the 33rd Chinese Control Conference, 2014
    Co-Authors: Jing Huang, Xiaogang Ruan, Ruoyan Wei, Qingwu Fan
    Abstract:

    The naissance of cognitive robotics marks that psychology is more and more highly involved in the artificial intelligence research. Inspired by psychology and ethology, we propose an Operant Conditioning learning model based on BP (back-propagation) network named OCLMBP on the basis of Skinner’s relevant theory. The model is applied to the problem of obstacle avoidance with a wheeled robot. The robot controlled by the model can learn to avoid obstacles through a learning-by-doing style without any external supervision, but by the proximity sensors information as positive or negative reinforcement signals. The results are compared with original OCLM (Operant Conditioning learning model), and the proposed model has better performance.

  • the skinner automaton a psychological model formalizing the theory of Operant Conditioning
    Science China-technological Sciences, 2013
    Co-Authors: Xiaogang Ruan
    Abstract:

    Operant Conditioning is one of the fundamental mechanisms of animal learning, which suggests that the behavior of all animals, from protists to humans, is guided by its consequences. We present a new stochastic learning automaton called a Skinner automaton that is a psychological model for formalizing the theory of Operant Conditioning. We identify animal Operant learning with a thermodynamic process, and derive a so-called Skinner algorithm from Monte Carlo method as well as Metropolis algorithm and simulated annealing. Under certain conditions, we prove that the Skinner automaton is expedient, ɛ-optimal, optimal, and that the Operant probabilities converge to the set of stable roots with probability of 1. The Skinner automaton enables machines to autonomously learn in an animal-like way.

  • Operant Conditioning Learning Model in the Bionic Experiment
    Applied Mechanics and Materials, 2013
    Co-Authors: Jing Huang, Xiaogang Ruan, Qingwu Fan, Xiaoping Zhang
    Abstract:

    A learning model based on the Operant Conditioning mechanism (OCLM) is presented in this paper to deal with the autonomous learning problem in cognitive robotics. The model is described by 9 elements, including the space set, the action set, the bionic learning function and the system entropy etc. To describe the learning mechanism which is the core of the model, a new notion negative ideal degree(NID) is defined. We also prove the convergence of OCLM to indicate that the model is a self-organization system. OCLM has been applied to simulating the Skinner rat experiment. The results show that this model can well simulate the animals Operant Conditioning behavior, acquire the cognitive skills through the interaction with the environment and achieve self-learning and self-adaptability.

  • Bionic experiments based on autonomous Operant Conditioning automata
    International Journal of Modelling Identification and Control, 2011
    Co-Authors: Lizhen Dai, Xiaogang Ruan, Jing Chen
    Abstract:

    This paper proposes an autonomous Operant Conditioning (AOC) automaton that, designs a bionic autonomous learning control method, and constructs an Operant Conditioning learning system. AOC provides a recursive operation programme. AOC simulates biological Operant Conditioning mechanism, which has a bionic self-organising feature, including self-learning and adaptive capabilities, and can be used for description, simulation, and design of a variety of self-organising systems. The bionic autonomous learning control method can be used to describe and simulate a bionic autonomous learning process. The learning system can learn on line by interaction with environment, and achieve the best consequences. Based on the above, we apply the model to simulate Skinner-rat experiment to prove that AOC can simulate the learning mechanism of Operant Conditioning, and apply it to achieving the balancing control of two-wheeled self-balancing robots which shows that AOC can be used to design a variety of intelligent behaviour for robotic systems.

  • ICNC - Skinner-rat experiment based on autonomous Operant Conditioning automata
    2010 Sixth International Conference on Natural Computation, 2010
    Co-Authors: Xiaogang Ruan, Lizhen Dai
    Abstract:

    This paper presents autonomous Operant Conditioning automata AOC. It involves a discrete computer model described self-automatic machines, including: set of actions, the state set; ‘condition - action’ rule set, the observed state transition, as well as Operant Conditioning learning law. And, it defines the behavior entropy based on the orientation value of the state of AOC. AOC provides a recursive run the program. AOC simulates biological Operant Conditioning mechanism, which has a bionic self-organizing feature, including self-learning and adaptive capabilities, can be used for description, simulation, design of a variety of self-organizing system. Based on the model this paper designs a bionic self-learning control method and uses it to simulate Skinner animal experiments to prove that AOC can simulate the learning mechanism of Operant Conditioning, which shows that AOC can be used to design a variety of intelligent robotic systems' behavior.

Ben Akpan - One of the best experts on this subject based on the ideXlab platform.

  • Classical and Operant Conditioning—Ivan Pavlov; Burrhus Skinner
    Springer Texts in Education, 2020
    Co-Authors: Ben Akpan
    Abstract:

    Conditioning is a learning process in which one’s behaviour becomes dependent on the occurrence of a stimulus in that environment. Two types of Conditioning will be considered. In classical Conditioning, an unconditioned stimulus such as meat will make a dog to salivate. The salivation is an unconditioned response. A neutral stimulus such as a bell will not produce any salivation in a dog. However, if a previously neutral stimulus such as a bell is paired with meat (an unconditioned stimulus), the bell becomes a conditioned stimulus and at the sound of the bell alone, the dog elicits a conditioned response by salivating. In contrast, Operant Conditioning does not depend on a preceding stimulus. It rather depends on what follows as a consequence of behaviour. Operant Conditioning involves a two-way process: action (or behaviour) operates on the environment while the environment at the same time shapes behaviour. Since behaviour is shaped efficiently through positive reinforcement, it follows that if behaviour results in a negative consequence, there is a decrease in that behaviour. The proponents of classical and Operant Conditioning are Ivan Pavlov (1849–1936) and Burrhus Frederic Skinner (1904–1990), respectively. This chapter explores the principles underlying classical and Operant Conditioning. Also discussed is how each theory may be applied in furtherance of science teaching and learning.

  • classical and Operant Conditioning ivan pavlov burrhus skinner
    2020
    Co-Authors: Ben Akpan
    Abstract:

    Conditioning is a learning process in which one’s behaviour becomes dependent on the occurrence of a stimulus in that environment. Two types of Conditioning will be considered. In classical Conditioning, an unconditioned stimulus such as meat will make a dog to salivate. The salivation is an unconditioned response. A neutral stimulus such as a bell will not produce any salivation in a dog. However, if a previously neutral stimulus such as a bell is paired with meat (an unconditioned stimulus), the bell becomes a conditioned stimulus and at the sound of the bell alone, the dog elicits a conditioned response by salivating. In contrast, Operant Conditioning does not depend on a preceding stimulus. It rather depends on what follows as a consequence of behaviour. Operant Conditioning involves a two-way process: action (or behaviour) operates on the environment while the environment at the same time shapes behaviour. Since behaviour is shaped efficiently through positive reinforcement, it follows that if behaviour results in a negative consequence, there is a decrease in that behaviour. The proponents of classical and Operant Conditioning are Ivan Pavlov (1849–1936) and Burrhus Frederic Skinner (1904–1990), respectively. This chapter explores the principles underlying classical and Operant Conditioning. Also discussed is how each theory may be applied in furtherance of science teaching and learning.

Xiaoqin Wang - One of the best experts on this subject based on the ideXlab platform.

  • An Operant Conditioning method for studying auditory behaviors in marmoset monkeys.
    PloS one, 2012
    Co-Authors: Evan D. Remington, Michael S. Osmanski, Xiaoqin Wang
    Abstract:

    The common marmoset (Callithrix jacchus) is a small New World primate that has increasingly been used as a non-human model in the fields of sensory, motor, and cognitive neuroscience. However, little knowledge exists regarding behavioral methods in this species. Developing an understanding of the neural basis of perception and cognition in an animal model requires measurement of both brain activity and behavior. Here we describe an Operant Conditioning behavioral training method developed to allow controlled psychoacoustic measurements in marmosets. We demonstrate that marmosets can be trained to consistently perform a Go/No-Go auditory task in which a subject licks at a feeding tube when it detects a sound. Correct responses result in delivery of a food reward. Crucially, this Operant Conditioning task generates little body movement and is well suited for pairing behavior with single-unit electrophysiology. Successful implementation of an Operant Conditioning behavior opens the door to a wide range of new studies in the field of auditory neuroscience using the marmoset as a model system.