The Experts below are selected from a list of 183 Experts worldwide ranked by ideXlab platform
Laura L. Peoples - One of the best experts on this subject based on the ideXlab platform.
-
session long modulations of accumbal firing during sucrose reinforced Operant Behavior
Synapse, 2006Co-Authors: Alexxai V Kravitz, David E Moorman, Alexis Simpson, Laura L. PeoplesAbstract:The nucleus accumbens is involved in the selection and expression of motivated Behaviors. Attempts to understand how activity of single neurons in the accumbens relates to Behavior have largely concentrated on brief modulations in accumbal firing that occur in the seconds around events during Operant sessions. However, a small number of studies have reported modulations that last the entire duration of a Behavioral session. In all of these reports, the Operant session was a drug self-administration session. The present study tested the hypothesis that session-long modulations, like phasic firing patterns, are components of normal accumbal activity during periods of instrumental Behavior. Eight rats were chronically implanted (unilaterally) with microwire arrays in the nucleus accumbens, and trained to lever press on a Fixed-Ratio 1 schedule of sucrose reinforcement. Activity of 51 single units was recorded, and both session-long increases (n = 14) and session-long decreases (n = 13) were observed. These findings show that session-long modulations are a normal component of the response of accumbal neurons during periods of Operant Behavior. Moreover, although session-long modulations during cocaine self-administration sessions might reflect pharmacological actions, aspects of the modulations might additionally or alternatively correspond to afferent-driven responses. Further characterization of the firing patterns may elucidate novel mechanisms that mediate accumbal contributions to Behavior.
-
Operant Behavior during sessions of intravenous cocaine infusion is necessary and sufficient for phasic firing of single nucleus accumbens neurons
Brain research, 1997Co-Authors: Laura L. Peoples, Anthony J. Uzwiak, Fred Gee, Mark O. WestAbstract:The activity of individual accumbens neurons in rats was recorded in relation to intravenous cocaine infusions that were either response (i.e., lever press) contingent or response non-contingent. Neural firing was additionally recorded in relation to non-reinforced lever presses. Comparisons of firing under the three conditions showed that Operant Behavior was necessary and sufficient for preinfusion firing to occur. Surprisingly, the same was true, in many cases, for firing that occurred during the infusion. For other neurons, firing during the infusion was unrelated to Operant Behavior and possibly related to infusion stimuli. The relationship to Operant Behavior exhibited by the majority of NAcc neurons is consistent with previous studies that demonstrated a necessary relationship between NAcc neurons and cocaine reinforced Operant Behavior.
-
Short communication Operant Behavior during sessions of intravenous cocaine infusion is necessary and sufficient for phasic firing of single nucleus accumbens neurons
1997Co-Authors: Laura L. Peoples, Anthony J. Uzwiak, Fred Gee, Mark O. WestAbstract:The activity of individual accumbens neurons in rats was recorded in relation to intravenous cocaine infusions that were either . response i.e., lever press contingent or response non-contingent. Neural firing was additionally recorded in relation to non-reinforced lever presses. Comparisons of firing under the three conditions showed that Operant Behavior was necessary and sufficient for preinfusion firing to occur. Surprisingly, the same was true, in many cases, for firing that occurred during the infusion. For other neurons, firing during the infusion was unrelated to Operant Behavior and possibly related to infusion stimuli. The relationship to Operant Behavior exhibited by the majority of NAcc neurons is consistent with previous studies that demonstrated a necessary relationship between NAcc neurons and cocaine reinforced Operant Behavior. and after cocaine self-infusion 4-6,10,13 . These phasic firing patterns are potentially related to Operant Behavior andror associated stimuli. Alternatively, the firing patterns may be related to other events coincident to the cocaine infusion. The present investigation set up a differentiation between the two alternatives. Specifically, firing patterns associated with response contingent cocaine infusions were compared to firing patterns associated with non-contingent cocaine infusions. A firing pattern related specifically to Operant Behavior would be expected to be present as long as and only if the Behavior were present i.e., present in conjunction with response contingent infusions but not in . conjunction with response non-contingent infusions . Pha- sic firing patterns that are unrelated to the Operant and related instead to the infusion or to some other non-oper-
Mark O. West - One of the best experts on this subject based on the ideXlab platform.
-
Operant Behavior during sessions of intravenous cocaine infusion is necessary and sufficient for phasic firing of single nucleus accumbens neurons
Brain research, 1997Co-Authors: Laura L. Peoples, Anthony J. Uzwiak, Fred Gee, Mark O. WestAbstract:The activity of individual accumbens neurons in rats was recorded in relation to intravenous cocaine infusions that were either response (i.e., lever press) contingent or response non-contingent. Neural firing was additionally recorded in relation to non-reinforced lever presses. Comparisons of firing under the three conditions showed that Operant Behavior was necessary and sufficient for preinfusion firing to occur. Surprisingly, the same was true, in many cases, for firing that occurred during the infusion. For other neurons, firing during the infusion was unrelated to Operant Behavior and possibly related to infusion stimuli. The relationship to Operant Behavior exhibited by the majority of NAcc neurons is consistent with previous studies that demonstrated a necessary relationship between NAcc neurons and cocaine reinforced Operant Behavior.
-
Short communication Operant Behavior during sessions of intravenous cocaine infusion is necessary and sufficient for phasic firing of single nucleus accumbens neurons
1997Co-Authors: Laura L. Peoples, Anthony J. Uzwiak, Fred Gee, Mark O. WestAbstract:The activity of individual accumbens neurons in rats was recorded in relation to intravenous cocaine infusions that were either . response i.e., lever press contingent or response non-contingent. Neural firing was additionally recorded in relation to non-reinforced lever presses. Comparisons of firing under the three conditions showed that Operant Behavior was necessary and sufficient for preinfusion firing to occur. Surprisingly, the same was true, in many cases, for firing that occurred during the infusion. For other neurons, firing during the infusion was unrelated to Operant Behavior and possibly related to infusion stimuli. The relationship to Operant Behavior exhibited by the majority of NAcc neurons is consistent with previous studies that demonstrated a necessary relationship between NAcc neurons and cocaine reinforced Operant Behavior. and after cocaine self-infusion 4-6,10,13 . These phasic firing patterns are potentially related to Operant Behavior andror associated stimuli. Alternatively, the firing patterns may be related to other events coincident to the cocaine infusion. The present investigation set up a differentiation between the two alternatives. Specifically, firing patterns associated with response contingent cocaine infusions were compared to firing patterns associated with non-contingent cocaine infusions. A firing pattern related specifically to Operant Behavior would be expected to be present as long as and only if the Behavior were present i.e., present in conjunction with response contingent infusions but not in . conjunction with response non-contingent infusions . Pha- sic firing patterns that are unrelated to the Operant and related instead to the infusion or to some other non-oper-
Mark E. Bouton - One of the best experts on this subject based on the ideXlab platform.
-
Prediction and control of Operant Behavior: What you see is not all there is
Behavior analysis (Washington D.C.), 2019Co-Authors: Mark E. Bouton, Bernard W. BalleineAbstract:Prediction and control of Operant Behavior are major goals of Behavior analysis. We suggest that achieving these goals can benefit from doing more than identifying the three-term contingency between the Behavior, its setting stimulus, and its consequences. Basic research now underscores the idea that prediction and control require consideration of the Behavior's history. As one example, if an Operant is a goal-directed action, it is controlled by the current value of the reinforcer, as illustrated by the so-called reinforcer devaluation effect. In contrast, if the Behavior is a habit, it occurs automatically, without regard to the reinforcer's value, as illustrated by its insensitivity to the reinforcer devaluation effect. History variables that distinguish actions and habits include the extent of their prior practice and their schedule of reinforcement. Other Operants can appear to have very low or zero strength. However, if the Behavior has reached that level through extinction or punishment, it may precipitously increase in strength by changing the context, allowing time to pass, presenting the reinforcer contingently or noncontingently, or extinguishing an alternative Behavior. Behaviors that are not suppressed by extinction or punishment are not affected the same way. When predicting the strength of an Operant Behavior, what you see is not all there is. The Behavior's history counts.
-
Context change explains resurgence after the extinction of Operant Behavior.
Revista mexicana de analisis de la conducta = Mexican journal of behavior analysis, 2015Co-Authors: Sydney Trask, Scott T. Schepers, Mark E. BoutonAbstract:Extinguished Operant Behavior can return or “resurge” when a response that has replaced it is also extinguished.Typically studied in nonhuman animals, the resurgence effect may provide insight into relapse that is seen when reinforcement is discontinued following human contingency management (CM) and functional communication training (FCT) treatments, which both involve reinforcing alternative Behaviors to reduce Behavioral excess.Although the variables that affect resurgence have been studied for some time, the mechanisms through which they promote relapse are still debated.We discuss three explanations of resurgence (response prevention, an extension of Behavioral momentum theory, and an account emphasizing context change) as well as studies that evaluate them. Several new findings from our laboratory concerning the effects of different temporal distributions of the reinforcer during response elimination and the effects of manipulating qualitative features of the reinforcer pose a particular challenge to the momentum–based model.Overall, the results are consistent with a contextual account of resurgence, which emphasizes that reinforcers presented during response elimination have a discriminative role controlling Behavioral inhibition.Changing the “reinforcer context” at the start of testing produces relapse if the organism has not learned to suppress its responding under conditions similar to the ones that prevail during testing.
-
Renewal After the Punishment of Free Operant Behavior
Journal of experimental psychology. Animal learning and cognition, 2014Co-Authors: Mark E. Bouton, Scott T. SchepersAbstract:Three experiments examined the role of context in punishment learning. In Experiment 1, rats were trained to lever press for food in Context A and then punished for responding in Context B (by presenting response-contingent footshock). Punishment led to complete suppression of the response. However, when responding was tested (in extinction) in Contexts A and B, a strong renewal of responding occurred in Context A. In Experiment 2, renewal also occurred when initial reinforcement occurred in Context A, punishment occurred in Context B, and testing occurred in a new context (Context C). In both experiments, Behavioral suppression and renewal were not observed in groups that received noncontingent (yoked) footshocks in Context B. In Experiment 3, 2 responses (lever press and chain pull) were separately reinforced in Contexts A and B and then punished in the opposite context. Although the procedure equated the contexts on their association with reinforcement and punishment, renewal of each response was observed when it was tested in its nonpunished context. The contexts also influenced response choice. Overall, the results suggest that punishment is specific to the context in which it is learned, and establish that its context-specificity does not depend on a simple association between the context and shock. Like extinction, punishment may involve learning to inhibit a specific response in a specific context. Implications for theories of punishment and for understanding the cessation of problematic Operant Behavior (e.g., drug abuse) are discussed.
-
Mechanisms of Renewal After the Extinction of Discriminated Operant Behavior
Journal of experimental psychology. Animal learning and cognition, 2014Co-Authors: Travis P. Todd, Drina Vurbic, Mark E. BoutonAbstract:Three experiments demonstrated, and examined the mechanisms that underlie, the renewal of extinguished discriminated Operant Behavior. In Experiment 1, rats were trained to perform 1 response (lever press or chain pull) in the presence of one discriminative stimulus (S; light or tone) in Context A, and to perform the other response in the presence of the other S in Context B. Next, each of the original S/response combinations was extinguished in the alternate context. When the S/response combinations were tested back in the context in which they had been trained, responding in the presence of S returned (an ABA renewal effect was observed). This renewal could not be due to differential context-reinforcer associations, suggesting instead that the extinction context inhibits either the response and/or the effectiveness of the S. Consistent with the latter mechanism, in Experiment 2, ABA renewal was still observed when both the extinction and renewal contexts inhibited the same response. However, in Experiment 3, previous extinction of the response in the renewing context (occasioned by a different S) reduced AAB renewal more than did extinction of the different response. Taken together, the results suggest at least 2 mechanisms of renewal after instrumental extinction. First, extinction performance is at least partly controlled by a direct inhibitory association that is formed between the context and the response. Second, in the discriminated Operant procedure, extinction performance can sometimes be partly controlled by a reduction in the effectiveness of the S in the extinction context. Renewal of discriminated Operant Behavior can be produced by a release from either of these forms of inhibition.
-
Contextual control of discriminated Operant Behavior.
Journal of experimental psychology. Animal learning and cognition, 2014Co-Authors: Mark E. Bouton, Travis P. Todd, Samuel P. LeónAbstract:Previous research suggests that changing the context after instrumental (Operant) conditioning can weaken the strength of the Operant response. That result contrasts with the results of studies of Pavlovian conditioning, where a context switch often does not affect the response elicited by a conditioned stimulus. To begin to make the methods more similar, Experiments 1–3 tested the effects of a context switch in rats on a discriminated Operant response (R, lever pressing or chain pulling) that had been reinforced only in the presence of a 30-s discriminative stimulus (S, tone or light). As in Pavlovian conditioning, responses and reinforcers became confined to presentations of the S during training. However, in Experiment 1, after training in Context A, a switch to Context B caused a decrement in responding during S. In Experiment 2, a switch to Context B likewise decreased responding in S when Context B was equally familiar, equally associated with reinforcement, or equally associated with the training of a discriminated Operant (a different R reinforced in a different S). However, there was no decrement if Context B had been associated with the same response that was trained in Context A (Experiments 2 and 3). The effectiveness of S transferred across contexts, whereas the strength of the response did not. Experiment 4 found that a continuously reinforced response was also disrupted by context change when the same response manipulandum was used in both training and testing. Overall, the results suggest that the context can have a robust general role in the control of Operant Behavior. Mechanisms of contextual control are discussed.
Joseph P. Huston - One of the best experts on this subject based on the ideXlab platform.
-
Non-linear dynamics of Operant Behavior: a new approach via the extended return map.
Reviews in the neurosciences, 2002Co-Authors: Joseph P. HustonAbstract:Previous efforts to apply non-linear dynamic tools to the analysis of Operant Behavior revealed some promise for this kind of approach, but also some doubts, since the complexity of animal Behavior seemed to be beyond the analyzing ability of the available tools. We here outline a series of studies based on a novel approach. We modified the so-called 'return map' and developed a new method, the 'extended return map' (ERM) to extract information from the highly irregular time series data, the inter-response time (IRT) generated by Skinner-box experiments. We applied the ERM to Operant lever pressing data from rats using the four fundamental reinforcement schedules: fixed interval (FI), fixed ratio (FR), variable interval (VI) and variable ratio (VR). Our results revealed interesting patterns in all experiment groups. In particular, the FI and VI groups exhibited well-organized clusters of data points. We calculated the fractal dimension out of these patterns and compared experimental data with surrogate data sets, that were generated by randomly shuffling the sequential order of original IRTs. This comparison supported the finding that patterns in ERM reflect the dynamics of the Operant Behaviors under study. We then built two models to simulate the functional mechanisms of the FI schedule. Both models can produce similar distributions of IRTs and the stereotypical 'scalloped' curve characteristic of FI responding. However, they differ in one important feature in their formulation: while one model uses a continuous function to describe the probability of occurrence of an Operant Behavior, the other one employs an abrupt switch of Behavioral state. Comparison of ERMs showed that only the latter was able to produce patterns similar to the experimental results, indicative of the operation of an abrupt switch from one Behavioral state to another over the course of the inter-reinforcement period. This example demonstrated the ERM to be a useful tool for the analysis of IRT accompanying intermittent reinforcement schedules and for the study of the non-linear dynamics of Operant Behavior.
-
Comparison of neurokinin substance P with morphine in effects on food-reinforced Operant Behavior and feeding.
Physiology & behavior, 1994Co-Authors: R. U. Hasenöhrl, Rainer K.w. Schwarting, P. Gerhardt, Caroline Privou, Joseph P. HustonAbstract:Abstract In the present study, substance P (SP) was injected intraperitoneally (IP), and its effects on Operant Behavior were assessed in rats, which had been trained to bar press for food reward on a fixed-ratio (FR) 20 schedule. These effects were compared with IP injection of morphine sulfate, which had previously been shown to strongly suppress Operant responding on FR schedules. The IP injection of SP resulted in a dose-related decrement in response rates. SP in a dose range of 250–500 μg/kg decreased Operant responding, whereas SP in a dose range of 5–50 μg/kg did not influence response rates. The IP injection of morphine (10 mg/kg) markedly suppressed Operant responding. However, in contrast to the rate-decreasing effects of SP, this suppression was not selective for the reinforced lever as responding on the nonreinforced lever, used as a control, was also decreased. Furthermore, both injection of 10 mg/kg morphine and SP in a dose range of 250–500 μg/kg was found to reduce food intake when the animals had free access to food subsequent to the Operant conditioning session. The present results provide the first evidence that systemically administered neurokinin SP can affect Operant responding for food reward. The suppressive effects on Operant Behavior and feeding obtained with systemic SP or morphine are discussed with respect to recent findings showing that both drugs can modulate mesolimbic dopamine activity after systemic drug injection.
C Bare - One of the best experts on this subject based on the ideXlab platform.
-
The critical role of nucleus accumbens dopamine systems in the mediation of fixed interval schedule-controlled Operant Behavior.
Brain research, 1997Co-Authors: D A Cory-slechta, R Pazmino, C BareAbstract:Microinjections of the irreversible dopamine antagonist EEDQ (N-ethoxycarbonyl-2-ethoxy-1,2-dihydroquinoline), into nucleus accumbens but not into dorsal striatum, markedly decreased response rates on a fixed interval schedule of reinforcement. These preferential effects in nucleus accumbens could be prevented by selectively activating either D1 or D2 receptors. These data demonstrate a critical role for mesolimbic dopamine systems in the mediation of fixed interval schedule-controlled Operant Behavior.
