A functional analysis of social reinforcement in vicarious verbal conditioning.

PubMed

Donohue, G B; Tryon, W W

1985-01-01

This article reports the results of 629 subjects in three experiments designed to replicate and extend the phenomenon of vicarious verbal conditioning. Experiment I replicated the finding that subjects who responded most to vicarious verbal conditioning were aware of the contingency involved. Experiment II attempted to examine the effects of prior history with the verbal reinforcer on vicarious verbal conditioning by providing seven groups of subjects with varying classic conditioning histories prior to vicarious verbal conditioning. The null results associated with this experiment were hypothesized to be due to the fact that the vicarious verbal conditioning took place in a language laboratory where the subjects could hear but not see the model. Experiment III replicated Experiment II in a live group context as was done in Experiment I. The results showed that vicarious verbal conditioning was again found to take place, that associating the verbal reinforcer with a tone or tone plus money via forward classic conditioning potentiated the effects of the verbal reinforcer, that backward classic conditioning did not potentiate the reinforcer, d) nor did either of two sensitization procedures potentiate the effects of the verbal reinforcer. Both aware and unaware subjects evidenced vicarious verbal conditioning.

Resistance to extinction, generalization decrement, and conditioned reinforcement.

PubMed

Dulaney, Alana E; Bell, Matthew C

2008-06-01

This study investigated generalization decrement during an extinction resistance-to-change test for pigeon key pecking using a two-component multiple schedule with equal variable-interval 3-min schedules and different reinforcer amounts (one component presented 2-s access to reinforcement and the other 8s). After establishing baseline responding, subjects were assigned to one of the two extinction conditions: hopper stimuli (hopper and hopper light were activated but no food was available) or Control (inactive hopper and hopper light). Responding in the 8-s component was more resistant to extinction than responding in the 2-s component, the hopper stimuli group was more resistant to extinction compared to the Control group, and an interaction between amount of reinforcement, extinction condition, and session block was present. This finding supports generalization decrement as a factor that influences resistance to extinction. Hopper-time data (the amount of time subjects spent with their heads in the hopper) were compared to resistance-to-change data in an investigation of the role of conditioned reinforcement on resistance to change.

[Effects of prefrontal ablations on the reaction of the active choice of feeder under different probability and value of the reinforcement on dog].

PubMed

Preobrazhenskaia, L A; Ioffe, M E; Mats, V N

2004-01-01

The role of the prefrontal cortex was investigated on the reaction of the active choice of the two feeders under changes value and probability reinforcement. The experiments were performed on 2 dogs with prefrontal ablation (g. proreus). Before the lesions the dogs were taught to receive food in two different feeders to conditioned stimuli with equally probable alimentary reinforcement. After ablation in the inter-trial intervals the dogs were running from the one feeder to another. In the answer to conditioned stimuli for many times the dogs choose the same feeder. The disturbance of the behavior after some times completely restored. In the experiments with competition of probability events and values of reinforcement the dogs chose the feeder with low-probability but better quality of reinforcement. In the experiments with equal value but different probability the intact dogs chose the feeder with higher probability. In our experiments the dogs with prefrontal lesions chose the each feeder equiprobably. Thus in condition of free behavior one of different functions of the prefrontal cortex is the reactions choose with more probability of reinforcement.

Reinforcing value and hypothetical behavioral economic demand for food and their relation to BMI.

PubMed

Epstein, Leonard H; Paluch, Rocco A; Carr, Katelyn A; Temple, Jennifer L; Bickel, Warren K; MacKillop, James

2018-04-01

Food is a primary reinforcer, and food reinforcement is related to obesity. The reinforcing value of food can be measured by establishing how hard someone will work to get food on progressive-ratio schedules. An alternative way to measure food reinforcement is a hypothetical purchase task which creates behavioral economic demand curves. This paper studies whether reinforcing value and hypothetical behavioral demand approaches are assessing the same or unique aspects of food reinforcement for low (LED) and high (HED) energy density foods using a combination of analytic approaches in females of varying BMI. Results showed absolute reinforcing value for LED and HED foods and relative reinforcing value were related to demand intensity (r's = 0.20-0.30, p's < 0.01), and demand elasticity (r's = 0.17-0.22, p's < 0.05). Correlations between demographic, BMI and restraint, disinhibition and hunger variables with the two measures of food reinforcement were different. Finally, the two measures provided unique contributions to predicting BMI. Potential reasons for differences between the reinforcing value and hypothetical purchase tasks were actual responding versus hypothetical purchasing, choice of reinforcers versus purchasing of individual foods in the demand task, and the differential role of effort in the two tasks. Examples of how a better understanding of food reinforcement may be useful to prevent or treat obesity are discussed, including engaging in alternative non-food reinforcers as substitutes for food, such as crafts or socializing in a non-food environment, and reducing the value of immediate food reinforcers by episodic future thinking. Copyright © 2018. Published by Elsevier Ltd.

Within-trial contrast: pigeons prefer conditioned reinforcers that follow a relatively more rather than a less aversive event.

PubMed

Zentall, Thomas R; Singer, Rebecca A

2007-07-01

When behavior suggests that the value of a reinforcer depends inversely on the value of the events that precede or follow it, the behavior has been described as a contrast effect. Three major forms of contrast have been studied: incentive contrast, in which a downward (or upward) shift in the magnitude of reinforcement produces a relatively stronger downward (or upward) shift in the vigor of a response; anticipatory contrast, in which a forthcoming improvement in reinforcement results in a relative reduction in consummatory response; and behavioral contrast, in which a decrease in the probability of reinforcement in one component of a multiple schedule results in an increase in responding in an unchanged component of the schedule. Here we discuss a possible fourth kind of contrast that we call within-trial contrast because within a discrete trial, the relative value of an event has an inverse effect on the relative value of the reinforcer that follows. We show that greater effort, longer delay to reinforcement, or the absence of food all result in an increase in the preference for positive discriminative stimuli that follow (relative to less effort, shorter delay, or the presence of food). We further distinguish this within-trial contrast effect from the effects of delay reduction. A general model of this form of contrast is proposed in which the value of a primary or conditioned reinforcer depends on the change in value from the value of the event that precedes it.

Within-Trial Contrast: Pigeons Prefer Conditioned Reinforcers that Follow a Relatively More Rather than a Less Aversive Event

PubMed Central

Zentall, Thomas R; Singer, Rebecca A

2007-01-01

When behavior suggests that the value of a reinforcer depends inversely on the value of the events that precede or follow it, the behavior has been described as a contrast effect. Three major forms of contrast have been studied: incentive contrast, in which a downward (or upward) shift in the magnitude of reinforcement produces a relatively stronger downward (or upward) shift in the vigor of a response; anticipatory contrast, in which a forthcoming improvement in reinforcement results in a relative reduction in consummatory response; and behavioral contrast, in which a decrease in the probability of reinforcement in one component of a multiple schedule results in an increase in responding in an unchanged component of the schedule. Here we discuss a possible fourth kind of contrast that we call within-trial contrast because within a discrete trial, the relative value of an event has an inverse effect on the relative value of the reinforcer that follows. We show that greater effort, longer delay to reinforcement, or the absence of food all result in an increase in the preference for positive discriminative stimuli that follow (relative to less effort, shorter delay, or the presence of food). We further distinguish this within-trial contrast effect from the effects of delay reduction. A general model of this form of contrast is proposed in which the value of a primary or conditioned reinforcer depends on the change in value from the value of the event that precedes it. PMID:17725056

The Effect of Conditioned Reinforcement Rate on Choice: A Review

ERIC Educational Resources Information Center

Fantino, Edmund; Romanowich, Paul

2007-01-01

We review the nature of conditioned reinforcement, including evidence that conditioned reinforcers maintain choice behavior in concurrent schedules and that they elevate responding in the terminal links of concurrent-chains schedules. A question has resurfaced recently: Do theories of choice in concurrent-chains schedules need to include a term…

Responding for a conditioned reinforcer or unconditioned sensory reinforcer in mice: interactions with environmental enrichment, social isolation, and monoamine reuptake inhibitors.

PubMed

Browne, Caleb J; Fletcher, Paul J; Zeeb, Fiona D

2016-03-01

Environmental factors influence the etiology of many psychiatric disorders. Likewise, environmental factors can alter processes central to motivation. Therefore, motivational deficits present in many disorders may be influenced by early life environmental conditions. We examined whether housing animals in different environmental conditions influenced the ability of sensory stimuli to acquire incentive value and whether elevated monoamine activity altered responsing for these stimuli. Isolation-housed (IH), pair-housed (PH), and environmentally enriched (EE) male C57BL/6N mice were examined in tests of responding for a conditioned reinforcer (CRf) or an unconditioned sensory reinforcer (USRf). The CRf was previously paired with saccharin delivery through Pavlovian conditioning, while the USRf was not conditioned with a reward. Following baseline tests of responding for the CRf or USRf, the effects of elevated monoamine activity were examined. At baseline, PH and EE mice responded similarly for the CRf or USRf. IH mice responded more for the CRf but exhibited slower acquisition of responding for the USRf. Administration of citalopram, a serotonin transporter blocker, or atomoxetine, a norepinephrine transporter blocker, decreased responding for the CRf and USRf in all groups. The dopamine transporter blocker GBR 12909 generally increased responding for the CRf and USRf, but further analysis revealed enhanced responding for both reinforcers only in EE mice. Baseline incentive motivation is strongly influenced by the social component of housing conditions. Furthermore, environmental enrichment increased the sensitivity to elevated dopamine activity, while acute elevations in serotonin and norepinephrine inhibit incentive motivation irrespective of housing condition.

Reinforcement Learning Explains Conditional Cooperation and Its Moody Cousin.

PubMed

Ezaki, Takahiro; Horita, Yutaka; Takezawa, Masanori; Masuda, Naoki

2016-07-01

Direct reciprocity, or repeated interaction, is a main mechanism to sustain cooperation under social dilemmas involving two individuals. For larger groups and networks, which are probably more relevant to understanding and engineering our society, experiments employing repeated multiplayer social dilemma games have suggested that humans often show conditional cooperation behavior and its moody variant. Mechanisms underlying these behaviors largely remain unclear. Here we provide a proximate account for this behavior by showing that individuals adopting a type of reinforcement learning, called aspiration learning, phenomenologically behave as conditional cooperator. By definition, individuals are satisfied if and only if the obtained payoff is larger than a fixed aspiration level. They reinforce actions that have resulted in satisfactory outcomes and anti-reinforce those yielding unsatisfactory outcomes. The results obtained in the present study are general in that they explain extant experimental results obtained for both so-called moody and non-moody conditional cooperation, prisoner's dilemma and public goods games, and well-mixed groups and networks. Different from the previous theory, individuals are assumed to have no access to information about what other individuals are doing such that they cannot explicitly use conditional cooperation rules. In this sense, myopic aspiration learning in which the unconditional propensity of cooperation is modulated in every discrete time step explains conditional behavior of humans. Aspiration learners showing (moody) conditional cooperation obeyed a noisy GRIM-like strategy. This is different from the Pavlov, a reinforcement learning strategy promoting mutual cooperation in two-player situations.

Operant conditioning of neural activity in freely behaving monkeys with intracranial reinforcement

PubMed Central

Eaton, Ryan W.; Libey, Tyler

2017-01-01

Operant conditioning of neural activity has typically been performed under controlled behavioral conditions using food reinforcement. This has limited the duration and behavioral context for neural conditioning. To reward cell activity in unconstrained primates, we sought sites in nucleus accumbens (NAc) whose stimulation reinforced operant responding. In three monkeys, NAc stimulation sustained performance of a manual target-tracking task, with response rates that increased monotonically with increasing NAc stimulation. We recorded activity of single motor cortex neurons and documented their modulation with wrist force. We conditioned increased firing rates with the monkey seated in the training booth and during free behavior in the cage using an autonomous head-fixed recording and stimulating system. Spikes occurring above baseline rates triggered single or multiple electrical pulses to the reinforcement site. Such rate-contingent, unit-triggered stimulation was made available for periods of 1–3 min separated by 3–10 min time-out periods. Feedback was presented as event-triggered clicks both in-cage and in-booth, and visual cues were provided in many in-booth sessions. In-booth conditioning produced increases in single neuron firing probability with intracranial reinforcement in 48 of 58 cells. Reinforced cell activity could rise more than five times that of non-reinforced activity. In-cage conditioning produced significant increases in 21 of 33 sessions. In-cage rate changes peaked later and lasted longer than in-booth changes, but were often comparatively smaller, between 13 and 18% above non-reinforced activity. Thus intracranial stimulation reinforced volitional increases in cortical firing rates during both free behavior and a controlled environment, although changes in the latter were more robust. NEW & NOTEWORTHY Closed-loop brain-computer interfaces (BCI) were used to operantly condition increases in muscle and neural activity in monkeys by delivering

Operant conditioning of neural activity in freely behaving monkeys with intracranial reinforcement.

PubMed

Eaton, Ryan W; Libey, Tyler; Fetz, Eberhard E

2017-03-01

Operant conditioning of neural activity has typically been performed under controlled behavioral conditions using food reinforcement. This has limited the duration and behavioral context for neural conditioning. To reward cell activity in unconstrained primates, we sought sites in nucleus accumbens (NAc) whose stimulation reinforced operant responding. In three monkeys, NAc stimulation sustained performance of a manual target-tracking task, with response rates that increased monotonically with increasing NAc stimulation. We recorded activity of single motor cortex neurons and documented their modulation with wrist force. We conditioned increased firing rates with the monkey seated in the training booth and during free behavior in the cage using an autonomous head-fixed recording and stimulating system. Spikes occurring above baseline rates triggered single or multiple electrical pulses to the reinforcement site. Such rate-contingent, unit-triggered stimulation was made available for periods of 1-3 min separated by 3-10 min time-out periods. Feedback was presented as event-triggered clicks both in-cage and in-booth, and visual cues were provided in many in-booth sessions. In-booth conditioning produced increases in single neuron firing probability with intracranial reinforcement in 48 of 58 cells. Reinforced cell activity could rise more than five times that of non-reinforced activity. In-cage conditioning produced significant increases in 21 of 33 sessions. In-cage rate changes peaked later and lasted longer than in-booth changes, but were often comparatively smaller, between 13 and 18% above non-reinforced activity. Thus intracranial stimulation reinforced volitional increases in cortical firing rates during both free behavior and a controlled environment, although changes in the latter were more robust. NEW & NOTEWORTHY Closed-loop brain-computer interfaces (BCI) were used to operantly condition increases in muscle and neural activity in monkeys by delivering

Effects of conditioned reinforcement frequency in an intermittent free-feeding situation, 12

PubMed Central

Zimmerman, Joseph; Hanford, Peter V.; Brown, Wyman

1967-01-01

Key-pecking intermittently produced a set of brief exteroceptive stimulus changes under two-component multiple schedules of conditioned reinforcement. Throughout the study, free access to grain was concurrently provided on an intermittent basis via a variable-interval tape. Free food presentations scheduled by the tape were delivered if no peck had been emitted for 6 sec, and the brief stimulus changes produced by responding under the multiple schedules were those which accompanied food presentation. The second component of each multiple schedule was always associated with a 1-min, variable-interval schedule of conditioned reinforcement. The schedule associated with the first component was systematically varied and conditioned reinforcement was either absent (extinction) or programmed on a 1-, 3-, 6-, or 12-min variable-interval schedule. Under these conditions, rate of responding in the manipulated component decreased monotonically with a decrease in the frequency of conditioned reinforcement. In addition, contrast effects were often obtained in the constant, second component. These results are similar to those obtained with similar multiple schedules of primary reinforcement. PMID:6033554

Asymmetry of Reinforcement and Punishment in Human Choice

PubMed Central

Rasmussen, Erin B; Newland, M Christopher

2008-01-01

The hypothesis that a penny lost is valued more highly than a penny earned was tested in human choice. Five participants clicked a computer mouse under concurrent variable-interval schedules of monetary reinforcement. In the no-punishment condition, the schedules arranged monetary gain. In the punishment conditions, a schedule of monetary loss was superimposed on one response alternative. Deviations from generalized matching using the free parameters c (sensitivity to reinforcement) and log k (bias) were compared in the no-punishment and punishment conditions. The no-punishment conditions yielded values of log k that approximated zero for all participants, indicating no bias. In the punishment condition, values of log k deviated substantially from zero, revealing a 3-fold bias toward the unpunished alternative. Moreover, the c parameters were substantially smaller in punished conditions. The values for bias and sensitivity under punishment did not change significantly when the measure of net reinforcers (gains minus losses) was applied to the analysis. These results mean that punishment reduced the sensitivity of behavior to reinforcement and biased performance toward the unpunished alternative. We concluded that a single punisher subtracted more value than a single reinforcer added, indicating an asymmetry in the law of effect. PMID:18422016

Experimental Protocol to Determine the Chloride Threshold Value for Corrosion in Samples Taken from Reinforced Concrete Structures

PubMed Central

Angst, Ueli M.; Boschmann, Carolina; Wagner, Matthias; Elsener, Bernhard

2017-01-01

The aging of reinforced concrete infrastructure in developed countries imposes an urgent need for methods to reliably assess the condition of these structures. Corrosion of the embedded reinforcing steel is the most frequent cause for degradation. While it is well known that the ability of a structure to withstand corrosion depends strongly on factors such as the materials used or the age, it is common practice to rely on threshold values stipulated in standards or textbooks. These threshold values for corrosion initiation (Ccrit) are independent of the actual properties of a certain structure, which clearly limits the accuracy of condition assessments and service life predictions. The practice of using tabulated values can be traced to the lack of reliable methods to determine Ccrit on-site and in the laboratory. Here, an experimental protocol to determine Ccrit for individual engineering structures or structural members is presented. A number of reinforced concrete samples are taken from structures and laboratory corrosion testing is performed. The main advantage of this method is that it ensures real conditions concerning parameters that are well known to greatly influence Ccrit, such as the steel-concrete interface, which cannot be representatively mimicked in laboratory-produced samples. At the same time, the accelerated corrosion test in the laboratory permits the reliable determination of Ccrit prior to corrosion initiation on the tested structure; this is a major advantage over all common condition assessment methods that only permit estimating the conditions for corrosion after initiation, i.e., when the structure is already damaged. The protocol yields the statistical distribution of Ccrit for the tested structure. This serves as a basis for probabilistic prediction models for the remaining time to corrosion, which is needed for maintenance planning. This method can potentially be used in material testing of civil infrastructures, similar to established

Experimental Protocol to Determine the Chloride Threshold Value for Corrosion in Samples Taken from Reinforced Concrete Structures.

PubMed

Angst, Ueli M; Boschmann, Carolina; Wagner, Matthias; Elsener, Bernhard

2017-08-31

The aging of reinforced concrete infrastructure in developed countries imposes an urgent need for methods to reliably assess the condition of these structures. Corrosion of the embedded reinforcing steel is the most frequent cause for degradation. While it is well known that the ability of a structure to withstand corrosion depends strongly on factors such as the materials used or the age, it is common practice to rely on threshold values stipulated in standards or textbooks. These threshold values for corrosion initiation (Ccrit) are independent of the actual properties of a certain structure, which clearly limits the accuracy of condition assessments and service life predictions. The practice of using tabulated values can be traced to the lack of reliable methods to determine Ccrit on-site and in the laboratory. Here, an experimental protocol to determine Ccrit for individual engineering structures or structural members is presented. A number of reinforced concrete samples are taken from structures and laboratory corrosion testing is performed. The main advantage of this method is that it ensures real conditions concerning parameters that are well known to greatly influence Ccrit, such as the steel-concrete interface, which cannot be representatively mimicked in laboratory-produced samples. At the same time, the accelerated corrosion test in the laboratory permits the reliable determination of Ccrit prior to corrosion initiation on the tested structure; this is a major advantage over all common condition assessment methods that only permit estimating the conditions for corrosion after initiation, i.e., when the structure is already damaged. The protocol yields the statistical distribution of Ccrit for the tested structure. This serves as a basis for probabilistic prediction models for the remaining time to corrosion, which is needed for maintenance planning. This method can potentially be used in material testing of civil infrastructures, similar to established

Can the reinforcing value of food be measured in bulimia nervosa?

PubMed Central

Schebendach, Janet; Broft, Allegra; Foltin, Richard W.; Walsh, B. Timothy

2013-01-01

Binge eating is a core clinical feature of bulimia nervosa (BN). Enhanced reinforcing value of food may play a role in this behavioral disturbance, but a systematic behavioral assessment of objective measures of the rewarding value of binge eating is lacking. The purpose of this study was to quantify the reinforcing value of food in BN patients as compared with normal controls. A progressive ratio (PR) computerized work task was completed under binge and non-binge instruction. The task consisted of 12 trials. The first trial required 50 keyboard taps to earn one portion of yogurt shake, and subsequent trials required progressive work increments of 200 taps for each additional portion. Completion of all 12 trials required 13,800 taps to earn 2,100 ml of shake. The breakpoint, defined as the largest ratio completed before a participant stopped working, was the measure of reinforcing efficacy. Ten patients and 10 controls completed the experiment. Under binge instruction, patients completed more trials and taps, and had a higher breakpoint than controls. The non-binge instruction yielded opposite findings; compared to controls, patients completed fewer trials and taps, and had a lower breakpoint. These results support the feasibility and potential utility of a PR task to quantify the reinforcing value of food in patients with BN. PMID:23178173

Can the reinforcing value of food be measured in bulimia nervosa?

PubMed

Schebendach, Janet; Broft, Allegra; Foltin, Richard W; Walsh, B Timothy

2013-03-01

Binge eating is a core clinical feature of bulimia nervosa (BN). Enhanced reinforcing value of food may play a role in this behavioral disturbance, but a systematic behavioral assessment of objective measures of the rewarding value of binge eating is lacking. The purpose of this study was to quantify the reinforcing value of food in BN patients as compared with normal controls. A progressive ratio (PR) computerized work task was completed under binge and non-binge instruction. The task consisted of 12 trials. The first trial required 50 keyboard taps to earn one portion of yogurt shake, and subsequent trials required progressive work increments of 200 taps for each additional portion. Completion of all 12 trials required 13,800 taps to earn 2100ml of shake. The breakpoint, defined as the largest ratio completed before a participant stopped working, was the measure of reinforcing efficacy. Ten patients and 10 controls completed the experiment. Under binge instruction, patients completed more trials and taps, and had a higher breakpoint than controls. The non-binge instruction yielded opposite findings; compared to controls, patients completed fewer trials and taps, and had a lower breakpoint. These results support the feasibility and potential utility of a PR task to quantify the reinforcing value of food in patients with BN. Copyright © 2012 Elsevier Ltd. All rights reserved.

Human reinforcement learning subdivides structured action spaces by learning effector-specific values

PubMed Central

Gershman, Samuel J.; Pesaran, Bijan; Daw, Nathaniel D.

2009-01-01

Humans and animals are endowed with a large number of effectors. Although this enables great behavioral flexibility, it presents an equally formidable reinforcement learning problem of discovering which actions are most valuable, due to the high dimensionality of the action space. An unresolved question is how neural systems for reinforcement learning – such as prediction error signals for action valuation associated with dopamine and the striatum – can cope with this “curse of dimensionality.” We propose a reinforcement learning framework that allows for learned action valuations to be decomposed into effector-specific components when appropriate to a task, and test it by studying to what extent human behavior and BOLD activity can exploit such a decomposition in a multieffector choice task. Subjects made simultaneous decisions with their left and right hands and received separate reward feedback for each hand movement. We found that choice behavior was better described by a learning model that decomposed the values of bimanual movements into separate values for each effector, rather than a traditional model that treated the bimanual actions as unitary with a single value. A decomposition of value into effector-specific components was also observed in value-related BOLD signaling, in the form of lateralized biases in striatal correlates of prediction error and anticipatory value correlates in the intraparietal sulcus. These results suggest that the human brain can use decomposed value representations to “divide and conquer” reinforcement learning over high-dimensional action spaces. PMID:19864565

Human reinforcement learning subdivides structured action spaces by learning effector-specific values.

PubMed

Gershman, Samuel J; Pesaran, Bijan; Daw, Nathaniel D

2009-10-28

Humans and animals are endowed with a large number of effectors. Although this enables great behavioral flexibility, it presents an equally formidable reinforcement learning problem of discovering which actions are most valuable because of the high dimensionality of the action space. An unresolved question is how neural systems for reinforcement learning-such as prediction error signals for action valuation associated with dopamine and the striatum-can cope with this "curse of dimensionality." We propose a reinforcement learning framework that allows for learned action valuations to be decomposed into effector-specific components when appropriate to a task, and test it by studying to what extent human behavior and blood oxygen level-dependent (BOLD) activity can exploit such a decomposition in a multieffector choice task. Subjects made simultaneous decisions with their left and right hands and received separate reward feedback for each hand movement. We found that choice behavior was better described by a learning model that decomposed the values of bimanual movements into separate values for each effector, rather than a traditional model that treated the bimanual actions as unitary with a single value. A decomposition of value into effector-specific components was also observed in value-related BOLD signaling, in the form of lateralized biases in striatal correlates of prediction error and anticipatory value correlates in the intraparietal sulcus. These results suggest that the human brain can use decomposed value representations to "divide and conquer" reinforcement learning over high-dimensional action spaces.

BEHAVIORAL MECHANISMS UNDERLYING NICOTINE REINFORCEMENT

PubMed Central

Rupprecht, Laura E.; Smith, Tracy T.; Schassburger, Rachel L.; Buffalari, Deanne M.; Sved, Alan F.; Donny, Eric C.

2015-01-01

Cigarette smoking is the leading cause of preventable deaths worldwide and nicotine, the primary psychoactive constituent in tobacco, drives sustained use. The behavioral actions of nicotine are complex and extend well beyond the actions of the drug as a primary reinforcer. Stimuli that are consistently paired with nicotine can, through associative learning, take on reinforcing properties as conditioned stimuli. These conditioned stimuli can then impact the rate and probability of behavior and even function as conditioning reinforcers that maintain behavior in the absence of nicotine. Nicotine can also act as a conditioned stimulus, predicting the delivery of other reinforcers, which may allow nicotine to acquire value as a conditioned reinforcer. These associative effects, establishing non-nicotine stimuli as conditioned stimuli with discriminative stimulus and conditioned reinforcing properties as well as establishing nicotine as a conditioned stimulus, are predicted by basic conditioning principles. However, nicotine can also act non-associatively. Nicotine directly enhances the reinforcing efficacy of other reinforcing stimuli in the environment, an effect that does not require a temporal or predictive relationship between nicotine and either the stimulus or the behavior. Hence, the reinforcing actions of nicotine stem both from the primary reinforcing actions of the drug (and the subsequent associative learning effects) as well as the reinforcement enhancement action of nicotine which is non-associative in nature. Gaining a better understanding of how nicotine impacts behavior will allow for maximally effective tobacco control efforts aimed at reducing the harm associated with tobacco use by reducing and/or treating its addictiveness. PMID:25638333

Differential effects of daily snack food intake on the reinforcing value of food in obese and nonobese women123

PubMed Central

Bulkley, Alison M; Badawy, Rebecca L; Krause, Nicole; McCann, Sarah; Epstein, Leonard H

2009-01-01

Background: Food reinforcement, ie, motivation to obtain food, is associated with energy intake and obesity. Finding ways to decrease the reinforcing value of unhealthy foods may help with adherence to diets and maintenance of weight loss. Our previous study in nonobese adults showed that daily consumption of the same snack food (food consumed apart from meals) for 14 d significantly decreased its reinforcing value. Objectives: The aims of this study were to replicate and extend these findings to obese individuals and to examine the effects of different portion sizes of snack foods on food reinforcement. Design: Food reinforcement and liking were tested in 31 obese and 27 nonobese women at baseline and after 2 wk of daily consumption of 0, 100, or 300 kcal/d of the same snack food. Results: We found a significant interaction of phase, portion size, and body mass index on the pattern of operant responding for food. Obese women had a significant increase in food reinforcement after consuming the 300-kcal portion of food for 2 wk, whereas nonobese women had the opposite response. No significant differences were found on the reinforcing value with the 0- and 100-kcal portion-size conditions. Women in the 300-kcal group (obese and nonobese) reported a significant decrease in snack food liking from baseline to after daily intake. Conclusions: These findings suggest that obese and nonobese women respond differently to the daily intake of a snack food and that this may not be a viable mechanism for reducing food reinforcement in obese women. This trial was registered at www.clinicaltrials.gov as NCT00837694. PMID:19458018

An Analysis of "Reinforcement" History Effects

ERIC Educational Resources Information Center

Okouchi, Hiroto; Lattal, Kennon A.

2006-01-01

Four pigeons were exposed to two tandem variable-interval differential-reinforcement-of-low-rate schedules under different stimulus conditions. The values of the tandem schedules were adjusted so that reinforcement rates in one stimulus condition were higher than those in the other, even though response rates in the two conditions were nearly…

A Galvanic Sensor for Monitoring the Corrosion Condition of the Concrete Reinforcing Steel: Relationship Between the Galvanic and the Corrosion Currents

PubMed Central

Pereira, Elsa Vaz; Figueira, Rita Bacelar; Salta, Maria Manuela Lemos; da Fonseca, Inês Teodora Elias

2009-01-01

This work reports a study carried out on the design and performance of galvanic and polarization resistance sensors to be embedded in concrete systems for permanent monitoring of the corrosion condition of reinforcing steel, aiming to establish a correlation between the galvanic currents, Igal, and the corrosion currents, Icorr, estimated from the polarization resistance, Rp. Sensors have been tested in saturated Ca(OH)2 aqueous solutions, under a variety of conditions, simulating the most important parameters that can accelerate the corrosion of concrete reinforcing steel, such as carbonation, ingress of chloride ions, presence or absence of O2. For all the conditions, the influence of temperature (20 to 55 °C) has also been considered. From this study, it could be concluded that the galvanic currents are sensitive to the various parameters following a trend similar to that of the Rp values. A relationship between the galvanic and the corrosion current densities was obtained and the limiting values of the Igal, indicative of the state condition of the reinforcing steel for the designed sensor, were established. PMID:22291514

Rate of Conditioned Reinforcement Affects Observing Rate but Not Resistance to Change

ERIC Educational Resources Information Center

Shahan, Timothy A.; Podlesnik, Christopher A.

2005-01-01

The effects of rate of conditioned reinforcement on the resistance to change of operant behavior have not been examined. In addition, the effects of rate of conditioned reinforcement on the rate of observing have not been adequately examined. In two experiments, a multiple schedule of observing-response procedures was used to examine the effects…

Human choice among five alternatives when reinforcers decay.

PubMed

Rothstein, Jacob B; Jensen, Greg; Neuringer, Allen

2008-06-01

Human participants played a computer game in which choices among five alternatives were concurrently reinforced according to dependent random-ratio schedules. "Dependent" indicates that choices to any of the wedges activated the random-number generators governing reinforcers on all five alternatives. Two conditions were compared. In the hold condition, once scheduled, a reinforcer - worth a constant five points - remained available until it was collected. In the decay condition, point values decreased with intervening responses, i.e., rapid collection was differentially reinforced. Slopes of matching functions were higher in the decay than hold condition. However inter-subject variability was high in both conditions.

Dietary restraint, anxiety, and the relative reinforcing value of snack food in non-obese women.

PubMed

Goldfield, Gary S; Legg, Christine

2006-11-01

This study tested the independent and interactive effects of anxiety and dietary restraint on the relative reinforcing value of snack food. Thirty non-obese, female university students were assigned to one of four groups based on median split scores on measures of dietary restraint and state-anxiety: low-restraint/low-anxiety (n=7), low-restraint/high-anxiety (n=7), high-restraint/low-anxiety (n=9), and high-restraint/high-anxiety (n=7). Participants were provided the choice to earn points for palatable snack foods or fruits and vegetables using a computerized concurrent schedules choice task. The behavioural cost to gain access to snack foods increased across trials, whereas the cost to gain access to fruits and vegetables was held constant across trials. The relative reinforcing value of palatable snack food in relation to fruits and vegetables was defined as the total amount of points earned for snack food. Two-way analysis of covariance, with hunger and hedonic snack food ratings as covariates, showed that dietary restraint and anxiety had a significant interactive effect on the relative reinforcing value of snack food, indicating that the effect of anxiety on snack food reinforcement is moderated by dietary restraint. Specifically, the high-anxiety/low-restraint women found snack food significantly less reinforcing than low-anxiety/low-restraint women, but no differences emerged between high- and low-anxiety women with high-restraint. Neither restraint nor anxiety had an independent effect on the relative reinforcing value of snack food. These findings indicate that anxiety may have a suppressive effect on the relative reinforcing value of snack food in low-restrained eaters, but not an enhancing effect on snack food reinforcement in high-restrained eaters. Clinical implications of these findings are discussed.

Generalization of value in reinforcement learning by humans.

PubMed

Wimmer, G Elliott; Daw, Nathaniel D; Shohamy, Daphna

2012-04-01

Research in decision-making has focused on the role of dopamine and its striatal targets in guiding choices via learned stimulus-reward or stimulus-response associations, behavior that is well described by reinforcement learning theories. However, basic reinforcement learning is relatively limited in scope and does not explain how learning about stimulus regularities or relations may guide decision-making. A candidate mechanism for this type of learning comes from the domain of memory, which has highlighted a role for the hippocampus in learning of stimulus-stimulus relations, typically dissociated from the role of the striatum in stimulus-response learning. Here, we used functional magnetic resonance imaging and computational model-based analyses to examine the joint contributions of these mechanisms to reinforcement learning. Humans performed a reinforcement learning task with added relational structure, modeled after tasks used to isolate hippocampal contributions to memory. On each trial participants chose one of four options, but the reward probabilities for pairs of options were correlated across trials. This (uninstructed) relationship between pairs of options potentially enabled an observer to learn about option values based on experience with the other options and to generalize across them. We observed blood oxygen level-dependent (BOLD) activity related to learning in the striatum and also in the hippocampus. By comparing a basic reinforcement learning model to one augmented to allow feedback to generalize between correlated options, we tested whether choice behavior and BOLD activity were influenced by the opportunity to generalize across correlated options. Although such generalization goes beyond standard computational accounts of reinforcement learning and striatal BOLD, both choices and striatal BOLD activity were better explained by the augmented model. Consistent with the hypothesized role for the hippocampus in this generalization, functional

The Emergence of Conditioned Reinforcement from Observation

ERIC Educational Resources Information Center

Greer, R. Douglas; Singer-Dudek, Jessica

2008-01-01

We report an experiment in which observations of peers by six 3-5-year-old participants under specific conditions functioned to convert a small plastic disc or, for one participant, a small piece of string, from a nonreinforcer to a reinforcer. Prior to the observational procedure, we compared each participant's responding on (a) previously…

Summation of reinforcement rates when conditioned stimuli are presented in compound.

PubMed

Andrew, Benjamin J; Harris, Justin A

2011-10-01

Three experiments used delay conditioning of magazine approach in rats to examine the summation of responding when two conditioned stimuli (CSs) are presented together as a compound. The duration of each CS varied randomly from trial-to-trial around a mean that differed between the CSs. This meant that the rats' response rate to each CS was systematically related to the reinforcement rate of that CS, but remained steady as time elapsed during the CS (Harris & Carpenter, 2011; Harris, Gharaei, & Pincham, 2011). When the rats were presented with a compound of two CSs that had been conditioned separately, they responded more during the compound than during either of the CSs individually. More significantly, however, in all three experiments, the rats responded to the compound at the same rate as they responded to a third CS that had been reinforced at a rate equal to the sum of the reinforcement rates of the two CSs in compound. We discuss the implications of this finding for associative models (e.g., Rescorla & Wagner, 1972) and rate-based models (Gallistel & Gibbon, 2000) of conditioning.

Increasing the Value of an Alternative Monetary Reinforcer Reduces Cigarette Choice in Adolescents

PubMed Central

Tidey, Jennifer W.; Kahler, Christopher W.; Wray, Tyler B.; Colby, Suzanne M.

2015-01-01

Introduction: Smoking can be conceptualized as an operant behavior maintained by the reinforcing effects of cigarettes. Changing the magnitude and availability of alternative reinforcers should shift behavior away from smoking. Adults’ smoking behavior is sensitive to the magnitude and availability of alternative reinforcers; however, the extent to which the same is true for adolescents has not yet been shown in the laboratory. Methods: To test the sensitivity of adolescent smoking behavior to changes in the magnitude of alternative reinforcement, we gave adolescents who abstained overnight the opportunity to make 20 choices between receiving two puffs of their usual-brand cigarette or money. The magnitude of the monetary reinforcer was varied across sessions in counterbalanced order ($0.00, $0.10, and $0.50). Results: Results indicated that adolescents’ choices for puffs decreased as a function of increasing monetary reinforcer magnitude, while money choices increased. This effect was moderated by baseline smoking level and by gender, such that heavier-smoking participants and males made more cigarette choices when the alternative monetary value was zero, and decreased their choices more steeply in response to increasing monetary value. Conclusions: The current study validates a laboratory choice procedure for studying smoking in adolescents, and demonstrates that adolescent smoking behavior is sensitive to changes in the magnitude of concurrently available monetary reinforcers. The current paradigm can be adapted and applied to explore the effects of other variables that may affect cigarette choice in adolescents. PMID:25666814

Extinction of Pavlovian conditioning: The influence of trial number and reinforcement history.

PubMed

Chan, C K J; Harris, Justin A

2017-08-01

Pavlovian conditioning is sensitive to the temporal relationship between the conditioned stimulus (CS) and the unconditioned stimulus (US). This has motivated models that describe learning as a process that continuously updates associative strength during the trial or specifically encodes the CS-US interval. These models predict that extinction of responding is also continuous, such that response loss is proportional to the cumulative duration of exposure to the CS without the US. We review evidence showing that this prediction is incorrect, and that extinction is trial-based rather than time-based. We also present two experiments that test the importance of trials versus time on the Partial Reinforcement Extinction Effect (PREE), in which responding extinguishes more slowly for a CS that was inconsistently reinforced with the US than for a consistently reinforced one. We show that increasing the number of extinction trials of the partially reinforced CS, relative to the consistently reinforced CS, overcomes the PREE. However, increasing the duration of extinction trials by the same amount does not overcome the PREE. We conclude that animals learn about the likelihood of the US per trial during conditioning, and learn trial-by-trial about the absence of the US during extinction. Moreover, what they learn about the likelihood of the US during conditioning affects how sensitive they are to the absence of the US during extinction. Copyright © 2017 Elsevier B.V. All rights reserved.

Effects of sucrose concentration and water deprivation on Pavlovian conditioning and responding for conditioned reinforcement.

PubMed

Tabbara, Rayane I; Maddux, Jean-Marie N; Beharry, Priscilla F; Iannuzzi, Jessica; Chaudhri, Nadia

2016-04-01

An appetitive Pavlovian conditioned stimulus (CS) can predict an unconditioned stimulus (US) and acquire incentive salience. We tested the hypothesis that US intensity and motivational state of the subject would influence Pavlovian learning and impact the attribution of incentive salience to an appetitive Pavlovian CS. To this end, we examined the effects of sucrose concentration and water deprivation on the acquisition of Pavlovian conditioning and responding for a conditioned reinforcer. Male Long-Evans rats (Harlan; 220-240 g) receiving 3% (3S) or 20% (20S) sucrose were either non-water deprived or given water for 1 hr per day. During Pavlovian conditioning sessions, half the rats in each concentration and deprivation condition received a 10-s CS paired with 0.2 ml of sucrose (16 trials/session; 3.2 ml/session). The remainder received unpaired CS and US presentations. Entries into a port where sucrose was delivered were recorded. Next, responding for conditioned reinforcement was tested, wherein pressing an active lever produced the CS and pressing an inactive lever had no consequences. CS-elicited port entries increased, and latency to the first CS-elicited port entry decreased across sessions in paired groups. Water deprivation augmented these effects, whereas sucrose concentration had no significant impact on behavior. Responding for conditioned reinforcement was observed in the 20S water-deprived, paired group. Thus, water deprivation can facilitate the acquisition of Pavlovian conditioning, potentially by enhancing motivational state, and a high-intensity US and a high motivational state can interact to heighten the attribution of incentive salience to an appetitive Pavlovian CS. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Effects of novelty and methamphetamine on conditioned and sensory reinforcement

PubMed Central

Lloyd, David R.; Kausch, Michael A.; Gancarz, Amy M.; Beyley, Linda J.; Richards, Jerry B.

2012-01-01

Background Light onset can be both a sensory reinforcer (SR) with intrinsic reinforcing properties, and a conditioned reinforcer (CR) which predicts a biologically important reinforcer. Stimulant drugs, such as methamphetamine (METH), may increase the reinforcing effectiveness of CRs by enhancing the predictive properties of the CR. In contrast, METH-induced increases in the reinforcing effectiveness of SRs, are mediated by the immediate sensory consequences of the light. Methods The effects of novelty (on SRs) and METH (on both CRs and SRs) were tested. Experiment 1: Rats were pre-exposed to 5 s light and water pairings presented according to a variable-time (VT) 2 min schedule or unpaired water and light presented according to independent, concurrent VT 2 min schedules. Experiment 2: Rats were pre-exposed to 5 s light presented according to a VT 2 min schedule, or no stimuli. In both experiments, the pre-exposure phase was followed by a test phase in which 5 s light onset was made response-contingent on a variable-interval (VI) 2 min schedule and the effects of METH (0.5 mg/kg) were determined. Results Novel light onset was a more effective reinforcer than familiar light onset. METH increased the absolute rate of responding without increasing the relative frequency of responding for both CRs and SRs. Conclusion Novelty plays a role in determining the reinforcing effectiveness of SRs. The results are consistent with the interpretation that METH-induced increases in reinforcer effectiveness of CRs and SRs may be mediated by immediate sensory consequences, rather than prediction. PMID:22814112

The reinforcing value and liking of resistance training and aerobic exercise as predictors of adult's physical activity.

PubMed

Flack, Kyle D; Johnson, LuAnn; Roemmich, James N

2017-10-01

Reinforcing value (motivating value) is a stronger predictor than hedonic value (liking) for engaging in drug use, gambling, and eating. The associations of reinforcing value and liking with physical activity of adults have not yet been studied and may depend on the modes of exercise (e.g., aerobic/cardiovascular exercise, resistance training) under consideration. The purpose of this study was to test associations of the reinforcing value and liking of aerobic exercise training (AT) and resistance exercise training (RT) modes of exercise with usual participation in aerobic and resistance exercise in adults. Men (n=38) and women (n=50) were measured for their liking and relative reinforcing value (RRV) of AT and RT, for their usual vigorous physical activity (VPA) participation, and for usual resistance exercise behavior (Yale physical activity questionnaire). The RRV of AT (RRVAT) and liking of AT were correlated, (r=0.22, p<0.04), as were the RRV of RT (RRVRT) and liking of RT (r=0.42, p˂0.01). The reinforcing value for, but not the liking of, a mode of exercise predicted how much an individual engaged in that mode of exercise. RRVAT (p˂0.01) was positively associated with usual VPA. RRVRT (p˂0.01) was positively associated with RT behavior. The hedonic value of AT and of RT were not associated (p>0.30) with VPA or RT behavior. Reinforcing value of a mode of exercise is a stronger predictor than the liking of that mode of exercise for usual amount of participation in the exercise. Published by Elsevier Inc.

Disrupted expected value signaling in youth with disruptive behavior disorders to environmental reinforcers.

PubMed

White, Stuart F; Fowler, Katherine A; Sinclair, Stephen; Schechter, Julia C; Majestic, Catherine M; Pine, Daniel S; Blair, R James

2014-05-01

Youth with disruptive behavior disorders (DBD), including conduct disorder (CD) and oppositional defiant disorder (ODD), have difficulties in reinforcement-based decision making, the neural basis of which is poorly understood. Studies examining decision making in youth with DBD have revealed reduced reward responses within the ventromedial prefrontal cortex/orbitofrontal cortex (vmPFC/OFC), increased responses to unexpected punishment within the vmPFC and striatum, and reduced use of expected value information in the anterior insula cortex and dorsal anterior cingulate cortex during the avoidance of suboptimal choices. Previous work has used only monetary reinforcement. The current study examined whether dysfunction in youth with DBD during decision making extended to environmental reinforcers. A total of 30 youth (15 healthy youth and 15 youth with DBD) completed a novel reinforcement-learning paradigm using environmental reinforcers (physical threat images, e.g., striking snake image; contamination threat images, e.g., rotting food; appetitive images, e.g., puppies) while undergoing functional magnetic resonance imaging (fMRI). Behaviorally, healthy youth were significantly more likely to avoid physical threat, but not contamination threat, stimuli than youth with DBD. Imaging results revealed that youth with DBD showed significantly reduced use of expected value information in the bilateral caudate, thalamus, and posterior cingulate cortex during the avoidance of suboptimal responses. The current data suggest that youth with DBD show deficits to environmental reinforcers similar to the deficits seen to monetary reinforcers. Importantly, this deficit was unrelated to callous-unemotional (CU) traits, suggesting that caudate impairment may be a common deficit across youth with DBD. Published by Elsevier Inc.

Deletion of the δ opioid receptor gene impairs place conditioning but preserves morphine reinforcement.

PubMed

Le Merrer, Julie; Plaza-Zabala, Ainhoa; Del Boca, Carolina; Matifas, Audrey; Maldonado, Rafael; Kieffer, Brigitte L

2011-04-01

Converging experimental data indicate that δ opioid receptors contribute to mediate drug reinforcement processes. Whether their contribution reflects a role in the modulation of drug reward or an implication in conditioned learning, however, has not been explored. In the present study, we investigated the impact of δ receptor gene knockout on reinforced conditioned learning under several experimental paradigms. We assessed the ability of δ receptor knockout mice to form drug-context associations with either morphine (appetitive)- or lithium (aversive)-induced Pavlovian place conditioning. We also examined the efficiency of morphine to serve as a positive reinforcer in these mice and their motivation to gain drug injections, with operant intravenous self-administration under fixed and progressive ratio schedules and at two different doses. Mutant mice showed impaired place conditioning in both appetitive and aversive conditions, indicating disrupted context-drug association. In contrast, mutant animals displayed intact acquisition of morphine self-administration and reached breaking-points comparable to control subjects. Thus, reinforcing effects of morphine and motivation to obtain the drug were maintained. Collectively, the data suggest that δ receptor activity is not involved in morphine reinforcement but facilitates place conditioning. This study reveals a novel aspect of δ opioid receptor function in addiction-related behaviors. Copyright © 2011 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

Procrastination in the pigeon: Can conditioned reinforcement increase the likelihood of human procrastination?

PubMed

Zentall, Thomas R; Case, Jacob P; Andrews, Danielle M

2017-11-29

Procrastination is the tendency to put off initiation or completion of a task. Although people are typically known to procrastinate, recent research suggests that they sometimes "pre-crastinate" by initiating a task sooner than they need to (Rosenbaum et al. in Psychological Science, 25(7), 1487-1496, 2014). A similar finding of precrastination was reported by Wasserman and Brzykcy (Psychonomic Bulletin & Review, 22, 1130-1134, 2015) with pigeons using a somewhat different procedure. In the present experiment, we used a procedure with pigeons that was more similar to the procedure used by Rosenbaum et al. Pigeons were given a choice between two sequences of events (concurrent chains). Choice of the procrastination chain resulted in color A, which 15-s later would change to color B and 5-s later resulted in reinforcement. Choice of the precrastination chain resulted in color C, which 5-s later would change to color D and 15-s later resulted in reinforcement. Thus, both chains led to reinforcement after 20 s. Results indicated that the pigeons procrastinated. That is, they preferred the 15-5 chain over the 5-15 chain. The results are consistent with Fantino's (Journal of the Experimental Analysis of Behavior, 12, 723-730, 1969) delay reduction theory, which posits that stimuli that signal a reduction in the delay to reinforcement, such as the 5-s stimulus that occurred immediately prior to reinforcement, serve as strong conditioned reinforcers and should be preferred. In support of this theory, the pigeons pecked most at the 5-s stimulus that led immediately to reinforcement, indicating that it had become a strong conditioned reinforcer. The results suggest that delay reduction theory, a theory that emphasizes the attraction to stimuli that predict reinforcement with a short delay, also may contribute to human procrastination behavior because when task completion comes just before the deadline, it may become a stronger conditioned reinforcer than if task completion

Teaching Children with Autism Using Conditioned Cue-Value and Response-Marking Procedures: A Socially Valid Procedure

ERIC Educational Resources Information Center

Grindle, Corinna F.; Remington, Bob

2004-01-01

Five children with autism were taught to match printed words to corresponding pictures. Participants' speed of learning was compared across three training conditions, each involving a 5-s delay of reinforcement, using a within-participants alternating treatments design. In the cue-value condition, a verbal phrase of approval (e.g., "good!") was…

Increasing the Value of an Alternative Monetary Reinforcer Reduces Cigarette Choice in Adolescents.

PubMed

Cassidy, Rachel N; Tidey, Jennifer W; Kahler, Christopher W; Wray, Tyler B; Colby, Suzanne M

2015-12-01

Smoking can be conceptualized as an operant behavior maintained by the reinforcing effects of cigarettes. Changing the magnitude and availability of alternative reinforcers should shift behavior away from smoking. Adults' smoking behavior is sensitive to the magnitude and availability of alternative reinforcers; however, the extent to which the same is true for adolescents has not yet been shown in the laboratory. To test the sensitivity of adolescent smoking behavior to changes in the magnitude of alternative reinforcement, we gave adolescents who abstained overnight the opportunity to make 20 choices between receiving two puffs of their usual-brand cigarette or money. The magnitude of the monetary reinforcer was varied across sessions in counterbalanced order ($0.00, $0.10, and $0.50). Results indicated that adolescents' choices for puffs decreased as a function of increasing monetary reinforcer magnitude, while money choices increased. This effect was moderated by baseline smoking level and by gender, such that heavier-smoking participants and males made more cigarette choices when the alternative monetary value was zero, and decreased their choices more steeply in response to increasing monetary value. The current study validates a laboratory choice procedure for studying smoking in adolescents, and demonstrates that adolescent smoking behavior is sensitive to changes in the magnitude of concurrently available monetary reinforcers. The current paradigm can be adapted and applied to explore the effects of other variables that may affect cigarette choice in adolescents. © The Author 2015. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Effects of dietary restraint and body mass index on the relative reinforcing value of snack food.

PubMed

Goldfield, Gary S; Lumb, Andrew

2009-01-01

The present study examined the independent and interactive association between dietary restraint, body mass index (BMI) and the relative reinforcing value of food. Four hundred and three introductory psychology students completed questionnaires assessing age, gender, BMI, hunger, smoking status, nicotine dependence, dietary restraint, hedonic ratings for snack food and fruits and vegetables and the relative reinforcing value of snack food and fruits and vegetables. In the overall sample, results indicated a dietary restraint x BMI interaction after controlling for age, hunger, nicotine dependence, and hedonics. However, when regression models were separated by gender, the BMI x restraint interaction emerged only for females and not for males. Findings suggest that BMI moderates the relationship between dietary restraint and snack food reinforcement in females only, such that restraint and snack food reinforcement are inversely correlated in females with lower BMI, but restraint is positively correlated with snack food reinforcement in females with higher BMI. Theoretical and clinical implications of these findings are discussed.

Control of preference in children by conditioned positive reinforcement.

PubMed

Favell, J E; Favell, J E

1972-07-01

A preference measure was employed with children to evaluate the conditioned positive reinforcing function of a stimulus that preceded reinforcement. A match-to-sample procedure was arranged in which subjects could respond to either the form or color dimension of a compound sample stimulus. Intermittent token reinforcement was provided equally for color and form matches. Two stimuli were employed (Stimulus A and Stimulus B), each consisting of a distinctive tone and colored light. One of these stimuli (the paired stimulus) preceded each token delivery, and the other did not (nonpaired stimulus). The paired stimulus was dependent upon each response to one match dimension, and the nonpaired stimulus followed each response to the other dimension. Three of the five subjects responded primarily to the dimension that was followed by the paired stimulus. This effect was obtained regardless of which stimulus (A or B) was paired and on which match dimension (color or form) the paired stimulus was dependent. These results were unaltered by discontinuing the nonpaired stimulus. The other two subjects demonstrated consistent preferences for the form dimension and Stimulus A, respectively.

Investigations of timing during the schedule and reinforcement intervals with wheel-running reinforcement.

PubMed

Belke, Terry W; Christie-Fougere, Melissa M

2006-11-01

Across two experiments, a peak procedure was used to assess the timing of the onset and offset of an opportunity to run as a reinforcer. The first experiment investigated the effect of reinforcer duration on temporal discrimination of the onset of the reinforcement interval. Three male Wistar rats were exposed to fixed-interval (FI) 30-s schedules of wheel-running reinforcement and the duration of the opportunity to run was varied across values of 15, 30, and 60s. Each session consisted of 50 reinforcers and 10 probe trials. Results showed that as reinforcer duration increased, the percentage of postreinforcement pauses longer than the 30-s schedule interval increased. On probe trials, peak response rates occurred near the time of reinforcer delivery and peak times varied with reinforcer duration. In a second experiment, seven female Long-Evans rats were exposed to FI 30-s schedules leading to 30-s opportunities to run. Timing of the onset and offset of the reinforcement period was assessed by probe trials during the schedule interval and during the reinforcement interval in separate conditions. The results provided evidence of timing of the onset, but not the offset of the wheel-running reinforcement period. Further research is required to assess if timing occurs during a wheel-running reinforcement period.

The reinforcing value and liking of resistance training and aerobic exercise as predictors of adult’s physical actively behavior

USDA-ARS?s Scientific Manuscript database

Background: Reinforcing value is a stronger predictor than hedonic value (liking) for engaging in drug use, gambling, and eating. The associations of reinforcing value and liking with physical activity of adults have not yet been studied and may depend on the mode of exercise available during exerc...

Prediction of the comparative reinforcement values of running and drinking.

PubMed

PREMACK, D

1963-03-15

The probability of free drinking and running in rats was controlled by sucrose concentration and force requirements on an activity wheel. Drinking and running were then made contingent on pressing a bar. Barpressing increased monotonically with the associated response probability, and equally for drinking and running. The results support the assumption that different responses of equal probability have equal reinforcement value.

Multiple determinants of transfer of evaluative function after conditioning with free-operant schedules of reinforcement.

PubMed

Dack, Charlotte; Reed, Phil; McHugh, Louise

2010-11-01

The aim of the four present experiments was to explore how different schedules of reinforcement influence schedule-induced behavior, their impact on evaluative ratings given to conditioned stimuli associated with each schedule through evaluative conditioning, and the transfer of these evaluations through derived stimulus networks. Experiment 1 compared two contrasting response reinforcement rules (variable ratio [VR], variable interval [VI]). Experiment 2 varied the response to reinforcement rule between two schedules but equated the outcome to response rate (differential reinforcement of high rate [DRH] vs. VR). Experiment 3 compared molar and molecular aspects of contingencies of reinforcement (tandem VIVR vs. tandem VRVI). Finally, Experiment 4 employed schedules that induced low rates of responding to determine whether, under these circumstances, responses were more sensitive to the molecular aspects of a schedule (differential reinforcement of low rate [DRL] vs. VI). The findings suggest that the transfer of evaluative functions is determined mainly by differences in response rate between the schedules and the molar aspects of the schedules. However, when neither schedule was based on a strong response reinforcement rule, the transfer of evaluative judgments came under the control of the molecular aspects of the schedule.

Patterns of Reinforcement and the Essential Values of Brands: I. Incorporation of Utilitarian and Informational Reinforcement into the Estimation of Demand

ERIC Educational Resources Information Center

Yan, Ji; Foxall, Gordon R.; Doyle, John R.

2012-01-01

Essential value is defined by Hursh and Silberberg (2008) as the value of reinforcers, presented in an exponential model (Equation 1). This study extends previous research concerned with animal behavior or human responding in therapeutic situations. We applied 9 available demand curves to consumer data that included 10,000+ data points collected…

Effects of pramipexole on the acquisition of responding with opioid-conditioned reinforcement in the rat

PubMed Central

Bertz, Jeremiah W.; Chen, Jianyong; Woods, James H.

2014-01-01

Rationale Dopamine D3 receptor-preferring ligands may be able to modify the conditioned reinforcing effects of drug-associated stimuli. In evaluating the effects of these compounds, it is important to clarify the extent to which responding depends on (1) conditioned reinforcement vs. other behavioral mechanisms and (2) dopamine D3 vs. D2 receptor activity. Objectives Use behaviorally stringent new-response acquisition procedures to characterize the effects of the D3-preferring agonist, pramipexole, on the conditioned reinforcing effects of a stimulus paired with the opioid agonist, remifentanil. Methods First, in Pavlovian conditioning (PAV) sessions, rats received response-independent IV injections of remifentanil and presentations of a light–noise stimulus. In separate groups, injections and stimuli either always co-occurred (“paired PAV”) or occurred with no consistent relationship (“random PAV” control). Next, in instrumental acquisition (ACQ) sessions, all animals could respond in two nose-poke manipulanda: an active nose-poke, which produced the stimulus alone, or an inactive nose-poke. Pramipexole was injected SC prior to ACQ sessions with or without pretreatments of the D3-preferring antagonist, SB-277011A, or the dopamine D2-preferring antagonist, L-741,626. Results After paired PAV, but not random PAV, rats acquired nose-poke responding during ACQ (i.e., active > inactive). Pramipexole dose-dependently increased active responding without changing inactive responding. Pramipexole-induced increases in responding were blocked by pretreatment with L-741,626, but not SB-277011A. Conclusions Pramipexole specifically enhanced remifentanil-conditioned reinforcement: active responding was selectively increased only after the stimulus was paired with remifentanil. Although pramipexole is D3-preferring, the antagonist effects obtained presently suggest an important role for the D2 receptor in opiod-conditioned reinforcement. PMID:24985891

Attentional Selection Can Be Predicted by Reinforcement Learning of Task-relevant Stimulus Features Weighted by Value-independent Stickiness.

PubMed

Balcarras, Matthew; Ardid, Salva; Kaping, Daniel; Everling, Stefan; Womelsdorf, Thilo

2016-02-01

Attention includes processes that evaluate stimuli relevance, select the most relevant stimulus against less relevant stimuli, and bias choice behavior toward the selected information. It is not clear how these processes interact. Here, we captured these processes in a reinforcement learning framework applied to a feature-based attention task that required macaques to learn and update the value of stimulus features while ignoring nonrelevant sensory features, locations, and action plans. We found that value-based reinforcement learning mechanisms could account for feature-based attentional selection and choice behavior but required a value-independent stickiness selection process to explain selection errors while at asymptotic behavior. By comparing different reinforcement learning schemes, we found that trial-by-trial selections were best predicted by a model that only represents expected values for the task-relevant feature dimension, with nonrelevant stimulus features and action plans having only a marginal influence on covert selections. These findings show that attentional control subprocesses can be described by (1) the reinforcement learning of feature values within a restricted feature space that excludes irrelevant feature dimensions, (2) a stochastic selection process on feature-specific value representations, and (3) value-independent stickiness toward previous feature selections akin to perseveration in the motor domain. We speculate that these three mechanisms are implemented by distinct but interacting brain circuits and that the proposed formal account of feature-based stimulus selection will be important to understand how attentional subprocesses are implemented in primate brain networks.

The impact of flavoring on the rewarding and reinforcing value of e-cigarettes with nicotine among young adult smokers

PubMed Central

Audrain-McGovern, Janet; Strasser, Andrew A.; Wileyto, E. Paul

2016-01-01

Objective Flavored e-cigarette use has risen rapidly, especially among young adults who also smoke cigarettes. We sought to determine whether flavoring enhances the subjective rewarding value, relative reinforcing value, and absolute reinforcing value of an e-cigarette with nicotine compared to an unflavored e-cigarette with nicotine. Methods Using a within-subjects design, young adult smokers (n=32) participated in three human laboratory sessions. Session 1 evaluated the rewarding value of flavoring by having participants rate unflavored and flavored e-cigarettes with nicotine. Session 2 assessed the relative reinforcing value of a flavored vs unflavored e-cigarette via a choice task that evaluated the willingness to “work” to hit targets on a computer screen to earn flavored or unflavored e-cigarette puffs. Session 3 measured the absolute reinforcing value of flavored versus unflavored e-cigarettes via a 90-minute ad-libitum vaping session where puffs from each e-cigarette were counted. Results Subjective reward value was higher for the flavored versus the unflavored e-cigarette (β=.83, CI 0.35 to 1.32, p=0.001). Participants worked harder for flavored e-cigarette puffs versus unflavored e-cigarette puffs (breakpoint = 5.7; 597 responses versus 127 responses; β=460.733, CI 246.58 to 674.88, p <0.0001). Participants took twice as many flavored puffs than unflavored e-cigarette puffs (40 vs 23 puffs; IRR=2.028, CI 1.183 to 3.475, p=0.01). Conclusions Flavoring enhances the rewarding and reinforcing value of e-cigarettes with nicotine, and thus their abuse liability in young adult smokers. Further research is necessary to determine whether the use of flavoring in e-cigarettes impacts cigarette smoking behavior among young adults. PMID:27426010

The impact of flavoring on the rewarding and reinforcing value of e-cigarettes with nicotine among young adult smokers.

PubMed

Audrain-McGovern, Janet; Strasser, Andrew A; Wileyto, E Paul

2016-09-01

Flavored e-cigarette use has risen rapidly, especially among young adults who also smoke cigarettes. We sought to determine whether flavoring enhances the subjective rewarding value, relative reinforcing value, and absolute reinforcing value of an e-cigarette with nicotine compared to an unflavored e-cigarette with nicotine. Using a within-subjects design, young adult smokers (n=32) participated in three human laboratory sessions. Session 1 evaluated the rewarding value of flavoring by having participants rate unflavored and flavored e-cigarettes with nicotine. Session 2 assessed the relative reinforcing value of a flavored vs unflavored e-cigarette via a choice task that evaluated the willingness to "work" to hit targets on a computer screen to earn flavored or unflavored e-cigarette puffs. Session 3 measured the absolute reinforcing value of flavored versus unflavored e-cigarettes via a 90-min ad-libitum vaping session where puffs from each e-cigarette were counted. Subjective reward value was higher for the flavored versus the unflavored e-cigarette (β=0.83, CI 0.35-1.32, p=0.001). Participants worked harder for flavored e-cigarette puffs versus unflavored e-cigarette puffs (breakpoint=5.7; 597 responses versus 127 responses; β=460.733, CI 246.58-674.88, p<0.0001). Participants took twice as many flavored puffs than unflavored e-cigarette puffs (40 vs 23 puffs; IRR=2.028, CI 1.183-3.475, p=0.01). Flavoring enhances the rewarding and reinforcing value of e-cigarettes with nicotine, and thus their abuse liability in young adult smokers. Further research is necessary to determine whether the use of flavoring in e-cigarettes impacts cigarette smoking behavior among young adults. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Nicotine's enhancing effects on responding maintained by conditioned reinforcers are reduced by pretreatment with mecamylamine, but not hexamethonium, in rats.

PubMed

Jones, Jeb; Raiff, Bethany R; Dallery, Jesse

2010-08-01

Several studies have indicated that nicotine increases responding maintained by conditioned reinforcers. We assessed the effects of subcutaneous injections of 0.3 mg/kg nicotine and two nicotinic antagonists on responding maintained by conditioned and primary reinforcers and responding during extinction in 8 Long Evans rats. Mecamylamine, a central and peripheral nicotinic antagonist, and hexamethonium, a peripheral nicotinic antagonist, were administered prior to a subset of the experimental sessions. Nicotine selectively increased responding maintained by conditioned reinforcers and mecamylamine, but not hexamethonium, attenuated this effect. These results suggest that nicotine's enhancing effect on responding maintained by conditioned reinforcers is mediated in the central nervous system. PsycINFO Database Record 2010 APA, all rights reserved.

Resurgence and alternative-reinforcer magnitude.

PubMed

Craig, Andrew R; Browning, Kaitlyn O; Nall, Rusty W; Marshall, Ciara M; Shahan, Timothy A

2017-03-01

Resurgence is defined as an increase in the frequency of a previously reinforced target response when an alternative source of reinforcement is suspended. Despite an extensive body of research examining factors that affect resurgence, the effects of alternative-reinforcer magnitude have not been examined. Thus, the present experiments aimed to fill this gap in the literature. In Experiment 1, rats pressed levers for single-pellet reinforcers during Phase 1. In Phase 2, target-lever pressing was extinguished, and alternative-lever pressing produced either five-pellet, one-pellet, or no alternative reinforcement. In Phase 3, alternative reinforcement was suspended to test for resurgence. Five-pellet alternative reinforcement produced faster elimination and greater resurgence of target-lever pressing than one-pellet alternative reinforcement. In Experiment 2, effects of decreasing alternative-reinforcer magnitude on resurgence were examined. Rats pressed levers and pulled chains for six-pellet reinforcers during Phases 1 and 2, respectively. In Phase 3, alternative reinforcement was decreased to three pellets for one group, one pellet for a second group, and suspended altogether for a third group. Shifting from six-pellet to one-pellet alternative reinforcement produced as much resurgence as suspending alternative reinforcement altogether, while shifting from six pellets to three pellets did not produce resurgence. These results suggest that alternative-reinforcer magnitude has effects on elimination and resurgence of target behavior that are similar to those of alternative-reinforcer rate. Thus, both suppression of target behavior during alternative reinforcement and resurgence when conditions of alternative reinforcement are altered may be related to variables that affect the value of the alternative-reinforcement source. © 2017 Society for the Experimental Analysis of Behavior.

Resurgence and Alternative-Reinforcer Magnitude

PubMed Central

Craig, Andrew R.; Browning, Kaitlyn O.; Nall, Rusty W.; Marshall, Ciara M.; Shahan, Timothy A.

2017-01-01

Resurgence is defined as an increase in the frequency of a previously reinforced target response when an alternative source of reinforcement is suspended. Despite an extensive body of research examining factors that affect resurgence, the effects of alternative-reinforcer magnitude have not been examined. Thus, the present experiments aimed to fill this gap in the literature. In Experiment 1, rats pressed levers for single-pellet reinforcers during Phase 1. In Phase 2, target-lever pressing was extinguished, and alternative-lever pressing produced either five-pellet, one-pellet, or no alternative reinforcement. In Phase 3, alternative reinforcement was suspended to test for resurgence. Five-pellet alternative reinforcement produced faster elimination and greater resurgence of target-lever pressing than one-pellet alternative reinforcement. In Experiment 2, effects of decreasing alternative-reinforcer magnitude on resurgence were examined. Rats pressed levers and pulled chains for six-pellet reinforcers during Phases 1 and 2, respectively. In Phase 3, alternative reinforcement was decreased to three pellets for one group, one pellet for a second group, and suspended altogether for a third group. Shifting from six-pellet to one-pellet alternative reinforcement produced as much resurgence as suspending alternative reinforcement altogether, while shifting from six pellets to three pellets did not produce resurgence. These results suggest that alternative-reinforcer magnitude has effects on elimination and resurgence of target behavior that are similar to those of alternative-reinforcer rate. Thus, both suppression of target behavior during alternative reinforcement and resurgence when conditions of alternative reinforcement are altered may be related to variables that affect the value of the alternative-reinforcement source. PMID:28194793

Delay discounting of qualitatively different reinforcers in rats.

PubMed

Calvert, Amanda L; Green, Leonard; Myerson, Joel

2010-03-01

Humans discount larger delayed rewards less steeply than smaller rewards, whereas no such magnitude effect has been observed in rats (and pigeons). It remains possible that rats' discounting is sensitive to differences in the quality of the delayed reinforcer even though it is not sensitive to amount. To evaluate this possibility, Experiment 1 examined discounting of qualitatively different food reinforcers: highly preferred versus nonpreferred food pellets. Similarly, Experiment 2 examined discounting of highly preferred versus nonpreferred liquid reinforcers. In both experiments, an adjusting-amount procedure was used to determine the amount of immediate reinforcer that was judged to be of equal subjective value to the delayed reinforcer. The amount and quality of the delayed reinforcer were varied across conditions. Discounting was well described by a hyperbolic function, but no systematic effects of the quantity or the quality of the delayed reinforcer were observed.

Autoshaping Chicks with Heat Reinforcement: The Role of Stimulus-Reinforcer and Response-Reinforcer Relations

ERIC Educational Resources Information Center

Wasserman, Edward A.; And Others

1975-01-01

The present series of experiments attempted to analyze more fully the contributions of stimulus-reinforcer and response-reinforcer relations to autoshaping within a single conditioning situation. (Author)

Body weight manipulation, reinforcement value and choice between sucrose and wheel running: a behavioral economic analysis.

PubMed

Belke, Terry W; Pierce, W David

2009-02-01

Twelve female Long-Evans rats were exposed to concurrent variable (VR) ratio schedules of sucrose and wheel-running reinforcement (Sucrose VR 10 Wheel VR 10; Sucrose VR 5 Wheel VR 20; Sucrose VR 20 Wheel VR 5) with predetermined budgets (number of responses). The allocation of lever pressing to the sucrose and wheel-running alternatives was assessed at high and low body weights. Results showed that wheel-running rate and lever-pressing rates for sucrose and wheel running increased, but the choice of wheel running decreased at the low body weight. A regression analysis of relative consumption as a function of relative price showed that consumption shifted toward sucrose and interacted with price differences in a manner consistent with increased substitutability. Demand curves showed that demand for sucrose became less elastic while demand for wheel running became more elastic at the low body weight. These findings reflect an increase in the difference in relative value of sucrose and wheel running as body weight decreased. Discussion focuses on the limitations of response rates as measures of reinforcement value. In addition, we address the commonalities between matching and demand curve equations for the analysis of changes in relative reinforcement value.

Nicotine’s Enhancing Effects on Responding Maintained by Conditioned Reinforcers are Reduced by Pretreatment with Mecamylamine, but not Hexamethonium, in Rats

PubMed Central

Jones, Jeb; Raiff, Bethany R.; Dallery, Jesse

2013-01-01

Several studies have indicated that nicotine increases responding maintained by conditioned reinforcers. We assessed the effects of subcutaneous injections of 0.3 mg/kg nicotine and two nicotinic antagonists on responding maintained by conditioned and primary reinforcers and responding during extinction in 8 Long Evans rats. Mecamylamine, a central and peripheral nicotinic antagonist, and hexamethonium, a peripheral nicotinic antagonist, were administered prior to a subset of the experimental sessions. Nicotine selectively increased responding maintained by conditioned reinforcers and mecamylamine, but not hexamethonium, attenuated this effect. These results suggest that nicotine’s enhancing effect on responding maintained by conditioned reinforcers is mediated in the central nervous system. PMID:20695691

Reducing added sugar intake increases the relative reinforcing value of high-sugar foods

USDA-ARS?s Scientific Manuscript database

Objective: To determine whether reducing added sugar intake to <10% of calories for 1 week changes the relative reinforcing value (RRV) of foods high in sugar and to test whether changes in RRV of high-sugar foods differed between non-overweight and obese adults. Background: The 2015-2020 DGA focu...

Thermal Analysis of Reinforced Concrete Tank for Conditioning Wood by FEM Method

NASA Astrophysics Data System (ADS)

Błaszczyński, Tomasz; Babiak, Michał; Wielentejczyk, Przemysław

2017-10-01

The article introduces the analysis of a RC tank for conditioning wood carried out using the FEM (Finite Element Method). A temperature gradient distribution increase resulting from the influence of hot liquid filling the tank was defined. Values of gradients in border sections of the tank walls and the bottom were defined on the basis of the isotherm method. The obtained results were compared with empirical formulas from literature. Strength analyses were also carried out. Additionally, the problematic aspects of elongated monolithic tanks for liquids were introduced, especially regarding large temperature gradients and the means of necessary technical solutions. The use of the FEM method for designing engineering objects is, nowadays, an irreplaceable solution. In the case of the discussed tank, a spatial model of the construction mapping its actual performance was constructed in order to correctly estimate the necessary dimensions of wall and bottom sections, as well as reinforcement.

The critical dimensions of the response-reinforcer contingency.

PubMed

Williams, B A.

2001-05-03

Two major dimensions of any contingency of reinforcement are the temporal relation between a response and its reinforcer, and the relative frequency of the reinforcer given the response versus when the response has not occurred. Previous data demonstrate that time, per se, is not sufficient to explain the effects of delay-of-reinforcement procedures; needed in addition is some account of the events occurring in the delay interval. Moreover, the effects of the same absolute time values vary greatly across situations, such that any notion of a standard delay-of-reinforcement gradient is simplistic. The effects of reinforcers occurring in the absence of a response depend critically upon the stimulus conditions paired with those reinforcers, in much the same manner as has been shown with Pavlovian contingency effects. However, it is unclear whether the underlying basis of such effects is response competition or changes in the calculus of causation.

The heuristic and motivational value of video reinforcement

NASA Technical Reports Server (NTRS)

Washburn, D. A.; Gulledge, J. P.; Rumbaugh, D. M.

1997-01-01

Four rhesus monkeys (Macaca mulatta) were tested on joystick-based computer tasks in which they could choose to be reinforced either with pellets-only or with pellets + video. A variety of videotapes were used to reinforce task performance. The monkeys significantly preferred to be rewarded with a pellet and 10 s of a blank screen than a pellet plus 10 s of videotape. When they did choose to see videotaped images, however, they were significantly more likely to view video of themselves than video of their roommate or of unfamiliar conspecifics. These data support earlier findings of individual differences in preference for video reinforcement, and have clear implications for the study of face-recognition and self-recognition by nonhuman primates.

Simple and conditional visual discrimination with wheel running as reinforcement in rats.

PubMed

Iversen, I H

1998-09-01

Three experiments explored whether access to wheel running is sufficient as reinforcement to establish and maintain simple and conditional visual discriminations in nondeprived rats. In Experiment 1, 2 rats learned to press a lit key to produce access to running; responding was virtually absent when the key was dark, but latencies to respond were longer than for customary food and water reinforcers. Increases in the intertrial interval did not improve the discrimination performance. In Experiment 2, 3 rats acquired a go-left/go-right discrimination with a trial-initiating response and reached an accuracy that exceeded 80%; when two keys showed a steady light, pressing the left key produced access to running whereas pressing the right key produced access to running when both keys showed blinking light. Latencies to respond to the lights shortened when the trial-initiation response was introduced and became much shorter than in Experiment 1. In Experiment 3, 1 rat acquired a conditional discrimination task (matching to sample) with steady versus blinking lights at an accuracy exceeding 80%. A trial-initiation response allowed self-paced trials as in Experiment 2. When the rat was exposed to the task for 19 successive 24-hr periods with access to food and water, the discrimination performance settled in a typical circadian pattern and peak accuracy exceeded 90%. When the trial-initiation response was under extinction, without access to running, the circadian activity pattern determined the time of spontaneous recovery. The experiments demonstrate that wheel-running reinforcement can be used to establish and maintain simple and conditional visual discriminations in nondeprived rats.

Examination of the effects of varenicline, bupropion, lorcaserin, or naltrexone on responding for conditioned reinforcement in nicotine-exposed rats.

PubMed

Guy, Elizabeth G; Fisher, Daniel C; Higgins, Guy A; Fletcher, Paul J

2014-12-01

Smoking tobacco remains one of the leading causes of preventable deaths in North America. Nicotine reinforces smoking behavior, in part, by enhancing the reinforcing properties of reward-related stimuli, or conditioned stimuli (CSs), associated with tobacco intake. To investigate how pharmaceutical interventions may affect this property of nicotine, we examined the effect of four US Food and Drug Administration (FDA) approved drugs on the ability of nicotine to enhance operant responding for a CS as a conditioned reinforcer. Thirsty rats were exposed to 13 Pavlovian sessions where a CS was paired with water delivery. Nicotine (0.4 mg/kg) injections were administered before each Pavlovian session. Then, in separate groups of rats, the effects of varenicline (1 mg/kg), bupropion (10 and 30 mg/kg), lorcaserin (0.6 mg/kg), and naltrexone (2 mg/kg), and their interaction with nicotine on responding for conditioned reinforcement were examined. Varenicline and lorcaserin each reduced nicotine-enhanced responding for conditioned reinforcement, whereas naltrexone had a modest effect of reducing response enhancements by nicotine. In contrast, bupropion enhanced the effect of nicotine on this measure. The results of these studies may inform how pharmaceutical interventions can affect smoking cessation attempts and relapse through diverse mechanisms, either substituting for, or interacting with, the reinforcement-enhancing properties of nicotine.

Reinforcement interval type-2 fuzzy controller design by online rule generation and q-value-aided ant colony optimization.

PubMed

Juang, Chia-Feng; Hsu, Chia-Hung

2009-12-01

This paper proposes a new reinforcement-learning method using online rule generation and Q-value-aided ant colony optimization (ORGQACO) for fuzzy controller design. The fuzzy controller is based on an interval type-2 fuzzy system (IT2FS). The antecedent part in the designed IT2FS uses interval type-2 fuzzy sets to improve controller robustness to noise. There are initially no fuzzy rules in the IT2FS. The ORGQACO concurrently designs both the structure and parameters of an IT2FS. We propose an online interval type-2 rule generation method for the evolution of system structure and flexible partitioning of the input space. Consequent part parameters in an IT2FS are designed using Q -values and the reinforcement local-global ant colony optimization algorithm. This algorithm selects the consequent part from a set of candidate actions according to ant pheromone trails and Q-values, both of which are updated using reinforcement signals. The ORGQACO design method is applied to the following three control problems: 1) truck-backing control; 2) magnetic-levitation control; and 3) chaotic-system control. The ORGQACO is compared with other reinforcement-learning methods to verify its efficiency and effectiveness. Comparisons with type-1 fuzzy systems verify the noise robustness property of using an IT2FS.

Color change in acrylic denture base resin reinforced with wire mesh and glass cloth.

PubMed

Kanie, Takahito; Arikawa, Hiroyuki; Fujii, Koichi; Ban, Seiji

2003-12-01

In this study, the L*a*b* color system as a color system and light transmittance of the denture base resin reinforced with wire mesh and glass cloth were measured, and the color difference (deltaE*ab) was calculated using L*, a* and b* values which were measured both on a white calibration plate and on a null background. The thicknesses of test specimens, which were reinforced with wire mesh and glass cloth 0.5 and 1.0 mm below the surface, were 3 and 5 mm. L*, a* and b* values of wire mesh reinforcing specimens decreased in comparison with the non-reinforcing specimens (p<0.05). L* values of glass cloth-reinforcing specimens increased compared with the non-reinforcing specimens (p<0.05). The glass cloth is an effective reinforcing material and an aesthetically important property of denture base resin, since wire mesh makes the resin appear darker with the background condition greatly altering the color, while glass cloth makes the resin lighter.

Interactions between neurons in the frontal cortex and hippocampus in cats trained to select reinforcements of different value in conditions of cholinergic deficiency.

PubMed

Dolbakyan, E E; Merzhanova, G Kh

2007-09-01

An operant food-related conditioned reflex was developed in six cats by the "active choice" protocol: short-latency pedal presses were followed by presentation of low-quality reinforcement (bread-meat mix), while long-latency pedal presses were followed by presentation of high-quality reinforcement (meat). Animals differed in terms of their food-procuring strategies, displaying "self-control," "ambivalence," or "impulsivity." Multineuron activity was recorded from the frontal cortex and hippocampus (field CA3). Cross-correlation analysis of interneuronal interactions within (local networks) and between (distributed networks) study structures showed that the numbers of interneuronal interactions in both local and distributed networks were maximal in animals with "self-control." On the background of systemic administration of the muscarinic cholinoreceptor blockers scopolamine and trihexyphenidyl, the numbers of interneuronal interactions decreased, while "common source" influences increased. This correlated with impairment of the reproduction of the selected strategy, primarily affecting the animals' self-controlled behavior. These results show that the "self-control" strategy is determined by the organization of local and distributed networks in the frontal cortex and hippocampus.

Establishing books as conditioned reinforcers for preschool children as a function of an observational intervention.

PubMed

Singer-Dudek, Jessica; Oblak, Mara; Greer, R Douglas

2011-01-01

We tested the effects of an observational intervention (Greer & Singer-Dudek, 2008) on establishing children's books as conditioned reinforcers using a delayed multiple baseline design. Three preschool students with mild language and developmental delays served as the participants. Prior to the intervention, books did not function as reinforcers for any of the participants. The observational intervention consisted of a situation in which the participant observed a confederate being presented with access to books contingent on correct responses and the participant received nothing for correct responses. After several sessions of this treatment, the previously neutral books acquired reinforcing properties for maintenance and acquisition responses for all three participants.

ESTABLISHING BOOKS AS CONDITIONED REINFORCERS FOR PRESCHOOL CHILDREN AS A FUNCTION OF AN OBSERVATIONAL INTERVENTION

PubMed Central

Singer-Dudek, Jessica; Oblak, Mara; Greer, R. Douglas

2011-01-01

We tested the effects of an observational intervention (Greer & Singer-Dudek, 2008) on establishing children's books as conditioned reinforcers using a delayed multiple baseline design. Three preschool students with mild language and developmental delays served as the participants. Prior to the intervention, books did not function as reinforcers for any of the participants. The observational intervention consisted of a situation in which the participant observed a confederate being presented with access to books contingent on correct responses and the participant received nothing for correct responses. After several sessions of this treatment, the previously neutral books acquired reinforcing properties for maintenance and acquisition responses for all three participants. PMID:21941376

Asymmetry of Reinforcement and Punishment in Human Choice

ERIC Educational Resources Information Center

Rasmussen, Erin B.; Newland, M. Christopher

2008-01-01

The hypothesis that a penny lost is valued more highly than a penny earned was tested in human choice. Five participants clicked a computer mouse under concurrent variable-interval schedules of monetary reinforcement. In the no-punishment condition, the schedules arranged monetary gain. In the punishment conditions, a schedule of monetary loss was…

Reinforcement and the Organization of Behavior in Golden Hamsters: Pavlovian Conditioning with Food and Shock Unconditioned Stimuli

ERIC Educational Resources Information Center

Shettleworth, Sara J.

1978-01-01

There has been considerable interest lately in cases where instrumental conditionability appears to depend on the reinforcer used. Here the effects of Pavlovian conditioned stimuli (CSs)on golden hamster behaviors was observed. The intent was to see whether previously reported differences among the behaviors produced by food reinforcement and…

Influence of temporal context on value in the multiple-chains and successive-encounters procedures.

PubMed

O'Daly, Matthew; Angulo, Samuel; Gipson, Cassandra; Fantino, Edmund

2006-05-01

This set of studies explored the influence of temporal context across multiple-chain and multiple-successive-encounters procedures. Following training with different temporal contexts, the value of stimuli sharing similar reinforcement schedules was assessed by presenting these stimuli in concurrent probes. The results for the multiple-chain schedule indicate that temporal context does impact the value of a conditioned reinforcer consistent with delay-reduction theory, such that a stimulus signaling a greater reduction in delay until reinforcement has greater value. Further, nonreinforced stimuli that are concurrently presented with the preferred terminal link also have greater value, consistent with value transfer. The effects of context on value for conditions with the multiple-successive-encounters procedure, however, appear to depend on whether the search schedule or alternate handling schedule was manipulated, as well as on whether the tested stimuli were the rich or lean schedules in their components. Overall, the results help delineate the conditions under which temporal context affects conditioned-reinforcement value (acting as a learning variable) and the conditions under which it does not (acting as a performance variable), an issue of relevance to theories of choice.

Model-Based Reinforcement Learning under Concurrent Schedules of Reinforcement in Rodents

ERIC Educational Resources Information Center

Huh, Namjung; Jo, Suhyun; Kim, Hoseok; Sul, Jung Hoon; Jung, Min Whan

2009-01-01

Reinforcement learning theories postulate that actions are chosen to maximize a long-term sum of positive outcomes based on value functions, which are subjective estimates of future rewards. In simple reinforcement learning algorithms, value functions are updated only by trial-and-error, whereas they are updated according to the decision-maker's…

Context transfer in reinforcement learning using action-value functions.

PubMed

Mousavi, Amin; Nadjar Araabi, Babak; Nili Ahmadabadi, Majid

2014-01-01

This paper discusses the notion of context transfer in reinforcement learning tasks. Context transfer, as defined in this paper, implies knowledge transfer between source and target tasks that share the same environment dynamics and reward function but have different states or action spaces. In other words, the agents learn the same task while using different sensors and actuators. This requires the existence of an underlying common Markov decision process (MDP) to which all the agents' MDPs can be mapped. This is formulated in terms of the notion of MDP homomorphism. The learning framework is Q-learning. To transfer the knowledge between these tasks, the feature space is used as a translator and is expressed as a partial mapping between the state-action spaces of different tasks. The Q-values learned during the learning process of the source tasks are mapped to the sets of Q-values for the target task. These transferred Q-values are merged together and used to initialize the learning process of the target task. An interval-based approach is used to represent and merge the knowledge of the source tasks. Empirical results show that the transferred initialization can be beneficial to the learning process of the target task.

Context Transfer in Reinforcement Learning Using Action-Value Functions

PubMed Central

Mousavi, Amin; Nadjar Araabi, Babak; Nili Ahmadabadi, Majid

2014-01-01

This paper discusses the notion of context transfer in reinforcement learning tasks. Context transfer, as defined in this paper, implies knowledge transfer between source and target tasks that share the same environment dynamics and reward function but have different states or action spaces. In other words, the agents learn the same task while using different sensors and actuators. This requires the existence of an underlying common Markov decision process (MDP) to which all the agents' MDPs can be mapped. This is formulated in terms of the notion of MDP homomorphism. The learning framework is Q-learning. To transfer the knowledge between these tasks, the feature space is used as a translator and is expressed as a partial mapping between the state-action spaces of different tasks. The Q-values learned during the learning process of the source tasks are mapped to the sets of Q-values for the target task. These transferred Q-values are merged together and used to initialize the learning process of the target task. An interval-based approach is used to represent and merge the knowledge of the source tasks. Empirical results show that the transferred initialization can be beneficial to the learning process of the target task. PMID:25610457

Effects of reinforcer magnitude on responding under differential-reinforcement-of-low-rate schedules of rats and pigeons.

PubMed

Doughty, Adam H; Richards, Jerry B

2002-07-01

Experiment I investigated the effects of reinforcer magnitude on differential-reinforcement-of-low-rate (DRL) schedule performance in three phases. In Phase 1, two groups of rats (n = 6 and 5) responded under a DRI. 72-s schedule with reinforcer magnitudes of either 30 or 300 microl of water. After acquisition, the water amounts were reversed for each rat. In Phase 2, the effects of the same reinforcer magnitudes on DRL 18-s schedule performance were examined across conditions. In Phase 3, each rat responded unider a DR1. 18-s schedule in which the water amotnts alternated between 30 and 300 microl daily. Throughout each phase of Experiment 1, the larger reinforcer magnitude resulted in higher response rates and lower reinforcement rates. The peak of the interresponse-time distributions was at a lower value tinder the larger reinforcer magnitude. In Experiment 2, 3 pigeons responded under a DRL 20-s schedule in which reinforcer magnitude (1-s or 6-s access to grain) varied iron session to session. Higher response rates and lower reinforcement rates occurred tinder the longer hopper duration. These results demonstrate that larger reinforcer magnitudes engender less efficient DRL schedule performance in both rats and pigeons, and when reinforcer magnitude was held constant between sessions or was varied daily. The present results are consistent with previous research demonstrating a decrease in efficiency as a function of increased reinforcer magnituide tinder procedures that require a period of time without a specified response. These findings also support the claim that DRI. schedule performance is not governed solely by a timing process.

The nature of sexual reinforcement.

PubMed Central

Crawford, L L; Holloway, K S; Domjan, M

1993-01-01

Sexual reinforcers are not part of a regulatory system involved in the maintenance of critical metabolic processes, they differ for males and females, they differ as a function of species and mating system, and they show ontogenetic and seasonal changes related to endocrine conditions. Exposure to a member of the opposite sex without copulation can be sufficient for sexual reinforcement. However, copulatory access is a stronger reinforcer, and copulatory opportunity can serve to enhance the reinforcing efficacy of stimulus features of a sexual partner. Conversely, under certain conditions, noncopulatory exposure serves to decrease reinforcer efficacy. Many common learning phenomena such as acquisition, extinction, discrimination learning, second-order conditioning, and latent inhibition have been demonstrated in sexual conditioning. These observations extend the generality of findings obtained with more conventional reinforcers, but the mechanisms of these effects and their gender and species specificity remain to be explored. PMID:8354970

Origins of food reinforcement in infants.

PubMed

Kong, Kai Ling; Feda, Denise M; Eiden, Rina D; Epstein, Leonard H

2015-03-01

Rapid weight gain in infancy is associated with a higher risk of obesity in children and adults. A high relative reinforcing value of food is cross-sectionally related to obesity; lean children find nonfood alternatives more reinforcing than do overweight/obese children. However, to our knowledge, there is no research on how and when food reinforcement develops. This study was designed to assess whether the reinforcing value of food and nonfood alternatives could be tested in 9- to 18-mo-old infants and whether the reinforcing value of food and nonfood alternatives is differentially related to infant weight status. Reinforcing values were assessed by using absolute progressive ratio schedules of reinforcement, with presentation of food and nonfood alternatives counterbalanced in 2 separate studies. Two nonfood reinforcers [Baby Einstein-Baby MacDonald shows (study 1, n = 27) or bubbles (study 2, n = 30)] were tested against the baby's favorite food. Food reinforcing ratio (FRR) was quantified by measuring the reinforcing value of food (Food Pmax) in proportion to the total reinforcing value of food and a nonfood alternative (DVD Pmax or BUB Pmax). Greater weight-for-length z score was associated with a greater FRR of a favorite food in study 1 (FRR-DVD) (r = 0.60, P < 0.001) and FRR of a favorite food in study 2 (FRR-BUB) (r = 0.49, P = 0.006), primarily because of the strong association between greater weight-for-length z score and lower DVD Pmax (r = -0.71, P < 0.0001) and BUB Pmax (r = -0.53, P = 0.003). Infant monthly weight gain was positively associated with FRR-DVD (r = 0.57, P = 0.009) and FRR-BUB (r = 0.37, P = 0.047). Our newly developed paradigm, which tested 2 different nonfood alternatives, demonstrated that lean infants find nonfood alternatives more reinforcing than do overweight/obese infants. This observation suggests that strengthening the alternative reinforcers may have a protective effect against childhood obesity. © 2015 American Society for

Braided reinforced composite rods for the internal reinforcement of concrete

NASA Astrophysics Data System (ADS)

Gonilho Pereira, C.; Fangueiro, R.; Jalali, S.; Araujo, M.; Marques, P.

2008-05-01

This paper reports on the development of braided reinforced composite rods as a substitute for the steel reinforcement in concrete. The research work aims at understanding the mechanical behaviour of core-reinforced braided fabrics and braided reinforced composite rods, namely concerning the influence of the braiding angle, the type of core reinforcement fibre, and preloading and postloading conditions. The core-reinforced braided fabrics were made from polyester fibres for producing braided structures, and E-glass, carbon, HT polyethylene, and sisal fibres were used for the core reinforcement. The braided reinforced composite rods were obtained by impregnating the core-reinforced braided fabric with a vinyl ester resin. The preloading of the core-reinforced braided fabrics and the postloading of the braided reinforced composite rods were performed in three and two stages, respectively. The results of tensile tests carried out on different samples of core-reinforced braided fabrics are presented and discussed. The tensile and bending properties of the braided reinforced composite rods have been evaluated, and the results obtained are presented, discussed, and compared with those of conventional materials, such as steel.

Are preference and resistance to change convergent expressions of stimulus value?

PubMed

Podlesnik, Christopher A; Jimenez-Gomez, Corina; Shahan, Timothy A

2013-07-01

Behavioral momentum theory asserts that preference and relative resistance to disruption depend on reinforcement rates and provide converging expressions of the conditioned value of discriminative stimuli. However, preference and resistance to disruption diverge when assessing preference during brief extinction probes. We expanded upon this opposing relation by arranging target stimuli signaling equal variable-interval schedules across components of a multiple schedule. We paired one target stimulus with a richer reinforced alternative and the other with a leaner alternative. Furthermore, we varied reinforcement rates for the paired alternatives to assess the effects of manipulating relative conditioned value on preference and resistance to disruption by presession feeding, intercomponent food, and extinction. We replicated the opposing relation between preference and resistance to disruption but varying reinforcement rates for the paired alternatives did not systematically affect preference or resistance to disruption beyond levels observed in our initial condition. Importantly, we found that only preference between the target stimuli was related to relative baseline response rates in the presence of those stimuli. These findings suggest that preference during extinction probes might reveal more about baseline response rates between concurrently available alternatives than relative conditioned value. Resistance to disruption, conversely, appears to better reflect conditioned value because it is less confounded with baseline response rates and is a function of all sources of reinforcement obtained in the presence of a stimulus context. © Society for the Experimental Analysis of Behavior.

Behaviour of fibre reinforced polymer confined reinforced concrete columns under fire condition

NASA Astrophysics Data System (ADS)

Chowdhury, Ershad Ullah

In recent years, fibre reinforced polymer (FRP) materials have demonstrated enormous potential as materials for repairing and retrofitting concrete bridges that have deteriorated from factors such as electro-chemical corrosion and increased load requirements. However, concerns associated with fire remain an obstacle to applications of FRP materials in buildings and parking garages due to FRP's sensitivity to high temperatures as compared with other structural materials and to limited knowledge on their thermal and mechanical behaviour in fire. This thesis presents results from an ongoing study on the fire performance of FRP materials, fire insulation materials and systems, and FRP wrapped reinforced concrete columns. The overall goal of the study is to understand the fire behaviour of FRP materials and FRP strengthened concrete columns and ultimately, provide rational fire safety design recommendations and guidelines for FRP strengthened concrete columns. A combined experimental and numerical investigation was conducted to achieve the goals of this research study. The experimental work consisted of both small-scale FRP material testing at elevated temperatures and full-scale fire tests on FRP strengthened columns. A numerical model was developed to simulate the behaviour of unwrapped reinforced concrete and FRP strengthened reinforced concrete square or rectangular columns in fire. After validating the numerical model against test data available in literature, it was determined that the numerical model can be used to analyze the behaviour of concrete axial compressive members in fire. Results from this study also demonstrated that although FRP materials experience considerable loss of their mechanical and bond properties at temperatures somewhat below the glass transition temperature of the resin matrix, externally-bonded FRP can be used in strengthening concrete structural members in buildings, if appropriate supplemental fire protection system is provided over

Effects of reinforcer magnitude on responding under differential-reinforcement-of-low-rate schedules of rats and pigeons.

PubMed Central

Doughty, Adam H; Richards, Jerry B

2002-01-01

Experiment I investigated the effects of reinforcer magnitude on differential-reinforcement-of-low-rate (DRL) schedule performance in three phases. In Phase 1, two groups of rats (n = 6 and 5) responded under a DRI. 72-s schedule with reinforcer magnitudes of either 30 or 300 microl of water. After acquisition, the water amounts were reversed for each rat. In Phase 2, the effects of the same reinforcer magnitudes on DRL 18-s schedule performance were examined across conditions. In Phase 3, each rat responded unider a DR1. 18-s schedule in which the water amotnts alternated between 30 and 300 microl daily. Throughout each phase of Experiment 1, the larger reinforcer magnitude resulted in higher response rates and lower reinforcement rates. The peak of the interresponse-time distributions was at a lower value tinder the larger reinforcer magnitude. In Experiment 2, 3 pigeons responded under a DRL 20-s schedule in which reinforcer magnitude (1-s or 6-s access to grain) varied iron session to session. Higher response rates and lower reinforcement rates occurred tinder the longer hopper duration. These results demonstrate that larger reinforcer magnitudes engender less efficient DRL schedule performance in both rats and pigeons, and when reinforcer magnitude was held constant between sessions or was varied daily. The present results are consistent with previous research demonstrating a decrease in efficiency as a function of increased reinforcer magnituide tinder procedures that require a period of time without a specified response. These findings also support the claim that DRI. schedule performance is not governed solely by a timing process. PMID:12144310

Reinforcement learning and Tourette syndrome.

PubMed

Palminteri, Stefano; Pessiglione, Mathias

2013-01-01

In this chapter, we report the first experimental explorations of reinforcement learning in Tourette syndrome, realized by our team in the last few years. This report will be preceded by an introduction aimed to provide the reader with the state of the art of the knowledge concerning the neural bases of reinforcement learning at the moment of these studies and the scientific rationale beyond them. In short, reinforcement learning is learning by trial and error to maximize rewards and minimize punishments. This decision-making and learning process implicates the dopaminergic system projecting to the frontal cortex-basal ganglia circuits. A large body of evidence suggests that the dysfunction of the same neural systems is implicated in the pathophysiology of Tourette syndrome. Our results show that Tourette condition, as well as the most common pharmacological treatments (dopamine antagonists), affects reinforcement learning performance in these patients. Specifically, the results suggest a deficit in negative reinforcement learning, possibly underpinned by a functional hyperdopaminergia, which could explain the persistence of tics, despite their evident inadaptive (negative) value. This idea, together with the implications of these results in Tourette therapy and the future perspectives, is discussed in Section 4 of this chapter. © 2013 Elsevier Inc. All rights reserved.

Response rate and reinforcement rate in Pavlovian conditioning.

PubMed

Harris, Justin A; Carpenter, Joanne S

2011-10-01

Four experiments used delay conditioning of magazine approach in rats to investigate the relationship between the rate of responding, R, to a conditioned stimulus (CS) and the rate, r, at which the CS is reinforced with the unconditioned stimulus (US). Rats were concurrently trained with four variable-duration CSs with different rs, either as a result of differences in the mean CS-US interval or in the proportion of CS presentations that ended with the US. In each case, R was systematically related to r, and the relationship was very accurately characterized by a hyperbolic function, R = Ar/(r +c). Accordingly, the reciprocal of these two variables-response interval, I (= 1/R), and CS-US interval, i (= 1/r) - were related by a simple affine (straight line) transformation, I = mi+b. This latter relationship shows that each increment in the time that the rats had to wait for food produced a linear increment in the time they waited between magazine entries. We discuss the close agreement between our findings and the Matching Law (Herrnstein, 1970) and consider their implications for both associative theories (e.g., Rescorla & Wagner, 1972) and nonassociative theories (Gallistel & Gibbon, 2000) of conditioning. (PsycINFO Database Record (c) 2011 APA, all rights reserved).

Mate call as reward: Acoustic communication signals can acquire positive reinforcing values during adulthood in female zebra finches (Taeniopygia guttata).

PubMed

Hernandez, Alexandra M; Perez, Emilie C; Mulard, Hervé; Mathevon, Nicolas; Vignal, Clémentine

2016-02-01

Social stimuli can have rewarding properties and promote learning. In birds, conspecific vocalizations like song can act as a reinforcer, and specific song variants can acquire particular rewarding values during early life exposure. Here we ask if, during adulthood, an acoustic signal simpler and shorter than song can become a reward for a female songbird because of its particular social value. Using an operant choice apparatus, we showed that female zebra finches display a preferential response toward their mate's calls. This reinforcing value of mate's calls could be involved in the maintenance of the monogamous pair-bond of the zebra finch. (c) 2016 APA, all rights reserved).

The Effects of Reinforcer Pairing and Fading on Preschoolers' Snack Selections

PubMed Central

Solberg, Katherine M; Hanley, Gregory P; Layer, Stacy A; Ingvarsson, Einar T

2007-01-01

The effects of reinforcement pairing and fading on preschoolers' snack selections were evaluated in a multiple baseline design. Baseline preferences for snack options were assessed via repeated paired-item preference assessments. Edible, social, and activity-based reinforcers were then exclusively paired with a less preferred snack option. Once the snack paired with reinforcement was selected most frequently, the three types of reinforcement were systematically faded. Frequent selections of the previously less preferred snack option were produced with paired reinforcement, but were disrupted for all children as the paired reinforcement was reduced to low levels. These data showed that paired reinforcement was initially effective in increasing preference for the originally less preferred snack options, but more permanent changes in the value of the snack options were not achieved. Conditions for producing persistent changes in children's snack choices are discussed. PMID:18189095

Taste and food reinforcement in non-overweight youth

PubMed Central

Epstein, Leonard H.; Carr, Katelyn A.; Scheid, Jennifer L.; Gebre, Eden; O’Brien, Alexis; Paluch, Rocco A.; Temple, Jennifer L.

2015-01-01

Food reinforcement is related to increased energy intake, cross-sectionally related to obesity and prospectively related to weight gain in children, adolescents and adults. There is very limited research on how different characteristics of food are related to food reinforcement, and none on how foods from different taste categories (sweet, savory, salty) are related to food reinforcement. We tested differences in food reinforcement for favorite foods in these categories and used a reinforcing value questionnaire to assess how food reinforcement was related to energy intake in 198 non-overweight 8–12 year-old children. Results showed stronger food reinforcement for sweet foods in comparison to savory or salty foods. In multiple regression models, controlling for child sex, minority status and age, average reinforcing value was related to total energy and fat intake, and reinforcing value of savory foods was related to total energy and fat intake. Factor analysis showed one factor, the motivation to eat, rather than separate factors based on different taste categories. Liking ratings were unrelated to total energy intake. These results suggest that while there are differences in the reinforcing value of food by taste groups, there are not strong differences in the relationship between reinforcing value of food by taste groups and energy or macronutrient intake. PMID:25891040

Partial reinforcement, extinction, and placebo analgesia

PubMed Central

Yeung, Siu Tsin Au; Colagiuri, Ben; Lovibond, Peter F.; Colloca, Luana

2014-01-01

Numerous studies indicate that placebo analgesia can be established via conditioning procedures. However, these studies have exclusively involved conditioning under continuous reinforcement. Thus, it is currently unknown whether placebo analgesia can be established under partial reinforcement and how durable any such effect would be. We tested this possibility using electro-cutaneous pain in healthy volunteers. Sixty undergraduates received placebo treatment (activation of a sham electrode) under the guise of an analgesic trial. The participants were randomly allocated to different conditioning schedules, namely continuous reinforcement (CRF), partial reinforcement (PRF), or control (no conditioning). Conditioning was achieved by surreptitiously reducing pain intensity during training when the placebo was activated compared with when it was inactive. For the CRF group, the placebo was always followed by a surreptitious reduction in pain during training. For the PRF group, the placebo was followed by a reduction in pain stimulation on 62.5% of trials only. In the test phase, pain stimulation was equivalent across placebo and no placebo trials. Both continuous and partial reinforcement produced placebo analgesia, with the magnitude of initial analgesia being larger following continuous reinforcement. However, while the placebo analgesia established under continuous reinforcement extinguished during test phase, the placebo analgesia established under partial reinforcement did not. These findings indicate that partial reinforcement can induce placebo analgesia and that these effects are more resistant to extinction than those established via continuous reinforcement. Partial reinforcement may, therefore, reflect a novel way of enhancing clinical outcomes via the placebo effect. PMID:24602997

Effect of Reinforcer Magnitude on Performance Maintained by Progressive-Ratio Schedules

PubMed Central

Rickard, J.F; Body, S; Zhang, Z; Bradshaw, C.M; Szabadi, E

2009-01-01

This experiment examined the relationship between reinforcer magnitude and quantitative measures of performance on progressive-ratio schedules. Fifteen rats were trained under a progressive-ratio schedule in seven phases of the experiment in which the volume of a 0.6-M sucrose solution reinforcer was varied within the range 6–300 µl. Overall response rates in successive ratios conformed to a bitonic equation derived from Killeen's (1994) Mathematical Principles of Reinforcement. The “specific activation” parameter, a, which is presumed to reflect the incentive value of the reinforcer, was a monotonically increasing function of reinforcer volume; the “response time” parameter, δ, which defines the minimum response time, increased as a function of reinforcer volume; the “currency” parameter, β, which is presumed to reflect the coupling of responses to the reinforcer, declined as a function of volume. Running response rate (response rate calculated after exclusion of the postreinforcement pause) decayed monotonically as a function of ratio size; the index of curvature of this function increased as a function of reinforcer volume. Postreinforcement pause increased as a function of ratio size. Estimates of a derived from overall response rates and postreinforcement pauses showed a modest positive correlation across conditions and between animals. Implications of the results for the quantification of reinforcer value and for the use of progressive-ratio schedules in behavioral neuroscience are discussed. PMID:19230513

Effect of reinforcer magnitude on performance maintained by progressive-ratio schedules.

PubMed

Rickard, J F; Body, S; Zhang, Z; Bradshaw, C M; Szabadi, E

2009-01-01

This experiment examined the relationship between reinforcer magnitude and quantitative measures of performance on progressive-ratio schedules. Fifteen rats were trained under a progressive-ratio schedule in seven phases of the experiment in which the volume of a 0.6-M sucrose solution reinforcer was varied within the range 6-300 microl. Overall response rates in successive ratios conformed to a bitonic equation derived from Killeen's (1994) Mathematical Principles of Reinforcement. The "specific activation" parameter, a, which is presumed to reflect the incentive value of the reinforcer, was a monotonically increasing function of reinforcer volume; the "response time" parameter, delta, which defines the minimum response time, increased as a function of reinforcer volume; the "currency" parameter, beta, which is presumed to reflect the coupling of responses to the reinforcer, declined as a function of volume. Running response rate (response rate calculated after exclusion of the postreinforcement pause) decayed monotonically as a function of ratio size; the index of curvature of this function increased as a function of reinforcer volume. Postreinforcement pause increased as a function of ratio size. Estimates of a derived from overall response rates and postreinforcement pauses showed a modest positive correlation across conditions and between animals. Implications of the results for the quantification of reinforcer value and for the use of progressive-ratio schedules in behavioral neuroscience are discussed.

THE EFFECTS OF FIXED VERSUS ESCALATING REINFORCEMENT SCHEDULES ON SMOKING ABSTINENCE

PubMed Central

Romanowich, Paul; Lamb, R. J.

2015-01-01

Studies indicate that when abstinence is initiated, escalating reinforcement schedules maintain continuous abstinence longer than fixed reinforcement schedules. However, these studies were conducted for shorter durations than most clinical trials and also resulted in larger reinforcer value for escalating participants during the 1st week of the experiment. We tested whether escalating reinforcement schedules maintained abstinence longer than fixed reinforcement schedules in a 12-week clinical trial. Smokers (146) were randomized to an escalating reinforcement schedule, a fixed reinforcement schedule, or a control condition. Escalating reinforcement participants received $5.00 for their first breath carbon monoxide (CO) sample <3 ppm, with a $0.50 increase for each consecutive sample. Fixed reinforcement participants received $19.75 for each breath CO sample <3 ppm. Control participants received payments only for delivering a breath CO sample. Similar proportions of escalating and fixed reinforcement participants met the breath CO criterion at least once. Escalating reinforcement participants maintained criterion breath CO levels longer than fixed reinforcement and control participants. Similar to previous short-term studies, escalating reinforcement schedules maintained longer durations of abstinence than fixed reinforcement schedules during a clinical trial. PMID:25640764

Creep of experimental short fiber-reinforced composite resin.

PubMed

Garoushi, Sufyan; Kaleem, Muhammad; Shinya, Akikazu; Vallittu, Pekka K; Satterthwaite, Julian D; Watts, David C; Lassila, Lippo V J

2012-01-01

The purpose of this study was to investigate the reinforcing effect of short E-glass fiber fillers oriented in different directions on composite resin under static and dynamic loading. Experimental short fiber-reinforced composite resin (FC) was prepared by mixing 22.5 wt% of short E-glass fibers, 22.5 wt% of resin, and 55 wt% of silane-treated silica fillers. Three groups of specimens (n=5) were tested: FC with isotropic fiber orientation, FC with anisotropic fiber orientation, and particulate-filled composite resin (PFC) as a control. Time-dependent creep and recovery were recorded. ANOVA revealed that after secondary curing in a vacuum oven and after storage in dry condition for 30 days, FC with isotropic fiber orientation (1.73%) exhibited significantly lower static creep value (p<0.05) than PFC (2.54%). For the different curing methods and storage conditions evaluated in this study, FC achieved acceptable static and dynamic creep values when compared to PFC.

Origins of food reinforcement in infants12345

PubMed Central

Kong, Kai Ling; Feda, Denise M; Eiden, Rina D; Epstein, Leonard H

2015-01-01

Background: Rapid weight gain in infancy is associated with a higher risk of obesity in children and adults. A high relative reinforcing value of food is cross-sectionally related to obesity; lean children find nonfood alternatives more reinforcing than do overweight/obese children. However, to our knowledge, there is no research on how and when food reinforcement develops. Objective: This study was designed to assess whether the reinforcing value of food and nonfood alternatives could be tested in 9- to 18-mo-old infants and whether the reinforcing value of food and nonfood alternatives is differentially related to infant weight status. Design: Reinforcing values were assessed by using absolute progressive ratio schedules of reinforcement, with presentation of food and nonfood alternatives counterbalanced in 2 separate studies. Two nonfood reinforcers [Baby Einstein–Baby MacDonald shows (study 1, n = 27) or bubbles (study 2, n = 30)] were tested against the baby’s favorite food. Food reinforcing ratio (FRR) was quantified by measuring the reinforcing value of food (Food Pmax) in proportion to the total reinforcing value of food and a nonfood alternative (DVD Pmax or BUB Pmax). Results: Greater weight-for-length z score was associated with a greater FRR of a favorite food in study 1 (FRR-DVD) (r = 0.60, P < 0.001) and FRR of a favorite food in study 2 (FRR-BUB) (r = 0.49, P = 0.006), primarily because of the strong association between greater weight-for-length z score and lower DVD Pmax (r = −0.71, P < 0.0001) and BUB Pmax (r = −0.53, P = 0.003). Infant monthly weight gain was positively associated with FRR-DVD (r = 0.57, P = 0.009) and FRR-BUB (r = 0.37, P = 0.047). Conclusions: Our newly developed paradigm, which tested 2 different nonfood alternatives, demonstrated that lean infants find nonfood alternatives more reinforcing than do overweight/obese infants. This observation suggests that strengthening the alternative reinforcers may have a protective

Adapting without reinforcement.

PubMed

Kheifets, Aaron; Gallistel, C Randy

2012-11-01

Our data rule out a broad class of behavioral models in which behavioral change is guided by differential reinforcement. To demonstrate this, we showed that the number of reinforcers missed before the subject shifted its behavior was not sufficient to drive behavioral change. What's more, many subjects shifted their behavior to a more optimal strategy even when they had not yet missed a single reinforcer. Naturally, differential reinforcement cannot be said to drive a process that shifts to accommodate to new conditions so adeptly that it doesn't miss a single reinforcer: it would have no input on which to base this shift.

Influence of Surface Conditioning Protocols on Reparability of CAD/CAM Zirconia-reinforced Lithium Silicate Ceramic.

PubMed

Al-Thagafi, Rana; Al-Zordk, Walid; Saker, Samah

2016-01-01

To test the effect of surface conditioning protocols on the reparability of CAD/CAM zirconia-reinforced lithium silicate ceramic compared to lithium-disilicate glass ceramic. Zirconia-reinforced lithium silicate ceramic (Vita Suprinity) and lithium disilicate glass-ceramic blocks (IPS e.max CAD) were categorized into four groups based on the surface conditioning protocol used. Group C: no treatment (control); group HF: 5% hydrofluoric acid etching for 60 s, silane (Monobond-S) application for 60 s, air drying; group HF-H: 5% HF acid etching for 60 s, application of silane for 60 s, air drying, application of Heliobond, light curing for 20 s; group CO: sandblasting with CoJet sand followed by silanization. Composite resin (Tetric EvoCeram) was built up into 4 x 6 x 3 mm blocks using teflon molds. All specimens were subjected to thermocycling (5000x, 5°C to 55°C). The microtensile bond strength test was employed at a crosshead speed of 1 mm/min. SEM was employed for evaluation of all the debonded microbars, the failure type was categorized as either adhesive (failure at adhesive layer), cohesive (failure at ceramic or composite resin), or mixed (failure between adhesive layer and substrate). Two-way ANOVA and the Tukey's HSD post-hoc test were applied to test for significant differences in bond strength values in relation to different materials and surface pretreatment (p < 0.05). The highest microtensile repair bond strength for Vita Suprinity was reported in group CO (33.1 ± 2.4 MPa) and the lowest in group HF (27.4 ± 4.4 MPa). Regarding IPS e.max CAD, group CO showed the highest (30.5 ± 4.9 MPa) and HF the lowest microtensile bond strength (22.4 ± 5.7 MPa). Groups HF, HF-H, and CO showed statistically significant differences in terms of all ceramic types used (p < 0.05). The control group showed exclusively adhesive failures, while in HF, HF-H, and CO groups, mixed failures were predominant. Repair bond strength to zirconia-reinforced lithium silicate

Taste and food reinforcement in non-overweight youth.

PubMed

Epstein, Leonard H; Carr, Katelyn A; Scheid, Jennifer L; Gebre, Eden; O'Brien, Alexis; Paluch, Rocco A; Temple, Jennifer L

2015-08-01

Food reinforcement is related to increased energy intake, cross-sectionally related to obesity and prospectively related to weight gain in children, adolescents and adults. There is very limited research on how different characteristics of food are related to food reinforcement, and none on how foods from different taste categories (sweet, savory, salty) are related to food reinforcement. We tested differences in food reinforcement for favorite foods in these categories and used a reinforcing value questionnaire to assess how food reinforcement was related to energy intake in 198 non-overweight 8- to 12-year-old children. Results showed stronger food reinforcement for sweet foods in comparison to savory or salty foods. In multiple regression models, controlling for child sex, minority status and age, average reinforcing value was related to total energy and fat intake, and reinforcing value of savory foods was related to total energy and fat intake. Factor analysis showed one factor, the motivation to eat, rather than separate factors based on different taste categories. Liking ratings were unrelated to total energy intake. These results suggest that while there are differences in the reinforcing value of food by taste groups, there are no strong differences in the relationship between reinforcing value of food by taste groups and energy or macronutrient intake. Copyright © 2015 Elsevier Ltd. All rights reserved.

Concurrent-Chains Schedules as a Method to Study Choice between Alcohol-Associated Conditioned Reinforcers

ERIC Educational Resources Information Center

Jimenez-Gomez, Corina; Shahan, Timothy A.

2012-01-01

An extensive body of research using concurrent-chains schedules of reinforcement has shown that choice for one of two differentially valued food-associated stimuli is dependent upon the overall temporal context in which those stimuli are embedded. The present experiments examined whether the concurrent chains procedure was useful for the study of…

Signal functions in delayed reinforcement

PubMed Central

Lattal, Kennon A.

1984-01-01

Three experiments were conducted with pigeons to examine the role of the signal in delay-of-reinforcement procedures. In the first, a blackout accompanying a period of nonreinforcement increased key-peck response rates maintained by immediate reinforcement. The effects of dissociating the blackout from the delay interval were examined in the second experiment. In three conditions, blackouts and unsignaled delays were negatively correlated or occurred randomly with respect to one another. A signaled delay and an unsignaled delay that omitted the blackouts were studied in two other conditions. All delay-of-reinforcement conditions generally produced response rates lower than those produced by immediate reinforcement. Signaled delays maintained higher response rates than did any of the various unsignaled-delay conditions, with or without dissociated blackouts. The effects of these latter conditions did not differ systematically from one another. The final experiment showed that response rates varied as a function of the frequency with which a blackout accompanied delay intervals. By eliminating a number of methodological difficulties present in previous delay-of-reinforcement experiments, these results suggest the importance of the signal in maintaining responding during delay-of-reinforcement procedures and, conversely, the importance of the delay interval in decreasing responding. PMID:16812387

Transient inactivation of basolateral amygdala during selective satiation disrupts reinforcer devaluation in rats

PubMed Central

West, Elizabeth A.; Forcelli, Patrick A.; Murnen, Alice T.; McCue, David L.; Gale, Karen; Malkova, Ludise

2012-01-01

Basolateral amygdala (BLA) function is critical for flexible, goal-directed behavior, including performance on reinforcer devaluation tasks. Here we tested, in rats, the hypothesis that BLA is critical for conditioned reinforcer devaluation during the period when the primary reinforcer (food) is being devalued (by feeding it to satiety), but not thereafter for guiding behavioral choices. We used a spatially-independent task, which employed two visual cues, each predicting one of two foods. An instrumental action (lever press) was required for reinforcer delivery. After training, rats received BLA or sham lesions, or cannulae implanted in BLA. Under control conditions (sham lesions, saline infusions), devaluation of one food significantly decreased responding to the cue associated with that food, when both cues were presented simultaneously during extinction. BLA lesions impaired this devaluation effect. Transient inactivation of BLA by microinfusion of the GABAA agonist muscimol resulted in an impairment, only when BLA was inactivated during satiation. When muscimol was infused after satiation and, therefore, BLA was inactivated only during the choice test, rats showed no impairment. Thus, BLA is necessary for registering or updating cues to reflect updated reinforcer values, but not for guiding choices once the value has been updated. Our results are the first to describe the contribution of rat BLA to specific components of reinforcer devaluation, and are the first to show impairment in reinforcer devaluation following transient inactivation in the rat. PMID:22845705

Merging separately established stimulus classes with outcome-specific reinforcement.

PubMed

Johnson, Cammarie; Meleshkevich, Olga; Dube, William V

2014-01-01

This study extended previous research on equivalence relations established with outcome-specific reinforcers to include the merger of separately established stimulus classes. Participants were four adults. Conditional discriminations AC and BC were trained first. Correct selections of C1 (C2, or C3) in the presence of A1 or B1 (A2 or B2, or A3 or B3) were followed by red (blue, or white) tokens; tokens were exchanged for value added to three participant-selected gift cards. Outcomes on equivalence tests for three-member classes ABC were positive. DF and EF were trained with the same reinforcing consequences, and tests were positive for three-member classes DEF. Results of class merger tests with combinations of stimuli from the ABC and DEF classes (AD, FB, etc.) were immediately positive for two participants, demonstrating six-member classes ABCDEF with reinforcers as nodes. Merger tests for a third participant were initially negative but became positive after brief exposure to unreinforced probe trials with reinforcers as comparison stimuli. Following class merger, tests for matching the reinforcers to samples and comparisons were also positive. Class-merger test results were negative for a fourth participant. The results provide the first demonstration of eight-member equivalence classes including two outcome-specific conditioned reinforcing stimuli. © Society for the Experimental Analysis of Behavior.

Value engineering and cost effectiveness of various fiber reinforced polymer (FRP) repair systems : final report, June 2007.

DOT National Transportation Integrated Search

2007-06-01

This report is an extension to the final report for NCDOT project 2004-15 Value Engineering and Cost-Effectiveness of : Various Fiber Reinforced Polymers (FRP) Repair Systems, submitted in June 2005. In that report, seventeen 30-ft long : prest...

Adapting without reinforcement

PubMed Central

Kheifets, Aaron; Gallistel, C. Randy

2012-01-01

Our data rule out a broad class of behavioral models in which behavioral change is guided by differential reinforcement. To demonstrate this, we showed that the number of reinforcers missed before the subject shifted its behavior was not sufficient to drive behavioral change. What’s more, many subjects shifted their behavior to a more optimal strategy even when they had not yet missed a single reinforcer. Naturally, differential reinforcement cannot be said to drive a process that shifts to accommodate to new conditions so adeptly that it doesn’t miss a single reinforcer: it would have no input on which to base this shift. PMID:23336018

Dysfunctional representation of expected value is associated with reinforcement-based decision-making deficits in adolescents with conduct problems.

PubMed

White, Stuart F; Tyler, Patrick M; Erway, Anna K; Botkin, Mary L; Kolli, Venkata; Meffert, Harma; Pope, Kayla; Blair, James R

2016-08-01

Previous work has shown that patients with conduct problems (CP) show impairments in reinforcement-based decision-making. However, studies with patients have not previously demonstrated any relationships between impairment in any of the neurocomputations underpinning reinforcement-based decision-making and specific symptom sets [e.g. level of CP and/or callous-unemotional (CU) traits]. Seventy-two youths [20 female, mean age = 13.81 (SD = 2.14), mean IQ = 102.34 (SD = 10.99)] from a residential treatment program and the community completed a passive avoidance task while undergoing functional MRI. Greater levels of CP were associated with poorer task performance. Reduced representation of expected values (EV) when making avoidance responses within bilateral anterior insula cortex/inferior frontal gyrus (AIC/iFG) and striatum was associated with greater levels of CP but not CU traits. The current data indicate that difficulties in the use of value information to motivate decisions to avoid suboptimal choices are associated with increased levels of CP (though not severity of CU traits). Moreover, they account for the behavioral deficits observed during reinforcement-based decision-making in youth with CP. In short, an individual's relative failure to utilize value information within AIC/iFG to avoid bad choices is associated with elevated levels of CP. © 2016 Association for Child and Adolescent Mental Health.

Examining the reinforcing value of stimuli within social and non-social contexts in children with and without high-functioning autism.

PubMed

Goldberg, Melissa C; Allman, Melissa J; Hagopian, Louis P; Triggs, Mandy M; Frank-Crawford, Michelle A; Mostofsky, Stewart H; Denckla, Martha B; DeLeon, Iser G

2017-10-01

One of the key diagnostic criteria for autism spectrum disorder includes impairments in social interactions. This study compared the extent to which boys with high-functioning autism and typically developing boys "value" engaging in activities with a parent or alone. Two different assessments that can empirically determine the relative reinforcing value of social and non-social stimuli were employed: paired-choice preference assessments and progressive-ratio schedules. There were no significant differences between boys with high-functioning autism and typically developing boys on either measure. Moreover, there was a strong correspondence in performance across these two measures for participants in each group. These results suggest that the relative reinforcing value of engaging in activities with a primary caregiver is not diminished for children with autism spectrum disorder.

Effects of endodontic post surface treatment, dentin conditioning, and artificial aging on the retention of glass fiber-reinforced composite resin posts.

PubMed

Albashaireh, Zakereyya S; Ghazal, Muhamad; Kern, Matthias

2010-01-01

Several post surface treatments with or without the application of a bonding agent have been recommended to improve the bond strength of resin cements to posts. A regimen that produces the maximum bond strength of glass fiber-reinforced composite resin posts has not been verified. The purpose of this study was to evaluate the influence of post surface conditioning methods and artificial aging on the retention and microleakage of adhesively luted glass fiber-reinforced composite resin posts. Seventy-two endodontically treated single-rooted teeth were prepared for glass fiber-reinforced composite resin posts. The posts were submitted to 3 different surface treatments (n=24), including no treatment, etching with phosphoric acid, and airborne-particle abrasion. Subgroups of the posts (n=8) were then allocated for 3 different experimental conditions: no artificial aging, no bonding agent; no artificial aging, bonding agent; or artificial aging, bonding agent. The posts were luted with resin cement (Calibra). Post retention was measured in tension at a crosshead speed of 2 mm/min. The posts assigned for microleakage investigation were placed in fuchsin dye for 72 hours. The dislodged posts and the post spaces were examined microscopically to evaluate the mode of failure and explore the microleakage. Data were analyzed by 2-way ANOVA followed by Tukey HSD test (alpha=.05). The mean (SD) retention values for test groups ranged from 269 (63.8) to 349 (52.2) N. The retention values of the airborne-particle-abrasion group were significantly higher than those of the acidic-treatment and no-treatment groups. The application of bonding agent on the post surface produced no significant influence on retention. The mean retention values after artificial aging were significantly higher than without artificial aging. Microscopic evaluation demonstrated that the failure mode was primarily mixed. Treating the surface of the posts with phosphoric acid for 15 seconds before cementation

Novel reinforcement learning paradigm based on response patterning under interval schedules of reinforcement.

PubMed

Schifani, Christin; Sukhanov, Ilya; Dorofeikova, Mariia; Bespalov, Anton

2017-07-28

There is a need to develop cognitive tasks that address valid neuropsychological constructs implicated in disease mechanisms and can be used in animals and humans to guide novel drug discovery. Present experiments aimed to characterize a novel reinforcement learning task based on a classical operant behavioral phenomenon observed in multiple species - differences in response patterning under variable (VI) vs fixed interval (FI) schedules of reinforcement. Wistar rats were trained to press a lever for food under VI30s and later weekly test sessions were introduced with reinforcement schedule switched to FI30s. During the FI30s test session, post-reinforcement pauses (PRPs) gradually grew towards the end of the session reaching 22-43% of the initial values. Animals could be retrained under VI30s conditions, and FI30s test sessions were repeated over a period of several months without appreciable signs of a practice effect. Administration of the non-competitive N-methyl-d-aspartate (NMDA) receptor antagonist MK-801 ((5S,10R)-(+)-5-Methyl-10,11-dihydro-5H-dibenzo[a,d]cyclohepten-5,10-imine maleate) prior to FI30s sessions prevented adjustment of PRPs associated with the change from VI to FI schedule. This effect was most pronounced at the highest tested dose of MK-801 and appeared to be independent of the effects of this dose on response rates. These results provide initial evidence for the possibility to use different response patterning under VI and FI schedules with equivalent reinforcement density for studying effects of drug treatment on reinforcement learning. Copyright © 2017 Elsevier B.V. All rights reserved.

Noncontingent reinforcement, alternative reinforcement, and the matching law: a laboratory demonstration.

PubMed Central

Ecott, Cheryl L; Critchfield, Thomas S

2004-01-01

Basic researchers, but not most applied researchers, have assumed that the behavior-decelerating effects of noncontingent reinforcement result at least partly from adventitious reinforcement of competing behaviors. The literature contains only sketchy evidence of these effects because few noncontingent reinforcement studies measure alternative behaviors. A laboratory model is presented in which concurrent schedules of contingent reinforcement were used to establish a "target" and an "alternative" behavior. Imposing noncontingent reinforcement decreased target behavior rates and increased alternative behavior rates, outcomes that were well described by the standard quantitative account of alternative reinforcement, the generalized matching law. These results suggest that adventitious reinforcement of alternative behaviors can occur during noncontingent reinforcement interventions, although the range of conditions under which this occurs remains to be determined in future studies. As an adjunct to applied studies, laboratory models permit easy measurement of alternative behaviors and parametric manipulations needed to answer many research questions. PMID:15529885

The relative reinforcing value of sweet versus savory snack foods after consumption of sugar- or non-nutritive sweetened beverages.

PubMed

Casperson, Shanon L; Johnson, LuAnn; Roemmich, James N

2017-05-01

The effects of sugar-sweetened (SSB) and non-nutritive sweetened (NSB) beverages on the regulation of appetite, energy intake and body weight regulation remain controversial. Using a behavioral choice paradigm, we sought to determine the effects of consuming a SSB or NSB on appetite and the reinforcing value of sweet relative to salty/savory snack foods. In a randomized crossover study, 21 healthy weight adults consumed 360 ml of SSB (sucrose; 31 g) or NSB (sucralose; 4 g) with a standardized meal. Hedonic ratings for the sweet and salty/savory snack foods used for the reinforcement task were assessed prior to the start of the study. Satiety and the desire to eat foods with a specific taste profile were assessed before and every 30 min post-meal for 4 h. The relative reinforcing value of the snack foods was assessed using a computer-based choice task (operant responding with concurrent schedules of reinforcement) 4 h post-meal. Hedonic ratings did not differ between the most highly liked sweet and salty/savory snack foods. Beverage type did not influence measures of satiety or the desire to eat foods with a specific taste. However, sweet snacks were more (p < 0.05) reinforcing relative to salty/savory snack foods after consuming a NSB than after a SSB. In conclusion, this is the first study to demonstrate that NSB can increase the motivation to gain access to sweet snacks relative to salty/savory snack foods later in the day. Published by Elsevier Ltd.

Increasing discomfort tolerance predicts incentive senitization of exercise reinforcement: Preliminary results from a randomized controlled intervention to increase the reinforcing value of exercise in overweight to obese adu

USDA-ARS?s Scientific Manuscript database

Objective: The reinforcing (motivating) value of exercise/physical activity (RRVex) predicts usual exercise behavior and meeting of physical activity guidelines. Recent cross-sectional evidence suggests, for the first time, that greater tolerance for the discomfort experienced during exercise is ass...

Acquisition with partial and continuous reinforcement in pigeon autoshaping.

PubMed

Gottlieb, Daniel A

2004-08-01

Contemporary time accumulation models make the unique prediction that acquisition of a conditioned response will be equally rapid with partial and continuous reinforcement, if the time between conditioned stimuli is held constant. To investigate this, acquisition of conditioned responding was examined in pigeon autoshaping under conditions of 100% and 25% reinforcement, holding intertrial interval constant. Contrary to what was predicted, evidence for slowed acquisition in partially reinforced animals was observed with several response measures. However, asymptotic performance was superior with 25% reinforcement. A switching of reinforcement contingencies after initial acquisition did not immediately affect responding. After further sessions, partial reinforcement augmented responding, whereas continuous reinforcement did not, irrespective of an animal's reinforcement history. Subsequent training with a novel stimulus maintained the response patterns. These acquisition results generally support associative, rather than time accumulation, accounts of conditioning.

Human self-control and the density of reinforcement

PubMed Central

Flora, Stephen R.; Pavlik, William B.

1992-01-01

Choice responding in adult humans on a discrete-trial button-pressing task was examined as a function of amount, delay, and overall density (points per unit time) of reinforcement. Reinforcement consisted of points that were exchangeable for money. In T 0 conditions, an impulsive response produced 4 points immediately and a self-control response produced 10 points after a delay of 15 s. In T 15 conditions, a constant delay of 15 s was added to both prereinforcer delays. Postreinforcer delays, which consisted of 15 s added to the end of each impulsive trial, equated trial durations regardless of choice, and was manipulated in both T 0 and T 15 conditions. In all conditions, choice was predicted directly from the relative reinforcement densities of the alternatives. Self-control was observed in all conditions except T 0 without postreinforcer delays, where the impulsive choices produced the higher reinforcement density. These results support previous studies showing that choice is a direct function of the relative reinforcement densities when conditioned (point) reinforcers are used. In contrast, where responding produces intrinsic (immediately consumable) reinforcers, immediacy of reinforcement appears to account for preference when density does not. PMID:16812652

MODELING THE EFFECTS OF SENSORY REINFORCERS ON BEHAVIORAL PERSISTENCE WITH ALTERNATIVE REINFORCEMENT

PubMed Central

Sweeney, Mary M.; Moore, Keira; Shahan, Timothy A.; Ahearn, William H.; Dube, William V.; Nevin, John A.

2014-01-01

Problem behavior often has sensory consequences that cannot be separated from the target response, even if external, social reinforcers are removed during treatment. Because sensory reinforcers that accompany socially mediated problem behavior may contribute to persistence and relapse, research must develop analog sensory reinforcers that can be experimentally manipulated. In this research, we devised analogs to sensory reinforcers in order to control for their presence and determine how sensory reinforcers may impact treatment efficacy. Experiments 1 and 2 compared the efficacy of differential reinforcement of alternative behavior (DRA) versus noncontingent reinforcement (NCR) with and without analog sensory reinforcers in a multiple schedule. Experiment 1 measured the persistence of key pecking in pigeons, whereas Experiment 2 measured the persistence of touchscreen responses in children with intellectual and developmental disabilities. Across both experiments, the presence of analog sensory reinforcers increased the levels, persistence, and variability of responding relative to when analog sensory reinforcers were absent. Also in both experiments, target responding was less persistent under conditions of DRA compared to NCR regardless of the presence or absence of analog sensory reinforcers. PMID:25130416

The Effects of Conditioned Reinforcement for Reading on Reading Comprehension for 5th Graders

ERIC Educational Resources Information Center

Cumiskey Moore, Colleen

2017-01-01

In three experiments, I tested the effects of the conditioned reinforcement for reading (R+Reading) on reading comprehension with 5th graders. In Experiment 1, I conducted a series of statistical analyses with data from 18 participants for one year. I administered 4 pre/post measurements for reading repertoires which included: 1) state-wide…

Numerical Simulations of As-Extruded Mg Matrix Composites Interpenetrated by Metal Reinforcement

NASA Astrophysics Data System (ADS)

Y Wang, H.; Wang, S. R.; Yang, X. F.; Li, P.

2017-12-01

The interpenetrating magnesium composites reinforced by three-dimensional braided stainless steel wire reinforcement were fabricated and investigated. The extrusion processes of the composites in different conditions were carried out and simulated by finite element method using the DEFORM-3D software. The results show that the matrix and reinforcement of the composites form a good interfacial bonding and the grains were refined by extrusion and the influence of reinforcement, which are in accordance with the enhanced strength and degraded plasticity. The combined quality between the matrix and reinforcement can be strengthened in extrusion chamber where occurred large strain and suffered intense stress, and the effective stress of the material increases continuously with the increase in extrusion ratio and the decrease in extrusion speed until it reaches a stable value.

Responding for sucrose and wheel-running reinforcement: effects of sucrose concentration and wheel-running reinforcer duration.

PubMed

Belke, Terry W; Hancock, Stephanie D

2003-03-01

Six male albino rats were placed in running wheels and exposed to a fixed-interval 30-s schedule of lever pressing that produced either a drop of sucrose solution or the opportunity to run for a fixed duration as reinforcers. Each reinforcer type was signaled by a different stimulus. In Experiment 1, the duration of running was held constant at 15 s while the concentration of sucrose solution was varied across values of 0, 2.5. 5, 10, and 15%. As concentration decreased, postreinforcement pause duration increased and local rates decreased in the presence of the stimulus signaling sucrose. Consequently, the difference between responding in the presence of stimuli signaling wheel-running and sucrose reinforcers diminished, and at 2.5%, response functions for the two reinforcers were similar. In Experiment 2, the concentration of sucrose solution was held constant at 15% while the duration of the opportunity to run was first varied across values of 15, 45, and 90 s then subsequently across values of 5, 10, and 15 s. As run duration increased, postreinforcement pause duration in the presence of the wheel-running stimulus increased and local rates increased then decreased. In summary, inhibitory aftereffects of previous reinforcers occurred when both sucrose concentration and run duration varied; changes in responding were attributable to changes in the excitatory value of the stimuli signaling the two reinforcers.

Investigation of rectangular concrete columns reinforced or prestressed with fiber reinforced polymer (FRP) bars or tendons

NASA Astrophysics Data System (ADS)

Choo, Ching Chiaw

Fiber reinforced polymer (FRP) composites have been increasingly used in concrete construction. This research focused on the behavior of concrete columns reinforced with FRP bars, or prestressed with FRP tendons. The methodology was based the ultimate strength approach where stress and strain compatibility conditions and material constitutive laws were applied. Axial strength-moment (P-M) interaction relations of reinforced or prestressed concrete columns with FRP, a linearly-elastic material, were examined. The analytical results identified the possibility of premature compression and/or brittle-tension failure occurring in FRP reinforced and prestressed concrete columns where sudden and explosive type failures were expected. These failures were related to the rupture of FRP rebars or tendons in compression and/or in tension prior to concrete reaching its ultimate strain and strength. The study also concluded that brittle-tension failure was more likely to occur due to the low ultimate tensile strain of FRP bars or tendons as compared to steel. In addition, the failures were more prevalent when long term effects such as creep and shrinkage of concrete, and creep rupture of FRP were considered. Barring FRP failure, concrete columns reinforced with FRP, in some instances, gained significant moment resistance. As expected the strength interaction of slender steel or FRP reinforced concrete columns were dependent more on column length rather than material differences between steel and FRP. Current ACI minimum reinforcement ratio for steel (rhomin) reinforced concrete columns may not be adequate for use in FRP reinforced concrete columns. Design aids were developed in this study to determine the minimum reinforcement ratio (rhof,min) required for rectangular reinforced concrete columns by averting brittle-tension failure to a failure controlled by concrete crushing which in nature was a less catastrophic and more gradual type failure. The proposed method using rhof

Changes in the activity of a CpG neuron after the reinforcement of an operantly conditioned behavior in Lymnaea.

PubMed

Spencer, Gaynor E; Kazmi, Mustapha H; Syed, Naweed I; Lukowiak, Ken

2002-10-01

We have previously shown that the aerial respiratory behavior of the mollusk Lymnaea stagnalis can be operantly conditioned, and the central pattern generating (CPG) neurons underlying this behavior have been identified. As neural correlates of operant conditioning remain poorly defined in both vertebrates and invertebrates, we have used the Lymnaea respiratory CPG to investigate neuronal changes associated with the change in behavior after conditioning. After operant conditioning of the intact animals, semi-intact preparations were dissected, so that changes in the respiratory behavior (pneumostome openings) and underlying activity of the identified CPG neuron, right pedal dorsal 1 (RPeD1), could be monitored simultaneously. RPeD1 was studied because it initiates the rhythmic activity of the CPG and receives chemo-sensory input from the pneumostome area. Pneumostome openings and RPeD1 activity were monitored both before and after a reinforcing training stimulus applied to the open pneumostome of operantly conditioned and yoked control preparations. After presentation of the reinforcing stimulus, there was a significant reduction in both breathing behavior and RPeD1 activity in operant preparations but not in yoked and naïve controls. Furthermore these changes were only significant in the subgroup of operantly conditioned animals described as good learners and not in poor learners. These data strongly suggest that changes in RPeD1 activity may underlie the behavioral changes associated with the reinforcement of operant conditioning of the respiratory behavior.

Concurrent progressive ratio schedules: Effects of reinforcer probability on breakpoint and response allocation.

PubMed

Jarmolowicz, David P; Sofis, Michael J; Darden, Alexandria C

2016-07-01

Although progressive ratio (PR) schedules have been used to explore effects of a range of reinforcer parameters (e.g., magnitude, delay), effects of reinforcer probability remain underexplored. The present project used independently progressing concurrent PR PR schedules to examine effects of reinforcer probability on PR breakpoint (highest completed ratio prior to a session terminating 300s pause) and response allocation. The probability of reinforcement on one lever remained at 100% across all conditions while the probability of reinforcement on the other lever was systematically manipulated (i.e., 100%, 50%, 25%, 12.5%, and a replication of 25%). Breakpoints systematically decreased with decreasing reinforcer probabilities while breakpoints on the control lever remained unchanged. Patterns of switching between the two levers were well described by a choice-by-choice unit price model that accounted for the hyperbolic discounting of the value of probabilistic reinforcers. Copyright © 2016 Elsevier B.V. All rights reserved.

HUMAN RESPONDING ON RANDOM-INTERVAL SCHEDULES OF RESPONSE-COST PUNISHMENT: THE ROLE OF REDUCED REINFORCEMENT DENSITY

PubMed Central

Pietras, Cynthia J; Brandt, Andrew E; Searcy, Gabriel D

2010-01-01

An experiment with adult humans investigated the effects of response-contingent money loss (response-cost punishment) on monetary-reinforced responding. A yoked-control procedure was used to separate the effects on responding of the response-cost contingency from the effects of reduced reinforcement density. Eight adults pressed buttons for money on a three-component multiple reinforcement schedule. During baseline, responding in all components produced money gains according to a random-interval 20-s schedule. During punishment conditions, responding during the punishment component conjointly produced money losses according to a random-interval schedule. The value of the response-cost schedule was manipulated across conditions to systematically evaluate the effects on responding of response-cost frequency. Participants were assigned to one of two yoked-control conditions. For participants in the Yoked Punishment group, during punishment conditions money losses were delivered in the yoked component response independently at the same intervals that money losses were produced in the punishment component. For participants in the Yoked Reinforcement group, responding in the yoked component produced the same net earnings as produced in the punishment component. In 6 of 8 participants, contingent response cost selectively decreased response rates in the punishment component and the magnitude of the decrease was directly related to the punishment schedule value. Under punishment conditions, for participants in the Yoked Punishment group response rates in the yoked component also decreased, but the decrease was less than that observed in the punishment component, whereas for participants in the Yoked Reinforcement group response rates in the yoked component remained similar to rates in the no-punishment component. These results provide further evidence that contingent response cost functions similarly to noxious punishers in that it appears to suppress responding apart from

Nucleus Accumbens Core and Shell Differentially Encode Reward-Associated Cues after Reinforcer Devaluation

PubMed Central

West, Elizabeth A.

2016-01-01

Nucleus accumbens (NAc) neurons encode features of stimulus learning and action selection associated with rewards. The NAc is necessary for using information about expected outcome values to guide behavior after reinforcer devaluation. Evidence suggests that core and shell subregions may play dissociable roles in guiding motivated behavior. Here, we recorded neural activity in the NAc core and shell during training and performance of a reinforcer devaluation task. Long–Evans male rats were trained that presses on a lever under an illuminated cue light delivered a flavored sucrose reward. On subsequent test days, each rat was given free access to one of two distinctly flavored foods to consume to satiation and were then immediately tested on the lever pressing task under extinction conditions. Rats decreased pressing on the test day when the reinforcer earned during training was the sated flavor (devalued) compared with the test day when the reinforcer was not the sated flavor (nondevalued), demonstrating evidence of outcome-selective devaluation. Cue-selective encoding during training by NAc core (but not shell) neurons reliably predicted subsequent behavioral performance; that is, the greater the percentage of neurons that responded to the cue, the better the rats suppressed responding after devaluation. In contrast, NAc shell (but not core) neurons significantly decreased cue-selective encoding in the devalued condition compared with the nondevalued condition. These data reveal that NAc core and shell neurons encode information differentially about outcome-specific cues after reinforcer devaluation that are related to behavioral performance and outcome value, respectively. SIGNIFICANCE STATEMENT Many neuropsychiatric disorders are marked by impairments in behavioral flexibility. Although the nucleus accumbens (NAc) is required for behavioral flexibility, it is not known how NAc neurons encode this information. Here, we recorded NAc neurons during a training

Gaze-contingent reinforcement learning reveals incentive value of social signals in young children and adults

PubMed Central

Smith, Tim J.; Senju, Atsushi

2017-01-01

While numerous studies have demonstrated that infants and adults preferentially orient to social stimuli, it remains unclear as to what drives such preferential orienting. It has been suggested that the learned association between social cues and subsequent reward delivery might shape such social orienting. Using a novel, spontaneous indication of reinforcement learning (with the use of a gaze contingent reward-learning task), we investigated whether children and adults' orienting towards social and non-social visual cues can be elicited by the association between participants' visual attention and a rewarding outcome. Critically, we assessed whether the engaging nature of the social cues influences the process of reinforcement learning. Both children and adults learned to orient more often to the visual cues associated with reward delivery, demonstrating that cue–reward association reinforced visual orienting. More importantly, when the reward-predictive cue was social and engaging, both children and adults learned the cue–reward association faster and more efficiently than when the reward-predictive cue was social but non-engaging. These new findings indicate that social engaging cues have a positive incentive value. This could possibly be because they usually coincide with positive outcomes in real life, which could partly drive the development of social orienting. PMID:28250186

Gaze-contingent reinforcement learning reveals incentive value of social signals in young children and adults.

PubMed

Vernetti, Angélina; Smith, Tim J; Senju, Atsushi

2017-03-15

While numerous studies have demonstrated that infants and adults preferentially orient to social stimuli, it remains unclear as to what drives such preferential orienting. It has been suggested that the learned association between social cues and subsequent reward delivery might shape such social orienting. Using a novel, spontaneous indication of reinforcement learning (with the use of a gaze contingent reward-learning task), we investigated whether children and adults' orienting towards social and non-social visual cues can be elicited by the association between participants' visual attention and a rewarding outcome. Critically, we assessed whether the engaging nature of the social cues influences the process of reinforcement learning. Both children and adults learned to orient more often to the visual cues associated with reward delivery, demonstrating that cue-reward association reinforced visual orienting. More importantly, when the reward-predictive cue was social and engaging, both children and adults learned the cue-reward association faster and more efficiently than when the reward-predictive cue was social but non-engaging. These new findings indicate that social engaging cues have a positive incentive value. This could possibly be because they usually coincide with positive outcomes in real life, which could partly drive the development of social orienting. © 2017 The Authors.

Reinforcement value and substitutability of sucrose and wheel running: implications for activity anorexia.

PubMed

Belke, Terry W; Pierce, W David; Duncan, Ian D

2006-09-01

Choice between sucrose and wheel-running reinforcement was assessed in two experiments. In the first experiment, ten male Wistar rats were exposed to concurrent VI 30 s VI 30 s schedules of wheel-running and sucrose reinforcement. Sucrose concentration varied across concentrations of 2.5, 7.5, and 12.5%. As concentration increased, more behavior was allocated to sucrose and more reinforcements were obtained from that alternative. Allocation of behavior to wheel running decreased, but obtained wheel-running reinforcement did not change. Overall, the results suggested that food-deprived rats were sensitive to qualitative changes in food supply (sucrose concentration) while continuing to defend a level of physical activity (wheel running). In the second study, 15 female Long Evans rats were exposed to concurrent variable ratio schedules of sucrose and wheel-running, wheel-running and wheel-running, and sucrose and sucrose reinforcement. For each pair of reinforcers, substitutability was assessed by the effect of income-compensated price changes on consumption of the two reinforcers. Results showed that, as expected, sucrose substituted for sucrose and wheel running substituted for wheel running. Wheel running, however, did not substitute for sucrose; but sucrose partially substituted for wheel running. We address the implications of the interrelationships of sucrose and wheel running for an understanding of activity anorexia.

Relationship between Food Habituation and Reinforcing Efficacy of Food

ERIC Educational Resources Information Center

Carr, Katelyn A.; Epstein, Leonard H.

2011-01-01

Reinforcing value and habituation are two processes that have been used to study eating behaviors, but no research has examined their relationship, how they relate to energy intake, and whether they respond in a similar manner to food deprivation. Twenty-two female subjects were randomized to food deprived or non-deprived conditions, and assessed…

Effect of sucrose availability and pre-running on the intrinsic value of wheel running as an operant and a reinforcing consequence.

PubMed

Belke, Terry W; Pierce, W David

2014-03-01

The current study investigated the effect of motivational manipulations on operant wheel running for sucrose reinforcement and on wheel running as a behavioral consequence for lever pressing, within the same experimental context. Specifically, rats responded on a two-component multiple schedule of reinforcement in which lever pressing produced the opportunity to run in a wheel in one component of the schedule (reinforcer component) and wheel running produced the opportunity to consume sucrose solution in the other component (operant component). Motivational manipulations involved removal of sucrose contingent on wheel running and providing 1h of pre-session wheel running. Results showed that, in opposition to a response strengthening view, sucrose did not maintain operant wheel running. The motivational operations of withdrawing sucrose or providing pre-session wheel running, however, resulted in different wheel-running rates in the operant and reinforcer components of the multiple schedule; this rate discrepancy revealed the extrinsic reinforcing effects of sucrose on operant wheel running, but also indicated the intrinsic reinforcement value of wheel running across components. Differences in wheel-running rates between components were discussed in terms of arousal, undermining of intrinsic motivation, and behavioral contrast. Copyright © 2013 Elsevier B.V. All rights reserved.

Impaired Behavior Regulation under Conditions of Concurrent Variable Schedules of Reinforcement in Children with ADHD

ERIC Educational Resources Information Center

Taylor, David; Lincoln, Alan J.; Foster, Sharon L.

2010-01-01

Objective: To bridge theory of response inhibition and learning in children with ADHD. Method: Thirty ADHD and 30 non-ADHD children (ages 9-12) were compared under concurrent variable interval (VI-15 sec., VI-30 sec. and VI- 45 sec.) reinforcement schedules that required the child to switch between the three schedules under conditions of…

The Effects of Value Confrontation and Reinforcement Counseling on the Career Planning Attitudes and Behavior of Adolescent Males.

ERIC Educational Resources Information Center

Young, Richard A.

1979-01-01

Post-tests show that the value confrontation procedure resulted in significantly greater frequency of information seeking for internally controlled subjects when compared to the reinforcement counseling and control procedures. Examines two procedures designed to enhance the career planning attitudes and behavior of rural adolescent males.…

Reinforcement Value and Substitutability of Sucrose and Wheel Running: Implications for Activity Anorexia

PubMed Central

Belke, Terry W; Duncan, Ian D; David Pierce, W

2006-01-01

Choice between sucrose and wheel-running reinforcement was assessed in two experiments. In the first experiment, ten male Wistar rats were exposed to concurrent VI 30 s VI 30 s schedules of wheel-running and sucrose reinforcement. Sucrose concentration varied across concentrations of 2.5, 7.5, and 12.5%. As concentration increased, more behavior was allocated to sucrose and more reinforcements were obtained from that alternative. Allocation of behavior to wheel running decreased, but obtained wheel-running reinforcement did not change. Overall, the results suggested that food-deprived rats were sensitive to qualitative changes in food supply (sucrose concentration) while continuing to defend a level of physical activity (wheel running). In the second study, 15 female Long Evans rats were exposed to concurrent variable ratio schedules of sucrose and wheel-running, wheel-running and wheel-running, and sucrose and sucrose reinforcement. For each pair of reinforcers, substitutability was assessed by the effect of income-compensated price changes on consumption of the two reinforcers. Results showed that, as expected, sucrose substituted for sucrose and wheel running substituted for wheel running. Wheel running, however, did not substitute for sucrose; but sucrose partially substituted for wheel running. We address the implications of the interrelationships of sucrose and wheel running for an understanding of activity anorexia. PMID:17002224

Evaluation of Absolute and Relative Reinforcer Value Using Progressive-Ratio Schedules

PubMed Central

Francisco, Monica T; Borrero, John C; Sy, Jolene R

2008-01-01

We evaluated behavior exhibited by individuals with developmental disabilities using progressive-ratio (PR) schedules. High- and low-preference stimuli were determined based on the results of a paired-stimulus preference assessment and were evaluated in subsequent reinforcer and PR assessments using concurrent and single schedules of presentation. In Experiment 1, results showed that for 2 of 3 participants, stimuli determined to be low-preference functioned as reinforcers when evaluated independent of high-preference stimuli. Further, the results from Experiment 2 showed that low-preference stimuli also functioned as reinforcers under gradually increasing PR requirements. Results suggest that for cases in which a high-preference stimulus is unavailable or impractical, the contingent delivery of relatively less preferred stimuli may maintain appropriate behavior, even as schedule requirements increase. PMID:18595283

Examining the reinforcing value of stimuli within social and non-social contexts in children with and without high-functioning autism

PubMed Central

Goldberg, Melissa C; Allman, Melissa J; Hagopian, Louis P; Triggs, Mandy M; Frank-Crawford, Michelle A; Mostofsky, Stewart H; Denckla, Martha B; DeLeon, Iser G

2018-01-01

One of the key diagnostic criteria for autism spectrum disorder includes impairments in social interactions. This study compared the extent to which boys with high-functioning autism and typically developing boys “value” engaging in activities with a parent or alone. Two different assessments that can empirically determine the relative reinforcing value of social and non-social stimuli were employed: paired-choice preference assessments and progressive-ratio schedules. There were no significant differences between boys with high-functioning autism and typically developing boys on either measure. Moreover, there was a strong correspondence in performance across these two measures for participants in each group. These results suggest that the relative reinforcing value of engaging in activities with a primary caregiver is not diminished for children with autism spectrum disorder. PMID:27368350

The Corrosion Characteristics and Tensile Behavior of Reinforcement under Coupled Carbonation and Static Loading

PubMed Central

Xu, Yidong

2015-01-01

This paper describes the non-uniform corrosion characteristics and mechanical properties of reinforcement under coupled action of carbonation and static loading. The two parameters, namely area-box (AB) value and arithmetical mean deviation (Ra), are adopted to characterize the corrosion morphology and pitting distribution from experimental observations. The results show that the static loading affects the corrosion characteristics of reinforcement. Local stress concentration in corroded reinforcement caused by tensile stress drives the corrosion pit pattern to be more irregular. The orthogonal test results from finite element simulations show that pit shape and pit depth are the two significant factors affecting the tensile behavior of reinforcement. Under the condition of similar corrosion mass loss ratio, the maximum plastic strain of corroded reinforcement increases with the increase of Ra and load time-history significantly. PMID:28793729

Acoustic emission energy b-value for local damage evaluation in reinforced concrete structures subjected to seismic loadings

NASA Astrophysics Data System (ADS)

Sagasta, Francisco; Zitto, Miguel E.; Piotrkowski, Rosa; Benavent-Climent, Amadeo; Suarez, Elisabet; Gallego, Antolino

2018-03-01

A modification of the original b-value (Gutenberg-Richter parameter) is proposed to evaluate local damage of reinforced concrete structures subjected to dynamical loads via the acoustic emission (AE) method. The modification, shortly called energy b-value, is based on the use of the true energy of the AE signals instead of its peak amplitude, traditionally used for the calculation of b-value. The proposal is physically supported by the strong correlation between the plastic strain energy dissipated by the specimen and the true energy of the AE signals released during its deformation and cracking process, previously demonstrated by the authors in several publications. AE data analysis consisted in the use of guard sensors and the Continuous Wavelet Transform in order to separate primary and secondary emissions as much as possible according to particular frequency bands. The approach has been experimentally applied to the AE signals coming from a scaled reinforced concrete frame structure, which was subjected to sequential seismic loads of incremental acceleration peak by means of a 3 × 3 m2 shaking table. For this specimen two beam-column connections-one exterior and one interior-were instrumented with wide band low frequency sensors properly attached on the structure. Evolution of the energy b-value along the loading process accompanies the evolution of the severe damage at the critical regions of the structure (beam-column connections), thus making promising its use for structural health monitoring purposes.

Effect of a Surprising Downward Shift in Reinforcer Value on Stimulus Over-Selectivity in a Simultaneous Discrimination Procedure

ERIC Educational Resources Information Center

Reynolds, Gemma; Reed, Phil

2013-01-01

Stimulus over-selectivity refers to the phenomenon whereby behavior is controlled by a subset of elements in the environment at the expense of other equally salient aspects of the environment. The experiments explored whether this cue interference effect was reduced following a surprising downward shift in reinforcer value. Experiment 1 revealed…

Striatum-dependent habits are insensitive to both increases and decreases in reinforcer value in mice.

PubMed

Quinn, Jennifer J; Pittenger, Christopher; Lee, Anni S; Pierson, Jamie L; Taylor, Jane R

2013-03-01

The mouse has emerged as an advantageous species for studying the brain circuitry that underlies complex behavior and for modeling neuropsychiatric disease. The transition from flexible, goal-directed actions to inflexible, habitual responses is argued to be a valid and reliable behavioral model for studying a core aspect of corticostriatal systems that is implicated in certain forms of psychopathology. This transition is thought to correspond to a progression of behavioral control from associative to sensorimotor corticobasal ganglia networks. Habits form following extensive training and are characterized by reduced sensitivity of instrumental responding to reinforcer revaluation; few studies have examined this form of behavioral control in mice. Here we examined the involvement of the dorsolateral and dorsomedial striatum in this transition in the C57BL/6 inbred mouse strain. We provided evidence that damage to the dorsolateral striatum disrupted habitual responding, i.e. it preserved sensitivity to changes in outcome value following either outcome devaluation or, shown for the first time in mice, outcome inflation. Together, these data show that instrumental responding in lesioned mice tracks the current value of a reinforcer and provide evidence that neuroanatomical mechanisms underlying habit learning in rats are preserved in the mouse. This will allow for the genetic and molecular dissection of neural factors involved in decision-making and mechanisms of aberrant habit formation. © 2013 Federation of European Neuroscience Societies and Blackwell Publishing Ltd.

Striatum-dependent habits are insensitive to both increases and decreases in reinforcer value in mice

PubMed Central

Quinn, Jennifer J.; Pittenger, Christopher; Lee, Anni S.; Pierson, Jamie L.; Taylor, Jane R.

2012-01-01

The mouse has emerged as an advantageous species for studying the brain circuitry that underlies complex behavior and for modeling neuropsychiatric disease. The transition from flexible, goal-directed actions to inflexible, habitual responses is argued to be a valid and reliable behavioral model for studying a core aspect of corticostriatal systems that is implicated in certain forms of psychopathology. This transition is thought to correspond to a progression of behavioral control from associative to sensorimotor cortico-basal ganglia networks. Habits form following extensive training and are characterized by reduced sensitivity of instrumental responding to reinforcer revaluation; few studies have examined this form of behavioral control in mice. Here we examine the involvement of the dorsolateral and dorsomedial striatum in this transition in the C57BL/6 inbred mouse strain. We provide evidence that damage to the dorsolateral striatum disrupts habitual responding – that is, it preserves sensitivity to changes in outcome value following either outcome devaluation or, for the first time in mice, outcome inflation. Together, these data show that instrumental responding in lesioned mice tracks the current value of a reinforcer and provide evidence that neuroanatomical mechanisms underlying habit learning in rats are preserved in mouse. This will allow for genetic and molecular dissection of neural factors involved in decision-making and mechanisms of aberrant habit formation. PMID:23298231

Examining the Discriminative and Strengthening Effects of Reinforcers in Concurrent Schedules

PubMed Central

Boutros, Nathalie; Elliffe, Douglas; Davison, Michael

2011-01-01

Reinforcers may increase operant responding via a response-strengthening mechanism whereby the probability of the preceding response increases, or via some discriminative process whereby the response more likely to provide subsequent reinforcement becomes, itself, more likely. We tested these two accounts. Six pigeons responded for food reinforcers in a two-alternative switching-key concurrent schedule. Within a session, equal numbers of reinforcers were arranged for responses to each alternative. Those reinforcers strictly alternated between the two alternatives in half the conditions, and were randomly allocated to the alternatives in half the conditions. We also varied, across conditions, the alternative that became available immediately after a reinforcer. Preference after a single reinforcer always favored the immediately available alternative, regardless of the local probability of a reinforcer on that alternative (0 or 1 in the strictly alternating conditions, .5 in the random conditions). Choice then reflected the local reinforcer probabilities, suggesting some discriminative properties of reinforcement. At a more extended level, successive same-alternative reinforcers from an alternative systematically shifted preference towards that alternative, regardless of which alternative was available immediately after a reinforcer. There was no similar shift when successive reinforcers came from alternating sources. These more temporally extended results may suggest a strengthening function of reinforcement, or an enhanced ability to respond appropriately to “win–stay” contingencies over “win–shift” contingencies. PMID:21909166

A multiscale model for reinforced concrete with macroscopic variation of reinforcement slip

NASA Astrophysics Data System (ADS)

Sciegaj, Adam; Larsson, Fredrik; Lundgren, Karin; Nilenius, Filip; Runesson, Kenneth

2018-06-01

A single-scale model for reinforced concrete, comprising the plain concrete continuum, reinforcement bars and the bond between them, is used as a basis for deriving a two-scale model. The large-scale problem, representing the "effective" reinforced concrete solid, is enriched by an effective reinforcement slip variable. The subscale problem on a Representative Volume Element (RVE) is defined by Dirichlet boundary conditions. The response of the RVEs of different sizes was investigated by means of pull-out tests. The resulting two-scale formulation was used in an FE^2 analysis of a deep beam. Load-deflection relations, crack widths, and strain fields were compared to those obtained from a single-scale analysis. Incorporating the independent macroscopic reinforcement slip variable resulted in a more pronounced localisation of the effective strain field. This produced a more accurate estimation of the crack widths than the two-scale formulation neglecting the effective reinforcement slip variable.

Impact resistance of composite fan blades. [fiber reinforced graphite and boron epoxy blades for STOL operating conditions

NASA Technical Reports Server (NTRS)

Premont, E. J.; Stubenrauch, K. R.

1973-01-01

The resistance of current-design Pratt and Whitney Aircraft low aspect ratio advanced fiber reinforced epoxy matrix composite fan blades to foreign object damage (FOD) at STOL operating conditions was investigated. Five graphite/epoxy and five boron/epoxy wide chord fan blades with nickel plated stainless steel leading edge sheath protection were fabricated and impact tested. The fan blades were individually tested in a vacuum whirlpit under FOD environments. The FOD environments were typical of those encountered in service operations. The impact objects were ice balls, gravel, stralings and gelatin simulated birds. Results of the damage sustained from each FOD impact are presented for both the graphite boron reinforced blades. Tests showed that the present design composite fan blades, with wrap around leading edge protection have inadequate FOD impact resistance at 244 m/sec (800 ft/sec) tip speed, a possible STOL operating condition.

Pigeons' demand and preference for specific and generalized conditioned reinforcers in a token economy.

PubMed

Tan, Lavinia; Hackenberg, Timothy D

2015-11-01

Pigeons' demand and preference for specific and generalized tokens was examined in a token economy. Pigeons could produce and exchange different colored tokens for food, for water, or for food or water. Token production was measured across three phases, which examined: (1) across-session price increases (typical demand curve method); (2) within-session price increases (progressive-ratio, PR, schedule); and (3) concurrent pairwise choices between the token types. Exponential demand curves were fitted to the response data and accounted for over 90% total variance. Demand curve parameter values, Pmax , Omax and α showed that demand was ordered in the following way: food tokens, generalized tokens, water tokens, both in Phase 1 and in Phase 3. This suggests that the preferences were predictable on the basis of elasticity and response output from the demand analysis. Pmax and Omax values failed to consistently predict breakpoints and peak response rates in the PR schedules in Phase 2, however, suggesting limits on a unitary conception of reinforcer efficacy. The patterns of generalized token production and exchange in Phase 3 suggest that the generalized tokens served as substitutes for the specific food and water tokens. Taken together, the present findings demonstrate the utility of behavioral economic concepts in the analysis of generalized reinforcement. © Society for the Experimental Analysis of Behavior.

Strength Calculation of Inclined Sections of Reinforced Concrete Elements under Transverse Bending

NASA Astrophysics Data System (ADS)

Filatov, V. B.

2017-11-01

The authors propose a design model to determine the strength of inclined sections of bent reinforced concrete elements without shear reinforcement for the action of transverse force taking into account the aggregate interlock forces in the inclined crack. The calculated dependences to find out the components of forces acting in an inclined section are presented. The calculated dependences are obtained from the consideration of equilibrium conditions of the block over the inclined crack. A comparative analysis of the experimental values of the failure loads of the inclined section and the theoretical values obtained for the proposed dependencies and normative calculation methods is performed. It is shown that the proposed design model makes it possible to take into account the effect the longitudinal reinforcement percentage has on the inclined section strength, the element cross section height without the introduction of empirical coefficients which contributes to an increase in the structural safety of design solutions including the safety of high-strength concrete elements.

Generating Variable and Random Schedules of Reinforcement Using Microsoft Excel Macros

PubMed Central

Bancroft, Stacie L; Bourret, Jason C

2008-01-01

Variable reinforcement schedules are used to arrange the availability of reinforcement following varying response ratios or intervals of time. Random reinforcement schedules are subtypes of variable reinforcement schedules that can be used to arrange the availability of reinforcement at a constant probability across number of responses or time. Generating schedule values for variable and random reinforcement schedules can be difficult. The present article describes the steps necessary to write macros in Microsoft Excel that will generate variable-ratio, variable-interval, variable-time, random-ratio, random-interval, and random-time reinforcement schedule values. PMID:18595286

Generating variable and random schedules of reinforcement using Microsoft Excel macros.

PubMed

Bancroft, Stacie L; Bourret, Jason C

2008-01-01

Variable reinforcement schedules are used to arrange the availability of reinforcement following varying response ratios or intervals of time. Random reinforcement schedules are subtypes of variable reinforcement schedules that can be used to arrange the availability of reinforcement at a constant probability across number of responses or time. Generating schedule values for variable and random reinforcement schedules can be difficult. The present article describes the steps necessary to write macros in Microsoft Excel that will generate variable-ratio, variable-interval, variable-time, random-ratio, random-interval, and random-time reinforcement schedule values.

Effects of partial reinforcement and time between reinforced trials on terminal response rate in pigeon autoshaping.

PubMed

Gottlieb, Daniel A

2006-03-01

Partial reinforcement often leads to asymptotically higher rates of responding and number of trials with a response than does continuous reinforcement in pigeon autoshaping. However, comparisons typically involve a partial reinforcement schedule that differs from the continuous reinforcement schedule in both time between reinforced trials and probability of reinforcement. Two experiments examined the relative contributions of these two manipulations to asymptotic response rate. Results suggest that the greater responding previously seen with partial reinforcement is primarily due to differential probability of reinforcement and not differential time between reinforced trials. Further, once established, differences in responding are resistant to a change in stimulus and contingency. Secondary response theories of autoshaped responding (theories that posit additional response-augmenting or response-attenuating mechanisms specific to partial or continuous reinforcement) cannot fully accommodate the current body of data. It is suggested that researchers who study pigeon autoshaping train animals on a common task prior to training them under different conditions.

Effect of location of glass fiber-reinforced composite reinforcement on the flexural properties of a maxillary complete denture in vitro.

PubMed

Takahashi, Yutaka; Yoshida, Kaneyoshi; Shimizu, Hiroshi

2011-07-01

Objective. To evaluate the effect of the location of glass fiber-reinforced composite (FRC) reinforcement on the flexural load at the proportional limit (FL-PL) and the flexural deflection of a maxillary acrylic resin complete denture. Material and methods. Maxillary acrylic resin complete dentures strengthened with and without FRC reinforcement were tested. The polymerized FRC was embedded in the denture base resin in the doughy state and placed (1) under the ridge lap region, (2) in the anterior region, (3) in the middle region or (4) in the anterior and posterior regions. The FL-PL and flexural deflection value at the 100-N loading point of the reinforced maxillary denture specimens were tested. Results. All of the reinforced dentures had a higher FL-PL than the denture without reinforcement but the FL-PL values of all the dentures were not significantly different from each other. The efficiency of the FRC reinforcement compared to the unreinforced denture was 1.54-1.75 times greater. All of the reinforced dentures showed significantly lower deflection compared to the unreinforced denture, but the flexural deflections of all the dentures were not significantly different from each other. Conclusions. The location of the FRC reinforcement did not affect the fracture resistance of the maxillary acrylic resin complete denture. All of the reinforced dentures had higher FL-PL and lower flexural deflection than the denture without reinforcement.

Spatial and temporal relations in conditioned reinforcement and observing behavior

PubMed Central

Bowe, Craig A.; Dinsmoor, James A.

1983-01-01

In Experiment 1, depressing one perch produced stimuli indicating which of two keys, if pecked, could produce food (spatial information) and depressing the other perch produced stimuli indicating whether a variable-interval or an extinction schedule was operating (temporal information). The pigeons increased the time they spent depressing the perch that produced the temporal information but did not increase the time they spent depressing the perch that produced the spatial information. In Experiment 2, pigeons that were allowed to produce combined spatial and temporal information did not acquire the perch pressing any faster or maintain it at a higher level than pigeons allowed to produce only temporal information. Later, when perching produced only spatial information, the time spent depressing the perch eventually declined. The results are not those implied by the statement that information concerning biologically important events is reinforcing but are consistent with an interpretation in terms of the acquisition of reinforcing properties by a stimulus associated with a higher density of primary reinforcement. PMID:16812316

Robust reinforcement learning.

PubMed

Morimoto, Jun; Doya, Kenji

2005-02-01

This letter proposes a new reinforcement learning (RL) paradigm that explicitly takes into account input disturbance as well as modeling errors. The use of environmental models in RL is quite popular for both offline learning using simulations and for online action planning. However, the difference between the model and the real environment can lead to unpredictable, and often unwanted, results. Based on the theory of H(infinity) control, we consider a differential game in which a "disturbing" agent tries to make the worst possible disturbance while a "control" agent tries to make the best control input. The problem is formulated as finding a min-max solution of a value function that takes into account the amount of the reward and the norm of the disturbance. We derive online learning algorithms for estimating the value function and for calculating the worst disturbance and the best control in reference to the value function. We tested the paradigm, which we call robust reinforcement learning (RRL), on the control task of an inverted pendulum. In the linear domain, the policy and the value function learned by online algorithms coincided with those derived analytically by the linear H(infinity) control theory. For a fully nonlinear swing-up task, RRL achieved robust performance with changes in the pendulum weight and friction, while a standard reinforcement learning algorithm could not deal with these changes. We also applied RRL to the cart-pole swing-up task, and a robust swing-up policy was acquired.

Partial reinforcement (acquisition) effects within subjects

PubMed Central

Amsel, Abram; MacKinnon, John R.; Rashotte, Michael E.; Surridge, C. Thomas

1964-01-01

Acquisition performance of 22 rats in a straight alley runway was examined. The animals were subjected to partial reinforcement when the alley was black (B±) and continuous reinforcement when it was white (W+). The results indicated (a) higher terminal performance, for partial as against continuous reinforcement conditions, for starting-time and running-time measures, and (b) lower terminal performance under partial conditions for a goal-entry-time measure. These results confirm within subjects an effect previously demonstrated, in the runway, only in between-groups tests, where one group is run under partial reinforcement and a separate group is run under continuous reinforcement in the presence of the same external stimuli. Differences between the runway situation, employing a discrete-trial procedure and performance measures at three points in the response chain, and the Skinner box situation, used in its free-operant mode with a single performance measure, are discussed in relation to the present findings. PMID:14130088

PARTIAL REINFORCEMENT (ACQUISITION) EFFECTS WITHIN SUBJECTS.

PubMed

AMSEL, A; MACKINNON, J R; RASHOTTE, M E; SURRIDGE, C T

1964-03-01

Acquisition performance of 22 rats in a straight alley runway was examined. The animals were subjected to partial reinforcement when the alley was black (B+/-) and continuous reinforcement when it was white (W+). The results indicated (a) higher terminal performance, for partial as against continuous reinforcement conditions, for starting-time and running-time measures, and (b) lower terminal performance under partial conditions for a goal-entry-time measure. These results confirm within subjects an effect previously demonstrated, in the runway, only in between-groups tests, where one group is run under partial reinforcement and a separate group is run under continuous reinforcement in the presence of the same external stimuli. Differences between the runway situation, employing a discrete-trial procedure and performance measures at three points in the response chain, and the Skinner box situation, used in its free-operant mode with a single performance measure, are discussed in relation to the present findings.

Social reinforcement as alternative to sucrose reinforcement is increased by nicotine and methylphenidate in male Fischer-344 rats.

PubMed

Martin, Connor D; Bool, Heather M; George, Anthony M; Carr, Katelyn A; Epstein, Leonard H; Hawk, Larry W; Richards, Jerry B

2018-04-24

Stimulant drugs such as nicotine (NIC) and methylphenidate (MPH) are hypothesized to increase the reinforcing value of sensory stimuli, thus increasing the effectiveness of such reinforcers as alternatives to sucrose reinforcers. Inbred Fischer-344 rats (n = 30) were assigned to three groups: saline (SAL; n = 10), nicotine (NIC; n = 10), or methylphenidate (MPH; n = 10). Testing was done in three phases: sucrose only, (SUC), sucrose and drug (SUC/DRUG), and sucrose, drug, and social reinforcement (SUC/DRUG/SOC). During the SUC phase, rats were trained on a progressive ratio 5 (PR5) reinforcement schedule for sucrose (20% solution). In the SUC/DRUG phase, animals were treated with SAL, NIC (0.4 mg/kg, n = 10 SC), or MPH (2.0 mg/kg, n = 10 IP) 30 min prior to testing. In the SUC/DRUG/SOC phase, animals continued receiving drug treatment, and social reinforcement was introduced concurrently with the sucrose reinforcer. The progressive ratio for each reinforcer ran independently of the others. Reinforcing value was measured as break point (BP), the highest number of responses resulting in a reinforcer. SAL-treated animals showed no significant change in sucrose BP. MPH-treated animals showed decreased sucrose BP in the SUC/DRUG phase, with a further reduction in the SUC/DRUG/SOC phase. NIC-treated animals decreased sucrose BP only when a social alternative was offered. Both NIC and MPH reduce the sucrose BP in the presence of a social alternative. The decrease in sucrose responding, coupled with increased social responding, suggests that the social alternative acted as an effective alternative reinforcer to sucrose. From a translational perspective, these results suggest that stimulant drugs such as NIC and MPH may increase the effectiveness of treatments that use alternative social reinforcers to decrease eating.

Reinforcement in an in Vitro Analog of Appetitive Classical Conditioning of Feeding Behavior in "Aplysia": Blockade by a Dopamine Antagonist

ERIC Educational Resources Information Center

Reyes, Fredy D.; Mozzachiodi, Riccardo; Baxter, Douglas A.; Byrne, John H.

2005-01-01

In a recently developed in vitro analog of appetitive classical conditioning of feeding in "Aplysia," the unconditioned stimulus (US) was electrical stimulation of the esophageal nerve (En). This nerve is rich in dopamine (DA)-containing processes, which suggests that DA mediates reinforcement during appetitive conditioning. To test this…

Basolateral amygdala lesions and sensitivity to reinforcer magnitude in concurrent chains schedules.

PubMed

Helms, Christa M; Mitchell, Suzanne H

2008-08-22

Previous studies show that the basolateral amygdala (BLA) is required for behavior to adjust when the value of a reinforcer decreases after satiation or pairing with gastric distress. This study evaluated the effect of pre- or post-training excitotoxic lesions of the BLA on changes in preference with another type of contingency change, reinforcer magnitude reversal. Rats were trained to press left and right levers during a variable-interval choice phase for 50 microl or 150 microl sucrose delivered to consistent locations after a 16-s delay. Tones were presented during the first and last 2s of the delay to reinforcement. The tone frequency predicted the magnitude of sucrose reinforcement in baseline conditions. All groups acquired stable preference for the lever on the large (150 microl) reinforcer side. However, nose poking during the delay to large reinforcement was highly accurate (i.e., to the reinforced side) for all groups except the rats with BLA lesions induced before training, suggesting impaired control of behavior by the tone. After the acquisition of stable preference, the locations of the reinforcer magnitudes were unpredictably reversed for a single session. Pre-training lesions blunted changes in preference when the reinforcer magnitudes were reversed. Lesions induced after stable preference was acquired, but prior to reversal, did not disrupt changes in preference. The data suggest that the BLA contributes to the adaptation of choice behavior following changes in reinforcer magnitude. Impaired learning about the tone-reinforcer magnitude relationships may have disrupted discrimination of the reinforcer magnitude reversal.

BASOLATERAL AMYGDALA LESIONS AND SENSITIVITY TO REINFORCER MAGNITUDE IN CONCURRENT CHAINS SCHEDULES

PubMed Central

Helms, Christa M.; Mitchell, Suzanne H.

2008-01-01

Previous studies show that the basolateral amygdala (BLA) is required for behavior to adjust when the value of a reinforcer decreases after satiation or pairing with gastric distress. This study evaluated the effect of pre- or post-training excitotoxic lesions of the BLA on changes in preference with another type of contingency change, reinforcer magnitude reversal. Rats were trained to press left and right levers during a variable-interval choice phase for 50 µl or 150 µl sucrose delivered to consistent locations after a 16-s delay. Tones were presented during the first and last 2 s of the delay to reinforcement. The tone frequency predicted the magnitude of sucrose reinforcement in baseline conditions. All groups acquired stable preference for the lever on the large (150-µl) reinforcer side. However, nose poking during the delay to large reinforcement was highly accurate (i.e., to the reinforced side) for all groups except the rats with BLA lesions induced before training, suggesting impaired control of behavior by the tone. After the acquisition of stable preference, the locations of the reinforcer magnitudes were unpredictably reversed for a single session. Pre-training lesions blunted changes in preference when the reinforcer magnitudes were reversed. Lesions induced after stable preference was acquired, but prior to reversal, did not disrupt changes in preference. The data suggest that the BLA contributes to the adaptation of choice behavior following changes in reinforcer magnitude. Impaired learning about the tone-reinforcer magnitude relationships may have disrupted discrimination of the reinforcer magnitude reversal. PMID:18455812

Prediction of reinforced concrete strength by ultrasonic velocities

NASA Astrophysics Data System (ADS)

Sabbağ, Nevbahar; Uyanık, Osman

2017-06-01

This study was aimed to determine the strength of the reinforced concrete and to reveal the reinforcement effect on the concrete strength by Ultrasonic P and S wave velocities. Studies were conducted with prepared 9 different concrete designs of showing low, medium and high strength features. 4 kinds of cubic samples which unreinforced and including 10, 14 or 20 mm diameter reinforcement were prepared for these designs. Studies were carried out on total 324 samples including 9 samples for each design of these 4 kinds. The prepared samples of these designs were subjected to water curing. On some days of the 90-day period, P and S wave measurements were repeated to reveal the changes in seismic velocities of samples depending on whether reinforced or unreinforced of samples and diameter of reinforcement. Besides, comparisons were done by performing uniaxial compressive strength test with crushing of 3 samples on 7th, 28th and 90th days. As a result of studies and evaluations, it was seen that values of seismic velocities and uniaxial compressive strength increased depending on reinforcement and diameter of reinforcement in low strength concretes. However, while the seismic velocities were not markedly affected from reinforcement or reinforcement diameter in high strength concrete, uniaxial compressive strength values were negatively affected.

Numerical Study on Deflection Behaviour of Concrete Beams Reinforced with GFRP Bars

NASA Astrophysics Data System (ADS)

Mohamed, Osama A.; Khattab, Rania; Hawat, Waddah Al

2017-10-01

Fiber-Reinforced Polymer (FRP) bars are gaining popularity as sustainable alternatives to conventional reinforcing steel bars in reinforced concrete applications. The production of FRP bars has lower environmental impact compared to steel reinforcing bars. In addition, the non-corroding FRP materials can potentially decrease the cost or need for maintenance of reinforced concrete structural elements, especially in harsh environmental conditions that can impact both concrete and reinforcement. FRP bars offer additional favourable properties including high tensile strength and low unit weight. However, the mechanical properties of FRP bars can lead to large crack widths and deflections. The objective of this study is to investigate the deflection behaviour of concrete beams reinforced with Glass FRP (GFRP) bars as a longitudinal main reinforcement. Six concrete beams reinforced with GFRP bars were modelled using the finite element computer program ANSYS. The main variable considered in the study is the reinforcement ratio. The deflection equations in current North American codes including ACI 440.1R-06, ACI 440.1R-15 and CSA S806-12 are used to compute deflections, and these are compared to numerical results. It was concluded in this paper that deflections predicted by ACI 440.1R-06 equations are lower than the numerical analysis results while ACI 440.1R-15 is in agreement with numerical analysis with tendency to be conservative. The values of deflections estimated by CSA S806-12 formulas are consistent with results of numerical analysis.

Mechanical Properties of a Unidirectional Basalt-Fiber-Reinforced Plastic Under a Loading Simulating Operation Conditions

NASA Astrophysics Data System (ADS)

Lobanov, D. S.; Slovikov, S. V.

2017-01-01

The results of experimental investigations of unidirectional composites based on basalt fibers and different marks of epoxy resins are presented. Uniaxial tensile tests were carried out using a specimen fixation technique simulating the operation conditions of structures. The mechanical properties of the basalt-fiber-reinforced plastics (BFRPs) were determined. The diagrams of loading and deformation of BFRP specimens were obtain. The formulations of the composites with the highest mechanical properties were revealed.

Neural Basis of Reinforcement Learning and Decision Making

PubMed Central

Lee, Daeyeol; Seo, Hyojung; Jung, Min Whan

2012-01-01

Reinforcement learning is an adaptive process in which an animal utilizes its previous experience to improve the outcomes of future choices. Computational theories of reinforcement learning play a central role in the newly emerging areas of neuroeconomics and decision neuroscience. In this framework, actions are chosen according to their value functions, which describe how much future reward is expected from each action. Value functions can be adjusted not only through reward and penalty, but also by the animal’s knowledge of its current environment. Studies have revealed that a large proportion of the brain is involved in representing and updating value functions and using them to choose an action. However, how the nature of a behavioral task affects the neural mechanisms of reinforcement learning remains incompletely understood. Future studies should uncover the principles by which different computational elements of reinforcement learning are dynamically coordinated across the entire brain. PMID:22462543

Effects Of Reinforcement History On Response Rate And Response Pattern In Periodic Reinforcement

PubMed Central

López, Florente; Menez, Marina

2005-01-01

Several researchers have suggested that conditioning history may have long-term effects on fixed-interval performances of rats. To test this idea and to identify possible factors involved in temporal control development, groups of rats initially were exposed to different reinforcement schedules: continuous, fixed-time, and random-interval. Afterwards, half of the rats in each group were studied on a fixed-interval 30-s schedule of reinforcement and the other half on a fixed-interval 90-s schedule of reinforcement. No evidence of long-term effects attributable to conditioning history on either response output or response patterning was found; history effects were transitory. Different tendencies in trajectory across sessions were observed for measures of early and late responding within the interreinforcer interval, suggesting that temporal control is the result of two separate processes: one involved in response output and the other in time allocation of responding and not responding. PMID:16047607

Reinforcement Value and Substitutability of Sucrose and Wheel Running: Implications for Activity Anorexia

ERIC Educational Resources Information Center

Belke, Terry W.; Duncan, Ian D.; Pierce, W. David

2006-01-01

Choice between sucrose and wheel-running reinforcement was assessed in two experiments. In the first experiment, ten male Wistar rats were exposed to concurrent VI 30 s VI 30 s schedules of wheel-running and sucrose reinforcement. Sucrose concentration varied across concentrations of 2.5, 7.5, and 12.5%. As concentration increased, more behavior…

Correlation between average frequency and RA value (rise time/amplitude) for crack classification of reinforced concrete beam using acoustic emission technique

NASA Astrophysics Data System (ADS)

Noorsuhada, M. N.; Abdul Hakeem, Z.; Soffian Noor, M. S.; Noor Syafeekha, M. S.; Azmi, I.

2017-12-01

Health monitoring of structures during their service life become a vital thing as it provides crucial information regarding the performance and condition of the structures. Acoustic emission (AE) is one of the non-destructive techniques (NDTs) that could be used to monitor the performance of the structures. Reinforced concrete (RC) beam associated with AE monitoring was monotonically loaded to failure under three-point loading. Correlation between average frequency and RA value (rise time / amplitude) was computed. The relationship was established to classify the crack types that propagated in the RC beam. The crack was classified as tensile crack and shear crack. It was found that the relationship is well matched with the actual crack pattern that appeared on the beam surface. Hence, this relationship is useful for prediction of the crack occurrence in the beam and its performance can be determined.

Sufficient conditions for uniqueness of the weak value

NASA Astrophysics Data System (ADS)

Dressel, J.; Jordan, A. N.

2012-01-01

We review and clarify the sufficient conditions for uniquely defining the generalized weak value as the weak limit of a conditioned average using the contextual values formalism introduced in Dressel, Agarwal and Jordan (2010 Phys. Rev. Lett. 104 240401). We also respond to criticism of our work by Parrott (arXiv:1105.4188v1) concerning a proposed counter-example to the uniqueness of the definition of the generalized weak value. The counter-example does not satisfy our prescription in the case of an underspecified measurement context. We show that when the contextual values formalism is properly applied to this example, a natural interpretation of the measurement emerges and the unique definition in the weak limit holds. We also prove a theorem regarding the uniqueness of the definition under our sufficient conditions for the general case. Finally, a second proposed counter-example by Parrott (arXiv:1105.4188v6) is shown not to satisfy the sufficiency conditions for the provided theorem.

The substitutability of reinforcers.

PubMed

Green, Leonard; Freed, Debra E

1993-07-01

Substitutability is a construct borrowed from microeconomics that describes a continuum of possible interactions among the reinforcers in a given situation. Highly substitutable reinforcers, which occupy one end of the continuum, are readily traded for each other due to their functional similarity. Complementary reinforcers, at the other end of the continuum, tend to be consumed jointly in fairly rigid proportion, and therefore cannot be traded for one another except to achieve that proportion. At the center of the continuum are reinforcers that are independent with respect to each other; consumption of one has no influence on consumption of another. Psychological research and analyses in terms of substitutability employ standard operant conditioning paradigms in which humans and nonhumans choose between alternative reinforcers. The range of reinforcer interactions found in these studies is more readily accommodated and predicted when behavior-analytic models of choice consider issues of substitutability. New insights are gained into such areas as eating and drinking, electrical brain stimulation, temporal separation of choice alternatives, behavior therapy, drug use, and addictions. Moreover, the generalized matching law (Baum, 1974) gains greater explanatory power and comprehensiveness when measures of substitutability are included.

The substitutability of reinforcers

PubMed Central

Green, Leonard; Freed, Debra E.

1993-01-01

Substitutability is a construct borrowed from microeconomics that describes a continuum of possible interactions among the reinforcers in a given situation. Highly substitutable reinforcers, which occupy one end of the continuum, are readily traded for each other due to their functional similarity. Complementary reinforcers, at the other end of the continuum, tend to be consumed jointly in fairly rigid proportion, and therefore cannot be traded for one another except to achieve that proportion. At the center of the continuum are reinforcers that are independent with respect to each other; consumption of one has no influence on consumption of another. Psychological research and analyses in terms of substitutability employ standard operant conditioning paradigms in which humans and nonhumans choose between alternative reinforcers. The range of reinforcer interactions found in these studies is more readily accommodated and predicted when behavior-analytic models of choice consider issues of substitutability. New insights are gained into such areas as eating and drinking, electrical brain stimulation, temporal separation of choice alternatives, behavior therapy, drug use, and addictions. Moreover, the generalized matching law (Baum, 1974) gains greater explanatory power and comprehensiveness when measures of substitutability are included. PMID:16812696

Prediction of strain values in reinforcements and concrete of a RC frame using neural networks

NASA Astrophysics Data System (ADS)

Vafaei, Mohammadreza; Alih, Sophia C.; Shad, Hossein; Falah, Ali; Halim, Nur Hajarul Falahi Abdul

2018-03-01

The level of strain in structural elements is an important indicator for the presence of damage and its intensity. Considering this fact, often structural health monitoring systems employ strain gauges to measure strains in critical elements. However, because of their sensitivity to the magnetic fields, inadequate long-term durability especially in harsh environments, difficulties in installation on existing structures, and maintenance cost, installation of strain gauges is not always possible for all structural components. Therefore, a reliable method that can accurately estimate strain values in critical structural elements is necessary for damage identification. In this study, a full-scale test was conducted on a planar RC frame to investigate the capability of neural networks for predicting the strain values. Two neural networks each of which having a single hidden layer was trained to relate the measured rotations and vertical displacements of the frame to the strain values measured at different locations of the frame. Results of trained neural networks indicated that they accurately estimated the strain values both in reinforcements and concrete. In addition, the trained neural networks were capable of predicting strains for the unseen input data set.

Effect of quinolinic acid-induced lesions of the subthalamic nucleus on performance on a progressive-ratio schedule of reinforcement: A quantitative analysis

PubMed Central

Bezzina, G.; Boon, F.S. den; Hampson, C.L.; Cheung, T.H.C.; Body, S.; Bradshaw, C.M.; Szabadi, E.; Anderson, I.M.; Deakin, J.F.W.

2008-01-01

The subthalamic nucleus (STN), a major relay in the indirect striatofugal pathway, plays an important role in extrapyramidal motor control. Recent evidence indicates that it may also be involved in regulating the incentive value of food reinforcers. Objective To examine the effect of lesions of the STN on performance on a progressive-ratio schedule using a quantitative model that dissociates effects of interventions on motor and motivational processes [Killeen PR. Mathematical principles of reinforcement. Behav Brain Sci 1994;17:105–72]. Rats with bilateral quinolinic acid-induced lesions of the STN (n = 14) or sham lesions (n = 14) were trained to press a lever for food-pellet reinforcers under a progressive-ratio schedule. In Phase 1 (90 sessions) the reinforcer was one pellet; in Phase 2 (30 sessions) it was two pellets; in Phase 3 (30 sessions) it was again one pellet. Results The performance of both groups conformed to the model of progressive-ratio schedule performance. The motor parameter, δ, was significantly higher in the STN-lesioned than the sham-lesioned group, reflecting lower overall response rates in the lesioned group. The motivational parameter, a, was significantly higher in the STN-lesioned group than in the sham-lesioned group, consistent with enhanced reinforcer value in the STN-lesioned group compared to the sham-lesioned group. In both groups, a was sensitive to changes in reinforcer size, being significantly greater under the two-pellet condition (Phase 2) than under the one-pellet condition (Phases 1 and 3). The results suggest that destruction of the STN impairs response capacity and enhances the incentive value of food reinforcers. PMID:18840473

The stress-strain relationships in wood and fiber-reinforced plastic laminae of reinforced glued-laminated wood beams

NASA Astrophysics Data System (ADS)

Tingley, Daniel Arthur

The reinforcement of wood and wood composite structural products to improve their mechanical properties has been in practice for many years. Recently, the use of high-strength fiber-reinforced plastic (FRP) as a reinforcement in such applications has been commercialized. The reinforcement is manufactured using a standard pultrusion process or alternatively a sheet-forming process commonly referred to as "pulforming". The high-modulus fibers are predominately unidirectional, although off-axis fibers are often used to enhance off-axis properties. The fibers used are either of a single type or multiple types, which are called "hybrids". Unidirectional, single, and hybrid fiber FRP physical properties and characteristics were compared to wood. Full-scale reinforced glulams were tested. Aramid-reinforced plastics (ARP) used as tensile reinforcements were found to be superior in strength applications to other types of FRP made with fiber, such as carbon and fiberglass. Carbon/aramid-reinforced plastic (CARP) was shown to be superior in both modulus and strength design situations. Fiberglass was shown to be suitable only in hybrid situations with another fiber such as aramid or carbon and only in limited use situations where modulus was a design criteria. The testing and analysis showed that the global response of reinforced glulam beams is controlled by localized strength variations in the wood such as slope of grain, knots, finger joints, etc. in the tensile zone. The elemental tensile strains in the extreme wood tensile laminae, due to global applied loads, were found to be well below the strain at failure in clear wood samples recovered from the failure area. Two areas affecting the relationship between the wood and the FRP were investigated: compatibility of the wood and FRP materials and interface characteristics between the wood and FRP. The optimum strain value at yield point for an FRP was assessed to be slightly higher than the clear wood value in tension for a

Knee degeneration in concrete reinforcement workers.

PubMed Central

Wickström, G; Hänninen, K; Mattsson, T; Niskanen, T; Riihimäki, H; Waris, P; Zitting, A

1983-01-01

The loads on the knees in concrete reinforcement work and maintenance painting were analysed on eight construction work sites. A total of 352 reinforcement workers and 231 painters. Finnish men aged 20-64, were clinically and radiologically examined to determine the condition of the knee joints in active workers. The loads on the knees and the occurrence of minor injuries and accidents were higher in reinforcement work than in painting, but the occurrence of symptoms, clinical signs, and radiological findings was equally common in both groups. Reinforcement work seemed to provoke more symptoms from degenerated knees than painting. PMID:6830721

A randomized study of reinforcing ambulatory exercise in older adults

PubMed Central

Petry, Nancy M.; Andrade, Leonardo F.; Barry, Danielle; Byrne, Shannon

2014-01-01

Many older adults do not meet physical activity recommendations and suffer from health-related complications. Reinforcement interventions can have pronounced effects on promoting behavior change; this study evaluated the efficacy of a reinforcement intervention to enhance walking in older adults. Forty-five sedentary adults with mild to moderate hypertension were randomized to 12-week interventions consisting of pedometers and guidelines to walk 10,000 steps/day or that same intervention with chances to win $1-$100 prizes for meeting recommendations. Patients walked an average of about 4,000 steps/day at baseline. Throughout the intervention, participants in the reinforcement intervention met walking goals on 82.5% ± 25.8% of days versus 55.3% ± 37.1% of days in the control condition, p < .01. Even though steps walked increased significantly in both groups relative to baseline, participants in the reinforcement condition walked an average of about 2,000 more steps/day than participants in the control condition, p < .02. Beneficial effects of the reinforcement condition relative to the control condition persisted at a 24-week follow-up evaluation, p < .02, although steps/day were lower than during the intervention period in both groups. Participants in the reinforcement intervention also evidenced greater reductions in blood pressure and weight over time and improvements in fitness indices, ps < .05. This reinforcement-based intervention substantially increased walking and improved clinical parameters, suggesting that larger-scale evaluations of reinforcement-based interventions for enhancing active lifestyles in older adults are warranted. Ultimately, economic analyses may reveal reinforcement interventions to be cost-effective, especially in high-risk populations of older adults. PMID:24128075

Behavior systems and reinforcement: an integrative approach.

PubMed Central

Timberlake, W

1993-01-01

Most traditional conceptions of reinforcement are based on a simple causal model in which responding is strengthened by the presentation of a reinforcer. I argue that reinforcement is better viewed as the outcome of constraint of a functioning causal system comprised of multiple interrelated causal sequences, complex linkages between causes and effects, and a set of initial conditions. Using a simplified system conception of the reinforcement situation, I review the similarities and drawbacks of traditional reinforcement models and analyze the recent contributions of cognitive, regulatory, and ecological approaches. Finally, I show how the concept of behavior systems can begin to incorporate both traditional and recent conceptions of reinforcement in an integrative approach. PMID:8354963

21 CFR 177.2355 - Mineral reinforced nylon resins.

Code of Federal Regulations, 2014 CFR

2014-04-01

... 21 Food and Drugs 3 2014-04-01 2014-04-01 false Mineral reinforced nylon resins. 177.2355 Section... Repeated Use § 177.2355 Mineral reinforced nylon resins. Mineral reinforced nylon resins identified in... accordance with the following prescribed conditions: (a) For the purpose of this section the mineral...

Pedunculopontine tegmental nucleus lesions impair stimulus--reward learning in autoshaping and conditioned reinforcement paradigms.

PubMed

Inglis, W L; Olmstead, M C; Robbins, T W

2000-04-01

The role of the pedunculopontine tegmental nucleus (PPTg) in stimulus-reward learning was assessed by testing the effects of PPTg lesions on performance in visual autoshaping and conditioned reinforcement (CRf) paradigms. Rats with PPTg lesions were unable to learn an association between a conditioned stimulus (CS) and a primary reward in either paradigm. In the autoshaping experiment, PPTg-lesioned rats approached the CS+ and CS- with equal frequency, and the latencies to respond to the two stimuli did not differ. PPTg lesions also disrupted discriminated approaches to an appetitive CS in the CRf paradigm and completely abolished the acquisition of responding with CRf. These data are discussed in the context of a possible cognitive function of the PPTg, particularly in terms of lesion-induced disruptions of attentional processes that are mediated by the thalamus.

DISCRIMINATION ACQUISITION IN CHILDREN WITH DEVELOPMENTAL DISABILITIES UNDER IMMEDIATE AND DELAYED REINFORCEMENT

PubMed Central

Sy, Jolene R.; Vollmer, Timothy R.

2012-01-01

We evaluated the discrimination acquisition of individuals with developmental disabilities under immediate and delayed reinforcement. In Experiment 1, discrimination between two alternatives was examined when reinforcement was immediate or delayed by 20 s, 30 s, or 40 s. In Experiment 2, discrimination between 2 alternatives was compared across an immediate reinforcement condition and a delayed reinforcement condition in which subjects could respond during the delay. In Experiment 3, discrimination among 4 alternatives was compared across immediate and delayed reinforcement. In Experiment 4, discrimination between 2 alternatives was examined when reinforcement was immediate and 0-s or 30-s intertrial intervals (ITI) were programmed. For most subjects, discrimination acquisition occurred under immediate reinforcement. However, for some subjects, introducing delays slowed or prevented discrimination acquisition under some conditions. Results from Experiment 4 suggest that longer ITIs cannot account for the lack of discrimination under delayed reinforcement. PMID:23322925

Micromechanics for particulate reinforced composites

NASA Technical Reports Server (NTRS)

Murthy, Pappu L. N.; Goldberg, Robert K.; Mital, Subodh K.

1996-01-01

A set of micromechanics equations for the analysis of particulate reinforced composites is developed using the mechanics of materials approach. Simplified equations are used to compute homogenized or equivalent thermal and mechanical properties of particulate reinforced composites in terms of the properties of the constituent materials. The microstress equations are also presented here to decompose the applied stresses on the overall composite to the microstresses in the constituent materials. The properties of a 'generic' particulate composite as well as those of a particle reinforced metal matrix composite are predicted and compared with other theories as well as some experimental data. The micromechanics predictions are in excellent agreement with the measured values.

Learning the specific quality of taste reinforcement in larval Drosophila.

PubMed

Schleyer, Michael; Miura, Daisuke; Tanimura, Teiichi; Gerber, Bertram

2015-01-27

The only property of reinforcement insects are commonly thought to learn about is its value. We show that larval Drosophila not only remember the value of reinforcement (How much?), but also its quality (What?). This is demonstrated both within the appetitive domain by using sugar vs amino acid as different reward qualities, and within the aversive domain by using bitter vs high-concentration salt as different qualities of punishment. From the available literature, such nuanced memories for the quality of reinforcement are unexpected and pose a challenge to present models of how insect memory is organized. Given that animals as simple as larval Drosophila, endowed with but 10,000 neurons, operate with both reinforcement value and quality, we suggest that both are fundamental aspects of mnemonic processing-in any brain.

Economic demand and essential value.

PubMed

Hursh, Steven R; Silberberg, Alan

2008-01-01

The strength of a rat's eating reflex correlates with hunger level when strength is measured by the response frequency that precedes eating (B. F. Skinner, 1932a, 1932b). On the basis of this finding, Skinner argued response frequency could index reflex strength. Subsequent work documented difficulties with this notion because responding was affected not only by the strengthening properties of the reinforcer but also by the rate-shaping effects of the schedule. This article obviates this problem by measuring strength via methods from behavioral economics. This approach uses demand curves to map how reinforcer consumption changes with changes in the "price" different ratio schedules impose. An exponential equation is used to model these demand curves. The value of this exponential's rate constant is used to scale the strength or essential value of a reinforcer, independent of the scalar dimensions of the reinforcer. Essential value determines the consumption level to be expected at particular prices and the response level that will occur to support that consumption. This approach permits comparing reinforcers that differ in kind, contributing toward the goal of scaling reinforcer value. (c) 2008 APA, all rights reserved

Does overall reinforcer rate affect discrimination of time-based contingencies?

PubMed

Cowie, Sarah; Davison, Michael; Blumhardt, Luca; Elliffe, Douglas

2016-05-01

Overall reinforcer rate appears to affect choice. The mechanism for such an effect is uncertain, but may relate to reinforcer rate changing the discrimination of the relation between stimuli and reinforcers. We assessed whether a quantitative model based on a stimulus-control approach could be used to account for the effects of overall reinforcer rate on choice under changing time-based contingencies. On a two-key concurrent schedule, the likely availability of a reinforcer reversed when a fixed time had elapsed since the last reinforcer, and the overall reinforcer rate was varied across conditions. Changes in the overall reinforcer rate produced a change in response bias, and some indication of a change in discrimination. These changes in bias and discrimination always occurred quickly, usually within the first session of a condition. The stimulus-control approach provided an excellent account of the data, suggesting that changes in overall reinforcer rate affect choice because they alter the frequency of reinforcers obtained at different times, or in different stimulus contexts, and thus change the discriminated relation between stimuli and reinforcers. These findings support the notion that temporal and spatial discriminations can be understood in terms of discrimination of reinforcers across time and space. © 2016 Society for the Experimental Analysis of Behavior.

Prediction of reinforcement corrosion using corrosion induced cracks width in corroded reinforced concrete beams

DOE Office of Scientific and Technical Information (OSTI.GOV)

Khan, Inamullah; François, Raoul; Castel, Arnaud

2014-02-15

This paper studies the evolution of reinforcement corrosion in comparison to corrosion crack width in a highly corroded reinforced concrete beam. Cracking and corrosion maps of the beam were drawn and steel reinforcement was recovered from the beam to observe the corrosion pattern and to measure the loss of mass of steel reinforcement. Maximum steel cross-section loss of the main reinforcement and average steel cross-section loss between stirrups were plotted against the crack width. The experimental results were compared with existing models proposed by Rodriguez et al., Vidal et al. and Zhang et al. Time prediction models for a givenmore » opening threshold are also compared to experimental results. Steel cross-section loss for stirrups was also measured and was plotted against the crack width. It was observed that steel cross-section loss in the stirrups had no relationship with the crack width of longitudinal corrosion cracks. -- Highlights: •Relationship between crack and corrosion of reinforcement was investigated. •Corrosion results of natural process and then corresponds to in-situ conditions. •Comparison with time predicting model is provided. •Prediction of load-bearing capacity from crack pattern was studied.« less

Food Reinforcement and Eating: A Multilevel Analysis

PubMed Central

Epstein, Leonard H.; Leddy, John J.; Temple, Jennifer L.; Faith, Myles S.

2008-01-01

Eating represents a choice among many alternative behaviors. The purpose of this review is to provide an overview of how food reinforcement and behavioral choice theory are related to eating and to show how this theoretical approach may help organize research on eating from molecular genetics through treatment and prevention of obesity. Special emphasis is placed on how food reinforcement and behavioral choice theory are relevant to understanding excess energy intake and obesity and how they provide a framework for examining factors that may influence eating and are outside of those that may regulate energy homeostasis. Methods to measure food reinforcement are reviewed, along with factors that influence the reinforcing value of eating. Contributions of neuroscience and genetics to the study of food reinforcement are illustrated by using the example of dopamine. Implications of food reinforcement for obesity and positive energy balance are explored, with suggestions for novel approaches to obesity treatment based on the synthesis of behavioral and pharmacological approaches to food reinforcement. PMID:17723034

Exposures to conditioned flavours with different hedonic values induce contrasted behavioural and brain responses in pigs.

PubMed

Clouard, Caroline; Jouhanneau, Mélanie; Meunier-Salaün, Marie-Christine; Malbert, Charles-Henri; Val-Laillet, David

2012-01-01

This study investigated the behavioural and brain responses towards conditioned flavours with different hedonic values in juvenile pigs. Twelve 30-kg pigs were given four three-day conditioning sessions: they received three different flavoured meals paired with intraduodenal (i.d.) infusions of 15% glucose (F(Glu)), lithium chloride (F(LiCl)), or saline (control treatment, F(NaCl)). One and five weeks later, the animals were subjected to three two-choice feeding tests without reinforcement to check the acquisition of a conditioned flavour preference or aversion. In between, the anaesthetised pigs were subjected to three (18)FDG PET brain imaging coupled with an olfactogustatory stimulation with the conditioned flavours. During conditioning, the pigs spent more time lying inactive, and investigated their environment less after the F(LiCl) than the F(NaCl) or F(Glu) meals. During the two-choice tests performed one and five weeks later, the F(NaCl) and F(Glu) foods were significantly preferred over the F(LICl) food even in the absence of i.d. infusions. Surprisingly, the F(NaCl) food was also preferred over the F(Glu) food during the first test only, suggesting that, while LiCl i.d. infusions led to a strong flavour aversion, glucose infusions failed to induce flavour preference. As for brain imaging results, exposure to aversive or less preferred flavours triggered global deactivation of the prefrontal cortex, specific activation of the posterior cingulate cortex, as well as asymmetric brain responses in the basal nuclei and the temporal gyrus. In conclusion, postingestive visceral stimuli can modulate the flavour/food hedonism and further feeding choices. Exposure to flavours with different hedonic values induced metabolism differences in neural circuits known to be involved in humans in the characterization of food palatability, feeding motivation, reward expectation, and more generally in the regulation of food intake.

Effects of Economy Type and Nicotine on the Essential Value of Food in Rats

PubMed Central

Cassidy, Rachel N; Dallery, Jesse

2012-01-01

The exponential demand equation proposed by Hursh and Silberberg (2008) provides an estimate of the essential value of a good as a function of price. The model predicts that essential value should remain constant across changes in the magnitude of a reinforcer, but may change as a function of motivational operations. In Experiment 1, rats' demand for food across a sequence of fixed-ratio schedules was assessed during open and closed economy conditions and across one- and two-pellet per reinforcer delivery conditions. The exponential equation was fitted to the relation between fixed-ratio size and the logarithm of the absolute number of reinforcers. Estimates of the rate of change in elasticity of food, the proposed measure of essential value, were compared across conditions. Essential value was equivalent across magnitudes during the closed economy, but showed a slight decrease across magnitudes during the open economy. Experiment 2 explored the behavioral mechanisms of nicotine's effects on consumption with the results from Experiment 1 serving as a within-subject frame of reference. The same subjects were administered nicotine via subcutaneously implanted osmotic minipumps at a dose of 3 mg/kg/day and exposed to both the one- and two-pellet conditions under a closed economy. Although nicotine produced large decreases in demand, essential value was not significantly changed. The data from the present experiments provide further evidence for the adequacy of the exponential demand equation as a tool for quantifying the rate of change in elasticity of a good and for assessing behavioral mechanisms of drug action. PMID:22389525

Effects of economy type and nicotine on the essential value of food in rats.

PubMed

Cassidy, Rachel N; Dallery, Jesse

2012-03-01

The exponential demand equation proposed by Hursh and Silberberg (2008) provides an estimate of the essential value of a good as a function of price. The model predicts that essential value should remain constant across changes in the magnitude of a reinforcer, but may change as a function of motivational operations. In Experiment 1, rats' demand for food across a sequence of fixed-ratio schedules was assessed during open and closed economy conditions and across one- and two-pellet per reinforcer delivery conditions. The exponential equation was fitted to the relation between fixed-ratio size and the logarithm of the absolute number of reinforcers. Estimates of the rate of change in elasticity of food, the proposed measure of essential value, were compared across conditions. Essential value was equivalent across magnitudes during the closed economy, but showed a slight decrease across magnitudes during the open economy. Experiment 2 explored the behavioral mechanisms of nicotine's effects on consumption with the results from Experiment 1 serving as a within-subject frame of reference. The same subjects were administered nicotine via subcutaneously implanted osmotic minipumps at a dose of 3 mg/kg/day and exposed to both the one- and two-pellet conditions under a closed economy. Although nicotine produced large decreases in demand, essential value was not significantly changed. The data from the present experiments provide further evidence for the adequacy of the exponential demand equation as a tool for quantifying the rate of change in elasticity of a good and for assessing behavioral mechanisms of drug action.

Learning the specific quality of taste reinforcement in larval Drosophila

PubMed Central

Schleyer, Michael; Miura, Daisuke; Tanimura, Teiichi; Gerber, Bertram

2015-01-01

The only property of reinforcement insects are commonly thought to learn about is its value. We show that larval Drosophila not only remember the value of reinforcement (How much?), but also its quality (What?). This is demonstrated both within the appetitive domain by using sugar vs amino acid as different reward qualities, and within the aversive domain by using bitter vs high-concentration salt as different qualities of punishment. From the available literature, such nuanced memories for the quality of reinforcement are unexpected and pose a challenge to present models of how insect memory is organized. Given that animals as simple as larval Drosophila, endowed with but 10,000 neurons, operate with both reinforcement value and quality, we suggest that both are fundamental aspects of mnemonic processing—in any brain. DOI: http://dx.doi.org/10.7554/eLife.04711.001 PMID:25622533

Behaviour of Cohesionless Soil Reinforced with Three Dimensional Inclusions Under Plane Strain Conditions

NASA Astrophysics Data System (ADS)

Harikumar, M.; Sankar, N.; Chandrakaran, S.

2015-09-01

Since 1969, when the concept of earth reinforcing was brought about by Henry Vidal, a large variety of materials such as steel bars, tire shreds, polypropylene, polyester, glass fibres, coir and jute fibres etc. have been widely added to soil mass randomly or in a regular, oriented manner. The conventional reinforcements in use were two dimensional or planar, in the form of strips with negligible widths or in the form of sheets. In this investigation, a novel concept of multi oriented plastic reinforcement (hexa-pods) is discussed. Direct shear tests were conducted on unreinforced and reinforced dry fine, medium and coarse sands. Detailed parametric studies with respect to the effective grain size of soil (d10), normal stress (σ) and the volume ratio of hexa-pods (Vr) were performed. It was noticed that addition of hexa-pods resulted in increase in the shear strength parameters viz. peak deviatoric stresses and increased angle of internal friction. The hexa-pods also changed the brittle behaviour of unreinforced sand samples to ductile ones. Although the peak shear stress did not show a considerable improvement, the angle of internal friction improved noticeably. Addition of a single layer of reinforcement along the shear plane also reduced the post peak loss of strength and changed the soil behavior from brittle to a ductile one.

Using aberrant behaviors as reinforcers for autistic children.

PubMed Central

Charlop, M H; Kurtz, P F; Casey, F G

1990-01-01

In a series of experiments, we assessed the efficacy of using autistic children's aberrant behaviors as reinforcers to increase their correct task responding. In Experiment 1, reinforcer conditions of stereotypy, food, and varied (food or stereotypy) were compared. In Experiment 2, the conditions were delayed echolalia, food, and varied (food or delayed echolalia), and in Experiment 3, perseverative behavior was compared with stereotypy and food as potential reinforcers. A multielement design was used for all comparisons, and side-effect measures were recorded during and after teaching sessions as well as at home. Results indicated that, in general, task performance was highest when brief opportunities to engage in aberrant behaviors were provided as reinforcers. Edibles were associated with the lowest performance. Furthermore, no negative side effects (e.g., an increase in aberrant behaviors) occurred. The results are discussed in terms of suggesting a more pragmatic treatment approach by addressing the contingent use of autistic children's aberrant behaviors as reinforcers. PMID:2373653

Development of structural health monitoring and early warning system for reinforced concrete system

DOE Office of Scientific and Technical Information (OSTI.GOV)

Iranata, Data, E-mail: iranata-data@yahoo.com, E-mail: data@ce.its.ac.id; Wahyuni, Endah; Murtiadi, Suryawan

Many buildings have been damaged due to earthquakes that occurred recently in Indonesia. The main cause of the damage is the large deformation of the building structural component cannot accommodate properly. Therefore, it is necessary to develop the Structural Health Monitoring System (SHMS) to measure precisely the deformation of the building structural component in the real time conditions. This paper presents the development of SHMS for reinforced concrete structural system. This monitoring system is based on deformation component such as strain of reinforcement bar, concrete strain, and displacement of reinforced concrete component. Since the deformation component has exceeded the limitmore » value, the warning message can be sent to the building occupies. This warning message has also can be performed as early warning system of the reinforced concrete structural system. The warning message can also be sent via Short Message Service (SMS) through the Global System for Mobile Communications (GSM) network. Hence, the SHMS should be integrated with internet modem to connect with GSM network. Additionally, the SHMS program is verified with experimental study of simply supported reinforced concrete beam. Verification results show that the SHMS has good agreement with experimental results.« less

Determinants of choice for pigeons and humans on concurrent-chains schedules of reinforcement.

PubMed

Belke, T W; Pierce, W D; Powell, R A

1989-09-01

Concurrent-chains schedules of reinforcement were arranged for humans and pigeons. Responses of humans were reinforced with tokens exchangeable for money, and key pecks of 4 birds were reinforced with food. Variable-interval 30-s and 40-s schedules operated in the terminal links of the chains. Condition 1 exposed subjects to variable-interval 90-s and variable-interval 30-s initial links, respectively. Conditions 2 and 3 arranged equal initial-link schedules of 40 s or 120 s. Experimental conditions tested the descriptive adequacy of five equations: reinforcement density, delay reduction, modified delay reduction, matching and maximization. Results based on choice proportions and switch rates during the initial links showed that pigeons behaved in accord with delay-reduction models, whereas humans maximized overall rate of reinforcement. As discussed by Logue and associates in self-control research, different types of reinforcement may affect sensitivity to delay differentially. Pigeons' responses were reinforced with food, a reinforcer that is consumable upon presentation. Humans' responses were reinforced with money, a reinforcer exchanged for consumable reinforcers after it was earned. Reinforcers that are immediately consumed may generate high sensitivity to delay and behavior described as delay reduction. Reinforces with longer times to consumption may generate low sensitivity to delay and behavior that maximizes overall payoff.

Working Memory and Reinforcement Schedule Jointly Determine Reinforcement Learning in Children: Potential Implications for Behavioral Parent Training

PubMed Central

Segers, Elien; Beckers, Tom; Geurts, Hilde; Claes, Laurence; Danckaerts, Marina; van der Oord, Saskia

2018-01-01

Introduction: Behavioral Parent Training (BPT) is often provided for childhood psychiatric disorders. These disorders have been shown to be associated with working memory impairments. BPT is based on operant learning principles, yet how operant principles shape behavior (through the partial reinforcement (PRF) extinction effect, i.e., greater resistance to extinction that is created when behavior is reinforced partially rather than continuously) and the potential role of working memory therein is scarcely studied in children. This study explored the PRF extinction effect and the role of working memory therein using experimental tasks in typically developing children. Methods: Ninety-seven children (age 6–10) completed a working memory task and an operant learning task, in which children acquired a response-sequence rule under either continuous or PRF (120 trials), followed by an extinction phase (80 trials). Data of 88 children were used for analysis. Results: The PRF extinction effect was confirmed: We observed slower acquisition and extinction in the PRF condition as compared to the continuous reinforcement (CRF) condition. Working memory was negatively related to acquisition but not extinction performance. Conclusion: Both reinforcement contingencies and working memory relate to acquisition performance. Potential implications for BPT are that decreasing working memory load may enhance the chance of optimally learning through reinforcement. PMID:29643822

Work Values, Early Career Difficulties, and the U.S. Economic Recession

PubMed Central

Johnson, Monica Kirkpatrick; Sage, Rayna Amber; Mortimer, Jeylan T.

2012-01-01

We examine how work difficulties in the early career, and the generally deteriorating work conditions associated with the recent U.S. economic recession, shape individuals’ work values. Drawing on panel data from the Youth Development Study, we test whether individuals change their work values in response to concerns about satisfying material needs or the features of jobs that they are able to attain. Results indicate that extrinsic values are weakened in the face of unemployment, as well as reduced job security, income, and advancement. These patterns support a reinforcement and accentuation model in which workers adjust their values to emphasize what they actually obtain from the job. Intrinsic values are weakened by working in a job unrelated to one’s career plans; they are reinforced by the experience of greater intrinsic rewards and advancement opportunities. PMID:23503050

Selfing, Local Mate Competition, and Reinforcement.

PubMed

Rausher, Mark D

2017-02-01

Reinforcement can contribute to speciation by increasing the strength of prezygotic isolating mechanisms. Theoretical analyses over the past two decades have demonstrated that conditions for reinforcement are not unduly restrictive, and empirical investigations have documented over a dozen likely cases, indicating that it may be a reasonably common phenomenon in nature. Largely uncharacterized, however, is the diversity of biological scenarios that can create the reduced hybrid fitness that drives reinforcement. Here I examine one such scenario-the evolution of the "selfing syndrome" (a suite of characters including reductions in flower size and in nectar, pollen, and scent production) in highly selfing plant species. Using a four-locus model, where the loci are (1) a discrimination locus, (2) a target-of-discimination locus, (3) a pollen-production locus, and (4) a selfing-rate locus, I determine the conditions under which this syndrome can favor reinforcement, an increase in discrimination through change at locus 1, in an outcrossing species that experiences gene flow from a highly selfing species. In the absence of both linkage disequilibrium between loci and pollen discounting, reinforcement can occur, but only in a very small fraction of the parameter combinations examined. Moderate linkage ([Formula: see text]) between one pair of loci increases this fraction moderately, depending on which two loci are linked. Pollen discounting (a reduction in pollen exported to other plants due to increased selfing), by contrast, can increase the fraction of parameter combinations that result in reinforcement substantially. The evolution of reduced pollen production in highly selfing species thus facilitates reinforcement, especially if substantial pollen discounting is associated with selfing.

Differential effects of serotonin-specific and excitotoxic lesions of OFC on conditioned reinforcer devaluation and extinction in rats

PubMed Central

West, Elizabeth A.; Forcelli, Patrick A.; McCue, David L.; Malkova, Ludise

2013-01-01

The orbitofrontal cortex (OFC) is critical for behavioral adaptation in response to changes in reward value. Here we investigated, in rats, the role of OFC and, specifically, serotonergic neurotransmission within OFC in a reinforcer devaluation task (which measures behavioral flexibility). This task used two visual cues, each predicting one of two foods, with the spatial position (left-right) of the cues above two levers pseudorandomized across trials. An instrumental action (lever press) was required for reinforcer delivery. After training, rats received either excitotoxic OFC lesions made by NMDA (N-methyl-D-aspartic acid), serotonin-specific OFC lesions made by 5,7-DHT (5,7-dihydroxytryptamine), or sham lesions. In sham-lesioned rats, devaluation of one food (by feeding to satiety) significantly decreased responding to the cue associated with that food, when both cues were presented simultaneously during extinction. Both types of OFC lesions disrupted the devaluation effect. In contrast, extinction learning was not affected by serotonin-specific lesions and was only mildly retarded in rats with excitotoxic lesions. Thus, serotonin within OFC is necessary for appropriately adjusting behavior towards cues that predict reward but not for reducing responses in the absence of reward. Our results are the first to demonstrate that serotonin in OFC is necessary for reinforcer devaluation, but not extinction. PMID:23458741

The reinforcing value of vegetables does not increase with repeated exposure during a randomized controlled provided vegetable intervention among overweight and obese adults

USDA-ARS?s Scientific Manuscript database

Objective: The primary aim of this randomized controlled trial is to determine whether the relative reinforcing value (RRV) of vegetables compared to a snack food can be increased through repeated exposure (incentive sensitization) to amounts of vegetables recommended by the Dietary Guidelines for A...

Is cascade reinforcement likely when sympatric and allopatric populations exchange migrants?

PubMed

Yukilevich, Roman; Aoki, Fumio

2016-04-01

When partially reproductively isolated species come back into secondary contact, these taxa may diverge in mating preferences and sexual cues to avoid maladaptive hybridization, a process known as reinforcement. This phenomenon often leads to reproductive character displacement (RCD) between sympatric and allopatric populations of reinforcing species that differ in their exposure to hybridization. Recent discussions have reinvigorated the idea that RCD may give rise to additional speciation between conspecific sympatric and allopatric populations, dubbing the concept "cascade reinforcement." Despite some empirical studies supporting cascade reinforcement, we still know very little about the conditions for its evolution. In the present article, we address this question by developing an individual-based population genetic model that explicitly simulates cascade reinforcement when one of the hybridizing species is split into sympatric and allopatric populations. Our results show that when sympatric and allopatric populations reside in the same environment and only differ in their exposure to maladaptive hybridization, migration between them generally inhibits the evolution of cascade by spreading the reinforcement alleles from sympatry into allopatry and erasing RCD. Under these conditions, cascade reinforcement only evolved when migration rate between sympatric and allopatric populations was very low. This indicates that stabilizing sexual selection in allopatry is generally ineffective in preventing the spread of reinforcement alleles. Only when sympatric and allopatric populations experienced divergent ecological selection did cascade reinforcement evolve in the presence of substantial migration. These predictions clarify the conditions for cascade reinforcement and facilitate our understanding of existing cases in nature.

Buckling of Fiber Reinforced Composite Plates with Nanofiber Reinforced Matrices

NASA Technical Reports Server (NTRS)

Chamis, Christos C.; Murthy, Pappu L. N.

2010-01-01

Anisotropic composite plates were evaluated with nanofiber reinforced matrices (NFRM). The nanofiber reinforcement volumes ratio in the matrix was 0.01. The plate dimensions were 20 by 10 by 1.0 in. (508 by 254 by 25.4 mm). Seven different loading condition cases were evaluated: three for uniaxial loading, three for pairs of combined loading, and one with three combined loadings. The anisotropy arose from the unidirectional plates having been at 30 from the structural axis. The anisotropy had a full 6 by 6 rigidities matrix which were satisfied and solved by a Galerkin buckling algorithm. The buckling results showed that the NFRM plates buckled at about twice those with conventional matrix.

Discriminative stimuli that follow the absence of reinforcement are preferred by pigeons over those that follow reinforcement.

PubMed

Friedrich, Andrea M; Clement, Tricia S; Zentall, Thomas R

2005-08-01

Clement, Feltus, Kaiser, and Zentall (2000) found that when pigeons have to work to obtain a discriminative stimulus that is followed by reinforcement, they prefer a discriminative stimulus that requires greater effort over one that requires less effort. The authors suggested that such a preference results from the greater change in hedonic value that occurs between the more aversive event and the onset of the stimulus that signals reinforcement, a contrast effect. It was hypothesized that any stimulus that follows a relatively more aversive event would be preferred over a stimulus that follows a relatively less aversive event. In the present experiment, the authors tested the counterintuitive prediction of that theory, that pigeons should prefer a discriminative stimulus that follows the absence of reinforcement over a discriminative stimulus that follows reinforcement. Results supported the theory.

CENTRAL REINFORCING EFFECTS OF ETHANOL ARE BLOCKED BY CATALASE INHIBITION

PubMed Central

Nizhnikov, Michael Edward; Molina, Juan Carlos; Spear, Norman

2007-01-01

Recent studies have systematically indicated that newborn rats are highly sensitive to ethanol’s positive reinforcing effects. Central administrations of ethanol (25–200 mg %) associated with an olfactory conditioned stimulus (CS) promote subsequent conditioned approach to the CS as evaluated through the newborn’s response to a surrogate nipple scented with the CS. It has been shown that ethanol’s first metabolite, acetaldehyde, exerts significant reinforcing effects in the central nervous system. A significant amount of acetaldehyde is derived from ethanol metabolism via the catalase system. In newborn rats catalase levels are particularly high in several brain structures. The present study tested the effect of catalase inhibition on central ethanol reinforcement. In the first experiment, pups experienced lemon odor either paired or unpaired with intracisternal (i.c.) administrations of 100 mg% ethanol. Half of the animals corresponding to each learning condition were pretreated with i.c. administrations of either physiological saline or a catalase inhibitor (sodium-azide). Catalase inhibition completely suppressed ethanol reinforcement in paired groups without affecting responsiveness to the CS during conditioning or responding by unpaired control groups. A second experiment tested whether these effects were specific to ethanol reinforcement or due instead to general impairment in learning and expression capabilities. Central administration of an endogenous kappa opioid receptor agonist (dynorphin A-13) was employed as an alternative source of reinforcement. Inhibition of the catalase system had no effect on the reinforcing properties of dynorphin. The present results support the hypothesis that ethanol metabolism regulated by the catalase system plays a critical role in determination of ethanol reinforcement in newborn rats. PMID:17980789

Test-specific control conditions for functional analyses.

PubMed

Fahmie, Tara A; Iwata, Brian A; Querim, Angie C; Harper, Jill M

2013-01-01

Most functional analyses of problem behavior include a common condition (play or noncontingent reinforcement) as a control for both positive and negative reinforcement. However, test-specific conditions that control for each potential source of reinforcement may be beneficial occasionally. We compared responding during alone, ignore, play, and differential reinforcement of other behavior (DRO) control conditions for individuals whose problem behavior was maintained by positive or negative reinforcement. Results showed that all of the conditions were effective controls for problem behavior maintained by positive reinforcement; however, the DRO condition was consistently ineffective as a control for problem behavior maintained by negative reinforcement. Implications for the design of functional analyses and future research are discussed. © Society for the Experimental Analysis of Behavior.

Buckling and Vibration of Fiber Reinforced Composite Plates With Nanofiber Reinforced Matrices

NASA Technical Reports Server (NTRS)

Chamis, Christos C.; Murthy, Pappu L. N.

2011-01-01

Anisotropic composite plates were evaluated with nanofiber reinforced matrices (NFRM). The nanofiber reinforcement volumes ratio in the matrix was 0.01. The plate dimensions were 20 by 10 by 1.0 in. (508 by 254 by 25.4 mm). Seven different loading condition cases were evaluated for buckling: three for uniaxial loading, three for pairs of combined loading, and one with three combined loadings. The anisotropy arose from the unidirectional plates having been at 30 from the structural axis. The anisotropy had a full 6 by 6 rigidities matrix which were satisfied and solved by a Galerkin buckling algorithm. For vibration the same conditions were used with the applied cods about a small fraction of the buckling loads. The buckling and vibration results showed that the NFRM plates buckled at about twice those with conventional matrix.

Estimation of value at risk and conditional value at risk using normal mixture distributions model

NASA Astrophysics Data System (ADS)

Kamaruzzaman, Zetty Ain; Isa, Zaidi

2013-04-01

Normal mixture distributions model has been successfully applied in financial time series analysis. In this paper, we estimate the return distribution, value at risk (VaR) and conditional value at risk (CVaR) for monthly and weekly rates of returns for FTSE Bursa Malaysia Kuala Lumpur Composite Index (FBMKLCI) from July 1990 until July 2010 using the two component univariate normal mixture distributions model. First, we present the application of normal mixture distributions model in empirical finance where we fit our real data. Second, we present the application of normal mixture distributions model in risk analysis where we apply the normal mixture distributions model to evaluate the value at risk (VaR) and conditional value at risk (CVaR) with model validation for both risk measures. The empirical results provide evidence that using the two components normal mixture distributions model can fit the data well and can perform better in estimating value at risk (VaR) and conditional value at risk (CVaR) where it can capture the stylized facts of non-normality and leptokurtosis in returns distribution.

Differential reinforcement and resistance to change of divided-attention performance.

PubMed

Podlesnik, Christopher A; Thrailkill, Eric; Shahan, Timothy A

2012-06-01

Behavioral momentum theory provides a framework for understanding how conditions of reinforcement influence instrumental response strength under conditions of disruption (i.e., resistance to change). The present experiment examined resistance to change of divided-attention performance when different overall probabilities of reinforcement were arranged across two components of a multiple schedule. Pigeons responded in a delayed-matching-to-sample procedure with compound samples (color + line orientation) and element comparisons (two colors or two line orientations). Reinforcement ratios of 1:9, 1:1, and 9:1 for accurate matches on the two types of comparison trials were examined across conditions using reinforcement probabilities (color/lines) of .9/.1, .5/.5, and .1/.9 in the rich component and .18/.02, .1/.1, and .02/.18 in the lean component. Relative accuracy with color and line comparisons was an orderly function of relative reinforcement, but this relation did not depend on the overall rate of reinforcement between components. The resistance to change of divided-attention performance was greater for both trial types in the rich component with presession feeding and extinction, but not with decreases in sample duration. These findings suggest promise for the applicability of quantitative models of operant behavior to divided-attention performance, but they highlight the need to further explore conditions impacting the resistance to change of attending.

Differential reinforcement and resistance to change of divided-attention performance

PubMed Central

Thrailkill, Eric

2016-01-01

Behavioral momentum theory provides a framework for understanding how conditions of reinforcement influence instrumental response strength under conditions of disruption (i.e., resistance to change). The present experiment examined resistance to change of divided-attention performance when different overall probabilities of reinforcement were arranged across two components of a multiple schedule. Pigeons responded in a delayed-matching-to-sample procedure with compound samples (color + line orientation) and element comparisons (two colors or two line orientations). Reinforcement ratios of 1:9, 1:1, and 9:1 for accurate matches on the two types of comparison trials were examined across conditions using reinforcement probabilities (color/lines) of .9/.1, .5/.5, and .1/.9 in the rich component and .18/.02, .1/.1, and .02/.18 in the lean component. Relative accuracy with color and line comparisons was an orderly function of relative reinforcement, but this relation did not depend on the overall rate of reinforcement between components. The resistance to change of divided-attention performance was greater for both trial types in the rich component with presession feeding and extinction, but not with decreases in sample duration. These findings suggest promise for the applicability of quantitative models of operant behavior to divided-attention performance, but they highlight the need to further explore conditions impacting the resistance to change of attending. PMID:22038737

Secondary reinforcement and number of primary reinforcements1

PubMed Central

Fantino, Edmund; Herrnstein, R. J.

1968-01-01

Pigeons' pecks on either of two concurrently available response keys produced secondary reinforcers according to independent one-minute variable-interval schedules. Different secondary reinforcers, in the presence of which the rates of primary reinforcement were equal, were associated with each key. The rate of pecking maintained by each secondary reinforcer varied directly, but nonproportionally, with the number of primary reinforcements given in the presence of the secondary reinforcer. PMID:5636860

Alternative Reinforcer Response Cost Impacts Methamphetamine Choice in Humans

PubMed Central

Bennett, J. Adam; Stoops, William W.; Rush, Craig R.

2012-01-01

Methamphetamine use disorders are a persistent public health concern. Behavioral treatments have demonstrated that providing access to non-drug alternative reinforcers reduces methamphetamine use. The purpose of this human laboratory experiment was to determine how changes in response cost for non-drug alternative reinforcers influenced methamphetamine choice. Seven subjects with past year histories of recreational stimulant use completed a placebo-controlled, crossover, double-blind protocol in which they first sampled doses of oral methamphetamine (0, 8 or 16 mg) and completed a battery of subject-rated and physiological measures. During subsequent sessions, subjects then made eight discrete choices between 1/8th of the sampled dose and an alternative reinforcer ($0.25). The response cost to earn a methamphetamine dose was always 500 responses (FR500). The response cost for the alternative reinforcer varied across sessions (FR500, FR1000, FR2000, FR3000). Methamphetamine functioned as a positive reinforcer and produced prototypical stimulant-like effects (e.g., elevated blood pressure, increased ratings of “Stimulated”). Choice for doses over money was sensitive to changes in response cost for alternative reinforcers in that more doses were taken at higher FR values than at lower FR values. Placebo choices changed as a function of alternative reinforcer response cost to a greater degree than active methamphetamine choices. These findings suggest that manipulating the effort necessary to earn alternative reinforcers could impact methamphetamine use. PMID:23046851

Is cascade reinforcement likely when sympatric and allopatric populations exchange migrants?

PubMed Central

Yukilevich, Roman; Aoki, Fumio

2016-01-01

Abstract When partially reproductively isolated species come back into secondary contact, these taxa may diverge in mating preferences and sexual cues to avoid maladaptive hybridization, a process known as reinforcement. This phenomenon often leads to reproductive character displacement (RCD) between sympatric and allopatric populations of reinforcing species that differ in their exposure to hybridization. Recent discussions have reinvigorated the idea that RCD may give rise to additional speciation between conspecific sympatric and allopatric populations, dubbing the concept “cascade reinforcement.” Despite some empirical studies supporting cascade reinforcement, we still know very little about the conditions for its evolution. In the present article, we address this question by developing an individual-based population genetic model that explicitly simulates cascade reinforcement when one of the hybridizing species is split into sympatric and allopatric populations. Our results show that when sympatric and allopatric populations reside in the same environment and only differ in their exposure to maladaptive hybridization, migration between them generally inhibits the evolution of cascade by spreading the reinforcement alleles from sympatry into allopatry and erasing RCD. Under these conditions, cascade reinforcement only evolved when migration rate between sympatric and allopatric populations was very low. This indicates that stabilizing sexual selection in allopatry is generally ineffective in preventing the spread of reinforcement alleles. Only when sympatric and allopatric populations experienced divergent ecological selection did cascade reinforcement evolve in the presence of substantial migration. These predictions clarify the conditions for cascade reinforcement and facilitate our understanding of existing cases in nature. PMID:29491903

Generalization of value in reinforcement learning by humans

PubMed Central

Wimmer, G. Elliott; Daw, Nathaniel D.; Shohamy, Daphna

2012-01-01

Research in decision making has focused on the role of dopamine and its striatal targets in guiding choices via learned stimulus-reward or stimulus-response associations, behavior that is well-described by reinforcement learning (RL) theories. However, basic RL is relatively limited in scope and does not explain how learning about stimulus regularities or relations may guide decision making. A candidate mechanism for this type of learning comes from the domain of memory, which has highlighted a role for the hippocampus in learning of stimulus-stimulus relations, typically dissociated from the role of the striatum in stimulus-response learning. Here, we used fMRI and computational model-based analyses to examine the joint contributions of these mechanisms to RL. Humans performed an RL task with added relational structure, modeled after tasks used to isolate hippocampal contributions to memory. On each trial participants chose one of four options, but the reward probabilities for pairs of options were correlated across trials. This (uninstructed) relationship between pairs of options potentially enabled an observer to learn about options’ values based on experience with the other options and to generalize across them. We observed BOLD activity related to learning in the striatum and also in the hippocampus. By comparing a basic RL model to one augmented to allow feedback to generalize between correlated options, we tested whether choice behavior and BOLD activity were influenced by the opportunity to generalize across correlated options. Although such generalization goes beyond standard computational accounts of RL and striatal BOLD, both choices and striatal BOLD were better explained by the augmented model. Consistent with the hypothesized role for the hippocampus in this generalization, functional connectivity between the ventral striatum and hippocampus was modulated, across participants, by the ability of the augmented model to capture participants’ choice

Differential effects of serotonin-specific and excitotoxic lesions of OFC on conditioned reinforcer devaluation and extinction in rats.

PubMed

West, Elizabeth A; Forcelli, Patrick A; McCue, David L; Malkova, Ludise

2013-06-01

The orbitofrontal cortex (OFC) is critical for behavioral adaptation in response to changes in reward value. Here we investigated, in rats, the role of OFC and, specifically, serotonergic neurotransmission within OFC in a reinforcer devaluation task (which measures behavioral flexibility). This task used two visual cues, each predicting one of two foods, with the spatial position (left-right) of the cues above two levers pseudorandomized across trials. An instrumental action (lever press) was required for reinforcer delivery. After training, rats received either excitotoxic OFC lesions made by NMDA (N-methyl-d-aspartic acid), serotonin-specific OFC lesions made by 5,7-DHT (5,7-dihydroxytryptamine), or sham lesions. In sham-lesioned rats, devaluation of one food (by feeding to satiety) significantly decreased responding to the cue associated with that food, when both cues were presented simultaneously during extinction. Both types of OFC lesions disrupted the devaluation effect. In contrast, extinction learning was not affected by serotonin-specific lesions and was only mildly retarded in rats with excitotoxic lesions. Thus, serotonin within OFC is necessary for appropriately adjusting behavior toward cues that predict reward but not for reducing responses in the absence of reward. Our results are the first to demonstrate that serotonin in OFC is necessary for reinforcer devaluation, but not extinction. Copyright © 2013 Elsevier B.V. All rights reserved.

Mechanical Retention and Waterproof Properties of Bacterial Cellulose-Reinforced Thermoplastic Starch Biocomposites Modified with Sodium Hexametaphosphate

PubMed Central

Wang, Da-wei; Xu, Ying-juan; Li, Xin; Huang, Chao-ming; Huang, Kuo-shien; Wang, Chuen-kai; Yeh, Jen-taut

2015-01-01

The waterproof and strength retention properties of bacterial cellulose (BC)-reinforced thermoplastic starch (TPS) resins were successfully improved by reacting with sodium hexametaphosphate (SHMP). After modification with SHMP, the tensile strength (σf) and impact strength (Is) values of initial and conditioned BC-reinforced TPS, modified with varying amounts of SHMP(TPS100BC0.02SHMPx), and their blends with poly(lactic acid)((TPS100BC0.02SHMPx)75PLA25) specimens improved significantly and reached a maximal value as SHMP content approached 10 parts per hundred parts of TPS resin (phr), while their moisture content and elongation at break (ɛf) was reduced to a minimal value as SHMP contents approached 10 phr. The σf, Is and ɛf retention values of a (TPS100BC0.02SHMP10)75PLA25 specimen conditioned for 56 days are 52%, 50% and 3 times its initial σf, Is and ɛf values, respectively, which are 32.5 times, 8.9 times and 40% of those of a corresponding conditioned TPS100BC0.02 specimen, respectively. As evidenced by FTIR analyses of TPS100BC0.02SHMPx specimens, hydroxyl groups of TPS100BC0.02 resins were successfully reacted with the phosphate groups of SHMP molecules. New melting endotherms and diffraction peaks of VH-type crystals were found on DSC thermograms and WAXD patterns of TPS or TPS100BC0.02 specimens conditioned for 7 days, while no new melting endotherm or diffraction peak was found for TPS100BC0.02SHMPx and/or (TPS100BC0.02SHMPx)75PLA25 specimens conditioned for less than 14 and 28 days, respectively.

Do Conditional Reinforcers Count?

PubMed Central

Davison, Michael; Baum, William M

2006-01-01

Six pigeons were trained on a procedure in which seven components arranged different food-delivery ratios on concurrent variable-interval schedules each session. The components were unsignaled, lasted for 10 food deliveries, and occurred in random order with a 60-s blackout between components. The schedules were arranged using a switching-key procedure in which two responses on a center key changed the schedules and associated stimuli on two side keys. In Experiment 1, over five conditions, an increasing proportion of food deliveries accompanied by a magazine light was replaced with the presentation of the magazine light only. Local analyses of preference showed preference pulses toward the alternative that had just produced either a food-plus-magazine-light or magazine-light-only presentation, but pulses after food deliveries were always greater than those after magazine lights. Increasing proportions of magazine lights did not change the size of preference pulses after food or magazine-light presentations. Experiment 2 investigated the effects of correlations between food ratios and magazine-light ratios: In Condition 6, magazine-light ratios in components were inversely correlated (−1.0) with food ratios, and in Condition 7, magazine-light ratios were uncorrelated with food ratios. In Conditions 8 and 9, pecks also produced occasional 2.5-s flashes of a green keylight. In Condition 8, food and magazine-light ratios were correlated 1.0 whereas food and green-key ratios were correlated −1.0. In Condition 9, food and green-key ratios were correlated 1.0 whereas food and magazine-light ratios were correlated −1.0. Preference pulses toward alternatives after magazine lights and green keys depended on the correlation between these event ratios and the food ratios: If the ratios were correlated +1.0, positive preference pulses resulted; if the correlation was −1.0, preference pulses were negative. These results suggest that the Law of Effect has more to do with

The primate amygdala represents the positive and negative value of visual stimuli during learning

PubMed Central

Paton, Joseph J.; Belova, Marina A.; Morrison, Sara E.; Salzman, C. Daniel

2008-01-01

Visual stimuli can acquire positive or negative value through their association with rewards and punishments, a process called reinforcement learning. Although we now know a great deal about how the brain analyses visual information, we know little about how visual representations become linked with values. To study this process, we turned to the amygdala, a brain structure implicated in reinforcement learning1–5. We recorded the activity of individual amygdala neurons in monkeys while abstract images acquired either positive or negative value through conditioning. After monkeys had learned the initial associations, we reversed image value assignments. We examined neural responses in relation to these reversals in order to estimate the relative contribution to neural activity of the sensory properties of images and their conditioned values. Here we show that changes in the values of images modulate neural activity, and that this modulation occurs rapidly enough to account for, and correlates with, monkeys’ learning. Furthermore, distinct populations of neurons encode the positive and negative values of visual stimuli. Behavioural and physiological responses to visual stimuli may therefore be based in part on the plastic representation of value provided by the amygdala. PMID:16482160

Nicotine enhances operant responding for qualitatively distinct reinforcers under maintenance and extinction conditions.

PubMed

Barret, Scott T; Bevins, Rick A

2013-12-01

Nicotine enhancement of reward has been implicated as an important contributor to tobacco addiction. Despite the attention that reward enhancement has received, the behavioral mechanisms whereby nicotine enhances operant responding remain largely unknown. The present study sought to extend previous work by evaluating the effects of nicotine on responding for two qualitatively different rewards (visual stimulation (VS) and 4% sucrose solution) under fixed-ratio (FR) maintenance and extinction conditions. Sprague–Dawley rats were trained to press an active lever for VS (Experiment 1) or 4% sucrose solution (Experiment 2) and evaluated over 15 sessions on a FR5 schedule of reinforcement. Nicotine (0.4 mg base/kg, SC) or saline were administered 5 min before each session; the alternate solution was given in the home cage after the session. The effects of nicotine on extinction responding were then assessed over 5 sessions and rats were divided into 4 groups based on drug of injection received during FR-maintenance and extinction phases (maintenance–extinction): Nic–Nic, Nic–Sal, Sal–Sal, and Sal–Nic. Nicotine increased active lever response rates for both VS and 4% sucrose under FR5 maintenance conditions. Nicotine also increased response rates in the Nic–Nic group relative to all other groups under extinction conditions in both experiments, though this effect had greater longevity following VS maintenance conditions than sucrose. Enhancement of responding during extinction does not appear dependent upon locomotor activation by nicotine.

Maintaining High Ambulatory Activity Levels of Sedentary Adults with a Reinforcement Thinning Schedule

PubMed Central

Andrade, Leonardo F.; Barry, Danielle; Litt, Mark D.; Petry, Nancy M.

2016-01-01

Physical inactivity is a leading cause of mortality. Reinforcement interventions appear useful for increasing activity and preventing adverse consequences of sedentary lifestyles. This study evaluated a reinforcement thinning schedule for maintaining high activity levels. Sedentary adults (n=77) were given pedometers and encouraged to walk ≥10,000 steps/day. Initially, all participants earned rewards for each day they walked ≥10,000 steps. Subsequently, 61 participants were randomized to a monitoring only condition or a monitoring plus reinforcement thinning condition, in which frequencies of monitoring and reinforcing walking decreased over 12 weeks. The mean ± SD percentage of participants in the monitoring plusreinforcement thinning condition who met walking goals was 83% ± 24% versus. 55% ± 31% for participants in the monitoring only condition, p < .001. Thus, this monitoring plusreinforcement thinning schedule maintained high rates of walking when it was in effect; however, groups did not differ at a 24-week follow-up. Monitoring plus reinforcement thinning schedules, nevertheless, hold potential to extend benefits of reinforcement interventions at low costs. PMID:25041789

General theory of skin reinforcement.

PubMed

Kruglikov, Ilja L; Scherer, Philipp E

2017-01-01

Macroscopic mechanical properties of human skin in vivo cannot be considered independent of adjacent subcutaneous white adipose tissue (sWAT). The layered system skin/sWAT appears as the hierarchical structural composite in which single layers behave as fiber-reinforced structures. Effective macroscopic mechanical properties of such composites are mainly determined either by the properties of the skin or by those of the sWAT, dependent on the conditions of mechanical loading. Mechanical interactions between the skin and the adjacent sWAT associated with a mismatch in the mechanical moduli of these two layers can lead to production of the skin wrinkles. Reinforcement of the composite skin/sWAT can take place in different ways. It can be provided through reorientation of collagen fibers under applied loading, through production of new bonds between existing collagen fibers and through induction of additional collagen structures. Effectiveness of this type of reinforcement is strongly dependent on the type of mechanical loading. Different physical interventions induce the reinforcement of at least one of these two layers, thus increasing the effective macroscopic stiffness of the total composite. At the same time, the standalone reinforcement of the skin appears to be less effective to achieve a delay or a reduction of the apparent signs of skin aging relative to the reinforcement of the sWAT.

Effects of Video Games as Reinforcers for Computerized Addition Performance.

ERIC Educational Resources Information Center

Axelrod, Saul; And Others

1987-01-01

Four 2nd-grade students completed addition problems on a computer, using video games as reinforcers. Two variable ratio schedules of reinforcement failed to increase student accuracy or the rate of correct responses. In a no-games reinforcement condition, students had more opportunities to respond and had a greater number of correct answers.…

Differences between appetitive and aversive reinforcement on reorientation in a spatial working memory task.

PubMed

Golob, Edward J; Taube, Jeffrey S

2002-10-17

Tasks using appetitive reinforcers show that following disorientation rats use the shape of an arena to reorient, and cannot distinguish two geometrically similar corners to obtain a reward, despite the presence of a prominent visual cue that provides information to differentiate the two corners. Other studies show that disorientation impairs performance on certain appetitive, but not aversive, tasks. This study evaluated whether rats would make similar geometric errors in a working memory task that used aversive reinforcement. We hypothesized that in a task that used aversive reinforcement rats that were initially disoriented would not reorient by arena shape and thus make similar geometric errors. Tests were performed in a rectangular arena having one polarizing cue. In the appetitive condition water consumption was the reward. The aversive condition was a water maze task with reinforcement provided by escape to a hidden platform. In the aversive condition rats returned to the reinforced corner significantly more often than in the dry condition, and did not favor the diagonally opposite corner. Results show that rats can use cues besides arena shape to reorient in an aversive reinforcement condition. These findings may also reflect different strategies, with an escape/homing strategy in the wet condition and a foraging strategy in the dry condition.

The effects of reinforcement magnitude on skill acquisition for children with autism.

PubMed

Paden, Amber R; Kodak, Tiffany

2015-12-01

We examined the effects of reinforcement magnitude on skill acquisition during discrete-trial training. After conducting a magnitude preference assessment, we compared acquisition during conditions with large and small magnitudes of edible reinforcement to a praise-only condition. Although all participants showed a preference for the large-magnitude reinforcer, preference did not predict the magnitude that produced the fastest skill acquisition. © Society for the Experimental Analysis of Behavior.

Comparison of the flexural strength of six reinforced restorative materials.

PubMed

Cohen, B I; Volovich, Y; Musikant, B L; Deutsch, A S

2001-01-01

This study calculated the flexural strength for six reinforced restorative materials and demonstrated that flexural strength values can be determined simply by using physical parameters (diametral tensile strength and Young's modulus values) that are easily determined experimentally. A one-way ANOVA analysis demonstrated a statistically significant difference between the two reinforced glass ionomers and the four composite resin materials, with the composite resin being stronger than the glass ionomers.

Analysing hydro-mechanical behaviour of reinforced slopes through centrifuge modelling

NASA Astrophysics Data System (ADS)

Veenhof, Rick; Wu, Wei

2017-04-01

Every year, slope instability is causing casualties and damage to properties and the environment. The behaviour of slopes during and after these kind of events is complex and depends on meteorological conditions, slope geometry, hydro-mechanical soil properties, boundary conditions and the initial state of the soils. This study describes the effects of adding reinforcement, consisting of randomly distributed polyolefin monofilament fibres or Ryegrass (Lolium), on the behaviour of medium-fine sand in loose and medium dense conditions. Direct shear tests were performed on sand specimens with different void ratios, water content and fibre or root density, respectively. To simulate the stress state of real scale field situations, centrifuge model tests were conducted on sand specimens with different slope angles, thickness of the reinforced layer, fibre density, void ratio and water content. An increase in peak shear strength is observed in all reinforced cases. Centrifuge tests show that for slopes that are reinforced the period until failure is extended. The location of shear band formation and patch displacement behaviour indicate that the design of slope reinforcement has a significant effect on the failure behaviour. Future research will focus on the effect of plant water uptake on soil cohesion.

From Positive Reinforcement to Positive Behaviors: An Everyday Guide for the Practitioner

ERIC Educational Resources Information Center

Sigler, Ellen A.; Aamidor, Shirley

2005-01-01

There are various opinions concerning the value of positive reinforcement when discussing modifying behaviors of young children. In some cases, individuals considered positive reinforcement difficult to implement and, in extreme cases, even felt it to be detrimental. Educators often use praise interchangeably with positive reinforcement when…

Research progress of microbial corrosion of reinforced concrete structure

NASA Astrophysics Data System (ADS)

Li, Shengli; Li, Dawang; Jiang, Nan; Wang, Dongwei

2011-04-01

Microbial corrosion of reinforce concrete structure is a new branch of learning. This branch deals with civil engineering , environment engineering, biology, chemistry, materials science and so on and is a interdisciplinary area. Research progress of the causes, research methods and contents of microbial corrosion of reinforced concrete structure is described. The research in the field is just beginning and concerted effort is needed to go further into the mechanism of reinforce concrete structure and assess the security and natural life of reinforce concrete structure under the special condition and put forward the protective methods.

Conditioned Reinforcement and Locomotor Activating Effects of Caffeine and Ethanol Combinations in Mice

PubMed Central

Hilbert, Megan L.T.; May, Christina E.; Griffin, William C.

2013-01-01

A growing trend among ethanol drinkers, especially young adults, is to combine caffeinated energy drinks with ethanol during a drinking episode. The primary active ingredient of these mixers is caffeine, which may significantly interact with ethanol. We tested the two hypotheses that caffeine would enhance ethanol-conditioned place preference and also enhance ethanol-stimulated locomotor activity. The interactive pharmacology of ethanol and caffeine was examined in C57BL/6J (B6) mice in a conditioned place preference procedure with 1.75 g/kg ethanol and 3 mg/kg caffeine. Additionally, we used B6 mice to evaluate ethanol/caffeine combinations on locomotor activity using 3 doses of ethanol (1.75, 2.5 and 3.25 g/kg) and 2 two doses of caffeine (3 and 15 mg/kg). Both ethanol and caffeine administered alone increased preference for the drug paired side, though the effect of caffeine was more modest than that of ethanol. The drug combination produced significant place preference itself, but this was not greater than that for ethanol alone. Additionally, the combination of caffeine and ethanol significantly increased locomotion compared to giving either drug alone. The effect was strongest with a stimulatory dose of ethanol (1.75 g/kg) and waned with increasing doses of ethanol. Thus, combinations of caffeine and ethanol had significant conditioned reinforcing and locomotor activating effects in mice. PMID:23872371

Process for preparing polymer reinforced silica aerogels

NASA Technical Reports Server (NTRS)

Meador, Mary Ann B. (Inventor); Capadona, Lynn A. (Inventor)

2011-01-01

Process for preparing polymer-reinforced silica aerogels which comprises a one-pot reaction of at least one alkoxy silane in the presence of effective amounts of a polymer precursor to obtain a silica reaction product, the reaction product is gelled and subsequently subjected to conditions that promotes polymerization of the precursor and then supercritically dried to obtain the polymer-reinforced monolithic silica aerogels.

A COMPARISON OF TWO PAIRING PROCEDURES TO ESTABLISH PRAISE AS A REINFORCER

PubMed Central

Dozier, Claudia L.; Iwata, Brian A.; Thomason-Sassi, Jessica; Worsdell, April S.; Wilson, David M.

2012-01-01

Some individuals with intellectual disabilities do not respond to praise as a reinforcer, which may limit their ability to learn. We evaluated 2 procedures (stimulus pairing and response–stimulus pairing), both of which involved pairing previously neutral praise statements with preferred edible items, to determine their usefulness in establishing praise as a reinforcer. Results of Study 1 indicated that stimulus pairing was not effective in conditioning praise as a reinforcer for 3 of 4 subjects; results were inconclusive for the 4th subject. Results of Study 2 indicated that response–stimulus pairing was effective in conditioning praise as a reinforcer for 4 of 8 subjects. After conditioning, praise also increased the occurrence of additional target responses for these 4 subjects. PMID:23322928

A comparison of differential reinforcement procedures with children with autism.

PubMed

Boudreau, Brittany A; Vladescu, Jason C; Kodak, Tiffany M; Argott, Paul J; Kisamore, April N

2015-12-01

The current evaluation compared the effects of 2 differential reinforcement arrangements and a nondifferential reinforcement arrangement on the acquisition of tacts for 3 children with autism. Participants learned in all reinforcement-based conditions, and we discuss areas for future research in light of these findings and potential limitations. © Society for the Experimental Analysis of Behavior.

Experience with dynamic reinforcement rates decreases resistance to extinction.

PubMed

Craig, Andrew R; Shahan, Timothy A

2016-03-01

The ability of organisms to detect reinforcer-rate changes in choice preparations is positively related to two factors: the magnitude of the change in rate and the frequency with which rates change. Gallistel (2012) suggested similar rate-detection processes are responsible for decreases in responding during operant extinction. Although effects of magnitude of change in reinforcer rate on resistance to extinction are well known (e.g., the partial-reinforcement-extinction effect), effects of frequency of changes in rate prior to extinction are unknown. Thus, the present experiments examined whether frequency of changes in baseline reinforcer rates impacts resistance to extinction. Pigeons pecked keys for variable-interval food under conditions where reinforcer rates were stable and where they changed within and between sessions. Overall reinforcer rates between conditions were controlled. In Experiment 1, resistance to extinction was lower following exposure to dynamic reinforcement schedules than to static schedules. Experiment 2 showed that resistance to presession feeding, a disruptor that should not involve change-detection processes, was unaffected by baseline-schedule dynamics. These findings are consistent with the suggestion that change detection contributes to extinction. We discuss implications of change-detection processes for extinction of simple and discriminated operant behavior and relate these processes to the behavioral-momentum based approach to understanding extinction. © 2016 Society for the Experimental Analysis of Behavior.

A clustering-based graph Laplacian framework for value function approximation in reinforcement learning.

PubMed

Xu, Xin; Huang, Zhenhua; Graves, Daniel; Pedrycz, Witold

2014-12-01

In order to deal with the sequential decision problems with large or continuous state spaces, feature representation and function approximation have been a major research topic in reinforcement learning (RL). In this paper, a clustering-based graph Laplacian framework is presented for feature representation and value function approximation (VFA) in RL. By making use of clustering-based techniques, that is, K-means clustering or fuzzy C-means clustering, a graph Laplacian is constructed by subsampling in Markov decision processes (MDPs) with continuous state spaces. The basis functions for VFA can be automatically generated from spectral analysis of the graph Laplacian. The clustering-based graph Laplacian is integrated with a class of approximation policy iteration algorithms called representation policy iteration (RPI) for RL in MDPs with continuous state spaces. Simulation and experimental results show that, compared with previous RPI methods, the proposed approach needs fewer sample points to compute an efficient set of basis functions and the learning control performance can be improved for a variety of parameter settings.

The measurement and reinforcement of behavior of psychotics1

PubMed Central

Ayllon, T.; Azrin, N. H.

1965-01-01

An attempt was made to strengthen behaviors of psychotics by applying operant reinforcement principles in a mental hospital ward. The behaviors studied were necessary and/or useful for the patient to function in the hospital environment. Reinforcement consisted of the opportunity to engage in activities that had a high level of occurrence when freely allowed. Tokens were used as conditioned reinforcers to bridge the delay between behavior and reinforcement. Emphasis was placed on objective definition and quantification of the responses and reinforcers and upon programming and recording procedures. Standardizing the objective criteria permitted ward attendants to administer the program. The procedures were found to be effective in maintaining the desired adaptive behaviors for as long as the procedures were in effect. In a series of six experiments, reinforced behaviors were considerably reduced when the reinforcement procedure was discontinued; the adaptive behaviors increased immediately when the reinforcement procedure was re-introduced. PMID:5851397

Signaling added response-independent reinforcement to assess Pavlovian processes in resistance to change and relapse.

PubMed

Podlesnik, Christopher A; Fleet, James D

2014-09-01

Behavioral momentum theory asserts Pavlovian stimulus-reinforcer relations govern the persistence of operant behavior. Specifically, resistance to conditions of disruption (e.g., extinction, satiation) reflects the relation between discriminative stimuli and the prevailing reinforcement conditions. The present study assessed whether Pavlovian stimulus-reinforcer relations govern resistance to disruption in pigeons by arranging both response-dependent and -independent food reinforcers in two components of a multiple schedule. In one component, discrete-stimulus changes preceded response-independent reinforcers, paralleling methods that reduce Pavlovian conditioned responding to contextual stimuli. Compared to the control component with no added stimuli preceding response-independent reinforcement, response rates increased as discrete-stimulus duration increased (0, 5, 10, and 15 s) across conditions. Although resistance to extinction decreased as stimulus duration increased in the component with the added discrete stimulus, further tests revealed no effect of discrete stimuli, including other disrupters (presession food, intercomponent food, modified extinction) and reinstatement designed to control for generalization decrement. These findings call into question a straightforward conception that the stimulus-reinforcer relations governing resistance to disruption reflect the same processes as Pavlovian conditioning, as asserted by behavioral momentum theory. © Society for the Experimental Analysis of Behavior.

Flexural properties of denture base polymers reinforced with a glass cloth-urethane polymer composite.

PubMed

Kanie, Takahito; Arikawa, Hiroyuki; Fujii, Koichi; Ban, Seiji

2004-10-01

A newly designed light-cured reinforcement made from urethanemethacrylate oligomer and woven glass cloth has orthotropic anisotropy. This is produced for incorporation into the outermost position under the greatest tension in denture base resins. In this study, the flexural properties of self-, heat-, and light-curing reinforced resins were determined. The silanized glass cloth was soaked in urethanemethacrylate oligomer containing camphorquinone and 2-(dimethylamino)ethylmethacrylate. It was sandwiched between two pieces of polyethylene film and pressed to form a reinforcement sheet 0.3 mm in thickness, which was light-cured and prepared using four different surface conditions: with or without the polyethylene film and with or without a bonding agent. The reinforcement sheet was fixed in a fluorocarbon resin mold 3 mm in thickness, which was filled with self-, heat-, or light-curing resin and cured. The cured laminated plate was cut for flexural testing (40 x 7 x 3 mm3). A three-point flexural test was carried out at a crosshead speed of 2 mm/min and a span length of 30 mm. In this study, the glass fiber content was measured at percentages by weight because it was not possible to determine accurately the volume of the various polymers. The baseline flexural strengths of the self-, heat-, and light-curing resins were 76.2, 68.6, and 55.6 MPa, respectively, and these values were increased to 271.7, 216.4, and 266.5 MPa by the reinforcement sheet. The baseline flexural moduli of self-, heat-, and light-curing resins were 2.0, 2.4, and 2.1 GPa, respectively. These values were increased to 7.2, 5.1, and 6.6 GPa by the reinforcement sheet. SEM photographs revealed good impregnation of the glass fiber within the polymer matrix. The differences in the flexural strengths and flexural moduli of the control and reinforced specimens were significant (p < 0.01).

Intolerance of uncertainty and startle potentiation in relation to different threat reinforcement rates.

PubMed

Chin, Brian; Nelson, Brady D; Jackson, Felicia; Hajcak, Greg

2016-01-01

Fear conditioning research on threat predictability has primarily examined the impact of temporal (i.e., timing) predictability on the startle reflex. However, there are other key features of threat that can vary in predictability. For example, the reinforcement rate (i.e., frequency) of threat is a crucial factor underlying fear learning. The present study examined the impact of threat reinforcement rate on the startle reflex and self-reported anxiety during a fear conditioning paradigm. Forty-five participants completed a fear learning task in which the conditioned stimulus was reinforced with an electric shock to the forearm on 50% of trials in one block and 75% of trials in a second block, in counter-balanced order. The present study also examined whether intolerance of uncertainty (IU), the tendency to perceive or experience uncertainty as stressful or unpleasant, was associated with the startle reflex during conditions of low (50%) vs. high (75%) reinforcement. Results indicated that, across all participants, startle was greater during the 75% relative to the 50% reinforcement condition. IU was positively correlated with startle potentiation (i.e., increased startle response to the CS+ relative to the CS-) during the 50%, but not the 75%, reinforcement condition. Thus, despite receiving fewer electric shocks during the 50% reinforcement condition, individuals with high IU uniquely demonstrated greater defense system activation when impending threat was more uncertain. The association between IU and startle was independent of state anxiety. The present study adds to a growing literature on threat predictability and aversive responding, and suggests IU is associated with abnormal responding in the context of uncertain threat. Copyright © 2015 Elsevier B.V. All rights reserved.

Dynamics of layered reinforced concrete beam on visco-elastic foundation with different resistances of concrete and reinforcement to tension and compression

NASA Astrophysics Data System (ADS)

Nemirovsky, Y. V.; Tikhonov, S. V.

2018-03-01

Originally, fundamentals of the theory of limit equilibrium and dynamic deformation of building metal and reinforced concrete structures were created by A. A. Gvozdev [1] and developed by his followers [4, 5, 6, 7, 11, 12]. Forming the basis for the calculation, the model of an ideal rigid-plastic material has enabled to determine in many cases the ultimate load bearing capacity and upper (kinematically possible) or lower (statically valid) values for a wide class of different structures with quite simple methods. At the same time, applied to concrete structures the most important property of concrete to significantly differently resist tension and compression was not taken into account [10]. This circumstance was considered in [3] for reinforced concrete beams under conditions of quasistatic loading. The deformation is often accompanied by resistance of the environment in construction practice [8, 9]. In [2], the dynamics of multi-layered concrete beams on visco-elastic foundation under the loadings of explosive type is considered. In this work we consider the case which is often encountered in practical applications when the loadings weakly change in time.

Usual energy intake mediates the relationship between food reinforcement and BMI.

PubMed

Epstein, Leonard H; Carr, Katelyn A; Lin, Henry; Fletcher, Kelly D; Roemmich, James N

2012-09-01

The relative reinforcing value of food (RRV(food)) is positively associated with energy consumed and overweight status. One hypothesis relating these variables is that food reinforcement is related to BMI through usual energy intake. Using a sample of two hundred fifty-two adults of varying weight and BMI levels, results showed that usual energy intake mediated the relationship between RRV(food) and BMI (estimated indirect effect = 0.0027, bootstrapped 95% confidence intervals (CIs) 0.0002-0.0068, effect ratio = 0.34), controlling for age, sex, minority status, education, and reinforcing value of reading (RRV(reading)). Laboratory and usual energy intake were correlated (r = 0.24, P < 0.001), indicating that laboratory energy intake could provide an index of eating behavior in the natural environment. The mediational relationship observed suggests that increasing or decreasing food reinforcement could influence body weight by altering food consumption. Research is needed to develop methods of modifying RRV(food) to determine experimentally whether manipulating food reinforcement would result in changes in body weight.

Exclusive Preference Develops Less Readily on Concurrent Ratio Schedules with Wheel-Running than with Sucrose Reinforcement

PubMed Central

Belke, Terry W

2010-01-01

Previous research suggested that allocation of responses on concurrent schedules of wheel-running reinforcement was less sensitive to schedule differences than typically observed with more conventional reinforcers. To assess this possibility, 16 female Long Evans rats were exposed to concurrent FR FR schedules of reinforcement and the schedule value on one alternative was systematically increased. In one condition, the reinforcer on both alternatives was .1 ml of 7.5% sucrose solution; in the other, it was a 30-s opportunity to run in a wheel. Results showed that the average ratio at which greater than 90% of responses were allocated to the unchanged alternative was higher with wheel-running reinforcement. As the ratio requirement was initially increased, responding strongly shifted toward the unchanged alternative with sucrose, but not with wheel running. Instead, responding initially increased on both alternatives, then subsequently shifted toward the unchanged alternative. Furthermore, changeover responses as a percentage of total responses decreased with sucrose, but not wheel-running reinforcement. Finally, for some animals, responding on the increasing ratio alternative decreased as the ratio requirement increased, but then stopped and did not decline with further increments. The implications of these results for theories of choice are discussed. PMID:21451744

Exclusive preference develops less readily on concurrent ratio schedules with wheel-running than with sucrose reinforcement.

PubMed

Belke, Terry W

2010-09-01

Previous research suggested that allocation of responses on concurrent schedules of wheel-running reinforcement was less sensitive to schedule differences than typically observed with more conventional reinforcers. To assess this possibility, 16 female Long Evans rats were exposed to concurrent FR FR schedules of reinforcement and the schedule value on one alternative was systematically increased. In one condition, the reinforcer on both alternatives was .1 ml of 7.5% sucrose solution; in the other, it was a 30-s opportunity to run in a wheel. Results showed that the average ratio at which greater than 90% of responses were allocated to the unchanged alternative was higher with wheel-running reinforcement. As the ratio requirement was initially increased, responding strongly shifted toward the unchanged alternative with sucrose, but not with wheel running. Instead, responding initially increased on both alternatives, then subsequently shifted toward the unchanged alternative. Furthermore, changeover responses as a percentage of total responses decreased with sucrose, but not wheel-running reinforcement. Finally, for some animals, responding on the increasing ratio alternative decreased as the ratio requirement increased, but then stopped and did not decline with further increments. The implications of these results for theories of choice are discussed.

Renewal, Resurgence, and Alternative Reinforcement Context

PubMed Central

Sweeney, Mary M.; Shahan, Timothy A.

2015-01-01

Resurgence, relapse induced by the removal of alternative reinforcement, and renewal, relapse induced by a change in contextual stimuli, are typically studied separately in operant conditioning paradigms. In analogous treatments of operant problem behavior, aspects of both relapse phenomena can operate simultaneously. Therefore, the purpose of this study was to examine a novel method for studying resurgence and renewal in the same experimental preparation. An alternative source of reinforcement was available during extinction for one group of rats (a typical resurgence preparation). Another group experienced an operant renewal preparation in which the extinction context was distinguished via olfactory and visual stimuli. A third group experienced alternative reinforcement delivery in the new context, a novel combination of typical resurgence and renewal preparations. Removal of alternative reinforcement and/or a change in context induced relapse, relative to an extinction-only control group. When alternative reinforcement was delivered in a novel context, the alternative response was less persistent relative to when extinction of the alternative response took place in the context in which it was trained. This methodology might be used to illustrate shared (or distinct) mechanisms of resurgence and renewal, and to determine how delivering alternative reinforcement in another context may affect persistence and relapse. PMID:25936876

Reinforcement magnitude: an evaluation of preference and reinforcer efficacy.

PubMed

Trosclair-Lasserre, Nicole M; Lerman, Dorothea C; Call, Nathan A; Addison, Laura R; Kodak, Tiffany

2008-01-01

Consideration of reinforcer magnitude may be important for maximizing the efficacy of treatment for problem behavior. Nonetheless, relatively little is known about children's preferences for different magnitudes of social reinforcement or the extent to which preference is related to differences in reinforcer efficacy. The purpose of the current study was to evaluate the relations among reinforcer magnitude, preference, and efficacy by drawing on the procedures and results of basic experimentation in this area. Three children who engaged in problem behavior that was maintained by social positive reinforcement (attention, access to tangible items) participated. Results indicated that preference for different magnitudes of social reinforcement may predict reinforcer efficacy and that magnitude effects may be mediated by the schedule requirement.

Effects of machining conditions on the specific cutting energy of carbon fibre reinforced polymer composites

NASA Astrophysics Data System (ADS)

Azmi, A. I.; Syahmi, A. Z.; Naquib, M.; Lih, T. C.; Mansor, A. F.; Khalil, A. N. M.

2017-10-01

This article presents an approach to evaluate the effects of different machining conditions on the specific cutting energy of carbon fibre reinforced polymer composites (CFRP). Although research works in the machinability of CFRP composites have been very substantial, the present literature rarely discussed the topic of energy consumption and the specific cutting energy. A series of turning experiments were carried out on two different CFRP composites in order to determine the power and specific energy constants and eventually evaluate their effects due to the changes in machining conditions. A good agreement between the power and material removal rate using a simple linear relationship. Further analyses revealed that a power law function is best to describe the effect of feed rate on the changes in the specific cutting energy. At lower feed rate, the specific cutting energy increases exponentially due to the nature of finishing operation, whereas at higher feed rate, the changes in specific cutting energy is minimal due to the nature of roughing operation.

Effects of cement alkalinity, exposure conditions and steel-concrete interface on the time-to-corrosion and chloride threshold for reinforcing steel in concrete

NASA Astrophysics Data System (ADS)

Nam, Jingak

Effects of (1) cement alkalinity (low, normal and high), (2) exposure conditions (RH and temperature), (3) rebar surface condition (as-received versus cleaned) and (4) density and distribution of air voids at the steel-concrete interface on the chloride threshold and time-to-corrosion for reinforcing steel in concrete have been studied. Also, experiments were performed to evaluate effects of RH and temperature on the diffusion of chloride in concrete and develop a method for ex-situ pH measurement of concrete pore water. Once specimens were fabricated and exposed to a corrosive chloride solution, various experimental techniques were employed to determine time-to-corrosion, chloride threshold, diffusion coefficient and void density along the rebar trace as well as pore water pH. Based upon the resultant data, several findings related to the above parameters have been obtained as summarized below. First, time for the corrosion initiation was longest for G109 concrete specimens with high alkalinity cement (HA). Also, chloride threshold increased with increasing time-to-corrosion and cement alkalinity. Consequently, the HA specimens exhibited the highest chloride threshold compared to low and normal alkalinity ones. Second, high temperature and temperature variations reduced time-to-corrosion of reinforcing steel in concrete since chloride diffusion was accelerated at higher temperature and possibly by temperature variations. The lowest chloride threshold values were found for outdoor exposed specimens suggesting that variation of RH or temperature (or both) facilitated rapid chloride diffusion. Third, an elevated time-to-corrosion and chloride threshold values were found for the wire brushed steel specimens compared to as-received ones. The higher ratio of [OH-]/[Fe n+] on the wire brushed steel surface compared to that of as-received case can be the possible cause because the higher ratio of this parameter enables the formation of a more protective passive film on

Strain rate effects on reinforcing steels in tension

NASA Astrophysics Data System (ADS)

Cadoni, Ezio; Forni, Daniele

2015-09-01

It is unquestionable the fact that a structural system should be able to fulfil the function for which it was created, without being damaged to an extent disproportionate to the cause of damage. In addition, it is an undeniable fact that in reinforced concrete structures under severe dynamic loadings, both concrete and reinforcing bars are subjected to high strain-rates. Although the behavior of the reinforcing steel under high strain rates is of capital importance in the structural assessment under the abovementioned conditions, only the behaviour of concrete has been widely studied. Due to this lack of data on the reinforcing steel under high strain rates, an experimental program on rebar reinforcing steels under high strain rates in tension is running at the DynaMat Laboratory. In this paper a comparison of the behaviour in a wide range of strain-rates of several types of reinforcing steel in tension is presented. Three reinforcing steels, commonly proposed by the European Standards, are compared: B500A, B500B and B500C. Lastly, an evaluation of the most common constitutive laws is performed.

The probability of reinforcement per trial affects posttrial responding and subsequent extinction but not within-trial responding.

PubMed

Harris, Justin A; Kwok, Dorothy W S

2018-01-01

During magazine approach conditioning, rats do not discriminate between a conditional stimulus (CS) that is consistently reinforced with food and a CS that is occasionally (partially) reinforced, as long as the CSs have the same overall reinforcement rate per second. This implies that rats are indifferent to the probability of reinforcement per trial. However, in the same rats, the per-trial reinforcement rate will affect subsequent extinction-responding extinguishes more rapidly for a CS that was consistently reinforced than for a partially reinforced CS. Here, we trained rats with consistently and partially reinforced CSs that were matched for overall reinforcement rate per second. We measured conditioned responding both during and immediately after the CSs. Differences in the per-trial probability of reinforcement did not affect the acquisition of responding during the CS but did affect subsequent extinction of that responding, and also affected the post-CS response rates during conditioning. Indeed, CSs with the same probability of reinforcement per trial evoked the same amount of post-CS responding even when they differed in overall reinforcement rate and thus evoked different amounts of responding during the CS. We conclude that reinforcement rate per second controls rats' acquisition of responding during the CS, but at the same time, rats also learn specifically about the probability of reinforcement per trial. The latter learning affects the rats' expectation of reinforcement as an outcome of the trial, which influences their ability to detect retrospectively that an opportunity for reinforcement was missed, and, in turn, drives extinction. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Effects of reinforcement on children's academic behavior as a function of self-determined and externally imposed contingencies1

PubMed Central

Felixbrod, Jeffrey J.; O'Leary, K. Daniel

1973-01-01

This experiment was designed to compare the effects of contingent reinforcement under conditions of self-determined and externally imposed performance standards. A major purpose was to examine the maintenance of self-imposed performance standards over time. Children in one contingent reinforcement condition self-determined their academic performance standards. The same performance standards were externally imposed upon children in a second contingent reinforcement condition who were yoked to subjects in the first condition. Children in a no-reinforcement control condition performed in the absence of external reward. Behavioral productivity of the self-determination condition was greater than that of the no-reinforcement condition. Further, no attenuation of the efficacy of contingent reinforcement occurred when performance standards were self-determined rather than externally imposed. Over six sessions, children became progressively more lenient in their self-imposed performance demands in the absence of social surveillance. PMID:16795405

Reinforcement Magnitude: An Evaluation of Preference and Reinforcer Efficacy

PubMed Central

Trosclair-Lasserre, Nicole M; Lerman, Dorothea C; Call, Nathan A; Addison, Laura R; Kodak, Tiffany

2008-01-01

Consideration of reinforcer magnitude may be important for maximizing the efficacy of treatment for problem behavior. Nonetheless, relatively little is known about children's preferences for different magnitudes of social reinforcement or the extent to which preference is related to differences in reinforcer efficacy. The purpose of the current study was to evaluate the relations among reinforcer magnitude, preference, and efficacy by drawing on the procedures and results of basic experimentation in this area. Three children who engaged in problem behavior that was maintained by social positive reinforcement (attention, access to tangible items) participated. Results indicated that preference for different magnitudes of social reinforcement may predict reinforcer efficacy and that magnitude effects may be mediated by the schedule requirement. PMID:18595284

The Effects of Reinforcement Magnitude on Skill Acquisition for Children with Autism

ERIC Educational Resources Information Center

Paden, Amber R.; Kodak, Tiffany

2015-01-01

We examined the effects of reinforcement magnitude on skill acquisition during discrete-trial training. After conducting a magnitude preference assessment, we compared acquisition during conditions with large and small magnitudes of edible reinforcement to a praise-only condition. Although all participants showed a preference for the…

Performance of universal adhesives on bonding to leucite-reinforced ceramic.

PubMed

Kim, Ryan Jin-Young; Woo, Jung-Soo; Lee, In-Bog; Yi, Young-Ah; Hwang, Ji-Yun; Seo, Deog-Gyu

2015-01-01

This study aimed to investigate the microshear bond strength of universal bonding adhesives to leucite-reinforced glass-ceramic. Leucite-reinforced glass-ceramic blocks were polished and etched with 9.5% hydrofluoric acid for 1 min. The specimens were assigned to one of four groups based on their surface conditioning (n = 16): 1) NC: negative control with no further treatment; 2) SBU: Single Bond Universal (3M ESPE); 3) ABU: ALL-BOND Universal (Bisco); and 4) PC: RelyX Ceramic Primer and Adper Scotchbond Multi-Purpose Adhesive (3M ESPE) as a positive control. RelyX Ultimate resin cement (3M ESPE) was placed on the pretreated ceramic and was light cured. Eight specimens from each group were stored in water for 24 h, and the remaining eight specimens were thermocycled 10,000 times prior to microshear bond strength evaluation. The fractured surfaces were examined by stereomicroscopy and scanning electron microscopy (SEM). After water storage and thermocycling, the microshear bond strength values decreased in the order of PC > SBU and ABU > NC (P < 0.05). Thermocycling significantly reduced the microshear bond strength, regardless of the surface conditioning used (P < 0.05). Cohesive failure in the ceramic and mixed failure in the ceramic and resin cement were observed in the fractured specimens. The percentage of specimens with cohesive failure after 24 h of water storage was: NC (50%), SBU (75%), ABU (75%), and PC (87%). After thermocycling, the percentage of cohesive failure in NC decreased to 25%; however, yet the percentages of the other groups remained the same. Although the bond strength between resin and hydrofluoric acid-etched glass ceramic was improved when universal adhesives were used, conventional surface conditioning using a separate silane and adhesive is preferable to a simplified procedure that uses only a universal adhesive for cementation of leucite-reinforced glass-ceramic.

Place preference and vocal learning rely on distinct reinforcers in songbirds.

PubMed

Murdoch, Don; Chen, Ruidong; Goldberg, Jesse H

2018-04-30

In reinforcement learning (RL) agents are typically tasked with maximizing a single objective function such as reward. But it remains poorly understood how agents might pursue distinct objectives at once. In machines, multiobjective RL can be achieved by dividing a single agent into multiple sub-agents, each of which is shaped by agent-specific reinforcement, but it remains unknown if animals adopt this strategy. Here we use songbirds to test if navigation and singing, two behaviors with distinct objectives, can be differentially reinforced. We demonstrate that strobe flashes aversively condition place preference but not song syllables. Brief noise bursts aversively condition song syllables but positively reinforce place preference. Thus distinct behavior-generating systems, or agencies, within a single animal can be shaped by correspondingly distinct reinforcement signals. Our findings suggest that spatially segregated vocal circuits can solve a credit assignment problem associated with multiobjective learning.

Geogrid reinforced road subgrade influence on the pavement evenness

NASA Astrophysics Data System (ADS)

Šiukščius, A.; Vorobjovas, V.; Vaitkus, A.

2018-05-01

As a result of increasing geogrid reinforcement applications in the road subgrade, there are number of projects where geogrid reinforcement is used to control road pavement evenness when there are small layers of peat or mud deeper under road construction. For this task geogrid reinforcement application is not documented but widely used in Lithuania for over a decade. This paper evaluates the long term influence of the geogrid reinforced soil influence on the road surface evenness, when the organic soils stratify in the deeper layers of the subgrade. The geological conditions of the investigated sections are reviewed. The experiment methodology and test results are described, which leads to the conclusions and insights how the pavement evenness depend on the geological conditions and its enhancement. The question is raised about the need for including this geogrid application to the normative documentation. Explanation of the problems that are encountered and the need for further research is given.

Autoshaping the pigeon's gape response: acquisition and topography as a function of reinforcer type and magnitude.

PubMed Central

Allan, R W; Zeigler, H P

1994-01-01

The pigeon's key-pecking response is experimentally dissociable into transport (head movement) and gape (jaw movement) components. During conditioning of the key-pecking response, both components come under the control of the conditioned stimulus. To study the acquisition of gape conditioned responses and to clarify the contribution of unconditioned stimulus (reinforcer) variables to the form of the response, gape and key-contact responses were recorded during an autoshaping procedure and reinforcer properties were systematically varied. One group of 8 pigeons was food deprived and subgroups of 2 birds each were exposed to four different pellet sizes as reinforcers, each reinforcer signaled by a keylight conditioned stimulus. A second group was water deprived and received water reinforcers paired with the conditioned stimulus. Water- or food-deprived control groups received appropriate water or food reinforcers that were randomly delivered with respect to the keylight stimulus. Acquisition of the conditioned gape response frequently preceded key-contact responses, and gape conditioned responses were generally elicited at higher rates than were key contacts. The form of the conditioned gape was similar to, but not identical with, the form of the unconditioned gape. The gape component is a critical topographical feature of the conditioned key peck, a sensitive measure of conditioning during autoshaping, and an important source of the observed similarities in the form of conditioned and consummatory responses. PMID:7964365

Autoshaping the pigeon's gape response: acquisition and topography as a function of reinforcer type and magnitude.

PubMed

Allan, R W; Zeigler, H P

1994-09-01

The pigeon's key-pecking response is experimentally dissociable into transport (head movement) and gape (jaw movement) components. During conditioning of the key-pecking response, both components come under the control of the conditioned stimulus. To study the acquisition of gape conditioned responses and to clarify the contribution of unconditioned stimulus (reinforcer) variables to the form of the response, gape and key-contact responses were recorded during an autoshaping procedure and reinforcer properties were systematically varied. One group of 8 pigeons was food deprived and subgroups of 2 birds each were exposed to four different pellet sizes as reinforcers, each reinforcer signaled by a keylight conditioned stimulus. A second group was water deprived and received water reinforcers paired with the conditioned stimulus. Water- or food-deprived control groups received appropriate water or food reinforcers that were randomly delivered with respect to the keylight stimulus. Acquisition of the conditioned gape response frequently preceded key-contact responses, and gape conditioned responses were generally elicited at higher rates than were key contacts. The form of the conditioned gape was similar to, but not identical with, the form of the unconditioned gape. The gape component is a critical topographical feature of the conditioned key peck, a sensitive measure of conditioning during autoshaping, and an important source of the observed similarities in the form of conditioned and consummatory responses.

Store operation with conditional push of a tag value to a queue

DOEpatents

Heidelberger, Philip; Steinmacher-Burow, Burkhard

2015-07-28

According to one embodiment, a method for a store operation with a conditional push of a tag value to a queue is provided. The method includes configuring a queue that is accessible by an application, setting a value at an address in a memory device including a memory and a controller, receiving a request for an operation using the value at the address and performing the operation. The method also includes the controller writing a result of the operation to the address, thus changing the value at the address, the controller determining if the result of the operation meets a condition and the controller pushing a tag value to the queue based on the condition being met, where the tag value in the queue indicates to the application that the condition is met.

Reinforcement of flowable dental composites with titanium dioxide nanotubes.

PubMed

Dafar, Manal O; Grol, Matthew W; Canham, Peter B; Dixon, S Jeffrey; Rizkalla, Amin S

2016-06-01

Flowable dental composites are used as restorative materials due to their excellent esthetics and rheology. However, they suffer from inferior mechanical properties compared to conventional composites. The aim of this study was to reinforce a flowable dental composite with TiO2 nanotubes (n-TiO2) and to assess the effect of n-TiO2 surface modifications on the mechanical properties of the reinforced composite. n-TiO2 were synthesized using an alkaline hydrothermal process and then functionalized with silane or methacrylic acid (MA). Nanotubes were characterized by scanning and transmission electron microscopy, X-ray diffraction, energy-dispersive X-ray spectroscopy and Fourier transform infrared spectroscopy. Commercially available flowable composite (Filtek™ Supreme Ultra Flowable Restorative, 3M ESPE) was reinforced with varying amounts of nanotubes (0-5wt%). Flowability of the resulting composites was evaluated using a Gillmore needle method. Dynamic Young's modulus (E) was measured using an ultrasonic technique. Fracture toughness (KIc) was assessed using a notchless triangular prism and radiopacity was quantified. Viability of NIH/3T3 fibroblasts was evaluated following incubation on composite specimens for 24h. Electron microscopy revealed a tubular morphology of n-TiO2. All reinforced composites exhibited significantly greater values of E than unreinforced composite. Composites reinforced with 3wt% n-TiO2 functionalized with MA exhibited the greatest values of E and KIc. Cytotoxicity assays revealed that reinforced composites were biocompatible. Taken together, flowable composites reinforced with n-TiO2 exhibited mechanical properties superior to those of unreinforced composite, with minimal effects on flowability and radiopacity. n-TiO2-reinforced flowable composites are promising materials for use in dental restorations. Copyright © 2016 Academy of Dental Materials. Published by Elsevier Ltd. All rights reserved.

Neurofeedback in Learning Disabled Children: Visual versus Auditory Reinforcement.

PubMed

Fernández, Thalía; Bosch-Bayard, Jorge; Harmony, Thalía; Caballero, María I; Díaz-Comas, Lourdes; Galán, Lídice; Ricardo-Garcell, Josefina; Aubert, Eduardo; Otero-Ojeda, Gloria

2016-03-01

Children with learning disabilities (LD) frequently have an EEG characterized by an excess of theta and a deficit of alpha activities. NFB using an auditory stimulus as reinforcer has proven to be a useful tool to treat LD children by positively reinforcing decreases of the theta/alpha ratio. The aim of the present study was to optimize the NFB procedure by comparing the efficacy of visual (with eyes open) versus auditory (with eyes closed) reinforcers. Twenty LD children with an abnormally high theta/alpha ratio were randomly assigned to the Auditory or the Visual group, where a 500 Hz tone or a visual stimulus (a white square), respectively, was used as a positive reinforcer when the value of the theta/alpha ratio was reduced. Both groups had signs consistent with EEG maturation, but only the Auditory Group showed behavioral/cognitive improvements. In conclusion, the auditory reinforcer was more efficacious in reducing the theta/alpha ratio, and it improved the cognitive abilities more than the visual reinforcer.

Separation of Time-Based and Trial-Based Accounts of the Partial Reinforcement Extinction Effect

PubMed Central

Bouton, Mark E.; Woods, Amanda M.; Todd, Travis P.

2013-01-01

Two appetitive conditioning experiments with rats examined time-based and trial-based accounts of the partial reinforcement extinction effect (PREE). In the PREE, the loss of responding that occurs in extinction is slower when the conditioned stimulus (CS) has been paired with a reinforcer on some of its presentations (partially reinforced) instead of every presentation (continuously reinforced). According to a time-based or “time-accumulation” view (e.g., Gallistel & Gibbon, 2000), the PREE occurs because the organism has learned in partial reinforcement to expect the reinforcer after a larger amount of time has accumulated in the CS over trials. In contrast, according to a trial-based view (e.g., Capaldi, 1967), the PREE occurs because the organism has learned in partial reinforcement to expect the reinforcer after a larger number of CS presentations. Experiment 1 used a procedure that equated partially- and continuously-reinforced groups on their expected times to reinforcement during conditioning. A PREE was still observed. Experiment 2 then used an extinction procedure that allowed time in the CS and the number of trials to accumulate differentially through extinction. The PREE was still evident when responding was examined as a function of expected time units to the reinforcer, but was eliminated when responding was examined as a function of expected trial units to the reinforcer. There was no evidence that the animal responded according to the ratio of time accumulated during the CS in extinction over the time in the CS expected before the reinforcer. The results thus favor a trial-based account over a time-based account of extinction and the PREE. PMID:23962669

The role of contextual associations in producing the partial reinforcement acquisition deficit.

PubMed

Miguez, Gonzalo; Witnauer, James E; Miller, Ralph R

2012-01-01

Three conditioned suppression experiments with rats as subjects assessed the contributions of the conditioned stimulus (CS)-context and context-unconditioned stimulus (US) associations to the degraded stimulus control by the CS that is observed following partial reinforcement relative to continuous reinforcement training. In Experiment 1, posttraining associative deflation (i.e., extinction) of the training context after partial reinforcement restored responding to a level comparable to the one produced by continuous reinforcement. In Experiment 2, posttraining associative inflation of the context (achieved by administering unsignaled outcome presentations in the context) enhanced the detrimental effect of partial reinforcement. Experiment 3 found that the training context must be an effective competitor to produce the partial reinforcement acquisition deficit. When the context was down-modulated, the target regained behavioral control thereby demonstrating higher-order retrospective revaluation. The results are discussed in terms of retrospective revaluation, and are used to contrast the predictions of a performance-focused model with those of an acquisition-focused model. (c) 2012 APA, all rights reserved.

Reinforced Carbon Nanotubes.

DOEpatents

Ren, Zhifen; Wen, Jian Guo; Lao, Jing Y.; Li, Wenzhi

2005-06-28

The present invention relates generally to reinforced carbon nanotubes, and more particularly to reinforced carbon nanotubes having a plurality of microparticulate carbide or oxide materials formed substantially on the surface of such reinforced carbon nanotubes composite materials. In particular, the present invention provides reinforced carbon nanotubes (CNTs) having a plurality of boron carbide nanolumps formed substantially on a surface of the reinforced CNTs that provide a reinforcing effect on CNTs, enabling their use as effective reinforcing fillers for matrix materials to give high-strength composites. The present invention also provides methods for producing such carbide reinforced CNTs.

Noncontingent reinforcement competes with response performance.

PubMed

Kelley, Michael E; Nadler, Cy B; Rey, Catalina; Cowie, Sarah; Podlesnik, Christopher A

2017-05-01

Noncontingent reinforcement is a commonly used procedure to decrease levels of problem behavior. Goals of this intervention are to decrease motivation, responding, and the functional relation between behavior and consequences, but it could also possibly compete with performance of alternative desirable responses. In the current study, we assessed the effects of noncontingent reinforcement arranged from 0% to 100% of sessions on performance of alternative responding across two experiments. Experiment 1 assessed manding (i.e., requests) maintained by attention and tangibles with a child with developmental disabilities and Experiment 2 assessed keypecking maintained by food with six pigeons. We extended previous research by (a) showing that noncontingent reinforcement competes with both the acquisition and maintenance (performance) of an alternative response, (b) extending the generality of the findings across nonhuman and human participants, and (c) eliminating influence of sequence effects through random manipulations of noncontingent value in pigeons. Overall, greater amounts of noncontingent reinforcement competed with both acquisition and maintenance of alternative responding. © 2017 Society for the Experimental Analysis of Behavior.

Composite strengthening. [of nonferrous, fiber reinforced alloys

NASA Technical Reports Server (NTRS)

Stoloff, N. S.

1976-01-01

The mechanical behavior of unidirectionally reinforced metals is examined, with particular attention to fabrication techniques for artificial composites and eutectic alloys and to principles of fiber reinforcement. The properties of artificial composites are discussed in terms of strength of fiber composites, strength of ribbon-reinforced composites, crack initiation, crack propagation, and creep behavior. The properties of eutectic composites are examined relative to tensile strength, compressive strength, fracture, high-temperature strength, and fatigue. In the case of artificial composites, parallelism of fibers, good bonding between fibers and matrix, and freedom of fibers from damage are all necessary to ensure superior performance. For many eutectic systems there are stringent boundary conditions relative to melt purity and superheat, atmosphere control, temperature gradient, and growth rate in order to provide near-perfect alignment of the reinforcements with a minimum of growth defects.

Nicotine enhancement and reinforcer devaluation: Interaction with opioid receptors.

PubMed

Kirshenbaum, Ari P; Suhaka, Jesse A; Phillips, Jessie L; Voltolini de Souza Pinto, Maiary

In rats, nicotine enhances responding maintained by non-pharmacological reinforcers, and discontinuation of nicotine devalues those same reinforcers. The goal of this study was to assess the interaction of nicotine and opioid receptors and to evaluate the degree to which nicotine enhancement and nicotine-induced devaluation are related to opioid activation. Nicotine (0.4mg/kg), or nicotine plus naloxone (0.3 or 3.0mg/kg), was delivered to rats prior to progressive ratio (PR) schedule sessions in which sucrose was used as a reinforcer. PR-schedule responding was assessed during ten daily sessions of drug delivery, and for three post-dosing days/sessions. Control groups for this investigation included a saline-only condition, and naloxone-only (0.3 or 3.0mg/kg) conditions. When administered in conjunction with nicotine, both naloxone doses attenuated nicotine enhancement of the sucrose reinforcer, and the combination of the larger dose of naloxone (3.0mg/kg) with nicotine produced significant impairments in sucrose reinforced responding. When administered alone, neither dose of naloxone (0.3 & 3.0mg/kg) significantly altered responding in comparison to saline. Furthermore, when dosing was discontinued after ten once-daily doses, all nicotine groups (nicotine-only and nicotine+naloxone combination) demonstrated significant decreases in sucrose reinforcement compared to the saline group. Although opioid antagonism attenuated reinforcement enhancement by nicotine, it did not prevent reinforcer devaluation upon discontinuation of nicotine dosing, and the higher dose of naloxone (3.0mg/kg) produced decrements upon discontinuation on its own in the absence of nicotine. Copyright © 2016 Elsevier Inc. All rights reserved.

Daily exposure to either a high- or low-energy-dense snack food reduces its reinforcing value in adolescents.

PubMed

Temple, Jennifer L; Van der Kloet, Erika; Atkins, Amanda M; Crandall, Amanda K; Ziegler, Amanda M

2017-02-01

To examine the impact of daily exposure to a low-energy-dense (LED) or a high-energy-dense (HED) snack food on its reinforcing value (RRV) in adolescents with healthy weight, overweight, or obesity. A parallel-group, randomized trial was used to assess RRV of LED or HED snack food at baseline and again after exposure to that snack food daily for 2 weeks in 77 adolescents, aged 13 to 17 years. Information on eating-related subject characteristics was also collected at baseline. After 2 weeks of daily exposure, the RRV of the snack foods was significantly reduced in all participants, regardless of energy density or participant weight status. Among individuals who were high in dietary restraint only, those randomized to LED food found their snack food less reinforcing at baseline than those who were randomized to HED food. Baseline eating-related variables also differed as a function of weight status. Daily exposure to snack food in adolescents reduces the RRV of that food regardless of snack food energy density or weight status of the adolescent. This finding differs from adults, suggesting that increases in RRV of HED food after repeated exposure may develop after adolescence. © 2017 The Obesity Society.

Pulsed co-electrodeposition and characterization of Ni-based nanocomposites reinforced with combustion-synthesized, undoped, tetragonal-ZrO(2) particulates.

PubMed

Reddy, B S B; Das, Karabi; Datta, Amal Kumar; Das, Siddhartha

2008-03-19

Nanostructured nickel matrix composites reinforced with nanosized, undoped, tetragonal zirconia has been synthesized by cathodic pulsed electrodeposition. The reinforcement is synthesized by the aqueous combustion synthesis route with glycine as the fuel and zirconyl nitrate as the oxidizer. The reinforcement and composite have been characterized by XRD, TEM and SEM coupled with EDS. The microhardness and thermal stability (Kissinger method) of the composite are evaluated. These values are compared with those of pure nickel deposited under the same conditions. The results show that the microhardness of the nickel matrix is enhanced by the presence of the reinforcement from 450 to 575 VHN. Also the strengthening due to grain size effects and dispersion strengthening effect are evaluated individually and the interparticle separation is estimated to be around 85 nm. The volume fraction of the reinforcement is estimated to be 12-15% and the particles are uniformly distributed and monodispersed in the nickel matrix. The thermal stability of the composite is better than that of pure nickel in contrast to some of the reported literature.

Fatigue Behavior of Crystalline-Reinforced Glass-Ceramics.

PubMed

Vicari, Carolina Barbosa; Magalhães, Bárbara de Oliveira; Griggs, Jason Alan; Borba, Márcia

2018-01-03

To evaluate the fatigue behavior of two crystalline-reinforced ceramics: leucite-reinforced (VL) and lithium disilicate-based (VD) glass-ceramics. Bar-shaped specimens (16 × 4 × 1.2 mm) were produced for each ceramic using prefabricated CAD/CAM blocks. For each group, 30 specimens were subjected to a three-point flexural strength test in a universal testing machine. For VL and VD, 36 and 41 specimens were subjected to a cyclic fatigue test, respectively. The cyclic fatigue test was performed with a pneumatic mechanical cycling machine (1 Hz; 37°C distilled water). Specimens were tested at two stress levels for each preset lifetime (10 3 and 10 4 cycles for VL; 10 4 and 10 5 cycles for VD) following the boundary technique. Fractography was performed with a scanning electron microscope. Data were analyzed with Weibull analysis. There were significant differences among groups for characteristic strength (σ 0 ) and Weibull modulus (m), as the confidence intervals did not overlap. The VD group presented the highest values of σ 0 , but the lowest Weibull modulus. Both groups showed a reduction of approximately 60% of the initial flexural strength (σ f ) after cycling for 10 4 cycles. For VD tested in fatigue, there was no degradation of σ f when the number of cycles was increased from 10 4 to 10 5 . The VL group showed an 18% decrease in σ f when the number of cycles increased from 10 3 to 10 4 . Flexural strength values estimated for a 5% probability of failure were 36 MPa for VL and 55 MPa for VD, after 10 4 cycles. Both glass-ceramics showed similar strength degradation (60%) after a lifetime of 10 4 cycles, despite their distinct mechanical properties. Mechanical cycling in humid conditions proved to be an important factor for the degradation of the mechanical properties of crystalline-reinforced glass-ceramics. © 2018 by the American College of Prosthodontists.

Making the Sour Sweet? Upcoming Food-Pellet Reinforcement Produces Positive Induction When Rats Press a Lever for Unsweetened Lemon Juice

ERIC Educational Resources Information Center

Weatherly, Jeffrey N.; Nurnberger, Jeri T.; Austin, David P.; Wright, Carol L.

2006-01-01

Research has suggested that rats increase their response rate for a low-valued reinforcer when a high-valued reinforcer will soon be available (i.e., positive induction) because the value of the low-valued substance has increased. The present study tested if such a procedure could be used to increase rats' responding for a non-reinforcing food.…

Value conditioning modulates visual working memory processes.

PubMed

Thomas, Paul M J; FitzGibbon, Lily; Raymond, Jane E

2016-01-01

Learning allows the value of motivationally salient events to become associated with stimuli that predict those events. Here, we asked whether value associations could facilitate visual working memory (WM), and whether such effects would be valence dependent. Our experiment was specifically designed to isolate value-based effects on WM from value-based effects on selective attention that might be expected to bias encoding. In a simple associative learning task, participants learned to associate the color of tinted faces with gaining or losing money or neither. Tinted faces then served as memoranda in a face identity WM task for which previously learned color associations were irrelevant and no monetary outcomes were forthcoming. Memory was best for faces with gain-associated tints, poorest for faces with loss-associated tints, and average for faces with no-outcome-associated tints. Value associated with 1 item in the WM array did not modulate memory for other items in the array. Eye movements when studying faces did not depend on the valence of previously learned color associations, arguing against value-based biases being due to differential encoding. This valence-sensitive value-conditioning effect on WM appears to result from modulation of WM maintenance processes. (c) 2015 APA, all rights reserved).

Quasi-reinforcement: control of responding by a percentage-reinforcement schedule1

PubMed Central

Neuringer, Allen J.; Chung, Shin-Ho

1967-01-01

When a variable-interval schedule of reinforcement was segmented into small fixed-interval components, with reinforcements following some components and brief blackouts following the others, rate of responding doubled and a positively accelerated pattern within each component was obtained. Presented according to this percentage reinforcement paradigm, the blackouts approximated the functions of a food reinforcer. These effects occurred only when the behavior sequence required to produce reinforcement was identical to that required to produce blackout. The quasi-reinforcing effects of these blackout stimuli suggest that a neutral stimulus need not occasion or accompany a primary reinforcer to acquire reinforcing properties. PMID:16811304

Testing the linearity and independence assumptions of the generalized matching law for reinforcer magnitude: a residual meta-analysis.

PubMed

Cording, Jacinta R; McLean, Anthony P; Grace, Randolph C

2011-05-01

We conducted a residual meta-analysis to test the assumptions of the generalized matching law that effects of relative reinforcer magnitude on response allocation in concurrent schedules can be described by a power function and are independent from the effects of relative reinforcer rate. We identified five studies which varied magnitude ratios over at least four levels and six studies in which reinforcer rate and magnitude ratios were varied factorially. The generalized matching law provided a reasonably good description of the data, accounting for 77.1% and 90.1% of the variance in the two sets of studies. Results of polynomial regressions showed that there were no systematic patterns in pooled residuals as a function of predicted log response ratios for data sets in which relative magnitude was varied. For data sets in which relative rate and magnitude were varied factorially, there was a significant negative cubic pattern in the pooled residuals, suggesting that obtained response allocation was less extreme than predicted for conditions with extreme predicted values. However, subsequent analyses showed that this result was associated with results from conditions in one study in which the product of the rate and magnitude ratios was 63:1, and in which response allocation may have been attenuated by a ceiling effect. When data from these conditions were omitted, there were no significant components in the residuals. Although the number of available studies was small, results provide tentative support for the assumptions of the generalized matching law that effects of reinforcer magnitude ratios on choice can be described by a power function and are independent from reinforcer rate ratios. Copyright © 2011 Elsevier B.V. All rights reserved.

Experimental Investigations on the Pull-Out Behavior of Tire Strips Reinforced Sands

PubMed Central

Li, Li-Hua; Chen, Yan-Jun; Ferreira, Pedro Miguel Vaz; Liu, Yong; Xiao, Heng-Lin

2017-01-01

Waste tires have excellent mechanical performance and have been used as reinforcing material in geotechnical engineering; however, their interface properties are poorly understood. To further our knowledge, this paper examines the pull-out characteristics of waste tire strips in a compacted sand, together with uniaxial and biaxial geogrids also tested under the same conditions. The analysis of the results shows that the interlocking effect and pull-out resistance between the tire strip and the sand is very strong and significantly higher than that of the geogrids. In the early stages of the pull-out test, the resistance is mainly provided by the front portion of the embedded tire strips, as the pull-out test continues, more and more of the areas towards the end of the tire strips are mobilized, showing a progressive failure mechanism. The deformations are proportional to the frictional resistance between the tire-sand interface, and increase as the normal stresses increase. Tire strips of different wear intensities were tested and presented different pull-out resistances; however, the pull-out resistance mobilization patterns were generally similar. The pull-out resistance values obtained show that rubber reinforcement can provide much higher pull-out forces than the geogrid reinforcements tested here, showing that waste tires are an excellent alternative as a reinforcing system, regardless of the environmental advantages. PMID:28773069

Experimental Investigations on the Pull-Out Behavior of Tire Strips Reinforced Sands.

PubMed

Li, Li-Hua; Chen, Yan-Jun; Ferreira, Pedro Miguel Vaz; Liu, Yong; Xiao, Heng-Lin

2017-06-27

Waste tires have excellent mechanical performance and have been used as reinforcing material in geotechnical engineering; however, their interface properties are poorly understood. To further our knowledge, this paper examines the pull-out characteristics of waste tire strips in a compacted sand, together with uniaxial and biaxial geogrids also tested under the same conditions. The analysis of the results shows that the interlocking effect and pull-out resistance between the tire strip and the sand is very strong and significantly higher than that of the geogrids. In the early stages of the pull-out test, the resistance is mainly provided by the front portion of the embedded tire strips, as the pull-out test continues, more and more of the areas towards the end of the tire strips are mobilized, showing a progressive failure mechanism. The deformations are proportional to the frictional resistance between the tire-sand interface, and increase as the normal stresses increase. Tire strips of different wear intensities were tested and presented different pull-out resistances; however, the pull-out resistance mobilization patterns were generally similar. The pull-out resistance values obtained show that rubber reinforcement can provide much higher pull-out forces than the geogrid reinforcements tested here, showing that waste tires are an excellent alternative as a reinforcing system, regardless of the environmental advantages.

High and low temperatures have unequal reinforcing properties in Drosophila spatial learning.

PubMed

Zars, Melissa; Zars, Troy

2006-07-01

Small insects regulate their body temperature solely through behavior. Thus, sensing environmental temperature and implementing an appropriate behavioral strategy can be critical for survival. The fly Drosophila melanogaster prefers 24 degrees C, avoiding higher and lower temperatures when tested on a temperature gradient. Furthermore, temperatures above 24 degrees C have negative reinforcing properties. In contrast, we found that flies have a preference in operant learning experiments for a low-temperature-associated position rather than the 24 degrees C alternative in the heat-box. Two additional differences between high- and low-temperature reinforcement, i.e., temperatures above and below 24 degrees C, were found. Temperatures equally above and below 24 degrees C did not reinforce equally and only high temperatures supported increased memory performance with reversal conditioning. Finally, low- and high-temperature reinforced memories are similarly sensitive to two genetic mutations. Together these results indicate the qualitative meaning of temperatures below 24 degrees C depends on the dynamics of the temperatures encountered and that the reinforcing effects of these temperatures depend on at least some common genetic components. Conceptualizing these results using the Wolf-Heisenberg model of operant conditioning, we propose the maximum difference in experienced temperatures determines the magnitude of the reinforcement input to a conditioning circuit.

Generalized Negatively Reinforced Manding in Children with Autism

PubMed Central

Yi, Janet I; Christian, LeeAnn; Vittimberga, Glenda; Lowenkron, Barry

2006-01-01

Individuals with developmental disabilities are often unable to influence their social environment in traditional ways (i.e., vocal language) and frequently exhibit challenging behaviors (e.g., aggression and self-injury) because such behaviors were previously reinforced under similar conditions. While the area of positive reinforcement manding has been well-documented and empirically validated, there is less research in the area of negatively reinforced manding—particularly in the area of negatively reinforced manding of nonpreferred items. Using a multiple baseline design across participants, this study sought to teach three children with autism to replace their challenging behaviors with more socially appropriate ways to request the removal of nonpreferred items. Results showed that all participants were able to learn the negatively reinforced mand response and these mand responses were generalized to other untrained items. In addition to extending the research in the area, the study empirically defined a procedure for teaching negatively reinforced manding of nonpreferred items. Moreover, teaching the mand response resulted in quality of life improvements for all participants and their families. PMID:22477341

Correspondence between Preference Assessment Outcomes and Stimulus Reinforcer Value for Social Interactions

ERIC Educational Resources Information Center

Davis, Tonya N.; Hodges, Abby; Weston, Regan; Hogan, Emily; Padilla-Mainor, Kristen

2017-01-01

Preferred forms of social interaction were identified using a paired-stimulus format in which two 3-5 s videos of the experimenter providing the social interaction to the participant were presented. Reinforcer efficacy of the high-, medium-, and low-preferred interactions was evaluated using a progressive-ratio schedule to determine the amount of…

Is extinction the hallmark of operant discrimination?: Reinforcement and SΔ effects

PubMed Central

Andrzejewski, Matthew E.; Ryals, Curtis D.; Higgins, Sean; Sulkowski, Jennifer; Doney, Janice; Kelley, Ann E.; Bersh, Philip J.

2008-01-01

Using a successive discrimination procedure with rats, three experiments investigated the contribution of reinforcement rate and amount of SΔ exposure on the acquisition of an operant discrimination. SD components and were always 2 min in length, while SΔ (extinction) components were either 1 min or 4 min in length; responses in SD were reinforced on one of four schedules. In Experiment 1, each of eight groups were exposed to one possible combination of rate of reinforcement and SΔ component length. At every level of reinforcement, the 4 min SΔ groups acquired the discrimination more quickly. However, within each level of reinforcement, the proportions of responding in SD as a function cumulative SΔ exposure were equivalent, regardless of the number of reinforcers earned in SD, suggesting that extinction is the “hallmark” of discrimination. Experiment 2 sought to replicate these results in a within-subjects design, and although the 4 min SΔ conditions always produced superior discriminations, the lack of discriminated responding in some conditions suggested that stimulus disparity was reduced. Experiment 3 clarified those results and extended the finding that the acquisition of operant discrimination closely parallels extinction of responding in SΔ. In sum, it appears that higher reinforcement rates and longer SΔ exposure facilitate the acquisition of discriminated operant responding. PMID:17071018

Separation of time-based and trial-based accounts of the partial reinforcement extinction effect.

PubMed

Bouton, Mark E; Woods, Amanda M; Todd, Travis P

2014-01-01

Two appetitive conditioning experiments with rats examined time-based and trial-based accounts of the partial reinforcement extinction effect (PREE). In the PREE, the loss of responding that occurs in extinction is slower when the conditioned stimulus (CS) has been paired with a reinforcer on some of its presentations (partially reinforced) instead of every presentation (continuously reinforced). According to a time-based or "time-accumulation" view (e.g., Gallistel and Gibbon, 2000), the PREE occurs because the organism has learned in partial reinforcement to expect the reinforcer after a larger amount of time has accumulated in the CS over trials. In contrast, according to a trial-based view (e.g., Capaldi, 1967), the PREE occurs because the organism has learned in partial reinforcement to expect the reinforcer after a larger number of CS presentations. Experiment 1 used a procedure that equated partially and continuously reinforced groups on their expected times to reinforcement during conditioning. A PREE was still observed. Experiment 2 then used an extinction procedure that allowed time in the CS and the number of trials to accumulate differentially through extinction. The PREE was still evident when responding was examined as a function of expected time units to the reinforcer, but was eliminated when responding was examined as a function of expected trial units to the reinforcer. There was no evidence that the animal responded according to the ratio of time accumulated during the CS in extinction over the time in the CS expected before the reinforcer. The results thus favor a trial-based account over a time-based account of extinction and the PREE. This article is part of a Special Issue entitled: Associative and Temporal Learning. Copyright © 2013 Elsevier B.V. All rights reserved.

Fracture Analysis of Particulate Reinforced Metal Matrix Composites

NASA Technical Reports Server (NTRS)

Min, James B.; Cornie, James A.

2013-01-01

A fracture analysis of highly loaded particulate reinforced composites was performed using laser moire interferometry to measure the displacements within the plastic zone at the tip of an advancing crack. Ten castings were made of five different particulate reinforcement-aluminum alloy combinations. Each casting included net-shape specimens which were used for the evaluation of fracture toughness, tensile properties, and flexure properties resulting in an extensive materials properties data. Measured fracture toughness range from 14.1 MPa for an alumina reinforced 356 aluminum alloy to 23.9 MPa for a silicon carbide reinforced 2214 aluminum alloy. For the combination of these K(sub Ic) values and the measured tensile strengths, the compact tension specimens were too thin to yield true plane strain K(sub Ic) values. All materials exhibited brittle behavior characterized by very small tensile ductility suggesting that successful application of these materials requires that the design stresses be below the elastic limit. Probabilistic design principles similar to those used with ceramics are recommended when using these materials. Such principles would include the use of experimentally determined design allowables. In the absence of thorough testing, a design allowable stress of 60 percent of the measured ultimate tensile stress is recommended.

Fundamental period of Italian reinforced concrete buildings: comparison between numerical, experimental and Italian code simplified values

NASA Astrophysics Data System (ADS)

Ditommaso, Rocco; Carlo Ponzo, Felice; Auletta, Gianluca; Iacovino, Chiara; Nigro, Antonella

2015-04-01

Aim of this study is a comparison among the fundamental period of reinforced concrete buildings evaluated using the simplified approach proposed by the Italian Seismic code (NTC 2008), numerical models and real values retrieved from an experimental campaign performed on several buildings located in Basilicata region (Italy). With the intention of proposing simplified relationships to evaluate the fundamental period of reinforced concrete buildings, scientists and engineers performed several numerical and experimental campaigns, on different structures all around the world, to calibrate different kind of formulas. Most of formulas retrieved from both numerical and experimental analyses provides vibration periods smaller than those suggested by the Italian seismic code. However, it is well known that the fundamental period of a structure play a key role in the correct evaluation of the spectral acceleration for seismic static analyses. Generally, simplified approaches impose the use of safety factors greater than those related to in depth nonlinear analyses with the aim to cover possible unexpected uncertainties. Using the simplified formula proposed by the Italian seismic code the fundamental period is quite higher than fundamental periods experimentally evaluated on real structures, with the consequence that the spectral acceleration adopted in the seismic static analysis may be significantly different than real spectral acceleration. This approach could produces a decreasing in safety factors obtained using linear and nonlinear seismic static analyses. Finally, the authors suggest a possible update of the Italian seismic code formula for the simplified estimation of the fundamental period of vibration of existing RC buildings, taking into account both elastic and inelastic structural behaviour and the interaction between structural and non-structural elements. Acknowledgements This study was partially funded by the Italian Civil Protection Department within the

Reinforcement learning in supply chains.

PubMed

Valluri, Annapurna; North, Michael J; Macal, Charles M

2009-10-01

Effective management of supply chains creates value and can strategically position companies. In practice, human beings have been found to be both surprisingly successful and disappointingly inept at managing supply chains. The related fields of cognitive psychology and artificial intelligence have postulated a variety of potential mechanisms to explain this behavior. One of the leading candidates is reinforcement learning. This paper applies agent-based modeling to investigate the comparative behavioral consequences of three simple reinforcement learning algorithms in a multi-stage supply chain. For the first time, our findings show that the specific algorithm that is employed can have dramatic effects on the results obtained. Reinforcement learning is found to be valuable in multi-stage supply chains with several learning agents, as independent agents can learn to coordinate their behavior. However, learning in multi-stage supply chains using these postulated approaches from cognitive psychology and artificial intelligence take extremely long time periods to achieve stability which raises questions about their ability to explain behavior in real supply chains. The fact that it takes thousands of periods for agents to learn in this simple multi-agent setting provides new evidence that real world decision makers are unlikely to be using strict reinforcement learning in practice.

The Effects of Observation of Learn Units during Reinforcement and Correction Conditions on the Rate of Learning Math Algorithms by Fifth Grade Students

ERIC Educational Resources Information Center

Neu, Jessica Adele

2013-01-01

I conducted two studies on the comparative effects of the observation of learn units during (a) reinforcement or (b) correction conditions on the acquisition of math objectives. The dependent variables were the within-session cumulative numbers of correct responses emitted during observational sessions. The independent variables were the…

Evaluating the influence of postsession reinforcement on choice of reinforcers.

PubMed

Kodak, Tiffany; Lerman, Dorothea C; Call, Nathan

2007-01-01

Factors that influence reinforcer choice have been examined in a number of applied studies (e.g., Neef, Mace, Shea, & Shade, 1992; Shore, Iwata, DeLeon, Kahng, & Smith, 1997; Tustin, 1994). However, no applied studies have evaluated the effects of postsession reinforcement on choice between concurrently available reinforcers, even though basic findings indicate that this is an important factor to consider (Hursh, 1978; Zeiler, 1999). In this bridge investigation, we evaluated the influence of postsession reinforcement on choice of two food items when task responding was reinforced on progressive-ratio schedules. Participants were 3 children who had been diagnosed with developmental disabilities. Results indicated that response allocation shifted from one food item to the other food item under thinner schedules of reinforcement when no postsession reinforcement was provided. These findings suggest that the efficacy of instructional programs or treatments for problem behavior may be improved by restricting reinforcers outside treatment sessions.

Inaccessibility of reinforcement increases persistence and signaling behavior in the fox squirrel (Sciurus niger).

PubMed

Delgado, Mikel M; Jacobs, Lucia F

2016-05-01

Under natural conditions, wild animals encounter situations where previously rewarded actions do not lead to reinforcement. In the laboratory, a surprising omission of reinforcement induces behavioral and emotional responses described as frustration. Frustration can lead to aggressive behaviors and to the persistence of noneffective responses, but it may also lead to new behavioral responses to a problem, a potential adaptation. We assessed the responses to inaccessible reinforcement in free-ranging fox squirrels (Sciurus niger). We trained squirrels to open a box to obtain food reinforcement, a piece of walnut. After 9 training trials, squirrels were tested in 1 of 4 conditions: a control condition with the expected reward, an alternative reinforcement (a piece of dried corn), an empty box, or a locked box. We measured the presence of signals suggesting arousal (e.g., tail flags and tail twitches) and found that squirrels performed fewer of these behaviors in the control condition and increased certain behaviors (tail flags, biting box) in the locked box condition, compared to other experimental conditions. When faced with nonreinforcement, that is, frustration, squirrels increased the number of interactions with the apparatus and spent more time interacting with the apparatus. This study of frustration responses in a free-ranging animal extends the conclusions of captive studies to the field and demonstrates that fox squirrels show short-term negatively valenced responses to the inaccessibility, omission, and change of reinforcement. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

A model for discriminating reinforcers in time and space.

PubMed

Cowie, Sarah; Davison, Michael; Elliffe, Douglas

2016-06-01

range of data suggests that timing, like other conditional discriminations, is choice under the joint discriminative control of elapsed time and differential reinforcement. Understanding the role of differential reinforcement is therefore critical to understanding control by elapsed time. Copyright © 2016 Elsevier B.V. All rights reserved.

Evaluating The Influence of Postsession Reinforcement on Choice of Reinforcers

PubMed Central

Kodak, Tiffany; Lerman, Dorothea C; Call, Nathan

2007-01-01

Factors that influence reinforcer choice have been examined in a number of applied studies (e.g., Neef, Mace, Shea, & Shade, 1992; Shore, Iwata, DeLeon, Kahng, & Smith, 1997; Tustin, 1994). However, no applied studies have evaluated the effects of postsession reinforcement on choice between concurrently available reinforcers, even though basic findings indicate that this is an important factor to consider (Hursh, 1978; Zeiler, 1999). In this bridge investigation, we evaluated the influence of postsession reinforcement on choice of two food items when task responding was reinforced on progressive-ratio schedules. Participants were 3 children who had been diagnosed with developmental disabilities. Results indicated that response allocation shifted from one food item to the other food item under thinner schedules of reinforcement when no postsession reinforcement was provided. These findings suggest that the efficacy of instructional programs or treatments for problem behavior may be improved by restricting reinforcers outside treatment sessions. PMID:17970264

Ultimate Load Behaviour of Reinforced Concrete Beam with Corroded Reinforcement

NASA Astrophysics Data System (ADS)

Kanchana Devi, A.; Ramajaneyulu, K.; Sundarkumar, S.; Ramesh, G.; Bharat Kumar, B. H.; Krishna Moorthy, T. S.

2017-12-01

Corrosion of reinforcement reduces the load carrying capacity, energy dissipation and ductility of Reinforced Concrete (RC) members. In the present study, reinforcements of RC beam are subjected to 10, 25, and 30% corrosion and the respective RC beams are tested to evaluate their ultimate load behaviour. A huge drop in energy dissipation capacity of the RC beam is observed beyond the corrosion level of 10%. Further, nonlinear finite element analysis is employed to assess the load-displacement behaviour and ultimate load of RC beam. The corrosion induced damage to the reinforcement is represented in the finite element model by modifying its mechanical properties based on the results reported in the literature. The resultant load versus displacement curves of reinforced concrete beams are obtained. Good correlation is observed between the finite element analysis results and that obtained from experimental investigation on the control beam. The experimental results are also compared with the finite element analysis results for RC beams with corroded reinforcement. In order to understand the effect of corrosion on the mechanical properties of reinforcement, the corroded reinforcements are modelled in nonlinear finite element analysis by (i) reducing the area of reinforcement alone (ii) by reducing both area and mechanical properties and (iii) reducing the mechanical properties without reducing the area of steel as reported in literature. The results obtained for the beam with corroded reinforcement confirms reduction in yield stress and ultimate stress of the reinforcement steel.

Fiber-reinforced materials: finite elements for the treatment of the inextensibility constraint

NASA Astrophysics Data System (ADS)

Auricchio, Ferdinando; Scalet, Giulia; Wriggers, Peter

2017-12-01

The present paper proposes a numerical framework for the analysis of problems involving fiber-reinforced anisotropic materials. Specifically, isotropic linear elastic solids, reinforced by a single family of inextensible fibers, are considered. The kinematic constraint equation of inextensibility in the fiber direction leads to the presence of an undetermined fiber stress in the constitutive equations. To avoid locking-phenomena in the numerical solution due to the presence of the constraint, mixed finite elements based on the Lagrange multiplier, perturbed Lagrangian, and penalty method are proposed. Several boundary-value problems under plane strain conditions are solved and numerical results are compared to analytical solutions, whenever the derivation is possible. The performed simulations allow to assess the performance of the proposed finite elements and to discuss several features of the developed formulations concerning the effective approximation for the displacement and fiber stress fields, mesh convergence, and sensitivity to penalty parameters.

Weathering Characteristics of Wood Plastic Composites Reinforced with Extracted or Delignified Wood Flour

PubMed Central

Chen, Yao; Stark, Nicole M.; Tshabalala, Mandla A.; Gao, Jianmin; Fan, Yongming

2016-01-01

This study investigated weathering performance of an HDPE wood plastic composite reinforced with extracted or delignified wood flour (WF). The wood flour was pre-extracted with three different solvents, toluene/ethanol (TE), acetone/water (AW), and hot water (HW), or sodium chlorite/acetic acid. The spectral properties of the composites before and after artificial weathering under accelerated conditions were characterized by Fourier transform infrared (FTIR) spectroscopy, the surface color parameters were analyzed using colorimetry, and the mechanical properties were determined by a flexural test. Weathering of WPC resulted in a surface lightening and a decrease in wood index (wood/HDPE) and flexural strength. WPCs that were reinforced with delignified wood flour showed higher ΔL* and ΔE* values, together with lower MOE and MOR retention ratios upon weathering when compared to those with non-extracted control and extracted WF. PMID:28773732

The Effects of the Absence of an Adult on the Emergence of Conditioned Reinforcement as a Function of Observation in Preschool Age Children

ERIC Educational Resources Information Center

Zrinzo, Michelle L.

2010-01-01

I tested the effects of the absence of an adult on the observational conditioning effect (Greer & Singer-Dudek, 2008). Neutral stimuli (metal washers) did not function to reinforce performance or learning tasks for three preschool age children as determined by a counterbalanced reversal design for the pre-intervention performance tasks and…

Effect of Reinforcement Architecture on Fracture of Selectively Reinforced Metallic Compact Tension Specimens

NASA Technical Reports Server (NTRS)

Abada, Christopher H.; Farley, Gary L.; Hyer, Michael W.

2006-01-01

A computer-based parametric study of the effect of reinforcement architectures on fracture response of aluminum compact-tension (CT) specimens is performed. Eleven different reinforcement architectures consisting of rectangular and triangular cross-section reinforcements were evaluated. Reinforced specimens produced between 13 and 28 percent higher fracture load than achieved with the non-reinforced case. Reinforcements with blunt leading edges (rectangular reinforcements) exhibited superior performance relative to the triangular reinforcements with sharp leading edges. Relative to the rectangular reinforcements, the most important architectural feature was reinforcement thickness. At failure, the reinforcements carried between 58 and 85 percent of the load applied to the specimen, suggesting that there is considerable load transfer between the base material and the reinforcement.

Response cost, reinforcement, and children's Porteus Maze qualitative performance.

PubMed

Neenan, D M; Routh, D K

1986-09-01

Sixty fourth-grade children were given two different series of the Porteus Maze Test. The first series was given as a baseline, and the second series was administered under one of four different experimental conditions: control, response cost, positive reinforcement, or negative verbal feedback. Response cost and positive reinforcement, but not negative verbal feedback, led to significant decreases in the number of all types of qualitative errors in relation to the control group. The reduction of nontargeted as well as targeted errors provides evidence for the generalized effects of response cost and positive reinforcement.

The effects of nicotine exposure during Pavlovian conditioning in rats on several measures of incentive motivation for a conditioned stimulus paired with water.

PubMed

Guy, Elizabeth Glenn; Fletcher, Paul J

2014-06-01

Nicotine enhances approach toward and operant responding for conditioned stimuli (CSs), but the effect of exposure during different phases of Pavlovian incentive learning on these measures remains to be determined. These studies examined the effects of administering nicotine early, late or throughout Pavlovian conditioning trials on discriminated approach behavior, nicotine-enhanced responding for conditioned reinforcement, extinction, and the reinstatement of responding for conditioned reinforcement. We also tested the effect of nicotine on approach to a lever-CS in a Pavlovian autoshaping procedure and for this CS to serve as a conditioned reinforcer. Thirsty rats were exposed to 13 conditioning sessions where a light/tone CS was paired with the delivery of water. Nicotine was administered either prior to the first or last seven sessions, or throughout the entire conditioning procedure. Responding for conditioned reinforcement, extinction, and the reinstatement of responding by the stimulus and nicotine were compared across exposure groups. Separately, the effects of nicotine on conditioned approach toward a lever-CS during autoshaping, and responding for that CS as a conditioned reinforcer, were examined. Nicotine exposure was necessary for nicotine-enhanced responding for conditioned reinforcement and the ability for nicotine and the stimulus to additively reinstate responding on the reinforced lever. Nicotine increased contacts with a lever-CS during autoshaping, and removal of nicotine abolished this effect. Prior nicotine exposure was necessary for nicotine-enhanced responding reinforced by the lever. Enhancements in the motivating properties of CSs by nicotine occur independently from duration and timing effects of nicotine exposure during conditioning.

Effects of systemic cholinergic antagonism on reinforcer devaluation in macaques.

PubMed

Waguespack, Hannah F; Málková, Ludise; Forcelli, Patrick A; Turchi, Janita

2018-06-21

The capacity to adjust actions based on new information is a vital cognitive function. An animal's ability to adapt behavioral responses according to changes in reward value can be measured using a reinforcer devaluation task, wherein the desirability of a given object is reduced by decreasing the value of the associated food reinforcement. Elements of the neural circuits serving this ability have been studied in both rodents and nonhuman primates. Specifically, the basolateral amygdala, orbitofrontal cortex, nucleus accumbens, and mediodorsal thalamus have each been shown to play a critical role in the process of value updating, required for adaptive goal selection. As these regions receive dense cholinergic input, we investigated whether systemic injections of non-selective nicotinic or muscarinic acetylcholine receptor antagonists, mecamylamine and scopolamine, respectively, would impair performance on a reinforcer devaluation task. Here we demonstrate that in the presence of either a nicotinic or muscarinic antagonist, animals are able to shift their behavioral responses in an appropriate manner, suggesting that disruption of cholinergic neuromodulation is not sufficient to disrupt value updating, and subsequent goal selection, in rhesus macaques. Published by Elsevier B.V.

Discriminability and Sensitivity to Reinforcer Magnitude in a Detection Task

ERIC Educational Resources Information Center

Alsop, Brent; Porritt, Melissa

2006-01-01

Three pigeons discriminated between two sample stimuli (intensities of red light). The difficulty of the discrimination was varied over four levels. At each level, the relative reinforcer magnitude for the two correct responses was varied across conditions, and the reinforcer rates were equal. Within levels, discriminability between the sample…

Arginine: Its pKa value revisited

PubMed Central

Fitch, Carolyn A; Platzer, Gerald; Okon, Mark; Garcia-Moreno E, Bertrand; McIntosh, Lawrence P

2015-01-01

Using complementary approaches of potentiometry and NMR spectroscopy, we have determined that the equilibrium acid dissociation constant (pKa value) of the arginine guanidinium group is 13.8 ± 0.1. This is substantially higher than that of ∼12 often used in structure-based electrostatics calculations and cited in biochemistry textbooks. The revised intrinsic pKa value helps explains why arginine side chains in proteins are always predominantly charged, even at pH values as great as 10. The high pKa value also reinforces the observation that arginine side chains are invariably protonated under physiological conditions of near neutral pH. This occurs even when the guanidinium moiety is buried in a hydrophobic micro-environment, such as that inside a protein or a lipid membrane, thought to be incompatible with the presence of a charged group. PMID:25808204

Conditioned pharmacotherapeutic effects: a preliminary study.

PubMed

Ader, Robert; Mercurio, Mary Gail; Walton, James; James, Deborra; Davis, Michael; Ojha, Valerie; Kimball, Alexa Boer; Fiorentino, David

2010-02-01

To test the hypothesize that psoriasis patients treated under a partial schedule of pharmacologic (corticosteroid) reinforcement would show less severe symptoms and relapse than those given the same amount of drug under standard conditions. Behavioral conditioning as an inherent component of many pharmacotherapeutic protocols has never been examined. A double-blind, simple randomization intervention was conducted with 46 patients from California and New York. Initially, lesions were treated with 0.1% acetonide triamcinolone under standard treatment conditions. Thereafter, a Standard Therapy group continued on continuous reinforcement (active drug every treatment) with 100% of the initial dose; Partial Reinforcement patients received a full dose 25% to 50% of the time and placebo medication other times; Dose Control patients received continuous reinforcement with 25% to 50% of the initial dose. Severity of disease scores in California neither supported nor refuted the hypothesis. In New York, where there was no difference between Partial Reinforcement and Dose Control groups at baseline, partial reinforcement effected a greater reduction in lesion severity than Dose Control conditions and did not differ from Standard Therapy patients receiving two to four times more drug. For the entire population, the frequency of relapse under partial reinforcement (26.7%) was lower than in Dose Control patients (61.5%) and did not differ from full-dose treatment (22.2%). A partial schedule of pharmacotherapeutic reinforcement could maintain psoriasis patients with a cumulative amount of corticosteroid that was relatively ineffective when administered under standard treatment conditions. Conceivably, corticosteroid administration only one quarter or half as frequently as currently prescribed is sufficient to treat psoriasis. We posit, however, that these preliminary observations implicate conditioning processes in-and for the design of-regimens of pharmacotherapy.

Effect of storage conditions on the calorific value of municipal solid waste.

PubMed

Nzioka, Antony Mutua; Hwang, Hyeon-Uk; Kim, Myung-Gyun; Yan, Cao Zheng; Lee, Chang-Soo; Kim, Young-Ju

2017-08-01

Storage conditions are considered to be an important factor as far as waste material characteristics are concerned. This experimental investigation was conducted using municipal solid waste (MSW) with a high moisture content and varying composition of organic waste. The objective of this study was to understand the effect of storage conditions and temperature on the moisture content and calorific value of the waste. Samples were subjected to two different storage conditions and investigated at specified temperatures. The composition of sample materials investigated was varied for each storage condition and temperature respectively. Gross calorific value was determined experimentally while net calorific value was calculated using empirical formulas proposed by other researchers. Results showed minimal changes in moisture content as well as in gross and net calorific values when the samples were subjected to sealed storage conditions. Moisture content reduced due to the ventilation process and the rate of moisture removal increased with a rise in storage temperature. As expected, rate of moisture removal had a positive effect on gross and net calorific values. Net calorific values also increased at varying rates with a simultaneous decrease in moisture content. Experimental investigation showed the effectiveness of ventilation in improving the combustion characteristics of the waste.

Credit assignment in movement-dependent reinforcement learning

PubMed Central

Boggess, Matthew J.; Crossley, Matthew J.; Parvin, Darius; Ivry, Richard B.; Taylor, Jordan A.

2016-01-01

When a person fails to obtain an expected reward from an object in the environment, they face a credit assignment problem: Did the absence of reward reflect an extrinsic property of the environment or an intrinsic error in motor execution? To explore this problem, we modified a popular decision-making task used in studies of reinforcement learning, the two-armed bandit task. We compared a version in which choices were indicated by key presses, the standard response in such tasks, to a version in which the choices were indicated by reaching movements, which affords execution failures. In the key press condition, participants exhibited a strong risk aversion bias; strikingly, this bias reversed in the reaching condition. This result can be explained by a reinforcement model wherein movement errors influence decision-making, either by gating reward prediction errors or by modifying an implicit representation of motor competence. Two further experiments support the gating hypothesis. First, we used a condition in which we provided visual cues indicative of movement errors but informed the participants that trial outcomes were independent of their actual movements. The main result was replicated, indicating that the gating process is independent of participants’ explicit sense of control. Second, individuals with cerebellar degeneration failed to modulate their behavior between the key press and reach conditions, providing converging evidence of an implicit influence of movement error signals on reinforcement learning. These results provide a mechanistically tractable solution to the credit assignment problem. PMID:27247404

Credit assignment in movement-dependent reinforcement learning.

PubMed

McDougle, Samuel D; Boggess, Matthew J; Crossley, Matthew J; Parvin, Darius; Ivry, Richard B; Taylor, Jordan A

2016-06-14

When a person fails to obtain an expected reward from an object in the environment, they face a credit assignment problem: Did the absence of reward reflect an extrinsic property of the environment or an intrinsic error in motor execution? To explore this problem, we modified a popular decision-making task used in studies of reinforcement learning, the two-armed bandit task. We compared a version in which choices were indicated by key presses, the standard response in such tasks, to a version in which the choices were indicated by reaching movements, which affords execution failures. In the key press condition, participants exhibited a strong risk aversion bias; strikingly, this bias reversed in the reaching condition. This result can be explained by a reinforcement model wherein movement errors influence decision-making, either by gating reward prediction errors or by modifying an implicit representation of motor competence. Two further experiments support the gating hypothesis. First, we used a condition in which we provided visual cues indicative of movement errors but informed the participants that trial outcomes were independent of their actual movements. The main result was replicated, indicating that the gating process is independent of participants' explicit sense of control. Second, individuals with cerebellar degeneration failed to modulate their behavior between the key press and reach conditions, providing converging evidence of an implicit influence of movement error signals on reinforcement learning. These results provide a mechanistically tractable solution to the credit assignment problem.

Choice between Single and Multiple Reinforcers in Concurrent-Chains Schedules

ERIC Educational Resources Information Center

Mazur, James E.

2006-01-01

Pigeons responded on concurrent-chains schedules with equal variable-interval schedules as initial links. One terminal link delivered a single reinforcer after a fixed delay, and the other terminal link delivered either three or five reinforcers, each preceded by a fixed delay. Some conditions included a postreinforcer delay after the single…

THE INFLUENCE OF EXTRINSIC REINFORCEMENT ON CHILDREN WITH HEAVY PRENATAL ALCOHOL EXPOSURE

PubMed Central

Graham, Diana M.; Glass, Leila; Mattson, Sarah N.

2016-01-01

Background Prenatal alcohol exposure affects inhibitory control and other aspects of attention and executive function. However, the efficacy of extrinsic reinforcement on these behaviors has not been tested. Methods Alcohol-exposed children (AE; n=34), children with ADHD (ADHD; n=23), and controls (CON; n=31) completed a flanker task with four reward conditions (no reward, reward, reward+occasional response cost, equal probability of reward+response cost). Inhibitory control was tested in the no reward conditions using a 3(group) x 2(flanker type) ANCOVA. Response to reinforcement was tested using 3(group) x 4(reward condition) x 4(flanker type) ANCOVA. Response time (RT) and accuracy were tested independently. Results Groups did not differ on demographic variables. The flanker task was successful in taxing interference control, an aspect of executive attention (i.e., responses to incongruent stimuli were slower than to congruent stimuli) and the AE group demonstrated impaired executive control over the other groups. Overall, the AE group had significantly slower response times compared to the CON and ADHD groups, which did not differ. However, reinforcement improved RT in all groups. While occasional response cost had the greatest benefit in the CON group, the type of reinforcement did not differentially affect the AE and ADHD groups. Accuracy across reward conditions did not differ by group, but was dependent on flanker type and reward condition. Conclusions Alcohol-exposed children, but not children with ADHD, had impaired interference control in comparison to controls, supporting a differential neurobehavioral profile in these two groups. Both clinical groups were equally affected by introduction of reinforcement, although the type of reinforcement did not differentially affect performance as it did in the control group, suggesting that reward or response cost could be used interchangeably to result in the same benefit. PMID:26842253

Behavioral and neural properties of social reinforcement learning

PubMed Central

Jones, Rebecca M.; Somerville, Leah H.; Li, Jian; Ruberry, Erika J.; Libby, Victoria; Glover, Gary; Voss, Henning U.; Ballon, Douglas J.; Casey, BJ

2011-01-01

Social learning is critical for engaging in complex interactions with other individuals. Learning from positive social exchanges, such as acceptance from peers, may be similar to basic reinforcement learning. We formally test this hypothesis by developing a novel paradigm that is based upon work in non-human primates and human imaging studies of reinforcement learning. The probability of receiving positive social reinforcement from three distinct peers was parametrically manipulated while brain activity was recorded in healthy adults using event-related functional magnetic resonance imaging (fMRI). Over the course of the experiment, participants responded more quickly to faces of peers who provided more frequent positive social reinforcement, and rated them as more likeable. Modeling trial-by-trial learning showed ventral striatum and orbital frontal cortex activity correlated positively with forming expectations about receiving social reinforcement. Rostral anterior cingulate cortex activity tracked positively with modulations of expected value of the cues (peers). Together, the findings across three levels of analysis - social preferences, response latencies and modeling neural responses – are consistent with reinforcement learning theory and non-human primate electrophysiological studies of reward. This work highlights the fundamental influence of acceptance by one’s peers in altering subsequent behavior. PMID:21917787

Defining Reinforcers--A Problem in Communication For Consultation in Behavior Modification

ERIC Educational Resources Information Center

Schmits, Donald W.

1973-01-01

This paper reviews the respondent (Hull-Spence) and operant (Skinnerian) conditioning definitions of reinforcers and reinforcement and demonstrates the need to keep the systems separate when consulting about behavior modification. The two systems are shown to lead to different modification procedures. (Author)

The research on thermal adaptability reinforcement technology for photovoltaic modules

NASA Astrophysics Data System (ADS)

Su, Nana; Zhou, Guozhong

2015-10-01

Nowadays, Photovoltaic module contains more high-performance components in smaller space. It is also demanded to work in severe temperature condition for special use, such as aerospace. As temperature rises, the failure rate will increase exponentially which makes reliability significantly reduce. In order to improve thermal adaptability of photovoltaic module, this paper makes a research on reinforcement technologies. Thermoelectric cooler is widely used in aerospace which has harsh working environment. So, theoretical formulas for computing refrigerating efficiency, refrigerating capacity and temperature difference are described in detail. The optimum operating current of three classical working condition is obtained which can be used to guide the design of driven circuit. Taken some equipment enclosure for example, we use thermoelectric cooler to reinforce its thermal adaptability. By building physical model and thermal model with the aid of physical dimension and constraint condition, the model is simulated by Flotherm. The temperature field cloud is shown to verify the effectiveness of reinforcement.

Stainless steel reinforcement as a replacement for epoxy coated steel in bridge decks : final report.

DOT National Transportation Integrated Search

2013-08-01

The corrosion resistance of 2304 stainless steel reinforcement and stainless steel clad reinforcement was compared to conventional and epoxy-coated reinforcement (ECR). 2304 stainless steel was tested in both the as-received condition (dark mottled f...

Strength and deformability of concrete beams reinforced by non-metallic fiber and composite rebar

NASA Astrophysics Data System (ADS)

Kudyakov, K. L.; Plevkov, V. S.; Nevskii, A. V.

2015-01-01

Production of durable and high-strength concrete structures with unique properties has always been crucial. Therefore special attention has been paid to non-metallic composite and fiber reinforcement. This article describes the experimental research of strength and deformability of concrete beams with dispersed and core fiber-based reinforcement. As composite reinforcement fiberglass reinforced plastic rods with diameters 6 mm and 10 mm are used. Carbon and basalt fibers are used as dispersed reinforcement. The developed experimental program includes designing and production of flexural structures with different parameters of dispersed fiber and composite rebar reinforcement. The preliminary testing of mechanical properties of these materials has shown their effectiveness. Structures underwent bending testing on a special bench by applying flexural static load up to complete destruction. During the tests vertical displacements were recorded, as well as value of actual load, slippage of rebars in concrete, crack formation. As a result of research were obtained structural failure and crack formation graphs, value of fracture load and maximum displacements of the beams at midspan. Analysis of experimental data showed the effectiveness of using dispersed reinforcement of concrete and the need for prestressing of fiberglass composite rebar.

Reinforcement Magnitude: An Evaluation of Preference and Reinforcer Efficacy

ERIC Educational Resources Information Center

Trosclair-Lasserre, Nicole M.; Lerman, Dorothea C.; Call, Nathan A.; Addison, Laura R.; Kodak, Tiffany

2008-01-01

Consideration of reinforcer magnitude may be important for maximizing the efficacy of treatment for problem behavior. Nonetheless, relatively little is known about children's preferences for different magnitudes of social reinforcement or the extent to which preference is related to differences in reinforcer efficacy. The purpose of the current…

Assessing appetitive, aversive, and negative ethanol-mediated reinforcement through an immature rat model.

PubMed

Pautassi, Ricardo M; Nizhnikov, Michael E; Spear, Norman E

2009-06-01

The motivational effects of drugs play a key role during the transition from casual use to abuse and dependence. Ethanol reinforcement has been successfully studied through Pavlovian and operant conditioning in adult rats and mice genetically selected for their ready acceptance of ethanol. Another model for studying ethanol reinforcement is the immature (preweanling) rat, which consumes ethanol and exhibits the capacity to process tactile, odor and taste cues and transfer information between different sensorial modalities. This review describes the motivational effects of ethanol in preweanling, heterogeneous non-selected rats. Preweanlings exhibit ethanol-mediated conditioned taste avoidance and conditioned place aversion. Ethanol's appetitive effects, however, are evident when using first- and second-order conditioning and operant procedures. Ethanol also devalues the motivational representation of aversive stimuli, suggesting early negative reinforcement. It seems that preweanlings are highly sensitive not only to the aversive motivational effects of ethanol but also to its positive and negative (anti-anxiety) reinforcement potential. The review underscores the advantages of using a developing rat to evaluate alcohol's motivational effects.

Assessing appetitive, aversive, and negative ethanol-mediated reinforcement through an immature rat model

PubMed Central

Pautassi, Ricardo M.; Nizhnikov, Michael E.; Spear, Norman E.

2009-01-01

The motivational effects of drugs play a key role during the transition from casual use to abuse and dependence. Ethanol reinforcement has been successfully studied through Pavlovian and operant conditioning in adult rats and mice genetically selected for their ready acceptance of ethanol. Another model for studying ethanol reinforcement is the immature (preweanling) rat, which consumes ethanol and exhibits the capacity to process tactile, odor and taste cues and transfer information between different sensorial modalities. This review describes the motivational effects of ethanol in preweanling, heterogeneous non-selected rats. Preweanlings exhibit ethanol-mediated conditioned taste avoidance and conditioned place aversion. Ethanol's appetitive effects, however, are evident when using first- and second-order conditioning and operant procedures. Ethanol also devalues the motivational representation of aversive stimuli, suggesting early negative reinforcement. It seems that preweanlings are highly sensitive not only to the aversive motivational effects of ethanol but also to its positive and negative (anti-anxiety) reinforcement potential. The review underscores the advantages of using a developing rat to evaluate alcohol's motivational effects. PMID:19428502

Experimental Study On Flexural Behaviour Of Beams Reinforced With GFRP Rebars

NASA Astrophysics Data System (ADS)

Naveen Kumar, G.; Sundaravadivelu, Karthik

2017-07-01

In saline, moisture and cold conditions corrosion of steel is inevitable and the lot of economy is used for rehabilitation works. Corrosion of steel is nothing but oxidation of iron in moisture conditions and this corrosion leads to the spalling of concrete which intern reduces the strength of the structure. To reduce this corrosion effects, new materials with resistance against corrosion have to be introduced. Many experiments are going on using Glass Fiber Reinforced Polymer (GFRP) as alternate material for steel due to its non-corrosive nature, weight of GFRP is nearly one third of steel and ultimate tensile strength is higher than steel. In this paper, six beams are casted in which three beams are casted with steel as main and shear reinforcement and another three beams are casted with GFRP as main reinforcement with steel as shear reinforcing material. All beams casted are of same dimensions with variation in reinforcement percentage. The size of the beams casted is of length 1200 mm, breadth 100 mm and depth 200 mm. The clear cover of 25 mm is provided on top and bottom of the beam. Beams are tested under two-point loading with constant aspect ratio (a/d) and comparing the flexural strength, load deflection curves and types of failures of beams reinforced with GFRP as main reinforcement and beams reinforced with conventional steel. The final experimental results are compared with numerical results. M30 grade concrete with Conplast as a superplasticizer is used for casting beams.

Teaching Absolute Value Meaningfully

ERIC Educational Resources Information Center

Wade, Angela

2012-01-01

What is the meaning of absolute value? And why do teachers teach students how to solve absolute value equations? Absolute value is a concept introduced in first-year algebra and then reinforced in later courses. Various authors have suggested instructional methods for teaching absolute value to high school students (Wei 2005; Stallings-Roberts…

An automated program for reinforcement requirements for openings in cylindrical pressure vessels

NASA Technical Reports Server (NTRS)

Wilson, J. F.; Taylor, J. T.

1975-01-01

An automated interactive program for calculating the reinforcement requirements for openings in cylindrical pressure vessels subjected to internal pressure is described. The program is written for an electronic desk top calculator. The program calculates the required area of reinforcement for a given opening and compares this value with the area of reinforcement provided by a proposed design. All program steps, operating instructions, and example problems with input and sample output are documented.

Signals, resistance to change, and conditioned reinforcement in a multiple schedule.

PubMed

Bell, Matthew C; Gomez, Belen E; Kessler, Kira

2008-06-01

The effect of signals on resistance to change was evaluated using pigeons responding on a three-component multiple schedule. Each component contained a variable-interval initial link followed by a fixed-time terminal link. One component was an unsignaled-delay schedule, and two were equivalent signaled-delay schedules. After baseline training, resistance to change was assessed through (a) extinction and (b) adding free food to the intercomponent interval. During these tests, the signal stimulus from one of the signaled-delay components (SIG-T) was replaced with the initial-link stimulus from that component, converting it to an unsignaled-delay schedule. That signal stimulus was added to the delay period of the unsignaled-delay component (UNS), converting it to a signaled-delay schedule. The remaining signaled component remained unchanged (SIG-C). Resistance-to-change tests showed removing the signal had a minimal effect on resistance to change in the SIG-T component compared to the unchanged SIG-C component except for one block during free-food testing. Adding the signal to the UNS component significantly increased response rates suggesting that component had low response strength. Interestingly, the direction of the effect was in the opposite direction from what is typically observed. Results are consistent with the conclusion that the signal functioned as a conditioned reinforcer and inconsistent with a generalization-decrement explanation.

Use of a skin adhesive (octyl-2-cyanoacrylate) and the optimum reinforcing combination for suturing wounds.

PubMed

Chigira, Miho; Akimoto, Masataka

2005-01-01

The adhesion strength of a skin adhesive, octyl-2-cyanoacrylate (Dermabond), was measured under various conditions using porcine skin. The combined use of a skin adhesive and a skin closure tape (n = 5) was significantly stronger than a single application of skin adhesive (n = 5) (p < 0.01). We have tentatively named the wound closure in which a skin adhesive and reinforcement material were combined the Reinforcing Combination Method. To obtain optimum conditions, further studies were done for sequence of application, type of reinforcement material, a number of layers, and width of the suture. The optimum condition for the reinforcement combination was established by applying one layer of skin adhesive over a skin closure tape, over one layer of skin adhesive, with a suture width of 4 cm. This reinforcement combination might be useful in clinical practice.

CS-duration and partial-reinforcement effects counteract overshadowing in select situations

PubMed Central

Urushihara, Kouji; Miller, Ralph R.

2008-01-01

Two experiments used rats in a conditioned lick suppression preparation to investigate how the conditioned stimulus (CS)-duration and partial-reinforcement effects (i.e., weakened responding due to conditioning with a CS of longer duration and presenting nonreinforced CSs intermingled with CS-unconditioned stimulus [US] pairings, respectively) interact with overshadowing. Experiment 1 found that when overshadowing treatment was combined with either extended CS duration or partial reinforcement, the response deficit was weaker than when either of these three treatments was administered alone. In Experiment 2, the generality of the findings in Experiment 1 was investigated by replicating it with various US-US intervals. This time counteraction was observed only when both the absolute duration of total CS exposure and the US-US interval were short. The results support neither the view that the ratio between the total CS exposure and total time in the context determines the CS-duration and the partial-reinforcement effects nor the view that these two effects arise from a loss of effectiveness of the excitatory CS-US association during CS-alone exposures in partial reinforcement or early periods of CS exposure with long CSs. PMID:18047218

Pediatric Audiometry: The Relative Success of Toy and Video Reinforcers.

ERIC Educational Resources Information Center

Doggett, Sheryl; Gans, Donald P.; Stein, Ramona

2000-01-01

An operate conditional technique was used to determine the relative success of toys and video shows as reinforcers for testing the hearing of 28 younger (30-month-old) and 28 older (45-month old) children. Animated toys and video shows for children were equally effective as reinforcers for both age groups. (Contains references.) (Author/CR)

The stay/switch model describes choice among magnitudes of reinforcers.

PubMed

MacDonall, James S

2008-06-01

The stay/switch model is an alternative to the generalized matching law for describing choice in concurrent procedures. The purpose of the present experiment was to extend this model to choice among magnitudes of reinforcers. Rats were exposed to conditions in which the magnitude of reinforcers (number of food pellets) varied for staying at alternative 1, switching from alternative 1, staying at alternative 2 and switching from alternative 2. A changeover delay was not used. The results showed that the stay/switch model provided a good account of the data overall, and deviations from fits of the generalized matching law to response allocation data were in the direction predicted by the stay/switch model. In addition, comparisons among specific conditions suggested that varying the ratio of obtained reinforcers, as in the generalized matching law, was not necessary to change the response and time allocations. Other comparisons suggested that varying the ratio of obtained reinforcers was not sufficient to change response allocation. Taken together these results provide additional support for the stay/switch model of concurrent choice.

Reinforcing of a calcium phosphate cement with hydroxyapatite crystals of various morphologies.

PubMed

Neira, Inés S; Kolen'ko, Yury V; Kommareddy, Krishna P; Manjubala, Inderchand; Yoshimura, Masahiro; Guitián, Francisco

2010-11-01

A series of biocomposite materials was successfully prepared by reinforcing advanced calcium phosphate cement with hydroxyapatite fibrous and elongated plate-like particles. Powder X-ray diffraction showed that ball-milled biocomposite precursors (dicalcium and tetracalcium phosphates) entirely transform to a single phase hydroxyapatite end product within 7 h at 37 °C. Electron microscopy showed that the resultant biocomposites are constituted of nanoscaled cement particles intimately associated with the reinforcement crystals. The influence of shape, size, and concentration of the hydroxyapatite filler on the compression strength of reinforced cements is discussed. The best compression strength of 37 ± 3 MPa (enhancement of ∼50% compared to pure cement) was achieved using submicrometer-sized hydroxyapatite crystals with complementary shapes. Nanoindentation revealed that averaged elastic modulus and hardness values of the cements are consistent with those reported for trabecular and cortical human bones, indicating a good match of the micromechanical properties for their potential use for bone repair. The stiffness of the biocomposites was confirmed to gradate-compliant cement matrix, cement-filler interface, and stiff filler-as a result of the structuring at the nanometer-micrometer level. This architecture is critical in conditioning the final mechanical properties of the functional composite biomaterial. In vitro cell culture experiments showed that the developed biomaterial system is noncytotoxic.

Isolating the incentive salience of reward-associated stimuli: value, choice, and persistence

PubMed Central

Chow, Jonathan J.

2015-01-01

Sign- and goal-tracking are differentially associated with drug abuse-related behavior. Recently, it has been hypothesized that sign- and goal-tracking behavior are mediated by different neurobehavioral valuation systems, including differential incentive salience attribution. Herein, we used different conditioned stimuli to preferentially elicit different response types to study the different incentive valuation characteristics of stimuli associated with sign- and goal-tracking within individuals. The results demonstrate that all stimuli used were equally effective conditioned stimuli; however, only a lever stimulus associated with sign-tracking behavior served as a robust conditioned reinforcer and was preferred over a tone associated with goal-tracking. Moreover, the incentive value attributed to the lever stimulus was capable of promoting suboptimal choice, leading to a significant reduction in reinforcers (food) earned. Furthermore, sign-tracking to a lever was more persistent than goal-tracking to a tone under omission and extinction contingencies. Finally, a conditional discrimination procedure demonstrated that sign-tracking to a lever and goal-tracking to a tone were dependent on learned stimulus–reinforcer relations. Collectively, these results suggest that the different neurobehavioral valuation processes proposed to govern sign- and goal-tracking behavior are independent but parallel processes within individuals. Examining these systems within individuals will provide a better understanding of how one system comes to dominate stimulus–reward learning, thus leading to the differential role these systems play in abuse-related behavior. PMID:25593298

Steel Fibers Reinforced Concrete Pipes - Experimental Tests and Numerical Simulation

NASA Astrophysics Data System (ADS)

Doru, Zdrenghea

2017-10-01

The paper presents in the first part a state of the art review of reinforced concrete pipes used in micro tunnelling realised through pipes jacking method and design methods for steel fibres reinforced concrete. In part two experimental tests are presented on inner pipes with diameters of 1410mm and 2200mm, and specimens (100x100x500mm) of reinforced concrete with metal fibres (35 kg / m3). In part two experimental tests are presented on pipes with inner diameters of 1410mm and 2200mm, and specimens (100x100x500mm) of reinforced concrete with steel fibres (35 kg / m3). The results obtained are analysed and are calculated residual flexural tensile strengths which characterise the post-cracking behaviour of steel fibres reinforced concrete. In the third part are presented numerical simulations of the tests of pipes and specimens. The model adopted for the pipes test was a three-dimensional model and loads considered were those obtained in experimental tests at reaching breaking forces. Tensile stresses determined were compared with mean flexural tensile strength. To validate tensile parameters of steel fibres reinforced concrete, experimental tests of the specimens were modelled with MIDAS program to reproduce the flexural breaking behaviour. To simulate post - cracking behaviour was used the method σ — ε based on the relationship stress - strain, according to RILEM TC 162-TDF. For the specimens tested were plotted F — δ diagrams, which have been superimposed for comparison with the similar diagrams of experimental tests. The comparison of experimental results with those obtained from numerical simulation leads to the following conclusions: - the maximum forces obtained by numerical calculation have higher values than the experimental values for the same tensile stresses; - forces corresponding of residual strengths have very similar values between the experimental and numerical calculations; - generally the numerical model estimates a breaking force greater

The effect of fiber reinforcement type and water storage on strength properties of a provisional fixed partial denture resin.

PubMed

Uzun, Gülay; Keyf, Filiz

2003-04-01

Fracture resistance of provisional restorations is an important clinical concern. This property is directly related to transverse strength. Strengthening of provisional fixed partial dentures may result from reinforcement with various fiber types. This study evaluated the effect of fiber type and water storage on the transverse strength of a commercially available provisional resin under two different conditions. The denture resin was reinforced with either glass or aramid fiber or no reinforcement was used. Uniform samples were made from a commercially available autopolymerizing provisional fixed partial denture resin. Sixteen bar-shaped specimens (60 x 10 x 4 mm) were reinforced with pre-treated epoxy resin-coated glass fibers, with aramid fibers, or with no fibers. Eight specimens of each group, with and without fibers, were tested after 24 h of fabrication (immediate group), and after 30-day water storage. A three-point loading test was used to measure the transverse strength, the maximal deflection, and the modulus of elasticity. The Kruskal-Wallis Analysis of Variance was used to examine differences among the three groups, and then the Mann-Whitney U Test and Wilcoxon Signed Ranks Test were applied to determine pair-wise differences. The transverse strength and the maximal deflection values in the immediate group and in the 30-day water storage group were not statistically significant. In the group tested immediately, the elasticity modulus was found to be significant (P = 0.042). In the 30-day water storage group, all the values were statistically insignificant. The highest transverse strength was displayed by the glass-reinforced resin (66.25MPa) in the immediate group. The transverse strength value was 62.04MPa for the unreinforced samples in the immediate group. All the specimens exhibited lower transverse strength with an increase in water immersion time. The transverse strength value was 61.13 MPa for the glass-reinforced resin and was 61.24 MPa for the

Negative Reinforcement and Premonitory Urges in Youth With Tourette Syndrome: An Experimental Evaluation.

PubMed

Capriotti, Matthew R; Brandt, Bryan C; Turkel, Jennifer E; Lee, Han-Joo; Woods, Douglas W

2014-03-01

Tourette syndrome (TS) is marked by the chronic presence of motor and vocal tics that are usually accompanied by aversive sensory experiences called "premonitory urges." Phenomenological accounts suggest that these urges occur before tics and diminish following their occurrence. This has led some to suggest that tics are negatively reinforced by removal of premonitory urges. This hypothesis has proven difficult to test experimentally, however, due in part to challenges in measuring premonitory urge strength. We tested predictions of the negative reinforcement conceptualization of premonitory urges using novel experimental tactics within the context of the "tic detector" paradigm. We compared tic rates and ratings of premonitory urge strength exhibited by youth with TS or chronic tic disorder under free-to-tic baseline (BL), reinforced tic suppression (RTS), and reinforced tic suppression with escape (RTS + E) conditions. Results were consistent with previous research and hypotheses of the present study. Participants rated the strength of their premonitory urges as higher during RTS conditions than during BL conditions. Within RTS + E conditions, tic rates were higher during escape portions when the contingency supporting tic suppression was inactive than during components where the contingency was active, and ratings of urge strength were higher at the onset of break periods than at the offset. All participants engaged in some level of escape from reinforced suppression during the course of the experiment. Results of this study support the notion that tics may be negatively reinforced by removal of aversive premonitory urges. Future directions for basic and clinical research are discussed. © The Author(s) 2014.

The effect of round window reinforcement on human hearing

NASA Astrophysics Data System (ADS)

Guan, Xiying; Cheng, Y. Song; Galaiya, Deepa; Nakajima, Hideko H.

2018-05-01

The compliant round window (RW) allows volume velocity to flow within the incompressible fluid of the cochlea as the oval window vibrates during sound stimulation. Recently, surgically stiffened RW is emerging as a treatment for various conditions such as superior canal dehiscence and hyperacusis. However, we lack the basic understanding of how reinforcing the RW affects sound transmission in the ear. The aim of this study is to clarify the effect of RW reinforcement on hearing. To study the effect of RW reinforcement with tissue and adhesive, we measured intracochlear pressures in scala vestibuli (Psv) and scala tympani (Pst) at the cochlear base together with stapes velocity in response to sound at the ear canal. The cochlear input drive (Pdiff = Psv - Pst, an estimate of hearing) was determined before and after RW reinforcement in a fresh human cadaveric ear. Results show that increasing the RW stiffness by reinforcement can affect the cochlear input drive in unexpected ways. Below 200 Hz, RW reinforcement resulted in reduced stapes motion, however an increase in cochlear drive, consistent with increase in hearing. At 200-1000 Hz, the hearing and stapes motion both were slightly decreased. Reinforcing the RW had no effect above 1 kHz. To understand the cochlear mechanical effects of RW reinforcement, we used a lumped-element model that simulated our findings.

A new Approach for Quantifying Root-Reinforcement of Streambanks: the RipRoot Model

NASA Astrophysics Data System (ADS)

Pollen, N. L.; Simon, A.

2003-12-01

streambank had a Fs of 0.98 without vegetation, indicating instability. With the addition of cohesion from 200 River Birch roots this value increased to 1.22 using the RipRoot value (Conditionally Stable) and 1.37 using the Wu et al. equation (Stable). In this example both of the root models produced cohesion values that were large enough to make the bank more stable, but the more conservative value from RipRoot suggests the bank may only be conditionally stable. Results to date indicate that the dynamic nature of RipRoot removes some of the overestimation from the static equation of Wu et al. (1979), therefore producing more realistic values for root reinforcement, which are particularly useful and important in the context of river management and restoration.

Energy Absorption Capacity in Natural Fiber Reinforcement Composites Structures

PubMed Central

López-Alba, Elías; Díaz, Francisco

2018-01-01

The study of natural fiber reinforcement composite structures has focused the attention of the automobile industry due to the new regulation in relation to the recyclability and the reusability of the materials preserving and/or improving the mechanical characteristics. The influence of different parameters on the material behavior of natural fiber reinforced plastic structures has been investigated, showing the potential for transport application in energy absorbing structures. Two different woven fabrics (twill and hopsack) made of flax fibers as well as a non-woven mat made of a mixture of hemp and kenaf fibers were employed as reinforcing materials. These reinforcing textiles were impregnated with both HD-PE (high-density polyethylen) and PLA (polylactic acid) matrix, using a continuous compression molding press. The impregnated semi-finished laminates (so-called organic sheets) were thermoformed in a second step to half-tubes that were assembled through vibration-welding process to cylindric crash absorbers. The specimens were loaded by compression to determine the specific energy absorption capacity. Quasi-static test results were compared to dynamic test data obtained on a catapult arrangement. The differences on the specific energies absorption (SEA) as a function of different parameters, such as the wall thickness, the weave material type, the reinforced textiles, and the matrix used, depending on the velocity rate application were quantified. In the case of quasi-static analysis it is observed a 20% increment in the SEA value when wove Hopsack fabric reinforcement is employed. No velocity rate influence from the material was observed on the SEA evaluation at higher speeds used to perform the experiments. The influence of the weave configuration (Hopsack) seems to be more stable against buckling effects at low loading rates with 10% higher SEA values. An increase of SEA level of up to 72% for PLA matrix was observed when compared with HD-PE matrix. PMID

Energy Absorption Capacity in Natural Fiber Reinforcement Composites Structures.

PubMed

López-Alba, Elías; Schmeer, Sebastian; Díaz, Francisco

2018-03-13

The study of natural fiber reinforcement composite structures has focused the attention of the automobile industry due to the new regulation in relation to the recyclability and the reusability of the materials preserving and/or improving the mechanical characteristics. The influence of different parameters on the material behavior of natural fiber reinforced plastic structures has been investigated, showing the potential for transport application in energy absorbing structures. Two different woven fabrics (twill and hopsack) made of flax fibers as well as a non-woven mat made of a mixture of hemp and kenaf fibers were employed as reinforcing materials. These reinforcing textiles were impregnated with both HD-PE (high-density polyethylen) and PLA (polylactic acid) matrix, using a continuous compression molding press. The impregnated semi-finished laminates (so-called organic sheets) were thermoformed in a second step to half-tubes that were assembled through vibration-welding process to cylindric crash absorbers. The specimens were loaded by compression to determine the specific energy absorption capacity. Quasi-static test results were compared to dynamic test data obtained on a catapult arrangement. The differences on the specific energies absorption (SEA) as a function of different parameters, such as the wall thickness, the weave material type, the reinforced textiles, and the matrix used, depending on the velocity rate application were quantified. In the case of quasi-static analysis it is observed a 20% increment in the SEA value when wove Hopsack fabric reinforcement is employed. No velocity rate influence from the material was observed on the SEA evaluation at higher speeds used to perform the experiments. The influence of the weave configuration (Hopsack) seems to be more stable against buckling effects at low loading rates with 10% higher SEA values. An increase of SEA level of up to 72% for PLA matrix was observed when compared with HD-PE matrix.

Structural Behavior of Concrete Beams Reinforced with Basalt Fiber Reinforced Polymer (BFRP) Bars

NASA Astrophysics Data System (ADS)

Ovitigala, Thilan

The main challenge for civil engineers is to provide sustainable, environmentally friendly and financially feasible structures to the society. Finding new materials such as fiber reinforced polymer (FRP) material that can fulfill the above requirements is a must. FRP material was expensive and it was limited to niche markets such as space shuttles and air industry in the 1960s. Over the time, it became cheaper and spread to other industries such as sporting goods in the 1980-1990, and then towards the infrastructure industry. Design and construction guidelines are available for carbon fiber reinforced polymer (CFRP), aramid fiber reinforced polymer (AFRP) and glass fiber reinforced polymer (GFRP) and they are currently used in structural applications. Since FRP is linear elastic brittle material, design guidelines for the steel reinforcement are not valid for FRP materials. Corrosion of steel reinforcement affects the durability of the concrete structures. FRP reinforcement is identified as an alternative to steel reinforcement in corrosive environments. Although basalt fiber reinforced polymer (BFRP) has many advantages over other FRP materials, but limited studies have been done. These studies didn't include larger BFRP bar diameters that are mostly used in practice. Therefore, larger beam sizes with larger BFRP reinforcement bar diameters are needed to investigate the flexural and shear behavior of BFRP reinforced concrete beams. Also, shear behavior of BFRP reinforced concrete beams was not yet studied. Experimental testing of mechanical properties and bond strength of BFRP bars and flexural and shear behavior of BFRP reinforced concrete beams are needed to include BFRP reinforcement bars in the design codes. This study mainly focuses on the use of BFRP bars as internal reinforcement. The test results of the mechanical properties of BFRP reinforcement bars, the bond strength of BFRP reinforcement bars, and the flexural and shear behavior of concrete beams

Stress intensity factors in a reinforced thick-walled cylinder

NASA Technical Reports Server (NTRS)

Tang, R.; Erdogan, F.

1984-01-01

An elastic thick-walled cylinder containing a radial crack is considered. It is assumed that the cylinder is reinforced by an elastic membrane on its inner surface. The model is intended to simulate pressure vessels with cladding. The formulation of the problem is reduced to a singular integral equation. Various special cases including that of a crack terminating at the cylinder-reinforcement interface are investigated and numerical examples are given. Results indicate that in the case of the crack touching the interface the crack surface displacement derivative is finite and consequently the stress state around the corresponding crack tip is bounded; and generally, for realistic values of the stiffness parameter, the effect of the reinforcement is not very significant.

Value-based purchasing and hospital acquired conditions: are we seeing improvement?

PubMed

Spaulding, Aaron; Zhao, Mei; Haley, D Rob

2014-12-01

To determine if the Value-Based Purchasing Performance Scoring system correlates with hospital acquired condition quality indicators. This study utilizes the following secondary data sources: the American Hospital Association (AHA) annual survey and the Centers for Medicare and Medicaid (CMS) Value-Based Purchasing and Hospital Acquired Conditions databases. Zero-inflated negative binomial regression was used to examine the effect of CMS total performance score on counts of hospital acquired conditions. Hospital structure variables including size, ownership, teaching status, payer mix, case mix, and location were utilized as control variables. The secondary data sources were merged into a single database using Stata 10. Total performance scores, which are used to determine if hospitals should receive incentive money, do not correlate well with quality outcome in the form of hospital acquired conditions. Value-based purchasing does not appear to correlate with improved quality and patient safety as indicated by Hospital Acquired Condition (HAC) scores. This leads us to believe that either the total performance score does not measure what it should, or the quality outcome measurements do not reflect the quality of the total performance scores measure. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

REINFORCEMENT ENHANCING EFFECTS OF ACUTE NICOTINE VIA ELECTRONIC CIGARETTES

PubMed Central

Perkins, Kenneth A.; Karelitz, Joshua L.; Michael, Valerie C.

2015-01-01

Background Recent human studies confirm animal research showing that nicotine enhances reinforcement from rewards unrelated to nicotine. These effects of acute nicotine via tobacco smoking may also occur when consumed from non-tobacco products. Methods We assessed acute effects of nicotine via electronic cigarettes (“e-cigarettes”) on responding reinforced by music, video, or monetary rewards, or for no reward (control). In a fully within-subjects design, adult dependent smokers (N=28) participated in three similar experimental sessions, each following overnight abstinence (verified by CO≤10 ppm). Varying only in e-cigarette condition, sessions involved controlled exposure to a nicotine (labeled “36 mg/ml”) or placebo (“0”) e-cigarette, or no e-cigarette use. A fourth session involved smoking one’s own tobacco cigarette brand after no abstinence, specifically to compare responses under typical nicotine satiation with these acute e-cigarette conditions after abstinence. Results Reinforced responding for video reward, but not the other rewards, was greater due to use of the nicotine versus placebo e-cigarette (i.e., nicotine per se), while no differences were found between the placebo e-cigarette and no e-cigarette conditions (i.e., e-cigarette use per se). For nicotine via tobacco smoking, responding compared to the nicotine e-cigarette was similar for video but greater for music, while both video and music reward were enhanced relative to the non-nicotine conditions (placebo and no e-cigarette). Conclusions Acute nicotine from a non-tobacco product has some reinforcement enhancing effects in humans, in a manner partly consistent with nicotine via tobacco smoking and perhaps contributing to the rising popularity of nicotine e-cigarette use. PMID:26070455

Reinforcement enhancing effects of acute nicotine via electronic cigarettes.

PubMed

Perkins, Kenneth A; Karelitz, Joshua L; Michael, Valerie C

2015-08-01

Recent human studies confirm animal research showing that nicotine enhances reinforcement from rewards unrelated to nicotine. These effects of acute nicotine via tobacco smoking may also occur when consumed from non-tobacco products. We assessed acute effects of nicotine via electronic cigarettes ("e-cigarettes") on responding reinforced by music, video, or monetary rewards, or for no reward (control). In a fully within-subjects design, adult dependent smokers (N=28) participated in three similar experimental sessions, each following overnight abstinence (verified by CO≤10ppm). Varying only in e-cigarette condition, sessions involved controlled exposure to a nicotine (labeled "36mg/ml") or placebo ("0″) e-cigarette, or no e-cigarette use. A fourth session involved smoking one's own tobacco cigarette brand after no abstinence, specifically to compare responses under typical nicotine satiation with these acute e-cigarette conditions after abstinence. Reinforced responding for video reward, but not the other rewards, was greater due to use of the nicotine versus placebo e-cigarette (i.e., nicotine per se), while no differences were found between the placebo e-cigarette and no e-cigarette conditions (i.e., e-cigarette use per se). For nicotine via tobacco smoking, responding compared to the nicotine e-cigarette was similar for video but greater for music, while both video and music reward were enhanced relative to the non-nicotine conditions (placebo and no e-cigarette). Acute nicotine from a non-tobacco product has some reinforcement enhancing effects in humans, in a manner partly consistent with nicotine via tobacco smoking and perhaps contributing to the rising popularity of nicotine e-cigarette use. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

The detrimental effects of extrinsic reinforcement on "Intrinsic motivation".

PubMed

Dickinson, A M

1989-01-01

Extrinsic consequences have been criticized on the grounds that they decrease intrinsic motivation or internally initiated behavior. Two popular rationales for this criticism, Lepper's overjustification hypothesis (1981) and Deci's motivational theory (Deci & Ryan, 1985), are reviewed and the criticism is then redefined behaviorally. "Intrinsically controlled" behavior is defined as behavior maintained by response-produced reinforcers, and the question concerning extrinsic consequences is thus restated as follows: When behavior is maintained by response-produced stimuli, does extrinsic reinforcement decrease the reinforcing value of those stimuli? The empirical support for this detrimental effect is summarized briefly, and several possible explanations for the phenomenon are offered. Research results that reflect on the effect's generality and social significance are discussed next, with the conclusion that the effect is transient and not likely to occur at all if extrinsic rewards are reinforcing, noncompetitive, based on reasonable performance standards, and delivered repetitively.

Using the Multiple-Choice Procedure to Measure the Relative Reinforcing Efficacy of Gambling: Initial Validity Evidence Among College Students.

PubMed

Butler, Leon H; Irons, Jessica G; Bassett, Drew T; Correia, Christopher J

2018-06-01

The multiple choice procedure (MCP) is used to assess the relative reinforcing value of concurrently available stimuli. The MCP was originally developed to assess the reinforcing value of drugs; the current within-subjects study employed the MCP to assess the reinforcing value of gambling behavior. Participants (N = 323) completed six versions of the MCP that presented hypothetical choices between money to be used while gambling ($10 or $25) versus escalating amounts of guaranteed money available immediately or after delays of either 1 week or 1 month. Results suggest that choices on the MCP are correlated with other measures of gambling behavior, thus providing concurrent validity data for using the MCP to quantify the relative reinforcing value of gambling. The MCP for gambling also displayed sensitivity to reinforcer magnitude and delay effects, which provides evidence of criterion validity. The results are consistent with a behavioral economic model of addiction and suggest that the MCP could be a valid tool for future research on gambling behavior.

Blocking of conditioning to a cocaine-paired stimulus: testing the hypothesis that cocaine perpetually produces a signal of larger-than-expected reward.

PubMed

Panlilio, Leigh V; Thorndike, Eric B; Schindler, Charles W

2007-04-01

According to a recent account of addiction, dopaminergic effects of drugs like cocaine mimic the neuronal signal that occurs when a natural reward has a larger value than expected. Consequently, the drug's expected reward value increases with each administration, leading to an over-selection of drug-seeking behavior. One prediction of this hypothesis is that the blocking effect, a cornerstone of contemporary learning theory, should not occur with drug reinforcers. To test this prediction, two groups of rats were trained to self-administer cocaine with a nose-poking response. For 5 sessions, a tone was paired with each self-administered injection (blocking group), or no stimulus was paired with injection (non-blocking group). Then, in both groups, the tone and a light were both paired with each injection for 5 sessions. In subsequent testing, the light functioned as a conditioned reinforcer for a new response (lever-pressing) in the non-blocking group, but not the blocking group. Thus, contrary to prediction, pre-training with the tone blocked conditioning to the light. Although these results fail to support a potentially powerful explanation of addiction, they are consistent with the fact that most conditioning and learning phenomena that occur with non-drug reinforcers can also be demonstrated with drug reinforcers.

From free energy to expected energy: Improving energy-based value function approximation in reinforcement learning.

PubMed

Elfwing, Stefan; Uchibe, Eiji; Doya, Kenji

2016-12-01

Free-energy based reinforcement learning (FERL) was proposed for learning in high-dimensional state and action spaces. However, the FERL method does only really work well with binary, or close to binary, state input, where the number of active states is fewer than the number of non-active states. In the FERL method, the value function is approximated by the negative free energy of a restricted Boltzmann machine (RBM). In our earlier study, we demonstrated that the performance and the robustness of the FERL method can be improved by scaling the free energy by a constant that is related to the size of network. In this study, we propose that RBM function approximation can be further improved by approximating the value function by the negative expected energy (EERL), instead of the negative free energy, as well as being able to handle continuous state input. We validate our proposed method by demonstrating that EERL: (1) outperforms FERL, as well as standard neural network and linear function approximation, for three versions of a gridworld task with high-dimensional image state input; (2) achieves new state-of-the-art results in stochastic SZ-Tetris in both model-free and model-based learning settings; and (3) significantly outperforms FERL and standard neural network function approximation for a robot navigation task with raw and noisy RGB images as state input and a large number of actions. Copyright © 2016 The Author(s). Published by Elsevier Ltd.. All rights reserved.

Evaluation of reinforced concrete structures using the electromagnetic method

NASA Astrophysics Data System (ADS)

Chady, Tomasz; Frankowski, Paweł; Waszczuk, Paweł; Zieliński, Adam

2018-04-01

Reinforced concrete has been a universally dominant construction material for over a century, although structures made of this material are often exposed to many types of damage and deterioration due to different causes and external conditions. The most important problem is corrosion of the reinforcement. Currently, most of the inspection methods of rebar in concrete are of an indirect nature or they are partially destructive. Moreover, none of the well-known systems allow for direct and non-destructive evaluation of the rebar corrosion. The purpose of this paper is to present the new, direct and non-destructive method, which allows detection of cracks and corrosion of the reinforcement bars.

Wheel running decreases the positive reinforcing effects of heroin.

PubMed

Smith, Mark A; Pitts, Elizabeth G

2012-01-01

The purpose of this study was to examine the effects of voluntary wheel running on the positive reinforcing effects of heroin in rats with an established history of drug self-administration. Rats were assigned to sedentary (no wheel) and exercise (wheel) conditions and trained to self-administer cocaine under positive reinforcement contingencies. Rats acquiring cocaine self-administration were then tested with various doses of heroin during daily test sessions. Sedentary rats self-administered more heroin than exercising rats, and this effect was greatest at low and moderate doses of heroin. These data suggest that voluntary wheel running decreases the positive reinforcing effects of heroin.

Developmental trajectories of work values and job entitlement beliefs in the transition to adulthood.

PubMed

Chow, Angela; Krahn, Harvey J; Galambos, Nancy L

2014-04-01

Employing a life span developmental systems perspective, this study used a 5-wave (1985-1992) Canadian longitudinal data set (N = 404) to examine trajectories of intrinsic and extrinsic work values and job entitlement beliefs from age 18 to 25. Piecewise growth models (Slope 1: age 18-20; Slope 2: age 20-25) showed intriguing patterns of change. Unconditional and conditional models suggested downward trends in all 3 measures from age 18 to 20. After age 20, the 2 work values reversed direction. Competing scarcity and value reinforcement hypotheses guided the analysis of change in work values and job entitlement beliefs conditional on unemployment experiences and postsecondary education pathways. Supporting a scarcity hypothesis, more unemployment from age 18 to 20 was associated with a faster increase in intrinsic and extrinsic work values, and a slower decrease in job entitlement beliefs from age 20 to 25. In line with a value reinforcement hypothesis, more unemployment from age 20 to 25 was associated with a slower concurrent increase in intrinsic work values. A postsecondary selection effect was observed; individuals who eventually obtained a university degree had higher intrinsic work values and job entitlement beliefs at age 18. Also congruent with a scarcity hypothesis, young adults with only a high school education experienced a significantly faster increase in extrinsic work values from age 20 to 25. This study highlights the transition to adulthood as a key developmental period for change in work values and beliefs. PsycINFO Database Record (c) 2014 APA, all rights reserved.

Modelling root reinforcement in shallow forest soils

USGS Publications Warehouse

Skaugset, Arne E.

1997-01-01

A hypothesis used to explain the relationship between timber harvesting and landslides is that tree roots add mechanical support to soil, thus increasing soil strength. Upon harvest, the tree roots decay which reduces soil strength and increases the risk of management -induced landslides. The technical literature does not adequately support this hypothesis. Soil strength values attributed to root reinforcement that are in the technical literature are such that forested sites can't fail and all high risk, harvested sites must fail. Both unstable forested sites and stable harvested sites exist, in abundance, in the real world thus, the literature does not adequately describe the real world. An analytical model was developed to calculate soil strength increase due to root reinforcement. Conceptually, the model is composed of a reinforcing element with high tensile strength, i.e. a conifer root, embedded in a material with little tensile strength, i.e. a soil. As the soil fails and deforms, the reinforcing element also deforms and stretches. The lateral deformation of the reinforcing element is treated analytically as a laterally loaded pile in a flexible foundation and the axial deformation is treated as an axially loaded pile. The governing differential equations are solved using finite-difference approximation techniques. The root reinforcement model was tested by comparing the final shape of steel and aluminum rods, parachute cord, wooden dowels, and pine roots in direct shear with predicted shapes from the output of the root reinforcement model. The comparisons were generally satisfactory, were best for parachute cord and wooden dowels, and were poorest for steel and aluminum rods. A parameter study was performed on the root reinforcement model which showed reinforced soil strength increased with increasing root diameter and soil depth. Output from the root reinforcement model showed a strain incompatibility between large and small diameter roots. The peak

Model-based reinforcement learning with dimension reduction.

PubMed

Tangkaratt, Voot; Morimoto, Jun; Sugiyama, Masashi

2016-12-01

The goal of reinforcement learning is to learn an optimal policy which controls an agent to acquire the maximum cumulative reward. The model-based reinforcement learning approach learns a transition model of the environment from data, and then derives the optimal policy using the transition model. However, learning an accurate transition model in high-dimensional environments requires a large amount of data which is difficult to obtain. To overcome this difficulty, in this paper, we propose to combine model-based reinforcement learning with the recently developed least-squares conditional entropy (LSCE) method, which simultaneously performs transition model estimation and dimension reduction. We also further extend the proposed method to imitation learning scenarios. The experimental results show that policy search combined with LSCE performs well for high-dimensional control tasks including real humanoid robot control. Copyright © 2016 Elsevier Ltd. All rights reserved.

Elucidating the role of D4 receptors in mediating attributions of salience to incentive stimuli on Pavlovian conditioned approach and conditioned reinforcement paradigms.

PubMed

Cocker, P J; Vonder Haar, C; Winstanley, C A

2016-10-01

The power of drug-associated cues to instigate drug 'wanting' and consequently promote drug seeking is a corner stone of contemporary theories of addiction. Gambling disorder has recently been added to the pantheon of addictive disorders due to the phenomenological similarities between the diseases. However, the neurobiological mechanism that may mediate increased sensitivity towards conditioned stimuli in addictive disorders is unclear. We have previously demonstrated using a rodent analogue of a simple slot machine that the dopamine D4 receptor is critically engaged in controlling animals' attribution of salience to stimuli associated with reward in this paradigm, and consequently may represent a target for the treatment of gambling disorder. Here, we investigated the role of acute administration of a D4 receptor agonist on animals' responsivity to conditioned stimuli on both a Pavlovian conditioned approach (autoshaping) and a conditioned reinforcement paradigm. Following training on one of the two tasks, separate cohorts of rats (male and female) were administered a dose of PD168077 shown to be maximally effective at precipitating errors in reward expectancy on the rat slot machine task (10mg/kg). However, augmenting the activity of the D4 receptors in this manner did not alter behaviour on either task. These data therefore provide novel evidence that the D4 receptor does not alter incentive motivation in response to cues on simple behavioural tasks. Copyright © 2016 Elsevier B.V. All rights reserved.

Anisotropic contraction of hydrogel reinforced by aligned fibers

NASA Astrophysics Data System (ADS)

Olvera de La Cruz, Monica; Liu, Shuangping

Hydrogel reinforced by aligned fibers can have strong anisotropic contraction or swelling behavior triggered by external stimuli, which has been largely employed in realizing soft actuators for artificial muscles as well as many biological systems. In this work, we investigate how this anisotropic behavior is controlled by the dimension of the embedded fibers and their reinforcement to the surrounding hydrogel. We describe the anisotropic contraction of hydrogels with rigid fibers using the Flory-Rehner thermodynamic model under periodic boundary conditions. It is found that a hydrogel reinforced by aligned fibers exhibits larger anisotropy when it is pre-stretched before contraction. Using finite element method, we further observe that the anisotropic contraction is dampened by reducing the fiber-fiber distance due to the finite size of the fibers.

Reinforcement Probability Modulates Temporal Memory Selection and Integration Processes

PubMed Central

Matell, Matthew S.; Kurti, Allison N.

2013-01-01

We have previously shown that rats trained in a mixed-interval peak procedure (tone = 4s, light = 12s) respond in a scalar manner at a time in between the trained peak times when presented with the stimulus compound (Swanton & Matell, 2011). In our previous work, the two component cues were reinforced with different probabilities (short = 20%, long = 80%) to equate response rates, and we found that the compound peak time was biased toward the cue with the higher reinforcement probability. Here, we examined the influence that different reinforcement probabilities have on the temporal location and shape of the compound response function. We found that the time of peak responding shifted as a function of the relative reinforcement probability of the component cues, becoming earlier as the relative likelihood of reinforcement associated with the short cue increased. However, as the relative probabilities of the component cues grew dissimilar, the compound peak became non-scalar, suggesting that the temporal control of behavior shifted from a process of integration to one of selection. As our previous work has utilized durations and reinforcement probabilities more discrepant than those used here, these data suggest that the processes underlying the integration/selection decision for time are based on cue value. PMID:23896560

Evaluating the Influence of Postsession Reinforcement on Choice of Reinforcers

ERIC Educational Resources Information Center

Kodak, Tiffany; Lerman, Dorothea C.; Call, Nathan

2007-01-01

Factors that influence reinforcer choice have been examined in a number of applied studies (e.g., Neef, Mace, Shea, & Shade, 1992; Shore, Iwata, DeLeon, Kahng, & Smith, 1997; Tustin, 1994). However, no applied studies have evaluated the effects of postsession reinforcement on choice between concurrently available reinforcers, even though basic…

Operant conditioning of facial displays of pain.

PubMed

Kunz, Miriam; Rainville, Pierre; Lautenbacher, Stefan

2011-06-01

The operant model of chronic pain posits that nonverbal pain behavior, such as facial expressions, is sensitive to reinforcement, but experimental evidence supporting this assumption is sparse. The aim of the present study was to investigate in a healthy population a) whether facial pain behavior can indeed be operantly conditioned using a discriminative reinforcement schedule to increase and decrease facial pain behavior and b) to what extent these changes affect pain experience indexed by self-ratings. In the experimental group (n = 29), the participants were reinforced every time that they showed pain-indicative facial behavior (up-conditioning) or a neutral expression (down-conditioning) in response to painful heat stimulation. Once facial pain behavior was successfully up- or down-conditioned, respectively (which occurred in 72% of participants), facial pain displays and self-report ratings were assessed. In addition, a control group (n = 11) was used that was yoked to the reinforcement plans of the experimental group. During the conditioning phases, reinforcement led to significant changes in facial pain behavior in the majority of the experimental group (p < .001) but not in the yoked control group (p > .136). Fine-grained analyses of facial muscle movements revealed a similar picture. Furthermore, the decline in facial pain displays (as observed during down-conditioning) strongly predicted changes in pain ratings (R(2) = 0.329). These results suggest that a) facial pain displays are sensitive to reinforcement and b) that changes in facial pain displays can affect self-report ratings.

Soil reinforcement with recycled carpet wastes.

PubMed

Ghiassian, Hossein; Poorebrahim, Gholamreza; Gray, Donald H

2004-04-01

A root or fibre-reinforced soil behaves as a composite material in which fibres of relatively high tensile strength are embedded in a matrix of relatively plastic soil. Shear stresses in the soil mobilize tensile resistance in the fibres, which in turn impart greater strength to the soil. A research project has been undertaken to study the influence of synthetic fibrous materials for improving the strength characteristics of a fine sandy soil. One of the main objectives of the project is to explore the conversion of fibrous carpet waste into a value-added product for soil reinforcement. Drained triaxial tests were conducted on specimens, which were prepared in a cylindrical mould and compacted at their optimum water contents. The main test variables included the aspect ratio and the weight percentage of the fibrous strips. The results clearly show that fibrous inclusions derived from carpet wastes improve the shear strength of silty sands. A model developed to simulate the effect of the fibrous inclusions accurately predicts the influence of strip content, aspect ratio and confining pressure on the shear strength of reinforced sand.

Rimonabant reduces the essential value of food in the genetically obese Zucker rat: an exponential demand analysis.

PubMed

Rasmussen, Erin B; Reilly, William; Buckley, Jessica; Boomhower, Steven R

2012-02-01

Research on free-food intake suggests that cannabinoids are implicated in the regulation of feeding. Few studies, however, have characterized how environmental factors that affect food procurement interact with cannabinoid drugs that reduce food intake. Demand analysis provides a framework to understand how cannabinoid blockers, such as rimonabant, interact with effort in reducing demand for food. The present study examined the effects rimonabant had on demand for sucrose in obese Zucker rats when effort to obtain food varied and characterized the data using the exponential ("essential value") model of demand. Twenty-nine male (15 lean, 14 obese) Zucker rats lever-pressed under eight fixed ratio (FR) schedules of sucrose reinforcement, in which the number of lever-presses to gain access to a single sucrose pellet varied between 1 and 300. After behavior stabilized under each FR schedule, acute doses of rimonabant (1-10mg/kg) were administered prior to some sessions. The number of food reinforcers and responses in each condition was averaged and the exponential and linear demand equations were fit to the data. These demand equations quantify the value of a reinforcer by its sensitivity to price (FR) increases. Under vehicle conditions, obese Zucker rats consumed more sucrose pellets than leans at smaller fixed ratios; however, they were equally sensitive to price increases with both models of demand. Rimonabant dose-dependently reduced reinforcers and responses for lean and obese rats across all FR schedules. Data from the exponential analysis suggest that rimonabant dose-dependently increased elasticity, i.e., reduced the essential value of sucrose, a finding that is consistent with graphical depictions of normalized demand curves. Copyright © 2011 Elsevier Inc. All rights reserved.

A Problem-Solving Approach to Teaching Operant Conditioning

ERIC Educational Resources Information Center

Shields, Carolyn; Gredler, Margaret

2003-01-01

Psychology students frequently have misconceptions of basic concepts in operant conditioning. Prior classroom observations revealed that most students defined positive reinforcement as reward and equated negative reinforcement and punishment. Students also labeled positive reinforcement as rewarding good behavior and negative reinforcement as…

77 FR 34073 - Value Engineering

Federal Register 2010, 2011, 2012, 2013, 2014

2012-06-08

... OFFICE OF MANAGEMENT AND BUDGET Office of Federal Procurement Policy Value Engineering AGENCY... Office of Management and Budget Circular No. A-131, ``Value Engineering''. SUMMARY: The Office of Federal...- 131, Value Engineering, to update and reinforce policies associated with the consideration and use of...

78 FR 78399 - Value Engineering

Federal Register 2010, 2011, 2012, 2013, 2014

2013-12-26

... OFFICE OF MANAGEMENT AND BUDGET Office of Federal Procurement Policy Value Engineering AGENCY... to Office of Management and Budget Circular No. A-131, ``Value Engineering''. SUMMARY: The Office of... revisions to OMB Circular A-131, Value Engineering, to update and reinforce policies associated with the...

Food reinforcement during infancy

PubMed Central

Kong, Kai Ling

2017-01-01

The motivation to eat, as operationalized by measuring how hard someone will work for food, is cross-sectionally and prospectively related to obesity. Persons high in food reinforcement consume more calories, and energy intake mediates the relationship between food reinforcement and obesity. Research has shown avid sucking for milk in early infancy predicts later adiposity, and the relationship between food reinforcement and excess body weight has been observed in infants as young as 9 months of age. New methodological developments in studying food reinforcement in infants and young children provide the first opportunity to study the origin of food reinforcement. This review seeks to provide background on the measurement of food reinforcement, and to present, for the first time, prenatal and postnatal predictors of infant food reinforcement. Lastly, potential mechanisms for an increasing trajectory of food reinforcement throughout development are proposed. PMID:27373207

Fatigue and Fracture Characterization of GlasGridRTM Reinforced Asphalt Concrete Pavement

NASA Astrophysics Data System (ADS)

Safavizadeh, Seyed Amirshayan

tests were conducted at 15°C, 20°C, and 23°C, with the main focus being to find the characteristics at 20°C. The results obtained from the tests at the different temperatures were used to investigate the effects of temperature on the reflective cracking performance of the gridreinforced beam specimens. The temperature tests were also used to investigate the validity of the time-temperature superposition (t-TS) principle in shear and the beam fatigue performance of the grid-reinforced specimens. The NBFT results suggest that different interlayer conditions do not reflect a unique failure mechanism, and thus, in order to predict and model the performance of grid-reinforced pavement, all the mechanisms involved in weakening its structural integrity, including damage within the asphalt layers and along the interface, must be considered. The shear and beam fatigue test results suggest that the grid opening size, interfacial bond quality, and mixture type play important roles in the reflective cracking performance of GlasGrid-reinforced asphalt pavements. According to the NBTF results, GlasGrid reinforcement retards reflective crack growth by stiffening the composite system and introducing a joint stiffness parameter. The results also show that the higher the bond strength and interlayer stiffness values, the higher the joint stiffness and retardation effects. The t-TS studies proved the validity of this principle in terms of the reflective crack growth of the grid-reinforced beam specimens and the shear modulus and shear strength of the grid-reinforced interfaces.

Contrast and autoshaping in multiple schedules varying reinforcer rate and duration.

PubMed

Hamilton, B E; Silberberg, A

1978-07-01

Thirteen master pigeons were exposed to multiple schedules in which reinforcement frequency (Experiment I) or duration (Experiment II) was varied. In Phases 1 and 3 of Experiment I, the values of the first and second components' random-interval schedules were 33 and 99 seconds, respectively. In Phase 2, these values were 99 seconds for both components. In Experiment II, a random-interval 33-second schedule was associated with each component. During Phases 1 and 3, the first and second components had hopper durations of 7.5 and 2.5 seconds respectively. During Phase 2, both components' hopper durations were 2.5 seconds. In each experiment, positive contrast obtained for about half the master subjects. The rest showed a rate increase in both components (positive induction). Each master subject's key colors and reinforcers were synchronously presented on a response-independent basis to a yoked control. Richer component key-pecking occurred during each experiment's Phases 1 and 3 among half these subjects. However, none responded during the contrast condition (unchanged component of each experiment's Phase 2). From this it is inferred that autoshaping did not contribute to the contrast and induction findings among master birds. Little evidence of local contrast (highest rate at beginning of richer component) was found in any subject. These data show that (a) contrast can occur independently from autoshaping, (b) contrast assays during equal-valued components may produce induction, (c) local contrast in multiple schedules often does not occur, and (d) differential hopper durations can produce autoshaping and contrast.

Contrast and autoshaping in multiple schedules varying reinforcer rate and duration

PubMed Central

Hamilton, Bruce E.; Silberberg, Alan

1978-01-01

Thirteen master pigeons were exposed to multiple schedules in which reinforcement frequency (Experiment I) or duration (Experiment II) was varied. In Phases 1 and 3 of Experiment I, the values of the first and second components' random-interval schedules were 33 and 99 seconds, respectively. In Phase 2, these values were 99 seconds for both components. In Experiment II, a random-interval 33-second schedule was associated with each component. During Phases 1 and 3, the first and second components had hopper durations of 7.5 and 2.5 seconds respectively. During Phase 2, both components' hopper durations were 2.5 seconds. In each experiment, positive contrast obtained for about half the master subjects. The rest showed a rate increase in both components (positive induction). Each master subject's key colors and reinforcers were synchronously presented on a response-independent basis to a yoked control. Richer component key-pecking occurred during each experiment's Phases 1 and 3 among half these subjects. However, none responded during the contrast condition (unchanged component of each experiment's Phase 2). From this it is inferred that autoshaping did not contribute to the contrast and induction findings among master birds. Little evidence of local contrast (highest rate at beginning of richer component) was found in any subject. These data show that (a) contrast can occur independently from autoshaping, (b) contrast assays during equal-valued components may produce induction, (c) local contrast in multiple schedules often does not occur, and (d) differential hopper durations can produce autoshaping and contrast. PMID:16812081

Habituation of reinforcer effectiveness

PubMed Central

Lloyd, David R.; Medina, Douglas J.; Hawk, Larry W.; Fosco, Whitney D.; Richards, Jerry B.

2014-01-01

In this paper we propose an integrative model of habituation of reinforcer effectiveness (HRE) that links behavioral- and neural-based explanations of reinforcement. We argue that HRE is a fundamental property of reinforcing stimuli. Most reinforcement models implicitly suggest that the effectiveness of a reinforcer is stable across repeated presentations. In contrast, an HRE approach predicts decreased effectiveness due to repeated presentation. We argue that repeated presentation of reinforcing stimuli decreases their effectiveness and that these decreases are described by the behavioral characteristics of habituation (McSweeney and Murphy, 2009; Rankin etal., 2009). We describe a neural model that postulates a positive association between dopamine neurotransmission and HRE. We present evidence that stimulant drugs, which artificially increase dopamine neurotransmission, disrupt (slow) normally occurring HRE and also provide evidence that stimulant drugs have differential effects on operant responding maintained by reinforcers with rapid vs. slow HRE rates. We hypothesize that abnormal HRE due to genetic and/or environmental factors may underlie some behavioral disorders. For example, recent research indicates that slow-HRE is predictive of obesity. In contrast ADHD may reflect “accelerated-HRE.” Consideration of HRE is important for the development of effective reinforcement-based treatments. Finally, we point out that most of the reinforcing stimuli that regulate daily behavior are non-consumable environmental/social reinforcers which have rapid-HRE. The almost exclusive use of consumable reinforcers with slow-HRE in pre-clinical studies with animals may have caused the importance of HRE to be overlooked. Further study of reinforcing stimuli with rapid-HRE is needed in order to understand how habituation and reinforcement interact and regulate behavior. PMID:24409128

Habituation of reinforcer effectiveness.

PubMed

Lloyd, David R; Medina, Douglas J; Hawk, Larry W; Fosco, Whitney D; Richards, Jerry B

2014-01-09

In this paper we propose an integrative model of habituation of reinforcer effectiveness (HRE) that links behavioral- and neural-based explanations of reinforcement. We argue that HRE is a fundamental property of reinforcing stimuli. Most reinforcement models implicitly suggest that the effectiveness of a reinforcer is stable across repeated presentations. In contrast, an HRE approach predicts decreased effectiveness due to repeated presentation. We argue that repeated presentation of reinforcing stimuli decreases their effectiveness and that these decreases are described by the behavioral characteristics of habituation (McSweeney and Murphy, 2009; Rankin etal., 2009). We describe a neural model that postulates a positive association between dopamine neurotransmission and HRE. We present evidence that stimulant drugs, which artificially increase dopamine neurotransmission, disrupt (slow) normally occurring HRE and also provide evidence that stimulant drugs have differential effects on operant responding maintained by reinforcers with rapid vs. slow HRE rates. We hypothesize that abnormal HRE due to genetic and/or environmental factors may underlie some behavioral disorders. For example, recent research indicates that slow-HRE is predictive of obesity. In contrast ADHD may reflect "accelerated-HRE." Consideration of HRE is important for the development of effective reinforcement-based treatments. Finally, we point out that most of the reinforcing stimuli that regulate daily behavior are non-consumable environmental/social reinforcers which have rapid-HRE. The almost exclusive use of consumable reinforcers with slow-HRE in pre-clinical studies with animals may have caused the importance of HRE to be overlooked. Further study of reinforcing stimuli with rapid-HRE is needed in order to understand how habituation and reinforcement interact and regulate behavior.

Composite intersection reinforcement

NASA Technical Reports Server (NTRS)

Misciagna, David T. (Inventor); Fuhrer, Jessica J. (Inventor); Funk, Robert S. (Inventor); Tolotta, William S. (Inventor)

2010-01-01

An assembly and method for manufacturing a composite reinforcement for unitizing a structure are provided. According to one embodiment, the assembly includes a base having a plurality of pins extending outwardly therefrom to define a structure about which a composite fiber is wound to define a composite reinforcement preform. The assembly also includes a plurality of mandrels positioned adjacent to the base and at least a portion of the composite reinforcement preform, and a cap that is positioned over at least a portion of the plurality of mandrels. The cap is configured to engage each of the mandrels to support the mandrels and the composite reinforcement preform during a curing process to form the composite reinforcement.

Composite Intersection Reinforcement

NASA Technical Reports Server (NTRS)

Misciagna, David T. (Inventor); Fuhrer, Jessica J. (Inventor); Funk, Robert S. (Inventor); Tolotta, William S. (Inventor)

2013-01-01

An assembly and method for manufacturing a composite reinforcement for unitizing a structure are provided. According to one embodiment, the assembly includes a base having a plurality of pins extending outwardly therefrom to define a structure about which a composite fiber is wound to define a composite reinforcement preform. The assembly also includes a plurality of mandrels positioned adjacent to the base and at least a portion of the composite reinforcement preform, and a cap that is positioned over at least a portion of the plurality of mandrels. The cap is configured to engage each of the mandrels to support the mandrels and the composite reinforcement preform during a curing process to form the composite reinforcement.

Evidence for an involvement of 5-hydroxytryptaminergic neurones in the maintenance of operant behaviour by positive reinforcement.

PubMed

Wogar, M A; Bradshaw, C M; Szabadi, E

1991-01-01

The possible involvement of the ascending 5-hydroxytryptaminergic (5HTergic) pathways in the maintenance of operant behaviour by positive reinforcement was examined using a quantitative paradigm based on Herrnstein's (1970) equation which defines a hyperbolic relationship between steady-state response rate and reinforcement frequency in variable-interval schedules. Nine rats received injections of 5,7-dihydroxytryptamine into the dorsal and median raphe nuclei; 12 rats received sham injections. The rats were trained to steady-state in a series of variable-interval schedules of sucrose reinforcement affording a range of reinforcement frequencies. Herrnstein's equation was fitted to the data obtained from each rat and to the averaged data obtained from the two groups. The value of KH (the parameter expressing the reinforcement frequency needed to obtain the half-maximum response rate) was significantly lower in the lesioned group than in the control group; the values of Rmax (the parameter expressing the maximum response rate) did not differ significantly between the two groups. The levels of 5HT and 5-hydroxyindoleacetic acid in the parietal cortex, hippocampus, nucleus accumbens and hypothalamus were markedly reduced in all four regions in the lesioned group, but the levels of noradrenaline and dopamine were not significantly affected. The results indicate that damage to the central 5HTergic pathways resulted in an increase in the "value" of the sucrose reinforcer, without affecting the animals' response capacity. The results are consistent with the suggestion that the 5HTergic pathways may exert some limiting control on the "values" of certain reinforcers.

Prespeech motor learning in a neural network using reinforcement.

PubMed

Warlaumont, Anne S; Westermann, Gert; Buder, Eugene H; Oller, D Kimbrough

2013-02-01

Vocal motor development in infancy provides a crucial foundation for language development. Some significant early accomplishments include learning to control the process of phonation (the production of sound at the larynx) and learning to produce the sounds of one's language. Previous work has shown that social reinforcement shapes the kinds of vocalizations infants produce. We present a neural network model that provides an account of how vocal learning may be guided by reinforcement. The model consists of a self-organizing map that outputs to muscles of a realistic vocalization synthesizer. Vocalizations are spontaneously produced by the network. If a vocalization meets certain acoustic criteria, it is reinforced, and the weights are updated to make similar muscle activations increasingly likely to recur. We ran simulations of the model under various reinforcement criteria and tested the types of vocalizations it produced after learning in the different conditions. When reinforcement was contingent on the production of phonated (i.e. voiced) sounds, the network's post-learning productions were almost always phonated, whereas when reinforcement was not contingent on phonation, the network's post-learning productions were almost always not phonated. When reinforcement was contingent on both phonation and proximity to English vowels as opposed to Korean vowels, the model's post-learning productions were more likely to resemble the English vowels and vice versa. Copyright © 2012 Elsevier Ltd. All rights reserved.

Effect of Round Window Reinforcement on Hearing: A Temporal Bone Study With Clinical Implications for Surgical Reinforcement of the Round Window.

PubMed

Wegner, Inge; Eldaebes, Mostafa M A S; Landry, Thomas G; Adamson, Robert B; Grolman, Wilko; Bance, Manohar L

2016-06-01

Round window reinforcement leads to conductive hearing loss. The round window is stiffened surgically as therapy for various conditions, including perilymphatic fistula and superior semicircular canal dehiscence. Round window reinforcement reduces symptoms in these patients. However, it also reduces fluid displacement in the cochlea and might therefore increase conductive hearing loss. Perichondrium was applied to the round window membrane in nine fresh-frozen, nonpathologic temporal bones. In four temporal bones cartilage was applied subsequently. Acoustic stimuli in the form of frequency sweeps from 250 to 8000 Hz were generated at 110 dB sound pressure level. A total of 16 frequencies in a 1/3-octave series were used. Stapes velocities in response to the acoustic stimuli were measured at equally spaced multiple points covering the stapes footplate using a scanning laser Doppler interferometry system. Measurements were made at baseline, after applying perichondrium, and after applying cartilage. At frequencies up to 1000 Hz perichondrium reinforcement decreased stapes velocities by 1.5 to 2.9 dB compared with no reinforcement (p value = 0.003). Reinforcement with cartilage led to a further deterioration of stapes velocities by 2.6 to 4.2 dB at frequencies up to 1000 Hz (p value = 0.050). The higher frequencies were not affected by perichondrium reinforcement (p value = 0.774) or cartilage reinforcement (p value = 0.644). Our results seem to suggest a modest, clinically negligible effect of reinforcement with perichondrium. Placing cartilage on the round window resulted in a graded effect on stapes velocities in keeping with the increased stiffness of cartilage compared with perichondrium. Even so, the effect was relatively small.

Enhancing second-order conditioning with lesions of the basolateral amygdala.

PubMed

Holland, Peter C

2016-04-01

Because the occurrence of primary reinforcers in natural environments is relatively rare, conditioned reinforcement plays an important role in many accounts of behavior, including pathological behaviors such as the abuse of alcohol or drugs. As a result of pairing with natural or drug reinforcers, initially neutral cues acquire the ability to serve as reinforcers for subsequent learning. Accepting a major role for conditioned reinforcement in everyday learning is complicated by the often-evanescent nature of this phenomenon in the laboratory, especially when primary reinforcers are entirely absent from the test situation. Here, I found that under certain conditions, the impact of conditioned reinforcement could be extended by lesions of the basolateral amygdala (BLA). Rats received first-order Pavlovian conditioning pairings of 1 visual conditioned stimulus (CS) with food prior to receiving excitotoxic or sham lesions of the BLA, and first-order pairings of another visual CS with food after that surgery. Finally, each rat received second-order pairings of a different auditory cue with each visual first-order CS. As in prior studies, relative to sham-lesioned control rats, lesioned rats were impaired in their acquisition of second-order conditioning to the auditory cue paired with the first-order CS that was trained after surgery. However, lesioned rats showed enhanced and prolonged second-order conditioning to the auditory cue paired with the first-order CS that was trained before amygdala damage was made. Implications for an enhanced role for conditioned reinforcement by drug-related cues after drug-induced alterations in neural plasticity are discussed. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Reinforcement in plants.

PubMed

Hopkins, Robin

2013-03-01

A major goal of evolutionary biology is to understand how diverging populations become species. The evolution of reproductive isolation (RI) halts the genomic homogenization caused by gene flow and recombination, and enables differentiation and local adaptations to become fixed between newly forming species. Selection can favor the strengthening of RI through a process termed reinforcement. Reinforcement occurs when selection favors traits that decrease mating between two incipient species in response to costly mating or the production of maladapted hybrids. Although this process has been investigated more frequently in animals, there is also evidence of reinforcement in plants. There are three strategies for the investigation of the process of reinforcement: case studies of species or diverging taxa; experimental evolution studies; and comparative studies. Here, I discuss how all three strategies find evidence consistent with reinforcement occurring in plants. I focus largely on case studies, and use research on Phlox drummondii to illustrate the importance of testing alternative hypotheses. Although the existing evidence suggests that reinforcement can occur, further investigations, particularly using large-scale comparative studies, are needed to determine the importance of reinforcement in plant speciation.

Food reinforcement during infancy.

PubMed

Kong, Kai Ling; Epstein, Leonard H

2016-11-01

The motivation to eat, as operationalized by measuring how hard someone will work for food, is cross-sectionally and prospectively related to obesity. Persons high in food reinforcement consume more calories, and energy intake mediates the relationship between food reinforcement and obesity. Research has shown avid sucking for milk in early infancy predicts later adiposity, and the relationship between food reinforcement and excess body weight has been observed in infants as young as 9months of age. New methodological developments in studying food reinforcement in infants and young children provide the first opportunity to study the origin of food reinforcement. This review seeks to provide background on the measurement of food reinforcement, and to present, for the first time, prenatal and postnatal predictors of infant food reinforcement. Lastly, potential mechanisms for an increasing trajectory of food reinforcement throughout development are proposed. Copyright © 2016 Elsevier Inc. All rights reserved.

Sapphire reinforced alumina matrix composites

NASA Technical Reports Server (NTRS)

Jaskowiak, Martha H.; Setlock, John A.

1994-01-01

Unidirectionally reinforced A1203 matrix composites have been fabricated by hot pressing. Approximately 30 volume % of either coated or uncoated sapphire fiber was used as reinforcement. Unstabilized ZrO2 was applied as the fiber coating. Composite mechanical behavior was analyzed both after fabrication and after additional heat treatment. The results of composite tensile tests were correlated with fiber-matrix interfacial shear strengths determined from fiber push-out tests. Substantially higher strength and greater fiber pull-out were observed for the coated fiber composites for all processing conditions studied. The coated fiber composites retained up to 95% and 87% of their as-fabricated strength when heat treated at 14000C for 8 or 24 hours, respectively. Electron microscopy analysis of the fracture surfaces revealed extensive fiber pull-out both before and after heat treatment.

Responding for sucrose and wheel-running reinforcement: effect of D-amphetamine.

PubMed

Belke, T W; Oldford, A C; Forgie, M Y; Beye, J A

2005-07-01

The present study assessed the effect of D-amphetamine on responding maintained by wheel-running and sucrose reinforcement. Six male albino Wistar rats were placed in running wheels and exposed to a fixed-interval 30-s schedule that produced either a drop of 5% sucrose solution or the opportunity to run for 15 s as reinforcing consequences for lever pressing. Each reinforcer type was signaled by a different stimulus. Doses of 0.25, 0.5, 1.0, 1.5, and 3.0 mg/kg D-amphetamine were administered by i.p. injection 20 min prior to a session. As the dose increased, index of curvature values decreased toward zero and rate-dependency plots revealed increases in lower rates early in the interval and decreases in higher rates toward the end of the interval. Effects were similar in the presence of both stimuli. However, an analysis of post-reinforcement pauses and local response rates broken down by transitions revealed a differential effect. As the dose increased, local response rates following a wheel-running reinforcer were affected more than those following a sucrose reinforcer.

FEM investigation of concrete silos damaged and reinforced externally with CFRP

NASA Astrophysics Data System (ADS)

Kermiche, Sihem; Boussaid, Ouzine; Redjel, Bachir; Amirat, Abdelaziz

2018-03-01

The present work investigates the reinforcement of concrete wheat-grain silos under initial damage. The reinforcement is achieved by mounting bands of carbon fiber reinforced polymer (CFRP) on the external walls of the silo. 4 modes of reinforcement are adapted according to the width of the band, the gap between two bands, the height of reinforcement and the number of layers achieved through banding. Analytical analyses were conducted using the Reimbert method and the Eurocode 1 Part 4 method, as well as numerically through the finite element software Abaqus. Results show that the normal pressure reaches a peak value when approaching the silo hopper. Initial damage in a concrete silo was first determined using a 3D geometrical model, while the damage analyses were conducted to optimize the CFRP reinforcement by mounting 2 CFRP bands close together above and below the cylinder-hopper joint. Increasing the number of banding layers could produce better performance as the damage was slightly decreased from 0.161 to 0.152 for 1 and 4 layers respectively.

Individual differences in the reinforcing and punishing effects of nicotine in rhesus monkeys.

PubMed

Koffarnus, Mikhail N; Winger, Gail

2015-07-01

The relatively weak reinforcing effects of nicotine in experimental studies have been attributed to possible aversive effects or the need to space nicotine administrations over time to expose reinforcing effects. This study was designed to determine if the response-maintaining effects of nicotine are increased when availability is spaced through time, and whether nicotine is an effective punisher of remifentanil-maintained responding. Compared to a cocaine reference dose, nicotine dose and timeout (TO) value were varied in eight rhesus monkeys responding for intravenous (i.v.) nicotine on varying fixed-ratio (FR) schedules of reinforcement.The aversive effects of nicotine were evaluated in four animals choosing between a standard dose of remifentanil alone or in combination with one of several doses of nicotine. In three of eight self-administration monkeys, 0.01 mg/kg/inj nicotine did not maintain responding at any FR value. In the other five animals, nicotine-maintained response rates increased with either FR or TO values to a certain point, and then slowed. Maximum nicotine-maintained response rates were much slower than those maintained by cocaine, and demand for nicotine was less than demand for cocaine. Nicotine was an effective punisher of remifentanil-maintained responding at doses ranging from 0.01 to 0.3 mg/kg/inj. Lower punishing dose seemed to be related to the absence of reinforcing effects within subject. There are an order of magnitude individual differences in sensitivity to both the reinforcing and punishing effects of nicotine, and this drug may be unique in being a weak positive reinforcer in small doses and aversive in large doses.

A Comparison of Positive Reinforcement and Punishment in Two Special Education Classes.

ERIC Educational Resources Information Center

Otto, Richard G.

Compared was the effectiveness of punishment and positive reinforcement on the nonattending behaviors and academic achievement of 18 elementary grade children in two special classes for children with social or adjustment problems. During the positive reinforcement condition each student earned a slash mark whenever he was observed attending to…

Self-immunity microcapsules for corrosion protection of steel bar in reinforced concrete

NASA Astrophysics Data System (ADS)

Wang, Yanshuai; Fang, Guohao; Ding, Weijian; Han, Ningxu; Xing, Feng; Dong, Biqin

2015-12-01

A novel microcapsule-based self-immunity system for reinforced concrete is proposed. Its feasibility for hindering the corrosion of steel rebar by means of lifting the threshold value of [Cl-]/[OH-] is discussed. Precisely controlled release behavior enables corrosion protection in the case of depassivation. The release process is characterized over a designated range of pH values, and its release characteristics of the microcapsules, triggered by decreasing pH value, are captured by observing that the core crystals are released when exposed to a signal (stimulus). The aim of corrosion protection of steel bar is achieved through the constantly-stabilized passive film, and its stability is promoted using continuous calcium hydroxide released from the microcapsule, restoring alkaline conditions. The test results exhibited that the release process of the microcapsules is a function of time. Moreover, the release rate of core materials could interact with environmental pH value, in which the release rate is found to increase remarkably with decreasing pH value, but is inhibited by high pH levels.

Self-immunity microcapsules for corrosion protection of steel bar in reinforced concrete.

PubMed

Wang, Yanshuai; Fang, Guohao; Ding, Weijian; Han, Ningxu; Xing, Feng; Dong, Biqin

2015-12-17

A novel microcapsule-based self-immunity system for reinforced concrete is proposed. Its feasibility for hindering the corrosion of steel rebar by means of lifting the threshold value of [Cl(-)]/[OH(-)] is discussed. Precisely controlled release behavior enables corrosion protection in the case of depassivation. The release process is characterized over a designated range of pH values, and its release characteristics of the microcapsules, triggered by decreasing pH value, are captured by observing that the core crystals are released when exposed to a signal (stimulus). The aim of corrosion protection of steel bar is achieved through the constantly-stabilized passive film, and its stability is promoted using continuous calcium hydroxide released from the microcapsule, restoring alkaline conditions. The test results exhibited that the release process of the microcapsules is a function of time. Moreover, the release rate of core materials could interact with environmental pH value, in which the release rate is found to increase remarkably with decreasing pH value, but is inhibited by high pH levels.

Machining of Fibre Reinforced Plastic Composite Materials.

PubMed

Caggiano, Alessandra

2018-03-18

Fibre reinforced plastic composite materials are difficult to machine because of the anisotropy and inhomogeneity characterizing their microstructure and the abrasiveness of their reinforcement components. During machining, very rapid cutting tool wear development is experienced, and surface integrity damage is often produced in the machined parts. An accurate selection of the proper tool and machining conditions is therefore required, taking into account that the phenomena responsible for material removal in cutting of fibre reinforced plastic composite materials are fundamentally different from those of conventional metals and their alloys. To date, composite materials are increasingly used in several manufacturing sectors, such as the aerospace and automotive industry, and several research efforts have been spent to improve their machining processes. In the present review, the key issues that are concerning the machining of fibre reinforced plastic composite materials are discussed with reference to the main recent research works in the field, while considering both conventional and unconventional machining processes and reporting the more recent research achievements. For the different machining processes, the main results characterizing the recent research works and the trends for process developments are presented.

Machining of Fibre Reinforced Plastic Composite Materials

PubMed Central

2018-01-01

Fibre reinforced plastic composite materials are difficult to machine because of the anisotropy and inhomogeneity characterizing their microstructure and the abrasiveness of their reinforcement components. During machining, very rapid cutting tool wear development is experienced, and surface integrity damage is often produced in the machined parts. An accurate selection of the proper tool and machining conditions is therefore required, taking into account that the phenomena responsible for material removal in cutting of fibre reinforced plastic composite materials are fundamentally different from those of conventional metals and their alloys. To date, composite materials are increasingly used in several manufacturing sectors, such as the aerospace and automotive industry, and several research efforts have been spent to improve their machining processes. In the present review, the key issues that are concerning the machining of fibre reinforced plastic composite materials are discussed with reference to the main recent research works in the field, while considering both conventional and unconventional machining processes and reporting the more recent research achievements. For the different machining processes, the main results characterizing the recent research works and the trends for process developments are presented. PMID:29562635

Housing conditions modulate the reinforcing properties of cocaine in adolescent mice that binge on fat.

PubMed

Blanco-Gandía, M Carmen; Montagud-Romero, Sandra; Aguilar, María A; Miñarro, José; Rodríguez-Arias, Marta

2018-01-01

Binge eating is a specific form of overeating characterized by intermittent, excessive eating. To date, several studies have addressed the effects that bingeing on fat has on the rewarding effects of drugs of abuse, but they have found contradictory and highly variable results. Housing conditions could modulate these results, as most studies employ isolated animals to measure the exact amount of food that is ingested. The aim of this study was to evaluate the effects of housing conditions on the response of mice to cocaine, modulated by bingeing on a high-fat diet during adolescence. After 40days of binge-eating for 2h, three days a week (PND 29-69), the reinforcing effects of a non-effective dose of cocaine (1mg/kg) was evaluated using the conditioned place preference (CPP) paradigm. The anxiolytic profile using the Elevated Plus Maze and circulating leptin and corticosterone levels were also assessed. Our results show a significant escalation in the consumption of a high-fat diet between the first and the last week in both types of housed mice. Among the grouped mice, only those exposed to high-fat binge (HFB) developed CPP. Conversely, isolated mice fed with standard diet were more sensitive to the rewarding effects of a subthreshold dose of cocaine than those fed with HFB. Plasma leptin levels were elevated in both groups that developed CPP. Although isolated animals presented higher corticosterone levels with respect to the grouped ones, anxiety levels did not differ. Therefore, our results highlight the importance of housing conditions on the effects that a high-fat diet exerts on cocaine reward. Copyright © 2017 Elsevier Inc. All rights reserved.

Contingent Stimuli Signal Subsequent Reinforcer Ratios

ERIC Educational Resources Information Center

Boutros, Nathalie; Davison, Michael; Elliffe, Douglas

2011-01-01

Conditioned reinforcer effects may be due to the stimulus' discriminative rather than its strengthening properties. While this was demonstrated in a frequently-changing choice procedure, a single attempt to replicate in a relatively static choice environment failed. We contend that this was because the information provided by the stimuli was…

Reinforcer devaluation as a consequence of acute nicotine exposure and withdrawal

PubMed Central

Kirshenbaum, Ari; Green, John; Fay, Michael; Parks, Angelique; Phillips, Jesse; Stone, Jason; Roy, Tessa

2014-01-01

RATIONALE Nicotine discontinuation produces behaviors in rats that are congruent with anhedonia, and these symptoms may be related to the devaluation of non-nicotine reinforcers. OBJECTIVE Four separate experiments were performed to explore the parameters surrounding nicotine-induced reinforcer devaluation. METHODS In Experiments 1 and 2, nicotine (0.1 or 0.3 mg/kg) or 0.3 mg/kg nicotine plus 1.0 mg/kg mecamylamine was delivered to rats prior to progressive ratio (PR) schedule sessions in which sucrose was used as a reinforcer. In order to (a) evaluate reinforcer enhancement by nicotine, and (b) reinforcer devaluation in the absence of nicotine, all rats experienced two PR schedule sessions per day for 10 days. Experiment 3 involved nicotine (0.3 mg/kg) and a visual stimulus in place of sucrose reinforcement. In Experiment 4, rats received nicotine (0.3 mg/kg) either before or after a single PR-schedule session for 10 days. RESULTS Experiments 1 and 2 demonstrate that reinforcer devaluation is related to the occupation of nicotinic-acetylcholine receptors. Results from Experiment 3 provide some evidence that devaluation occurs with either sucrose or visual-stimulus reinforcement. Experiment 4 demonstrates that a necessary condition for reinforcer devaluation to occur is the concurrent exposure to the reinforcer and nicotine. CONCLUSIONS Reinforcer devaluation in rats emerges rapidly in a progressive, orderly fashion that coincides with accumulated exposure to nicotine. These results suggest that reinforcer devaluation may be a feature of nicotine that contributes to the abuse liability of tobacco products. PMID:25401169

Monetary effects on fear conditioning.

PubMed

Qu, Chen; Zhang, Aiyi; Chen, Qishan

2013-04-01

Previous research has found that the loss of money as a negative secondary reinforcer was as effective as a primary reinforcer during fear conditioning. The purpose of the present study was to explore the effect of monetary gain as a positive secondary reinforcer in fear conditioning. Participants were assigned to a high-reward group or low-reward group. Three kinds of squares prompting non-compensation shock, compensation shock, and no shock were presented. Skin conductance responses (SCRs) and self-ratings were recorded. The results revealed that (a) both SCRs and self-ratings in the compensation shock condition were lower than in the non-compensation shock condition, suggesting that money might block the learning stage of fear conditioning; and (b) a higher ratio of fear reduction was present in self-rating when compared to SCRs, suggesting that people might overstate the utility of money, subjectively. Monetary effects, the effects of different amounts of money, and the differences between subjective and physiological levels are discussed.