Facilitating tolerance of delayed reinforcement during functional communication training.

PubMed

Fisher, W W; Thompson, R H; Hagopian, L P; Bowman, L G; Krug, A

2000-01-01

Few clinical investigations have addressed the problem of delayed reinforcement. In this investigation, three individuals whose destructive behavior was maintained by positive reinforcement were treated using functional communication training (FCT) with extinction (EXT). Next, procedures used in the basic literature on delayed reinforcement and self-control (reinforcer delay fading, punishment of impulsive responding, and provision of an alternative activity during reinforcer delay) were used to teach participants to tolerate delayed reinforcement. With the first case, reinforcer delay fading alone was effective at maintaining low rates of destructive behavior while introducing delayed reinforcement. In the second case, the addition of a punishment component reduced destructive behavior to near-zero levels and facilitated reinforcer delay fading. With the third case, reinforcer delay fading was associated with increases in masturbation and head rolling, but prompting and praising the individual for completing work during the delay interval reduced all problem behaviors and facilitated reinforcer delay fading.

PARAMETRIC ANALYSIS OF DELAYED PRIMARY AND CONDITIONED REINFORCERS

PubMed Central

Leon, Yanerys; Borrero, John C.; DeLeon, Iser G.

2016-01-01

We examined the effects of delayed reinforcement on the responding of individuals with intellectual disabilities. Three conditions were evaluated: (a) food reinforcement, (b) token reinforcement with a postsession exchange opportunity, and (c) token reinforcement with a posttrial exchange opportunity. Within each condition, we assessed responding given (a) a no-reinforcement baseline, (b) immediate reinforcement, and (c) delayed reinforcement, in which responses produced a reinforcer after 1 of 6 delays. Results suggest that delayed food produced greater response persistence than did delayed tokens. PMID:27174440

Estimation of Critical Gap Based on Raff's Definition

PubMed Central

Guo, Rui-jun; Wang, Xiao-jing; Wang, Wan-xiang

2014-01-01

Critical gap is an important parameter used to calculate the capacity and delay of minor road in gap acceptance theory of unsignalized intersections. At an unsignalized intersection with two one-way traffic flows, it is assumed that two events are independent between vehicles' arrival of major stream and vehicles' arrival of minor stream. The headways of major stream follow M3 distribution. Based on Raff's definition of critical gap, two calculation models are derived, which are named M3 definition model and revised Raff's model. Both models use total rejected coefficient. Different calculation models are compared by simulation and new models are found to be valid. The conclusion reveals that M3 definition model is simple and valid. Revised Raff's model strictly obeys the definition of Raff's critical gap and its application field is more extensive than Raff's model. It can get a more accurate result than the former Raff's model. The M3 definition model and revised Raff's model can derive accordant result. PMID:25574160

Estimation of critical gap based on Raff's definition.

PubMed

Guo, Rui-jun; Wang, Xiao-jing; Wang, Wan-xiang

2014-01-01

Critical gap is an important parameter used to calculate the capacity and delay of minor road in gap acceptance theory of unsignalized intersections. At an unsignalized intersection with two one-way traffic flows, it is assumed that two events are independent between vehicles' arrival of major stream and vehicles' arrival of minor stream. The headways of major stream follow M3 distribution. Based on Raff's definition of critical gap, two calculation models are derived, which are named M3 definition model and revised Raff's model. Both models use total rejected coefficient. Different calculation models are compared by simulation and new models are found to be valid. The conclusion reveals that M3 definition model is simple and valid. Revised Raff's model strictly obeys the definition of Raff's critical gap and its application field is more extensive than Raff's model. It can get a more accurate result than the former Raff's model. The M3 definition model and revised Raff's model can derive accordant result.

DISCRIMINATION ACQUISITION IN CHILDREN WITH DEVELOPMENTAL DISABILITIES UNDER IMMEDIATE AND DELAYED REINFORCEMENT

PubMed Central

Sy, Jolene R.; Vollmer, Timothy R.

2012-01-01

We evaluated the discrimination acquisition of individuals with developmental disabilities under immediate and delayed reinforcement. In Experiment 1, discrimination between two alternatives was examined when reinforcement was immediate or delayed by 20 s, 30 s, or 40 s. In Experiment 2, discrimination between 2 alternatives was compared across an immediate reinforcement condition and a delayed reinforcement condition in which subjects could respond during the delay. In Experiment 3, discrimination among 4 alternatives was compared across immediate and delayed reinforcement. In Experiment 4, discrimination between 2 alternatives was examined when reinforcement was immediate and 0-s or 30-s intertrial intervals (ITI) were programmed. For most subjects, discrimination acquisition occurred under immediate reinforcement. However, for some subjects, introducing delays slowed or prevented discrimination acquisition under some conditions. Results from Experiment 4 suggest that longer ITIs cannot account for the lack of discrimination under delayed reinforcement. PMID:23322925

Determinants of choice for pigeons and humans on concurrent-chains schedules of reinforcement.

PubMed

Belke, T W; Pierce, W D; Powell, R A

1989-09-01

Concurrent-chains schedules of reinforcement were arranged for humans and pigeons. Responses of humans were reinforced with tokens exchangeable for money, and key pecks of 4 birds were reinforced with food. Variable-interval 30-s and 40-s schedules operated in the terminal links of the chains. Condition 1 exposed subjects to variable-interval 90-s and variable-interval 30-s initial links, respectively. Conditions 2 and 3 arranged equal initial-link schedules of 40 s or 120 s. Experimental conditions tested the descriptive adequacy of five equations: reinforcement density, delay reduction, modified delay reduction, matching and maximization. Results based on choice proportions and switch rates during the initial links showed that pigeons behaved in accord with delay-reduction models, whereas humans maximized overall rate of reinforcement. As discussed by Logue and associates in self-control research, different types of reinforcement may affect sensitivity to delay differentially. Pigeons' responses were reinforced with food, a reinforcer that is consumable upon presentation. Humans' responses were reinforced with money, a reinforcer exchanged for consumable reinforcers after it was earned. Reinforcers that are immediately consumed may generate high sensitivity to delay and behavior described as delay reduction. Reinforces with longer times to consumption may generate low sensitivity to delay and behavior that maximizes overall payoff.

Delay discounting of qualitatively different reinforcers in rats.

PubMed

Calvert, Amanda L; Green, Leonard; Myerson, Joel

2010-03-01

Humans discount larger delayed rewards less steeply than smaller rewards, whereas no such magnitude effect has been observed in rats (and pigeons). It remains possible that rats' discounting is sensitive to differences in the quality of the delayed reinforcer even though it is not sensitive to amount. To evaluate this possibility, Experiment 1 examined discounting of qualitatively different food reinforcers: highly preferred versus nonpreferred food pellets. Similarly, Experiment 2 examined discounting of highly preferred versus nonpreferred liquid reinforcers. In both experiments, an adjusting-amount procedure was used to determine the amount of immediate reinforcer that was judged to be of equal subjective value to the delayed reinforcer. The amount and quality of the delayed reinforcer were varied across conditions. Discounting was well described by a hyperbolic function, but no systematic effects of the quantity or the quality of the delayed reinforcer were observed.

Effect of Delayed Reinforcement on Skill Acquisition during Discrete-Trial Instruction: Implications for Treatment-Integrity Errors in Academic Settings

ERIC Educational Resources Information Center

Carroll, Regina A.; Kodak, Tiffany; Adolf, Kari J.

2016-01-01

We used an adapted alternating treatments design to compare skill acquisition during discrete-trial instruction using immediate reinforcement, delayed reinforcement with immediate praise, and delayed reinforcement for 2 children with autism spectrum disorder. Participants acquired the skills taught with immediate reinforcement; however, delayed…

Effect of delayed reinforcement on skill acquisition during discrete-trial instruction: Implications for treatmen-integrity errors in academic settings.

PubMed

Carroll, Regina A; Kodak, Tiffany; Adolf, Kari J

2016-03-01

We used an adapted alternating treatments design to compare skill acquisition during discrete-trial instruction using immediate reinforcement, delayed reinforcement with immediate praise, and delayed reinforcement for 2 children with autism spectrum disorder. Participants acquired the skills taught with immediate reinforcement; however, delayed reinforcement decreased the efficiency and effectiveness of discrete-trial instruction. We discuss the importance of evaluating the influence of treatment-integrity errors on skill acquisition during discrete-trial instruction. © 2015 Society for the Experimental Analysis of Behavior.

Delay discounting of food by rhesus monkeys: Cocaine and food choice in isomorphic and allomorphic situations.

PubMed

Huskinson, Sally L; Woolverton, William L; Green, Leonard; Myerson, Joel; Freeman, Kevin B

2015-06-01

Research on delay discounting has focused largely on nondrug reinforcers in an isomorphic context in which choice is between alternatives that involve the same type of reinforcer. Less often, delay discounting has been studied with drug reinforcers in a more ecologically valid allomorphic context where choice is between alternatives involving different types of reinforcers. The present experiment is the first to examine discounting of drug and nondrug reinforcers in both isomorphic and allomorphic situations using a theoretical model (i.e., the hyperbolic discounting function) that allows for comparisons of discounting rates between reinforcer types and amounts. The goal of the current experiment was to examine discounting of a delayed, nondrug reinforcer (food) by male rhesus monkeys when the immediate alternative was either food (isomorphic situation) or cocaine (allomorphic situation). In addition, we sought to determine whether there was a magnitude effect with delayed food in the allomorphic situation. Choice of immediate food and immediate cocaine increased with amount and dose, respectively. Choice functions for immediate food and cocaine generally shifted leftward as delay increased. Compared to isomorphic situations in which food was the immediate alternative, delayed food was discounted more steeply in allomorphic situations where cocaine was the immediate alternative. Notably, discounting was not affected by the magnitude of the delayed reinforcer. These data indicate that how steeply a delayed nondrug reinforcer is discounted may depend more on the qualitative characteristics of the immediate reinforcer and less on the magnitude of the delayed one. (c) 2015 APA, all rights reserved).

Effects of Acute and Chronic Flunitrazepam on Delay Discounting in Pigeons

PubMed Central

Eppolito, Amy K; France, Charles P; Gerak, Lisa R

2011-01-01

Delay to delivery of a reinforcer can decrease responding for that reinforcer and increase responding for smaller reinforcers that are available concurrently and delivered without delay; acute administration of drugs can alter responding for large, delayed reinforcers, although the impact of chronic treatment on delay discounting is not well understood. In this experiment, the effects of repeated administration of the benzodiazepine flunitrazepam were studied in 6 pigeons responding on one key to receive food that was delivered immediately and on a second key to receive a larger amount of food that was delivered following delays which increased across a single session. Pigeons responded predominantly for the large reinforcer when there were no delays and when delays were short; however, as delays increased, responding for the large reinforcer decreased. Acutely, flunitrazepam (0.32, 1.0 and 3.2 mg/kg) dose-dependently increased responding for the large reinforcer, shifting the discounting curve rightward and upward. Repeated administration of flunitrazepam (0.32, 1.0 and 3.2 mg/kg, each for six sessions, separated by one session during which vehicle was administered) did not markedly alter its effects on responding for the large reinforcer, indicating that the development of tolerance to this effect of flunitrazepam is modest under these conditions. PMID:21541119

Role of ionotropic glutamate receptors in delay and probability discounting in the rat.

PubMed

Yates, Justin R; Batten, Seth R; Bardo, Michael T; Beckmann, Joshua S

2015-04-01

Discounting of delayed and probabilistic reinforcement is linked to increased drug use and pathological gambling. Understanding the neurobiology of discounting is important for designing treatments for these disorders. Glutamate is considered to be involved in addiction-like behaviors; however, the role of ionotropic glutamate receptors (iGluRs) in discounting remains unclear. The current study examined the effects of N-methyl-D-aspartate (NMDA) and α-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid (AMPA) glutamate receptor blockade on performance in delay and probability discounting tasks. Following training in either delay or probability discounting, rats (n = 12, each task) received pretreatments of the NMDA receptor antagonists MK-801 (0, 0.01, 0.03, 0.1, or 0.3 mg/kg, s.c.) or ketamine (0, 1.0, 5.0, or 10.0 mg/kg, i.p.), as well as the AMPA receptor antagonist CNQX (0, 1.0, 3.0, or 5.6 mg/kg, i.p.). Hyperbolic discounting functions were used to estimate sensitivity to delayed/probabilistic reinforcement and sensitivity to reinforcer amount. An intermediate dose of MK-801 (0.03 mg/kg) decreased sensitivity to both delayed and probabilistic reinforcement. In contrast, ketamine did not affect the rate of discounting in either task but decreased sensitivity to reinforcer amount. CNQX did not alter sensitivity to reinforcer amount or delayed/probabilistic reinforcement. These results show that blockade of NMDA receptors, but not AMPA receptors, decreases sensitivity to delayed/probabilistic reinforcement (MK-801) and sensitivity to reinforcer amount (ketamine). The differential effects of MK-801 and ketamine demonstrate that sensitivities to delayed/probabilistic reinforcement and reinforcer amount are pharmacologically dissociable.

Algorithms for sorting unsigned linear genomes by the DCJ operations.

PubMed

Jiang, Haitao; Zhu, Binhai; Zhu, Daming

2011-02-01

The double cut and join operation (abbreviated as DCJ) has been extensively used for genomic rearrangement. Although the DCJ distance between signed genomes with both linear and circular (uni- and multi-) chromosomes is well studied, the only known result for the NP-complete unsigned DCJ distance problem is an approximation algorithm for unsigned linear unichromosomal genomes. In this article, we study the problem of computing the DCJ distance on two unsigned linear multichromosomal genomes (abbreviated as UDCJ). We devise a 1.5-approximation algorithm for UDCJ by exploiting the distance formula for signed genomes. In addition, we show that UDCJ admits a weak kernel of size 2k and hence an FPT algorithm running in O(2(2k)n) time.

An effect of immediate reinforcement and delayed punishment, with possible implications for self-control.

PubMed

Epstein, R

1984-12-01

Behavior said to show self-control occurs virtually always as an alternative to behavior that produces conflicting consequences. One class of such consequences, immediate reinforcement and delayed punishment, is especially pervasive. Three experiments are described in which an effect of immediate reinforcement and delayed punishment is demonstrated. The results suggest that when immediate reinforcement and delayed punishment are imminent, the reinforcer alone controls the organism's behavior (in other words the organism behaves "impulsively"). The key to self-control, therefore, may be the acquisition of a large number of avoidance behaviors relevant to reinforcers that are correlated with delayed punishment. Human self-control may indeed involve such a process but undoubtedly involves others as well.

Food reinforcement and delay discounting in zBMI-discordant siblings.

PubMed

Feda, Denise M; Roemmich, James N; Roberts, April; Epstein, Leonard H

2015-02-01

The interaction of food reinforcement and the inability to delay gratification are related to adult energy intake and obesity. This study was designed to test the association of sibling pair differences in relative reinforcing efficacy of food and delay discounting on sibling pair differences in zBMI scores of same-gender zBMI-discordant siblings. We tested main and interactive relationships between delay discounting and relative reinforcing efficacy of food on zBMI discordance in 14 zBMI-discordant biological sibling pairs (6 female pairs) using a discordant sibling study design. Sibling pair differences in relative reinforcing efficacy of food were associated with sibling pair differences in zBMI (p= 0.046); this effect was moderated by delay discounting (p <0.002). Sibling pairs with greater differences in relative reinforcing efficacy and delay discounting had greater differences in zBMI. The combination of greater sibling pair differences in delay discounting and relative reinforcing efficacy is associated with greater discordance in zBMI in adolescent sibling pairs. Copyright © 2014 Elsevier Ltd. All rights reserved.

Food reinforcement and delay discounting in zBMI-discordant siblings ☆

PubMed Central

Feda, Denise M.; Roemmich, James N.; Roberts, April; Epstein, Leonard H.

2014-01-01

Objective The interaction of food reinforcement and the inability to delay gratification are related to adult energy intake and obesity. This study was designed to test the association of sibling pair differences in relative reinforcing efficacy of food and delay discounting on sibling pair differences in zBMI scores of same-gender zBMI-discordant siblings. Design and methods We tested main and interactive relationships between delay discounting and relative reinforcing efficacy of food on zBMI discordance in 14 zBMI-discordant biological sibling pairs (6 female pairs) using a discordant sibling study design. Results Sibling pair differences in relative reinforcing efficacy of food were associated with sibling pair differences in zBMI (p = 0.046); this effect was moderated by delay discounting (p < 0.002). Sibling pairs with greater differences in relative reinforcing efficacy and delay discounting had greater differences in zBMI. Conclusions The combination of greater sibling pair differences in delay discounting and relative reinforcing efficacy is associated with greater discordance in zBMI in adolescent sibling pairs. PMID:25464024

Human self-control and the density of reinforcement

PubMed Central

Flora, Stephen R.; Pavlik, William B.

1992-01-01

Choice responding in adult humans on a discrete-trial button-pressing task was examined as a function of amount, delay, and overall density (points per unit time) of reinforcement. Reinforcement consisted of points that were exchangeable for money. In T 0 conditions, an impulsive response produced 4 points immediately and a self-control response produced 10 points after a delay of 15 s. In T 15 conditions, a constant delay of 15 s was added to both prereinforcer delays. Postreinforcer delays, which consisted of 15 s added to the end of each impulsive trial, equated trial durations regardless of choice, and was manipulated in both T 0 and T 15 conditions. In all conditions, choice was predicted directly from the relative reinforcement densities of the alternatives. Self-control was observed in all conditions except T 0 without postreinforcer delays, where the impulsive choices produced the higher reinforcement density. These results support previous studies showing that choice is a direct function of the relative reinforcement densities when conditioned (point) reinforcers are used. In contrast, where responding produces intrinsic (immediately consumable) reinforcers, immediacy of reinforcement appears to account for preference when density does not. PMID:16812652

Effects of amphetamine on delay discounting in rats depend upon the manner in which delay is varied

PubMed Central

Maguire, David R; Henson, Cedric; France, Charles P

2014-01-01

Whether stimulant drugs like amphetamine increase or decrease choice of larger delayed reinforcers over smaller immediately available reinforcers under delay discounting procedures can depend on several factors, including the order in which delay is presented. This study examined whether the order of delay presentation impacts drug effects on discounting in rats (n=8) trained and tested under an ascending order, a descending order, as well as under a fixed delay condition. Responses on one lever delivered 1 food pellet immediately and responses on the other lever delivered 3 food pellets immediately or after a delay (4–32 s). In Experiment 1, the delay to the larger reinforcer varied within session and the order of delay presentation (ascending or descending) varied across conditions. In Experiment 2, the same delay value was presented in all blocks of the session (i.e., delay was fixed), and delay varied across phases. Under the ascending order of delay, amphetamine (0.32–1.78 mg/kg) increased choice of the larger reinforcer in some rats and decreased choice in others. In the same rats responding under the descending and fixed delay conditions, amphetamine markedly decreased choice of the larger reinforcer even in the component associated with no delay. In some subjects, the effects of amphetamine differed depending on the manner in which delay was presented, indicating that drug-induced changes in performance were due, in part, to mechanisms other than altered sensitivity to reinforcer delay. These results also suggest that a history of responding under both orders of delay presentation can modulate drug effects. PMID:24780379

A COMPARISON OF THE EFFECTS OF BRIEF RULES, A TIMER, AND PREFERRED TOYS ON SELF-CONTROL

PubMed Central

Newquist, Matthew H; Dozier, Claudia L; Neidert, Pamela L

2012-01-01

Some children make impulsive choices (i.e., choose a small but immediate reinforcer over a large but delayed reinforcer). Previous research has shown that delay fading, providing an alternative activity during the delay, teaching participants to repeat a rule during the delay, combining delay fading with an alternative activity, and combining delay fading with a countdown timer are effective for increasing self-control (i.e., choosing the large but delayed reinforcer over the small but immediate reinforcer). The purpose of the current study was to compare the effects of various interventions in the absence of delay fading (i.e., providing brief rules, providing a countdown timer during the delay, or providing preferred toys during the delay) on self-control. Results suggested that providing brief rules or a countdown timer during the delay was ineffective for enhancing self-control. However, providing preferred toys during the delay effectively enhanced self-control. PMID:23060664

A comparison of the effects of brief rules, a timer, and preferred toys on self-control.

PubMed

Newquist, Matthew H; Dozier, Claudia L; Neidert, Pamela L

2012-01-01

Some children make impulsive choices (i.e., choose a small but immediate reinforcer over a large but delayed reinforcer). Previous research has shown that delay fading, providing an alternative activity during the delay, teaching participants to repeat a rule during the delay, combining delay fading with an alternative activity, and combining delay fading with a countdown timer are effective for increasing self-control (i.e., choosing the large but delayed reinforcer over the small but immediate reinforcer). The purpose of the current study was to compare the effects of various interventions in the absence of delay fading (i.e., providing brief rules, providing a countdown timer during the delay, or providing preferred toys during the delay) on self-control. Results suggested that providing brief rules or a countdown timer during the delay was ineffective for enhancing self-control. However, providing preferred toys during the delay effectively enhanced self-control.

Shallow discounting of delayed cocaine by male rhesus monkeys when immediate food is the choice alternative.

PubMed

Huskinson, Sally L; Myerson, Joel; Green, Leonard; Rowlett, James K; Woolverton, William L; Freeman, Kevin B

2016-12-01

Huskinson et al. (2015) recently examined delay discounting in monkeys choosing between an immediate drug (cocaine) reinforcer and a delayed nondrug (food) reinforcer. The present experiment examined the reverse situation: choice between immediate nondrug (food) and delayed drug (cocaine) reinforcers. Whereas the former choice situation exemplifies drug abuse from a delay-discounting perspective, our interest in the latter choice situation is derived from the observation that drug abusers, who characteristically are associated with impulsive choice, typically must devote considerable time to procuring drugs, often at the expense of immediate nondrug alternatives. Accordingly, we analyzed 3 male rhesus monkeys' choices between immediate food and delayed cocaine (0.1 and 0.2 mg/kg/injection) using a hyperbolic model that allowed us to compare discounting rates between qualitatively different reinforcers. Choice of immediate food increased with food amount, and choice functions generally shifted leftward as delay to cocaine increased, indicating a decrease in the subjective value of cocaine. Compared with our previous delay-discounting experiment with immediate cocaine versus delayed food, both doses of delayed cocaine were discounted at a shallow rate. The present results demonstrate that rhesus monkeys will tolerate relatively long delays in an immediate-food versus delayed-drug situation, suggesting that in intertemporal choices between cocaine and food, the subjective value of cocaine is less affected by the delay until reinforcement than is the subjective value of delayed food. More generally, the present findings suggest that although drug abusers may choose impulsively when immediate drug reinforcement is available, they exercise self-control in the acquisition of a highly preferred, delayed drug reinforcer. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Reversing the Signaled Magnitude Effect in Delayed Matching to Sample: Delay-Specific Remembering?

ERIC Educational Resources Information Center

White, K. Geoffrey; Brown, Glenn S.

2011-01-01

Pigeons performed a delayed matching-to-sample task in which large or small reinforcers for correct remembering were signaled during the retention interval. Accuracy was low when small reinforcers were signaled, and high when large reinforcers were signaled (the signaled magnitude effect). When the reinforcer-size cue was switched from small to…

The effect of reinforcer magnitude on probability and delay discounting of experienced outcomes in a computer game task in humans.

PubMed

Greenhow, Anna K; Hunt, Maree J; Macaskill, Anne C; Harper, David N

2015-09-01

Delay and uncertainty of receipt both reduce the subjective value of reinforcers. Delay has a greater impact on the subjective value of smaller reinforcers than of larger ones while the reverse is true for uncertainty. We investigated the effect of reinforcer magnitude on discounting of delayed and uncertain reinforcers using a novel approach: embedding relevant choices within a computer game. Participants made repeated choices between smaller, certain, immediate outcomes and larger, but delayed or uncertain outcomes while experiencing the result of each choice. Participants' choices were generally well described by the hyperbolic discounting function. Smaller numbers of points were discounted more steeply than larger numbers as a function of delay but not probability. The novel experiential choice task described is a promising approach to investigating both delay and probability discounting in humans. © Society for the Experimental Analysis of Behavior.

Frontal Theta Reflects Uncertainty and Unexpectedness during Exploration and Exploitation

PubMed Central

Figueroa, Christina M.; Cohen, Michael X; Frank, Michael J.

2012-01-01

In order to understand the exploitation/exploration trade-off in reinforcement learning, previous theoretical and empirical accounts have suggested that increased uncertainty may precede the decision to explore an alternative option. To date, the neural mechanisms that support the strategic application of uncertainty-driven exploration remain underspecified. In this study, electroencephalography (EEG) was used to assess trial-to-trial dynamics relevant to exploration and exploitation. Theta-band activities over middle and lateral frontal areas have previously been implicated in EEG studies of reinforcement learning and strategic control. It was hypothesized that these areas may interact during top-down strategic behavioral control involved in exploratory choices. Here, we used a dynamic reward–learning task and an associated mathematical model that predicted individual response times. This reinforcement-learning model generated value-based prediction errors and trial-by-trial estimates of exploration as a function of uncertainty. Mid-frontal theta power correlated with unsigned prediction error, although negative prediction errors had greater power overall. Trial-to-trial variations in response-locked frontal theta were linearly related to relative uncertainty and were larger in individuals who used uncertainty to guide exploration. This finding suggests that theta-band activities reflect prefrontal-directed strategic control during exploratory choices. PMID:22120491

Effects of Reinforcer Probability, Delay, and Response Requirements on the Choices of Rats and Pigeons: Possible Species Differences

ERIC Educational Resources Information Center

Mazur, James E.

2005-01-01

In Experiment 1 with rats, a left lever press led to a 5-s delay and then a possible reinforcer. A right lever press led to an adjusting delay and then a certain reinforcer. This delay was adjusted over trials to estimate an indifference point, or a delay at which the two alternatives were chosen about equally often. Indifference points increased…

Teaching self-control with qualitatively different reinforcers.

PubMed

Passage, Michael; Tincani, Matt; Hantula, Donald A

2012-01-01

This study examined the effectiveness of using qualitatively different reinforcers to teach self-control to an adolescent boy who had been diagnosed with an intellectual disability. First, he was instructed to engage in an activity without programmed reinforcement. Next, he was instructed to engage in the activity under a two-choice fixed-duration schedule of reinforcement. Finally, he was exposed to self-control training, during which the delay to a more preferred reinforcer was initially short and then increased incrementally relative to the delay to a less preferred reinforcer. Self-control training effectively increased time on task to earn the delayed reinforcer.

Isolating behavioral mechanisms of intertemporal choice: nicotine effects on delay discounting and amount sensitivity.

PubMed

Locey, Matthew L; Dallery, Jesse

2009-03-01

Many drugs of abuse produce changes in impulsive choice, that is, choice for a smaller-sooner reinforcer over a larger-later reinforcer. Because the alternatives differ in both delay and amount, it is not clear whether these drug effects are due to the differences in reinforcer delay or amount. To isolate the effects of delay, we used a titrating delay procedure. In phase 1, 9 rats made discrete choices between variable delays (1 or 19 s, equal probability of each) and a delay to a single food pellet. The computer titrated the delay to a single food pellet until the rats were indifferent between the two options. This indifference delay was used as the starting value for the titrating delay for all future sessions. We next evaluated the acute effects of nicotine (subcutaneous 1.0, 0.3, 0.1, and 0.03 mg/kg) on choice. If nicotine increases delay discounting, it should have increased preference for the variable delay. Instead, nicotine had very little effect on choice. In a second phase, the titrated delay alternative produced three food pellets instead of one, which was again produced by the variable delay (1 s or 19 s) alternative. Under this procedure, nicotine increased preference for the one pellet alternative. Nicotine-induced changes in impulsive choice are therefore likely due to differences in reinforcer amount rather than differences in reinforcer delay. In addition, it may be necessary to include an amount sensitivity parameter in any mathematical model of choice when the alternatives differ in reinforcer amount.

Delayed Reinforcement of Operant Behavior

ERIC Educational Resources Information Center

Lattal, Kennon A.

2010-01-01

The experimental analysis of delay of reinforcement is considered from the perspective of three questions that seem basic not only to understanding delay of reinforcement but also, by implication, the contributions of temporal relations between events to operant behavior. The first question is whether effects of the temporal relation between…

Teaching self-control to small groups of dually diagnosed adults.

PubMed

Dixon, M R; Holcomb, S

2000-01-01

The present study examined the use of a progressive delay procedure to teach self-control to two groups of dually diagnosed adults. When given a choice between an immediate smaller reinforcer and a larger delayed reinforcer, both groups chose the smaller reinforcer during baseline. During treatment, progressive increases in work requirements for gaining access to a larger reinforcer resulted in both groups selecting larger delayed reinforcers. The results are discussed with respect to increasing cooperative work behavior and self-control.

Multiscale Architectures and Parallel Algorithms for Video Object Tracking

DTIC Science & Technology

2011-10-01

0 4 : if FIFO1 contains nDt frames then 5: Partition data into blocks. 6: Put SPE control block information...char buf 4 = FF; vec to r unsigned char buf 5 = FF; vec to r unsigned char buf 6 = FF; vec to r unsigned char buf 7 = FF; for ( j = 0 ; j < s i z e ; j...Public Release; Distribution Unlimited 8 7 u 6 ill :J (;) 5 E -;::; c 0 4 ~ u Q) X 3 Q) 8 7 6 u Q) Ul 5 :J (;) E :;::; 4 c 0

Resistance to Change and Relapse of Observing

PubMed Central

Thrailkill, Eric A; Shahan, Timothy A

2012-01-01

Four experiments examined relapse of extinguished observing behavior of pigeons using a two-component multiple schedule of observing-response procedures. In both components, unsignaled periods of variable-interval (VI) food reinforcement alternated with extinction and observing responses produced stimuli associated with the availability of the VI schedule (i.e., S+). The components differed in the rate of food arranged (Rich  = VI 30 s; Lean  =  VI 120 s). In Experiment 1, following baseline training, extinction of observing involved removal of both food and S+ deliveries, and reinstatement was examined by presenting either response-independent food or S+ deliveries. In Experiment 2, extinction involved removal of only food deliveries while observing responses continued to produce S+. Reinstatement was examined by delivering food contingent upon the first two food-key responses occurring in the presence of the S+. Experiment 3 assessed ABA renewal of observing by extinguishing food-key and observing responses in the presence of one contextual stimulus (i.e., B) and then returning to the original training context (i.e., A) during continued extinction. Experiment 4 examined resurgence by introducing food reinforcement for an alternative response during extinction, and subsequently removing that alternative source of food. Across experiments, relative resistance to extinction and relapse of observing tended to be greater in the component previously associated with the higher rate of primary reinforcement. Relapse of observing or attending to stimuli associated with primary reinforcement appears to be impacted by frequency of primary reinforcement in a manner similar to responding maintained directly by primary reinforcement. PMID:22693359

Isolating Behavioral Mechanisms of Inter-Temporal Choice: Nicotine Effects on Delay Discounting and Amount Sensitivity

ERIC Educational Resources Information Center

Locey, Matthew L.; Dallery, Jesse

2009-01-01

Many drugs of abuse produce changes in impulsive choice, that is, choice for a smaller-sooner reinforcer over a larger-later reinforcer. Because the alternatives differ in both delay and amount, it is not clear whether these drug effects are due to the differences in reinforcer delay or amount. To isolate the effects of delay, we used a titrating…

Food reinforcement and delay discounting in zBMI-discordant siblings

USDA-ARS?s Scientific Manuscript database

The interaction of food reinforcement and the inability to delay gratification are related to adult energy intake and obesity. This study was designed to test the association of sibling pair differences in relative reinforcing efficacy of food and delay discounting on sibling pair differences in zBM...

DISTRIBUTED AND ACCUMULATED REINFORCEMENT ARRANGEMENTS: EVALUATIONS OF EFFICACY AND PREFERENCE

PubMed Central

DELEON, ISER G.; CHASE, JULIE A.; FRANK-CRAWFORD, MICHELLE A.; CARREAU-WEBSTER, ABBEY B.; TRIGGS, MANDY M.; BULLOCK, CHRISTOPHER E.; JENNETT, HEATHER K.

2015-01-01

We assessed the efficacy of, and preference for, accumulated access to reinforcers, which allows uninterrupted engagement with the reinforcers but imposes an inherent delay required to first complete the task. Experiment 1 compared rates of task completion in 4 individuals who had been diagnosed with intellectual disabilities when reinforcement was distributed (i.e., 30-s access to the reinforcer delivered immediately after each response) and accumulated (i.e., 5-min access to the reinforcer after completion of multiple consecutive responses). Accumulated reinforcement produced response rates that equaled or exceeded rates during distributed reinforcement for 3 participants. Experiment 2 used a concurrent-chains schedule to examine preferences for each arrangement. All participants preferred delayed, accumulated access when the reinforcer was an activity. Three participants also preferred accumulated access to edible reinforcers. The collective results suggest that, despite the inherent delay, accumulated reinforcement is just as effective and is often preferred by learners over distributed reinforcement. PMID:24782203

Free-Operant Avoidance Behavior by Rats after Reinforcer Revaluation Using Opioid Agonists and d-Amphetamine

PubMed Central

Urcelay, Gonzalo; Mar, Adam; Dickinson, Anthony; Robbins, Trevor

2014-01-01

The associative processes that support free-operant instrumental avoidance behavior are still unknown. We used a revaluation procedure to determine whether the performance of an avoidance response is sensitive to the current value of the aversive, negative reinforcer. Rats were trained on an unsignaled, free-operant lever press avoidance paradigm in which each response avoided or escaped shock and produced a 5 s feedback stimulus. The revaluation procedure consisted of noncontingent presentations of the shock in the absence of the lever either paired or unpaired with systemic morphine and in a different cohort with systemic d-amphetamine. Rats were then tested drug free during an extinction test. In both the d-amphetamine and morphine groups, pairing of the drug and shock decreased subsequent avoidance responding during the extinction test, suggesting that avoidance behavior was sensitive to the current incentive value of the aversive negative reinforcer. Experiment 2 used central infusions of D-Ala2, NMe-Phe4, Gly-ol5]-enkephalin (DAMGO), a mu-opioid receptor agonist, in the periacqueductal gray and nucleus accumbens shell to revalue the shock. Infusions of DAMGO in both regions replicated the effects seen with systemic morphine. These results are the first to demonstrate the impact of revaluation of an aversive reinforcer on avoidance behavior using pharmacological agents, thereby providing potential therapeutic targets for the treatment of avoidance behavior symptomatic of anxiety disorders. PMID:24790199

Choice between Single and Multiple Reinforcers in Concurrent-Chains Schedules

ERIC Educational Resources Information Center

Mazur, James E.

2006-01-01

Pigeons responded on concurrent-chains schedules with equal variable-interval schedules as initial links. One terminal link delivered a single reinforcer after a fixed delay, and the other terminal link delivered either three or five reinforcers, each preceded by a fixed delay. Some conditions included a postreinforcer delay after the single…

Discrimination Acquisition in Children with Developmental Disabilities under Immediate and Delayed Reinforcement

ERIC Educational Resources Information Center

Sy, Jolene R.; Vollmer, Timothy R.

2012-01-01

We evaluated the discrimination acquisition of individuals with developmental disabilities under immediate and delayed reinforcement. In Experiment 1, discrimination between two alternatives was examined when reinforcement was immediate or delayed by 20 s, 30 s, or 40 s. In Experiment 2, discrimination between 2 alternatives was compared across an…

Vehicle barrier with access delay

DOEpatents

Swahlan, David J; Wilke, Jason

2013-09-03

An access delay vehicle barrier for stopping unauthorized entry into secure areas by a vehicle ramming attack includes access delay features for preventing and/or delaying an adversary from defeating or compromising the barrier. A horizontally deployed barrier member can include an exterior steel casing, an interior steel reinforcing member and access delay members disposed within the casing and between the casing and the interior reinforcing member. Access delay members can include wooden structural lumber, concrete and/or polymeric members that in combination with the exterior casing and interior reinforcing member act cooperatively to impair an adversarial attach by thermal, mechanical and/or explosive tools.

Safety and Guidelines for Marked and Unmarked Pedestrian Crosswalks at Unsignalized Intersections in Nevada

DOT National Transportation Integrated Search

2012-09-01

This report examines two aspects of marked and unmarked crosswalks at unsignalized intersections. Firstly, the report assesses the safety performance of marked/unmarked crosswalks in Nevada through comparing pedestrian-related crash rates. In which, ...

10. Historic American Buildings Survey Photocopy of Unsigned, Undated Drawing, ...

Library of Congress Historic Buildings Survey, Historic Engineering Record, Historic Landscapes Survey

10. Historic American Buildings Survey Photocopy of Unsigned, Undated Drawing, Courtesy, The Cosmos Club PROPOSED FLOOR PLANS, 2121 MASSACHUSETTS AVENUE, N.W., BLUEPRINT #11, THIRD FLOOR PLAN - Townsend House, 2121 Massachusetts Avenue Northwest, Washington, District of Columbia, DC

11. Historic American Buildings Survey Photocopy of Unsigned, Undated Drawing, ...

Library of Congress Historic Buildings Survey, Historic Engineering Record, Historic Landscapes Survey

11. Historic American Buildings Survey Photocopy of Unsigned, Undated Drawing, Courtesy, The Cosmos Club PROPOSED FLOOR PLANS, 2121 MASSACHUSETTS AVENUE, N.W., BLUEPRINT #11, FOURTH FLOOR PLAN - Townsend House, 2121 Massachusetts Avenue Northwest, Washington, District of Columbia, DC

9. Historic American Buildings Survey Photocopy of Unsigned, Undated Drawing, ...

Library of Congress Historic Buildings Survey, Historic Engineering Record, Historic Landscapes Survey

9. Historic American Buildings Survey Photocopy of Unsigned, Undated Drawing, Courtesy, The Cosmos Club PROPOSED FLOOR PLANS, 2121 MASSACHUSETTS AVENUE, N.W., BLUEPRING #11, SECOND FLOOR PLAN - Townsend House, 2121 Massachusetts Avenue Northwest, Washington, District of Columbia, DC

8. Historic American Buildings Survey Photocopy of Unsigned, Undated Drawing, ...

Library of Congress Historic Buildings Survey, Historic Engineering Record, Historic Landscapes Survey

8. Historic American Buildings Survey Photocopy of Unsigned, Undated Drawing, Courtesy, The Cosmos Club PROPOSED FLOOR PLANS, 2121 MASSACHUSETTS AVENUE, N.W., BLUEPRINT #11, FIRST-FLOOR PLAN - Townsend House, 2121 Massachusetts Avenue Northwest, Washington, District of Columbia, DC

Safety effects of unsignalized superstreets in North Carolina.

PubMed

Ott, Sarah E; Haley, Rebecca L; Hummer, Joseph E; Foyle, Robert S; Cunningham, Christopher M

2012-03-01

Arterials across the United States are experiencing far too many collisions. Agencies tasked with improving these arterials have few available effective solutions. Superstreets, called restricted crossing u-turns by the Federal Highway Administration (FHWA), are part of a menu of unconventional arterial intersection designs that may provide a promising solution. Up to this point, there is little valid information available on the safety effects of superstreets, as study results have been from basic analyses that only account for traffic volume changes. The purpose of this research was to determine the safety effects of the unsignalized superstreet countermeasure on existing arterials in North Carolina. The safety study involved traffic flow adjustment, comparison-group, and Empirical Bayes analyses of 13 unsignalized superstreet intersections in North Carolina. The superstreets have been installed in the last few years across the state as opportunities presented themselves, but not necessarily at the most hazardous sites. The unsignalized superstreet countermeasure showed a significant reduction in total, angle and right turn, and left turn collisions in all analyses. Analyses also showed a significant reduction in fatal and injury collisions. The authors recommend that future analysts use a crash modification factor of 46 percent when considering the conversion of a typical unsignalized arterial intersection into a superstreet. Copyright © 2011 Elsevier Ltd. All rights reserved.

Impulsivity in spontaneously hypertensive rats: Within-subjects comparison of sensitivity to delay and to amount of reinforcement.

PubMed

Orduña, Vladimir; Mercado, Eduardo

2017-06-15

Previous research has shown that spontaneously hypertensive rats (SHR) display higher levels of impulsive choice behavior, which is accompanied by a higher sensitivity to the delay of reinforcement, and by a normal sensitivity to the amount of reinforcement. Because those results were based on three different samples of subjects, in the present report we evaluated these three processes in the same individuals. SHR and WIS rats were exposed to concurrent-chains schedules in which the terminal links were manipulated to assess impulsivity, sensitivity to delay, and sensitivity to amount. For exploring impulsivity, a terminal link was associated with a small reinforcer (1 pellet) delivered after a short delay (2s) while the other terminal link was associated with a larger reinforcer (4 pellets) delivered after a longer delay (28s). For assessing sensitivity to delay, both alternatives delivered the same amount of reinforcement (1 pellet) and the only difference between them was in the delay before reinforcement delivery (2s vs 28s). For assessing sensitivity to amount, both alternatives were associated with the same delay (15s), but the alternatives differed in the amount of reinforcement (1 vs 4 pellets). In addition to replicating previously observed effects within-subjects, we were interested in analyzing different aspects of the regularity of rats' actions in the choice task. The results confirmed that previous findings were not a consequence of between-group differences: SHR were more impulsive and more sensitive to delay, while their sensitivity to amount was normal. Analyses of response regularity indicated that SHR subjects were more periodic in their responses to levers and in their feeder entries, had a higher number of short-duration bouts of responding, and made a substantially higher number of switches between the alternatives. We discuss the potential implications of these findings for the possible behavioral mechanisms driving the increased sensitivity to delay in SHR. Copyright © 2017 Elsevier B.V. All rights reserved.

Distributed and accumulated reinforcement arrangements: evaluations of efficacy and preference.

PubMed

DeLeon, Iser G; Chase, Julie A; Frank-Crawford, Michelle A; Carreau-Webster, Abbey B; Triggs, Mandy M; Bullock, Christopher E; Jennett, Heather K

2014-01-01

We assessed the efficacy of, and preference for, accumulated access to reinforcers, which allows uninterrupted engagement with the reinforcers but imposes an inherent delay required to first complete the task. Experiment 1 compared rates of task completion in 4 individuals who had been diagnosed with intellectual disabilities when reinforcement was distributed (i.e., 30-s access to the reinforcer delivered immediately after each response) and accumulated (i.e., 5-min access to the reinforcer after completion of multiple consecutive responses). Accumulated reinforcement produced response rates that equaled or exceeded rates during distributed reinforcement for 3 participants. Experiment 2 used a concurrent-chains schedule to examine preferences for each arrangement. All participants preferred delayed, accumulated access when the reinforcer was an activity. Three participants also preferred accumulated access to edible reinforcers. The collective results suggest that, despite the inherent delay, accumulated reinforcement is just as effective and is often preferred by learners over distributed reinforcement. © Society for the Experimental Analysis of Behavior.

Providing Alternative Reinforcers to Facilitate Tolerance to Delayed Reinforcement Following Functional Communication Training

ERIC Educational Resources Information Center

Austin, Jillian E.; Tiger, Jeffrey H.

2015-01-01

The earliest stages of functional communication training (FCT) involve providing immediate and continuous reinforcement for a communicative response (FCR) that is functionally equivalent to the targeted problem behavior. However, maintaining immediate reinforcement is not practical, and the introduction of delays is associated with increased…

Effects Of Methylphenidate And Morphine On Delay-Discount Functions Obtained Within Sessions

PubMed Central

Pitts, Raymond C; McKinney, A. Patrick

2005-01-01

Four rats responded under a “self-control” procedure designed to obtain delay-discount functions within sessions. Each session consisted of seven blocks, with seven trials within each block. Each block consisted of two initial forced-choice trials followed by five free-choice trials. On choice trials, the rats could press either of two retractable levers. A press on one lever was followed by presentation of a smaller reinforcer (a single dipper presentation of a sucrose solution); a press on the other lever was followed by presentation of a larger reinforcer (four consecutive dipper presentations). The delay associated with the smaller reinforcer always was 0 s, whereas the signaled delay associated with the larger reinforcer increased across blocks (from 0 to 50 s). Under these conditions, the percentage of choices of the larger reinforcer decreased across blocks, and relatively reliable delay-discount functions were obtained within sessions. Doses of methylphenidate (1.0 to 17.0 mg/kg) and morphine (0.3 to 17.0 mg/kg) were then administered prior to selected sessions. Typically, intermediate doses of methylphenidate shifted the discount functions to the right (increased choices of the larger reinforcer). For 2 of the rats, this effect was pronounced; for the other 2 rats, this effect occurred after the range of delays for the larger reinforcer was decreased (0 to 20 s). On the other hand, in most cases morphine produced a slight leftward shift in the discount function (decreased choices of the larger reinforcer). The present procedure appears to be a useful and efficient method to characterize drug effects on an entire delay-discount function. As with many procedures used to study self-control choices, however, sources of control other than reinforcement delay and amount may have been operating in the present study, and these sources must be considered when interpreting drug effects. PMID:16047609

Effects of N-methyl-D-aspartate receptor ligands on sensitivity to reinforcer magnitude and delayed reinforcement in a delay-discounting procedure

PubMed Central

Yates, Justin R; Gunkel, Benjamin T; Rogers, Katherine K; Hughes, Mallory N; Prior, Nicholas A

2016-01-01

Rationale The N-methyl-D-aspartate (NMDA) receptor has been recently identified as an important mediator of impulsive choice, as assessed in delay discounting. Although discounting is independently influenced by sensitivity to reinforcer magnitude and delayed reinforcement, few studies have examined how NMDA receptor ligands differentially affect these parameters. Objectives The current study examined the effects of various NMDA receptor ligands on sensitivity to reinforcer magnitude and delayed reinforcement in a delay-discounting procedure. Methods Following behavioral training, rats received treatments of the following NMDA receptor ligands: the uncompetitive antagonists ketamine (0, 1.0, 5.0, or 10.0 mg/kg; i.p.), MK-801 (0, 0.003, 0.01, or 0.03 mg/kg; s.c.), and memantine (0, 2.5, 5.0, or 10.0 mg/kg; i.p.), the competitive antagonist CGS 19755 (0, 5.0, 10.0, or 20.0 mg/kg; s.c.), the non-competitive NR2B subunit-selective antagonist ifenprodil (0, 1.0, 3.0, or 10.0 mg/kg; i.p), and the partial agonist D-cycloserine (0, 3.25, 15.0, or 30.0 mg/kg; s.c.). Results When an exponential model was used to describe discounting, CGS 19755 (5.0 mg/kg) increased impulsive choice without altering sensitivity to reinforcer magnitude. Conversely, ketamine (10.0 mg/kg), memantine (5.0 mg/kg), and ifenprodil (10.0 mg/kg) decreased sensitivity to reinforcer magnitude without altering impulsive choice. MK-801 and D-cycloserine did not alter delay-discounting performance, although two-way ANOVA analyses indicated D-cycloserine (15.0 mg/kg) decreased impulsive choice. Conclusions The behavioral changes observed in delay discounting following administration of NMDA receptor antagonists do not always reflect an alteration in impulsive choice. These results emphasize the utility in employing quantitative methods to assess drug effects in delay discounting. PMID:27837332

A Comparison of the Effects of Brief Rules, a Timer, and Preferred Toys on Self-Control

ERIC Educational Resources Information Center

Newquist, Matthew H.; Dozier, Claudia L.; Neidert, Pamela L.

2012-01-01

Some children make impulsive choices (i.e., choose a small but immediate reinforcer over a large but delayed reinforcer). Previous research has shown that delay fading, providing an alternative activity during the delay, teaching participants to repeat a rule during the delay, combining delay fading with an alternative activity, and combining…

Developing a short range vehicle to infrastructure communication system to enhance the safety at STOP sign intersections : final report.

DOT National Transportation Integrated Search

2016-05-01

Stop sign controlled unsignalized intersections raise a public safe concern. Even though various strategies, such as engineering, education, and policy, have been applied in practice, there are a number of fatal crashes occurred at unsignalized inter...

The critical dimensions of the response-reinforcer contingency.

PubMed

Williams, B A.

2001-05-03

Two major dimensions of any contingency of reinforcement are the temporal relation between a response and its reinforcer, and the relative frequency of the reinforcer given the response versus when the response has not occurred. Previous data demonstrate that time, per se, is not sufficient to explain the effects of delay-of-reinforcement procedures; needed in addition is some account of the events occurring in the delay interval. Moreover, the effects of the same absolute time values vary greatly across situations, such that any notion of a standard delay-of-reinforcement gradient is simplistic. The effects of reinforcers occurring in the absence of a response depend critically upon the stimulus conditions paired with those reinforcers, in much the same manner as has been shown with Pavlovian contingency effects. However, it is unclear whether the underlying basis of such effects is response competition or changes in the calculus of causation.

Token reinforcement, choice, and self-control in pigeons.

PubMed Central

Jackson, K; Hackenberg, T D

1996-01-01

Pigeons were exposed to self-control procedures that involved illumination of light-emitting diodes (LEDs) as a form of token reinforcement. In a discrete-trials arrangement, subjects chose between one and three LEDs; each LED was exchangeable for 2-s access to food during distinct posttrial exchange periods. In Experiment 1, subjects generally preferred the immediate presentation of a single LED over the delayed presentation of three LEDs, but differences in the delay to the exchange period between the two options prevented a clear assessment of the relative influence of LED delay and exchange-period delay as determinants of choice. In Experiment 2, in which delays to the exchange period from either alternative were equal in most conditions, all subjects preferred the delayed three LEDs more often than in Experiment-1. In Experiment 3, subjects preferred the option that resulted in a greater amount of food more often if the choices also produced LEDs than if they did not. In Experiment 4, preference for the delayed three LEDs was obtained when delays to the exchange period were equal, but reversed in favor of an immediate single LED when the latter choice also resulted in quicker access to exchange periods. The overall pattern of results suggests that (a) delay to the exchange period is a more critical determinant of choice than is delay to token presentation; (b) tokens may function as conditioned reinforcers, although their discriminative properties may be responsible for the self-control that occurs under token reinforcer arrangements; and (c) previously reported differences in the self-control choices of humans and pigeons may have resulted at least in part from the procedural conventions of using token reinforcers with human subjects and food reinforcers with pigeon subjects. PMID:8755699

Effect of daily morphine administration and its discontinuation on delay discounting of food in rhesus monkeys

PubMed Central

Maguire, David R; Gerak, Lisa R; France, Charles P

2015-01-01

Opioid abusers discount delayed reinforcers more rapidly than non-users; however, it is unclear whether chronic drug administration or its discontinuation impact discounting. This study examined daily morphine administration and its discontinuation on delay discounting of food in rhesus monkeys. Responding on one lever delivered 1 food pellet immediately; responding on another lever delivered 2 food pellets either immediately or after a delay (30–120 sec) that increased within the session. Monkeys (n=3) responded for the large reinforcer when both reinforcers were delivered immediately and more for the smaller, immediately available reinforcer as delay to delivery of the large reinforcer increased. When administered acutely, morphine (0.032–5.6 mg/kg) increased trial omissions and had variable effects on choice, with small doses decreasing and large doses increasing choice of the large delayed reinforcer. Chronic morphine administration (0.1 mg/kg/day to 3.2 mg/kg twice daily) reduced choice of the large delayed reinforcer in two monkeys while increasing choice in a third monkey. Despite the development of tolerance to some effects (i.e., rightward shifts in dose-effect curves for the number of trials omitted) and evidence of mild opioid dependence (e.g., decrease in the number of trials completed as well as body weight), discontinuation of treatment did not appear to systematically impact discounting. Overall, these results suggest that repeated opioid administration causes persistent effects on choice under a delay discounting procedure; however, differences in the direction of effect among individuals suggest factors other than, or in addition to, changes in discounting might play a role. PMID:26397762

Social Reinforcement Delays in Free-Flying Honey Bees (Apis mellifera L.)

PubMed Central

Craig, David Philip Arthur; Grice, James W.; Varnon, Chris A.; Gibson, B.; Sokolowski, Michel B. C.; Abramson, Charles I.

2012-01-01

Free-flying honey bees (Apis mellifera L.) reactions were observed when presented with varying schedules of post-reinforcement delays of 0 s, 300 s, or 600 s. We measured inter-visit-interval, response length, inter-response-time, and response rate. Honey bees exposed to these post-reinforcement delay intervals exhibit one of several patterns compared to groups not encountering delays, and had longer inter-visit-intervals. We observed no group differences in inter-response time. Honey bees with higher response rates tended to not finish the experiment. The removal of the delay intervals increased response rates for those subjects that completed the trials. PMID:23056425

Context Blocking in Rat Autoshaping: Sign-Tracking versus Goal-Tracking

ERIC Educational Resources Information Center

Costa, Daniel S. J.; Boakes, Robert A.

2009-01-01

Prior experience of unsignaled food can interfere with subsequent acquisition by birds of autoshaped key-pecking at a signal light. This has been understood to indicate that unsignaled food results in context conditioning, which blocks subsequent learning about the keylight-food relationship. In the present experiment with rats lever insertion as…

Analysis of Crossing Speed of the Pedestrians in Marked and Unmarked Crosswalks in the Signalized and Un-Signalized Intersections (Case Study: Rasht city)

NASA Astrophysics Data System (ADS)

Behbahani, Hamid; Najafi Moghaddam Gilani, Vahid; Jahangir Samet, Mehdi; Salehfard, Reza

2017-10-01

Pedestrians affect the traffic in the signalized and un-signalized intersections. Therefore, identifying the behavioural features of the pedestrians is of great importance and may result in better designing facilities for them. In this study, by shooting the four intersections in Rasht for 15 hours and inventory from 4568 pedestrians, crossing speed of the pedestrians in the marked crosswalks and unmarked crosswalks was evaluated and analysed. Results showed that pedestrians‧ crossing speed in the marked crosswalks is higher than their crossing speed in the unmarked crosswalks in both signalized and un-signalized intersections. Moreover, in the unmarked crosswalks in the signalized intersections, 15th percentile speed of male pedestrians, female pedestrians and group of pedestrians’ decrease 6.4%, 5.4% and 12.2%, respectively, compared with the 15th percentile speed in the marked crosswalks. Above-mentioned values in the unmarked crosswalks in the un-signalized intersections for male pedestrians, female pedestrians, and group of pedestrians decrease 1.2%, 3.8%, and 1.4%, respectively.

Teaching Self-Control to Small Groups of Dually Diagnosed Adults.

ERIC Educational Resources Information Center

Dixon, Mark R.; Holcomb, Sharon

2000-01-01

A study used a progressive delay procedure to teach self-control to six adults with mental retardation. At baseline, participants chose an immediate smaller reinforcer rather than a larger delayed reinforcer. Progressive increases in work requirements for gaining access to a larger reinforcer resulted in participants selecting larger delayed…

Motivational Control of Impulsive Behavior Interacts with Choice Opportunities

ERIC Educational Resources Information Center

Tanno, Takayuki; Kurashima, Ryo; Watanabe, Shigeru

2011-01-01

Impulsive behavior has been investigated through choice between a smaller/immediate reinforcer and a larger/delayed reinforcer, or through performance on a differential reinforcement of low rate (DRL) schedule. In the present study, we investigated a methodological divergence between these two procedures: in the former procedure, delay is a…

Impulsive choice and pre-exposure to delays: iv. effects of delay- and immediacy-exposure training relative to maturational changes in impulsivity.

PubMed

Renee Renda, C; Rung, Jillian M; Hinnenkamp, Jay E; Lenzini, Stephanie N; Madden, Gregory J

2018-04-23

Impulsive choice describes preference for smaller, sooner rewards over larger, later rewards. Excessive delay discounting (i.e., rapid devaluation of delayed rewards) underlies some impulsive choices, and is observed in many maladaptive behaviors (e.g., substance abuse, gambling). Interventions designed to reduce delay discounting may provide therapeutic gains. One such intervention provides rats with extended training with delayed reinforcers. When compared to a group given extended training with immediate reinforcers, delay-exposed rats make significantly fewer impulsive choices. To what extent is this difference due to delay-exposure training shifting preference toward self-control or immediacy-exposure training (the putative control group) shifting preference toward impulsivity? The current study compared the effects of delay- and immediacy-exposure training to a no-training control group and evaluated within-subject changes in impulsive choice across 51 male Wistar rats. Delay-exposed rats made significantly fewer impulsive choices than immediacy-exposed and control rats. Between-group differences in impulsive choice were not observed in the latter two groups. While delay-exposed rats showed large, significant pre- to posttraining reductions in impulsive choice, immediacy-exposed and control rats showed small reductions in impulsive choice. These results suggest that extended training with delayed reinforcers reduces impulsive choice, and that extended training with immediate reinforcers does not increase impulsive choice. © 2018 Society for the Experimental Analysis of Behavior.

OPPORTUNITY COSTS OF REWARD DELAYS AND THE DISCOUNTING OF HYPOTHETICAL MONEY AND CIGARETTES

PubMed Central

Johnson, Patrick S.; Herrmann, Evan S.; Johnson, Matthew W.

2015-01-01

Humans are reported to discount delayed rewards at lower rates than nonhumans. However, nonhumans are studied in tasks that restrict reinforcement during delays, whereas humans are typically studied in tasks that do not restrict reinforcement during delays. In nonhuman tasks, the opportunity cost of restricted reinforcement during delays may increase delay discounting rates. The present within-subjects study used online crowdsourcing (Amazon Mechanical Turk, or MTurk) to assess the discounting of hypothetical delayed money (and cigarettes in smokers) under four hypothetical framing conditions differing in the availability of reinforcement during delays. At one extreme, participants were free to leave their computer without returning, and engage in any behavior during reward delays (modeling typical human tasks). At the opposite extreme, participants were required to stay at their computer and engage in little other behavior during reward delays (modeling typical nonhuman tasks). Discounting rates increased as an orderly function of opportunity cost. Results also indicated predominantly hyperbolic discounting, the “magnitude effect,” steeper discounting of cigarettes than money, and positive correlations between discounting rates of these commodities. This is the first study to test the effects of opportunity costs on discounting, and suggests that procedural differences may partially account for observed species differences in discounting. PMID:25388973

Opportunity costs of reward delays and the discounting of hypothetical money and cigarettes.

PubMed

Johnson, Patrick S; Herrmann, Evan S; Johnson, Matthew W

2015-01-01

Humans are reported to discount delayed rewards at lower rates than nonhumans. However, nonhumans are studied in tasks that restrict reinforcement during delays, whereas humans are typically studied in tasks that do not restrict reinforcement during delays. In nonhuman tasks, the opportunity cost of restricted reinforcement during delays may increase delay discounting rates. The present within-subjects study used online crowdsourcing (Amazon Mechanical Turk, or MTurk) to assess the discounting of hypothetical delayed money (and cigarettes in smokers) under four hypothetical framing conditions differing in the availability of reinforcement during delays. At one extreme, participants were free to leave their computer without returning, and engage in any behavior during reward delays (modeling typical human tasks). At the opposite extreme, participants were required to stay at their computer and engage in little other behavior during reward delays (modeling typical nonhuman tasks). Discounting rates increased as an orderly function of opportunity cost. Results also indicated predominantly hyperbolic discounting, the "magnitude effect," steeper discounting of cigarettes than money, and positive correlations between discounting rates of these commodities. This is the first study to test the effects of opportunity costs on discounting, and suggests that procedural differences may partially account for observed species differences in discounting. © Society for the Experimental Analysis of Behavior.

A variation of noncontingent reinforcement in the treatment of aberrant behavior.

PubMed

Britton, L N; Carr, J E; Kellum, K K; Dozier, C L; Weil, T M

2000-01-01

We examined the effectiveness of a variation of noncontingent reinforcement (NCR) that incorporated a stimulus-delay procedure in the reduction of aberrant behavior maintained by positive reinforcement. Functional analyses for three individuals diagnosed with developmental disabilities indicated that their behaviors were maintained by positive reinforcement: one in the form of access to a tangible item, another by attention, and the third by physical contact. We implemented NCR with the delay procedure with two participants using reversal designs to evaluate effects. We also compared this NCR variation and DRO with the third participant to evaluate reinforcer-delivery rates. The variation of NCR was successful in reducing all aberrant behavior to near-zero levels. A comparison of reinforcer delivery between NCR with the stimulus-delay procedure and DRO demonstrated that the participant accessed more reinforcement with NCR. Results are discussed in the context of enhancing decelerative interventions with emphases on minimizing response effort for caregivers and maximizing access to reinforcement for the individuals.

"The stone which the builders rejected...": Delay of reinforcement and response rate on fixed-interval and related schedules.

PubMed

Wearden, J H; Lejeune, Helga

2006-02-28

The article deals with response rates (mainly running and peak or terminal rates) on simple and on some mixed-FI schedules and explores the idea that these rates are determined by the average delay of reinforcement for responses occurring during the response periods that the schedules generate. The effects of reinforcement delay are assumed to be mediated by a hyperbolic delay of reinforcement gradient. The account predicts that (a) running rates on simple FI schedules should increase with increasing rate of reinforcement, in a manner close to that required by Herrnstein's equation, (b) improving temporal control during acquisition should be associated with increasing running rates, (c) two-valued mixed-FI schedules with equiprobable components should produce complex results, with peak rates sometimes being higher on the longer component schedule, and (d) that effects of reinforcement probability on mixed-FI should affect the response rate at the time of the shorter component only. All these predictions were confirmed by data, although effects in some experiments remain outside the scope of the model. In general, delay of reinforcement as a determinant of response rate on FI and related schedules (rather than temporal control on such schedules) seems a useful starting point for a more thorough analysis of some neglected questions about performance on FI and related schedules.

A Generalized DIF Effect Variance Estimator for Measuring Unsigned Differential Test Functioning in Mixed Format Tests

ERIC Educational Resources Information Center

Penfield, Randall D.; Algina, James

2006-01-01

One approach to measuring unsigned differential test functioning is to estimate the variance of the differential item functioning (DIF) effect across the items of the test. This article proposes two estimators of the DIF effect variance for tests containing dichotomous and polytomous items. The proposed estimators are direct extensions of the…

Applying a behavioral economic framework to understanding adolescent smoking.

PubMed

Audrain-McGovern, Janet; Rodriguez, Daniel; Tercyak, Kenneth P; Epstein, Leonard H; Goldman, Paula; Wileyto, E Paul

2004-03-01

Adolescents' choice to smoke may depend on substitute reinforcers for smoking, complementary activities to smoking, and individual differences in reinforcer value. The influence of these variables on smoking was determined among 983 adolescents. Substitutes were school involvement, academic performance, physical activity, and sports team participation: complements were peer smoking and substance use; delay discounting assessed individual differences in reinforcer value. Latent growth modeling indicated that substitute reinforcers reduced the odds of smoking progression almost two-fold, complementary reinforcers increased the odds by 1.14. and delay discounting indirectly influenced the odds of smoking progression through complementary reinforcers. Adolescents who smoke may have fewer reinforcers that protect against smoking and more reinforcers that promote smoking. Discounting of future rewards affects smoking through reinforcer type.

Adolescent Methylmercury Exposure Affects Choice and Delay Discounting in Mice

PubMed Central

Boomhower, Steven R.; Newland, M. Christopher

2016-01-01

The developing fetus is vulnerable to low-level exposure to methylmercury (MeHg), an environmental neurotoxicant, but the consequences of exposure during the adolescent period remain virtually unknown. The current experiments were designed to assess the effects of low-level MeHg exposure during adolescence on delay discounting, preference for small, immediate reinforcers over large, delayed ones, using a mouse model. Thirty-six male C57BL/6n mice were exposed to 0, 0.3, or 3.0 ppm mercury (as MeHg) via drinking water from postnatal day 21 through 59, encompassing the murine adolescent period. As adults, mice lever-pressed for a 0.01-cc droplet of milk solution delivered immediately or four 0.01-cc droplets delivered after a delay. Delays ranged from 1.26 to 70.79 seconds, all presented within a session. A model based on the Generalized Matching Law indicated that sensitivity to reinforcer magnitude was lower for MeHg-exposed mice relative to controls; responding in MeHg-exposed mice was relatively indifferent to the larger reinforcer. Sensitivity to reinforcer delay was reduced (delay discounting was decreased) in the 0.3-ppm group, but not in the 3.0-ppm group, compared to controls. Adolescence is a developmental period during which the brain and behavior may be vulnerable to MeHg exposure. As with gestational exposure, the effects are reflected in the impact of reinforcing stimuli. PMID:27677934

Dopaminergic lesions of the dorsolateral striatum in rats increase delay discounting in an impulsive choice task.

PubMed

Tedford, Stephanie E; Persons, Amanda L; Napier, T Celeste

2015-01-01

Dysregulated dopamine transmission in striatal circuitry is associated with impulsivity. The current study evaluated the influence of dopaminergic inputs to the dorsolateral striatum on impulsive choice, one aspect of impulsive behavior. We implemented an operant task that measures impulsive choice in rats via delay discounting wherein intracranial self-stimulation (ICSS) was used as the positive reinforcer. To do so, rats were anesthetized to allow implanting of a stimulating electrode within the lateral hypothalamus of one hemisphere and bilateral dorsal striatal injections of the dopaminergic toxin, 6-OHDA (lesioned) or its vehicle (sham). Following recovery, rats were trained in a delay discounting task wherein they selected between a small ICSS current presented immediately after lever pressing, and a large ICSS current presented following a 0 to 15 s delay upon pressing the alternate lever. Task acquisition and reinforcer discrimination were similar for lesioned and sham rats. All rats exhibited an initial preference for the large reinforcer, and as the delay was increased, preference for the large reinforcer was decreased indicating that the subjective value of the large reinforcer was discounted as a function of delay time. However, this discounting effect was significantly enhanced in lesioned rats for the longer delays. These data reveal a contribution of dopaminergic inputs to the dorsolateral striatum on impulsive choice behavior, and provide new insights into neural substrates underlying discounting behaviors.

Dopaminergic Lesions of the Dorsolateral Striatum in Rats Increase Delay Discounting in an Impulsive Choice Task

PubMed Central

Tedford, Stephanie E.; Persons, Amanda L.; Napier, T. Celeste

2015-01-01

Dysregulated dopamine transmission in striatal circuitry is associated with impulsivity. The current study evaluated the influence of dopaminergic inputs to the dorsolateral striatum on impulsive choice, one aspect of impulsive behavior. We implemented an operant task that measures impulsive choice in rats via delay discounting wherein intracranial self-stimulation (ICSS) was used as the positive reinforcer. To do so, rats were anesthetized to allow implanting of a stimulating electrode within the lateral hypothalamus of one hemisphere and bilateral dorsal striatal injections of the dopaminergic toxin, 6-OHDA (lesioned) or its vehicle (sham). Following recovery, rats were trained in a delay discounting task wherein they selected between a small ICSS current presented immediately after lever pressing, and a large ICSS current presented following a 0 to 15s delay upon pressing the alternate lever. Task acquisition and reinforcer discrimination were similar for lesioned and sham rats. All rats exhibited an initial preference for the large reinforcer, and as the delay was increased, preference for the large reinforcer was decreased indicating that the subjective value of the large reinforcer was discounted as a function of delay time. However, this discounting effect was significantly enhanced in lesioned rats for the longer delays. These data reveal a contribution of dopaminergic inputs to the dorsolateral striatum on impulsive choice behavior, and provide new insights into neural substrates underlying discounting behaviors. PMID:25927685

The Effects of Short Interval Delay of Reinforcement Upon Human Discrimination Learning. IMRID Papers and Reports Vol. 4 No. 12.

ERIC Educational Resources Information Center

Kral, Paul A.; And Others

Investigates the effect of delay of reinforcement upon human discrimination learning with particular emphasis on the form of the gradient within the first few seconds of delay. In previous studies subjects are usually required to make an instrumental response to a stimulus, this is followed by the delay interval, and finally, the reinforcement…

The effects of physical activity on impulsive choice: Influence of sensitivity to reinforcement amount and delay

PubMed Central

Strickland, Justin C.; Feinstein, Max A.; Lacy, Ryan T.; Smith, Mark A.

2016-01-01

Impulsive choice is a diagnostic feature and/or complicating factor for several psychological disorders and may be examined in the laboratory using delay-discounting procedures. Recent investigators have proposed using quantitative measures of analysis to examine the behavioral processes contributing to impulsive choice. The purpose of this study was to examine the effects of physical activity (i.e., wheel running) on impulsive choice in a single-response, discrete-trial procedure using two quantitative methods of analysis. To this end, rats were assigned to physical activity or sedentary groups and trained to respond in a delay-discounting procedure. In this procedure, one lever always produced one food pellet immediately, whereas a second lever produced three food pellets after a 0, 10, 20, 40, or 80-second delay. Estimates of sensitivity to reinforcement amount and sensitivity to reinforcement delay were determined using (1) a simple linear analysis and (2) an analysis of logarithmically transformed response ratios. Both analyses revealed that physical activity decreased sensitivity to reinforcement amount and sensitivity to reinforcement delay. These findings indicate that (1) physical activity has significant but functionally opposing effects on the behavioral processes that contribute to impulsive choice and (2) both quantitative methods of analysis are appropriate for use in single-response, discrete-trial procedures. PMID:26964905

Delay Discounting of Qualitatively Different Reinforcers in Rats

ERIC Educational Resources Information Center

Calvert, Amanda L.; Green, Leonard; Myerson, Joel

2010-01-01

Humans discount larger delayed rewards less steeply than smaller rewards, whereas no such magnitude effect has been observed in rats (and pigeons). It remains possible that rats' discounting is sensitive to differences in the quality of the delayed reinforcer even though it is not sensitive to amount. To evaluate this possibility, Experiment 1…

On the Effects of Signaling Reinforcer Probability and Magnitude in Delayed Matching to Sample

ERIC Educational Resources Information Center

Brown, Glenn S.; White, K. Geoffrey

2005-01-01

Two experiments examined whether postsample signals of reinforcer probability or magnitude affected the accuracy of delayed matching to sample in pigeons. On each trial, red or green choice responses that matched red or green stimuli seen shortly before a variable retention interval were reinforced with wheat access. In Experiment 1, the…

Childhood ADHD and Delayed Reinforcement: A Direct Comparison of Performance on Hypothetical and Real-Time Delay Tasks.

PubMed

Yu, Xue; Sonuga-Barke, Edmund

2016-07-28

Individuals with ADHD have been shown to prefer smaller sooner over larger later rewards. This has been explained in terms of abnormally steeper discounting of the value of delayed reinforcers. Evidence for this comes from different experimental paradigms. In some, participants experience delay in the laboratory (real-time delay tasks; R-TD), in others they imagine the delay to reinforcers (hypothetical delay tasks; HD). We directly contrasted the performance of 7- to 12-year-old children with ADHD (n = 23) and matched controls (n = 23) on R-TD and HD tasks with monetary rewards. Children with ADHD displayed steeper temporal discounting on the R-TD, but not the HD tasks. These findings suggest that the experience of waiting prior to the delivery of rewards is an important determinant of heightened temporal discounting in ADHD-a finding consistent with models that emphasize the aversive nature of delay for children. © The Author(s) 2016.

Tolerance to cocaine's effects on schedule-controlled behavior: role of delay between pause-ending responses and reinforcement.

PubMed

Macaskill, Anne C; Branch, Marc N

2012-01-01

The schedule of reinforcement under which behavior is maintained is an important contributor to whether tolerance to the behavioral effects of cocaine develops. Schedule parameter value (for example, fixed-ratio size) has been shown to affect the development of tolerance under some schedule types but not others, but the specific procedural variables causing this effect remain to be identified. To date, schedule-parameter-related tolerance has developed when a longer pause after reinforcement does not lead to a shorter delay between the response that ends the pause and reinforcement. The current study investigated the importance of this variable in pigeons using a multiple chained Fixed-Ratio 1, Fixed-Time x schedule, in which the first key peck in a trial produced a stimulus change and initiated a delay at the end of which food was presented regardless of whether or not additional pecks were made during the delay. Dose-response curves were assessed before, during and after chronic (daily) administration of cocaine. Tolerance to the pause-increasing effects of cocaine occurred to a similar degree regardless of the scheduled time between the end of the pause and reinforcement. Therefore, the relationship between pause length and delay to reinforcement does not provide an explanation for schedule-parameter-related tolerance. Copyright © 2011 Elsevier Inc. All rights reserved.

The effects of physical activity on impulsive choice: Influence of sensitivity to reinforcement amount and delay.

PubMed

Strickland, Justin C; Feinstein, Max A; Lacy, Ryan T; Smith, Mark A

2016-05-01

Impulsive choice is a diagnostic feature and/or complicating factor for several psychological disorders and may be examined in the laboratory using delay-discounting procedures. Recent investigators have proposed using quantitative measures of analysis to examine the behavioral processes contributing to impulsive choice. The purpose of this study was to examine the effects of physical activity (i.e., wheel running) on impulsive choice in a single-response, discrete-trial procedure using two quantitative methods of analysis. To this end, rats were assigned to physical activity or sedentary groups and trained to respond in a delay-discounting procedure. In this procedure, one lever always produced one food pellet immediately, whereas a second lever produced three food pellets after a 0, 10, 20, 40, or 80-s delay. Estimates of sensitivity to reinforcement amount and sensitivity to reinforcement delay were determined using (1) a simple linear analysis and (2) an analysis of logarithmically transformed response ratios. Both analyses revealed that physical activity decreased sensitivity to reinforcement amount and sensitivity to reinforcement delay. These findings indicate that (1) physical activity has significant but functionally opposing effects on the behavioral processes that contribute to impulsive choice and (2) both quantitative methods of analysis are appropriate for use in single-response, discrete-trial procedures. Copyright © 2016 Elsevier B.V. All rights reserved.

Effects of a Signaled Delay to Reinforcement in the Previous and Upcoming Ratios on Between-Ratio Pausing in Fixed-Ratio Schedules

ERIC Educational Resources Information Center

Harris, Aimee; Foster, T. Mary; Levine, Joshua; Temple, William

2012-01-01

Domestic hens responded under multiple fixed-ratio fixed-ratio schedules with equal fixed ratios. One component provided immediate reinforcement and the other provided reinforcement after a delay, signaled by the offset of the key light. The components were presented quasi-randomly so that all four possible transitions occurred in each session.…

Basolateral amygdala lesions and sensitivity to reinforcer magnitude in concurrent chains schedules.

PubMed

Helms, Christa M; Mitchell, Suzanne H

2008-08-22

Previous studies show that the basolateral amygdala (BLA) is required for behavior to adjust when the value of a reinforcer decreases after satiation or pairing with gastric distress. This study evaluated the effect of pre- or post-training excitotoxic lesions of the BLA on changes in preference with another type of contingency change, reinforcer magnitude reversal. Rats were trained to press left and right levers during a variable-interval choice phase for 50 microl or 150 microl sucrose delivered to consistent locations after a 16-s delay. Tones were presented during the first and last 2s of the delay to reinforcement. The tone frequency predicted the magnitude of sucrose reinforcement in baseline conditions. All groups acquired stable preference for the lever on the large (150 microl) reinforcer side. However, nose poking during the delay to large reinforcement was highly accurate (i.e., to the reinforced side) for all groups except the rats with BLA lesions induced before training, suggesting impaired control of behavior by the tone. After the acquisition of stable preference, the locations of the reinforcer magnitudes were unpredictably reversed for a single session. Pre-training lesions blunted changes in preference when the reinforcer magnitudes were reversed. Lesions induced after stable preference was acquired, but prior to reversal, did not disrupt changes in preference. The data suggest that the BLA contributes to the adaptation of choice behavior following changes in reinforcer magnitude. Impaired learning about the tone-reinforcer magnitude relationships may have disrupted discrimination of the reinforcer magnitude reversal.

Transitional and Steady-State Choice Behavior under an Adjusting-Delay Schedule

ERIC Educational Resources Information Center

Torres, L. Valencia; Araujo, S. da Costa; Sanchez, C. M. Olarte; Body, S.; Bradshaw, C. M.; Szabadi, E.

2011-01-01

Twelve rats made repeated choices on an adjusting-delay schedule between a smaller reinforcer (A) that was delivered immediately after a response and a larger reinforcer (B) that was delivered after a delay which increased or decreased by 20% depending on the subject's choices in successive blocks of trials. In two phases of the experiment (100…

Effects of delay to reinforcement on the choice between cocaine and food in rhesus monkeys.

PubMed

Woolverton, William L; Anderson, Karen G

2006-05-01

Although a delay between behavior and reinforcer has been shown to weaken behavior, little is known about the effects of delay on drug choice. The present study examined effects of delay between lever press and reinforcer presentation on the choice between a drug and non-drug reinforcer and between different drug doses. Monkeys (n=4) were allowed to choose 32 times/day between cocaine and four food pellets. The delay between lever press and a preferred dose of cocaine (0.05 mg/kg/injection) was increased systematically from 0 to 240 s, while the delay to food remained at 0 s. A second group of monkeys (n=4) was allowed to choose between 0.05 mg/kg/injection and a lower dose of cocaine (0.025 mg/kg/injection). Next, a delay that resulted in less than 20% choice of 0.05 mg/kg/injection cocaine was selected and delay to the alternative was varied. Results were similar across groups. The choice of 0.05 mg/kg/injection approximated 100% at 0 delay and decreased to near 0 as delay increased. As the delay to alternative was subsequently increased from 0 to 240 s, choice of 0.05 mg/kg/injection increased, though full cocaine choice was not generally restored. The delay estimated to maintain 50% choice (indifference point) was lower for the cocaine-food choice (mean=64 s) than for the cocaine-cocaine choice (mean=207 s). This experiment demonstrates that the choice between cocaine and a non-drug or drug alternative can be modified by increasing the interval between behavior and drug injection. Overall, the results are consistent with a temporal discounting model of drug choice.

BASOLATERAL AMYGDALA LESIONS AND SENSITIVITY TO REINFORCER MAGNITUDE IN CONCURRENT CHAINS SCHEDULES

PubMed Central

Helms, Christa M.; Mitchell, Suzanne H.

2008-01-01

Previous studies show that the basolateral amygdala (BLA) is required for behavior to adjust when the value of a reinforcer decreases after satiation or pairing with gastric distress. This study evaluated the effect of pre- or post-training excitotoxic lesions of the BLA on changes in preference with another type of contingency change, reinforcer magnitude reversal. Rats were trained to press left and right levers during a variable-interval choice phase for 50 µl or 150 µl sucrose delivered to consistent locations after a 16-s delay. Tones were presented during the first and last 2 s of the delay to reinforcement. The tone frequency predicted the magnitude of sucrose reinforcement in baseline conditions. All groups acquired stable preference for the lever on the large (150-µl) reinforcer side. However, nose poking during the delay to large reinforcement was highly accurate (i.e., to the reinforced side) for all groups except the rats with BLA lesions induced before training, suggesting impaired control of behavior by the tone. After the acquisition of stable preference, the locations of the reinforcer magnitudes were unpredictably reversed for a single session. Pre-training lesions blunted changes in preference when the reinforcer magnitudes were reversed. Lesions induced after stable preference was acquired, but prior to reversal, did not disrupt changes in preference. The data suggest that the BLA contributes to the adaptation of choice behavior following changes in reinforcer magnitude. Impaired learning about the tone-reinforcer magnitude relationships may have disrupted discrimination of the reinforcer magnitude reversal. PMID:18455812

The Effect of Brief Delays to Reinforcement on the Acquisition of Tacts in Children with Autism

ERIC Educational Resources Information Center

Majdalany, Lina; Wilder, David A.; Smeltz, Lindsay; Lipschultz, Joshua

2016-01-01

We used discrete-trial training to teach 3 children with autism to tact shapes of countries using 3 levels of reinforcement delay for correct responding: 0 s (immediate delivery), 6 s, and 12 s. Two of the 3 participants acquired the targets more quickly in the immediate-delivery condition, suggesting that delays as brief as 6 s may be detrimental…

Procrastination in the pigeon: Can conditioned reinforcement increase the likelihood of human procrastination?

PubMed

Zentall, Thomas R; Case, Jacob P; Andrews, Danielle M

2017-11-29

Procrastination is the tendency to put off initiation or completion of a task. Although people are typically known to procrastinate, recent research suggests that they sometimes "pre-crastinate" by initiating a task sooner than they need to (Rosenbaum et al. in Psychological Science, 25(7), 1487-1496, 2014). A similar finding of precrastination was reported by Wasserman and Brzykcy (Psychonomic Bulletin & Review, 22, 1130-1134, 2015) with pigeons using a somewhat different procedure. In the present experiment, we used a procedure with pigeons that was more similar to the procedure used by Rosenbaum et al. Pigeons were given a choice between two sequences of events (concurrent chains). Choice of the procrastination chain resulted in color A, which 15-s later would change to color B and 5-s later resulted in reinforcement. Choice of the precrastination chain resulted in color C, which 5-s later would change to color D and 15-s later resulted in reinforcement. Thus, both chains led to reinforcement after 20 s. Results indicated that the pigeons procrastinated. That is, they preferred the 15-5 chain over the 5-15 chain. The results are consistent with Fantino's (Journal of the Experimental Analysis of Behavior, 12, 723-730, 1969) delay reduction theory, which posits that stimuli that signal a reduction in the delay to reinforcement, such as the 5-s stimulus that occurred immediately prior to reinforcement, serve as strong conditioned reinforcers and should be preferred. In support of this theory, the pigeons pecked most at the 5-s stimulus that led immediately to reinforcement, indicating that it had become a strong conditioned reinforcer. The results suggest that delay reduction theory, a theory that emphasizes the attraction to stimuli that predict reinforcement with a short delay, also may contribute to human procrastination behavior because when task completion comes just before the deadline, it may become a stronger conditioned reinforcer than if task completion comes earlier.

Fixed-interval performance and self-control in children.

PubMed Central

Darcheville, J C; Rivière, V; Wearden, J H

1992-01-01

Operant responses of 16 children (mean age 6 years and 1 month) were reinforced according to different fixed-interval schedules (with interreinforcer intervals of 20, 30, or 40 s) in which the reinforcers were either 20-s or 40-s presentations of a cartoon. In another procedure, they received training on a self-control paradigm in which both reinforcer delay (0.5 s or 40 s) and reinforcer duration (20 s or 40 s of cartoons) varied, and subjects were offered a choice between various combinations of delay and duration. Individual differences in behavior under the self-control procedure were precisely mirrored by individual differences under the fixed-interval schedule. Children who chose the smaller immediate reinforcer on the self-control procedure (impulsive) produced short postreinforcement pauses and high response rates in the fixed-interval conditions, and both measures changed little with changes in fixed-interval value. Conversely, children who chose the larger delayed reinforcer in the self-control condition (the self-controlled subjects) exhibited lower response rates and long postreinforcement pauses, which changed systematically with changes in the interval, in their fixed-interval performances. PMID:1573372

Choice and conditioned reinforcement.

PubMed Central

Fantino, E; Freed, D; Preston, R A; Williams, W A

1991-01-01

A potential weakness of one formulation of delay-reduction theory is its failure to include a term for rate of conditioned reinforcement, that is, the rate at which the terminal-link stimuli occur in concurrent-chains schedules. The present studies assessed whether or not rate of conditioned reinforcement has an independent effect upon choice. Pigeons responded on either modified concurrent-chains schedules or on comparable concurrent-tandem schedules. The initial link was shortened on only one of two concurrent-chains schedules and on only one of two corresponding concurrent-tandem schedules. This manipulation increased rate of conditioned reinforcement sharply in the chain but not in the tandem schedule. According to a formulation of delay-reduction theory, when the outcomes chosen (the terminal links) are equal, as in Experiment 1, choice should depend only on rate of primary reinforcement; thus, choice should be equivalent for the tandem and chain schedules despite a large difference in rate of conditioned reinforcement. When the outcomes chosen are unequal, however, as in Experiment 2, choice should depend upon both rate of primary reinforcement and relative signaled delay reduction; thus, larger preferences should occur in the chain than in the tandem schedules. These predictions were confirmed, suggesting that increasing the rate of conditioned reinforcement on concurrent-chains schedules may have no independent effect on choice. PMID:2037826

Reinforcer control by comparison-stimulus color and location in a delayed matching-to-sample task.

PubMed

Alsop, Brent; Jones, B Max

2008-05-01

Six pigeons were trained in a delayed matching-to-sample task involving bright- and dim-yellow samples on a central key, a five-peck response requirement to either sample, a constant 1.5-s delay, and the presentation of comparison stimuli composed of red on the left key and green on the right key or vice versa. Green-key responses were occasionally reinforced following the dimmer-yellow sample, and red-key responses were occasionally reinforced following the brighter-yellow sample. Reinforcer delivery was controlled such that the distribution of reinforcers across both comparison-stimulus color and comparison-stimulus location could be varied systematically and independently across conditions. Matching accuracy was high throughout. The ratio of left to right side-key responses increased as the ratio of left to right reinforcers increased, the ratio of red to green responses increased as the ratio of red to green reinforcers increased, and there was no interaction between these variables. However, side-key biases were more sensitive to the distribution of reinforcers across key location than were comparison-color biases to the distribution of reinforcers across key color. An extension of Davison and Tustin's (1978) model of DMTS performance fit the data well, but the results were also consistent with an alternative theory of conditional discrimination performance (Jones, 2003) that calls for a conceptually distinct quantitative model.

Analysis of discriminative control by social behavioral stimuli

PubMed Central

Hake, Don F.; Donaldson, Tom; Hyten, Cloyd

1983-01-01

Visual discriminative control of the behavior of one rat by the behavior of another was studied in a two-compartment chamber. Each rat's compartment had a food cup and two response keys arranged vertically next to the clear partition that separated the two rats. Illumination of the leader's key lights signaled a “search” period when a response by the leader on the unsignaled and randomly selected correct key for that trial illuminated the follower's keys. Then, a response by the follower on the corresponding key was reinforced, or a response on the incorrect key terminated the trial without reinforcement. Accuracy of following the leader increased to 85% within 15 sessions. Blocking the view of the leader reduced accuracy but not to chance levels. Apparent control by visual behavioral stimuli was also affected by auditory stimuli and a correction procedure. When white noise eliminated auditory cues, social learning was not acquired as fast nor as completely. A reductionistic position holds that behavioral stimuli are the same as nonsocial stimuli; however, that does not mean that they do not require any separate treatment. Behavioral stimuli are usually more variable than nonsocial stimuli, and further study is required to disentangle behavioral and nonsocial contributions to the stimulus control of social interactions. PMID:16812313

The Negative Effects of Positive Reinforcement in Teaching Children with Developmental Delay.

ERIC Educational Resources Information Center

Biederman, Gerald B.; And Others

1994-01-01

This study compared the performance of 12 children (ages 4 to 10) with developmental delay, each trained in 2 tasks, one through interactive modeling (with or without verbal reinforcement) and the other through passive modeling. Results showed that passive modeling produced better rated performance than interactive modeling and that verbal…

Stimuli inevitably generated by behavior that avoids electric shock are inherently reinforcing.

PubMed Central

Dinsmoor, J A

2001-01-01

A molecular analysis based on the termination of stimuli that are positively correlated with shock and the production of stimuli that are negatively correlated with shock provides a parsimonious count for both traditional discrete-trial avoidance behavior and the data derived from more recent free-operant procedures. The necessary stimuli are provided by the intrinsic feedback generated by the subject's behavior, in addition to those presented by the experimenter. Moreover, all data compatible with the molar principle of shock-frequency reduction as reinforcement are also compatible with a delay-of-shock gradient, but some data compatible with the delay gradient are not compatible with frequency reduction. The delay gradient corresponds to functions relating magnitude of behavioral effect to the time between conditional and unconditional stimuli, the time between conditioned and primary reinforcers, and the time between responses and positive reinforcers. PMID:11453621

Remifentanil maintains lower initial delayed nonmatching-to-sample accuracy compared to food pellets in male rhesus monkeys.

PubMed

Hutsell, Blake A; Banks, Matthew L

2017-12-01

Emerging human laboratory and preclinical drug self-administration data suggest that a history of contingent abused drug exposure impairs performance in operant discrimination procedures, such as delayed nonmatching-to-sample (DNMTS), that are hypothesized to assess components of executive function. However, these preclinical discrimination studies have exclusively used food as the reinforcer and the effects of drugs as reinforcers in these operant procedures are unknown. The present study determined effects of contingent intravenous remifentanil injections on DNMTS performance hypothesized to assess 1 aspect of executive function, working memory. Daily behavioral sessions consisted of 2 components with sequential intravenous remifentanil (0, 0.01-1.0 μg/kg/injection) or food (0, 1-10 pellets) availability in nonopioid dependent male rhesus monkeys (n = 3). Remifentanil functioned as a reinforcer in the DNMTS procedure. Similar delay-dependent DNMTS accuracy was observed under both remifentanil- and food-maintained components, such that higher accuracies were maintained at shorter (0.1-1.0 s) delays and lower accuracies approaching chance performance were maintained at longer (10-32 s) delays. Remifentanil maintained significantly lower initial DNMTS accuracy compared to food. Reinforcer magnitude was not an important determinant of DNMTS accuracy for either remifentanil or food. These results extend the range of experimental procedures under which drugs function as reinforcers. Furthermore, the selective remifentanil-induced decrease in initial DNMTS accuracy is consistent with a selective impairment of attentional, but not memorial, processes. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Effects of Time between Trials on Rats' and Pigeons' Choices with Probabilistic Delayed Reinforcers

ERIC Educational Resources Information Center

Mazur, James E.; Biondi, Dawn R.

2011-01-01

Parallel experiments with rats and pigeons examined reasons for previous findings that in choices with probabilistic delayed reinforcers, rats' choices were affected by the time between trials whereas pigeons' choices were not. In both experiments, the animals chose between a standard alternative and an adjusting alternative. A choice of the…

Defining Delayed Consequences as Reinforcers: Some Do, Some Don't, and Nothing Changes

ERIC Educational Resources Information Center

Bradley, Kelly P.; Poling, Alan

2010-01-01

Results of a survey sent to members of the editorial boards of five behavior-analytic journals in 1990 indicated that there was no consensus among respondents with respect to whether delayed events can function as reinforcers (Schlinger, Blakely, Fillhard, & Poling, 1991). Since that time, several studies with nonhuman animals have demonstrated…

Effects of intra-accumbal administration of dopamine and ionotropic glutamate receptor drugs on delay discounting performance in rats.

PubMed

Yates, Justin R; Bardo, Michael T

2017-10-01

Nucleus accumbens core (NAcc) has been implicated in impulsive choice, as measured in delay discounting. The role of dopamine (DA) in impulsive choice has received considerable attention, whereas glutamate (Glu) has recently been shown to be an important mediator of discounting. However, research has not examined how DA or Glu receptors in NAcc mediate different aspects of delay discounting performance, that is, (a) sensitivity to reinforcer magnitude and (b) sensitivity to delayed reinforcement. Adult male Sprague-Dawley rats were first trained in a delay discounting task, in which the delay to a large magnitude food reinforcer increased across blocks of trials. Following behavioral training, rats received bilateral implantation of guide cannulas into NAcc. Half of the rats (n = 12) received infusions of the DA-selective ligands SKF 38393 (D1-like agonist: 0.03 or 0.1 μg), SCH 23390 (D1-like antagonist: 0.3 or 1.0 μg), quinpirole (D2-like agonist: 0.3 or 1.0 μg), and eticlopride (D2-like antagonist: 0.3 or 1.0 μg). The other half received infusions of the ionotropic Glu ligands MK-801 (NMDA uncompetitive antagonist: 0.3 or 1.0 μg), AP-5 (NMDA competitive antagonist: 0.3 or 1.0 μg), ifenprodil (noncompetitive antagonist at NR2B-containing NMDA receptors: 0.3 or 1.0 μg), and CNQX (AMPA competitive antagonist: 0.2 or 0.5 μg). Results showed that SCH 23390 (0.3 μg) decreased sensitivity to reinforcer magnitude without altering impulsive choice, whereas ifenprodil (1.0 μg) decreased sensitivity to delayed reinforcement (i.e., impulsive choice). The current results show that DA and NMDA receptors in NAcc mediate distinct aspects of discounting performance. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Noise and Sonic Boom Impact Technology. Initial Development of an Assessment System for Aircraft Noise (ASAN). Volume 3. Technical Description

DTIC Science & Technology

1989-06-01

field width, it will be padded on the left (or right, if the left adjustment indicator has been given) to make up the field width. The padding character...is blank (space) normally, and zero if the field width was specified with a leading zero (this zero does not imply an octal field width). 25 " a...unsigned octal notation (without a leading zero ). ’x The argument is coverted to unsigned hexadecimal notation (without a leading Ox). * u The argument is

Establishing books as conditioned reinforcers for preschool children as a function of an observational intervention.

PubMed

Singer-Dudek, Jessica; Oblak, Mara; Greer, R Douglas

2011-01-01

We tested the effects of an observational intervention (Greer & Singer-Dudek, 2008) on establishing children's books as conditioned reinforcers using a delayed multiple baseline design. Three preschool students with mild language and developmental delays served as the participants. Prior to the intervention, books did not function as reinforcers for any of the participants. The observational intervention consisted of a situation in which the participant observed a confederate being presented with access to books contingent on correct responses and the participant received nothing for correct responses. After several sessions of this treatment, the previously neutral books acquired reinforcing properties for maintenance and acquisition responses for all three participants.

ESTABLISHING BOOKS AS CONDITIONED REINFORCERS FOR PRESCHOOL CHILDREN AS A FUNCTION OF AN OBSERVATIONAL INTERVENTION

PubMed Central

Singer-Dudek, Jessica; Oblak, Mara; Greer, R. Douglas

2011-01-01

We tested the effects of an observational intervention (Greer & Singer-Dudek, 2008) on establishing children's books as conditioned reinforcers using a delayed multiple baseline design. Three preschool students with mild language and developmental delays served as the participants. Prior to the intervention, books did not function as reinforcers for any of the participants. The observational intervention consisted of a situation in which the participant observed a confederate being presented with access to books contingent on correct responses and the participant received nothing for correct responses. After several sessions of this treatment, the previously neutral books acquired reinforcing properties for maintenance and acquisition responses for all three participants. PMID:21941376

Within-trial contrast: pigeons prefer conditioned reinforcers that follow a relatively more rather than a less aversive event.

PubMed

Zentall, Thomas R; Singer, Rebecca A

2007-07-01

When behavior suggests that the value of a reinforcer depends inversely on the value of the events that precede or follow it, the behavior has been described as a contrast effect. Three major forms of contrast have been studied: incentive contrast, in which a downward (or upward) shift in the magnitude of reinforcement produces a relatively stronger downward (or upward) shift in the vigor of a response; anticipatory contrast, in which a forthcoming improvement in reinforcement results in a relative reduction in consummatory response; and behavioral contrast, in which a decrease in the probability of reinforcement in one component of a multiple schedule results in an increase in responding in an unchanged component of the schedule. Here we discuss a possible fourth kind of contrast that we call within-trial contrast because within a discrete trial, the relative value of an event has an inverse effect on the relative value of the reinforcer that follows. We show that greater effort, longer delay to reinforcement, or the absence of food all result in an increase in the preference for positive discriminative stimuli that follow (relative to less effort, shorter delay, or the presence of food). We further distinguish this within-trial contrast effect from the effects of delay reduction. A general model of this form of contrast is proposed in which the value of a primary or conditioned reinforcer depends on the change in value from the value of the event that precedes it.

Within-Trial Contrast: Pigeons Prefer Conditioned Reinforcers that Follow a Relatively More Rather than a Less Aversive Event

PubMed Central

Zentall, Thomas R; Singer, Rebecca A

2007-01-01

When behavior suggests that the value of a reinforcer depends inversely on the value of the events that precede or follow it, the behavior has been described as a contrast effect. Three major forms of contrast have been studied: incentive contrast, in which a downward (or upward) shift in the magnitude of reinforcement produces a relatively stronger downward (or upward) shift in the vigor of a response; anticipatory contrast, in which a forthcoming improvement in reinforcement results in a relative reduction in consummatory response; and behavioral contrast, in which a decrease in the probability of reinforcement in one component of a multiple schedule results in an increase in responding in an unchanged component of the schedule. Here we discuss a possible fourth kind of contrast that we call within-trial contrast because within a discrete trial, the relative value of an event has an inverse effect on the relative value of the reinforcer that follows. We show that greater effort, longer delay to reinforcement, or the absence of food all result in an increase in the preference for positive discriminative stimuli that follow (relative to less effort, shorter delay, or the presence of food). We further distinguish this within-trial contrast effect from the effects of delay reduction. A general model of this form of contrast is proposed in which the value of a primary or conditioned reinforcer depends on the change in value from the value of the event that precedes it. PMID:17725056

Self-Control and Impulsiveness in Nondieting Adult Human Females: Effects of Visual Food Cues and Food Deprivation

ERIC Educational Resources Information Center

Forzano, Lori-Ann B.; Chelonis, John J.; Casey, Caitlin; Forward, Marion; Stachowiak, Jacqueline A.; Wood, Jennifer

2010-01-01

Self-control can be defined as the choice of a larger, more delayed reinforcer over a smaller, less delayed reinforcer, and impulsiveness as the opposite. Previous research suggests that exposure to visual food cues affects adult humans' self-control. Previous research also suggests that food deprivation decreases adult humans' self-control. The…

Rapid Acquisition of Preference in Concurrent Chains: Effects of "d"-Amphetamine on Sensitivity to Reinforcement Delay

ERIC Educational Resources Information Center

Ta, Wei-Min; Pitts, Raymond C.; Hughes, Christine E.; McLean, Anthony P.; Grace, Randolph C.

2008-01-01

The purpose of this study was to examine effects of "d"-amphetamine on choice controlled by reinforcement delay. Eight pigeons responded under a concurrent-chains procedure in which one terminal-link schedule was always fixed- interval 8 s, and the other terminal-link schedule changed from session to session between fixed-interval 4 s and…

Preference for a stimulus that follows a relatively aversive event: contrast or delay reduction?

PubMed

Singer, Rebecca A; Berry, Laura M; Zentall, Thomas R

2007-03-01

Several types of contrast effects have been identified including incentive contrast, anticipatory contrast, and behavioral contrast. Clement, Feltus, Kaiser, and Zentall (2000) proposed a type of contrast that appears to be different from these others and called it within-trial contrast. In this form of contrast the relative value of a reinforcer depends on the events that occur immediately prior to the reinforcer. Reinforcers that follow relatively aversive events are preferred over those that follow less aversive events. In many cases the delay reduction hypothesis proposed by Fantino (1969) also can account for such effects. The current experiments provide a direct test of the delay reduction and contrast hypotheses by manipulating the schedule of reinforcement while holding trial duration constant. In Experiment 1, preference for fixed-interval (FI) versus differential-reinforcement-of-other-behavior (DRO) schedules of reinforcement was assessed. Some pigeons preferred one schedule over the other while others demonstrated a position (side) preference. Thus, no systematic preference was found. In Experiment 2, a simultaneous color discrimination followed the FI or DRO schedule, and following training, preference was assessed by presenting the two positive stimuli simultaneously. Consistent with the contrast hypothesis, pigeons showed a significant preference for the positive stimulus that in training had followed their less preferred schedule.

Reinforcement of wheel running in BALB/c mice: role of motor activity and endogenous opioids.

PubMed

Vargas-Pérez, Héctor; Sellings, Laurie H L; Paredes, Raúl G; Prado-Alcalá, Roberto A; Díaz, José-Luis

2008-11-01

The authors investigated the effect of the opioid antagonist naloxone on wheel-running behavior in Balb/c mice. Naloxone delayed the acquisition of wheel-running behavior, but did not reduce the expression of this behavior once acquired. Delayed acquisition was not likely a result of reduced locomotor activity, as naloxone-treated mice did not exhibit reduced wheel running after the behavior was acquired, and they performed normally on the rotarod test. However, naloxone-blocked conditioned place preference for a novel compartment paired previously with wheel running, suggesting that naloxone may delay wheel-running acquisition by blocking the rewarding or reinforcing effects of the behavior. These results suggest that the endogenous opioid system mediates the initial reinforcing effects of wheel running that are important in acquisition of the behavior.

Delayed temporal discrimination in pigeons: A comparison of two procedures

PubMed Central

Chatlosh, Diane L.; Wasserman, Edward A.

1987-01-01

A within-subjects comparison was made of pigeons' performance on two temporal discrimination procedures that were signaled by differently colored keylight samples. During stimulus trials, a peck on the key displaying a slanted line was reinforced following short keylight samples, and a peck on the key displaying a horizontal line was reinforced following long keylight samples, regardless of the location of the stimuli on those two choice keys. During position trials, a peck on the left key was reinforced following short keylight samples and a peck on the right key was reinforced following long keylight samples, regardless of which line stimulus appeared on the correct key. Thus, on stimulus trials, the correct choice key could not be discriminated prior to the presentation of the test stimuli, whereas on position trials, the correct choice key could be discriminated during the presentation of the sample stimulus. During Phase 1, with a 0-s delay between sample and choice stimuli, discrimination learning was faster on position trials than on stimulus trials for all 4 birds. During Phase 2, 0-, 0.5-, and 1.0-s delays produced differential loss of stimulus control under the two tasks for 2 birds. Response patterns during the delay intervals provided some evidence for differential mediation of the two delayed discriminations. These between-task differences suggest that the same processes may not mediate performance in each. PMID:16812483

The effects of reinforcement and response-cost on a delayed response task in children with attention deficit hyperactivity disorder: a research note.

PubMed

Solanto, M V

1990-07-01

Children with attention deficit hyperactivity disorder are more inattentive, active, and impulsive than normal children. Some researchers have postulated that these symptoms can all be explained as a result of reduced sensitivity to reinforcement. In order to evaluate this hypothesis, we tested 20 ADD-H children and 18 matched normal controls, 4 1/2-11 years of age, on a delayed response task, a measure of impulsiveness, under conditions of positive reinforcement, and punishment in the form of response-cost. The contingencies each improved performance compared to baseline but did not differ significantly from each other. Neither contingency affected the groups differentially, thus failing to provide support for the reinforcement hypothesis.

Choice between delayed food and immediate opioids in rats: treatment effects and individual differences.

PubMed

Panlilio, Leigh V; Secci, Maria E; Schindler, Charles W; Bradberry, Charles W

2017-11-01

Addiction involves maladaptive choice behavior in which immediate drug effects are valued more than delayed nondrug rewards. To model this behavior and extend our earlier work with the prescription opioid oxycodone, we allowed rats to choose between immediate intravenous delivery of the short-acting opioid remifentanil and delayed delivery of highly palatable food pellets. Treatment drugs were tested on a baseline where remifentanil was preferred over food. Treatment with a high dose of the opioid antagonist naltrexone decreased but did not reverse the preference for remifentanil. Treatment with the serotonin 5-HT 2C agonist lorcaserin decreased remifentanil and food self-administration nonselectively. Across conditions in which the alternative to delayed food was either a moderate dose of oxycodone, a moderate or high dose of remifentanil, a smaller more immediate delivery of food, or timeout with no primary reinforcement, choice was determined by both the length of the delay and the nature of the alternative option. Delayed food was discounted most steeply when the alternative was a high dose of remifentanil, which was preferred over food when food was delayed by 30 s or more. Within-subject comparisons showed no evidence for trait-like impulsivity or sensitivity to delay across these conditions. Choice was determined more by the current contingencies of reinforcement than by innate individual differences. This finding suggests that people might develop steep delay-discounting functions because of the contingencies in their environment, and it supports the use of contingency management to enhance the relative value of delayed nondrug reinforcers.

How should periods without social interaction be scheduled? Children's preference for practical schedules of positive reinforcement.

PubMed

Luczynski, Kevin C; Hanley, Gregory P

2014-01-01

Several studies have shown that children prefer contingent reinforcement (CR) rather than yoked noncontingent reinforcement (NCR) when continuous reinforcement is programmed in the CR schedule. Preference has not, however, been evaluated for practical schedules that involve CR. In Study 1, we assessed 5 children's preference for obtaining social interaction via a multiple schedule (periods of fixed-ratio 1 reinforcement alternating with periods of extinction), a briefly signaled delayed reinforcement schedule, and an NCR schedule. The multiple schedule promoted the most efficient level of responding. In general, children chose to experience the multiple schedule and avoided the delay and NCR schedules, indicating that they preferred multiple schedules as the means to arrange practical schedules of social interaction. In Study 2, we evaluated potential controlling variables that influenced 1 child's preference for the multiple schedule and found that the strong positive contingency was the primary variable. © Society for the Experimental Analysis of Behavior.

Using aberrant behaviors as reinforcers for autistic children.

PubMed Central

Charlop, M H; Kurtz, P F; Casey, F G

1990-01-01

In a series of experiments, we assessed the efficacy of using autistic children's aberrant behaviors as reinforcers to increase their correct task responding. In Experiment 1, reinforcer conditions of stereotypy, food, and varied (food or stereotypy) were compared. In Experiment 2, the conditions were delayed echolalia, food, and varied (food or delayed echolalia), and in Experiment 3, perseverative behavior was compared with stereotypy and food as potential reinforcers. A multielement design was used for all comparisons, and side-effect measures were recorded during and after teaching sessions as well as at home. Results indicated that, in general, task performance was highest when brief opportunities to engage in aberrant behaviors were provided as reinforcers. Edibles were associated with the lowest performance. Furthermore, no negative side effects (e.g., an increase in aberrant behaviors) occurred. The results are discussed in terms of suggesting a more pragmatic treatment approach by addressing the contingent use of autistic children's aberrant behaviors as reinforcers. PMID:2373653

An Evaluation of the Effects of a Mild Delayed Verbal Punisher on Choice of an Immediate Reinforcer by Children With Autism.

PubMed

Sy, Jolene R; Green, Leonard; Gratz, Olivia; Ervin, Thea

2016-09-01

Different combinations of immediate and delayed consequences differentially affect choice. Basic research has found that nonhuman animals are more likely to choose an alternative that produces an immediate reinforcer that is followed by a delayed punisher as the delay to punishment increases. The purpose of the current effort was to examine the choices of three individuals with autism when they were given the choice between receiving a larger amount of preferred food followed by a mild, delayed verbal punisher and a smaller amount of the preferred food. A secondary purpose was to determine whether signal presence and duration would affect the efficacy of the punisher (i.e., whether children would be more likely to select the smaller reward that was not followed by a delayed punisher). Results were idiosyncratic across children and highlight the need to evaluate choice under multiple arrangements. © The Author(s) 2016.

Using a Self-Control Training Procedure To Increase Appropriate Behavior.

ERIC Educational Resources Information Center

Dixon, Mark R.; Hayes, Linda J.; Binder, Lisa M.; Manthey, Sharon; Sigman, Connie; Zdanowski, Darlene M.

1998-01-01

A study evaluated teaching a technique for self-control to three adults with developmental disabilities. Concurrent fixed-duration/progressive-duration reinforcement schedules were introduced in which both smaller and larger reinforcers were available immediately. When progressively increasing delays were introduced for the larger reinforcer,…

Determinants of choice, and vulnerability and recovery in addiction.

PubMed

Lamb, R J; Maguire, David R; Ginsburg, Brett C; Pinkston, Jonathan W; France, Charles P

2016-06-01

Addiction may be viewed as choice governed by competing contingencies. One factor impacting choice, particularly as it relates to addiction, is sensitivity to delayed rewards. Discounting of delayed rewards influences addiction vulnerability because of competition between relatively immediate gains of drug use, e.g. intoxication, versus relatively remote gains of abstinence, e.g. family stability. Factors modifying delay sensitivity can be modeled in the laboratory. For instance, increased delay sensitivity can be similarly observed in adolescent humans and non-human animals. Similarly, genetic factors influence delay sensitivity in humans and animals. Recovery from addiction may also be viewed as choice behavior. Thus, reinforcing alternative behavior facilitates recovery because reinforcing alternative behavior decreases the frequency of using drugs. How reinforcing alternative behavior influences recovery can also be modeled in the laboratory. For instance, relapse risk decreases as abstinence duration increases, and this decreasing risk can be modeled in animals using choice procedures. In summary, addiction in many respects can be conceptualized as a problem of choice. Animal models of choice disorders stand to increase our understanding of the core processes that establish and maintain addiction and serve as a proving ground for development of novel treatments. Copyright © 2016 Elsevier B.V. All rights reserved.

Determinants of choice, and vulnerability and recovery in addiction

PubMed Central

Lamb, R.J.; Maguire, David R.; Ginsburg, Brett C.; Pinkston, Jonathan W.; France, Charles P.

2016-01-01

Addiction may be viewed as choice governed by competing contingencies. One factor impacting choice, particularly as it relates to addiction, is sensitivity to delayed rewards. Discounting of delayed rewards influences addiction vulnerability because of competition between relatively immediate gains of drug use, e.g. intoxication, versus relatively remote gains of abstinence, e.g. family stability. Factors modifying delay sensitivity can be modeled in the laboratory. For instance, increased delay sensitivity can be similarly observed in adolescent humans and non-human animals. Similarly, genetic factors influence delay sensitivity in humans and animals. Recovery from addiction may also be viewed as choice behavior. Thus, reinforcing alternative behavior facilitates recovery because reinforcing alternative behavior decreases the frequency of using drugs. How reinforcing alternative behavior influences recovery can also be modeled in the laboratory. For instance, relapse risk decreases as abstinence duration increases, and this decreasing risk can be modeled in animals using choice procedures. In summary, addiction in many respects can be conceptualized as a problem of choice. Animal models of choice disorders stand to increase our understanding of the core processes that establish and maintain addiction and serve as a proving ground for development of novel treatments. PMID:27083500

The Effects of Constant versus Varied Reinforcers on Preference and Resistance to Change

ERIC Educational Resources Information Center

Milo, Jessie-Sue; Mace, F. Charles; Nevin, John A.

2010-01-01

Previous research has demonstrated that factors such as reinforcer frequency, amount, and delay have similar effects on resistance to change and preference. In the present study, 4 boys with autism made choices between a constant reinforcer (one that was the same food item every trial) and a varied food reinforcer (one that varied randomly between…

Effect of Intermittent Reinforcement on Acquisition and Retention in Delayed Matching-to-Sample in Pigeons

ERIC Educational Resources Information Center

Grant, Douglas S.

2011-01-01

Experiments 1 and 2 involved independent groups that received primary reinforcement after a correct match with a probability of 1.0, 0.50 or 0.25. Correct matches that did not produce primary reinforcement produced a conditioned reinforcer. Both experiments revealed little evidence that acquisition or retention was adversely affected by use of…

Using Aberrant Behaviors as Reinforcers for Autistic Children.

ERIC Educational Resources Information Center

Charlop, Marjorie H.; And Others

1990-01-01

Three experiments assessed the efficacy of various reinforcers to increase correct task responding in a total of 10 autistic children, aged 6-9. Of the reinforcers used (stereotypy, delayed echolalia, perseverative behavior, and food), task performance was highest with opportunities to engage in aberrant behaviors, and lowest with edible…

SecureQEMU: Emulation-Based Software Protection Providing Encrypted Code Execution and Page Granularity Code Signing

DTIC Science & Technology

2008-12-01

SHA256 DIGEST LENGTH) ) ; peAddSection(&sF i l e , " . S i g S t u b " , dwStubSecSize , dwStubSecSize ) ; 169 peSecure(&sF i l e , deqAddrSize...deqAuthPageAddrSize . s i z e ( ) /2) ∗ (8 + SHA256 DIGEST LENGTH) ) + 16 ; bCode [ 3 4 ] = ( ( char∗)&dwSize ) [ 0 ] ; bCode [ 3 5 ] = ( ( char∗)&dwSize ) [ 1...2) ∗ (8 + SHA256 DIGEST LENGTH... ) ) ; AES KEY aesKey ; unsigned char i v s a l t [ 1 6 ] , temp iv [ 1 6 ] ; 739 unsigned char ∗key

The 6-31B(d) basis set and the BMC-QCISD and BMC-CCSD multicoefficient correlation methods.

PubMed

Lynch, Benjamin J; Zhao, Yan; Truhlar, Donald G

2005-03-03

Three new multicoefficient correlation methods (MCCMs) called BMC-QCISD, BMC-CCSD, and BMC-CCSD-C are optimized against 274 data that include atomization energies, electron affinities, ionization potentials, and reaction barrier heights. A new basis set called 6-31B(d) is developed and used as part of the new methods. BMC-QCISD has mean unsigned errors in calculating atomization energies per bond and barrier heights of 0.49 and 0.80 kcal/mol, respectively. BMC-CCSD has mean unsigned errors of 0.42 and 0.71 kcal/mol for the same two quantities. BMC-CCSD-C is an equally effective variant of BMC-CCSD that employs Cartesian rather than spherical harmonic basis sets. The mean unsigned error of BMC-CCSD or BMC-CCSD-C for atomization energies, barrier heights, ionization potentials, and electron affinities is 22% lower than G3SX(MP2) at an order of magnitude less cost for gradients for molecules with 9-13 atoms, and it scales better (N6 vs N,7 where N is the number of atoms) when the size of the molecule is increased.

Chronic cocaine exposure in adolescence: Effects on spatial discrimination reversal, delay discounting, and performance on fixed-ratio schedules in mice.

PubMed

Pope, Derek A; Boomhower, Steven R; Hutsell, Blake A; Teixeira, Kathryn M; Newland, M Christopher

2016-04-01

Adolescence is marked by the continued development of the neural pathways that support choice and decision-making, particularly those involving dopamine signaling. Cocaine exposure during adolescence may interfere with this development and manifest as increased perseveration and delay discounting in adulthood, behavioral processes that are related to drug addiction. Adolescent mice were exposed to 30mg/kg/day of cocaine (n=11) or saline vehicle (n=10) for 14days and behavior was assessed in adulthood. In Experiment 1, performance on a spatial-discrimination-reversal procedure was evaluated. In the first two sessions following the first reversal, cocaine-exposed mice produced more preservative errors relative to controls. In Experiment 2, cocaine-exposed mice displayed steeper delay discounting than saline-exposed mice, effects that were reversed by acute cocaine administration. Experiment 3 examined responding maintained by a range of fixed-ratio schedules of reinforcement. An analysis based on a theoretical framework called Mathematical Principles of Reinforcement (MPR) was applied to response-rate functions of individual mice. According to MPR, differences in response-rate functions in adulthood were due to a steepening of the delay-of-reinforcement gradient, disrupted motoric capacity (lower maximum response rates), and enhanced reinforcer efficacy for the adolescent cocaine- compared with saline-exposed mice. Overall, these experiments suggest that chronic exposure to cocaine during adolescence may impair different features of 'executive functions' in adulthood, and these may be related to distortions in the impact of reinforcing events. Copyright © 2016 Elsevier Inc. All rights reserved.

Does Sensitivity to Magnitude Depend on the Temporal Distribution of Reinforcement?

ERIC Educational Resources Information Center

Grace, Randolph C.; Bragason, Orn

2005-01-01

Our research addressed the question of whether sensitivity to relative reinforcer magnitude in concurrent chains depends on the distribution of reinforcer delays when the terminal-link schedules are equal. In Experiment 1, 12 pigeons responded in a two-component procedure. In both components, the initial links were concurrent variable-interval 40…

Using the Multiple-Choice Procedure to Measure the Relative Reinforcing Efficacy of Gambling: Initial Validity Evidence Among College Students.

PubMed

Butler, Leon H; Irons, Jessica G; Bassett, Drew T; Correia, Christopher J

2018-06-01

The multiple choice procedure (MCP) is used to assess the relative reinforcing value of concurrently available stimuli. The MCP was originally developed to assess the reinforcing value of drugs; the current within-subjects study employed the MCP to assess the reinforcing value of gambling behavior. Participants (N = 323) completed six versions of the MCP that presented hypothetical choices between money to be used while gambling ($10 or $25) versus escalating amounts of guaranteed money available immediately or after delays of either 1 week or 1 month. Results suggest that choices on the MCP are correlated with other measures of gambling behavior, thus providing concurrent validity data for using the MCP to quantify the relative reinforcing value of gambling. The MCP for gambling also displayed sensitivity to reinforcer magnitude and delay effects, which provides evidence of criterion validity. The results are consistent with a behavioral economic model of addiction and suggest that the MCP could be a valid tool for future research on gambling behavior.

The general matching law describes choice on concurrent variable-interval schedules of wheel-running reinforcement.

PubMed

Belke, T W; Belliveau, J

2001-05-01

Six male Wistar rats were exposed to concurrent variable-interval schedules of wheel-running reinforcement. The reinforcer associated with each alternative was the opportunity to run for 15 s, and the duration of the changeover delay was 1 s. Results suggested that time allocation was more sensitive to relative reinforcement rate than was response allocation. For time allocation, the mean slopes and intercepts were 0.82 and 0.008, respectively. In contrast, for response allocation, mean slopes and intercepts were 0.60 and 0.03, respectively. Correction for low response rates and high rates of changing over, however, increased slopes for response allocation to about equal those for time allocation. The results of the present study suggest that the two-operant form of the matching law can be extended to wheel-running reinforcement. 'I'he effects of a low overall response rate, a short Changeover delay, and long postreinforcement pausing on the assessment of matching in the present study are discussed.

The Effects of Task Fluency and Concurrent Reinforcement Schedules on Student Choice Allocation between Math Tasks

ERIC Educational Resources Information Center

Zaman, Maliha

2010-01-01

Students may avoid working on difficult tasks because it takes them longer to complete those tasks, which results in a delay to reinforcement. Research studies show that reinforcer and response dimensions can be manipulated within a concurrent operants framework to bias choice allocation toward more difficult tasks. The current study extends…

"Work ethic" in pigeons: reward value is directly related to the effort or time required to obtain the reward.

PubMed

Clement, T S; Feltus, J R; Kaiser, D H; Zentall, T R

2000-03-01

Stimuli associated with less effort or with shorter delays to reinforcement are generally preferred over those associated with greater effort or longer delays to reinforcement. However, the opposite appears to be true of stimuli that follow greater effort or longer delays. In training, a simple simultaneous discrimination followed a single peck to an initial stimulus (S+FR1 S-FR1) and a different simple simultaneous discrimination followed 20 pecks to the initial stimulus (S+FR20 S-FR20). On test trials, pigeons preferred S+FR20 over S+FR1 and S-FR20 over S-FR1. These data support the view that the state of the animal immediately prior to presentation of the discrimination affects the value of the reinforcement that follows it. This contrast effect is analogous to effects that when they occur in humans have been attributed to more complex cognitive and social factors.

Disparate cocaine-induced locomotion as a predictor of choice behavior in rats trained in a delay-discounting task

PubMed Central

Stanis, Jessica J.; Burns, Randi M.; Sherrill, Luke K.; Gulley, Joshua M.

2008-01-01

Heightened impulsivity and differential sensitivity to a drug's behavioral effects are traits that, individually, have been associated with chronic drug use and dependence. Here, we used an animal model to test whether individual differences in cocaine-induced activity are predictive of impulsive choice behavior. Adult, male Sprague-Dawley rats were given cocaine (10 mg/kg, i.p.) and classified into low or high cocaine responders (LCRs and HCRs, respectively) based on their locomotor response in an open-field arena. Rats were then trained in a delay-discounting task that offers a choice between immediately delivered, but smaller reinforcements, or larger reinforcements that are delivered after a delay. We also examined the effects of amphetamine (AMPH; 0.3-1.0 mg/kg) and the 5-HT1A agonist 8-OH-DPAT (0.3-1.0 mg/kg) on delay discounting. Lastly, all rats were retested in the open-field to determine if phenotypes were stable. We observed baseline differences in choice behavior between the groups, with HCRs behaving more impulsively (i.e., choosing the small reinforcement) compared to LCRs. AMPH decreased choice of the large reinforcement in LCRs, but did not alter choice in HCRs. Impulsive choice was increased in both phenotypes following 8-OH-DPAT, with LCRs exhibiting changes across a wider range of delays. When cocaine-induced open-field behavior was retested, responses in LCRs were similar whereas HCRs showed evidence of tolerance. Our results suggest that differential sensitivity to cocaine-induced locomotion is predictive of impulsivity and the potential neurobiological differences in LCRs and HCRs may provide insight into mechanisms contributing to vulnerability for chronic drug use and/or dependence. PMID:18539407

Zn Coordination Chemistry:  Development of Benchmark Suites for Geometries, Dipole Moments, and Bond Dissociation Energies and Their Use To Test and Validate Density Functionals and Molecular Orbital Theory.

PubMed

Amin, Elizabeth A; Truhlar, Donald G

2008-01-01

We present nonrelativistic and relativistic benchmark databases (obtained by coupled cluster calculations) of 10 Zn-ligand bond distances, 8 dipole moments, and 12 bond dissociation energies in Zn coordination compounds with O, S, NH3, H2O, OH, SCH3, and H ligands. These are used to test the predictions of 39 density functionals, Hartree-Fock theory, and seven more approximate molecular orbital theories. In the nonrelativisitic case, the M05-2X, B97-2, and mPW1PW functionals emerge as the most accurate ones for this test data, with unitless balanced mean unsigned errors (BMUEs) of 0.33, 0.38, and 0.43, respectively. The best local functionals (i.e., functionals with no Hartree-Fock exchange) are M06-L and τ-HCTH with BMUEs of 0.54 and 0.60, respectively. The popular B3LYP functional has a BMUE of 0.51, only slightly better than the value of 0.54 for the best local functional, which is less expensive. Hartree-Fock theory itself has a BMUE of 1.22. The M05-2X functional has a mean unsigned error of 0.008 Å for bond lengths, 0.19 D for dipole moments, and 4.30 kcal/mol for bond energies. The X3LYP functional has a smaller mean unsigned error (0.007 Å) for bond lengths but has mean unsigned errors of 0.43 D for dipole moments and 5.6 kcal/mol for bond energies. The M06-2X functional has a smaller mean unsigned error (3.3 kcal/mol) for bond energies but has mean unsigned errors of 0.017 Å for bond lengths and 0.37 D for dipole moments. The best of the semiempirical molecular orbital theories are PM3 and PM6, with BMUEs of 1.96 and 2.02, respectively. The ten most accurate functionals from the nonrelativistic benchmark analysis are then tested in relativistic calculations against new benchmarks obtained with coupled-cluster calculations and a relativistic effective core potential, resulting in M05-2X (BMUE = 0.895), PW6B95 (BMUE = 0.90), and B97-2 (BMUE = 0.93) as the top three functionals. We find significant relativistic effects (∼0.01 Å in bond lengths, ∼0.2 D in dipole moments, and ∼4 kcal/mol in Zn-ligand bond energies) that cannot be neglected for accurate modeling, but the same density functionals that do well in all-electron nonrelativistic calculations do well with relativistic effective core potentials. Although most tests are carried out with augmented polarized triple-ζ basis sets, we also carried out some tests with an augmented polarized double-ζ basis set, and we found, on average, that with the smaller basis set DFT has no loss in accuracy for dipole moments and only ∼10% less accurate bond lengths.

Delay Discounting of Self-Determined and Experimenter-Determined Commodities

ERIC Educational Resources Information Center

Weatherly, Jeffrey N.; Gudding, Jennifer; Derenne, Adam

2010-01-01

Research suggests that individuals prefer self-determined reinforcers over experimenter-determined ones. The present study had 518 college students complete a delay-discounting task in which the commodity was cigarettes, a grocery store gift card, casino tokens, cash, or the choice of the four. The least amount of delay discounting was observed…

Using Funds of Knowledge to Build Trust between a Teacher and Parents of Language-Delayed Preschoolers

ERIC Educational Resources Information Center

Gonzalez, Alissa Zoraida

2014-01-01

Preschool children with language delays often struggle to learn new concepts. Proven strategies such as modeling, prompting, reinforcing responses, direct teaching, and hands-on experience matter to young children with language delays. Also important are social interactions and shared experiences with more knowledgeable persons. Within a cultural…

Pigeons' Discrimination of Michotte's Launching Effect

PubMed Central

Young, Michael E; Beckmann, Joshua S; Wasserman, Edward A

2006-01-01

We trained four pigeons to discriminate a Michotte launching animation from three other animations using a go/no-go task. The pigeons received food for pecking at one of the animations, but not for pecking at the others. The four animations featured two types of interactions among objects: causal (direct launching) and noncausal (delayed, distal, and distal & delayed). Two pigeons were reinforced for pecking at the causal interaction, but not at the noncausal interactions; two other pigeons were reinforced for pecking at the distal & delayed interaction, but not at the other interactions. Both discriminations proved difficult for the pigeons to master; later tests suggested that the pigeons often learned the discriminations by attending to subtle stimulus properties other than the intended ones. PMID:17002229

Changing Delay Discounting in the Light of the Competing Neurobehavioral Decision Systems Theory: A Review

ERIC Educational Resources Information Center

Koffarnus, Mikhail N.; Jarmolowicz, David P.; Mueller, E. Terry; Bickel, Warren K.

2013-01-01

Excessively devaluing delayed reinforcers co-occurs with a wide variety of clinical conditions such as drug dependence, obesity, and excessive gambling. If excessive delay discounting is a trans-disease process that underlies the choice behavior leading to these and other negative health conditions, efforts to change an individual's discount rate…

Reinforcer pathologies: Predicting alcohol related problems in college drinking men and women.

PubMed

Lemley, Shea M; Kaplan, Brent A; Reed, Derek D; Darden, Alexandria C; Jarmolowicz, David P

2016-10-01

Alcohol use in college is common, and problematic consequences of alcohol may affect college men and women differently. Approaches within behavioral economics have been used to improve our understanding of alcohol use in college students. The current study assessed relations between college students' delay discounting, demand for alcohol, and alcohol problems as measured by the Young Adult Alcohol Consequences Questionnaire (YAACQ). In this study, 80 college drinkers completed a monetary choice questionnaire that assessed delay discounting of money, a novel beer choice questionnaire that evaluated delay discounting of beer, and an alcohol purchase task that measured demand for alcohol. Behavioral economic measures associated with the reinforcer pathologies model (i.e., demand and discounting) predicted alcohol consequences as measured by the YAACQ. For men, these significant predictor variables included money discounting, beer discounting, and intensity of alcohol demand, whereas for women money discounting and essential value were significant predictors. These findings highlight the utility of the reinforcer pathologies approach for the study of alcohol use and the importance of considering gender differences in examining college drinking. Copyright © 2016. Published by Elsevier Ireland Ltd.

Using Behavior Economics to Understand Alcohol Use Disorders: A Concise Review and Identification of Research Priorities

PubMed Central

Gray, Joshua C.; MacKillop, James

2016-01-01

We review recent advances in the application of behavioral economics to alcohol use disorders (AUDs). Specifically, we review individual differences in alcohol demand (i.e., the relative reinforcing value of alcohol) and delayed reward discounting (i.e., impulsive decision making) in relation to AUDs. Additionally, we review the efficacy of reinforcement-based clinical applications. What emerges from the literature is an extensive body of cross-sectional research implicating alcohol demand and delayed reward discounting with alcohol misuse. However, more research is needed to examine these domains across the lifespan in order to understand their longitudinal trajectories. Similarly, clinical research is consistently supportive of reinforcement-based clinical interventions, but the number of randomized controlled trials to date is relatively small and there has been limited examination of the putative mechanisms of behavior change. PMID:27795939

Rule-governed behavior and behavioral anthropology

PubMed Central

Malott, Richard W.

1988-01-01

According to cultural materialism, cultural practices result from the materialistic outcomes of those practices, not from sociobiological, mentalistic, or mystical predispositions (e.g., Hindus worship cows because, in the long run, that worship results in more food, not less food). However, according to behavior analysis, such materialistic outcomes do not reinforce or punish the cultural practices, because such outcomes are too delayed, too improbable, or individually too small to directly reinforce or punish the cultural practices (e.g., the food increase is too delayed to reinforce the cow worship). Therefore, the molar, materialistic contingencies need the support of molecular, behavioral contingencies. And according to the present theory of rule-governed behavior, the statement of rules describing those molar, materialistic contingencies can establish the needed molecular contingencies. Given the proper behavioral history, such rule statements combine with noncompliance to produce a learned aversive condition (often labeled fear, anxiety, or guilt). The termination of this aversive condition reinforces compliance, just as its presentation punishes noncompliance (e.g., the termination of guilt reinforces the tending to a sick cow). In addition, supernatural rules often supplement these materialistic rules. Furthermore, the production of both materialistic and supernatural rules needs cultural designers who understand the molar, materialistic contingencies. PMID:22478012

Statistical Mechanics of the Delayed Reward-Based Learning with Node Perturbation

NASA Astrophysics Data System (ADS)

Hiroshi Saito,; Kentaro Katahira,; Kazuo Okanoya,; Masato Okada,

2010-06-01

In reward-based learning, reward is typically given with some delay after a behavior that causes the reward. In machine learning literature, the framework of the eligibility trace has been used as one of the solutions to handle the delayed reward in reinforcement learning. In recent studies, the eligibility trace is implied to be important for difficult neuroscience problem known as the “distal reward problem”. Node perturbation is one of the stochastic gradient methods from among many kinds of reinforcement learning implementations, and it searches the approximate gradient by introducing perturbation to a network. Since the stochastic gradient method does not require a objective function differential, it is expected to be able to account for the learning mechanism of a complex system, like a brain. We study the node perturbation with the eligibility trace as a specific example of delayed reward-based learning, and analyzed it using a statistical mechanics approach. As a result, we show the optimal time constant of the eligibility trace respect to the reward delay and the existence of unlearnable parameter configurations.

Delayed nootropic effects of arginine vasopressin after early postnatal chronic administration to albino rat pups.

PubMed

Kim, P A; Voskresenskaya, O G; Kamensky, A A

2009-06-01

Intranasal administration of arginine vasopressin (10 microg/kg) to albino rat pups had a strong nootropic effect during training with positive and negative reinforcement. This effect was different in animals of various age groups: training with positive reinforcement was improved in "adolescent" rats and pubertal animals, while during training with negative reinforcement, the nootropic effect of the peptide was more prolonged and persisted also in adult animals.

Assessment of progressively delayed prompts on guided skill learning in rats.

PubMed

Reid, Alliston K; Futch, Sara E; Ball, Katherine M; Knight, Aubrey G; Tucker, Martha

2017-03-01

We examined the controlling factors that allow a prompted skill to become autonomous in a discrete-trials implementation of Touchette's (1971) progressively delayed prompting procedure, but our subjects were rats rather than children with disabilities. Our prompted skill was a left-right lever-press sequence guided by two panel lights. We manipulated (a) the effectiveness of the guiding lights prompt and (b) the presence or absence of a progressively delayed prompt in four groups of rats. The less effective prompt yielded greater autonomy than the more effective prompt. The ability of the progressively delayed prompt procedure to produce behavioral autonomy depended upon characteristics of the obtained delay (trial duration) rather than on the pending prompt. Sequence accuracy was reliably higher in unprompted trials than in prompted trials, and this difference was maintained in the 2 groups that received no prompts but yielded equivalent trial durations. Overall sequence accuracy decreased systematically as trial duration increased. Shorter trials and their greater accuracy were correlated with higher overall reinforcement rates for faster responding. Waiting for delayed prompts (even if no actual prompt was provided) was associated with lower overall reinforcement rate by decreasing accuracy and by lengthening trials. These findings extend results from previous studies regarding the controlling factors in delayed prompting procedures applied to children with disabilities.

The measurement and reinforcement of behavior of psychotics1

PubMed Central

Ayllon, T.; Azrin, N. H.

1965-01-01

An attempt was made to strengthen behaviors of psychotics by applying operant reinforcement principles in a mental hospital ward. The behaviors studied were necessary and/or useful for the patient to function in the hospital environment. Reinforcement consisted of the opportunity to engage in activities that had a high level of occurrence when freely allowed. Tokens were used as conditioned reinforcers to bridge the delay between behavior and reinforcement. Emphasis was placed on objective definition and quantification of the responses and reinforcers and upon programming and recording procedures. Standardizing the objective criteria permitted ward attendants to administer the program. The procedures were found to be effective in maintaining the desired adaptive behaviors for as long as the procedures were in effect. In a series of six experiments, reinforced behaviors were considerably reduced when the reinforcement procedure was discontinued; the adaptive behaviors increased immediately when the reinforcement procedure was re-introduced. PMID:5851397

Investigation of the internal stresses caused by delayed ettringite formation in concrete.

DOT National Transportation Integrated Search

2008-11-01

Delayed ettringite formation (DEF) in concrete has been identified in recent as a significant cause of deterioration in : some of the reinforced concrete infrastructure in Texas. This report is part of a research project, TxDOT project : 5218, to inv...

Delay Discounting in Lewis and Fischer 344 Rats: Steady-state and Rapid-determination Adjusting-amount Procedures

PubMed Central

Stein, Jeffrey S; Pinkston, Jonathan W; Brewer, Adam T; Francisco, Monica T; Madden, Gregory J

2012-01-01

Lewis rats have been shown to make more impulsive choices than Fischer 344 rats in discrete-trial choice procedures that arrange fixed (i.e., nontitrating) reinforcement parameters. However, nontitrating procedures yield only gross estimates of preference, as choice measures in animal subjects are rarely graded at the level of the individual subject. The present study was designed to examine potential strain differences in delay discounting using an adjusting-amount procedure, in which distributed (rather than exclusive) choice is observed due to dynamic titration of reinforcer magnitude across trials. Using a steady-state version of the adjusting-amount procedure in which delay was manipulated between experimental conditions, steeper delay discounting was observed in Lewis rats compared to Fischer 344 rats; further, delay discounting in both strains was well described by the traditional hyperbolic discounting model. However, upon partial completion of the present study, a study published elsewhere (Wilhelm & Mitchell, 2009) demonstrated no difference in delay discounting between these strains with the use of a more rapid version of the adjusting-amount procedure (i.e., in which delay is manipulated daily). Thus, following completion of the steady-state assessment in the present study, all surviving Lewis and Fischer 344 rats completed an approximation of this rapid-determination procedure in which no strain difference in delay discounting was observed. PMID:22693360

Delay discounting in Lewis and Fischer 344 rats: steady-state and rapid-determination adjusting-amount procedures.

PubMed

Stein, Jeffrey S; Pinkston, Jonathan W; Brewer, Adam T; Francisco, Monica T; Madden, Gregory J

2012-05-01

Lewis rats have been shown to make more impulsive choices than Fischer 344 rats in discrete-trial choice procedures that arrange fixed (i.e., nontitrating) reinforcement parameters. However, nontitrating procedures yield only gross estimates of preference, as choice measures in animal subjects are rarely graded at the level of the individual subject. The present study was designed to examine potential strain differences in delay discounting using an adjusting-amount procedure, in which distributed (rather than exclusive) choice is observed due to dynamic titration of reinforcer magnitude across trials. Using a steady-state version of the adjusting-amount procedure in which delay was manipulated between experimental conditions, steeper delay discounting was observed in Lewis rats compared to Fischer 344 rats; further, delay discounting in both strains was well described by the traditional hyperbolic discounting model. However, upon partial completion of the present study, a study published elsewhere (Wilhelm & Mitchell, 2009) demonstrated no difference in delay discounting between these strains with the use of a more rapid version of the adjusting-amount procedure (i.e., in which delay is manipulated daily). Thus, following completion of the steady-state assessment in the present study, all surviving Lewis and Fischer 344 rats completed an approximation of this rapid-determination procedure in which no strain difference in delay discounting was observed.

The effect of scopolamine on matching behavior and the estimation of relative reward magnitude.

PubMed

Leon, Matthew I; Rodriguez-Barrera, Vanessa; Amaya, Aldo

2017-10-01

We investigated the behavioral effects of scopolamine on rats that bar pressed for trains of electrically stimulating pulses under concurrent variable interval schedules of reward. For the first half of the session (30 min) a 1:4 ratio in the programmed number of stimulation trains delivered at each option was in effect. At the start of the second half of the session, an unsignaled reversal in the relative train number (4:1) occurred. We tracked the relative magnitude of reward estimated for each contiguous pair of reinforced visits to competing options. Scopolamine hydrobromide led to a reduction in the relative magnitude of reward. A similar result was obtained in a follow-up test in which relative magnitude was manipulated by varying the pulse frequency of stimulation, while equating the train number at each option. The effect of scopolamine hydrobromide could not be attributed to undermatching, side bias, nor to an effect of scopolamine on the reward integration process. When the same rats were treated with scopolamine methylbromide, no effects on matching behavior were observed. Our results suggest a cholinergic basis for the computation of choice variables related to matching behavior. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

A quantitative analysis of sensitivity to the conditioned reinforcing value of terminal-link stimuli in a concurrent-chains schedule.

PubMed Central

Omino, T

1993-01-01

Pigeons were exposed to a concurrent-chains schedule in which a single variable-interval 30-s schedule was used in the initial links and fixed-time schedules were used in the terminal links. Three types of keylight conditions were used in the terminal links. In the first condition, different delays were associated with different keylight stimuli (cued condition). In the second condition, different delays were associated with the same stimulus, either a blackout (uncued blackout condition) or a white key (uncued white condition). Paired values of terminal-link fixed-time schedules differed by a constant ratio of 3:1, while the absolute value of delays was varied from 3 s to 54 s. The results showed that choice proportions for the shorter of two delays increased when the absolute size of the delays was increased for all keylight conditions. Further, the choice proportions for the shorter delay increased from the uncued blackout condition, to the uncued white condition, to the cued condition. A modified version of Fantino's (1969) delay-reduction model (expressed as a function relating the response ratio to the delay-reduction ratio) can be applied to these data by showing that sensitivity to delay reduction increased from the uncued blackout condition, to the uncued white condition, to the cued condition. Thus, the present study demonstrated that a modified version of the delay-reduction model can be used to assess quantitative differences in the terminal-link keylight condition in terms of sensitivity to delay reduction (i.e., the conditioned reinforcing value of the terminal-link keylight stimuli). PMID:8283150

Buspirone Reduces Sexual Risk-Taking Intent but not Cocaine Self-Administration

PubMed Central

Bolin, B. Levi; Lile, Joshua A.; Marks, Katherine R.; Beckmann, Joshua S.; Rush, Craig R.; Stoops, William W.

2016-01-01

Impulsive sexual decision-making may underlie sexual risk-taking behavior that contributes to the disproportionately high prevalence of HIV infection among cocaine users. Delay-discounting procedures measure impulsive decision-making and may provide insight into the underlying mechanisms of sexual risk-taking behavior. The anxiolytic drug buspirone reduces delay discounting in rats and blunts the reinforcing effects of cocaine in some preclinical studies suggesting that it might have utility in the treatment of cocaine-use disorders. This study determined whether buspirone mitigates impulsive risky sexual decision-making in cocaine users on a sexual delay-discounting procedure. The effects of buspirone maintenance on the abuse-related and physiological effects of cocaine were also tested. Nine (N = 9) current cocaine users completed a repeated-measures, inpatient protocol in which sexual delay discounting was assessed following three days of maintenance on placebo and buspirone (30 mg/day) in counterbalanced order. The reinforcing, subject-rated, and physiological effects of placebo and intranasal cocaine (15 and 45 mg) were also assessed during buspirone and placebo maintenance. Buspirone increased the likelihood of condom use for hypothetical sexual partners that were categorized as most likely to have a sexually transmitted infection and least sexually desirable. Cocaine functioned as a reinforcer and increased positive subjective effects ratings, but buspirone maintenance did not impact these effects of cocaine. Buspirone was also safe and tolerable when combined with cocaine and may have blunted some its cardiovascular effects. The results from the sexual delay-discounting procedure indicate that buspirone may reduce preference for riskier sex in cocaine users. PMID:27254258

Opioid Abstinence Reinforcement Delays Heroin Lapse during Buprenorphine Dose Tapering

ERIC Educational Resources Information Center

Greenwald, Mark K.

2008-01-01

A positive reinforcement contingency increased opioid abstinence during outpatient dose tapering (4, 2, then 0 mg/day during Weeks 1 through 3) in non-treatment-seeking heroin-dependent volunteers who had been maintained on buprenorphine (8 mg/day) during an inpatient research protocol. The control group (n = 12) received $4.00 for completing…

A Response to "The Negative Effects of Positive Reinforcement in Teaching Children with Developmental Delays."

ERIC Educational Resources Information Center

Ward, Phillip C.

1995-01-01

This article responds to a study by Gerald Biederman and others, which concluded that verbal reinforcement in combination with interactive modeling strategies may produce confusion in children with language/learning difficulties. The article contends that a functional relationship cannot be claimed for the study's variables because measurement…

Eb&D: A new clustering approach for signed social networks based on both edge-betweenness centrality and density of subgraphs

NASA Astrophysics Data System (ADS)

Qi, Xingqin; Song, Huimin; Wu, Jianliang; Fuller, Edgar; Luo, Rong; Zhang, Cun-Quan

2017-09-01

Clustering algorithms for unsigned social networks which have only positive edges have been studied intensively. However, when a network has like/dislike, love/hate, respect/disrespect, or trust/distrust relationships, unsigned social networks with only positive edges are inadequate. Thus we model such kind of networks as signed networks which can have both negative and positive edges. Detecting the cluster structures of signed networks is much harder than for unsigned networks, because it not only requires that positive edges within clusters are as many as possible, but also requires that negative edges between clusters are as many as possible. Currently, we have few clustering algorithms for signed networks, and most of them requires the number of final clusters as an input while it is actually hard to predict beforehand. In this paper, we will propose a novel clustering algorithm called Eb &D for signed networks, where both the betweenness of edges and the density of subgraphs are used to detect cluster structures. A hierarchically nested system will be constructed to illustrate the inclusion relationships of clusters. To show the validity and efficiency of Eb &D, we test it on several classical social networks and also hundreds of synthetic data sets, and all obtain better results compared with other methods. The biggest advantage of Eb &D compared with other methods is that the number of clusters do not need to be known prior.

Non-neutralized Electric Currents in Solar Active Regions and Flare Productivity

NASA Astrophysics Data System (ADS)

Kontogiannis, Ioannis; Georgoulis, Manolis K.; Park, Sung-Hong; Guerra, Jordan A.

2017-11-01

We explore the association of non-neutralized currents with solar flare occurrence in a sizable sample of observations, aiming to show the potential of such currents in solar flare prediction. We used the high-quality vector magnetograms that are regularly produced by the Helioseismic Magnetic Imager, and more specifically, the Space weather HMI Active Region Patches (SHARP). Through a newly established method that incorporates detailed error analysis, we calculated the non-neutralized currents contained in active regions (AR). Two predictors were produced, namely the total and the maximum unsigned non-neutralized current. Both were tested in AR time-series and a representative sample of point-in-time observations during the interval 2012 - 2016. The average values of non-neutralized currents in flaring active regions are higher by more than an order of magnitude than in non-flaring regions and correlate very well with the corresponding flare index. The temporal evolution of these parameters appears to be connected to physical processes, such as flux emergence and/or magnetic polarity inversion line formation, that are associated with increased solar flare activity. Using Bayesian inference of flaring probabilities, we show that the total unsigned non-neutralized current significantly outperforms the total unsigned magnetic flux and other well-established current-related predictors. It therefore shows good prospects for inclusion in an operational flare-forecasting service. We plan to use the new predictor in the framework of the FLARECAST project along with other highly performing predictors.

Speed of CMEs and the Magnetic Non-Potentiality of Their Source ARs

NASA Technical Reports Server (NTRS)

Tiwari, Sanjiv K.; Falconer, David A.; Moore, Ronald L.; Venkatakrishnan, P.

2014-01-01

Most fast coronal mass ejections (CMEs) originate from solar active regions (ARs). Non-potentiality of ARs is expected to determine the speed and size of CMEs in the outer corona. Several other unexplored parameters might be important as well. To find out the correlation between the initial speed of CMEs and the non-potentiality of source ARs, we associated over a hundred of CMEs with source ARs via their co-produced flares. The speed of the CMEs are collected from the SOHO LASCO CME catalog. We have used vector magnetograms obtained mainly with HMI/SDO, also with Hinode (SOT/SP) when available within an hour of a CME occurrence, to evaluate various magnetic non-potentiality parameters, e.g. magnetic free-energy proxies, computed magnetic free energy, twist, shear angle, signed shear angle etc. We have also included several other parameters e.g. total unsigned flux, net current, magnetic area of ARs, area of sunspots, to investigate their correlation, if any, with the initial speeds of CMEs. Our preliminary results show that the ARs with larger non-potentiality and area mostly produce fast CMEs but they can also produce slower ones. The ARs with lesser non-potentiality and area generally produce only slower CMEs, however, there are a few exceptions. The total unsigned flux correlate with the non-potentiality parameters and area of ARs but some ARs with large unsigned flux are also found to be least non-potential. A more detailed analysis is underway.

Concurrent progressive ratio schedules: Effects of reinforcer probability on breakpoint and response allocation.

PubMed

Jarmolowicz, David P; Sofis, Michael J; Darden, Alexandria C

2016-07-01

Although progressive ratio (PR) schedules have been used to explore effects of a range of reinforcer parameters (e.g., magnitude, delay), effects of reinforcer probability remain underexplored. The present project used independently progressing concurrent PR PR schedules to examine effects of reinforcer probability on PR breakpoint (highest completed ratio prior to a session terminating 300s pause) and response allocation. The probability of reinforcement on one lever remained at 100% across all conditions while the probability of reinforcement on the other lever was systematically manipulated (i.e., 100%, 50%, 25%, 12.5%, and a replication of 25%). Breakpoints systematically decreased with decreasing reinforcer probabilities while breakpoints on the control lever remained unchanged. Patterns of switching between the two levers were well described by a choice-by-choice unit price model that accounted for the hyperbolic discounting of the value of probabilistic reinforcers. Copyright © 2016 Elsevier B.V. All rights reserved.

Self-Control and Impulsivity in Children: Multiple Behavioral Measures

ERIC Educational Resources Information Center

Forzano, L. B.; Michels, Jennifer L.; Carapella, R. K.; Conway, Patrick; Chelonis, J. J.

2011-01-01

The present experiment investigated the relationship between laboratory measures of self-control and delay of gratification in children and explored several other factors that may influence self-control. In the self-control paradigm, 30 four-year-old children repeatedly chose between three reinforcers received after a delay and one reinforcer…

The Behavioral Economics and Neuroeconomics of Alcohol Use Disorders

PubMed Central

MacKillop, James

2016-01-01

Background Behavioral economics and neuroeconomics bring together perspectives and methods from psychology, economics, and cognitive neuroscience to understand decision making and choice behavior. Extending an operant behavioral theoretical framework, these perspectives have increasingly been applied to understanding alcohol use disorders (AUDs) and this review surveys the theory, methods, and findings from this approach. The focus is on three key behavioral economic concepts: delay discounting (i.e., preferences for smaller immediate rewards relative to larger delayed rewards), alcohol demand (i.e., alcohol reinforcing value), and proportionate alcohol-related reinforcement (i.e., relative amount of psychosocial reinforcement associated with alcohol use). Findings Delay discounting has been linked to AUDs in both cross-sectional and longitudinal studies, and has been investigated cross-sectionally using neuroimaging. Alcohol demand and proportionate alcohol-related reinforcement have both been robustly associated with drinking and alcohol misuse cross-sectionally, but not over time. Both have also been found to predict treatment response to brief interventions. Alcohol demand has also been used to enhance the measurement of acute motivation for alcohol in laboratory studies. Interventions that focus on reducing the value of alcohol by increasing alternative reinforcement and response cost have been found to be efficacious, albeit in relatively small numbers of randomized controlled trials (RCTs). Mediators and moderators of response to these interventions have not been extensively investigated. Future Directions The application of behavioral economics and neuroeconomics to AUDs has given rise to an extensive body of empirical work, although significant gaps in knowledge remain. In particular, there is a need for more longitudinal investigations to clarify the etiological roles of these behavioral economic processes, especially alcohol demand and proportionate alcohol reinforcement. Additional RCTs are needed to extend and generalize the findings from reinforcement-based interventions and to investigate mediators and moderators of treatment success for optimization. Applying neuroeconomics to AUDs remains at an early stage and has been primarily descriptive to date, but has high potential for important translational insights in the future. The same is true for using these behavioral economic indicators to understand genetic influences on AUDs. PMID:26993151

Reinforcer Control by Comparison-Stimulus Color and Location in a Delayed Matching-to-Sample Task

ERIC Educational Resources Information Center

Alsop, Brent; Jones, B. Max

2008-01-01

Six pigeons were trained in a delayed matching-to-sample task involving bright- and dim-yellow samples on a central key, a five-peck response requirement to either sample, a constant 1.5-s delay, and the presentation of comparison stimuli composed of red on the left key and green on the right key or vice versa. Green-key responses were…

The Effect of a Constant Time Delay Procedure on Teaching an Adult with Severe Mental Retardation a Recreation Bowling Skill

ERIC Educational Resources Information Center

Zhang, Jiabei; Cote, Bridget; Chen, Shihui; Liu, John

2004-01-01

The purpose of this study was to examine the effect of a constant time delay (CTD) procedure on teaching a recreational bowling skill to a 39-year-old male with severe mental retardation. The CTD procedure used 5 seconds as delay interval, task direction as target stimulus, physical assistance as controlling prompt, and oral praise as reinforcer.…

Both trace and delay conditioned eyeblink responding can be dissociated from outcome expectancy.

PubMed

Weidemann, Gabrielle; Broderick, Joshua; Lovibond, Peter F; Mitchell, Christopher J

2012-01-01

Squire and colleagues have proposed that trace and delay eyeblink conditioning are fundamentally different kinds of learning: trace conditioning requires acquisition of a conscious declarative memory for the stimulus contingencies whereas delay conditioning does not. Declarative memory in trace conditioning is thought to generate conditioned responding through the activation of a conscious expectancy for when the unconditioned stimulus (US) is going to occur. Perruchet (1985) has previously shown that in a 50% partial reinforcement design it is possible to dissociate single cue delay eyeblink conditioning from conscious expectancy for the US by examining performance over runs of reinforced and nonreinforced trials. Clark, Manns, and Squire (2001) claim that this dissociation does not occur in trace eyeblink conditioning. In the present experiment we examined the Perruchet effect for short, moderate, and long trace intervals (600, 1000, and 1400 ms) and for the equivalent interstimulus intervals (ISIs) in a delay conditioning procedure. We found evidence for a dissociation of eyeblink CRs and US expectancy over runs regardless of whether there was a delay or a trace arrangement of cues. The reasons for the Perruchet effect are still unclear, but the present data suggest that it does not depend on a separate nondeclarative system of the type proposed by Squire and colleagues. (c) 2012 APA, all rights reserved.

Individual Differences in Discount Rate Are Associated With Demand for Self-Administered Cocaine, But Not Sucrose

PubMed Central

Koffarnus, Mikhail N.; Woods, James H.

2011-01-01

Substance abusers, including cocaine abusers, discount delayed rewards to a greater extent than do matched controls. In the current experiment, individual differences in discounting of delayed rewards in rats (choice of one immediate over three delayed sucrose pellets) were assessed for associations with demand for either sucrose pellets or an i.v. dose of 0.1 mg/kg/infusion cocaine. Twenty-four male Sprague Dawley rats were split into three groups based on sensitivity to delay to reinforcement. Then, demand for sucrose pellets and cocaine was determined across a range of fixed-ratio (FR) values. Delay discounting was then reassessed to determine the stability of this measure over the course of the experiment. Individual differences in impulsive choice were positively associated with elasticity of demand for cocaine, a measure of reinforcer value, indicating that rats having higher discount rates also valued cocaine more. Impulsive choice was not associated with level of cocaine consumption as price approached 0, or any parameter associated with demand for sucrose. Individual sensitivity to delay was correlated with the initial assessment when reassessed at the end of the experiment, although impulsive choice increased for this cohort of rats as a whole. These findings suggest that impulsive choice in rats is positively associated with valuation of cocaine, but not sucrose. PMID:21812874

Left-Turn Bays

DOT National Transportation Integrated Search

1996-05-01

The topic of left-turn bays (left-turn lanes) involves the following three issues: 1.) Warrants; 2.) Bay Length and 3.) Design Details. This discussion paper deals with warrants and bay length -- including queue storage at signalized and unsignalized...

A Decision Model for Steady-State Choice in Concurrent Chains

ERIC Educational Resources Information Center

Christensen, Darren R.; Grace, Randolph C.

2010-01-01

Grace and McLean (2006) proposed a decision model for acquisition of choice in concurrent chains which assumes that after reinforcement in a terminal link, subjects make a discrimination whether the preceding reinforcer delay was short or long relative to a criterion. Their model was subsequently extended by Christensen and Grace (2008, 2009a,…

Effects of lesions of the nucleus accumbens core on choice between small certain rewards and large uncertain rewards in rats

PubMed Central

Cardinal, Rudolf N; Howes, Nathan J

2005-01-01

Background Animals must frequently make choices between alternative courses of action, seeking to maximize the benefit obtained. They must therefore evaluate the magnitude and the likelihood of the available outcomes. Little is known of the neural basis of this process, or what might predispose individuals to be overly conservative or to take risks excessively (avoiding or preferring uncertainty, respectively). The nucleus accumbens core (AcbC) is known to contribute to rats' ability to choose large, delayed rewards over small, immediate rewards; AcbC lesions cause impulsive choice and an impairment in learning with delayed reinforcement. However, it is not known how the AcbC contributes to choice involving probabilistic reinforcement, such as between a large, uncertain reward and a small, certain reward. We examined the effects of excitotoxic lesions of the AcbC on probabilistic choice in rats. Results Rats chose between a single food pellet delivered with certainty (p = 1) and four food pellets delivered with varying degrees of uncertainty (p = 1, 0.5, 0.25, 0.125, and 0.0625) in a discrete-trial task, with the large-reinforcer probability decreasing or increasing across the session. Subjects were trained on this task and then received excitotoxic or sham lesions of the AcbC before being retested. After a transient period during which AcbC-lesioned rats exhibited relative indifference between the two alternatives compared to controls, AcbC-lesioned rats came to exhibit risk-averse choice, choosing the large reinforcer less often than controls when it was uncertain, to the extent that they obtained less food as a result. Rats behaved as if indifferent between a single certain pellet and four pellets at p = 0.32 (sham-operated) or at p = 0.70 (AcbC-lesioned) by the end of testing. When the probabilities did not vary across the session, AcbC-lesioned rats and controls strongly preferred the large reinforcer when it was certain, and strongly preferred the small reinforcer when the large reinforcer was very unlikely (p = 0.0625), with no differences between AcbC-lesioned and sham-operated groups. Conclusion These results support the view that the AcbC contributes to action selection by promoting the choice of uncertain, as well as delayed, reinforcement. PMID:15921529

Intersection collision warning system

DOT National Transportation Integrated Search

1999-04-01

Safety at unsignalized intersections is a major concern. Intersection collisions are one of the most common types of crash, and in the United States, they account for nearly 2 million accidents and 6,700 fatalities every year. However, a fully signal...

Driver eye-scanning behavior at intersections at night.

DOT National Transportation Integrated Search

2009-10-01

This research project analyzed drivers eye scanning behavior at night when approaching signalized : and unsignalized intersections using the data from a head-mounted eye-tracking system during open road : driving on a prescribed route. During the ...

Left-turn lanes at unsignalized median openings.

DOT National Transportation Integrated Search

2014-03-01

Due to the frequent presence of median openings in urban arterial settings, the requirements for the deceleration and : storage of turning vehicles (e.g. AASHTO Green Book) often exceed the available length between two adjacent : openings which leave...

The effects of mobile phone use on pedestrian crossing behaviour at signalized and unsignalized intersections.

PubMed

Hatfield, Julie; Murphy, Susanne

2007-01-01

Research amongst drivers suggests that pedestrians using mobile telephones may behave riskily while crossing the road, and casual observation suggests concerning levels of pedestrian mobile-use. An observational field survey of 270 females and 276 males was conducted to compare the safety of crossing behaviours for pedestrians using, versus not using, a mobile phone. Amongst females, pedestrians who crossed while talking on a mobile phone crossed more slowly, and were less likely to look at traffic before starting to cross, to wait for traffic to stop, or to look at traffic while crossing, compared to matched controls. For males, pedestrians who crossed while talking on a mobile phone crossed more slowly at unsignalized crossings. These effects suggest that talking on a mobile phone is associated with cognitive distraction that may undermine pedestrian safety. Messages explicitly suggesting techniques for avoiding mobile-use while road crossing may benefit pedestrian safety.

Experimental investigation of reinforced bonded joints for composite laminates.

PubMed

Bisagni, Chiara; Furfari, Domenico; Pacchione, Marco

2018-02-01

An experimental study has been carried out to investigate the behaviour of co-bonded carbon fibre reinforced plastics joints with a novel design incorporating a through the thickness local reinforcement. Different specimens were manufactured to investigate static and fatigue behaviour, as well as delamination size after impact and damage tolerance characteristics. The mechanical performances of the specimens with local reinforcement, consisting of the insertion of spiked thin metal sheets between co-bonded laminates, were compared with those ones obtained from specimens with purely co-bonded joints. This novel design demonstrated by tests that damage progression under cycling load results significantly delayed by the reinforcements. A significant number of experimental results were obtained that can be used to define preliminary design guidelines.

Experimental investigation of reinforced bonded joints for composite laminates

PubMed Central

Bisagni, Chiara; Furfari, Domenico; Pacchione, Marco

2017-01-01

An experimental study has been carried out to investigate the behaviour of co-bonded carbon fibre reinforced plastics joints with a novel design incorporating a through the thickness local reinforcement. Different specimens were manufactured to investigate static and fatigue behaviour, as well as delamination size after impact and damage tolerance characteristics. The mechanical performances of the specimens with local reinforcement, consisting of the insertion of spiked thin metal sheets between co-bonded laminates, were compared with those ones obtained from specimens with purely co-bonded joints. This novel design demonstrated by tests that damage progression under cycling load results significantly delayed by the reinforcements. A significant number of experimental results were obtained that can be used to define preliminary design guidelines. PMID:29568127

Signal-Detection Analyses of Conditional Discrimination and Delayed Matching-to-Sample Performance

ERIC Educational Resources Information Center

Alsop, Brent

2004-01-01

Quantitative analyses of stimulus control and reinforcer control in conditional discriminations and delayed matching-to-sample procedures often encounter a problem; it is not clear how to analyze data when subjects have not made errors. The present article examines two common methods for overcoming this problem. Monte Carlo simulations of…

Do Adjusting-Amount and Adjusting-Delay Procedures Produce Equivalent Estimates of Subjective Value in Pigeons?

ERIC Educational Resources Information Center

Green, Leonard; Myerson, Joel; Shah, Anuj K.; Estle, Sara J.; Holt, Daniel D.

2007-01-01

The current experiment examined whether adjusting-amount and adjusting-delay procedures provide equivalent measures of discounting. Pigeons' discounting on the two procedures was compared using a within-subject yoking technique in which the indifference point (number of pellets or time until reinforcement) obtained with one procedure determined…

Temporal discounting and heart rate reactivity to stress.

PubMed

Diller, James W; Patros, Connor H G; Prentice, Paula R

2011-07-01

Temporal discounting is the reduction of the value of a reinforcer as a function of increasing delay to its presentation. Impulsive individuals discount delayed consequences more rapidly than self-controlled individuals, and impulsivity has been related to substance abuse, gambling, and other problem behaviors. A growing body of literature has identified biological correlates of impulsivity, though little research to date has examined relations between delay discounting and markers of poor health (e.g., cardiovascular reactivity to stress). We evaluated the relation between one aspect of impulsivity, measured using a computerized temporal discounting task, and heart rate reactivity, measured as a change in heart rate from rest during a serial subtraction task. A linear regression showed that individuals who were more reactive to stress responded more impulsively (i.e., discounted delayed reinforcers more rapidly). When results were stratified by gender, the effect was observed for females, but not for males. This finding supports previous research on gender differences in cardiovascular reactivity and suggests that this type of reactivity may be an important correlate of impulsive behavior. Copyright © 2011 Elsevier B.V. All rights reserved.

Sound System Engineering & Optimization: The effects of multiple arrivals on the intelligibility of reinforced speech

NASA Astrophysics Data System (ADS)

Ryan, Timothy James

The effects of multiple arrivals on the intelligibility of speech produced by live-sound reinforcement systems are examined. The intent is to determine if correlations exist between the manipulation of sound system optimization parameters and the subjective attribute speech intelligibility. Given the number, and wide range, of variables involved, this exploratory research project attempts to narrow the focus of further studies. Investigated variables are delay time between signals arriving from multiple elements of a loudspeaker array, array type and geometry and the two-way interactions of speech-to-noise ratio and array geometry with delay time. Intelligibility scores were obtained through subjective evaluation of binaural recordings, reproduced via headphone, using the Modified Rhyme Test. These word-score results are compared with objective measurements of Speech Transmission Index (STI). Results indicate that both variables, delay time and array geometry, have significant effects on intelligibility. Additionally, it is seen that all three of the possible two-way interactions have significant effects. Results further reveal that the STI measurement method overestimates the decrease in intelligibility due to short delay times between multiple arrivals.

Higher-order aberrations and best-corrected visual acuity in Native American children with a high prevalence of astigmatism

PubMed Central

Miller, Joseph M.; Harvey, Erin M.; Schwiegerling, Jim

2016-01-01

Purpose To determine whether higher-order aberrations (HOAs) in children from a highly astigmatic population differ from population norms and whether HOAs are associated with astigmatism and reduced best-corrected visual acuity. Methods Subjects were 218 Tohono O’odham Native American children 5–9 years of age. Noncycloplegic HOA measurements were obtained with a handheld Shack-Hartmann sensor (SHS). Signed (z06s to z14s) and unsigned (z06u to z14u) wavefront aberration Zernike coefficients Z(3,−3) to Z(4,4) were rescaled for a 4 mm diameter pupil and compared to adult population norms. Cycloplegic refraction and best-corrected logMAR letter visual acuity (BCVA) were also measured. Regression analyses assessed the contribution of astigmatism (J0) and HOAs to BCVA. Results The mean root-mean-square (RMS) HOA of 0.191 ± 0.072 μm was significantly greater than population norms (0.100 ± 0.044 μm. All unsigned HOA coefficients (z06u to z14u) and all signed coefficients except z09s, z10s, and z11s were significantly larger than population norms. Decreased BCVA was associated with astigmatism (J0) and spherical aberration (z12u) but not RMS coma, with the effect of J0 about 4 times as great as z12u. Conclusions Tohono O’odham children show elevated HOAs compared to population norms. Astigmatism and unsigned spherical aberration are associated with decreased acuity, but the effects of spherical aberration are minimal and not clinically significant. PMID:26239206

The role of 'jackpot' stimuli in maladaptive decision-making: dissociable effects of D1/D2 receptor agonists and antagonists.

PubMed

Smith, Aaron P; Hofford, Rebecca S; Zentall, Thomas R; Beckmann, Joshua S

2018-05-01

Laboratory experiments often model risk through a choice between a large, uncertain (LU) reward against a small, certain (SC) reward as an index of an individual's risk tolerance. An important factor generally lacking from these procedures are reward-associated cues that may modulate risk preferences. We tested whether the addition of cues signaling 'jackpot' wins to LU choices would modulate risk preferences and if these cue effects were mediated by dopaminergic signaling. Three groups of rats chose between LU and SC rewards for which the LU probability of reward decreased across blocks. The unsignaled group received a non-informative stimulus of trial outcome. The signaled group received a jackpot signal prior to reward delivery and blackout on losses. The signaled-light group received a similar jackpot for wins, but a salient loss signal distinct from the win signal. Presenting win signals decreased the discounting of LU value for both signaled groups regardless of loss signal, while the unsignaled group showed discounting similar to previous research without cues. Pharmacological challenges with D1/D2 agonists and antagonists revealed that D1 antagonism increased and decreased sensitives to the relative probability of reward for unsignaled and signaled groups, respectively, while D2 agonists decreased sensitivities to the relative magnitude of reward. The results highlight how signals predictive of wins can promote maladaptive risk taking in individuals, while loss signals have reduced effect. Additionally, the presence of reward-predictive cues may change the underlying neurobehavioral mechanisms mediating decision-making under risk.

The Effects of a Local Negative Feedback Function between Choice and Relative Reinforcer Rate

ERIC Educational Resources Information Center

Davison, Michael; Elliffe, Douglas; Marr, M. Jackson

2010-01-01

Four pigeons were trained on two-key concurrent variable-interval schedules with no changeover delay. In Phase 1, relative reinforcers on the two alternatives were varied over five conditions from 0.1 to 0.9. In Phases 2 and 3, we instituted a molar feedback function between relative choice in an interreinforcer interval and the probability of…

Influence of temporal context on value in the multiple-chains and successive-encounters procedures.

PubMed

O'Daly, Matthew; Angulo, Samuel; Gipson, Cassandra; Fantino, Edmund

2006-05-01

This set of studies explored the influence of temporal context across multiple-chain and multiple-successive-encounters procedures. Following training with different temporal contexts, the value of stimuli sharing similar reinforcement schedules was assessed by presenting these stimuli in concurrent probes. The results for the multiple-chain schedule indicate that temporal context does impact the value of a conditioned reinforcer consistent with delay-reduction theory, such that a stimulus signaling a greater reduction in delay until reinforcement has greater value. Further, nonreinforced stimuli that are concurrently presented with the preferred terminal link also have greater value, consistent with value transfer. The effects of context on value for conditions with the multiple-successive-encounters procedure, however, appear to depend on whether the search schedule or alternate handling schedule was manipulated, as well as on whether the tested stimuli were the rich or lean schedules in their components. Overall, the results help delineate the conditions under which temporal context affects conditioned-reinforcement value (acting as a learning variable) and the conditions under which it does not (acting as a performance variable), an issue of relevance to theories of choice.

Pramipexole-induced disruption of behavioral processes fundamental to intertemporal choice.

PubMed

Johnson, Patrick S; Stein, Jeffrey S; Smits, Rochelle R; Madden, Gregory J

2013-05-01

Evaluating the effects of presession drug administration on intertemporal choice in nonhumans is a useful approach for identifying compounds that promote impulsive behavior in clinical populations, such as those prescribed the dopamine agonist pramipexole (PPX). Based on the results of previous studies, it is unclear whether PPX increases rats' impulsive choice or attenuates aspects of stimulus control. The present study was designed to experimentally isolate behavioral processes fundamental to intertemporal choice and challenge them pharmacologically with PPX administration. In Experiment 1, the hypothesis that PPX increases impulsive choice as a result of enhanced sensitivity to reinforcer delays was tested and disconfirmed. That is, acute PPX diminished delay sensitivity in a manner consistent with disruption of stimulus control whereas repeated PPX had no effect on delay sensitivity. Experiments 2 and 3 elaborated upon this finding by examining the effects of repeated PPX on rats' discrimination of response-reinforcer contingencies and reinforcer amounts, respectively. Accuracy of both discriminations was reduced by PPX. Collectively these results provide no support for past studies that have suggested PPX increases impulsive choice. Instead, PPX impairs stimulus control over choice behavior. The behavioral approach adopted herein could be profitably integrated with genetic and other biobehavioral models to advance our understanding of impulsive behavior associated with drug administration. © Society for the Experimental Analysis of Behavior.

An Alternative to the Stay/Switch Equation Assessed When Using a Changeover-Delay

PubMed Central

MacDonall, James S.

2015-01-01

An alternative to the generalized matching equation for understanding concurrent performances is the stay/switch model. For the stay/switch model, the important events are the contingencies and behaviors at each alternative. The current experiment compares the descriptions by two stay/switch equations, the original, empirically derived stay/switch equation and a more theoretically derived equation based on ratios of stay to switch responses matching ratios of stay to switch reinforcers. The present experiment compared descriptions by the original stay/switch equation when using and not using a changeover delay. It also compared descriptions by the more theoretical equation with and without a changeover delay. Finally, it compared descriptions of the concurrent performances by these two equations. Rats were trained in 15 conditions on identical concurrent random-interval schedules in each component of a multiple schedule. A COD operated in only one component. There were no consistent differences in the variance accounted for by each equation of concurrent performances whether or not a COD was used. The simpler equation found greater sensitivity to stay than to switch reinforcers. It also found a COD eliminated the influence of switch reinforcers. Because estimates of parameters were more meaningful when using the more theoretical stay/switch equation it is preferred. PMID:26299548

An alternative to the stay/switch equation assessed when using a changeover-delay.

PubMed

MacDonall, James S

2015-11-01

An alternative to the generalized matching equation for understanding concurrent performances is the stay/switch model. For the stay/switch model, the important events are the contingencies and behaviors at each alternative. The current experiment compares the descriptions by two stay/switch equations, the original, empirically derived stay/switch equation and a more theoretically derived equation based on ratios of stay to switch responses matching ratios of stay to switch reinforcers. The present experiment compared descriptions by the original stay/switch equation when using and not using a changeover delay. It also compared descriptions by the more theoretical equation with and without a changeover delay. Finally, it compared descriptions of the concurrent performances by these two equations. Rats were trained in 15 conditions on identical concurrent random-interval schedules in each component of a multiple schedule. A COD operated in only one component. There were no consistent differences in the variance accounted for by each equation of concurrent performances whether or not a COD was used. The simpler equation found greater sensitivity to stay than to switch reinforcers. It also found a COD eliminated the influence of switch reinforcers. Because estimates of parameters were more meaningful when using the more theoretical stay/switch equation it is preferred. Copyright © 2015 Elsevier B.V. All rights reserved.

Traffic operational evaluation of traffic impact analysis (TIA) case sites.

DOT National Transportation Integrated Search

2010-09-22

This report summarizes traffic operational evaluation of six select traffic impact analysis (TIA) case sites and the effectiveness of forecasting methods used in TIA studies. Six TIA case sites comprising 15 signalized intersections and 2 unsignalize...

Empirically-based performance assessment & simulation of pedestrian behavior at unsignalized crossings.

DOT National Transportation Integrated Search

2014-09-01

The objective of this research was to provide an improved understanding of pedestrian-vehicle interaction : at mid-block pedestrian crossings and develop methods that can be used in traffic operational analysis and : microsimulation packages. Models ...

DNS Rebinding Attacks

DTIC Science & Technology

2009-09-01

active scripting, file downloads, installation of desktop items, signed and unsigned ActiveX controls, Java permissions, launching applications and...files in an IFRAME, running ActiveX controls and plug-ins, and scripting of Java applets [49]. This security measure is very effective against DNS

Delay discounting moderates the effect of food reinforcement on energy intake among non-obese women☆

PubMed Central

Rollins, Brandi Y.; Dearing, Kelly K.; Epstein, Leonard H.

2011-01-01

Recent theoretical approaches to food intake hypothesize that eating represents a balance between reward-driven motivation to eat versus inhibitory executive function processes, however this hypothesis remains to be tested. The objective of the current study was to test the hypothesis that the motivation to eat, operationalized by the relative reinforcing value (RRV) of food, and inhibitory processes, assessed by delay discounting (DD), interact to influence energy intake in an ad libitum eating task. Female subjects (n = 24) completed a DD of money procedure, RRV task, and an ad libitum eating task in counterbalanced sessions. RRV of food predicted total energy intake, however the effect of the RRV of food on energy intake was moderated by DD. Women higher in DD and RRV of food consumed greater total energy, whereas women higher in RRV of food but lower in DD consumed less total energy. Our findings support the hypothesis that reinforcing value and executive function mediated processes interactively influence food consumption. PMID:20678532

Amphetamine increases schedule-induced drinking reduced by negative punishment procedures.

PubMed

Pérez-Padilla, Angeles; Pellón, Ricardo

2003-05-01

d-Amphetamine has been reported to increase schedule-induced drinking punished by lick-dependent signalled delays in food delivery. This might reflect a drug-behaviour interaction dependent on the type of punisher, because no such effect has been found when drinking was reduced by lick-contingent electric shocks. However, the anti-punishment effect of amphetamine could be mediated by other behavioural processes, such as a loss of discriminative control or an increase in the value of delayed reinforcers. To test the effects of d-amphetamine on the acquisition and maintenance of schedule-induced drinking reduced by unsignalled delays in food delivery. Rats received 10-s unsignalled delays initiated by each lick after polydipsia was induced by a fixed-time 30-s food reinforcement schedule or from the outset of the experiment. Yoked-control rats received these same delays but independently of their own behaviour. d-Amphetamine (0.1-3.0 mg/kg) was then tested IP. d-Amphetamine dose-dependently increased and then decreased punished schedule-induced drinking. The drug led to dose-dependent reductions when the delays were not contingent or when they were applied from the outset of training. These results support the contention that d-amphetamine has an increasing effect on schedule-induced drinking that has been previously reduced by a negative punishment procedure. This effect cannot be attributed to other potentially involved processes, and therefore support the idea that drug effects on punished behaviour depend on punishment being delays in food or shock deliveries.

Individual differences in discount rate are associated with demand for self-administered cocaine, but not sucrose.

PubMed

Koffarnus, Mikhail N; Woods, James H

2013-01-01

Substance abusers, including cocaine abusers, discount delayed rewards to a greater extent than do matched controls. In the current experiment, individual differences in discounting of delayed rewards in rats (choice of one immediate over three delayed sucrose pellets) were assessed for associations with demand for either sucrose pellets or an intravenous dose of 0.1 mg/kg/infusion cocaine. Twenty-four male Sprague Dawley rats were split into three groups based on sensitivity to delay to reinforcement. Then, demand for sucrose pellets and cocaine was determined across a range of fixed-ratio values. Delay discounting was then reassessed to determine the stability of this measure over the course of the experiment. Individual differences in impulsive choice were positively associated with elasticity of demand for cocaine, a measure of reinforcer value, indicating that rats having higher discount rates also valued cocaine more. Impulsive choice was not associated with the level of cocaine consumption as price approached 0 or with any parameter associated with demand for sucrose. Individual sensitivity to delay was correlated with the initial assessment when reassessed at the end of the experiment, although impulsive choice increased for this cohort of rats as a whole. These findings suggest that impulsive choice in rats is positively associated with valuation of cocaine, but not sucrose. © 2011 The Authors, Addiction Biology © 2011 Society for the Study of Addiction.

Discriminative stimuli that follow a delay have added value for pigeons.

PubMed

DiGian, Kelly A; Friedrich, Andrea M; Zentall, Thomas R

2004-10-01

Clement, Feltus, Kaiser, and Zentall (2000) reported that pigeons prefer discriminative stimuli that require greater effort (more pecks) to obtain over those that require less effort. In the present experiment, we examined two variables associated with this phenomenon. First, we asked whether delay of reinforcement, presumably a relatively aversive event similar to effort, would produce similar effects. Second, we asked whether the stimulus preference produced by a prior relatively aversive event depends on its anticipation. Anticipation of delay was accomplished by signaling its occurrence. Results indicated that delays can produce preferences similar to those produced by increased effort, but only if the delays are signaled.

Roadway lighting and safety : phase II--monitoring quality, durability and efficiency.

DOT National Transportation Integrated Search

2011-10-01

This Phase II project follows a previous project titled Strategies to Address Nighttime Crashes at Rural, Unsignalized Intersections. Based on the results of the previous study, the Iowa Highway Research Board (IHRB) indicated interest in pursuing fu...

Incubation of ethanol reinstatement depends on test conditions and how ethanol consumption is reduced.

PubMed

Ginsburg, Brett C; Lamb, R J

2015-04-01

In reinstatement studies (a common preclinical procedure for studying relapse), incubation occurs (longer abstinence periods result in more responding). This finding is discordant with the clinical literature. Identifying determinants of incubation could aid in interpreting reinstatement and identifying processes involved in relapse. Reinstated responding was examined in rats trained to respond for ethanol and food under a multiple concurrent schedule (Component 1: ethanol FR5, food FR150; Component 2: ethanol FR5, food FR5-alternating across the 30-min session). Ethanol consumption was then reduced for 1 or 16 sessions either by suspending training (rats remained in home cage) or by providing alternative reinforcement (only Component 2 stimuli and contingencies were presented throughout the session). In the next session, stimuli associated with Component 1 were presented and responses recorded but ethanol and food were never delivered. Two test conditions were studied: fixed-ratio completion either produced ethanol- or food-associated stimuli (signaled) or had no programmed consequence (unsignaled). Incubation of ethanol responding was observed only after suspended training during signaled test sessions. Incubation of food responding was also observed after suspended training. These results are most consistent with incubation resulting from a degradation of feedback functions limiting extinction responding, rather than from increased motivation. Copyright © 2015 Elsevier B.V. All rights reserved.

Public roads : a journal of highway research. Vol. 25, No. 10

DOT National Transportation Integrated Search

1949-10-01

In this issue of Public Roads appears the first portion of an important work on highway capacity and its practical applications. The second half of the report, dealing with intersections at grade, weaving sections and unsignalized cross movements, ra...

Multi-Site λ-dynamics for simulated Structure-Activity Relationship studies

PubMed Central

Knight, Jennifer L.; Brooks, Charles L.

2011-01-01

Multi-Site λ-dynamics (MSλD) is a new free energy simulation method that is based on λ-dynamics. It has been developed to enable multiple substituents at multiple sites on a common ligand core to be modeled simultaneously and their free energies assessed. The efficacy of MSλD for estimating relative hydration free energies and relative binding affinties is demonstrated using three test systems. Model compounds representing multiple identical benzene, dihydroxybenzene and dimethoxybenzene molecules show total combined MSλD trajectory lengths of ~1.5 ns are sufficient to reliably achieve relative hydration free energy estimates within 0.2 kcal/mol and are less sensitive to the number of trajectories that are used to generate these estimates for hybrid ligands that contain up to ten substituents modeled at a single site or five substituents modeled at each of two sites. Relative hydration free energies among six benzene derivatives calculated from MSλD simulations are in very good agreement with those from alchemical free energy simulations (with average unsigned differences of 0.23 kcal/mol and R2=0.991) and experiment (with average unsigned errors of 1.8 kcal/mol and R2=0.959). Estimates of the relative binding affinities among 14 inhibitors of HIV-1 reverse transcriptase obtained from MSλD simulations are in reasonable agreement with those from traditional free energy simulations and experiment (average unsigned errors of 0.9 kcal/mol and R2=0.402). For the same level of accuracy and precision MSλD simulations are achieved ~20–50 times faster than traditional free energy simulations and thus with reliable force field parameters can be used effectively to screen tens to hundreds of compounds in structure-based drug design applications. PMID:22125476

PRODUCTIVITY OF SOLAR FLARES AND MAGNETIC HELICITY INJECTION IN ACTIVE REGIONS

DOE Office of Scientific and Technical Information (OSTI.GOV)

Park, Sung-hong; Wang Haimin; Chae, Jongchul, E-mail: sp295@njit.ed

The main objective of this study is to better understand how magnetic helicity injection in an active region (AR) is related to the occurrence and intensity of solar flares. We therefore investigate the magnetic helicity injection rate and unsigned magnetic flux, as a reference. In total, 378 ARs are analyzed using SOHO/MDI magnetograms. The 24 hr averaged helicity injection rate and unsigned magnetic flux are compared with the flare index and the flare-productive probability in the next 24 hr following a measurement. In addition, we study the variation of helicity over a span of several days around the times ofmore » the 19 flares above M5.0 which occurred in selected strong flare-productive ARs. The major findings of this study are as follows: (1) for a sub-sample of 91 large ARs with unsigned magnetic fluxes in the range from (3-5) x 10{sup 22} Mx, there is a difference in the magnetic helicity injection rate between flaring ARs and non-flaring ARs by a factor of 2; (2) the GOES C-flare-productive probability as a function of helicity injection displays a sharp boundary between flare-productive ARs and flare-quiet ones; (3) the history of helicity injection before all the 19 major flares displayed a common characteristic: a significant helicity accumulation of (3-45) x 10{sup 42} Mx{sup 2} during a phase of monotonically increasing helicity over 0.5-2 days. Our results support the notion that helicity injection is important in flares, but it is not effective to use it alone for the purpose of flare forecast. It is necessary to find a way to better characterize the time history of helicity injection as well as its spatial distribution inside ARs.« less

Signed weighted gene co-expression network analysis of transcriptional regulation in murine embryonic stem cells

PubMed Central

Mason, Mike J; Fan, Guoping; Plath, Kathrin; Zhou, Qing; Horvath, Steve

2009-01-01

Background Recent work has revealed that a core group of transcription factors (TFs) regulates the key characteristics of embryonic stem (ES) cells: pluripotency and self-renewal. Current efforts focus on identifying genes that play important roles in maintaining pluripotency and self-renewal in ES cells and aim to understand the interactions among these genes. To that end, we investigated the use of unsigned and signed network analysis to identify pluripotency and differentiation related genes. Results We show that signed networks provide a better systems level understanding of the regulatory mechanisms of ES cells than unsigned networks, using two independent murine ES cell expression data sets. Specifically, using signed weighted gene co-expression network analysis (WGCNA), we found a pluripotency module and a differentiation module, which are not identified in unsigned networks. We confirmed the importance of these modules by incorporating genome-wide TF binding data for key ES cell regulators. Interestingly, we find that the pluripotency module is enriched with genes related to DNA damage repair and mitochondrial function in addition to transcriptional regulation. Using a connectivity measure of module membership, we not only identify known regulators of ES cells but also show that Mrpl15, Msh6, Nrf1, Nup133, Ppif, Rbpj, Sh3gl2, and Zfp39, among other genes, have important roles in maintaining ES cell pluripotency and self-renewal. We also report highly significant relationships between module membership and epigenetic modifications (histone modifications and promoter CpG methylation status), which are known to play a role in controlling gene expression during ES cell self-renewal and differentiation. Conclusion Our systems biologic re-analysis of gene expression, transcription factor binding, epigenetic and gene ontology data provides a novel integrative view of ES cell biology. PMID:19619308

Productivity of Solar Flares and Magnetic Helicity Injection in Active Regions

NASA Astrophysics Data System (ADS)

Park, Sung-hong; Chae, Jongchul; Wang, Haimin

2010-07-01

The main objective of this study is to better understand how magnetic helicity injection in an active region (AR) is related to the occurrence and intensity of solar flares. We therefore investigate the magnetic helicity injection rate and unsigned magnetic flux, as a reference. In total, 378 ARs are analyzed using SOHO/MDI magnetograms. The 24 hr averaged helicity injection rate and unsigned magnetic flux are compared with the flare index and the flare-productive probability in the next 24 hr following a measurement. In addition, we study the variation of helicity over a span of several days around the times of the 19 flares above M5.0 which occurred in selected strong flare-productive ARs. The major findings of this study are as follows: (1) for a sub-sample of 91 large ARs with unsigned magnetic fluxes in the range from (3-5) × 1022 Mx, there is a difference in the magnetic helicity injection rate between flaring ARs and non-flaring ARs by a factor of 2; (2) the GOES C-flare-productive probability as a function of helicity injection displays a sharp boundary between flare-productive ARs and flare-quiet ones; (3) the history of helicity injection before all the 19 major flares displayed a common characteristic: a significant helicity accumulation of (3-45) × 1042 Mx2 during a phase of monotonically increasing helicity over 0.5-2 days. Our results support the notion that helicity injection is important in flares, but it is not effective to use it alone for the purpose of flare forecast. It is necessary to find a way to better characterize the time history of helicity injection as well as its spatial distribution inside ARs.

Effects of High Frequency Repeated Transcranial Magnetic Stimulation and Continuous Theta Burst Stimulation on Gambling Reinforcement, Delay Discounting, and Stroop Interference in Men with Pathological Gambling.

PubMed

Zack, Martin; Cho, Sang Soo; Parlee, Jennifer; Jacobs, Mark; Li, Crystal; Boileau, Isabelle; Strafella, Antonio

Repeated transcranial magnetic stimulation (rTMS) can reduce cravings and improve cognitive function in substance dependent individuals. Whether these benefits extend to individuals with pathological gambling (PG) is unclear. High-frequency rTMS of the medial prefrontal cortex (PFC) and continuous theta burst stimulation (cTBS) of the right dorsolateral PFC can reduce impulsive choice in healthy volunteers. This study aimed to assess the effects of these two protocols on gambling reinforcement and related responses in otherwise healthy men with PG. Participants (n = 9) underwent active or sham treatments at weekly intervals in a repeated-measures, Latin square design. Subjective and physiological responses were assessed before and after a 15-min slot machine game on each session. Delay discounting and Stroop tasks measured post-game impulsive choice and attentional control. Multivariate analysis of covariance, controlling for winnings on the slot machine under each treatment, found that rTMS reduced the post-game increase in Desire to Gamble; cTBS reduced amphetamine-like effects, and decreased diastolic blood pressure. Treatment had no significant univariate effects on bet size or speed of play in the game; however, a multivariate effect for the two indices suggested that treatment decreased behavioral activation. Neither treatment reduced impulsive choice, while both treatments increased Stroop interference. rTMS and cTBS can reduce gambling reinforcement in non-comorbid men with PG. Separate processes appear to mediate gambling reinforcement and betting behavior as against delay discounting and Stroop interference. Interventions that modify risky as opposed to temporal aspects of decision making may better predict therapeutic response in PG. Copyright © 2016 Elsevier Inc. All rights reserved.

Rapid Long-Range Disynaptic Inhibition Explains the Formation of Cortical Orientation Maps

PubMed Central

Antolík, Ján

2017-01-01

Competitive interactions are believed to underlie many types of cortical processing, ranging from memory formation, attention and development of cortical functional organization (e.g., development of orientation maps in primary visual cortex). In the latter case, the competitive interactions happen along the cortical surface, with local populations of neurons reinforcing each other, while competing with those displaced more distally. This specific configuration of lateral interactions is however in stark contrast with the known properties of the anatomical substrate, i.e., excitatory connections (mediating reinforcement) having longer reach than inhibitory ones (mediating competition). No satisfactory biologically plausible resolution of this conflict between anatomical measures, and assumed cortical function has been proposed. Recently a specific pattern of delays between different types of neurons in cat cortex has been discovered, where direct mono-synaptic excitation has approximately the same delay, as the combined delays of the disynaptic inhibitory interactions between excitatory neurons (i.e., the sum of delays from excitatory to inhibitory and from inhibitory to excitatory neurons). Here we show that this specific pattern of delays represents a biologically plausible explanation for how short-range inhibition can support competitive interactions that underlie the development of orientation maps in primary visual cortex. We demonstrate this statement analytically under simplifying conditions, and subsequently show using network simulations that development of orientation maps is preserved when long-range excitation, direct inhibitory to inhibitory interactions, and moderate inequality in the delays between excitatory and inhibitory pathways is added. PMID:28408869

Pedestrian crosswalk case studies : Sacramento, California; Richmond, Virginia; Buffalo, New York; Stillwater, Minnesota

DOT National Transportation Integrated Search

2001-08-01

The objective of this research was to determine the effect of crosswalk markings on driver and pedestrian behavior at unsignalized intersections. A before/after evaluation of crosswalk markings was conducted at 11 locations in 4 U.S. cities. Behavior...

Development of left-turn lane guidelines for signalized and unsignalized intersections.

DOT National Transportation Integrated Search

2004-01-01

It is generally accepted that the level of service (LOS) at intersections significantly affects the overall LOS of the road system. It is also known that the LOS at an intersection can be adversely affected by frequently allowing left-turning vehicle...

L&D Manual Turn Lane Storage Validation/Update

DOT National Transportation Integrated Search

2012-08-01

Queuing occurs at intersections mostly due to overflow or inadequacy of turn bays. The ODOT L&D : Manual Volume 1 has storage requirements for both signalized and unsignalized intersections. Figures : 401-9E and 401-10E of the L&D Manual provide the ...

Explicitly Representing the Solvation Shell in Continuum Solvent Calculations

PubMed Central

Svendsen, Hallvard F.; Merz, Kenneth M.

2009-01-01

A method is presented to explicitly represent the first solvation shell in continuum solvation calculations. Initial solvation shell geometries were generated with classical molecular dynamics simulations. Clusters consisting of solute and 5 solvent molecules were fully relaxed in quantum mechanical calculations. The free energy of solvation of the solute was calculated from the free energy of formation of the cluster and the solvation free energy of the cluster calculated with continuum solvation models. The method has been implemented with two continuum solvation models, a Poisson-Boltzmann model and the IEF-PCM model. Calculations were carried out for a set of 60 ionic species. Implemented with the Poisson-Boltzmann model the method gave an unsigned average error of 2.1 kcal/mol and a RMSD of 2.6 kcal/mol for anions, for cations the unsigned average error was 2.8 kcal/mol and the RMSD 3.9 kcal/mol. Similar results were obtained with the IEF-PCM model. PMID:19425558

Signed-negabinary-arithmetic-based optical computing by use of a single liquid-crystal-display panel.

PubMed

Datta, Asit K; Munshi, Soumika

2002-03-10

Based on the negabinary number representation, parallel one-step arithmetic operations (that is, addition and subtraction), logical operations, and matrix-vector multiplication on data have been optically implemented, by use of a two-dimensional spatial-encoding technique. For addition and subtraction, one of the operands in decimal form is converted into the unsigned negabinary form, whereas the other decimal number is represented in the signed negabinary form. The result of operation is obtained in the mixed negabinary form and is converted back into decimal. Matrix-vector multiplication for unsigned negabinary numbers is achieved through the convolution technique. Both of the operands for logical operation are converted to their signed negabinary forms. All operations are implemented by use of a unique optical architecture. The use of a single liquid-crystal-display panel to spatially encode the input data, operational kernels, and decoding masks have simplified the architecture as well as reduced the cost and complexity.

Generalization of Clustering Coefficients to Signed Correlation Networks

PubMed Central

Costantini, Giulio; Perugini, Marco

2014-01-01

The recent interest in network analysis applications in personality psychology and psychopathology has put forward new methodological challenges. Personality and psychopathology networks are typically based on correlation matrices and therefore include both positive and negative edge signs. However, some applications of network analysis disregard negative edges, such as computing clustering coefficients. In this contribution, we illustrate the importance of the distinction between positive and negative edges in networks based on correlation matrices. The clustering coefficient is generalized to signed correlation networks: three new indices are introduced that take edge signs into account, each derived from an existing and widely used formula. The performances of the new indices are illustrated and compared with the performances of the unsigned indices, both on a signed simulated network and on a signed network based on actual personality psychology data. The results show that the new indices are more resistant to sample variations in correlation networks and therefore have higher convergence compared with the unsigned indices both in simulated networks and with real data. PMID:24586367

Psychophysics of remembering.

PubMed Central

White, K G; Wixted, J T

1999-01-01

We present a new model of remembering in the context of conditional discrimination. For procedures such as delayed matching to sample, the effect of the sample stimuli at the time of remembering is represented by a pair of Thurstonian (normal) distributions of effective stimulus values. The critical assumption of the model is that, based on prior experience, each effective stimulus value is associated with a ratio of reinforcers obtained for previous correct choices of the comparison stimuli. That ratio determines the choice that is made on the basis of the matching law. The standard deviations of the distributions are assumed to increase with increasing retention-interval duration, and the distance between their means is assumed to be a function of other factors that influence overall difficulty of the discrimination. It is a behavioral model in that choice is determined by its reinforcement history. The model predicts that the biasing effects of the reinforcer differential increase with decreasing discriminability and with increasing retention-interval duration. Data from several conditions using a delayed matching-to-sample procedure with pigeons support the predictions. PMID:10028693

Orexin signaling via the orexin 1 receptor mediates operant responding for food reinforcement.

PubMed

Sharf, Ruth; Sarhan, Maysa; Brayton, Catherine E; Guarnieri, Douglas J; Taylor, Jane R; DiLeone, Ralph J

2010-04-15

Orexin (hypocretin) signaling is implicated in drug addiction and reward, but its role in feeding and food-motivated behavior remains unclear. We investigated orexin's contribution to food-reinforced instrumental responding using an orexin 1 receptor (Ox1r) antagonist, orexin -/- (OKO) and littermate wildtype (WT) mice, and RNAi-mediated knockdown of orexin. C57BL/6J (n = 76) and OKO (n = 39) mice were trained to nose poke for food under a variable ratio schedule of reinforcement. After responding stabilized, a progressive ratio schedule was initiated to evaluate motivation to obtain food reinforcement. Blockade of Ox1r in C57BL/6J mice impaired performance under both the variable ratio and progressive ratio schedules of reinforcement, indicating impaired motivational processes. In contrast, OKO mice initially demonstrated a delay in acquisition but eventually achieved levels of responding similar to those observed in WT animals. Moreover, OKO mice did not differ from WT mice under a progressive ratio schedule, indicating delayed learning processes but no motivational impairments. Considering the differences between pharmacologic blockade of Ox1r and the OKO mice, animals with RNAi mediated knockdown of orexin were then generated and analyzed to eliminate possible developmental effects of missing orexin. Orexin gene knockdown in the lateral hypothalamus in C57BL/6J mice resulted in blunted performance under both the variable ratio and progressive ratio schedules, resembling data obtained following Ox1r antagonism. The behavior seen in OKO mice likely reflects developmental compensation often seen in mutant animals. These data suggest that activation of the Ox1r is a necessary component of food-reinforced responding, motivation, or both in normal mice. Copyright 2010 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

Orexin signaling via the orexin 1 receptor mediates operant responding for food reinforcement

PubMed Central

Sharf, Ruth; Sarhan, Maysa; Brayton, Catherine E.; Guarnieri, Douglas J.; Taylor, Jane R.; DiLeone, Ralph J.

2010-01-01

Background Orexin (hypocretin) signaling is implicated in drug addiction and reward, but its role in feeding and food-motivated behavior remains unclear. Methods We investigated orexin’s contribution to food-reinforced instrumental responding using an orexin 1 receptor (Ox1r) antagonist, orexin −/− (OKO) and littermate wild-type (WT) mice, and RNAi-mediated knockdown of orexin. C57BL/6J (n=76) and OKO (n=39) mice were trained to nose poke for food under a variable ratio (VR) schedule of reinforcement. Once responding stabilized, a progressive ratio (PR) schedule was initiated to evaluate motivation to obtain food reinforcement. Results Blockade of Ox1r in C57BL/6J mice impaired performance under both the VR and PR schedules of reinforcement, indicating impaired motivational processes. In contrast, OKO mice initially demonstrated a delay in acquisition, but eventually achieved levels of responding similar to those observed in WT animals. Moreover, OKO mice did not differ from WT mice under a PR schedule, indicating delayed learning processes but no motivational impairments. Considering the differences between pharmacological blockade of Ox1r and the OKO mice, animals with RNAi mediated knockdown of orexin were then generated and analyzed to eliminate possible developmental effects of missing orexin. Orexin gene knockdown in the lateral hypothalamus (LH) in C57BL/6J mice resulted in blunted performance under both the VR and PR schedules, resembling data obtained following Ox1r antagonism. Conclusions The behavior seen in OKO mice likely reflects developmental compensation often seen in mutant animals. These data suggest that activation of the Ox1r is a necessary component of food-reinforced responding and/or motivation in normal mice. PMID:20189166

Another look at contrast in multiple schedules

PubMed Central

Williams, Ben A.

1983-01-01

Recent research on multiple schedule interactions is reviewed. Contrary to formulations that view contrast as the result of elicited behavior controlled by the stimulus-reinforcer contingency (e.g., additivity theory), the major controlling variable is the relative rate of reinforcement, which cannot be reduced to some combination of stimulus-reinforcer and response-reinforcer effects. Other recent theoretical formulations are also reviewed and all are found to face serious counterevidence. The best description of the available data continues to be in terms of the “context of reinforcement,” but Herrnstein's (1970) formulation of the basis of such context effects appears to be inadequate. An alternative conception is provided by Catania's concept of “inhibition by reinforcement,” by which rate of responding is inversely related to the average rate of reinforcement in the situation. Such a conception is related to Gibbon's recent scalar-expectancy account of autoshaping and Fantino's delay-reduction model of conditioned reinforcement, suggesting that a common set of principles determines several diverse conditioning phenomena. However, the empirical status of such a description remains uncertain, because recent evidence shows that schedule interactions are temporally asymmetric, depending primarily upon the conditions of reinforcement that follow a schedule component. PMID:16812325

Efficient reinforcement learning of a reservoir network model of parametric working memory achieved with a cluster population winner-take-all readout mechanism.

PubMed

Cheng, Zhenbo; Deng, Zhidong; Hu, Xiaolin; Zhang, Bo; Yang, Tianming

2015-12-01

The brain often has to make decisions based on information stored in working memory, but the neural circuitry underlying working memory is not fully understood. Many theoretical efforts have been focused on modeling the persistent delay period activity in the prefrontal areas that is believed to represent working memory. Recent experiments reveal that the delay period activity in the prefrontal cortex is neither static nor homogeneous as previously assumed. Models based on reservoir networks have been proposed to model such a dynamical activity pattern. The connections between neurons within a reservoir are random and do not require explicit tuning. Information storage does not depend on the stable states of the network. However, it is not clear how the encoded information can be retrieved for decision making with a biologically realistic algorithm. We therefore built a reservoir-based neural network to model the neuronal responses of the prefrontal cortex in a somatosensory delayed discrimination task. We first illustrate that the neurons in the reservoir exhibit a heterogeneous and dynamical delay period activity observed in previous experiments. Then we show that a cluster population circuit decodes the information from the reservoir with a winner-take-all mechanism and contributes to the decision making. Finally, we show that the model achieves a good performance rapidly by shaping only the readout with reinforcement learning. Our model reproduces important features of previous behavior and neurophysiology data. We illustrate for the first time how task-specific information stored in a reservoir network can be retrieved with a biologically plausible reinforcement learning training scheme. Copyright © 2015 the American Physiological Society.

The Effects of Behavioral History on Response Acquisition with Immediate and Delayed Reinforcement

ERIC Educational Resources Information Center

Snycerski, Susan; Laraway, Sean; Huitema, Bradley E.; Poling, Alan

2004-01-01

Effects of prior exposure to the experimental chamber with levers present or absent and variable-time (VT) 60-s water deliveries arranged during one, five, or no 1-hr sessions were examined in rats during a 6-hr response-acquisition session in which presses on one lever produced water delivery immediately or after a 15-s resetting delay, and…

The Fail-Proof Student

ERIC Educational Resources Information Center

Fiamengo, Janice

2013-01-01

In this article, the author comments on an unsigned newspaper piece titled "Helping Talent Rise to the Top," printed in Canada's "Globe and Mail" about a new measure to enhance student well-being at Queen's University in Kingston, Ontario. The "Globe" piece lauds Queen's, a top-ranked Canadian undergraduate school,…

Effects of dopamine on reinforcement learning and consolidation in Parkinson's disease.

PubMed

Grogan, John P; Tsivos, Demitra; Smith, Laura; Knight, Brogan E; Bogacz, Rafal; Whone, Alan; Coulthard, Elizabeth J

2017-07-10

Emerging evidence suggests that dopamine may modulate learning and memory with important implications for understanding the neurobiology of memory and future therapeutic targeting. An influential hypothesis posits that dopamine biases reinforcement learning. More recent data also suggest an influence during both consolidation and retrieval. Eighteen Parkinson's disease patients learned through feedback ON or OFF medication, with memory tested 24 hr later ON or OFF medication (4 conditions, within-subjects design with matched healthy control group). Patients OFF medication during learning decreased in memory accuracy over the following 24 hr. In contrast to previous studies, however, dopaminergic medication during learning and testing did not affect expression of positive or negative reinforcement. Two further experiments were run without the 24 hr delay, but they too failed to reproduce effects of dopaminergic medication on reinforcement learning. While supportive of a dopaminergic role in consolidation, this study failed to replicate previous findings on reinforcement learning.

Visual reinforcement in the female Siamese fighting fish, Betta splendens.

PubMed

Elcoro, Mirari; Silva, Stephanie P; Lattal, Kennon A

2008-07-01

Operant conditioning with Betta splendens (Bettas) has been investigated extensively using males of the species. Ethological studies of female Bettas have revealed aggressive interactions that qualitatively parallel those between male Bettas. Given these similarities, four experiments were conducted with female Bettas to examine the generality of a widely reported finding with males: mirror-image reinforcement. Swimming through a ring was reinforced by a 10-s mirror presentation. As with males, ring swimming was acquired and maintained when mirror presentations were immediate (Experiments 1, 2, and 3) and delayed (Experiment 4). The failure of conventional extinction (Experiments 1 and 2) and response-independent mirror presentations (Experiment 3) to maintain responding confirmed the reinforcing properties of mirror presentation. These results extend previous findings of mirror images as reinforcers in males of the same species and illustrate a complementarity between behavioral ecology and the experimental analysis of behavior.

Variation, Repetition, And Choice

PubMed Central

Abreu-Rodrigues, Josele; Lattal, Kennon A; dos Santos, Cristiano V; Matos, Ricardo A

2005-01-01

Experiment 1 investigated the controlling properties of variability contingencies on choice between repeated and variable responding. Pigeons were exposed to concurrent-chains schedules with two alternatives. In the REPEAT alternative, reinforcers in the terminal link depended on a single sequence of four responses. In the VARY alternative, a response sequence in the terminal link was reinforced only if it differed from the n previous sequences (lag criterion). The REPEAT contingency generated low, constant levels of sequence variation whereas the VARY contingency produced levels of sequence variation that increased with the lag criterion. Preference for the REPEAT alternative tended to increase directly with the degree of variation required for reinforcement. Experiment 2 examined the potential confounding effects in Experiment 1 of immediacy of reinforcement by yoking the interreinforcer intervals in the REPEAT alternative to those in the VARY alternative. Again, preference for REPEAT was a function of the lag criterion. Choice between varying and repeating behavior is discussed with respect to obtained behavioral variability, probability of reinforcement, delay of reinforcement, and switching within a sequence. PMID:15828592

Oral drug self-administration: an overview of laboratory animal studies.

PubMed

Meisch, R A

2001-06-01

Many abused drugs can be established as orally delivered reinforcers for rhesus monkeys and other animals. Benzodiazepines, barbiturates, opioids, psychomotor stimulants, dissociative anesthetics, and ethanol can come to serve as reinforcers when taken by mouth. The principal problems in establishing drugs as reinforcers by the oral route of administration are (1) aversive taste, (2) delay in onset of central nervous system effects, and (3) consumption of low volumes of drug solution. Strategies have been devised to successfully overcome these problems, and orally delivered drugs can be established as effective reinforcers. Reinforcing actions are demonstrated by consumption of greater volumes of drug solution than volumes of the water vehicle, and supporting evidence for reinforcing effects consists of the maintenance of behavior under intermittent schedules of reinforcement and the generation of orderly dose-response functions. This article presents an overview of studies of behavior reinforced by oral drug reinforcement. Factors that control oral drug intake include dose, schedule of reinforcement, food restriction, and alternative reinforcers. Many drugs, administered by the experimenter, can alter oral drug reinforcement. Relative reinforcing effects can be assessed by choice procedures and by persistence of behavior across increases in schedule size. In general, reinforcing effects increase directly with dose. Rhesus monkeys prefer combinations of reinforcing drugs to the component drugs. The taste of drug solutions may act as a conditioned reinforcer and a discriminative stimulus. Consequences of drug intake include tolerance and physiological dependence. Findings with orally self-administered drugs are similar to many findings with other positive reinforcers, including intravenously self-administered drugs.

Evaluating the Effect of Advance Yield Markings and Symbolic Signs on Vehicle-Pedestrian Conflicts at Marked Midblock Crosswalks across Multilane Roads

DOT National Transportation Integrated Search

2016-02-01

The Commonwealth of Massachusetts has made walkable communities a priority. Pedestrian safety is key to the success of this objective. Pedestrians are at high risk when traversing unsignalized, marked crosswalks located either midblock or at T inters...

Evaluating the effect of advance yield markings and symbolic signs on vehicle-pedestrian conflicts at marked midblock crosswalks across multilane roads.

DOT National Transportation Integrated Search

2016-02-01

The Commonwealth of Massachusetts has made walkable communities a priority. Pedestrian safety is key to the success of : this objective. Pedestrians are at high risk when traversing unsignalized, marked crosswalks located either midblock or at Tinter...

On Double-Entry Bookkeeping: The Mathematical Treatment

ERIC Educational Resources Information Center

Ellerman, David

2014-01-01

Double-entry bookkeeping (DEB) implicitly uses a specific mathematical construction, the group of differences using pairs of unsigned numbers ("T-accounts"). That construction was only formulated abstractly in mathematics in the nineteenth century, even though DEB had been used in the business world for over five centuries. Yet the…

Signed vs. Unsigned Report of Depression and Self-Esteem.

ERIC Educational Resources Information Center

Nolan, R. F; And Others

1994-01-01

One hundred thirty-five adolescents were administered the Children's Depression Inventory (CDI) and the Coopersmith Self-Esteem Inventory (CSEI). On the CDI, male adolescents responded more severely on an item involving fighting with others when they could be identified. There were no significant differences among responses on CSEI items.…

Changes in the stimulus-preceding negativity and lateralized readiness potential during reinforcement learning.

PubMed

Ren, Xi; Valle-Inclán, Fernando; Tukaiev, Sergii; Hackley, Steven A

2017-07-01

According to reinforcement learning theory, dopamine-dependent anticipatory processes play a critical role in learning from action outcomes such as feedback or reward. To better understand outcome anticipation, we examined variation in slow cortical potentials and assessed their changes over the course of motor-skill acquisition. Healthy young adults learned a series of precisely timed, key press sequences. Feedback was delivered at a delay of either 2.5 or 8 s, to encourage use of either the striatally mediated, habit learning system or the hippocampus-dependent, episodic memory system, respectively. During the 2.5-s delay, the stimulus-preceding negativity (SPN) was shown to decline in amplitude across trials, confirming previous results from a perceptual categorization task (Morís, Luque, & Rodríguez-Fornells, 2013). This falsifies the hypothesis that SPN reflects specific outcome predictions, on the assumption that the ability to make such predictions should improve as a task is mastered. An SPN was also evident during the 8-s delay, but it increased in amplitude across trials. At the conclusion of the 8-s but not the 2.5-s prefeedback interval, a reversed-polarity lateralized readiness potential (LRP) was noted. It was suggested that this might indicate maintenance of an action representation for comparison with the feedback display. If so, this would constitute the first direct psychophysiological evidence for a popular hypothetical construct in quantitative models of reinforcement learning, the so-called eligibility trace. © 2017 Society for Psychophysiological Research.

Pavlovian conditioning and cumulative reinforcement rate.

PubMed

Harris, Justin A; Patterson, Angela E; Gharaei, Saba

2015-04-01

In 5 experiments using delay conditioning of magazine approach with rats, reinforcement rate was varied either by manipulating the mean interval between onset of the conditioned stimulus (CS) and unconditioned stimulus (US) or by manipulating the proportion of CS presentations that ended with the US (trial-based reinforcement rate). Both manipulations influenced the acquisition of responding. In each experiment, a specific comparison was made between 2 CSs that differed in their mean CS-US interval and in their trial-based reinforcement rate, such that the cumulative reinforcement rate-the cumulative duration of the CS between reinforcements-was the same for the 2 CSs. For example, a CS reinforced on 100% of trials with a mean CS-US interval of 60 s was compared with a CS reinforced on 33% of trials and a mean duration of 20 s. Across the 5 experiments, conditioning was virtually identical for the 2 CSs with matched cumulative reinforcement rate. This was true as long as the timing of the US was unpredictable and, thus, response rates were uniform across the length of the CS. We conclude that the effects of CS-US interval and of trial-based reinforcement rate are reducible entirely to their common effect on cumulative reinforcement rate. We discuss the implications of this for rate-based, trial-based, and real-time associative models of conditioning. (c) 2015 APA, all rights reserved).

When good pigeons make bad decisions: Choice with probabilistic delays and outcomes.

PubMed

Pisklak, Jeffrey M; McDevitt, Margaret A; Dunn, Roger M; Spetch, Marcia L

2015-11-01

Pigeons chose between an (optimal) alternative that sometimes provided food after a 10-s delay and other times after a 40-s delay and another (suboptimal) alternative that sometimes provided food after 10 s but other times no food after 40 s. When outcomes were not signaled during the delays, pigeons strongly preferred the optimal alternative. When outcomes were signaled, choices of the suboptimal alternative increased and most pigeons preferred the alternative that provided no food after the long delay despite the cost in terms of obtained food. The pattern of results was similar whether the short delays occurred on 25% or 50% of the trials. Shortening the 40-s delay to food sharply reduced suboptimal choices, but shortening the delay to no food had little effect. The results suggest that a signaled delay to no food does not punish responding in probabilistic choice procedures. The findings are discussed in terms of conditioned reinforcement by signals for good news. © Society for the Experimental Analysis of Behavior.

VERNIER CHRONOTRON UTILIZING AT LEAST TWO SHORTED DELAY LINES

DOEpatents

Rufer, R.P.

1964-02-25

An improved vernier chronotron featuring pulse-forming circuits of a ringing'' or back and forth'' oscillatory type is described. A delay line shorted at both ends together with transistor circuitry to introduce a pulse into that line and also to provide reinforcement of the pulse as it oscillates between the pulse-reflective extremities is provided. A transistorized coincidence circuit is also provided. Enhanced measurement of time intervals in the nanosecond range is afforded. (AEC)

Synchronization of Chaotic Systems without Direct Connections Using Reinforcement Learning

NASA Astrophysics Data System (ADS)

Sato, Norihisa; Adachi, Masaharu

In this paper, we propose a control method for the synchronization of chaotic systems that does not require the systems to be connected, unlike existing methods such as that proposed by Pecora and Carroll in 1990. The method is based on the reinforcement learning algorithm. We apply our method to two discrete-time chaotic systems with mismatched parameters and achieve M step delay synchronization. Moreover, we extend the proposed method to the synchronization of continuous-time chaotic systems.

[Single and Network Neuron Activity of Subthalamic Nucleus at Impulsive and Delayed (Self-Control) Reactions in Choice Behavior].

PubMed

Sidorina, V V; Gerasimova, Yu A; Kuleshova, E P; Merzhanova, G Kh

2015-01-01

During our experiments on cats was investigated the subthalamic neuron activity at different types of behavior in case of reinforcement choice depending on its value and availability. In chronic experiences the multiunit activity in subthalamic nucleus (STN) and orbitofrontal cortex (FC) has been recorded. Multiunit activity was analyzed over frequency and network properties of spikes. It was shown, that STN neurons reaction to different reinforcements and conditional stimulus at short- or long-delay reactions was represented by increasing or decreasing of frequency of single neurons. However the same STN neu- rons responded with increasing of frequency of single neuron during expectation of mix-bread-meat and decreasing--during the meat expectation. It has been revealed, that the number of STN interneuron interactions was authentic more at impulsive behavior than at self-control choice of behavior. The number of interactions between FC and STN neurons within intervals of 0-30 Ms was authentic more at display impulsive than during self-control behavior. These results suppose that FC and STN neurons participate in integration of reinforcement estimation; and distinctions in a choice of behavior are defined by the local and distributed interneuron interactions of STN and FC.

Effect Size Measures for Differential Item Functioning in a Multidimensional IRT Model

ERIC Educational Resources Information Center

Suh, Youngsuk

2016-01-01

This study adapted an effect size measure used for studying differential item functioning (DIF) in unidimensional tests and extended the measure to multidimensional tests. Two effect size measures were considered in a multidimensional item response theory model: signed weighted P-difference and unsigned weighted P-difference. The performance of…

17 CFR 270.8b-11 - Number of copies; signatures; binding.

Code of Federal Regulations, 2010 CFR

2010-04-01

... 17 Commodity and Securities Exchanges 3 2010-04-01 2010-04-01 false Number of copies; signatures... (CONTINUED) RULES AND REGULATIONS, INVESTMENT COMPANY ACT OF 1940 § 270.8b-11 Number of copies; signatures... manner prescribed by the appropriate form. Unsigned copies shall be conformed. If the signature of any...

Kids and Chemistry: Large Event Guide.

ERIC Educational Resources Information Center

Tinnesand, Michael

This guide is intended to provide Kids and Chemistry (K&C) with a variety of age-appropriate, fun, and safe demonstrations. It features information on planning a large event and includes safety guidelines. Several activities are included under each major topic. Topics include: (1) Acids and Bases; (2) Unsigned; (3) Kool Tie-Dye; (4) Secret…

20 CFR 418.1270 - What modified adjusted gross income evidence will we not accept?

Code of Federal Regulations, 2010 CFR

2010-04-01

... 20 Employees' Benefits 2 2010-04-01 2010-04-01 false What modified adjusted gross income evidence will we not accept? 418.1270 Section 418.1270 Employees' Benefits SOCIAL SECURITY ADMINISTRATION... letter from IRS acknowledging the change. We will also not accept illegible or unsigned copies of income...

A Comparison of Lord's Chi Square and Raju's Area Measures in Detection of DIF.

ERIC Educational Resources Information Center

Cohen, Allan S.; Kim, Seock-Ho

1993-01-01

The effectiveness of two statistical tests of the area between item response functions (exact signed area and exact unsigned area) estimated in different samples, a measure of differential item functioning (DIF), was compared with Lord's chi square. Lord's chi square was found the most effective in determining DIF. (SLD)

Probabilistic performance estimators for computational chemistry methods: The empirical cumulative distribution function of absolute errors

NASA Astrophysics Data System (ADS)

Pernot, Pascal; Savin, Andreas

2018-06-01

Benchmarking studies in computational chemistry use reference datasets to assess the accuracy of a method through error statistics. The commonly used error statistics, such as the mean signed and mean unsigned errors, do not inform end-users on the expected amplitude of prediction errors attached to these methods. We show that, the distributions of model errors being neither normal nor zero-centered, these error statistics cannot be used to infer prediction error probabilities. To overcome this limitation, we advocate for the use of more informative statistics, based on the empirical cumulative distribution function of unsigned errors, namely, (1) the probability for a new calculation to have an absolute error below a chosen threshold and (2) the maximal amplitude of errors one can expect with a chosen high confidence level. Those statistics are also shown to be well suited for benchmarking and ranking studies. Moreover, the standard error on all benchmarking statistics depends on the size of the reference dataset. Systematic publication of these standard errors would be very helpful to assess the statistical reliability of benchmarking conclusions.

0-6723 : development of rapid, cement-based repair materials for transportation structures.

DOT National Transportation Integrated Search

2014-08-01

The state of Texas has been plagued by various : durability-related issues in recent years, : including deterioration from alkali-silica : reaction, delayed ettringite formation, corrosion : of reinforcing steel, volume changes (plastic : shrinkage, ...

Landscaping of highway medians and roadway safety at unsignalized intersections.

PubMed

Chen, Hongyun; Fabregas, Aldo; Lin, Pei-Sung

2016-05-01

Well-planted and maintained landscaping can help reduce driving stress, provide better visual quality, and decrease over speeding, thus improving roadway safety. Florida Department of Transportation (FDOT) Standard Index (SI-546) is one of the more demanding standards in the U.S. for landscaping design criteria at highway medians near intersections. The purposes of this study were to (1) empirically evaluate the safety results of SI-546 at unsignalized intersections and (2) quantify the impacts of geometrics, traffic, and landscaping design features on total crashes and injury plus fatal crashes. The studied unsignalized intersections were divided into (1) those without median trees near intersections, (2) those with median trees near intersections that were compliant with SI-546, and (3) those with median trees near intersections that were non-compliant with SI-546. A total of 72 intersections were selected, for which five-year crash data from 2006-2010 were collected. The sites that were compliant with SI-546 showed the best safety performance in terms of the lowest crash counts and crash rates. Four crash predictive models-two for total crashes and two for injury crashes-were developed. The results indicated that improperly planted and maintained median trees near highway intersections can increase the total number of crashes and injury plus fatal crashes at a 90% confidence level; no significant difference could be found in crash rates between sites that were compliant with SI-546 and sites without trees. All other conditions remaining the same, an intersection with trees that was not compliant with SI-546 had 63% more crashes and almost doubled injury plus fatal crashes than those at intersections without trees. The study indicates that appropriate landscaping in highway medians near intersections can be an engineering technology that not only improves roadway environmental quality but also maintains intersection safety. Copyright © 2016. Published by Elsevier Ltd.

Analytic Energy Gradients for Variational Two-Electron Reduced-Density-Matrix-Driven Complete Active Space Self-Consistent Field Theory.

PubMed

Maradzike, Elvis; Gidofalvi, Gergely; Turney, Justin M; Schaefer, Henry F; DePrince, A Eugene

2017-09-12

Analytic energy gradients are presented for a variational two-electron reduced-density-matrix (2-RDM)-driven complete active space self-consistent field (CASSCF) method. The active-space 2-RDM is determined using a semidefinite programing (SDP) algorithm built upon an augmented Lagrangian formalism. Expressions for analytic gradients are simplified by the fact that the Lagrangian is stationary with respect to variations in both the primal and the dual solutions to the SDP problem. Orbital response contributions to the gradient are identical to those that arise in conventional CASSCF methods in which the electronic structure of the active space is described by a full configuration interaction (CI) wave function. We explore the relative performance of variational 2-RDM (v2RDM)- and CI-driven CASSCF for the equilibrium geometries of 20 small molecules. When enforcing two-particle N-representability conditions, full-valence v2RDM-CASSCF-optimized bond lengths display a mean unsigned error of 0.0060 Å and a maximum unsigned error of 0.0265 Å, relative to those obtained from full-valence CI-CASSCF. When enforcing partial three-particle N-representability conditions, the mean and maximum unsigned errors are reduced to only 0.0006 and 0.0054 Å, respectively. For these same molecules, full-valence v2RDM-CASSCF bond lengths computed in the cc-pVQZ basis set deviate from experimentally determined ones on average by 0.017 and 0.011 Å when enforcing two- and three-particle conditions, respectively, whereas CI-CASSCF displays an average deviation of 0.010 Å. The v2RDM-CASSCF approach with two-particle conditions is also applied to the equilibrium geometry of pentacene; optimized bond lengths deviate from those derived from experiment, on average, by 0.015 Å when using a cc-pVDZ basis set and a (22e,22o) active space.

Effects of dopamine on reinforcement learning and consolidation in Parkinson’s disease

PubMed Central

Grogan, John P; Tsivos, Demitra; Smith, Laura; Knight, Brogan E; Bogacz, Rafal; Whone, Alan; Coulthard, Elizabeth J

2017-01-01

Emerging evidence suggests that dopamine may modulate learning and memory with important implications for understanding the neurobiology of memory and future therapeutic targeting. An influential hypothesis posits that dopamine biases reinforcement learning. More recent data also suggest an influence during both consolidation and retrieval. Eighteen Parkinson’s disease patients learned through feedback ON or OFF medication, with memory tested 24 hr later ON or OFF medication (4 conditions, within-subjects design with matched healthy control group). Patients OFF medication during learning decreased in memory accuracy over the following 24 hr. In contrast to previous studies, however, dopaminergic medication during learning and testing did not affect expression of positive or negative reinforcement. Two further experiments were run without the 24 hr delay, but they too failed to reproduce effects of dopaminergic medication on reinforcement learning. While supportive of a dopaminergic role in consolidation, this study failed to replicate previous findings on reinforcement learning. DOI: http://dx.doi.org/10.7554/eLife.26801.001 PMID:28691905

Interrelationships between Marijuana Demand and Discounting of Delayed Rewards: Convergence in Behavioral Economic Methods

PubMed Central

Aston, Elizabeth R.; Metrik, Jane; Amlung, Michael; Kahler, Christopher W.; MacKillop, James

2016-01-01

Background Distinct behavioral economic domains, including high perceived drug value (demand) and delay discounting (DD), have been implicated in the initiation of drug use and the progression to dependence. However, it is unclear whether frequent marijuana users conform to a “reinforcer pathology” addiction model wherein marijuana demand and DD jointly increase risk for problematic marijuana use and cannabis dependence (CD). Methods Participants (n=88, 34% female, 14% cannabis dependent) completed a marijuana purchase task at baseline. A delay discounting task was completed following placebo marijuana cigarette (0% THC) administration during a separate experimental session. Results Marijuana demand and DD were quantified using area under the curve (AUC). In multiple regression models, demand uniquely predicted frequency of marijuana use while DD did not. In contrast, DD uniquely predicted CD symptom count while demand did not. There were no significant interactions between demand and DD in either model. Conclusions These findings suggest that frequent marijuana users exhibit key constituents of the reinforcer pathology model: high marijuana demand and steep discounting of delayed rewards. However, demand and DD appear to be independent rather than synergistic risk factors for elevated marijuana use and risk for progression to CD. Findings also provide support for using AUC as a singular marijuana demand metric, particularly when also examining other behavioral economic constructs that apply similar statistical approaches, such as DD, to support analytic methodological convergence. PMID:27810657

Adolescent nicotine exposure disrupts context conditioning in adulthood in rats.

PubMed

Spaeth, Andrea M; Barnet, Robert C; Hunt, Pamela S; Burk, Joshua A

2010-10-01

Despite the prevalence of smoking among adolescents, few studies have assessed the effects of adolescent nicotine exposure on learning in adulthood. In particular, it remains unclear whether adolescent nicotine exposure has effects on hippocampus-dependent learning that persist into adulthood. The present experiment examined whether there were effects of adolescent nicotine exposure on context conditioning, a form of learning dependent on the integrity of the hippocampus, when tested during adulthood. Rats were exposed to nicotine during adolescence (postnatal days [PD] 28-42) via osmotic minipump (0, 3.0 or 6.0mg/kg/day). Context conditioning occurred in early adulthood (PD 65-70). Animals were exposed to an experimental context and were given 10 unsignaled footshocks or no shock. Additional groups were included to test the effects of adolescent nicotine on delay conditioning, a form of learning that is not dependent upon the hippocampus. Conditioning was assessed using a lick suppression paradigm. For animals in the context conditioning groups, adolescent nicotine resulted in significantly less suppression of drinking in the presence of context cues compared with vehicle-pretreated animals. For animals in the delay conditioning groups, there was a trend for adolescent nicotine (3.0mg/kg/day) to suppress drinking compared to vehicle-pretreated animals. There were no differences in extinction of contextual fear or cued fear between rats previously exposed to vehicle or nicotine. The data indicate that adolescent nicotine administration impairs context conditioning when animals are trained and tested as adults. The present data suggest that adolescent nicotine exposure may disrupt hippocampus-dependent learning when animals are tested during adulthood. (c) 2010 Elsevier Inc. All rights reserved.

Stimulus Effects on Local Preference: Stimulus-Response Contingencies, Stimulus-Food Pairing, and Stimulus-Food Correlation

ERIC Educational Resources Information Center

Davison, Michael; Baum, William M.

2010-01-01

Four pigeons were trained in a procedure in which concurrent-schedule food ratios changed unpredictably across seven unsignaled components after 10 food deliveries. Additional green-key stimulus presentations also occurred on the two alternatives, sometimes in the same ratio as the component food ratio, and sometimes in the inverse ratio. In eight…

Relapse of Extinguished Fear after Exposure to a Dangerous Context Is Mitigated by Testing in a Safe Context

ERIC Educational Resources Information Center

Goode, Travis D.; Kim, Janice J.; Maren, Stephen

2015-01-01

Aversive events can trigger relapse of extinguished fear memories, presenting a major challenge to the long-term efficacy of therapeutic interventions. Here, we examined factors regulating the relapse of extinguished fear after exposure of rats to a dangerous context. Rats received unsignaled shock in a distinct context ("dangerous"…

Relative contributions of three descriptive methods: implications for behavioral assessment.

PubMed

Pence, Sacha T; Roscoe, Eileen M; Bourret, Jason C; Ahearn, William H

2009-01-01

This study compared the outcomes of three descriptive analysis methods-the ABC method, the conditional probability method, and the conditional and background probability method-to each other and to the results obtained from functional analyses. Six individuals who had been diagnosed with developmental delays and exhibited problem behavior participated. Functional analyses indicated that participants' problem behavior was maintained by social positive reinforcement (n = 2), social negative reinforcement (n = 2), or automatic reinforcement (n = 2). Results showed that for all but 1 participant, descriptive analysis outcomes were similar across methods. In addition, for all but 1 participant, the descriptive analysis outcome differed substantially from the functional analysis outcome. This supports the general finding that descriptive analysis is a poor means of determining functional relations.

An Investigation of Extinction-Induced Vocalizations

ERIC Educational Resources Information Center

Valentino, Amber L.; Shillingsburg, M. Alice; Call, Nathan A.; Burton, Britney; Bowen, Crystal N.

2011-01-01

Children with autism have significant communication delays. Although some children develop vocalizations through shaping and differential reinforcement, others rarely exhibit vocalizations, and alternative methods are targeted in intervention. However, vocal language often remains a goal for caregivers and clinicians. Thus, strategies to increase…

ASR/DEF-damaged bent caps : shear tests and field implications.

DOT National Transportation Integrated Search

2009-08-01

Over the last decade, a number of reinforced concrete bent caps within Houston, Texas have exhibited premature concrete damage (cracking, spalling and a loss of material : strength) due to alkali-silica reaction (ASR) and/or delayed ettringite format...

A Machine Learning Concept for DTN Routing

NASA Technical Reports Server (NTRS)

Dudukovich, Rachel; Hylton, Alan; Papachristou, Christos

2017-01-01

This paper discusses the concept and architecture of a machine learning based router for delay tolerant space networks. The techniques of reinforcement learning and Bayesian learning are used to supplement the routing decisions of the popular Contact Graph Routing algorithm. An introduction to the concepts of Contact Graph Routing, Q-routing and Naive Bayes classification are given. The development of an architecture for a cross-layer feedback framework for DTN (Delay-Tolerant Networking) protocols is discussed. Finally, initial simulation setup and results are given.

Behavioral Economic Predictors of Overweight Children’s Weight Loss

PubMed Central

Best, John R.; Theim, Kelly R.; Gredysa, Dana M.; Stein, Richard I.; Welch, R. Robinson; Saelens, Brian E.; Perri, Michael G.; Schechtman, Kenneth B.; Epstein, Leonard H.; Wilfley, Denise E.

2012-01-01

Objective Our goal was to determine whether behavioral economic constructs—including impulsivity (i.e., steep discounting of delayed food and monetary rewards), the relative reinforcing value of food (RRVfood), and environmental enrichment (i.e., the presence of alternatives to unhealthy foods in the home and neighborhood environments)—are significant pretreatment predictors of overweight children’s weight loss within family-based treatment. Method Overweight children (N = 241; ages 7–12 years; 63% female; 65% non-Hispanic White) enrolled in a 16-week family-based obesity treatment with at least one parent. At baseline, children completed a task to assess RRVfood and delay discounting measures of snack foods and money to assess impulsivity. Parents completed questionnaires to assess environmental enrichment. Results Children who found food highly reinforcing and steeply discounted future food rewards at baseline showed a blunted response to treatment compared with children without this combination of risk factors. High environmental enrichment was associated with treatment success only among children who did not find food highly reinforcing. Monetary discounting rate predicted weight loss, regardless of children’s level of RRVfood. Conclusions Investigation is warranted into novel approaches to obesity treatment that target underlying impulsivity and RRVfood. Enriching the environment with alternatives to unhealthy eating may facilitate weight loss, especially for children with low RRVfood. PMID:22924332

General theory of skin reinforcement.

PubMed

Kruglikov, Ilja L; Scherer, Philipp E

2017-01-01

Macroscopic mechanical properties of human skin in vivo cannot be considered independent of adjacent subcutaneous white adipose tissue (sWAT). The layered system skin/sWAT appears as the hierarchical structural composite in which single layers behave as fiber-reinforced structures. Effective macroscopic mechanical properties of such composites are mainly determined either by the properties of the skin or by those of the sWAT, dependent on the conditions of mechanical loading. Mechanical interactions between the skin and the adjacent sWAT associated with a mismatch in the mechanical moduli of these two layers can lead to production of the skin wrinkles. Reinforcement of the composite skin/sWAT can take place in different ways. It can be provided through reorientation of collagen fibers under applied loading, through production of new bonds between existing collagen fibers and through induction of additional collagen structures. Effectiveness of this type of reinforcement is strongly dependent on the type of mechanical loading. Different physical interventions induce the reinforcement of at least one of these two layers, thus increasing the effective macroscopic stiffness of the total composite. At the same time, the standalone reinforcement of the skin appears to be less effective to achieve a delay or a reduction of the apparent signs of skin aging relative to the reinforcement of the sWAT.

Differential reinforcement and resistance to change of divided-attention performance.

PubMed

Podlesnik, Christopher A; Thrailkill, Eric; Shahan, Timothy A

2012-06-01

Behavioral momentum theory provides a framework for understanding how conditions of reinforcement influence instrumental response strength under conditions of disruption (i.e., resistance to change). The present experiment examined resistance to change of divided-attention performance when different overall probabilities of reinforcement were arranged across two components of a multiple schedule. Pigeons responded in a delayed-matching-to-sample procedure with compound samples (color + line orientation) and element comparisons (two colors or two line orientations). Reinforcement ratios of 1:9, 1:1, and 9:1 for accurate matches on the two types of comparison trials were examined across conditions using reinforcement probabilities (color/lines) of .9/.1, .5/.5, and .1/.9 in the rich component and .18/.02, .1/.1, and .02/.18 in the lean component. Relative accuracy with color and line comparisons was an orderly function of relative reinforcement, but this relation did not depend on the overall rate of reinforcement between components. The resistance to change of divided-attention performance was greater for both trial types in the rich component with presession feeding and extinction, but not with decreases in sample duration. These findings suggest promise for the applicability of quantitative models of operant behavior to divided-attention performance, but they highlight the need to further explore conditions impacting the resistance to change of attending.

Female Wistar rats tested during late proestrus or during pregnancy and ovariectomized rats tested after receiving progesterone or allopregnanolone displayed reduced conflict behavior.

PubMed

Molina-Hernandez, Miguel; Perez, Julian Garcia; Olivera Lopez, Jorge Ivan

2002-06-01

In a conflict test based on the rat's choice between an immediate punished reinforcer or a delayed nonpunished reinforcer, anxiolytic drugs increase the number of immediate punished reinforcers. In this study, two hypotheses were tested: first, during late proestrus or during midpregnancy, female rats will display an elevated amount of immediate punished reinforcers; second, ovariectomized rats will display an elevated amount of immediate punished reinforcers when they receive anxiolytic doses of neurosteroids. Thus, female rats (n = 15) were tested repeatedly during late proestrus, diestrus, and pregnancy in the aforementioned conflict task. They displayed an elevated amount of immediate punished reinforcers during late proestrus (P < .05) and during the 14th (P < .05) and 17th (P < .05) days of pregnancy compared to diestrus or 3rd, 7th, or 20th days of pregnancy. Likewise, ovariectomized rats (n = 90) displayed an elevated amount of immediate punished reinforcers compared to control rats only when they received anxiolytic doses of progesterone (1.0-2.0 mg/kg, P < .05) or allopregnanolone (1.0-2.0 mg/kg, P < .05). In conclusion, female rats displayed reduced conflict behavior during late proestrus and pregnancy, or after received anxiolytic doses of neurosteroids.

Differential reinforcement and resistance to change of divided-attention performance

PubMed Central

Thrailkill, Eric

2016-01-01

Behavioral momentum theory provides a framework for understanding how conditions of reinforcement influence instrumental response strength under conditions of disruption (i.e., resistance to change). The present experiment examined resistance to change of divided-attention performance when different overall probabilities of reinforcement were arranged across two components of a multiple schedule. Pigeons responded in a delayed-matching-to-sample procedure with compound samples (color + line orientation) and element comparisons (two colors or two line orientations). Reinforcement ratios of 1:9, 1:1, and 9:1 for accurate matches on the two types of comparison trials were examined across conditions using reinforcement probabilities (color/lines) of .9/.1, .5/.5, and .1/.9 in the rich component and .18/.02, .1/.1, and .02/.18 in the lean component. Relative accuracy with color and line comparisons was an orderly function of relative reinforcement, but this relation did not depend on the overall rate of reinforcement between components. The resistance to change of divided-attention performance was greater for both trial types in the rich component with presession feeding and extinction, but not with decreases in sample duration. These findings suggest promise for the applicability of quantitative models of operant behavior to divided-attention performance, but they highlight the need to further explore conditions impacting the resistance to change of attending. PMID:22038737

Cognitive and Neural Sciences Division. 1988 Programs

DTIC Science & Technology

1988-08-01

the P.I. uses a delayed reinforcement autoshaping procedure which incorporates features of both classical and operant conditioning paradigms...Progress: The PT has completed initial dose-response study of effects of TMT on autoshaping and has submitted a paper that separates "non-specific

Short-term memory for responses: the "choose-small" effect.

PubMed Central

Fetterman, J G; MacEwen, D

1989-01-01

Pigeons' short-term memory for fixed-ratio requirements was assessed using a delayed symbolic matching-to-sample procedure. Different choices were reinforced after fixed-ratio 10 and fixed-ratio 40 requirements, and delays of 0, 5, or 20 s were sometimes placed between sample ratios and choice. All birds made disproportionate numbers of responses to the small-ratio choice alternative when delays were interposed between ratios and choice, and this bias increased as a function of delay. Preference for the small fixed-ratio alternative was also observed on "no-sample" trials, during which the choice alternatives were presented without a prior sample ratio. This "choose-small" bias is analogous to results obtained by Spetch and Wilkie (1983) with event duration as the discriminative stimulus. The choose-small bias was attenuated when the houselight was turned on during delays, but overall accuracy was not influenced systematically by the houselight manipulation. PMID:2584917

Let's talk it over : interagency cooperation facilities success : a case study : the New York, New Jersey, Connecticut metropolitan area TRANSMIT operational test : ensuring integration of intelligent transportation systems products and services

DOT National Transportation Integrated Search

1989-01-01

This manual provides basic background information and step-by-step procedures for conducting traffic conflict surveys at signalized and unsignalized intersections. The manual was prepared as a training aid and reference source for persons who are ass...

NAVAIR Portable Source Initiative (NPSI) Standard for Reusable Source Dataset Metadata (RSDM) V2.4

DTIC Science & Technology

2012-09-26

defining a raster file format: <RasterFileFormat> <FormatName>TIFF</FormatName> <Order>BIP</Order> < DataType >8-BIT_UNSIGNED</ DataType ...interleaved by line (BIL); Band interleaved by pixel (BIP). element RasterFileFormatType/ DataType diagram type restriction of xsd:string facets

Performance of the SMD and SM8 models for predicting solvation free energy of neutral solutes in methanol, dimethyl sulfoxide and acetonitrile.

PubMed

Zanith, Caroline C; Pliego, Josefredo R

2015-03-01

The continuum solvation models SMD and SM8 were developed using 2,346 solvation free energy values for 318 neutral molecules in 91 solvents as reference. However, no solvation data of neutral solutes in methanol was used in the parametrization, while only few solvation free energy values of solutes in dimethyl sulfoxide and acetonitrile were used. In this report, we have tested the performance of the models for these important solvents. Taking data from literature, we have generated solvation free energy, enthalpy and entropy values for 37 solutes in methanol, 21 solutes in dimethyl sulfoxide and 19 solutes in acetonitrile. Both SMD and SM8 models have presented a good performance in methanol and acetonitrile, with mean unsigned error equal or less than 0.66 and 0.55 kcal mol(-1) in methanol and acetonitrile, respectively. However, the correlation is worse in dimethyl sulfoxide, where the SMD and SM8 methods present mean unsigned error of 1.02 and 0.95 kcal mol(-1), respectively. Our results point out the SMx family of models need be improved for dimethyl sulfoxide solvent.

LOGISMOS-B for primates: primate cortical surface reconstruction and thickness measurement

NASA Astrophysics Data System (ADS)

Oguz, Ipek; Styner, Martin; Sanchez, Mar; Shi, Yundi; Sonka, Milan

2015-03-01

Cortical thickness and surface area are important morphological measures with implications for many psychiatric and neurological conditions. Automated segmentation and reconstruction of the cortical surface from 3D MRI scans is challenging due to the variable anatomy of the cortex and its highly complex geometry. While many methods exist for this task in the context of the human brain, these methods are typically not readily applicable to the primate brain. We propose an innovative approach based on our recently proposed human cortical reconstruction algorithm, LOGISMOS-B, and the Laplace-based thickness measurement method. Quantitative evaluation of our approach was performed based on a dataset of T1- and T2-weighted MRI scans from 12-month-old macaques where labeling by our anatomical experts was used as independent standard. In this dataset, LOGISMOS-B has an average signed surface error of 0.01 +/- 0.03mm and an unsigned surface error of 0.42 +/- 0.03mm over the whole brain. Excluding the rather problematic temporal pole region further improves unsigned surface distance to 0.34 +/- 0.03mm. This high level of accuracy reached by our algorithm even in this challenging developmental dataset illustrates its robustness and its potential for primate brain studies.

Pole-strength of the earth from Magsat and magnetic determination of the core radius

NASA Technical Reports Server (NTRS)

Voorhies, G. V.; Benton, E. R.

1982-01-01

A model based on two days of Magsat data is used to numerically evaluate the unsigned magnetic flux linking the earth's surface, and a comparison of the 16.054 GWb value calculated with values from earlier geomagnetic field models reveals a smooth, monotonic, and recently-accelerating decrease in the earth's pole strength at a 50-year average rate of 8.3 MWb, or 0.052%/year. Hide's (1978) magnetic technique for determining the radius of the earth's electrically-conducting core is tested by (1) extrapolating main field models for 1960 and 1965 downward through the nearly-insulating mantle, and then separately comparing them to equivalent, extrapolated models of Magsat data. The two unsigned fluxes are found to equal the Magsat values at a radius which is within 2% of the core radius; and (2) the 1960 main field and secular variation and acceleration coefficients are used to derive models of 1930, 1940 and 1950. The same core magnetic radius value, within 2% of the seismic value, is obtained. It is concluded that the mantle is a nearly-perfect insulator, while the core is a perfect conductor, on the decade time scale.

Performance of the SMD and SM8 models for predicting solvation free energy of neutral solutes in methanol, dimethyl sulfoxide and acetonitrile

NASA Astrophysics Data System (ADS)

Zanith, Caroline C.; Pliego, Josefredo R.

2015-03-01

The continuum solvation models SMD and SM8 were developed using 2,346 solvation free energy values for 318 neutral molecules in 91 solvents as reference. However, no solvation data of neutral solutes in methanol was used in the parametrization, while only few solvation free energy values of solutes in dimethyl sulfoxide and acetonitrile were used. In this report, we have tested the performance of the models for these important solvents. Taking data from literature, we have generated solvation free energy, enthalpy and entropy values for 37 solutes in methanol, 21 solutes in dimethyl sulfoxide and 19 solutes in acetonitrile. Both SMD and SM8 models have presented a good performance in methanol and acetonitrile, with mean unsigned error equal or less than 0.66 and 0.55 kcal mol-1 in methanol and acetonitrile, respectively. However, the correlation is worse in dimethyl sulfoxide, where the SMD and SM8 methods present mean unsigned error of 1.02 and 0.95 kcal mol-1, respectively. Our results point out the SMx family of models need be improved for dimethyl sulfoxide solvent.

Impact of repeated intravenous cocaine administration on incentive motivation depends on mode of drug delivery.

PubMed

LeBlanc, Kimberly H; Maidment, Nigel T; Ostlund, Sean B

2014-11-01

The incentive sensitization theory of addiction posits that repeated exposure to drugs of abuse, like cocaine, can lead to long-term adaptations in the neural circuits that support motivated behavior, providing an account of pathological drug-seeking behavior. Although pre-clinical findings provide strong support for this theory, much remains unknown about the conditions that support incentive sensitization. The current study examined whether the mode of cocaine administration is an important factor governing that drug's long-term impact on behavior. Separate groups of rats were allowed either to self-administer intravenous cocaine or were given an equivalent number and distribution of unsignaled cocaine or saline infusions. During the subsequent test of incentive motivation (Pavlovian-to-instrumental transfer), we found that rats with a history of cocaine self-administration showed strong cue-evoked food seeking, in contrast to rats given unsignaled cocaine or saline. This finding indicates that the manner in which cocaine is administered can determine its lasting behavioral effects, suggesting that subjective experiences during drug use play a critical role in the addiction process. Our findings may therefore have important implications for the study and treatment of compulsive drug seeking. © 2013 Society for the Study of Addiction.

The Effects of a Local Negative Feedback Function between Choice and Relative Reinforcer Rate

PubMed Central

Davison, Michael; Elliffe, Douglas; Marr, M. Jackson

2010-01-01

Four pigeons were trained on two-key concurrent variable-interval schedules with no changeover delay. In Phase 1, relative reinforcers on the two alternatives were varied over five conditions from .1 to .9. In Phases 2 and 3, we instituted a molar feedback function between relative choice in an interreinforcer interval and the probability of reinforcers on the two keys ending the next interreinforcer interval. The feedback function was linear, and was negatively sloped so that more extreme choice in an interreinforcer interval made it more likely that a reinforcer would be available on the other key at the end of the next interval. The slope of the feedback function was −1 in Phase 2 and −3 in Phase 3. We varied relative reinforcers in each of these phases by changing the intercept of the feedback function. Little effect of the feedback functions was discernible at the local (interreinforcer interval) level, but choice measured at an extended level across sessions was strongly and significantly decreased by increasing the negative slope of the feedback function. PMID:21451748

The stay/switch model describes choice among magnitudes of reinforcers.

PubMed

MacDonall, James S

2008-06-01

The stay/switch model is an alternative to the generalized matching law for describing choice in concurrent procedures. The purpose of the present experiment was to extend this model to choice among magnitudes of reinforcers. Rats were exposed to conditions in which the magnitude of reinforcers (number of food pellets) varied for staying at alternative 1, switching from alternative 1, staying at alternative 2 and switching from alternative 2. A changeover delay was not used. The results showed that the stay/switch model provided a good account of the data overall, and deviations from fits of the generalized matching law to response allocation data were in the direction predicted by the stay/switch model. In addition, comparisons among specific conditions suggested that varying the ratio of obtained reinforcers, as in the generalized matching law, was not necessary to change the response and time allocations. Other comparisons suggested that varying the ratio of obtained reinforcers was not sufficient to change response allocation. Taken together these results provide additional support for the stay/switch model of concurrent choice.

Interrelationships between marijuana demand and discounting of delayed rewards: Convergence in behavioral economic methods.

PubMed

Aston, Elizabeth R; Metrik, Jane; Amlung, Michael; Kahler, Christopher W; MacKillop, James

2016-12-01

Distinct behavioral economic domains, including high perceived drug value (demand) and delay discounting (DD), have been implicated in the initiation of drug use and the progression to dependence. However, it is unclear whether frequent marijuana users conform to a "reinforcer pathology" addiction model wherein marijuana demand and DD jointly increase risk for problematic marijuana use and cannabis dependence (CD). Participants (n=88, 34% female, 14% cannabis dependent) completed a marijuana purchase task at baseline. A delay discounting task was completed following placebo marijuana cigarette (0% THC) administration during a separate experimental session. Marijuana demand and DD were quantified using area under the curve (AUC). In multiple regression models, demand uniquely predicted frequency of marijuana use while DD did not. In contrast, DD uniquely predicted CD symptom count while demand did not. There were no significant interactions between demand and DD in either model. These findings suggest that frequent marijuana users exhibit key constituents of the reinforcer pathology model: high marijuana demand and steep discounting of delayed rewards. However, demand and DD appear to be independent rather than synergistic risk factors for elevated marijuana use and risk for progression to CD. Findings also provide support for using AUC as a singular marijuana demand metric, particularly when also examining other behavioral economic constructs that apply similar statistical approaches, such as DD, to support analytic methodological convergence. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Delay Discounting: Pigeon, Rat, Human – Does it Matter?

PubMed Central

Vanderveldt, Ariana; Oliveira, Luís; Green, Leonard

2016-01-01

Delay discounting refers to the decrease in subjective value of an outcome as the time to its receipt increases. Across species and situations, animals discount delayed rewards, and their discounting is well-described by a hyperboloid function. The current review begins with a comparison of discounting models and the procedures used to assess delay discounting in nonhuman animals. We next discuss the generality of discounting, reviewing the effects of different variables on the degree of discounting delayed reinforcers by nonhuman animals. Despite the many similarities in discounting observed between human and nonhuman animals, several differences have been proposed (e.g., the magnitude effect; nonhuman animals discount over a matter of seconds whereas humans report willing to wait months, if not years before receiving a reward), raising the possibility of fundamental species differences in intertemporal choice. After evaluating these differences, we discuss delay discounting from an adaptationist perspective. The pervasiveness of discounting across species and situations suggests it is a fundamental process underlying decision making. PMID:26881899

RELATIVE CONTRIBUTIONS OF THREE DESCRIPTIVE METHODS: IMPLICATIONS FOR BEHAVIORAL ASSESSMENT

PubMed Central

Pence, Sacha T; Roscoe, Eileen M; Bourret, Jason C; Ahearn, William H

2009-01-01

This study compared the outcomes of three descriptive analysis methods—the ABC method, the conditional probability method, and the conditional and background probability method—to each other and to the results obtained from functional analyses. Six individuals who had been diagnosed with developmental delays and exhibited problem behavior participated. Functional analyses indicated that participants' problem behavior was maintained by social positive reinforcement (n  =  2), social negative reinforcement (n  =  2), or automatic reinforcement (n  =  2). Results showed that for all but 1 participant, descriptive analysis outcomes were similar across methods. In addition, for all but 1 participant, the descriptive analysis outcome differed substantially from the functional analysis outcome. This supports the general finding that descriptive analysis is a poor means of determining functional relations. PMID:19949536

A junction-tree based learning algorithm to optimize network wide traffic control: A coordinated multi-agent framework

DOE PAGES

Zhu, Feng; Aziz, H. M. Abdul; Qian, Xinwu; ...

2015-01-31

Our study develops a novel reinforcement learning algorithm for the challenging coordinated signal control problem. Traffic signals are modeled as intelligent agents interacting with the stochastic traffic environment. The model is built on the framework of coordinated reinforcement learning. The Junction Tree Algorithm (JTA) based reinforcement learning is proposed to obtain an exact inference of the best joint actions for all the coordinated intersections. Moreover, the algorithm is implemented and tested with a network containing 18 signalized intersections in VISSIM. Finally, our results show that the JTA based algorithm outperforms independent learning (Q-learning), real-time adaptive learning, and fixed timing plansmore » in terms of average delay, number of stops, and vehicular emissions at the network level.« less

Running Improves Pattern Separation during Novel Object Recognition.

PubMed

Bolz, Leoni; Heigele, Stefanie; Bischofberger, Josef

2015-10-09

Running increases adult neurogenesis and improves pattern separation in various memory tasks including context fear conditioning or touch-screen based spatial learning. However, it is unknown whether pattern separation is improved in spontaneous behavior, not emotionally biased by positive or negative reinforcement. Here we investigated the effect of voluntary running on pattern separation during novel object recognition in mice using relatively similar or substantially different objects.We show that running increases hippocampal neurogenesis but does not affect object recognition memory with 1.5 h delay after sample phase. By contrast, at 24 h delay, running significantly improves recognition memory for similar objects, whereas highly different objects can be distinguished by both, running and sedentary mice. These data show that physical exercise improves pattern separation, independent of negative or positive reinforcement. In sedentary mice there is a pronounced temporal gradient for remembering object details. In running mice, however, increased neurogenesis improves hippocampal coding and temporally preserves distinction of novel objects from familiar ones.

Effect of quinolinic acid-induced lesions of the nucleus accumbens core on performance on a progressive ratio schedule of reinforcement: implications for inter-temporal choice.

PubMed

Bezzina, G; Body, S; Cheung, T H C; Hampson, C L; Deakin, J F W; Anderson, I M; Szabadi, E; Bradshaw, C M

2008-04-01

The nucleus accumbens core (AcbC) is believed to contribute to the control of operant behaviour by reinforcers. Recent evidence suggests that it is not crucial for determining the incentive value of immediately available reinforcers, but is important for maintaining the values of delayed reinforcers. This study aims to examine the effect of AcbC lesions on performance on a progressive-ratio schedule using a quantitative model that dissociates effects of interventions on motor and motivational processes (Killeen 1994 Mathematical principles of reinforcement. Behav Brain Sci 17:105-172). Rats with bilateral quinolinic acid-induced lesions of the AcbC (n = 15) or sham lesions (n = 14) were trained to lever-press for food-pellet reinforcers under a progressive-ratio schedule. In Phase 1 (90 sessions) the reinforcer was one pellet; in Phase 2 (30 sessions), it was two pellets; in Phase 3, (30 sessions) it was one pellet. The performance of both groups conformed to the model of progressive-ratio performance (group mean data: r2 > 0.92). The motor parameter, delta, was significantly higher in the AcbC-lesioned than the sham-lesioned group, reflecting lower overall response rates in the lesioned group. The motivational parameter, a, was sensitive to changes in reinforcer size, but did not differ significantly between the two groups. The AcbC-lesioned group showed longer post-reinforcement pauses and lower running response rates than the sham-lesioned group. The results suggest that destruction of the AcbC impairs response capacity but does not alter the efficacy of food reinforcers. The results are consistent with recent findings that AcbC lesions do not alter sensitivity to reinforcer size in inter-temporal choice schedules.

The combination of appetitive and aversive reinforcers and the nature of their interaction during auditory learning.

PubMed

Ilango, A; Wetzel, W; Scheich, H; Ohl, F W

2010-03-31

Learned changes in behavior can be elicited by either appetitive or aversive reinforcers. It is, however, not clear whether the two types of motivation, (approaching appetitive stimuli and avoiding aversive stimuli) drive learning in the same or different ways, nor is their interaction understood in situations where the two types are combined in a single experiment. To investigate this question we have developed a novel learning paradigm for Mongolian gerbils, which not only allows rewards and punishments to be presented in isolation or in combination with each other, but also can use these opposite reinforcers to drive the same learned behavior. Specifically, we studied learning of tone-conditioned hurdle crossing in a shuttle box driven by either an appetitive reinforcer (brain stimulation reward) or an aversive reinforcer (electrical footshock), or by a combination of both. Combination of the two reinforcers potentiated speed of acquisition, led to maximum possible performance, and delayed extinction as compared to either reinforcer alone. Additional experiments, using partial reinforcement protocols and experiments in which one of the reinforcers was omitted after the animals had been previously trained with the combination of both reinforcers, indicated that appetitive and aversive reinforcers operated together but acted in different ways: in this particular experimental context, punishment appeared to be more effective for initial acquisition and reward more effective to maintain a high level of conditioned responses (CRs). The results imply that learning mechanisms in problem solving were maximally effective when the initial punishment of mistakes was combined with the subsequent rewarding of correct performance. Copyright 2010 IBRO. Published by Elsevier Ltd. All rights reserved.

A neural model of hierarchical reinforcement learning.

PubMed

Rasmussen, Daniel; Voelker, Aaron; Eliasmith, Chris

2017-01-01

We develop a novel, biologically detailed neural model of reinforcement learning (RL) processes in the brain. This model incorporates a broad range of biological features that pose challenges to neural RL, such as temporally extended action sequences, continuous environments involving unknown time delays, and noisy/imprecise computations. Most significantly, we expand the model into the realm of hierarchical reinforcement learning (HRL), which divides the RL process into a hierarchy of actions at different levels of abstraction. Here we implement all the major components of HRL in a neural model that captures a variety of known anatomical and physiological properties of the brain. We demonstrate the performance of the model in a range of different environments, in order to emphasize the aim of understanding the brain's general reinforcement learning ability. These results show that the model compares well to previous modelling work and demonstrates improved performance as a result of its hierarchical ability. We also show that the model's behaviour is consistent with available data on human hierarchical RL, and generate several novel predictions.

Reducing Repetitive Speech: Effects of Strategy Instruction.

ERIC Educational Resources Information Center

Dipipi, Caroline M.; Jitendra, Asha K.; Miller, Judith A.

2001-01-01

This article describes an intervention with an 18-year-old young woman with mild mental retardation and a seizure disorder, which focused on her repetitive echolalic verbalizations. The intervention included time delay, differential reinforcement of other behaviors, and self-monitoring. Overall, the intervention was successful in facilitating…

Navigating complex decision spaces: Problems and paradigms in sequential choice

PubMed Central

Walsh, Matthew M.; Anderson, John R.

2015-01-01

To behave adaptively, we must learn from the consequences of our actions. Doing so is difficult when the consequences of an action follow a delay. This introduces the problem of temporal credit assignment. When feedback follows a sequence of decisions, how should the individual assign credit to the intermediate actions that comprise the sequence? Research in reinforcement learning provides two general solutions to this problem: model-free reinforcement learning and model-based reinforcement learning. In this review, we examine connections between stimulus-response and cognitive learning theories, habitual and goal-directed control, and model-free and model-based reinforcement learning. We then consider a range of problems related to temporal credit assignment. These include second-order conditioning and secondary reinforcers, latent learning and detour behavior, partially observable Markov decision processes, actions with distributed outcomes, and hierarchical learning. We ask whether humans and animals, when faced with these problems, behave in a manner consistent with reinforcement learning techniques. Throughout, we seek to identify neural substrates of model-free and model-based reinforcement learning. The former class of techniques is understood in terms of the neurotransmitter dopamine and its effects in the basal ganglia. The latter is understood in terms of a distributed network of regions including the prefrontal cortex, medial temporal lobes cerebellum, and basal ganglia. Not only do reinforcement learning techniques have a natural interpretation in terms of human and animal behavior, but they also provide a useful framework for understanding neural reward valuation and action selection. PMID:23834192

The impact of reinforcement contingencies on AD/HD: a review and theoretical appraisal.

PubMed

Luman, Marjolein; Oosterlaan, Jaap; Sergeant, Joseph A

2005-02-01

One of the core deficits in attention deficit/hyperactivity disorder (AD/HD) is thought to be an aberrant sensitivity to reinforcement, such as reward and response cost. Twenty-two studies (N=1181 children) employing AD/HD and reinforcement contingencies are reviewed from vantage points: task performance, motivation, and psychophysiology. Results indicate that reinforcement contingencies have a positive impact on task performance and levels of motivation for both children with AD/HD and normal controls. There is evidence that the effect related to task performance is somewhat more prominent in AD/HD. There is some evidence that a high intensity of reinforcement is highly effective in AD/HD. Children with AD/HD prefer immediate over delayed reward. From a psychophysiological point of view, children with AD/HD seem less sensitive to reinforcement compared to controls. While comorbid disorders are suggested to be confounders of the dependent variables, many studies do not examine the effect of oppositional defiant disorder (ODD) and conduct disorder (CD). We discuss the implications of the findings for five theoretical frameworks, including the model by, the cognitive-energetic model (CEM), the dual-pathway model and the BIS/BAS model. Results show a discrepancy between the theoretical models and the behavioural findings.

A mild alkali treated jute fibre controlling the hydration behaviour of greener cement paste

PubMed Central

Jo, Byung-Wan; Chakraborty, Sumit

2015-01-01

To reduce the antagonistic effect of jute fibre on the setting and hydration of jute reinforced cement, modified jute fibre reinforcement would be a unique approach. The present investigation deals with the effectiveness of mild alkali treated (0.5%) jute fibre on the setting and hydration behaviour of cement. Setting time measurement, hydration test and analytical characterizations of the hardened samples (viz., FTIR, XRD, DSC, TGA, and free lime estimation) were used to evaluate the effect of alkali treated jute fibre. From the hydration test, the time (t) required to reach maximum temperature for the hydration of control cement sample is estimated to be 860 min, whilst the time (t) is measured to be 1040 min for the hydration of a raw jute reinforced cement sample. However, the time (t) is estimated to be 1020 min for the hydration of an alkali treated jute reinforced cement sample. Additionally, from the analytical characterizations, it is determined that fibre-cement compatibility is increased and hydration delaying effect is minimized by using alkali treated jute fibre as fibre reinforcement. Based on the analyses, a model has been proposed to explain the setting and hydration behaviour of alkali treated jute fibre reinforced cement composite. PMID:25592665

Risky Choice in Pigeons and Humans: A Cross-Species Comparison

ERIC Educational Resources Information Center

Lagorio, Carla H.; Hackenberg, Timothy D.

2010-01-01

Pigeon and human subjects were given repeated choices between variable and adjusting delays to token reinforcement that titrated in relation to a subject's recent choice patterns. Indifference curves were generated under two different procedures: "immediate exchange," in which a token earned during each trial was exchanged immediately for access…

Behavioral Economic Predictors of Overweight Children's Weight Loss

ERIC Educational Resources Information Center

Best, John R.; Theim, Kelly R.; Gredysa, Dana M.; Stein, Richard I.; Welch, R. Robinson; Saelens, Brian E.; Perri, Michael G.; Schechtman, Kenneth B.; Epstein, Leonard H.; Wilfley, Denise E.

2012-01-01

Objective: Our goal was to determine whether behavioral economic constructs--including impulsivity (i.e., steep discounting of delayed food and monetary rewards), the relative reinforcing value of food (RRV[subscript food]), and environmental enrichment (i.e., the presence of alternatives to unhealthy foods in the home and neighborhood…

Assessing Self-Control Training in Children with Attention Deficit Hyperactivity Disorder

ERIC Educational Resources Information Center

Bloh, Christopher

2009-01-01

This study examined the use of a progressive delay procedure with and without a concurrent activity to teach self-control to children with attention deficit hyperactivity disorder. Three participants were initially required to wait progressively longer periods of time for access to preferred edible reinforcers. After demonstrating this…

A rapid method of toilet training the institutionalized retarded1

PubMed Central

Azrin, N. H.; Foxx, R. M.

1971-01-01

Incontinence is a major unsolved problem in the institutional care of the profoundly retarded. A reinforcement and social analysis of incontinence was used to develop a procedure that would rapidly toilet train retardates and motivate them to remain continent during the day in their ward setting. Nine profoundly retarded adults were given intensive training (median of four days per patient), the distinctive features of which were artificially increasing the frequency of urinations, positive reinforcement of correct toileting but a delay for “accidents”, use of new automatic apparatus for signalling elimination, shaping of independent toileting, cleanliness training, and staff reinforcement procedures. Incontinence was reduced immediately by about 90% and eventually decreased to near-zero. These results indicate the present procedure is an effective, rapid, enduring, and administratively feasible solution to the problem of incontinence of the institutionalized retarded. PMID:16795291

Relapse of extinguished fear after exposure to a dangerous context is mitigated by testing in a safe context

PubMed Central

Goode, Travis D.; Kim, Janice J.

2015-01-01

Aversive events can trigger relapse of extinguished fear memories, presenting a major challenge to the long-term efficacy of therapeutic interventions. Here, we examined factors regulating the relapse of extinguished fear after exposure of rats to a dangerous context. Rats received unsignaled shock in a distinct context (“dangerous” context) 24 h prior to auditory fear conditioning in another context. Fear to the auditory conditioned stimulus (CS) was subsequently extinguished either in the conditioning context (“ambiguous” context) or in a third novel context (“safe” context). Exposure to the dangerous context 30 min before a CS retention test caused relapse to the CS in the ambiguous and safe test contexts relative to nonextinguished controls. When rats were tested 24 h later (with or without short-term testing), rats tested in the ambiguous context continued to exhibit relapse, whereas rats tested in the safe context did not. Additionally, exposure of rats to the conditioning context—in place of the unsignaled shock context—did not result in relapse of fear to the CS in the safe testing context. Our work highlights the vulnerabilities of extinction recall to interference, and demonstrates the importance of context associations in the relapse of fear after extinction. PMID:25691517

Correlation between solar flare productivity and photospheric vector magnetic fields

NASA Astrophysics Data System (ADS)

Cui, Yanmei; Wang, Huaning

2008-11-01

Studying the statistical correlation between the solar flare productivity and photospheric magnetic fields is very important and necessary. It is helpful to set up a practical flare forecast model based on magnetic properties and improve the physical understanding of solar flare eruptions. In the previous study ([Cui, Y.M., Li, R., Zhang, L.Y., He, Y.L., Wang, H.N. Correlation between solar flare productivity and photospheric magnetic field properties 1. Maximum horizontal gradient, length of neutral line, number of singular points. Sol. Phys. 237, 45 59, 2006]; from now on we refer to this paper as ‘Paper I’), three measures of the maximum horizontal gradient, the length of the neutral line, and the number of singular points are computed from 23990 SOHO/MDI longitudinal magnetograms. The statistical relationship between the solar flare productivity and these three measures is well fitted with sigmoid functions. In the current work, the three measures of the length of strong-shear neutral line, total unsigned current, and total unsigned current helicity are computed from 1353 vector magnetograms observed at Huairou Solar Observing Station. The relationship between the solar flare productivity and the current three measures can also be well fitted with sigmoid functions. These results are expected to be beneficial to future operational flare forecasting models.

Relapse of extinguished fear after exposure to a dangerous context is mitigated by testing in a safe context.

PubMed

Goode, Travis D; Kim, Janice J; Maren, Stephen

2015-03-01

Aversive events can trigger relapse of extinguished fear memories, presenting a major challenge to the long-term efficacy of therapeutic interventions. Here, we examined factors regulating the relapse of extinguished fear after exposure of rats to a dangerous context. Rats received unsignaled shock in a distinct context ("dangerous" context) 24 h prior to auditory fear conditioning in another context. Fear to the auditory conditioned stimulus (CS) was subsequently extinguished either in the conditioning context ("ambiguous" context) or in a third novel context ("safe" context). Exposure to the dangerous context 30 min before a CS retention test caused relapse to the CS in the ambiguous and safe test contexts relative to nonextinguished controls. When rats were tested 24 h later (with or without short-term testing), rats tested in the ambiguous context continued to exhibit relapse, whereas rats tested in the safe context did not. Additionally, exposure of rats to the conditioning context--in place of the unsignaled shock context--did not result in relapse of fear to the CS in the safe testing context. Our work highlights the vulnerabilities of extinction recall to interference, and demonstrates the importance of context associations in the relapse of fear after extinction. © 2015 Goode et al.; Published by Cold Spring Harbor Laboratory Press.

The effects of methylphenidate on cerebral responses to conflict anticipation and unsigned prediction error in a stop-signal task.

PubMed

Manza, Peter; Hu, Sien; Ide, Jaime S; Farr, Olivia M; Zhang, Sheng; Leung, Hoi-Chung; Li, Chiang-shan R

2016-03-01

To adapt flexibly to a rapidly changing environment, humans must anticipate conflict and respond to surprising, unexpected events. To this end, the brain estimates upcoming conflict on the basis of prior experience and computes unsigned prediction error (UPE). Although much work implicates catecholamines in cognitive control, little is known about how pharmacological manipulation of catecholamines affects the neural processes underlying conflict anticipation and UPE computation. We addressed this issue by imaging 24 healthy young adults who received a 45 mg oral dose of methylphenidate (MPH) and 62 matched controls who did not receive MPH prior to performing the stop-signal task. We used a Bayesian Dynamic Belief Model to make trial-by-trial estimates of conflict and UPE during task performance. Replicating previous research, the control group showed anticipation-related activation in the presupplementary motor area and deactivation in the ventromedial prefrontal cortex and parahippocampal gyrus, as well as UPE-related activations in the dorsal anterior cingulate, insula, and inferior parietal lobule. In group comparison, MPH increased anticipation activity in the bilateral caudate head and decreased UPE activity in each of the aforementioned regions. These findings highlight distinct effects of catecholamines on the neural mechanisms underlying conflict anticipation and UPE, signals critical to learning and adaptive behavior. © The Author(s) 2016.

The effects of methylphenidate on cerebral responses to conflict anticipation and unsigned prediction error in a stop-signal task

PubMed Central

Manza, Peter; Hu, Sien; Ide, Jaime S; Farr, Olivia M; Zhang, Sheng; Leung, Hoi-Chung; Li, Chiang-shan R

2016-01-01

To adapt flexibly to a rapidly changing environment, humans must anticipate conflict and respond to surprising, unexpected events. To this end, the brain estimates upcoming conflict on the basis of prior experience and computes unsigned prediction error (UPE). Although much work implicates catecholamines in cognitive control, little is known about how pharmacological manipulation of catecholamines affects the neural processes underlying conflict anticipation and UPE computation. We addressed this issue by imaging 24 healthy young adults who received a 45 mg oral dose of methylphenidate (MPH) and 62 matched controls who did not receive MPH prior to performing the stop-signal task. We used a Bayesian Dynamic Belief Model to make trial-by-trial estimates of conflict and UPE during task performance. Replicating previous research, the control group showed anticipation-related activation in the presupplementary motor area and deactivation in the ventromedial prefrontal cortex and parahippocampal gyrus, as well as UPE-related activations in the dorsal anterior cingulate, insula, and inferior parietal lobule. In group comparison, MPH increased anticipation activity in the bilateral caudate head and decreased UPE activity in each of the aforementioned regions. These findings highlight distinct effects of catecholamines on the neural mechanisms underlying conflict anticipation and UPE, signals critical to learning and adaptive behavior. PMID:26755547

Hydrogen bonding and pi-stacking: how reliable are force fields? A critical evaluation of force field descriptions of nonbonded interactions.

PubMed

Paton, Robert S; Goodman, Jonathan M

2009-04-01

We have evaluated the performance of a set of widely used force fields by calculating the geometries and stabilization energies for a large collection of intermolecular complexes. These complexes are representative of a range of chemical and biological systems for which hydrogen bonding, electrostatic, and van der Waals interactions play important roles. Benchmark energies are taken from the high-level ab initio values in the JSCH-2005 and S22 data sets. All of the force fields underestimate stabilization resulting from hydrogen bonding, but the energetics of electrostatic and van der Waals interactions are described more accurately. OPLSAA gave a mean unsigned error of 2 kcal mol(-1) for all 165 complexes studied, and outperforms DFT calculations employing very large basis sets for the S22 complexes. The magnitude of hydrogen bonding interactions are severely underestimated by all of the force fields tested, which contributes significantly to the overall mean error; if complexes which are predominantly bound by hydrogen bonding interactions are discounted, the mean unsigned error of OPLSAA is reduced to 1 kcal mol(-1). For added clarity, web-based interactive displays of the results have been developed which allow comparisons of force field and ab initio geometries to be performed and the structures viewed and rotated in three dimensions.

Automated contour detection in X-ray left ventricular angiograms using multiview active appearance models and dynamic programming.

PubMed

Oost, Elco; Koning, Gerhard; Sonka, Milan; Oemrawsingh, Pranobe V; Reiber, Johan H C; Lelieveldt, Boudewijn P F

2006-09-01

This paper describes a new approach to the automated segmentation of X-ray left ventricular (LV) angiograms, based on active appearance models (AAMs) and dynamic programming. A coupling of shape and texture information between the end-diastolic (ED) and end-systolic (ES) frame was achieved by constructing a multiview AAM. Over-constraining of the model was compensated for by employing dynamic programming, integrating both intensity and motion features in the cost function. Two applications are compared: a semi-automatic method with manual model initialization, and a fully automatic algorithm. The first proved to be highly robust and accurate, demonstrating high clinical relevance. Based on experiments involving 70 patient data sets, the algorithm's success rate was 100% for ED and 99% for ES, with average unsigned border positioning errors of 0.68 mm for ED and 1.45 mm for ES. Calculated volumes were accurate and unbiased. The fully automatic algorithm, with intrinsically less user interaction was less robust, but showed a high potential, mostly due to a controlled gradient descent in updating the model parameters. The success rate of the fully automatic method was 91% for ED and 83% for ES, with average unsigned border positioning errors of 0.79 mm for ED and 1.55 mm for ES.

S-R associations, their extinction, and recovery in an animal model of anxiety: a new associative account of phobias without recall of original trauma.

PubMed

Laborda, Mario A; Miller, Ralph R

2011-06-01

Associative accounts of the etiology of phobias have been criticized because of numerous cases of phobias in which the client does not remember a relevant traumatic event (i.e., Pavlovian conditioning trial), instructions, or vicarious experience with the phobic object. In three lick suppression experiments with rats as subjects, we modeled an associative account of such fears. Experiment 1 assessed stimulus-response (S-R) associations in first-order fear conditioning. After behaviorally complete devaluation of the unconditioned stimulus, the target stimulus still produced strong conditioned responses, suggesting that an S-R association had been formed and that this association was not significantly affected when the outcome was devalued through unsignaled presentations of the unconditioned stimulus. Experiments 2 and 3 examined extinction and recovery of S-R associations. Experiment 2 showed that extinguished S-R associations returned when testing occurred outside of the extinction context (i.e., renewal) and Experiment 3 found that a long delay between extinction and testing also produced a return of the extinguished S-R associations (i.e., spontaneous recovery). These experiments suggest that fears for which people cannot recall a cause are explicable in an associative framework, and indicate that those fears are susceptible to relapse after extinction treatment just like stimulus-outcome (S-O) associations. Copyright © 2010. Published by Elsevier Ltd.

Learning Disability as Related to Infrequent Punishment and Limited Participation in Delay of Reinforcement Tasks

ERIC Educational Resources Information Center

Wilson, L. R.

1975-01-01

This study, by comparing for learning disabled and control children parental frequency rating of physical punishment and of completion of tasks, hypothesized that parental indulgence is associated with learning disorders. Referral children with learning problems (N=18), were rated significantly lower on both measures that students referred for…

Psychological Distance to Reward: Effects of S+ Duration and the Delay Reduction It Signals

ERIC Educational Resources Information Center

Alessandri, Jerome; Stolarz-Fantino, Stephanie; Fantino, Edmund

2011-01-01

A concurrent-chains procedure was used to examine choice between segmented (two-component chained schedules) and unsegmented schedules (simple schedules) in terminal links with equal inter-reinforcement intervals. Previous studies using this kind of experimental procedure showed preference for unsegmented schedules for both pigeons and humans. In…

The Effects of Reduced Cigarette Smoking on Discounting Future Rewards: An Initial Evaluation

ERIC Educational Resources Information Center

Yi, Richard; Johnson, Matthew W.; Giordano, Louis A.; Landes, Reid D.; Badger, Gary J.; Bickel, Warren K.

2008-01-01

To determine whether reduction of smoking via contingency management in dependent smokers would decrease the discounting of delayed reinforcers compared with smokers who did not reduce their smoking, moderate to heavy cigarette smokers were randomly assigned to one of two conditions: a contingency management condition and a control condition. In…

The Response of the North American Monsoon to Increased Greenhouse Gas Forcing

NASA Technical Reports Server (NTRS)

Cook, B. I.; Seager, R.

2013-01-01

[1] We analyze the response of the North American Monsoon (NAM) to increased greenhouse gas (GHG) forcing (emissions scenario RCP 8.5) using new simulations available through the Coupled Model Intercomparison Project version 5 (CMIP5). Changes in total monsoon season rainfall with GHG warming are small and insignificant. The models do, however, show significant declines in early monsoon season precipitation (June-July) and increases in late monsoon season (September-October) precipitation, indicating a shift in seasonality toward delayed onset and withdrawal of the monsoon. Early in the monsoon season, tropospheric warming increases vertical stability, reinforced by reductions in available surface moisture, inhibiting precipitation and delaying the onset of the monsoon. By the end of the monsoon season, moisture convergence is sufficient to overcome the warming induced stability increases, and precipitation is enhanced. Even with no change in total NAM rainfall, shifts in the seasonal distribution of precipitation within the NAM region are still likely to have significant societal and ecological consequences, reinforcing the need to not only understand the magnitude, but also the timing, of future precipitation changes.

Fixed-interval performance and self-control in infants.

PubMed Central

Darcheville, J C; Rivière, V; Wearden, J H

1993-01-01

Twenty-six infants, 3 to 23 months old, were trained on fixed-interval schedules ranging from 10 s to 80 s. The operant response was touching an illuminated location on a touch-sensitive screen, and 20 s of cartoon presentation was the reinforcer. The subjects were also trained in a six-phase self-control procedure in which the critical phases involved choice between 20 s of cartoon available after a 0.5-s delay (impulsive choice) and 40 s of cartoon delayed for 40 s (self-controlled choice). All the youngest children (3 to 5 months) showed long postreinforcement pauses on the fixed-interval schedule, with most intervals involving the emission of a single, reinforced, response, and all made self-controlled choices. Older subjects (9 to 23 months) either produced the same pattern as the younger ones on the fixed-interval schedule (classified as pause-sensitive subjects) or produced short pauses and higher steady response rates (classified as pause-insensitive subjects). All pause-sensitive subjects made self-controlled choices in the self-control condition, and all pause-insensitive subjects made impulsive ones. PMID:8409821

Effect of different fibers on mechanical properties and ductility of alkali-activated slag cementitious material

NASA Astrophysics Data System (ADS)

Zhu, J.; Zheng, W. Z.; Qin, C. Z.; Xu, Z. Z.; Wu, Y. Q.

2018-01-01

The effect of different fibers on mechanical properties and ductility of alkali-activated slag cementitious material (AASCM) is studied. The research contents include: fiber type (plant fiber, polypropylene fiber), fiber content, mechanical property index, tensile stress-strain relationship curve, treating time. The test results showed that the compressive strength of two fibers reinforced AASCM was about 90 ~ 110MPa, and the tensile strength was about 3 ~ 5MPa. The reinforcement effect of polypropylene fiber is superior to that of plant fiber, and the mechanical properties of polypropylene fiber reinforced AASCM are superior to those of plant fiber, According to the comparison of SEM pictures, the plant fiber and polypropylene fiber are both closely bound with the matrix, and the transition zones are complete and close. Thus, it is proved that plant fiber and polypropylene fiber delay the crack extension and enhance the ductility of AASCM.

ANALYSES OF RESPONSE–STIMULUS SEQUENCES IN DESCRIPTIVE OBSERVATIONS

PubMed Central

Samaha, Andrew L; Vollmer, Timothy R; Borrero, Carrie; Sloman, Kimberly; Pipkin, Claire St. Peter; Bourret, Jason

2009-01-01

Descriptive observations were conducted to record problem behavior displayed by participants and to record antecedents and consequences delivered by caregivers. Next, functional analyses were conducted to identify reinforcers for problem behavior. Then, using data from the descriptive observations, lag-sequential analyses were conducted to examine changes in the probability of environmental events across time in relation to occurrences of problem behavior. The results of the lag-sequential analyses were interpreted in light of the results of functional analyses. Results suggested that events identified as reinforcers in a functional analysis followed behavior in idiosyncratic ways: after a range of delays and frequencies. Thus, it is possible that naturally occurring reinforcement contingencies are arranged in ways different from those typically evaluated in applied research. Further, these complex response–stimulus relations can be represented by lag-sequential analyses. However, limitations to the lag-sequential analysis are evident. PMID:19949537

An electrophysiological investigation of reinforcement effects in attention deficit/hyperactivity disorder: Dissociating cue sensitivity from down-stream effects on target engagement and performance.

PubMed

Chronaki, Georgia; Soltesz, Fruzsina; Benikos, Nicholas; Sonuga-Barke, Edmund J S

2017-12-01

Neural hypo-sensitivity to cues predicting positive reinforcement has been observed in ADHD using the Monetary Incentive Delay (MID) task. Here we report the first study using an electrophysiological analogue of this task to distinguish between (i) cue related anticipation of reinforcement and downstream effects on (ii) target engagement and (iii) performance in a clinical sample of adolescents with ADHD and controls. Thirty-one controls and 32 adolescents with ADHD aged 10-16 years performed the electrophysiological (e)-MID task - in which preparatory cues signal whether a response to an upcoming target will be reinforced or not - under three conditions; positive reinforcement, negative reinforcement (response cost) and no consequence (neutral). We extracted values for both cue-related potentials known to be, both, associated with response preparation and modulated by reinforcement (Cue P3 and Cue CNV) and target-related potentials (target P3) and compared these between ADHD and controls. ADHD and controls did not differ on cue-related components on neutral trials. Against expectation, adolescents with ADHD displayed Cue P3 and Cue CNV reinforcement-related enhancement (versus neutral trials) compared to controls. ADHD individuals displayed smaller target P3 amplitudes and slower and more variable performance - but effects were not modulated by reinforcement contingencies. When age, IQ and conduct problems were controlled effects were marginally significant but the pattern of results did not change. ADHD was associated with hypersensitivity to positive (and marginally negative) reinforcement reflected on components often thought to be associated with response preparation - however these did not translate into improved attention to targets. In the case of ADHD, upregulated CNV may be a specific marker of hyper-arousal rather than an enhancement of anticipatory attention to upcoming targets. Future studies should examine the effects of age, IQ and conduct problems on reinforcement sensitivity in ADHD. Copyright © 2017 The Authors. Published by Elsevier Ltd.. All rights reserved.

A neural model of hierarchical reinforcement learning

PubMed Central

Rasmussen, Daniel; Eliasmith, Chris

2017-01-01

We develop a novel, biologically detailed neural model of reinforcement learning (RL) processes in the brain. This model incorporates a broad range of biological features that pose challenges to neural RL, such as temporally extended action sequences, continuous environments involving unknown time delays, and noisy/imprecise computations. Most significantly, we expand the model into the realm of hierarchical reinforcement learning (HRL), which divides the RL process into a hierarchy of actions at different levels of abstraction. Here we implement all the major components of HRL in a neural model that captures a variety of known anatomical and physiological properties of the brain. We demonstrate the performance of the model in a range of different environments, in order to emphasize the aim of understanding the brain’s general reinforcement learning ability. These results show that the model compares well to previous modelling work and demonstrates improved performance as a result of its hierarchical ability. We also show that the model’s behaviour is consistent with available data on human hierarchical RL, and generate several novel predictions. PMID:28683111

Do Pigeons Prefer Information in the Absence of Differential Reinforcement?

PubMed Central

Zentall, Thomas R.; Stagner, Jessica P.

2012-01-01

Prior research indicates that pigeons do not prefer an alternative that provides a sample (for matching-to-sample) over an alternative that does not provide a sample (i.e., there is no indication of which comparison stimulus is correct). However, Zentall and Stagner (2010) showed that when delay of reinforcement was controlled, pigeons had a strong preference for matching over pseudo-matching (there was a sample but it did not indicate which comparison stimulus was correct). Experiment 1 of the present study replicated and extended the results of the Zentall and Stagner study by including an identity relation between the sample and one of the comparison stimuli in both the matching and pseudo-matching tasks. In Experiment 2, when we asked if the pigeons would still prefer matching if we equated the two tasks for probability of reinforcement, we found no systematic preference for matching over pseudo-matching. Thus, it appears that in the absence of differential reinforcement, the information provided by a sample that signals which of the two comparison stimuli is correct is insufficient to produce a preference for that alternative. PMID:22367755

Reinforcement learning state estimator.

PubMed

Morimoto, Jun; Doya, Kenji

2007-03-01

In this study, we propose a novel use of reinforcement learning for estimating hidden variables and parameters of nonlinear dynamical systems. A critical issue in hidden-state estimation is that we cannot directly observe estimation errors. However, by defining errors of observable variables as a delayed penalty, we can apply a reinforcement learning frame-work to state estimation problems. Specifically, we derive a method to construct a nonlinear state estimator by finding an appropriate feedback input gain using the policy gradient method. We tested the proposed method on single pendulum dynamics and show that the joint angle variable could be successfully estimated by observing only the angular velocity, and vice versa. In addition, we show that we could acquire a state estimator for the pendulum swing-up task in which a swing-up controller is also acquired by reinforcement learning simultaneously. Furthermore, we demonstrate that it is possible to estimate the dynamics of the pendulum itself while the hidden variables are estimated in the pendulum swing-up task. Application of the proposed method to a two-linked biped model is also presented.

Opposing acute and chronic behavioural effects of a beta-blocker, propranolol, in the rat.

PubMed

Salmon, P; Gray, J A

1985-01-01

Rats were trained over 40 days to lever-press for food reward under a schedule of differential reinforcement of low rates of response with a 20-s criterion (DRL 20), following seven sessions of continuous reinforcement. The effect of injecting a beta-adrenergic blocker, propranolol (5 mg/kg IP), before and at two different delays after each daily session of DRL were investigated. In Experiment I, rats drugged 5-8 min before every session earned fewer reinforcements compared to controls, and showed impaired temporal discrimination. In Experiment II, this result was not replicated, but similar effects were clear in animals drugged pre-session from the 15th day of acquisition. By contrast, an improved temporal discrimination, and increased number of reinforcements were seen in rats drugged 5-8 min after every session. In Experiment III, the post-session effects were replicated and found also in rats drugged 4-5.5 h after each session. These results suggest that propranolol has an acute effect on DRL responding which resembles that of anxiolytics, and a chronic effect which opposes the acute one.

Summation of reinforcement rates when conditioned stimuli are presented in compound.

PubMed

Andrew, Benjamin J; Harris, Justin A

2011-10-01

Three experiments used delay conditioning of magazine approach in rats to examine the summation of responding when two conditioned stimuli (CSs) are presented together as a compound. The duration of each CS varied randomly from trial-to-trial around a mean that differed between the CSs. This meant that the rats' response rate to each CS was systematically related to the reinforcement rate of that CS, but remained steady as time elapsed during the CS (Harris & Carpenter, 2011; Harris, Gharaei, & Pincham, 2011). When the rats were presented with a compound of two CSs that had been conditioned separately, they responded more during the compound than during either of the CSs individually. More significantly, however, in all three experiments, the rats responded to the compound at the same rate as they responded to a third CS that had been reinforced at a rate equal to the sum of the reinforcement rates of the two CSs in compound. We discuss the implications of this finding for associative models (e.g., Rescorla & Wagner, 1972) and rate-based models (Gallistel & Gibbon, 2000) of conditioning.

One Time Passwords in Everything (OPIE): Experiences with Building and Using Stringer Authentication

DTIC Science & Technology

1995-01-01

opiepasswd(1). The name change brings it more in line with its UNIX counterpart passwd (1), which should make both programs easier to remember for users. This...char * passwd ) int opiehash(char *x, unsigned algorithm) The one-time password schemes implemented in OPIE, as rst described in [Hal94], compute a...seed, passwd ); while (sequence-- != 0) opiehash(result, algorithm); opiebtoe(result,words); Send words. : : : 6 Deployment Every machine that has

Discrimination training facilitates pigeons' performance on one-trial-per-day delayed matching of key location

PubMed Central

Willson, Robert J.; Wilkie, Donald M.

1991-01-01

Six pigeons were tested on a one-trial-per-day variant of delayed matching of key location. In one condition, a trial began with the illumination of a pair of quasi-randomly selected pecking keys in a large 10-key test box. Pigeons' pecks to one key (the sample) were reinforced with 8-second access to grain on a variable-interval 30-second schedule, whereas pecks to the other key (the distractor) had no scheduled consequences. In the second condition, the nonreinforced distractor was not presented. In both conditions, subjects were removed from the apparatus after 15 minutes and placed in a holding cage. Subjects were subsequently replaced in the box after a delay (retention interval) of 30 seconds and were reexposed to the illuminated sample and distractor keys for 1 minute. If a pigeon made more pecks to the sample during this interval, the distractor was extinguished and subsequent pecks to the sample were reinforced on the previous schedule for an additional 15 minutes. If, however, a pigeon made more pecks to the distractor, both keys were extinguished and the subject was returned to its home cage. For all subjects, matching-to-sample accuracy was higher in the first condition. In a second experiment, the retention interval was increased to 5, 15, and 30 minutes, and then to 1, 2, 4, 8, 12, and 24 hours. Most subjects remembered the correct key location for up to 4 hours, and in one case, up to 24 hours, demonstrating a spatial-memory proficiency far better than previously reported in this species on delayed matching tasks. The results are discussed in terms of the commonly held distinction between working and reference memory. PMID:16812633

Suppression of Cocaine Self-Administration in Monkeys: Effects of Delayed Punishment

PubMed Central

Woolverton, William L.; Freeman, Kevin B.; Myerson, Joel; Green, Leonard

2014-01-01

Rationale Delaying presentation of a drug can decrease its effectiveness as a reinforcer, but the effect of delaying punishment of drug self-administration is unknown. Objective This study examined whether a histamine injection could punish cocaine self-administration in a drug-drug choice, whether delaying histamine would decrease its effectiveness, and whether the effects of delay could be described within a delay discounting framework. Methods Monkeys were implanted with double-lumen catheters to allow separate injection of cocaine and histamine. In discrete trials, subjects first chose between cocaine (50 or 100 μg/kg/inj) alone and an injection of the same dose of cocaine followed immediately by an injection of histamine (0.37–50 μg/kg). Next, they chose between cocaine followed immediately by histamine and cocaine followed by an equal but delayed dose of histamine. Results When choosing between cocaine alone and cocaine followed immediately by histamine, preference increased with histamine dose from indifference to > 80% choice of cocaine alone. When choosing between cocaine followed by immediate histamine and cocaine followed by delayed histamine, monkeys showed strong position preferences. When delayed histamine was associated with the non-preferred position, preference for that option increased with delay from ≤ 30% to > 85%. The corresponding decrease in choice of the preferred position was well described by a hyperboloid discounting function. Conclusions Histamine can function as a punisher in the choice between injections of cocaine and delay can decrease its effectiveness as a punisher. The effects of delaying punishment of drug self-administration can be conceptualized within the delay discounting framework. PMID:21956240

Suppression of cocaine self-administration in monkeys: effects of delayed punishment.

PubMed

Woolverton, William L; Freeman, Kevin B; Myerson, Joel; Green, Leonard

2012-04-01

Delaying presentation of a drug can decrease its effectiveness as a reinforcer, but the effect of delaying punishment of drug self-administration is unknown. This study examined whether a histamine injection could punish cocaine self-administration in a drug-drug choice, whether delaying histamine would decrease its effectiveness, and whether the effects of delay could be described within a delay discounting framework. Monkeys were implanted with double-lumen catheters to allow separate injection of cocaine and histamine. In discrete trials, subjects first chose between cocaine (50 or 100 μg/kg/inj) alone and an injection of the same dose of cocaine followed immediately by an injection of histamine (0.37-50 μg/kg). Next, they chose between cocaine followed immediately by histamine and cocaine followed by an equal but delayed dose of histamine. When choosing between cocaine alone and cocaine followed immediately by histamine, preference increased with histamine dose from indifference to >80% choice of cocaine alone. When choosing between cocaine followed by immediate histamine and cocaine followed by delayed histamine, monkeys showed strong position preferences. When delayed histamine was associated with the nonpreferred position, preference for that option increased with delay from ≤30% to >85%. The corresponding decrease in choice of the preferred position was well described by a hyperboloid discounting function. Histamine can function as a punisher in the choice between injections of cocaine and delay can decrease its effectiveness as a punisher. The effects of delaying punishment of drug self-administration can be conceptualized within the delay discounting framework.

Delay Discounting in Lewis and Fischer 344 Rats: Steady-State and Rapid-Determination Adjusting-Amount Procedures

ERIC Educational Resources Information Center

Stein, Jeffrey S.; Pinkston, Jonathan W.; Brewer, Adam T.; Francisco, Monica T.; Madden, Gregory J.

2012-01-01

Lewis rats have been shown to make more impulsive choices than Fischer 344 rats in discrete trial choice procedures that arrange fixed (i.e., nontitrating) reinforcement parameters. However, nontitrating procedures yield only gross estimates of preference, as choice measures in animal subjects are rarely graded at the level of the individual…

Psychopysics of Remembering: To Bias or Not to Bias?

ERIC Educational Resources Information Center

White, K. Geoffrey; Wixted, John T.

2010-01-01

Delayed matching to sample is typically a two-alternative forced-choice procedure with two sample stimuli. In this task the effects of varying the probability of reinforcers for correct choices and the resulting receiver operating characteristic are symmetrical. A version of the task where a sample is present on some trials and absent on others is…

The Effects of a Treatment Package in Establishing Independent Academic Work Skills in Children with Autism.

ERIC Educational Resources Information Center

Pelios, Lillian V.; MacDuff, Gregory S.; Axelrod, Saul

2003-01-01

This study evaluated a treatment package to improve on-task academic skills by three children with autism. Program components included delayed reinforcement for on-task and on-schedule responding, fading of instructional prompts and instructor's presence, unpredictable supervision, and response cost for off-task responding. On-task and on-schedule…

The Effects of a Concurrent Task on Human Optimization and Self Control

ERIC Educational Resources Information Center

Reed, Phil; Thompson, Caitlin; Osborne, Lisa A.; McHugh, Louise

2011-01-01

Memory deficits have been shown to hamper decision making in a number of populations. In two experiments, participants were required to select one of three alternatives that varied in reinforcer amount and delay, and the effect of a concurrent task on a behavioral choice task that involved making either an impulsive, self-controlled, or optimal…

Nondestructive Evaluation of Carbon Fiber Reinforced Polymer Composites Using Reflective Terahertz Imaging

PubMed Central

Zhang, Jin; Li, Wei; Cui, Hong-Liang; Shi, Changcheng; Han, Xiaohui; Ma, Yuting; Chen, Jiandong; Chang, Tianying; Wei, Dongshan; Zhang, Yumin; Zhou, Yufeng

2016-01-01

Terahertz (THz) time-domain spectroscopy (TDS) imaging is considered a nondestructive evaluation method for composite materials used for examining various defects of carbon fiber reinforced polymer (CFRP) composites and fire-retardant coatings in the reflective imaging modality. We demonstrate that hidden defects simulated by Teflon artificial inserts are imaged clearly in the perpendicular polarization mode. The THz TDS technique is also used to measure the thickness of thin fire-retardant coatings on CFRP composites with a typical accuracy of about 10 micrometers. In addition, coating debonding is successfully imaged based on the time-delay difference of the time-domain waveforms between closely adhered and debonded sample locations. PMID:27314352

The effects of reward and punishment on reaction times and autonomic activity in hyperactive and normal children.

PubMed

Firestone, P; Douglas, V

1975-01-01

The performance of hyperactive and control children was compared on a delayed reaction time task under three reinforcement conditions: reward, punishment, and reward plus punishment. Hyperactives had slower and more variable reaction times, suggesting an attentional deficit. Although each of the three reinforcement conditons was successful in improving reaction times for both subject groups, reward led to a significant increase in impulsive responses in the hyperactive children. Autonomic data revealed that reward also increased arousal to a greater extent than punishment or reward plus punishment. Although resting skin conductance was not different in the two groups of subjects, hyperactives produced fewer specific autonomic responses to signal stimuli.

Dynamics of rapid dopamine release in the nucleus accumbens during goal-directed behaviors for cocaine versus natural rewards

PubMed Central

Cameron, Courtney M.; Wightman, R. Mark; Carelli, Regina M.

2014-01-01

Electrophysiological studies show that distinct subsets of nucleus accumbens (NAc) neurons differentially encode information about goal-directed behaviors for intravenous cocaine versus natural (food/water) rewards. Further, NAc rapid dopamine signaling occurs on a timescale similar to phasic cell firing during cocaine and natural reward-seeking behaviors. However, it is not known whether dopamine signaling is reinforcer specific (i.e., is released during responding for only one type of reinforcer) within discrete NAc locations, similar to neural firing dynamics. Here, fast-scan cyclic voltammetry (FSCV) was used to measure rapid dopamine release during multiple schedules involving sucrose reward and cocaine self-administration (n=8 rats) and, in a separate group of rats (n = 6), during a sucrose/food multiple schedule. During the sucrose/cocaine multiple schedule, dopamine increased within seconds of operant responding for both reinforcers. Although dopamine release was not reinforcer specific, more subtle differences were observed in peak dopamine concentration [DA] across reinforcer conditions. Specifically, peak [DA] was higher during the first phase of the multiple schedule, regardless of reinforcer type. Further, the time to reach peak [DA] was delayed during cocaine-responding compared to sucrose. During the sucrose/food multiple schedule, increases in dopamine release were also observed relative to operant responding for both natural rewards. However, peak [DA] was higher relative to responding for sucrose than food, regardless of reinforcer order. Overall, the results reveal the dynamics of rapid dopamine signaling in discrete locations in the NAc across reward conditions, and provide novel insight into the functional role of this system in reward-seeking behaviors. PMID:25174553

Evaluating Behavioral Economic Models of Heavy Drinking Among College Students.

PubMed

Acuff, Samuel F; Soltis, Kathryn E; Dennhardt, Ashley A; Berlin, Kristoffer S; Murphy, James G

2018-05-14

Heavy drinking among college students is a significant public health concern that can lead to profound social and health consequences, including alcohol use disorder. Behavioral economics posits that low future orientation and high valuation of alcohol (alcohol demand) combined with deficits in alternative reinforcement increase the likelihood of alcohol misuse (Bickel et al., 2011). Despite this, no study has examined the incremental utility of all three variables simultaneously in a comprehensive model METHOD: The current study uses structural equation modeling to test the associations between behavioral economic variables - alcohol demand (latent), future orientation (measured with a delay discounting task and the Consideration of Future Consequences (CFC) scale), and proportionate substance-related reinforcement - and alcohol consumption and problems among 393 heavy drinking college students. Two models are tested: 1) an iteration of the reinforcer pathology model that includes an interaction between future orientation and alcohol demand; and 2) an alternative model evaluating the interconnectedness of behavioral economic variables in predicting problematic alcohol use RESULTS: The interaction effects in model 1 were nonsignificant. Model 2 suggests that greater alcohol demand and proportionate substance-related reinforcement is associated with greater alcohol consumption and problems. Further, CFC was associated with alcohol-related problems and lower proportionate substance-related reinforcement but was not significantly associated with alcohol consumption or alcohol demand. Finally, greater proportionate substance-related reinforcement was associated with greater alcohol demand CONCLUSIONS: Our results support the validity of the behavioral economic reinforcer pathology model as applied to young adult heavy drinking. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

Automated 3-D method for the correction of axial artifacts in spectral-domain optical coherence tomography images

PubMed Central

Antony, Bhavna; Abràmoff, Michael D.; Tang, Li; Ramdas, Wishal D.; Vingerling, Johannes R.; Jansonius, Nomdo M.; Lee, Kyungmoo; Kwon, Young H.; Sonka, Milan; Garvin, Mona K.

2011-01-01

The 3-D spectral-domain optical coherence tomography (SD-OCT) images of the retina often do not reflect the true shape of the retina and are distorted differently along the x and y axes. In this paper, we propose a novel technique that uses thin-plate splines in two stages to estimate and correct the distinct axial artifacts in SD-OCT images. The method was quantitatively validated using nine pairs of OCT scans obtained with orthogonal fast-scanning axes, where a segmented surface was compared after both datasets had been corrected. The mean unsigned difference computed between the locations of this artifact-corrected surface after the single-spline and dual-spline correction was 23.36 ± 4.04 μm and 5.94 ± 1.09 μm, respectively, and showed a significant difference (p < 0.001 from two-tailed paired t-test). The method was also validated using depth maps constructed from stereo fundus photographs of the optic nerve head, which were compared to the flattened top surface from the OCT datasets. Significant differences (p < 0.001) were noted between the artifact-corrected datasets and the original datasets, where the mean unsigned differences computed over 30 optic-nerve-head-centered scans (in normalized units) were 0.134 ± 0.035 and 0.302 ± 0.134, respectively. PMID:21833377

Positive reinforcement modulates fronto-limbic systems subserving emotional interference in adolescents.

PubMed

Ladouceur, Cecile D; Schlund, Michael W; Segreti, Anna-Maria

2018-02-15

Fronto-limbic systems play an important role in supporting resistance to emotional distraction to promote goal-directed behavior. Despite evidence that alterations in the functioning of these systems are implicated in developmental trajectories of psychopathology, most studies have been conducted in adults. This study examined the functioning of fronto-limbic systems subserving emotional interference in adolescents and whether differential reinforcement of correct responding can modulate these neural systems in ways that could promote resistance to emotional distraction. Fourteen healthy adolescents (ages 9-15) completed an emotional delayed working memory task during fMRI with emotional distracters (none, neutral, negative) while positive reinforcement (i.e., monetary reward) was provided for correct responses under some conditions. Adolescents showed slightly reduced behavioral performance and greater activation in amygdala and prefrontal cortical regions (ventrolateral, ventromedial, dorsolateral) on correct trials with negative distracters compared to those with no or neutral distracters. Positive reinforcement yielded an overall improvement in accuracy and reaction times and counteracted the effects of negative distracters as evidenced by significant reductions in activation in key fronto-limbic regions. The present findings extend results on emotional interference from adults to adolescents and suggest that positive reinforcement could be used to potentially promote insulation from emotional distraction. A challenge for the future will be to build upon these findings for constructing reinforcement-based attention training programs that could be used to reduce emotional attention biases in anxious youth. Copyright © 2017 Elsevier B.V. All rights reserved.

Teaching Children with Autism Using Conditioned Cue-Value and Response-Marking Procedures: A Socially Valid Procedure

ERIC Educational Resources Information Center

Grindle, Corinna F.; Remington, Bob

2004-01-01

Five children with autism were taught to match printed words to corresponding pictures. Participants' speed of learning was compared across three training conditions, each involving a 5-s delay of reinforcement, using a within-participants alternating treatments design. In the cue-value condition, a verbal phrase of approval (e.g., "good!") was…

Preference for Progressive Delays and Concurrent Physical Therapy Exercise in an Adult with Acquired Brain Injury

ERIC Educational Resources Information Center

Dixon, Mark R.; Falcomata, Terry S.

2004-01-01

The purpose of this study was to increase self-control and engagement in a physical therapy task (head holding) for a man with acquired traumatic brain injury. Once impulsivity was observed (i.e., repeated impulsive choices), an experimental condition was introduced that consisted of choices between a small immediate reinforcer, a large…

Helicopter Fatigue Design Guide

DTIC Science & Technology

1983-11-01

for example, glass and carbon fibre reinforced plastics. The general principles behind the substantiation procedures for these materials are...initiating cause of many minor (and sometimes major) cracks that can lead to expensive repair, even though they may not immediately cause a safety...be seen, blade stresses correlated well with both unsteady models. However, push rod loads calculated with the Time Delay Model are much less than

Implementation study of an analog spiking neural network for assisting cardiac delay prediction in a cardiac resynchronization therapy device.

PubMed

Sun, Qing; Schwartz, François; Michel, Jacques; Herve, Yannick; Dalmolin, Renzo

2011-06-01

In this paper, we aim at developing an analog spiking neural network (SNN) for reinforcing the performance of conventional cardiac resynchronization therapy (CRT) devices (also called biventricular pacemakers). Targeting an alternative analog solution in 0.13- μm CMOS technology, this paper proposes an approach to improve cardiac delay predictions in every cardiac period in order to assist the CRT device to provide real-time optimal heartbeats. The primary analog SNN architecture is proposed and its implementation is studied to fulfill the requirement of very low energy consumption. By using the Hebbian learning and reinforcement learning algorithms, the intended adaptive CRT device works with different functional modes. The simulations of both learning algorithms have been carried out, and they were shown to demonstrate the global functionalities. To improve the realism of the system, we introduce various heart behavior models (with constant/variable heart rates) that allow pathologic simulations with/without noise on the signals of the input sensors. The simulations of the global system (pacemaker models coupled with heart models) have been investigated and used to validate the analog spiking neural network implementation.

Mediodorsal Thalamic Neurons Mirror the Activity of Medial Prefrontal Neurons Responding to Movement and Reinforcement during a Dynamic DNMTP Task

PubMed Central

Miller, Rikki L.A.

2017-01-01

Abstract The mediodorsal nucleus (MD) interacts with medial prefrontal cortex (mPFC) to support learning and adaptive decision-making. MD receives driver (layer 5) and modulatory (layer 6) projections from PFC and is the main source of driver thalamic projections to middle cortical layers of PFC. Little is known about the activity of MD neurons and their influence on PFC during decision-making. We recorded MD neurons in rats performing a dynamic delayed nonmatching to position (dDNMTP) task and compared results to a previous study of mPFC with the same task (Onos et al., 2016). Criterion event-related responses were observed for 22% (254/1179) of neurons recorded in MD, 237 (93%) of which exhibited activity consistent with mPFC response types. More MD than mPFC neurons exhibited responses related to movement (45% vs. 29%) and reinforcement (51% vs. 27%). MD had few responses related to lever presses, and none related to preparation or memory delay, which constituted 43% of event-related activity in mPFC. Comparison of averaged normalized population activity and population response times confirmed the broad similarity of common response types in MD and mPFC and revealed differences in the onset and offset of some response types. Our results show that MD represents information about actions and outcomes essential for decision-making during dDNMTP, consistent with evidence from lesion studies that MD supports reward-based learning and action-selection. These findings support the hypothesis that MD reinforces task-relevant neural activity in PFC that gives rise to adaptive behavior. PMID:29034318

Mediodorsal Thalamic Neurons Mirror the Activity of Medial Prefrontal Neurons Responding to Movement and Reinforcement during a Dynamic DNMTP Task.

PubMed

Miller, Rikki L A; Francoeur, Miranda J; Gibson, Brett M; Mair, Robert G

2017-01-01

The mediodorsal nucleus (MD) interacts with medial prefrontal cortex (mPFC) to support learning and adaptive decision-making. MD receives driver (layer 5) and modulatory (layer 6) projections from PFC and is the main source of driver thalamic projections to middle cortical layers of PFC. Little is known about the activity of MD neurons and their influence on PFC during decision-making. We recorded MD neurons in rats performing a dynamic delayed nonmatching to position (dDNMTP) task and compared results to a previous study of mPFC with the same task (Onos et al., 2016). Criterion event-related responses were observed for 22% (254/1179) of neurons recorded in MD, 237 (93%) of which exhibited activity consistent with mPFC response types. More MD than mPFC neurons exhibited responses related to movement (45% vs. 29%) and reinforcement (51% vs. 27%). MD had few responses related to lever presses, and none related to preparation or memory delay, which constituted 43% of event-related activity in mPFC. Comparison of averaged normalized population activity and population response times confirmed the broad similarity of common response types in MD and mPFC and revealed differences in the onset and offset of some response types. Our results show that MD represents information about actions and outcomes essential for decision-making during dDNMTP, consistent with evidence from lesion studies that MD supports reward-based learning and action-selection. These findings support the hypothesis that MD reinforces task-relevant neural activity in PFC that gives rise to adaptive behavior.

Impact of stimulus format and reward value on quantity discrimination in capuchin and squirrel monkeys.

PubMed

Gazes, Regina Paxton; Billas, Alison R; Schmitt, Vanessa

2018-03-01

Quantity discrimination abilities are seen in a diverse range of species with similarities in performance patterns, suggesting common underlying cognitive mechanisms. However, methodological factors that impact performance make it difficult to draw broad phylogenetic comparisons of numerical cognition across studies. For example, some Old World monkeys selected a higher quantity stimulus more frequently when choosing between inedible (pebbles) than edible (food) stimuli. In Experiment 1 we presented brown capuchin (Cebus [Sapajus] paella) and squirrel monkeys (Saimiri sciureus) with the same two-choice quantity discrimination task in three different stimulus conditions: edible, inedible, and edible replaced (in which choice stimuli were food items that stood in for the same quantity of food items that were given as a reward). Unlike Old World monkeys, capuchins selected the higher quantity stimulus more in the edible condition and squirrel monkeys showed generally poor performance across all stimulus types. Performance patterns suggested that differences in subjective reward value might motivate differences in choice behavior between and within species. In Experiment 2 we manipulated the subjective reinforcement value of the reward by varying reward type and delay to reinforcement and found that delay to reinforcement had no impact on choice behavior, while increasing the value of the reward significantly improved performance by both species. The results of this study indicate that species presented with identical tasks may respond differently to methodological factors such as stimulus and reward types, resulting in significant differences in choice behavior that may lead to spurious suggestions of species differences in cognitive abilities.

Excitotoxic lesions of the medial striatum delay extinction of a reinforcement color discrimination operant task in domestic chicks; a functional role of reward anticipation.

PubMed

Ichikawa, Yoko; Izawa, Ei-Ichi; Matsushima, Toshiya

2004-12-01

To reveal the functional roles of the striatum, we examined the effects of excitotoxic lesions to the bilateral medial striatum (mSt) and nucleus accumbens (Ac) in a food reinforcement color discrimination operant task. With a food reward as reinforcement, 1-week-old domestic chicks were trained to peck selectively at red and yellow beads (S+) and not to peck at a blue bead (S-). Those chicks then received either lesions or sham operations and were tested in extinction training sessions, during which yellow turned out to be nonrewarding (S-), whereas red and blue remained unchanged. To further examine the effects on postoperant noninstrumental aspects of behavior, we also measured the "waiting time", during which chicks stayed at the empty feeder after pecking at yellow. Although the lesioned chicks showed significantly higher error rates in the nonrewarding yellow trials, their postoperant waiting time gradually decreased similarly to the sham controls. Furthermore, the lesioned chicks waited significantly longer than the controls, even from the first extinction block. In the blue trials, both lesioned and sham chicks consistently refrained from pecking, indicating that the delayed extinction was not due to a general disinhibition of pecking. Similarly, no effects were found in the novel training sessions, suggesting that the lesions had selective effects on the extinction of a learned operant. These results suggest that a neural representation of memory-based reward anticipation in the mSt/Ac could contribute to the anticipation error required for extinction.

A Review on Strengthening Steel Beams Using FRP under Fatigue

PubMed Central

Jumaat, Mohd Zamin; Ramli Sulong, N. H.

2014-01-01

In recent decades, the application of fibre-reinforced polymer (FRP) composites for strengthening structural elements has become an efficient option to meet the increased cyclic loads or repair due to corrosion or fatigue cracking. Hence, the objective of this study is to explore the existing FRP reinforcing techniques to care for fatigue damaged structural steel elements. This study covers the surface treatment techniques, adhesive curing, and support conditions under cyclic loading including fatigue performance, crack propagation, and failure modes with finite element (FE) simulation of the steel bridge girders and structural elements. FRP strengthening composites delay initial cracking, reduce the crack growth rate, extend the fatigue life, and decrease the stiffness decay with residual deflection. Prestressed carbon fibre-reinforced polymer (CFRP) is the best strengthening option. End anchorage prevents debonding of the CRRP strips at the beam ends by reducing the local interfacial shear and peel stresses. Hybrid-joint, nanoadhesive, and carbon-flex can also be attractive for strengthening systems. PMID:25243221

A review on strengthening steel beams using FRP under fatigue.

PubMed

Kamruzzaman, Mohamed; Jumaat, Mohd Zamin; Sulong, N H Ramli; Islam, A B M Saiful

2014-01-01

In recent decades, the application of fibre-reinforced polymer (FRP) composites for strengthening structural elements has become an efficient option to meet the increased cyclic loads or repair due to corrosion or fatigue cracking. Hence, the objective of this study is to explore the existing FRP reinforcing techniques to care for fatigue damaged structural steel elements. This study covers the surface treatment techniques, adhesive curing, and support conditions under cyclic loading including fatigue performance, crack propagation, and failure modes with finite element (FE) simulation of the steel bridge girders and structural elements. FRP strengthening composites delay initial cracking, reduce the crack growth rate, extend the fatigue life, and decrease the stiffness decay with residual deflection. Prestressed carbon fibre-reinforced polymer (CFRP) is the best strengthening option. End anchorage prevents debonding of the CRRP strips at the beam ends by reducing the local interfacial shear and peel stresses. Hybrid-joint, nanoadhesive, and carbon-flex can also be attractive for strengthening systems.

Assessing the relationship between latent inhibition and the partial reinforcement extinction effect in autoshaping with rats.

PubMed

Boughner, Robert L; Papini, Mauricio R

2008-05-01

Results from a variety of independently run experiments suggest that latent inhibition (LI) and the partial reinforcement extinction effect (PREE) share underlying mechanisms. Experiment 1 tested this LI=PREE hypothesis by training the same set of rats in situations involving both nonreinforced preexposure to the conditioned stimulus (LI stage) and partial reinforcement training (PREE stage). Control groups were also included to assess both LI and the PREE. The results demonstrated a significant, but negative correlation between the size of the LI effect and that of the PREE. Experiment 2 extended this analysis to the effects on LI and the PREE of the anxiolytic benzodiazepine chlordiazepoxide (5 mg/kg, i.p.). Whereas chlordiazepoxide had no effect on LI, it delayed the onset of the PREE. No evidence in support of the LI=PREE hypothesis was obtained when these two learning phenomena were compared within the same experiment and under the same general conditions of training.

Investigation of geomagnetic field forecasting and fluid dynamics of the core

NASA Technical Reports Server (NTRS)

Benton, E. R. (Principal Investigator)

1981-01-01

The magnetic determination of the depth of the core-mantle boundary using MAGSAT data is discussed. Refinements to the approach of using the pole-strength of Earth to evaluate the radius of the Earth's core-mantle boundary are reported. The downward extrapolation through the electrically conducting mantle was reviewed. Estimates of an upper bound for the time required for Earth's liquid core to overturn completely are presented. High order analytic approximations to the unsigned magnetic flux crossing the Earth's surface are also presented.

Far Forward Life Support System (FFLSS) Phase II

DTIC Science & Technology

2001-05-01

button will clear audible, flashing , or constant red alarms. Pushing the Config button drops down to the Level 2 menu (bottom line of Figure 8). In...disabled. Again, with testing this audible noise can be disabled. The visual flashing or constant red cannot be disabled. Pushing Return goes back to Level...Calling PLOTPIXEL( x ,y) and PLOTLINE(xl,x2,yl,y2) is as simple as pushing the appropriate bytes (unsigned integers) onto the stack and jumping to the

Effects of muscimol, amphetamine, and DAMGO injected into the nucleus accumbens shell on food-reinforced lever pressing by undeprived rats.

PubMed

Stratford, Thomas R; Wirtshafter, David

2012-05-01

Previous studies have shown that large increases in food intake in nondeprived animals can be induced by injections of both the GABA(A) agonist muscimol and the μ-opioid agonist DAMGO into the nucleus accumbens shell (AcbSh), while injections of the catecholamine agonist amphetamine have little effect. In the current study we examined whether injections of these drugs are able to increase food-reinforced lever pressing in nondeprived rats. Twelve subjects were trained to lever press on a continuous reinforcement schedule while food deprived and were then tested after being placed back on ad libitum feeding. Under these conditions, responding was markedly increased by injections of either muscimol or DAMGO, although the onset of the effects of the latter drug was delayed by 30-40 min. In contrast, amphetamine injections failed to increase reinforced lever pressing, although they did enhance responding on a non-reinforced lever, presumably reflecting alterations in behavioral activation. These results demonstrate that stimulation of GABA(A) and μ-opioid receptors within the AcbSh is able to promote not only food intake, but also food-directed operant behavior. In contrast, stimulation of AcbSh dopamine receptors may enhance behavioral arousal, but does not appear to specifically potentiate behaviors directed toward food procurement. Copyright © 2012 Elsevier Inc. All rights reserved.

Deficient reinforcement learning in medial frontal cortex as a model of dopamine-related motivational deficits in ADHD.

PubMed

Silvetti, Massimo; Wiersema, Jan R; Sonuga-Barke, Edmund; Verguts, Tom

2013-10-01

Attention Deficit/Hyperactivity Disorder (ADHD) is a pathophysiologically complex and heterogeneous condition with both cognitive and motivational components. We propose a novel computational hypothesis of motivational deficits in ADHD, drawing together recent evidence on the role of anterior cingulate cortex (ACC) and associated mesolimbic dopamine circuits in both reinforcement learning and ADHD. Based on findings of dopamine dysregulation and ACC involvement in ADHD we simulated a lesion in a previously validated computational model of ACC (Reward Value and Prediction Model, RVPM). We explored the effects of the lesion on the processing of reinforcement signals. We tested specific behavioral predictions about the profile of reinforcement-related deficits in ADHD in three experimental contexts; probability tracking task, partial and continuous reward schedules, and immediate versus delayed rewards. In addition, predictions were made at the neurophysiological level. Behavioral and neurophysiological predictions from the RVPM-based lesion-model of motivational dysfunction in ADHD were confirmed by data from previously published studies. RVPM represents a promising model of ADHD reinforcement learning suggesting that ACC dysregulation might play a role in the pathogenesis of motivational deficits in ADHD. However, more behavioral and neurophysiological studies are required to test core predictions of the model. In addition, the interaction with different brain networks underpinning other aspects of ADHD neuropathology (i.e., executive function) needs to be better understood. Copyright © 2013 Elsevier Ltd. All rights reserved.

Reinforcement Learning Strategies for Clinical Trials in Non-small Cell Lung Cancer

PubMed Central

Zhao, Yufan; Zeng, Donglin; Socinski, Mark A.; Kosorok, Michael R.

2010-01-01

Summary Typical regimens for advanced metastatic stage IIIB/IV non-small cell lung cancer (NSCLC) consist of multiple lines of treatment. We present an adaptive reinforcement learning approach to discover optimal individualized treatment regimens from a specially designed clinical trial (a “clinical reinforcement trial”) of an experimental treatment for patients with advanced NSCLC who have not been treated previously with systemic therapy. In addition to the complexity of the problem of selecting optimal compounds for first and second-line treatments based on prognostic factors, another primary goal is to determine the optimal time to initiate second-line therapy, either immediately or delayed after induction therapy, yielding the longest overall survival time. A reinforcement learning method called Q-learning is utilized which involves learning an optimal regimen from patient data generated from the clinical reinforcement trial. Approximating the Q-function with time-indexed parameters can be achieved by using a modification of support vector regression which can utilize censored data. Within this framework, a simulation study shows that the procedure can extract optimal regimens for two lines of treatment directly from clinical data without prior knowledge of the treatment effect mechanism. In addition, we demonstrate that the design reliably selects the best initial time for second-line therapy while taking into account the heterogeneity of NSCLC across patients. PMID:21385164

An exploratory analysis of task-interspersal procedures while teaching object labels to children with autism.

PubMed

Volkert, Valerie M; Lerman, Dorothea C; Trosclair, Nicole; Addison, Laura; Kodak, Tiffany

2008-01-01

Research has demonstrated that interspersing mastered tasks with new tasks facilitates learning under certain conditions; however, little is known about factors that influence the effectiveness of this treatment strategy. The initial purpose of the current investigation was to evaluate the effects of similar versus dissimilar interspersed tasks while teaching object labels to children diagnosed with autism or developmental delays. We then conducted a series of exploratory analyses involving the type of reinforcer delivered for correct responses on trials with unknown or known object labels. Performance was enhanced under the interspersal condition only when either brief praise was delivered for all correct responses or presumably more preferred reinforcers were provided for performance on known trials rather than on unknown trials.

The fatigue behavior of an amorphous brittle composite material

NASA Astrophysics Data System (ADS)

Kumar, Brijesh

The use of poly methyl methacrylate (PMMA) based bone cement as a grouting agent for the in-vivo fixation of orthopaedic implants has been in practice for nearly fifty years. Fatigue failure of the bone cement has been identified as the primary cause of cement failure. Implant loosening due to the failure of the cement is one of the major reasons necessitating revision surgery. The need for a more fatigue resistant bone cement is well documented in the literature. One method of producing a more fatigue resistant bone cement is to reinforce it with short fibers. The fundamental purpose of this work was to investigate the possible improvement of the fatigue characteristics of bone cement provided by the following two types of fiber reinforcements: short flexible Polyethylene Terephalate (PET) fibers and stiff milled carbon fibers. It has been shown that the reinforcement of the bone cement with fibers provides substantial improvement of the fracture toughness of the bone cement. In this investigation the impact of fiber reinforcement on the fatigue properties of the bone cement was studied. The effects of the fiber reinforcement on the fatigue life of bone cement has been determined experimentally. Since fatigue characteristics are known to have considerable scatter, a methodology was developed to analyze the experimental data in a statistically rigorous manner. The effect of the fiber reinforcement on bone cement was also analyzed using a theoretical approach and by conducting extensive Scanning Electron Microscopy (SEM) of the fractured surfaces. The results of this study indicate that fiber reinforcement improves the fatigue life of bone cement at a very high level of reliability. This could potentially lead to a more fatigue tolerant bone cement, which would delay the need for revision surgery due to implant loosening.

Dynamics of rapid dopamine release in the nucleus accumbens during goal-directed behaviors for cocaine versus natural rewards.

PubMed

Cameron, Courtney M; Wightman, R Mark; Carelli, Regina M

2014-11-01

Electrophysiological studies show that distinct subsets of nucleus accumbens (NAc) neurons differentially encode information about goal-directed behaviors for intravenous cocaine versus natural (food/water) rewards. Further, NAc rapid dopamine signaling occurs on a timescale similar to phasic cell firing during cocaine and natural reward-seeking behaviors. However, it is not known whether dopamine signaling is reinforcer specific (i.e., is released during responding for only one type of reinforcer) within discrete NAc locations, similar to neural firing dynamics. Here, fast-scan cyclic voltammetry (FSCV) was used to measure rapid dopamine release during multiple schedules involving sucrose reward and cocaine self-administration (n = 8 rats) and, in a separate group of rats (n = 6), during a sucrose/food multiple schedule. During the sucrose/cocaine multiple schedule, dopamine increased within seconds of operant responding for both reinforcers. Although dopamine release was not reinforcer specific, more subtle differences were observed in peak dopamine concentration [DA] across reinforcer conditions. Specifically, peak [DA] was higher during the first phase of the multiple schedule, regardless of reinforcer type. Further, the time to reach peak [DA] was delayed during cocaine-responding compared to sucrose. During the sucrose/food multiple schedule, increases in dopamine release were also observed relative to operant responding for both natural rewards. However, peak [DA] was higher relative to responding for sucrose than food, regardless of reinforcer order. Overall, the results reveal the dynamics of rapid dopamine signaling in discrete locations in the NAc across reward conditions, and provide novel insight into the functional role of this system in reward-seeking behaviors. Copyright © 2014 Elsevier Ltd. All rights reserved.

Why are Some Games More Addictive than Others: The Effects of Timing and Payoff on Perseverance in a Slot Machine Game.

PubMed

James, Richard J E; O'Malley, Claire; Tunney, Richard J

2016-01-01

Manipulating different behavioral characteristics of gambling games can potentially affect the extent to which individuals persevere at gambling, and their transition to problematic behaviors. This has potential impact for mobile gambling technologies and responsible gambling interventions. Two laboratory models pertinent to this are the partial reinforcement extinction effect (PREE) and the trial spacing effect. Both of these might speed up or delay the acquisition and extinction of conditioned behavior. We report an experiment that manipulated the rate of reinforcement and inter trial interval (ITI) on a simulated slot machine where participants were given the choice between gambling and skipping on each trial, before perseverative gambling was measured in extinction, followed by measurements of the illusion of control, depression and impulsivity. We hypothesized that longer ITI's in conjunction with the low rates of reinforcement observed in gambling would lead to greater perseverance. We further hypothesized, given that timing is known to be important in displaying illusory control and potentially in persevering in gambling, that prior exposure to longer intervals might affect illusions of control. An interaction between ITI and rate of reinforcement was observed, as low reinforced gamblers with a long ITI gambled for longer. Respondents also displayed extinction and a PREE. Gamblers exposed to a higher rate of reinforcement gambled for longer in acquisition. Impulsivity was associated with extended perseverance in extinction, and more depressed gamblers in the high reinforcement short ITI group persevered for longer. Performance in the contingency judgment failed to support the second hypothesis: the only significant contrast observed was that participants became better calibrated as the task progressed.

[Efficacy of the keyword mnemonic method in adults].

PubMed

Campos, Alfredo; Pérez-Fabello, María José; Camino, Estefanía

2010-11-01

Two experiments were used to assess the efficacy of the keyword mnemonic method in adults. In Experiment 1, immediate and delayed recall (at a one-day interval) were assessed by comparing the results obtained by a group of adults using the keyword mnemonic method in contrast to a group using the repetition method. The mean age of the sample under study was 59.35 years. Subjects were required to learn a list of 16 words translated from Latin into Spanish. Participants who used keyword mnemonics that had been devised by other experimental participants of the same characteristics, obtained significantly higher immediate and delayed recall scores than participants in the repetition method. In Experiment 2, other participants had to learn a list of 24 Latin words translated into Spanish by using the keyword mnemonic method reinforced with pictures. Immediate and delayed recall were significantly greater in the keyword mnemonic method group than in the repetition method group.

Cyclone '78 in Sri Lanka--the mental health trail.

PubMed

Patrick, V; Patrick, W K

1981-03-01

A longitudinal study of psychological disturbance in the affected population in Sri Lanka after the cyclone disaster of 1978 was carried out. The post-cyclonic stress identified among the rural communities after their return to the same destroyed environment was studied. Symptoms tended to be early or delayed in appearance. The degree of unpreparedness is postulated as the causes of the former. Group cohesiveness and feelings of community tended to delay the manifestation of symptoms. Realization of losses, family needs, and continued habitation in damaged homes acted as reminders and reinforcers. Morbidity continued to affect over half the population one year later. Early intervention within community settings after such disasters is recommended.

Changing delay discounting in the light of the competing neurobehavioral decision systems theory: a review.

PubMed

Koffarnus, Mikhail N; Jarmolowicz, David P; Mueller, E Terry; Bickel, Warren K

2013-01-01

Excessively devaluing delayed reinforcers co-occurs with a wide variety of clinical conditions such as drug dependence, obesity, and excessive gambling. If excessive delay discounting is a trans-disease process that underlies the choice behavior leading to these and other negative health conditions, efforts to change an individual's discount rate are arguably important. Although discount rate is often regarded as a relatively stable trait, descriptions of interventions and environmental manipulations that successfully alter discount rate have begun to appear in the literature. In this review, we compare published examples of procedures that change discount rate and classify them into categories of procedures, including therapeutic interventions, direct manipulation of the executive decision-making system, framing effects, physiological state effects, and acute drug effects. These changes in discount rate are interpreted from the perspective of the competing neurobehavioral decision systems theory, which describes a combination of neurological and behavioral processes that account for delay discounting. We also suggest future directions that researchers could take to identify the mechanistic processes that allow for changes in discount rate and to test whether the competing neurobehavioral decision systems view of delay discounting is correct. © Society for the Experimental Analysis of Behavior.

A general theory of intertemporal decision-making and the perception of time.

PubMed

Namboodiri, Vijay M K; Mihalas, Stefan; Marton, Tanya M; Hussain Shuler, Marshall G

2014-01-01

Animals and humans make decisions based on their expected outcomes. Since relevant outcomes are often delayed, perceiving delays and choosing between earlier vs. later rewards (intertemporal decision-making) is an essential component of animal behavior. The myriad observations made in experiments studying intertemporal decision-making and time perception have not yet been rationalized within a single theory. Here we present a theory-Training-Integrated Maximized Estimation of Reinforcement Rate (TIMERR)-that explains a wide variety of behavioral observations made in intertemporal decision-making and the perception of time. Our theory postulates that animals make intertemporal choices to optimize expected reward rates over a limited temporal window which includes a past integration interval-over which experienced reward rate is estimated-as well as the expected delay to future reward. Using this theory, we derive mathematical expressions for both the subjective value of a delayed reward and the subjective representation of the delay. A unique contribution of our work is in finding that the past integration interval directly determines the steepness of temporal discounting and the non-linearity of time perception. In so doing, our theory provides a single framework to understand both intertemporal decision-making and time perception.

A general theory of intertemporal decision-making and the perception of time

PubMed Central

Namboodiri, Vijay M. K.; Mihalas, Stefan; Marton, Tanya M.; Hussain Shuler, Marshall G.

2014-01-01

Animals and humans make decisions based on their expected outcomes. Since relevant outcomes are often delayed, perceiving delays and choosing between earlier vs. later rewards (intertemporal decision-making) is an essential component of animal behavior. The myriad observations made in experiments studying intertemporal decision-making and time perception have not yet been rationalized within a single theory. Here we present a theory—Training-Integrated Maximized Estimation of Reinforcement Rate (TIMERR)—that explains a wide variety of behavioral observations made in intertemporal decision-making and the perception of time. Our theory postulates that animals make intertemporal choices to optimize expected reward rates over a limited temporal window which includes a past integration interval—over which experienced reward rate is estimated—as well as the expected delay to future reward. Using this theory, we derive mathematical expressions for both the subjective value of a delayed reward and the subjective representation of the delay. A unique contribution of our work is in finding that the past integration interval directly determines the steepness of temporal discounting and the non-linearity of time perception. In so doing, our theory provides a single framework to understand both intertemporal decision-making and time perception. PMID:24616677

Changing Delay Discounting in the Light of the Competing Neurobehavioral Decision Systems Theory: a Review

PubMed Central

Koffarnus, Mikhail N.; Jarmolowicz, David P.; Mueller, E. Terry; Bickel, Warren K.

2014-01-01

Excessively devaluing delayed reinforcers co-occurs with a wide variety of clinical conditions such as drug dependence, obesity, and excessive gambling. If excessive delay discounting is a trans-disease process that underlies the choice behavior leading to these and other negative health conditions, efforts to change an individual’s discount rate are arguably important. Although discount rate is often regarded as a relatively stable trait, descriptions of interventions and environmental manipulations that successfully alter discount rate have begun to appear in the literature. In this review, we compare published examples of procedures that change discount rate and classify them into categories of procedures, including therapeutic interventions, direct manipulation of the executive decision-making system, framing effects, physiological state effects, and acute drug effects. These changes in discount rate are interpreted from the perspective of the competing neurobehavioral decision systems theory, which describes a combination of neurological and behavioral processes that account for delay discounting. We also suggest future directions that researchers could take to identify the mechanistic processes that allow for changes in discount rate and to test whether the competing neurobehavioral decision systems view of delay discounting is correct. PMID:23344987

Density and delay of punishment of free-operant avoidance1

PubMed Central

Baron, Alan; Kaufman, Arnold; Fazzini, Dan

1969-01-01

In two experiments, the free-operant shock-avoidance behavior of rats was punished by electric shock. Two aspects of the schedule of response-produced shock were varied: the frequency of punishment over time (punishment density) and the temporal interval between the punished response and the punishment (punishment delay). The general finding was that response-produced shock suppressed avoidance responding under most of the density-delay combinations studied, and suppression increased as a function of increases in density and decreases in delay. Rate increases of small magnitude also were observed, usually as an initial reaction to the lesser densities and longer delays. Response suppression, while decreasing the number of punishment shocks received, also increased the number of avoidance shocks, so that the total number of shocks received usually was greater than the minimal number possible. The results were discussed from the standpoint of similarities between the effects of punishing positively and negatively reinforced behavior. The finding that subjects did not minimize the total number of shocks suggested that when avoidance behavior is punished, responding is controlled more by the local consequences of responding than by overall shock frequencies during the course of the session. PMID:16811408

Effects of Differential Reinforcement of Short Latencies on Response Latency, Task Completion, and Accuracy of an Adolescent with Autism

ERIC Educational Resources Information Center

Donohue, Melanie M.; Casey, Laura Baylot; Bicard, David F.; Bicard, Sara E.

2012-01-01

Children with Autism Spectrum Disorder (ASD) are faced with many challenging behaviors that could impede their learning. One commonly reported problem behavior is noncompliance, which is often defined as a delay in response (latency), decrease in rate of responding (fluency), or failure to complete a task. This failure to comply in an appropriate…

Learning and Memory Enhancement by Neuropeptides

DTIC Science & Technology

1987-12-31

extxosure to other toxicants ,’e.g. other heavy metals, organic solvents), or arising from disease statee. We study leaming ii, an autoshaping task...Sparber, S.B. Selective leaming impairment of j delayed reinforcement autoshaped behavior caused by low doses of trimethyltin. S EPsychopharn-.acology...impairs acquis:tion of autoshaped behavior, whether given before or after training sessions. manuscript des -")ing this work is in preparation, and an

Behavior Modification of Aggressive Behavior on a Nursery School Bus: A Case Study.1

ERIC Educational Resources Information Center

Whitehurst, Carol; Miller, Edward

1973-01-01

A case study is presented in which aggressive behavior of two pre-school boys on a nursery school bus was modified by the introduction of a negative punishment contingency in which the Ss were told they would be detained on the bus until the second time the bus passed their house (delay of reinforcement) if abusive behavior occurred. (Author)

Characterizing operant hyperactivity in the Spontaneously Hypertensive Rat

PubMed Central

2012-01-01

Background Operant hyperactivity, the emission of reinforced responses at an inordinately high rate, has been reported in children with ADHD and in the Spontaneously Hypertensive Rat (SHR), the most widely studied animal model of ADHD. The SHR emits behavior at hyperactive levels, relative to a normoactive strain, only when such behavior is seldom reinforced. Because of its dependence on rate of reinforcement, operant hyperactivity appears to be driven primarily by incentive motivation, not motoric capacity. This claim was evaluated in the present study using a novel strategy, based on the organization of behavior in bouts of reinforced responses separated by pauses. Method Male SHR, Wistar-Kyoto (WKY) and Wistar rats (WIS) were exposed each to a multiple variable-interval schedule of sucrose reinforcement (12, 24, 48, 96, and 192 s) between post-natal days (PND) 48 and 93. Responding in each schedule was examined in two epochs, PND 58-62 and 89-93. Parameters of response-reinforcement functions (Herrnstein's hyperbola) and bout-organized behavior were estimated in each epoch. Results SHR emitted higher response rates than WKY and WIS, but only when rate of reinforcement was low (fewer than 2 reinforcers per minute), and particularly in the second epoch. Estimates of Herrnstein's hyperbola parameters suggested the primacy of motivational over motoric factors driving the response-rate differential. Across epochs and schedules, a more detailed analysis of response bouts by SHR revealed that these were shorter than those by WKY, but more frequent than those by WKY and WIS. Differences in bout length subsided between epochs, but differences in bout-initiation rate were exacerbated. These results were interpreted in light of robust evidence linking changes in bout-organization parameters and experimental manipulations of motivation and response-reinforcement contingency. Conclusions Operant hyperactivity in SHR was confirmed. Although incentive motivation appears to play an important role in operant hyperactivity and motoric capacity cannot be ruled out as a factor, response-bout patterns suggest that operant hyperactivity is primarily driven by steeper delay-of-reinforcement gradients. Convergence of this conclusion with theoretical accounts of ADHD and with free-operant performance in children with ADHD supports the use of SHR as an animal model of ADHD. PMID:22277367

Effects of environmental and pharmacological manipulations on a novel delayed nonmatching-to-sample 'working memory' procedure in unrestrained rhesus monkeys.

PubMed

Hutsell, Blake A; Banks, Matthew L

2015-08-15

Working memory is a domain of 'executive function.' Delayed nonmatching-to-sample (DNMTS) procedures are commonly used to examine working memory in both human laboratory and preclinical studies. The aim was to develop an automated DNMTS procedure maintained by food pellets in rhesus monkeys using a touch-sensitive screen attached to the housing chamber. Specifically, the DNMTS procedure was a 2-stimulus, 2-choice recognition memory task employing unidimensional discriminative stimuli and randomized delay interval presentations. DNMTS maintained a delay-dependent decrease in discriminability that was independent of the retention interval distribution. Eliminating reinforcer availability during a single delay session or providing food pellets before the session did not systematically alter accuracy, but did reduce total choices. Increasing the intertrial interval enhanced accuracy at short delays. Acute Δ(9)-THC pretreatment produced delay interval-dependent changes in the forgetting function at doses that did not alter total choices. Acute methylphenidate pretreatment only decreased total choices. All monkeys were trained to perform NMTS at the 1s training delay within 60 days of initiating operant touch training. Furthermore, forgetting functions were reliably delay interval-dependent and stable over the experimental period (∼6 months). Consistent with previous studies, increasing the intertrial interval improved DNMTS performance, whereas Δ(9)-THC disrupted DNMTS performance independent of changes in total choices. Overall, the touchscreen-based DNMTS procedure described provides an efficient method for training and testing experimental manipulations on working memory in unrestrained rhesus monkeys. Copyright © 2015 Elsevier B.V. All rights reserved.

How much of reinforcement learning is working memory, not reinforcement learning? A behavioral, computational, and neurogenetic analysis

PubMed Central

Collins, Anne G. E.; Frank, Michael J.

2012-01-01

Instrumental learning involves corticostriatal circuitry and the dopaminergic system. This system is typically modeled in the reinforcement learning (RL) framework by incrementally accumulating reward values of states and actions. However, human learning also implicates prefrontal cortical mechanisms involved in higher level cognitive functions. The interaction of these systems remains poorly understood, and models of human behavior often ignore working memory (WM) and therefore incorrectly assign behavioral variance to the RL system. Here we designed a task that highlights the profound entanglement of these two processes, even in simple learning problems. By systematically varying the size of the learning problem and delay between stimulus repetitions, we separately extracted WM-specific effects of load and delay on learning. We propose a new computational model that accounts for the dynamic integration of RL and WM processes observed in subjects' behavior. Incorporating capacity-limited WM into the model allowed us to capture behavioral variance that could not be captured in a pure RL framework even if we (implausibly) allowed separate RL systems for each set size. The WM component also allowed for a more reasonable estimation of a single RL process. Finally, we report effects of two genetic polymorphisms having relative specificity for prefrontal and basal ganglia functions. Whereas the COMT gene coding for catechol-O-methyl transferase selectively influenced model estimates of WM capacity, the GPR6 gene coding for G-protein-coupled receptor 6 influenced the RL learning rate. Thus, this study allowed us to specify distinct influences of the high-level and low-level cognitive functions on instrumental learning, beyond the possibilities offered by simple RL models. PMID:22487033

Flow-diverter in radiation-induced skull base carotid blowout syndrome: do not write it off!

PubMed

Anil, Gopinathan; Zhang, Junwei; Ong, Yew Kwang; Hui, Francis

2017-10-01

Post-radiotherapy carotid blowout syndrome (CBS) of the skull base is a rare but often catastrophic complication of head and neck malignancies. The existing literature on the treatment of this condition with flow-diverting devices (FDD) is extremely limited and disappointing. We present a case of impending CBS in a patient previously irradiated for nasopharyngeal cancer that was successfully treated with use of multiple FDDs, adjunctive endonasal packing and delayed reinforcement with pedicled naso-septal flap, yielding an excellent outcome at 14-months follow-up. Notwithstanding the discouraging results in literature, our anecdotal experience suggests that endovascular reconstruction using FDD could be an option with long-term viability in post-radiotherapy CBS involving the skull base when reinforced with a vascularised naso-septal flap.

An Exploratory Analysis of Task-Interspersal Procedures While Teaching Object Labels to Children with Autism

PubMed Central

Volkert, Valerie M; Lerman, Dorothea C; Trosclair, Nicole; Addison, Laura; Kodak, Tiffany

2008-01-01

Research has demonstrated that interspersing mastered tasks with new tasks facilitates learning under certain conditions; however, little is known about factors that influence the effectiveness of this treatment strategy. The initial purpose of the current investigation was to evaluate the effects of similar versus dissimilar interspersed tasks while teaching object labels to children diagnosed with autism or developmental delays. We then conducted a series of exploratory analyses involving the type of reinforcer delivered for correct responses on trials with unknown or known object labels. Performance was enhanced under the interspersal condition only when either brief praise was delivered for all correct responses or presumably more preferred reinforcers were provided for performance on known trials rather than on unknown trials. PMID:18816973

Learing and Memory Enhancement by Neuropeptides

DTIC Science & Technology

1989-09-27

autoshaping task, in which rats learn to touch a lever to obtain food. Substantial progress towards the goals of the project were made, especially...impairment of "delayed reinforcement autoshaped behavior caused by low doses of trimethyltin, Psychxoharmacology 93(1987): 301-307. S.B. Sparber, C.A...impairs autoshaped learning. Behavioral and Neural Biolog 51 (1989)34-45. The following papers have been submitted for publication: b -~iL101 Rita B

Investigating the procedural variables that determine whether rats will display negative anticipatory contrast or positive induction.

PubMed

Weatherly, Jeffrey N; Nurnberger, Jeri T; Hanson, Brent C

2005-08-31

Previous studies have demonstrated that consumption of a low-valued food substance may decrease if access to a high-valued substance will soon be available (negative anticipatory contrast). Research has also demonstrated that responding for a low-valued reinforcer may increase if responding for a high-valued reinforcer will soon be possible (positive induction). The present experiment employed rats to respond in a procedure similar to that typically used to produce negative anticipatory contrast. The goal was to determine what factors contribute to when a contrast or an induction effect will occur. Based on previous research, the influence of auditory cues, temporal delays, food deprivation, and location of substance delivery were investigated. Auditory cues and temporal delays did little to influence whether subjects increased or decreased their consumption of 1% sucrose when access to 32% sucrose was upcoming. The appearance of contrast or induction was related to level of deprivation, with deprivation promoting induction. Which effect occurred also depended on whether subjects consumed the two substances from one spout in one location (induction) or from two different spouts in two different locations (contrast). The present results help identify the procedural link(s) between these two effects. They also provide insight to why positive induction may occur (i.e., higher-order place conditioning).

Open Source Tools for Temporally Controlled Rodent Behavior Suitable for Electrophysiology and Optogenetic Manipulations.

PubMed

Solari, Nicola; Sviatkó, Katalin; Laszlovszky, Tamás; Hegedüs, Panna; Hangya, Balázs

2018-01-01

Understanding how the brain controls behavior requires observing and manipulating neural activity in awake behaving animals. Neuronal firing is timed at millisecond precision. Therefore, to decipher temporal coding, it is necessary to monitor and control animal behavior at the same level of temporal accuracy. However, it is technically challenging to deliver sensory stimuli and reinforcers as well as to read the behavioral responses they elicit with millisecond precision. Presently available commercial systems often excel in specific aspects of behavior control, but they do not provide a customizable environment allowing flexible experimental design while maintaining high standards for temporal control necessary for interpreting neuronal activity. Moreover, delay measurements of stimulus and reinforcement delivery are largely unavailable. We combined microcontroller-based behavior control with a sound delivery system for playing complex acoustic stimuli, fast solenoid valves for precisely timed reinforcement delivery and a custom-built sound attenuated chamber using high-end industrial insulation materials. Together this setup provides a physical environment to train head-fixed animals, enables calibrated sound stimuli and precisely timed fluid and air puff presentation as reinforcers. We provide latency measurements for stimulus and reinforcement delivery and an algorithm to perform such measurements on other behavior control systems. Combined with electrophysiology and optogenetic manipulations, the millisecond timing accuracy will help interpret temporally precise neural signals and behavioral changes. Additionally, since software and hardware provided here can be readily customized to achieve a large variety of paradigms, these solutions enable an unusually flexible design of rodent behavioral experiments.

An extended car-following model with consideration of vehicle to vehicle communication of two conflicting streams

NASA Astrophysics Data System (ADS)

Zhao, Jing; Li, Peng

2017-05-01

In this paper, we propose a car-following model to explore the influences of V2V communication on the driving behavior at un-signalized intersections with two crossing streams and to explore how the speed guidance strategy affects the operation efficiency. The numerical results illustrate that the benefits of the guidance strategy could be enhanced by lengthening the guiding space range and increasing the maximum speed limitation, and that the guidance strategy is more suitable under low to medium traffic density and small safety interval condition.

Electrical stimulation of the lateral habenula produces an inhibitory effect on sucrose self-administration.

PubMed

Friedman, Alexander; Lax, Elad; Dikshtein, Yahav; Abraham, Lital; Flaumenhaft, Yakov; Sudai, Einav; Ben-Tzion, Moshe; Yadid, Gal

2011-01-01

The lateral habenula (LHb) plays a role in prediction of negative reinforcement, punishment and aversive responses. In the current study, we examined the role that the LHb plays in regulation of negative reward responses and aversion. First, we tested the effect of intervention in LHb activity on sucrose reinforcing behavior. An electrode was implanted into the LHb and rats were trained to self-administer sucrose (20%; 16 days) until at least three days of stable performance were achieved (as represented by the number of active lever presses in self-administration cages). Rats subsequently received deep brain stimulation (DBS) of the LHb, which significantly reduced sucrose self-administration levels. In contrast, lesion of the LHb increased sucrose-seeking behavior, as demonstrated by a delayed extinction response to substitution of sucrose with water. Furthermore, in a modified non-rewarding conditioned-place-preference paradigm, DBS of the LHb led to aversion to the context associated with stimulation of this brain region. We postulate that electrical stimulation of the LHb attenuates positive reward-associated reinforcement by natural substances. Copyright © 2010 Elsevier Ltd. All rights reserved.

Tobacco demand, delay discounting, and smoking topography among smokers with and without psychopathology.

PubMed

Farris, Samantha G; Aston, Elizabeth R; Abrantes, Ana M; Zvolensky, Michael J

2017-10-01

Tobacco demand (i.e., relative value attributed to a given reinforcer) and delay discounting (i.e., relative preference for smaller immediate rewards over larger delayed rewards) are two behavioral economic processes that are linked to the progression of problematic substance use. These processes have not been studied among those with psychopathology, a vulnerable group of smokers. The current study examined differences in tobacco demand and delay discounting, and their association with smoking topography among smokers with (n=43) and without (n=64) past-year psychopathology. Adult daily smokers (n=107,M age =43.5; SD=9.7) participated in a study on "smoking behavior." Past-year psychological disorders were assessed via a clinician-administered diagnostic assessment. All subjects participated in an ad libitum smoking trial and then completed an assessment of delay discounting (Monetary Choice Questionnaire) and tobacco demand (Cigarette Purchase Task) approximately 45-60min post-smoking. Smokers with psychopathology, compared to those without, had significantly higher demand intensity and maximum expenditure on tobacco (O max ), but did not differ on other demand indices or delay discounting. Smokers with psychopathology had shorter average inter-puff intervals and shorter time to cigarette completion than smokers without psychopathology. Tobacco demand and delay discounting measures were significantly intercorrelated among smokers with psychopathology, but not those without. Both behavioral economic measures were associated with specific aspects of smoking topography in smokers with psychopathology. The association between tobacco demand and delay discounting is evident among smokers with psychopathology and both measures were most consistently related to smoking behavior. Copyright © 2017 Elsevier B.V. All rights reserved.

Impulsive-choice patterns for food in genetically lean and obese Zucker rats

PubMed Central

Boomhower, Steven R.; Rasmussen, Erin B.; Doherty, Tiffany S.

2012-01-01

Behavioral-economic studies have shown that differences between lean and obese Zuckers in food consumption depend on the response requirement for food. Since a response requirement inherently increases the delay to reinforcement, differences in sensitivity to delay may also be a relevant mechanism of food consumption in the obese Zucker rat. Furthermore, the endocannabinoid neurotransmitter system has been implicated in impulsivity, but studies that attempt to characterize the effects of cannabinoid drugs (e.g., rimonabant) on impulsive choice may be limited by floor effects. The present study aimed to characterize impulsive-choice patterns for sucrose using an adjusting-delay procedure in genetically lean and obese Zuckers. Ten lean and ten obese Zucker rats chose between one lever that resulted in one pellet after a standard delay (either 1 s or 5 s) and a second lever that resulted in two or three pellets after an adjusting delay. After behavior stabilized under baseline, rimonabant (0–10 mg/kg) was administered prior to some choice sessions in the two-pellet condition. Under baseline, obese Zuckers made more impulsive choices than leans in three of the four standard-delay/pellet conditions. Additionally, in the 2-pellet condition, rimonabant increased impulsive choice in lean rats in the 1-s standard-delay condition; however, rimonabant decreased impulsive choice in obese rats in the 1-s and 5-s standard-delay conditions. These data suggest that genetic factors that influence impulsive choice are stronger in some choice conditions than others, and that the endocannabinoid system may be a relevant neuromechanism. PMID:23261877

Choice between delayed food and immediate oxycodone in rats.

PubMed

Secci, Maria E; Factor, Julie A; Schindler, Charles W; Panlilio, Leigh V

2016-12-01

The choice to seek immediate drug effects instead of more meaningful but delayed rewards is a defining feature of addiction. To develop a rodent model of this behavior, we allowed rats to choose between immediate intravenous delivery of the prescription opioid oxycodone (50 μg/kg) and delayed delivery of palatable food pellets. Rats preferred food at delays up to 30 s, but they chose oxycodone and food equally at 60-s delay and preferred oxycodone over food at 120-s delay. Comparison of food-drug choice, food-only, and drug-only conditions indicated that food availability decreased drug intake, but drug availability increased food intake. In the food-only condition, food was effective as a reinforcer even when delayed by 120 s. Pre-session feeding with chow slowed acquisition of food and drug self-administration, but did not affect choice. To establish procedures for testing potential anti-addiction medications, noncontingent pre-treatment with oxycodone or naltrexone (analogous to substitution and antagonist therapies, respectively) were tested on a baseline in which oxycodone was preferred over delayed food. Naltrexone pre-treatment decreased drug intake and increased food intake. Oxycodone pre-treatment decreased drug intake, but also produced extended periods with no food or drug responding. These findings show that the contingencies that induce preference for drugs over more meaningful but less immediate rewards in humans can be modeled in rodents, and they suggest that the model could be useful for assessing the therapeutic potential of treatments and exploring the underlying behavioral and neural mechanisms involved in addiction.

Choice between delayed food and immediate oxycodone in rats

PubMed Central

Secci, Maria E.; Factor, Julie A.; Schindler, Charles W.; Panlilio, Leigh V.

2016-01-01

Rationale The choice to seek immediate drug effects instead of more meaningful but delayed rewards is a defining feature of addiction. Objectives To develop a rodent model of this behavior, we allowed rats to choose between immediate intravenous delivery of the prescription opioid oxycodone (50 μg/kg) and delayed delivery of palatable food pellets. Results Rats preferred food at delays up to 30 s, but they chose oxycodone and food equally at 60-s delay and preferred oxycodone over food at 120-s delay. Comparison of food-drug choice, food-only, and drug-only conditions indicated that food availability decreased drug intake, but drug availability increased food intake. In the food-only condition, food was effective as a reinforcer even when delayed by 120 s. Pre-session feeding with chow slowed acquisition of food and drug self-administration, but did not affect choice. To establish procedures for testing potential anti-addiction medications, noncontingent pretreatment with oxycodone or naltrexone (analogous to substitution and antagonist therapies, respectively) were tested on a baseline in which oxycodone was preferred over delayed food. Naltrexone pretreatment decreased drug intake and increased food intake. Oxycodone pretreatment decreased drug intake, but also produced extended periods with no food or drug responding. Conclusions These findings show that the contingencies that induce preference for drugs over more meaningful but less immediate rewards in humans can be modeled in rodents, and they suggest that the model could be useful for assessing the therapeutic potential of treatments and exploring the underlying behavioral and neural mechanisms involved in addiction. PMID:27678551

Impulsive-choice patterns for food in genetically lean and obese Zucker rats.

PubMed

Boomhower, Steven R; Rasmussen, Erin B; Doherty, Tiffany S

2013-03-15

Behavioral-economic studies have shown that differences between lean and obese Zuckers in food consumption depend on the response requirement for food. Since a response requirement inherently increases the delay to reinforcement, differences in sensitivity to delay may also be a relevant mechanism of food consumption in the obese Zucker rat. Furthermore, the endocannabinoid neurotransmitter system has been implicated in impulsivity, but studies that attempt to characterize the effects of cannabinoid drugs (e.g., rimonabant) on impulsive choice may be limited by floor effects. The present study aimed to characterize impulsive-choice patterns for sucrose using an adjusting-delay procedure in genetically lean and obese Zuckers. Ten lean and ten obese Zucker rats chose between one lever that resulted in one pellet after a standard delay (either 1 s or 5 s) and a second lever that resulted in two or three pellets after an adjusting delay. After behavior stabilized under baseline, rimonabant (0-10 mg/kg) was administered prior to some choice sessions in the two-pellet condition. Under baseline, obese Zuckers made more impulsive choices than leans in three of the four standard-delay/pellet conditions. Additionally, in the 2-pellet condition, rimonabant increased impulsive choice in lean rats in the 1-s standard-delay condition; however, rimonabant decreased impulsive choice in obese rats in the 1-s and 5-s standard-delay conditions. These data suggest that genetic factors that influence impulsive choice are stronger in some choice conditions than others, and that the endocannabinoid system may be a relevant neuromechanism. Copyright © 2012 Elsevier B.V. All rights reserved.

Email notification combined with off site signing substantially reduces resident approval to faculty verification time.

PubMed

Deitte, Lori A; Moser, Patricia P; Geller, Brian S; Sistrom, Chris L

2011-06-01

Attending radiologist signature time (AST) is a variable and modifiable component of overall report turnaround time. Delays in finalized reports have potential to undermine radiologists' value as consultants and adversely affect patient care. This study was performed to evaluate the impact of notebook computer distribution and daily automated e-mail notification on reducing AST. Two simultaneous interventions were initiated in the authors' radiology department in February 2010. These included the distribution of a notebook computer with preloaded software for each attending radiologist to sign radiology reports and daily automated e-mail notifications for unsigned reports. The digital dictation system archive and the radiology information system were queried for all radiology reports produced from January 2009 through August 2010. The time between resident approval and attending radiologist signature before and after the intervention was analyzed. Potential unintended "side effects" of the intervention were also studied. Resident-authored reports were signed, on average, 2.53 hours sooner after the intervention. This represented a highly significant (P = .003) decrease in AST with all else held equal. Postintervention reports were authored by residents at the same rate (about 70%). An unintended "side effect" was that attending radiologists were less likely to make changes to resident-authored reports after the intervention. E-mail notification combined with offsite signing can reduce AST substantially. Notebook computers with preloaded software streamline the process of accessing, editing, and signing reports. The observed decrease in AST reflects a positive change in the timeliness of report signature. Copyright © 2011 AUR. Published by Elsevier Inc. All rights reserved.

Advanced Composites for Air and Ground Vehicles

DTIC Science & Technology

2015-08-01

Engineering A, 429: 225–235. [2] Sharma, S. (2010). “Process development issues of glass-carbon hybrid- reinforced polymer composite wind turbine blades...with numerous possibilities including “zero- slip ” behavior, reduced/delayed delaminations under load, and enhanced load-carrying capacities relative to...pads having a Shore-A durometer of 55 and thickness of 3 mm were glued to the loading block to prevent slipping . The loading and support bars were

Delay Discounting of Video Game Players: Comparison of Time Duration Among Gamers

PubMed Central

Sprong, Matthew E.; Lloyd, Daniel P.; Cutter, Christopher J.; Printz, Destiny M.B.; Sullivan, Ryan M.; Moore, Brent A.

2017-01-01

Abstract Video game addiction or Internet game disorder, as proposed by the DSM-5 (Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition), has similar criterion characteristics to other impulse control disorders. There is limited research examining video game addiction within a behavioral economic framework using delay discounting. The current study evaluated delay-discounting patterns of money and video game play by usual weekly hours of video game play. A total of 104 participants were split into 1 of 3 groups of video game players (low, medium, and high) and were asked to complete a monetary and video game discounting procedure through an online survey. Results showed significant differences between groups within both the monetary (p = 0.003) and video game discounting procedures (p = 0.004). Additionally, a positive linear relationship was noted between the groups across both procedures. The results of the current article reinforce previous findings that more hours of video game use are associated with greater impulsivity and provide implications for future research. PMID:28118044

Delay Discounting of Video Game Players: Comparison of Time Duration Among Gamers.

PubMed

Buono, Frank D; Sprong, Matthew E; Lloyd, Daniel P; Cutter, Christopher J; Printz, Destiny M B; Sullivan, Ryan M; Moore, Brent A

2017-02-01

Video game addiction or Internet game disorder, as proposed by the DSM-5 (Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition), has similar criterion characteristics to other impulse control disorders. There is limited research examining video game addiction within a behavioral economic framework using delay discounting. The current study evaluated delay-discounting patterns of money and video game play by usual weekly hours of video game play. A total of 104 participants were split into 1 of 3 groups of video game players (low, medium, and high) and were asked to complete a monetary and video game discounting procedure through an online survey. Results showed significant differences between groups within both the monetary (p = 0.003) and video game discounting procedures (p = 0.004). Additionally, a positive linear relationship was noted between the groups across both procedures. The results of the current article reinforce previous findings that more hours of video game use are associated with greater impulsivity and provide implications for future research.

Response-food delay gradients for lever pressing and schedule-induced licking in rats.

PubMed

Pellón, Ricardo; Pérez-Padilla, Angeles

2013-06-01

Eight food-deprived Wistar rats developed stable patterns of lever pressing and licking when exposed to a fixed-time 30-s schedule of food pellet presentation. The rats were trained to lever press by presenting the lever 10 s before the programmed food delivery, with the food pellet being delivered immediately upon a lever press. The operant contingency was then removed and the lever was inserted through the entire interfood interval, being withdrawn with food delivery and reinserted 2 s later. On successive phases of the study, a protective contingency postponed food delivery if responses (lever presses or licks) occurred within the last 1, 2, 5, 10, 20, or 25 s of the interfood interval. Lever pressing was reduced at much shorter response-food delays than those that reduced licking. These results demonstrate that reinforcement contributes to the maintenance of different response patterns on periodic schedules, and that different responses are differentially sensitive to delays.

On-the-fly Numerical Surface Integration for Finite-Difference Poisson-Boltzmann Methods.

PubMed

Cai, Qin; Ye, Xiang; Wang, Jun; Luo, Ray

2011-11-01

Most implicit solvation models require the definition of a molecular surface as the interface that separates the solute in atomic detail from the solvent approximated as a continuous medium. Commonly used surface definitions include the solvent accessible surface (SAS), the solvent excluded surface (SES), and the van der Waals surface. In this study, we present an efficient numerical algorithm to compute the SES and SAS areas to facilitate the applications of finite-difference Poisson-Boltzmann methods in biomolecular simulations. Different from previous numerical approaches, our algorithm is physics-inspired and intimately coupled to the finite-difference Poisson-Boltzmann methods to fully take advantage of its existing data structures. Our analysis shows that the algorithm can achieve very good agreement with the analytical method in the calculation of the SES and SAS areas. Specifically, in our comprehensive test of 1,555 molecules, the average unsigned relative error is 0.27% in the SES area calculations and 1.05% in the SAS area calculations at the grid spacing of 1/2Å. In addition, a systematic correction analysis can be used to improve the accuracy for the coarse-grid SES area calculations, with the average unsigned relative error in the SES areas reduced to 0.13%. These validation studies indicate that the proposed algorithm can be applied to biomolecules over a broad range of sizes and structures. Finally, the numerical algorithm can also be adapted to evaluate the surface integral of either a vector field or a scalar field defined on the molecular surface for additional solvation energetics and force calculations.

Dynamic analysis of pedestrian crossing behaviors on traffic flow at unsignalized mid-block crosswalks

NASA Astrophysics Data System (ADS)

Liu, Gang; He, Jing; Luo, Zhiyong; Yang, Wunian; Zhang, Xiping

2015-05-01

It is important to study the effects of pedestrian crossing behaviors on traffic flow for solving the urban traffic jam problem. Based on the Nagel-Schreckenberg (NaSch) traffic cellular automata (TCA) model, a new one-dimensional TCA model is proposed considering the uncertainty conflict behaviors between pedestrians and vehicles at unsignalized mid-block crosswalks and defining the parallel updating rules of motion states of pedestrians and vehicles. The traffic flow is simulated for different vehicle densities and behavior trigger probabilities. The fundamental diagrams show that no matter what the values of vehicle braking probability, pedestrian acceleration crossing probability, pedestrian backing probability and pedestrian generation probability, the system flow shows the "increasing-saturating-decreasing" trend with the increase of vehicle density; when the vehicle braking probability is lower, it is easy to cause an emergency brake of vehicle and result in great fluctuation of saturated flow; the saturated flow decreases slightly with the increase of the pedestrian acceleration crossing probability; when the pedestrian backing probability lies between 0.4 and 0.6, the saturated flow is unstable, which shows the hesitant behavior of pedestrians when making the decision of backing; the maximum flow is sensitive to the pedestrian generation probability and rapidly decreases with increasing the pedestrian generation probability, the maximum flow is approximately equal to zero when the probability is more than 0.5. The simulations prove that the influence of frequent crossing behavior upon vehicle flow is immense; the vehicle flow decreases and gets into serious congestion state rapidly with the increase of the pedestrian generation probability.

Study of magnetic helicity injection in the active region NOAA 9236 producing multiple flare-associated coronal mass ejection events

DOE Office of Scientific and Technical Information (OSTI.GOV)

Park, Sung-Hong; Cho, Kyung-Suk; Bong, Su-Chan

To better understand a preferred magnetic field configuration and its evolution during coronal mass ejection (CME) events, we investigated the spatial and temporal evolution of photospheric magnetic fields in the active region NOAA 9236 that produced eight flare-associated CMEs during the time period of 2000 November 23-26. The time variations of the total magnetic helicity injection rate and the total unsigned magnetic flux are determined and examined not only in the entire active region but also in some local regions such as the main sunspots and the CME-associated flaring regions using SOHO/MDI magnetogram data. As a result, we found thatmore » (1) in the sunspots, a large amount of positive (right-handed) magnetic helicity was injected during most of the examined time period, (2) in the flare region, there was a continuous injection of negative (left-handed) magnetic helicity during the entire period, accompanied by a large increase of the unsigned magnetic flux, and (3) the flaring regions were mainly composed of emerging bipoles of magnetic fragments in which magnetic field lines have substantially favorable conditions for making reconnection with large-scale, overlying, and oppositely directed magnetic field lines connecting the main sunspots. These observational findings can also be well explained by some MHD numerical simulations for CME initiation (e.g., reconnection-favored emerging flux models). We therefore conclude that reconnection-favored magnetic fields in the flaring emerging flux regions play a crucial role in producing the multiple flare-associated CMEs in NOAA 9236.« less

Indication of the Hanle Effect by Comparing the Scattering Polarization Observed by CLASP in the Ly α and Si iii 120.65 nm Lines

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ishikawa, R.; Kubo, M.; Kano, R.

The Chromospheric Lyman-Alpha Spectro-Polarimeter is a sounding rocket experiment that has provided the first successful measurement of the linear polarization produced by scattering processes in the hydrogen Ly α line (121.57 nm) radiation of the solar disk. In this paper, we report that the Si iii line at 120.65 nm also shows scattering polarization and we compare the scattering polarization signals observed in the Ly α and Si iii lines in order to search for observational signatures of the Hanle effect. We focus on four selected bright structures and investigate how the U / I spatial variations vary between themore » Ly α wing, the Ly α core, and the Si iii line as a function of the total unsigned photospheric magnetic flux estimated from Solar Dynamics Observatory /Helioseismic and Magnetic Imager observations. In an internetwork region, the Ly α core shows an antisymmetric spatial variation across the selected bright structure, but it does not show it in other more magnetized regions. In the Si iii line, the spatial variation of U / I deviates from the above-mentioned antisymmetric shape as the total unsigned photospheric magnetic flux increases. A plausible explanation of this difference is the operation of the Hanle effect. We argue that diagnostic techniques based on the scattering polarization observed simultaneously in two spectral lines with very different sensitivities to the Hanle effect, like Ly α and Si iii, are of great potential interest for exploring the magnetism of the upper solar chromosphere and transition region.« less

Lithium, but not Valproate, Reduces Impulsive Choice in the Delay-Discounting Task in Mice

PubMed Central

Halcomb, Meredith E; Gould, Todd D; Grahame, Nicholas J

2013-01-01

Both lithium and valproate are well-established treatments for bipolar disorder. Studies have also found that lithium is effective at reducing suicidal behaviors in patients with mood disorders. Impulsivity is a validated endophenotype of both bipolar disorder and suicidal behavior. We assessed effects of treatment with lithium or valproate on cognitive impulsivity in selectively bred mice previously shown to manifest relatively high levels of cognitive impulsivity. Mice were trained in the delay-discounting paradigm, a measure of cognitive impulsivity reflecting a behavioral bias towards immediacy, and then treated with lithium, valproate, or control chow. After 3 weeks of drug treatment, mice were tested at various delays to a large, delayed reward. Drug treatment continued during this time. Lithium reduced impulsivity, whereas valproate had no effect on choice behavior. Both drugs increased the number of choice trials and reinforcer intake, but effects on choice behavior did not depend on these motivational changes. To our knowledge, this is the first study demonstrating lithium's effects to reduce cognitive impulsivity. Future studies may focus on the ability of putative pharmacotherapies for patients at risk for bipolar disorder or suicide to modify the impulsive choice dimension of this diseases. PMID:23584261

Open Source Tools for Temporally Controlled Rodent Behavior Suitable for Electrophysiology and Optogenetic Manipulations

PubMed Central

Solari, Nicola; Sviatkó, Katalin; Laszlovszky, Tamás; Hegedüs, Panna; Hangya, Balázs

2018-01-01

Understanding how the brain controls behavior requires observing and manipulating neural activity in awake behaving animals. Neuronal firing is timed at millisecond precision. Therefore, to decipher temporal coding, it is necessary to monitor and control animal behavior at the same level of temporal accuracy. However, it is technically challenging to deliver sensory stimuli and reinforcers as well as to read the behavioral responses they elicit with millisecond precision. Presently available commercial systems often excel in specific aspects of behavior control, but they do not provide a customizable environment allowing flexible experimental design while maintaining high standards for temporal control necessary for interpreting neuronal activity. Moreover, delay measurements of stimulus and reinforcement delivery are largely unavailable. We combined microcontroller-based behavior control with a sound delivery system for playing complex acoustic stimuli, fast solenoid valves for precisely timed reinforcement delivery and a custom-built sound attenuated chamber using high-end industrial insulation materials. Together this setup provides a physical environment to train head-fixed animals, enables calibrated sound stimuli and precisely timed fluid and air puff presentation as reinforcers. We provide latency measurements for stimulus and reinforcement delivery and an algorithm to perform such measurements on other behavior control systems. Combined with electrophysiology and optogenetic manipulations, the millisecond timing accuracy will help interpret temporally precise neural signals and behavioral changes. Additionally, since software and hardware provided here can be readily customized to achieve a large variety of paradigms, these solutions enable an unusually flexible design of rodent behavioral experiments. PMID:29867383

Learning with incomplete information and the mathematical structure behind it.

PubMed

Kühn, Reimer; Stamatescu, Ion-Olimpiu

2007-07-01

We investigate the problem of learning with incomplete information as exemplified by learning with delayed reinforcement. We study a two phase learning scenario in which a phase of Hebbian associative learning based on momentary internal representations is supplemented by an 'unlearning' phase depending on a graded reinforcement signal. The reinforcement signal quantifies the success-rate globally for a number of learning steps in phase one, and 'unlearning' is indiscriminate with respect to associations learnt in that phase. Learning according to this model is studied via simulations and analytically within a student-teacher scenario for both single layer networks and, for a committee machine. Success and speed of learning depend on the ratio lambda of the learning rates used for the associative Hebbian learning phase and for the unlearning-correction in response to the reinforcement signal, respectively. Asymptotically perfect generalization is possible only, if this ratio exceeds a critical value lambda( c ), in which case the generalization error exhibits a power law decay with the number of examples seen by the student, with an exponent that depends in a non-universal manner on the parameter lambda. We find these features to be robust against a wide spectrum of modifications of microscopic modelling details. Two illustrative applications-one of a robot learning to navigate a field containing obstacles, and the problem of identifying a specific component in a collection of stimuli-are also provided.

Differential effects of co-administration of oxotremorine with SCH 23390 on impulsive choice in high-impulsive rats and low-impulsive rats.

PubMed

Tian, Lin; Qin, Xingna; Sun, Jinling; Li, Xinwang; Wei, Li

2016-03-01

The effect of acetylcholine on impulsive choice is thought to be due to interactions between cholinergic and dopaminergic systems, but this hypothesis has not been proven. This study investigated whether D1-like receptors were involved in the effects of the muscarinic cholinergic agonist oxotremorine on impulsive choice in high-impulsive rats (HI rats, n=8) and low-impulsive rats (LI rats, n=8) characterized by basal levels of impulsive choice in a delay-discounting task. The results revealed that oxotremorine (0.05mg/kg) significantly increased the choice of the large reinforcer in HI rats, whereas decreased the choice of the large reinforcer in LI rats. The D1-like antagonist SCH 23390 produced significant reductions in the large-reinforcer choice in HI rats (0.01mg/kg) and LI rats (0.005, 0.0075, and 0.01mg/kg). SCH 23390 significantly inhibited the increase in the choice of the large reinforcer induced by oxotremorine (0.05mg/kg) in HI rats at doses of 0.005 and 0.0075mg/kg, but enhanced the effect of oxotremorine in LI rats only at the dose of 0.0075mg/kg. These findings suggested that D1-like receptors might be involved in the differential effects of oxotremorine on impulsive choice between HI rats and LI rats. Copyright © 2016 Elsevier Inc. All rights reserved.

Longitudinal assessment of stereotypic, proto-injurious, and self-injurious behavior exhibited by young children with developmental delays.

PubMed

Richman, David M; Lindauer, Steven E

2005-11-01

Twelve children (CA, 12 to 32 months) with developmental delay were observed in their homes during monthly analogue functional analysis probes to document patterns of emerging self-injurious behavior. Two patterns of emerging self-injury were observed for 5 participants: (a) The topography and functional analysis pattern remained the same, but the behavior eventually caused tissue damage; or (b) a new topography emerged that was similar to an established stereotypic motor behavior. Functional analysis results were inconclusive for the majority of target behaviors across participants due to undifferentiated responding across conditions. One participant exhibited two topographies that appeared to become sensitive to positive reinforcement over time. Results are discussed in terms of implications for future research on early intervention and prevention of self-injury.

Ability to Resist Temptations of Technology Use: A Qualitative Analysis of Children's Views on Factors Associated with Delay of Gratification.

PubMed

Ang, Chin-Siang; Lee, Kam-Fong

2017-01-01

Excessive technology use among young children remains a public health concern with diverse serious consequences. It is important to find out how children resist the temptation to use technology. Using focus group interviews, the authors explored what factors influence children's ability to delay gratification in using technology. Four specific themes emerged from the interview data: they found (a) fear of punishment, (b) self-directed speech, (c) reinforcement, and (d) parental modeling are effective measures to train children to forgo immediate pleasures of using technology. These findings provided some support for the hypothesis that children's self-control of technology use can be modified and improved. This study suggests methods to leverage and strengthen existing initiatives to promote self-control of technology use for children.

Sex-dependent impacts of low-level lead exposure and prenatal stress on impulsive choice behavior and associated biochemical and neurochemical manifestations.

PubMed

Weston, Hiromi I; Weston, Douglas D; Allen, Joshua L; Cory-Slechta, Deborah A

2014-09-01

A prior study demonstrated increased overall response rates on a fixed interval (FI) schedule of reward in female offspring that had been subjected to maternal lead (Pb) exposure, prenatal stress (PS) and offspring stress challenge relative to control, prenatal stress alone, lead alone and lead+prenatal stress alone (Virgolini et al., 2008). Response rates on FI schedules have been shown to directly relate to measures of self-control (impulsivity) in children and in infants (Darcheville et al., 1992, 1993). The current study sought to determine whether enhanced effects of Pb±PS would therefore be seen in a more direct measure of impulsive choice behavior, i.e., a delay discounting paradigm. Offspring of dams exposed to 0 or 50ppm Pb acetate from 2 to 3 months prior to breeding through lactation, with or without immobilization restraint stress (PS) on gestational days 16 and 17, were trained on a delay discounting paradigm that offered a choice between a large reward (three 45mg food pellets) after a long delay or a small reward (one 45mg food pellet) after a short delay, with the long delay value increased from 0s to 30s across sessions. Alterations in extinction of this performance, and its subsequent re-acquisition after reinforcement delivery was reinstated were also examined. Brains of littermates of behaviorally-trained offspring were utilized to examine corresponding changes in monoamines and in levels of brain derived neurotrophic factor (BDNF), the serotonin transporter (SERT) and the N-methyl-d-aspartate receptor (NMDAR) 2A in brain regions associated with impulsive choice behavior. Results showed that Pb±PS-induced changes in delay discounting occurred almost exclusively in males. In addition to increasing percent long delay responding at the indifference point (i.e., reduced impulsive choice behavior), Pb±PS slowed acquisition of delayed discounting performance, and increased numbers of both failures to and latencies to initiate trials. Overall, the profile of these alterations were more consistent with impaired learning/behavioral flexibility and/or with enhanced sensitivity to the downshift in reward opportunities imposed by the transition from delay discounting training conditions to delay discounting choice response contingencies. Consistent with these behavioral changes, Pb±PS treated males also showed reductions in brain serotonin function in all mesocorticolimbic regions, broad monoamine changes in nucleus accumbens, and reductions in both BDNF and NMDAR 2A levels and increases in SERT in frontal cortex, i.e., in regions and neurotransmitter systems known to mediate learning/behavioral flexibility, and which were of greater impact in males. The current findings do not fully support a generality of the enhancement of Pb effects by PS, as previously seen with FI performance in females (Virgolini et al., 2008), and suggest a dissociation of the behaviors controlled by FI and delay discounting paradigms, at least in response to Pb±PS in rats. Collectively, however, the findings remain consistent with sex-dependent differences in the impacts of both Pb and PS and with the need to understand both the role of contingencies of reinforcement and underlying neurobiological effects in these sex differences. Copyright © 2014 Elsevier Inc. All rights reserved.

Evaluation of Introduction of a Delayed Cord Clamping Protocol for Premature Neonates in a High-Volume Maternity Center.

PubMed

Liu, Lilly Y; Feinglass, Joe M; Khan, Janine Y; Gerber, Susan E; Grobman, William A; Yee, Lynn M

2017-05-01

To evaluate adherence to a delayed cord clamping protocol for preterm births in the first 2 years after its introduction, perform a quality improvement assessment, and determine neonatal outcomes associated with protocol implementation and adherence. This is a retrospective cohort study of women delivering singleton neonates at 23-32 weeks of gestation in the 2 years before (preprotocol) and 2 years after (postprotocol) introduction of a 30-second delayed cord clamping protocol at a large-volume academic center. This policy was communicated to obstetric and pediatric health care providers and nurses and reinforced with intermittent educational reviews. Barriers to receiving delayed cord clamping were assessed using χ tests and multivariable logistic regression. Neonatal outcomes then were compared between all neonates in the preprotocol period and all neonates in the postprotocol period and between all neonates in the preprotocol period and neonates receiving delayed cord clamping in the postprotocol period using multivariable linear and logistic regression analyses. Of the 427 eligible neonates, 187 were born postprotocol. Of these, 53.5% (n=100) neonates received delayed cord clamping according to the protocol. The rate of delayed cord clamping preprotocol was 0%. Protocol uptake and frequency of delayed cord clamping increased over the 2 years after its introduction. In the postprotocol period, cesarean delivery was the only factor independently associated with failing to receive delayed cord clamping (adjusted odds ratio [OR] 0.49, 95% confidence interval [CI] 0.25-0.96). In comparison with the preprotocol period, those who received delayed cord clamping in the postprotocol period had significantly higher birth hematocrit (β=2.46, P=.007) and fewer blood transfusions in the first week of life (adjusted OR 0.49, 95% CI 0.25-0.96). After introduction of an institutional delayed cord clamping protocol followed by continued health care provider education and quality feedback, the frequency of delayed cord clamping progressively increased. Compared with historical controls, performing delayed cord clamping in eligible preterm neonates was associated with improved neonatal hematologic indices, demonstrating the effectiveness of delayed cord clamping in a large-volume maternity unit.

A Developmental Perspective on Neuroeconomic Mechanisms of Contingency Management

PubMed Central

Stanger, Catherine; Budney, Alan J.; Bickel, Warren K.

2012-01-01

This paper provides a developmental overview of relevant theory and research on delay discounting and neuroeconomics, and their implications for CM approaches to treatment. Recent advances in neuroscience, and in particular the neuroscience of decision making, have the potential to inform treatment development for adolescent substance use in general, and contingency management (CM) treatments in particular. CM utilizes abstinence-based reinforcement to enhance motivation to engage in treatment and engender abstinence. CM interventions may be informed by research on delay discounting, a type of decision making that reflects how individuals value immediate vs. delayed rewards. Delay discounting reliably distinguishes substance abusers from non abusers and is a significant predictor of individual differences in response to substance use treatments. Delay discounting is also of high potential importance in the development of substance use problems in adolescence. Discounting may also be important in predicting response to CM, as CM attempts to directly influence this decision making process, shifting the preference from the immediate rewards of use to delayed rewards for choosing not to use. Multiple neural processes underlie decision making, and those processes have implications for adolescent substance abuse. There are significant neurodevelopmental processes that differentiate adolescents from adults. These processes are implicated in delay discounting, suggesting that adolescence may reflect a period of plasticity in temporal decision making. Understanding the neural mechanisms of delay discounting has led to promising working memory interventions directly targeting the executive functions that underlie individual choices. These interventions may be particularly helpful in combination with CM interventions that offer immediate rewards for brief periods of abstinence, and may show particular benefit in adolescence due to the heightened neural plasticity of systems that underlie temporal discounting in adolescence. PMID:22663343

Translations on Korea No. 547 KULLOJA, No. 5, 1977

DTIC Science & Technology

1977-08-30

of Saturday. So the delay in our meeting and I hope you will understand. Today, in- asmuch as I have reserved time for you, I would like you to feel...mass base of a more reinforced party, the authority and prestige of the party which have been extraordinarily enhanced among the masses of people, the...and economic task, the revolutionary fervor and creative postivity of the producer masses expressed as practical achievements in socialist economic

Offensive Infantry Tactics During the Battle of Chancellorsville, May 1863

DTIC Science & Technology

1993-06-05

main column deploying only after the enemy appeared in force." Tactically, this delay was understandable. Not having a clear knowledge of the enemy...regimental colors, managed to escape. By 1810 Birney’s advance guard controlled the road; reinforcements were securing his flanks and Jastram’s battery... knowledge of the enemy’s movement and of the approaches to his line of march.*17 Furthermore, Berdan 9 acknowledged that he was ordered to report co

Stabilizing nanocellulose-nonionic surfactant composite foams by delayed Ca-induced gelation.

PubMed

Gordeyeva, Korneliya S; Fall, Andreas B; Hall, Stephen; Wicklein, Bernd; Bergström, Lennart

2016-06-15

Aggregation of dispersed rod-like particles like nanocellulose can improve the strength and rigidity of percolated networks but may also have a detrimental effect on the foamability. However, it should be possible to improve the strength of nanocellulose foams by multivalent ion-induced aggregation if the aggregation occurs after the foam has been formed. Lightweight and highly porous foams based on TEMPO-mediated oxidized cellulose nanofibrils (CNF) were formulated with the addition of a non-ionic surfactant, pluronic P123, and CaCO3 nanoparticles. Foam volume measurements show that addition of the non-ionic surfactant generates wet CNF/P123 foams with a high foamability. Foam bubble size studies show that delayed Ca-induced aggregation of CNF by gluconic acid-triggered dissolution of the CaCO3 nanoparticles significantly improves the long-term stability of the wet composite foams. Drying the Ca-reinforced foam at 60 °C results in a moderate shrinkage and electron microscopy and X-ray tomography studies show that the pores became slightly oblate after drying but the overall microstructure and pore/foam bubble size distribution is preserved after drying. The elastic modulus (0.9-1.4 MPa) of Ca-reinforced composite foams with a density of 9-15 kg/m(3) is significantly higher than commercially available polyurethane foams used for thermal insulation. Copyright © 2016 Elsevier Inc. All rights reserved.

Haloperidol and Rimonabant Increase Delay Discounting in Rats Fed High-Fat and Standard-Chow Diets

PubMed Central

Boomhower, Steven R.; Rasmussen, Erin B.

2016-01-01

The dopamine and endocannabinoid neurotransmitter systems have been implicated in delay discounting, a measure of impulsive choice, and obesity. The current study was designed to determine the extent to which haloperidol and rimonabant affected delay discounting in rats fed standard-chow and high-fat diets. Sprague-Dawley rats were allowed to free-feed under a high-fat diet (4.73 kcal/g) or a standard-chow diet (3.0 kcal/g) for three months. Then, operant sessions began in which rats (n = 9 standard chow; n = 10 high-fat) chose between one sucrose pellet delivered immediately vs. three sucrose pellets after a series of delays. In another condition, carrot-flavored pellets replaced sucrose pellets. After behavior stabilized, acute injections of rimonabant (0.3-10 mg/kg) and haloperidol (0.003-0.1 mg/kg) were administered i.p. before some choice sessions in both pellet conditions. Haloperidol and rimonabant increased discounting in both groups of rats by decreasing percent choice for the larger reinforcer and area-under-the-curve (AUC) values. Rats in the high-fat diet condition demonstrated increased sensitivity to haloperidol compared to chow-fed controls: haloperidol increased discounting in both dietary groups in the sucrose condition,, but only in the high-fat-fed rats in the carrot-pellet condition. These findings indicate that blocking D2 and CB1 receptors results in increased delay discounting, and that a high-fat diet may alter sensitivity to dopaminergic compounds using the delay-discounting task. PMID:25000488

Performance of Frozen Density Embedding for Modeling Hole Transfer Reactions.

PubMed

Ramos, Pablo; Papadakis, Markos; Pavanello, Michele

2015-06-18

We have carried out a thorough benchmark of the frozen density-embedding (FDE) method for calculating hole transfer couplings. We have considered 10 exchange-correlation functionals, 3 nonadditive kinetic energy functionals, and 3 basis sets. Overall, we conclude that with a 7% mean relative unsigned error, the PBE and PW91 functionals coupled with the PW91k nonadditive kinetic energy functional and a TZP basis set constitute the most stable and accurate levels of theory for hole transfer coupling calculations. The FDE-ET method is found to be an excellent tool for computing diabatic couplings for hole transfer reactions.

Do Practical Standard Coupled Cluster Calculations Agree Better than Kohn–Sham Calculations with Currently Available Functionals When Compared to the Best Available Experimental Data for Dissociation Energies of Bonds to 3d Transition Metals?

DOE Office of Scientific and Technical Information (OSTI.GOV)

Xu, Xuefei; Zhang, Wenjing; Tang, Mingsheng

2015-05-12

Coupled-cluster (CC) methods have been extensively used as the high-level approach in quantum electronic structure theory to predict various properties of molecules when experimental results are unavailable. It is often assumed that CC methods, if they include at least up to connected-triple-excitation quasiperturbative corrections to a full treatment of single and double excitations (in particular, CCSD(T)), and a very large basis set, are more accurate than Kohn–Sham (KS) density functional theory (DFT). In the present work, we tested and compared the performance of standard CC and KS methods on bond energy calculations of 20 3d transition metal-containing diatomic molecules againstmore » the most reliable experimental data available, as collected in a database called 3dMLBE20. It is found that, although the CCSD(T) and higher levels CC methods have mean unsigned deviations from experiment that are smaller than most exchange-correlation functionals for metal–ligand bond energies of transition metals, the improvement is less than one standard deviation of the mean unsigned deviation. Furthermore, on average, almost half of the 42 exchange-correlation functionals that we tested are closer to experiment than CCSD(T) with the same extended basis set for the same molecule. The results show that, when both relativistic and core–valence correlation effects are considered, even the very high-level (expensive) CC method with single, double, triple, and perturbative quadruple cluster operators, namely, CCSDT(2)Q, averaged over 20 bond energies, gives a mean unsigned deviation (MUD(20) = 4.7 kcal/mol when one correlates only valence, 3p, and 3s electrons of transition metals and only valence electrons of ligands, or 4.6 kcal/mol when one correlates all core electrons except for 1s shells of transition metals, S, and Cl); and that is similar to some good xc functionals (e.g., B97-1 (MUD(20) = 4.5 kcal/mol) and PW6B95 (MUD(20) = 4.9 kcal/mol)) when the same basis set is used. We found that, for both coupled cluster calculations and KS calculations, the T1 diagnostics correlate the errors better than either the M diagnostics or the B1 DFT-based diagnostics. The potential use of practical standard CC methods as a benchmark theory is further confounded by the finding that CC and DFT methods usually have different signs of the error. We conclude that the available experimental data do not provide a justification for using conventional single-reference CC theory calculations to validate or test xc functionals for systems involving 3d transition metals.« less

Changes in reward-induced brain activation in opiate addicts.

PubMed

Martin-Soelch, C; Chevalley, A F; Künig, G; Missimer, J; Magyar, S; Mino, A; Schultz, W; Leenders, K L

2001-10-01

Many studies indicate a role of the cerebral dopaminergic reward system in addiction. Motivated by these findings, we examined in opiate addicts whether brain regions involved in the reward circuitry also react to human prototypical rewards. We measured regional cerebral blood flow (rCBF) with H(2)(15)O positron emission tomography (PET) during a visuo-spatial recognition task with delayed response in control subjects and in opiate addicts participating in a methadone program. Three conditions were defined by the types of feedback: nonsense feedback; nonmonetary reinforcement; or monetary reward, received by the subjects for a correct response. We found in the control subjects rCBF increases in regions associated with the meso-striatal and meso-corticolimbic circuits in response to both monetary reward and nonmonetary reinforcement. In opiate addicts, these regions were activated only in response to monetary reward. Furthermore, nonmonetary reinforcement elicited rCBF increases in limbic regions of the opiate addicts that were not activated in the control subjects. Because psychoactive drugs serve as rewards and directly affect regions of the dopaminergic system like the striatum, we conclude that the differences in rCBF increases between controls and addicts can be attributed to an adaptive consequence of the addiction process.

Effect of rate of delivery of intravenous cocaine on self-administration in rats.

PubMed

Schindler, Charles W; Panlilio, Leigh V; Thorndike, Eric B

2009-10-01

Many studies of drug self-administration in primates have shown that faster infusions of a drug are more reinforcing than slower infusions. Similar effects have not been shown in rats. We assessed the influence of delivery rate by allowing rats to choose between the same doses of intravenous cocaine delivered over two different infusion speeds. Rats were trained in chambers containing two nose-poke response devices. In Experiment 1, responses in one nose-poke delivered 0.3 mg/kg/injection of cocaine over 10 s, and responses in the other delivered the same dose over 100 s. In Experiment 2, the same procedure was used, but with 1.0 mg/kg/injection dose delivered over 1.7 versus 100 s. During acquisition, most rats preferred the faster infusion. When the delivery rates associated with the nose pokes were reversed, rats trained with 0.3 mg/kg/injection failed to switch nose-poke preference, but half the rats trained with 1.0 mg/kg/injection did switch. In Experiment 3, the choice was between 1 mg/kg cocaine delivered over 1.7 s and no reinforcement. Here, rats quickly learned to respond in the nose-poke associated with cocaine and quickly switched their choice during reversal. In Experiment 4, two groups of rats were allowed to choose between food delivered with a delay of 1 versus 5 s or 1 versus 10 s, respectively. Rats preferred the shorter delay during initial training. In reversal, some rats in the 1 vs 5 s group failed to reverse, while all the rats in the 1 vs 10 s group reversed. These results show that faster infusions of cocaine are clearly more reinforcing during acquisition, but delivery rate may not be as important to the maintenance of self-administration once it has been established. The results with food suggest that these findings represent general principles of behavior and are not unique to drug self-administration.

Learning from Noisy and Delayed Rewards: The Value of Reinforcement Learning to Defense Modeling and Simulation

DTIC Science & Technology

2012-09-01

following 500 trials with 1000 replications with single reward upon attainment of the goal state by algorithm and policy. DQ- C with -greedy obtained...aspects of the civilian population rather than combat forces. These agents rep- resent not a single human, but a population segment. Similar...TD(λ) combines elements of MC and TD methods into a single framework to estimate the value of each state, V(s), through the use of eligibility traces

Parenting Practices and Associations with Development Delays among Young Children in Dominican Republic.

PubMed

Uwemedimo, Omolara Thomas; Howlader, Afrin; Pierret, Giselina

According to the World Health Organization, >200 million children in low- and middle-income countries experience developmental delays. However, household structure and parenting practices have been minimally explored as potential correlates of developmental delay in low- and middle-income countries, despite potential as areas for intervention. The objective of the study was to examine associations of developmental delays with use of World Health Organization-recommended parenting practices among a clinic-based cohort of children aged 6-60 months attending in La Romana, Dominican Republic. This study was conducted among 74 caregiver-child pairs attending the growth-monitoring clinic at Hospital Francisco Gonzalvo in June 2015. The Malawi Developmental Assessment Tool was adapted and performed on each child to assess socioadaptive, fine motor, gross motor, and language development. The IMCI Household Level Survey Questionnaire was used to assess parenting practices. Fisher's exact test was used to determine associations significant at P < .05. Significant variables were then entered into a multivariable logistic regression. Almost two-thirds of children had a delay in at least 1 developmental domain. Most caregivers used scolding (43.2%) or spanking (44%) for child discipline. Children who were disciplined by spanking and scolding were more likely to have language delay (P = .007) and socioadaptive delay (P = .077), respectively. On regression analysis, children with younger primary caregivers had 7 times higher odds of language delay (adjusted odds ratio [AOR]: 7.35, 95% confidence interval [CI]: 1.52-35.61) and 4 times greater odds of any delay (AOR: 4.72, 95% CI: 1.01-22.22). In addition, children punished by spanking had 5 times higher odds of having language delay (AOR: 5.04, 95% CI: 1.13-22.39). Parenting practices such as harsh punishment and lack of positive parental reinforcement were found to have strong associations with language and socioadaptive delays. Likewise, delays were also more common among children with younger caregivers. Copyright © 2017 Icahn School of Medicine at Mount Sinai. Published by Elsevier Inc. All rights reserved.

Bleak Present, Bright Future: Online Episodic Future Thinking, Scarcity, Delay Discounting, and Food Demand.

PubMed

Sze, Yan Yan; Stein, Jeffrey S; Bickel, Warren K; Paluch, Rocco A; Epstein, Leonard H

2017-07-01

Obesity is associated with steep discounting of the future and increased food reinforcement. Episodic future thinking (EFT), a type of prospective thinking, has been observed to reduce delay discounting (DD) and improve dietary decision making. In contrast, negative income shock (i.e., abrupt transitions to poverty) has been shown to increase discounting and may worsen dietary decision-making. Scalability of EFT training and protective effects of EFT against simulated negative income shock on DD and demand for food were assessed. In two experiments we showed online-administered EFT reliably reduced DD. Furthermore, EFT reduced DD and demand for fast foods even when challenged by negative income shock. Our findings suggest EFT is a scalable intervention that has implications for improving public health by reducing discounting of the future and demand for high energy dense food.

Reinforced Superhydrophobic Coating on Silicone Rubber for Longstanding Anti-Icing Performance in Severe Conditions.

PubMed

Emelyanenko, Alexandre M; Boinovich, Ludmila B; Bezdomnikov, Alexey A; Chulkova, Elizaveta V; Emelyanenko, Kirill A

2017-07-19

We present a simple method for fabricating the superhydrophobic coatings on composite silicone rubber used for electrical outdoor applications. The coating is characterized by contact angles as high as 170° and is mechanically durable in contact with the aqueous phase. We discuss the impact of mechanical durability of the surface texture on the anti-icing performance of the coating on the basis of the experimental data on freezing delay of sessile aqueous droplets. A set of complementary data obtained in laboratory and outdoor experiments on freezing delay time, variation of wettability and practical work of adhesion for supercooled aqueous sessile droplets, impacting behavior of droplets at low negative temperatures, as well as the results of snow and ice accumulation in outdoor experiments indicate the very prospective icephobic properties of the developed coating.

Using polarizable POSSIM force field and fuzzy-border continuum solvent model to calculate pK(a) shifts of protein residues.

PubMed

Sharma, Ity; Kaminski, George A

2017-01-15

Our Fuzzy-Border (FB) continuum solvent model has been extended and modified to produce hydration parameters for small molecules using POlarizable Simulations Second-order Interaction Model (POSSIM) framework with an average error of 0.136 kcal/mol. It was then used to compute pK a shifts for carboxylic and basic residues of the turkey ovomucoid third domain (OMTKY3) protein. The average unsigned errors in the acid and base pK a values were 0.37 and 0.4 pH units, respectively, versus 0.58 and 0.7 pH units as calculated with a previous version of polarizable protein force field and Poisson Boltzmann continuum solvent. This POSSIM/FB result is produced with explicit refitting of the hydration parameters to the pK a values of the carboxylic and basic residues of the OMTKY3 protein; thus, the values of the acidity constants can be viewed as additional fitting target data. In addition to calculating pK a shifts for the OMTKY3 residues, we have studied aspartic acid residues of Rnase Sa. This was done without any further refitting of the parameters and agreement with the experimental pK a values is within an average unsigned error of 0.65 pH units. This result included the Asp79 residue that is buried and thus has a high experimental pK a value of 7.37 units. Thus, the presented model is capable or reproducing pK a results for residues in an environment that is significantly different from the solvated protein surface used in the fitting. Therefore, the POSSIM force field and the FB continuum solvent parameters have been demonstrated to be sufficiently robust and transferable. © 2016 Wiley Periodicals, Inc. © 2016 Wiley Periodicals, Inc.

Comparing alchemical and physical pathway methods for computing the absolute binding free energy of charged ligands.

PubMed

Deng, Nanjie; Cui, Di; Zhang, Bin W; Xia, Junchao; Cruz, Jeffrey; Levy, Ronald

2018-06-13

Accurately predicting absolute binding free energies of protein-ligand complexes is important as a fundamental problem in both computational biophysics and pharmaceutical discovery. Calculating binding free energies for charged ligands is generally considered to be challenging because of the strong electrostatic interactions between the ligand and its environment in aqueous solution. In this work, we compare the performance of the potential of mean force (PMF) method and the double decoupling method (DDM) for computing absolute binding free energies for charged ligands. We first clarify an unresolved issue concerning the explicit use of the binding site volume to define the complexed state in DDM together with the use of harmonic restraints. We also provide an alternative derivation for the formula for absolute binding free energy using the PMF approach. We use these formulas to compute the binding free energy of charged ligands at an allosteric site of HIV-1 integrase, which has emerged in recent years as a promising target for developing antiviral therapy. As compared with the experimental results, the absolute binding free energies obtained by using the PMF approach show unsigned errors of 1.5-3.4 kcal mol-1, which are somewhat better than the results from DDM (unsigned errors of 1.6-4.3 kcal mol-1) using the same amount of CPU time. According to the DDM decomposition of the binding free energy, the ligand binding appears to be dominated by nonpolar interactions despite the presence of very large and favorable intermolecular ligand-receptor electrostatic interactions, which are almost completely cancelled out by the equally large free energy cost of desolvation of the charged moiety of the ligands in solution. We discuss the relative strengths of computing absolute binding free energies using the alchemical and physical pathway methods.

PHYSICAL PROPERTIES OF LARGE AND SMALL GRANULES IN SOLAR QUIET REGIONS

DOE Office of Scientific and Technical Information (OSTI.GOV)

Yu Daren; Xie Zongxia; Hu Qinghua

The normal mode observations of seven quiet regions obtained by the Hinode spacecraft are analyzed to study the physical properties of granules. An artificial intelligence technique is introduced to automatically find the spatial distribution of granules in feature spaces. In this work, we investigate the dependence of granular continuum intensity, mean Doppler velocity, and magnetic fields on granular diameter. We recognized 71,538 granules by an automatic segmentation technique and then extracted five properties: diameter, continuum intensity, Doppler velocity, and longitudinal and transverse magnetic flux density to describe the granules. To automatically explore the intrinsic structures of the granules in themore » five-dimensional parameter space, the X-means clustering algorithm and one-rule classifier are introduced to define the rules for classifying the granules. It is found that diameter is a dominating parameter in classifying the granules and two families of granules are derived: small granules with diameters smaller than 1.''44, and large granules with diameters larger than 1.''44. Based on statistical analysis of the detected granules, the following results are derived: (1) the averages of diameter, continuum intensity, and Doppler velocity in the upward direction of large granules are larger than those of small granules; (2) the averages of absolute longitudinal, transverse, and unsigned flux density of large granules are smaller than those of small granules; (3) for small granules, the average of continuum intensity increases with their diameters, while the averages of Doppler velocity, transverse, absolute longitudinal, and unsigned magnetic flux density decrease with their diameters. However, the mean properties of large granules are stable; (4) the intensity distributions of all granules and small granules do not satisfy Gaussian distribution, while that of large granules almost agrees with normal distribution with a peak at 1.04 I{sub 0}.« less

Toward polarizable AMOEBA thermodynamics at fixed charge efficiency using a dual force field approach: application to organic crystals.

PubMed

Nessler, Ian J; Litman, Jacob M; Schnieders, Michael J

2016-11-09

First principles prediction of the structure, thermodynamics and solubility of organic molecular crystals, which play a central role in chemical, material, pharmaceutical and engineering sciences, challenges both potential energy functions and sampling methodologies. Here we calculate absolute crystal deposition thermodynamics using a novel dual force field approach whose goal is to maintain the accuracy of advanced multipole force fields (e.g. the polarizable AMOEBA model) while performing more than 95% of the sampling in an inexpensive fixed charge (FC) force field (e.g. OPLS-AA). Absolute crystal sublimation/deposition phase transition free energies were determined using an alchemical path that grows the crystalline state from a vapor reference state based on sampling with the OPLS-AA force field, followed by dual force field thermodynamic corrections to change between FC and AMOEBA resolutions at both end states (we denote the three step path as AMOEBA/FC). Importantly, whereas the phase transition requires on the order of 200 ns of sampling per compound, only 5 ns of sampling was needed for the dual force field thermodynamic corrections to reach a mean statistical uncertainty of 0.05 kcal mol -1 . For five organic compounds, the mean unsigned error between direct use of AMOEBA and the AMOEBA/FC dual force field path was only 0.2 kcal mol -1 and not statistically significant. Compared to experimental deposition thermodynamics, the mean unsigned error for AMOEBA/FC (1.4 kcal mol -1 ) was more than a factor of two smaller than uncorrected OPLS-AA (3.2 kcal mol -1 ). Overall, the dual force field thermodynamic corrections reduced condensed phase sampling in the expensive force field by a factor of 40, and may prove useful for protein stability or binding thermodynamics in the future.

Beyond discounting: possible experimental models of impulse control.

PubMed

Monterosso, J; Ainslie, G

1999-10-01

Animal studies of impulsivity have typically used one of three models: a delay of reward procedure, a differential reinforcement for low rate responding (DRL) procedure, or an autoshaping procedure. In each of these paradigms, we argue, measurement of impulsivity is implicitly or explicitly equated with the effect delay has on the value of reward. The steepness by which delay diminishes value (the temporal discount function) is treated as an index of impulsivity. In order to provide a better analog of human impulsivity, this model needs to be expanded to include the converse of impulsivity - self-control. Through mechanisms such as committing to long range interests before the onset of temptation, or through bundling individual choices into classes of choices that are made at once, human decision-making can often look far less myopic than single trial experiments predict. For people, impulsive behavior may be more often the result of the breakdown of self-control mechanisms than of steep discount functions. Existing animal models of self-control are discussed, and future directions are suggested for psychopharmacological research.

Taste-dependent sociophobia: when food and company do not mix.

PubMed

Guitton, Matthieu J; Klin, Yael; Dudai, Yadin

2008-08-22

Using a combination of the paradigm of conditioned taste aversion (CTA) and of the paradigm of social interactions, we report here that in the rat, eating while anxious may result in long-term alterations in social behavior. In the conventional CTA, the subject learns to associate a tastant (the conditioned stimulus, CS) with delayed toxicosis (an unconditioned stimulus, UCS) to yield taste aversion (the conditioned response, CR). However, the association of taste with delayed negative internal states that could generate CRs that are different from taste aversion should not be neglected. Such associations may contribute to the ontogenesis, reinforcement and symptoms of some types of taste- and food-related disorders. We have recently reported that a delayed anxiety-like state, induced by the anxiogenic drug meta-chlorophenylpiperazine (mCPP), can specifically associate with taste to produce CTA. We now show that a similar protocol results in a marked lingering impairment in social interactions in response to the conditioned taste. This is hence a learned situation in which food and company do not mix well.

The neurobiology of thalamic amnesia: Contributions of medial thalamus and prefrontal cortex to delayed conditional discrimination.

PubMed

Mair, Robert G; Miller, Rikki L A; Wormwood, Benjamin A; Francoeur, Miranda J; Onos, Kristen D; Gibson, Brett M

2015-07-01

Although medial thalamus is well established as a site of pathology associated with global amnesia, there is uncertainty about which structures are critical and how they affect memory function. Evidence from human and animal research suggests that damage to the mammillothalamic tract and the anterior, mediodorsal (MD), midline (M), and intralaminar (IL) nuclei contribute to different signs of thalamic amnesia. Here we focus on MD and the adjacent M and IL nuclei, structures identified in animal studies as critical nodes in prefrontal cortex (PFC)-related pathways that are necessary for delayed conditional discrimination. Recordings of PFC neurons in rats performing a dynamic delayed non-matching-to position (DNMTP) task revealed discrete populations encoding information related to planning, execution, and outcome of DNMTP-related actions and delay-related activity signaling previous reinforcement. Parallel studies recording the activity of MD and IL neurons and examining the effects of unilateral thalamic inactivation on the responses of PFC neurons demonstrated a close coupling of central thalamic and PFC neurons responding to diverse aspects of DNMTP and provide evidence that thalamus interacts with PFC neurons to give rise to complex goal-directed behavior exemplified by the DNMTP task. Copyright © 2015 Elsevier Ltd. All rights reserved.

Future so bright? Delay discounting and consideration of future consequences predict academic performance among college drinkers.

PubMed

Acuff, Samuel F; Soltis, Kathryn E; Dennhardt, Ashley A; Borsari, Brian; Martens, Matthew P; Murphy, James G

2017-10-01

College student drinking is a major public health concern and can result in a range of negative consequences, from acute health risks to decreased academic performance and drop out. Harm reduction interventions have been developed to reduce problems associated with drinking but there is a need to identify specific risk/protective factors related to academic performance among college drinkers. Behavioral economics suggests that chronic alcohol misuse reflects a dysregulated behavioral process or reinforcer pathology-alcohol is overvalued and the value of prosocial rewards are sharply discounted due, in part, to their delay. This study examined delay discounting, consideration of future consequences (CFC) and protective behavioral strategies (PBS) as predictors of academic success (grade point average; GPA) and engagement (time devoted to academic activities) among 393 college drinkers (61% female). In multivariate models, PBS were associated with greater academic engagement, but were not with academic success. Lower discounting of delayed rewards and greater CFC were associated with both academic success and engagement among drinkers. Previous research suggests that future time orientation is malleable, and the current results provide support for efforts to enhance future time orientation as part of alcohol harm-reduction approaches. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Voltage sensitivity of M2 muscarinic receptors underlies the delayed rectifier-like activation of ACh-gated K(+) current by choline in feline atrial myocytes.

PubMed

Navarro-Polanco, Ricardo A; Aréchiga-Figueroa, Iván A; Salazar-Fajardo, Pedro D; Benavides-Haro, Dora E; Rodríguez-Elías, Julio C; Sachse, Frank B; Tristani-Firouzi, Martin; Sánchez-Chapula, José A; Moreno-Galindo, Eloy G

2013-09-01

Choline (Ch) is a precursor and metabolite of the neurotransmitter acetylcholine (ACh). In canine and guinea pig atrial myocytes, Ch was shown to activate an outward K(+) current in a delayed rectifier fashion. This current has been suggested to modulate cardiac electrical activity and to play a role in atrial fibrillation pathophysiology. However, the exact nature and identity of this current has not been convincingly established. We recently described the unique ligand- and voltage-dependent properties of muscarinic activation of ACh-activated K(+) current (IKACh) and showed that, in contrast to ACh, pilocarpine induces a current with delayed rectifier-like properties with membrane depolarization. Here, we tested the hypothesis that Ch activates IKACh in feline atrial myocytes in a voltage-dependent manner similar to pilocarpine. Single-channel recordings, biophysical profiles, specific pharmacological inhibition and computational data indicate that the current activated by Ch is IKACh. Moreover, we show that membrane depolarization increases the potency and efficacy of IKACh activation by Ch and thus gives the appearance of a delayed rectifier activating K(+) current at depolarized potentials. Our findings support the emerging concept that IKACh modulation is both voltage- and ligand-specific and reinforce the importance of these properties in understanding cardiac physiology.

Functional brain development in growth-restricted and constitutionally small fetuses: a fetal magnetoencephalography case-control study.

PubMed

Morin, E C; Schleger, F; Preissl, H; Braendle, J; Eswaran, H; Abele, H; Brucker, S; Kiefer-Schmidt, I

2015-08-01

Fetal magnetoencephalography records fetal brain activity non-invasively. Delayed brain responses were reported for fetuses weighing below the tenth percentile. To investigate whether this delay indicates delayed brain maturation resulting from placental insufficiency, this study distinguished two groups of fetuses below the tenth percentile: growth-restricted fetuses with abnormal umbilical artery Doppler velocity (IUGR) and constitutionally small-for-gestational-age fetuses with normal umbilical artery Doppler findings (SGA) were compared with fetuses of adequate weight for gestational age (AGA), matched for age and behavioural state. A case-control study of matched pairs. Fetal magnetoencephalography-Center at the University Hospital of Tuebingen. Fourteen IUGR fetuses and 23 SGA fetuses were matched for gestational age and fetal behavioural state with 37 healthy, normal-sized fetuses. A 156-channel fetal magentoencephalography system was used to record fetal brain activity. Light flashes as visual stimulation were applied to the fetus. The Student's t-test for paired groups was performed. Latency of fetal visual evoked magnetic responses (VER). The IUGR fetuses showed delayed VERs compared with controls (IUGR, 233.1 ms; controls, 184.6 ms; P = 0.032). SGA fetuses had similar evoked response latencies compared with controls (SGA, 216.1 ms; controls, 219.9 ms; P = 0.828). Behavioural states were similarly distributed. Visual evoked responses are delayed in IUGR fetuses, but not in SGA. Fetal behavioural state as an influencing factor of brain response latency was accounted for in the comparison. This reinforces that delayed brain maturation is the result of placental insufficiency. © 2015 Royal College of Obstetricians and Gynaecologists.

Choice in situations of time-based diminishing returns: immediate versus delayed consequences of action.

PubMed Central

Hackenberg, T D; Hineline, P N

1992-01-01

Pigeons chose between two schedules of food presentation, a fixed-interval schedule and a progressive-interval schedule that began at 0 s and increased by 20 s with each food delivery provided by that schedule. Choosing one schedule disabled the alternate schedule and stimuli until the requirements of the chosen schedule were satisfied, at which point both schedules were again made available. Fixed-interval duration remained constant within individual sessions but varied across conditions. Under reset conditions, completing the fixed-interval schedule not only produced food but also reset the progressive interval to its minimum. Blocks of sessions under the reset procedure were interspersed with sessions under a no-reset procedure, in which the progressive schedule value increased independent of fixed-interval choices. Median points of switching from the progressive to the fixed schedule varied systematically with fixed-interval value, and were consistently lower during reset than during no-reset conditions. Under the latter, each subject's choices of the progressive-interval schedule persisted beyond the point at which its requirements equaled those of the fixed-interval schedule at all but the highest fixed-interval value. Under the reset procedure, switching occurred at or prior to that equality point. These results qualitatively confirm molar analyses of schedule preference and some versions of optimality theory, but they are more adequately characterized by a model of schedule preference based on the cumulated values of multiple reinforcers, weighted in inverse proportion to the delay between the choice and each successive reinforcer. PMID:1548449

Does temporal discounting explain unhealthy behavior? A systematic review and reinforcement learning perspective

PubMed Central

Story, Giles W.; Vlaev, Ivo; Seymour, Ben; Darzi, Ara; Dolan, Raymond J.

2014-01-01

The tendency to make unhealthy choices is hypothesized to be related to an individual's temporal discount rate, the theoretical rate at which they devalue delayed rewards. Furthermore, a particular form of temporal discounting, hyperbolic discounting, has been proposed to explain why unhealthy behavior can occur despite healthy intentions. We examine these two hypotheses in turn. We first systematically review studies which investigate whether discount rates can predict unhealthy behavior. These studies reveal that high discount rates for money (and in some instances food or drug rewards) are associated with several unhealthy behaviors and markers of health status, establishing discounting as a promising predictive measure. We secondly examine whether intention-incongruent unhealthy actions are consistent with hyperbolic discounting. We conclude that intention-incongruent actions are often triggered by environmental cues or changes in motivational state, whose effects are not parameterized by hyperbolic discounting. We propose a framework for understanding these state-based effects in terms of the interplay of two distinct reinforcement learning mechanisms: a “model-based” (or goal-directed) system and a “model-free” (or habitual) system. Under this framework, while discounting of delayed health may contribute to the initiation of unhealthy behavior, with repetition, many unhealthy behaviors become habitual; if health goals then change, habitual behavior can still arise in response to environmental cues. We propose that the burgeoning development of computational models of these processes will permit further identification of health decision-making phenotypes. PMID:24659960

Does temporal discounting explain unhealthy behavior? A systematic review and reinforcement learning perspective.

PubMed

Story, Giles W; Vlaev, Ivo; Seymour, Ben; Darzi, Ara; Dolan, Raymond J

2014-01-01

The tendency to make unhealthy choices is hypothesized to be related to an individual's temporal discount rate, the theoretical rate at which they devalue delayed rewards. Furthermore, a particular form of temporal discounting, hyperbolic discounting, has been proposed to explain why unhealthy behavior can occur despite healthy intentions. We examine these two hypotheses in turn. We first systematically review studies which investigate whether discount rates can predict unhealthy behavior. These studies reveal that high discount rates for money (and in some instances food or drug rewards) are associated with several unhealthy behaviors and markers of health status, establishing discounting as a promising predictive measure. We secondly examine whether intention-incongruent unhealthy actions are consistent with hyperbolic discounting. We conclude that intention-incongruent actions are often triggered by environmental cues or changes in motivational state, whose effects are not parameterized by hyperbolic discounting. We propose a framework for understanding these state-based effects in terms of the interplay of two distinct reinforcement learning mechanisms: a "model-based" (or goal-directed) system and a "model-free" (or habitual) system. Under this framework, while discounting of delayed health may contribute to the initiation of unhealthy behavior, with repetition, many unhealthy behaviors become habitual; if health goals then change, habitual behavior can still arise in response to environmental cues. We propose that the burgeoning development of computational models of these processes will permit further identification of health decision-making phenotypes.

[Use of personal computers by diplomats of anesthesiology in Japan].

PubMed

Yamamoto, K; Ohmura, S; Tsubokawa, T; Kita, M; Kushida, Y; Kobayashi, T

1999-04-01

Use of personal computers by diplomats of the Japanese Board of Anesthesiology working in Japanese university hospitals was investigated. Unsigned questionnaires were returned from 232 diplomats of 18 anesthesia departments. The age of responders ranged from twenties to sixties. Personal computer systems are used by 223 diplomats (96.1%), while nine (3.9%) do not use them. The computer systems used are: Apple Macintosh 77%, IBM compatible PC 21% and UNIX 2%. Although 197 diplomats have e-mail addresses, only 162 of them actually send and receive e-mails. Diplomats in fifties use e-mail most actively and those in sixties come second.

The charger transfer electronic coupling in diabatic perspective: A multi-state density functional theory study

NASA Astrophysics Data System (ADS)

Guo, Xinwei; Qu, Zexing; Gao, Jiali

2018-01-01

The multi-state density functional theory (MSDFT) provides a convenient way to estimate electronic coupling of charge transfer processes based on a diabatic representation. Its performance has been benchmarked against the HAB11 database with a mean unsigned error (MUE) of 17 meV between MSDFT and ab initio methods. The small difference may be attributed to different representations, diabatic from MSDFT and adiabatic from ab initio calculations. In this discussion, we conclude that MSDFT provides a general and efficient way to estimate the electronic coupling for charge-transfer rate calculations based on the Marcus-Hush model.

Do Conditional Reinforcers Count?

PubMed Central

Davison, Michael; Baum, William M

2006-01-01

Six pigeons were trained on a procedure in which seven components arranged different food-delivery ratios on concurrent variable-interval schedules each session. The components were unsignaled, lasted for 10 food deliveries, and occurred in random order with a 60-s blackout between components. The schedules were arranged using a switching-key procedure in which two responses on a center key changed the schedules and associated stimuli on two side keys. In Experiment 1, over five conditions, an increasing proportion of food deliveries accompanied by a magazine light was replaced with the presentation of the magazine light only. Local analyses of preference showed preference pulses toward the alternative that had just produced either a food-plus-magazine-light or magazine-light-only presentation, but pulses after food deliveries were always greater than those after magazine lights. Increasing proportions of magazine lights did not change the size of preference pulses after food or magazine-light presentations. Experiment 2 investigated the effects of correlations between food ratios and magazine-light ratios: In Condition 6, magazine-light ratios in components were inversely correlated (−1.0) with food ratios, and in Condition 7, magazine-light ratios were uncorrelated with food ratios. In Conditions 8 and 9, pecks also produced occasional 2.5-s flashes of a green keylight. In Condition 8, food and magazine-light ratios were correlated 1.0 whereas food and green-key ratios were correlated −1.0. In Condition 9, food and green-key ratios were correlated 1.0 whereas food and magazine-light ratios were correlated −1.0. Preference pulses toward alternatives after magazine lights and green keys depended on the correlation between these event ratios and the food ratios: If the ratios were correlated +1.0, positive preference pulses resulted; if the correlation was −1.0, preference pulses were negative. These results suggest that the Law of Effect has more to do with events signaling consequences than with strengthening responses. PMID:17191753

Gratitude: a tool for reducing economic impatience.

PubMed

DeSteno, David; Li, Ye; Dickens, Leah; Lerner, Jennifer S

2014-06-01

The human mind tends to excessively discount the value of delayed rewards relative to immediate ones, and it is thought that "hot" affective processes drive desires for short-term gratification. Supporting this view, recent findings demonstrate that sadness exacerbates financial impatience even when the sadness is unrelated to the economic decision at hand. Such findings might reinforce the view that emotions must always be suppressed to combat impatience. But if emotions serve adaptive functions, then certain emotions might be capable of reducing excessive impatience for delayed rewards. We found evidence supporting this alternative view. Specifically, we found that (a) the emotion gratitude reduces impatience even when real money is at stake, and (b) the effects of gratitude are differentiable from those of the more general positive state of happiness. These findings challenge the view that individuals must tamp down affective responses through effortful self-regulation to reach more patient and adaptive economic decisions. © The Author(s) 2014.

Peeling Away Timing Error in NetFlow Data

NASA Astrophysics Data System (ADS)

Trammell, Brian; Tellenbach, Bernhard; Schatzmann, Dominik; Burkhart, Martin

In this paper, we characterize, quantify, and correct timing errors introduced into network flow data by collection and export via Cisco NetFlow version 9. We find that while some of these sources of error (clock skew, export delay) are generally implementation-dependent and known in the literature, there is an additional cyclic error of up to one second that is inherent to the design of the export protocol. We present a method for correcting this cyclic error in the presence of clock skew and export delay. In an evaluation using traffic with known timing collected from a national-scale network, we show that this method can successfully correct the cyclic error. However, there can also be other implementation-specific errors for which insufficient information remains for correction. On the routers we have deployed in our network, this limits the accuracy to about 70ms, reinforcing the point that implementation matters when conducting research on network measurement data.

3,4-methylenedioxymethamphetamine self-administration is abolished in serotonin transporter knockout mice.

PubMed

Trigo, José Manuel; Renoir, Thibault; Lanfumey, Laurence; Hamon, Michel; Lesch, Klaus-Peter; Robledo, Patricia; Maldonado, Rafael

2007-09-15

The neurobiological mechanism underlying the reinforcing effects of 3,4-methylenedioxymethamphetamine (MDMA) remains unclear. The aim of the present study was to determine the contribution of the serotonin transporter (SERT) in MDMA self-administration behavior by using knockout (KO) mice deficient in SERT. Knockout mice and wild-type (WT) littermates were trained to acquire intravenous self-administration of MDMA (0, .03, .06, .125, and .25 mg/kg/infusion) on a fixed ratio 1 (FR1) schedule of reinforcement. Additional groups of mice were trained to obtain food and water to rule out operant responding impairments. Microdialysis studies were performed to evaluate dopamine (DA) and serotonin (5-HT) extracellular levels in the nucleus accumbens (NAC) and prefrontal cortex (PFC), respectively, after acute MDMA (10 mg/kg). None of the MDMA doses tested maintained intravenous self-administration in KO animals, whereas WT mice acquired responding for MDMA. Acquisition of operant responding for food and water was delayed in KO mice, but no differences between genotypes were observed on the last day of training. MDMA increased DA extracellular levels to a similar extent in the NAC of WT and KO mice. Conversely, extracellular concentrations of 5-HT in the PFC were increased following MDMA only in WT mice. These findings provide evidence for the specific involvement of SERT in MDMA reinforcing properties.

Viscoelastic behavior and life-time predictions

NASA Technical Reports Server (NTRS)

Dillard, D. A.; Brinson, H. F.

1985-01-01

Fiber reinforced plastics were considered for many structural applications in automotive, aerospace and other industries. A major concern was and remains the failure modes associated with the polymer matrix which serves to bind the fibers together and transfer the load through connections, from fiber to fiber and ply to ply. An accelerated characterization procedure for prediction of delayed failures was developed. This method utilizes time-temperature-stress-moisture superposition principles in conjunction with laminated plate theory. Because failures are inherently nonlinear, the testing and analytic modeling for both moduli and strength is based upon nonlinear viscoelastic concepts.

Two models for a maternal factor in the inheritance of Huntington disease.

PubMed Central

Boehnke, M; Conneally, P M; Lange, K

1983-01-01

Huntington disease is a classic example of an autosomal dominant trait. Over the years, however, a number of investigators have reported anomalies regarding the age of onset of the disease that are inconsistent with this paradigm. We propose two models in which a maternal factor--cytoplasmic in one case, autosomal or X-linked in the other--acts to delay onset in a manner consistent with the previously reported anomalies. Relevant data from the Huntington's Disease Research Roster are presented that reinforce and extend the previous observations. PMID:6225335

Mechanical properties of three layer glass fibre reinforced unsaturated polyester filled with P84 Polyimide

NASA Astrophysics Data System (ADS)

Ibrahim, Nik Noor Idayu Nik; Mamauod, Siti Nur Liyana; Romli, Ahmad Zafir

2017-12-01

The glass fibre reinforced orthophthalic unsaturated polyester composite was widely used in the pipeline industry as a replacement to the corroded steel pipes. A filler which possesses high mechanical performance at high temperature; P84 Polyimide used as the particulate reinforcement in the unsaturated polyester matrix system to increase the mechanical performance of the glass fibre reinforced unsaturated polyester. The glass fibre composite laminates were prepared through a hand lay-up technique and fabricated into three layer laminate. Prior to be used as the matrix system in the lamination process, the unsaturated polyester resin was mixed with masterbatch P84 Polyimide at three loadings amount of 1, 3, and 5 wt%. The addition of P84 Polyimide at 1, 3, and 5 wt% increased the tensile properties and flexural properties especially at 1 wt% filler loading. As the filler loading increased, the tensile properties and flexural properties showed decreasing pattern. In the dynamic mechanical analysis, the values of storage modulus were taken at two points; 50 °C and 150 °C which were the storage modulus before and after the glass transition temperature. All storage modulus showed fluctuation trend for both before and after Tg. However, the storage modulus of the filled composite laminates after Tg showed higher values than unfilled composite laminates at all filler loading. Since the P84 Polyimide possesses high thermal stability, the presence of P84 Polyimide inside the composite system had assisted in delaying the Tg. In terms of the filler dispersion, the Cole-Cole plot showed an imperfect semi-circular shape which indicated good filler dispersion.

The role of multisensor data fusion in neuromuscular control of a sagittal arm with a pair of muscles using actor-critic reinforcement learning method.

PubMed

Golkhou, V; Parnianpour, M; Lucas, C

2004-01-01

In this study, we consider the role of multisensor data fusion in neuromuscular control using an actor-critic reinforcement learning method. The model we use is a single link system actuated by a pair of muscles that are excited with alpha and gamma signals. Various physiological sensor information such as proprioception, spindle sensors, and Golgi tendon organs have been integrated to achieve an oscillatory movement with variable amplitude and frequency, while achieving a stable movement with minimum metabolic cost and coactivation. The system is highly nonlinear in all its physical and physiological attributes. Transmission delays are included in the afferent and efferent neural paths to account for a more accurate representation of the reflex loops. This paper proposes a reinforcement learning method with an Actor-Critic architecture instead of middle and low level of central nervous system (CNS). The Actor in this structure is a two layer feedforward neural network and the Critic is a model of the cerebellum. The Critic is trained by the State-Action-Reward-State-Action (SARSA) method. The Critic will train the Actor by supervisory learning based on previous experiences. The reinforcement signal in SARSA is evaluated based on available alternatives concerning the concept of multisensor data fusion. The effectiveness and the biological plausibility of the present model are demonstrated by several simulations. The system showed excellent tracking capability when we integrated the available sensor information. Addition of a penalty for activation of muscles resulted in much lower muscle coactivation while keeping the movement stable.

A comparison of cosmological models using time delay lenses

DOE Office of Scientific and Technical Information (OSTI.GOV)

Wei, Jun-Jie; Wu, Xue-Feng; Melia, Fulvio, E-mail: jjwei@pmo.ac.cn, E-mail: xfwu@pmo.ac.cn, E-mail: fmelia@email.arizona.edu

2014-06-20

The use of time-delay gravitational lenses to examine the cosmological expansion introduces a new standard ruler with which to test theoretical models. The sample suitable for this kind of work now includes 12 lens systems, which have thus far been used solely for optimizing the parameters of ΛCDM. In this paper, we broaden the base of support for this new, important cosmic probe by using these observations to carry out a one-on-one comparison between competing models. The currently available sample indicates a likelihood of ∼70%-80% that the R {sub h} = ct universe is the correct cosmology versus ∼20%-30% formore » the standard model. This possibly interesting result reinforces the need to greatly expand the sample of time-delay lenses, e.g., with the successful implementation of the Dark Energy Survey, the VST ATLAS survey, and the Large Synoptic Survey Telescope. In anticipation of a greatly expanded catalog of time-delay lenses identified with these surveys, we have produced synthetic samples to estimate how large they would have to be in order to rule out either model at a ∼99.7% confidence level. We find that if the real cosmology is ΛCDM, a sample of ∼150 time-delay lenses would be sufficient to rule out R {sub h} = ct at this level of accuracy, while ∼1000 time-delay lenses would be required to rule out ΛCDM if the real universe is instead R {sub h} = ct. This difference in required sample size reflects the greater number of free parameters available to fit the data with ΛCDM.« less

The Dynamics of Conditioning and Extinction

PubMed Central

Killeen, Peter R.; Sanabria, Federico; Dolgov, Igor

2009-01-01

Pigeons responded to intermittently reinforced classical conditioning trials with erratic bouts of responding to the CS. Responding depended on whether the prior trial contained a peck, food, or both. A linear-persistence/learning model moved animals into and out of a response state, and a Weibull distribution for number of within-trial responses governed in-state pecking. Variations of trial and inter-trial durations caused correlated changes in rate and probability of responding, and model parameters. A novel prediction—in the protracted absence of food, response rates can plateau above zero—was validated. The model predicted smooth acquisition functions when instantiated with the probability of food, but a more accurate jagged learning curve when instantiated with trial-to-trial records of reinforcement. The Skinnerian parameter was dominant only when food could be accelerated or delayed by pecking. These experiments provide a framework for trial-by-trial accounts of conditioning and extinction that increases the information available from the data, permitting them to comment more definitively on complex contemporary models of momentum and conditioning. PMID:19839699

Somato-dendritic Synaptic Plasticity and Error-backpropagation in Active Dendrites

PubMed Central

Schiess, Mathieu; Urbanczik, Robert; Senn, Walter

2016-01-01

In the last decade dendrites of cortical neurons have been shown to nonlinearly combine synaptic inputs by evoking local dendritic spikes. It has been suggested that these nonlinearities raise the computational power of a single neuron, making it comparable to a 2-layer network of point neurons. But how these nonlinearities can be incorporated into the synaptic plasticity to optimally support learning remains unclear. We present a theoretically derived synaptic plasticity rule for supervised and reinforcement learning that depends on the timing of the presynaptic, the dendritic and the postsynaptic spikes. For supervised learning, the rule can be seen as a biological version of the classical error-backpropagation algorithm applied to the dendritic case. When modulated by a delayed reward signal, the same plasticity is shown to maximize the expected reward in reinforcement learning for various coding scenarios. Our framework makes specific experimental predictions and highlights the unique advantage of active dendrites for implementing powerful synaptic plasticity rules that have access to downstream information via backpropagation of action potentials. PMID:26841235

The acquisition of conditioned responding.

PubMed

Harris, Justin A

2011-04-01

This report analyzes the acquisition of conditioned responses in rats trained in a magazine approach paradigm. Following the suggestion by Gallistel, Fairhurst, and Balsam (2004), Weibull functions were fitted to the trial-by-trial response rates of individual rats. These showed that the emergence of responding was often delayed, after which the response rate would increase relatively gradually across trials. The fit of the Weibull function to the behavioral data of each rat was equaled by that of a cumulative exponential function incorporating a response threshold. Thus, the growth in conditioning strength on each trial can be modeled by the derivative of the exponential--a difference term of the form used in many models of associative learning (e.g., Rescorla & Wagner, 1972). Further analyses, comparing the acquisition of responding with a continuously reinforced stimulus (CRf) and a partially reinforced stimulus (PRf), provided further evidence in support of the difference term. In conclusion, the results are consistent with conventional models that describe learning as the growth of associative strength, incremented on each trial by an error-correction process.

Is it patience or motivation? On motivational confounds in intertemporal choice tasks.

PubMed

Paglieri, Fabio; Addessi, Elsa; Sbaffi, Agnese; Tasselli, Maria Isabella; Delfino, Alexia

2015-01-01

Intertemporal choices create a tension between amount maximization, which would favor the larger and later option (LL), and delay minimization, which would promote the smaller and sooner reward (SS). Two common interpretations of intertemporal choice behavior are discussed: looking at LL responses as indicative of self-control, and using intertemporal choices to assess delay aversion. We argue that both interpretations need to take into account motivational confounds, in order to be warranted by data. In intertemporal choices with prepotent, salient stimuli (e.g., food amounts, typically used with nonhuman primates), LL responses could also be indicative of failed inhibition of a "go for more" impulsive response-the opposite of self-control. Similarly, intertemporal choices can be used to measure delay aversion only with respect to the subject's baseline motivation to maximize the reinforcer in question, and this baseline is not always assessed in current experimental protocols. This concern is especially crucial in comparing intertemporal choices across different groups or manipulation. We focus in particular on the effects of reward types on intertemporal choices, presenting two experimental studies where the difference in behavior with monetary versus food rewards is the product of different baseline motivation, rather than variations in delay aversion. We conclude discussing the implications of these and other similar recent findings, which are far-reaching. © Society for the Experimental Analysis of Behavior.

Study on In-mold Punching during PPS/GF Injection Molding

NASA Astrophysics Data System (ADS)

Inuzuka, Takayuki; Fujita, Akihiro; Nakai, Asami; Hamada, Hiroyuki

The influence of the punching condition on strength and the amount of shear droop was investigated to optimize the processing condition for punching in the mold during glass fiber reinforced polyphenylenesulfide (PPS/GF) injection molding. For in-mold punching part during cooling process, the tensile strength was constant because the pressure loss by the punch did not occur. The amount of the shear droop decreased in line with the increase in delay time because the rigidity of injection molded part in the mold increased when the resin was cooled. Moreover, when the resin temperature lowered more than the glass transition temperature, the amount of the shear droop was constant because the rigidity became constant. It is necessary to begin punching when the resin temperature lowers more than the glass transition temperature after holding pressure process is completed, to secure high strength and to assume 0.05 mm or less, at which level the shear droop cannot be visually recognized. The shortest delay time for PPS/GF is 8 sec. The delay time to minimize the amount of the shear droop can be guessed by analyzing the temperature change of the resin in the mold by injection molding CAE.

The radiology digital dashboard: effects on report turnaround time.

PubMed

Morgan, Matthew B; Branstetter, Barton F; Lionetti, David M; Richardson, Jeremy S; Chang, Paul J

2008-03-01

As radiology departments transition to near-complete digital information management, work flows and their supporting informatics infrastructure are becoming increasingly complex. Digital dashboards can integrate separate computerized information systems and summarize key work flow metrics in real time to facilitate informed decision making. A PACS-integrated digital dashboard function designed to alert radiologists to their unsigned report queue status, coupled with an actionable link to the report signing application, resulted in a 24% reduction in the time between transcription and report finalization. The dashboard was well received by radiologists who reported high usage for signing reports. Further research is needed to identify and evaluate other potentially useful work flow metrics for inclusion in a radiology clinical dashboard.

Empirical Behavioral Models to Support Alternative Tools for the Analysis of Mixed-Priority Pedestrian-Vehicle Interaction in a Highway Capacity Context

PubMed Central

Rouphail, Nagui M.

2011-01-01

This paper presents behavioral-based models for describing pedestrian gap acceptance at unsignalized crosswalks in a mixed-priority environment, where some drivers yield and some pedestrians cross in gaps. Logistic regression models are developed to predict the probability of pedestrian crossings as a function of vehicle dynamics, pedestrian assertiveness, and other factors. In combination with prior work on probabilistic yielding models, the results can be incorporated in a simulation environment, where they can more fully describe the interaction of these two modes. The approach is intended to supplement HCM analytical procedure for locations where significant interaction occurs between drivers and pedestrians, including modern roundabouts. PMID:21643488

Durability of treatment response to zolpidem with three different maintenance regimens: a preliminary study.

PubMed

Perlis, Michael; Grandner, Michael; Zee, Jarcy; Bremer, Erin; Whinnery, Julia; Barilla, Holly; Andalia, Priscilla; Gehrman, Phil; Morales, Knashawn; Thase, Michael; Bootzin, Richard; Ader, Robert

2015-09-01

At present, there is no consensus regarding how to medically manage chronic insomnia in the long term. The unstated standard of practice is for patients to use hypnotics intermittently. The present study aimed to compare a partial reinforcement strategy with nightly and intermittent dosing strategies for its potential as a maintenance therapy. A mixed model was used in the study. One between-subjects factor: group (n = 4). One repeated-measures factor: time (12 weekly assessments). A total of 74 subjects with chronic Insomnia were treated with 10 mg zolpidem for 4 weeks. Treatment respondents were randomized to nightly dosing with 10 mg or 5 mg (QHS-10 and QHS-5), intermittent dosing with 10 mg (IDS-10 [3-5 days weekly]), or partial reinforcement dosing with 10 mg (PRS-10 [nightly pill use with 50% active medication and 50% placebos]) for 12 weeks. It was found, in compliant subjects (n = 55), that all four strategies evaluated maintained treatment response over time (ie, prevented or delayed relapse). For the subjects that remained in remission, the subjects in the intermittent dosing group (IDS-10) group exhibited poorer sleep continuity. While best considered a preliminary study, the present findings suggest that the partial reinforcement strategy may be a viable means toward maintaining treatment gains over time with less active medication. Copyright © 2015. Published by Elsevier B.V.

Durability of treatment response to zolpidem with three different maintenance regimens: a preliminary study

PubMed Central

Perlis, Michael; Grandner, Michael; Zee, Jarcy; Bremer, Erin; Whinnery, Julia; Barilla, Holly; Andalia, Priscilla; Gehrman, Phil; Morales, Knashawn; Thase, Michael; Bootzin, Richard; Ader, Robert

2015-01-01

Background and aim At present, there is no consensus regarding how to medically manage chronic insomnia in the long term. The unstated standard of practice is for patients to use hypnotics intermittently. The present study aimed to compare a partial reinforcement strategy with nightly and intermittent dosing strategies for its potential as a maintenance therapy. Methods A mixed model was used in the study. One between-subjects factor: group (n = 4). One repeated-measures factor: time (12 weekly assessments). A total of 74 subjects with chronic Insomnia were treated with 10 mg zolpidem for 4 weeks. Treatment respondents were randomized to nightly dosing with 10 mg or 5 mg (QHS-10 and QHS-5), intermittent dosing with 10 mg (IDS-10 [3–5 days weekly]), or partial reinforcement dosing with 10 mg (PRS-10 [nightly pill use with 50% active medication and 50% placebos]) for 12 weeks. Results It was found, in compliant subjects (n = 55), that all four strategies evaluated maintained treatment response over time (ie, prevented or delayed relapse). For the subjects that remained in remission, the subjects in the intermittent dosing group (IDS-10) group exhibited poorer sleep continuity. Conclusions While best considered a preliminary study, the present findings suggest that the partial reinforcement strategy may be a viable means toward maintaining treatment gains over time with less active medication. PMID:26298795

Working Memory Contributions to Reinforcement Learning Impairments in Schizophrenia

PubMed Central

Brown, Jaime K.; Gold, James M.; Waltz, James A.; Frank, Michael J.

2014-01-01

Previous research has shown that patients with schizophrenia are impaired in reinforcement learning tasks. However, behavioral learning curves in such tasks originate from the interaction of multiple neural processes, including the basal ganglia- and dopamine-dependent reinforcement learning (RL) system, but also prefrontal cortex-dependent cognitive strategies involving working memory (WM). Thus, it is unclear which specific system induces impairments in schizophrenia. We recently developed a task and computational model allowing us to separately assess the roles of RL (slow, cumulative learning) mechanisms versus WM (fast but capacity-limited) mechanisms in healthy adult human subjects. Here, we used this task to assess patients' specific sources of impairments in learning. In 15 separate blocks, subjects learned to pick one of three actions for stimuli. The number of stimuli to learn in each block varied from two to six, allowing us to separate influences of capacity-limited WM from the incremental RL system. As expected, both patients (n = 49) and healthy controls (n = 36) showed effects of set size and delay between stimulus repetitions, confirming the presence of working memory effects. Patients performed significantly worse than controls overall, but computational model fits and behavioral analyses indicate that these deficits could be entirely accounted for by changes in WM parameters (capacity and reliability), whereas RL processes were spared. These results suggest that the working memory system contributes strongly to learning impairments in schizophrenia. PMID:25297101

Sexuality and reproductive issues in children with myelomeningocele.

PubMed

Joyner, B D; McLorie, G A; Khoury, A E

1998-02-01

Recent advancements in surgical and medical therapies have improved the life expectancy of children with myelomeningocele. Yet, there has been a contrasting lack of improvement with regards to sexual function and reproductive issues that continue to infantilize this population. This article identifies five major risk factors that contribute to these delays which invariably lead to irreversible emotional trauma if they are not addressed early in childhood. Adequate psychosexual education of myelomeningocele patients and their families is a tremendous societal challenge. But, only with education will there be trends away from policies of isolation to those that reinforce community integration of the physically disabled.

[Behavior therapy technics in the treatment of endogenous eczema with special reference to compulsive scratching].

PubMed

Böddeker, K W; Böddeker, M

1976-01-01

An exact observation and description of scratching behavior leads to a behavioral model for the obsessional scratching in patients with atopic dermatitis. The patient who cannot handle negative emotions because of a deficit in social behavior strategies suffers from diffuse tension. He can reduce the tension for the moment by scratching. Thus itching is being reinforced. The feeling of misbehavior occurs with delay and then again can serve as a stimulus for more tension.--Basing on this model behavior therapeutical techniques for breaking up this vicious circle are discussed.

Observational learning from a radical-behavioristic viewpoint

PubMed Central

Deguchi, Hikaru

1984-01-01

Bandura (1972, 1977b) has argued that observational learning has some distinctive features that set it apart from the operant paradigm: (1) acquisition simply through observation, (2) delayed performance through cognitive mediation, and (3) vicarious reinforcement. The present paper first redefines those three features at the descriptive level, and then adopts a radical-behavioristic viewpoint to show how those redefined distinctive features can be explained and tested experimentally. Finally, the origin of observational learning is discussed in terms of recent data of neonatal imitation. The present analysis offers a consistent theoretical and practical understanding of observational learning from a radical-behavioristic viewpoint. PMID:22478602

A critique of medicalisation: three instances.

PubMed

Ryang, Sonia

2017-12-01

By briefly exploring three different examples where the existence of mental illness and developmental delay has been presumed, this paper sheds light on the way what Foucault calls the emergence of a regime of truth, i.e. where something that does not exist is made to exist through the construction of a system of truth around it. The first example concerns the direct marketing of pharmaceutical products to consumers in the US, the second the use of psychology in semi-post-Cold War Korea, and the third the persisting authority of psychology in the treatment of the developmentally delayed. While these instances are not innately connected, looking at these as part of the process by which the authoritative knowledge is established will help us understand, albeit partially, the mechanism by which mental illness penetrates our lives as truth, and how this regime of truth is supported by the authority of psychology, psychiatry and psychoanalysis, what Foucault calls the 'psy-function,' reinforcing the medicalisation of our lives.

Liver repair and hemorrhage control by using laser soldering of liquid albumin in a porcine model.

PubMed

Wadia, Y; Xie, H; Kajitani, M

2000-01-01

We evaluated laser soldering by using liquid albumin for welding liver injuries. Major liver trauma has a high mortality because of immediate exsanguination and a delayed morbidity from septicemia, peritonitis, biliary fistulae, and delayed secondary hemorrhage. Eight laceration (6 x 2 cm) and eight nonanatomic resection injuries (raw surface, 6 x 2 cm) were repaired. An 805-nm laser was used to weld 50% liquid albumin-indocyanine green solder to the liver surface, reinforcing it with a free autologous omental scaffold. The animals were heparinized and hepatic inflow occlusion was used for vascular control. All 16 soldering repairs were evaluated at 3 hours. All 16 laser mediated liver repairs had minimal blood loss as compared with the suture controls. No dehiscence, hemorrhage, or bile leakage was seen in any of the laser repairs after 3 hours. Laser fusion repair of the liver is a reliable technique to gain hemostasis on the raw surface as well as weld lacerations. Copyright 2000 Wiley-Liss, Inc.

Long-term behavioral sensitization to apomorphine is independent of conditioning and increases conditioned pecking, but not preference, in pigeons.

PubMed

Anselme, Patrick; Edeş, Neslihan; Tabrik, Sepideh; Güntürkün, Onur

2018-01-15

When rodents are given a free choice between a variable option and a constant option, they may prefer variability. This preference is even sometimes increased following repeated administration of a dopamine agonist. The present study was the first to examine preference for variability under the systemic administration of a dopamine agonist, apomorphine (Apo), in birds. Experiment 1 tested the drug-free preference and the propensity to choose of pigeons for a constant over a variable delay. It appeared that they preferred and decided more quickly to peck at the optimal delay option. Experiment 2 assessed the effects of a repeated injection of Apo on delay preference, in comparison with previous control tests within the same individuals. Apo treatment might have decreased the number of pecks at the constant option across the different experimental phases, but failed to induce a preference for the variable option. In Experiment 3, two groups of pigeons (Apo-sensitized and saline) were used in order to avoid inhomogeneity in treatments. They had to choose between a 50% probability option and a 5-s delay option. Conditioned pecking and the propensity to choose were higher in the Apo-sensitized pigeons, but, in each group, the pigeons showed indifference between the two options. This experiment also showed that long-term behavioral sensitization to Apo can occur independently of a conditioning process. These results suggest that Apo sensitization can enhance the attractiveness of conditioned cues, while having no effect on the development of a preference for variable-delay and probabilistic schedules of reinforcement. Copyright © 2017 Elsevier B.V. All rights reserved.

Acquisition of delayed matching in the pigeon.

PubMed

Berryman, R; Cumming, W W; Nevin, J A

1963-01-01

Pigeons were exposed to three successive matching-to-sample procedures. On a given trial, the sample (red, green or blue light) appeared on a center key; observing responses to this key produced the comparison stimuli on two side keys. Seven different experimental conditions could govern the temporal relations between the sample and comparison stimuli. In the "simultaneous" condition, the center key response was followed immediately by illumination of the side key comparison stimuli, with the center key remaining on. In "zero delay" the center key response simultaneously turned the side keys on and the center key off, while in the "variable delay" conditions, intervals of 1, 2, 4, 10, and 24 sec were interposed between the offset of the sample and the appearance of the comparison stimuli on the side keys. In all conditions, a response to the side key of matching hue produced reinforcement, while a response to the non-matching side key was followed by a blackout. In procedure I all seven experimental conditions were presented in randomly permutated order. After nine sessions of exposure (at 191 trials per session, for a total of 1719 trials) the birds gave no evidence of acquisition in any of the conditions. They were therefore transferred to Procedure II, which required them to match only in the "simultaneous" condition, with both the sample and comparison stimuli present at the same time. With the exception of one bird, all subjects acquired this performance to near 100% levels. Next, in Procedure III, they were once more exposed to presentation of all seven experimental conditions in random order. In contrast to Procedure I, they now acquired the delay performance, and were able to match effectively at delays of about 4 sec.

A comparative study of the structures and electronic properties of graphene fragments: A DFT and MP2 survey

NASA Astrophysics Data System (ADS)

de Carvalho, E. F. V.; Lopez-Castillo, A.; Roberto-Neto, O.

2018-01-01

Graphene can be viewed as sheet of benzene rings fused together forming a variety of structures including the trioxotriangulenes (TOTs) which is a class of organic molecules with electro-active properties. In order to clarify such properties, structures and electronic properties of the graphene fragments phenalenyl, triangulene, 6-oxophenalenoxyl, and X3TOT (X = H, F, Cl) are computed. Validation of the methodologies are carried out using the density functionals B3LYP, M06-2X, B2PLYP-D, and the MP2 theory, giving equilibrium geometries of benzene, naphthalene, and anthracene with mean unsigned error (MUE) of only 0.003, 0.007, 0.004, and 0.007 Å, respectively in relation to experiment.

The effects of extinction-aroused attention on context conditioning.

PubMed

Nelson, James Byron; Fabiano, Andrew M; Lamoureux, Jeffrey A

2018-04-01

Two experiments assessed the effects of extinguishing a conditioned cue on subsequent context conditioning. Each experiment used a different video-game method where sensors predicted attacking spaceships and participants responded to the sensor in a way that prepared them for the upcoming attack. In Experiment 1 extinction of a cue which signaled a spaceship-attack outcome facilitated subsequent learning when the attack occurred unsignaled. In Experiment 2 extinction of a cue facilitated subsequent learning, regardless of whether the spaceship outcome was the same or different as used in the earlier training. In neither experiment did the extinction context become inhibitory. Results are discussed in terms of current associative theories of attention and conditioning. © 2018 Nelson et al.; Published by Cold Spring Harbor Laboratory Press.

Effect of planar cuts' orientation on the perceived surface layout and object's shape.

PubMed

Bocheva, Nadejda

2009-07-01

The effect of the orientation of the cutting planes producing planar curves over the surface of an object on its perceived pose and shape was investigated for line drawings representing three-dimensional objects. The results suggest that the orientational flow produced by the surface curves introduces an apparent object rotation in depth and in the image plane and changes in its perceived elongation. The apparent location of the nearest points is determined by the points of maximal view-dependent unsigned curvature of the surface curves. The data are discussed in relation to the interaction of the shape-from-silhouette system and shape-from-contour system and its effect on the interpretation of the surface contours with respect to the surface geometry.

Nonparametric weighted stochastic block models

NASA Astrophysics Data System (ADS)

Peixoto, Tiago P.

2018-01-01

We present a Bayesian formulation of weighted stochastic block models that can be used to infer the large-scale modular structure of weighted networks, including their hierarchical organization. Our method is nonparametric, and thus does not require the prior knowledge of the number of groups or other dimensions of the model, which are instead inferred from data. We give a comprehensive treatment of different kinds of edge weights (i.e., continuous or discrete, signed or unsigned, bounded or unbounded), as well as arbitrary weight transformations, and describe an unsupervised model selection approach to choose the best network description. We illustrate the application of our method to a variety of empirical weighted networks, such as global migrations, voting patterns in congress, and neural connections in the human brain.

"Forty is the new twenty": An analysis of British media portrayals of older mothers.

PubMed

Mills, Tracey A; Lavender, Rebecca; Lavender, Tina

2015-06-01

Despite increased risks of infertility and poor outcomes, women in high-income countries are increasingly deferring pregnancy beyond age 35.The underlying causes are incompletely understood. The mass media is recognised as a powerful influence on health-related behaviour; therefore media representations warrant critical examination. Qualitative thematic analysis of portrayals of pregnancy and birth in women over 35 in UK national newspapers, popular magazines and television programmes Extensive media interest in childbearing and a preponderance of coverage related to celebrities was confirmed. Three main themes were identified; delayed childbearing was portrayed positively, as part of a life plan allowing women have the "best of both worlds". The media did not acknowledge age per sé as an obstacle to pregnancy and endorsed reproductive technologies suggesting 'it's never too late'. Images and descriptions of ideal post-pregnancy bodies in women over 35 reinforced the message that "you can regain your beautiful body". Delayed childbearing was represented positively, as it facilitated conformity with dominant ideologies surrounding motherhood. Within these boundaries, the effects of age were disregarded. This study provides evidence of restrictive framing of the issues surrounding delayed childbearing in the UK media which militate against communication of important public health messages. Copyright © 2014 Elsevier B.V. All rights reserved.

A Fiber Optic Doppler Sensor and Its Application in Debonding Detection for Composite Structures

PubMed Central

Li, Fucai; Murayama, Hideaki; Kageyama, Kazuro; Meng, Guang; Ohsawa, Isamu; Shirai, Takehiro

2010-01-01

Debonding is one of the most important damage forms in fiber-reinforced composite structures. This work was devoted to the debonding damage detection of lap splice joints in carbon fiber reinforced plastic (CFRP) structures, which is based on guided ultrasonic wave signals captured by using fiber optic Doppler (FOD) sensor with spiral shape. Interferometers based on two types of laser sources, namely the He-Ne laser and the infrared semiconductor laser, are proposed and compared in this study for the purpose of measuring Doppler frequency shift of the FOD sensor. Locations of the FOD sensors are optimized based on mechanical characteristics of lap splice joint. The FOD sensors are subsequently used to detect the guided ultrasonic waves propagating in the CFRP structures. By taking advantage of signal processing approaches, features of the guided wave signals can be revealed. The results demonstrate that debonding in the lap splice joint results in arrival time delay of the first package in the guided wave signals, which can be the characteristic for debonding damage inspection and damage extent estimation. PMID:22219698

A fiber optic Doppler sensor and its application in debonding detection for composite structures.

PubMed

Li, Fucai; Murayama, Hideaki; Kageyama, Kazuro; Meng, Guang; Ohsawa, Isamu; Shirai, Takehiro

2010-01-01

Debonding is one of the most important damage forms in fiber-reinforced composite structures. This work was devoted to the debonding damage detection of lap splice joints in carbon fiber reinforced plastic (CFRP) structures, which is based on guided ultrasonic wave signals captured by using fiber optic Doppler (FOD) sensor with spiral shape. Interferometers based on two types of laser sources, namely the He-Ne laser and the infrared semiconductor laser, are proposed and compared in this study for the purpose of measuring Doppler frequency shift of the FOD sensor. Locations of the FOD sensors are optimized based on mechanical characteristics of lap splice joint. The FOD sensors are subsequently used to detect the guided ultrasonic waves propagating in the CFRP structures. By taking advantage of signal processing approaches, features of the guided wave signals can be revealed. The results demonstrate that debonding in the lap splice joint results in arrival time delay of the first package in the guided wave signals, which can be the characteristic for debonding damage inspection and damage extent estimation.

Acquisition of choice in concurrent chains: Assessing the cumulative decision model.

PubMed

Grace, Randolph C

2016-05-01

Concurrent chains is widely used to study pigeons' choice between terminal links that can vary in delay, magnitude, or probability of reinforcement. We review research on the acquisition of choice in this procedure. Acquisition has been studied with a variety of research designs, and some studies have incorporated no-food trials to allow for timing and choice to be observed concurrently. Results show that: Choice can be acquired rapidly within sessions when terminal links change unpredictably; under steady-state conditions, acquisition depends on both initial- and terminal-link schedules; and initial-link responding is mediated by learning about the terminal-link stimulus-reinforcer relations. The cumulative decision model (CDM) proposed by Christensen and Grace (2010) and Grace and McLean (2006, 2015) provides a good description of within-session acquisition, and correctly predicts the effects of initial and terminal-link schedules in steady-state designs (Grace, 2002a). Questions for future research include how abrupt shifts in preference within individual sessions and temporal control of terminal-link responding can be modeled. Copyright © 2016 Elsevier B.V. All rights reserved.

Feasibility and potential efficacy of the family-centered Prevent-Teach-Reinforce model with families of children with developmental disorders.

PubMed

Bailey, Kathleen M; Blair, Kwang-Sun Cho

2015-12-01

This study examined the feasibility and potential efficacy of the family-centered Prevent-Teach-Reinforce (PTR) model with three families of young children with an autism spectrum disorder or language delay with sensory processing problems. Particularly, the study assessed the family adherence to the PTR intervention, changes in child behavior, family use of the Individualized Behavior Rating Scale Tool (IBRST), procedural integrity, and social validity. A multiple-baseline design across families was used to examine the functional relation between parent-implemented PTR intervention and changes in child behavior. Results indicated that the family-centered PTR process was successful in promoting parents to design and implement the PTR intervention plans with fidelity, and the parents' implemented intervention plans were effective in increasing replacement behavior and decreasing problem behavior across children. The results also indicated that the parents successfully used the IBRST to monitor their child's progress and were highly satisfied with the PTR intervention process and outcomes for their children. Copyright © 2015 Elsevier Ltd. All rights reserved.

Selective attention to visual compound stimuli in squirrel monkeys (Saimiri sciureus).

PubMed

Ploog, Bertram O

2011-05-01

Five squirrel monkeys served under a simultaneous discrimination paradigm with visual compound stimuli that allowed measurement of excitatory and inhibitory control exerted by individual stimulus components (form and luminance/"color"), which could not be presented in isolation (i.e., form could not be presented without color). After performance exceeded a criterion of 75% correct during training, unreinforced test trials with stimuli comprising recombined training stimulus components were interspersed while the overall reinforcement rate remained constant for training and testing. The training-testing series was then repeated with reversed reinforcement contingencies. The findings were that color acquired greater excitatory control than form under the original condition, that no such difference was found for the reversal condition or for inhibitory control under either condition, and that overall inhibitory control was less pronounced than excitatory control. The remarkably accurate performance throughout suggested that a forced 4-s delay between the stimulus presentation and the opportunity to respond was effective in reducing "impulsive" responding, which has implications for suppressing impulsive responding in children with autism and with attention deficit disorder. Copyright © 2011 Elsevier B.V. All rights reserved.

Heterogeneous Suppression of Sequential Effects in Random Sequence Generation, but Not in Operant Learning.

PubMed

Shteingart, Hanan; Loewenstein, Yonatan

2016-01-01

There is a long history of experiments in which participants are instructed to generate a long sequence of binary random numbers. The scope of this line of research has shifted over the years from identifying the basic psychological principles and/or the heuristics that lead to deviations from randomness, to one of predicting future choices. In this paper, we used generalized linear regression and the framework of Reinforcement Learning in order to address both points. In particular, we used logistic regression analysis in order to characterize the temporal sequence of participants' choices. Surprisingly, a population analysis indicated that the contribution of the most recent trial has only a weak effect on behavior, compared to more preceding trials, a result that seems irreconcilable with standard sequential effects that decay monotonously with the delay. However, when considering each participant separately, we found that the magnitudes of the sequential effect are a monotonous decreasing function of the delay, yet these individual sequential effects are largely averaged out in a population analysis because of heterogeneity. The substantial behavioral heterogeneity in this task is further demonstrated quantitatively by considering the predictive power of the model. We show that a heterogeneous model of sequential dependencies captures the structure available in random sequence generation. Finally, we show that the results of the logistic regression analysis can be interpreted in the framework of reinforcement learning, allowing us to compare the sequential effects in the random sequence generation task to those in an operant learning task. We show that in contrast to the random sequence generation task, sequential effects in operant learning are far more homogenous across the population. These results suggest that in the random sequence generation task, different participants adopt different cognitive strategies to suppress sequential dependencies when generating the "random" sequences.

The longevity of statistical learning: When infant memory decays, isolated words come to the rescue.

PubMed

Karaman, Ferhat; Hay, Jessica F

2018-02-01

Research over the past 2 decades has demonstrated that infants are equipped with remarkable computational abilities that allow them to find words in continuous speech. Infants can encode information about the transitional probability (TP) between syllables to segment words from artificial and natural languages. As previous research has tested infants immediately after familiarization, infants' ability to retain sequential statistics beyond the immediate familiarization context remains unknown. Here, we examine infants' memory for statistically defined words 10 min after familiarization with an Italian corpus. Eight-month-old English-learning infants were familiarized with Italian sentences that contained 4 embedded target words-2 words had high internal TP (HTP, TP = 1.0) and 2 had low TP (LTP, TP = .33)-and were tested on their ability to discriminate HTP from LTP words using the Headturn Preference Procedure. When tested after a 10-min delay, infants failed to discriminate HTP from LTP words, suggesting that memory for statistical information likely decays over even short delays (Experiment 1). Experiments 2-4 were designed to test whether experience with isolated words selectively reinforces memory for statistically defined (i.e., HTP) words. When 8-month-olds were given additional experience with isolated tokens of both HTP and LTP words immediately after familiarization, they looked significantly longer on HTP than LTP test trials 10 min later. Although initial representations of statistically defined words may be fragile, our results suggest that experience with isolated words may reinforce the output of statistical learning by helping infants create more robust memories for words with strong versus weak co-occurrence statistics. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Altered neural processing of reward and punishment in adolescents with Major Depressive Disorder.

PubMed

Landes, I; Bakos, S; Kohls, G; Bartling, J; Schulte-Körne, G; Greimel, E

2018-05-01

Altered reward and punishment function has been suggested as an important vulnerability factor for the development of Major Depressive Disorder (MDD). Prior ERP studies found evidence for neurophysiological dysfunctions in reinforcement processes in adults with MDD. To date, only few ERP studies have examined the neural underpinnings of reinforcement processing in adolescents diagnosed with MDD. The present event-related potential (ERP) study aimed to investigate neurophysiological mechanisms of anticipation and consumption of reward and punishment in adolescents with MDD in one comprehensive paradigm. During ERP recording, 25 adolescents with MDD and 29 healthy controls (12-17 years) completed a Monetary Incentive Delay Task comprising both a monetary reward and a monetary punishment condition. During anticipation, the cue-P3 signaling attentional allocation was recorded. During consumption, the feedback-P3 and Reward Positivity (RewP) were recorded to capture attentional allocation and outcome evaluation, respectively. Compared to controls, adolescents with MDD showed prolonged cue-P3 latencies to reward cues. Furthermore, unlike controls, adolescents with MDD displayed shorter feedback-P3 latencies in the reward versus punishment condition. RewPs did not differ between groups. It remains unanswered whether the observed alterations in adolescent MDD represent a state or trait. Delayed neural processing of reward cues corresponds to the clinical presentation of adolescent MDD with reduced motivational tendencies to obtain rewards. Relatively shorter feedback-P3 latencies in the reward versus punishment condition could indicate a high salience of performance-contingent reward. Frequent exposure of negatively biased adolescents with MDD to performance-contingent rewards might constitute a promising intervention approach. Copyright © 2018 Elsevier B.V. All rights reserved.

Determinants of delay in malaria care-seeking behaviour for children 15 years and under in Bata district, Equatorial Guinea.

PubMed

Romay-Barja, Maria; Cano, Jorge; Ncogo, Policarpo; Nseng, Gloria; Santana-Morales, Maria A; Valladares, Basilio; Riloha, Matilde; Benito, Agustin

2016-03-31

Malaria remains a major cause of morbidity and mortality in children under 5 years of age in Equatorial Guinea. Early appropriate treatment can reduce progression of the illness to severe stages, thus reducing of mortality, morbidity and onward transmission. The factors that contribute to malaria treatment delay have not been studied previously in Equatorial Guinea. The objective of this study was to assess the determinants of delay in seeking malaria treatment for children in the Bata district, in mainland Equatorial Guinea. A cross-sectional study was conducted in Bata district, in 2013, which involved 428 houses in 18 rural villages and 26 urban neighbourhoods. Household caregivers were identified in each house and asked about their knowledge of malaria and about the management of the last reported malaria episode in a child 15 years and younger under their care. Bivariate and multivariate statistical analyses were conducted to determine the relevance of socio-economic, geographical and behavioural factors on delays in care-seeking behaviour. Nearly half of the children sought treatment at least 24 h after the onset of the symptoms. The median delay in seeking care was 2.8 days. Children from households with the highest socio-economic status were less likely to be delayed in seeking care than those from households with the lowest socio-economic status (OR 0.37, 95% CI 0.19-0.72). Children that first received treatment at home, mainly paracetamol, were more than twice more likely to be delayed for seeking care, than children who did not first receive treatment at home (OR 2.36, 95% CI 1.45-3.83). Children living in a distance >3 km from the nearest health facility were almost two times more likely to be delayed in seeking care than those living closer to a facility but with non significant association once adjusted for other variables (OR 1.75, 95% CI 0.88-3.47). To decrease malaria morbidity and mortality in Bata district, efforts should be addressed to reduce household delays in seeking care. It is necessary to provide free access to effective malaria diagnosis and treatment, to reinforce malaria management at community level through community health workers and drug sellers and to increase awareness on the severity of malaria, the importance of early diagnosis and appropriate treatment.

Working memory contributions to reinforcement learning impairments in schizophrenia.

PubMed

Collins, Anne G E; Brown, Jaime K; Gold, James M; Waltz, James A; Frank, Michael J

2014-10-08

Previous research has shown that patients with schizophrenia are impaired in reinforcement learning tasks. However, behavioral learning curves in such tasks originate from the interaction of multiple neural processes, including the basal ganglia- and dopamine-dependent reinforcement learning (RL) system, but also prefrontal cortex-dependent cognitive strategies involving working memory (WM). Thus, it is unclear which specific system induces impairments in schizophrenia. We recently developed a task and computational model allowing us to separately assess the roles of RL (slow, cumulative learning) mechanisms versus WM (fast but capacity-limited) mechanisms in healthy adult human subjects. Here, we used this task to assess patients' specific sources of impairments in learning. In 15 separate blocks, subjects learned to pick one of three actions for stimuli. The number of stimuli to learn in each block varied from two to six, allowing us to separate influences of capacity-limited WM from the incremental RL system. As expected, both patients (n = 49) and healthy controls (n = 36) showed effects of set size and delay between stimulus repetitions, confirming the presence of working memory effects. Patients performed significantly worse than controls overall, but computational model fits and behavioral analyses indicate that these deficits could be entirely accounted for by changes in WM parameters (capacity and reliability), whereas RL processes were spared. These results suggest that the working memory system contributes strongly to learning impairments in schizophrenia. Copyright © 2014 the authors 0270-6474/14/3413747-10$15.00/0.

Reinforcement of schedule-induced drinking in rats by lick-contingent shortening of food delivery.

PubMed

Álvarez, Beatriz; Íbias, Javier; Pellón, Ricardo

2016-12-01

Schedule-induced drinking has been a theoretical question of concern ever since it was first described more than 50 years ago. It has been classified as adjunctive behavior; that is, behavior that is induced by an incentive but not reinforced by it. Nevertheless, some authors have argued against this view, claiming that adjunctive drinking is actually a type of operant behavior. If this were true, schedule-induced drinking should be controlled by its consequences, which is the major definition of an operant. The present study tested this hypothesis. In a first experimental phase, a single pellet of food was delivered at regular 90-s intervals, but the interfood interval could be shortened depending on the rat's licking. The degree of contingency between licking the bottle spout and hastening the delivery of the food pellet was 100 %, 50 %, and 0 % for 3 separate groups of animals. Rats that could shorten the interval (100 % and 50 % contingency) drank at a higher rate than those that could not (0 %), and the level of acquisition was positively related to the degree of contingency. In a second phase of the experiment, all groups were exposed to a 100 % contingency, which resulted in all rats developing high levels of schedule-induced drinking. Licking is enhanced if it hastens reinforcement, and can do so at delay characteristics of those present in studies of schedule-induced drinking, thus supporting the view that adjunctive behavior is an operant.

Application of Bionic Design to FRP T-Joints

NASA Astrophysics Data System (ADS)

Luo, Guang-Min; Kuo, Chia-Hung

2017-09-01

We applied the concepts of bionics to enhance the mechanical strength of fiberglass reinforced plastic T-joints. The failure modes of the designed arthrosis-like and gum-like joints were determined using three-point bending tests and numerical simulations and compared with those of normal T-joints bonded using structural adhesives. In the simulation, we used cohesive elements to simulate the adhesive interface of the structural adhesive. The experimental and simulation results show that the arthrosis-like joint can effectively delay the failure progress and enhance the bonding strength of T-joints, thus confirming that an appropriate bionic design can effectively control the bonding properties of structural adhesives.

Present State of the Art of Composite Fabric Forming: Geometrical and Mechanical Approaches

PubMed Central

Cherouat, Abel; Borouchaki, Houman

2009-01-01

Continuous fibre reinforced composites are now firmly established engineering materials for the manufacture of components in the automotive and aerospace industries. In this respect, composite fabrics provide flexibility in the design manufacture. The ability to define the ply shapes and material orientation has allowed engineers to optimize the composite properties of the parts. The formulation of new numerical models for the simulation of the composite forming processes must allow for reduction in the delay in manufacturing and an optimization of costs in an integrated design approach. We propose two approaches to simulate the deformation of woven fabrics: geometrical and mechanical approaches.

Rule learning in autism: the role of reward type and social context.

PubMed

Jones, E J H; Webb, S J; Estes, A; Dawson, G

2013-01-01

Learning abstract rules is central to social and cognitive development. Across two experiments, we used Delayed Non-Matching to Sample tasks to characterize the longitudinal development and nature of rule-learning impairments in children with Autism Spectrum Disorder (ASD). Results showed that children with ASD consistently experienced more difficulty learning an abstract rule from a discrete physical reward than children with DD. Rule learning was facilitated by the provision of more concrete reinforcement, suggesting an underlying difficulty in forming conceptual connections. Learning abstract rules about social stimuli remained challenging through late childhood, indicating the importance of testing executive functions in both social and non-social contexts.

Design of a Neurally Plausible Model of Fear Learning

PubMed Central

Krasne, Franklin B.; Fanselow, Michael S.; Zelikowsky, Moriel

2011-01-01

A neurally oriented conceptual and computational model of fear conditioning manifested by freezing behavior (FRAT), which accounts for many aspects of delay and context conditioning, has been constructed. Conditioning and extinction are the result of neuromodulation-controlled LTP at synapses of thalamic, cortical, and hippocampal afferents on principal cells and inhibitory interneurons of lateral and basal amygdala. The phenomena accounted for by the model (and simulated by the computational version) include conditioning, secondary reinforcement, blocking, the immediate shock deficit, extinction, renewal, and a range of empirically valid effects of pre- and post-training ablation or inactivation of hippocampus or amygdala nuclei. PMID:21845175

Fragile X syndrome and an isodicentric X chromosome in a woman with multiple anomalies, developmental delay, and normal pubertal development.

PubMed

Freedenberg, D L; Gane, L W; Richards, C S; Lampe, M; Hills, J; O'Connor, R; Manchester, D; Taylor, A; Tassone, F; Hulseberg, D; Hagerman, R J; Patil, S R

1999-07-30

We report on an individual with developmental delays, short stature, skeletal abnormalities, normal pubertal development, expansion of the fragile X triplet repeat, as well as an isodicentric X chromosome. S is a 19-year-old woman who presented for evaluation of developmental delay. Pregnancy was complicated by a threatened miscarriage. She was a healthy child with intellectual impairment noted in infancy. Although she had global delays, speech was noted to be disproportionately delayed with few words until age 3.5 years. Facial appearance was consistent with fragile X syndrome. Age of onset of menses was 11 years with normal breast development. A maternal male second cousin had been identified with fragile X syndrome based on DNA studies. The mother of this child (S's maternal first cousin) and the grandfather (S's maternal uncle) were both intellectually normal but were identified as carrying triplet expansions in the premutation range. S's mother had some school difficulties but was not identified as having global delays. Molecular analysis of S's fragile X alleles noted an expansion of more than 400 CGG repeats in one allele. Routine cytogenetic studies of peripheral blood noted the presence of an isodicentric X in 81of 86 cells scored. Five of 86 cells were noted to be 45,X. Cytogenetic fra(X) studies from peripheral blood showed that the structurally normal chromosome had the fragile site in approximately 16% of the cells. Analysis of maternal fragile X alleles identified an allele with an expansion to approximately 110 repeats. FMRP studies detected the expression of the protein in 24% of cells studied. To our knowledge, this is the first patient reported with an isodicentric X and fragile X syndrome. Whereas her clinical phenotype is suggestive of fragile X syndrome, her skeletal abnormalities may represent the presence of the isodicentric X. Treatment of S with 20 mg/day of Prozac improved her behavior. In the climate of cost con trol, this individual reinforces the recommendation of obtaining chromosomes on individuals with developmental delay even with a family history of fragile X syndrome. Copyright 1999 Wiley-Liss, Inc.

Pharmacology for the treatment of premature ejaculation.

PubMed

Giuliano, François; Clèment, Pierre

2012-07-01

Male sexual response comprises four phases: excitement, including erection; plateau; ejaculation, usually accompanied by orgasm; and resolution. Ejaculation is a complex sexual response involving a sequential process consisting of two phases: emission and expulsion. Ejaculation, which is basically a spinal reflex, requires a tight coordination between sympathetic, parasympathetic, and somatic efferent pathways originating from different segments and area in the spinal cord and innervating pelvi-perineal anatomical structures. A major relaying and synchronizing role is played by a group of lumbar neurons described as the spinal generator of ejaculation. Excitatory and inhibitory influences from sensory genital and cerebral stimuli are integrated and processed in the spinal cord. Premature ejaculation (PE) can be defined by ≤1-min ejaculatory latency, an inability to delay ejaculation, and negative personal consequences. Because there is no physiological impairment in PE, any pharmacological agent with central or peripheral mechanism of action that is delaying the ejaculation is a drug candidate for the treatment of PE. Ejaculation is centrally mediated by a variety of neurotransmitter systems, involving especially serotonin and serotonergic pathways but also dopaminergic and oxytocinergic systems. Pharmacological delay of ejaculation can be achieved either by inhibiting excitatory or reinforcing inhibitory pathways from the brain or the periphery to the spinal cord. PE can be treated with long-term use of selective serotonin-reuptake inhibitors (SSRIs) or tricyclic antidepressants. Dapoxetine, a short-acting SSRI, is the first treatment registered for the on-demand treatment of PE. Anesthetics applied on the glans penis have the ability to lengthen the time to ejaculation. Targeting oxytocinergic, neurokinin-1, dopaminergic, and opioid receptors represent future avenues to delaying ejaculation.

Network models of frequency modulated sweep detection.

PubMed

Skorheim, Steven; Razak, Khaleel; Bazhenov, Maxim

2014-01-01

Frequency modulated (FM) sweeps are common in species-specific vocalizations, including human speech. Auditory neurons selective for the direction and rate of frequency change in FM sweeps are present across species, but the synaptic mechanisms underlying such selectivity are only beginning to be understood. Even less is known about mechanisms of experience-dependent changes in FM sweep selectivity. We present three network models of synaptic mechanisms of FM sweep direction and rate selectivity that explains experimental data: (1) The 'facilitation' model contains frequency selective cells operating as coincidence detectors, summing up multiple excitatory inputs with different time delays. (2) The 'duration tuned' model depends on interactions between delayed excitation and early inhibition. The strength of delayed excitation determines the preferred duration. Inhibitory rebound can reinforce the delayed excitation. (3) The 'inhibitory sideband' model uses frequency selective inputs to a network of excitatory and inhibitory cells. The strength and asymmetry of these connections results in neurons responsive to sweeps in a single direction of sufficient sweep rate. Variations of these properties, can explain the diversity of rate-dependent direction selectivity seen across species. We show that the inhibitory sideband model can be trained using spike timing dependent plasticity (STDP) to develop direction selectivity from a non-selective network. These models provide a means to compare the proposed synaptic and spectrotemporal mechanisms of FM sweep processing and can be utilized to explore cellular mechanisms underlying experience- or training-dependent changes in spectrotemporal processing across animal models. Given the analogy between FM sweeps and visual motion, these models can serve a broader function in studying stimulus movement across sensory epithelia.

Adinkra (in)equivalence from Coxeter group representations: A case study

NASA Astrophysics Data System (ADS)

Chappell, Isaac; Gates, S. James; Hübsch, T.

2014-02-01

Using a MathematicaTM code, we present a straightforward numerical analysis of the 384-dimensional solution space of signed permutation 4×4 matrices, which in sets of four, provide representations of the 𝒢ℛ(4, 4) algebra, closely related to the 𝒩 = 1 (simple) supersymmetry algebra in four-dimensional space-time. Following after ideas discussed in previous papers about automorphisms and classification of adinkras and corresponding supermultiplets, we make a new and alternative proposal to use equivalence classes of the (unsigned) permutation group S4 to define distinct representations of higher-dimensional spin bundles within the context of adinkras. For this purpose, the definition of a dual operator akin to the well-known Hodge star is found to partition the space of these 𝒢ℛ(4, 4) representations into three suggestive classes.

Automated flare forecasting using a statistical learning technique

NASA Astrophysics Data System (ADS)

Yuan, Yuan; Shih, Frank Y.; Jing, Ju; Wang, Hai-Min

2010-08-01

We present a new method for automatically forecasting the occurrence of solar flares based on photospheric magnetic measurements. The method is a cascading combination of an ordinal logistic regression model and a support vector machine classifier. The predictive variables are three photospheric magnetic parameters, i.e., the total unsigned magnetic flux, length of the strong-gradient magnetic polarity inversion line, and total magnetic energy dissipation. The output is true or false for the occurrence of a certain level of flares within 24 hours. Experimental results, from a sample of 230 active regions between 1996 and 2005, show the accuracies of a 24-hour flare forecast to be 0.86, 0.72, 0.65 and 0.84 respectively for the four different levels. Comparison shows an improvement in the accuracy of X-class flare forecasting.

Decision making with uncertain reinforcement in children with attention deficit/hyperactivity disorder (ADHD).

PubMed

Drechsler, Renate; Rizzo, Patrizia; Steinhausen, Hans-Christoph

2010-01-01

Reward-related processes are impaired in children with ADHD. Whether these deficits can be ascribed to an aversion to delay or to an altered responsiveness to magnitude, frequency, valence, or the probability of rewards still needs to be explored. In the present study, children with ADHD and normal controls aged 7 to 10 years performed a simple probabilistic discounting task. They had to choose between alternatives where the magnitude of rewards was inversely related to the probability of outcomes. As a result, children with ADHD opted more frequently for less likely but larger rewards than normal controls. Shifts of the response category after positive or negative feedback, however, occurred as often in children with ADHD as in control children. In children with ADHD, the frequency of risky choices was correlated with neuropsychological measures of response time variability but unrelated to measures of inhibitory control. It is concluded that the tendency to select less likely but larger rewards possibly represents a separate facet of dysfunctional reward processing, independent of delay aversion or altered responsiveness to feedback.

Sutureless liver repair and hemorrhage control using laser-mediated fusion of human albumin as a solder.

PubMed

Wadia, Y; Xie, H; Kajitani, M

2001-07-01

Major liver trauma has a high mortality because of immediate exsanguination and a delayed morbidity from septicemia, peritonitis, biliary fistulae, and delayed secondary hemorrhage. We evaluated laser soldering using liquid albumin for welding liver injuries. Fourteen lacerations (6 x 2 cm) and 13 nonanatomic resection injuries (raw surface, 8 x 2 cm) were repaired. An 805-nm laser was used to weld 53% liquid albumin-indocyanine green solder to the liver surface, reinforcing it by welding a free autologous omental scaffold. The animals were heparinized and hepatic inflow occlusion was used for vascular control. For both laceration and resection injuries, 16 soldering repairs were evaluated acutely at 3 hours. Eleven animals were evaluated chronically, two at 2 weeks and nine at 4 weeks. All 27 laser mediated-liver repairs had minimal blood loss compared with the suture controls. No dehiscence, hemorrhage, or bile leakage was seen in any of the laser repairs after 3 hours. All 11 chronic repairs healed without complication. This modality effectively seals the liver surface, joins lacerations with minimal thermal injury, and works independently of the patient's coagulation status.

A new approach to assess gambling-like behavior in laboratory rats: using intracranial self-stimulation as a positive reinforcer

PubMed Central

Tedford, Stephanie E.; Holtz, Nathan A.; Persons, Amanda L.; Napier, T. Celeste

2014-01-01

Pathological gambling is one manifestation of impulse control disorders. The biological underpinnings of these disorders remain elusive and treatment is far from ideal. Animal models of impulse control disorders are a critical research tool for understanding this condition and for medication development. Modeling such complex behaviors is daunting, but by its deconstruction, scientists have recapitulated in animals critical aspects of gambling. One aspect of gambling is cost/benefit decision-making wherein one weighs the anticipated costs and expected benefits of a course of action. Risk/reward, delay-based and effort-based decision-making all represent cost/benefit choices. These features are studied in humans and have been translated to animal protocols to measure decision-making processes. Traditionally, the positive reinforcer used in animal studies is food. Here, we describe how intracranial self-stimulation can be used for cost/benefit decision-making tasks and overview our recent studies showing how pharmacological therapies alter these behaviors in laboratory rats. We propose that these models may have value in screening new compounds for the ability to promote and prevent aspects of gambling behavior. PMID:24966822

Economic principles motivating social attention in humans.

PubMed

Hayden, Benjamin Y; Parikh, Purak C; Deaner, Robert O; Platt, Michael L

2007-07-22

We know little about the processes by which we evaluate the opportunity to look at another person. We propose that behavioural economics provides a powerful approach to understanding this basic aspect of social attention. We hypothesized that the decision process culminating in attention to another person follows the same economic principles that govern choices about rewards such as food, drinks and money. Specifically, such rewards are discounted as a function of time, are tradable for other rewards, and reinforce work. Behavioural and neurobiological evidence suggests that looking at other people can also be described as rewarding, but to what extent these economic principles apply to social orienting remains unknown. Here, we show that the opportunity to view pictures of the opposite sex is discounted by delay to viewing, substitutes for money and reinforces work. The reward value of photos of the opposite sex varied with physical attractiveness and was greater in men, suggesting differential utility of acquiring visual information about the opposite sex in men and women. Together, these results demonstrate that choosing whom to look at follows a general set of economic principles, implicating shared neural mechanisms in both social and non-social decision making.

Fatigue Damage Evaluation of Short Carbon Fiber Reinforced Plastics Based on Phase Information of Thermoelastic Temperature Change.

PubMed

Shiozawa, Daiki; Sakagami, Takahide; Nakamura, Yu; Nonaka, Shinichi; Hamada, Kenichi

2017-12-06

Carbon fiber-reinforced plastic (CFRP) is widely used for structural members of transportation vehicles such as automobile, aircraft, or spacecraft, utilizing its excellent specific strength and specific rigidity in contrast with the metal. Short carbon fiber composite materials are receiving a lot of attentions because of their excellent moldability and productivity, however they show complicated behaviors in fatigue fracture due to the random fibers orientation. In this study, thermoelastic stress analysis (TSA) using an infrared thermography was applied to evaluate fatigue damage in short carbon fiber composites. The distribution of the thermoelastic temperature change was measured during the fatigue test, as well as the phase difference between the thermoelastic temperature change and applied loading signal. Evolution of fatigue damage was detected from the distribution of thermoelastic temperature change according to the thermoelastic damage analysis (TDA) procedure. It was also found that fatigue damage evolution was more clearly detected than before by the newly developed thermoelastic phase damage analysis (TPDA) in which damaged area was emphasized in the differential phase delay images utilizing the property that carbon fiber shows opposite phase thermoelastic temperature change.

Behaviour of reinforced concrete slabs with steel fibers

NASA Astrophysics Data System (ADS)

Baarimah, A. O.; Syed Mohsin, S. M.

2017-11-01

This paper investigates the potential effect of steel fiber added into reinforced concrete slabs. Four-point bending test is conducted on six slabs to investigate the structural behaviour of the slabs by considering two different parameters; (i) thickness of slab (ii) volume fraction of steel fiber. The experimental work consists of six slabs, in which three slabs are designed in accordance to Eurocode 2 to fulfil shear capacity characteristic, whereas, the other three slabs are designed with 17% less thickness, intended to fail in shear. Both series of slabs are added with steel fiber with a volume fraction of Vf = 0%, Vf = 1% and Vf = 2% in order to study the effect and potential of fiber to compensate the loss in shear capacity. The slab with Vf = 0% steel fiber and no reduction in thickness is taken as the control slab. The experimental result suggests promising improvement of the load carrying capacity (up to 32%) and ductility (up to 87%) as well as delayed in crack propagation for the slabs with Vf = 2%. In addition, it is observed that addition of fibers compensates the reduction in the slab thickness as well as changes the failure mode of the slab from brittle to a more ductile manner.

Distinctiveness enhances long-term event memory in non-human primates, irrespective of reinforcement.

PubMed

Lewis, Amy; Call, Josep; Berntsen, Dorthe

2017-08-01

Non-human primates are capable of recalling events that occurred as long as 3 years ago, and are able to distinguish between similar events; akin to human memory. In humans, distinctiveness enhances memory for events, however, it is unknown whether the same occurs in non-human primates. As such, we tested three great ape species on their ability to remember an event that varied in distinctiveness. Across three experiments, apes witnessed a baiting event in which one of three identical containers was baited with food. After a delay of 2 weeks, we tested their memory for the location of the baited container. Apes failed to recall the baited container when the event was undistinctive (Experiment 1), but were successful when it was distinctive (Experiment 2), although performance was equally good in a less-distinctive condition. A third experiment (Experiment 3) confirmed that distinctiveness, independent of reinforcement, was a consistent predictor of performance. These findings suggest that distinctiveness may enhance memory for events in non-human primates in the same way as in humans, and provides further evidence of basic similarities between the ways apes and humans remember past events. © 2017 Wiley Periodicals, Inc.

Life Limiting Behavior in Interlaminar Shear of Continuous Fiber-Reinforced Ceramic Matrix Composites at Elevated Temperatures

NASA Technical Reports Server (NTRS)

Choi, Sung R.; Calomino, Anthony M.; Bansal, Narottam P.; Verrilli, Michael J.

2006-01-01

Interlaminar shear strength of four different fiber-reinforced ceramic matrix composites was determined with doublenotch shear test specimens as a function of test rate at elevated temperatures ranging from 1100 to 1316 C in air. Life limiting behavior, represented as interlaminar shear strength degradation with decreasing test rate, was significant for 2-D crossplied SiC/MAS-5 and 2-D plain-woven C/SiC composites, but insignificant for 2-D plain-woven SiC/SiC and 2-D woven Sylramic (Dow Corning, Midland, Michigan) SiC/SiC composites. A phenomenological, power-law delayed failure model was proposed to account for and to quantify the rate dependency of interlaminar shear strength of the composites. Additional stress rupture testing in interlaminar shear was conducted at elevated temperatures to validate the proposed model. The model was in good agreement with SiC/MAS-5 and C/SiC composites, but in poor to reasonable agreement with Sylramic SiC/SiC. Constant shear stress-rate testing was proposed as a possible means of life prediction testing methodology for ceramic matrix composites subjected to interlaminar shear at elevated temperatures when short lifetimes are expected.

Two-key concurrent responding: response-reinforcement dependencies and blackouts1

PubMed Central

Herbert, Emily W.

1970-01-01

Two-key concurrent responding was maintained for three pigeons by a single variable-interval 1-minute schedule of reinforcement in conjunction with a random number generator that assigned feeder operations between keys with equal probability. The duration of blackouts was varied between keys when each response initiated a blackout, and grain arranged by the variable-interval schedule was automatically presented after a blackout (Exp. I). In Exp. II every key peck, except for those that produced grain, initiated a blackout, and grain was dependent upon a response following a blackout. For each pigeon in Exp. I and for one pigeon in Exp. II, the relative frequency of responding on a key approximated, i.e., matched, the relative reciprocal of the duration of the blackout interval on that key. In a third experiment, blackouts scheduled on a variable-interval were of equal duration on the two keys. For one key, grain automatically followed each blackout; for the other key, grain was dependent upon a response and never followed a blackout. The relative frequency of responding on the former key, i.e., the delay key, better approximated the negative exponential function obtained by Chung (1965) than the matching function predicted by Chung and Herrnstein (1967). PMID:16811458

Neuronal Reward and Decision Signals: From Theories to Data

PubMed Central

Schultz, Wolfram

2015-01-01

Rewards are crucial objects that induce learning, approach behavior, choices, and emotions. Whereas emotions are difficult to investigate in animals, the learning function is mediated by neuronal reward prediction error signals which implement basic constructs of reinforcement learning theory. These signals are found in dopamine neurons, which emit a global reward signal to striatum and frontal cortex, and in specific neurons in striatum, amygdala, and frontal cortex projecting to select neuronal populations. The approach and choice functions involve subjective value, which is objectively assessed by behavioral choices eliciting internal, subjective reward preferences. Utility is the formal mathematical characterization of subjective value and a prime decision variable in economic choice theory. It is coded as utility prediction error by phasic dopamine responses. Utility can incorporate various influences, including risk, delay, effort, and social interaction. Appropriate for formal decision mechanisms, rewards are coded as object value, action value, difference value, and chosen value by specific neurons. Although all reward, reinforcement, and decision variables are theoretical constructs, their neuronal signals constitute measurable physical implementations and as such confirm the validity of these concepts. The neuronal reward signals provide guidance for behavior while constraining the free will to act. PMID:26109341

Response rate and reinforcement rate in Pavlovian conditioning.

PubMed

Harris, Justin A; Carpenter, Joanne S

2011-10-01

Four experiments used delay conditioning of magazine approach in rats to investigate the relationship between the rate of responding, R, to a conditioned stimulus (CS) and the rate, r, at which the CS is reinforced with the unconditioned stimulus (US). Rats were concurrently trained with four variable-duration CSs with different rs, either as a result of differences in the mean CS-US interval or in the proportion of CS presentations that ended with the US. In each case, R was systematically related to r, and the relationship was very accurately characterized by a hyperbolic function, R = Ar/(r +c). Accordingly, the reciprocal of these two variables-response interval, I (= 1/R), and CS-US interval, i (= 1/r) - were related by a simple affine (straight line) transformation, I = mi+b. This latter relationship shows that each increment in the time that the rats had to wait for food produced a linear increment in the time they waited between magazine entries. We discuss the close agreement between our findings and the Matching Law (Herrnstein, 1970) and consider their implications for both associative theories (e.g., Rescorla & Wagner, 1972) and nonassociative theories (Gallistel & Gibbon, 2000) of conditioning. (PsycINFO Database Record (c) 2011 APA, all rights reserved).

Anticonflict effect of alpidem as compared with the benzodiazepine alprazolam in rats.

PubMed

Hascoët, M; Bourin, M

1997-02-01

A comparative study between two drugs acting on the GABAA receptor, alprazolam and alpidem was undertaken, using simple tests such as measurement of spontaneous locomotor activity, four plates test and rotarod in mice. Additional conflict test was further performed using a new conflict paradigm where the opportunity existed for rats to choose during punished periods between immediate, punished reinforcement and delayed non-punished reinforcement. The benzodiazepine alprazolam, demonstrated, as expected, strong anxiolytic effects in mice and increased punished response in rats at non sedative doses (0.5, 1 mg/kg). High doses of alprazolam decreased spontaneous locomotor activity and induced myorelaxant effects in mice. Alpidem, an imidazopyridine derivative, induced motor impairment in mice and only very weak anxiolytic effects in the four plates test in mice (4 mg/kg) and in punished procedure in rats (32 mg/kg). As alprazolam is a full agonist for the GABAA receptor complex and alpidem is a partial agonist acting with specificity on omega 1 GABAA receptor subtypes, the results are discussed. Activity on omega 1 receptor subtypes is perhaps not sufficient in order to obtain a true anti-conflict effect and compounds such as alpidem only relieve some of the symptoms of anxiety disorders.

A cross-sectional survey to assess the migraineur's medication decision-making beliefs: determining when a migraine is triptan-worthy.

PubMed

Landy, Stephen H; Turner, Ira M; Runken, M Chris; Lee, Mechele; Sulcs, Ellen; Bell, Christopher F

2013-01-01

To investigate the factors that influence a migraineur's beliefs regarding oral triptans for the acute treatment of migraines and to provide further insight into patients' decision-making process when faced with migraine. A multicenter, cross-sectional, observational study of subjects currently prescribed an oral triptan medication for the acute treatment of migraine headaches. Subjects were recruited from 6 headache clinics and one primary care practice in the United States. Enrolled subjects completed a questionnaire that could be completed either at the site as part of the visit or at home. The questionnaire comprised 27 questions assessing demographic characteristics, migraine history, migraine frequency and severity, and general beliefs about migraine treatments. The study population was stratified into 2 cohorts (Early Treatment and Delayed Treatment) based on how they typically use their oral triptan to treat a typical migraine. A total 506 subjects were enrolled in the study, of which 502 were stratified into the Early Treatment cohort (41.2%) and Delayed Treatment cohort (58.8%). Demographic and clinical characteristics were generally similar between the 2 cohorts. In terms of general treatment patterns, there were notable differences between the Delayed and Early Treatment cohorts, with the Delayed Treatment cohort significantly more likely to take an over-the-counter (OTC) or non-triptan medication first (P ≤ .001) and only take a triptan if the OTC or non-triptan medication did not work (P ≤ .001). Furthermore, 55% of the Delayed Treatment cohort delayed taking a triptan to be certain that the headache was a migraine (vs 32% of the Early Treatment cohort; P ≤ .001). When asked to specify the reasons for delaying treatment with a triptan, the Delayed Treatment cohort had, in general, greater concerns about using their oral triptan in comparison with the Early Treatment cohort. In particular, respondents were primarily concerned with running out of their triptan medication with 35% of the Delayed Treatment cohort expressing this concern compared with 22% of the Early Treatment cohort (P ≤ .001). Statistically significant differences were also noted for concerns about taking medications (P ≤ .001), side effects (P ≤ .05), expense (P ≤ .01), and taking prescription medications (P ≤ .001). Results build upon previously published studies and suggest that patient beliefs directly influence how migraineurs manage their migraines and have implications for patient outcomes. Such insights should be used to facilitate physician-patient communication and reinforce the need for patient-centered care to improve patient outcomes. © 2013 American Headache Society.

Study design for a randomized controlled trial to increase the relative reinforcing value of vegetable consumption using incentive sensitization among obese and overweight people.

PubMed

Jahns, Lisa; Roemmich, James N

2016-09-01

In this manuscript, we present the protocol for a study that applies incentive sensitization theory to improve vegetable intake in overweight and obese adults. This 8-week, randomized, controlled, community-based feeding study with an 8-week follow-up seeks to use repeated exposure to amounts of vegetables recommended by federal guidance to increase the primary outcome of the relative reinforcing value of vegetables compared to a snack food. A community-based design is used to give participants autonomy in choosing their method of exposure. Secondary outcomes include: 1) Determine potential moderators of incentive sensitization of vegetables, including genetic polymorphisms associated with food reinforcement and obesity, 6-n-propylthiouracil tasting status, and delay discounting. 2) Determine whether adding vegetables to the diet results in participants substituting low-energy-dense vegetables for energy-dense foods or whether energy-dense food consumption is independent of vegetable consumption. 3) Determine whether reductions in adiposity are associated with substitution of vegetables in the diet. 4) Determine if markers of bone turnover change. 5) Assess changes in self-reported secondary outcomes measured by questionnaire such as self-efficacy to eat vegetables. The results of this study will provide information about the drivers of individual choice to consume recommended amounts of vegetables. The understanding gained will help increase the effectiveness and sustainability of behavior-based interventions focused on improving vegetable intake. This information may also be used to assist in setting dietary guidance targets for the amounts and types of vegetables Americans can, and should, consume. Published by Elsevier Inc.

Effects of exogenous testosterone on the ventral striatal BOLD response during reward anticipation in healthy women.

PubMed

Hermans, Erno J; Bos, Peter A; Ossewaarde, Lindsey; Ramsey, Nick F; Fernández, Guillén; van Honk, Jack

2010-08-01

Correlational evidence in humans shows that levels of the androgen hormone testosterone are positively related to reinforcement sensitivity and competitive drive. Structurally similar anabolic-androgenic steroids (AAS) are moreover widely abused, and animal studies show that rodents self-administer testosterone. These observations suggest that testosterone exerts activational effects on mesolimbic dopaminergic pathways involved in incentive processing and reinforcement regulation. However, there are no data on humans supporting this hypothesis. We used functional magnetic resonance imaging (fMRI) to investigate the effects of testosterone administration on neural activity in terminal regions of the mesolimbic pathway. In a placebo-controlled double-blind crossover design, 12 healthy women received a single sublingual administration of .5 mg of testosterone. During MRI scanning, participants performed a monetary incentive delay task, which is known to elicit robust activation of the ventral striatum during reward anticipation. Results show a positive main effect of testosterone on the differential response in the ventral striatum to cues signaling potential reward versus nonreward. Notably, this effect interacted with levels self-reported intrinsic appetitive motivation: individuals with low intrinsic appetitive motivation exhibited larger testosterone-induced increases but had smaller differential responses after placebo. Thus, the present study lends support to the hypothesis that testosterone affects activity in terminal regions of the mesolimbic dopamine system but suggests that such effects may be specific to individuals with low intrinsic appetitive motivation. By showing a potential mechanism underlying central reinforcement of androgen use, the present findings may moreover have implications for our understanding of the pathophysiology of AAS dependency. Copyright 2010 Elsevier Inc. All rights reserved.

Good feeling of living in the earth

DOE Office of Scientific and Technical Information (OSTI.GOV)

Wolf, R.

1978-12-01

Underground houses combine energy savings and a comfortable lifestyle that leaves more land undisturbed and works with rather than against nature. Soil moderates and delays temperature fluctuations, leaving the heating system with a steady temperature that is much more efficient than the best insulated above-ground building. The combination of passive solar heating and underground construction suggests the possibility of an entirely new direction for future housing. Passive solar heating is appropriate because of the soil shield and the thermal mass provided by reinforced concrete. Both construction and operating costs are lower than conventional housing. Three styles: bermed, below grade, andmore » dug-in are available. Several sources of additional information are listed.« less

Increasing instructional efficiency by presenting additional stimuli in learning trials for children with autism spectrum disorders.

PubMed

Vladescu, Jason C; Kodak, Tiffany M

2013-12-01

The current study examined the effectiveness and efficiency of presenting secondary targets within learning trials for 4 children with an autism spectrum disorder. Specifically, we compared 4 instructional conditions using a progressive prompt delay. In 3 conditions, we presented secondary targets in the antecedent or consequence portion of learning trials, or in the absence of prompts and reinforcement. In the fourth condition (control), we did not include secondary targets in learning trials. Results replicate and extend previous research by demonstrating that the majority of participants acquired secondary targets presented in the antecedent and consequent events of learning trials. © Society for the Experimental Analysis of Behavior.

Rule Learning in Autism: The Role of Reward Type and Social Context

PubMed Central

Jones, E. J. H.; Webb, S. J.; Estes, A.; Dawson, G.

2013-01-01

Learning abstract rules is central to social and cognitive development. Across two experiments, we used Delayed Non-Matching to Sample tasks to characterize the longitudinal development and nature of rule-learning impairments in children with Autism Spectrum Disorder (ASD). Results showed that children with ASD consistently experienced more difficulty learning an abstract rule from a discrete physical reward than children with DD. Rule learning was facilitated by the provision of more concrete reinforcement, suggesting an underlying difficulty in forming conceptual connections. Learning abstract rules about social stimuli remained challenging through late childhood, indicating the importance of testing executive functions in both social and non-social contexts. PMID:23311315

Influence of the 2009 financial crisis on detection of advanced pulmonary tuberculosis in Osaka city, Japan: a cross-sectional study.

PubMed

Danno, Katsura; Komukai, Jun; Yoshida, Hideki; Matsumoto, Kenji; Koda, Shinichi; Terakawa, Kazuhiko; Iso, Hiroyasu

2013-01-01

To investigate the association between the economic recession and the detection of advanced cases of pulmonary tuberculosis in Osaka city from 2007 to 2009. A repeated cross-sectional study. Osaka city has been the highest tuberculosis burden area in Japan. After the previous global financial crisis, the unemployment rate in Osaka prefecture has deteriorated from 5.3% in 2008 to 6.6% in 2009. During the study period, 3406 pulmonary tuberculosis cases were enrolled: 2530 males and 876 females; 1546 elderly cases (65 years and above) and 1860 young cases (under 65 years); 417 homeless cases and 2989 non-homeless cases. Patients' information included the sex, age, registry, health insurances, places of detection, sputum smear test results, patients' delay, doctors' delay and the grade of chest x-ray findings. They were statistically analysed between 2007 and 2008, two years before and just before the financial crisis, and between 2008 and 2009, just before and after the financial crisis. The total numbers of pulmonary tuberculosis cases were 1172 in 2007, 1083 in 2008 and 1151 in 2009. In health examinations for non-homeless people, higher number of cases in 2009 were sputum smear positive, had respiratory symptoms and showed advanced disease in chest x-rays than those in 2008, with a longer patients' delay. On the contrary, in health examination for homeless people, fewer cases of advanced pulmonary tuberculosis were found in 2009 than in 2008, with a shorter patients' delay. In clinical examinations, there was no trend towards a difference between non-homeless and homeless people. Although homeless people might be protected by public assistance, tuberculosis prevention and control need to be reinforced for the non-homeless population after the financial crisis.

Short-term total sleep deprivation alters delay-conditioned memory in the rat.

PubMed

Tripathi, Shweta; Jha, Sushil K

2016-06-01

Short-term sleep deprivation soon after training may impair memory consolidation. Also, a particular sleep stage or its components increase after learning some tasks, such as negative and positive reinforcement tasks, avoidance tasks, and spatial learning tasks, and so forth. It suggests that discrete memory types may require specific sleep stage or its components for their optimal processing. The classical conditioning paradigms are widely used to study learning and memory but the role of sleep in a complex conditioned learning is unclear. Here, we have investigated the effects of short-term sleep deprivation on the consolidation of delay-conditioned memory and the changes in sleep architecture after conditioning. Rats were trained for the delay-conditioned task (for conditioning, house-light [conditioned stimulus] was paired with fruit juice [unconditioned stimulus]). Animals were divided into 3 groups: (a) sleep deprived (SD); (b) nonsleep deprived (NSD); and (c) stress control (SC) groups. Two-way ANOVA revealed a significant interaction between groups and days (training and testing) during the conditioned stimulus-unconditioned stimulus presentation. Further, Tukey post hoc comparison revealed that the NSD and SC animals exhibited significant increase in performances during testing. The SD animals, however, performed significantly less during testing. Further, we observed that wakefulness and NREM sleep did not change after training and testing. Interestingly, REM sleep increased significantly on both days compared to baseline more specifically during the initial 4-hr time window after conditioning. Our results suggest that the consolidation of delay-conditioned memory is sleep-dependent and requires augmented REM sleep during an explicit time window soon after training. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Exact kinetic energy enables accurate evaluation of weak interactions by the FDE-vdW method.

PubMed

Sinha, Debalina; Pavanello, Michele

2015-08-28

The correlation energy of interaction is an elusive and sought-after interaction between molecular systems. By partitioning the response function of the system into subsystem contributions, the Frozen Density Embedding (FDE)-vdW method provides a computationally amenable nonlocal correlation functional based on the adiabatic connection fluctuation dissipation theorem applied to subsystem density functional theory. In reproducing potential energy surfaces of weakly interacting dimers, we show that FDE-vdW, either employing semilocal or exact nonadditive kinetic energy functionals, is in quantitative agreement with high-accuracy coupled cluster calculations (overall mean unsigned error of 0.5 kcal/mol). When employing the exact kinetic energy (which we term the Kohn-Sham (KS)-vdW method), the binding energies are generally closer to the benchmark, and the energy surfaces are also smoother.

Exact kinetic energy enables accurate evaluation of weak interactions by the FDE-vdW method

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sinha, Debalina; Pavanello, Michele, E-mail: m.pavanello@rutgers.edu

2015-08-28

The correlation energy of interaction is an elusive and sought-after interaction between molecular systems. By partitioning the response function of the system into subsystem contributions, the Frozen Density Embedding (FDE)-vdW method provides a computationally amenable nonlocal correlation functional based on the adiabatic connection fluctuation dissipation theorem applied to subsystem density functional theory. In reproducing potential energy surfaces of weakly interacting dimers, we show that FDE-vdW, either employing semilocal or exact nonadditive kinetic energy functionals, is in quantitative agreement with high-accuracy coupled cluster calculations (overall mean unsigned error of 0.5 kcal/mol). When employing the exact kinetic energy (which we term themore » Kohn-Sham (KS)-vdW method), the binding energies are generally closer to the benchmark, and the energy surfaces are also smoother.« less

Differential effects of adding and removing components of a context on the generalization of conditional freezing.

PubMed

González, Felisa; Quinn, Jennifer J; Fanselow, Michael S

2003-01-01

Rats were conditioned across 2 consecutive days where a single unsignaled footshock was presented in the presence of specific contextual cues. Rats were tested with contexts that had additional stimulus components either added or subtracted. Using freezing as a measure of conditioning, removal but not addition of a cue from the training context produced significant generalization decrement. The results are discussed in relation to the R. A. Rescorla and A. R. Wagner (1972), J. M. Pearce (1994), and A. R. Wagner and S. E. Brandon (2001) accounts of generalization. Although the present data are most consistent with elemental models such as Rescorla and Wagner, a slight modification of the Wagner-Brandon replaced-elements model that can account for differences in the pattern of generalization obtained with contexts and discrete conditional stimuli is proposed.

Post-Extinction Conditional Stimulus Valence Predicts Reinstatement Fear: Relevance for Long Term Outcomes of Exposure Therapy

PubMed Central

Zbozinek, Tomislav D.; Hermans, Dirk; Prenoveau, Jason M.; Liao, Betty; Craske, Michelle G.

2014-01-01

Exposure therapy for anxiety disorders is translated from fear conditioning and extinction. While exposure therapy is effective in treating anxiety, fear sometimes returns after exposure. One pathway for return of fear is reinstatement: unsignaled unconditional stimuli following completion of extinction. The present study investigated the extent to which valence of the conditional stimulus (CS+) after extinction predicts return of CS+ fear after reinstatement. Participants (N = 84) engaged in a differential fear conditioning paradigm and were randomized to reinstatement or non-reinstatement. We hypothesized that more negative post-extinction CS+ valence would predict higher CS+ fear after reinstatement relative to non-reinstatement and relative to extinction retest. Results supported the hypotheses and suggest that strategies designed to decrease negative valence of the CS+ may reduce the return of fear via reinstatement following exposure therapy. PMID:24957680

mGluR5 positive allosteric modulation and its effects on MK-801 induced set-shifting impairments in a rat operant delayed matching/non-matching-to-sample task

PubMed Central

LaCrosse, Amber L.; Burrows, Brian T.; Angulo, Rachel M.; Conrad, Phoebe R.; Himes, Sarah M.; Mathews, Nordia; Wegner, Scott A.; Taylor, Sara B.; Olive, M. Foster

2014-01-01

Rationale Positive allosteric modulators (PAMs) of type 5 metabotropic glutamate receptors (mGluR5) exert pro-cognitive effects in animal models of various neuropsychiatric diseases. However, few studies to date have examined ability of mGluR5 PAMs to reverse cognitive deficits in operant delayed matching/non-matching-to-sample (DMS/DNMS) tasks. Objectives To determine the ability of the mGluR5 PAM 3-cyano-N-1,3-diphenyl-1H-pyrazol-5-yl)benzamide (CDPPB) to reverse set-shifting deficits induced by the NMDA receptor antagonist MK-801. Methods Male Sprague-Dawley rats were initially trained to lever press for sucrose reinforcement under either DMS or DNMS conditions. Following successful acquisition of the task, reinforcement conditions were reversed (DNMS→DMS or DMS→DNMS). In Experiment 1, rats were treated daily prior to each session with either vehicle/vehicle, vehicle/MK-801 (0.06 mg/kg) simultaneously, CDPPB (20 mg/kg)/MK-801 simultaneously, or CDPPB 30 min prior to MK-801. In Experiment 2, rats were treated with either vehicle/vehicle, vehicle/MK-801, or CDPPB 30 min prior to MK-801 only prior to sessions that followed task reversal. Results In Experiment 1, no group differences in initial task acquisition were observed. Rats treated with vehicle+MK−801 showed significant set-shifting impairments following task reversal, which were partially attenuated by simultaneous administration of CDPPB/MK-801, and completely precluded by administration of CDPPB 30 min prior to MK-801. In Experiment 2, MK-801 did not impair reversal learning and no other group differences were observed. Conclusions MK-801 induced deficits in operant set-shifting ability were prevented by pretreatment with CDPPB. MK-801 did not produce deficits in initial task learning or when treatment was initiated following task reversal. PMID:24973895

Extinction of Conditioned Fear is Better Learned and Recalled in the Morning than in the Evening

PubMed Central

Pace-Schott, Edward F.; Spencer, Rebecca M.C.; Vijayakumar, Shilpa; Ahmed, Nafis; Verga, Patrick W.; Orr, Scott P.; Pitman, Roger K.; Milad, Mohammed R.

2013-01-01

Sleep helps emotional memories consolidate and may promote generalization of fear extinction memory. We examined whether extinction learning and memory might differ in the morning and evening due, potentially, to circadian and/or sleep-homeostatic factors. Healthy men (N=109) in 6 groups completed a 2-session protocol. In Session 1, fear conditioning was followed by extinction learning. Partial reinforcement with mild electric shock produced conditioned skin conductance responses (SCR) to 2 differently colored lamps (CS+), but not a third color (CS−), within the computer image of a room (conditioning context). One CS+ (CS+E) but not the other (CS+U) was immediately extinguished by un-reinforced presentations in a different room (extinction context). Delay durations of 3 hr (within AM or PM), 12 hr (morning-to-evening or evening-to-morning) or 24 hr (morning-to-morning or evening-to-evening) followed. In Session 2, extinction recall and contextual fear renewal were tested. We observed no significant effects of the delay interval on extinction memory but did observe an effect of time-of-day. Fear extinction was significantly better if learned in the morning (p=.002). Collapsing across CS+ type, there was smaller morning differential SCR at both extinction recall (p=.003) and fear renewal (p=.005). Morning extinction recall showed better generalization from the CS+E to CS+U with the response to the CS+U significantly larger than to the CS+E only in the evening (p=.028). Thus, extinction is learned faster and its memory is better generalized in the morning. Cortisol and testosterone showed the expected greater salivary levels in the morning when higher testosterone/cortisol ratio also predicting better extinction learning. Circadian factors may promote morning extinction. Alternatively, evening homeostatic sleep pressure may impede extinction and favor recall of conditioned fear. PMID:23992769

Extinction of conditioned fear is better learned and recalled in the morning than in the evening.

PubMed

Pace-Schott, Edward F; Spencer, Rebecca M C; Vijayakumar, Shilpa; Ahmed, Nafis A K; Verga, Patrick W; Orr, Scott P; Pitman, Roger K; Milad, Mohammed R

2013-11-01

Sleep helps emotional memories consolidate and may promote generalization of fear extinction memory. We examined whether extinction learning and memory might differ in the morning and evening due, potentially, to circadian and/or sleep-homeostatic factors. Healthy men (N = 109) in 6 groups completed a 2-session protocol. In Session 1, fear conditioning was followed by extinction learning. Partial reinforcement with mild electric shock produced conditioned skin conductance responses (SCRs) to 2 differently colored lamps (CS+), but not a third color (CS-), within the computer image of a room (conditioning context). One CS+ (CS + E) but not the other (CS + U) was immediately extinguished by un-reinforced presentations in a different room (extinction context). Delay durations of 3 h (within AM or PM), 12 h (morning-to-evening or evening-to-morning) or 24 h (morning-to-morning or evening-to-evening) followed. In Session 2, extinction recall and contextual fear renewal were tested. We observed no significant effects of the delay interval on extinction memory but did observe an effect of time-of-day. Fear extinction was significantly better if learned in the morning (p = .002). Collapsing across CS + type, there was smaller morning differential SCR at both extinction recall (p = .003) and fear renewal (p = .005). Morning extinction recall showed better generalization from the CS + E to CS + U with the response to the CS + U significantly larger than to the CS + E only in the evening (p = .028). Thus, extinction is learned faster and its memory is better generalized in the morning. Cortisol and testosterone showed the expected greater salivary levels in the morning when higher testosterone/cortisol ratio also predicted better extinction learning. Circadian factors may promote morning extinction. Alternatively, evening homeostatic sleep pressure may impede extinction and favor recall of conditioned fear. Copyright © 2013 Elsevier Ltd. All rights reserved.

Infiltration processing of metal matrix composites using coated ceramic particulates

NASA Astrophysics Data System (ADS)

Leon-Patino, Carlos Alberto

2001-07-01

A new process was developed to fabricate particulate metal matrix composites (MMCs). The process involves three steps: (1) modifying the particulate surface by metal coating, (2) forming a particulate porous compact; and (3) introducing metal into the channel network by vacuum infiltration. MMCs with different reinforcements, volume fractions, and sizes can be produced by this technique. Powders of alumina and silicon carbide were successfully coated with nickel and copper in preparation for infiltration with molten aluminum. Electroless Ni and Cu deposition was used since it enhances the wettability of the reinforcements for composite fabrication. While Cu deposits were polycrystalline, traces of phosphorous co-deposited from the electroless bath gave an amorphous Ni-P coating. The effect of metal coating on wetting behavior was evaluated at 800°C on plain and metal-coated ceramic plates using a sessile drop technique. The metallic films eliminated the non-wetting behavior of the uncoated ceramics, leading to equilibrium contact angles in the order of 12° and below 58° for Ni and Cu coated ceramics, respectively. The spreading data indicated that local diffusion at the triple junction was the governing mechanism of the wetting process. Precipitation of intermetallic phases in the drop/ceramic interface delayed the formation of Al4C3. Infiltration with molten Al showed that the coated-particulates are suitable as reinforcing materials for fabricating MMCs, giving porosity-free components with a homogeneously distributed reinforcing phase. The coating promoted easy metal flow through the preform, compared to the non-infiltration behavior of the uncoated counterparts. Liquid state diffusion kinetics due to temperature dependent viscosity forces controlled the infiltration process. Microstructural analysis indicated the formation of intermetallic phases such as CuAl 2, in the case of Cu coating, and Ni2Al3 and NiAl 3 when Ni-coated powders were infiltrated. The overall Ni and Cu content increased from bottom to top of the samples due to dissolution of the metal film by the stream of liquid Al during infiltration. The strengths of the Al/Ni-SiC composites, measured by four-point bending, were 205 and 225 MPa for samples reinforced with 78 mum and 49 mum Ni-SiC, respectively. The mode of fracture was mainly controlled by SiC particle fracture.

Exploring the associations between intimate partner violence victimization during pregnancy and delayed entry into prenatal care: Evidence from a population-based study in Bangladesh.

PubMed

Islam, Md Jahirul; Broidy, Lisa; Baird, Kathleen; Mazerolle, Paul

2017-04-01

Intimate partner violence (IPV) during pregnancy can have serious health consequences for mothers and newborns. The aim of the study is to explore: 1) the influence of experiencing IPV during pregnancy on delayed entry into prenatal care; and 2) whether women's decision-making autonomy and the support for traditional gender roles act to mediate or moderate the relationship between IPV and delayed entry into prenatal care. cross-sectional survey. Multivariate logistic regression models were estimated that control for various socio-demographic and pregnancy related factors to assess whether women who experienced IPV during pregnancy were more likely to delay entry into prenatal care compared with women who had not experienced IPV. The influence of traditional gender roles acceptance and decision-making autonomy were examined both as independent variables and in interaction with IPV, to assess their role as potential mediators or moderators. Chandpur district, Bangladesh. the sample comprised of 426 Bangladeshi women, aged 15-49 years. Postpartum mothers who visited vaccinations centres to receive their children's vaccinations constitute the sampling frame. almost 70% of the women surveyed reported patterns consistent with delayed entry into prenatal care. Accounting for the influence of other covariates, women who experienced physical IPV during pregnancy were 2.61 times more likely (95% CI [1.33, 5.09]) to have delayed entry into prenatal care than their counterparts who did not report physical IPV. Neither sexual nor psychological IPV victimization during pregnancy was linked with late entry into prenatal care. Both gender role attitudes and levels of autonomy mediate the effect of IPV on prenatal care. the results suggest that the high rates of IPV in Bangladesh have effects that can compromise women's health seeking behaviour during pregnancy, putting them and their developing fetus at risk. Specifically, Bangladeshi women who experience physical IPV during pregnancy are more likely to delay or forgo prenatal care, an effect that is further magnified by cultural ideals that emphasize women's traditional roles and limit their autonomy. this study reinforces the need to detect and assist women suffering IPV, not only to offer them help and support but also to increase entry into prenatal care. Healthcare professionals involved in obstetrics and midwifery need to be aware of the risk factors of IPV during pregnancy and be able to identify women who are at risk for delayed entry into prenatal care. Copyright © 2017 Elsevier Ltd. All rights reserved.

Interactions between prefrontal cortex and cerebellum revealed by trace eyelid conditioning.

PubMed

Kalmbach, Brian E; Ohyama, Tatsuya; Kreider, Joy C; Riusech, Frank; Mauk, Michael D

2009-01-01

Eyelid conditioning has proven useful for analysis of learning and computation in the cerebellum. Two variants, delay and trace conditioning, differ only by the relative timing of the training stimuli. Despite the subtlety of this difference, trace eyelid conditioning is prevented by lesions of the cerebellum, hippocampus, or medial prefrontal cortex (mPFC), whereas delay eyelid conditioning is prevented by cerebellar lesions and is largely unaffected by forebrain lesions. Here we test whether these lesion results can be explained by two assertions: (1) Cerebellar learning requires temporal overlap between the mossy fiber inputs activated by the tone conditioned stimulus (CS) and the climbing fiber inputs activated by the reinforcing unconditioned stimulus (US), and therefore (2) trace conditioning requires activity that outlasts the presentation of the CS in a subset of mossy fibers separate from those activated directly by the CS. By use of electrical stimulation of mossy fibers as a CS, we show that cerebellar learning during trace eyelid conditioning requires an input that persists during the stimulus-free trace interval. By use of reversible inactivation experiments, we provide evidence that this input arises from the mPFC and arrives at the cerebellum via a previously unidentified site in the pontine nuclei. In light of previous PFC recordings in various species, we suggest that trace eyelid conditioning involves an interaction between the persistent activity of delay cells in mPFC-a putative mechanism of working memory-and motor learning in the cerebellum.

Deep imitation learning for 3D navigation tasks.

PubMed

Hussein, Ahmed; Elyan, Eyad; Gaber, Mohamed Medhat; Jayne, Chrisina

2018-01-01

Deep learning techniques have shown success in learning from raw high-dimensional data in various applications. While deep reinforcement learning is recently gaining popularity as a method to train intelligent agents, utilizing deep learning in imitation learning has been scarcely explored. Imitation learning can be an efficient method to teach intelligent agents by providing a set of demonstrations to learn from. However, generalizing to situations that are not represented in the demonstrations can be challenging, especially in 3D environments. In this paper, we propose a deep imitation learning method to learn navigation tasks from demonstrations in a 3D environment. The supervised policy is refined using active learning in order to generalize to unseen situations. This approach is compared to two popular deep reinforcement learning techniques: deep-Q-networks and Asynchronous actor-critic (A3C). The proposed method as well as the reinforcement learning methods employ deep convolutional neural networks and learn directly from raw visual input. Methods for combining learning from demonstrations and experience are also investigated. This combination aims to join the generalization ability of learning by experience with the efficiency of learning by imitation. The proposed methods are evaluated on 4 navigation tasks in a 3D simulated environment. Navigation tasks are a typical problem that is relevant to many real applications. They pose the challenge of requiring demonstrations of long trajectories to reach the target and only providing delayed rewards (usually terminal) to the agent. The experiments show that the proposed method can successfully learn navigation tasks from raw visual input while learning from experience methods fail to learn an effective policy. Moreover, it is shown that active learning can significantly improve the performance of the initially learned policy using a small number of active samples.

Interactions Among Working Memory, Reinforcement Learning, and Effort in Value-Based Choice: A New Paradigm and Selective Deficits in Schizophrenia.

PubMed

Collins, Anne G E; Albrecht, Matthew A; Waltz, James A; Gold, James M; Frank, Michael J

2017-09-15

When studying learning, researchers directly observe only the participants' choices, which are often assumed to arise from a unitary learning process. However, a number of separable systems, such as working memory (WM) and reinforcement learning (RL), contribute simultaneously to human learning. Identifying each system's contributions is essential for mapping the neural substrates contributing in parallel to behavior; computational modeling can help to design tasks that allow such a separable identification of processes and infer their contributions in individuals. We present a new experimental protocol that separately identifies the contributions of RL and WM to learning, is sensitive to parametric variations in both, and allows us to investigate whether the processes interact. In experiments 1 and 2, we tested this protocol with healthy young adults (n = 29 and n = 52, respectively). In experiment 3, we used it to investigate learning deficits in medicated individuals with schizophrenia (n = 49 patients, n = 32 control subjects). Experiments 1 and 2 established WM and RL contributions to learning, as evidenced by parametric modulations of choice by load and delay and reward history, respectively. They also showed interactions between WM and RL, where RL was enhanced under high WM load. Moreover, we observed a cost of mental effort when controlling for reinforcement history: participants preferred stimuli they encountered under low WM load. Experiment 3 revealed selective deficits in WM contributions and preserved RL value learning in individuals with schizophrenia compared with control subjects. Computational approaches allow us to disentangle contributions of multiple systems to learning and, consequently, to further our understanding of psychiatric diseases. Copyright © 2017 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

Following rules in the intermontane west: 19th-century mormon settlement

PubMed Central

Norton, William

2001-01-01

The academic discipline of human geography is concerned with human activities, especially as these relate to physical landscapes and contribute to the modification of those landscapes. Although little attention has been paid to objectivist philosophies to inform human geography, behavior analysis might offer a useful explanatory model. As an example, a behavior analysis of selected aspects of 19th-century Mormon movement and settlement in the intermontane West is conducted. Mormons are a society of believers who practice cooperative effort and support for other members, and the Mormon church is governed by priesthood authority with members being called to perform tasks. This analysis employs the concepts of metacontingency, rule-governed behavior, and delayed reinforcement to analyze how Mormons settled the intermontane West. PMID:22478355

Formation of laser-induced periodic surface structures on fused silica upon two-color double-pulse irradiation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Höhm, S.; Herzlieb, M.; Rosenfeld, A.

2013-12-16

The formation of laser-induced periodic surface structures (LIPSS) upon irradiation of fused silica with multiple irradiation sequences consisting of laser pulse pairs (50 fs single-pulse duration) of two different wavelengths (400 and 800 nm) is studied experimentally. Parallel polarized double-pulse sequences with a variable delay Δt between −10 and +10 ps and between the individual fs-laser pulses were used to investigate the LIPSS periods versus Δt. These two-color experiments reveal the importance of the ultrafast energy deposition to the silica surface by the first laser pulse for LIPSS formation. The second laser pulse subsequently reinforces the previously seeded spatial LIPSSmore » frequencies.« less

Self-Learning Power Control in Wireless Sensor Networks.

PubMed

Chincoli, Michele; Liotta, Antonio

2018-01-27

Current trends in interconnecting myriad smart objects to monetize on Internet of Things applications have led to high-density communications in wireless sensor networks. This aggravates the already over-congested unlicensed radio bands, calling for new mechanisms to improve spectrum management and energy efficiency, such as transmission power control. Existing protocols are based on simplistic heuristics that often approach interference problems (i.e., packet loss, delay and energy waste) by increasing power, leading to detrimental results. The scope of this work is to investigate how machine learning may be used to bring wireless nodes to the lowest possible transmission power level and, in turn, to respect the quality requirements of the overall network. Lowering transmission power has benefits in terms of both energy consumption and interference. We propose a protocol of transmission power control through a reinforcement learning process that we have set in a multi-agent system. The agents are independent learners using the same exploration strategy and reward structure, leading to an overall cooperative network. The simulation results show that the system converges to an equilibrium where each node transmits at the minimum power while respecting high packet reception ratio constraints. Consequently, the system benefits from low energy consumption and packet delay.

A Q-backpropagated time delay neural network for diagnosing severity of gait disturbances in Parkinson's disease.

PubMed

Nancy Jane, Y; Khanna Nehemiah, H; Arputharaj, Kannan

2016-04-01

Parkinson's disease (PD) is a movement disorder that affects the patient's nervous system and health-care applications mostly uses wearable sensors to collect these data. Since these sensors generate time stamped data, analyzing gait disturbances in PD becomes challenging task. The objective of this paper is to develop an effective clinical decision-making system (CDMS) that aids the physician in diagnosing the severity of gait disturbances in PD affected patients. This paper presents a Q-backpropagated time delay neural network (Q-BTDNN) classifier that builds a temporal classification model, which performs the task of classification and prediction in CDMS. The proposed Q-learning induced backpropagation (Q-BP) training algorithm trains the Q-BTDNN by generating a reinforced error signal. The network's weights are adjusted through backpropagating the generated error signal. For experimentation, the proposed work uses a PD gait database, which contains gait measures collected through wearable sensors from three different PD research studies. The experimental result proves the efficiency of Q-BP in terms of its improved classification accuracy of 91.49%, 92.19% and 90.91% with three datasets accordingly compared to other neural network training algorithms. Copyright © 2016 Elsevier Inc. All rights reserved.

Self-Learning Power Control in Wireless Sensor Networks

PubMed Central

Liotta, Antonio

2018-01-01

Current trends in interconnecting myriad smart objects to monetize on Internet of Things applications have led to high-density communications in wireless sensor networks. This aggravates the already over-congested unlicensed radio bands, calling for new mechanisms to improve spectrum management and energy efficiency, such as transmission power control. Existing protocols are based on simplistic heuristics that often approach interference problems (i.e., packet loss, delay and energy waste) by increasing power, leading to detrimental results. The scope of this work is to investigate how machine learning may be used to bring wireless nodes to the lowest possible transmission power level and, in turn, to respect the quality requirements of the overall network. Lowering transmission power has benefits in terms of both energy consumption and interference. We propose a protocol of transmission power control through a reinforcement learning process that we have set in a multi-agent system. The agents are independent learners using the same exploration strategy and reward structure, leading to an overall cooperative network. The simulation results show that the system converges to an equilibrium where each node transmits at the minimum power while respecting high packet reception ratio constraints. Consequently, the system benefits from low energy consumption and packet delay. PMID:29382072

Phased-array ultrasonic surface contour mapping system and method for solids hoppers and the like

DOEpatents

Fasching, George E.; Smith, Jr., Nelson S.

1994-01-01

A real time ultrasonic surface contour mapping system is provided including a digitally controlled phased-array of transmitter/receiver (T/R) elements located in a fixed position above the surface to be mapped. The surface is divided into a predetermined number of pixels which are separately scanned by an arrangement of T/R elements by applying phase delayed signals thereto that produce ultrasonic tone bursts from each T/R that arrive at a point X in phase and at the same time relative to the leading edge of the tone burst pulse so that the acoustic energies from each T/R combine in a reinforcing manner at point X. The signals produced by the reception of the echo signals reflected from point X back to the T/Rs are also delayed appropriately so that they add in phase at the input of a signal combiner. This combined signal is then processed to determine the range to the point X using density-corrected sound velocity values. An autofocusing signal is developed from the computed average range for a complete scan of the surface pixels. A surface contour map is generated in real time form the range signals on a video monitor.