Effect of sucrose availability on wheel-running as an operant and as a reinforcing consequence on a multiple schedule: Additive effects of extrinsic and automatic reinforcement.

PubMed

Belke, Terry W; Pierce, W David

2015-07-01

As a follow up to Belke and Pierce's (2014) study, we assessed the effects of repeated presentation and removal of sucrose solution on the behavior of rats responding on a two-component multiple schedule. Rats completed 15 wheel turns (FR 15) for either 15% or 0% sucrose solution in the manipulated component and lever pressed 10 times on average (VR 10) for an opportunity to complete 15 wheel turns (FR 15) in the other component. In contrast to our earlier study, the components advanced based on time (every 8min) rather than completed responses. Results showed that in the manipulated component wheel-running rates were higher and the latency to initiate running longer when sucrose was present (15%) compared to absent (0% or water); the number of obtained outcomes (sucrose/water), however, did not differ with the presentation and withdrawal of sucrose. For the wheel-running as reinforcement component, rates of wheel turns, overall lever-pressing rates, and obtained wheel-running reinforcements were higher, and postreinforcement pauses shorter, when sucrose was present (15%) than absent (0%) in manipulated component. Overall, our findings suggest that wheel-running rate regardless of its function (operant or reinforcement) is maintained by automatically generated consequences (automatic reinforcement) and is increased as an operant by adding experimentally arranged sucrose reinforcement (extrinsic reinforcement). This additive effect on operant wheel-running generalizes through induction or arousal to the wheel-running as reinforcement component, increasing the rate of responding for opportunities to run and the rate of wheel-running per opportunity. Copyright © 2015 Elsevier B.V. All rights reserved.

Aggression as Positive Reinforcement in People with Intellectual Disabilities

ERIC Educational Resources Information Center

May, Michael E.

2011-01-01

From an applied behavior-analytic perspective, aggression in people with intellectual disabilities is mostly maintained by social reinforcement consequences. However, nonsocial consequences have also been identified in functional assessments on aggression. Behaviors producing their own reinforcement have been labeled "automatic" or "nonsocial" in…

From heroin to methadone--social role changes and reinforcement differentials in relation to outcome on methadone. Part I. The study of reinforcement differentials.

PubMed

Cheek, F E; Holstein, C N; Fullam, F A; Arana, G; Tomarchio, T P; Mandell, S

1976-01-01

This study examines the relevance of reinforcements available to the addict in five critical stages of his career to his success on methadone maintenance. In-depth focused interviews were held with 30 addicts who had completed a program of methadone induction and who were characterized by social worker's evaluations as Successful, Marginally Adjusted, or Failures. The Successful group showed a higher initial negative reinforcement followed by higher positive reinforcement on methadone. The Moderately Successful group showed more negative reinforcement before treatment but continued to show negative reinforcements afterwards. The Failures were low on negative reinforcements earlier but negative reinforcements were high after treatment.

Negative reinforcement learning is affected in substance dependence.

PubMed

Thompson, Laetitia L; Claus, Eric D; Mikulich-Gilbertson, Susan K; Banich, Marie T; Crowley, Thomas; Krmpotich, Theodore; Miller, David; Tanabe, Jody

2012-06-01

Negative reinforcement results in behavior to escape or avoid an aversive outcome. Withdrawal symptoms are purported to be negative reinforcers in perpetuating substance dependence, but little is known about negative reinforcement learning in this population. The purpose of this study was to examine reinforcement learning in substance dependent individuals (SDI), with an emphasis on assessing negative reinforcement learning. We modified the Iowa Gambling Task to separately assess positive and negative reinforcement. We hypothesized that SDI would show differences in negative reinforcement learning compared to controls and we investigated whether learning differed as a function of the relative magnitude or frequency of the reinforcer. Thirty subjects dependent on psychostimulants were compared with 28 community controls on a decision making task that manipulated outcome frequencies and magnitudes and required an action to avoid a negative outcome. SDI did not learn to avoid negative outcomes to the same degree as controls. This difference was driven by the magnitude, not the frequency, of negative feedback. In contrast, approach behaviors in response to positive reinforcement were similar in both groups. Our findings are consistent with a specific deficit in negative reinforcement learning in SDI. SDI were relatively insensitive to the magnitude, not frequency, of loss. If this generalizes to drug-related stimuli, it suggests that repeated episodes of withdrawal may drive relapse more than the severity of a single episode. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Emotion dysregulation explains the relation between insomnia symptoms and negative reinforcement smoking cognitions among daily smokers.

PubMed

Kauffman, Brooke Y; Farris, Samantha G; Alfano, Candice A; Zvolensky, Michael J

2017-09-01

Insomnia co-occurs with smoking. However, mechanisms that may explain their comorbidity are not well known. The present study tested the hypothesis that insomnia would exert an indirect effect on negative reinforcement smoking processes via emotion dysregulation among 126 adult non-treatment seeking daily smokers (55 females; M age =44.1years, SD=9.72). Negative reinforcement smoking processes included negative reinforcement smoking outcome expectancies, negative reinforcement smoking motives, and two negative expectancies from brief smoking abstinence (somatic symptoms and harmful consequences). Insomnia symptoms yielded a significant indirect effect through emotion dysregulation for negative reinforcement smoking outcome expectancies, negative reinforcement smoking motives, and harmful consequences expectancies from brief smoking abstinence. In contrast to prediction, however, insomnia was not associated with somatic symptom expectancies from brief smoking abstinence through emotion dysregulation. These data may suggest that the indirect effect of emotion dysregulation is more relevant to cognitive-affective negative reinforcement processes rather than somatic states. Overall, the present findings contribute to a growing body of literature linking emotion dysregulation as an explanatory mechanism for insomnia and smoking and uniquely extend such work to an array of clinically significant negative reinforcement smoking processes. Copyright © 2017 Elsevier Ltd. All rights reserved.

The dissociable effects of punishment and reward on motor learning.

PubMed

Galea, Joseph M; Mallia, Elizabeth; Rothwell, John; Diedrichsen, Jörn

2015-04-01

A common assumption regarding error-based motor learning (motor adaptation) in humans is that its underlying mechanism is automatic and insensitive to reward- or punishment-based feedback. Contrary to this hypothesis, we show in a double dissociation that the two have independent effects on the learning and retention components of motor adaptation. Negative feedback, whether graded or binary, accelerated learning. While it was not necessary for the negative feedback to be coupled to monetary loss, it had to be clearly related to the actual performance on the preceding movement. Positive feedback did not speed up learning, but it increased retention of the motor memory when performance feedback was withdrawn. These findings reinforce the view that independent mechanisms underpin learning and retention in motor adaptation, reject the assumption that motor adaptation is independent of motivational feedback, and raise new questions regarding the neural basis of negative and positive motivational feedback in motor learning.

Are positive and negative reinforcement "different"? Insights from a free-operant differential outcomes effect.

PubMed

Magoon, Michael A; Critchfield, Thomas S; Merrill, Dustin; Newland, M Christopher; Schneider, W Joel

2017-01-01

Although theoretical discussions typically assume that positive and negative reinforcement differ, the literature contains little unambiguous evidence that they produce differential behavioral effects. To test whether the two types of consequences control behavior differently, we pitted money-gain positive reinforcement and money-loss-avoidance negative reinforcement, scheduled through identically programmed variable-cycle schedules, against each other in concurrent schedules. Contingencies of response-produced feedback, normally different in positive and negative reinforcement, were made symmetrical. Steeper matching slopes were produced compared to a baseline consisting of all positive reinforcement. This free-operant differential outcomes effect supports the notion that that stimulus-presentation positive reinforcement and stimulus-elimination negative reinforcement are functionally "different." However, a control experiment showed that the feedback asymmetry of more traditional positive and negative reinforcement schedules also is sufficient to create a "difference" when the type of consequence is held constant. We offer these findings as a small step in meeting the very large challenge of moving negative reinforcement theory beyond decades of relative quiescence. © 2017 Society for the Experimental Analysis of Behavior.

Treating stereotypy in adolescents diagnosed with autism by refining the tactic of "using stereotypy as reinforcement".

PubMed

Potter, Jacqueline N; Hanley, Gregory P; Augustine, Matotopa; Clay, Casey J; Phelps, Meredith C

2013-01-01

Use of automatically reinforced stereotypy as reinforcement has been shown to be successful for increasing socially desirable behaviors in persons with intellectual disabilities (Charlop, Kurtz, & Casey, 1990; Hanley, Iwata, Thompson, & Lindberg, 2000; Hung, 1978). A component analysis of this treatment was conducted with 3 adolescents who had been diagnosed with autism, and then extended by (a) progressively increasing the quantitative and qualitative aspects of the response requirement to earn access to stereotypy, (b) arranging objective measures of client preference for contingent access to stereotypy compared to other relevant treatments for their automatically reinforced stereotypy, and (c) assessing the social validity of this treatment with other relevant stakeholders. Implications for addressing stereotypy and increasing the leisure skills of adolescents with autism are discussed. © Society for the Experimental Analysis of Behavior.

Measuring the Complexity of Treatment for Challenging Behavior using the Treatment Intensity Rating Form.

PubMed

Zarcone, Jennifer; Hagopian, Louis; Ninci, Jennifer; McKay, Chloe; Bonner, Andrew; Dillon, Christopher; Hausman, Nicole

2016-01-01

The goal of this study was to develop and evaluate a tool to measure the complexity and intensity of psychotropic medication interventions, behavioral interventions, and issues related to crisis management for challenging behavior using a standardized rating form. The Treatment Intensity Rating Form (TIRF) is a 10-item scale with three categories: pharmacological interventions, behavior supports, and protective equipment. In a retrospective review we examined the final treatment recommendations for 74 individuals with self-injurious behavior (SIB) based on psychiatric and behavioral notes and reports. We also compared whether TIRF scores differed across individuals for whom SIB was maintained by social reinforcement (e.g., to access attention or toys/activities, or escape from tasks) versus those for whom SIB was maintained by automatic reinforcement (e.g., occurs independent of social variables, and is presumed to be maintained by sensory reinforcement). The TIRF was demonstrated to have strong inter-rater reliability (98%) and appears to have good face validity. As hypothesized, individuals with SIB maintained by automatic reinforcement had significantly more medication trials (p=0.0005) and required more protective equipment than individuals with SIB maintained by social reinforcement (p=0.0002). Antidepressant medication was used more often with individuals with automatically reinforced SIB, although antipsychotics and anticonvulsants were also commonly used across both groups. Findings provide initial support for the TIRF's reliability, and face validity as a measure the level of complexity of medical and behavioral treatment plans - although additional research is needed to fully evaluate its psychometric properties.

Choices between positive and negative reinforcement during treatment for escape-maintained behavior.

PubMed

DeLeon, I G; Neidert, P L; Anders, B M; Rodriguez-Catter, V

2001-01-01

Positive reinforcement was more effective than negative reinforcement in promoting compliance and reducing escape-maintained problem behavior for a child with autism. Escape extinction was then added while the child was given a choice between positive or negative reinforcement for compliance and the reinforcement schedule was thinned. When the reinforcement requirement reached 10 consecutive tasks, the treatment effects became inconsistent and reinforcer selection shifted from a strong preference for positive reinforcement to an unstable selection pattern.

Refining Linear Fuzzy Rules by Reinforcement Learning

NASA Technical Reports Server (NTRS)

Berenji, Hamid R.; Khedkar, Pratap S.; Malkani, Anil

1996-01-01

Linear fuzzy rules are increasingly being used in the development of fuzzy logic systems. Radial basis functions have also been used in the antecedents of the rules for clustering in product space which can automatically generate a set of linear fuzzy rules from an input/output data set. Manual methods are usually used in refining these rules. This paper presents a method for refining the parameters of these rules using reinforcement learning which can be applied in domains where supervised input-output data is not available and reinforcements are received only after a long sequence of actions. This is shown for a generalization of radial basis functions. The formation of fuzzy rules from data and their automatic refinement is an important step in closing the gap between the application of reinforcement learning methods in the domains where only some limited input-output data is available.

Measuring the Complexity of Treatment for Challenging Behavior using the Treatment Intensity Rating Form

PubMed Central

Zarcone, Jennifer; Hagopian, Louis; Ninci, Jennifer; McKay, Chloe; Bonner, Andrew; Dillon, Christopher; Hausman, Nicole

2016-01-01

Objectives The goal of this study was to develop and evaluate a tool to measure the complexity and intensity of psychotropic medication interventions, behavioral interventions, and issues related to crisis management for challenging behavior using a standardized rating form. Method The Treatment Intensity Rating Form (TIRF) is a 10-item scale with three categories: pharmacological interventions, behavior supports, and protective equipment. In a retrospective review we examined the final treatment recommendations for 74 individuals with self-injurious behavior (SIB) based on psychiatric and behavioral notes and reports. We also compared whether TIRF scores differed across individuals for whom SIB was maintained by social reinforcement (e.g., to access attention or toys/activities, or escape from tasks) versus those for whom SIB was maintained by automatic reinforcement (e.g., occurs independent of social variables, and is presumed to be maintained by sensory reinforcement). Results The TIRF was demonstrated to have strong inter-rater reliability (98%) and appears to have good face validity. As hypothesized, individuals with SIB maintained by automatic reinforcement had significantly more medication trials (p=0.0005) and required more protective equipment than individuals with SIB maintained by social reinforcement (p=0.0002). Antidepressant medication was used more often with individuals with automatically reinforced SIB, although antipsychotics and anticonvulsants were also commonly used across both groups. Conclusion Findings provide initial support for the TIRF’s reliability, and face validity as a measure the level of complexity of medical and behavioral treatment plans - although additional research is needed to fully evaluate its psychometric properties. PMID:27917287

Single-Case Evaluation of a Negative Reinforcement Toilet Training Intervention

ERIC Educational Resources Information Center

Luiselli, James K.

2007-01-01

A negative reinforcement intervention was used to toilet train a child with multiple disabilities. The child appeared to actively withhold urinating in the toilet and was unresponsive to two positive reinforcement training programs. Negative reinforcement required that the child remain in the bathroom during toileting opportunities until he…

Competing Contingencies for Escape Behavior: Effects of Negative Reinforcement Magnitude and Quality

ERIC Educational Resources Information Center

Hammond, Jennifer L.

2009-01-01

Previous research has shown that problem behavior maintained by social-negative reinforcement can be treated without escape extinction by enhancing the quality of positive reinforcement for an appropriate alternative response such as compliance. By contrast, negative reinforcement (escape) for compliance generally has been ineffective in the…

The Distinction between Positive and Negative Reinforcement: Some Additional Considerations

ERIC Educational Resources Information Center

Sidman, Murray

2006-01-01

In this article, the author discusses the distinction between positive and negative reinforcement and some additional considerations. He states that the concept of negative reinforcement has caused confusion, and he believes that the difficulty stems from conventions of ordinary speech, in which the term "negative" usually denotes the opposite of…

Generalized Negatively Reinforced Manding in Children with Autism

PubMed Central

Yi, Janet I; Christian, LeeAnn; Vittimberga, Glenda; Lowenkron, Barry

2006-01-01

Individuals with developmental disabilities are often unable to influence their social environment in traditional ways (i.e., vocal language) and frequently exhibit challenging behaviors (e.g., aggression and self-injury) because such behaviors were previously reinforced under similar conditions. While the area of positive reinforcement manding has been well-documented and empirically validated, there is less research in the area of negatively reinforced manding—particularly in the area of negatively reinforced manding of nonpreferred items. Using a multiple baseline design across participants, this study sought to teach three children with autism to replace their challenging behaviors with more socially appropriate ways to request the removal of nonpreferred items. Results showed that all participants were able to learn the negatively reinforced mand response and these mand responses were generalized to other untrained items. In addition to extending the research in the area, the study empirically defined a procedure for teaching negatively reinforced manding of nonpreferred items. Moreover, teaching the mand response resulted in quality of life improvements for all participants and their families. PMID:22477341

A Problem-Solving Approach to Teaching Operant Conditioning

ERIC Educational Resources Information Center

Shields, Carolyn; Gredler, Margaret

2003-01-01

Psychology students frequently have misconceptions of basic concepts in operant conditioning. Prior classroom observations revealed that most students defined positive reinforcement as reward and equated negative reinforcement and punishment. Students also labeled positive reinforcement as rewarding good behavior and negative reinforcement as…

Anxiety sensitivity and negative urgency: a pathway to negative reinforcement-related smoking expectancies.

PubMed

Guillot, Casey R; Pang, Raina D; Leventhal, Adam M

2014-01-01

Anxiety sensitivity--fear of anxiety symptoms--may increase motivation to smoke by influencing the development of cognitive expectations regarding smoking's negative reinforcing effects; yet, the nature and mechanisms of this pathway are unclear. We hypothesized that relations between anxiety sensitivity and negative reinforcement-related smoking expectancies would be mediated by negative urgency, that is, a trait tendency to act impulsively during negative affect. In a cross-sectional design, we administered self-report measures of anxiety sensitivity, negative urgency, and negative reinforcement-related smoking outcome and abstinence expectancies to 205 smokers (≥10 cigarettes/d, 34% female, M age = 44.4 years). Anxiety sensitivity was associated with stronger expectancies that smoking alleviates negative affect (β = 0.30; P < 0.0001) and smoking abstinence exacerbates aversive withdrawal symptoms (β = 0.24; P = 0.0004). Negative urgency partially mediated the relation between anxiety sensitivity and both types of negative reinforcement-related smoking expectancies (βs ≥ 0.057; Ps ≤ 0.007). Results remained significant after statistically controlling for anxiety and nicotine dependence symptoms. Smokers high in anxiety sensitivity tend to display negative urgency, which in turn is related to greater expectations of negative reinforcement consequences of smoking and smoking abstinence. Treatments that mitigate fear of anxiety symptoms and the tendency to act impulsively in response to negative affect (eg, interoceptive exposure, distress tolerance skills training, and mindfulness training) may be particularly useful in assisting with smoking cessation for high-anxiety sensitivity smokers.

The effects of variable-time delivery of food items and praise on problem behavior reinforced by escape.

PubMed

Lomas, Joanna E; Fisher, Wayne W; Kelley, Michael E

2010-01-01

Prior research indicates that reinforcement of an appropriate response (e.g., compliance) can produce concomitant reductions in problem behavior reinforced by escape when problem behavior continues to produce negative reinforcement (e.g., Lalli et al., 1999). These effects may be due to a preference for positive over negative reinforcement or to positive reinforcement acting as an abolishing operation, rendering demands less aversive and escape from demands less effective as negative reinforcement. In the current investigation, we delivered a preferred food item and praise on a variable-time 15-s schedule while providing escape for problem behavior on a fixed-ratio 1 schedule in a demand condition for 3 participants with problem behavior maintained by negative reinforcement. Results for all 3 participants showed that variable-time delivery of preferred edible items reduced problem behavior even though escape continued to be available for these responses. These findings are discussed in the context of motivating operations.

Reinforcement learning in scheduling

NASA Technical Reports Server (NTRS)

Dietterich, Tom G.; Ok, Dokyeong; Zhang, Wei; Tadepalli, Prasad

1994-01-01

The goal of this research is to apply reinforcement learning methods to real-world problems like scheduling. In this preliminary paper, we show that learning to solve scheduling problems such as the Space Shuttle Payload Processing and the Automatic Guided Vehicle (AGV) scheduling can be usefully studied in the reinforcement learning framework. We discuss some of the special challenges posed by the scheduling domain to these methods and propose some possible solutions we plan to implement.

The Effects of Variable-Time Delivery of Food Items and Praise on Problem Behavior Reinforced by Escape

ERIC Educational Resources Information Center

Lomas, Joanna E.; Fisher, Wayne W.; Kelley, Michael E.

2010-01-01

Prior research indicates that reinforcement of an appropriate response (e.g., compliance) can produce concomitant reductions in problem behavior reinforced by escape when problem behavior continues to produce negative reinforcement (e.g., Lalli et al., 1999). These effects may be due to a preference for positive over negative reinforcement or to…

Test-specific control conditions for functional analyses.

PubMed

Fahmie, Tara A; Iwata, Brian A; Querim, Angie C; Harper, Jill M

2013-01-01

Most functional analyses of problem behavior include a common condition (play or noncontingent reinforcement) as a control for both positive and negative reinforcement. However, test-specific conditions that control for each potential source of reinforcement may be beneficial occasionally. We compared responding during alone, ignore, play, and differential reinforcement of other behavior (DRO) control conditions for individuals whose problem behavior was maintained by positive or negative reinforcement. Results showed that all of the conditions were effective controls for problem behavior maintained by positive reinforcement; however, the DRO condition was consistently ineffective as a control for problem behavior maintained by negative reinforcement. Implications for the design of functional analyses and future research are discussed. © Society for the Experimental Analysis of Behavior.

The role of negative reinforcement eating expectancies in the relation between experiential avoidance and disinhibition.

PubMed

Schaumberg, Katherine; Schumacher, Leah M; Rosenbaum, Diane L; Kase, Colleen A; Piers, Amani D; Lowe, Michael R; Forman, Evan M; Butryn, Meghan L

2016-04-01

Eating-related disinhibition (i.e., a tendency to overeat in response to various stimuli) is associated with weight gain and poorer long-term weight loss success. Theoretically, experiential avoidance (i.e., the desire or attempts to avoid uncomfortable internal experiences), may predispose individuals to developing negative reinforcement eating expectancies (i.e., the belief that eating will help to mitigate distress), which in turn promote disinhibition. Such relationships are consistent with an acquired preparedness model, which posits that dispositions influence learning and subsequent behavior. Drawing from this framework, the current study represents the first investigation of relations between negative reinforcement eating expectancies, experiential avoidance (both general and food-specific) and disinhibited eating. In particular, the mediating role of negative reinforcement eating expectancies in the relation between experiential avoidance and disinhibited eating was examined. Participants (N=107) were overweight and obese individuals presenting for behavioral weight loss treatment who completed measures of general and food-related experiential avoidance, negative reinforcement eating expectancies, and disinhibition. Experiential avoidance and negative reinforcement eating expectancies significantly related to disinhibition. Furthermore, the relation between experiential avoidance and disinhibition was mediated by negative reinforcement eating expectancies. The current study supports an acquired preparedness model for disinhibition, such that the relation between experiential avoidance and disinhibition is accounted for by expectations that eating will alleviate distress. Findings highlight the potential role of eating expectancies in models accounting for obesity risk, and identify negative reinforcement eating expectancies as a potential treatment target for reducing disinhibition. Copyright © 2016. Published by Elsevier Ltd.

Acquisition of cup drinking using previously refused foods as positive and negative reinforcement.

PubMed

Kelley, Michael E; Piazza, Cathleen C; Fisher, Wayne W; Oberdorff, Amanda J

2003-01-01

We used previously refused foods as positive and negative reinforcement in the acquisition of cup drinking. Cup drinking increased with positive and negative reinforcement, both alone and in combination (without escape extinction), indicating that treatment of food refusal can establish some foods as appetitive stimuli whereas others remain aversive.

Evaluating the Separate and Combined Effects of Positive and Negative Reinforcement on Task Compliance

ERIC Educational Resources Information Center

Bouxsein, Kelly J.; Roane, Henry S.; Harper, Tara

2011-01-01

Positive and negative reinforcement are effective for treating escape-maintained destructive behavior. The current study evaluated the separate and combined effects of these contingencies to increase task compliance. Results showed that a combination of positive and negative reinforcement was most effective for increasing compliance. (Contains 1…

Analysis of free-time contingencies as positive versus negative reinforcement.

PubMed

Zarcone, J R; Fisher, W W; Piazza, C C

1996-01-01

Providing a short break contingent on completed work may increase responding through positive reinforcement (e.g., access to preferred activities) or negative reinforcement (e.g., escape form work). In this investigation, three analyses conducted with a boy with profound mental retardation showed that (a) a 20-s break increased responding more than a positive reinforcer (cola) did, and (b) the reinforcing effect of a 20-s break were affected by the availability of positive reinforcers during the break were affected by the availability of positive reinforcers during the break.

Development and preliminary validation of a behavioral task of negative reinforcement underlying risk taking and its relation to problem alcohol use in college freshmen

PubMed Central

MacPherson, Laura; Calvin, Nicholas T.; Richards, Jessica M.; Guller, Leila; Mayes, Linda C.; Crowley, Michael J.; Daughters, Stacey B.; Lejuez, C.W.

2011-01-01

Background A long line of theoretical and empirical evidence implicates negative reinforcement as a process underlying the etiology and maintenance of risky alcohol use behaviors from adolescence through emerging adulthood. However, the bulk of this literature has relied on self-report measures and there is a notable absence of behavioral modes of assessments of negative reinforcement-based alcohol-related risk-taking. To address this clear gap in the literature, the current study presents the first published data on the reliability and validity of the Maryland Resource for the Behavioral Utilization of the Reinforcement of Negative Stimuli (MRBURNS), which is a modified version of the positive reinforcement-based Balloon Analogue Risk Task (BART). Methods Participants included a convenience sample of 116 college freshmen ever regular drinkers (aged 18–19) who completed both behavioral tasks; self-report measures of negative reinforcement/avoidance constructs and of positive reinforcement/appetitive constructs to examine convergent validity and discriminant validity, respectively; and self-report measures of alcohol use, problems, and motives to examine criterion validity. Results The MRBURNS evidenced sound experimental properties and reliability across task trials. In support of convergent validity, risk taking on the MRBURNS correlated significantly with negative urgency, difficulties in emotion regulation and depressive and anxiety-related symptoms. In support of discriminant validity, performance on the MRBURNS was unrelated to risk taking on the BART, sensation seeking, and trait impulsivity. Finally, pertaining to criterion validity, risk taking on the MRBURNS was related to alcohol-related problems but not heavy episodic alcohol use. Notably, risk taking on the MRBURNS was associated with negative reinforcement-based but not with positive reinforcement-based drinking motives. Conclusions Data from this initial investigation suggest the utility of the MRBURNS as a behavioral measure of negative-reinforcement based risk-taking that can provide a useful compliment to existing self-report measures to improve our understanding of the relationship between avoidant reinforcement processes and risky alcohol use. PMID:22309846

The development and maintenance of drug addiction.

PubMed

Wise, Roy A; Koob, George F

2014-01-01

What is the defining property of addiction? We dust off a several-decades-long debate about the relative importance of two forms of reinforcement—positive reinforcement, subjectively linked to drug-induced euphoria, and negative reinforcement, subjectively linked to the alleviation of pain—both of which figure importantly in addiction theory; each of these forms has dominated addiction theory in its time. We agree that addiction begins with the formation of habits through positive reinforcement and that drug-opposite physiological responses often establish the conditions for negative reinforcement to come into play at a time when tolerance, in the form of increasing reward thresholds, appears to develop into positive reinforcement. Wise’s work has tended to focus on positive-reinforcement mechanisms that are important for establishing drug-seeking habits and reinstating them quickly after periods of abstinence, whereas Koob’s work has tended to focus on the negative-reinforcement mechanisms that become most obvious in the late stages of sustained addiction. While we tend to agree with each other about the early and late stages of addiction, we hold different views as to (i) the point between early and late at which the diagnosis of ‘addiction’ should be invoked, (ii) the relative importance of positive and negative reinforcement leading up to this transition, and (iii) the degree to which the specifics of negative reinforcement can be generalized across the range of addictive agents.

Brain network response underlying decisions about abstract reinforcers.

PubMed

Mills-Finnerty, Colleen; Hanson, Catherine; Hanson, Stephen Jose

2014-12-01

Decision making studies typically use tasks that involve concrete action-outcome contingencies, in which subjects do something and get something. No studies have addressed decision making involving abstract reinforcers, where there are no action-outcome contingencies and choices are entirely hypothetical. The present study examines these kinds of choices, as well as whether the same biases that exist for concrete reinforcer decisions, specifically framing effects, also apply during abstract reinforcer decisions. We use both General Linear Model as well as Bayes network connectivity analysis using the Independent Multi-sample Greedy Equivalence Search (IMaGES) algorithm to examine network response underlying choices for abstract reinforcers under positive and negative framing. We find for the first time that abstract reinforcer decisions activate the same network of brain regions as concrete reinforcer decisions, including the striatum, insula, anterior cingulate, and VMPFC, results that are further supported via comparison to a meta-analysis of decision making studies. Positive and negative framing activated different parts of this network, with stronger activation in VMPFC during negative framing and in DLPFC during positive, suggesting different decision making pathways depending on frame. These results were further clarified using connectivity analysis, which revealed stronger connections between anterior cingulate, insula, and accumbens during negative framing compared to positive. Taken together, these results suggest that not only do abstract reinforcer decisions rely on the same brain substrates as concrete reinforcers, but that the response underlying framing effects on abstract reinforcers also resemble those for concrete reinforcers, specifically increased limbic system connectivity during negative frames. Copyright © 2014 Elsevier Inc. All rights reserved.

Negative Life Events and Antenatal Depression among Pregnant Women in Rural China: The Role of Negative Automatic Thoughts.

PubMed

Wang, Yang; Wang, Xiaohua; Liu, Fangnan; Jiang, Xiaoning; Xiao, Yun; Dong, Xuehan; Kong, Xianglei; Yang, Xuemei; Tian, Donghua; Qu, Zhiyong

2016-01-01

Few studies have looked at the relationship between psychological and the mental health status of pregnant women in rural China. The current study aims to explore the potential mediating effect of negative automatic thoughts between negative life events and antenatal depression. Data were collected in June 2012 and October 2012. 495 rural pregnant women were interviewed. Depressive symptoms were measured by the Edinburgh postnatal depression scale, stresses of pregnancy were measured by the pregnancy pressure scale, negative automatic thoughts were measured by the automatic thoughts questionnaire, and negative life events were measured by the life events scale for pregnant women. We used logistic regression and path analysis to test the mediating effect. The prevalence of antenatal depression was 13.7%. In the logistic regression, the only socio-demographic and health behavior factor significantly related to antenatal depression was sleep quality. Negative life events were not associated with depression in the fully adjusted model. Path analysis showed that the eventual direct and general effects of negative automatic thoughts were 0.39 and 0.51, which were larger than the effects of negative life events. This study suggested that there was a potentially significant mediating effect of negative automatic thoughts. Pregnant women who had lower scores of negative automatic thoughts were more likely to suffer less from negative life events which might lead to antenatal depression.

Stress affects instrumental learning based on positive or negative reinforcement in interaction with personality in domestic horses

PubMed Central

Valenchon, Mathilde; Lévy, Frédéric; Moussu, Chantal; Lansade, Léa

2017-01-01

The present study investigated how stress affects instrumental learning performance in horses (Equus caballus) depending on the type of reinforcement. Horses were assigned to four groups (N = 15 per group); each group received training with negative or positive reinforcement in the presence or absence of stressors unrelated to the learning task. The instrumental learning task consisted of the horse entering one of two compartments at the appearance of a visual signal given by the experimenter. In the absence of stressors unrelated to the task, learning performance did not differ between negative and positive reinforcements. The presence of stressors unrelated to the task (exposure to novel and sudden stimuli) impaired learning performance. Interestingly, this learning deficit was smaller when the negative reinforcement was used. The negative reinforcement, considered as a stressor related to the task, could have counterbalanced the impact of the extrinsic stressor by focusing attention toward the learning task. In addition, learning performance appears to differ between certain dimensions of personality depending on the presence of stressors and the type of reinforcement. These results suggest that when negative reinforcement is used (i.e. stressor related to the task), the most fearful horses may be the best performers in the absence of stressors but the worst performers when stressors are present. On the contrary, when positive reinforcement is used, the most fearful horses appear to be consistently the worst performers, with and without exposure to stressors unrelated to the learning task. This study is the first to demonstrate in ungulates that stress affects learning performance differentially according to the type of reinforcement and in interaction with personality. It provides fundamental and applied perspectives in the understanding of the relationships between personality and training abilities. PMID:28475581

Post-traumatic stress disorder symptoms, underlying affective vulnerabilities, and smoking for affect regulation.

PubMed

Mathew, Amanda R; Cook, Jessica W; Japuntich, Sandra J; Leventhal, Adam M

2015-01-01

Post-traumatic stress disorder (PTSD) is overrepresented among cigarette smokers. It has been hypothesized that those with PTSD smoke to alleviate negative affect and counteract deficient positive affect commonly associated with the disorder; however, limited research has examined associations between PTSD symptoms, smoking motives, and affective vulnerability factors. In the current study, we examined (1) whether PTSD symptoms were associated with positive reinforcement and negative reinforcement smoking motives; and (2) whether two affective vulnerability factors implicated in PTSD-anxiety sensitivity and anhedonia-mediated relationships between PTSD symptoms and smoking motives. Data were drawn from a community sample of non-treatment-seeking smokers recruited without regard for trauma history (N = 342; 10+ cig/day). We used the Posttraumatic Stress Disorder Checklist-Civilian Version (PCL-C) to assess overall PTSD symptom severity as well as individual PTSD subfactors. Overall, PTSD symptom severity was significantly associated with negative reinforcement, but not positive reinforcement, smoking motives. Variation in anxiety sensitivity significantly mediated the relation between PTSD symptom severity and negative reinforcement smoking motives, whereas anhedonia did not. Regarding PTSD subfactors, emotional numbing was the only PTSD subfactor associated with smoking rate, while re-experiencing symptoms were uniquely associated with both positive reinforcement and negative reinforcement smoking motives. Findings suggest that anxiety sensitivity may be an important feature associated with PTSD that enhances motivation to smoke for negative reinforcement purposes. Smoking cessation interventions that alleviate anxiety sensitivity and enhance coping with negative affect may be useful for smokers with elevated PTSD symptoms. © American Academy of Addiction Psychiatry.

Post-Traumatic Stress Disorder Symptoms, Underlying Affective Vulnerabilities, and Smoking for Affect Regulation

PubMed Central

Mathew, Amanda R.; Cook, Jessica W.; Japuntich, Sandra J.; Leventhal, Adam M.

2015-01-01

Background and Objectives Post-traumatic stress disorder (PTSD) is overrepresented among cigarette smokers. It has been hypothesized that those with PTSD smoke to alleviate negative affect and counteract deficient positive affect commonly associated with the disorder; however, limited research has examined associations between PTSD symptoms, smoking motives, and affective vulnerability factors. In the current study, we examined (1) whether PTSD symptoms were associated with positive reinforcement and negative reinforcement smoking motives; and (2) whether two affective vulnerability factors implicated in PTSD—anxiety sensitivity and anhedonia—mediated relationships between PTSD symptoms and smoking motives. Methods Data were drawn from a community sample of non-treatment-seeking smokers recruited without regard for trauma history (N = 342; 10+cig/day). We used the Posttraumatic Stress Disorder Checklist-Civilian Version (PCL-C) to assess overall PTSD symptom severity as well as individual PTSD subfactors. Results Overall, PTSD symptom severity was significantly associated with negative reinforcement, but not positive reinforcement, smoking motives. Variation in anxiety sensitivity significantly mediated the relation between PTSD symptom severity and negative reinforcement smoking motives, whereas anhedonia did not. Regarding PTSD subfactors, emotional numbing was the only PTSD subfactor associated with smoking rate, while re-experiencing symptoms were uniquely associated with both positive reinforcement and negative reinforcement smoking motives. Conclusions and Scientific Significance Findings suggest that anxiety sensitivity may be an important feature associated with PTSD that enhances motivation to smoke for negative reinforcement purposes. Smoking cessation interventions that alleviate anxiety sensitivity and enhance coping with negative affect may be useful for smokers with elevated PTSD symptoms. PMID:25823634

Measuring the emergence of tobacco dependence: the contribution of negative reinforcement models.

PubMed

Eissenberg, Thomas

2004-06-01

This review of negative reinforcement models of drug dependence is part of a series that takes the position that a complete understanding of current concepts of dependence will facilitate the development of reliable and valid measures of the emergence of tobacco dependence. Other reviews within the series consider models that emphasize positive reinforcement and social learning/cognitive models. This review summarizes negative reinforcement in general and then presents four current negative reinforcement models that emphasize withdrawal, classical conditioning, self-medication and opponent-processes. For each model, the paper outlines central aspects of dependence, conceptualization of dependence development and influences that the model might have on current and future measures of dependence. Understanding how drug dependence develops will be an important part of future successful tobacco dependence measurement, prevention and treatment strategies.

Grammatical Constructions in Typical Developing Children: Effects of Explicit Reinforcement, Automatic Reinforcement and Parity

ERIC Educational Resources Information Center

Ostvik, Leni; Eikeseth, Svein; Klintwall, Lars

2012-01-01

This study replicated and extended Wright (2006) and Whitehurst, Ironsmith, and Goldfein (1974) by examining whether preschool aged children would increase their use of passive grammatical voice rather than using the more age-appropriate active grammatical construction when the former was modeled by an adult. Results showed that 5 of the 6…

Relationships between trait urgency, smoking reinforcement expectancies, and nicotine dependence

PubMed Central

Pang, Raina D.; Hom, Marianne S.; Geary, Bree A.; Doran, Neal; Spillane, Nichea S.; Guillot, Casey R.; Leventhal, Adam M.

2014-01-01

Urgency (i.e. the tendency to act rashly during negative/positive affect) may increase vulnerability to a variety of risky behaviors. This cross-sectional study of non-treatment-seeking smokers examined the relationship between urgency, level of nicotine dependence, and smoking reinforcement expectancies. Both positive and negative urgency were associated with nicotine dependence. Mediational analyses illustrated that smoking reinforcement expectancies significantly accounted for urgency-dependence relations, with negative reinforcement expectancies displaying incremental mediational effects. If replicated and extended, these findings may support the use of treatments that modify beliefs regarding smoking reinforcement outcomes as a means of buffering the risk of nicotine dependence carried by urgency. PMID:24784229

Bio-robots automatic navigation with graded electric reward stimulation based on Reinforcement Learning.

PubMed

Zhang, Chen; Sun, Chao; Gao, Liqiang; Zheng, Nenggan; Chen, Weidong; Zheng, Xiaoxiang

2013-01-01

Bio-robots based on brain computer interface (BCI) suffer from the lack of considering the characteristic of the animals in navigation. This paper proposed a new method for bio-robots' automatic navigation combining the reward generating algorithm base on Reinforcement Learning (RL) with the learning intelligence of animals together. Given the graded electrical reward, the animal e.g. the rat, intends to seek the maximum reward while exploring an unknown environment. Since the rat has excellent spatial recognition, the rat-robot and the RL algorithm can convergent to an optimal route by co-learning. This work has significant inspiration for the practical development of bio-robots' navigation with hybrid intelligence.

Understanding Excessive School Absenteeism as School Refusal Behavior

ERIC Educational Resources Information Center

Dube, Shanta R.; Orpinas, Pamela

2009-01-01

Understanding excessive absenteeism is important to ameliorating the negative outcomes associated with the behavior. The present study examined behavioral reinforcement profiles of school refusal behavior: negative reinforcement (avoidance) and positive reinforcement (gaining parental attention or receiving tangible benefits from not attending…

How Teachers Inadvertently Reinforce Negative Behavior of Elementary School Students through Negative Communications.

ERIC Educational Resources Information Center

Frederick, Barbara

This paper reviews ways in which teachers inadvertently reinforce negative behavior of elementary school students through negative verbal or nonverbal communication. Discussion first points out differences between nonverbal and verbal communication, and then focuses on consequences of negative communication for children. Special attention is given…

An evaluation of generalization of mands during functional communication training.

PubMed

Falcomata, Terry S; Wacker, David P; Ringdahl, Joel E; Vinquist, Kelly; Dutt, Anuradha

2013-01-01

The primary purpose of this study was to evaluate the generalization of mands during functional communication training (FCT) and sign language training across functional contexts (i.e., positive reinforcement, negative reinforcement). A secondary purpose was to evaluate a training procedure based on stimulus control to teach manual signs. During the treatment evaluation, we implemented sign language training in 1 functional context (e.g., positive reinforcement by attention) while continuing the functional analysis conditions in 2 other contexts (e.g., positive reinforcement by tangible item; negative reinforcement by escape). During the generalization evaluation, we tested for the generalization of trained mands across functional contexts (i.e., positive reinforcement; negative reinforcement) by implementing extinction in the 2 nontarget contexts. The results suggested that the stimulus control training procedure effectively taught manual signs and treated destructive behavior. Specific patterns of generalization of trained mands and destructive behavior also were observed. © Society for the Experimental Analysis of Behavior.

DEVELOPMENT AND MODIFICATION OF A RESPONSE CLASS VIA POSITIVE AND NEGATIVE REINFORCEMENT: A TRANSLATIONAL APPROACH

PubMed Central

Mendres, Amber E; Borrero, John C

2010-01-01

When responses function to produce the same reinforcer, a response class exists. Researchers have examined response classes in applied settings; however, the challenges associated with conducting applied research on response class development have recently necessitated the development of an analogue response class model. To date, little research has examined response classes that are strengthened by negative reinforcement. The current investigation was designed to develop a laboratory model of a response class through positive reinforcement (i.e., points exchangeable for money) and through negative reinforcement (i.e., the avoidance of scheduled point losses) with 11 college students as participants and clicks as the operant. Results of both the positive and negative reinforcement evaluations showed that participants usually selected the least effortful response that produced points or the avoidance of point losses, respectively. The applied implications of the findings are discussed, along with the relevance of the present model to the study of punishment and resurgence. PMID:21541150

Competition between positive and negative reinforcement in the treatment of escape behavior.

PubMed

Lalli, J S; Vollmer, T R; Progar, P R; Wright, C; Borrero, J; Daniel, D; Barthold, C H; Tocco, K; May, W

1999-01-01

We compared the effects of reinforcing compliance with either positive reinforcement (edible items) or negative reinforcement (a break) on 5 participants' escape-maintained problem behavior. Both procedures were assessed with or without extinction. Results showed that compliance was higher and problem behavior was lower for all participants when compliance produced an edible item rather than a break. Treatment gains were achieved without the use of extinction. Results are discussed regarding the use of positive reinforcement to treat escape behavior.

The therapeutic workplace to promote treatment engagement and drug abstinence in out-of-treatment injection drug users: a randomized controlled trial.

PubMed

Holtyn, August F; Koffarnus, Mikhail N; DeFulio, Anthony; Sigurdsson, Sigurdur O; Strain, Eric C; Schwartz, Robert P; Leoutsakos, Jeannie-Marie S; Silverman, Kenneth

2014-11-01

Determine if employment-based reinforcement can increase methadone treatment engagement and drug abstinence in out-of-treatment injection drug users. This study was conducted from 2008 to 2012 in a therapeutic workplace in Baltimore, MD. After a 4-week induction, participants (N=98) could work and earn pay for 26 weeks and were randomly assigned to Work Reinforcement, Methadone & Work Reinforcement, and Abstinence, Methadone & Work Reinforcement conditions. Work Reinforcement participants had to work to earn pay. Methadone & Work Reinforcement and Abstinence, Methadone, & Work Reinforcement participants had to enroll in methadone treatment to work and maximize pay. Abstinence, Methadone, & Work Reinforcement participants had to provide opiate- and cocaine-negative urine samples to maximize pay. Most participants (92%) enrolled in methadone treatment during induction. Drug abstinence increased as a graded function of the addition of the methadone and abstinence contingencies. Abstinence, Methadone & Work Reinforcement participants provided significantly more urine samples negative for opiates (75% versus 54%) and cocaine (57% versus 32%) than Work Reinforcement participants. Methadone & Work Reinforcement participants provided significantly more cocaine-negative samples than Work Reinforcement participants (55% versus 32%). The therapeutic workplace can promote drug abstinence in out-of-treatment injection drug users. Clinical trial registration number: NCT01416584. Copyright © 2014 Elsevier Inc. All rights reserved.

The Therapeutic Workplace to Promote Treatment Engagement and Drug Abstinence in Out-of-Treatment Injection Drug Users: A Randomized Controlled Trial

PubMed Central

Holtyn, August F.; Koffarnus, Mikhail N.; DeFulio, Anthony; Sigurdsson, Sigurdur O.; Strain, Eric C.; Schwartz, Robert P.; Leoutsakos, Jeannie-Marie S.; Silverman, Kenneth

2014-01-01

Objective Determine if employment-based reinforcement can increase methadone treatment engagement and drug abstinence in out-of-treatment injection drug users. Method This study was conducted from 2008–2012 in a therapeutic workplace in Baltimore, MD. After a 4-week induction, participants (N=98) could work and earn pay for 26 weeks and were randomly assigned to Work Reinforcement, Methadone & Work Reinforcement, and Abstinence, Methadone & Work Reinforcement conditions. Work Reinforcement participants had to work to earn pay. Methadone & Work Reinforcement, and Abstinence, Methadone, & Work Reinforcement participants had to enroll in methadone treatment to work and maximize pay. Abstinence, Methadone, & Work Reinforcement participants had to provide opiate- and cocaine-negative urine samples to maximize pay. Results Most participants (92%) enrolled in methadone treatment during induction. Drug abstinence increased as a graded function of the addition of the methadone and abstinence contingencies. Abstinence, Methadone & Work Reinforcement participants provided significantly more urine samples negative for opiates (75% versus 54%) and cocaine (57% versus 32%) than Work Reinforcement participants. Methadone & Work Reinforcement participants provided significantly more cocaine-negative samples than Work Reinforcement participants (55% versus 32%). Conclusion The therapeutic workplace can promote drug abstinence in out-of-treatment injection drug users. PMID:24607365

Automatic stereotyping against people with schizophrenia, schizoaffective and affective disorders

PubMed Central

Rüsch, Nicolas; Corrigan, Patrick W.; Todd, Andrew R.; Bodenhausen, Galen V.

2010-01-01

Similar to members of the public, people with mental illness may exhibit general negative automatic prejudice against their own group. However, it is unclear whether more specific negative stereotypes are automatically activated among diagnosed individuals and how such automatic stereotyping may be related to self-reported attitudes and emotional reactions. We therefore studied automatically activated reactions toward mental illness among 85 people with schizophrenia, schizoaffective or affective disorders as well as among 50 members of the general public, using a Lexical Decision Task to measure automatic stereotyping. Deliberately endorsed attitudes and emotional reactions were assessed by self-report. Independent of diagnosis, people with mental illness showed less negative automatic stereotyping than did members of the public. Among members of the public, stronger automatic stereotyping was associated with more self-reported shame about a potential mental illness and more anger toward stigmatized individuals. Reduced automatic stereotyping in the diagnosed group suggests that people with mental illness might not entirely internalize societal stigma. Among members of the public, automatic stereotyping predicted negative emotional reactions to people with mental illness. Initiatives to reduce the impact of public stigma and internalized stigma should take automatic stereotyping and related emotional aspects of stigma into account. PMID:20843560

Mediators' Emotional Responses to Self-Injurious Behavior: An Experimental Study.

ERIC Educational Resources Information Center

Mossman, Dominique A.; Hastings, Richard P.; Brown, Tony

2002-01-01

Sixty mediators from British schools for children with mental retardation watched one of five matched videos depicting no self-injury, self-injury maintained by positive reinforcement, self-injury maintained by negative reinforcement, and self-injury unrelated to social events. Self-injury maintained by negative reinforcement was associated with…

The Comparative Effectiveness of Positive Reinforcement Versus Negative Verbal Reinforcement in the Training of Autistic Children to Avoid Self-Inflicted Injury.

ERIC Educational Resources Information Center

Alvir, Claire

After a brief review of the literature the research proposal focuses on the comparative effectiveness of non-verbal positive reinforcement vs. verbal negative reinforcement in the reduction of self-inflicted injury on 23 elementary age autistic children. In the two phase study each child would be paired by age, sex, length of time in school,…

Use of the Exponential and Exponentiated Demand Equations to Assess the Behavioral Economics of Negative Reinforcement

PubMed Central

Fragale, Jennifer E. C.; Beck, Kevin D.; Pang, Kevin C. H.

2017-01-01

Abnormal motivation and hedonic assessment of aversive stimuli are symptoms of anxiety and depression. Symptoms influenced by motivation and anhedonia predict treatment success or resistance. Therefore, a translational approach to the study of negatively motivated behaviors is needed. We describe a novel use of behavioral economics demand curve analysis to investigate negative reinforcement in animals that separates hedonic assessment of footshock termination (i.e., relief) from motivation to escape footshock. In outbred Sprague Dawley (SD) rats, relief increased as shock intensity increased. Likewise, motivation to escape footshock increased as shock intensity increased. To demonstrate the applicability to anxiety disorders, hedonic and motivational components of negative reinforcement were investigated in anxiety vulnerable Wistar Kyoto (WKY) rats. WKY rats demonstrated increased motivation for shock cessation with no difference in relief as compared to control SD rats, consistent with a negative bias for motivation in anxiety vulnerability. Moreover, motivation was positively correlated with relief in SD, but not in WKY. This study is the first to assess the hedonic and motivational components of negative reinforcement using behavioral economic analysis. This procedure can be used to investigate positive and negative reinforcement in humans and animals to gain a better understanding of the importance of motivated behavior in stress-related disorders. PMID:28270744

Reinforcement Sensitivity Underlying Treatment-Seeking Smokers’ Affect, Smoking Reinforcement Motives, and Affective Responses

PubMed Central

Cui, Yong; Robinson, Jason D.; Engelmann, Jeffrey M.; Lam, Cho Y.; Minnix, Jennifer A.; Karam-Hage, Maher; Wetter, David W.; Dani, John A.; Kosten, Thomas R.; Cinciripini, Paul M.

2014-01-01

Nicotine dependence has been suggested to be related to reinforcement sensitivity, which encompasses behavioral predispositions either to avoid aversive (behavioral inhibition) or to approach appetitive (behavioral activation) stimuli. Reinforcement sensitivity may shape motives for nicotine use and offer potential targets for personalized smoking cessation therapy. However, little is known regarding how reinforcement sensitivity is related to motivational processes implicated in the maintenance of smoking. Additionally, women and men differ in reinforcement sensitivity, and such difference may cause distinct relationships between reinforcement sensitivity and motivational processes for female and male smokers. In this study, we characterized reinforcement sensitivity in relation to affect, smoking-related reinforcement motives, and affective responses, using self-report and psychophysiological measures, in over 200 smokers before treating them. The Behavioral Inhibition/Activation Scales (BIS/BAS; Carver & White, 1994) was used to measure reinforcement sensitivity. In female and male smokers, BIS was similarly associated with negative affect and negative reinforcement of smoking. But positive affect was positively associated with BAS Drive scores in male smokers, and this association was reversed in female smokers. BIS was positively associated with corrugator electromyographic reactivity towards negative stimuli and left frontal electroencephalogram alpha asymmetry. Female and male smokers showed similar relationships for these physiological measures. These findings suggest that reinforcement sensitivity underpins important motivational processes (e.g., affect), and gender is a moderating factor for these relationships. Future personalized smoking intervention, particularly among more dependent treatment-seeking smokers, may experiment to target individual differences in reinforcement sensitivity. PMID:25621416

Addiction Motivation Reformulated: An Affective Processing Model of Negative Reinforcement

ERIC Educational Resources Information Center

Baker, Timothy B.; Piper, Megan E.; McCarthy, Danielle E.; Majeskie, Matthew R.; Fiore, Michael C.

2004-01-01

This article offers a reformulation of the negative reinforcement model of drug addiction and proposes that the escape and avoidance of negative affect is the prepotent motive for addictive drug use. The authors posit that negative affect is the motivational core of the withdrawal syndrome and argue that, through repeated cycles of drug use and…

[The effects of interpretation bias for social events and automatic thoughts on social anxiety].

PubMed

Aizawa, Naoki

2015-08-01

Many studies have demonstrated that individuals with social anxiety interpret ambiguous social situations negatively. It is, however, not clear whether the interpretation bias discriminatively contributes to social anxiety in comparison with depressive automatic thoughts. The present study investigated the effects of negative interpretation bias and automatic thoughts on social anxiety. The Social Intent Interpretation-Questionnaire, which measures the tendency to interpret ambiguous social events as implying other's rejective intents, the short Japanese version of the Automatic Thoughts Questionnaire-Revised, and the Anthropophobic Tendency Scale were administered to 317 university students. Covariance structure analysis indicated that both rejective intent interpretation bias and negative automatic thoughts contributed to mental distress in social situations mediated by a sense of powerlessness and excessive concern about self and others in social situations. Positive automatic thoughts reduced mental distress. These results indicate the importance of interpretation bias and negative automatic thoughts in the development and maintenance of social anxiety. Implications for understanding of the cognitive features of social anxiety were discussed.

AN EVALUATION OF ANTECEDENT EXERCISE ON BEHAVIOR MAINTAINED BY AUTOMATIC REINFORCEMENT USING A THREE-COMPONENT MULTIPLE SCHEDULE

PubMed Central

Morrison, Heather; Roscoe, Eileen M; Atwell, Amy

2011-01-01

We evaluated antecedent exercise for treating the automatically reinforced problem behavior of 4 individuals with autism. We conducted preference assessments to identify leisure and exercise items that were associated with high levels of engagement and low levels of problem behavior. Next, we conducted three 3-component multiple-schedule sequences: an antecedent-exercise test sequence, a noncontingent leisure-item control sequence, and a social-interaction control sequence. Within each sequence, we used a 3-component multiple schedule to evaluate preintervention, intervention, and postintervention effects. Problem behavior decreased during the postintervention component relative to the preintervention component for 3 of the 4 participants during the exercise-item assessment; however, the effects could not be attributed solely to exercise for 1 of these participants. PMID:21941383

Theoretical Frameworks and Mechanistic Aspects of Alcohol Addiction: Alcohol Addiction as a Reward Deficit Disorder

PubMed Central

2012-01-01

Alcoholism can be defined by a compulsion to seek and take drug, loss of control in limiting intake, and the emergence of a negative emotional state when access to the drug is prevented. Alcoholism impacts multiple motivational mechanisms and can be conceptualized as a disorder that includes a progression from impulsivity (positive reinforcement) to compulsivity (negative reinforcement). The compulsive drug seeking associated with alcoholism can be derived from multiple neuroadaptations, but the thesis argued here is that a key component involves the construct of negative reinforcement. Negative reinforcement is defined as drug taking that alleviates a negative emotional state. The negative emotional state that drives such negative reinforcement is hypothesized to derive from dysregulation of specific neurochemical elements involved in reward and stress within the basal forebrain structures involving the ventral striatum and extended amygdala, respectively. Specific neurochemical elements in these structures include not only decreases in reward neurotransmission, such as decreased dopamine and γ-aminobutyric acid function in the ventral striatum, but also recruitment of brain stress systems, such as corticotropin-releasing factor (CRF), in the extended amygdala. Acute withdrawal from chronic alcohol, sufficient to produce dependence, increases reward thresholds, increases anxiety-like responses, decreases dopamine system function, and increases extracellular levels of CRF in the central nucleus of the amygdala. CRF receptor antagonists also block excessive drug intake produced by dependence. A brain stress response system is hypothesized to be activated by acute excessive drug intake, to be sensitized during repeated withdrawal, to persist into protracted abstinence, and to contribute to the compulsivity of alcoholism. Other components of brain stress systems in the extended amygdala that interact with CRF and that may contribute to the negative motivational state of withdrawal include norepinephrine, dynorphin, and neuropeptide Y. The combination of loss of reward function and recruitment of brain stress systems provides a powerful neurochemical basis for a negative emotional state that is responsible for the negative reinforcement driving, at least partially, the compulsivity of alcoholism. PMID:21744309

Reinforcement sensitivity underlying treatment-seeking smokers' affect, smoking reinforcement motives, and affective responses.

PubMed

Cui, Yong; Robinson, Jason D; Engelmann, Jeffrey M; Lam, Cho Y; Minnix, Jennifer A; Karam-Hage, Maher; Wetter, David W; Dani, John A; Kosten, Thomas R; Cinciripini, Paul M

2015-06-01

Nicotine dependence has been suggested to be related to reinforcement sensitivity, which encompasses behavioral predispositions either to avoid aversive (behavioral inhibition) or to approach appetitive (behavioral activation) stimuli. Reinforcement sensitivity may shape motives for nicotine use and offer potential targets for personalized smoking cessation therapy. However, little is known regarding how reinforcement sensitivity is related to motivational processes implicated in the maintenance of smoking. Additionally, women and men differ in reinforcement sensitivity, and such difference may cause distinct relationships between reinforcement sensitivity and motivational processes for female and male smokers. In this study, the authors characterized reinforcement sensitivity in relation to affect, smoking-related reinforcement motives, and affective responses, using self-report and psychophysiological measures, in over 200 smokers before treating them. The Behavioral Inhibition/Activation Scales (BIS/BAS; Carver & White, 1994) was used to measure reinforcement sensitivity. In female and male smokers, BIS was similarly associated with negative affect and negative reinforcement of smoking. However, positive affect was positively associated with BAS Drive scores in male smokers, and this association was reversed in female smokers. BIS was positively associated with corrugator electromyographic reactivity toward negative stimuli and left frontal electroencephalogram alpha asymmetry. Female and male smokers showed similar relationships for these physiological measures. These findings suggest that reinforcement sensitivity underpins important motivational processes (e.g., affect), and gender is a moderating factor for these relationships. Future personalized smoking intervention, particularly among more dependent treatment-seeking smokers, may experiment to target individual differences in reinforcement sensitivity. (PsycINFO Database Record (c) 2015 APA, all rights reserved).

Investigation of negative moment reinforcing in bridge decks.

DOT National Transportation Integrated Search

2015-09-01

Multi-span pre-tensioned pre-stressed concrete beam (PPCB) bridges made continuous usually experience a negative live load : moment region over the intermediate supports. Conventional thinking dictates that sufficient reinforcement must be provided i...

The combined effects of noncontingent reinforcement and punishment on the reduction of rumination.

PubMed

DeRosa, Nicole M; Roane, Henry S; Bishop, Jamie R; Silkowski, Erica L

2016-09-01

The current study extends the literature on the assessment and treatment of rumination through the evaluation of a combined reinforcement- and punishment-based intervention. The study included a single participant with a history of rumination maintained by automatic reinforcement, as identified via a functional analysis. Both noncontingent reinforcement (NCR) with preferred edible items and punishment, in the form of a facial screen, were implemented separately to evaluate their independent effects on the occurrence of rumination. The final treatment package included both NCR and punishment procedures. Implementation of the combined treatment resulted in a 96.5% reduction in rumination relative to baseline. Procedural modifications and integrity errors also were evaluated. © 2016 Society for the Experimental Analysis of Behavior.

Reducing covert self-injurious behavior maintained by automatic reinforcement through a variable momentary DRO procedure.

PubMed

Toussaint, Karen A; Tiger, Jeffrey H

2012-01-01

Covert self-injurious behavior (i.e., behavior that occurs in the absence of other people) can be difficult to treat. Traditional treatments typically have involved sophisticated methods of observation and often have employed positive punishment procedures. The current study evaluated the effectiveness of a variable momentary differential reinforcement contingency in the treatment of covert self-injury. Neither positive punishment nor extinction was required to produce decreased skin picking.

Automatic Counting of Pedestrians and Cyclists.

DOT National Transportation Integrated Search

2016-01-01

On September 2014, U.S. Secretary of Transportation Anthony Foxx : unveiled a new Transportation Action Plan [1] to increase active, no-motorized : transportation. On it, the Department of Transportation reinforced its commitment : to making safe ...

Response cost, reinforcement, and children's Porteus Maze qualitative performance.

PubMed

Neenan, D M; Routh, D K

1986-09-01

Sixty fourth-grade children were given two different series of the Porteus Maze Test. The first series was given as a baseline, and the second series was administered under one of four different experimental conditions: control, response cost, positive reinforcement, or negative verbal feedback. Response cost and positive reinforcement, but not negative verbal feedback, led to significant decreases in the number of all types of qualitative errors in relation to the control group. The reduction of nontargeted as well as targeted errors provides evidence for the generalized effects of response cost and positive reinforcement.

Cognitions as mediators in the relationship between self-compassion and affect

PubMed Central

Arimitsu, Kohki; Hofmann, Stefan G.

2014-01-01

Previous studies suggest that self-compassion is related to numerous facets of mental health, but the role of cognitions in this relationship remains unknown. To examine the mediating role of cognitions in the relationship between self-compassion and anxiety, depression, and life satisfaction when controlling for self-esteem in Japanese people, we conducted two studies. Study 1 (N = 231) examined the relationship between self-compassion and affect by modeling negative automatic thoughts as a mediator; Study 2 (N = 233) tested whether positive and negative automatic thoughts meditate this relationship. Results suggested that both self-compassion and self-esteem increased positive automatic thoughts and decreased trait anxiety, whereas only self-esteem increased life satisfaction and decreased depression directly. Positive automatic thoughts increased life satisfaction and decreased depression and trait anxiety, and positive automatic thoughts mediated the relationship between self-compassion and negative affect. These findings suggest that both positive and negative automatic thoughts mediate the relationship between self-compassion and affect in Japanese people. PMID:25395717

Memory biases in remitted depression: the role of negative cognitions at explicit and automatic processing levels.

PubMed

Romero, Nuria; Sanchez, Alvaro; Vazquez, Carmelo

2014-03-01

Cognitive models propose that depression is caused by dysfunctional schemas that endure beyond the depressive episode, representing vulnerability factors for recurrence. However, research testing negative cognitions linked to dysfunctional schemas in formerly depressed individuals is still scarce. Furthermore, negative cognitions are presumed to be linked to biases in recalling negative self-referent information in formerly depressed individuals, but no studies have directly tested this association. In the present study, we evaluated differences between formerly and never-depressed individuals in several experimental indices of negative cognitions and their associations with the recall of emotional self-referent material. Formerly (n = 30) and never depressed individuals (n = 40) completed measures of explicit (i.e., scrambled sentence test) and automatic (i.e., lexical decision task) processing to evaluate negative cognitions. Furthermore participants completed a self-referent incidental recall task to evaluate memory biases. Formerly compared to never depressed individuals showed greater negative cognitions at both explicit and automatic levels of processing. Results also showed greater recall of negative self-referent information in formerly compared to never-depressed individuals. Finally, individual differences in negative cognitions at both explicit and automatic levels of processing predicted greater recall of negative self-referent material in formerly depressed individuals. Analyses of the relationship between explicit and automatic processing indices and memory biases were correlational and the majority of participants in both groups were women. Our findings provide evidence of negative cognitions in formerly depressed individuals at both automatic and explicit levels of processing that may confer a cognitive vulnerability to depression. Copyright © 2013 Elsevier Ltd. All rights reserved.

Stuttering Thoughts: Negative Self-Referent Thinking Is Less Sensitive to Aversive Outcomes in People with Higher Levels of Depressive Symptoms

PubMed Central

Iijima, Yudai; Takano, Keisuke; Boddez, Yannick; Raes, Filip; Tanno, Yoshihiko

2017-01-01

Learning theories of depression have proposed that depressive cognitions, such as negative thoughts with reference to oneself, can develop through a reinforcement learning mechanism. This negative self-reference is considered to be positively reinforced by rewarding experiences such as genuine support from others after negative self-disclosure, and negatively reinforced by avoidance of potential aversive situations. The learning account additionally predicts that negative self-reference would be maintained by an inability to adjust one’s behavior when negative self-reference no longer leads to such reward. To test this prediction, we designed an adapted version of the reversal-learning task. In this task, participants were reinforced to choose and engage in either negative or positive self-reference by probabilistic economic reward and punishment. Although participants were initially trained to choose negative self-reference, the stimulus-reward contingencies were reversed to prompt a shift toward positive self-reference (Study 1) and a further shift toward negative self-reference (Study 2). Model-based computational analyses showed that depressive symptoms were associated with a low learning rate of negative self-reference, indicating a high level of reward expectancy for negative self-reference even after the contingency reversal. Furthermore, the difficulty in updating outcome predictions of negative self-reference was significantly associated with the extent to which one possesses negative self-images. These results suggest that difficulty in adjusting action-outcome estimates for negative self-reference increases the chance to be faced with negative aspects of self, which may result in depressive symptoms. PMID:28824511

Stuttering Thoughts: Negative Self-Referent Thinking Is Less Sensitive to Aversive Outcomes in People with Higher Levels of Depressive Symptoms.

PubMed

Iijima, Yudai; Takano, Keisuke; Boddez, Yannick; Raes, Filip; Tanno, Yoshihiko

2017-01-01

Learning theories of depression have proposed that depressive cognitions, such as negative thoughts with reference to oneself, can develop through a reinforcement learning mechanism. This negative self-reference is considered to be positively reinforced by rewarding experiences such as genuine support from others after negative self-disclosure, and negatively reinforced by avoidance of potential aversive situations. The learning account additionally predicts that negative self-reference would be maintained by an inability to adjust one's behavior when negative self-reference no longer leads to such reward. To test this prediction, we designed an adapted version of the reversal-learning task. In this task, participants were reinforced to choose and engage in either negative or positive self-reference by probabilistic economic reward and punishment. Although participants were initially trained to choose negative self-reference, the stimulus-reward contingencies were reversed to prompt a shift toward positive self-reference (Study 1) and a further shift toward negative self-reference (Study 2). Model-based computational analyses showed that depressive symptoms were associated with a low learning rate of negative self-reference, indicating a high level of reward expectancy for negative self-reference even after the contingency reversal. Furthermore, the difficulty in updating outcome predictions of negative self-reference was significantly associated with the extent to which one possesses negative self-images. These results suggest that difficulty in adjusting action-outcome estimates for negative self-reference increases the chance to be faced with negative aspects of self, which may result in depressive symptoms.

Positive and Negative Reinforcers: How about the Second and Third Functions?

ERIC Educational Resources Information Center

Staats, Arthur W.

2006-01-01

The author of this article presents his own explanation on the two types of conditioning--respondent and operant. He states that when withdrawal of a negative reinforcer is the contingency that increases the strength of the operant behavior, the stimulus will have a negative emotional response to the experimental chamber. However, when a positive…

Concurrent Schedules of Positive and Negative Reinforcement: Differential-Impact and Differential-Outcomes Hypotheses

PubMed Central

Magoon, Michael A; Critchfield, Thomas S

2008-01-01

Considerable evidence from outside of operant psychology suggests that aversive events exert greater influence over behavior than equal-sized positive-reinforcement events. Operant theory is largely moot on this point, and most operant research is uninformative because of a scaling problem that prevents aversive events and those based on positive reinforcement from being directly compared. In the present investigation, humans' mouse-click responses were maintained on similarly structured, concurrent schedules of positive (money gain) and negative (avoidance of money loss) reinforcement. Because gains and losses were of equal magnitude, according to the analytical conventions of the generalized matching law, bias (log b ≠ 0) would indicate differential impact by one type of consequence; however, no systematic bias was observed. Further research is needed to reconcile this outcome with apparently robust findings in other literatures of superior behavior control by aversive events. In an incidental finding, the linear function relating log behavior ratio and log reinforcement ratio was steeper for concurrent negative and positive reinforcement than for control conditions involving concurrent positive reinforcement. This may represent the first empirical confirmation of a free-operant differential-outcomes effect predicted by contingency-discriminability theories of choice. PMID:18683609

Comparing positive and negative reinforcement: A fantasy experiment.

PubMed

Nevin, John A; Mandell, Charlotte

2017-01-01

We propose quantitative experimental approaches to the question of whether positive and negative reinforcement are functionally different, and discuss scientific and ethical concerns that would arise if these approaches were pursued. © 2017 Society for the Experimental Analysis of Behavior.

Neurobiological Substrates for the Dark Side of Compulsivity in Addiction

PubMed Central

Koob, George F.

2009-01-01

Drug addiction can be defined by a compulsion to seek and take drug, loss of control in limiting intake, and the emergence of a negative emotional state when access to the drug is prevented. Drug addiction impacts multiple motivational mechanisms and can be conceptualized as a disorder that progresses from impulsivity (positive reinforcement) to compulsivity (negative reinforcement). The construct of negative reinforcement is defined as drug taking that alleviates a negative emotional state. The negative emotional state that drives such negative reinforcement is hypothesized to derive from dysregulation of key neurochemical elements involved in reward and stress within the basal forebrain structures involving the ventral striatum and extended amygdala. Specific neurochemical elements in these structures include not only decreases in reward neurotransmission, such as decreases in dopamine and opioid peptide function in the ventral striatum, but also recruitment of brain stress systems, such as corticotropin-releasing factor (CRF), in the extended amygdala. Acute withdrawal from all major drugs of abuse produces increases in reward thresholds, increases in anxiety-like responses, and increases in extracellular levels of CRF in the central nucleus of the amygdala. CRF receptor antagonists also block excessive drug intake produced by dependence. A brain stress response system is hypothesized to be activated by acute excessive drug intake, to be sensitized during repeated withdrawal, to persist into protracted abstinence, and to contribute to the compulsivity of addiction. Other components of brain stress systems in the extended amygdala that interact with CRF and may contribute to the negative motivational state of withdrawal include norepinephrine, dynorphin, and neuropeptide Y. The combination of loss of reward function and recruitment of brain stress systems provides a powerful neurochemical basis for a negative emotional state that is responsible for the negative reinforcement driving, at least in part, the compulsivity of addiction. PMID:18725236

Delayed nootropic effects of arginine vasopressin after early postnatal chronic administration to albino rat pups.

PubMed

Kim, P A; Voskresenskaya, O G; Kamensky, A A

2009-06-01

Intranasal administration of arginine vasopressin (10 microg/kg) to albino rat pups had a strong nootropic effect during training with positive and negative reinforcement. This effect was different in animals of various age groups: training with positive reinforcement was improved in "adolescent" rats and pubertal animals, while during training with negative reinforcement, the nootropic effect of the peptide was more prolonged and persisted also in adult animals.

FUNCTIONAL ANALYSIS AND TREATMENT OF COPROPHAGIA

PubMed Central

Ing, Anna D; Roane, Henry S; Veenstra, Rebecca A

2011-01-01

In the current investigation, functional analysis results suggested that coprophagia, the ingestion of fecal matter, was maintained by automatic reinforcement. Providing noncontingent access to alternative stimuli decreased coprophagia, and the intervention was generalized to two settings. PMID:21541128

How does self-injury feel? Examining automatic positive reinforcement in adolescent self-injurers with experience sampling.

PubMed

Selby, Edward A; Nock, Matthew K; Kranzler, Amy

2014-02-28

One of the most frequently reported, yet understudied, motivations for non-suicidal self-injury (NSSI) involves automatic positive reinforcement (APR), wherein sensations arising from NSSI reinforce and promote the behavior. The current study used experience sampling methodology with a clinical sample of self-injuring adolescents (N=30) over a 2-week period during which the adolescents reported NSSI behaviors, and rated if an APR motivation was present, and if so whether that motivation pertained to feeling "pain," "stimulation," or "satisfaction." Over 50% of the sample reported at least one instance of NSSI for APR reasons. No significant differences were found on demographic factors or psychiatric comorbidity for those with and without an APR motivation. However, those with an APR motivation reported elevated NSSI thoughts, longer duration of those thoughts, and more NSSI behaviors. They also reported more alcohol use thoughts, alcohol use, impulsive spending, and binge eating. The most commonly reported sensation following NSSI for APR was "satisfaction." However those endorsing feeling pain reported the most NSSI behaviors. These findings provide new information about the APR motivations for NSSI and shed light on the different sensations felt. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.

Towards autonomous neuroprosthetic control using Hebbian reinforcement learning.

PubMed

Mahmoudi, Babak; Pohlmeyer, Eric A; Prins, Noeline W; Geng, Shijia; Sanchez, Justin C

2013-12-01

Our goal was to design an adaptive neuroprosthetic controller that could learn the mapping from neural states to prosthetic actions and automatically adjust adaptation using only a binary evaluative feedback as a measure of desirability/undesirability of performance. Hebbian reinforcement learning (HRL) in a connectionist network was used for the design of the adaptive controller. The method combines the efficiency of supervised learning with the generality of reinforcement learning. The convergence properties of this approach were studied using both closed-loop control simulations and open-loop simulations that used primate neural data from robot-assisted reaching tasks. The HRL controller was able to perform classification and regression tasks using its episodic and sequential learning modes, respectively. In our experiments, the HRL controller quickly achieved convergence to an effective control policy, followed by robust performance. The controller also automatically stopped adapting the parameters after converging to a satisfactory control policy. Additionally, when the input neural vector was reorganized, the controller resumed adaptation to maintain performance. By estimating an evaluative feedback directly from the user, the HRL control algorithm may provide an efficient method for autonomous adaptation of neuroprosthetic systems. This method may enable the user to teach the controller the desired behavior using only a simple feedback signal.

Effects of multisensory environments on stereotyped behaviours assessed as maintained by automatic reinforcement.

PubMed

Hill, Lindsay; Trusler, Karen; Furniss, Frederick; Lancioni, Giulio

2012-11-01

The aim of the present study was to evaluate the effects of the sensory equipment provided in a multi-sensory environment (MSE) and the level of social contact provided on levels of stereotyped behaviours assessed as being maintained by automatic reinforcement. Stereotyped and engaged behaviours of two young people with severe intellectual disabilities were observed while the participants were either in a living room or in a MSE and receiving either high or low levels of interaction from carers. For both participants, levels of stereotyped behaviour were lower in the MSE irrespective of the level of carer attention received, while levels of engagement were higher under conditions of high carer attention in both environments. The results are consistent with the hypothesis that reductions in stereotyped behaviour observed in MSEs are due to the increased levels of specific sensory stimulation provided by such environments. © 2012 Blackwell Publishing Ltd.

Neurobiology of dysregulated motivational systems in drug addiction

PubMed Central

Edwards, Scott; Koob, George F

2010-01-01

The progression from recreational drug use to drug addiction impacts multiple neurobiological processes and can be conceptualized as a transition from positive to negative reinforcement mechanisms driving both drug-taking and drug-seeking behaviors. Neurobiological mechanisms for negative reinforcement, defined as drug taking that alleviates a negative emotional state, involve changes in the brain reward system and recruitment of brain stress (or antireward) systems within forebrain structures, including the extended amygdala. These systems are hypothesized to be dysregulated by excessive drug intake and to contribute to allostatic changes in reinforcement mechanisms associated with addiction. Points of intersection between positive and negative motivational circuitry may further drive the compulsivity of drug addiction but also provide a rich neurobiological substrate for therapeutic intervention. PMID:20563312

Access of emotional information to visual awareness in patients with major depressive disorder.

PubMed

Sterzer, P; Hilgenfeldt, T; Freudenberg, P; Bermpohl, F; Adli, M

2011-08-01

According to cognitive theories of depression, negative biases affect most cognitive processes including perception. Such depressive perception may result not only from biased cognitive appraisal but also from automatic processing biases that influence the access of sensory information to awareness. Twenty patients with major depressive disorder (MDD) and 20 healthy control participants underwent behavioural testing with a variant of binocular rivalry, continuous flash suppression (CFS), to investigate the potency of emotional visual stimuli to gain access to awareness. While a neutral, fearful, happy or sad emotional face was presented to one eye, high-contrast dynamic patterns were presented to the other eye, resulting in initial suppression of the face from awareness. Participants indicated the location of the face with a key press as soon as it became visible. The modulation of suppression time by emotional expression was taken as an index of unconscious emotion processing. We found a significant difference in the emotional modulation of suppression time between MDD patients and controls. This difference was due to relatively shorter suppression of sad faces and, to a lesser degree, to longer suppression of happy faces in MDD. Suppression time modulation by sad expression correlated with change in self-reported severity of depression after 4 weeks. Our finding of preferential access to awareness for mood-congruent stimuli supports the notion that depressive perception may be related to altered sensory information processing even at automatic processing stages. Such perceptual biases towards mood-congruent information may reinforce depressed mood and contribute to negative cognitive biases. © Cambridge University Press 2011

AN EVALUATION OF THE INTERACTION BETWEEN QUALITY OF ATTENTION AND NEGATIVE REINFORCEMENT WITH CHILDREN WHO DISPLAY ESCAPE-MAINTAINED PROBLEM BEHAVIOR

PubMed Central

Gardner, Andrew W; Wacker, David P; Boelter, Eric W

2009-01-01

The choice-making behavior of 2 typically developing children who engaged in problem behavior maintained by negative reinforcement was evaluated within a concurrent-operants assessment that varied the quality of attention across free-play and demand conditions. The results demonstrated that it was possible to bias responding towards academic demands for both participants by providing high-quality attention, despite the continuous availability of negative reinforcement. The current study extended brief clinical methods with typically developing children and demonstrated how different qualities of attention provided across concurrent schedules could bias responding. PMID:19949522

Conceptualizing withdrawal-induced escalation of alcohol self-administration as a learned, plasticity-dependent process

PubMed Central

Walker, Brendan M.

2013-01-01

This article represents one of five contributions focusing on the topic “Plasticity and neuroadaptive responses within the extended amygdala in response to chronic or excessive alcohol exposure” that were developed by awardees participating in the Young Investigator Award Symposium at the “Alcoholism and Stress: A Framework for Future Treatment Strategies” conference in Volterra, Italy on May 3–6, 2011 that was organized/chaired by Drs. Antonio Noronha and Fulton Crews and sponsored by the National Institute on Alcohol Abuse and Alcoholism. This review discusses the dependence-induced neuroadaptations in affective systems that provide a basis for negative reinforcement learning and presents evidence demonstrating that escalated alcohol consumption during withdrawal is a learned, plasticity-dependent process. The review concludes by identifying changes within extended amygdala dynorphin/kappa-opioid receptor systems that could serve as the foundation for the occurrence of negative reinforcement processes. While some evidence contained herein may be specific to alcohol dependence-related learning and plasticity, much of the information will be of relevance to any addictive disorder involving negative reinforcement mechanisms. Collectively, the information presented within this review provides a framework to assess the negative reinforcing effects of alcohol in a manner that distinguishes neuroadaptations produced by chronic alcohol exposure from the actual plasticity that is associated with negative reinforcement learning in dependent organisms. PMID:22459874

Negative Reinforcement and Premonitory Urges in Youth With Tourette Syndrome: An Experimental Evaluation.

PubMed

Capriotti, Matthew R; Brandt, Bryan C; Turkel, Jennifer E; Lee, Han-Joo; Woods, Douglas W

2014-03-01

Tourette syndrome (TS) is marked by the chronic presence of motor and vocal tics that are usually accompanied by aversive sensory experiences called "premonitory urges." Phenomenological accounts suggest that these urges occur before tics and diminish following their occurrence. This has led some to suggest that tics are negatively reinforced by removal of premonitory urges. This hypothesis has proven difficult to test experimentally, however, due in part to challenges in measuring premonitory urge strength. We tested predictions of the negative reinforcement conceptualization of premonitory urges using novel experimental tactics within the context of the "tic detector" paradigm. We compared tic rates and ratings of premonitory urge strength exhibited by youth with TS or chronic tic disorder under free-to-tic baseline (BL), reinforced tic suppression (RTS), and reinforced tic suppression with escape (RTS + E) conditions. Results were consistent with previous research and hypotheses of the present study. Participants rated the strength of their premonitory urges as higher during RTS conditions than during BL conditions. Within RTS + E conditions, tic rates were higher during escape portions when the contingency supporting tic suppression was inactive than during components where the contingency was active, and ratings of urge strength were higher at the onset of break periods than at the offset. All participants engaged in some level of escape from reinforced suppression during the course of the experiment. Results of this study support the notion that tics may be negatively reinforced by removal of aversive premonitory urges. Future directions for basic and clinical research are discussed. © The Author(s) 2014.

The effects of differential negative reinforcement of other behavior and noncontingent escape on compliance.

PubMed Central

Kodak, Tiffany; Miltenberger, Raymond G; Romaniuk, Cathryn

2003-01-01

The present study evaluated the effects of noncontingent escape and differential negative reinforcement of other behavior in reducing problem behaviors and increasing compliance in 2 children with disabilities. Results showed that both methods reduced problem behavior and increased compliance for both children. PMID:14596581

The effects of differential negative reinforcement of other behavior and noncontingent escape on compliance.

PubMed

Kodak, Tiffany; Miltenberger, Raymond G; Romaniuk, Cathryn

2003-01-01

The present study evaluated the effects of noncontingent escape and differential negative reinforcement of other behavior in reducing problem behaviors and increasing compliance in 2 children with disabilities. Results showed that both methods reduced problem behavior and increased compliance for both children.

Sleep Deprivation, Allergy Symptoms, and Negatively Reinforced Problem Behavior.

ERIC Educational Resources Information Center

Kennedy, Craig H.; Meyer, Kim A.

1996-01-01

A study of the relationship between presence or absence of sleep deprivation, allergy symptoms, and the rate and function of problem behavior in three adolescents with moderate to profound mental retardation found that problem behavior was negatively reinforced by escape from instruction, and both allergy symptoms and sleep deprivation influenced…

Goal-Directed and Habit-Like Modulations of Stimulus Processing during Reinforcement Learning.

PubMed

Luque, David; Beesley, Tom; Morris, Richard W; Jack, Bradley N; Griffiths, Oren; Whitford, Thomas J; Le Pelley, Mike E

2017-03-15

Recent research has shown that perceptual processing of stimuli previously associated with high-value rewards is automatically prioritized even when rewards are no longer available. It has been hypothesized that such reward-related modulation of stimulus salience is conceptually similar to an "attentional habit." Recording event-related potentials in humans during a reinforcement learning task, we show strong evidence in favor of this hypothesis. Resistance to outcome devaluation (the defining feature of a habit) was shown by the stimulus-locked P1 component, reflecting activity in the extrastriate visual cortex. Analysis at longer latencies revealed a positive component (corresponding to the P3b, from 550-700 ms) sensitive to outcome devaluation. Therefore, distinct spatiotemporal patterns of brain activity were observed corresponding to habitual and goal-directed processes. These results demonstrate that reinforcement learning engages both attentional habits and goal-directed processes in parallel. Consequences for brain and computational models of reinforcement learning are discussed. SIGNIFICANCE STATEMENT The human attentional network adapts to detect stimuli that predict important rewards. A recent hypothesis suggests that the visual cortex automatically prioritizes reward-related stimuli, driven by cached representations of reward value; that is, stimulus-response habits. Alternatively, the neural system may track the current value of the predicted outcome. Our results demonstrate for the first time that visual cortex activity is increased for reward-related stimuli even when the rewarding event is temporarily devalued. In contrast, longer-latency brain activity was specifically sensitive to transient changes in reward value. Therefore, we show that both habit-like attention and goal-directed processes occur in the same learning episode at different latencies. This result has important consequences for computational models of reinforcement learning. Copyright © 2017 the authors 0270-6474/17/373009-09$15.00/0.

The partial-reinforcement extinction effect and the contingent-sampling hypothesis.

PubMed

Hochman, Guy; Erev, Ido

2013-12-01

The partial-reinforcement extinction effect (PREE) implies that learning under partial reinforcements is more robust than learning under full reinforcements. While the advantages of partial reinforcements have been well-documented in laboratory studies, field research has failed to support this prediction. In the present study, we aimed to clarify this pattern. Experiment 1 showed that partial reinforcements increase the tendency to select the promoted option during extinction; however, this effect is much smaller than the negative effect of partial reinforcements on the tendency to select the promoted option during the training phase. Experiment 2 demonstrated that the overall effect of partial reinforcements varies inversely with the attractiveness of the alternative to the promoted behavior: The overall effect is negative when the alternative is relatively attractive, and positive when the alternative is relatively unattractive. These results can be captured with a contingent-sampling model assuming that people select options that provided the best payoff in similar past experiences. The best fit was obtained under the assumption that similarity is defined by the sequence of the last four outcomes.

Self-stimulatory behavior and perceptual reinforcement.

PubMed Central

Lovaas, I; Newsom, C; Hickman, C

1987-01-01

Self-stimulatory behavior is repetitive, stereotyped, functionally autonomous behavior seen in both normal and developmentally disabled populations, yet no satisfactory theory of its development and major characteristics has previously been offered. We present here a detailed hypothesis of the acquisition and maintenance of self-stimulatory behavior, proposing that the behaviors are operant responses whose reinforcers are automatically produced interoceptive and exteroceptive perceptual consequences. The concept of perceptual stimuli and reinforcers, the durability of self-stimulatory behaviors, the sensory extinction effect, the inverse relationship between self-stimulatory and other behaviors, the blocking effect of self-stimulatory behavior on new learning, and response substitution effects are discussed in terms of the hypothesis. Support for the hypothesis from the areas of sensory reinforcement and sensory deprivation is also reviewed. Limitations of major alternative theories are discussed, along with implications of the perceptual reinforcement hypothesis for the treatment of excessive self-stimulatory behavior and for theoretical conceptualizations of functionally related normal and pathological behaviors. PMID:3583964

The Effects of a Local Negative Feedback Function between Choice and Relative Reinforcer Rate

PubMed Central

Davison, Michael; Elliffe, Douglas; Marr, M. Jackson

2010-01-01

Four pigeons were trained on two-key concurrent variable-interval schedules with no changeover delay. In Phase 1, relative reinforcers on the two alternatives were varied over five conditions from .1 to .9. In Phases 2 and 3, we instituted a molar feedback function between relative choice in an interreinforcer interval and the probability of reinforcers on the two keys ending the next interreinforcer interval. The feedback function was linear, and was negatively sloped so that more extreme choice in an interreinforcer interval made it more likely that a reinforcer would be available on the other key at the end of the next interval. The slope of the feedback function was −1 in Phase 2 and −3 in Phase 3. We varied relative reinforcers in each of these phases by changing the intercept of the feedback function. Little effect of the feedback functions was discernible at the local (interreinforcer interval) level, but choice measured at an extended level across sessions was strongly and significantly decreased by increasing the negative slope of the feedback function. PMID:21451748

Positive and negative reinforcement underlying risk behavior in early adolescents.

PubMed

MacPherson, Laura; Reynolds, Elizabeth K; Daughters, Stacey B; Wang, Frances; Cassidy, Jude; Mayes, Linda C; Lejuez, C W

2010-09-01

The goal of the current study was to examine the combined influence of positive reinforcement processes using a behavioral task measuring risk taking propensity (RTP) and negative reinforcement processes using a behavioral task measuring deficits in distress tolerance (DT) on a range of risk taking behaviors among early adolescents. Participants included a community sample of 230 early adolescents (aged 9-13) who completed two behavioral tasks assessing reinforcement processes as well as reported on past year risk behavior involvement as assessed by items from the Youth Risk Behavior Surveillance System at a baseline and a 1-year follow-up assessment. Data indicated that at the Wave 2 assessment, RTP was positively related to number of risk-taking behaviors in the past year but only for those with low DT, with this finding persisting after controlling for the significant influence of male gender and higher sensation seeking. Results of the present study highlight the importance of considering both positive and negative reinforcement processes in combination when investigating vulnerability factors for early risk behavior engagement in youth.

Assessing appetitive, aversive, and negative ethanol-mediated reinforcement through an immature rat model.

PubMed

Pautassi, Ricardo M; Nizhnikov, Michael E; Spear, Norman E

2009-06-01

The motivational effects of drugs play a key role during the transition from casual use to abuse and dependence. Ethanol reinforcement has been successfully studied through Pavlovian and operant conditioning in adult rats and mice genetically selected for their ready acceptance of ethanol. Another model for studying ethanol reinforcement is the immature (preweanling) rat, which consumes ethanol and exhibits the capacity to process tactile, odor and taste cues and transfer information between different sensorial modalities. This review describes the motivational effects of ethanol in preweanling, heterogeneous non-selected rats. Preweanlings exhibit ethanol-mediated conditioned taste avoidance and conditioned place aversion. Ethanol's appetitive effects, however, are evident when using first- and second-order conditioning and operant procedures. Ethanol also devalues the motivational representation of aversive stimuli, suggesting early negative reinforcement. It seems that preweanlings are highly sensitive not only to the aversive motivational effects of ethanol but also to its positive and negative (anti-anxiety) reinforcement potential. The review underscores the advantages of using a developing rat to evaluate alcohol's motivational effects.

Assessing appetitive, aversive, and negative ethanol-mediated reinforcement through an immature rat model

PubMed Central

Pautassi, Ricardo M.; Nizhnikov, Michael E.; Spear, Norman E.

2009-01-01

The motivational effects of drugs play a key role during the transition from casual use to abuse and dependence. Ethanol reinforcement has been successfully studied through Pavlovian and operant conditioning in adult rats and mice genetically selected for their ready acceptance of ethanol. Another model for studying ethanol reinforcement is the immature (preweanling) rat, which consumes ethanol and exhibits the capacity to process tactile, odor and taste cues and transfer information between different sensorial modalities. This review describes the motivational effects of ethanol in preweanling, heterogeneous non-selected rats. Preweanlings exhibit ethanol-mediated conditioned taste avoidance and conditioned place aversion. Ethanol's appetitive effects, however, are evident when using first- and second-order conditioning and operant procedures. Ethanol also devalues the motivational representation of aversive stimuli, suggesting early negative reinforcement. It seems that preweanlings are highly sensitive not only to the aversive motivational effects of ethanol but also to its positive and negative (anti-anxiety) reinforcement potential. The review underscores the advantages of using a developing rat to evaluate alcohol's motivational effects. PMID:19428502

Increasing Treatment Integrity through Negative Reinforcement: Effects on Teacher and Student Behavior

ERIC Educational Resources Information Center

DiGennaro, Florence D.; Martens, Brian K.; McIntyre, Laura Lee

2005-01-01

The current study examined the extent to which treatment integrity was increased and maintained for 4 teachers in their regular classroom settings as a result of performance feedback and negative reinforcement. Teachers received daily written feedback about their accuracy in implementing an intervention and were able to avoid meeting with a…

On the Distinction between Positive and Negative Reinforcement

ERIC Educational Resources Information Center

Iwata, Brian A.

2006-01-01

In this article, the author presents his views on Michael's (1975) and Baron and Galizio's (2005) arguments on eliminating the distinction between positive and negative reinforcement. He first discusses Michael's concept of these two types of operations and contrasts it with the notions of Baron and Galizio. The author provides the readers his own…

Resurgence of instrumental behavior after an abstinence contingency.

PubMed

Bouton, Mark E; Schepers, Scott T

2014-06-01

In resurgence, an extinguished instrumental behavior (R1) recovers when a behavior that has replaced it (R2) is also extinguished. The phenomenon may be relevant to understanding relapse that can occur after the termination of "contingency management" treatments, in which an unwanted behavior (e.g., substance abuse) is reduced by reinforcing an alternative behavior. When reinforcement is discontinued, the unwanted behavior might resurge. However, unlike most resurgence experiments, contingency management treatments also introduce a negative contingency, in which reinforcers are not delivered unless the client has abstained from the unwanted behavior. In two experiments with rats, we therefore examined the effects of adding a negative "abstinence" contingency to the resurgence design. During response elimination, R2 was not reinforced unless R1 had not been emitted for a minimum period of time (45, 90, or 135 s). In both experiments, adding such a contingency to simple R1 extinction reduced, but did not eliminate, resurgence. In Experiment 2, we found the same effect in a yoked group that could earn reinforcers for R2 at the same points in time as the negative-contingency group, but without the requirement to abstain from R1. Thus, the negative contingency per se did not contribute to the reduction in resurgence. These results suggest that the contingency reduced resurgence by making reinforcers more difficult to earn and more widely spaced in time. This could have allowed the animal to learn that R1 was extinguished in the "context" of infrequent reinforcement-a context more like that of resurgence testing. The results are thus consistent with a contextual (renewal) account of resurgence. The method might provide a better model of relapse after termination of a contingency management treatment.

Automatic affective appraisal of sexual penetration stimuli in women with vaginismus or dyspareunia.

PubMed

Huijding, Jorg; Borg, Charmaine; Weijmar-Schultz, Willibrord; de Jong, Peter J

2011-03-01

Current psychological views are that negative appraisals of sexual stimuli lie at the core of sexual dysfunctions. It is important to differentiate between deliberate appraisals and more automatic appraisals, as research has shown that the former are most relevant to controllable behaviors, and the latter are most relevant to reflexive behaviors. Accordingly, it can be hypothesized that in women with vaginismus, the persistent difficulty to allow vaginal entry is due to global negative automatic affective appraisals that trigger reflexive pelvic floor muscle contraction at the prospect of penetration. To test whether sexual penetration pictures elicited global negative automatic affective appraisals in women with vaginismus or dyspareunia and to examine whether deliberate appraisals and automatic appraisals differed between the two patient groups. Women with persistent vaginismus (N = 24), dyspareunia (N = 23), or no sexual complaints (N = 30) completed a pictorial Extrinsic Affective Simon Task (EAST), and then made a global affective assessment of the EAST stimuli using visual analogue scales (VAS). The EAST assessed global automatic affective appraisals of sexual penetration stimuli, while the VAS assessed global deliberate affective appraisals of these stimuli. Automatic affective appraisals of sexual penetration stimuli tended to be positive, independent of the presence of sexual complaints. Deliberate appraisals of the same stimuli were significantly more negative in the women with vaginismus than in the dyspareunia group and control group, while the latter two groups did not differ in their appraisals. Unexpectedly, deliberate appraisals seemed to be most important in vaginismus, whereas dyspareunia did not seem to implicate negative deliberate or automatic affective appraisals. These findings dispute the view that global automatic affect lies at the core of vaginismus and indicate that a useful element in therapeutic interventions may be the modification of deliberate global affective appraisals of sexual penetration (e.g., via counter-conditioning). © 2010 International Society for Sexual Medicine.

Antireward, compulsivity, and addiction: seminal contributions of Dr. Athina Markou to motivational dysregulation in addiction.

PubMed

Koob, George F

2017-05-01

Addiction is defined as a chronically relapsing disorder characterized by compulsive drug seeking that is hypothesized to derive from multiple sources of motivational dysregulation. Dr. Athina Markou made seminal contributions to our understanding of the neurobiology of addiction with her studies on the dysregulation of reward function using animal models with construct validity. Repeated overstimulation of the reward systems with drugs of abuse decreases reward function, characterized by brain stimulation reward and presumbably reflecting dysphoria-like states. The construct of negative reinforcement, defined as drug taking that alleviates a negative emotional state that is created by drug abstinence, is particularly relevant as a driving force in both the withdrawal/negative affect and preoccupation/anticipation stages of the addiction cycle. The negative emotional state that drives such negative reinforcement is hypothesized to derive from the dysregulation of key neurochemical circuits that drive incentive-salience/reward systems (dopamine, opioid peptides) in the ventral striatum and from the recruitment of brain stress systems (corticotropin-releasing factor, dynorphin) within the extended amygdala. As drug taking becomes compulsive-like, the factors that motivate behavior are hypothesized to shift to drug-seeking behavior that is driven not only by positive reinforcement but also by negative reinforcement. This shift in motivation is hypothesized to reflect the allostatic misregulation of hedonic tone such that drug taking makes the hedonic negative emotional state worse during the process of seeking temporary relief with compulsive drug taking.

The Fire-Alarm Game: Exit Training Using Negative and Positive Reinforcement under Varied Stimulus Conditions. Short Reports.

ERIC Educational Resources Information Center

Holburn, C. Steven; Dougher, Michael J.

1985-01-01

Techniques for training a severely retarded blind client to exit his living unit during a fire drill used a combination of negative and positive reinforcement. Following a shaping procedure, the client learned to leave his living unit from any internal point through generalization training and subsequent test probes. (Author/CL)

Successive Negative Contrast after Partial Reinforcement in the Consummatory Behavior of Rats

ERIC Educational Resources Information Center

Pellegrini, Santiago; Muzio, Ruben N.; Mustaca, Alba E.; Papini, Mauricio R.

2004-01-01

Rats given access to a 32% sucrose solution later reject a 4% solution significantly more than controls that have only received the 4% solution. In Experiment 1, this consummatory successive negative contrast (cSNC) effect was attenuated by previous exposure to 50% partial reinforcement. Furthermore, recovery from cSNC was also facilitated by…

Effects of reinforcement value on instruction following under schedules of negative reinforcement.

PubMed

Alessandri, Jérôme; Cançado, Carlos R X; Abreu-Rodrigues, Josele

2017-12-01

The effects of reinforcement value and social control on instruction following under a negative-reinforcement (escape) schedule were studied. Initially, responding produced timeouts from pressing a force cell under a low and a high force requirement on a fixed-ratio 1 schedule of reinforcement. Next, participants were reexposed to the low and high force requirements, but were instructed that the experimenter expected them to decrease the number of timeouts relative to the previous exposures to the procedure. Even though following the instruction led to a decrease in number of timeouts and to an increase in effort (i.e., was non-efficient), instruction following occurred consistently for each participant and was modulated by reinforcement value. That is, the decrease in the number of timeouts (i.e., instruction following) was lower under the high force requirement than under the low force requirement. These results replicate and extend previous findings that instructions interact with social and nonsocial contingencies in controlling human behavior. Copyright © 2017 Elsevier B.V. All rights reserved.

An Analysis of Vocal Stereotypy and Therapist Fading

ERIC Educational Resources Information Center

Athens, Elizabeth S.; Vollmer, Timothy R.; Sloman, Kimberly N.; Pipkin, Claire St. Peter

2008-01-01

A functional analysis for a boy with Down syndrome and autism suggested that vocal stereotypy was maintained by automatic reinforcement. The analysis also showed that instructions and noncontingent attention suppressed vocal stereotypy. A treatment package consisting of noncontingent attention, contingent demands, and response cost effectively…

Child abuse and negative explicit and automatic self-associations: the cognitive scars of emotional maltreatment.

PubMed

van Harmelen, Anne-Laura; de Jong, Peter J; Glashouwer, Klaske A; Spinhoven, Philip; Penninx, Brenda W J H; Elzinga, Bernet M

2010-06-01

Individuals reporting Childhood Abuse (CA) (i.e., emotional neglect, emotional-, physical- and sexual-abuse) are marked by increased explicit (i.e. self-reported) negative self-associations, and an increased risk to develop depression or anxiety disorders. Automatic self-associations might play an important role in the development and maintenance of affective disorders after exposure to CA, since automatic associations are assumed to be involved in uncontrolled (spontaneous) affective behavior. This study examined whether individuals reporting a history of CA show stronger automatic (and explicit) self-depression and/or self-anxiety associations than individuals who report no CA in a large cohort study (Netherlands Study of Depression and Anxiety (NESDA), n = 2981). The Implicit Association Test (IAT) was utilized to assess automatic self-depression and self-anxiety associations. We found that CA was associated with enhanced automatic (and explicit) self-depression and self-anxiety associations. Additionally, when compared to physical- and sexual-abuse, Childhood Emotional Maltreatment (CEM; emotional abuse and emotional neglect) had the strongest link with enhanced automatic (and explicit) self-depression and self-anxiety associations. In addition, automatic and explicit negative self-associations partially mediated the association between CEM and depressive or anxious symptomatology. Implications regarding the importance of CA, and CEM in particular will be discussed. Copyright (c) 2010 Elsevier Ltd. All rights reserved.

Relationships between Drinking Motives and Smoking Expectancies among Daily Smokers who are also Problem Drinkers

PubMed Central

Foster, Dawn W.; Zvolensky, Michael J.; Garey, Lorra; Ditre, Joseph W.; Schmidt, Norman B.

2014-01-01

Objective There is a high co-occurrence of problem drinking and regular cigarette smoking, and cognitive processes (e.g., motivation to use, expectations about the consequences of use) related to each are positively associated with one another. We explored drinking motives in relation to cognitive-based smoking processes among smokers with problematic drinking. We expected that drinking coping motives would be associated with smoking consequences related to negative reinforcement and negative personal outcomes, and inflexibility of smoking behavior; observed effects for coping motives would be unique from shared variance with other motives and incrementally evident beyond the variance accounted for by tobacco-related health problems, smoking rate, negative affectivity, cannabis use, and gender. Methods The sample included 195 individuals recruited into a larger study of smoking cessation treatments (i.e., they were interested in quitting), who were heavy drinkers and smoked daily. Participants were primarily male (n = 122, 63%), fairly young (Mage=30.3 years; SD=12.46), and predominantly White/Caucasian (n = 175, 80%). Roughly 57% (n = 111) had at least one comorbid Axis I disorder, the most common being social anxiety (n = 21, 11%) and generalized anxiety disorder (n = 12, 6%). Results Coping drinking motives predicted negative smoking consequences, negative reinforcement, and smoking inflexibility. Enhancement drinking motives marginally predicted positive reinforcement. Conformity drinking motives predicted smoking consequences related to appetite/weight control. Social drinking motives predicted negative reinforcement and barriers to cessation, and marginally predicted positive reinforcement. Conclusions Theoretical models and clinical activities focused on smoking cessation among problem drinkers may benefit from considering the role of drinking motives, particularly coping-oriented motives, to better understanding cognitive-based smoking processes. PMID:25392285

Automatic Processing of Changes in Facial Emotions in Dysphoria: A Magnetoencephalography Study.

PubMed

Xu, Qianru; Ruohonen, Elisa M; Ye, Chaoxiong; Li, Xueqiao; Kreegipuu, Kairi; Stefanics, Gabor; Luo, Wenbo; Astikainen, Piia

2018-01-01

It is not known to what extent the automatic encoding and change detection of peripherally presented facial emotion is altered in dysphoria. The negative bias in automatic face processing in particular has rarely been studied. We used magnetoencephalography (MEG) to record automatic brain responses to happy and sad faces in dysphoric (Beck's Depression Inventory ≥ 13) and control participants. Stimuli were presented in a passive oddball condition, which allowed potential negative bias in dysphoria at different stages of face processing (M100, M170, and M300) and alterations of change detection (visual mismatch negativity, vMMN) to be investigated. The magnetic counterpart of the vMMN was elicited at all stages of face processing, indexing automatic deviance detection in facial emotions. The M170 amplitude was modulated by emotion, response amplitudes being larger for sad faces than happy faces. Group differences were found for the M300, and they were indexed by two different interaction effects. At the left occipital region of interest, the dysphoric group had larger amplitudes for sad than happy deviant faces, reflecting negative bias in deviance detection, which was not found in the control group. On the other hand, the dysphoric group showed no vMMN to changes in facial emotions, while the vMMN was observed in the control group at the right occipital region of interest. Our results indicate that there is a negative bias in automatic visual deviance detection, but also a general change detection deficit in dysphoria.

The effects of variable-time versus contingent reinforcement delivery on problem behavior maintained by escape.

PubMed

Lomas Mevers, Joanna E; Fisher, Wayne W; Kelley, Michael E; Fredrick, Laura D

2014-01-01

Results of previous research indicate that the delivery of positive reinforcement (e.g., food) for an appropriate, alternative target response (e.g., compliance) or delivery of food on a time-based schedule can decrease problem behavior reinforced by escape, even when problem behavior continues to produce negative reinforcement (e.g., Lalli et al., ; Lomas, Fisher, & Kelley, ). In this study, we compared the levels of both compliance and problem behavior when food and praise were delivered either contingent on compliance or on a time-based schedule. Results for 3 of the 4 participants showed that contingent delivery of preferred edible items and praise was more effective in both reducing problem behavior and increasing compliance compared to variable-time delivery of these same items. These findings are discussed in the context of motivating operations and competition between positive and negative reinforcement. © Society for the Experimental Analysis of Behavior.

Reinforcing Abstinence and Treatment Participation among Offenders in a Drug Diversion Program: Are Vouchers Effective?

PubMed Central

Hall, Elizabeth A.; Prendergast, Michael L.; Roll, John M.; Warda, Umme

2010-01-01

This study assessed a 26-week voucher-based intervention to reinforce abstinence and participation in treatment-related activities among substance-abusing offenders court referred to outpatient treatment under drug diversion legislation (California's Substance Abuse and Crime Prevention Act). Standard treatment consisted of criminal justice supervision and an evidence-based model for treating stimulant abuse. Participants were randomly assigned to four groups, standard treatment (ST) only, ST plus vouchers for testing negative, ST plus vouchers for performing treatment plan activities, and ST plus vouchers for testing negative and/or performing treatment plan activities. Results indicate that voucher-based reinforcement of negative urines and of treatment plan tasks (using a flat reinforcement schedule) showed no statistically significant effects on measures of retention or drug use relative to the standard treatment protocol. It is likely that criminal justice contingencies had a stronger impact on participants' treatment retention and drug use than the relatively low-value vouchers awarded as part of the treatment protocol. PMID:20463918

Reinforcement principles for addiction medicine; from recreational drug use to psychiatric disorder.

PubMed

Edwards, Scott

2016-01-01

The transition from recreational drug use to addiction can be conceptualized as a pathological timeline whereby the psychological mechanisms responsible for disordered drug use evolve from positive reinforcement to favor elements of negative reinforcement. Abused substances (ranging from alcohol to psychostimulants) are initially ingested at regular occasions according to their positive reinforcing properties. Importantly, repeated exposure to rewarding substances sets off a chain of secondary reinforcing events, whereby cues and contexts associated with drug use may themselves become reinforcing and thereby contribute to the continued use and possible abuse of the substance(s) of choice. Indeed, the powerful reinforcing efficacy of certain drugs may eclipse that of competing social rewards (such as career and family) and lead to an aberrant narrowing of behavioral repertoire. In certain vulnerable individuals, escalation of drug use over time is thought to drive specific molecular neuroadaptations that foster the development of addiction. Research has identified neurobiological elements of altered reinforcement following excessive drug use that comprise within-circuit and between-circuit neuroadaptations, both of which contribute to addiction. Central to this process is the eventual potentiation of negative reinforcement mechanisms that may represent the final definitive criterion locking vulnerable individuals into a persistent state of addiction. Targeting the neural substrates of reinforcement likely represents our best chances for therapeutic intervention for this devastating disease. © 2016 Elsevier B.V. All rights reserved.

Automatic vigilance for negative words in lexical decision and naming: comment on Larsen, Mercer, and Balota (2006).

PubMed

Estes, Zachary; Adelman, James S

2008-08-01

An automatic vigilance hypothesis states that humans preferentially attend to negative stimuli, and this attention to negative valence disrupts the processing of other stimulus properties. Thus, negative words typically elicit slower color naming, word naming, and lexical decisions than neutral or positive words. Larsen, Mercer, and Balota analyzed the stimuli from 32 published studies, and they found that word valence was confounded with several lexical factors known to affect word recognition. Indeed, with these lexical factors covaried out, Larsen et al. found no evidence of automatic vigilance. The authors report a more sensitive analysis of 1011 words. Results revealed a small but reliable valence effect, such that negative words (e.g., "shark") elicit slower lexical decisions and naming than positive words (e.g., "beach"). Moreover, the relation between valence and recognition was categorical rather than linear; the extremity of a word's valence did not affect its recognition. This valence effect was not attributable to word length, frequency, orthographic neighborhood size, contextual diversity, first phoneme, or arousal. Thus, the present analysis provides the most powerful demonstration of automatic vigilance to date.

Evidence for positive, but not negative, behavioral contrast with wheel-running reinforcement on multiple variable-ratio schedules.

PubMed

Belke, Terry W; Pierce, W David

2016-12-01

Rats responded on a multiple variable-ratio (VR) 10 VR 10 schedule of reinforcement in which lever pressing was reinforced by the opportunity to run in a wheel for 30s in both the changed (manipulated) and unchanged components. To generate positive contrast, the schedule of reinforcement in the changed component was shifted to extinction; to generate negative contrast, the schedule was shifted to VR 3. With the shift to extinction in the changed component, wheel-running and local lever-pressing rates increased in the unchanged component, a result supporting positive contrast; however, the shift to a VR 3 schedule in the changed component showed no evidence of negative contrast in the unaltered setting, only wheel running decreased in the unchanged component. Changes in wheel-running rates across components were consistent in showing a compensation effect, depending on whether the schedule manipulation increased or decreased opportunities for wheel running in the changed component. These findings are the first to demonstrate positive behavioral contrast on a multiple schedule with wheel running as reinforcement in both components. Copyright © 2016 Elsevier B.V. All rights reserved.

Comparison of the Frequency and Effectiveness of Positive and Negative Reinforcement Practices in Schools

ERIC Educational Resources Information Center

Dad, Hukam; Ali, Riasat; Janjua, Muhammad Zaigham Qadeer; Shahzad, Saqib; Khan, Muhammad Saeed

2010-01-01

The major purpose of the study was to compare the frequency and effectiveness of positive and negative reinforcement practices deployed by teachers in boys' and girls' secondary schools in urban and rural areas. It was hypothesized that there would be no difference in use of reward and punishment by teachers in secondary schools in urban and rural…

The Use of Negative Reinforcement in the Management of Television Newsrooms in the Southwestern U.S.

ERIC Educational Resources Information Center

Swanson, Douglas J.

A study highlighted the extent to which TV news directors and subordinates perceived negative reinforcement to be used to help establish working climate in their newsrooms, and examined the differences in their perceptions that working climate affects personal ability to do "best" work on the job. Twenty news directors and 40…

Employment-based abstinence reinforcement promotes opiate and cocaine abstinence in out-of-treatment injection drug users.

PubMed

Holtyn, August F; Koffarnus, Mikhail N; DeFulio, Anthony; Sigurdsson, Sigurdur O; Strain, Eric C; Schwartz, Robert P; Silverman, Kenneth

2014-01-01

We examined the use of employment-based abstinence reinforcement in out-of-treatment injection drug users, in this secondary analysis of a previously reported trial. Participants (N = 33) could work in the therapeutic workplace, a model employment-based program for drug addiction, for 30 weeks and could earn approximately $10 per hr. During a 4-week induction, participants only had to work to earn pay. After induction, access to the workplace was contingent on enrollment in methadone treatment. After participants met the methadone contingency for 3 weeks, they had to provide opiate-negative urine samples to maintain maximum pay. After participants met those contingencies for 3 weeks, they had to provide opiate- and cocaine-negative urine samples to maintain maximum pay. The percentage of drug-negative urine samples remained stable until the abstinence reinforcement contingency for each drug was applied. The percentage of opiate- and cocaine-negative urine samples increased abruptly and significantly after the opiate- and cocaine-abstinence contingencies, respectively, were applied. These results demonstrate that the sequential administration of employment-based abstinence reinforcement can increase opiate and cocaine abstinence among out-of-treatment injection drug users. © Society for the Experimental Analysis of Behavior.

EMPLOYMENT-BASED ABSTINENCE REINFORCEMENT PROMOTES OPIATE AND COCAINE ABSTINENCE IN OUT-OF-TREATMENT INJECTION DRUG USERS

PubMed Central

Holtyn, August F.; Koffarnus, Mikhail N.; DeFulio, Anthony; Sigurdsson, Sigurdur O.; Strain, Eric C.; Schwartz, Robert P.; Silverman, Kenneth

2016-01-01

We examined the use of employment-based abstinence reinforcement in out-of-treatment injection drug users, in this secondary analysis of a previously reported trial. Participants (N = 33) could work in the therapeutic workplace, a model employment-based program for drug addiction, for 30 weeks and could earn approximately $10 per hr. During a 4-week induction, participants only had to work to earn pay. After induction, access to the workplace was contingent on enrollment in methadone treatment. After participants met the methadone contingency for 3 weeks, they had to provide opiate-negative urine samples to maintain maximum pay. After participants met those contingencies for 3 weeks, they had to provide opiate- and cocaine-negative urine samples to maintain maximum pay. The percentage of drug-negative urine samples remained stable until the abstinence reinforcement contingency for each drug was applied. The percentage of opiate- and cocaine-negative urine samples increased abruptly and significantly after the opiate- and cocaine-abstinence contingencies, respectively, were applied. These results demonstrate that the sequential administration of employment-based abstinence reinforcement can increase opiate and cocaine abstinence among out-of-treatment injection drug users. PMID:25292399

The Dark Side of Addiction: The Horsley Gantt to Joseph Brady Connection.

PubMed

Koob, George F

2017-04-01

W. Horsley Gantt and Joseph V. Brady laid a rich foundation for understanding the concept of emotion, derived from 2 prominent traditions of physiology and psychology: classic conditioning and operant conditioning, respectively. This framework guided my fierce interest in motivation in general and the interaction between reward and stress, which began at John Hopkins with my thesis work under the guidance of Drs. Zoltan Annau, Solomon Synder, and Joseph Brady, among many others. Using the study of the neurobiology of addiction as a framework, I argue that drug addiction not only involves positive reinforcement associated with the rewarding effects of drugs of abuse but also involves another major source of reinforcement, specifically negative reinforcement driven by negative emotional states (termed the "dark side" of addiction). Excessive activation of the brain reward systems leads to antireward or a decrease in the function of normal reward-related neurocircuitry and persistent recruitment of the brain stress systems, both of which may be neurobiologically linked. Understanding the neuroplasticity of the neurocircuitry that comprises the negative reinforcement associated with addiction is a key to understanding negative emotional states in general and their pathophysiology.

Treatment of Multiply Controlled Problem Behavior with Procedural Variations of Differential Reinforcement

ERIC Educational Resources Information Center

Neidert, Pamela L.; Iwata, Brian A.; Dozier, Claudia L.

2005-01-01

We describe the assessment and treatment of 2 children with autism spectrum disorder whose problem behaviors (self-injury, aggression, and disruption) were multiply controlled. Results of functional analyses indicated that the children's problem behaviors were maintained by both positive reinforcement (attention) and negative reinforcement (escape…

Differential Effects of Positive and Negative Reinforcement on Two Psychoanalytic Character Types

ERIC Educational Resources Information Center

Cooperman, Marc; Child, Irvin L.

1971-01-01

The present study attempted to duplicate earlier findings and to investigate the effects of mechanical as well as personal reinforcement. However, the acquisition and extinction differences between oral and anal scoring types reported in the earlier studies were not obtained with either personal or mechanical reinforcement. (Author)

Identification and Modelling of the In-Plane Reinforcement Orientation Variations in a CFRP Laminate Produced by Manual Lay-Up

NASA Astrophysics Data System (ADS)

Davila, Yves; Crouzeix, Laurent; Douchin, Bernard; Collombet, Francis; Grunevald, Yves-Henri

2017-08-01

Reinforcement angle orientation has a significant effect on the mechanical properties of composite materials. This work presents a methodology to introduce variable reinforcement angles into finite element (FE) models of composite structures. The study of reinforcement orientation variations uses meta-models to identify and control a continuous variation across the composite ply. First, the reinforcement angle is measured through image analysis techniques of the composite plies during the lay-up phase. Image analysis results show that variations in the mean ply orientations are between -0.5 and 0.5° with standard deviations ranging between 0.34 and 0.41°. An automatic post-treatment of the images determines the global and local angle variations yielding good agreements visually and numerically between the analysed images and the identified parameters. A composite plate analysed at the end of the cooling phase is presented as a case of study. Here, the variation in residual strains induced by the variability in the reinforcement orientation are up to 28% of the strain field of the homogeneous FE model. The proposed methodology has shown its capabilities to introduce material and geometrical variability into FE analysis of layered composite structures.

Identification and Modelling of the In-Plane Reinforcement Orientation Variations in a CFRP Laminate Produced by Manual Lay-Up

NASA Astrophysics Data System (ADS)

Davila, Yves; Crouzeix, Laurent; Douchin, Bernard; Collombet, Francis; Grunevald, Yves-Henri

2018-06-01

Reinforcement angle orientation has a significant effect on the mechanical properties of composite materials. This work presents a methodology to introduce variable reinforcement angles into finite element (FE) models of composite structures. The study of reinforcement orientation variations uses meta-models to identify and control a continuous variation across the composite ply. First, the reinforcement angle is measured through image analysis techniques of the composite plies during the lay-up phase. Image analysis results show that variations in the mean ply orientations are between -0.5 and 0.5° with standard deviations ranging between 0.34 and 0.41°. An automatic post-treatment of the images determines the global and local angle variations yielding good agreements visually and numerically between the analysed images and the identified parameters. A composite plate analysed at the end of the cooling phase is presented as a case of study. Here, the variation in residual strains induced by the variability in the reinforcement orientation are up to 28% of the strain field of the homogeneous FE model. The proposed methodology has shown its capabilities to introduce material and geometrical variability into FE analysis of layered composite structures.

Staple line reinforcement during sleeve gastrectomy with a new type of reinforced stapler.

PubMed

El Moussaoui, Imad; Limbga, Augustin; Mehdi, Abdelilah

2018-04-01

Bleeding and staple-line leak, are the most common complications of laparoscopic sleeve gastrectomy. To decrease the incidence of this complications, a variety of intraoperative reinforcement of staple line is used. Reinforced GIA™ is a new automatic suture device with pre-attached synthetic tissue reinforcement, but no study has evaluated its use in sleeve gastrectomy. The objective of this study is to evaluate the efficacy and safety of this new staple line reinforcement technique in laparoscopic sleeve gastrectomy. We conducted a retrospective review of 290 patients who underwent laparoscopic sleeve gastrectomy between January 2013 and January 2016 in which reinforced GIA™ or standard GIA™ was used. Patients preoperative characteristics, Operative time, staple line leaks, staple line bleeds, stenosis, and complications requiring reoperation were collected. A total of 187 laparoscopic sleeve gastrectomy were performed with standard GIA and 103 with reinforced GIA™. Patient characteristics were not significantly different between the groups. The average operating time in the standard GIA group is 57.41±16.44 min against 50.9±14.12 min in the reinforced GIA group (P=0.006). Two staple line leaks developed in the standard GIA group and reoperated against no patients in the reinforced GIA group, without significant difference between the both groups (P=0.66). Staple line bleeds are less in the reinforced GIA group, only 23 (22.3%) against 78 (41.7%) cases in the standard GIA group (P=0.001). No patients of both groups developed gastric sleeve stenosis. During laparoscopic sleeve gastrectomy, the use of a reinforced stapler significantly reduces the operative time and staple line bleeding. No significant difference is evidenced in terms of reduction of staple line leaks with this reinforced stapler.

Automatic affective processing impairments in patients with deficit syndrome schizophrenia.

PubMed

Strauss, Gregory P; Allen, Daniel N; Duke, Lisa A; Ross, Sylvia A; Schwartz, Jason

2008-07-01

Affective impairments were examined in patients with and without deficit syndrome schizophrenia. Two Emotional Stroop tasks designed to measure automatic processing of emotional information were administered to deficit (n=15) and non-deficit syndrome (n=26) schizophrenia patients classified according to the Schedule for the Deficit Syndrome, and matched non-patient control subjects (n=22). In comparison to non-deficit patients and controls, deficit syndrome patients demonstrated a lack of attention bias for positive information, and an elevated attentional lingering effect for negative information. These findings suggest that positive information fails to automatically capture attention of deficit syndrome patients, and that when negative information captures attention, it produces difficulty in disengagement Attentional abnormalities were significantly correlated with negative symptoms, such that more severe symptoms were associated with less attention bias for positive emotion and a greater lingering effect for negative information. Results are generally consistent with a mood-congruent processing abnormality and suggest that impaired automatic processing may be core to diminished emotional experience symptoms exhibited in deficit syndrome patients.

The Short Form Vaping Consequences Questionnaire: Psychometric Properties of a Measure of Vaping Expectancies for Use With Adult E-cigarette Users.

PubMed

Morean, Meghan E; L'Insalata, Alexa

2017-02-01

E-cigarettes are popular in the United States, but psychometrically sound measures of vaping beliefs and behaviors are lacking. We evaluated the psychometrics of the Short Form Vaping Consequences Questionnaire (S-VCQ), a modified version of the Short Form Smoking Consequences Questionnaire that assesses expectancies for negative consequences, positive reinforcement, negative reinforcement, and appetite/weight control associated with vaping. Adult, past-month e-cigarette users completed an anonymous survey in Fall 2015 (N = 522, 50.4% female; 71.5% white; 34.10 [SD = 9.66] years). Psychometric analyses included confirmatory factor analysis, internal consistency, measurement invariance, t tests, correlations, and test-criterion relationships with vaping outcomes. The S-VCQ evidenced a four-factor latent structure (Bentler's Comparative Fit Index = .95, Root Mean Square Error of Approximation = .05, Standardized Root Mean Square Residual = .06), and subscales evidenced internal consistency (mean α = 0.89). S-VCQ scores were scalar invariant for sex and smoking status; women reported stronger appetite/weight control than men and dual cigarette/e-cigarette users (n = 309) reported stronger negative vaping consequences and negative reinforcement than nonsmokers. Among dual users, vaping and smoking expectancies also were scalar invariant; dual users reported stronger positive reinforcement associated with vaping than smoking but stronger negative consequences, negative reinforcement, and appetite/weight control associated with smoking than vaping. Correlations indicated that vaping and smoking expectancies were related, yet distinct constructs. Univariate general linear models indicated that vaping frequency and dependence were associated with positive reinforcement (ηp2 = .02/.02), negative reinforcement (ηp2 = .02/.08), and appetite/weight control (ηp2 = .02/.02) from vaping. The S-VCQ evidences solid psychometrics as a measure of adult e-cigarette users' vaping expectancies. The current study provides evidence for the reliability and validity of the S-VCQ, the first measure of vaping expectancies that has been validated for use with adult e-cigarette users. Results indicated that the S-VCQ comprises four subscales that evidence internal consistency, scalar measurement invariance for important groups of interest, and test-criterion relationships with vaping outcomes. Researchers are encouraged to consider using this measure for assessing vaping expectancies in adult e-cigarette users. © The Author 2016. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Comparisons of Interventions for Rumination Maintained by Automatic Reinforcement

ERIC Educational Resources Information Center

Sharp, Rebecca A.; Phillips, Katrina J.; Mudford, Oliver C.

2012-01-01

The effectiveness of four antecedent treatments for rumination was compared for two individuals with autism, severe intellectual disabilities and long histories (at least 20 years) of rumination. Comparisons of increased meal size, supplemental feedings, fixed-time provision of peanut butter, and liquid rescheduling found liquid rescheduling to be…

Assessing and Treating Stereotypical Behaviors in Classrooms Using a Functional Approach

ERIC Educational Resources Information Center

Bruhn, Allison L.; Balint-Langel, Kinga; Troughton, Leonard; Langan, Sean; Lodge, Kelsey; Kortemeyer, Sara

2015-01-01

For years, the assumption has been that stereotypical behaviors functioned only to provide sensory or automatic reinforcement. However, these behaviors also may serve social functions. Given the unsettled debate, functional behavior assessment and functional analysis can be used to identify the exact function of stereotypical behavior and design…

Infant Temperament Is Associated with Relative Food Reinforcement.

PubMed

Kong, Kai Ling; Anzman-Frasca, Stephanie; Feda, Denise M; Eiden, Rina D; Sharma, Neha N; Stier, Corrin L; Epstein, Leonard H

2016-12-01

Food reinforcement refers to how hard someone is motivated to work to gain access to food. Infant temperament is defined as behavioral styles, or constitutionally based individual differences in reactive and regulatory aspects of behavior. Identifying correlates of food reinforcement, such as infant temperament, may help identify infants at risk for future negative health consequences (e.g., overweight or obesity) of high food reinforcement. This study tested aspects of parent-reported negative reactivity and regulation and their associations with relative food reinforcement in a cross-sectional sample of 105 9- to 18-month-old infants. Hierarchical linear regression models were then used to predict infant food reinforcement for the temperament dimensions that were significantly related to it. Two temperament dimensions, cuddliness (regulatory aspect) (B = -0.050, ΔR 2  = 0.074, p = 0.005) and rate of recovery from distress and arousal (reactive aspect) (B = -0.040, ΔR 2  = 0.045, p = 0.031), were inversely associated with relative food reinforcement. Clarifying the nature of relationships between these two behavioral predictors, infant temperament and relative food reinforcement, and early obesity can elucidate the role of individual differences in early obesity risk and can further inform targets for early behavioral obesity preventive interventions.

Using Negative Reinforcement to Increase Self-Feeding in a Child with Food Selectivity

ERIC Educational Resources Information Center

Vaz, Petula C. M.; Volkert, Valerie M.; Piazza, Cathleen C.

2011-01-01

We examined the effects of a negative reinforcement-based treatment on the self-feeding of 1 child with food selectivity by type and texture. Self-feeding increased when the child could choose to either self-feed 1 bite of a target food or be fed 1 bite of the target food and 5 bites of another food. Possible mechanisms that underlie the…

Preference Assessment for Dimensions of Reinforcement to Inform Token Economies Targeting Problem Behavior

ERIC Educational Resources Information Center

Romani, Patrick W.; Alcorn, Aimee S.; Miller, Jonathan R.; Clark, Gwendolyn

2017-01-01

The purpose of the current two-experiment study was to examine the use of a preference assessment for dimensions of reinforcement to inform an effective token economy arrangement. Three participants diagnosed with developmental disabilities who engaged in negatively reinforced problem behavior participated in this study. During Experiment 1, a…

Contingency Management Treatments: Reinforcing Abstinence Versus Adherence with Goal-Related Activities

ERIC Educational Resources Information Center

Petry, Nancy M.; Alessi, Sheila M.; Carroll, Kathleen M.; Hanson, Tressa; MacKinnon, Stephen; Rounsaville, Bruce; Sierra, Sean

2006-01-01

Contingency management (CM) interventions usually reinforce submission of drug-negative specimens, but they can also reinforce adherence with goal-related activities. This study compared the efficacy of the 2 approaches. Substance-abusing outpatients (N = 131) were randomly assigned to 1 of 3 12-week treatments: standard treatment (ST), ST with CM…

Effects of Signaled Positive Reinforcement on Problem Behavior Maintained by Negative Reinforcement

ERIC Educational Resources Information Center

Schieltz, Kelly M.; Wacker, David P.; Romani, Patrick W.

2017-01-01

We evaluated the effects of providing positive reinforcement for task completion, signaled via the presence of a tangible item, on escape-maintained problem behavior displayed by three typically developing children during one-time 90-min outpatient evaluations. Brief functional analyses of problem behavior, conducted within a multielement design,…

Negative Automatic Thoughts, Emotional Intelligence and Demographical Different Variables Affecting University Students

ERIC Educational Resources Information Center

Direktor, Cemaliye; Simsek, Angelika H.; Serin, Nerguz Bulut

2017-01-01

This study examines the relationship of negative automatic thoughts, emotional intelligence subscales, gender, and department of university students. The participants are 291 students (170 female and 121 male) of Department of Psychology, Department of Counselling and Department of Preschool Education, of Private University in North Cyprus.…

Components of Implicit Stigma against Mental Illness among Chinese Students

PubMed Central

Wang, Xiaogang; Huang, Xiting; Jackson, Todd; Chen, Ruijun

2012-01-01

Although some research has examined negative automatic aspects of attitudes toward mental illness via relatively indirect measures among Western samples, it is unclear whether negative attitudes can be automatically activated in individuals from non-Western countries. This study attempted to validate results from Western samples with Chinese college students. We first examined the three-component model of implicit stigma (negative cognition, negative affect, and discriminatory tendencies) toward mental illness with the Single Category Implicit Association Test (SC-IAT). We also explored the relationship between explicit and implicit stigma among 56 Chinese university college students. In the three separate SC-IATs and the combined SC-IAT, automatic associations between mental illness and negative descriptors were stronger relative to those with positive descriptors and the implicit effect of cognitive and affective SC-IATs were significant. Explicit and implicit measures of stigma toward mental illness were unrelated. In our sample, women's overall attitudes toward mental illness were more negative than men's were, but no gender differences were found for explicit measures. These findings suggested that implicit stigma toward mental illness exists in Chinese students, and provide some support for the three-component model of implicit stigma toward mental illness. Future studies that focus on automatic components of stigmatization and stigma-reduction in China are warranted. PMID:23029366

Behavioral contrast with timeout, blackout, or extinction as the negative condition1

PubMed Central

Sadowsky, Stephen

1973-01-01

When either a timeout period (darkening the response key) or a blackout period (darkening both chamber and response key) was alternated with a stimulus associated with variable-interval reinforcement, behavioral contrast was obtained. Either peck contrast or maintained contrast occurred, depending on whether or not responding was evidenced during the negative condition. These results are contrary to recent accounts emphasizing the role of non-reinforced responding in the production of contrast, but are consistent with interpretations emphasizing the aversiveness of the negative condition. PMID:16811680

Validation of the Automatic Thoughts Questionnaire (ATQ) Among Mainland Chinese Students in Hong Kong.

PubMed

Pan, Jia-Yan; Ye, Shengquan; Ng, Petrus

2016-01-01

The present study validated the combined version of the 8-item Automatic Thought Questionnaire (ATQ) and 10 positive items from the ATQ-revised among Chinese university students. A total of 412 Mainland Chinese university students were recruited in Hong Kong by an online survey. A 14-item Chinese ATQ was derived via item analysis. Satisfactory internal consistency reliability and good split-half reliability were obtained. Exploratory and confirmatory factor analysis revealed a 3-correlated-factor solution for the Chinese ATQ: negative thought, positive thought (emotional), and positive thought (cognitive). The negative ATQ subscale score was positively correlated with negative affect, and negatively correlated with positive affect and life satisfaction. The two positive ATQ subscale scores were negatively correlated with negative affect, and positively correlated with positive affect and life satisfaction. The 14-item ATQ is a valid and reliable instrument for measuring automatic thoughts in the Chinese context of Hong Kong. © 2015 Wiley Periodicals, Inc.

A knowledge-base generating hierarchical fuzzy-neural controller.

PubMed

Kandadai, R M; Tien, J M

1997-01-01

We present an innovative fuzzy-neural architecture that is able to automatically generate a knowledge base, in an extractable form, for use in hierarchical knowledge-based controllers. The knowledge base is in the form of a linguistic rule base appropriate for a fuzzy inference system. First, we modify Berenji and Khedkar's (1992) GARIC architecture to enable it to automatically generate a knowledge base; a pseudosupervised learning scheme using reinforcement learning and error backpropagation is employed. Next, we further extend this architecture to a hierarchical controller that is able to generate its own knowledge base. Example applications are provided to underscore its viability.

Examining an underlying mechanism between perceived stress and smoking cessation-related outcomes.

PubMed

Robles, Zuzuky; Garey, Lorra; Hogan, Julianna; Bakhshaie, Jafar; Schmidt, Norman B; Zvolensky, Michael J

2016-07-01

The mediational role of negative reinforcement smoking outcome expectancies in the relation between perceived stress and (1) perceived barriers to cessation, (2) severity of problematic symptoms during past quit attempts, and (3) smoking-specific experiential avoidance (AIS) was examined. Data were drawn from a baseline assessment of a larger clinical trial. Participants included 332 adult treatment-seeking smokers (47.3% female; Mage=38.45; SD=.50; age range: 18-65 years). Results indicated that perceived stress was indirectly related to perceived barriers to smoking cessation, severity of problematic symptoms during past quit attempts, and AIS through negative reinforcement outcome expectancies. These results were evident after accounting for the variance explained by gender, negative affectivity, and alternative outcome expectancies for smoking. The present findings suggest that smokers with greater perceived stress experience greater negative reinforcement smoking expectancies, which in turn, may be related to numerous processes involved in the maintenance of smoking. Copyright © 2016 Elsevier Ltd. All rights reserved.

Actions speak louder than words: An elaborated theoretical model of the social functions of self-injury and other harmful behaviors

PubMed Central

Nock, Matthew K.

2008-01-01

The question of why some people do things that are intentionally harmful to themselves continues to puzzle scientists, clinicians, and the public. Prior studies have demonstrated that one fairly extreme, direct form of self-harm, non-suicidal self-injury (NSSI), is maintained by both automatic (i.e., intrapersonal) as well as social (i.e., interpersonal) reinforcement. However, the majority of theoretical and empirical papers on this topic focus almost exclusively on the automatic functions. The purpose of this paper is to provide a more comprehensive analysis of the social functions of NSSI. Evidence is presented supporting the notion that NSSI is maintained by social reinforcement in at least a substantial minority of instances. Moreover, an elaborated theoretical model of the social functions of NSSI is outlined that proposes that this behavior represents a high intensity social signal used when less intense communication strategies fail (e.g., speaking, yelling, crying). The model further proposes that NSSI can serve not only as a signal of distress that is reinforced primarily by the caregiving behavior it elicits from others, but that it also can serve as a signal of strength and fitness that is reinforced by warding off potential threats (e.g., peer victimization), and in some cases can strengthen affiliation with others. Support for this theoretical model is drawn from diverse literatures including psychology, evolutionary biology, and cultural anthropology. The paper concludes with specific recommendations for empirical tests of the proposed model of the social functions of NSSI, as well as other harmful behaviors such as alcohol and drug use. PMID:19122893

Motion sickness: a negative reinforcement model.

PubMed

Bowins, Brad

2010-01-15

Theories pertaining to the "why" of motion sickness are in short supply relative to those detailing the "how." Considering the profoundly disturbing and dysfunctional symptoms of motion sickness, it is difficult to conceive of why this condition is so strongly biologically based in humans and most other mammalian and primate species. It is posited that motion sickness evolved as a potent negative reinforcement system designed to terminate motion involving sensory conflict or postural instability. During our evolution and that of many other species, motion of this type would have impaired evolutionary fitness via injury and/or signaling weakness and vulnerability to predators. The symptoms of motion sickness strongly motivate the individual to terminate the offending motion by early avoidance, cessation of movement, or removal of oneself from the source. The motion sickness negative reinforcement mechanism functions much like pain to strongly motivate evolutionary fitness preserving behavior. Alternative why theories focusing on the elimination of neurotoxins and the discouragement of motion programs yielding vestibular conflict suffer from several problems, foremost that neither can account for the rarity of motion sickness in infants and toddlers. The negative reinforcement model proposed here readily accounts for the absence of motion sickness in infants and toddlers, in that providing strong motivation to terminate aberrant motion does not make sense until a child is old enough to act on this motivation.

Reinforcement expectations explain the relationship between depressive history and smoking status in college students.

PubMed

McChargue, Dennis E; Spring, Bonnie; Cook, Jessica W; Neumann, Christopher A

2004-07-01

Little is understood about biobehavioral mechanisms that mediate the comorbidity between cigarette smoking and depression. We hypothesized that expectancies about nicotine's reinforcing effects are associated with vulnerability to depression, and may partially explain the relationship between history of depression and smoking. Young adult smokers and never smokers (N=175, mean age=19.9 years, S.D.=3.2) were assessed for history of depression and expectations about the negative (e.g., dispels bad moods) and positive (e.g., increases pleasure) reinforcing effects of smoking. Results are inconsistent with the premise that negative reinforcement expectancies mediate the comorbidity between depression and nicotine dependence. Instead, findings suggest that young adults with a prior history of major depression hold exaggerated expectations about nicotine's positive effects, which could enhance their likelihood of initiating smoking. Copyright 2004 Elsevier Ltd.

Positive reinforcement modulates fronto-limbic systems subserving emotional interference in adolescents.

PubMed

Ladouceur, Cecile D; Schlund, Michael W; Segreti, Anna-Maria

2018-02-15

Fronto-limbic systems play an important role in supporting resistance to emotional distraction to promote goal-directed behavior. Despite evidence that alterations in the functioning of these systems are implicated in developmental trajectories of psychopathology, most studies have been conducted in adults. This study examined the functioning of fronto-limbic systems subserving emotional interference in adolescents and whether differential reinforcement of correct responding can modulate these neural systems in ways that could promote resistance to emotional distraction. Fourteen healthy adolescents (ages 9-15) completed an emotional delayed working memory task during fMRI with emotional distracters (none, neutral, negative) while positive reinforcement (i.e., monetary reward) was provided for correct responses under some conditions. Adolescents showed slightly reduced behavioral performance and greater activation in amygdala and prefrontal cortical regions (ventrolateral, ventromedial, dorsolateral) on correct trials with negative distracters compared to those with no or neutral distracters. Positive reinforcement yielded an overall improvement in accuracy and reaction times and counteracted the effects of negative distracters as evidenced by significant reductions in activation in key fronto-limbic regions. The present findings extend results on emotional interference from adults to adolescents and suggest that positive reinforcement could be used to potentially promote insulation from emotional distraction. A challenge for the future will be to build upon these findings for constructing reinforcement-based attention training programs that could be used to reduce emotional attention biases in anxious youth. Copyright © 2017 Elsevier B.V. All rights reserved.

A rapid method of toilet training the institutionalized retarded1

PubMed Central

Azrin, N. H.; Foxx, R. M.

1971-01-01

Incontinence is a major unsolved problem in the institutional care of the profoundly retarded. A reinforcement and social analysis of incontinence was used to develop a procedure that would rapidly toilet train retardates and motivate them to remain continent during the day in their ward setting. Nine profoundly retarded adults were given intensive training (median of four days per patient), the distinctive features of which were artificially increasing the frequency of urinations, positive reinforcement of correct toileting but a delay for “accidents”, use of new automatic apparatus for signalling elimination, shaping of independent toileting, cleanliness training, and staff reinforcement procedures. Incontinence was reduced immediately by about 90% and eventually decreased to near-zero. These results indicate the present procedure is an effective, rapid, enduring, and administratively feasible solution to the problem of incontinence of the institutionalized retarded. PMID:16795291

Try P.R.A.I.S.E. - Positive Reinforcement And Individualized Systematic Economics.

ERIC Educational Resources Information Center

Wollam, Scott

Described is a multi-faceted money system which utilizes positive and negative reinforcement while at the same time incorporating peer pressure and reinforcement for behavior modification. The system uses such items as money, checks, deposit slips, and bank books. Children have jobs such as pencil sellers, banker, or door monitor, and receive pay…

Assessing Preferences for Positive and Negative Reinforcement during Treatment of Destructive Behavior with Functional Communication Training

ERIC Educational Resources Information Center

Fisher, Wayne W.; Adelinis, John D.; Volkert, Valerie M.; Keeney, Kris M.; Neidert, Pamela L.; Hovanetz, Alyson

2005-01-01

Results of prior studies (e.g. [J. Appl. Behav. Anal. 32 (1999) 285]) showing that participants chose alternative behavior (compliance) over escape-reinforced destructive behavior when this latter response produced escape and the former response produced positive reinforcement may have been due to (a) the value of the positive reinforcer…

The Effects of a Brushing Procedure on Stereotypical Behavior

ERIC Educational Resources Information Center

Davis, Tonya N.; Durand, Shannon; Chan, Jeffrey M.

2011-01-01

In this study we analyzed the effects of a brushing protocol on stereotyped behavior of a young boy with autism. First, a functional analysis was conducted which showed that the participant's stereotypy was maintained by automatic reinforcement. Next, the Wilbarger Protocol, a brushing intervention, was implemented. An ABA design was implemented…

Indirect Functional Assessment of Stereotypy in Children with Autism Spectrum Disorders

ERIC Educational Resources Information Center

Wilke, Arthur E.; Tarbox, Jonathan; Dixon, Dennis R.; Kenzer, Amy L.; Bishop, Michele R.; Kakavand, Heleya

2012-01-01

Autism spectrum disorders (ASD) are characterized by the presence of repetitive behavior and stereotyped patterns of interest and activities. It is common for clinicians to assume that repetitive behaviors are maintained by automatic reinforcement but, as with any challenging behavior, the function of stereotypy should not be assumed based on its…

Reducing Covert Self-Injurious Behavior Maintained by Automatic Reinforcement through a Variable Momentary DRO Procedure

ERIC Educational Resources Information Center

Toussaint, Karen A.; Tiger, Jeffrey H.

2012-01-01

Covert self-injurious behavior (i.e., behavior that occurs in the absence of other people) can be difficult to treat. Traditional treatments typically have involved sophisticated methods of observation and often have employed positive punishment procedures. The current study evaluated the effectiveness of a variable momentary differential…

Evaluation of Stimulus Control over a Communication Response as an Intervention for Stereotypical Responding

ERIC Educational Resources Information Center

Anderson, Cynthia M.; Doughty, Shannon S.; Doughty, Adam H.; Williams, Dean C.; Saunders, Kathryn J.

2010-01-01

Stereotypical behavior maintained by automatic reinforcement often does not result in harm but may be undesirable in some situations. In the current investigation, participants were 2 individuals who engaged in nonharmful stereotypical responses shown in an analogue functional analysis to be insensitive to social contingencies. After bringing…

Automatic Neural Processing of Disorder-Related Stimuli in Social Anxiety Disorder: Faces and More

PubMed Central

Schulz, Claudia; Mothes-Lasch, Martin; Straube, Thomas

2013-01-01

It has been proposed that social anxiety disorder (SAD) is associated with automatic information processing biases resulting in hypersensitivity to signals of social threat such as negative facial expressions. However, the nature and extent of automatic processes in SAD on the behavioral and neural level is not entirely clear yet. The present review summarizes neuroscientific findings on automatic processing of facial threat but also other disorder-related stimuli such as emotional prosody or negative words in SAD. We review initial evidence for automatic activation of the amygdala, insula, and sensory cortices as well as for automatic early electrophysiological components. However, findings vary depending on tasks, stimuli, and neuroscientific methods. Only few studies set out to examine automatic neural processes directly and systematic attempts are as yet lacking. We suggest that future studies should: (1) use different stimulus modalities, (2) examine different emotional expressions, (3) compare findings in SAD with other anxiety disorders, (4) use more sophisticated experimental designs to investigate features of automaticity systematically, and (5) combine different neuroscientific methods (such as functional neuroimaging and electrophysiology). Finally, the understanding of neural automatic processes could also provide hints for therapeutic approaches. PMID:23745116

On the relative contributions of positive reinforcement and escape extinction in the treatment of food refusal.

PubMed

Piazza, Cathleen C; Patel, Meeta R; Gulotta, Charles S; Sevin, Bari M; Layer, Stacy A

2003-01-01

We compared the effects of positive reinforcement alone, escape extinction alone, and positive reinforcement with escape extinction in the treatment of the food and fluid refusal of 4 children who had been diagnosed with a pediatric feeding disorder. Consumption did not increase when positive reinforcement was implemented alone. By contrast, consumption increased for all participants when escape extinction was implemented, independent of the presence or absence of positive reinforcement. However, the addition of positive reinforcement to escape extinction was associated with beneficial effects (e.g., greater decreases in negative vocalizations and inappropriate behavior) for some participants.

Common psychotic symptoms can be explained by the theory of ecological perception.

PubMed

Golembiewski, Jan Alexander

2012-01-01

The symptoms of psychiatric illness are diverse, as are the causes of the conditions that cause them. Yet, regardless of the heterogeneity of cause and presentation, a great deal of symptoms can be explained by the failure of a single perceptual function--the reprocessing of ecological perception. It is a central tenet of the ecological theory of perception that we perceive opportunities to act. It has also been found that perception automatically causes actions and thoughts to occur unless this primary action pathway is inhibited. Inhibition allows perceptions to be reprocessed into more appropriate alternative actions and thoughts. Reprocessing of this kind takes place over the entire frontal lobe and it renders action optional. Choice about what action to take (if any) is the basis for the feeling of autonomy and ultimately for the sense-of-self. When thoughts and actions occur automatically (without choice) they appear to originate outside of the self, thereby providing prima facie evidence for some of the bizarre delusions that define schizophrenia such as delusional misidentification, delusions of control and Cotard's delusion. Automatic actions and thoughts are triggered by residual stimulation whenever reprocessing is insufficient to balance automatic excitatory cues (for whatever reason). These may not be noticed if they are neutral and therefore unimportant or where actions and thoughts have a positive bias and are desirable. Responses to negative stimulus, on the other hand, are always unwelcome, because the actions that are triggered will carry the negative bias. Automatic thoughts may include spontaneous positive feelings of love and joy, but automatic negative thoughts and visualisations are experienced as hallucinations. Not only do these feel like they emerge from elsewhere but they carry a negative bias (they are most commonly critical, rude and are irrationally paranoid). Automatic positive actions may include laughter and smiling and these are welcome. Automatic behaviours that carry a negative bias, however, are unwelcome and like hallucinations, occur without a sense of choice. These include crying, stereotypies, perseveration, ataxia, utilization and imitation behaviours and catatonia. Copyright © 2011 Elsevier Ltd. All rights reserved.

Reinforcement of timber beams with carbon fibers reinforced plastics

NASA Astrophysics Data System (ADS)

Gugutsidze, G.; Draškovič, F.

2010-06-01

Wood is a polymeric material with many valuable features and which also lacks some negative features. In order to keep up with high construction rates and the minimization of negative effects, wood has become one of the most valuable materials in modern engineering. But the use of timber material economically is also an actual problem in order to protect the environment and improve natural surroundings. A panel of scientists is interested in solving these problems and in creating rational structures, where timber can be used efficiently. These constructions are as follows: glue-laminated (gluelam), composed and reinforced wooden constructions. Composed and reinforced wooden constructions are examined less, but according to researches already carried out, it is clear that significant work can be accomplished in creating rational, highly effective and economic timber constructions. The paper deals with research on the formation of composed fiber-reinforced beams (CFRP) made of timber and provide evidence of their effectiveness. The aim of the paper is to investigate cross-bending of CFRP-reinforced gluelaminated timber beams. According to the results we were able to determine the additional effectiveness of reinforcement with CFRP (which depends on the CFRP material's quality, quantity and module of elasticity) on the mechanical features of timber and a whole beam.

Merging separately established stimulus classes with outcome-specific reinforcement.

PubMed

Johnson, Cammarie; Meleshkevich, Olga; Dube, William V

2014-01-01

This study extended previous research on equivalence relations established with outcome-specific reinforcers to include the merger of separately established stimulus classes. Participants were four adults. Conditional discriminations AC and BC were trained first. Correct selections of C1 (C2, or C3) in the presence of A1 or B1 (A2 or B2, or A3 or B3) were followed by red (blue, or white) tokens; tokens were exchanged for value added to three participant-selected gift cards. Outcomes on equivalence tests for three-member classes ABC were positive. DF and EF were trained with the same reinforcing consequences, and tests were positive for three-member classes DEF. Results of class merger tests with combinations of stimuli from the ABC and DEF classes (AD, FB, etc.) were immediately positive for two participants, demonstrating six-member classes ABCDEF with reinforcers as nodes. Merger tests for a third participant were initially negative but became positive after brief exposure to unreinforced probe trials with reinforcers as comparison stimuli. Following class merger, tests for matching the reinforcers to samples and comparisons were also positive. Class-merger test results were negative for a fourth participant. The results provide the first demonstration of eight-member equivalence classes including two outcome-specific conditioned reinforcing stimuli. © Society for the Experimental Analysis of Behavior.

Feedback-related negativity is enhanced in adolescence during a gambling task with and without probabilistic reinforcement learning.

PubMed

Martínez-Velázquez, Eduardo S; Ramos-Loyo, Julieta; González-Garrido, Andrés A; Sequeira, Henrique

2015-01-21

Feedback-related negativity (FRN) is a negative deflection that appears around 250 ms after the gain or loss of feedback to chosen alternatives in a gambling task in frontocentral regions following outcomes. Few studies have reported FRN enhancement in adolescents compared with adults in a gambling task without probabilistic reinforcement learning, despite the fact that learning from positive or negative consequences is crucial for decision-making during adolescence. Therefore, the aim of the present research was to identify differences in FRN amplitude and latency between adolescents and adults on a gambling task with favorable and unfavorable probabilistic reinforcement learning conditions, in addition to a nonlearning condition with monetary gains and losses. Higher rate scores of high-magnitude choices during the final 30 trials compared with the first 30 trials were observed during the favorable condition, whereas lower rates were observed during the unfavorable condition in both groups. Higher FRN amplitude in all conditions and longer latency in the nonlearning condition were observed in adolescents compared with adults and in relation to losses. Results indicate that both the adolescents and the adults improved their performance in relation to positive and negative feedback. However, the FRN findings suggest an increased sensitivity to external feedback to losses in adolescents compared with adults, irrespective of the presence or absence of probabilistic reinforcement learning. These results reflect processing differences on the neural monitoring system and provide new perspectives on the dynamic development of an adolescent's brain.

The motivating operation and negatively reinforced problem behavior: a systematic review.

PubMed

Langthorne, Paul; McGill, Peter; Oliver, Chris

2014-01-01

The concept of motivational operations exerts an increasing influence on the understanding and assessment of problem behavior in people with intellectual and developmental disability. In this systematic review of 59 methodologically robust studies of the influence of motivational operations in negative reinforcement paradigms in this population, we identify themes related to situational and biological variables that have implications for assessment, intervention, and further research. There is now good evidence that motivational operations of differing origins influence negatively reinforced problem behavior, and that these might be subject to manipulation to facilitate favorable outcomes. There is also good evidence that some biological variables warrant consideration in assessment procedures as they predispose the person's behavior to be influenced by specific motivational operations. The implications for assessment and intervention are made explicit with reference to variables that are open to manipulation or that require further research and conceptualization within causal models.

Individual differences in automatic emotion regulation affect the asymmetry of the LPP component.

PubMed

Zhang, Jing; Zhou, Renlai

2014-01-01

The main goal of this study was to investigate how automatic emotion regulation altered the hemispheric asymmetry of ERPs elicited by emotion processing. We examined the effect of individual differences in automatic emotion regulation on the late positive potential (LPP) when participants were viewing blocks of positive high arousal, positive low arousal, negative high arousal and negative low arousal pictures from International affect picture system (IAPS). Two participant groups were categorized by the Emotion Regulation-Implicit Association Test which has been used in previous research to identify two groups of participants with automatic emotion control and with automatic emotion express. The main finding was that automatic emotion express group showed a right dominance of the LPP component at posterior electrodes, especially in high arousal conditions. But no right dominance of the LPP component was observed for automatic emotion control group. We also found the group with automatic emotion control showed no differences in the right posterior LPP amplitude between high- and low-arousal emotion conditions, while the participants with automatic emotion express showed larger LPP amplitude in the right posterior in high-arousal conditions compared to low-arousal conditions. This result suggested that AER (Automatic emotion regulation) modulated the hemispheric asymmetry of LPP on posterior electrodes and supported the right hemisphere hypothesis.

A dual process model of perfectionism based on reinforcement theory.

PubMed

Slade, P D; Owens, R G

1998-07-01

This article begins with a brief review of the current literature on the structure and measurement of perfectionism. It is concluded from this review that two major types can be distinguished, a normal/healthy form and a pathological form. These two forms are then defined as positive and negative perfectionism and related directly to Skinnerian concepts of positive and negative reinforcement. The positive/negative distinction is then further elaborated on in terms of approach/avoidance behavior, goal differences, self-concept involvement, emotional correlates, and the promoting environment. Finally, some of the more obvious theoretical and practical implications are briefly explored.

Automatic attention to emotional stimuli: neural correlates.

PubMed

Carretié, Luis; Hinojosa, José A; Martín-Loeches, Manuel; Mercado, Francisco; Tapia, Manuel

2004-08-01

We investigated the capability of emotional and nonemotional visual stimulation to capture automatic attention, an aspect of the interaction between cognitive and emotional processes that has received scant attention from researchers. Event-related potentials were recorded from 37 subjects using a 60-electrode array, and were submitted to temporal and spatial principal component analyses to detect and quantify the main components, and to source localization software (LORETA) to determine their spatial origin. Stimuli capturing automatic attention were of three types: emotionally positive, emotionally negative, and nonemotional pictures. Results suggest that initially (P1: 105 msec after stimulus), automatic attention is captured by negative pictures, and not by positive or nonemotional ones. Later (P2: 180 msec), automatic attention remains captured by negative pictures, but also by positive ones. Finally (N2: 240 msec), attention is captured only by positive and nonemotional stimuli. Anatomically, this sequence is characterized by decreasing activation of the visual association cortex (VAC) and by the growing involvement, from dorsal to ventral areas, of the anterior cingulate cortex (ACC). Analyses suggest that the ACC and not the VAC is responsible for experimental effects described above. Intensity, latency, and location of neural activity related to automatic attention thus depend clearly on the stimulus emotional content and on its associated biological importance. Copyright 2004 Wiley-Liss, Inc.

Reinforcement learning and Tourette syndrome.

PubMed

Palminteri, Stefano; Pessiglione, Mathias

2013-01-01

In this chapter, we report the first experimental explorations of reinforcement learning in Tourette syndrome, realized by our team in the last few years. This report will be preceded by an introduction aimed to provide the reader with the state of the art of the knowledge concerning the neural bases of reinforcement learning at the moment of these studies and the scientific rationale beyond them. In short, reinforcement learning is learning by trial and error to maximize rewards and minimize punishments. This decision-making and learning process implicates the dopaminergic system projecting to the frontal cortex-basal ganglia circuits. A large body of evidence suggests that the dysfunction of the same neural systems is implicated in the pathophysiology of Tourette syndrome. Our results show that Tourette condition, as well as the most common pharmacological treatments (dopamine antagonists), affects reinforcement learning performance in these patients. Specifically, the results suggest a deficit in negative reinforcement learning, possibly underpinned by a functional hyperdopaminergia, which could explain the persistence of tics, despite their evident inadaptive (negative) value. This idea, together with the implications of these results in Tourette therapy and the future perspectives, is discussed in Section 4 of this chapter. © 2013 Elsevier Inc. All rights reserved.

Integrating the automatic and the controlled: Strategies in Semantic Priming in an Attractor Network with Latching Dynamics

PubMed Central

Lerner, Itamar; Bentin, Shlomo; Shriki, Oren

2014-01-01

Semantic priming has long been recognized to reflect, along with automatic semantic mechanisms, the contribution of controlled strategies. However, previous theories of controlled priming were mostly qualitative, lacking common grounds with modern mathematical models of automatic priming based on neural networks. Recently, we have introduced a novel attractor network model of automatic semantic priming with latching dynamics. Here, we extend this work to show how the same model can also account for important findings regarding controlled processes. Assuming the rate of semantic transitions in the network can be adapted using simple reinforcement learning, we show how basic findings attributed to controlled processes in priming can be achieved, including their dependency on stimulus onset asynchrony and relatedness proportion and their unique effect on associative, category-exemplar, mediated and backward prime-target relations. We discuss how our mechanism relates to the classic expectancy theory and how it can be further extended in future developments of the model. PMID:24890261

Rumor spreading in online social networks by considering the bipolar social reinforcement

NASA Astrophysics Data System (ADS)

Ma, Jing; Li, Dandan; Tian, Zihao

2016-04-01

Considering the bipolar social reinforcement which includes positive and negative effects, in this paper we explore the rumor spreading dynamics in online social networks. By means of the generation function and cavity method developed from statistical physics of disordered system, the rumor spreading threshold can be theoretically drawn. Simulation results indicate that decreasing the positive reinforcement factor or increasing the negative reinforcement factor can suppress the rumor spreading effectively. By analyzing the topological properties of the real world social network, we find that the nodes with lower degree usually have smaller weight. However, the nodes with lower degree may have larger k-shell. In order to curb rumor spreading, some control strategies that are based on the nodes' degree, k-shell and weight are presented. By comparison, we show that controlling those nodes that have larger degree or weight are two effective strategies to prevent the rumor spreading.

Examination of a cognitive model of stress, burnout, and intention to resign for Japanese nurses.

PubMed

Ohue, Takashi; Moriyama, Michiko; Nakaya, Takashi

2011-06-01

A reduction in burnout is required to decrease the voluntary turnover of nurses. This study was carried out with the aim of establishing a cognitive model of stress, burnout, and intention to resign for nurses. A questionnaire survey was administered to 336 nurses (27 male and 309 female) who had worked for ≤5 years at a hospital with multiple departments. The survey included an evaluation of burnout (Maslach Burnout Inventory), stress (Nursing Job Stressor Scale), automatic thoughts (Automatic Thoughts Questionnaire-Revised), and irrational beliefs (Japanese Irrational Belief Test), in addition to the intention to resign. The stressors that affected burnout in the nurses included conflict with other nursing staff, nursing role conflict, qualitative workload, quantitative workload, and conflict with patients. The irrational beliefs that were related to burnout included dependence, problem avoidance, and helplessness. In order to examine the automatic thoughts affecting burnout, groups with low and high negative automatic thoughts and low and high positive automatic thoughts were established. A two-way ANOVA showed a significant interaction of these factors with emotional exhaustion, but no significant interaction with depersonalization and a personal sense of accomplishment. Only the major effect was significant. The final model showed a process of "stressor → irrational beliefs → negative automatic thoughts/positive automatic thoughts → burnout". In addition, a relationship between burnout and an intention to resign was shown. These results suggest that stress and burnout in nurses might be prevented and that the number of nurses who leave their position could be decreased by changing irrational beliefs to rational beliefs, decreasing negative automatic thoughts, and facilitating positive automatic thoughts. © 2010 The Authors. Japan Journal of Nursing Science © 2010 Japan Academy of Nursing Science.

[Alexithymia and automatic activation of emotional-evaluative information].

PubMed

Suslow, T; Arolt, V; Junghanns, K

1998-05-01

The emotional valence of stimuli seems to be stored in the associative network and is automatically activated on the mere observation of a stimulus. A principal characteristic of alexithymia represents the difficulty to symbolize emotions verbally. The present study examines the relationship between the dimensions of the alexithymia construct and emotional priming effects in a word-word paradigma. The 20-Item Toronto Alexithymia Scale was administered to 32 subjects along with two word reading tasks as measures of emotional and semantic priming effects. The subscale "difficulty describing feelings" correlated as expected negatively with the negative inhibition effect. The subscale "externally oriented thinking" tended to correlate negatively with the negative facilitation effect. Thus, these dimensions of alexithymia are inversely related to the degree of automatic emotional priming. In summary, there is evidence for an impaired structural integration of emotion and language in persons with difficulties in describing feelings. Poor "symbolization" of emotions in alexithymia is discussed from a cognitive perspective.

Improving Robot Motor Learning with Negatively Valenced Reinforcement Signals

PubMed Central

Navarro-Guerrero, Nicolás; Lowe, Robert J.; Wermter, Stefan

2017-01-01

Both nociception and punishment signals have been used in robotics. However, the potential for using these negatively valenced types of reinforcement learning signals for robot learning has not been exploited in detail yet. Nociceptive signals are primarily used as triggers of preprogrammed action sequences. Punishment signals are typically disembodied, i.e., with no or little relation to the agent-intrinsic limitations, and they are often used to impose behavioral constraints. Here, we provide an alternative approach for nociceptive signals as drivers of learning rather than simple triggers of preprogrammed behavior. Explicitly, we use nociception to expand the state space while we use punishment as a negative reinforcement learning signal. We compare the performance—in terms of task error, the amount of perceived nociception, and length of learned action sequences—of different neural networks imbued with punishment-based reinforcement signals for inverse kinematic learning. We contrast the performance of a version of the neural network that receives nociceptive inputs to that without such a process. Furthermore, we provide evidence that nociception can improve learning—making the algorithm more robust against network initializations—as well as behavioral performance by reducing the task error, perceived nociception, and length of learned action sequences. Moreover, we provide evidence that punishment, at least as typically used within reinforcement learning applications, may be detrimental in all relevant metrics. PMID:28420976

Fast and fragile: A new look at the automaticity of negation processing.

PubMed

Deutsch, Roland; Kordts-Freudinger, Robert; Gawronski, Bertram; Strack, Fritz

2009-01-01

Numerous studies suggest that processing verbal materials containing negations slows down cognition and makes it more error-prone. This suggests that processing negations affords relatively nonautomatic processes. The present research studied the role of two automaticity features (processing speed and resource dependency) for negation processing. In three experiments, we tested the impact of verbal negations on affective priming effects in the Affect Misattribution Paradigm. Going beyond previous work, the results indicate that negations can be processed unintentionally and quickly (Experiments 1 and 2). In Experiment 3, negations failed to qualify affective priming effects when participants' working memory was taxed by memorizing an eight-digit number. In sum, the experiments suggest that negations can be processed unintentionally, very quickly, but that they rely on working-memory resources.

Affective Evaluations of Exercising: The Role of Automatic-Reflective Evaluation Discrepancy.

PubMed

Brand, Ralf; Antoniewicz, Franziska

2016-12-01

Sometimes our automatic evaluations do not correspond well with those we can reflect on and articulate. We present a novel approach to the assessment of automatic and reflective affective evaluations of exercising. Based on the assumptions of the associative-propositional processes in evaluation model, we measured participants' automatic evaluations of exercise and then shared this information with them, asked them to reflect on it and rate eventual discrepancy between their reflective evaluation and the assessment of their automatic evaluation. We found that mismatch between self-reported ideal exercise frequency and actual exercise frequency over the previous 14 weeks could be regressed on the discrepancy between a relatively negative automatic and a more positive reflective evaluation. This study illustrates the potential of a dual-process approach to the measurement of evaluative responses and suggests that mistrusting one's negative spontaneous reaction to exercise and asserting a very positive reflective evaluation instead leads to the adoption of inflated exercise goals.

[Computer games and Internet addiction as well as pathological gambling. Therapy approaches].

PubMed

Wölfling, K; Leménager, T; Peukert, P; Batra, A

2013-05-01

In accordance with the development of substance-related disorders, behavioral addictions, such as internet use disorder and pathological gambling are regarded as repetitive excessive behavior which increasingly turns into an automatic action which is difficult to control intentionally. This automatic behavior is reinforced by learning processes, associated with neuroadaption, especially in the dopaminergic reward system. Treatment aims at finding alternatives for gambling or online activities and reducing times online so that social contacts need to be re-established. The following article provides a short overview on studies assessing the effects of different psychotherapeutic and pharmacological interventions and details psychotherapeutic treatment options.

Development of early age shrinkage stresses in reinforced concrete bridge decks

NASA Astrophysics Data System (ADS)

William, Gergis W.; Shoukry, Samir N.; Riad, Mourad Y.

2008-12-01

This paper describes the instrumentation and data analysis of a reinforced concrete bridge deck constructed on 3-span continuous steel girders in Evansville, West Virginia. An instrumentation system consisting of 232 sensors is developed and implemented specifically to measure strains and temperature in concrete deck, strains in longitudinal and transverse rebars, the overall contraction and expansion of concrete deck, and crack openings. Data from all sensors are automatically collected every 30 minutes starting at the time of placing the concrete deck. Measured strain and temperature time-histories were used to calculate the stresses, which were processed to attenuate the thermal effects due to daily temperature changes and isolate the drying shrinkage component. The results indicated that most of concrete shrinkage occurs during the first three days. Under the constraining effects from stay-in-place forms and reinforcement, early age shrinkage leads to elevated longitudinal stress, which is the main factor responsible for crack initiation.

Differences in the subjective and motivational properties of alcohol across alcohol use severity: application of a novel translational human laboratory paradigm.

PubMed

Bujarski, Spencer; Jentsch, J David; Roche, Daniel J O; Ramchandani, Vijay A; Miotto, Karen; Ray, Lara A

2018-05-08

The Allostatic Model proposes that Alcohol Use Disorder (AUD) is associated with a transition in the motivational structure of alcohol drinking: from positive reinforcement in early-stage drinking to negative reinforcement in late-stage dependence. However, direct empirical support for this preclinical model from human experiments is limited. This study tests predictions derived from the Allostatic Model in humans. Specifically, this study tested whether alcohol use severity (1) independently predicts subjective responses to alcohol (SR; comprised of stimulation/hedonia, negative affect, sedation and craving domains), and alcohol self-administration and 2) moderates associations between domains of SR and alcohol self-administration. Heavy drinking participants ranging in severity of alcohol use and problems (N = 67) completed an intravenous alcohol administration paradigm combining an alcohol challenge (target BrAC = 60 mg%), with progressive ratio self-administration. Alcohol use severity was associated with greater baseline negative affect, sedation, and craving but did not predict changes in any SR domain during the alcohol challenge. Alcohol use severity also predicted greater self-administration. Craving during the alcohol challenge strongly predicted self-administration and sedation predicted lower self-administration. Neither stimulation, nor negative affect predicted self-administration. This study represents a novel approach to translating preclinical neuroscientific theories to the human laboratory. As expected, craving predicted self-administration and sedation was protective. Contrary to the predictions of the Allostatic Model, however, these results were inconsistent with a transition from positively to negatively reinforced alcohol consumption in severe AUD. Future studies that assess negative reinforcement in the context of an acute stressor are warranted.

Microstructural characterization of PAN based carbon fiber reinforced nylon 6 polymer composites

NASA Astrophysics Data System (ADS)

Munirathnamma, L. M.; Ningaraju, S.; Kumar, K. V. Aneesh; Ravikumar, H. B.

2018-04-01

Microstructural characterization of nylon 6/polyacrolonitrile based carbon fibers (PAN-CFs) of 10 to 40 wt% has been performed by positron lifetime technique (PLT). The positron lifetime parameters viz., o-Ps lifetime (τ3), o-Ps intensity (I3) and fractional free volume (Fv) of nylon 6/PAN-CF composites are correlated with the mechanical properties viz., Tensile strength and Young's modulus. The Fv show negative deviation with the reinforcement of 10 to 40 wt% of PAN-CF from the linear additivity relation. The negative deviation in nylon 6/PAN-CF composite suggests the induced molecular packing due to the chemical interaction between the polymeric chains of nylon 6 and PAN-CF. This is evident from Fourier Transform Infrared Spectrometry (FTIR) studies. The FTIR results suggests that observed negative deviation in PALS results of nylon 6/PAN-CF reinforced polymer composites is due to the induced chemical interaction at N-H-O sites. The improved tensile strength (TS) and Young's modulus (YM) in nylon 6/PAN-CF reinforced polymer composites is due to AS4C (surface treated and epoxy coated) PAN-CF has shown highest adhesion level due to better stress transfer between nylon 6 and PAN-CF.

Biases in probabilistic category learning in relation to social anxiety

PubMed Central

Abraham, Anna; Hermann, Christiane

2015-01-01

Instrumental learning paradigms are rarely employed to investigate the mechanisms underlying acquired fear responses in social anxiety. Here, we adapted a probabilistic category learning paradigm to assess information processing biases as a function of the degree of social anxiety traits in a sample of healthy individuals without a diagnosis of social phobia. Participants were presented with three pairs of neutral faces with differing probabilistic accuracy contingencies (A/B: 80/20, C/D: 70/30, E/F: 60/40). Upon making their choice, negative and positive feedback was conveyed using angry and happy faces, respectively. The highly socially anxious group showed a strong tendency to be more accurate at learning the probability contingency associated with the most ambiguous stimulus pair (E/F: 60/40). Moreover, when pairing the most positively reinforced stimulus or the most negatively reinforced stimulus with all the other stimuli in a test phase, the highly socially anxious group avoided the most negatively reinforced stimulus significantly more than the control group. The results are discussed with reference to avoidance learning and hypersensitivity to negative socially evaluative information associated with social anxiety. PMID:26347685

Brief Functional Analysis and Intervention Evaluation for Treatment of Saliva-Play

ERIC Educational Resources Information Center

Luiselli, James K.; Ricciardi, Joseph N.; Schmidt, Sarah; Tarr, Melissa

2004-01-01

We conducted a brief (8 days) functional analysis to identify sources of control over persistent saliva-play displayed by a 6-year old child with autism in a school setting. The functional analysis suggested that saliva-play was maintained by automatic reinforcement, leading to an intervention evaluation (3 days) that compared two methods of…

Recent Research on Aetiology, Development and Phenomenology of Self-Injurious Behaviour in People with Intellectual Disabilities: A Systematic Review and Implications for Treatment

ERIC Educational Resources Information Center

Furniss, F.; Biswas, A. B.

2012-01-01

Background: Behavioural interventions conceptualise self-injurious behaviour (SIB) as developing from early repetitive behaviours through acquisition of homeostatic functions in regulating stimulation and subsequent shaping into SIB through socially mediated or automatic operant reinforcement. Despite high success rates, such interventions rarely…

Evaluation of an Enhanced Stimulus-Stimulus Pairing Procedure to Increase Early Vocalizations of Children with Autism

ERIC Educational Resources Information Center

Esch, Barbara E.; Carr, James E.; Grow, Laura L.

2009-01-01

Evidence to support stimulus-stimulus pairing (SSP) in speech acquisition is less than robust, calling into question the ability of SSP to reliably establish automatically reinforcing properties of speech and limiting the procedure's clinical utility for increasing vocalizations. We evaluated the effects of a modified SSP procedure on…

Self-Injurious Behavior in Rett Syndrome: Interactions between Features of Rett Syndrome and Operant Conditioning.

ERIC Educational Resources Information Center

Oliver, Chris; And Others

1993-01-01

In this case study, interactions were examined between features of Rett syndrome and operant conditioning as determinants of self-injurious behavior (SIB). Analysis suggested different functions for two forms of SIB: automatic reinforcement by sensory stimulation and escape from social interactions. Features of Rett syndrome tended to maximize the…

Use of Short Podcasts to Reinforce Learning Outcomes in Biology

ERIC Educational Resources Information Center

Aguiar, Cristina; Carvalho, Ana Amelia; Carvalho, Carla Joana

2009-01-01

Podcasts are audio or video files which can be automatically downloaded to one's computer when the episodes become available, then later transferred to a portable player for listening. The technology thereby enables the user to listen to and/or watch the content anywhere at any time. Formerly popular as radio shows, podcasting was rapidly explored…

The Evaluation and Treatment of Aggression Maintained by Attention and Automatic Reinforcement.

ERIC Educational Resources Information Center

Thompson, Rachel H.; Fisher, Wayne W.; Piazza, Cathleen C.; Kuhn, David E.

1998-01-01

A study used direct and indirect methods to assess and treat several topographies of the aggression of a 7-year-old boy with severe mental retardation and pervasive personality disorder. Functional communication training with extinction reduced all forms of aggression except chin grinding, which was reduced by an alternative treatment. (Author/CR)

Longitudinal investigation on learned helplessness tested under negative and positive reinforcement involving stimulus control.

PubMed

Oliveira, Emileane C; Hunziker, Maria Helena

2014-07-01

In this study, we investigated whether (a) animals demonstrating the learned helplessness effect during an escape contingency also show learning deficits under positive reinforcement contingencies involving stimulus control and (b) the exposure to positive reinforcement contingencies eliminates the learned helplessness effect under an escape contingency. Rats were initially exposed to controllable (C), uncontrollable (U) or no (N) shocks. After 24h, they were exposed to 60 escapable shocks delivered in a shuttlebox. In the following phase, we selected from each group the four subjects that presented the most typical group pattern: no escape learning (learned helplessness effect) in Group U and escape learning in Groups C and N. All subjects were then exposed to two phases, the (1) positive reinforcement for lever pressing under a multiple FR/Extinction schedule and (2) a re-test under negative reinforcement (escape). A fourth group (n=4) was exposed only to the positive reinforcement sessions. All subjects showed discrimination learning under multiple schedule. In the escape re-test, the learned helplessness effect was maintained for three of the animals in Group U. These results suggest that the learned helplessness effect did not extend to discriminative behavior that is positively reinforced and that the learned helplessness effect did not revert for most subjects after exposure to positive reinforcement. We discuss some theoretical implications as related to learned helplessness as an effect restricted to aversive contingencies and to the absence of reversion after positive reinforcement. This article is part of a Special Issue entitled: insert SI title. Copyright © 2014. Published by Elsevier B.V.

From Memory to Attitude: The Neurocognitive Process beyond Euthanasia Acceptance.

PubMed

Enke, Martin; Meyer, Patric; Flor, Herta

2016-01-01

Numerous questionnaire studies on attitudes towards euthanasia produced conflicting results, precluding any general conclusion. This might be due to the fact that human behavior can be influenced by automatically triggered attitudes, which represent ingrained associations in memory and cannot be assessed by standard questionnaires, but require indirect measures such as reaction times (RT) or electroencephalographic recording (EEG). Event related potentials (ERPs) of the EEG and RT during an affective priming task were assessed to investigate the impact of automatically triggered attitudes and were compared to results of an explicit questionnaire. Explicit attitudes were ambivalent. Reaction time data showed neither positive nor negative associations towards euthanasia. ERP analyses revealed an N400 priming effect with lower mean amplitudes when euthanasia was associated with negative words. The euthanasia-related modulation of the N400 component shows an integration of the euthanasia object in negatively valenced associative neural networks. The integration of all measures suggests a bottom-up process of attitude activation, where automatically triggered negative euthanasia-relevant associations can become more ambiguous with increasing time in order to regulate the bias arising from automatic processes. These data suggest that implicit measures may make an important contribution to the understanding of euthanasia-related attitudes.

From Memory to Attitude: The Neurocognitive Process beyond Euthanasia Acceptance

PubMed Central

Enke, Martin; Meyer, Patric; Flor, Herta

2016-01-01

Numerous questionnaire studies on attitudes towards euthanasia produced conflicting results, precluding any general conclusion. This might be due to the fact that human behavior can be influenced by automatically triggered attitudes, which represent ingrained associations in memory and cannot be assessed by standard questionnaires, but require indirect measures such as reaction times (RT) or electroencephalographic recording (EEG). Event related potentials (ERPs) of the EEG and RT during an affective priming task were assessed to investigate the impact of automatically triggered attitudes and were compared to results of an explicit questionnaire. Explicit attitudes were ambivalent. Reaction time data showed neither positive nor negative associations towards euthanasia. ERP analyses revealed an N400 priming effect with lower mean amplitudes when euthanasia was associated with negative words. The euthanasia-related modulation of the N400 component shows an integration of the euthanasia object in negatively valenced associative neural networks. The integration of all measures suggests a bottom-up process of attitude activation, where automatically triggered negative euthanasia-relevant associations can become more ambiguous with increasing time in order to regulate the bias arising from automatic processes. These data suggest that implicit measures may make an important contribution to the understanding of euthanasia-related attitudes. PMID:27088244

Functional relationships among monitoring performance: Subjective report of thought process and compromising states of awareness

NASA Technical Reports Server (NTRS)

Freeman, Frederick

1995-01-01

A biocybernetic system for use in adaptive automation was evaluated using EEG indices based on the beta, alpha, and theta bandwidths. Subjects performed a compensatory tracking task while their EEG was recorded and one of three engagement indices was derived: beta/(alpha + theta), beta/alpha, or 1/alpha. The task was switched between manual and automatic modes as a function of the subjects' level of engagement and whether they were under a positive or negative feedback condition. It was hypothesized that negative feedback would produce more switches between manual and automatic modes, and that the beta/(alpha + theta) index would produce the strongest effect. The results confirmed these hypotheses. There were no systematic changes in these effects over three 16-minute trials. Tracking performance was found to be better under negative feedback. An analysis of the different EEG bands under positive and negative feedback in manual and automatic modes found more beta power in the positive feedback/manual condition and less in the positive feedback/automatic condition. The opposite effect was observed for alpha and theta power. The implications of biocybernetic systems for adaptive automation are discussed.

Automatic and deliberate affective associations with sexual stimuli in women with lifelong vaginismus before and after therapist-aided exposure treatment.

PubMed

Melles, Reinhilde J; ter Kuile, Moniek M; Dewitte, Marieke; van Lankveld, Jacques J D M; Brauer, Marieke; de Jong, Peter J

2014-03-01

The intense fear response to vaginal penetration in women with lifelong vaginismus, who have never been able to experience coitus, may reflect negative automatic and deliberate appraisals of vaginal penetration stimuli which might be modified by exposure treatment. The aim of this study is to examine whether (i) sexual stimuli elicit relatively strong automatic and deliberate threat associations in women with vaginismus, as well as relatively negative automatic and deliberate global affective associations, compared with symptom-free women; and (ii) these automatic and more deliberate attitudes can be modified by therapist-aided exposure treatment. A single target Implicit Association Test (st-IAT) was used to index automatic threat associations, and an Affective Simon Task (AST) to index global automatic affective associations. Participants were women with lifelong vaginismus (N = 68) and women without sexual problems (N = 70). The vaginismus group was randomly allocated to treatment (n = 34) and a waiting list control condition (n = 34). Indices of automatic threat were obtained by the st-IAT and automatic global affective associations by the AST, visual analogue scales (VAS) were used to assess deliberate appraisals of the sexual pictures (fear and global positive affect). More deliberate fear and less global positive affective associations with sexual stimuli were found in women with vaginismus. Following therapist-aided exposure treatment, the strength of fear was strongly reduced, whereas global positive affective associations were strengthened. Automatic associations did not differ between women with and without vaginismus and did not change following treatment. Relatively stronger negative (threat or global affect) associations with sexual stimuli in vaginismus appeared restricted to the deliberate level. Therapist-aided exposure treatment was effective in reducing subjective fear of sexual penetration stimuli and led to more global positive affective associations with sexual stimuli. The impact of exposure might be further improved by strengthening the association between vaginal penetration and positive affect (e.g., by using counter-conditioning techniques). © 2013 International Society for Sexual Medicine.

Reduction of aggression evoked by sounds using noncontingent reinforcement and time-out.

PubMed

Dupuis, Danielle L; Lerman, Dorothea C; Tsami, Loukia; Shireman, Molly L

2015-09-01

Some individuals with developmental disabilities engage in problem behavior to escape or avoid auditory stimuli. In this study, a 6-year-old boy with autism engaged in severe aggression in the presence of specific sounds. Following an assessment based on the procedures described by McCord, Iwata, Galensky, Ellingson, and Thomson (2001), we treated negatively reinforced behavior using noncontingent reinforcement and time-out from positive reinforcement in the absence of extinction. Treatment was effective in reducing aggression across multiple sounds. © Society for the Experimental Analysis of Behavior.

Re-Examining the Overjustification Effect

ERIC Educational Resources Information Center

Akin-Little, K. Angeleque; Little, Steven G.

2004-01-01

The purpose of the present investigation was to extend the research related to the possible negative side effects of extrinsic reinforcement on children's compliant behavior, particularly the overjustification effect. Specifically, this study examined the effects of a token reinforcement procedure in a naturalistic environment (third grade…

To fly or not to fly? The automatic influence of negation on language-space associations.

PubMed

Dudschig, Carolin; de la Vega, Irmgard; Kaup, Barbara

2015-09-01

Embodied models of language understanding propose a close association between language comprehension and sensorimotor processes. Specifically, they suggest that meaning representation is grounded in modal experiences. Converging evidence suggests that words automatically activate spatial processing. For example, words such as 'sky' ('ground') facilitate motor and visual processing associated with upper (lower) space. However, very little is known regarding the influence of linguistic operators such as negation on these language-space associations. If these associations play a crucial role for language understanding beyond the word level, one would expect linguistic operators to automatically influence or modify these language-space associations. Participants read sentences describing an event implying an upward or a downward motion in an affirmative or negated version (e.g. The granny looks to the sky/ground vs. The granny does not look to the sky/ground). Subsequently, participants responded with an upward or downward arm movement according to the colour of a dot on the screen. The results showed that the motion direction implied in the sentences influenced subsequent spatially directed motor responses. For affirmative sentences, arm movements were faster if they matched the movement direction implied in the sentence. This language-space association was modified by the negation operator. Our results show that linguistic operators--such as negation--automatically modify language-space associations. Thus, language-space associations seem to reflect language processes beyond pure word-based activations.

Predictors of Change Following Cognitive-Behavioral Treatment of Children with Anxiety Problems: A Preliminary Investigation on Negative Automatic Thoughts and Anxiety Control

ERIC Educational Resources Information Center

Muris, Peter; Mayer, Birgit; den Adel, Madelon; Roos, Tamara; van Wamelen, Julie

2009-01-01

The purpose of the present study was to evaluate negative automatic thoughts and anxiety control as predictors of change produced by cognitive-behavioral treatment of youths with anxiety disorders. Forty-five high-anxious children aged between 9 and 12 years who were selected from the primary school population, received a standardized CBT…

The behavioral economics of substance use disorders: reinforcement pathologies and their repair.

PubMed

Bickel, Warren K; Johnson, Matthew W; Koffarnus, Mikhail N; MacKillop, James; Murphy, James G

2014-01-01

The field of behavioral economics has made important inroads into the understanding of substance use disorders through the concept of reinforcer pathology. Reinforcer pathology refers to the joint effects of (a) the persistently high valuation of a reinforcer, broadly defined to include tangible commodities and experiences, and/or (b) the excessive preference for the immediate acquisition or consumption of a commodity despite long-term negative outcomes. From this perspective, reinforcer pathology results from the recursive interactions of endogenous person-level variables and exogenous environment-level factors. The current review describes the basic principles of behavioral economics that are central to reinforcer pathology, the processes that engender reinforcer pathology, and the approaches and procedures that can repair reinforcement pathologies. The overall goal of this review is to present a new understanding of substance use disorders as viewed by recent advances in behavioral economics.

The Behavioral Economics of Substance Use Disorders: reinforcement pathologies and their repair

PubMed Central

Bickel, Warren K.; Johnson, Matthew W.; Koffarnus, Mikhail N.; MacKillop, James; Murphy, James G.

2015-01-01

The field of behavioral economics has made important inroads into the understanding of substance use disorders through the concept of reinforcer pathology. Reinforcer pathology refers to the joint effects of (a) the persistently high valuation of a reinforcer, broadly defined to include tangible commodities and experiences, and/or (b) the excessive preference for the immediate acquisition or consumption of a commodity despite long-term negative outcomes. From this perspective, reinforcer pathology results from the recursive interactions of endogenous person-level variables and exogenous environment-level factors. The current review describes the basic principles of behavioral economics that are central to reinforcer pathology, the processes that engender reinforcer pathology, and the approaches and procedures that can repair reinforcement pathologies. The overall goal of this review is to present a new understanding of substance use disorders as viewed by recent advances in behavioral economics. PMID:24679180

Resurgence of instrumental behavior after an abstinence contingency

PubMed Central

Bouton, Mark E.; Schepers, Scott T.

2014-01-01

In resurgence, an extinguished instrumental behavior (R1) recovers when a behavior that replaced it (R2) is also extinguished. The phenomenon may be relevant to understanding relapse that can occur after the termination of “contingency management” treatments, in which unwanted behavior (e.g., substance abuse) is reduced by reinforcing alternative behavior. When reinforcement is discontinued, the unwanted behavior might resurge. However, unlike most resurgence experiments, contingency management treatments also introduce a negative contingency in which reinforcers are not delivered unless the client has abstained from the unwanted behavior. Two experiments with rats therefore examined the effects of adding a negative “abstinence” contingency to the resurgence design. During response elimination, R2 was not reinforced unless R1 had not been emitted for a minimum period of time (45, 90, or 135 s). In both experiments, adding such a contingency to simple R1 extinction reduced, but did not eliminate, resurgence. Experiment 2 found the same effect in a yoked group that could earn reinforcers for R2 at the same points in time, but without the requirement to abstain from R1. Thus, the negative contingency per se did not contribute. Results suggest that the contingency reduced resurgence by making reinforcers more difficult to earn and more widely spaced in time. This could have allowed the animal to learn that R1 was extinguished in the “context” of infrequent reinforcement—a context more like that of resurgence testing. The results are thus consistent with a contextual (renewal) account of resurgence. The method might provide a better model of relapse after termination of a contingency management treatment. PMID:24366673

The effects of instructions on the sensitivity of negatively reinforced human behavior to extinction.

PubMed

Alessandri, Jérôme; Cançado, Carlos R X

2017-03-01

The effects of instructions on the sensitivity of negatively reinforced (escape) behavior to extinction were studied. Initially, responding produced timeouts from pressing a force cell on a variable-ratio (VR) schedule, which was then discontinued (extinction). Based on extinction data, participants were distributed into two groups. Participants in the Persistence Group (for which response rates were low in extinction) were instructed that the experimenter expected them to continue responding in extinction after a second exposure to the VR schedule. Participants in the Extinction group (for which response rates were high in extinction) were instructed that the experimenter expected them to stop responding in extinction. Relative to the condition in which instructions were absent, extinction-response rates increased and decreased, respectively, for participants in the Persistence and Extinction groups. These results replicate and extend to negatively reinforced responding previous findings that showed behavioral control by instructions formulated as explicit experimenter demands or expectations. Copyright © 2017 Elsevier B.V. All rights reserved.

Functional Analysis and Treatment of Rumination Using Fixed-Time Delivery of a Flavor Spray

ERIC Educational Resources Information Center

Wilder, David A.; Register, Martisa; Register, Stanley; Bajagic, Vedrana; Neidert, Pamela L.

2009-01-01

A functional analysis suggested that rumination exhibited by an adult with autism was maintained by automatic reinforcement. Next, a preference assessment with three flavor sprays (i.e., flavored sprays used by dieters) showed that apple pie spray was most preferred. Finally, the effects of fixed-time delivery of the apple pie spray on levels of…

Using Stimulus Equivalence-Based Instruction to Teach Graduate Students in Applied Behavior Analysis to Interpret Operant Functions of Behavior

ERIC Educational Resources Information Center

Albright, Leif; Schnell, Lauren; Reeve, Kenneth F.; Sidener, Tina M.

2016-01-01

Stimulus equivalence-based instruction (EBI) was used to teach four, 4-member classes representing functions of behavior to ten graduate students. The classes represented behavior maintained by attention (Class 1), escape (Class 2), access to tangibles (Class 3), and automatic reinforcement (Class 4). Stimuli within each class consisted of a…

Further examination of factors that influence preference for positive versus negative reinforcement.

PubMed

Kodak, Tiffany; Lerman, Dorothea C; Volkert, Valerie M; Trosclair, Nicole

2007-01-01

Factors that influence choice between qualitatively different reinforcers (e.g., a food item or a break from work) are important to consider when arranging treatments for problem behavior. Previous findings indicate that children who engage in problem behavior maintained by escape from demands may choose a food item over the functional reinforcer during treatment (DeLeon, Neidert, Anders, & Rodriguez-Catter, 2001; Lalli et al., 1999). However, a number of variables may influence choice between concurrently available forms of reinforcement. An analogue for treatment situations in which positive reinforcement for compliance is in direct competition with negative reinforcement for problem behavior was used in the current study to evaluate several variables that may influence choice. Participants were 5 children who had been diagnosed with developmental disabilities and who engaged in problem behavior maintained by escape from demands. In the first phase, the effects of task preference and schedule of reinforcement on choice between a 30-s break and a high-preference food item were evaluated. The food item was preferred over the break, regardless of the preference level of the task or the reinforcement schedule, for all but 1 participant. In the second phase, the quality of the break was manipulated by combining escape with toys, attention, or both. Only 1 participant showed preference for the enriched break. In the third phase, choice of a medium- or low-preference food item versus the enriched break was evaluated. Three of 4 participants showed preference for the break over the less preferred food item. Results extend previous research by identifying some of the conditions under which individuals who engage in escape-maintained behavior will prefer a food reinforcer over the functional one.

Further Examination of Factors that Influence Preference for Positive Versus Negative Reinforcement

PubMed Central

Kodak, Tiffany; Lerman, Dorothea C; Volkert, Valerie M; Trosclair, Nicole

2007-01-01

Factors that influence choice between qualitatively different reinforcers (e.g., a food item or a break from work) are important to consider when arranging treatments for problem behavior. Previous findings indicate that children who engage in problem behavior maintained by escape from demands may choose a food item over the functional reinforcer during treatment (DeLeon, Neidert, Anders, & Rodriguez-Catter, 2001; Lalli et al., 1999). However, a number of variables may influence choice between concurrently available forms of reinforcement. An analogue for treatment situations in which positive reinforcement for compliance is in direct competition with negative reinforcement for problem behavior was used in the current study to evaluate several variables that may influence choice. Participants were 5 children who had been diagnosed with developmental disabilities and who engaged in problem behavior maintained by escape from demands. In the first phase, the effects of task preference and schedule of reinforcement on choice between a 30-s break and a high-preference food item were evaluated. The food item was preferred over the break, regardless of the preference level of the task or the reinforcement schedule, for all but 1 participant. In the second phase, the quality of the break was manipulated by combining escape with toys, attention, or both. Only 1 participant showed preference for the enriched break. In the third phase, choice of a medium- or low-preference food item versus the enriched break was evaluated. Three of 4 participants showed preference for the break over the less preferred food item. Results extend previous research by identifying some of the conditions under which individuals who engage in escape-maintained behavior will prefer a food reinforcer over the functional one. PMID:17471792

An electrophysiological investigation of reinforcement effects in attention deficit/hyperactivity disorder: Dissociating cue sensitivity from down-stream effects on target engagement and performance.

PubMed

Chronaki, Georgia; Soltesz, Fruzsina; Benikos, Nicholas; Sonuga-Barke, Edmund J S

2017-12-01

Neural hypo-sensitivity to cues predicting positive reinforcement has been observed in ADHD using the Monetary Incentive Delay (MID) task. Here we report the first study using an electrophysiological analogue of this task to distinguish between (i) cue related anticipation of reinforcement and downstream effects on (ii) target engagement and (iii) performance in a clinical sample of adolescents with ADHD and controls. Thirty-one controls and 32 adolescents with ADHD aged 10-16 years performed the electrophysiological (e)-MID task - in which preparatory cues signal whether a response to an upcoming target will be reinforced or not - under three conditions; positive reinforcement, negative reinforcement (response cost) and no consequence (neutral). We extracted values for both cue-related potentials known to be, both, associated with response preparation and modulated by reinforcement (Cue P3 and Cue CNV) and target-related potentials (target P3) and compared these between ADHD and controls. ADHD and controls did not differ on cue-related components on neutral trials. Against expectation, adolescents with ADHD displayed Cue P3 and Cue CNV reinforcement-related enhancement (versus neutral trials) compared to controls. ADHD individuals displayed smaller target P3 amplitudes and slower and more variable performance - but effects were not modulated by reinforcement contingencies. When age, IQ and conduct problems were controlled effects were marginally significant but the pattern of results did not change. ADHD was associated with hypersensitivity to positive (and marginally negative) reinforcement reflected on components often thought to be associated with response preparation - however these did not translate into improved attention to targets. In the case of ADHD, upregulated CNV may be a specific marker of hyper-arousal rather than an enhancement of anticipatory attention to upcoming targets. Future studies should examine the effects of age, IQ and conduct problems on reinforcement sensitivity in ADHD. Copyright © 2017 The Authors. Published by Elsevier Ltd.. All rights reserved.

Failure to produce response variability with reinforcement

PubMed Central

Schwartz, Barry

1982-01-01

Two experiments attempted to train pigeons to produce variable response sequences. In the first, naive pigeons were exposed to a procedure requiring four pecks on each of two keys in any order, with a reinforcer delivered only if a given sequence was different from the preceding one. In the second experiment, the same pigeons were exposed to this procedure after having been trained successfully to alternate between two specific response sequences. In neither case did any pigeon produce more than a few different sequences or obtain more than 50% of the possible reinforcers. Stereotyped sequences developed even though stereotypy was not reinforced. It is suggested that reinforcers have both hedonic and informative properties and that the hedonic properties are responsible for sterotyped repetition of reinforced responses, even when stereotypy is negatively related to reinforcer delivery. PMID:16812263

An Electrophysiological Investigation of Emotional Abnormalities in Groups at Risk for Schizophrenia-Spectrum Personality Disorders

PubMed Central

Martin, Elizabeth A.; Karcher, Nicole R.; Bartholow, Bruce D.; Siegle, Greg J.; Kerns, John G.

2017-01-01

Both extreme levels of social anhedonia (SocAnh) and perceptual aberration/magical ideation (PerMag) are associated with risk for schizophrenia-spectrum disorders and with emotional abnormalities. Yet, the nature of any psychophysiological-measured affective abnormality, including the role of automatic/controlled processes, is unclear. We examined the late positive potential (LPP) during passive viewing (to assess automatic processing) and during cognitive reappraisal (to assess controlled processing) in three groups: SocAnh, PerMag, and controls. The SocAnh group exhibited an increased LPP when viewing negative images. Further, SocAnh exhibited greater reductions in the LPP for negative images when told to use strategies to alter negative emotion. Similar to SocAnh, PerMag exhibited an increased LPP when viewing negative images. However, PerMag also exhibited an increased LPP when viewing positive images as well as an atypical decreased LPP when increasing positive emotion. Overall, these results suggest that at-risk groups are associated with shared and unique automatic and controlled abnormalities. PMID:28174121

The role of GABAB receptors in human reinforcement learning.

PubMed

Ort, Andres; Kometer, Michael; Rohde, Judith; Seifritz, Erich; Vollenweider, Franz X

2014-10-01

Behavioral evidence from human studies suggests that the γ-aminobutyric acid type B receptor (GABAB receptor) agonist baclofen modulates reinforcement learning and reduces craving in patients with addiction spectrum disorders. However, in contrast to the well established role of dopamine in reinforcement learning, the mechanisms by which the GABAB receptor influences reinforcement learning in humans remain completely unknown. To further elucidate this issue, a cross-over, double-blind, placebo-controlled study was performed in healthy human subjects (N=15) to test the effects of baclofen (20 and 50mg p.o.) on probabilistic reinforcement learning. Outcomes were the feedback-induced P2 component of the event-related potential, the feedback-related negativity, and the P300 component of the event-related potential. Baclofen produced a reduction of P2 amplitude over the course of the experiment, but did not modulate the feedback-related negativity. Furthermore, there was a trend towards increased learning after baclofen administration relative to placebo over the course of the experiment. The present results extend previous theories of reinforcement learning, which focus on the importance of mesolimbic dopamine signaling, and indicate that stimulation of cortical GABAB receptors in a fronto-parietal network leads to better attentional allocation in reinforcement learning. This observation is a first step in our understanding of how baclofen may improve reinforcement learning in healthy subjects. Further studies with bigger sample sizes are needed to corroborate this conclusion and furthermore, test this effect in patients with addiction spectrum disorder. Copyright © 2014 Elsevier B.V. and ECNP. All rights reserved.

Histidine-decarboxylase knockout mice show deficient nonreinforced episodic object memory, improved negatively reinforced water-maze performance, and increased neo- and ventro-striatal dopamine turnover.

PubMed

Dere, Ekrem; De Souza-Silva, Maria A; Topic, Bianca; Spieler, Richard E; Haas, Helmut L; Huston, Joseph P

2003-01-01

The brain's histaminergic system has been implicated in hippocampal synaptic plasticity, learning, and memory, as well as brain reward and reinforcement. Our past pharmacological and lesion studies indicated that the brain's histamine system exerts inhibitory effects on the brain's reinforcement respective reward system reciprocal to mesolimbic dopamine systems, thereby modulating learning and memory performance. Given the close functional relationship between brain reinforcement and memory processes, the total disruption of brain histamine synthesis via genetic disruption of its synthesizing enzyme, histidine decarboxylase (HDC), in the mouse might have differential effects on learning dependent on the task-inherent reinforcement contingencies. Here, we investigated the effects of an HDC gene disruption in the mouse in a nonreinforced object exploration task and a negatively reinforced water-maze task as well as on neo- and ventro-striatal dopamine systems known to be involved in brain reward and reinforcement. Histidine decarboxylase knockout (HDC-KO) mice had higher dihydrophenylacetic acid concentrations and a higher dihydrophenylacetic acid/dopamine ratio in the neostriatum. In the ventral striatum, dihydrophenylacetic acid/dopamine and 3-methoxytyramine/dopamine ratios were higher in HDC-KO mice. Furthermore, the HDC-KO mice showed improved water-maze performance during both hidden and cued platform tasks, but deficient object discrimination based on temporal relationships. Our data imply that disruption of brain histamine synthesis can have both memory promoting and suppressive effects via distinct and independent mechanisms and further indicate that these opposed effects are related to the task-inherent reinforcement contingencies.

76 FR 81421 - Eligible Obligations, Charitable Contributions, Nonmember Deposits, Fixed Assets, Investments...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-12-28

... will have no negative impact on these FCUs. The proposed rule also removes the automatic exemption from... proposed change. RegFlex FCUs currently operating under the automatic exemption criteria for a RegFlex... not meet the standards for automatic qualification will now, like current non-RegFlex FCUs, have...

A Randomized Trial of Adjunct mHealth Abstinence Reinforcement With Transdermal Nicotine and Counseling for Smoking Cessation.

PubMed

Alessi, Sheila M; Rash, Carla J; Petry, Nancy M

2017-03-01

Abstinence reinforcement is efficacious for improving smoking treatment outcomes, but practical constraints related to the need for multiple in-person carbon monoxide (CO) breath tests daily to verify smoking abstinence have limited its use. This study tested an mHealth procedure to remotely monitor and reinforce smoking abstinence in individuals' natural environment. Eligible treatment-seeking smokers (N = 90) were randomized to (1) usual care and ecological monitoring with abstinence reinforcement (mHealth reinforcement) or (2) without reinforcement (mHealth monitoring). Usual care was 8 weeks of transdermal nicotine and twice-weekly telephone counseling. Following training, an interactive voice response system prompted participants to conduct CO tests 1-3 daily at pseudorandom times (7 am to 10 pm) for 4 weeks. When prompted, participants used a study cell phone and CO monitor to complete a CO self-test, video record the process, and submit videos using multimedia messaging. mHealth reinforcement participants could earn prizes for smoking-negative on-time CO tests. The interactive voice response generated preliminary earnings immediately. Earnings were finalized by comparing video records against participants' self-reports. mHealth reinforcement was associated with a greater proportion of smoking-negative CO tests, longest duration of prolonged abstinence, and point-prevalence abstinence during the monitoring/reinforcement phase compared to mHealth monitoring (p < .01, d = 0.8-1.3). Follow-up (weeks 4-24) analyses indicated main effects of reinforcement on point-prevalence abstinence and proportion of days smoked (p ≤ .05); values were comparable by week 24. mHealth reinforcement has short-term efficacy. Research on methods to enhance and sustain benefits is needed. This study suggests that mHealth abstinence reinforcement is efficacious and may present temporal and spatial opportunities to research, engage, and support smokers trying to quit that do not exist with conventional (not technology-based) reinforcement interventions. © The Author 2016. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

General functioning predicts reward and punishment learning in schizophrenia.

PubMed

Somlai, Zsuzsanna; Moustafa, Ahmed A; Kéri, Szabolcs; Myers, Catherine E; Gluck, Mark A

2011-04-01

Previous studies investigating feedback-driven reinforcement learning in patients with schizophrenia have provided mixed results. In this study, we explored the clinical predictors of reward and punishment learning using a probabilistic classification learning task. Patients with schizophrenia (n=40) performed similarly to healthy controls (n=30) on the classification learning task. However, more severe negative and general symptoms were associated with lower reward-learning performance, whereas poorer general psychosocial functioning was correlated with both lower reward- and punishment-learning performances. Multiple linear regression analyses indicated that general psychosocial functioning was the only significant predictor of reinforcement learning performance when education, antipsychotic dose, and positive, negative and general symptoms were included in the analysis. These results suggest a close relationship between reinforcement learning and general psychosocial functioning in schizophrenia. Published by Elsevier B.V.

Achievement Goal Orientations and Self Handicapping as Mediator and Moderator of the Relationship between Intrinsic Achievement Motivation and Negative Automatic Thoughts in Adolescence Students

ERIC Educational Resources Information Center

Kapikiran, Sahin

2012-01-01

The main purpose of this study was to examine the mediator and moderator role of self-handicapping and achievement goal orientations variables on the relationship between negative automatic thoughts intrinsic achievement motivation in high school students. 586 high school students, ranging in age from 14 to 20 (M = 16.08), adolescence students…

Analyzing the multiple functions of stereotypical behavior for students with autism: implications for assessment and treatment.

PubMed

Kennedy, C H; Meyer, K A; Knowles, T; Shukla, S

2000-01-01

We studied behavioral functions associated with stereotypical responses for students with autism. In Study 1, analogue functional analyses (attention, demand, no-attention, and recreation conditions) were conducted for 5 students. Results suggested that stereotypy was multiply determined or occurred across all assessment conditions. For 2 students, stereotypy was associated with positive and negative reinforcement and the absence of environmental stimulation. For 2 other students, stereotypy occurred at high levels across all experimental conditions. For the 5th student, stereotypy was associated with negative reinforcement and the absence of environmental stimulation. In Study 2, the stereotypy of 1 student was further analyzed on a function-by-function basis. Within a concurrent-schedules procedure, alternative responses were taught to the student using functional communication training. The results of Study 2 showed that similar topographies of stereotypy, based on qualitatively different reinforcers, were reduced only when differential reinforcement contingencies for alternative forms of communication were implemented for specific response-reinforcer relations. Our results suggest that the causes of stereotypy for students with autism are complex and that the presumed association between response topography and behavioral function may be less important than previously realized.

Analyzing the multiple functions of stereotypical behavior for students with autism: implications for assessment and treatment.

PubMed Central

Kennedy, C H; Meyer, K A; Knowles, T; Shukla, S

2000-01-01

We studied behavioral functions associated with stereotypical responses for students with autism. In Study 1, analogue functional analyses (attention, demand, no-attention, and recreation conditions) were conducted for 5 students. Results suggested that stereotypy was multiply determined or occurred across all assessment conditions. For 2 students, stereotypy was associated with positive and negative reinforcement and the absence of environmental stimulation. For 2 other students, stereotypy occurred at high levels across all experimental conditions. For the 5th student, stereotypy was associated with negative reinforcement and the absence of environmental stimulation. In Study 2, the stereotypy of 1 student was further analyzed on a function-by-function basis. Within a concurrent-schedules procedure, alternative responses were taught to the student using functional communication training. The results of Study 2 showed that similar topographies of stereotypy, based on qualitatively different reinforcers, were reduced only when differential reinforcement contingencies for alternative forms of communication were implemented for specific response-reinforcer relations. Our results suggest that the causes of stereotypy for students with autism are complex and that the presumed association between response topography and behavioral function may be less important than previously realized. PMID:11214031

Automatically produced FRP beams with embedded FOS in complex geometry: process, material compatibility, micromechanical analysis, and performance tests

NASA Astrophysics Data System (ADS)

Gabler, Markus; Tkachenko, Viktoriya; Küppers, Simon; Kuka, Georg G.; Habel, Wolfgang R.; Milwich, Markus; Knippers, Jan

2012-04-01

The main goal of the presented work was to evolve a multifunctional beam composed out of fiber reinforced plastics (FRP) and an embedded optical fiber with various fiber Bragg grating sensors (FBG). These beams are developed for the use as structural member for bridges or industrial applications. It is now possible to realize large scale cross sections, the embedding is part of a fully automated process and jumpers can be omitted in order to not negatively influence the laminate. The development includes the smart placement and layout of the optical fibers in the cross section, reliable strain transfer, and finally the coupling of the embedded fibers after production. Micromechanical tests and analysis were carried out to evaluate the performance of the sensor. The work was funded by the German ministry of economics and technology (funding scheme ZIM). Next to the authors of this contribution, Melanie Book with Röchling Engineering Plastics KG (Haren/Germany; Katharina Frey with SAERTEX GmbH & Co. KG (Saerbeck/Germany) were part of the research group.

Model-Based Reasoning in Humans Becomes Automatic with Training.

PubMed

Economides, Marcos; Kurth-Nelson, Zeb; Lübbert, Annika; Guitart-Masip, Marc; Dolan, Raymond J

2015-09-01

Model-based and model-free reinforcement learning (RL) have been suggested as algorithmic realizations of goal-directed and habitual action strategies. Model-based RL is more flexible than model-free but requires sophisticated calculations using a learnt model of the world. This has led model-based RL to be identified with slow, deliberative processing, and model-free RL with fast, automatic processing. In support of this distinction, it has recently been shown that model-based reasoning is impaired by placing subjects under cognitive load--a hallmark of non-automaticity. Here, using the same task, we show that cognitive load does not impair model-based reasoning if subjects receive prior training on the task. This finding is replicated across two studies and a variety of analysis methods. Thus, task familiarity permits use of model-based reasoning in parallel with other cognitive demands. The ability to deploy model-based reasoning in an automatic, parallelizable fashion has widespread theoretical implications, particularly for the learning and execution of complex behaviors. It also suggests a range of important failure modes in psychiatric disorders.

An applied test of the social learning theory of deviance to college alcohol use.

PubMed

DeMartino, Cynthia H; Rice, Ronald E; Saltz, Robert

2015-04-01

Several hypotheses about influences on college drinking derived from the social learning theory of deviance were tested and confirmed. The effect of ethnicity on alcohol use was completely mediated by differential association and differential reinforcement, whereas the effect of biological sex on alcohol use was partially mediated. Higher net positive reinforcements to costs for alcohol use predicted increased general use, more underage use, and more frequent binge drinking. Two unexpected finding were the negative relationship between negative expectations and negative experiences, and the substantive difference between nondrinkers and general drinkers compared with illegal or binge drinkers. The discussion considers implications for future campaigns based on Akers's deterrence theory.

Non-suicidal self-injury in patients with eating disorder: associations with identity formation above and beyond anxiety and depression.

PubMed

Claes, Laurence; Luyckx, Koen; Bijttebier, Patricia; Turner, Brianna; Ghandi, Amarendra; Smets, Jos; Norre, Jan; Van Assche, Leen; Verheyen, Els; Goris, Yvienne; Hoksbergen, Ingrid; Schoevaerts, Katrien

2015-03-01

In the present study, we investigated the association between non-suicidal self-injury (NSSI) and problems in identity formation among patients with eating disorder (ED). NSSI is highly prevalent in ED, and problems with identity formation are characteristic of both NSSI and ED. Few studies, however, have investigated identity formation in patients with ED with and without NSSI while taking into account comorbid psychopathology (e.g. anxiety and depression). Therefore, we investigated the relationships between NSSI characteristics, identity confusion/synthesis, and anxiety/depression in 99 female patients with ED by means of self-report questionnaires. The results showed that 58.6% of the patients with ED engaged in at least one type of NSSI (most frequently cutting), with no significant differences in rates of NSSI or identity problems among ED subtypes. Presence, versatility and automatic negative reinforcement functions of NSSI were each significantly and positively related to identity confusion and negatively related to identity synthesis. Even after controlling for age, anxiety, and depression, lack of identity synthesis remained a significant predictor of NSSI in patients with ED. Given that NSSI may constitute an effort to deal with identity confusion/synthesis in patients with ED, therapists should take this developmental task into account while treating patients with ED with NSSI. Copyright © 2014 John Wiley & Sons, Ltd and Eating Disorders Association.

Addiction as a Stress Surfeit Disorder

PubMed Central

Koob, George F.; Buck, Cara L.; Cohen, Ami; Edwards, Scott; Park, Paula E.; Schlosburg, Joel E.; Schmeichel, Brooke; Vendruscolo, Leandro F.; Wade, Carrie L.; Whitfield, Timothy W.; George, Olivier

2013-01-01

Drug addiction has been conceptualized as a chronically relapsing disorder of compulsive drug seeking and taking that progresses through three stages: binge/intoxication, withdrawal/negative affect, and preoccupation/anticipation. Drug addiction impacts multiple motivational mechanisms and can be conceptualized as a disorder that progresses from positive reinforcement (binge/intoxication stage) to negative reinforcement (withdrawal/negative affect stage). The construct of negative reinforcement is defined as drug taking that alleviates a negative emotional state. Our hypothesis is that the negative emotional state that drives such negative reinforcement is derived from dysregulation of key neurochemical elements involved in the brain stress systems within the frontal cortex, ventral striatum, and extended amygdala. Specific neurochemical elements in these structures include not only recruitment of the classic stress axis mediated by corticotropin-releasing factor (CRF) in the extended amygdala as previously hypothesized but also recruitment of dynorphin-κ opioid aversive systems in the ventral striatum and extended amygdala. Additionally, we hypothesized that these brain stress systems may be engaged in the frontal cortex early in the addiction process. Excessive drug taking engages activation of CRF not only in the extended amygdala, accompanied by anxiety-like states, but also in the medial prefrontal cortex, accompanied by deficits in executive function that may facilitate the transition to compulsive-like responding. Excessive activation of the nucleus accumbens via the release of mesocorticolimbic dopamine or activation of opioid receptors has long been hypothesized to subsequently activate the dynorphin-κ opioid system, which in turn can decrease dopaminergic activity in the mesocorticolimbic dopamine system. Blockade of the κ opioid system can also block anxiety-like and reward deficits associated with withdrawal from drugs of abuse and block the development of compulsive-like responding during extended access to drugs of abuse, suggesting another powerful brain stress/anti-reward system that contributes to compulsive drug seeking. Thus, brain stress response systems are hypothesized to be activated by acute excessive drug intake, to be sensitized during repeated withdrawal, to persist into protracted abstinence, and to contribute to the development and persistence of addiction. The recruitment of anti-reward systems provides a powerful neurochemical basis for the negative emotional states that are responsible for the dark side of addiction. PMID:23747571

ESCAPE AS REINFORCEMENT AND ESCAPE EXTINCTION IN THE TREATMENT OF FEEDING PROBLEMS

PubMed Central

LaRue, Robert H; Stewart, Victoria; Piazza, Cathleen C; Volkert, Valerie M; Patel, Meeta R; Zeleny, Jason

2011-01-01

Given the effectiveness of putative escape extinction as treatment for feeding problems, it is surprising that little is known about the effects of escape as reinforcement for appropriate eating during treatment. In the current investigation, we examined the effectiveness of escape as reinforcement for mouth clean (a product measure of swallowing), escape as reinforcement for mouth clean plus escape extinction (EE), and EE alone as treatment for the food refusal of 5 children. Results were similar to those of previous studies, in that reinforcement alone did not result in increases in mouth clean or decreases in inappropriate behavior (e.g., Piazza, Patel, Gulotta, Sevin, & Layer, 2003). Increases in mouth clean and decreases in inappropriate behavior occurred when the therapist implemented EE independent of the presence or absence of reinforcement. Results are discussed in terms of the role of negative reinforcement in the etiology and treatment of feeding problems. PMID:22219525

An evaluation of two differential reinforcement procedures with escape extinction to treat food refusal.

PubMed

Patel, Meeta R; Piazza, Cathleen C; Martinez, Cheryl J; Volkert, Valerie M; Christine, M Santana

2002-01-01

Consumption of solids and liquids occurs as a chain of behaviors that may include accepting, swallowing, and retaining the food or drink. In the current investigation, we evaluated the relative effectiveness of differential reinforcement of the first behavior in the chain (acceptance) versus differential reinforcement for the terminal behavior in the chain (mouth clean). Three children who had been diagnosed with a feeding disorder participated. Acceptance remained at zero when differential reinforcement contingencies were implemented for acceptance or mouth clean. Acceptance and mouth clean increased for all 3 participants once escape extinction was added to the differential reinforcement procedures, independent of whether reinforcement was provided for acceptance or for mouth clean. Maintenance was observed in 2 children when escape extinction was removed from the treatment package. The mechanism by which consumption increased is discussed in relation to positive and negative reinforcement contingencies.

Testing a model of depression among Thai adolescents.

PubMed

Vatanasin, Duangjai; Thapinta, Darawan; Thompson, Elaine Adams; Thungjaroenkul, Petsunee

2012-11-01

This predictive correlational study was designed to test a comprehensive model of depression for Thai adolescents. This sample included 800 high school students in Chiang Mai, Thailand. Data were collected using self-reported measures of depression, negative automatic thoughts, effective social problem solving, ineffective social problem solving, rumination, parental care, parental overprotection, and negative life events. Structural equation modeling revealed that negative automatic thoughts, effective and ineffective social problem solving mediated the effects of rumination, negative life events, and parental care and overprotection on adolescent depression. These findings provide new knowledge about identified factors and the mechanisms of their influence on depression among Thai adolescents, which are appropriate for targeting preventive interventions. © 2012 Wiley Periodicals, Inc.

Personality Correlates of the Reinforcement Propensities of Leaders.

ERIC Educational Resources Information Center

Hinton, Bernard L.; Barrow, Jeffrey C.

A study was done to investigate the relationship between a selected set of personality dimensions and the propensities of supervisors to use varying levels of both positive and negative reinforcements. Data were collected during exercises involving 129 male undergraduate business students carried out in a behavioral laboratory wherein a…

Incorporating Nondrug Social & Recreational Activities in Outpatient Chemical Dependency Treatment

ERIC Educational Resources Information Center

Siporin, Sheldon; Baron, Lisa

2012-01-01

"Contingency Management programs (CMP) and non-drug social and recreational activities (NDSRA) are interventions premised on behavior theory that rely on external sources of reinforcement alternative to drug-based forms to decrease drug use. CMP usually employs vouchers as reinforcement for negative toxicologies. Despite research support, CMP…

An Evaluation of Generalization of Mands during Functional Communication Training

ERIC Educational Resources Information Center

Falcomata, Terry S.; Wacker, David P.; Ringdahl, Joel E.; Vinquist, Kelly; Dutt, Anuradha

2013-01-01

The primary purpose of this study was to evaluate the generalization of mands during functional communication training (FCT) and sign language training across functional contexts (i.e., positive reinforcement, negative reinforcement). A secondary purpose was to evaluate a training procedure based on stimulus control to teach manual signs. During…

In-Service Training of Teachers as Behavior Modifiers: Review and Analysis.

ERIC Educational Resources Information Center

Eachus, Herbert Todd

The basic principles of operant and classical conditioning are presented, and their applications for the in-service training of teachers are discussed. Certain classroom behaviors are analyzed and applied to the classic stimulus-response paradigm. Activities are generically classified as positive or negative reinforcers and these reinforcers, in…

Through the Looking Glass: Symmetry in Behavioral Principles?

ERIC Educational Resources Information Center

Marr, M. Jackson

2006-01-01

In this article, the author discusses and presents seven possibilities that describe how symmetry principles are reflected in behavior analysis. First, if there are apparently no functional distinctions to be made between positive and negative reinforcement, then reinforcer effectiveness (by various measures) is invariant under a simple inversion…

Comments on Michael (1993): Establishing Operations

ERIC Educational Resources Information Center

Moore, J.

2013-01-01

The present comments concern Michael's concept of motivative variables, and the implications of that concept for our understanding of the nature of reinforcement as well as the extinction of responses maintained through positive and negative reinforcement. We note that both extinction and altering motivative variables decrease responding, but…

Treatment of Escape-Maintained Challenging Behavior Using Chained Schedules: An Evaluation of the Effects of Thinning Positive plus Negative Reinforcement During Functional Communication Training.

PubMed

Zangrillo, Amanda N; Fisher, Wayne W; Greer, Brian D; Owen, Todd M; DeSouza, Andresa A

2016-01-01

Previous research has supported functional communication training (FCT) as an effective intervention for reducing challenging behavior. Clinicians often program schedule-thinning procedures to increase the portability of the treatment (i.e., reinforcement is provided less frequently). For individuals with escape-maintained problem behavior, chained schedules have proven effective in increasing task completion and supplemental procedures may ameliorate reemergence of challenging behavior as access to reinforcement is decreased. The present study compared the use of a chained schedule-thinning procedure with and without alternative reinforcement (e.g., toys and activities) embedded in an intervention in which escape from the task is provided contingent on a request for a break. Two individuals with escape-maintained challenging behavior participated. We compared two treatment conditions, escape-only and escape-to-tangibles, using a single-subject, alternating treatments design with each treatment implemented in a distinct academic context. With the escape-to-tangibles treatment, we reached the final schedule in both contexts with both participants (4 successes out of 4 applications). We did not reach the final schedule with either participant with the escape-only intervention (0 successes out of 2 applications). The current results provided preliminary confirmation that providing positive plus negative reinforcement would decrease destructive behavior, increase compliance, and facilitate reinforcer-schedule thinning.

Treatment of Escape-Maintained Challenging Behavior Using Chained Schedules: An Evaluation of the Effects of Thinning Positive plus Negative Reinforcement During Functional Communication Training

PubMed Central

Zangrillo, Amanda N.; Fisher, Wayne W.; Greer, Brian D.; Owen, Todd M.; DeSouza, Andresa A.

2016-01-01

Objective Previous research has supported functional communication training (FCT) as an effective intervention for reducing challenging behavior. Clinicians often program schedule-thinning procedures to increase the portability of the treatment (i.e., reinforcement is provided less frequently). For individuals with escape-maintained problem behavior, chained schedules have proven effective in increasing task completion and supplemental procedures may ameliorate reemergence of challenging behavior as access to reinforcement is decreased. The present study compared the use of a chained schedule-thinning procedure with and without alternative reinforcement (e.g., toys and activities) embedded in an intervention in which escape from the task is provided contingent on a request for a break. Method Two individuals with escape-maintained challenging behavior participated. We compared two treatment conditions, escape-only and escape-to-tangibles, using a single-subject, alternating treatments design with each treatment implemented in a distinct academic context. Results With the escape-to-tangibles treatment, we reached the final schedule in both contexts with both participants (4 successes out of 4 applications). We did not reach the final schedule with either participant with the escape-only intervention (0 successes out of 2 applications). Conclusion The current results provided preliminary confirmation that providing positive plus negative reinforcement would decrease destructive behavior, increase compliance, and facilitate reinforcer-schedule thinning. PMID:28626579

The Automatic Conservative: Ideology-Based Attentional Asymmetries in the Processing of Valenced Information

PubMed Central

Carraro, Luciana; Castelli, Luigi; Macchiella, Claudia

2011-01-01

Research has widely explored the differences between conservatives and liberals, and it has been also recently demonstrated that conservatives display different reactions toward valenced stimuli. However, previous studies have not yet fully illuminated the cognitive underpinnings of these differences. In the current work, we argued that political ideology is related to selective attention processes, so that negative stimuli are more likely to automatically grab the attention of conservatives as compared to liberals. In Experiment 1, we demonstrated that negative (vs. positive) information impaired the performance of conservatives, more than liberals, in an Emotional Stroop Task. This finding was confirmed in Experiment 2 and in Experiment 3 employing a Dot-Probe Task, demonstrating that threatening stimuli were more likely to attract the attention of conservatives. Overall, results support the conclusion that people embracing conservative views of the world display an automatic selective attention for negative stimuli. PMID:22096486

Trial-Based Functional Analysis Informs Treatment for Vocal Scripting.

PubMed

Rispoli, Mandy; Brodhead, Matthew; Wolfe, Katie; Gregori, Emily

2018-05-01

Research on trial-based functional analysis has primarily focused on socially maintained challenging behaviors. However, procedural modifications may be necessary to clarify ambiguous assessment results. The purposes of this study were to evaluate the utility of iterative modifications to trial-based functional analysis on the identification of putative reinforcement and subsequent treatment for vocal scripting. For all participants, modifications to the trial-based functional analysis identified a primary function of automatic reinforcement. The structure of the trial-based format led to identification of social attention as an abolishing operation for vocal scripting. A noncontingent attention treatment was evaluated using withdrawal designs for each participant. This noncontingent attention treatment resulted in near zero levels of vocal scripting for all participants. Implications for research and practice are presented.

Framework for robot skill learning using reinforcement learning

NASA Astrophysics Data System (ADS)

Wei, Yingzi; Zhao, Mingyang

2003-09-01

Robot acquiring skill is a process similar to human skill learning. Reinforcement learning (RL) is an on-line actor critic method for a robot to develop its skill. The reinforcement function has become the critical component for its effect of evaluating the action and guiding the learning process. We present an augmented reward function that provides a new way for RL controller to incorporate prior knowledge and experience into the RL controller. Also, the difference form of augmented reward function is considered carefully. The additional reward beyond conventional reward will provide more heuristic information for RL. In this paper, we present a strategy for the task of complex skill learning. Automatic robot shaping policy is to dissolve the complex skill into a hierarchical learning process. The new form of value function is introduced to attain smooth motion switching swiftly. We present a formal, but practical, framework for robot skill learning and also illustrate with an example the utility of method for learning skilled robot control on line.

Automatic recognition of light source from color negative films using sorting classification techniques

NASA Astrophysics Data System (ADS)

Sanger, Demas S.; Haneishi, Hideaki; Miyake, Yoichi

1995-08-01

This paper proposed a simple and automatic method for recognizing the light sources from various color negative film brands by means of digital image processing. First, we stretched the image obtained from a negative based on the standardized scaling factors, then extracted the dominant color component among red, green, and blue components of the stretched image. The dominant color component became the discriminator for the recognition. The experimental results verified that any one of the three techniques could recognize the light source from negatives of any film brands and all brands greater than 93.2 and 96.6% correct recognitions, respectively. This method is significant for the automation of color quality control in color reproduction from color negative film in mass processing and printing machine.

Differences in the relationship between traumatic experiences, self-esteem, negative cognition, and Internet addiction symptoms among North Korean adolescent defectors and South Korean adolescents: A preliminary study.

PubMed

Park, Subin; Lee, Yeeun; Jun, Jin Yong

2017-11-01

North Korean adolescent defectors experience adaptation difficulties along with a wide range of psychosocial problems, but no study has yet examined their Internet addiction symptoms. We compared early traumatic experiences, self-esteem, negative cognition, and Internet addiction symptoms, as well as the relationships between these variables, between North Korean adolescent defectors and South Korean adolescents. Fifty-six North Korean adolescent defectors and 112 age- and sex- matched South Korean adolescents participated. The analyses examined the relationship between traumatic experiences and Internet addiction symptoms, with negative automatic thoughts or low self-esteem as mediators of these relations. North Korean adolescent defectors tended to have higher levels of negative automatic thoughts and more severe Internet addiction symptoms, as well as better self-esteem, than did South Korean adolescents. Furthermore, only among North Korean adolescent defectors, traumatic experiences were positively associated with Internet addition symptoms via increasing negative automatic thoughts. North Korean adolescent defectors are more susceptible to Internet addiction, negative cognitions, and early traumatic experiences compared to South Korean adolescents. However, the cross-sectional design of this study precludes consideration of the causality of these relationships. Interventions aiming to correct negative cognitions and increase self-esteem may be helpful for North Korean adolescent defectors with problematic Internet use. Copyright © 2017 Elsevier B.V. All rights reserved.

Freeze or Flee? Negative Stimuli Elicit Selective Responding

ERIC Educational Resources Information Center

Estes, Zachary; Verges, Michelle

2008-01-01

Humans preferentially attend to negative stimuli. A consequence of this automatic vigilance for negative valence is that negative words elicit slower responses than neutral or positive words on a host of cognitive tasks. Some researchers have speculated that negative stimuli elicit a general suppression of motor activity, akin to the freezing…

On the Automaticity of Emotion Processing in Words and Faces: Event-Related Brain Potentials Evidence from a Superficial Task

ERIC Educational Resources Information Center

Rellecke, Julian; Palazova, Marina; Sommer, Werner; Schacht, Annekathrin

2011-01-01

The degree to which emotional aspects of stimuli are processed automatically is controversial. Here, we assessed the automatic elicitation of emotion-related brain potentials (ERPs) to positive, negative, and neutral words and facial expressions in an easy and superficial face-word discrimination task, for which the emotional valence was…

Low implicit self-esteem and dysfunctional automatic associations in social anxiety disorder.

PubMed

Glashouwer, Klaske A; Vroling, Maartje S; de Jong, Peter J; Lange, Wolf-Gero; de Keijser, Jos

2013-06-01

Negative automatic associations towards the self and social cues are assumed to play an important role in social anxiety disorder. We tested whether social anxiety disorder patients (n = 45) showed stronger dysfunctional automatic associations than non-clinical controls (n = 45) and panic disorder patients (n = 24) and whether there existed gender differences in this respect. We used a single-target Implicit Association Test and an Implicit Association Test to measure dysfunctional automatic associations with social cues and implicit self-esteem, respectively. Results showed that automatic associations with social cues were more dysfunctional in socially anxious patients than in both control groups, suggesting this might be a specific characteristic of social anxiety disorder. Socially anxious patients showed relatively low implicit self-esteem compared to non-clinical controls, whereas panic disorder patients scored in between both groups. Unexpectedly, we found that lower implicit self-esteem was related to higher severity of social anxiety symptoms in men, whereas no such relationship was found in women. These findings support the view that automatic negative associations with social cues and lowered implicit self-esteem may both help to enhance our understanding of the cognitive processes that underlie social anxiety disorder. Copyright © 2012 Elsevier Ltd. All rights reserved.

Negative symptoms in schizophrenia result from a failure to represent the expected value of rewards: Behavioral and computational modeling evidence

PubMed Central

Gold, James M.; Waltz, James A.; Matveeva, Tatyana M.; Kasanova, Zuzana; Strauss, Gregory P.; Herbener, Ellen S.; Collins, Anne G.E.; Frank, Michael J.

2015-01-01

Context Negative symptoms are a core feature of schizophrenia, but their pathophysiology remains unclear. Objective Negative symptoms are defined by the absence of normal function. However, there must be a productive mechanism that leads to this absence. Here, we test a reinforcement learning account suggesting that negative symptoms result from a failure to represent the expected value of rewards coupled with preserved loss avoidance learning. Design Subjects performed a probabilistic reinforcement learning paradigm involving stimulus pairs in which choices resulted in either reward or avoidance of loss. Following training, subjects indicated their valuation of the stimuli in a transfer task. Computational modeling was used to distinguish between alternative accounts of the data. Setting A tertiary care research outpatient clinic. Patients A total of 47 clinically stable patients with a diagnosis of schizophrenia or schizoaffective disorder and 28 healthy volunteers participated. Patients were divided into high and low negative symptom groups. Main Outcome measures 1) The number of choices leading to reward or loss avoidance and 2) performance in the transfer phase. Quantitative fits from three different models were examined. Results High negative symptom patients demonstrated impaired learning from rewards but intact loss avoidance learning, and failed to distinguish rewarding stimuli from loss-avoiding stimuli in the transfer phase. Model fits revealed that high negative symptom patients were better characterized by an “actor-critic” model, learning stimulus-response associations, whereas controls and low negative symptom patients incorporated expected value of their actions (“Q-learning”) into the selection process. Conclusions Negative symptoms are associated with a specific reinforcement learning abnormality: High negative symptoms patients do not represent the expected value of rewards when making decisions but learn to avoid punishments through the use of prediction errors. This computational framework offers the potential to understand negative symptoms at a mechanistic level. PMID:22310503

Comparative Analysis of the Reinforcement of Polymers with 2D-Nanofillers: Organoclay and Boron Nitride

NASA Astrophysics Data System (ADS)

Kozlov, G. V.; Kuvshinova, S. A.; Dolbin, I. V.; Koifman, O. I.

2018-03-01

Using the percolation reinforcement model, it has been shown that the main factor governing the degree of reinforcement of polymer/2D-nanofiller composites is the ability of a nanofiller to generate interfacial regions. This parameter is interrelated with two fundamental structural characteristics of a nanocomposite, i.e., the fractal dimension of its structure and the content of polymer matrix/nanofiller interfacial surfaces. The negative effect of high nanofiller anisotropy on the elasticity modulus of a nanocomposite is demonstrated.

An Investigation of Ways to Reduce the Failure Rate of Student Pilots during Flying Training in the Royal Australian Air Force.

DTIC Science & Technology

1987-09-01

Luthans (28) expanded the concept of learning as follows: 1. Learning involves a change, though not necessarily an improvement, in behaviour. Learning...that results in an unpleasant outcome is not likely to be repeated (36:244). Luthans and Kreitner (27) described the various forms of reinforcement as...four 33 alternatives (defined previously on page 24 and taken from Luthans ) of positive reinforcement, negative reinforcement, extinction and punishment

Balanced states of mind in psychopathology and psychological well-being.

PubMed

Wong, Shyh Shin

2010-08-01

The balanced states of mind (BSOM) model proposes that coping with stress and psychological well-being is a function of the BSOM ratio of positive thoughts to the sum of positive and negative thoughts. Based on different BSOM ratios, different BSOM categories are constructed to quantitatively differentiate levels of coping with stress and psychological well-being. The cognitive content-specificity hypothesis states that there are unique themes of semantic content in self-reported automatic thoughts particular to depression or anxiety. This study investigated the BSOM model and its cognitive content-specificity for depression, anxiety, anger, stress, life satisfaction, and happiness, based on negative and positive automatic thoughts. Three hundred and ninety-eight college students from Singapore participated in this study. First, BSOM ratio and positive automatic thoughts were positively correlated with life satisfaction and happiness, and negatively correlated with stress, anxiety, depression, and anger. In contrast, negative automatic thoughts were positively correlated with stress, anxiety, depression, and anger, and negatively correlated with life satisfaction and happiness. Second, levels of psychopathology and psychological well-being were statistically differentiable among the BSOM categories for depression, happiness, perceived stress, and life satisfaction; and less statistically differentiable among the BSOM categories for anxiety and anger, as expected based on the BSOM model and cognitive content-specificity hypothesis. Third, the results were more supportive of the BSOM model for depression, followed by happiness, perceived stress, life satisfaction, anxiety, and anger in terms of percentage of variance accounted for by BSOM categories, as expected based on the cognitive content-specificity hypothesis. Taken together, the results suggested that the more moderately positive thoughts one has (balanced by negative thoughts), the better mental health outcomes one has. Implications and limitations of these findings are discussed.

Revisiting the Role of Bad News in Maintaining Human Observing Behavior

PubMed Central

Fantino, Edmund; Silberberg, Alan

2010-01-01

Results from studies of observing responses have suggested that stimuli maintain observing owing to their special relationship to primary reinforcement (the conditioned-reinforcement hypothesis), and not because they predict the availability and nonavailability of reinforcement (the information hypothesis). The present article first reviews a study that challenges that conclusion and then reports a series of five brief experiments that provide further support for the conditioned-reinforcement view. In Experiments 1 through 3, participants preferred occasional good news (a stimulus correlated with reinforcement) or no news (a stimulus uncorrelated with reinforcement) to occasional bad news (a stimulus negatively correlated with reinforcement). In Experiment 4 bad news was preferred to no news when the absence of stimulus change following a response to the bad-news option was reliably associated with good news. When this association was weakened in Experiment 5 the results were intermediate. The results support the conclusion that information is reinforcing only when it is positive or useful. As required by the conditioned-reinforcement hypothesis, useless information does not maintain observing. PMID:20885808

An electrophysiological investigation of emotional abnormalities in groups at risk for schizophrenia-spectrum personality disorders.

PubMed

Martin, Elizabeth A; Karcher, Nicole R; Bartholow, Bruce D; Siegle, Greg J; Kerns, John G

2017-03-01

Both extreme levels of social anhedonia (SocAnh) and perceptual aberration/magical ideation (PerMag) are associated with risk for schizophrenia-spectrum disorders and with emotional abnormalities. Yet, the nature of any psychophysiological-measured affective abnormality, including the role of automatic/controlled processes, is unclear. We examined the late positive potential (LPP) during passive viewing (to assess automatic processing) and during cognitive reappraisal (to assess controlled processing) in three groups: SocAnh, PerMag, and controls. The SocAnh group exhibited an increased LPP when viewing negative images. Further, SocAnh exhibited greater reductions in the LPP for negative images when told to use strategies to alter negative emotion. Similar to SocAnh, PerMag exhibited an increased LPP when viewing negative images. However, PerMag also exhibited an increased LPP when viewing positive images as well as an atypical decreased LPP when increasing positive emotion. Overall, these results suggest that at-risk groups are associated with shared and unique automatic and controlled abnormalities. Copyright © 2017 Elsevier B.V. All rights reserved.

Reinforcing effects of non-pathogenic bacteria and predation risk: from physiology to life history.

PubMed

Janssens, Lizanne; Stoks, Robby

2014-10-01

The important ecological role of predation risk in shaping populations, communities and ecosystems is becoming increasingly clear. In this context, synergistic effects between predation risk and other natural stressors on prey organisms are gaining attention. Although non-pathogenic bacteria can be widespread in aquatic ecosystems, their role in mediating effects of predation risk has been ignored. We here address the hypothesis that non-pathogenic bacteria may reinforce the negative effects of predation risk in larvae of the damselfly Coenagrion puella. We found synergistic effects for all three life history variables studied: mortality increased, growth reductions were magnified and bacterial load was higher when both non-lethal stressors were combined. The combined exposure to the bacterium and predation risk considerably impaired the two key antipredator mechanisms of the damselfly larvae: they no longer reduced their food intake under predation risk and showed a synergistic reduction in escape swimming speed. The reinforcing negative effects on the fitness-related traits could be explained by the observed synergistic effects on food intake, swimming muscle mass, immune function and oxidative damage. These are likely widespread consequences of energetic constraints and increased metabolic rates associated with the fight-or-flight response. We therefore hypothesize that the here documented synergistic interactions with non-pathogenic bacteria may be widespread. Our results highlight the ignored ecological role of non-pathogenic bacteria in reinforcing the negative effects of predation risk on prey organisms.

Avoidance-based human Pavlovian-to-instrumental transfer

PubMed Central

Lewis, Andrea H.; Niznikiewicz, Michael A.; Delamater, Andrew R.; Delgado, Mauricio R.

2013-01-01

The Pavlovian-to-instrumental transfer (PIT) paradigm probes the influence of Pavlovian cues over instrumentally learned behavior. The paradigm has been used extensively to probe basic cognitive and motivational processes in studies of animal learning but, more recently, PIT and its underlying neural basis have been extended to investigations in humans. These initial neuroimaging studies of PIT have focused on the influence of appetitively conditioned stimuli on instrumental responses maintained by positive reinforcement, and highlight the involvement of the striatum. In the current study, we sought to understand the neural correlates of PIT in an aversive Pavlovian learning situation when instrumental responding was maintained through negative reinforcement. Participants exhibited specific PIT, wherein selective increases in instrumental responding to conditioned stimuli occurred when the stimulus signaled a specific aversive outcome whose omission negatively reinforced the instrumental response. Additionally, a general PIT effect was observed such that when a stimulus was associated with a different aversive outcome than was used to negatively reinforce instrumental behavior, the presence of that stimulus caused a non-selective increase in overall instrumental responding. Both specific and general PIT behavioral effects correlated with increased activation in corticostriatal circuitry, particularly in the striatum, a region involved in cognitive and motivational processes. These results suggest that avoidance-based PIT utilizes a similar neural mechanism to that seen with PIT in an appetitive context, which has implications for understanding mechanisms of drug-seeking behavior during addiction and relapse. PMID:24118624

Depot naltrexone in lieu of incarceration: a behavioral analysis of coerced treatment for addicted offenders.

PubMed

Marlowe, Douglas B

2006-09-01

This article is part of a series of articles examining a proposal to offer depot naltrexone to certain nonviolent opiate-addicted criminal offenders in exchange for release from incarceration or diversion from prosecution. This "negative-reinforcement" behavioral paradigm could have a better chance of success than what has heretofore been attempted with drug-abusing offenders. Traditional correctional efforts have been largely unsuccessful due to the complexities of implementation and the side effects of punishment. Although positive reinforcement can be more efficacious, it has often been strenuously resisted on the ground that it is inequitable to reward antisocial individuals for doing what is minimally expected of most citizens. Negative reinforcement steers between these hurdles by avoiding the iatrogenic effects of punishment, while also being palatable to stakeholders. More research is needed to identify the effects, costs, and side effects of negative-reinforcement arrangements for drug offenders. The current proposal provides an excellent platform for conducting this research because the target intervention (depot naltrexone) is demonstrably efficacious, nonpsychoactive, and has few, if any, side effects. Therefore, use of this medication would be unlikely to invoke the same types of legal and ethical objections that have traditionally been levied against the use of psychoactive medications with vulnerable populations of institutionalized offenders. Specific recommendations are offered for questions that must be addressed in future research studies.

Life Span Differences in Electrophysiological Correlates of Monitoring Gains and Losses during Probabilistic Reinforcement Learning

ERIC Educational Resources Information Center

Hammerer, Dorothea; Li, Shu-Chen; Muller, Viktor; Lindenberger, Ulman

2011-01-01

By recording the feedback-related negativity (FRN) in response to gains and losses, we investigated the contribution of outcome monitoring mechanisms to age-associated differences in probabilistic reinforcement learning. Specifically, we assessed the difference of the monitoring reactions to gains and losses to investigate the monitoring of…

Concurrent Schedules of Positive and Negative Reinforcement: Differential-Impact and Differential-Outcomes Hypotheses

ERIC Educational Resources Information Center

Magoon, Michael A.; Critchfield, Thomas S.

2008-01-01

Considerable evidence from outside of operant psychology suggests that aversive events exert greater influence over behavior than equal-sized positive-reinforcement events. Operant theory is largely moot on this point, and most operant research is uninformative because of a scaling problem that prevents aversive events and those based on positive…

The Negative Effects of Positive Reinforcement in Teaching Children with Developmental Delay.

ERIC Educational Resources Information Center

Biederman, Gerald B.; And Others

1994-01-01

This study compared the performance of 12 children (ages 4 to 10) with developmental delay, each trained in 2 tasks, one through interactive modeling (with or without verbal reinforcement) and the other through passive modeling. Results showed that passive modeling produced better rated performance than interactive modeling and that verbal…

A Response to "The Negative Effects of Positive Reinforcement in Teaching Children with Developmental Delays."

ERIC Educational Resources Information Center

Ward, Phillip C.

1995-01-01

This article responds to a study by Gerald Biederman and others, which concluded that verbal reinforcement in combination with interactive modeling strategies may produce confusion in children with language/learning difficulties. The article contends that a functional relationship cannot be claimed for the study's variables because measurement…

Development and Modification of a Response Class via Positive and Negative Reinforcement: A Translational Approach

ERIC Educational Resources Information Center

Mendres, Amber E.; Borrero, John C.

2010-01-01

When responses function to produce the same reinforcer, a response class exists. Researchers have examined response classes in applied settings; however, the challenges associated with conducting applied research on response class development have recently necessitated the development of an analogue response class model. To date, little research…

Short- and Long-Term Effects of Unpredictable Repeated Negative Stimuli on Japanese Quail's Fear of Humans

PubMed Central

Laurence, Agathe; Lumineau, Sophie; Calandreau, Ludovic; Arnould, Cécile; Leterrier, Christine; Boissy, Alain; Houdelier, Cécilia

2014-01-01

Numerous aversive events occur in poultry production, and if repeated and unpredictable, can result in an impaired welfare. Some events such as handling can be perceived negatively and it is of interest to understand how humans' behaviour could affect poultry's behaviours and especially its avoidance of humans. Our aim was to evaluate short- and long-lasting effects of a 3-week procedure involving unpredictable repeated negative stimuli (URNS) applied during the post-juvenile period on quail's reactivity to humans. We compared the reactions of two sets of quail: URNS was applied to one set (treated quail) and the other set was left undisturbed (control quail). When two weeks old, treated quail were exposed to a variety of negative stimuli, either applied automatically or involving human presence. One and seven weeks after the termination of the procedure, the reactivity of control and treated quail to a passive human being was evaluated. Furthermore, the experimenter with her hand on a trough containing a mealworm assessed the propensity of quail of both groups to habituate to feed close to a human being. In the presence of a seated observer, treated quail were more inhibited and more alert than control quail. Likewise, seven weeks after the end of the URNS procedure, more treated than control quail adopted a fear posture. Moreover, whereas control quail spent as much time in the different areas of their cages, treated quail spent more time in the rear part of their cages. Finally, whereas control quail habituated gradually to feed near the experimenter's hand, treated quail did not. All these tests evidence negative short- and long-term effects on treated quail's reactivity to a passive human being and on their habituation to a human being when her presence is positively reinforced. This highlights the importance of young poultry's experience with humans in production. PMID:24668017

Training Strategies for the M1 Abrams Tank Driver Trainer

DTIC Science & Technology

1984-10-01

positive reinforcement. The automatic freeze after incorrect performance, for example, may even be aversive to the trainee. The TECEP learning algorithms ...Aagard, J.A. and Braby, R. Learning Guidelines and Algorithms for Types of Training Objectives. (TAEG Report No. 23). Orlando, FL: Training Analysis and...checklist ite. flake it identical to operational setting. () Cresponde to the g;uideli ne number Tor thiss oast. Figure B-I. Learning Algorithm for

Effort-Based Reinforcement Processing and Functional Connectivity Underlying Amotivation in Medicated Patients with Depression and Schizophrenia.

PubMed

Park, Il Ho; Lee, Boung Chul; Kim, Jae-Jin; Kim, Joong Il; Koo, Min-Seung

2017-04-19

Amotivation is a common phenotype of major depressive disorder and schizophrenia, which are clinically distinct disorders. Effective treatment targets and strategies can be discovered by examining the dopaminergic reward network function underlying amotivation between these disorders. We conducted an fMRI study in healthy human participants and medicated patients with depression and schizophrenia using an effort-based reinforcement task. We examined regional activations related to reward type (positive and negative reinforcement), effort level, and their composite value, as well as resting-state functional connectivities within the meso-striatal-prefrontal pathway. We found that integrated reward and effort values of low effort-positive reinforcement and high effort-negative reinforcement were behaviorally anticipated and represented in the putamen and medial orbitofrontal cortex activities. Patients with schizophrenia and depression did not show anticipation-related and work-related reaction time reductions, respectively. Greater amotivation severity correlated with smaller work-related putamen activity changes according to reward type in schizophrenia and effort level in depression. Patients with schizophrenia showed feedback-related putamen hyperactivity of low effort compared with healthy controls and depressed patients. The strength of medial orbitofrontal-striatal functional connectivity predicted work-related reaction time reduction of high effort negative reinforcement in healthy controls and amotivation severity in both patients with schizophrenia and those with depression. Patients with depression showed deficient medial orbitofrontal-striatal functional connectivity compared with healthy controls and patients with schizophrenia. These results indicate that amotivation in depression and schizophrenia involves different pathophysiology in the prefrontal-striatal circuitry. SIGNIFICANCE STATEMENT Amotivation is present in both depression and schizophrenia. However, treatment involves the use of drugs that enhance serotonin activity in depression and inhibit serotonin and dopamine activity in schizophrenia. Understanding how motivation processed in the mesocorticolimbic and nigostriatal pathways is affected in depression and schizophrenia is important in discovering treatment targets and strategies for amotivation. To our knowledge, this is the first study to compare patients with depression and schizophrenia in a common functional construct. By using an effort-based reinforcement task and examining resting-state functional connectivity in the dopaminergic network, we propose that difference in striato-orbitofrontal dysfunction in effort-based reinforcement between depression and schizophrenia may be related to differences in the extent of functional dysconnectivity in the dopaminergic pathway. Copyright © 2017 the authors 0270-6474/17/374371-11$15.00/0.

Short Time Impulse Response Function (STIRF) for automatic evaluation of the variation of the dynamic parameters of reinforced concrete framed structures during strong earthquakes.

NASA Astrophysics Data System (ADS)

Carlo Ponzo, Felice; Ditommaso, Rocco

2015-04-01

This study presents an innovative strategy for automatic evaluation of the variable fundamental frequency and related damping factor of nonlinear structures during strong motion phases. Most of methods for damage detection are based on the assessment of the variations of the dynamic parameters characterizing the monitored structure. A crucial aspect of these methods is the automatic and accurate estimation of both structural eigen-frequencies and related damping factors also during the nonlinear behaviour. A new method, named STIRF (Short-Time Impulse Response Function - STIRF), based on the nonlinear interferometric analysis combined with the Fourier Transform (FT) here is proposed in order to allow scientists and engineers to characterize frequencies and damping variations of a monitored structure. The STIRF approach helps to overcome some limitation derived from the use of techniques based on simple Fourier Transform. These latter techniques provide good results when the response of the monitored system is stationary, but fails when the system exhibits a non-stationary, time-varying behaviour: even non-stationary input, soil-foundation and/or adjacent structures interaction phenomena can show the inadequacy of classic techniques to analysing the nonlinear and/or non-stationary behaviour of structures. In fact, using this kind of approach it is possible to improve some of the existing methods for the automatic damage detection providing stable results also during the strong motion phase. Results are consistent with those expected if compared with other techniques. The main advantage derived from the use of the proposed approach (STIRF) for Structural Health Monitoring is based on the simplicity of the interpretation of the nonlinear variations of the fundamental frequency and the related equivalent viscous damping factor. The proposed methodology has been tested on both numerical and experimental models also using data retrieved from shaking table tests. Based on the results provided in this study, the methodology seems to be able to evaluate fast variations (over time) of dynamic parameters of a generic reinforced concrete framed structure. Further analyses are necessary to better calibrate the length of the moving time-window (in order to minimize the spurious frequency within each Interferometric Response Function evaluated on both weak and strong motion phases) and to verify the possibility to use the STIRF to analyse the nonlinear behaviour of general systems. Acknowledgements This study was partially funded by the Italian Civil Protection Department within the project DPC-RELUIS 2014 - RS4 ''Seismic observatory of structures and health monitoring''. References R. Ditommaso, F.C. Ponzo (2015). Automatic evaluation of the fundamental frequency variations and related damping factor of reinforced concrete framed structures using the Short Time Impulse Response Function (STIRF). Engineering Structures, 82 (2015), 104-112. http://dx.doi.org/10.1016/j.engstruct.2014.10.023.

Teaching children with autism spectrum disorders to mand for the removal of stimuli that prevent access to preferred items.

PubMed

Shillingsburg, M Alice; Powell, Nicole M; Bowen, Crystal N

2013-01-01

Mand training is often a primary focus in early language instruction and typically includes mands that are positively reinforced. However, mands maintained by negative reinforcement are also important skills to teach. These include mands to escape aversive demands or unwanted items. Another type of negatively reinforced mand important to teach involves the removal of a stimulus that prevents access to a preferred activity. We taught 5 participants diagnosed with autism spectrum disorders to mand for the removal of a stimulus in order to access a preferred item that had been blocked. An evaluation was conducted to determine if participants responded differentially when the establishing operations for the preferred item were present versus absent. All participants learned to mand for the removal of the stimulus exclusively under conditions when the establishing operation was present.

An analysis of choice making in the assessment of young children with severe behavior problems.

PubMed

Harding, J W; Wacker, D P; Berg, W K; Cooper, L J; Asmus, J; Mlela, K; Muller, J

1999-01-01

We examined how positive and negative reinforcement influenced time allocation, occurrence of problem behavior, and completion of parent instructions during a concurrent choice assessment with 2 preschool-aged children who displayed severe problem behavior in their homes. The children were given a series of concurrent choice options that varied availability of parent attention, access to preferred toys, and presentation of parent instructions. The results showed that both children consistently allocated their time to choice areas that included parent attention when no instructions were presented. When parent attention choice areas included the presentation of instructions, the children displayed differential patterns of behavior that appeared to be influenced by the presence or absence of preferred toys. The results extended previous applications of reinforcer assessment procedures by analyzing the relative influence of both positive and negative reinforcement within a concurrent-operants paradigm.

Employment-based abstinence reinforcement as a maintenance intervention for the treatment of cocaine dependence: post-intervention outcomes.

PubMed

DeFulio, Anthony; Silverman, Kenneth

2011-05-01

Due to the chronicity of cocaine dependence, practical and effective maintenance interventions are needed to sustain long-term abstinence. We sought to assess the effects of long-term employment-based reinforcement of cocaine abstinence after discontinuation of the intervention. Participants who initiated sustained opiate and cocaine abstinence during a 6-month abstinence reinforcement and training program worked as data entry operators and were randomly assigned to a group that could work independently of drug use (control, n = 24), or an abstinence-contingent employment (n = 27) group that was required to provide cocaine- and opiate-negative urine samples to work and maintain maximum rate of pay. A non-profit data entry business. Unemployed welfare recipients who persistently used cocaine while in methadone treatment. Urine samples and self-reports were collected every 6 months for 30 months. During the employment year, abstinence-contingent employment participants provided significantly more cocaine-negative samples than controls (82.7% and 54.2%; P = 0.01, OR = 4.61). During the follow-up year, the groups had similar rates of cocaine-negative samples (44.2% and 50.0%; P = 0.93) and human immunodeficiency virus risk behaviors. Participants' social, employment, economic and legal conditions were similar in the two groups across all phases of the study. Employment-based reinforcement effectively maintains long-term cocaine abstinence, but many patients relapse to use when the abstinence contingency is discontinued, even after a year of abstinence-contingent employment. Relapse could be prevented in many patients by leaving employment-based abstinence reinforcement in place indefinitely, which could be facilitated by integrating it into typical workplaces. © 2011 The Authors, Addiction © 2011 Society for the Study of Addiction.

Deficits in Positive Reinforcement Learning and Uncertainty-Driven Exploration are Associated with Distinct Aspects of Negative Symptoms in Schizophrenia

PubMed Central

Strauss, Gregory P.; Frank, Michael J.; Waltz, James A.; Kasanova, Zuzana; Herbener, Ellen S.; Gold, James M.

2011-01-01

Background Negative symptoms are core features of schizophrenia; however, the cognitive and neural basis for individual negative symptom domains remains unclear. Converging evidence suggests a role for striatal and prefrontal dopamine in reward learning and the exploration of actions that might produce outcomes that are better than the status quo. The current study examines whether deficits in reinforcement learning and uncertainty-driven exploration predict specific negative symptoms domains. Methods We administered a temporal decision making task, which required trial-by-trial adjustment of reaction time (RT) to maximize reward receipt, to 51 patients with schizophrenia and 39 age-matched healthy controls. Task conditions were designed such that expected value (probability * magnitude) increased (IEV), decreased (DEV), or remained constant (CEV) with increasing response times. Computational analyses were applied to estimate the degree to which trial-by-trial responses are influenced by reinforcement history. Results Individuals with schizophrenia showed impaired Go learning, but intact NoGo learning relative to controls. These effects were pronounced as a function of global measures of negative symptom. Uncertainty-based exploration was substantially reduced in individuals with schizophrenia, and selectively correlated with clinical ratings of anhedonia. Conclusions Schizophrenia patients, particularly those with high negative symptoms, failed to speed RT's to increase positive outcomes and showed reduced tendency to explore when alternative actions could lead to better outcomes than the status quo. Results are interpreted in the context of current computational, genetic, and pharmacological data supporting the roles of striatal and prefrontal dopamine in these processes. PMID:21168124

Automaticity of higher cognitive functions: neurophysiological evidence for unconscious syntactic processing of masked words.

PubMed

Jiménez-Ortega, Laura; García-Milla, Marcos; Fondevila, Sabela; Casado, Pilar; Hernández-Gutiérrez, David; Martín-Loeches, Manuel

2014-12-01

Models of language comprehension assume that syntactic processing is automatic, at least at early stages. However, the degree of automaticity of syntactic processing is still controversial. Evidence of automaticity is either indirect or has been observed for pairs of words, which might provide a poor syntactic context in comparison to sentences. The present study investigates the automaticity of syntactic processing using event-related brain potentials (ERPs) during sentence processing. To this end, masked adjectives that could either be syntactically correct or incorrect relative to a sentence being processed appeared just prior to the presentation of supraliminal adjectives. The latter could also be correct or incorrect. According to our data, subliminal gender agreement violations embedded in a sentence trigger an early anterior negativity-like modulation, whereas supraliminal gender agreement violations elicited a later anterior negativity. First-pass syntactic parsing thus appears to be unconsciously and automatically elicited. Interestingly, a P600-like modulation of short duration and early latency could also be observed for masked violations. In addition, masked violations also modulated the P600 component elicited by unmasked targets, probably reflecting that the mechanisms of revising a structural mismatch appear affected by subliminal information. According to our findings, both conscious and unconscious processes apparently contribute to syntactic processing. These results are discussed in line with most recent theories of automaticity and syntactic processing. Copyright © 2014 Elsevier B.V. All rights reserved.

A Randomized Trial Adapting Contingency Management Targets Based on Initial Abstinence Status of Cocaine-Dependent Patients

ERIC Educational Resources Information Center

Petry, Nancy M.; Barry, Danielle; Alessi, Sheila M.; Rounsaville, Bruce J.; Carroll, Kathleen M.

2012-01-01

Objective: Contingency management (CM) reduces drug use, but questions remain regarding optimal targets and magnitudes of reinforcement. We evaluated the efficacy of CM reinforcing attendance in patients who initiated treatment with cocaine-negative samples, and of higher magnitude abstinence-based CM in patients who began treatment positive.…

Further Examination of Factors that Influence Preference for Positive versus Negative Reinforcement

ERIC Educational Resources Information Center

Kodak, Tiffany; Lerman, Dorothea C.; Volkert, Valerie M.; Trosclair, Nicole

2007-01-01

Factors that influence choice between qualitatively different reinforcers (e.g., a food item or a break from work) are important to consider when arranging treatments for problem behavior. Previous findings indicate that children who engage in problem behavior maintained by escape from demands may choose a food item over the functional reinforcer…

Investigation of negative moment reinforcing in bridge decks : [tech transfer summary].

DOT National Transportation Integrated Search

2015-09-01

Multi-span pre-tensioned pre-stressed concrete beam (PPCB) bridges made : continuous, for live loads, usually may experience a negative total moment : over the intermediate supports, which this research investigated as part of an : investigation into...

Clarifying Inconclusive Functional Analysis Results: Assessment and Treatment of Automatically Reinforced Aggression

PubMed Central

Saini, Valdeep; Greer, Brian D.; Fisher, Wayne W.

2016-01-01

We conducted a series of studies in which multiple strategies were used to clarify the inconclusive results of one boy’s functional analysis of aggression. Specifically, we (a) evaluated individual response topographies to determine the composition of aggregated response rates, (b) conducted a separate functional analysis of aggression after high rates of disruption masked the consequences maintaining aggression during the initial functional analysis, (c) modified the experimental design used during the functional analysis of aggression to improve discrimination and decrease interaction effects between conditions, and (d) evaluated a treatment matched to the reinforcer hypothesized to maintain aggression. An effective yet practical intervention for aggression was developed based on the results of these analyses and from data collected during the matched-treatment evaluation. PMID:25891269

Selective effects of 5-HT2C receptor modulation on performance of a novel valence-probe visual discrimination task and probabilistic reversal learning in mice.

PubMed

Phillips, Benjamin U; Dewan, Sigma; Nilsson, Simon R O; Robbins, Trevor W; Heath, Christopher J; Saksida, Lisa M; Bussey, Timothy J; Alsiö, Johan

2018-04-22

Dysregulation of the serotonin (5-HT) system is a pathophysiological component in major depressive disorder (MDD), a condition closely associated with abnormal emotional responsivity to positive and negative feedback. However, the precise mechanism through which 5-HT tone biases feedback responsivity remains unclear. 5-HT2C receptors (5-HT2CRs) are closely linked with aspects of depressive symptomatology, including abnormalities in reinforcement processes and response to stress. Thus, we aimed to determine the impact of 5-HT2CR function on response to feedback in biased reinforcement learning. We used two touchscreen assays designed to assess the impact of positive and negative feedback on probabilistic reinforcement in mice, including a novel valence-probe visual discrimination (VPVD) and a probabilistic reversal learning procedure (PRL). Systemic administration of a 5-HT2CR agonist and antagonist resulted in selective changes in the balance of feedback sensitivity bias on these tasks. Specifically, on VPVD, SB 242084, the 5-HT2CR antagonist, impaired acquisition of a discrimination dependent on appropriate integration of positive and negative feedback. On PRL, SB 242084 at 1 mg/kg resulted in changes in behaviour consistent with reduced sensitivity to positive feedback. In contrast, WAY 163909, the 5-HT2CR agonist, resulted in changes associated with increased sensitivity to positive feedback and decreased sensitivity to negative feedback. These results suggest that 5-HT2CRs tightly regulate feedback sensitivity bias in mice with consequent effects on learning and cognitive flexibility and specify a framework for the influence of 5-HT2CRs on sensitivity to reinforcement.

A robust automatic phase correction method for signal dense spectra

NASA Astrophysics Data System (ADS)

Bao, Qingjia; Feng, Jiwen; Chen, Li; Chen, Fang; Liu, Zao; Jiang, Bin; Liu, Chaoyang

2013-09-01

A robust automatic phase correction method for Nuclear Magnetic Resonance (NMR) spectra is presented. In this work, a new strategy combining ‘coarse tuning' with ‘fine tuning' is introduced to correct various spectra accurately. In the ‘coarse tuning' procedure, a new robust baseline recognition method is proposed for determining the positions of the tail ends of the peaks, and then the preliminary phased spectra are obtained by minimizing the objective function based on the height difference of these tail ends. After the ‘coarse tuning', the peaks in the preliminary corrected spectra can be categorized into three classes: positive, negative, and distorted. Based on the classification result, a new custom negative penalty function used in the step of ‘fine tuning' is constructed to avoid the negative peak points in the spectra excluded in the negative peaks and distorted peaks. Finally, the fine phased spectra can be obtained by minimizing the custom negative penalty function. This method is proven to be very robust for it is tolerant to low signal-to-noise ratio, large baseline distortion and independent of the starting search points of phasing parameters. The experimental results on both 1D metabonomics spectra with over-crowded peaks and 2D spectra demonstrate the high efficiency of this automatic method.

Oscillatory brain dynamics associated with the automatic processing of emotion in words.

PubMed

Wang, Lin; Bastiaansen, Marcel

2014-10-01

This study examines the automaticity of processing the emotional aspects of words, and characterizes the oscillatory brain dynamics that accompany this automatic processing. Participants read emotionally negative, neutral and positive nouns while performing a color detection task in which only perceptual-level analysis was required. Event-related potentials and time frequency representations were computed from the concurrently measured EEG. Negative words elicited a larger P2 and a larger late positivity than positive and neutral words, indicating deeper semantic/evaluative processing of negative words. In addition, sustained alpha power suppressions were found for the emotional compared to neutral words, in the time range from 500 to 1000ms post-stimulus. These results suggest that sustained attention was allocated to the emotional words, whereas the attention allocated to the neutral words was released after an initial analysis. This seems to hold even when the emotional content of the words is task-irrelevant. Copyright © 2014 Elsevier Inc. All rights reserved.

Cognitive predictors and moderators of winter depression treatment outcomes in cognitive-behavioral therapy vs. light therapy.

PubMed

Sitnikov, Lilya; Rohan, Kelly J; Evans, Maggie; Mahon, Jennifer N; Nillni, Yael I

2013-12-01

There is no empirical basis for determining which seasonal affective disorder (SAD) patients are best suited for what type of treatment. Using data from a parent clinical trial comparing light therapy (LT), cognitive-behavioral therapy (CBT), and their combination (CBT + LT) for SAD, we constructed hierarchical linear regression models to explore baseline cognitive vulnerability constructs (i.e., dysfunctional attitudes, negative automatic thoughts, response styles) as prognostic and prescriptive factors of acute and next winter depression outcomes. Cognitive constructs did not predict or moderate acute treatment outcomes. Baseline dysfunctional attitudes and negative automatic thoughts were prescriptive of next winter treatment outcomes. Participants with higher baseline levels of dysfunctional attitudes and negative automatic thoughts had less severe depression the next winter if treated with CBT than if treated with LT. In addition, participants randomized to solo LT who scored at or above the sample mean on these cognitive measures at baseline had more severe depressive symptoms the next winter relative to those who scored below the mean. Baseline dysfunctional attitudes and negative automatic thoughts did not predict treatment outcomes in participants assigned to solo CBT or CBT + LT. Therefore, SAD patients with extremely rigid cognitions did not fare as well in the subsequent winter if treated initially with solo LT. Such patients may be better suited for initial treatment with CBT, which directly targets cognitive vulnerability processes. Copyright © 2013 Elsevier Ltd. All rights reserved.

[On efficiency of biomanagement with negative feedback from patient's EEG in correction of functional disorders, caused by stress].

PubMed

Fedotchev, A I

2010-01-01

The perspective approach to non-pharmacological correction of the stress induced functional disorders in humans, based on the double negative feedback from patient's EEG was validated and experimentally tested. The approach implies a simultaneous use of narrow frequency EEG-oscillators, characteristic for each patient and recorded in real time span, in two independent contours of negative feedback--traditional contour of adaptive biomanagement and additional contour of resonance stimulation. In the last the signals of negative feedback from individual narrow frequency EEG oscillators are not recognized by the subject, but serve for an automatic modulation of the parameters of the sensory impact. Was shown that due to combination of active (conscious perception) and passive (automatic modulation) use of signals of negative feedback from narrow frequency EEG components of the patient, opens a possibility of considerable increase of efficiency of the procedures of EEG biomanagement.

Combined incentives versus no-incentive exercise programs on objectively measured physical activity and health-related variables.

PubMed

Fennell, Curtis; Gerhart, Hayden; Seo, Yongsuk; Hauge, Kimberly; Glickman, Ellen L

2016-09-01

Incentivized exercise program interventions have recently led to mixed findings with regard to increasing physical activity, attendance, and improving healthy lifestyles. However, in this area limited research exists on implementing a combined negative reinforcement strategy, using a "buy-in" and positive reinforcement system. To determine the effect of comparing a non-incentivized reward system with an incentivized reward system using combined positive and negative rewards on physical activity, attendance, and health and performance outcomes. 15 Previously sedentary faculty and staff of a large public research university participated in two separate 12-week exercise interventions and wore a program accelerometer throughout the entire day during the 12weeks. During the first intervention, there were no incentives offered to participants. The second intervention consisted of an incentivized program. Positive reinforcements included various rewards for meeting achievements related to physical activity levels. A program rebate worth $25 for achieving 450miles was used as the negative reinforcement "buy-in" incentive. A two-way repeated measures ANOVA demonstrated a main effect of time for percent body fat (p<0.001) and push-ups (p=0.018). All other variables revealed no differences between conditions or from pre to post testing. There was no difference between conditions with physical activity or attendance. No differences in physical activity or health-related variables were found within the incentivized and non-incentivized conditions. Copyright © 2016 Elsevier Inc. All rights reserved.

Exploiting negative Poisson's ratio to design 3D-printed composites with enhanced mechanical properties

DOE PAGES

Li, Tiantian; Chen, Yanyu; Hu, Xiaoyi; ...

2018-02-03

Auxetic materials exhibiting a negative Poisson's ratio are shown to have better indentation resistance, impact shielding capability, and enhanced toughness. Here, we report a class of high-performance composites in which auxetic lattice structures are used as the reinforcements and the nearly incompressible soft material is employed as the matrix. This coupled geometry and material design concept is enabled by the state-of-the-art additive manufacturing technique. Guided by experimental tests and finite element analyses, we systematically study the compressive behavior of the 3D printed auxetics reinforced composites and achieve a significant enhancement of their stiffness and energy absorption. This improved mechanical performancemore » is due to the negative Poisson's ratio effect of the auxetic reinforcements, which makes the matrix in a state of biaxial compression and hence provides additional support. This mechanism is further supported by the investigation of the effect of auxetic degree on the stiffness and energy absorption capability. The findings reported here pave the way for developing a new class of auxetic composites that significantly expand their design space and possible applications through a combination of rational design and 3D printing.« less

Exploiting negative Poisson's ratio to design 3D-printed composites with enhanced mechanical properties

DOE Office of Scientific and Technical Information (OSTI.GOV)

Li, Tiantian; Chen, Yanyu; Hu, Xiaoyi

Auxetic materials exhibiting a negative Poisson's ratio are shown to have better indentation resistance, impact shielding capability, and enhanced toughness. Here, we report a class of high-performance composites in which auxetic lattice structures are used as the reinforcements and the nearly incompressible soft material is employed as the matrix. This coupled geometry and material design concept is enabled by the state-of-the-art additive manufacturing technique. Guided by experimental tests and finite element analyses, we systematically study the compressive behavior of the 3D printed auxetics reinforced composites and achieve a significant enhancement of their stiffness and energy absorption. This improved mechanical performancemore » is due to the negative Poisson's ratio effect of the auxetic reinforcements, which makes the matrix in a state of biaxial compression and hence provides additional support. This mechanism is further supported by the investigation of the effect of auxetic degree on the stiffness and energy absorption capability. The findings reported here pave the way for developing a new class of auxetic composites that significantly expand their design space and possible applications through a combination of rational design and 3D printing.« less

Automatic processing of pragmatic information in the human brain: a mismatch negativity study.

PubMed

Zhao, Ming; Liu, Tao; Chen, Feiyan

2018-05-23

Language comprehension involves pragmatic information processing, which allows world knowledge to influence the interpretation of a sentence. This study explored whether pragmatic information can be automatically processed during spoken sentence comprehension. The experiment adopted the mismatch negativity (MMN) paradigm to capture the neurophysiological indicators of automatic processing of spoken sentences. Pragmatically incorrect ('Foxes have wings') and correct ('Butterflies have wings') sentences were used as the experimental stimuli. In condition 1, the pragmatically correct sentence was the deviant and the pragmatically incorrect sentence was the standard stimulus, whereas the opposite case was presented in condition 2. The experimental results showed that, compared with the condition that the pragmatically correct sentence is the deviant stimulus, when the condition that the pragmatically incorrect sentence is the deviant stimulus MMN effects were induced within 60-120 and 220-260 ms. The results indicated that the human brain can monitor for incorrect pragmatic information in the inattentive state and can automatically process pragmatic information at the beginning of spoken sentence comprehension.

A comparison of positive and negative reinforcement for compliance to treat problem behavior maintained by escape.

PubMed

Slocum, Sarah K; Vollmer, Timothy R

2015-09-01

Previous research has shown that problem behavior maintained by escape can be treated using positive reinforcement. In the current study, we directly compared functional (escape) and nonfunctional (edible) reinforcers in the treatment of escape-maintained problem behavior for 5 subjects. In the first treatment, compliance produced a break from instructions. In the second treatment, compliance produced a small edible item. Neither treatment included escape extinction. Results suggested that the delivery of a positive reinforcer for compliance was effective for treating escape-maintained problem behavior for all 5 subjects, and the delivery of escape for compliance was ineffective for 3 of the 5 subjects. Implications and future directions related to the use of positive reinforcers in the treatment of escape behavior are discussed. © Society for the Experimental Analysis of Behavior.

The effect of partial reinforcement on instrumental successive negative contrast in inbred Roman High- (RHA-I) and Low- (RLA-I) Avoidance rats.

PubMed

Cuenya, L; Sabariego, M; Donaire, R; Fernández-Teruel, A; Tobeña, A; Gómez, M J; Mustaca, A; Torres, C

2012-03-20

Frustration is an emotional response that can be induced by the sudden devaluation of a reinforcer in the presence of greater reinforcement expectancies (e.g. instrumental successive negative contrast, iSNC). This emotional response seems to be similar to anxiety and can be attenuated by previous experiences of reward loss (e.g. partial reinforcement, PR, as opposed to continuous reinforcement, CR). In this study we used iSNC and PR procedures in order to compare the performance of two strains of rats psychogenetically selected on the basis of their emotional reactivity: the inbred Roman High- (RHA-I, low anxiety) and Low- (RLA-I, high anxiety) Avoidance rats. Animals were exposed to a straight alley, where they were changed from 12 pellets in the preshift phase (presented in 100% of trials-CR vs. 50% of trials-PR) to 2 pellets in the postshift phase, or exposed to 2 pellets throughout the training. The results indicated that the iSNC only appeared in RLA-I rats exposed to CR, as opposed to RLA-I animals exposed to PR and to RHA-I rats exposed to PR or CR. These data seem to support the implication of emotional responses in both iSNC and PR situations, and indicate that the behavioral reactivity to reward loss experiences is modulated by genetic variables. Published by Elsevier Inc.

Prediction of reinforced concrete strength by ultrasonic velocities

NASA Astrophysics Data System (ADS)

Sabbağ, Nevbahar; Uyanık, Osman

2017-06-01

This study was aimed to determine the strength of the reinforced concrete and to reveal the reinforcement effect on the concrete strength by Ultrasonic P and S wave velocities. Studies were conducted with prepared 9 different concrete designs of showing low, medium and high strength features. 4 kinds of cubic samples which unreinforced and including 10, 14 or 20 mm diameter reinforcement were prepared for these designs. Studies were carried out on total 324 samples including 9 samples for each design of these 4 kinds. The prepared samples of these designs were subjected to water curing. On some days of the 90-day period, P and S wave measurements were repeated to reveal the changes in seismic velocities of samples depending on whether reinforced or unreinforced of samples and diameter of reinforcement. Besides, comparisons were done by performing uniaxial compressive strength test with crushing of 3 samples on 7th, 28th and 90th days. As a result of studies and evaluations, it was seen that values of seismic velocities and uniaxial compressive strength increased depending on reinforcement and diameter of reinforcement in low strength concretes. However, while the seismic velocities were not markedly affected from reinforcement or reinforcement diameter in high strength concrete, uniaxial compressive strength values were negatively affected.

Comparing Pleasure and Pain: The Fundamental Mathematical Equivalence of Reward Gain and Shock Reduction under Variable Interval Schedules

ERIC Educational Resources Information Center

Mallpress, Dave E. W.; Fawcett, Tim W.; McNamara, John M.; Houston, Alasdair I.

2012-01-01

The relationship between positive and negative reinforcement and the symmetry of Thorndike's law of effect are unresolved issues in operant psychology. Here we show that, for a given pattern of responding on variable interval (VI) schedules with the same programmed rate of food rewards (positive reinforcement VI) or electric shocks (negative…

The Effects of a Local Negative Feedback Function between Choice and Relative Reinforcer Rate

ERIC Educational Resources Information Center

Davison, Michael; Elliffe, Douglas; Marr, M. Jackson

2010-01-01

Four pigeons were trained on two-key concurrent variable-interval schedules with no changeover delay. In Phase 1, relative reinforcers on the two alternatives were varied over five conditions from 0.1 to 0.9. In Phases 2 and 3, we instituted a molar feedback function between relative choice in an interreinforcer interval and the probability of…

Cardiac Concomitants of Feedback and Prediction Error Processing in Reinforcement Learning.

PubMed

Kastner, Lucas; Kube, Jana; Villringer, Arno; Neumann, Jane

2017-01-01

Successful learning hinges on the evaluation of positive and negative feedback. We assessed differential learning from reward and punishment in a monetary reinforcement learning paradigm, together with cardiac concomitants of positive and negative feedback processing. On the behavioral level, learning from reward resulted in more advantageous behavior than learning from punishment, suggesting a differential impact of reward and punishment on successful feedback-based learning. On the autonomic level, learning and feedback processing were closely mirrored by phasic cardiac responses on a trial-by-trial basis: (1) Negative feedback was accompanied by faster and prolonged heart rate deceleration compared to positive feedback. (2) Cardiac responses shifted from feedback presentation at the beginning of learning to stimulus presentation later on. (3) Most importantly, the strength of phasic cardiac responses to the presentation of feedback correlated with the strength of prediction error signals that alert the learner to the necessity for behavioral adaptation. Considering participants' weight status and gender revealed obesity-related deficits in learning to avoid negative consequences and less consistent behavioral adaptation in women compared to men. In sum, our results provide strong new evidence for the notion that during learning phasic cardiac responses reflect an internal value and feedback monitoring system that is sensitive to the violation of performance-based expectations. Moreover, inter-individual differences in weight status and gender may affect both behavioral and autonomic responses in reinforcement-based learning.

Cardiac Concomitants of Feedback and Prediction Error Processing in Reinforcement Learning

PubMed Central

Kastner, Lucas; Kube, Jana; Villringer, Arno; Neumann, Jane

2017-01-01

Successful learning hinges on the evaluation of positive and negative feedback. We assessed differential learning from reward and punishment in a monetary reinforcement learning paradigm, together with cardiac concomitants of positive and negative feedback processing. On the behavioral level, learning from reward resulted in more advantageous behavior than learning from punishment, suggesting a differential impact of reward and punishment on successful feedback-based learning. On the autonomic level, learning and feedback processing were closely mirrored by phasic cardiac responses on a trial-by-trial basis: (1) Negative feedback was accompanied by faster and prolonged heart rate deceleration compared to positive feedback. (2) Cardiac responses shifted from feedback presentation at the beginning of learning to stimulus presentation later on. (3) Most importantly, the strength of phasic cardiac responses to the presentation of feedback correlated with the strength of prediction error signals that alert the learner to the necessity for behavioral adaptation. Considering participants' weight status and gender revealed obesity-related deficits in learning to avoid negative consequences and less consistent behavioral adaptation in women compared to men. In sum, our results provide strong new evidence for the notion that during learning phasic cardiac responses reflect an internal value and feedback monitoring system that is sensitive to the violation of performance-based expectations. Moreover, inter-individual differences in weight status and gender may affect both behavioral and autonomic responses in reinforcement-based learning. PMID:29163004

Stress enhances model-free reinforcement learning only after negative outcome

PubMed Central

Lee, Daeyeol

2017-01-01

Previous studies found that stress shifts behavioral control by promoting habits while decreasing goal-directed behaviors during reward-based decision-making. It is, however, unclear how stress disrupts the relative contribution of the two systems controlling reward-seeking behavior, i.e. model-free (or habit) and model-based (or goal-directed). Here, we investigated whether stress biases the contribution of model-free and model-based reinforcement learning processes differently depending on the valence of outcome, and whether stress alters the learning rate, i.e., how quickly information from the new environment is incorporated into choices. Participants were randomly assigned to either a stress or a control condition, and performed a two-stage Markov decision-making task in which the reward probabilities underwent periodic reversals without notice. We found that stress increased the contribution of model-free reinforcement learning only after negative outcome. Furthermore, stress decreased the learning rate. The results suggest that stress diminishes one’s ability to make adaptive choices in multiple aspects of reinforcement learning. This finding has implications for understanding how stress facilitates maladaptive habits, such as addictive behavior, and other dysfunctional behaviors associated with stress in clinical and educational contexts. PMID:28723943

Stress enhances model-free reinforcement learning only after negative outcome.

PubMed

Park, Heyeon; Lee, Daeyeol; Chey, Jeanyung

2017-01-01

Previous studies found that stress shifts behavioral control by promoting habits while decreasing goal-directed behaviors during reward-based decision-making. It is, however, unclear how stress disrupts the relative contribution of the two systems controlling reward-seeking behavior, i.e. model-free (or habit) and model-based (or goal-directed). Here, we investigated whether stress biases the contribution of model-free and model-based reinforcement learning processes differently depending on the valence of outcome, and whether stress alters the learning rate, i.e., how quickly information from the new environment is incorporated into choices. Participants were randomly assigned to either a stress or a control condition, and performed a two-stage Markov decision-making task in which the reward probabilities underwent periodic reversals without notice. We found that stress increased the contribution of model-free reinforcement learning only after negative outcome. Furthermore, stress decreased the learning rate. The results suggest that stress diminishes one's ability to make adaptive choices in multiple aspects of reinforcement learning. This finding has implications for understanding how stress facilitates maladaptive habits, such as addictive behavior, and other dysfunctional behaviors associated with stress in clinical and educational contexts.

Eroticizing inequality in the United States: the consequences and determinants of traditional gender role adherence in intimate relationships.

PubMed

Sanchez, Diana T; Fetterolf, Janell C; Rudman, Laurie A

2012-01-01

This article reviews the research on traditional gender-role adherence and sexuality for heterosexual men and women. Specifically, the consequences and predictors of following traditional gender roles of female submissiveness and male dominance in sexual relationships is examined. Despite evidence that men and women's sexual roles are becoming more egalitarian over time, empirical evidence suggests that the traditional sexual roles continue to dominate heterosexual relations. This article explores whether the sexual context is one in which both men and women feel particularly compelled to engage in gender stereotypic behavior, and why. In addition, this article reports on research that finds that men and women have automatic associations between sexuality and power that reinforce their gender stereotypic behavior in sexual contexts. The negative effects of traditional gender-role adherence for women's sexual problems and satisfaction is demonstrated. This article concludes that traditional sexual scripts are harmful for both women's and men's ability to engage in authentic, rewarding sexual expression, although the female submissive role may be particularly debilitating. Future directions of research are suggested, including interventions to reduce women's adherence to the sexually submissive female script.

Sexual Modes Questionnaire (SMQ): Translation and Psychometric Properties of the Italian Version of the Automatic Thought Scale.

PubMed

Nimbi, Filippo Maria; Tripodi, Francesca; Simonelli, Chiara; Nobre, Pedro

2018-03-01

The Sexual Modes Questionnaire (SMQ) is a validated and widespread used tool to assess the association among negative automatic thoughts, emotions, and sexual response during sexual activity in men and women. To test the psychometric characteristics of the Italian version of the SMQ focusing on the Automatic Thoughts subscale (SMQ-AT). After linguistic translation, the psychometric properties (internal consistency, construct, and discriminant validity) were evaluated. 1,051 participants (425 men and 626 women, 776 healthy and 275 clinical groups complaining about sexual problems) participated in the present study. 2 confirmatory factor analyses were conducted to test the fit of the original factor structures of the SMQ versions. In addition, 2 principal component analyses were performed to highlight 2 new factorial structures that were further validated with confirmatory factor analyses. Cronbach α and composite reliability were used as internal consistency measures and differences between clinical and control groups were run to test the discriminant validity for the male and female versions. The associations with emotions and sexual functioning measures also are reported. Principal component analyses identified 5 factors in the male version: erection concerns thoughts, lack of erotic thoughts, age- and body-related thoughts, negative thoughts toward sex, and worries about partner's evaluation and failure anticipation thoughts. In the female version 6 factors were found: sexual abuse thoughts, lack of erotic thoughts, low self-body image thoughts, failure and disengagement thoughts, sexual passivity and control, and partner's lack of affection. Confirmatory factor analysis supported the adequacy of the factor structure for men and women. Moreover, the SMQ showed a strong association with emotional response and sexual functioning, differentiating between clinical and control groups. This measure is useful to evaluate patients and design interventions focused on negative automatic thoughts during sexual activity and to develop multicultural research. This study reports on the translation and validation of the Italian version of a clinically useful and widely used measure (assessing automatic thoughts during sexual activity). Limits regarding sampling technique and use of the Automatic Thoughts subscale are discussed in the article. The present findings support the validity and the internal consistency of the Italian version of the SMQ-AT and allow the assessment of negative automatic thoughts during sexual activity for clinical and research purposes. Nimbi FM, Tripodi F, Simonelli C, Nobre P. Sexual Modes Questionnaire (SMQ): Translation and Psychometric Properties of the Italian Version of the Automatic Thought Scale. J Sex Med 2018;15:396-409. Copyright © 2018 International Society for Sexual Medicine. Published by Elsevier Inc. All rights reserved.

Negative affect in at-risk youth: Outcome expectancies mediate relations with both regular and electronic cigarette use.

PubMed

Miller, Stephen; Pike, James; Stacy, Alan W; Xie, Bin; Ames, Susan L

2017-06-01

Despite the general trend of declining use of traditional cigarettes among young adults in the United States, alternative high school students continue to smoke cigarettes and electronic cigarettes at rates much higher than do students attending regular high schools. Challenging life circumstances leading to elevated levels of negative affect may account for increased smoking behavior in this population. Further, a belief in the negative affect-reducing qualities of nicotine may mediate this effect. The current study tested the hypothesis that negative reinforcing outcome expectancies mediate the relationship between negative affect on smoking susceptibility in nonusers, smoking frequency in users, and smoking experimentation in the overall sample. Results support the hypothesis that negative affect in alternative high school students is correlated with smoking experimentation, smoking willingness, and smoking frequency and that the relationship between negative affect and smoking behavior outcomes is mediated by negative reinforcing outcome expectancies (i.e., beliefs in the negative affect-reducing effects of smoking). This finding was supported for both cigarettes and electronic cigarettes and coincides with a rapid increase in the number of high school students nationally who have experimented with electronic cigarettes. Future antismoking initiatives directed at at-risk youth should consider integrating healthier negative affect reduction techniques to counter the use of nicotine products. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Using aberrant behaviors as reinforcers for autistic children.

PubMed Central

Charlop, M H; Kurtz, P F; Casey, F G

1990-01-01

In a series of experiments, we assessed the efficacy of using autistic children's aberrant behaviors as reinforcers to increase their correct task responding. In Experiment 1, reinforcer conditions of stereotypy, food, and varied (food or stereotypy) were compared. In Experiment 2, the conditions were delayed echolalia, food, and varied (food or delayed echolalia), and in Experiment 3, perseverative behavior was compared with stereotypy and food as potential reinforcers. A multielement design was used for all comparisons, and side-effect measures were recorded during and after teaching sessions as well as at home. Results indicated that, in general, task performance was highest when brief opportunities to engage in aberrant behaviors were provided as reinforcers. Edibles were associated with the lowest performance. Furthermore, no negative side effects (e.g., an increase in aberrant behaviors) occurred. The results are discussed in terms of suggesting a more pragmatic treatment approach by addressing the contingent use of autistic children's aberrant behaviors as reinforcers. PMID:2373653

Obsessive-Compulsive Symptoms and Negative Affect During Tobacco Withdrawal in a Non-Clinical Sample of African American Smokers

PubMed Central

Bello, Mariel S.; Pang, Raina D.; Chasson, Gregory S.; Ray, Lara A.; Leventhal, Adam M.

2016-01-01

The association between obsessive-compulsive (OC) symptomatology and smoking is poorly understood, particularly in African Americans—a group subject to smoking- and OC-related health disparities. In a non-clinical sample of 253 African American smokers, we tested the negative reinforcement model of OC-smoking comorbidity, purporting that smokers with higher OC symptoms experience greater negative affect (NA) and urge to smoke for NA suppression upon acute tobacco abstinence. Following a baseline visit involving OC assessment, participants completed two counterbalanced experimental visits (non-abstinent vs. 16-hr tobacco abstinence) involving affect, smoking urge, and nicotine withdrawal assessment. OC symptom severity predicted larger abstinence-provoked increases in overall NA, anger, anxiety, depression, fatigue, urge to smoke to suppress NA, and composite nicotine withdrawal symptom index. African American smokers with elevated OC symptoms appear to be vulnerable to negative reinforcement-mediated smoking motivation and may benefit from cessation treatments that diminish NA or the urge to quell NA via smoking. PMID:27769664

Reinforcement learning for a biped robot based on a CPG-actor-critic method.

PubMed

Nakamura, Yutaka; Mori, Takeshi; Sato, Masa-aki; Ishii, Shin

2007-08-01

Animals' rhythmic movements, such as locomotion, are considered to be controlled by neural circuits called central pattern generators (CPGs), which generate oscillatory signals. Motivated by this biological mechanism, studies have been conducted on the rhythmic movements controlled by CPG. As an autonomous learning framework for a CPG controller, we propose in this article a reinforcement learning method we call the "CPG-actor-critic" method. This method introduces a new architecture to the actor, and its training is roughly based on a stochastic policy gradient algorithm presented recently. We apply this method to an automatic acquisition problem of control for a biped robot. Computer simulations show that training of the CPG can be successfully performed by our method, thus allowing the biped robot to not only walk stably but also adapt to environmental changes.

Psychometric Properties of the Positive Automatic Thoughts Questionnaire.

ERIC Educational Resources Information Center

Ingram, Rick E.; And Others

1995-01-01

Original data and other studies using the Positive Automatic Thoughts Questionnaire (ATP-Q) show that the reliability and norms of the instrument appear stable and that the ATP-Q is inversely associated with negative affective states but unrelated to conditions such as medical condition not accompanied by psychological distress. (SLD)

Electrophysiological Correlates of Automatic Visual Change Detection in School-Age Children

ERIC Educational Resources Information Center

Clery, Helen; Roux, Sylvie; Besle, Julien; Giard, Marie-Helene; Bruneau, Nicole; Gomot, Marie

2012-01-01

Automatic stimulus-change detection is usually investigated in the auditory modality by studying Mismatch Negativity (MMN). Although the change-detection process occurs in all sensory modalities, little is known about visual deviance detection, particularly regarding the development of this brain function throughout childhood. The aim of the…

Reading Ability Is Negatively Related to Stroop Interference

ERIC Educational Resources Information Center

Protopapas, Athanassios; Archonti, Anastasia; Skaloumbakas, Christos

2007-01-01

Stroop interference is often taken as evidence for reading automaticity even though young and poor readers, who presumably lack reading automaticity, present strong interference. Here the relationship between reading skills and Stroop interference was studied in a 7th-grade sample. Greater interference was observed in children diagnosed with…

Second-order contrast based on the expectation of effort and reinforcement.

PubMed

Clement, Tricia S; Zentall, Thomas R

2002-01-01

Pigeons prefer signals for reinforcement that require greater effort (or time) to obtain over those that require less effort to obtain (T. S. Clement, J. Feltus, D. H. Kaiser, & T. R. Zentall, 2000). Preference was attributed to contrast (or to the relatively greater improvement in conditions) produced by the appearance of the signal when it was preceded by greater effort. In Experiment 1, the authors of the present study demonstrated that the expectation of greater effort was sufficient to produce such a preference (a second-order contrast effect). In Experiments 2 and 3, low versus high probability of reinforcement was substituted for high versus low effort, respectively, with similar results. In Experiment 3, the authors found that the stimulus preference could be attributed to positive contrast (when the discriminative stimuli represented an improvement in the probability of reinforcement) and perhaps also negative contrast (when the discriminative stimuli represented reduction in the probability of reinforcement).

Effects of dopamine on reinforcement learning and consolidation in Parkinson's disease.

PubMed

Grogan, John P; Tsivos, Demitra; Smith, Laura; Knight, Brogan E; Bogacz, Rafal; Whone, Alan; Coulthard, Elizabeth J

2017-07-10

Emerging evidence suggests that dopamine may modulate learning and memory with important implications for understanding the neurobiology of memory and future therapeutic targeting. An influential hypothesis posits that dopamine biases reinforcement learning. More recent data also suggest an influence during both consolidation and retrieval. Eighteen Parkinson's disease patients learned through feedback ON or OFF medication, with memory tested 24 hr later ON or OFF medication (4 conditions, within-subjects design with matched healthy control group). Patients OFF medication during learning decreased in memory accuracy over the following 24 hr. In contrast to previous studies, however, dopaminergic medication during learning and testing did not affect expression of positive or negative reinforcement. Two further experiments were run without the 24 hr delay, but they too failed to reproduce effects of dopaminergic medication on reinforcement learning. While supportive of a dopaminergic role in consolidation, this study failed to replicate previous findings on reinforcement learning.

Automated Fabrication Technologies for High Performance Polymer Composites

NASA Technical Reports Server (NTRS)

Shuart , M. J.; Johnston, N. J.; Dexter, H. B.; Marchello, J. M.; Grenoble, R. W.

1998-01-01

New fabrication technologies are being exploited for building high graphite-fiber-reinforced composite structure. Stitched fiber preforms and resin film infusion have been successfully demonstrated for large, composite wing structures. Other automatic processes being developed include automated placement of tacky, drapable epoxy towpreg, automated heated head placement of consolidated ribbon/tape, and vacuum-assisted resin transfer molding. These methods have the potential to yield low cost high performance structures by fabricating composite structures to net shape out-of-autoclave.

How we learn to make decisions: rapid propagation of reinforcement learning prediction errors in humans.

PubMed

Krigolson, Olav E; Hassall, Cameron D; Handy, Todd C

2014-03-01

Our ability to make decisions is predicated upon our knowledge of the outcomes of the actions available to us. Reinforcement learning theory posits that actions followed by a reward or punishment acquire value through the computation of prediction errors-discrepancies between the predicted and the actual reward. A multitude of neuroimaging studies have demonstrated that rewards and punishments evoke neural responses that appear to reflect reinforcement learning prediction errors [e.g., Krigolson, O. E., Pierce, L. J., Holroyd, C. B., & Tanaka, J. W. Learning to become an expert: Reinforcement learning and the acquisition of perceptual expertise. Journal of Cognitive Neuroscience, 21, 1833-1840, 2009; Bayer, H. M., & Glimcher, P. W. Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron, 47, 129-141, 2005; O'Doherty, J. P. Reward representations and reward-related learning in the human brain: Insights from neuroimaging. Current Opinion in Neurobiology, 14, 769-776, 2004; Holroyd, C. B., & Coles, M. G. H. The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity. Psychological Review, 109, 679-709, 2002]. Here, we used the brain ERP technique to demonstrate that not only do rewards elicit a neural response akin to a prediction error but also that this signal rapidly diminished and propagated to the time of choice presentation with learning. Specifically, in a simple, learnable gambling task, we show that novel rewards elicited a feedback error-related negativity that rapidly decreased in amplitude with learning. Furthermore, we demonstrate the existence of a reward positivity at choice presentation, a previously unreported ERP component that has a similar timing and topography as the feedback error-related negativity that increased in amplitude with learning. The pattern of results we observed mirrored the output of a computational model that we implemented to compute reward prediction errors and the changes in amplitude of these prediction errors at the time of choice presentation and reward delivery. Our results provide further support that the computations that underlie human learning and decision-making follow reinforcement learning principles.

Bartonella spp. and Coxiella burnetii Associated with Community-Acquired, Culture-Negative Endocarditis, Brazil

PubMed Central

Castelli, Jussara Bianchi; Mansur, Alfredo Jose; Pereira dos Santos, Fabiana; Colombo, Silvia; do Nascimento, Elvira Mendes; Paddock, Christopher D.; Brasil, Roosecelis Araújo; Velho, Paulo Eduardo Neves Ferreira; Drummond, Marina Rovani; Grinberg, Max; Strabelli, Tania Mara Varejao

2015-01-01

We evaluated culture-negative, community-acquired endocarditis by using indirect immunofluorescent assays and molecular analyses for Bartonella spp. and Coxiella burnetii and found a prevalence of 19.6% and 7.8%, respectively. Our findings reinforce the need to study these organisms in patients with culture-negative, community-acquired endocarditis, especially B. henselae in cat owners. PMID:26197233

Negative reinforcement impairs overnight memory consolidation.

PubMed

Stamm, Andrew W; Nguyen, Nam D; Seicol, Benjamin J; Fagan, Abigail; Oh, Angela; Drumm, Michael; Lundt, Maureen; Stickgold, Robert; Wamsley, Erin J

2014-11-01

Post-learning sleep is beneficial for human memory. However, it may be that not all memories benefit equally from sleep. Here, we manipulated a spatial learning task using monetary reward and performance feedback, asking whether enhancing the salience of the task would augment overnight memory consolidation and alter its incorporation into dreaming. Contrary to our hypothesis, we found that the addition of reward impaired overnight consolidation of spatial memory. Our findings seemingly contradict prior reports that enhancing the reward value of learned information augments sleep-dependent memory processing. Given that the reward followed a negative reinforcement paradigm, consolidation may have been impaired via a stress-related mechanism. © 2014 Stamm et al.; Published by Cold Spring Harbor Laboratory Press.

Social stress reactivity alters reward and punishment learning

PubMed Central

Frank, Michael J.; Allen, John J. B.

2011-01-01

To examine how stress affects cognitive functioning, individual differences in trait vulnerability (punishment sensitivity) and state reactivity (negative affect) to social evaluative threat were examined during concurrent reinforcement learning. Lower trait-level punishment sensitivity predicted better reward learning and poorer punishment learning; the opposite pattern was found in more punishment sensitive individuals. Increasing state-level negative affect was directly related to punishment learning accuracy in highly punishment sensitive individuals, but these measures were inversely related in less sensitive individuals. Combined electrophysiological measurement, performance accuracy and computational estimations of learning parameters suggest that trait and state vulnerability to stress alter cortico-striatal functioning during reinforcement learning, possibly mediated via medio-frontal cortical systems. PMID:20453038

Social stress reactivity alters reward and punishment learning.

PubMed

Cavanagh, James F; Frank, Michael J; Allen, John J B

2011-06-01

To examine how stress affects cognitive functioning, individual differences in trait vulnerability (punishment sensitivity) and state reactivity (negative affect) to social evaluative threat were examined during concurrent reinforcement learning. Lower trait-level punishment sensitivity predicted better reward learning and poorer punishment learning; the opposite pattern was found in more punishment sensitive individuals. Increasing state-level negative affect was directly related to punishment learning accuracy in highly punishment sensitive individuals, but these measures were inversely related in less sensitive individuals. Combined electrophysiological measurement, performance accuracy and computational estimations of learning parameters suggest that trait and state vulnerability to stress alter cortico-striatal functioning during reinforcement learning, possibly mediated via medio-frontal cortical systems.

Identifying Cognitive Remediation Change Through Computational Modelling—Effects on Reinforcement Learning in Schizophrenia

PubMed Central

Cella, Matteo; Bishara, Anthony J.; Medin, Evelina; Swan, Sarah; Reeder, Clare; Wykes, Til

2014-01-01

Objective: Converging research suggests that individuals with schizophrenia show a marked impairment in reinforcement learning, particularly in tasks requiring flexibility and adaptation. The problem has been associated with dopamine reward systems. This study explores, for the first time, the characteristics of this impairment and how it is affected by a behavioral intervention—cognitive remediation. Method: Using computational modelling, 3 reinforcement learning parameters based on the Wisconsin Card Sorting Test (WCST) trial-by-trial performance were estimated: R (reward sensitivity), P (punishment sensitivity), and D (choice consistency). In Study 1 the parameters were compared between a group of individuals with schizophrenia (n = 100) and a healthy control group (n = 50). In Study 2 the effect of cognitive remediation therapy (CRT) on these parameters was assessed in 2 groups of individuals with schizophrenia, one receiving CRT (n = 37) and the other receiving treatment as usual (TAU, n = 34). Results: In Study 1 individuals with schizophrenia showed impairment in the R and P parameters compared with healthy controls. Study 2 demonstrated that sensitivity to negative feedback (P) and reward (R) improved in the CRT group after therapy compared with the TAU group. R and P parameter change correlated with WCST outputs. Improvements in R and P after CRT were associated with working memory gains and reduction of negative symptoms, respectively. Conclusion: Schizophrenia reinforcement learning difficulties negatively influence performance in shift learning tasks. CRT can improve sensitivity to reward and punishment. Identifying parameters that show change may be useful in experimental medicine studies to identify cognitive domains susceptible to improvement. PMID:24214932

Adaptive Self-Tuning Networks

NASA Astrophysics Data System (ADS)

Knox, H. A.; Draelos, T.; Young, C. J.; Lawry, B.; Chael, E. P.; Faust, A.; Peterson, M. G.

2015-12-01

The quality of automatic detections from seismic sensor networks depends on a large number of data processing parameters that interact in complex ways. The largely manual process of identifying effective parameters is painstaking and does not guarantee that the resulting controls are the optimal configuration settings. Yet, achieving superior automatic detection of seismic events is closely related to these parameters. We present an automated sensor tuning (AST) system that learns near-optimal parameter settings for each event type using neuro-dynamic programming (reinforcement learning) trained with historic data. AST learns to test the raw signal against all event-settings and automatically self-tunes to an emerging event in real-time. The overall goal is to reduce the number of missed legitimate event detections and the number of false event detections. Reducing false alarms early in the seismic pipeline processing will have a significant impact on this goal. Applicable both for existing sensor performance boosting and new sensor deployment, this system provides an important new method to automatically tune complex remote sensing systems. Systems tuned in this way will achieve better performance than is currently possible by manual tuning, and with much less time and effort devoted to the tuning process. With ground truth on detections in seismic waveforms from a network of stations, we show that AST increases the probability of detection while decreasing false alarms.

Automatic control of negative emotions: evidence that structured practice increases the efficiency of emotion regulation.

PubMed

Christou-Champi, Spyros; Farrow, Tom F D; Webb, Thomas L

2015-01-01

Emotion regulation (ER) is vital to everyday functioning. However, the effortful nature of many forms of ER may lead to regulation being inefficient and potentially ineffective. The present research examined whether structured practice could increase the efficiency of ER. During three training sessions, comprising a total of 150 training trials, participants were presented with negatively valenced images and asked either to "attend" (control condition) or "reappraise" (ER condition). A further group of participants did not participate in training but only completed follow-up measures. Practice increased the efficiency of ER as indexed by decreased time required to regulate emotions and increased heart rate variability (HRV). Furthermore, participants in the ER condition spontaneously regulated their negative emotions two weeks later and reported being more habitual in their use of ER. These findings indicate that structured practice can facilitate the automatic control of negative emotions and that these effects persist beyond training.

Motives underlying smoking in college students with ADHD.

PubMed

Murphy, Kerrie Glass; Flory, Kate

2017-05-01

The positive association between attention deficit hyperactivity disorder (ADHD) symptoms and smoking in youth has been well documented. Less research has examined why individuals with ADHD, particularly college students, are at increased risk for smoking. This longitudinal study examined whether smoking motives [cognitive enhancement, tolerance, negative reinforcement (smoking to reduce negative affect or stress), craving, social influences, and weight control] helped to explain the relation between ADHD symptoms (inattention and hyperactivity/impulsivity) and cigarette smoking among college students. Participants were 889 undergraduates (21% men) and their parents who completed online surveys at the beginning and end of the Fall semester regarding their smoking behaviors, ADHD symptoms, and smoking motives. Structural equation modeling was used to analyze data and answer research questions. Nineteen percent of students reported smoking, while 20% reported one or more inattentive symptoms, 35% reported one or more hyperactive/impulsive symptoms, and 3.3% met criteria for ADHD. All smoking motives significantly moderated the relation between inattentive symptoms and smoking, while most smoking motives (negative reinforcement, tolerance, craving, cognitive enhancement, and weight control) moderated the link between hyperactive/impulsive symptoms and smoking. Results remained significant after controlling for stimulant medication use and conduct disorder symptoms. Conclusions/Importance. Addressing negative reinforcement, craving, social influences, and tolerance in prevention and intervention efforts on college campuses may reduce smoking. Results also highlight the importance of assessing a range of ADHD symptoms in college students as ADHD symptoms, even at subthreshold levels, were associated with increased smoking rates among college students.

Ethanol Seeking by Long Evans Rats Is Not Always a Goal-Directed Behavior

PubMed Central

Mangieri, Regina A.; Cofresí, Roberto U.; Gonzales, Rueben A.

2012-01-01

Background Two parallel and interacting processes are said to underlie animal behavior, whereby learning and performance of a behavior is at first via conscious and deliberate (goal-directed) processes, but after initial acquisition, the behavior can become automatic and stimulus-elicited (habitual). With respect to instrumental behaviors, animal learning studies suggest that the duration of training and the action-outcome contingency are two factors involved in the emergence of habitual seeking of “natural” reinforcers (e.g., sweet solutions, food or sucrose pellets). To rigorously test whether behaviors reinforced by abused substances such as ethanol, in particular, similarly become habitual was the primary aim of this study. Methodology/Principal Findings Male Long Evans rats underwent extended or limited operant lever press training with 10% sucrose/10% ethanol (10S10E) reinforcement (variable interval (VI) or (VR) ratio schedule of reinforcement), or with 10% sucrose (10S) reinforcement (VI schedule only). Once training and pretesting were complete, the impact of outcome devaluation on operant behavior was evaluated after lithium chloride injections were paired with the reinforcer, or unpaired 24 hours later. After limited, but not extended instrumental training, lever pressing by groups trained under VR with 10S10E and under VI with 10S was sensitive to outcome devaluation. In contrast, responding by both the extended and limited training 10S10E VI groups was not sensitive to ethanol devaluation during the test for habitual behavior. Conclusions/Significance Operant behavior by rats trained to self-administer an ethanol-sucrose solution showed variable sensitivity to a change in the value of ethanol, with relative insensitivity developing sooner in animals that received time-variable ethanol reinforcement during training sessions. One important implication, with respect to substance abuse in humans, is that initial learning about the relationship between instrumental actions and the opportunity to consume ethanol-containing drinks can influence the time course for the development or expression of habitual ethanol seeking behavior. PMID:22870342

Better or Worse than Expected? Aging, Learning, and the ERN

ERIC Educational Resources Information Center

Eppinger, Ben; Kray, Jutta; Mock, Barbara; Mecklinger, Axel

2008-01-01

This study examined age differences in error processing and reinforcement learning. We were interested in whether the electrophysiological correlates of error processing, the error-related negativity (ERN) and the feedback-related negativity (FRN), reflect learning-related changes in younger and older adults. To do so, we applied a probabilistic…

Changes in Intrinsic Motivation as a Function of Negative Feedback and Threats.

ERIC Educational Resources Information Center

Deci, Edward L.; Cascio, Wayne F.

Recent studies have demonstrated that external rewards can affect intrinsic motivation to perform an activity. Money tends to decrease intrinsic motivation, whereas positive verbal reinforcements tend to increase intrinsic motivation. This paper presents evidence that negative feedback and threats of punishment also decrease intrinsic motivation.…

The Lamentable Alliance Between the Media and School Critics.

ERIC Educational Resources Information Center

Berliner, David C.; Biddle, Bruce J.

1998-01-01

As shown by their treatment of incidents involving kissing, aspirins, and Ebonics, the media are adept at spotlighting the unseemly, the negative, and the absurdities occurring in a public education system comprising 100,000 schools. Such negative reinforcement stymies public support for schools. When covering the Third International Mathematics…

Cyanate Ester Resin Modified with Nano-particles for Inclusion in Continuous Fiber Reinforced Composites

DTIC Science & Technology

2011-02-25

custom built rotating oven, to prevent settling during cure. The filler content in the test specimen are verified by thermogravimetric analysis (TGA...using a Shimadzu SA-CP3 centrifugal particle size analyzer. The moisture absorption of the nanoparticles was studied using a Q50 thermogravimetric ...low viscosity bisphenol E cyanate ester resin (BECy) resin reinforced with macro scale carbon fibers and negative CTE nanoparticles . Polymer

Tribological dry sliding behavior of chopped carbon fiber reinforced polyetheretherketone

NASA Astrophysics Data System (ADS)

Chumaevskii, A. V.; Ivanov, A. N.; Filippov, A. V.; Rubtsov, V. E.; Kolubaev, E. A.

2017-12-01

Tribological tests on 3D printed pure polyetheretherketone and carbon fiber reinforced polyetheretherketone samples were carried out. The negative effect of carbon fiber sticking out of the matrix on wear and sliding process stability was revealed. These fibers may be too long and oriented to the worn surface in a manner that prevents their removal by wear so that the worn surface becomes irregular and the sliding process instable.

Electrophysiological correlates of reinforcement learning in young people with Tourette syndrome with and without co-occurring ADHD symptoms.

PubMed

Shephard, Elizabeth; Jackson, Georgina M; Groom, Madeleine J

2016-06-01

Altered reinforcement learning is implicated in the causes of Tourette syndrome (TS) and attention-deficit/hyperactivity disorder (ADHD). TS and ADHD frequently co-occur but how this affects reinforcement learning has not been investigated. We examined the ability of young people with TS (n=18), TS+ADHD (N=17), ADHD (n=13) and typically developing controls (n=20) to learn and reverse stimulus-response (S-R) associations based on positive and negative reinforcement feedback. We used a 2 (TS-yes, TS-no)×2 (ADHD-yes, ADHD-no) factorial design to assess the effects of TS, ADHD, and their interaction on behavioural (accuracy, RT) and event-related potential (stimulus-locked P3, feedback-locked P2, feedback-related negativity, FRN) indices of learning and reversing the S-R associations. TS was associated with intact learning and reversal performance and largely typical ERP amplitudes. ADHD was associated with lower accuracy during S-R learning and impaired reversal learning (significantly reduced accuracy and a trend for smaller P3 amplitude). The results indicate that co-occurring ADHD symptoms impair reversal learning in TS+ADHD. The implications of these findings for behavioural tic therapies are discussed. Copyright © 2016 ISDN. Published by Elsevier Ltd. All rights reserved.

Spared internal but impaired external reward prediction error signals in major depressive disorder during reinforcement learning.

PubMed

Bakic, Jasmina; Pourtois, Gilles; Jepma, Marieke; Duprat, Romain; De Raedt, Rudi; Baeken, Chris

2017-01-01

Major depressive disorder (MDD) creates debilitating effects on a wide range of cognitive functions, including reinforcement learning (RL). In this study, we sought to assess whether reward processing as such, or alternatively the complex interplay between motivation and reward might potentially account for the abnormal reward-based learning in MDD. A total of 35 treatment resistant MDD patients and 44 age matched healthy controls (HCs) performed a standard probabilistic learning task. RL was titrated using behavioral, computational modeling and event-related brain potentials (ERPs) data. MDD patients showed comparable learning rate compared to HCs. However, they showed decreased lose-shift responses as well as blunted subjective evaluations of the reinforcers used during the task, relative to HCs. Moreover, MDD patients showed normal internal (at the level of error-related negativity, ERN) but abnormal external (at the level of feedback-related negativity, FRN) reward prediction error (RPE) signals during RL, selectively when additional efforts had to be made to establish learning. Collectively, these results lend support to the assumption that MDD does not impair reward processing per se during RL. Instead, it seems to alter the processing of the emotional value of (external) reinforcers during RL, when additional intrinsic motivational processes have to be engaged. © 2016 Wiley Periodicals, Inc.

Disrupted Reinforcement Learning and Maladaptive Behavior in Women with a History of Childhood Sexual Abuse: A High-Density Event-Related Potential Study

PubMed Central

Pechtel, Pia; Pizzagalli, Diego A.

2013-01-01

Context Childhood sexual abuse (CSA) has been associated with psychopathology, particularly major depressive disorder (MDD), and high-risk behaviors. Despite grave epidemiological data, the mechanisms underlying these maladaptive outcomes remain poorly understood. Objective We examined whether CSA history, particularly in conjunction with past MDD, is associated with behavioral and neural dysfunction in reinforcement learning, and whether such dysfunction is linked to maladaptive behavior. Design Participants completed a clinical evaluation and a probabilistic reinforcement task while 128-channel event-related potentials were recorded. Setting Academic setting; participants recruited from the community. Participants Fifteen remitted depressed females with CSA history (CSA+rMDD), 16 remitted depressed females without CSA history (rMDD), and 18 healthy females. Main Outcome Measures Participants’ preference for choosing the most rewarded stimulus and avoiding the most punished stimulus was evaluated. The feedback-related negativity (FRN) and error-related negativity (ERN)–hypothesized to reflect activation in the anterior cingulate cortex–were used as electrophysiological indices of reinforcement learning. Results No group differences emerged in the acquisition of reinforcement contingencies. In trials requiring to rely partially or exclusively on previously rewarded information, the CSA+rMDD group showed (1) lower accuracy (relative to both controls and rMDD), (2) blunted electrophysiological differentiation between correct and incorrect responses (relative to controls), and (3) increased activation in the subgenual anterior cingulate cortex (relative to rMDD). CSA history was not associated with impairments in avoiding the most punished stimulus. Self-harm and suicidal behaviors correlated with poorer performance of previously rewarded–but not previously punished–trials. Conclusions Irrespective of past MDD, women with CSA histories showed neural and behavioral deficits in utilizing previous reinforcement to optimize decision-making in the absence of feedback (blunted “Go learning”). While the current study provides initial evidence for reward-specific deficits associated with CSA, future research is warranted to determine if disrupted positive reinforcement learning predicts high-risk behavior following CSA. PMID:23487253

Sutureless functional end-to-end anastomosis using a linear stapler with polyglycolic acid felt for intestinal anastomoses.

PubMed

Naito, Masanori; Miura, Hirohisa; Nakamura, Takatoshi; Sato, Takeo; Yamanashi, Takahiro; Tsutsui, Atsuko; Watanabe, Masahiko

2017-05-01

Gastrointestinal anastomosis remains associated with a considerable burden of morbidity and, in some cases, mortality. Functional end-to-end anastomosis, whilst extremely efficient, is vulnerable to increased intestinal pressure in the immediate postoperative period, which may predispose to development of anastomotic leakage or bleeding. Therefore, there is a requirement for new techniques that facilitate safe and efficacious anastomotic procedures. This study examined the clinical application of functional end-to-end anastomosis with a stapler that automatically applies a bioabsorbable polyglycolic acid sheet (Endo GIA™ Reinforced Reload with Tri-Staple™ Technology). A porcine model was used to examine functional end-to-end anastomosis with and without application of a bioabsorbable polyglycolic acid sheet. As the crotch of the anastomosis is considered the weakest point, a probe was used to test the integrity of these anastomoses. Furthermore, we performed functional end-to-end anastomosis using the Endo GIA™ Reinforced stapler in a clinical series of 20 patients undergoing gastrointestinal tract resection. In all cases, functional end-to-end anastomosis was performed without suture reinforcement. Small intestine anastomoses in the animal study exhibited no weakness at the crotch of the anastomosis, as tested with a probe, suggesting an increased resiliency to conventional complications of functional end-to-end anastomosis. In the clinical population, no postoperative complications were noted. No adhesive intestinal obstruction was noted. Sutureless functional end-to-end anastomosis using the Endo GIA™ Reinforced appears to be safe, efficacious, and straightforward. Reinforcement of the crotch site with a bioabsorbable polyglycolic acid sheet appears to mitigate conventional problems with crotch-site vulnerability.

Financial incentives to promote extended smoking abstinence in opioid-maintained patients: a randomized trial.

PubMed

Sigmon, Stacey C; Miller, Mollie E; Meyer, Andrew C; Saulsgiver, Kathryn; Badger, Gary J; Heil, Sarah H; Higgins, Stephen T

2016-05-01

Prior studies by our group demonstrated the efficacy of a brief but intensive behavioral intervention for producing initial smoking abstinence among opioid-dependent patients. In the present study, our aim was to promote longer-duration abstinence in this population. Following an initial 2-week incentive intervention for smoking abstinence, we examined whether a 10-week maintenance arm involving continuation of contingent reinforcement will produce greater smoking abstinence than a similar duration of noncontingent reinforcement. Randomized, 12-week, parallel-group study. Out-patient research clinic in Burlington, Vermont, USA. Opioid-maintained smokers (n = 88) who provided breath carbon monoxide and urinary cotinine specimens and received contingent reinforcement for smoking abstinence during weeks 1-2 (phase 1), with 63 randomized on day 14 to an extended contingent (EC; n = 31) or extended noncontingent (EN; n = 32) experimental condition for weeks 3-12 (phase 2). The EC condition consisted of voucher values that escalated across consecutive negative samples until they reached $30, after which they remained at $30 per negative sample. A positive or a missing sample resulted in no vouchers for that day and reset the value of the next negative same to $9. Two consecutive negatives returned the schedule to the pre-reset value. The EN control condition consisted of vouchers delivered for providing scheduled samples, but independent of smoking status. The primary outcome was percentage of biochemically abstinent samples during phase 2. Secondary measures included abstinence status at final study visit, complete abstinence, participants' longest duration of continuous abstinence, cotinine and carbon monoxide (CO) levels and self-reported cigarettes per day. EC participants achieved greater smoking abstinence during phase 2 than EN participants [46.7 versus 23.5% negative samples, respectively; odds ratio (OR) = 2.98, 95% confidence interval (CI) = 1.16-7.65, χ(2) 1  (=)  5.0, P = 0.02]. When longest duration of continuous abstinence was compared between experimental groups, EC participants achieved twice the mean duration of continuous abstinence compared with EN participants (3.31 versus 1.68 weeks; t61  = 1.83, P = 0.07). An effect of experimental condition was also seen on mean cotinine levels (42.5 versus 210.6 ng/ml, respectively; F1,61 =5.9, P = 0.02). Among opioid-maintained smokers receiving an initial period of daily contingent incentives, a contingent reinforcement intervention appears to be more effective at extending smoking abstinence than noncontingent reinforcement over 10 weeks. © 2015 Society for the Study of Addiction.

Signal functions in delayed reinforcement

PubMed Central

Lattal, Kennon A.

1984-01-01

Three experiments were conducted with pigeons to examine the role of the signal in delay-of-reinforcement procedures. In the first, a blackout accompanying a period of nonreinforcement increased key-peck response rates maintained by immediate reinforcement. The effects of dissociating the blackout from the delay interval were examined in the second experiment. In three conditions, blackouts and unsignaled delays were negatively correlated or occurred randomly with respect to one another. A signaled delay and an unsignaled delay that omitted the blackouts were studied in two other conditions. All delay-of-reinforcement conditions generally produced response rates lower than those produced by immediate reinforcement. Signaled delays maintained higher response rates than did any of the various unsignaled-delay conditions, with or without dissociated blackouts. The effects of these latter conditions did not differ systematically from one another. The final experiment showed that response rates varied as a function of the frequency with which a blackout accompanied delay intervals. By eliminating a number of methodological difficulties present in previous delay-of-reinforcement experiments, these results suggest the importance of the signal in maintaining responding during delay-of-reinforcement procedures and, conversely, the importance of the delay interval in decreasing responding. PMID:16812387

Tissue soldering with biodegradable polymer films: in-vitro investigation of hydration effects on weld strength

NASA Astrophysics Data System (ADS)

Sorg, Brian S.; Welch, Ashley J.

2001-05-01

Previous work demonstrated increased breaking strengths of tissue repaired with liquid albumin solder reinforced with a biodegradable polymer film compared to unreinforced control specimens. It was hypothesized that the breaking strength increase was due to reinforcement of the liquid solder cohesive strength. Immersion in a moist environment can decrease the adhesion of solder to tissue and negate any strength benefits gained from reinforcement. The purpose of this study was to determine if hydrated specimens repaired with reinforced solder would still be stronger than unreinforced controls. A 50%(w/v) bovine serum albumin solder with 0.5 mg/mL Indocyanine Green dye was used to repair an incision in bovine aorta. The solder was coagulated with 806-nm diode laser light. A poly(DL-lactic- co-glycolic acid) film was used to reinforce the solder (the controls had no reinforcement). The repaired tissues were immersed in phosphate buffered saline for time periods of 1 and 2 days. The breaking strengths of all of the hydrated specimens decreased compared to the acute breaking strengths. However, the reinforced specimens still had larger breaking strengths than the unreinforced controls. These results indicate that reinforcement of a liquid albumin solder may have the potential to improve the breaking strength in a clinical setting.

Implicit self-esteem compensation: automatic threat defense.

PubMed

Rudman, Laurie A; Dohn, Matthew C; Fairchild, Kimberly

2007-11-01

Four experiments demonstrated implicit self-esteem compensation (ISEC) in response to threats involving gender identity (Experiment 1), implicit racism (Experiment 2), and social rejection (Experiments 3-4). Under conditions in which people might be expected to suffer a blow to self-worth, they instead showed high scores on 2 implicit self-esteem measures. There was no comparable effect on explicit self-esteem. However, ISEC was eliminated following self-affirmation (Experiment 3). Furthermore, threat manipulations increased automatic intergroup bias, but ISEC mediated these relationships (Experiments 2-3). Thus, a process that serves as damage control for the self may have negative social consequences. Finally, pretest anxiety mediated the relationship between threat and ISEC (Experiment 3), whereas ISEC negatively predicted anxiety among high-threat participants (Experiment 4), suggesting that ISEC may function to regulate anxiety. The implications of these findings for automatic emotion regulation, intergroup bias, and implicit self-esteem measures are discussed. (c) 2007 APA, all rights reserved.

Remediation of negative side effects of an on-going response-cost system with chronic mental patients.

PubMed

Doty, D W; McInnis, T; Paul, G L

1974-01-01

Response-cost procedures within a token economy with extremely regressed residents excluded many residents from access to positive reinforcement. Procedures allowing residents to "purchase eligibility" to obtain backup reinforcers through contingent payment on standing fines, combined with proportional fine payoff schedules contingent upon time without new fines, increased payment on fines, reduced incidence of new fines, and increased utilization of backup reinforcers. These modifications removed adverse side effects while retaining the benefits associated with response costs. Failures or adverse effects of elements of token systems should not occasion abandonment of token economies, but rather encourage their continual evaluation and modification.

Evidence-based practice implementation in community mental health settings: the relative importance of key domains of implementation activity.

PubMed

Torrey, William C; Bond, Gary R; McHugo, Gregory J; Swain, Karin

2012-09-01

Implementation research has examined practice prioritization, implementation leadership, workforce development, workflow re-engineering, and practice reinforcement, but not addressed their relative importance as implementation drivers. This study investigated domains of implementation activities and correlated them to implementation success during a large national evidence-based practice implementation project. Implementation success was correlated with active leadership strategically devoted to redesigning the flow of work and reinforcing implementation through measurement and feedback. Relative attention to workforce development was negatively correlated with implementation. Active leaders should focus on redesigning the flow of work to support the implementation and on reinforcing program improvements.

Affect and the computer game player: the effect of gender, personality, and game reinforcement structure on affective responses to computer game-play.

PubMed

Chumbley, Justin; Griffiths, Mark

2006-06-01

Previous research on computer games has tended to concentrate on their more negative effects (e.g., addiction, increased aggression). This study departs from the traditional clinical and social learning explanations for these behavioral phenomena and examines the effect of personality, in-game reinforcement characteristics, gender, and skill on the emotional state of the game-player. Results demonstrated that in-game reinforcement characteristics and skill significantly effect a number of affective measures (most notably excitement and frustration). The implications of the impact of game-play on affect are discussed with reference to the concepts of "addiction" and "aggression."

Cross-language opinion lexicon extraction using mutual-reinforcement label propagation.

PubMed

Lin, Zheng; Tan, Songbo; Liu, Yue; Cheng, Xueqi; Xu, Xueke

2013-01-01

There is a growing interest in automatically building opinion lexicon from sources such as product reviews. Most of these methods depend on abundant external resources such as WordNet, which limits the applicability of these methods. Unsupervised or semi-supervised learning provides an optional solution to multilingual opinion lexicon extraction. However, the datasets are imbalanced in different languages. For some languages, the high-quality corpora are scarce or hard to obtain, which limits the research progress. To solve the above problems, we explore a mutual-reinforcement label propagation framework. First, for each language, a label propagation algorithm is applied to a word relation graph, and then a bilingual dictionary is used as a bridge to transfer information between two languages. A key advantage of this model is its ability to make two languages learn from each other and boost each other. The experimental results show that the proposed approach outperforms baseline significantly.

Cerebellar and prefrontal cortex contributions to adaptation, strategies, and reinforcement learning.

PubMed

Taylor, Jordan A; Ivry, Richard B

2014-01-01

Traditionally, motor learning has been studied as an implicit learning process, one in which movement errors are used to improve performance in a continuous, gradual manner. The cerebellum figures prominently in this literature given well-established ideas about the role of this system in error-based learning and the production of automatized skills. Recent developments have brought into focus the relevance of multiple learning mechanisms for sensorimotor learning. These include processes involving repetition, reinforcement learning, and strategy utilization. We examine these developments, considering their implications for understanding cerebellar function and how this structure interacts with other neural systems to support motor learning. Converging lines of evidence from behavioral, computational, and neuropsychological studies suggest a fundamental distinction between processes that use error information to improve action execution or action selection. While the cerebellum is clearly linked to the former, its role in the latter remains an open question. © 2014 Elsevier B.V. All rights reserved.

Contingency Management and Deliberative Decision-Making Processes.

PubMed

Regier, Paul S; Redish, A David

2015-01-01

Contingency management is an effective treatment for drug addiction. The current explanation for its success is rooted in alternative reinforcement theory. We suggest that alternative reinforcement theory is inadequate to explain the success of contingency management and produce a model based on demand curves that show how little the monetary rewards offered in this treatment would affect drug use. Instead, we offer an explanation of its success based on the concept that it accesses deliberative decision-making processes. We suggest that contingency management is effective because it offers a concrete and immediate alternative to using drugs, which engages deliberative processes, improves the ability of those deliberative processes to attend to non-drug options, and offsets more automatic action-selection systems. This theory makes explicit predictions that can be tested, suggests which users will be most helped by contingency management, and suggests improvements in its implementation.

Cerebellar and Prefrontal Cortex Contributions to Adaptation, Strategies, and Reinforcement Learning

PubMed Central

Taylor, Jordan A.; Ivry, Richard B.

2014-01-01

Traditionally, motor learning has been studied as an implicit learning process, one in which movement errors are used to improve performance in a continuous, gradual manner. The cerebellum figures prominently in this literature given well-established ideas about the role of this system in error-based learning and the production of automatized skills. Recent developments have brought into focus the relevance of multiple learning mechanisms for sensorimotor learning. These include processes involving repetition, reinforcement learning, and strategy utilization. We examine these developments, considering their implications for understanding cerebellar function and how this structure interacts with other neural systems to support motor learning. Converging lines of evidence from behavioral, computational, and neuropsychological studies suggest a fundamental distinction between processes that use error information to improve action execution or action selection. While the cerebellum is clearly linked to the former, its role in the latter remains an open question. PMID:24916295

Inertia and Decision Making.

PubMed

Alós-Ferrer, Carlos; Hügelschäfer, Sabine; Li, Jiahui

2016-01-01

Decision inertia is the tendency to repeat previous choices independently of the outcome, which can give rise to perseveration in suboptimal choices. We investigate this tendency in probability-updating tasks. Study 1 shows that, whenever decision inertia conflicts with normatively optimal behavior (Bayesian updating), error rates are larger and decisions are slower. This is consistent with a dual-process view of decision inertia as an automatic process conflicting with a more rational, controlled one. We find evidence of decision inertia in both required and autonomous decisions, but the effect of inertia is more clear in the latter. Study 2 considers more complex decision situations where further conflict arises due to reinforcement processes. We find the same effects of decision inertia when reinforcement is aligned with Bayesian updating, but if the two latter processes conflict, the effects are limited to autonomous choices. Additionally, both studies show that the tendency to rely on decision inertia is positively associated with preference for consistency.

Inertia and Decision Making

PubMed Central

Alós-Ferrer, Carlos; Hügelschäfer, Sabine; Li, Jiahui

2016-01-01

Decision inertia is the tendency to repeat previous choices independently of the outcome, which can give rise to perseveration in suboptimal choices. We investigate this tendency in probability-updating tasks. Study 1 shows that, whenever decision inertia conflicts with normatively optimal behavior (Bayesian updating), error rates are larger and decisions are slower. This is consistent with a dual-process view of decision inertia as an automatic process conflicting with a more rational, controlled one. We find evidence of decision inertia in both required and autonomous decisions, but the effect of inertia is more clear in the latter. Study 2 considers more complex decision situations where further conflict arises due to reinforcement processes. We find the same effects of decision inertia when reinforcement is aligned with Bayesian updating, but if the two latter processes conflict, the effects are limited to autonomous choices. Additionally, both studies show that the tendency to rely on decision inertia is positively associated with preference for consistency. PMID:26909061

Constructing Temporally Extended Actions through Incremental Community Detection

PubMed Central

Li, Ge

2018-01-01

Hierarchical reinforcement learning works on temporally extended actions or skills to facilitate learning. How to automatically form such abstraction is challenging, and many efforts tackle this issue in the options framework. While various approaches exist to construct options from different perspectives, few of them concentrate on options' adaptability during learning. This paper presents an algorithm to create options and enhance their quality online. Both aspects operate on detected communities of the learning environment's state transition graph. We first construct options from initial samples as the basis of online learning. Then a rule-based community revision algorithm is proposed to update graph partitions, based on which existing options can be continuously tuned. Experimental results in two problems indicate that options from initial samples may perform poorly in more complex environments, and our presented strategy can effectively improve options and get better results compared with flat reinforcement learning. PMID:29849543

Contingency Management and Deliberative Decision-Making Processes

PubMed Central

Regier, Paul S.; Redish, A. David

2015-01-01

Contingency management is an effective treatment for drug addiction. The current explanation for its success is rooted in alternative reinforcement theory. We suggest that alternative reinforcement theory is inadequate to explain the success of contingency management and produce a model based on demand curves that show how little the monetary rewards offered in this treatment would affect drug use. Instead, we offer an explanation of its success based on the concept that it accesses deliberative decision-making processes. We suggest that contingency management is effective because it offers a concrete and immediate alternative to using drugs, which engages deliberative processes, improves the ability of those deliberative processes to attend to non-drug options, and offsets more automatic action-selection systems. This theory makes explicit predictions that can be tested, suggests which users will be most helped by contingency management, and suggests improvements in its implementation. PMID:26082725

Cross-Language Opinion Lexicon Extraction Using Mutual-Reinforcement Label Propagation

PubMed Central

Lin, Zheng; Tan, Songbo; Liu, Yue; Cheng, Xueqi; Xu, Xueke

2013-01-01

There is a growing interest in automatically building opinion lexicon from sources such as product reviews. Most of these methods depend on abundant external resources such as WordNet, which limits the applicability of these methods. Unsupervised or semi-supervised learning provides an optional solution to multilingual opinion lexicon extraction. However, the datasets are imbalanced in different languages. For some languages, the high-quality corpora are scarce or hard to obtain, which limits the research progress. To solve the above problems, we explore a mutual-reinforcement label propagation framework. First, for each language, a label propagation algorithm is applied to a word relation graph, and then a bilingual dictionary is used as a bridge to transfer information between two languages. A key advantage of this model is its ability to make two languages learn from each other and boost each other. The experimental results show that the proposed approach outperforms baseline significantly. PMID:24260190

Deep Direct Reinforcement Learning for Financial Signal Representation and Trading.

PubMed

Deng, Yue; Bao, Feng; Kong, Youyong; Ren, Zhiquan; Dai, Qionghai

2017-03-01

Can we train the computer to beat experienced traders for financial assert trading? In this paper, we try to address this challenge by introducing a recurrent deep neural network (NN) for real-time financial signal representation and trading. Our model is inspired by two biological-related learning concepts of deep learning (DL) and reinforcement learning (RL). In the framework, the DL part automatically senses the dynamic market condition for informative feature learning. Then, the RL module interacts with deep representations and makes trading decisions to accumulate the ultimate rewards in an unknown environment. The learning system is implemented in a complex NN that exhibits both the deep and recurrent structures. Hence, we propose a task-aware backpropagation through time method to cope with the gradient vanishing issue in deep training. The robustness of the neural system is verified on both the stock and the commodity future markets under broad testing conditions.

Neural Correlates of Automatic Mood Regulation in Girls at High Risk for Depression

PubMed Central

Joormann, Jutta; Cooney, Rebecca E.; Henry, Melissa L.; Gotlib, Ian H.

2012-01-01

Daughters of depressed mothers are at significantly elevated risk for developing a depressive disorder themselves. We have little understanding, however, of the specific factors that contribute to this risk. The ability to regulate negative affect effectively is critical to emotional and physical health and may play an important role in influencing risk for depression. We examined whether never-disordered daughters whose mothers have experienced recurrent episodes of depression during their daughters’ lifetime differ from never-disordered daughters of never-disordered mothers in their patterns of neural activation during a negative mood induction and during automatic mood regulation. Sad mood was induced in daughters through the use of film clips; daughters then recalled positive autobiographical memories, a procedure shown previously to repair negative affect. During the mood induction, high-risk girls exhibited greater activation than did low-risk daughters in brain areas that have frequently been implicated in the experience of negative affect, including the amygdala and ventrolateral prefrontal cortex. In contrast, during automatic mood regulation, low-risk daughters exhibited greater activation than did their high-risk counterparts in brain areas that have frequently been associated with top-down regulation of emotion, including the dorsolateral prefrontal cortex and dorsal anterior cingulate cortex. These findings indicate that girls at high and low risk for depression differ in their patterns of neural activation both while experiencing, and while repairing negative affect, and suggest that anomalies in neural functioning precede the onset of a depressive episode. PMID:21895344

Comparative learning theory and its application in the training of horses.

PubMed

Cooper, J J

1998-11-01

Training can best be explained as a process that occurs through stimulus-response-reinforcement chains, whereby animals are conditioned to associate cues in their environment, with specific behavioural responses and their rewarding consequences. Research into learning in horses has concentrated on their powers of discrimination and on primary positive reinforcement schedules, where the correct response is paired with a desirable consequence such as food. In contrast, a number of other learning processes that are used in training have been widely studied in other species, but have received little scientific investigation in the horse. These include: negative reinforcement, where performance of the correct response is followed by removal of, or decrease in, intensity of a unpleasant stimulus; punishment, where an incorrect response is paired with an undesirable consequence, but without consistent prior warning; secondary conditioning, where a natural primary reinforcer such as food is closely associated with an arbitrary secondary reinforcer such as vocal praise; and variable or partial conditioning, where once the correct response has been learnt, reinforcement is presented according to an intermittent schedule to increase resistance to extinction outside of training.

The Nature of Indexing: How Humans and Machines Analyze Messages and Texts for Retrieval. Part II: Machine Indexing, and the Allocation of Human versus Machine Effort.

ERIC Educational Resources Information Center

Anderson, James D.; Perez-Carballo, Jose

2001-01-01

Discussion of human intellectual indexing versus automatic indexing focuses on automatic indexing. Topics include keyword indexing; negative vocabulary control; counting words; comparative counting and weighting; stemming; words versus phrases; clustering; latent semantic indexing; citation indexes; bibliographic coupling; co-citation; relevance…

Joint Extraction of Entities and Relations Using Reinforcement Learning and Deep Learning.

PubMed

Feng, Yuntian; Zhang, Hongjun; Hao, Wenning; Chen, Gang

2017-01-01

We use both reinforcement learning and deep learning to simultaneously extract entities and relations from unstructured texts. For reinforcement learning, we model the task as a two-step decision process. Deep learning is used to automatically capture the most important information from unstructured texts, which represent the state in the decision process. By designing the reward function per step, our proposed method can pass the information of entity extraction to relation extraction and obtain feedback in order to extract entities and relations simultaneously. Firstly, we use bidirectional LSTM to model the context information, which realizes preliminary entity extraction. On the basis of the extraction results, attention based method can represent the sentences that include target entity pair to generate the initial state in the decision process. Then we use Tree-LSTM to represent relation mentions to generate the transition state in the decision process. Finally, we employ Q -Learning algorithm to get control policy π in the two-step decision process. Experiments on ACE2005 demonstrate that our method attains better performance than the state-of-the-art method and gets a 2.4% increase in recall-score.

Joint Extraction of Entities and Relations Using Reinforcement Learning and Deep Learning

PubMed Central

Zhang, Hongjun; Chen, Gang

2017-01-01

We use both reinforcement learning and deep learning to simultaneously extract entities and relations from unstructured texts. For reinforcement learning, we model the task as a two-step decision process. Deep learning is used to automatically capture the most important information from unstructured texts, which represent the state in the decision process. By designing the reward function per step, our proposed method can pass the information of entity extraction to relation extraction and obtain feedback in order to extract entities and relations simultaneously. Firstly, we use bidirectional LSTM to model the context information, which realizes preliminary entity extraction. On the basis of the extraction results, attention based method can represent the sentences that include target entity pair to generate the initial state in the decision process. Then we use Tree-LSTM to represent relation mentions to generate the transition state in the decision process. Finally, we employ Q-Learning algorithm to get control policy π in the two-step decision process. Experiments on ACE2005 demonstrate that our method attains better performance than the state-of-the-art method and gets a 2.4% increase in recall-score. PMID:28894463

Cyanate Ester Resin Modified with Nano-particles for Inclusion in Continuous Fiber Reinforced Composites

DTIC Science & Technology

2011-02-25

thermogravimetric analyzer (TGA) from TA Instruments upon heating at 20 oC/min under air purge. The structural features of the nanoparticles were...low viscosity bisphenol E cyanate ester resin (BECy) resin reinforced with macro scale carbon fibers and negative CTE nanoparticles . Polymer...developed to improve the compatibility of the ZrW2O8 nanoparticles with the polymer matrix. The hybrid composites were prepared with 30 wt

Poor adjustment to college life mediates the relationship between drinking motives and alcohol consequences: a look at college adjustment, drinking motives, and drinking outcomes.

PubMed

LaBrie, Joseph W; Ehret, Phillip J; Hummer, Justin F; Prenovost, Katherine

2012-04-01

The current study examined whether the relationship between drinking motives and alcohol-related outcomes was mediated by college adjustment. Participants (N=253) completed an online survey that assessed drinking motives, degree of both positive and negative college adjustment, typical weekly drinking, and past month negative alcohol-related consequences. Structural equation modeling examined negative alcohol consequences as a function of college adjustment, drinking motives, and weekly drinking behavior in college students. Negative college adjustment mediated the relationship between coping drinking motives and drinking consequences. Positive college adjustment was not related to alcohol consumption or consequences. Positive reinforcement drinking motives (i.e. social and enhancement) not only directly predicted consequences, but were partially mediated by weekly drinking and degree of negative college adjustment. Gender specific models revealed that males exhibited more variability in drinking and their positive reinforcement drinking motives were more strongly associated with weekly drinking. Uniquely for females, coping motives were directly and indirectly (via negative adjustment) related to consequences. These findings suggest that interventions which seek to decrease alcohol-related risk may wish to incorporate discussions about strategies for decreasing stress and increasing other factors associated with better college adjustment. Copyright © 2011 Elsevier Ltd. All rights reserved.

Identifying cognitive remediation change through computational modelling--effects on reinforcement learning in schizophrenia.

PubMed

Cella, Matteo; Bishara, Anthony J; Medin, Evelina; Swan, Sarah; Reeder, Clare; Wykes, Til

2014-11-01

Converging research suggests that individuals with schizophrenia show a marked impairment in reinforcement learning, particularly in tasks requiring flexibility and adaptation. The problem has been associated with dopamine reward systems. This study explores, for the first time, the characteristics of this impairment and how it is affected by a behavioral intervention-cognitive remediation. Using computational modelling, 3 reinforcement learning parameters based on the Wisconsin Card Sorting Test (WCST) trial-by-trial performance were estimated: R (reward sensitivity), P (punishment sensitivity), and D (choice consistency). In Study 1 the parameters were compared between a group of individuals with schizophrenia (n = 100) and a healthy control group (n = 50). In Study 2 the effect of cognitive remediation therapy (CRT) on these parameters was assessed in 2 groups of individuals with schizophrenia, one receiving CRT (n = 37) and the other receiving treatment as usual (TAU, n = 34). In Study 1 individuals with schizophrenia showed impairment in the R and P parameters compared with healthy controls. Study 2 demonstrated that sensitivity to negative feedback (P) and reward (R) improved in the CRT group after therapy compared with the TAU group. R and P parameter change correlated with WCST outputs. Improvements in R and P after CRT were associated with working memory gains and reduction of negative symptoms, respectively. Schizophrenia reinforcement learning difficulties negatively influence performance in shift learning tasks. CRT can improve sensitivity to reward and punishment. Identifying parameters that show change may be useful in experimental medicine studies to identify cognitive domains susceptible to improvement. © The Author 2013. Published by Oxford University Press on behalf of the Maryland Psychiatric Research Center. All rights reserved. For permissions, please email: journals.permissions@oup.com.

Evolution of genetic architecture under directional selection.

PubMed

Hansen, Thomas F; Alvarez-Castro, José M; Carter, Ashley J R; Hermisson, Joachim; Wagner, Günter P

2006-08-01

We investigate the multilinear epistatic model under mutation-limited directional selection. We confirm previous results that only directional epistasis, in which genes on average reinforce or diminish each other's effects, contribute to the initial evolution of mutational effects. Thus, either canalization or decanalization can occur under directional selection, depending on whether positive or negative epistasis is prevalent. We then focus on the evolution of the epistatic coefficients themselves. In the absence of higher-order epistasis, positive pairwise epistasis will tend to weaken relative to additive effects, while negative pairwise epistasis will tend to become strengthened. Positive third-order epistasis will counteract these effects, while negative third-order epistasis will reinforce them. More generally, gene interactions of all orders have an inherent tendency for negative changes under directional selection, which can only be modified by higher-order directional epistasis. We identify three types of nonadditive quasi-equilibrium architectures that, although not strictly stable, can be maintained for an extended time: (1) nondirectional epistatic architectures; (2) canalized architectures with strong epistasis; and (3) near-additive architectures in which additive effects keep increasing relative to epistasis.

Obsessive-compulsive symptoms and negative affect during tobacco withdrawal in a non-clinical sample of African American smokers.

PubMed

Bello, Mariel S; Pang, Raina D; Chasson, Gregory S; Ray, Lara A; Leventhal, Adam M

2017-05-01

The association between obsessive-compulsive (OC) symptomatology and smoking is poorly understood, particularly in African Americans-a group subject to smoking- and OC-related health disparities. In a non-clinical sample of 253 African American smokers, we tested the negative reinforcement model of OC-smoking comorbidity, purporting that smokers with higher OC symptoms experience greater negative affect (NA) and urge to smoke for NA suppression upon acute tobacco abstinence. Following a baseline visit involving OC assessment, participants completed two counterbalanced experimental visits (non-abstinent vs. 16-h tobacco abstinence) involving affect, smoking urge, and nicotine withdrawal assessment. OC symptom severity predicted larger abstinence-provoked increases in overall NA, anger, anxiety, depression, fatigue, urge to smoke to suppress NA, and composite nicotine withdrawal symptom index. African American smokers with elevated OC symptoms appear to be vulnerable to negative reinforcement-mediated smoking motivation and may benefit from cessation treatments that diminish NA or the urge to quell NA via smoking. Copyright © 2016 Elsevier Ltd. All rights reserved.

Posttraumatic Stress Symptom Severity and Cognitive-Based Smoking Processes Among Trauma-Exposed Treatment-Seeking Smokers: The Role of Perceived Stress

PubMed Central

Garey, Lorra; Bakhshaie, Jafar; Vujanovic, Anka A.; Reitzel, Lorraine R.; Schmidt, Norman B.; Zvolensky, Michael J.

2016-01-01

Trauma exposure and smoking co-occur at an alarmingly high rate. However, there is little understanding of the mechanisms underlying this clinically significant relation. The present study examined perceived stress as an explanatory mechanism linking posttraumatic stress symptom severity and smoking-specific avoidance/inflexibility, perceived barriers to smoking cessation, and negative affect reduction/negative reinforcement expectancies from smoking among trauma-exposed smokers. Participants were trauma-exposed, treatment-seeking daily cigarette smokers (n = 179; 48.0% female; Mage = 41.17; SD = 12.55). Results indicated that posttraumatic stress symptom severity had an indirect significant effect on each of the dependent variables via perceived stress. The present results provide empirical support that perceived stress may be an underlying mechanism that indirectly explains posttraumatic symptoms relation to smoking-specific avoidance/inflexibility, perceived barriers to smoking cessation, and negative affect reduction/negative reinforcement expectancies among trauma-exposed smokers. These findings suggest that there may be clinical utility in targeting perceived stress among trauma-exposed smokers via stress management psychoeducation and skills training. PMID:27100473

Composite flexible skin with large negative Poisson’s ratio range: numerical and experimental analysis

NASA Astrophysics Data System (ADS)

Chen, Y. J.; Scarpa, F.; Farrow, I. R.; Liu, Y. J.; Leng, J. S.

2013-04-01

This paper describes the manufacturing, characterization and parametric modeling of a novel fiber-reinforced composite flexible skin with in-plane negative Poisson’s ratio (auxetic) behavior. The elastic mechanical performance of the auxetic skin is evaluated using a three-dimensional analytical model based on the classical laminate theory (CLT) and Sun’s thick laminate theory. Good agreement is observed between in-plane Poisson’s ratios and Young’s moduli of the composite skin obtained by the theoretical model and the experimental results. A parametric analysis carried out with the validated model shows that significant changes in the in-plane negative Poisson’s ratio can be achieved through different combinations of matrix and fiber materials and stacking sequences. It is also possible to identify fiber-reinforced composite skin configurations with the same in-plane auxeticity but different orthotropic stiffness performance, or the same orthotropic stiffness performance but different in-plane auxeticity. The analysis presented in this work provides useful guidelines to develop and manufacture flexible skins with negative Poisson’s ratio for applications focused on morphing aircraft wing designs.

Effects of dopamine on reinforcement learning and consolidation in Parkinson’s disease

PubMed Central

Grogan, John P; Tsivos, Demitra; Smith, Laura; Knight, Brogan E; Bogacz, Rafal; Whone, Alan; Coulthard, Elizabeth J

2017-01-01

Emerging evidence suggests that dopamine may modulate learning and memory with important implications for understanding the neurobiology of memory and future therapeutic targeting. An influential hypothesis posits that dopamine biases reinforcement learning. More recent data also suggest an influence during both consolidation and retrieval. Eighteen Parkinson’s disease patients learned through feedback ON or OFF medication, with memory tested 24 hr later ON or OFF medication (4 conditions, within-subjects design with matched healthy control group). Patients OFF medication during learning decreased in memory accuracy over the following 24 hr. In contrast to previous studies, however, dopaminergic medication during learning and testing did not affect expression of positive or negative reinforcement. Two further experiments were run without the 24 hr delay, but they too failed to reproduce effects of dopaminergic medication on reinforcement learning. While supportive of a dopaminergic role in consolidation, this study failed to replicate previous findings on reinforcement learning. DOI: http://dx.doi.org/10.7554/eLife.26801.001 PMID:28691905

Ecological Momentary Assessment of Negative Symptoms in Schizophrenia: Relationships to Effort Based Decision Making and Reinforcement Learning

PubMed Central

Moran, Erin K.; Culbreth, Adam J.; Barch, Deanna M.

2017-01-01

Negative symptoms are a core clinical feature of schizophrenia, but conceptual and methodological problems with current instruments can make their assessment challenging. One hypothesis is that current symptom assessments may be influenced by impairments in memory and may not be fully reflective of actual functioning outside of the laboratory. The present study sought to investigate the validity of assessing negative symptoms using ecological momentary assessment (EMA). Participants with schizophrenia (N=31) completed electronic questionnaires on smartphones four times a day for one week. Participants also completed Effort-Based Decision Making and Reinforcement Learning (RL) tasks to assess the relationship between EMA and laboratory measures, which tap into negative symptom relevant domains. Hierarchical linear modeling analyses revealed that clinician-rated and self-report measures of negative symptoms were significantly related to negative symptoms assessed via EMA. However, working memory moderated the relationship between EMA and retrospective measures of negative symptoms, such that there was a stronger relationship between EMA and retrospective negative symptom measures among individuals with better working memory. We also found that negative symptoms assessed via EMA were related to poor performance on the Effort task, while clinician-rated symptoms and self-reports were not. Further, we found that negative symptoms were related to poorer performance on learning reward contingencies. Our findings suggest that negative symptoms can be assessed through EMA and that working memory impairments frequently seen in schizophrenia may affect recall of symptoms. Moreover, these findings suggest the importance of examining the relationship between laboratory tasks and symptoms assessed during daily life. PMID:27893230

Evidence for dose-dependent positively and negatively reinforcing effects of the substance P C-terminal analog DIME-C7.

PubMed

Hasenöhrl, R U; Gerhardt, P; Huston, J P

1990-12-01

Possible positive reinforcing and aversive effects of intraperitoneally (ip) administered substance P (SP) and its C-terminal heptapeptide analog [pGlu5, MePhe8, Sar9]-SP5-11 (DIME-C7) were investigated in rats. The 'conditioned corral preference and avoidance procedure' was used for assessing positive and negative reinforcement. Behavioural testing was conducted in a circular open field consisting of four uniform quadrants equally preferred by the rats prior to drug treatment. On 3 consecutive days, rats received an ip injection of either SP (37 nmol/kg), DIME-C7 (3.7, 7.4, 37, 185 nmol/kg) or vehicle (0.01 M acetic acid in saline) and were placed immediately into their assigned treatment corral. During the test for conditioned corral preference and avoidance, when provided a choice between the four quadrants, rats treated with SP and with the equimolar dose of DIME-C7 (37 nmol/kg) spent significant more time in the drug-paired corral, indicative of positive reinforcing effects. The doses of 3.7 and 7.4 nmol/kg DIME-C7 did not influence the preference behaviour. The high dose of 185 nmol/kg DIME-C7 led to a significant decrease in time spent in the previously drug-paired corral, suggestive of aversive effects of the treatment. Gross locomotor activity was not influenced by either treatment. These results are discussed in the framework of a structure/activity relationship for the reinforcing properties of peripheraly applied SP.

Dynamics of neuronal circuits in addiction: reward, antireward, and emotional memory.

PubMed

Koob, G F

2009-05-01

Drug addiction is conceptualized as chronic, relapsing compulsive use of drugs with significant dysregulation of brain hedonic systems. Compulsive drug use is accompanied by decreased function of brain substrates for drug positive reinforcement and recruitment of brain substrates mediating the negative reinforcement of motivational withdrawal. The neural substrates for motivational withdrawal ("dark side" of addiction) involve recruitment of elements of the extended amygdala and the brain stress systems, including corticotropin-releasing factor and norepinephrine. These changes, combined with decreased reward function, are hypothesized to persist in the form of an allostatic state that forms a powerful motivational background for relapse. Relapse also involves a key role for the basolateral amygdala in mediating the motivational effects of stimuli previously paired with drug seeking and drug motivational withdrawal. The basolateral amygdala has a key role in mediating emotional memories in general. The hypothesis argued here is that brain stress systems activated by the motivational consequences of drug withdrawal can not only form the basis for negative reinforcement that drives drug seeking, but also potentiate associative mechanisms that perpetuate the emotional state and help drive the allostatic state of addiction.

Electrical stimulation of the lateral habenula produces an inhibitory effect on sucrose self-administration.

PubMed

Friedman, Alexander; Lax, Elad; Dikshtein, Yahav; Abraham, Lital; Flaumenhaft, Yakov; Sudai, Einav; Ben-Tzion, Moshe; Yadid, Gal

2011-01-01

The lateral habenula (LHb) plays a role in prediction of negative reinforcement, punishment and aversive responses. In the current study, we examined the role that the LHb plays in regulation of negative reward responses and aversion. First, we tested the effect of intervention in LHb activity on sucrose reinforcing behavior. An electrode was implanted into the LHb and rats were trained to self-administer sucrose (20%; 16 days) until at least three days of stable performance were achieved (as represented by the number of active lever presses in self-administration cages). Rats subsequently received deep brain stimulation (DBS) of the LHb, which significantly reduced sucrose self-administration levels. In contrast, lesion of the LHb increased sucrose-seeking behavior, as demonstrated by a delayed extinction response to substitution of sucrose with water. Furthermore, in a modified non-rewarding conditioned-place-preference paradigm, DBS of the LHb led to aversion to the context associated with stimulation of this brain region. We postulate that electrical stimulation of the LHb attenuates positive reward-associated reinforcement by natural substances. Copyright © 2010 Elsevier Ltd. All rights reserved.

Competing stimuli in the treatment of multiply controlled problem behavior during hygiene routines.

PubMed

Long, Ethan S; Hagopian, Louis P; Deleon, Iser G; Marhefka, Jean Marie; Resau, Dawn

2005-01-01

The current study describes the use of noncontingent competing stimuli in the treatment of problem behavior exhibited by three individuals during staff-assisted hygiene routines. Functional analyses revealed that particular topographies of problem behaviors appeared to be maintained by their own sensory consequences, whereas other topographies appeared to be maintained by escape from demands. Competing stimulus assessments were then conducted to identify items associated with low levels of automatically-maintained problem behavior and high levels of stimulus engagement. Stimuli associated with low levels of automatically-maintained problem behavior (competing stimuli) were then delivered noncontingently during staff-assisted hygiene routines that were problematic for each participant. In all three cases, substantial reductions in all problem behaviors were observed. These results are discussed in terms of the relative ease of this intervention and possible mechanisms underlying the effects of competing stimuli on behaviors maintained by different types of reinforcement.

Sensitivity to value-driven attention is predicted by how we learn from value.

PubMed

Jahfari, Sara; Theeuwes, Jan

2017-04-01

Reward learning is known to influence the automatic capture of attention. This study examined how the rate of learning, after high- or low-value reward outcomes, can influence future transfers into value-driven attentional capture. Participants performed an instrumental learning task that was directly followed by an attentional capture task. A hierarchical Bayesian reinforcement model was used to infer individual differences in learning from high or low reward. Results showed a strong relationship between high-reward learning rates (or the weight that is put on learning after a high reward) and the magnitude of attentional capture with high-reward colors. Individual differences in learning from high or low rewards were further related to performance differences when high- or low-value distractors were present. These findings provide novel insight into the development of value-driven attentional capture by showing how information updating after desired or undesired outcomes can influence future deployments of automatic attention.

Exercise-enhanced Neuroplasticity Targeting Motor and Cognitive Circuitry in Parkinson’s Disease

PubMed Central

Petzinger, G. M.; Fisher, B. E.; McEwen, S.; Beeler, J. A.; Walsh, J. P.; Jakowec, M. W.

2013-01-01

The purpose of this review is to highlight the potential role of exercise in promoting neuroplasticity and repair in Parkinson’s disease (PD). Exercise interventions in individuals with PD incorporate goal-based motor skill training in order to engage cognitive circuitry important in motor learning. Using this exercise approach, physical therapy facilitates learning through instruction and feedback (reinforcement), and encouragement to perform beyond self-perceived capability. Individuals with PD become more cognitively engaged with the practice and learning of movements and skills that were previously automatic and unconscious. Studies that have incorporated both goal-based training and aerobic exercise have supported the potential for improving both cognitive and automatic components of motor control. Utilizing animal models, basic research is beginning to reveal exercise-induced effects on neuroplasticity. Since neuroplasticity occurs at the level of circuits and synaptic connections, we examine the effects of exercise from this perspective. PMID:23769598

A Simulation of Low and High Cycle Fatigue Failure Effects for Metal Matrix Composites Based on Innovative J2-Flow Elastoplasticity Model

PubMed Central

Wang, Zhaoling; Xiao, Heng

2017-01-01

New elastoplastic J2-flow constitutive equations at finite deformations are proposed for the purpose of simulating the fatigue failure behavior for metal matrix composites. A new, direct approach is established in a two-fold sense of unification. Namely, both low and high cycle fatigue failure effects of metal matrix composites may be simultaneously simulated for various cases of the weight percentage of reinforcing particles. Novel results are presented in four respects. First, both the yield condition and the loading–unloading conditions in a usual sense need not be involved but may be automatically incorporated into inherent features of the proposed constitutive equations; second, low-to-high cycle fatigue failure effects may be directly represented by a simple condition for asymptotic loss of the material strength, without involving any additional damage-like variables; third, both high and low cycle fatigue failure effects need not be separately treated but may be automatically derived as model predictions with a unified criterion for critical failure states, without assuming any ad hoc failure criteria; and, finally, explicit expressions for each incorporated model parameter changing with the weight percentage of reinforcing particles may be obtainable directly from appropriate test data. Numerical examples are presented for medium-to-high cycle fatigue failure effects and for complicated duplex effects from low to high cycle fatigue failure effects. Simulation results are in good agreement with experimental data. PMID:28946637

Incorporation of composite defects from ultrasonic NDE into CAD and FE models

NASA Astrophysics Data System (ADS)

Bingol, Onur Rauf; Schiefelbein, Bryan; Grandin, Robert J.; Holland, Stephen D.; Krishnamurthy, Adarsh

2017-02-01

Fiber-reinforced composites are widely used in aerospace industry due to their combined properties of high strength and low weight. However, owing to their complex structure, it is difficult to assess the impact of manufacturing defects and service damage on their residual life. While, ultrasonic testing (UT) is the preferred NDE method to identify the presence of defects in composites, there are no reasonable ways to model the damage and evaluate the structural integrity of composites. We have developed an automated framework to incorporate flaws and known composite damage automatically into a finite element analysis (FEA) model of composites, ultimately aiding in accessing the residual life of composites and make informed decisions regarding repairs. The framework can be used to generate a layer-by-layer 3D structural CAD model of the composite laminates replicating their manufacturing process. Outlines of structural defects, such as delaminations, are automatically detected from UT of the laminate and are incorporated into the CAD model between the appropriate layers. In addition, the framework allows for direct structural analysis of the resulting 3D CAD models with defects by automatically applying the appropriate boundary conditions. In this paper, we show a working proof-of-concept for the composite model builder with capabilities of incorporating delaminations between laminate layers and automatically preparing the CAD model for structural analysis using a FEA software.

Influence of the Western Pacific teleconnection pattern on Western North Pacific tropical cyclone activity

NASA Astrophysics Data System (ADS)

Choi, Ki-Seon; Moon, Il-Ju

2012-09-01

This study analyzes the characteristics of Western North Pacific (WNP) tropical cyclone (TC) activity and large-scale environments according to the Western Pacific (WP) teleconnection pattern in summer. In the positive WP phase, an anomalous cyclone and an anomalous anticyclone develop in the low and middle latitudes of the East Asia area, respectively. As a result, southeasterlies are reinforced in the northeast area of East Asia (including Korea and Japan), which facilitates the movement of TC to this area, whereas northwesterlies are reinforced in the southwest area of East Asia (including southern China and the Indochina Peninsula) which blocks the movement of TC to that area. Due to the spatial distribution of this reinforced pressure system, TCs that develop during the positive WP phase move and turn more to the northeast of the WNP than TCs which develop during the negative WP phase. The characteristics of this TC activity during the positive WP phase are associated with the upper tropospheric jet being located farther to the northeast. TCs during the negative WP phase mainly move to the west from the Philippines toward southern China and the Indochina Peninsula. Due to the terrain effect caused by the passage of TCs in mainland China, the intensity of TCs during the negative WP phase is weaker than those during the positive WP phase.

Origin of Emotion Effects on ERP Correlates of Emotional Word Processing: The Emotion Duality Approach.

PubMed

Imbir, Kamil Konrad; Jarymowicz, Maria Teresa; Spustek, Tomasz; Kuś, Rafał; Żygierewicz, Jarosław

2015-01-01

We distinguish two evaluative systems which evoke automatic and reflective emotions. Automatic emotions are direct reactions to stimuli whereas reflective emotions are always based on verbalized (and often abstract) criteria of evaluation. We conducted an electroencephalography (EEG) study in which 25 women were required to read and respond to emotional words which engaged either the automatic or reflective system. Stimulus words were emotional (positive or negative) and neutral. We found an effect of valence on an early response with dipolar fronto-occipital topography; positive words evoked a higher amplitude response than negative words. We also found that topographically specific differences in the amplitude of the late positive complex were related to the system involved in processing. Emotional stimuli engaging the automatic system were associated with significantly higher amplitudes in the left-parietal region; the response to neutral words was similar regardless of the system engaged. A different pattern of effects was observed in the central region, neutral stimuli engaging the reflective system evoked a higher amplitudes response whereas there was no system effect for emotional stimuli. These differences could not be reduced to effects of differences between the arousing properties and concreteness of the words used as stimuli.

Automatic and controlled attentional orienting in the elderly: A dual-process view of the positivity effect.

PubMed

Gronchi, G; Righi, S; Pierguidi, L; Giovannelli, F; Murasecco, I; Viggiano, M P

2018-04-01

The positivity effect in the elderly consists of an attentional preference for positive information as well as avoidance of negative information. Extant theories predict either that the positivity effect depends on controlled attentional processes (socio-emotional selectivity theory), or on an automatic gating selection mechanism (dynamic integration theory). This study examined the role of automatic and controlled attention in the positivity effect. Two dot-probe tasks (with the duration of the stimuli lasting 100 ms and 500 ms, respectively) were employed to compare the attentional bias of 35 elderly people to that of 35 young adults. The stimuli used were expressive faces displaying neutral, disgusted, fearful, and happy expressions. In comparison to young people, the elderly allocated more attention to happy faces at 100 ms and they tended to avoid fearful faces at 500 ms. The findings are not predicted by either theory taken alone, but support the hypothesis that the positivity effect in the elderly is driven by two different processes: an automatic attention bias toward positive stimuli, and a controlled mechanism that diverts attention away from negative stimuli. Copyright © 2018 Elsevier B.V. All rights reserved.

Origin of Emotion Effects on ERP Correlates of Emotional Word Processing: The Emotion Duality Approach

PubMed Central

Imbir, Kamil Konrad; Jarymowicz, Maria Teresa; Spustek, Tomasz; Kuś, Rafał; Żygierewicz, Jarosław

2015-01-01

We distinguish two evaluative systems which evoke automatic and reflective emotions. Automatic emotions are direct reactions to stimuli whereas reflective emotions are always based on verbalized (and often abstract) criteria of evaluation. We conducted an electroencephalography (EEG) study in which 25 women were required to read and respond to emotional words which engaged either the automatic or reflective system. Stimulus words were emotional (positive or negative) and neutral. We found an effect of valence on an early response with dipolar fronto-occipital topography; positive words evoked a higher amplitude response than negative words. We also found that topographically specific differences in the amplitude of the late positive complex were related to the system involved in processing. Emotional stimuli engaging the automatic system were associated with significantly higher amplitudes in the left-parietal region; the response to neutral words was similar regardless of the system engaged. A different pattern of effects was observed in the central region, neutral stimuli engaging the reflective system evoked a higher amplitudes response whereas there was no system effect for emotional stimuli. These differences could not be reduced to effects of differences between the arousing properties and concreteness of the words used as stimuli. PMID:25955719

Employment-based Reinforcement of Adherence to Oral Naltrexone in Unemployed Injection Drug Users: 12-month Outcomes

PubMed Central

Dunn, Kelly; DeFulio, Anthony; Everly, Jeffrey J.; Donlin, Wendy D.; Aklin, Will M.; Nuzzo, Paul A.; Leoutsakos, Jeannie-Marie S.; Umbricht, Annie; Fingerhood, Michael; Bigelow, George E.; Silverman, Kenneth

2015-01-01

Oral naltrexone could be a promising relapse prevention pharmacotherapy for recently detoxified opioid-dependent patients, however interventions are often needed to promote adherence with this treatment approach. We recently conducted a study to evaluate a 26-week employment-based reinforcement intervention of oral naltrexone in unemployed injection drug users (Dunn et al., 2013). Participants were randomly assigned into a Contingency (n=35) group required to ingest naltrexone under staff observation to gain entry into a therapeutic workplace, or a Prescription (n=32) group given a take-home supply of oral naltrexone and access to the workplace without observed ingestion. Monthly urine samples were collected and analyzed for evidence for naltrexone adherence, opioid use, and cocaine use. As previously reported, Contingency participants provided significantly more naltrexone-positive urine samples than Prescription participants during the 26-week intervention period. The goal of this current study is to report the 12-month outcomes, which occurred 6 months after the intervention ended. Results at the 12-month visit showed no between-group differences in naltrexone-positive, opioid-negative, or cocaine-negative urine samples, and no participant self-reported using naltrexone at the follow-up visit. These results show that even after a period of successfully reinforced oral naltrexone adherence longer-term naltrexone use is unlikely to be maintained after reinforcement contingencies are discontinued. PMID:25134047

Free-Operant Avoidance Behavior by Rats after Reinforcer Revaluation Using Opioid Agonists and d-Amphetamine

PubMed Central

Urcelay, Gonzalo; Mar, Adam; Dickinson, Anthony; Robbins, Trevor

2014-01-01

The associative processes that support free-operant instrumental avoidance behavior are still unknown. We used a revaluation procedure to determine whether the performance of an avoidance response is sensitive to the current value of the aversive, negative reinforcer. Rats were trained on an unsignaled, free-operant lever press avoidance paradigm in which each response avoided or escaped shock and produced a 5 s feedback stimulus. The revaluation procedure consisted of noncontingent presentations of the shock in the absence of the lever either paired or unpaired with systemic morphine and in a different cohort with systemic d-amphetamine. Rats were then tested drug free during an extinction test. In both the d-amphetamine and morphine groups, pairing of the drug and shock decreased subsequent avoidance responding during the extinction test, suggesting that avoidance behavior was sensitive to the current incentive value of the aversive negative reinforcer. Experiment 2 used central infusions of D-Ala2, NMe-Phe4, Gly-ol5]-enkephalin (DAMGO), a mu-opioid receptor agonist, in the periacqueductal gray and nucleus accumbens shell to revalue the shock. Infusions of DAMGO in both regions replicated the effects seen with systemic morphine. These results are the first to demonstrate the impact of revaluation of an aversive reinforcer on avoidance behavior using pharmacological agents, thereby providing potential therapeutic targets for the treatment of avoidance behavior symptomatic of anxiety disorders. PMID:24790199

Allergic contact dermatitis from a nonbisphenol A epoxy in a graphite fiber reinforced epoxy laminate.

PubMed

Mathias, C G

1987-09-01

An employee of the Composites Division of an aircraft engine manufacturing firm developed dermatitis associated with the handling of a graphite fiber reinforced epoxy laminate (epoxy prepreg). Patch test investigation demonstrated that the responsible causal agent was the nonbisphenol A epoxy binder, 4-glycidyloxy-N, N-diglycidylaniline. A patch test with bisphenol A epoxy from a standard patch test screening series was negative. Subsequent interviews with employees of the Composites Division suggested that a relative lack of awareness of the cutaneous hazards of fiber reinforced epoxy laminates, compared with liquid epoxy resin systems, may be an important risk factor for allergic sensitization to these composite materials.

Motivational Processes Underlying Substance Abuse Disorder.

PubMed

Meyer, Paul J; King, Christopher P; Ferrario, Carrie R

2016-01-01

Drug addiction is a syndrome of dysregulated motivation, evidenced by intense drug craving and compulsive drug-seeking behavior. In the search for 'common neurobiological substrates of addiction to different classes of drugs, behavioral neuroscientists have attempted to determine the neural basis for a number of motivational concepts and describe how they are changed by repeated drug use. Here, we describe these concepts and summarize previous work describing three major neural systems that play distinct roles in different conceptual aspects of motivation: (1) a nigrostriatal system that is involved in two forms of instrumental learning, (2) a ventral striatal system that is involved in Pavlovian incentive motivation and negative reinforcement, and (3) frontal cortical areas that regulate decision making and motivational processes. Within striatal systems, drug addiction can involve a transition from goal-oriented, incentive processes to automatic, habit-based responding. In the cortex, weak inhibitory control is a predisposing factor to, as well as a consequence of, repeated drug intake. However, these transitions are not absolute, and addiction can occur without a transition to habit-based responding, occurring as a result of the overvaluation of drug outcomes and hypersensitivity to incentive properties of drug-associated cues. Finally, we point out that addiction is not monolithic and can depend not only on individual differences between addicts, but also on the neurochernical action of specific drug classes.

Psychometric Properties of the Adolescent Reinforcement Survey Schedule – Alcohol Use Version with College Student Drinkers

PubMed Central

Hallgren, Kevin A.; Greenfield, Brenna L.; Ladd, Benjamin O.

2016-01-01

Background Behavioral economic theories of drinking posit that the reinforcing value of engaging in activities with versus without alcohol influences drinking behavior. Measures of the reinforcement value of drugs and alcohol have been used in previous research, but little work has examined the psychometric properties of these measures. Objectives The present study aims to evaluate the factor structure, test-retest reliability, and concurrent validity of an alcohol-only version of the Adolescent Reinforcement Survey Schedule (ARSS-AUV). Methods A sample of 157 college student drinkers completed the ARSS-AUV at two time points 2–3 days apart. Test-retest reliability, hierarchical factor analysis, and correlations with other drinking measures were examined. Results Single, unidimensional general factors accounted for a majority of the variance in alcohol and alcohol-free reinforcement items. Residual factors emerged that typically represented alcohol or alcohol-free reinforcement while doing activities with friends, romantic or sexual partners, and family members. Individual ARSS-AUV items had fair-to-good test-retest reliability, while general and residual factors had excellent test-retest reliability. General alcohol reinforcement and alcohol reinforcement from friends and romantic partners were positively correlated with past-year alcohol consumption, heaviest drinking episode, and alcohol-related negative consequences. Alcohol-free reinforcement indices were unrelated to alcohol use or consequences. Conclusions/Importance The ARSS-AUV appears to demonstrate good reliability and mixed concurrent validity among college student drinkers. The instrument may provide useful information about alcohol reinforcement from various activities and people and could provide clinically-relevant information for prevention and treatment programs. PMID:27096713

Psychometric Properties of the Adolescent Reinforcement Survey Schedule-Alcohol Use Version with College Student Drinkers.

PubMed

Hallgren, Kevin A; Greenfield, Brenna L; Ladd, Benjamin O

2016-06-06

Behavioral economic theories of drinking posit that the reinforcing value of engaging in activities with versus without alcohol influences drinking behavior. Measures of the reinforcement value of drugs and alcohol have been used in previous research, but little work has examined the psychometric properties of these measures. The present study aims to evaluate the factor structure, test-retest reliability, and concurrent validity of an alcohol-only version of the Adolescent Reinforcement Survey Schedule (ARSS-AUV). A sample of 157 college student drinkers completed the ARSS-AUV at two time points 2-3 days apart. Test-retest reliability, hierarchical factor analysis, and correlations with other drinking measures were examined. Single, unidimensional general factors accounted for a majority of the variance in alcohol and alcohol-free reinforcement items. Residual factors emerged that typically represented alcohol or alcohol-free reinforcement while doing activities with friends, romantic or sexual partners, and family members. Individual ARSS-AUV items had fair-to-good test-retest reliability, while general and residual factors had excellent test-retest reliability. General alcohol reinforcement and alcohol reinforcement from friends and romantic partners were positively correlated with past-year alcohol consumption, heaviest drinking episode, and alcohol-related negative consequences. Alcohol-free reinforcement indices were unrelated to alcohol use or consequences. The ARSS-AUV appears to demonstrate good reliability and mixed concurrent validity among college student drinkers. The instrument may provide useful information about alcohol reinforcement from various activities and people and could provide clinically-relevant information for prevention and treatment programs.

The Origins of Individual Differences in How Learning Is Expressed in Rats: A General-Process Perspective

PubMed Central

2016-01-01

Laboratory rats can exhibit marked, qualitative individual differences in the form of acquired behaviors. For example, when exposed to a signal-reinforcer relationship some rats show marked and consistent changes in sign-tracking (interacting with the signal; e.g., a lever) and others show marked and consistent changes in goal-tracking (interacting with the location of the predicted reinforcer; e.g., the food well). Here, stable individual differences in rats’ sign-tracking and goal-tracking emerged over the course of training, but these differences did not generalize across different signal-reinforcer relationships (Experiment 1). This selectivity suggests that individual differences in sign- and goal-tracking reflect differences in the value placed on individual reinforcers. Two findings provide direct support for this interpretation: the palatability of a reinforcer (as measured by an analysis of lick-cluster size) was positively correlated with goal-tracking (and negatively correlated with sign-tracking); and sating rats with a reinforcer affected goal-tracking but not sign-tracking (Experiment 2). These results indicate that the observed individual differences in sign- and goal-tracking behavior arise from the interaction between the palatability or value of the reinforcer and processes of association as opposed to dispositional differences (e.g., in sensory processes, “temperament,” or response repertoire). PMID:27732045

Working Memory and Reinforcement Schedule Jointly Determine Reinforcement Learning in Children: Potential Implications for Behavioral Parent Training

PubMed Central

Segers, Elien; Beckers, Tom; Geurts, Hilde; Claes, Laurence; Danckaerts, Marina; van der Oord, Saskia

2018-01-01

Introduction: Behavioral Parent Training (BPT) is often provided for childhood psychiatric disorders. These disorders have been shown to be associated with working memory impairments. BPT is based on operant learning principles, yet how operant principles shape behavior (through the partial reinforcement (PRF) extinction effect, i.e., greater resistance to extinction that is created when behavior is reinforced partially rather than continuously) and the potential role of working memory therein is scarcely studied in children. This study explored the PRF extinction effect and the role of working memory therein using experimental tasks in typically developing children. Methods: Ninety-seven children (age 6–10) completed a working memory task and an operant learning task, in which children acquired a response-sequence rule under either continuous or PRF (120 trials), followed by an extinction phase (80 trials). Data of 88 children were used for analysis. Results: The PRF extinction effect was confirmed: We observed slower acquisition and extinction in the PRF condition as compared to the continuous reinforcement (CRF) condition. Working memory was negatively related to acquisition but not extinction performance. Conclusion: Both reinforcement contingencies and working memory relate to acquisition performance. Potential implications for BPT are that decreasing working memory load may enhance the chance of optimally learning through reinforcement. PMID:29643822

High and low temperatures have unequal reinforcing properties in Drosophila spatial learning.

PubMed

Zars, Melissa; Zars, Troy

2006-07-01

Small insects regulate their body temperature solely through behavior. Thus, sensing environmental temperature and implementing an appropriate behavioral strategy can be critical for survival. The fly Drosophila melanogaster prefers 24 degrees C, avoiding higher and lower temperatures when tested on a temperature gradient. Furthermore, temperatures above 24 degrees C have negative reinforcing properties. In contrast, we found that flies have a preference in operant learning experiments for a low-temperature-associated position rather than the 24 degrees C alternative in the heat-box. Two additional differences between high- and low-temperature reinforcement, i.e., temperatures above and below 24 degrees C, were found. Temperatures equally above and below 24 degrees C did not reinforce equally and only high temperatures supported increased memory performance with reversal conditioning. Finally, low- and high-temperature reinforced memories are similarly sensitive to two genetic mutations. Together these results indicate the qualitative meaning of temperatures below 24 degrees C depends on the dynamics of the temperatures encountered and that the reinforcing effects of these temperatures depend on at least some common genetic components. Conceptualizing these results using the Wolf-Heisenberg model of operant conditioning, we propose the maximum difference in experienced temperatures determines the magnitude of the reinforcement input to a conditioning circuit.

Linking automatic evaluation to mood and information processing style: consequences for experienced affect, impression formation, and stereotyping.

PubMed

Chartrand, Tanya L; van Baaren, Rick B; Bargh, John A

2006-02-01

According to the feelings-as-information account, a person's mood state signals to him or her the valence of the current environment (N. Schwarz & G. Clore, 1983). However, the ways in which the environment automatically influences mood in the first place remain to be explored. The authors propose that one mechanism by which the environment influences affect is automatic evaluation, the nonconscious evaluation of environmental stimuli as good or bad. A first experiment demonstrated that repeated brief exposure to positive or negative stimuli (which leads to automatic evaluation) induces a corresponding mood in participants. In 3 additional studies, the authors showed that automatic evaluation affects information processing style. Experiment 4 showed that participants' mood mediates the effect of valenced brief primes on information processing. ((c) 2006 APA, all rights reserved).

Linking Automatic Evaluation to Mood and Information Processing Style: Consequences for Experienced Affect, Impression Formation, and Stereotyping

PubMed Central

Chartrand, Tanya L.; van Baaren, Rick B.; Bargh, John A.

2009-01-01

According to the feelings-as-information account, a person’s mood state signals to him or her the valence of the current environment (N. Schwarz & G. Clore, 1983). However, the ways in which the environment automatically influences mood in the first place remain to be explored. The authors propose that one mechanism by which the environment influences affect is automatic evaluation, the nonconscious evaluation of environmental stimuli as good or bad. A first experiment demonstrated that repeated brief exposure to positive or negative stimuli (which leads to automatic evaluation) induces a corresponding mood in participants. In 3 additional studies, the authors showed that automatic evaluation affects information processing style. Experiment 4 showed that participants’ mood mediates the effect of valenced brief primes on information processing. PMID:16478316

Alcohol Use in College Students as a Function of Reinforcement Sensitivity, Life Events, and Affect

ERIC Educational Resources Information Center

Lee, Hyoung Suk

2010-01-01

Mood has been commonly viewed as an important determinant of drinking, but studies of positive and negative affect and alcohol use have reported inconsistent results. It has been suggested that the relationship between negative affect and heavy drinking or drinking problems depends on individual vulnerability dimensions such as personality. Gray's…

Interpersonal problems and negative affect in Borderline Personality and Depressive Disorders in daily life

PubMed Central

Hepp, Johanna; Lane, Sean P.; Carpenter, Ryan W.; Niedtfeld, Inga; Brown, Whitney C.; Trull, Timothy J.

2016-01-01

Theories of Borderline Personality Disorder (BPD) suggest that interpersonal problems in BPD act as triggers for negative affect and, at the same time, are a possible result of affective dysregulation. Therefore, we assessed the relations between momentary negative affect (hostility, sadness, fear) and interpersonal problems (rejection, disagreement) in a sample of 80 BPD and 51 depressed outpatients at 6 time-points over 28 days. Data were analyzed using multivariate multi-level modeling to separate momentary-, day-, and person-level effects. Results revealed a mutually reinforcing relationship between disagreement and hostility, rejection and hostility, and between rejection and sadness in both groups, at the momentary and day level. The mutual reinforcement between hostility and rejection/disagreement was significantly stronger in the BPD group. Moreover, the link between rejection and sadness was present at all three levels of analysis for the BPD group, while it was localized to the momentary level in the depressed group. PMID:28529826

Reinforcement Learning Deficits in People with Schizophrenia Persist after Extended Trials

PubMed Central

Cicero, David C.; Martin, Elizabeth A.; Becker, Theresa M.; Kerns, John G.

2014-01-01

Previous research suggests that people with schizophrenia have difficulty learning from positive feedback and when learning needs to occur rapidly. However, they seem to have relatively intact learning from negative feedback when learning occurs gradually. Participants are typically given a limited amount of acquisition trials to learn the reward contingencies and then tested about what they learned. The current study examined whether participants with schizophrenia continue to display these deficits when given extra time to learn the contingences. Participants with schizophrenia and matched healthy controls completed the Probabilistic Selection Task, which measures positive and negative feedback learning separately. Participants with schizophrenia showed a deficit in learning from both positive and negative feedback. These reward learning deficits persisted even if people with schizophrenia are given extra time (up to 10 blocks of 60 trials) to learn the reward contingencies. These results suggest that the observed deficits cannot be attributed solely to slower learning and instead reflect a specific deficit in reinforcement learning. PMID:25172610

Reinforcement learning deficits in people with schizophrenia persist after extended trials.

PubMed

Cicero, David C; Martin, Elizabeth A; Becker, Theresa M; Kerns, John G

2014-12-30

Previous research suggests that people with schizophrenia have difficulty learning from positive feedback and when learning needs to occur rapidly. However, they seem to have relatively intact learning from negative feedback when learning occurs gradually. Participants are typically given a limited amount of acquisition trials to learn the reward contingencies and then tested about what they learned. The current study examined whether participants with schizophrenia continue to display these deficits when given extra time to learn the contingences. Participants with schizophrenia and matched healthy controls completed the Probabilistic Selection Task, which measures positive and negative feedback learning separately. Participants with schizophrenia showed a deficit in learning from both positive feedback and negative feedback. These reward learning deficits persisted even if people with schizophrenia are given extra time (up to 10 blocks of 60 trials) to learn the reward contingencies. These results suggest that the observed deficits cannot be attributed solely to slower learning and instead reflect a specific deficit in reinforcement learning. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Buffers or Boosters? The Role of HRM Practices in Older Workers' Experience of Stereotype Threat.

PubMed

Oliveira, Eduardo André da Silva; Cabral-Cardoso, Carlos José

2018-01-02

Building on the social identity approach and the HRM literature, this two-wave cross-sectional study examined the effects of negative age-based metastereotypes on the age-based stereotype threat experience of older workers and on organizational disidentification. The moderator role of HRM practices in the relationship between negative age-based metastereotypes and age-based stereotype threat was also investigated. Older workers survey results (n = 469) from 14 manufacturing companies indicated that negative age-based metastereotypes correlate positively with stereotype threat. Moderation results showed that age-awareness HRM practices (training for older workers) reinforced age-based stereotype threat, whereas general HRM practices (recognition and respect) impaired it. The article suggests that the combination of age-based metastereotypes with a stereotype threat framework contributes to further understand older workers' beliefs and attitudes. It also indicates that to be effective, HRM practices should emphasize positive social identities older workers share with their colleagues, rather than giving older workers special treatment that may, after all, reinforce stigmatization.

Stimuli inevitably generated by behavior that avoids electric shock are inherently reinforcing.

PubMed Central

Dinsmoor, J A

2001-01-01

A molecular analysis based on the termination of stimuli that are positively correlated with shock and the production of stimuli that are negatively correlated with shock provides a parsimonious count for both traditional discrete-trial avoidance behavior and the data derived from more recent free-operant procedures. The necessary stimuli are provided by the intrinsic feedback generated by the subject's behavior, in addition to those presented by the experimenter. Moreover, all data compatible with the molar principle of shock-frequency reduction as reinforcement are also compatible with a delay-of-shock gradient, but some data compatible with the delay gradient are not compatible with frequency reduction. The delay gradient corresponds to functions relating magnitude of behavioral effect to the time between conditional and unconditional stimuli, the time between conditioned and primary reinforcers, and the time between responses and positive reinforcers. PMID:11453621

Self-control across species (Columba livia, Homo sapiens, and Rattus norvegicus).

PubMed

Tobin, H; Logue, A W

1994-06-01

Data from six previous studies of self-control behavior were compared against predictions made by the matching law and by molar maximization. The studies involved pigeons (Columba livia), rats (Rattus norvegicus), and 3-year-old, 5-year-old, and adult humans (Homo sapiens) who had received food as the reinforcer, and adult humans who had received points exchangeable for money as the reinforcer. Neither theory proved to be an accurate or better predictor for all groups. In contrast to the predictions of these theories, self-control was shown to vary according to species, human age group, and reinforcer quality. When the reinforcer was food, the self-control of different species was found to be negatively correlated with metabolic rate; that is, larger species showed greater self-control. These results suggest that allometric scaling may prove useful in describing and predicting species differences in self-control.

Food cravings in food addiction: the distinct role of positive reinforcement.

PubMed

Meule, Adrian; Kübler, Andrea

2012-08-01

Craving for a particular substance is an essential characteristic of addictive behavior. Increasing evidence suggests that food cravings and excessive food consumption could similarly be due to addictive processes. Recently, the Yale Food Addiction Scale (YFAS) was introduced for identifying individuals with addictive eating patterns. We conducted an online study (n=616, 75.8% female) in which participants filled out the YFAS and the Food Cravings Questionnaire-Trait (FCQ-T). Participants diagnosed as being addicted to food using the YFAS had higher scores on all food craving subscales except for anticipation of positive reinforcement that may result from eating. In a subsequent regression analysis, all food craving subscales positively predicted food addiction symptoms while positive reinforcement negatively predicted food addiction symptoms. Similar to other addictive behaviors, results indicate that individuals with addictive eating patterns experience more food cravings, but concurrently do not expect a positive reinforcement through eating. Copyright © 2012 Elsevier Ltd. All rights reserved.

Cognitive-Affective Dimensions of Female Orgasm: The Role of Automatic Thoughts and Affect During Sexual Activity.

PubMed

Tavares, Inês M; Laan, Ellen T M; Nobre, Pedro J

2017-06-01

Cognitive-affective factors contribute to female sexual dysfunctions, defined as clinically significant difficulties in the ability to respond sexually or to experience sexual pleasure. Automatic thoughts and affect presented during sexual activity are acknowledged as maintenance factors for these difficulties. However, there is a lack of studies on the influence of these cognitive-affective dimensions regarding female orgasm. To assess the role of automatic thoughts and affect during sexual activity in predicting female orgasm occurrence and to investigate the mediator role of these variables in the relation between sexual activity and orgasm occurrence. Nine hundred twenty-six sexually active heterosexual premenopausal women reported on frequency of sexual activities and frequency of orgasm occurrence, cognitive factors, and social desirability. Participants completed the Sexual Modes Questionnaire-Automatic Thoughts Subscale, the Positive and Negative Affect Schedule, and the Socially Desirable Response Set. Multiple linear regressions and mediation analyses were performed, controlling for the effect of covariates such as social desirability, sociodemographic and medical characteristics, and relationship factors. The main outcome measurement was orgasm frequency as predicted and mediated by automatic thoughts and affect experienced during sexual activities. The presence of failure thoughts and lack of erotic thoughts during sexual activity significantly and negatively predicted female orgasm, whereas positive affect experienced during sexual activity significantly and positively predicted female orgasm. Moreover, negative automatic thoughts and positive affect during sexual activity were found to mediate the relation between sexual activity and female orgasm occurrence. These data suggest that the cognitive aspects of sexual involvement are critical to enhancing female orgasm experience and can aid the development of strategies that contemplate the central role of automatic thoughts and of positive emotions experienced during sexual activity. Data were not collected face to face, which constitutes a strength of this study, because it is known that social desirability is lower in self-administered online questionnaires compared with traditional paper-and-pencil questionnaires, particularly for more sensitive sexual issues. The fact that the sample was composed of heterosexual, premenopausal, and relatively young women demands some caution regarding generalization of the present results. The findings support the contribution of cognitive and affective factors to female orgasmic functioning. It is recommended that future research confirm these findings with other samples, particularly clinical samples of women with orgasmic difficulties. Tavares IM, Laan ETM, Nobre PJ. Cognitive-Affective Dimensions of Female Orgasm: The Role of Automatic Thoughts and Affect During Sexual Activity. J Sex Med 2017;14:818-828. Copyright © 2017 International Society for Sexual Medicine. Published by Elsevier Inc. All rights reserved.

Visual mismatch negativity indicates automatic, task-independent detection of artistic image composition in abstract artworks.

PubMed

Menzel, Claudia; Kovács, Gyula; Amado, Catarina; Hayn-Leichsenring, Gregor U; Redies, Christoph

2018-05-06

In complex abstract art, image composition (i.e., the artist's deliberate arrangement of pictorial elements) is an important aesthetic feature. We investigated whether the human brain detects image composition in abstract artworks automatically (i.e., independently of the experimental task). To this aim, we studied whether a group of 20 original artworks elicited a visual mismatch negativity when contrasted with a group of 20 images that were composed of the same pictorial elements as the originals, but in shuffled arrangements, which destroy artistic composition. We used a passive oddball paradigm with parallel electroencephalogram recordings to investigate the detection of image type-specific properties. We observed significant deviant-standard differences for the shuffled and original images, respectively. Furthermore, for both types of images, differences in amplitudes correlated with the behavioral ratings of the images. In conclusion, we show that the human brain can detect composition-related image properties in visual artworks in an automatic fashion. Copyright © 2018 Elsevier B.V. All rights reserved.

Automatic annotation of histopathological images using a latent topic model based on non-negative matrix factorization

PubMed Central

Cruz-Roa, Angel; Díaz, Gloria; Romero, Eduardo; González, Fabio A.

2011-01-01

Histopathological images are an important resource for clinical diagnosis and biomedical research. From an image understanding point of view, the automatic annotation of these images is a challenging problem. This paper presents a new method for automatic histopathological image annotation based on three complementary strategies, first, a part-based image representation, called the bag of features, which takes advantage of the natural redundancy of histopathological images for capturing the fundamental patterns of biological structures, second, a latent topic model, based on non-negative matrix factorization, which captures the high-level visual patterns hidden in the image, and, third, a probabilistic annotation model that links visual appearance of morphological and architectural features associated to 10 histopathological image annotations. The method was evaluated using 1,604 annotated images of skin tissues, which included normal and pathological architectural and morphological features, obtaining a recall of 74% and a precision of 50%, which improved a baseline annotation method based on support vector machines in a 64% and 24%, respectively. PMID:22811960

Word associations contribute to machine learning in automatic scoring of degree of emotional tones in dream reports.

PubMed

Amini, Reza; Sabourin, Catherine; De Koninck, Joseph

2011-12-01

Scientific study of dreams requires the most objective methods to reliably analyze dream content. In this context, artificial intelligence should prove useful for an automatic and non subjective scoring technique. Past research has utilized word search and emotional affiliation methods, to model and automatically match human judges' scoring of dream report's negative emotional tone. The current study added word associations to improve the model's accuracy. Word associations were established using words' frequency of co-occurrence with their defining words as found in a dictionary and an encyclopedia. It was hypothesized that this addition would facilitate the machine learning model and improve its predictability beyond those of previous models. With a sample of 458 dreams, this model demonstrated an improvement in accuracy from 59% to 63% (kappa=.485) on the negative emotional tone scale, and for the first time reached an accuracy of 77% (kappa=.520) on the positive scale. Copyright © 2011 Elsevier Inc. All rights reserved.

Credit WCT. Original 4"x5" black and white negative is housed ...

Library of Congress Historic Buildings Survey, Historic Engineering Record, Historic Landscapes Survey

Credit WCT. Original 4"x5" black and white negative is housed in the JPL Archives, Pasadena, California. This view shows Building E-39 under construction. E-39 is an example of the typical reinforced concrete block construction of the E-30s and E-40s structures (JPL negative no. 381-2586, 13 December 1962) - Jet Propulsion Laboratory Edwards Facility, Propellant Curing Building, Edwards Air Force Base, Boron, Kern County, CA

Cerebral Correlates of Automatic Associations Towards Performance Enhancing Substances

PubMed Central

Schindler, Sebastian; Wolff, Wanja

2015-01-01

The direct assessment of explicit attitudes toward performance enhancing substances, for example Neuroenhancement or doping in sports, can be affected by social desirability biases and cheating attempts. According to Dual Process Theories of cognition, indirect measures like the Implicit Association Test (IAT) measure automatic associations toward a topic (as opposed to explicit attitudes measured by self-report measures). Such automatic associations are thought to occur rapidly and to evade voluntary control. However, whether or not such indirect tests actually reflect automatic associations is difficult to validate. Electroencephalography (EEG) has a superior time resolution which can differentiate between highly automatic compared to more elaborate processing stages. We therefore used EEG to examine on which processing stages cortical differences between negative or positive attitudes to doping occur, and whether or not these differences can be related to BIAT scores. We tested 42 university students (31 females, 24.43 ± 3.17 years old), who were requested to complete a brief doping IAT (BIAT) on attitudes toward doping. Cerebral activity during doping BIAT completion was assessed using high-density EEG. Behaviorally, participants D-scores exhibited negative attitudes toward doping, represented by faster reaction times in the doping + dislike pairing task. Event-related potentials (ERPs) revealed earliest effects between 200 and 300 ms. Here, a relatively larger occipital positivity was found for the doping + dislike pairing task. Further, in the LPP time range between 400 and 600 ms a larger late positive potential was found for the doping + dislike pairing task over central regions. These LPP amplitude differences were successfully predicting participants' BIAT D-scores. Results indicate that event-related potentials differentiate between positive and negative doping attitudes at stages of mid-latency. However, it seems that IAT scores can be predicted only by the later occurring LPP. Our study is the first to investigate the cerebral correlates that contribute to test scores obtained in the indirect testing of automatic associations toward doping. The implications of our results for the broader NE concept are discussed in light of the conceptual similarity of doping and NE. PMID:26733914

Measuring reinforcement learning and motivation constructs in experimental animals: relevance to the negative symptoms of schizophrenia.

PubMed

Markou, Athina; Salamone, John D; Bussey, Timothy J; Mar, Adam C; Brunner, Daniela; Gilmour, Gary; Balsam, Peter

2013-11-01

The present review article summarizes and expands upon the discussions that were initiated during a meeting of the Cognitive Neuroscience Treatment Research to Improve Cognition in Schizophrenia (CNTRICS; http://cntrics.ucdavis.edu) meeting. A major goal of the CNTRICS meeting was to identify experimental procedures and measures that can be used in laboratory animals to assess psychological constructs that are related to the psychopathology of schizophrenia. The issues discussed in this review reflect the deliberations of the Motivation Working Group of the CNTRICS meeting, which included most of the authors of this article as well as additional participants. After receiving task nominations from the general research community, this working group was asked to identify experimental procedures in laboratory animals that can assess aspects of reinforcement learning and motivation that may be relevant for research on the negative symptoms of schizophrenia, as well as other disorders characterized by deficits in reinforcement learning and motivation. The tasks described here that assess reinforcement learning are the Autoshaping Task, Probabilistic Reward Learning Tasks, and the Response Bias Probabilistic Reward Task. The tasks described here that assess motivation are Outcome Devaluation and Contingency Degradation Tasks and Effort-Based Tasks. In addition to describing such methods and procedures, the present article provides a working vocabulary for research and theory in this field, as well as an industry perspective about how such tasks may be used in drug discovery. It is hoped that this review can aid investigators who are conducting research in this complex area, promote translational studies by highlighting shared research goals and fostering a common vocabulary across basic and clinical fields, and facilitate the development of medications for the treatment of symptoms mediated by reinforcement learning and motivational deficits. Copyright © 2013 Elsevier Ltd. All rights reserved.

Measuring reinforcement learning and motivation constructs in experimental animals: relevance to the negative symptoms of schizophrenia

PubMed Central

Markou, Athina; Salamone, John D.; Bussey, Timothy; Mar, Adam; Brunner, Daniela; Gilmour, Gary; Balsam, Peter

2013-01-01

The present review article summarizes and expands upon the discussions that were initiated during a meeting of the Cognitive Neuroscience Treatment Research to Improve Cognition in Schizophrenia (CNTRICS; http://cntrics.ucdavis.edu). A major goal of the CNTRICS meeting was to identify experimental procedures and measures that can be used in laboratory animals to assess psychological constructs that are related to the psychopathology of schizophrenia. The issues discussed in this review reflect the deliberations of the Motivation Working Group of the CNTRICS meeting, which included most of the authors of this article as well as additional participants. After receiving task nominations from the general research community, this working group was asked to identify experimental procedures in laboratory animals that can assess aspects of reinforcement learning and motivation that may be relevant for research on the negative symptoms of schizophrenia, as well as other disorders characterized by deficits in reinforcement learning and motivation. The tasks described here that assess reinforcement learning are the Autoshaping Task, Probabilistic Reward Learning Tasks, and the Response Bias Probabilistic Reward Task. The tasks described here that assess motivation are Outcome Devaluation and Contingency Degradation Tasks and Effort-Based Tasks. In addition to describing such methods and procedures, the present article provides a working vocabulary for research and theory in this field, as well as an industry perspective about how such tasks may be used in drug discovery. It is hoped that this review can aid investigators who are conducting research in this complex area, promote translational studies by highlighting shared research goals and fostering a common vocabulary across basic and clinical fields, and facilitate the development of medications for the treatment of symptoms mediated by reinforcement learning and motivational deficits. PMID:23994273

Trust, control strategies and allocation of function in human-machine systems.

PubMed

Lee, J; Moray, N

1992-10-01

As automated controllers supplant human intervention in controlling complex systems, the operators' role often changes from that of an active controller to that of a supervisory controller. Acting as supervisors, operators can choose between automatic and manual control. Improperly allocating function between automatic and manual control can have negative consequences for the performance of a system. Previous research suggests that the decision to perform the job manually or automatically depends, in part, upon the trust the operators invest in the automatic controllers. This paper reports an experiment to characterize the changes in operators' trust during an interaction with a semi-automatic pasteurization plant, and investigates the relationship between changes in operators' control strategies and trust. A regression model identifies the causes of changes in trust, and a 'trust transfer function' is developed using time series analysis to describe the dynamics of trust. Based on a detailed analysis of operators' strategies in response to system faults we suggest a model for the choice between manual and automatic control, based on trust in automatic controllers and self-confidence in the ability to control the system manually.

The perseverative worry bout: A review of cognitive, affective and motivational factors that contribute to worry perseveration.

PubMed

Davey, Graham C L; Meeten, F

2016-12-01

This paper reviews the cognitive, affective and attentional factors that contribute to individual perseverative worry bouts. We describe how automatic biases in attentional and interpretational processes contribute to threat detection and to the inclusion of negative intrusive thoughts into the worry stream typical of the "what if …?" thinking style of pathological worriers. The review also describes processes occurring downstream from these perceptual biases that also facilitate perseveration, including cognitive biases in beliefs about the nature of the worry process, the automatic deployment of strict goal-directed responses for dealing with the threat, the role of negative mood in facilitating effortful forms of information processing (i.e. systematic information processing styles), and in providing negative information for evaluating the success of the worry bout. We also consider the clinical implications of this model for an integrated intervention programme for pathological worrying. Copyright © 2016 Elsevier B.V. All rights reserved.

Mismatch Negativity in Children with Autism and Typical Development

ERIC Educational Resources Information Center

Dunn, Michelle A.; Gomes, Hilary; Gravel, Judith

2008-01-01

Children with autism are often characterized as having abnormalities in auditory processing. This study examined automatic and active processing of simple auditory stimuli in children using a component of event related potentials, the mismatch negativity (MMN). Amplitude of MMN in children with autism was significantly smaller than in children…

The primate amygdala represents the positive and negative value of visual stimuli during learning

PubMed Central

Paton, Joseph J.; Belova, Marina A.; Morrison, Sara E.; Salzman, C. Daniel

2008-01-01

Visual stimuli can acquire positive or negative value through their association with rewards and punishments, a process called reinforcement learning. Although we now know a great deal about how the brain analyses visual information, we know little about how visual representations become linked with values. To study this process, we turned to the amygdala, a brain structure implicated in reinforcement learning1–5. We recorded the activity of individual amygdala neurons in monkeys while abstract images acquired either positive or negative value through conditioning. After monkeys had learned the initial associations, we reversed image value assignments. We examined neural responses in relation to these reversals in order to estimate the relative contribution to neural activity of the sensory properties of images and their conditioned values. Here we show that changes in the values of images modulate neural activity, and that this modulation occurs rapidly enough to account for, and correlates with, monkeys’ learning. Furthermore, distinct populations of neurons encode the positive and negative values of visual stimuli. Behavioural and physiological responses to visual stimuli may therefore be based in part on the plastic representation of value provided by the amygdala. PMID:16482160

Addiction is a Reward Deficit and Stress Surfeit Disorder

PubMed Central

Koob, George F.

2013-01-01

Drug addiction can be defined by a three-stage cycle – binge/intoxication, withdrawal/negative affect, and preoccupation/anticipation – that involves allostatic changes in the brain reward and stress systems. Two primary sources of reinforcement, positive and negative reinforcement, have been hypothesized to play a role in this allostatic process. The negative emotional state that drives negative reinforcement is hypothesized to derive from dysregulation of key neurochemical elements involved in the brain reward and stress systems. Specific neurochemical elements in these structures include not only decreases in reward system function (within-system opponent processes) but also recruitment of the brain stress systems mediated by corticotropin-releasing factor (CRF) and dynorphin-κ opioid systems in the ventral striatum, extended amygdala, and frontal cortex (both between-system opponent processes). CRF antagonists block anxiety-like responses associated with withdrawal, block increases in reward thresholds produced by withdrawal from drugs of abuse, and block compulsive-like drug taking during extended access. Excessive drug taking also engages the activation of CRF in the medial prefrontal cortex, paralleled by deficits in executive function that may facilitate the transition to compulsive-like responding. Neuropeptide Y, a powerful anti-stress neurotransmitter, has a profile of action on compulsive-like responding for ethanol similar to a CRF1 antagonist. Blockade of the κ opioid system can also block dysphoric-like effects associated with withdrawal from drugs of abuse and block the development of compulsive-like responding during extended access to drugs of abuse, suggesting another powerful brain stress system that contributes to compulsive drug seeking. The loss of reward function and recruitment of brain systems provide a powerful neurochemical basis that drives the compulsivity of addiction. PMID:23914176

The cerebellum: a neural system for the study of reinforcement learning.

PubMed

Swain, Rodney A; Kerr, Abigail L; Thompson, Richard F

2011-01-01

In its strictest application, the term "reinforcement learning" refers to a computational approach to learning in which an agent (often a machine) interacts with a mutable environment to maximize reward through trial and error. The approach borrows essentials from several fields, most notably Computer Science, Behavioral Neuroscience, and Psychology. At the most basic level, a neural system capable of mediating reinforcement learning must be able to acquire sensory information about the external environment and internal milieu (either directly or through connectivities with other brain regions), must be able to select a behavior to be executed, and must be capable of providing evaluative feedback about the success of that behavior. Given that Psychology informs us that reinforcers, both positive and negative, are stimuli or consequences that increase the probability that the immediately antecedent behavior will be repeated and that reinforcer strength or viability is modulated by the organism's past experience with the reinforcer, its affect, and even the state of its muscles (e.g., eyes open or closed); it is the case that any neural system that supports reinforcement learning must also be sensitive to these same considerations. Once learning is established, such a neural system must finally be able to maintain continued response expression and prevent response drift. In this report, we examine both historical and recent evidence that the cerebellum satisfies all of these requirements. While we report evidence from a variety of learning paradigms, the majority of our discussion will focus on classical conditioning of the rabbit eye blink response as an ideal model system for the study of reinforcement and reinforcement learning.

Modulation of the conflict monitoring intensity: the role of aversive reinforcement, cognitive demand, and trait-BIS.

PubMed

Leue, Anja; Lange, Sebastian; Beauducel, André

2012-06-01

According to Botvinick's (2007) integrative account, conflict monitoring is aversive because individuals anticipate cognitive demand, whereas the revised reinforcement sensitivity theory (rRST) predicts that conflict processing is aversive because individuals anticipate aversive reinforcement of erroneous responses. Because these accounts give different reasons for the aversive aspects of conflict, we manipulated cognitive demand and the aversive reinforcement as a consequence of wrong choices in a go/no-go task. Thereby, we also aimed to investigate whether individual differences in conflict sensitivity (i.e., in trait anxiety, linked to high sensitivity of the behavioral inhibition system [trait-BIS]) represent the effects of aversive reinforcement and cognitive demand in conflict tasks. We expected that these manipulations would have effects on the frontal N2 component representing activity of the anterior cingulate cortex. Moreover, higher-trait-BIS individuals should be more sensitive than lower-trait-BIS individuals to aversive effects in conflict situations, resulting in a more negative frontal N2 for higher-trait-BIS individuals. In Study 1, with N = 104 students, and Study 2, with N = 47 students, aversive reinforcement was manipulated in three levels (within-subjects factor) and cognitive demand in two levels (between-subjects factor). The behavioral findings from the go/no-go task with noncounterbalanced reinforcement levels (Study 1) could be widely replicated in a task with counterbalanced reinforcement levels (Study 2). The frontal mean no-go N2 amplitude and the frontal no-go N2 dipole captured predicted reinforcement-related variations of conflict monitoring, indicating that the anticipation of aversive reinforcement induces variations in conflict monitoring intensity in frontal brain areas. The aversive nature of conflict was underlined by the more pronounced conflict monitoring in higher- than in lower-trait-BIS individuals.

Why humans deviate from rational choice.

PubMed

Hewig, Johannes; Kretschmer, Nora; Trippe, Ralf H; Hecht, Holger; Coles, Michael G H; Holroyd, Clay B; Miltner, Wolfgang H R

2011-04-01

Rational choice theory predicts that humans always optimize the expected utility of options when making decisions. However, in decision-making games, humans often punish their opponents even when doing so reduces their own reward. We used the Ultimatum and Dictator games to examine the affective correlates of decision-making. We show that the feedback negativity, an event-related brain potential that originates in the anterior cingulate cortex that has been related to reinforcement learning, predicts the decision to reject unfair offers in the Ultimatum game. Furthermore, the decision to reject is positively related to more negative emotional reactions and to increased autonomic nervous system activity. These findings support the idea that subjective emotional markers guide decision-making and that the anterior cingulate cortex integrates instances of reinforcement and punishment to provide such affective markers. Copyright © 2010 Society for Psychophysiological Research.

Frontal Theta Links Prediction Errors to Behavioral Adaptation in Reinforcement Learning

PubMed Central

Cavanagh, James F.; Frank, Michael J.; Klein, Theresa J.; Allen, John J.B.

2009-01-01

Investigations into action monitoring have consistently detailed a fronto-central voltage deflection in the Event-Related Potential (ERP) following the presentation of negatively valenced feedback, sometimes termed the Feedback Related Negativity (FRN). The FRN has been proposed to reflect a neural response to prediction errors during reinforcement learning, yet the single trial relationship between neural activity and the quanta of expectation violation remains untested. Although ERP methods are not well suited to single trial analyses, the FRN has been associated with theta band oscillatory perturbations in the medial prefrontal cortex. Medio-frontal theta oscillations have been previously associated with expectation violation and behavioral adaptation and are well suited to single trial analysis. Here, we recorded EEG activity during a probabilistic reinforcement learning task and fit the performance data to an abstract computational model (Q-learning) for calculation of single-trial reward prediction errors. Single-trial theta oscillatory activities following feedback were investigated within the context of expectation (prediction error) and adaptation (subsequent reaction time change). Results indicate that interactive medial and lateral frontal theta activities reflect the degree of negative and positive reward prediction error in the service of behavioral adaptation. These different brain areas use prediction error calculations for different behavioral adaptations: with medial frontal theta reflecting the utilization of prediction errors for reaction time slowing (specifically following errors), but lateral frontal theta reflecting prediction errors leading to working memory-related reaction time speeding for the correct choice. PMID:19969093

Reinforcement sensitivity theory and alcohol outcome expectancies in early adolescence.

PubMed

Lopez-Vergara, Hector I; Colder, Craig R; Hawk, Larry W; Wieczorek, William F; Eiden, Rina D; Lengua, Liliana J; Read, Jennifer P

2012-03-01

Little research has examined the development of alcohol expectancies in childhood, a notable omission as expectancies are viable targets for prevention programs. Moreover, limited alcohol expectancies research has been conducted from the perspective of psychobiological models of motivation despite the strong conceptual links between such models and cognitive models of alcohol use. To examine if the associations between individual differences from the revised reinforcement sensitivity theory (Gray JA, McNaughton N. The Neuropsychology of Anxiety: An Enquiry into the Functions of the Septo-hippocampal System (2nd ed.). Oxford, UK: Oxford University Press, 2000) and alcohol use is mediated by alcohol expectancies in a large community sample of early adolescents using a prospective design. 378 families (1 caregiver; 1 child) were recruited via random digit phone call using a prospective design. Our findings suggest that both a strong behavioral approach system and fight-flight or freeze system were associated with high levels of positive outcome expectancies, which subsequently predicted an increase in likelihood of alcohol use. There was also some evidence that drive (an aspect of behavioral approach system) was also positively associated with negative expectancies, which subsequently predicted a low probability of alcohol use. Individual differences in reinforcement sensitivity may influence the acquisition of positive and negative outcome expectancies, thereby potentially influencing the likelihood of alcohol use in early adolescence. Thus, reinforcement sensitivity theory is a promising theory to account for the link between neural models of addiction and early acquisition of alcohol use in humans.

The force required to fracture endodontically roots restored with various materials as intra-orifice barriers.

PubMed

Yasa, E; Arslan, H; Yasa, B; Akcay, M; Alsancak, M; Hatirli, H

2017-10-01

To evaluate the effect of various materials as intra-orifice barriers on the force required fracture roots. One hundred-thirty five mandibular premolars were decoronated and prepared up to size #40. The root canals were filled and randomly divided into two control and seven experimental groups (n = 15), as follows: Positive control group (the intra-orifice barrier cavity was not prepared), negative control group (the intra-orifice barrier cavity was prepared, but not filled), filling using glass ionomer cement, nano-hybrid composite resin, short fiber-reinforced composite, bulk-fill flowable composite, MTA Angelus, Micro Mega MTA or Biodentine. A fracture strength test was performed, and the data were analyzed using one-way ANOVA and Tukey's post hoc tests. Nano-hybrid composite, short fiber-reinforced composite, bulk-fill flow able composite, and glass ionomer cement increased the force required fracture the roots compared to the positive and negative control groups (P < 0.05). While MTA groups did not increase the force required fracture the roots compared to the control groups, Biodentine increased significantly. Within the limitations of the present study, the use of nano-hybrid composite, short fiber-reinforced composite, bulk-fill flowable composite, and glass ionomer cement as an intra-orifice barrier may be useful in reinforcing roots. MTA placement (MTA Angelus or Micro Mega MTA) did not significantly increase the fracture resistance of endodontically treated roots compared to the control groups, however Biodentine did.

Automatic mouse ultrasound detector (A-MUD): A new tool for processing rodent vocalizations.

PubMed

Zala, Sarah M; Reitschmidt, Doris; Noll, Anton; Balazs, Peter; Penn, Dustin J

2017-01-01

House mice (Mus musculus) emit complex ultrasonic vocalizations (USVs) during social and sexual interactions, which have features similar to bird song (i.e., they are composed of several different types of syllables, uttered in succession over time to form a pattern of sequences). Manually processing complex vocalization data is time-consuming and potentially subjective, and therefore, we developed an algorithm that automatically detects mouse ultrasonic vocalizations (Automatic Mouse Ultrasound Detector or A-MUD). A-MUD is a script that runs on STx acoustic software (S_TOOLS-STx version 4.2.2), which is free for scientific use. This algorithm improved the efficiency of processing USV files, as it was 4-12 times faster than manual segmentation, depending upon the size of the file. We evaluated A-MUD error rates using manually segmented sound files as a 'gold standard' reference, and compared them to a commercially available program. A-MUD had lower error rates than the commercial software, as it detected significantly more correct positives, and fewer false positives and false negatives. The errors generated by A-MUD were mainly false negatives, rather than false positives. This study is the first to systematically compare error rates for automatic ultrasonic vocalization detection methods, and A-MUD and subsequent versions will be made available for the scientific community.

A clustering-based graph Laplacian framework for value function approximation in reinforcement learning.

PubMed

Xu, Xin; Huang, Zhenhua; Graves, Daniel; Pedrycz, Witold

2014-12-01

In order to deal with the sequential decision problems with large or continuous state spaces, feature representation and function approximation have been a major research topic in reinforcement learning (RL). In this paper, a clustering-based graph Laplacian framework is presented for feature representation and value function approximation (VFA) in RL. By making use of clustering-based techniques, that is, K-means clustering or fuzzy C-means clustering, a graph Laplacian is constructed by subsampling in Markov decision processes (MDPs) with continuous state spaces. The basis functions for VFA can be automatically generated from spectral analysis of the graph Laplacian. The clustering-based graph Laplacian is integrated with a class of approximation policy iteration algorithms called representation policy iteration (RPI) for RL in MDPs with continuous state spaces. Simulation and experimental results show that, compared with previous RPI methods, the proposed approach needs fewer sample points to compute an efficient set of basis functions and the learning control performance can be improved for a variety of parameter settings.

Bi-directional evolutionary structural optimization for strut-and-tie modelling of three-dimensional structural concrete

NASA Astrophysics Data System (ADS)

Shobeiri, Vahid; Ahmadi-Nedushan, Behrouz

2017-12-01

This article presents a method for the automatic generation of optimal strut-and-tie models in reinforced concrete structures using a bi-directional evolutionary structural optimization method. The methodology presented is developed for compliance minimization relying on the Abaqus finite element software package. The proposed approach deals with the generation of truss-like designs in a three-dimensional environment, addressing the design of corbels and joints as well as bridge piers and pile caps. Several three-dimensional examples are provided to show the capabilities of the proposed framework in finding optimal strut-and-tie models in reinforced concrete structures and verifying its efficiency to cope with torsional actions. Several issues relating to the use of the topology optimization for strut-and-tie modelling of structural concrete, such as chequerboard patterns, mesh-dependency and multiple load cases, are studied. In the last example, a design procedure for detailing and dimensioning of the strut-and-tie models is given according to the American Concrete Institute (ACI) 318-08 provisions.

Reconsideration of Serial Visual Reversal Learning in Octopus (Octopus vulgaris) from a Methodological Perspective

PubMed Central

Bublitz, Alexander; Weinhold, Severine R.; Strobel, Sophia; Dehnhardt, Guido; Hanke, Frederike D.

2017-01-01

Octopuses (Octopus vulgaris) are generally considered to possess extraordinary cognitive abilities including the ability to successfully perform in a serial reversal learning task. During reversal learning, an animal is presented with a discrimination problem and after reaching a learning criterion, the signs of the stimuli are reversed: the former positive becomes the negative stimulus and vice versa. If an animal improves its performance over reversals, it is ascribed advanced cognitive abilities. Reversal learning has been tested in octopus in a number of studies. However, the experimental procedures adopted in these studies involved pre-training on the new positive stimulus after a reversal, strong negative reinforcement or might have enabled secondary cueing by the experimenter. These procedures could have all affected the outcome of reversal learning. Thus, in this study, serial visual reversal learning was revisited in octopus. We trained four common octopuses (O. vulgaris) to discriminate between 2-dimensional stimuli presented on a monitor in a simultaneous visual discrimination task and reversed the signs of the stimuli each time the animals reached the learning criterion of ≥80% in two consecutive sessions. The animals were trained using operant conditioning techniques including a secondary reinforcer, a rod that was pushed up and down the feeding tube, which signaled the correctness of a response and preceded the subsequent primary reinforcement of food. The experimental protocol did not involve negative reinforcement. One animal completed four reversals and showed progressive improvement, i.e., it decreased its errors to criterion the more reversals it experienced. This animal developed a generalized response strategy. In contrast, another animal completed only one reversal, whereas two animals did not learn to reverse during the first reversal. In conclusion, some octopus individuals can learn to reverse in a visual task demonstrating behavioral flexibility even with a refined methodology. PMID:28223940

Optimization of a Lunar Pallet Lander Reinforcement Structure Using a Genetic Algorithm

NASA Technical Reports Server (NTRS)

Burt, Adam

2014-01-01

In this paper, a unique system level spacecraft design optimization will be presented. A Genetic Algorithm is used to design the global pattern of the reinforcing structure, while a gradient routine is used to adequately stiffen the sub-structure. The system level structural design includes determining the optimal physical location (and number) of reinforcing beams of a lunar pallet lander deck structure. Design of the substructure includes determining placement of secondary stiffeners and the number of rivets required for assembly.. In this optimization, several considerations are taken into account. The primary objective was to raise the primary natural frequencies of the structure such that the Pallet Lander primary structure does not significantly couple with the launch vehicle. A secondary objective is to determine how to properly stiffen the reinforcing beams so that the beam web resists the shear buckling load imparted by the spacecraft components mounted to the pallet lander deck during launch and landing. A third objective is that the calculated stress does not exceed the allowable strength of the material. These design requirements must be met while, minimizing the overall mass of the spacecraft. The final paper will discuss how the optimization was implemented as well as the results. While driven by optimization algorithms, the primary purpose of this effort was to demonstrate the capability of genetic algorithms to enable design automation in the preliminary design cycle. By developing a routine that can automatically generate designs through the use of Finite Element Analysis, considerable design efficiencies, both in time and overall product, can be obtained over more traditional brute force design methods.

An analysis of the topography, severity, potential sources of reinforcement, and treatments utilized for skin picking in Prader-Willi syndrome.

PubMed

Hustyi, Kristin M; Hammond, Jennifer L; Rezvani, Ava B; Hall, Scott S

2013-09-01

We examined the topography, severity, potential sources of reinforcement, and treatments utilized for skin-picking behavior shown by individuals with Prader-Willi syndrome (PWS). The parents of 55 individuals with PWS, aged 6-25 years, were interviewed about their child's skin-picking behavior using the Self-Injury Trauma Scale (SIT; Iwata, Pace, Kissel, Nau, & Farber, 1990) and the Functional Analysis Screening Tool (FAST; Iwata, DeLeon, & Roscoe, 2013). Results showed that skin picking in PWS occurred on the extremities (i.e., arms, legs, hands, and feet) for 75% of cases and resulted in bodily injury for 83.7% cases. Skin picking posed a high risk to the individual concerned in 41.8% of cases. Automatic sensory stimulation was identified as a potential source of reinforcement in the majority of cases (52.7%) followed by access to social attention or preferred items (36.4%). Treatments utilized by parents were primarily behavioral strategies (56.3%) followed by basic first aid (54.5%). There were no differences in the topography, severity or potential source of reinforcement between those with the deletion (DEL) subtype and those with the uniparental disomy (UPD) subtype. Taken together, these data indicate that skin picking shown by individuals with PWS is a particularly severe and intractable behavioral issue that may be maintained by (as yet unknown) sensory consequences. Further studies to identify the determinants of skin picking in PWS are therefore needed. The implications for interventions are discussed. Copyright © 2013 Elsevier Ltd. All rights reserved.

A clinical profile of compulsive exercise in adolescent inpatients with anorexia nervosa.

PubMed

Noetel, Melissa; Miskovic-Wheatley, Jane; Crosby, Ross D; Hay, Phillipa; Madden, Sloane; Touyz, Stephen

2016-01-01

The aim of the current study was to contribute to the development of a clinical profile of compulsive exercise in adolescents with Anorexia Nervosa (AN), by examining associations between compulsive exercise and eating and general psychopathology. A sample of 60 female adolescent inpatients with AN completed a self-report measure of compulsive exercise and a series of standardized self-report questionnaires assessing eating and general psychopathology. Higher levels of compulsive exercise were associated with increased levels of eating disorder psychopathology and anxiety. Specifically, the avoidance aspect (negatively reinforced) of compulsive exercise was associated with elevated scores on measures of eating disorder, anxiety, depression, and obsessive compulsiveness psychopathology, as well as lower self-esteem scores. The mood improvement value (positively reinforced) of compulsive exercise, however, did not reflect such trends. Compulsive exercise driven by avoidance of negative affect is associated with more severe psychological features in adolescent inpatients with AN. The current findings emphasize the need for research and clinical efforts in the development of treatments addressing avoidance of negative affect and compulsive exercise in adolescents with AN.

Gender, Ethnicity, and their Intersectionality in the Prediction of Smoking Outcome Expectancies in Regular Cigarette Smokers

PubMed Central

Aguirre, Claudia G.; Bello, Mariel S.; Pang, Raina D.; Andrabi, Nafeesa; Hendricks, Peter S.; Bluthenthal, Ricky N.; Leventhal, Adam M.

2016-01-01

The current study utilized the intersectionality framework to explore whether smoking outcome expectancies (i.e., cognitions about the anticipated effects of smoking) were predicted by gender and ethnicity, and the gender-by-ethnicity interaction. In a cross-sectional design, daily smokers from the general community [32.2% women; Non-Hispanic African American (N=175), Non-Hispanic White (N=109), or Hispanic (N=26)] completed self-report measures on smoking expectancies and other co-factors. Results showed that women reported greater negative reinforcement (i.e., anticipated smoking-induced negative affect reduction) and weight control (i.e., anticipated smoking-induced appetite/weight suppression) expectancies than men. Hispanic (vs. African American or White) smokers endorsed greater negative reinforcement expectancies. A gender by ethnicity interaction was found for weight control expectancies, such that White women reported greater weight control expectancies than White men, but no gender differences among African American and Hispanic smokers were found. Ethnicity, gender, and their intersectionality should be considered in smoking cessation programs to target smoking-related cognitions. PMID:26438665

Gender, Ethnicity, and Their Intersectionality in the Prediction of Smoking Outcome Expectancies in Regular Cigarette Smokers.

PubMed

Aguirre, Claudia G; Bello, Mariel S; Andrabi, Nafeesa; Pang, Raina D; Hendricks, Peter S; Bluthenthal, Ricky N; Leventhal, Adam M

2016-01-01

The current study utilized the intersectionality framework to explore whether smoking outcome expectancies (i.e., cognitions about the anticipated effects of smoking) were predicted by gender and ethnicity, and the gender-by-ethnicity interaction. In a cross-sectional design, daily smokers from the general community (32.2% women; non-Hispanic African American [n = 175], non-Hispanic White [n = 109], or Hispanic [n = 26]) completed self-report measures on smoking expectancies and other co-factors. Results showed that women reported greater negative reinforcement (i.e., anticipated smoking-induced negative affect reduction) and weight control (i.e., anticipated smoking-induced appetite/weight suppression) expectancies than men. Hispanic (vs. African American or White) smokers endorsed greater negative reinforcement expectancies. A gender-by-ethnicity interaction was found for weight control expectancies, such that White women reported greater weight control expectancies than White men, but no gender differences among African American and Hispanic smokers were found. These findings suggest that gender, ethnicity, and their intersectionality should be considered in research on cognitive mechanisms that may contribute to tobacco-related health disparities. © The Author(s) 2015.

Localized disruption of Narp in medial prefrontal cortex blocks reinforcer devaluation performance

PubMed Central

Johnson, Alexander W.; Han, Sungho; Blouin, Ashley M.; Saini, Jasjit; Worley, Paul F.; During, Matthew J.; Holland, Peter C.; Baraban, Jay M.; Reti, Irving M.

2010-01-01

Neuronal activity regulated pentraxin (Narp) is a secreted protein that regulates α-amino-3-hydroxyl-5-methyl-4-isoxazole-propionate receptors (AMPAR) aggregation and synaptogenesis. Mapping of Narp-positive neurons in brain has revealed it is prominently expressed in several limbic system projection pathways. Consistent with this localization pattern, Narp knockout mice show deficits in using the current value of a reinforcer to guide behavior, a critical function of the limbic system. To help assess whether this behavioral deficit is due to impairment of synaptogenesis during development or in modulating synaptic signaling in the mature brain, we have used a dominant negative Narp viral construct which blocks trafficking of endogenous Narp to axons. Focal injection of this viral construct into the medial prefrontal cortex (mPFC) of adult mice, a region containing Narp-positive projection neurons, blocked reinforcer devaluation. Thus, these results indicate that Narp released from mPFC neurons plays a key role in mediating synaptic changes underlying instrumental reinforcer devaluation. PMID:21127001

Experimental analysis of precursors to severe problem behavior.

PubMed

Fritz, Jennifer N; Iwata, Brian A; Hammond, Jennifer L; Bloom, Sarah E

2013-01-01

Some individuals engage in both mild and severe forms of problem behavior. Research has shown that when mild behaviors precede severe behaviors (i.e., the mild behaviors serve as precursors), they can (a) be maintained by the same source of reinforcement as severe behavior and (b) reduce rates of severe behavior observed during assessment. In Study 1, we developed an objective checklist to identify precursors via videotaped trials for 16 subjects who engaged in problem behavior and identified at least 1 precursor for every subject. In Study 2, we conducted separate functional analyses of precursor and severe problem behaviors for 8 subjects, and obtained correspondence between outcomes in 7 cases. In Study 3, we evaluated noncontingent reinforcement schedule thinning plus differential reinforcement of alternative behavior to reduce precursors, increase appropriate behavior, and maintain low rates of severe behavior during 3 treatment analyses for 2 subjects. Results showed that this treatment strategy was effective for behaviors maintained by positive and negative reinforcement. © Society for the Experimental Analysis of Behavior.

Higher incentives can impair performance: neural evidence on reinforcement and rationality

PubMed Central

Achtziger, Anja; Hügelschäfer, Sabine; Steinhauser, Marco

2015-01-01

Standard economic thinking postulates that increased monetary incentives should increase performance. Human decision makers, however, frequently focus on past performance, a form of reinforcement learning occasionally at odds with rational decision making. We used an incentivized belief-updating task from economics to investigate this conflict through measurements of neural correlates of reward processing. We found that higher incentives fail to improve performance when immediate feedback on decision outcomes is provided. Subsequent analysis of the feedback-related negativity, an early event-related potential following feedback, revealed the mechanism behind this paradoxical effect. As incentives increase, the win/lose feedback becomes more prominent, leading to an increased reliance on reinforcement and more errors. This mechanism is relevant for economic decision making and the debate on performance-based payment. PMID:25816816

The association between automatic thoughts about eating, the actual-ideal weight discrepancies, and eating disorders symptoms: a longitudinal study in late adolescence.

PubMed

Zarychta, Karolina; Luszczynska, Aleksandra; Scholz, Urte

2014-06-01

This study tested the reciprocal relationships between automatic thoughts about eating and the actual-ideal weight discrepancies, and their role in the formation and maintenance of eating disorders (ED) symptoms in a non-clinical sample of adolescents. In particular, we investigated whether thoughts about eating mediated the effects of weight discrepancies on ED formation and whether weight discrepancies mediated the effects of thoughts about eating on ED formation were investigated. Data were collected three times, with a 2-month interval between Time 1 (T1) and Time 2 (T2), and a 9-month interval between T2 and Time 3 (T3). Adolescents (N = 55) aged 15-18 filled out the SCOFF Questionnaire, assessing eating disorders symptoms, and the Eating Disorder Thoughts Questionnaire, evaluating automatic thoughts. To assess weight discrepancies questions about actual (subjectively reported) and ideal body weight were asked followed by objective measurement of height and weight. Negative thoughts about eating (T2) mediated the relation between weight discrepancies (T1) and symptoms of anorexia and bulimia (T3). In addition, the association between negative thoughts (T1) and eating disorders symptoms (T3) was mediated by weight discrepancies (T2). The negative thoughts and the actual (both subjectively reported and objectively measured)-ideal weight discrepancies constitute a vicious cycle, related to higher ED symptoms. Prevention of eating disorders should be directed to adolescents who manifest large weight discrepancies or high levels of negative thoughts about eating, as they are at risk for developing eating disorder symptoms.

Implicit depression and hopelessness in remitted depressed individuals.

PubMed

Meites, Tiffany M; Deveney, Christen M; Steele, Katherine T; Holmes, Avram J; Pizzagalli, Diego A

2008-09-01

Cognitive theories of depression posit that automatically activated cognitive schemas, including negative thoughts about the self and the future, predispose individuals to develop depressive disorders. However, prior research has largely examined these constructs using explicit tests in currently depressed individuals. Using the Implicit Association Test (IAT), the present study examined automatic associations between the self and mood state ("depression IAT") and between the future and mood state ("hopelessness IAT") before and after a negative mood induction in 19 remitted depressed individuals and 23 healthy controls. In the depression IAT, remitted depressed participants exhibited an overall lower tendency to associate themselves with happiness relative to the healthy controls before the mood induction. Control, but not remitted depressed, participants' automatic associations between the self and happiness diminished following the mood induction. Contrary to our hypotheses, no significant findings emerged when considering the hopelessness IAT. Consistent with prior studies, no significant correlations emerged between implicit and explicit biases, suggesting that these measures probe different processes. Results extend prior IAT research by documenting the presence of a reduced tendency to associate the self with happiness in a sample at increased risk for depression.

Difficulty identifying feelings and automatic activation in the fusiform gyrus in response to facial emotion.

PubMed

Eichmann, Mischa; Kugel, Harald; Suslow, Thomas

2008-12-01

Difficulties in identifying and differentiating one's emotions are a central characteristic of alexithymia. In the present study, automatic activation of the fusiform gyrus to facial emotion was investigated as a function of alexithymia as assessed by the 20-item Toronto Alexithymia Scale. During 3 Tesla fMRI scanning, pictures of faces bearing sad, happy, and neutral expressions masked by neutral faces were presented to 22 healthy adults who also responded to the Toronto Alexithymia Scale. The fusiform gyrus was selected as the region of interest, and voxel values of this region were extracted, summarized as means, and tested among the different conditions (sad, happy, and neutral faces). Masked sad facial emotions were associated with greater bilateral activation of the fusiform gyrus than masked neutral faces. The subscale, Difficulty Identifying Feelings, was negatively correlated with the neural response of the fusiform gyrus to masked sad faces. The correlation results suggest that automatic hyporesponsiveness of the fusiform gyrus to negative emotion stimuli may reflect problems in recognizing one's emotions in everyday life.

Relationship Quality and Alcohol-Related Social Reinforcement during Couples Interaction.

PubMed

Fairbairn, Catharine E; Testa, Maria

2016-01-01

Individuals who are unhappy in their intimate partnerships are at risk for developing alcohol problems. But little is known about the mechanisms underlying this link. One possibility is that couples with poor relationship quality gain more reinforcement from alcohol in certain contexts-a possibility that has never previously been empirically examined. In the current study, 304 individuals (152 couples) were assigned to receive alcohol (target BAC .08%) or a non-alcoholic beverage. They then engaged in a conflict-resolution interaction with their partners. Videotaped interactions were coded by trained observers. Results revealed a significant interaction between alcohol and relationship quality across multiple measures. Alcohol decreased negative behaviors, decreased negative reciprocity, and enhanced self-reported experience to a greater extent during interactions involving individuals reporting low relationship quality and had comparatively little effect among those reporting high relationship quality. Findings point to a potential mechanism underlying problem drinking among couples with poor relationship quality.

Three Myths from the Language Acquisition Literature

PubMed Central

Schoneberger, Ted

2010-01-01

Three popular assertions have hindered the promotion of an empiricist approach to language acquisition: (a) that Brown and Hanlon (1970) claimed to offer data that parents do not reinforce their children's grammaticality; (b) that Brown and Hanlon also claimed to offer data that parents do not provide negative evidence (i.e., corrective feedback) for ungrammaticality; and (c) that Gold (1967) claimed to offer a formal proof showing that, without negative evidence, a child cannot acquire a language solely from environmental input. In this paper I offer introductory comments on the nature–nurture distinction (including interactionism, and the nativists' claim to have found a gene for language). Next I debunk the three aforementioned assertions by arguing that the authors (Brown & Hanlon; Gold) never made the claims attributed to them; review evidence on the role of reinforcement and corrective feedback in language acquisition; and offer some concluding comments. PMID:22477466

Automatically augmenting lifelog events using pervasively generated content from millions of people.

PubMed

Doherty, Aiden R; Smeaton, Alan F

2010-01-01

In sensor research we take advantage of additional contextual sensor information to disambiguate potentially erroneous sensor readings or to make better informed decisions on a single sensor's output. This use of additional information reinforces, validates, semantically enriches, and augments sensed data. Lifelog data is challenging to augment, as it tracks one's life with many images including the places they go, making it non-trivial to find associated sources of information. We investigate realising the goal of pervasive user-generated content based on sensors, by augmenting passive visual lifelogs with "Web 2.0" content collected by millions of other individuals.

Functional analysis and treatment of the diurnal bruxism of a 16-year-old girl with autism.

PubMed

Armstrong, Amy; Knapp, Vicki Madaus; McAdam, David B

2014-01-01

Bruxism is defined as the clenching and grinding of teeth. This study used a functional analysis to examine whether the bruxism of a 16-year-old girl with autism was maintained by automatic reinforcement or social consequences. A subsequent component analysis of the intervention package described by Barnoy, Najdowski, Tarbox, Wilke, and Nollet (2009) showed that a vocal reprimand (e.g., "stop grinding") effectively reduced the participant's bruxism. Results were maintained across time, and effects extended to novel staff members. © Society for the Experimental Analysis of Behavior.

[Reconsideration of nicotine and other substance dependence: a clue from dependence-related mentation including reward, motivation, learning, delusion and hallucination toward understanding the concept of non-substance-related addiction].

PubMed

Miyata, Hisatsugu

2013-11-01

Nicotine produces core symptoms of substance dependence (craving and withdrawal) without any psychotic symptoms. The psychopharmacological structure of craving is hypothesized to be constituted by three components: the primary reinforcing property of a substance, the secondary reinforcing property of that substance (conditioned aspects of the environment, such as contextual or specific cues associated with substance taking), and the negative affective motivational property during withdrawal (i.e. the desire to avoid the dysphoric withdrawal symptoms elicits craving). Among the three components, the primary reinforcing property of a substance forms the most fundamental factor for establishing substance dependence. Sensitization or reverse tolerance observed in locomotor activity of animals, which had been believed to be a methamphetamine psychosis model, is demonstrated to reflect the establishment of conditioned reinforcement. Finally, non-substance-related addiction such as gambling, internet, and sex is discussed. From the aspect of the above hypothetical psychopharmacological structure of craving, the most significant difference between substance dependence and non-substance-related addiction is that the primary reinforcing property of non-substance reward is relatively intangible in comparison with that of a substance of abuse.

A randomized trial of employment-based reinforcement of cocaine abstinence in injection drug users.

PubMed

Silverman, Kenneth; Wong, Conrad J; Needham, Mick; Diemer, Karly N; Knealing, Todd; Crone-Todd, Darlene; Fingerhood, Michael; Nuzzo, Paul; Kolodner, Kenneth

2007-01-01

High-magnitude and long-duration abstinence reinforcement can promote drug abstinence but can be difficult to finance. Employment may be a vehicle for arranging high-magnitude and long-duration abstinence reinforcement. This study determined if employment-based abstinence reinforcement could increase cocaine abstinence in adults who inject drugs and use cocaine during methadone treatment. Participants could work 4 hr every weekday in a workplace where they could earn about $10.00 per hour in vouchers; they were required to provide routine urine samples. Participants who attended the workplace and provided cocaine-positive urine samples during the initial 4 weeks were invited to work 26 weeks and were randomly assigned to an abstinence-and-work (n = 28) or work-only (n = 28) group. Abstinence-and-work participants had to provide urine samples showing cocaine abstinence to work and maintain maximum pay. Work-only participants could work independent of their urinalysis results. Abstinence-and-work participants provided more (p = .004; OR = 5.80, 95% CI = 2.03-16.56) cocaine-negative urine samples (29%) than did work-only participants (10%). Employment-based abstinence reinforcement can increase cocaine abstinence.

Disrupted reinforcement learning and maladaptive behavior in women with a history of childhood sexual abuse: a high-density event-related potential study.

PubMed

Pechtel, Pia; Pizzagalli, Diego A

2013-05-01

Childhood sexual abuse (CSA) has been associated with psychopathology, particularly major depressive disorder (MDD), and high-risk behaviors. Despite the epidemiological data available, the mechanisms underlying these maladaptive outcomes remain poorly understood. We examined whether a history of CSA, particularly in conjunction with a past episode of MDD, is associated with behavioral and neural dysfunction in reinforcement learning, and whether such dysfunction is linked to maladaptive behavior. Participants completed a clinical evaluation and a probabilistic reinforcement task while 128-channel event-related potentials were recorded. Academic setting; participants recruited from the community. Fifteen women with a history of CSA and remitted MDD (CSA + rMDD), 16 women with remitted MDD with no history of CSA (rMDD), and 18 healthy women (controls). Three or more episodes of coerced sexual contact (mean [SD] duration, 3.00 [2.20] years) between the ages of 7 and 12 years by at least 1 male perpetrator. Participants' preference for choosing the most rewarded stimulus and avoiding the most punished stimulus was evaluated. The feedback-related negativity and error-related negativity-hypothesized to reflect activation in the anterior cingulate cortex-were used as electrophysiological indices of reinforcement learning. No group differences emerged in the acquisition of reinforcement contingencies. In trials requiring participants to rely partially or exclusively on previously rewarded information, the CSA + rMDD group showed (1) lower accuracy (relative to both controls and the rMDD group), (2) blunted electrophysiological differentiation between correct and incorrect responses (relative to controls), and (3) increased activation in the subgenual anterior cingulate cortex (relative to the rMDD group). A history of CSA was not associated with impairments in avoiding the most punished stimulus. Self-harm and suicidal behaviors correlated with poorer performance of previously rewarded, but not previously punished, trials. Irrespective of past MDD episodes, women with a history of CSA showed neural and behavioral deficits in utilizing previous reinforcement to optimize decision making in the absence of feedback (blunted "Go learning"). Although our study provides initial evidence for reward-specific deficits associated with CSA, future research is warranted to determine if disrupted positive reinforcement learning predicts high-risk behavior following CSA.

Negative reinforcement smoking outcome expectancies are associated with affective response to acute nicotine administration and abstinence.

PubMed

Robinson, Jason D; Lam, Cho Y; Carter, Brian L; Wetter, David W; Cinciripini, Paul M

2012-01-01

Negative affect is an important predictor of smoking behavior, and many smokers believe that smoking reduces negative affect. However, it is unclear whether such beliefs, known as negative reinforcement smoking outcome expectancies (NRSOE), are associated with changes in negative affect in response to nicotine deprivation and administration. Smokers (N=114) participated in 4 sessions that balanced overnight smoking deprivation (12-h deprived vs. ad lib) and nasal spray administration (nicotine vs. placebo). Corrugator supercilii (COR) EMG, skin conductance (SCR), and in-session ratings were collected while the participants viewed affective, cigarette-related, and neutral slides. Retrospective questionnaire data were collected prior to slide viewing. NRSOE were determined using the Smoking Consequences Questionnaire - Adult Nicotine Affect Reduction scale (SCQ-NAR). High scores on the SCQ-NAR were associated with smaller COR EMG to unpleasant slides following nicotine nasal spray administration compared to placebo spray, regardless of overnight deprivation. Smokers who had high scores on the SCQ-NAR had smaller SCR, following nicotine nasal spray administration compared to placebo spray, but only after overnight deprivation. The in-session ratings and retrospective questionnaire measures indicated that smokers who had high scores on the SCQ-NAR experienced greater negative affect and craving, and less positive affect, than smokers with low scores on the SCQ-NAR, regardless of nicotine exposure. Our questionnaire results suggest that while smokers who have high NRSOE self-report greater overall levels of negative affect and craving, while the psychophysiological data suggest that such smokers may experience negative affect reduction when blindly administered a dose of nicotine. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Inaccessibility of reinforcement increases persistence and signaling behavior in the fox squirrel (Sciurus niger).

PubMed

Delgado, Mikel M; Jacobs, Lucia F

2016-05-01

Under natural conditions, wild animals encounter situations where previously rewarded actions do not lead to reinforcement. In the laboratory, a surprising omission of reinforcement induces behavioral and emotional responses described as frustration. Frustration can lead to aggressive behaviors and to the persistence of noneffective responses, but it may also lead to new behavioral responses to a problem, a potential adaptation. We assessed the responses to inaccessible reinforcement in free-ranging fox squirrels (Sciurus niger). We trained squirrels to open a box to obtain food reinforcement, a piece of walnut. After 9 training trials, squirrels were tested in 1 of 4 conditions: a control condition with the expected reward, an alternative reinforcement (a piece of dried corn), an empty box, or a locked box. We measured the presence of signals suggesting arousal (e.g., tail flags and tail twitches) and found that squirrels performed fewer of these behaviors in the control condition and increased certain behaviors (tail flags, biting box) in the locked box condition, compared to other experimental conditions. When faced with nonreinforcement, that is, frustration, squirrels increased the number of interactions with the apparatus and spent more time interacting with the apparatus. This study of frustration responses in a free-ranging animal extends the conclusions of captive studies to the field and demonstrates that fox squirrels show short-term negatively valenced responses to the inaccessibility, omission, and change of reinforcement. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

But for the Bad, There Would Not Be Good: Grounding Valence in Brightness through Shared Relational Structures

ERIC Educational Resources Information Center

Lakens, Daniel; Semin, Gun R.; Foroni, Francesco

2012-01-01

Light and dark are used pervasively to represent positive and negative concepts. Recent studies suggest that black and white stimuli are automatically associated with negativity and positivity. However, structural factors in experimental designs, such as the shared opposition in the valence (good vs. bad) and brightness (light vs. dark) dimensions…

Emotional priming with facial exposures in euthymic patients with bipolar disorder.

PubMed

Kim, Taek Su; Lee, Su Young; Ha, Ra Yeon; Kim, Eosu; An, Suk Kyoon; Ha, Kyooseob; Cho, Hyun-Sang

2011-12-01

People with bipolar disorder have abnormal emotional processing. We investigated the automatic and controlled emotional processing via a priming paradigm with subliminal and supraliminal facial exposure. We compared 20 euthymic bipolar patients and 20 healthy subjects on their performance in subliminal and supraliminal tasks. Priming tasks consisted of three different primes according to facial emotions (happy, sad, and neutral) followed by a neutral face as a target stimulus. The prime stimuli were presented subliminally (17 msec) or supraliminally (1000 msec). In subliminal tasks, both patients and controls judged the neutral target face as significantly more unpleasant (negative judgment shift) when presented with negative emotion primes compared with positive primes. In supraliminal tasks, bipolar subjects showed significant negative judgment shift, whereas healthy subjects did not. There was a significant group × emotion interaction for the judgment rate in supraliminal tasks. Our finding of persistent affective priming even at conscious awareness may suggest that bipolar patients have impaired cognitive control on emotional processing rather than automatically spreading activation of emotion.

A Transient Dopamine Signal Represents Avoidance Value and Causally Influences the Demand to Avoid

PubMed Central

Pultorak, Katherine J.; Schelp, Scott A.; Isaacs, Dominic P.; Krzystyniak, Gregory

2018-01-01

Abstract While an extensive literature supports the notion that mesocorticolimbic dopamine plays a role in negative reinforcement, recent evidence suggests that dopamine exclusively encodes the value of positive reinforcement. In the present study, we employed a behavioral economics approach to investigate whether dopamine plays a role in the valuation of negative reinforcement. Using rats as subjects, we first applied fast-scan cyclic voltammetry (FSCV) to determine that dopamine concentration decreases with the number of lever presses required to avoid electrical footshock (i.e., the economic price of avoidance). Analysis of the rate of decay of avoidance demand curves, which depict an inverse relationship between avoidance and increasing price, allows for inference of the worth an animal places on avoidance outcomes. Rapidly decaying demand curves indicate increased price sensitivity, or low worth placed on avoidance outcomes, while slow rates of decay indicate reduced price sensitivity, or greater worth placed on avoidance outcomes. We therefore used optogenetics to assess how inducing dopamine release causally modifies the demand to avoid electrical footshock in an economic setting. Increasing release at an avoidance predictive cue made animals more sensitive to price, consistent with a negative reward prediction error (i.e., the animal perceives they received a worse outcome than expected). Increasing release at avoidance made animals less sensitive to price, consistent with a positive reward prediction error (i.e., the animal perceives they received a better outcome than expected). These data demonstrate that transient dopamine release events represent the value of avoidance outcomes and can predictably modify the demand to avoid. PMID:29766047

Motivational Processes Underlying Substance Abuse Disorder

PubMed Central

King, Christopher P.; Ferrario, Carrie R.

2016-01-01

Drug addiction is a syndrome of dysregulated motivation, evidenced by intense drug craving and compulsive drug-seeking behavior. In the search for common neurobiological substrates of addiction to different classes of drugs, behavioral neuroscientists have attempted to determine the neural basis for a number of motivational concepts and describe how they are changed by repeated drug use. Here, we describe these concepts and summarize previous work describing three major neural systems that play distinct roles in different conceptual aspects of motivation: (1) a nigrostriatal system that is involved in two forms of instrumental learning, (2) a ventral striatal system that is involved in Pavlovian incentive motivation and negative reinforcement, and (3) frontal cortical areas that regulate decision making and motivational processes. Within striatal systems, drug addiction can involve a transition from goal-oriented, incentive processes to automatic, habit-based responding. In the cortex, weak inhibitory control is a predisposing factor to, as well as a consequence of, repeated drug intake. However, these transitions are not absolute, and addiction can occur without a transition to habit-based responding, occurring as a result of the overvaluation of drug outcomes and hypersensitivity to incentive properties of drug-associated cues. Finally, we point out that addiction is not monolithic and can depend not only on individual differences between addicts, but also on the neurochemical action of specific drug classes. PMID:26475159

Automatic mouse ultrasound detector (A-MUD): A new tool for processing rodent vocalizations

PubMed Central

Reitschmidt, Doris; Noll, Anton; Balazs, Peter; Penn, Dustin J.

2017-01-01

House mice (Mus musculus) emit complex ultrasonic vocalizations (USVs) during social and sexual interactions, which have features similar to bird song (i.e., they are composed of several different types of syllables, uttered in succession over time to form a pattern of sequences). Manually processing complex vocalization data is time-consuming and potentially subjective, and therefore, we developed an algorithm that automatically detects mouse ultrasonic vocalizations (Automatic Mouse Ultrasound Detector or A-MUD). A-MUD is a script that runs on STx acoustic software (S_TOOLS-STx version 4.2.2), which is free for scientific use. This algorithm improved the efficiency of processing USV files, as it was 4–12 times faster than manual segmentation, depending upon the size of the file. We evaluated A-MUD error rates using manually segmented sound files as a ‘gold standard’ reference, and compared them to a commercially available program. A-MUD had lower error rates than the commercial software, as it detected significantly more correct positives, and fewer false positives and false negatives. The errors generated by A-MUD were mainly false negatives, rather than false positives. This study is the first to systematically compare error rates for automatic ultrasonic vocalization detection methods, and A-MUD and subsequent versions will be made available for the scientific community. PMID:28727808

Chronic Exposure to Methamphetamine Disrupts Reinforcement-Based Decision Making in Rats.

PubMed

Groman, Stephanie M; Rich, Katherine M; Smith, Nathaniel J; Lee, Daeyeol; Taylor, Jane R

2018-03-01

The persistent use of psychostimulant drugs, despite the detrimental outcomes associated with continued drug use, may be because of disruptions in reinforcement-learning processes that enable behavior to remain flexible and goal directed in dynamic environments. To identify the reinforcement-learning processes that are affected by chronic exposure to the psychostimulant methamphetamine (MA), the current study sought to use computational and biochemical analyses to characterize decision-making processes, assessed by probabilistic reversal learning, in rats before and after they were exposed to an escalating dose regimen of MA (or saline control). The ability of rats to use flexible and adaptive decision-making strategies following changes in stimulus-reward contingencies was significantly impaired following exposure to MA. Computational analyses of parameters that track choice and outcome behavior indicated that exposure to MA significantly impaired the ability of rats to use negative outcomes effectively. These MA-induced changes in decision making were similar to those observed in rats following administration of a dopamine D2/3 receptor antagonist. These data use computational models to provide insight into drug-induced maladaptive decision making that may ultimately identify novel targets for the treatment of psychostimulant addiction. We suggest that the disruption in utilization of negative outcomes to adaptively guide dynamic decision making is a new behavioral mechanism by which MA rigidly biases choice behavior.

Altered interaction with environmental reinforcers in major depressive disorder: Relationship to anhedonia.

PubMed

Szczepanik, Joanna E; Furey, Maura L; Nugent, Allison C; Henter, Ioline D; Zarate, Carlos A; Lejuez, Carl W

2017-10-01

Anhedonia-defined as loss of interest or pleasure-is one of two core symptoms of major depressive disorder (MDD). Anhedonia may involve decreased enjoyment of potentially rewarding activities and decreased motivation to engage in such activities. Increased engagement with reinforcers-activities with the potential to be positive experiences-is a frequent target of cognitive-behavioral therapies. Nevertheless, how environmental reinforcers are perceived, and how decisions to approach or avoid them are made by individuals with MDD, is largely unknown. We developed an experimental Behavioral Approach Motivation Paradigm to study how activities are evaluated and approached in MDD. Twenty-one MDD participants and 23 healthy controls performed an experimental task that rated activity words for their hedonic value, then engaged in an approach-avoidance joystick task with each individual's unique set of 'liked' and 'disliked' activity words. A negative correlation was observed between anhedonia and the number of 'liked' activities across participants. No significant difference between approach and avoidance behavior was found in direct comparisons between healthy controls and MDD participants; however, weaker avoidance and greater approach toward 'disliked' activities was found in MDD participants. This suggests negative bias in selecting environmental opportunities, potentially further compromising access to hedonic experiences in MDD. Copyright © 2017. Published by Elsevier Ltd.

Fun Seeking and Reward Responsiveness Moderate the Effect of the Behavioural Inhibition System on Coping-Motivated Problem Gambling.

PubMed

Keough, Matthew T; Wardell, Jeffrey D; Hendershot, Christian S; Bagby, R Michael; Quilty, Lena C

2017-09-01

Gray's Reinforcement Sensitivity Theory (RST) predicts that the Behavioral Inhibition System (BIS) may relate to coping-motivated problem gambling, given its central role in anxiety. Studies examining the BIS-problem gambling association, however, are mixed. The revised RST posits that the Behavioral Approach System (BAS) may moderate the effect of the BIS on coping-motivated problem gambling. A concurrently strong BAS may highlight the negatively reinforcing effects of gambling, which may strengthen coping motives and increase gambling-related harms. We examined these interactive effects to clarify the moderators and mediators of the negative reinforcement pathway to problem gambling. Data came from a larger investigation of problem gambling among individuals with mood disorders. All participants (N = 275) met criteria for a lifetime depressive or bipolar disorder. During a two-day assessment, participants completed a diagnostic assessment and self-reports. Mediated moderation path analysis showed positive indirect effects from the BIS to problem gambling via coping motives at high, but not at low, levels of BAS-Reward Responsiveness and BAS-Fun Seeking. Enhancement motives were also found to mediate the associations of BAS-Fun Seeking and BAS-Drive with problem gambling. Reward Responsiveness and Fun Seeking facets of the BAS may strengthen coping gambling motives within the mood disorders.

Marijuana motivations across adolescence: impacts on use and consequences.

PubMed

Anderson, Kristen G; Sitney, Miranda; White, Helene R

2015-02-01

Background. Motivational models for marijuana use have focused on reasons to use marijuana, but rarely consider motives to abstain. We examined how both adolescent marijuana abstinence motives and use motives contribute to marijuana use and problems at the end of emerging adulthood. Methods. 434 community recruited youth who had not initiated marijuana use at baseline were followed from adolescence (at ages 12, 15, and 18 years) into emerging adulthood (age 25 years). Motives to abstain and to use marijuana, marijuana consumption, and marijuana-related problems were assessed across time. Results. Endorsing more motives to abstain from marijuana across adolescence predicted less marijuana use in emerging adulthood and fewer marijuana-related problems when controlling for past motives to abstain and marijuana-related behavior. Positive reinforcement use motives related to increased marijuana consumption and problems, and negative reinforcement motives predicted problems when controlling for past marijuana use motives and behaviors. Expansion motives during adolescence related to lower marijuana use in emerging adulthood. When considered together, motives to abstain buffered the effect of negative reinforcement motives on outcomes at age 25 for youth endorsing a greater number of abstinence motives. Conclusions/ Implications. Given these findings, inclusion of both motives to use and abstain is warranted within comprehensive models of marijuana use decision making and may provide important markers for prevention and intervention specialists.

Dorsomedial striatum lesions affect adjustment to reward uncertainty, but not to reward devaluation or omission.

PubMed

Torres, Carmen; Glueck, Amanda C; Conrad, Shannon E; Morón, Ignacio; Papini, Mauricio R

2016-09-22

The dorsomedial striatum (DMS) has been implicated in the acquisition of reward representations, a proposal leading to the hypothesis that it should play a role in situations involving reward loss. We report the results of an experiment in which the effects of DMS excitotoxic lesions were tested in consummatory successive negative contrast (reward devaluation), autoshaping training with partial vs. continuous reinforcement (reward uncertainty), and appetitive extinction (reward omission). Animals with DMS lesions exhibited reduced lever pressing responding, but enhanced goal entries, during partial reinforcement training in autoshaping. However, they showed normal negative contrast, acquisition under continuous reinforcement (CR), appetitive extinction, and response facilitation in early extinction trials. Open-field testing also indicated normal motor behavior. Thus, DMS lesions selectively affected the behavioral adjustment to a situation involving reward uncertainty, producing a behavioral reorganization according to which goal tracking (goal entries) became predominant at the expense of sign tracking (lever pressing). This pattern of results shows that the function of the DMS in situations involving reward loss is not general, but restricted to reward uncertainty. We suggest that a nonassociative, drive-related process induced by reward uncertainty requires normal output from DMS neurons. Copyright © 2016 IBRO. Published by Elsevier Ltd. All rights reserved.

Divided attention enhances the recognition of emotional stimuli: evidence from the attentional boost effect.

PubMed

Rossi-Arnaud, Clelia; Spataro, Pietro; Costanzi, Marco; Saraulli, Daniele; Cestari, Vincenzo

2018-01-01

The present study examined predictions of the early-phase-elevated-attention hypothesis of the attentional boost effect (ABE), which suggests that transient increases in attention at encoding, as instantiated in the ABE paradigm, should enhance the recognition of neutral and positive items (whose encoding is mostly based on controlled processes), while having small or null effects on the recognition of negative items (whose encoding is primarily based on automatic processes). Participants were presented a sequence of negative, neutral and positive stimuli (pictures in Experiment 1, words in Experiment 2) associated to target (red) squares, distractor (green) squares or no squares (baseline condition). They were told to attend to the pictures/words and simultaneously press the spacebar of the computer when a red square appeared. In a later recognition task, stimuli associated to target squares were recognised better than stimuli associated to distractor squares, replicating the standard ABE. More importantly, we also found that: (a) the memory enhancement following target detection occurred with all types of stimuli (neutral, negative and positive) and (b) the advantage of negative stimuli over neutral stimuli was intact in the DA condition. These findings suggest that the encoding of negative stimuli depends on both controlled (attention-dependent) and automatic (attention-independent) processes.

Self-healing nanocomposite using shape memory polymer and carbon nanotubes

NASA Astrophysics Data System (ADS)

Liu, Yingtao; Rajadas, Abhishek; Chattopadhyay, Aditi

2013-04-01

Carbon fiber reinforced composites are used in a wide range of applications in aerospace, mechanical, and civil structures. Due to the nature of material, most damage in composites, such as delaminations, are always barely visible to the naked eye, which makes it difficult to detect and repair. The investigation of biological systems has inspired the development and characterization of self-healing composites. This paper presents the development of a new type of self-healing material in order to impede damage progression and conduct in-situ damage repair in composite structures. Carbon nanotubes, which are highly conductive materials, are mixed with shape memory polymer to develop self-healing capability. The developed polymeric material is applied to carbon fiber reinforced composites to automatically heal the delamination between different layers. The carbon fiber reinforced composite laminates are manufactured using high pressure molding techniques. Tensile loading is applied to double cantilever beam specimens using an MTS hydraulic test frame. A direct current power source is used to generate heat within the damaged area. The application of thermal energy leads to re-crosslinking in shape memory polymers. Experimental results showed that the developed composite materials are capable of healing the matrix cracks and delaminations in the bonded areas of the test specimens. The developed self-healing material has the potential to be used as a novel structural material in mechanical, civil, aerospace applications.

Motives to drink or not to drink: Longitudinal relations among personality, motives and alcohol use across adolescence and early adulthood

PubMed Central

Anderson, Kristen G.; Briggs, Kristen E.L.; White, Helene R.

2012-01-01

Background Adolescent selective intervention programs for alcohol have focused on the identification of youth at risk as a function of personality and associated alcohol-related cognitions. Research into the role of personality, drinking motivations, and alcohol-related outcomes has generally focused exclusively on motives to drink. We expand on this literature by focusing on both motives to drink and motives not drink across time from adolescence to early adulthood in a community sample. Methods Using three waves of data from three cohorts from the Rutgers Health and Human Development Project (n = 1380; 49.4% women), we modeled the influence of baseline alcohol consumption, disinhibition and harm avoidance (ages 15, 18 and 21 years) on drinking motives and motives not to drink three years later (ages 18, 21 and 24 years) and alcohol use and drinking-related problems seven years subsequently (ages 25, 28, 31 years). Results Path analytic models were relatively invariant across cohort. Across cohorts, disinhibition and baseline alcohol consumption related to later positive reinforcement drinking motives, but less consistency was found for the prediction of negative reinforcement motives to drink. While positive reinforcement motives were associated with greater alcohol consumption and problems seven years later, negative reinforcement motives were generally associated with problems alone. Positive reinforcement motives for drinking mediated relations between baseline consumption and later consumption. However, results were mixed when considering disinhibition as a predictor and drinking problems as an outcome. Similarly, personality and baseline consumption related to later motives not to drink and such motives predicted subsequent alcohol-related problems. However, mediation was not generally supported for pathways through motives to abstain. Conclusions The results of this study replicate and extend previous longitudinal findings with youth and add to the growing literature on motivations not to engage in alcohol use. PMID:23278843

Motives to drink or not to drink: longitudinal relations among personality, motives, and alcohol use across adolescence and early adulthood.

PubMed

Anderson, Kristen G; Briggs, Kristen E L; White, Helene R

2013-05-01

Adolescent selective intervention programs for alcohol have focused on the identification of youth at risk as a function of personality and associated alcohol-related cognitions. Research into the role of personality, drinking motivations, and alcohol-related outcomes has generally focused exclusively on motives to drink. We expand on this literature by focusing on both motives to drink and motives not to drink across time from adolescence to early adulthood in a community sample. Using 3 waves of data from 3 cohorts from the Rutgers Health and Human Development Project (n = 1,380; 49.4% women), we modeled the influence of baseline alcohol consumption, disinhibition (DIS), and harm avoidance (ages 15, 18, and 21 years) on drinking motives and motives not to drink 3 years later (ages 18, 21, and 24 years) and alcohol use and drinking-related problems 7 years subsequently (ages 25, 28, and 31 years). Path analytic models were relatively invariant across cohort. Across cohorts, DIS and baseline alcohol consumption related to later positive reinforcement drinking motives, but less consistency was found for the prediction of negative reinforcement motives to drink. While positive reinforcement motives were associated with greater alcohol consumption and problems 7 years later, negative reinforcement motives were generally associated with problems alone. Positive reinforcement motives for drinking mediated relations between baseline consumption and later consumption. However, results were mixed when considering DIS as a predictor and drinking problems as an outcome. Similarly, personality and baseline consumption related to later motives not to drink and such motives predicted subsequent alcohol-related problems. However, mediation was not generally supported for pathways through motives to abstain. The results of this study replicate and extend previous longitudinal findings with youth and add to the growing literature on motivations not to engage in alcohol use. Copyright © 2012 by the Research Society on Alcoholism.

Employment-based abstinence reinforcement as a maintenance intervention for the treatment of cocaine dependence: a randomized controlled trial.

PubMed

DeFulio, Anthony; Donlin, Wendy D; Wong, Conrad J; Silverman, Kenneth

2009-09-01

Due to the chronic nature of cocaine dependence, long-term maintenance treatments may be required to sustain abstinence. Abstinence reinforcement is among the most effective means of initiating cocaine abstinence. Practical and effective means of maintaining abstinence reinforcement programs over time are needed. To determine whether employment-based abstinence reinforcement can be an effective long-term maintenance intervention for cocaine dependence. Participants (n = 128) were enrolled in a 6-month job skills training and abstinence initiation program. Participants who initiated abstinence, attended regularly and developed needed job skills during the first 6 months were hired as operators in a data entry business and assigned randomly to an employment-only (control, n = 24) or abstinence-contingent employment (n = 27) group. A non-profit data entry business. Participants Unemployed welfare recipients who used cocaine persistently while enrolled in methadone treatment in Baltimore. Abstinence-contingent employment participants received 1 year of employment-based contingency management, in which access to employment was contingent upon provision of drug-free urine samples under routine and then random drug testing. If a participant provided drug-positive urine or failed to provide a mandatory sample, then that participant received a temporary reduction in pay and could not work until urinalysis confirmed recent abstinence. Cocaine-negative urine samples at monthly assessments across 1 year of employment. During the 1 year of employment, abstinence-contingent employment participants provided significantly more cocaine-negative urine samples than employment-only participants [79.3% and 50.7%, respectively; P = 0.004, odds ratio (OR) = 3.73, 95% confidence interval (CI) = 1.60-8.69]. Conclusions Employment-based abstinence reinforcement that includes random drug testing is effective as a long-term maintenance intervention, and is among the most promising treatments for drug dependence. Work-places could serve as therapeutic agents in the treatment of drug dependence by arranging long-term employment-based contingency management programs.

Reinforcement learning in professional basketball players

PubMed Central

Neiman, Tal; Loewenstein, Yonatan

2011-01-01

Reinforcement learning in complex natural environments is a challenging task because the agent should generalize from the outcomes of actions taken in one state of the world to future actions in different states of the world. The extent to which human experts find the proper level of generalization is unclear. Here we show, using the sequences of field goal attempts made by professional basketball players, that the outcome of even a single field goal attempt has a considerable effect on the rate of subsequent 3 point shot attempts, in line with standard models of reinforcement learning. However, this change in behaviour is associated with negative correlations between the outcomes of successive field goal attempts. These results indicate that despite years of experience and high motivation, professional players overgeneralize from the outcomes of their most recent actions, which leads to decreased performance. PMID:22146388

[Application of automatic photography in Schistosoma japonicum miracidium hatching experiments].

PubMed

Ming-Li, Zhou; Ai-Ling, Cai; Xue-Feng, Wang

2016-05-20

To explore the value of automatic photography in the observation of results of Schistosoma japonicum miracidium hatching experiments. Some fresh S. japonicum eggs were added into cow feces, and the samples of feces were divided into a low infested experimental group and a high infested group (40 samples each group). In addition, there was a negative control group with 40 samples of cow feces without S. japonicum eggs. The conventional nylon bag S. japonicum miracidium hatching experiments were performed. The process was observed with the method of flashlight and magnifying glass combined with automatic video (automatic photography method), and, at the same time, with the naked eye observation method. The results were compared. In the low infested group, the miracidium positive detection rates were 57.5% and 85.0% by the naked eye observation method and automatic photography method, respectively ( χ 2 = 11.723, P < 0.05). In the high infested group, the positive detection rates were 97.5% and 100% by the naked eye observation method and automatic photography method, respectively ( χ 2 = 1.253, P > 0.05). In the two infested groups, the average positive detection rates were 77.5% and 92.5% by the naked eye observation method and automatic photography method, respectively ( χ 2 = 6.894, P < 0.05). The automatic photography can effectively improve the positive detection rate in the S. japonicum miracidium hatching experiments.

How do working-memory-related demand, reasoning ability and aversive reinforcement modulate conflict monitoring?

PubMed Central

Leue, Anja; Weber, Bernd; Beauducel, André

2014-01-01

Conflict monitoring is a process of stimulus evaluation and a pre-requisite for subsequent recruitment of cognitive control and behavioral adaptations. This study investigated how experimentally manipulated working-memory-related cognitive demand and aversive reinforcement modulate individual differences of conflict monitoring intensity and behavioral adjustments. Individual differences were assessed by means of an anxiety-related trait dimension (trait-BIS) and by means of reasoning abilities—a core determinant of intelligence. Moreover, we investigated the special role of verbal reasoning ability and figural reasoning ability for the modulation of the conflict monitoring intensity. Ninety participants performed a go/nogo task with four conditions each comprising a combination of low vs. high working-memory-related cognitive demand and low vs. high aversive reinforcement. No effect of aversive reinforcement was observed for the N2 amplitude. The fronto-central nogo N2 amplitude was more pronounced for high demand vs. low demand suggesting that cognitive demand served as an aversive costly event. Higher total reasoning abilities were associated with more intense conflict monitoring and shorter response times with increasing aversive reinforcement (defined as verbal error-feedback vs. monetary loss). Individuals with higher trait-BIS scores demonstrated a more intense conflict monitoring even in conditions with low aversive reinforcement and also a more cautious responding (i.e., response times slowing) with increasing aversive reinforcement indicating a focus on negative feedback prevention. The findings provide evidence for the conflict monitoring theory and suggest that working-memory-related demand overrules the impact of aversive reinforcement on conflict monitoring intensity. Reasoning abilities and anxiety-related traits go along with an intensification of conflict monitoring but differences in the flexibility of behavioral adjustment. PMID:24782739

Reinforcement Learning and Dopamine in Schizophrenia: Dimensions of Symptoms or Specific Features of a Disease Group?

PubMed Central

Deserno, Lorenz; Boehme, Rebecca; Heinz, Andreas; Schlagenhauf, Florian

2013-01-01

Abnormalities in reinforcement learning are a key finding in schizophrenia and have been proposed to be linked to elevated levels of dopamine neurotransmission. Behavioral deficits in reinforcement learning and their neural correlates may contribute to the formation of clinical characteristics of schizophrenia. The ability to form predictions about future outcomes is fundamental for environmental interactions and depends on neuronal teaching signals, like reward prediction errors. While aberrant prediction errors, that encode non-salient events as surprising, have been proposed to contribute to the formation of positive symptoms, a failure to build neural representations of decision values may result in negative symptoms. Here, we review behavioral and neuroimaging research in schizophrenia and focus on studies that implemented reinforcement learning models. In addition, we discuss studies that combined reinforcement learning with measures of dopamine. Thereby, we suggest how reinforcement learning abnormalities in schizophrenia may contribute to the formation of psychotic symptoms and may interact with cognitive deficits. These ideas point toward an interplay of more rigid versus flexible control over reinforcement learning. Pronounced deficits in the flexible or model-based domain may allow for a detailed characterization of well-established cognitive deficits in schizophrenia patients based on computational models of learning. Finally, we propose a framework based on the potentially crucial contribution of dopamine to dysfunctional reinforcement learning on the level of neural networks. Future research may strongly benefit from computational modeling but also requires further methodological improvement for clinical group studies. These research tools may help to improve our understanding of disease-specific mechanisms and may help to identify clinically relevant subgroups of the heterogeneous entity schizophrenia. PMID:24391603

Understanding and Managing Self-Injurious Behavior.

ERIC Educational Resources Information Center

Zirpoli, Thomas J.; Lloyd, John Wills

1987-01-01

The literature review looks at self-injurious behaviors in handicapped students in terms of characteristics, prevalence, etiology (biological, psychological, and as learned behavior), and management including extinction, positive punishment, negative punishment, and reinforcement of other behaviors. Problems in areas of management, administration,…

Pieces to the Motivation Puzzle.

ERIC Educational Resources Information Center

Powell, Lacey

1984-01-01

Students enter music classes for various reasons. Teachers must study the group in order to understand the attitudes and motivations of students. Advises the teacher to emphasize the intrinsic rewards of learning and to set individual strategies of positive reinforcement and negative punishment. (CS)

Learning processes underlying avoidance of negative outcomes.

PubMed

Andreatta, Marta; Michelmann, Sebastian; Pauli, Paul; Hewig, Johannes

2017-04-01

Successful avoidance of a threatening event may negatively reinforce the behavior due to activation of brain structures involved in reward processing. Here, we further investigated the learning-related properties of avoidance using feedback-related negativity (FRN). The FRN is modulated by violations of an intended outcome (prediction error, PE), that is, the bigger the difference between intended and actual outcome, the larger the FRN amplitude is. Twenty-eight participants underwent an operant conditioning paradigm, in which a behavior (button press) allowed them to avoid a painful electric shock. During two learning blocks, participants could avoid an electric shock in 80% of the trials by pressing one button (avoidance button), or by not pressing another button (punishment button). After learning, participants underwent two test blocks, which were identical to the learning ones except that no shocks were delivered. Participants pressed the avoidance button more often than the punishment button. Importantly, response frequency increased throughout the learning blocks but it did not decrease during the test blocks, indicating impaired extinction and/or habit formation. In line with a PE account, FRN amplitude to negative feedback after correct responses (i.e., unexpected punishment) was significantly larger than to positive feedback (i.e., expected omission of punishment), and it increased throughout the blocks. Highly anxious individuals showed equal FRN amplitudes to negative and positive feedback, suggesting impaired discrimination. These results confirm the role of negative reinforcement in motivating behavior and learning, and reveal important differences between high and low anxious individuals in the processing of prediction errors. © 2017 Society for Psychophysiological Research.

Automatic auditory processing deficits in schizophrenia and clinical high-risk patients: forecasting psychosis risk with mismatch negativity.

PubMed

Perez, Veronica B; Woods, Scott W; Roach, Brian J; Ford, Judith M; McGlashan, Thomas H; Srihari, Vinod H; Mathalon, Daniel H

2014-03-15

Only about one third of patients at high risk for psychosis based on current clinical criteria convert to a psychotic disorder within a 2.5-year follow-up period. Targeting clinical high-risk (CHR) individuals for preventive interventions could expose many to unnecessary treatments, underscoring the need to enhance predictive accuracy with nonclinical measures. Candidate measures include event-related potential components with established sensitivity to schizophrenia. Here, we examined the mismatch negativity (MMN) component of the event-related potential elicited automatically by auditory deviance in CHR and early illness schizophrenia (ESZ) patients. We also examined whether MMN predicted subsequent conversion to psychosis in CHR patients. Mismatch negativity to auditory deviants (duration, frequency, and duration + frequency double deviant) was assessed in 44 healthy control subjects, 19 ESZ, and 38 CHR patients. Within CHR patients, 15 converters to psychosis were compared with 16 nonconverters with at least 12 months of clinical follow-up. Hierarchical Cox regression examined the ability of MMN to predict time to psychosis onset in CHR patients. Irrespective of deviant type, MMN was significantly reduced in ESZ and CHR patients relative to healthy control subjects and in CHR converters relative to nonconverters. Mismatch negativity did not significantly differentiate ESZ and CHR patients. The duration + frequency double deviant MMN, but not the single deviant MMNs, significantly predicted the time to psychosis onset in CHR patients. Neurophysiological mechanisms underlying automatic processing of auditory deviance, as reflected by the duration + frequency double deviant MMN, are compromised before psychosis onset and can enhance the prediction of psychosis risk among CHR patients. Copyright © 2014 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

The dark side of emotion: the addiction perspective.

PubMed

Koob, George F

2015-04-15

Emotions are "feeling" states and classic physiological emotive responses that are interpreted based on the history of the organism and the context. Motivation is a persistent state that leads to organized activity. Both are intervening variables and intimately related and have neural representations in the brain. The present thesis is that drugs of abuse elicit powerful emotions that can be interwoven conceptually into this framework. Such emotions range from pronounced euphoria to a devastating negative emotional state that in the extreme can create a break with homeostasis and thus an allostatic hedonic state that has been considered key to the etiology and maintenance of the pathophysiology of addiction. Drug addiction can be defined as a three-stage cycle-binge/intoxication, withdrawal/negative affect, and preoccupation/anticipation-that involves allostatic changes in the brain reward and stress systems. Two primary sources of reinforcement, positive and negative reinforcement, have been hypothesized to play a role in this allostatic process. The negative emotional state that drives negative reinforcement is hypothesized to derive from dysregulation of key neurochemical elements involved in the brain incentive salience and stress systems. Specific neurochemical elements in these structures include not only decreases in incentive salience system function in the ventral striatum (within-system opponent processes) but also recruitment of the brain stress systems mediated by corticotropin-releasing factor (CRF), dynorphin-κ opioid systems, and norepinephrine, vasopressin, hypocretin, and substance P in the extended amygdala (between-system opponent processes). Neuropeptide Y, a powerful anti-stress neurotransmitter, has a profile of action on compulsive-like responding for drugs similar to a CRF1 receptor antagonist. Other stress buffers include nociceptin and endocannabinoids, which may also work through interactions with the extended amygdala. The thesis argued here is that the brain has specific neurochemical neurocircuitry coded by the hedonic extremes of pleasant and unpleasant emotions that have been identified through the study of opponent processes in the domain of addiction. These neurochemical systems need to be considered in the context of the framework that emotions involve the specific brain regions now identified to differentially interpreting emotive physiological expression. Published by Elsevier B.V.

The dark side of emotion: the addiction perspective

PubMed Central

Koob, George F.

2015-01-01

Emotions are “feeling” states and classic physiological emotive responses that are interpreted based on the history of the organism and the context. Motivation is a persistent state that leads to organized activity. Both are intervening variables and intimately related and have neural representations in the brain. The present thesis is that drugs of abuse elicit powerful emotions that can be interwoven conceptually into this framework. Such emotions range from pronounced euphoria to a devastating negative emotional state that in the extreme can create a break with homeostasis and thus an allostatic hedonic state that has been considered key to the etiology and maintenance of the pathophysiology of addiction. Drug addiction can be defined as a three-stage cycle—binge/intoxication, withdrawal/negative affect, and preoccupation/anticipation—that involves allostatic changes in the brain reward and stress systems. Two primary sources of reinforcement, positive and negative reinforcement, have been hypothesized to play a role in this allostatic process. The negative emotional state that drives negative reinforcement is hypothesized to derive from dysregulation of key neurochemical elements involved in the brain incentive salience and stress systems. Specific neurochemical elements in these structures include not only decreases in incentive salience system function in the ventral striatum (within-system opponent processes) but also recruitment of the brain stress systems mediated by corticotropin-releasing factor (CRF), dynorphin-κ opioid systems, and norepinephrine, vasopressin, hypocretin, and substance P in the extended amygdala (between-system opponent processes). Neuropeptide Y, a powerful anti-stress neurotransmitter, has a profile of action on compulsive-like responding for drugs similar to a CRF1 antagonist. Other stress buffers include nociceptin and endocannabinoids, which may also work through interactions with the extended amygdala. The thesis argued here is that the brain has specific neurochemical neurocircuitry coded by the hedonic extremes of pleasant and unpleasant emotions that have been identified through the study of opponent processes in the domain of addiction. These neurochemical systems need to be considered in the context of the framework that emotions involve the specific brain regions now identified as differentially interpreting emotive physiological expression. PMID:25583178

Rett syndrome: a preliminary analysis of stereotypy, stress, and negative affect.

PubMed

Quest, Kelsey M; Byiers, Breanne J; Payen, Ameante; Symons, Frank J

2014-05-01

Rett syndrome (RTT) is a neurodevelopmental disorder primarily affecting females. It is characterized by apparently normative development of motor and communicative abilities followed by deterioration in these domains. Stereotypic hand movements are one of the core diagnostic criteria for RTT. There is some anecdotal but limited scientific evidence that changes in hand stereotypy may be a sign of increased anxiety or arousal (i.e., a 'stress response') in RTT. Understanding stress responsivity is difficult in RTT because almost all individuals are nonverbal or otherwise severely communicatively impaired. This study used direct behavioral observation to quantify and compare the frequency of hand stereotypy and signs of negative affect during presumed periods of high and low stress associated with functional analysis conditions (negative reinforcement ['escape'] and control ['free play'], respectively) for 5 females with RTT (mean age=17.8; range 4-47). Negative affect was more likely to occur during negative reinforcement ('stress') conditions for each participant whereas hand stereotypies did not differ across conditions for any of the participants. Although preliminary, the results suggest that hand stereotypy may not be a valid behavioral 'stress-response' indicator in females with RTT. Alternatively, the approach we used may have been limited and not sufficient to evoke a stress response. Either way, more work with direct relevance to improving our understanding of hand stereotypy and anxiety in RTT in relation to social context appears warranted. Copyright © 2014 Elsevier Ltd. All rights reserved.

A method for the automatic reconstruction of fetal cardiac signals from magnetocardiographic recordings

NASA Astrophysics Data System (ADS)

Mantini, D.; Alleva, G.; Comani, S.

2005-10-01

Fetal magnetocardiography (fMCG) allows monitoring the fetal heart function through algorithms able to retrieve the fetal cardiac signal, but no standardized automatic model has become available so far. In this paper, we describe an automatic method that restores the fetal cardiac trace from fMCG recordings by means of a weighted summation of fetal components separated with independent component analysis (ICA) and identified through dedicated algorithms that analyse the frequency content and temporal structure of each source signal. Multichannel fMCG datasets of 66 healthy and 4 arrhythmic fetuses were used to validate the automatic method with respect to a classical procedure requiring the manual classification of fetal components by an expert investigator. ICA was run with input clusters of different dimensions to simulate various MCG systems. Detection rates, true negative and false positive component categorization, QRS amplitude, standard deviation and signal-to-noise ratio of reconstructed fetal signals, and real and per cent QRS differences between paired fetal traces retrieved automatically and manually were calculated to quantify the performances of the automatic method. Its robustness and reliability, particularly evident with the use of large input clusters, might increase the diagnostic role of fMCG during the prenatal period.

A lexicon based method to search for extreme opinions

PubMed Central

Gamallo, Pablo

2018-01-01

Studies in sentiment analysis and opinion mining have been focused on many aspects related to opinions, namely polarity classification by making use of positive, negative or neutral values. However, most studies have overlooked the identification of extreme opinions (most negative and most positive opinions) in spite of their vast significance in many applications. We use an unsupervised approach to search for extreme opinions, which is based on the automatic construction of a new lexicon containing the most negative and most positive words. PMID:29799867

A lexicon based method to search for extreme opinions.

PubMed

Almatarneh, Sattam; Gamallo, Pablo

2018-01-01

Studies in sentiment analysis and opinion mining have been focused on many aspects related to opinions, namely polarity classification by making use of positive, negative or neutral values. However, most studies have overlooked the identification of extreme opinions (most negative and most positive opinions) in spite of their vast significance in many applications. We use an unsupervised approach to search for extreme opinions, which is based on the automatic construction of a new lexicon containing the most negative and most positive words.

Dysphoria and smoking among treatment seeking smokers: the role of smoking-related inflexibility/avoidance

PubMed Central

Buckner, Julia D.; Farris, Samantha G.; Zvolensky, Michael J.; Shah, Sonia M.; Leventhal, Adam M.; Minnix, Jennifer A.; Schmidt, Norman B.

2016-01-01

Background Emerging data suggest that dysphoria is one facet of depression that is especially related to various aspects of cigarette smoking. However, it is presently unknown what emotional processes may account for these relations. Objectives In the current cross-sectional study, the impact of avoidance and inflexibility to smoking (AIS), a smoking-specific form of experiential avoidance, was tested on the relationship of dysphoria to four specific smoking processes that are key factors in cessation: perceived barriers to cessation, severity of problems during prior quit attempts, negative reinforcement smoking expectancies, and motivation to quit smoking. Methods Participants (n = 465) were treatment-seeking adult daily smokers. Relative indirect effects were subjected to bootstrap analyses to test direct and indirect effects of dysphoria on smoking processes. Results After controlling for gender, nicotine dependence severity, drinking problems, cannabis use, negative affectivity, tobacco-related medical problems, and AIS, dysphoria remained directly, positively related to perceived barriers and cessation problems. Additionally, dysphoria was indirectly, positively related to perceived barriers, cessation problems, negative reinforcement smoking expectancies, and motivation to quit indirectly through higher levels of AIS. Conclusion In the context of dysphoria, AIS may explain a wide range of clinically-relevant smoking processes. PMID:25396705

Animal models of extinction-induced depression: loss of reward and its consequences.

PubMed

Huston, Joseph P; Silva, Maria A de Souza; Komorowski, Mara; Schulz, Daniela; Topic, Bianca

2013-11-01

The absence or loss of rewards or reinforcers holds a major role in the development of depression in humans. In spite of the prevalence of extinction-induced depression (EID) in humans, few attempts have been made to establish animal models thereof. Here we present the concept of extinction-related depression and summarize the results of two sets of studies in our attempt to create animal models of EID, one set based on extinction after positive reinforcement in the Skinner-box, the other on extinction after negative reinforcement - escape from water. We found various behaviors emitted during the extinction trials that responded to treatment with antidepressant drugs: Accordingly, the important behavioral marker for EID during extinction of escape from the water was immobility. During extinction after positive reinforcement the important indices for extinction-induced depression are the withdrawal from the former site of reward, biting behavior and rearing up on the hind legs. Avoidance behavior and biting may model aspects of human depressive behavior, which may include withdrawal or avoidance as well as aggressive-like behaviors. Copyright © 2013 Elsevier Ltd. All rights reserved.

Automatic design of fiber-reinforced soft actuators for trajectory matching

NASA Astrophysics Data System (ADS)

Connolly, Fionnuala; Walsh, Conor J.; Bertoldi, Katia

2017-01-01

Soft actuators are the components responsible for producing motion in soft robots. Although soft actuators have allowed for a variety of innovative applications, there is a need for design tools that can help to efficiently and systematically design actuators for particular functions. Mathematical modeling of soft actuators is an area that is still in its infancy but has the potential to provide quantitative insights into the response of the actuators. These insights can be used to guide actuator design, thus accelerating the design process. Here, we study fluid-powered fiber-reinforced actuators, because these have previously been shown to be capable of producing a wide range of motions. We present a design strategy that takes a kinematic trajectory as its input and uses analytical modeling based on nonlinear elasticity and optimization to identify the optimal design parameters for an actuator that will follow this trajectory upon pressurization. We experimentally verify our modeling approach, and finally we demonstrate how the strategy works, by designing actuators that replicate the motion of the index finger and thumb.

Cognitive control predicts use of model-based reinforcement learning.

PubMed

Otto, A Ross; Skatova, Anya; Madlon-Kay, Seth; Daw, Nathaniel D

2015-02-01

Accounts of decision-making and its neural substrates have long posited the operation of separate, competing valuation systems in the control of choice behavior. Recent theoretical and experimental work suggest that this classic distinction between behaviorally and neurally dissociable systems for habitual and goal-directed (or more generally, automatic and controlled) choice may arise from two computational strategies for reinforcement learning (RL), called model-free and model-based RL, but the cognitive or computational processes by which one system may dominate over the other in the control of behavior is a matter of ongoing investigation. To elucidate this question, we leverage the theoretical framework of cognitive control, demonstrating that individual differences in utilization of goal-related contextual information--in the service of overcoming habitual, stimulus-driven responses--in established cognitive control paradigms predict model-based behavior in a separate, sequential choice task. The behavioral correspondence between cognitive control and model-based RL compellingly suggests that a common set of processes may underpin the two behaviors. In particular, computational mechanisms originally proposed to underlie controlled behavior may be applicable to understanding the interactions between model-based and model-free choice behavior.

Intelligent Control of a Sensor-Actuator System via Kernelized Least-Squares Policy Iteration

PubMed Central

Liu, Bo; Chen, Sanfeng; Li, Shuai; Liang, Yongsheng

2012-01-01

In this paper a new framework, called Compressive Kernelized Reinforcement Learning (CKRL), for computing near-optimal policies in sequential decision making with uncertainty is proposed via incorporating the non-adaptive data-independent Random Projections and nonparametric Kernelized Least-squares Policy Iteration (KLSPI). Random Projections are a fast, non-adaptive dimensionality reduction framework in which high-dimensionality data is projected onto a random lower-dimension subspace via spherically random rotation and coordination sampling. KLSPI introduce kernel trick into the LSPI framework for Reinforcement Learning, often achieving faster convergence and providing automatic feature selection via various kernel sparsification approaches. In this approach, policies are computed in a low-dimensional subspace generated by projecting the high-dimensional features onto a set of random basis. We first show how Random Projections constitute an efficient sparsification technique and how our method often converges faster than regular LSPI, while at lower computational costs. Theoretical foundation underlying this approach is a fast approximation of Singular Value Decomposition (SVD). Finally, simulation results are exhibited on benchmark MDP domains, which confirm gains both in computation time and in performance in large feature spaces. PMID:22736969

Automatic design of fiber-reinforced soft actuators for trajectory matching

PubMed Central

Connolly, Fionnuala; Walsh, Conor J.; Bertoldi, Katia

2017-01-01

Soft actuators are the components responsible for producing motion in soft robots. Although soft actuators have allowed for a variety of innovative applications, there is a need for design tools that can help to efficiently and systematically design actuators for particular functions. Mathematical modeling of soft actuators is an area that is still in its infancy but has the potential to provide quantitative insights into the response of the actuators. These insights can be used to guide actuator design, thus accelerating the design process. Here, we study fluid-powered fiber-reinforced actuators, because these have previously been shown to be capable of producing a wide range of motions. We present a design strategy that takes a kinematic trajectory as its input and uses analytical modeling based on nonlinear elasticity and optimization to identify the optimal design parameters for an actuator that will follow this trajectory upon pressurization. We experimentally verify our modeling approach, and finally we demonstrate how the strategy works, by designing actuators that replicate the motion of the index finger and thumb. PMID:27994133

Automatic design of fiber-reinforced soft actuators for trajectory matching.

PubMed

Connolly, Fionnuala; Walsh, Conor J; Bertoldi, Katia

2017-01-03

Soft actuators are the components responsible for producing motion in soft robots. Although soft actuators have allowed for a variety of innovative applications, there is a need for design tools that can help to efficiently and systematically design actuators for particular functions. Mathematical modeling of soft actuators is an area that is still in its infancy but has the potential to provide quantitative insights into the response of the actuators. These insights can be used to guide actuator design, thus accelerating the design process. Here, we study fluid-powered fiber-reinforced actuators, because these have previously been shown to be capable of producing a wide range of motions. We present a design strategy that takes a kinematic trajectory as its input and uses analytical modeling based on nonlinear elasticity and optimization to identify the optimal design parameters for an actuator that will follow this trajectory upon pressurization. We experimentally verify our modeling approach, and finally we demonstrate how the strategy works, by designing actuators that replicate the motion of the index finger and thumb.

The effect of the blackout method on acquisition and generalization1

PubMed Central

Wildemann, Donald G.; Holland, James G.

1973-01-01

In discrimination training with the Lyons' blackout method, pecks to the negative stimulus are prevented by darkening the chamber each time the subject approaches the negative stimulus. Stimulus generalization along a stimulus dimension was measured after training with this method. For comparison, generalization was also measured after reinforced responding to the positive stimulus without discrimination training, and after discrimination training by extinction of pecks to the negative stimulus. The blackout procedure and the extinction of pecks to the negative stimulus both produced a peak shift in the generalization gradients. The results suggest that after discrimination training in which the positive and negative stimulus are on the same continuum, the blackout method produces extinction-like effects on generalization tests. PMID:16811655

Phase-Transformation-Induced Extra Thermal Expansion Behavior of (SrxBa1-x)TiO3/Cu Composite.

PubMed

Sheng, Jie; Wang, Lidong; Li, Shouwei; Yin, Benke; Liu, Xiangli; Fei, Wei-Dong

2016-06-03

The properties of metal matrix composites (MMCs) can be optimized effectively through adjusting the type or the volume fraction of reinforcement. Generally, the coefficient of thermal expansion (CTE) of MMCs can be reduced by increasing the volume fraction of the reinforcement with lower CTE than metal matrix. However, it is great challenge to fabricate low CTE MMCs with low reinforcement volume fraction because of the limitation of reinforcement CTEs. SrxBa1-xTiO3 (SBT) powder presents negative thermal expansion behavior during the phase transformation from tetragonal to cubic phase. Here, we demonstrate that the phase transformation of SBT can be utilized to reduce and design the thermal expansion properties of SBT particle-reinforced Cu (SBT/Cu) composite, and ultralow CTE can be obtained in SBT/Cu composite. The X-ray diffraction analysis on heating indicates that the temperature range of phase transformation is extended greatly, therefore, the low CTE can be achieved within wide temperature range. Landau-Devonshire theory study on the phase transformation behaviors of SBT particles in the composite indicates that thermal mismatch stress significantly affects the Curie temperature of SBT particles and the CTE of the composite. The results given in the present study provide a new approach to design the MMCs with low CTE.

A Randomized Trial of Employment-Based Reinforcement of Cocaine Abstinence in Injection Drug Users

PubMed Central

Silverman, Kenneth; Wong, Conrad J; Needham, Mick; Diemer, Karly N; Knealing, Todd; Crone-Todd, Darlene; Fingerhood, Michael; Nuzzo, Paul; Kolodner, Kenneth

2007-01-01

High-magnitude and long-duration abstinence reinforcement can promote drug abstinence but can be difficult to finance. Employment may be a vehicle for arranging high-magnitude and long-duration abstinence reinforcement. This study determined if employment-based abstinence reinforcement could increase cocaine abstinence in adults who inject drugs and use cocaine during methadone treatment. Participants could work 4 hr every weekday in a workplace where they could earn about $10.00 per hour in vouchers; they were required to provide routine urine samples. Participants who attended the workplace and provided cocaine-positive urine samples during the initial 4 weeks were invited to work 26 weeks and were randomly assigned to an abstinence-and-work (n  =  28) or work-only (n  =  28) group. Abstinence-and-work participants had to provide urine samples showing cocaine abstinence to work and maintain maximum pay. Work-only participants could work independent of their urinalysis results. Abstinence-and-work participants provided more (p  =  .004; OR  =  5.80, 95% CI  =  2.03–16.56) cocaine-negative urine samples (29%) than did work-only participants (10%). Employment-based abstinence reinforcement can increase cocaine abstinence. PMID:17970256

Implicit Depression and Hopelessness in Remitted Depressed Individuals

PubMed Central

Meites, Tiffany M.; Deveney, Christen M.; Steele, Katherine T.; Holmes, Avram J.; Pizzagalli, Diego A.

2008-01-01

Cognitive theories of depression posit that automatically activated cognitive schemas, including negative thoughts about the self and the future, predispose individuals to develop depressive disorders. However, prior research has largely examined these constructs using explicit tests in currently depressed individuals. Using the Implicit Association Test (IAT), the present study examined automatic associations between the self and mood state (“depression IAT”) and between the future and mood state (“hopelessness IAT”) before and after a negative mood induction in 19 remitted depressed individuals and 23 healthy controls. In the depression IAT, remitted depressed participants exhibited an overall lower tendency to associate themselves with happiness relative to the healthy controls before the mood induction. Control, but not remitted depressed, participants’ automatic associations between the self and happiness diminished following the mood induction. Contrary to our hypotheses, no significant findings emerged when considering the hopelessness IAT. Consistent with prior studies, no significant correlations emerged between implicit and explicit biases, suggesting that these measures probe different processes. Results extend prior IAT research by documenting the presence of a reduced tendency to associate the self with happiness in a sample at increased risk for depression. PMID:18692169

Performance monitoring in nicotine dependence: Considering integration of recent reinforcement history.

PubMed

Butler, Kevin; Rusted, Jennifer; Gard, Paul; Jackson, Anne

2017-05-01

Impaired monitoring of errors and conflict (performance monitoring; PM) is well documented in substance dependence (SD) including nicotine dependence and may contribute to continued drug use. Contemporary models of PM and complementary behavioural evidence suggest that PM works by integrating recent reinforcement history rather than evaluating individual behaviours. Despite this, studies of PM in SD have typically used indices derived from reaction to task error or conflict on individual trials. Consequently impaired integration of reinforcement history during action selection tasks requiring behavioural control in SD populations has been underexplored. A reinforcement learning task assessed the ability of abstinent, satiated, former and never smokers (N=60) to integrate recent reinforcement history alongside a more typical behavioural index of PM reflecting the degree of reaction time slowing following an error (post-punishment slowing; PPS). On both indices there was a consistent pattern in PM data: Former smokers had the greatest and satiated smokers the poorest PM. Specifically satiated smokers had poorer reinforcement integration than former (p=0.005) and never smokers (p=0.041) and had less post-punishment slowing than former (p<0.001), never (p=0.003) and abstinent smokers (p=0.026). These are the first data examining the effects of smoking status on PM that use an integration of reinforcement history metric. The concordance of the reinforcement integration and PPS data suggest that this could be a promising method to interrogate PM in future studies. PM is influenced by smoking status. As PM is associated with adapting behaviour, poor PM in satiated smokers may contribute towards continued smoking despite negative consequences. Former smokers show elevated PM suggesting this may be a good relapse prevention target for individuals struggling to remain abstinent however prospective and intervention studies are needed. A better understanding of PM deficits in terms of reinforcement integration failure may stimulate development of novel treatment approaches. Copyright © 2017 Elsevier Inc. All rights reserved.

A new artefacts resistant method for automatic lineament extraction using Multi-Hillshade Hierarchic Clustering (MHHC)

NASA Astrophysics Data System (ADS)

Šilhavý, Jakub; Minár, Jozef; Mentlík, Pavel; Sládek, Ján

2016-07-01

This paper presents a new method of automatic lineament extraction which includes the removal of the 'artefacts effect' which is associated with the process of raster based analysis. The core of the proposed Multi-Hillshade Hierarchic Clustering (MHHC) method incorporates a set of variously illuminated and rotated hillshades in combination with hierarchic clustering of derived 'protolineaments'. The algorithm also includes classification into positive and negative lineaments. MHHC was tested in two different territories in Bohemian Forest and Central Western Carpathians. The original vector-based algorithm was developed for comparison of the individual lineaments proximity. Its use confirms the compatibility of manual and automatic extraction and their similar relationships to structural data in the study areas.

Mechanical properties and cytocompatibility of carbon fibre reinforced nano-hydroxyapatite/polyamide66 ternary biocomposite.

PubMed

Zhang, Xuesong; Zhang, Yonggang; Zhang, Xuelian; Wang, Yan; Wang, Jiaqi; Lu, Ming; Li, Hong

2015-02-01

Fibre-reinforced composites with good strength and ductility as bone repair biomaterials have been attracting increasing attention in biomedical applications. In the present study, a novel ternary composite was prepared using carbon fibre (CF) to reinforce a nano-hydroxyapatite/polyamide66 composite (HA/PA). The interface and mechanical strength of the ternary composite (CF/HA/PA) were characterised. In addition, to assess the cytocompatibility, the composite was co-cultured with MG-63 cells, and the cell morphology, MTT, and ALP were tested. The results indicated that CFs were uniformly distributed in the HA/PA matrix with random orientation and that the CFs bonded well to the HA/PA matrix. The reinforced ternary composite exhibited a compressive strength of 116-212 MPa, a bending strength of 89-138 MPa, a tensile strength of 109-181 MPa, with the breaking elongation ratio of 6.2-9.1%, and a tensile modulus of 2.9-5.8 GPa, with the values varying with increasing CF content from 5 to 20 (mass fraction). The MG-63 cells of normal phenotype were well extended and spread onto the ternary composite surface. In addition, its proliferation and differentiation on the composite surface were significantly increased with time, indicating that the incorporation of CFs into HA/PA had little negative effects on MG-63 cells. The incorporation of CFs into a HA/PA66 composite improved the strength and ductility and introduced no negative effects on the cytocompatibility. Hence, the CF/HA/PA ternary composite has potential to be used as a bone repair materials and in fixation devices. Copyright © 2014 Elsevier Ltd. All rights reserved.

Intolerance for smoking abstinence among nicotine-deprived, treatment-seeking smokers.

PubMed

Germeroth, Lisa J; Baker, Nathaniel L; Saladin, Michael E

2018-09-01

The Intolerance for Smoking Abstinence Discomfort Questionnaire (IDQ-S) assesses distress tolerance specific to nicotine withdrawal. Though developed to assess withdrawal-related distress, the IDQ-S has not been validated among nicotine-deprived, treatment-seeking smokers. The present study extended previous research by examining the predictive utility of the IDQ-S among abstinent, motivated-to-quit smokers. Abstinent, treatment-seeking smokers completed the IDQ-S Withdrawal Intolerance and Lack of Cognitive Coping scales, assessments of nicotine dependence and reinforcement, and smoking history at baseline. At baseline and at 24-h, 2-week, and 1-month follow-up, participants completed a smoking cue-reactivity task (collection of cue-elicited craving and negative affect), and assessments of cigarettes per day (CPD; daily diaries at follow-up), carbon monoxide (CO), and cotinine. Greater IDQ-S Withdrawal Intolerance was associated with younger age, higher nicotine dependence and reinforcement, and less smoking years (ps < .03). Greater IDQ-S Lack of Cognitive Coping was associated with less education, lower nicotine dependence and reinforcement, higher baseline CPD, and no prior quit attempts (ps < .04). IDQ-S scales did not significantly predict cue-elicited craving or negative affect, CPD, CO, or cotinine levels at follow-up (ps > .10). Withdrawal intolerance and lack of cognitive coping did not predict smoking outcomes among nicotine-deprived, treatment-seeking smokers, but were associated with smoking characteristics, including nicotine dependence and reinforcement. Withdrawal intolerance and lack of cognitive coping may not be especially useful in predicting craving and smoking behavior, but future studies should replicate the present study's findings and assess the stability of the IDQ-S before forming firm conclusions about its predictive utility. Copyright © 2018 Elsevier Ltd. All rights reserved.

Effects of CB1 and CRF1 receptor antagonists on binge-like eating in rats with limited access to a sweet fat diet: Lack of withdrawal-like responses

PubMed Central

Sabino, Valentina; Rice, Kenner C.; Zorrilla, Eric P.

2013-01-01

Positive reinforcement (e.g., appetitive, rewarding properties) has often been hypothesized to maintain excessive intake of palatable foods. Recently, rats receiving intermittent access to high sucrose diets showed binge-like intake with withdrawal-like signs upon cessation of access, suggesting negative reinforcement mechanisms contribute as well. Whether intermittent access to high fat diets also produces withdrawal-like syndromes is controversial. The present study therefore tested the hypothesis that binge-like eating and withdrawal-like anxiety would arise in a novel model of binge eating based on daily 10-min access to a sweet fat diet (35% fat kcal, 31% sucrose kcal). Within 2–3 weeks, female Wistar rats developed binge-like intake comparable to levels seen previously for high sucrose diets (~40% of daily caloric intake within 10 min) plus excess weight gain and adiposity, but absent increased anxiety-like behavior during elevated plus-maze or defensive withdrawal tests after diet withdrawal. Binge-like intake was unaffected by pretreatment with the corticotropin-releasing factor type 1 (CRF1) receptor antagonist R121919, and corticosterone responses to restraint stress did not differ between sweet-fat binge rats and chow-fed controls. In contrast, pretreatment with the cannabinoid type 1 (CB1) receptor antagonist SR147778 dose-dependently reduced binge-like intake, albeit less effectively than in ad lib chow or sweet fat controls. A priming dose of the sweet fat diet did not precipitate increased anxiety-like behavior, but rather increased plus-maze locomotor activity. The results suggest that CB1-dependent positive reinforcement rather than CRF1-dependent negative reinforcement mechanisms predominantly maintain excessive intake in this limited access model of sweet-fat diet binges. PMID:22776620

Different requirements for cAMP response element binding protein in positive and negative reinforcing properties of drugs of abuse.

PubMed

Walters, C L; Blendy, J A

2001-12-01

Addiction is a complex process that relies on the ability of an organism to integrate positive and negative properties of drugs of abuse. Therefore, studying the reinforcing as well as aversive components of drugs of abuse in a single model system will enable us to understand the role of final common mediators, such as cAMP response element-binding protein (CREB), in the addiction process. To this end, we analyzed mice with a mutation in the alpha and Delta isoforms of the CREB gene. Previously we have shown that CREB(alphaDelta) mutant mice in a mixed genetic background show attenuated signs of physical dependence, as measured by the classic signs of withdrawal. We have generated a uniform genetically stable F1 hybrid (129SvEv/C57BL/6) mouse line harboring the CREB mutation. We have found the functional activity of CREB in these F1 hybrid mice to be dramatically reduced compared with their wild-type littermates. These mice maintain a reduced withdrawal phenotype after chronic morphine. We are now poised to examine a number of complex behavioral phenotypes related to addiction in a well defined CREB-deficient mouse model. We demonstrate that the aversive properties of morphine are still present in CREB mutant mice despite a reduction of physical withdrawal. On the other hand, these mice do not respond to the reinforcing properties of morphine in a conditioned place preference paradigm. In contrast, CREB mutant mice demonstrate an enhanced response to the reinforcing properties of cocaine compared with their wild-type controls in both conditioned place preference and sensitization behaviors. These data may provide the first paradigm for differential vulnerability to various drugs of abuse.

Unaltered radial maze performance and brain acetylcholine of the endothelial nitric oxide synthase knockout mouse.

PubMed

Dere, E; Frisch, C; De Souza Silva, M A; Gödecke, A; Schrader, J; Huston, J P

2001-01-01

Proceeding from previous findings of a beneficial effect of endothelial nitric oxide synthase (eNOS) gene inactivation on negatively reinforced water maze performance, we asked whether this improvement in place learning capacities also holds for a positively reinforced radial maze task. Unlike its beneficial effects on the water maze task, eNOS gene inactivation did not facilitate radial maze performance. The acquisition performance over the days of place learning did not differ between eNOS knockout (eNOS-/-) and wild-type mice (eNOS+/+). eNOS-/- mice displayed a slight and eNOS+/+ mice a more severe working memory deficit in the place learning version of the radial maze compared to the genetic background C57BL/6 strain. Possible differential effects of eNOS inactivation, related to differences in reinforcement contingencies between the Morris water maze and radial maze tasks, behavioral strategy requirements, or to different emotional and physiological concomitants inherent in the two tasks are discussed. These task-unique characteristics might be differentially affected by the reported anxiogenic and hypertensional effects of eNOS gene inactivation. Post-mortem determination of acetylcholine concentrations in diverse brain structures revealed that acetylcholine and choline contents were not different between eNOS-/- and eNOS+/+ mice, but were increased in eNOS+/+ mice compared to C57BL/6 mice in the frontal cortex. Our findings demonstrate that phenotyping of learning and memory capacities should not rely on one learning task only, but should include tasks employing both negative and positive reinforcement contingencies in order to allow valid statements regarding differences in learning capacities between rodent strains.

Smoking-related correlates of psychomotor restlessness and agitation in a community sample of daily cigarette smokers.

PubMed

Wong, Jordan A; Leventhal, Adam M

2015-03-01

Psychomotor restlessness and agitation (PMA) is a putatively important, yet understudied, psychopathologic correlate of smoking. The scant smoking research on PMA previously conducted has been narrow in scope and conducted among psychiatric patients. To examine the generalizability and relevance of PMA to smoking, this cross-sectional study investigated associations between PMA and a variety of smoking processes in a community sample. Participants in this study were non-treatment-seeking smokers (N = 254, ≥10 cig/day, M age = 44 years) from the community without an active mood disorder. At baseline, they completed a PMA symptom checklist, a composite depressive symptom index, and a battery of smoking questionnaires. Linear regression models adjusting for depressive symptoms and demographics indicated that PMA level was positively associated with severity of nicotine withdrawal symptoms during prior quit attempts (β = .18, p < .05), anticipated likelihood of withdrawal in a future quit attempt (β = .19, p < .05), motivation to smoke for negative reinforcement (β = .14, p < .05), and smoking expectancies for negative reinforcement (β = .17, p < .05), negative consequences (β = .22, p < .01), and positive reinforcement (β = .14, p < .05). PMA was not significantly associated with smoking chronicity, frequency, or dependence severity. Smokers with elevated PMA appear to experience greater smoking-induced affect modulation and nicotine withdrawal than the average smoker, regardless of other depressive symptoms. Given that PMA differentiates a qualitatively unique profile of smoking characteristics, PMA warrants consideration in tobacco addiction research and practice. © American Academy of Addiction Psychiatry.

Automatic Processing of Reactive Polymers

NASA Technical Reports Server (NTRS)

Roylance, D.

1985-01-01

A series of process modeling computer codes were examined. The codes use finite element techniques to determine the time-dependent process parameters operative during nonisothermal reactive flows such as can occur in reaction injection molding or composites fabrication. The use of these analytical codes to perform experimental control functions is examined; since the models can determine the state of all variables everywhere in the system, they can be used in a manner similar to currently available experimental probes. A small but well instrumented reaction vessel in which fiber-reinforced plaques are cured using computer control and data acquisition was used. The finite element codes were also extended to treat this particular process.

Preference for blocking or response redirection during stereotypy treatment.

PubMed

Giles, Aimee F; St Peter, Claire C; Pence, Sacha T; Gibson, Alexandra B

2012-01-01

Response redirection and response blocking reduce stereotypy maintained by automatic reinforcement. The current study evaluated the effects of redirection and response blocking on the stereotypic responding of three elementary-age children diagnosed with autism. During the treatment evaluation, redirection and response blocking were evaluated using an alternating treatment embedded in a reversal design. Both procedures resulted in comparably low levels of motor stereotypy. Following treatment evaluation, a concurrent chain was conducted to evaluate participant preference for redirection or response blocking. All three participants preferred redirection. Practitioners may wish to consider participant preference when developing and implementing treatments for stereotypy. Copyright © 2012 Elsevier Ltd. All rights reserved.

The relationship between parents' and children's automatic thoughts in a college student sample.

PubMed

Donnelly, Reesa; Renk, Kimberly; Sims, Valerie K; McGuire, Jack

2011-04-01

Research demonstrates the importance of early social interactions in the development of schemas and automatic thoughts. It does not appear, however, that the existing research examines intergenerational correlations in automatic thoughts. As a result, this study explores the relationship between the automatic thoughts of parents and those of their college-age children in a sample of 252 college students and their mothers and fathers. Results of this study suggest that there are significant relationships between parents' and college students' positive automatic thoughts. Different trends by gender also are noted in the relationships among variables for male and female college students with their mothers and fathers. Further, mothers' positive ATs predicted the positive ATs of their college students, with mothers' ratings of their own communication with their college students mediating partially this relationship. Finally, college students' anxiety and self-esteem is predicted significantly by their mothers' anxiety and self-esteem (respectively) as well as their own positive and negative ATs. These findings suggest the possibility that ATs play a role in the intergenerational transmission of certain domains of psychological functioning.

Higher incentives can impair performance: neural evidence on reinforcement and rationality.

PubMed

Achtziger, Anja; Alós-Ferrer, Carlos; Hügelschäfer, Sabine; Steinhauser, Marco

2015-11-01

Standard economic thinking postulates that increased monetary incentives should increase performance. Human decision makers, however, frequently focus on past performance, a form of reinforcement learning occasionally at odds with rational decision making. We used an incentivized belief-updating task from economics to investigate this conflict through measurements of neural correlates of reward processing. We found that higher incentives fail to improve performance when immediate feedback on decision outcomes is provided. Subsequent analysis of the feedback-related negativity, an early event-related potential following feedback, revealed the mechanism behind this paradoxical effect. As incentives increase, the win/lose feedback becomes more prominent, leading to an increased reliance on reinforcement and more errors. This mechanism is relevant for economic decision making and the debate on performance-based payment. © The Author (2015). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Dopamine and reward: the anhedonia hypothesis 30 years on.

PubMed

Wise, Roy A

2008-10-01

The anhedonia hypothesis--that brain dopamine plays a critical role in the subjective pleasure associated with positive rewards--was intended to draw the attention of psychiatrists to the growing evidence that dopamine plays a critical role in the objective reinforcement and incentive motivation associated with food and water, brain stimulation reward, and psychomotor stimulant and opiate reward. The hypothesis called to attention the apparent paradox that neuroleptics, drugs used to treat a condition involving anhedonia (schizophrenia), attenuated in laboratory animals the positive reinforcement that we normally associate with pleasure. The hypothesis held only brief interest for psychiatrists, who pointed out that the animal studies reflected acute actions of neuroleptics whereas the treatment of schizophrenia appears to result from neuroadaptations to chronic neuroleptic administration, and that it is the positive symptoms of schizophrenia that neuroleptics alleviate, rather than the negative symptoms that include anhedonia. Perhaps for these reasons, the hypothesis has had minimal impact in the psychiatric literature. Despite its limited heuristic value for the understanding of schizophrenia, however, the anhedonia hypothesis has had major impact on biological theories of reinforcement, motivation, and addiction. Brain dopamine plays a very important role in reinforcement of response habits, conditioned preferences, and synaptic plasticity in cellular models of learning and memory. The notion that dopamine plays a dominant role in reinforcement is fundamental to the psychomotor stimulant theory of addiction, to most neuroadaptation theories of addiction, and to current theories of conditioned reinforcement and reward prediction. Properly understood, it is also fundamental to recent theories of incentive motivation.

Dimensions of Feminist Therapy.

ERIC Educational Resources Information Center

Marecek, Jeanne

This paper reviews the current status of psychotherapy for women from a feminist perspective. It examines the sexist prejudices and biases of traditional psychotherapies and psychological approaches; notes the manners in which therapy has often tended to reinforce the traditional sex role stereotyping and the women's consequent negative self…

Indifference between punishment and free shock: evidence for the negative law of effect1

PubMed Central

Schuster, Richard; Rachlin, Howard

1968-01-01

Pigeons were trained to respond under two conditions with two identical variable-interval schedules of positive reinforcement. While the schedules operated for separate response keys, they were not available concurrently. During one condition, each response was punished with electric shock. During the other condition, shocks were delivered independently of responding. The punishment suppressed responding but the free shocks did not. However, when allowed to choose, the pigeons preferred the condition associated with the lowest rate of shock regardless of whether or not the shock was dependent on responding. In general, shocks exerted their greatest effect on whichever response had the greatest influence on shocks. In this respect, punishment is instrumental in suppressing behavior and the properties of punishment are symmetrical to those of reinforcement. This empirical symmetry dictates a corresponding conceptual symmetry in terms of a positive law of effect accounting for response increments and a negative law accounting for response decrements. PMID:16811322

Space structures concepts and materials

NASA Technical Reports Server (NTRS)

Nowitzky, A. M.; Supan, E. C.

1988-01-01

An extension is preseted of the evaluation of graphite/aluminum metal matrix composites (MMC) for space structures application. A tubular DWG graphite/aluminum truss assembly was fabricated having the structural integrity and thermal stability needed for space application. DWG is a proprietary thin ply continuous graphite reinforced aluminum composite. The truss end fittings were constructed using the discontinuous ceramic particulate reinforced MMC DWAl 20 (trademark). Thermal stability was incorporated in the truss by utilizing high stiffness, negative coefficient of thermal expansion (CTE) P100 graphite fibers in a 6061 aluminum matrix, crossplied to provide minimized CTE in the assembled truss. Tube CTE was designed to be slightly negative to offset the effects of the end fitting and sleeve, CTE values of which are approx. 1/2 that of aluminum. In the design of the truss configuration, the CTE contribution of each component was evaluated to establish the component dimension and layup configuration required to provide a net zero CTE in the subassemblies which would then translate to a zero CTE for the entire truss bay produced.

Running Improves Pattern Separation during Novel Object Recognition.

PubMed

Bolz, Leoni; Heigele, Stefanie; Bischofberger, Josef

2015-10-09

Running increases adult neurogenesis and improves pattern separation in various memory tasks including context fear conditioning or touch-screen based spatial learning. However, it is unknown whether pattern separation is improved in spontaneous behavior, not emotionally biased by positive or negative reinforcement. Here we investigated the effect of voluntary running on pattern separation during novel object recognition in mice using relatively similar or substantially different objects.We show that running increases hippocampal neurogenesis but does not affect object recognition memory with 1.5 h delay after sample phase. By contrast, at 24 h delay, running significantly improves recognition memory for similar objects, whereas highly different objects can be distinguished by both, running and sedentary mice. These data show that physical exercise improves pattern separation, independent of negative or positive reinforcement. In sedentary mice there is a pronounced temporal gradient for remembering object details. In running mice, however, increased neurogenesis improves hippocampal coding and temporally preserves distinction of novel objects from familiar ones.

Automatic blood pressure measuring system (M091)

NASA Technical Reports Server (NTRS)

1977-01-01

The Leg Volume Measuring System is used to measure leg calf girth changes that occur during exposure to lower body negative pressure as a result of pooling of blood and other fluids in the lower extremities.

Why not the best? Social anxiety symptoms and perfectionism among Israeli Jews and Arabs: a comparative Study.

PubMed

Iancu, I; Bodner, E; Joubran, S; Ben Zion, I; Ram, E

2015-05-01

Social Anxiety Disorder (SAD) has been repeatedly shown to be very prevalent in the Western society and is characterized by low self-esteem, pessimism, procrastination and also perfectionism. Very few studies on SAD have been done in the Middle East or in Arab countries, and no study tackled the relationship between social anxiety symptoms and perfectionism in non-Western samples. We examined social anxiety symptoms and perfectionism in a group of 132 Israeli Jewish (IJ) and Israeli Arab (IA) students. Subjects completed the Liebowitz Social Anxiety Scale (LSAS), the Multidimensional Perfectionism Scale (MPS), the Negative Automatic Thoughts Questionnaire (ATQ-N), the Positive Automatic Thoughts Questionnaire (ATQ-P) and a socio-demographic questionnaire. The rate of SAD in our sample according to a LSAS score of 60 or more was 17.2% (IJ=13.8%, IA=19%, ns). The correlation between perfectionism and the LSAS was high in both groups, and in particular in the IJ group. The IA group had higher scores of social avoidance, of ATQ-P and of two of the MPS subscales: parental expectations and parental criticism. Concern over mistakes and negative automatic thoughts positively predicted social fear in the IJ group, whereas in the IA group being female, religious and less educated positively predicted social fear. Negative automatic thoughts and age positively predicted social avoidance in the IJ group. In general, the IJ and IA subjects showed higher social anxiety, higher ATQ-N scores and lower parental expectations as compared with non-clinical US samples. Social anxiety symptoms and perfectionism are prevalent in Arab and Jewish students in Israel and seem to be closely related. Further studies among non-western minority groups may detect cultural influences on social anxiety and might add to the growing body of knowledge on this intriguing condition. Copyright © 2014 Elsevier Inc. All rights reserved.

Growth trajectories of alcohol information processing and associations with escalation of drinking in early adolescence.

PubMed

Colder, Craig R; O'Connor, Roisin M; Read, Jennifer P; Eiden, Rina D; Lengua, Liliana J; Hawk, Larry W; Wieczorek, William F

2014-09-01

This longitudinal study provided a comprehensive examination of age-related changes in alcohol outcome expectancies, subjective evaluation of alcohol outcomes, and automatic alcohol associations in early adolescence. A community sample (52% female, 75% White/non-Hispanic) was assessed annually for 3 years (mean age at the first assessment = 11.6 years). Results from growth modeling suggested that perceived likelihood of positive outcomes increased and that subjective evaluations of these outcomes were more positive with age. Perceived likelihood of negative outcomes declined with age. Automatic alcohol associations were assessed with an Implicit Association Task (IAT), and were predominantly negative, but these negative associations weakened with age. High initial levels of perceived likelihood of positive outcomes at age 11 were associated with escalation of drinking. Perceived likelihood of negative outcomes was associated with low risk for drinking at age 11, but not with changes in drinking. Increases in positive evaluations of positive outcomes were associated with increases in alcohol use. Overall, findings suggest that at age 11, youth maintain largely negative attitudes and perceptions about alcohol, but with the transition into adolescence, there is a shift toward a more neutral or ambivalent view of alcohol. Some features of this shift are associated with escalation of drinking. Our findings point to the importance of delineating multiple aspects of alcohol information processing for extending cognitive models of alcohol use to the early stages of drinking.

Development and initial validation of a caffeine craving questionnaire.

PubMed

West, Oliver; Roderique-Davies, Gareth

2008-01-01

Craving for caffeine has received little empirical attention, despite considerable research into the potential for caffeine dependence. The main aim of this study was to develop, and initially validate, a multi-item, multidimensional instrument to measure cravings for caffeine. Participants were 189 caffeine consumers who completed the Questionnaire of Caffeine Cravings, which was based on the Questionnaire of Smoking Urges (QSU), in one of five naturally occurring periods of abstinence; 1-15 min; 16-120 mins; 3-7 h; 12-48 h and +48 h. Exploratory factor analysis suggested a three-factor solution best described the data; Factor 1 reflected strong desires, intentions and positive reinforcement; Factor 2 reflected mild/general positive and negative reinforcement and Factor 3 reflected functional/mood-based negative reinforcement. Significantly higher Factor 1 and Factor 2 scores were recorded for high frequency users; significantly higher Factor 1 and Factor 3 scores were recorded as a function of increased levels of dependence. Duration of abstinence did not significantly effect cravings across all three factors. Regression analyses suggested level of dependence best predicted both current cravings and frequency of daily use. These findings suggest caffeine cravings may be conceptualized multidimensionally and further validates the use of multidimensional, multi-item instruments. Cravings for caffeine may manifest and be detected across varying levels of dependence and, frequency of use and independently of duration of abstinence.

Interaction of the phencyclidine model of schizophrenia and nicotine on total and categorized ultrasonic vocalizations in rats

PubMed Central

Swalve, Natashia; Mulholland, Michele M.; Schulz, Tiffany D.; Li, Ming

2015-01-01

Patients with schizophrenia smoke cigarettes at a higher rate than the general population. We hypothesized that a factor in this comorbidity is sensitivity to the reinforcing and reinforcement-enhancement effects of nicotine. Phencyclidine (PCP) was used to model behavioral changes resembling negative symptoms of schizophrenia in rats. USVs in rats have been used to measure emotional states, with 50 kHz USVs indicating positive states and 22 kHz indicating negative. Total and categorized numbers of 22 and 50 kHz ultrasonic vocalizations (USVs) and USVs during a visual stimulus (e.g. a potential measure of reinforcement-enhancement) were examined in rats following .injection ofh PCP (2.0 mg/kg), and/or nicotine (0.2 or 0.4 mg/kg) daily for 7 days. PCP was then discontinued and all rats received nicotine (0.2 mg/kg and 0.4 mg/kg) and PCP (2.0 mg/kg) on 3 challenge days. PCP acutely decreased 50 kHz vocalizations while repeated nicotine potentiated rates of vocalizations, with similar patterns during light presentations. Rats in the PCP and nicotine combination groups made more 50 kHz vocalizations compared to control groups on challenge days. We conclude that PCP may produce a reward deficit that is shown by decreased 50 kHz USVs, and behaviors post-PCP exposure may best model the comorbidity between schizophrenia and nicotine. PMID:26479849

Electrophysiological correlates of observational learning in children.

PubMed

Rodriguez Buritica, Julia M; Eppinger, Ben; Schuck, Nicolas W; Heekeren, Hauke R; Li, Shu-Chen

2016-09-01

Observational learning is an important mechanism for cognitive and social development. However, the neurophysiological mechanisms underlying observational learning in children are not well understood. In this study, we used a probabilistic reward-based observational learning paradigm to compare behavioral and electrophysiological markers of individual and observational reinforcement learning in 8- to 10-year-old children. Specifically, we manipulated the amount of observable information as well as children's similarity in age to the observed person (same-aged child vs. adult) to examine the effects of similarity in age on the integration of observed information in children. We show that the feedback-related negativity (FRN) during individual reinforcement learning reflects the valence of outcomes of own actions. Furthermore, we found that the feedback-related negativity during observational reinforcement learning (oFRN) showed a similar distinction between outcome valences of observed actions. This suggests that the oFRN can serve as a measure of observational learning in middle childhood. Moreover, during observational learning children profited from the additional social information and imitated the choices of their own peers more than those of adults, indicating that children have a tendency to conform more with similar others (e.g. their own peers) compared to dissimilar others (adults). Taken together, our results show that children can benefit from integrating observable information and that oFRN may serve as a measure of observational learning in children. © 2015 John Wiley & Sons Ltd.

A hypertext system that learns from user feedback

NASA Technical Reports Server (NTRS)

Mathe, Nathalie

1994-01-01

Retrieving specific information from large amounts of documentation is not an easy task. It could be facilitated if information relevant in the current problem solving context could be automatically supplied to the user. As a first step towards this goal, we have developed an intelligent hypertext system called CID (Computer Integrated Documentation). Besides providing an hypertext interface for browsing large documents, the CID system automatically acquires and reuses the context in which previous searches were appropriate. This mechanism utilizes on-line user information requirements and relevance feedback either to reinforce current indexing in case of success or to generate new knowledge in case of failure. Thus, the user continually augments and refines the intelligence of the retrieval system. This allows the CID system to provide helpful responses, based on previous usage of the documentation, and to improve its performance over time. We successfully tested the CID system with users of the Space Station Freedom requirements documents. We are currently extending CID to other application domains (Space Shuttle operations documents, airplane maintenance manuals, and on-line training). We are also exploring the potential commercialization of this technique.

Automated Dispersion and Orientation Analysis for Carbon Nanotube Reinforced Polymer Composites

PubMed Central

Gao, Yi; Li, Zhuo; Lin, Ziyin; Zhu, Liangjia; Tannenbaum, Allen; Bouix, Sylvain; Wong, C.P.

2012-01-01

The properties of carbon nanotube (CNT)/polymer composites are strongly dependent on the dispersion and orientation of CNTs in the host matrix. Quantification of the dispersion and orientation of CNTs by microstructure observation and image analysis has been demonstrated as a useful way to understand the structure-property relationship of CNT/polymer composites. However, due to the various morphologies and large amount of CNTs in one image, automatic and accurate identification of CNTs has become the bottleneck for dispersion/orientation analysis. To solve this problem, shape identification is performed for each pixel in the filler identification step, so that individual CNT can be exacted from images automatically. The improved filler identification enables more accurate analysis of CNT dispersion and orientation. The obtained dispersion index and orientation index of both synthetic and real images from model compounds correspond well with the observations. Moreover, these indices help to explain the electrical properties of CNT/Silicone composite, which is used as a model compound. This method can also be extended to other polymer composites with high aspect ratio fillers. PMID:23060008

Understanding the role of injury/illness sensitivity and anxiety sensitivity in (automatic) pain processing: an examination using the extrinsic affective simon task.

PubMed

Vancleef, Linda M G; Peters, Madelon L; Gilissen, Susan M P; De Jong, Peter J

2007-07-01

Three fundamental fears are assumed to underlie psychopathology: Anxiety Sensitivity (AS), Injury/illness sensitivity (IS), and Fear of Negative Evaluation (FNE). Both AS and IS may form risk factors for the development and exacerbation of chronic pain. The current research examines the relation between these fears and automatic threat appraisal for pain-related stimuli. Study 1 (n=48) additionally examined content-specific associations of AS and FNE with the automatic threat appraisal of, respectively, panic and social evaluative cues. Study 2 (n=60) additionally focused on the association of IS and AS with the engagement in health protecting behavior, and the use of health care services. Both studies found evidence for an automatic threat appraisal of aversive stimuli. Study 2 demonstrated a positive association between the automatic threat appraisal for pain-related stimuli and individuals' IS levels. IS was found to be the single best predictor of the tendency to engage in health protecting behavior, whereas AS was the single best predictor of the reported use of health care services. This study contributes to the field of knowledge on putative risk factors for chronic pain. Results demonstrate an automatic threat appraisal toward pain-related stimuli that is related to vulnerability traits for pain. This automatic threat appraisal might initiate relatively spontaneous (nonstrategic) pain-maintaining behavioral responses.

Stimulus properties of inhaled substances

DOE Office of Scientific and Technical Information (OSTI.GOV)

Wood, R.W.

1978-10-01

Inhaled substances can modify behavior by their toxic action, or because they are discriminable events, or because they can support or suppress behavior. They can be used as discriminative stimuli at concentrations above the olfactory threshold. Inhalants can elicit unconditioned reflexes. As aversive stimuli, they can be studied in respondent conditioning experiments (e.g. conditioned suppression), in punishment paradigms, or as negative reinforcers in escape paradigms. Inhalants can also be positive reinforcers; their intoxication properties have engendered patterns of chronic self-administration (solvent abuse). Such stimulus properties should be considered in industrial hygiene and environmental quality decisions. Laboratory techniques to study suchmore » properties abound.« less

Stimulus properties of inhaled substances

DOE Office of Scientific and Technical Information (OSTI.GOV)

Wood, R.W.

1978-01-01

Inhaled substances can modify behavior by their toxic action, or because they are discriminable events, or because they can support or suppress behavior. They can be used as discriminative stimuli at concentrations above the olfactory threshold. Inhalants can elicit unconditioned reflexes. As aversive stimuli, they can be studied in respondent conditioning experiments (e.g. conditioned suppression), in punishment paradigms, or as negative reinforcers in escape paradigms. Inhalants can also be positive reinforcers; their intoxicating properties have engendered patterns of chronic self-administration (solvent abuse). Such stimulus properties should be considered in industrial hygiene and environmental quality decisions. Laboratory techniques to study suchmore » properties abound.« less

Automatic design of decision-tree induction algorithms tailored to flexible-receptor docking data.

PubMed

Barros, Rodrigo C; Winck, Ana T; Machado, Karina S; Basgalupp, Márcio P; de Carvalho, André C P L F; Ruiz, Duncan D; de Souza, Osmar Norberto

2012-11-21

This paper addresses the prediction of the free energy of binding of a drug candidate with enzyme InhA associated with Mycobacterium tuberculosis. This problem is found within rational drug design, where interactions between drug candidates and target proteins are verified through molecular docking simulations. In this application, it is important not only to correctly predict the free energy of binding, but also to provide a comprehensible model that could be validated by a domain specialist. Decision-tree induction algorithms have been successfully used in drug-design related applications, specially considering that decision trees are simple to understand, interpret, and validate. There are several decision-tree induction algorithms available for general-use, but each one has a bias that makes it more suitable for a particular data distribution. In this article, we propose and investigate the automatic design of decision-tree induction algorithms tailored to particular drug-enzyme binding data sets. We investigate the performance of our new method for evaluating binding conformations of different drug candidates to InhA, and we analyze our findings with respect to decision tree accuracy, comprehensibility, and biological relevance. The empirical analysis indicates that our method is capable of automatically generating decision-tree induction algorithms that significantly outperform the traditional C4.5 algorithm with respect to both accuracy and comprehensibility. In addition, we provide the biological interpretation of the rules generated by our approach, reinforcing the importance of comprehensible predictive models in this particular bioinformatics application. We conclude that automatically designing a decision-tree algorithm tailored to molecular docking data is a promising alternative for the prediction of the free energy from the binding of a drug candidate with a flexible-receptor.

Automatic design of decision-tree induction algorithms tailored to flexible-receptor docking data

PubMed Central

2012-01-01

Background This paper addresses the prediction of the free energy of binding of a drug candidate with enzyme InhA associated with Mycobacterium tuberculosis. This problem is found within rational drug design, where interactions between drug candidates and target proteins are verified through molecular docking simulations. In this application, it is important not only to correctly predict the free energy of binding, but also to provide a comprehensible model that could be validated by a domain specialist. Decision-tree induction algorithms have been successfully used in drug-design related applications, specially considering that decision trees are simple to understand, interpret, and validate. There are several decision-tree induction algorithms available for general-use, but each one has a bias that makes it more suitable for a particular data distribution. In this article, we propose and investigate the automatic design of decision-tree induction algorithms tailored to particular drug-enzyme binding data sets. We investigate the performance of our new method for evaluating binding conformations of different drug candidates to InhA, and we analyze our findings with respect to decision tree accuracy, comprehensibility, and biological relevance. Results The empirical analysis indicates that our method is capable of automatically generating decision-tree induction algorithms that significantly outperform the traditional C4.5 algorithm with respect to both accuracy and comprehensibility. In addition, we provide the biological interpretation of the rules generated by our approach, reinforcing the importance of comprehensible predictive models in this particular bioinformatics application. Conclusions We conclude that automatically designing a decision-tree algorithm tailored to molecular docking data is a promising alternative for the prediction of the free energy from the binding of a drug candidate with a flexible-receptor. PMID:23171000

Rats bred for helplessness exhibit positive reinforcement learning deficits which are not alleviated by an antidepressant dose of the MAO-B inhibitor deprenyl.

PubMed

Schulz, Daniela; Henn, Fritz A; Petri, David; Huston, Joseph P

2016-08-04

Principles of negative reinforcement learning may play a critical role in the etiology and treatment of depression. We examined the integrity of positive reinforcement learning in congenitally helpless (cH) rats, an animal model of depression, using a random ratio schedule and a devaluation-extinction procedure. Furthermore, we tested whether an antidepressant dose of the monoamine oxidase (MAO)-B inhibitor deprenyl would reverse any deficits in positive reinforcement learning. We found that cH rats (n=9) were impaired in the acquisition of even simple operant contingencies, such as a fixed interval (FI) 20 schedule. cH rats exhibited no apparent deficits in appetite or reward sensitivity. They reacted to the devaluation of food in a manner consistent with a dose-response relationship. Reinforcer motivation as assessed by lever pressing across sessions with progressively decreasing reward probabilities was highest in congenitally non-helpless (cNH, n=10) rats as long as the reward probabilities remained relatively high. cNH compared to wild-type (n=10) rats were also more resistant to extinction across sessions. Compared to saline (n=5), deprenyl (n=5) reduced the duration of immobility of cH rats in the forced swimming test, indicative of antidepressant effects, but did not restore any deficits in the acquisition of a FI 20 schedule. We conclude that positive reinforcement learning was impaired in rats bred for helplessness, possibly due to motivational impairments but not deficits in reward sensitivity, and that deprenyl exerted antidepressant effects but did not reverse the deficits in positive reinforcement learning. Copyright © 2016 IBRO. Published by Elsevier Ltd. All rights reserved.

Research methodology simplification for teaching purposes illustrated by clutch automatic control device testing

NASA Astrophysics Data System (ADS)

Wojs, J.

2016-09-01

The paper proves that simplified, shorter examination of an object, feasible in laboratory classes, can produce results similar to those reached in scientific investigation of the device using extensive equipment. A thorough investigation of an object, an automatic clutch device in this case, enabled identifying the magnitudes that most significantly affect its operation. The knowledge of these most sensitive magnitudes allows focusing in the teaching process on simplified measurement of only selected magnitudes and verifying the given object in the positive or negative.

Endangered Children and Environmental Standards.

ERIC Educational Resources Information Center

Barry, Frank; Gunn, Hazel Dayton

1996-01-01

Community-based prevention-oriented approaches that provide basic supports to families are needed to address rising rates of violence, child abuse, and other socially disruptive behavior. Weak families, weak neighborhoods, and weak economies are mutually reinforcing and lead to negative behaviors by youth and others. In proposing a community…

Positive Parenting and Challenging Children

ERIC Educational Resources Information Center

Knoll, Melissa

2007-01-01

Positive parenting focuses on developing proactive ways to teach and reinforce desirable behaviors, as opposed to focusing on reacting to and attempting to decrease negative behaviors. Dr. Sheldon Braaten, Executive Director of Behavioral Institute for Children and Adolescents, offers some keys for setting up and using a positive reinforcement…

Learning without Borders

ERIC Educational Resources Information Center

Adelman, Clifford

2008-01-01

Each time the Organization for Economic Cooperation and Development announces that America's students are falling behind those of other countries, and with every business section article on America's trade deficit with China, America sees a new commission to reinforce the negatives and urge dramatic upgrading of the workforce. This author states…

Computational model for behavior shaping as an adaptive health intervention strategy.

PubMed

Berardi, Vincent; Carretero-González, Ricardo; Klepeis, Neil E; Ghanipoor Machiani, Sahar; Jahangiri, Arash; Bellettiere, John; Hovell, Melbourne

2018-03-01

Adaptive behavioral interventions that automatically adjust in real-time to participants' changing behavior, environmental contexts, and individual history are becoming more feasible as the use of real-time sensing technology expands. This development is expected to improve shortcomings associated with traditional behavioral interventions, such as the reliance on imprecise intervention procedures and limited/short-lived effects. JITAI adaptation strategies often lack a theoretical foundation. Increasing the theoretical fidelity of a trial has been shown to increase effectiveness. This research explores the use of shaping, a well-known process from behavioral theory for engendering or maintaining a target behavior, as a JITAI adaptation strategy. A computational model of behavior dynamics and operant conditioning was modified to incorporate the construct of behavior shaping by adding the ability to vary, over time, the range of behaviors that were reinforced when emitted. Digital experiments were performed with this updated model for a range of parameters in order to identify the behavior shaping features that optimally generated target behavior. Narrowing the range of reinforced behaviors continuously in time led to better outcomes compared with a discrete narrowing of the reinforcement window. Rapid narrowing followed by more moderate decreases in window size was more effective in generating target behavior than the inverse scenario. The computational shaping model represents an effective tool for investigating JITAI adaptation strategies. Model parameters must now be translated from the digital domain to real-world experiments so that model findings can be validated.

Genetic reinforcement learning through symbiotic evolution for fuzzy controller design.

PubMed

Juang, C F; Lin, J Y; Lin, C T

2000-01-01

An efficient genetic reinforcement learning algorithm for designing fuzzy controllers is proposed in this paper. The genetic algorithm (GA) adopted in this paper is based upon symbiotic evolution which, when applied to fuzzy controller design, complements the local mapping property of a fuzzy rule. Using this Symbiotic-Evolution-based Fuzzy Controller (SEFC) design method, the number of control trials, as well as consumed CPU time, are considerably reduced when compared to traditional GA-based fuzzy controller design methods and other types of genetic reinforcement learning schemes. Moreover, unlike traditional fuzzy controllers, which partition the input space into a grid, SEFC partitions the input space in a flexible way, thus creating fewer fuzzy rules. In SEFC, different types of fuzzy rules whose consequent parts are singletons, fuzzy sets, or linear equations (TSK-type fuzzy rules) are allowed. Further, the free parameters (e.g., centers and widths of membership functions) and fuzzy rules are all tuned automatically. For the TSK-type fuzzy rule especially, which put the proposed learning algorithm in use, only the significant input variables are selected to participate in the consequent of a rule. The proposed SEFC design method has been applied to different simulated control problems, including the cart-pole balancing system, a magnetic levitation system, and a water bath temperature control system. The proposed SEFC has been verified to be efficient and superior from these control problems, and from comparisons with some traditional GA-based fuzzy systems.

Simulation of fiber Bragg grating sensor for rebar corrosion

NASA Astrophysics Data System (ADS)

Geng, Jiang; Wu, Jin; Zhao, Xinming

2009-07-01

It is world widely concerned in the durability of reinforced concrete structures. Corrosion of rebar is one of the most important factors which can affect the durability of the concrete structures, and may result in damage to the structures in the form of expansion, cracking and eventually spalling of the cover concrete. In addition, the structural damage may be due to loss of bond between reinforcement and concrete and reduction of reinforcement cross-sectional area, and finally it may cause structure failure. With the advantages of linear reaction, small volume, high anti-erosion capability and automatic signal transmission, the smart sensors made of fiber bragg grating (FBG) to monitor strain, stress, temperature and local crack have got wide application in buildings, bridges and tunnels. FBG can be adhered to the surface of the structure, and also can be embedded into the inner of the structures when the project is being under construction to realize the real-time health monitoring. Based on volume expansion, the fiber bragg grating sensor for rebar corrosion is designed. The corrosion status of the structure can be obtained from the information provided by sensors. With the aid of the finite element software ANSYS, the simulation of the corrosion sensor was carried in this paper. The relationship between corrosion ratio and the shift of wavelength was established. According to the results of the simulation, there were differences between simulated results and measured results. The reason of the differences was also studied in this paper.