Science.gov

Sample records for morphine-induced reward caused

  1. Minocycline suppresses morphine-induced respiratory depression, suppresses morphine-induced reward, and enhances systemic morphine-induced analgesia

    PubMed Central

    Hutchinson, Mark R.; Northcutt, Alexis L.; Chao, Lindsey W.; Kearney, Jeffrey J.; Zhang, Yingning; Berkelhammer, Debra L.; Loram, Lisa C.; Rozeske, Robert R.; Bland, Sondra T.; Maier, Steven F.; Gleeson, Todd T.; Watkins, Linda R.

    2008-01-01

    Recent data suggest that opioids can activate immune-like cells of the central nervous system (glia). This opioid-induced glial activation is associated with decreased analgesia, owing to the release of proinflammatory mediators. Here we examine in rats whether the putative microglial inhibitor, minocycline, may affect morphine-induced respiratory depression and/or morphine-induced reward (conditioned place preference). Systemic co-administration of minocycline significantly attenuated morphine-induced reductions in tidal volume, minute volume, inspiratory force and expiratory force, but did not affect morphine-induced reductions in respiratory rate. Minocycline attenuation of respiratory depression was also paralleled with significant attenuation by minocycline of morphine-induced reductions in blood oxygen saturation. Minocycline also attenuated morphine conditioned place preference. Minocycline did not simply reduce all actions of morphine, as morphine analgesia was significantly potentiated by minocycline co-administration. Lastly, morphine dose-dependently increased cyclooxygenase-1 gene expression in a rat microglial cell line, an effect that was dose-dependently blocked by minocycline. Together, these data support that morphine can directly activate microglia in a minocycline-suppressible manner and suggest a pivotal role for minocycline-sensitive processes in the mechanisms of morphine-induced respiration depression, reward, and pain modulation. PMID:18706994

  2. Drug-seeking behavior in an invertebrate system: evidence of morphine-induced reward, extinction and reinstatement in crayfish.

    PubMed

    Nathaniel, Thomas I; Panksepp, Jaak; Huber, Robert

    2009-02-11

    Several lines of evidence suggest that exploring the neurochemical basis of reward in invertebrate species may provide clues for the fundamental behavioral and neurobiology underpinnings of drug addiction. How the presence of drug-sensitive reward relates to a decrease in drug-seeking behavior and reinstatement of drug-seeking behavior in invertebrate systems is not known. The present study of a conditioned place preference (CPP) paradigm in crayfish (Orconectes rusticus) explores morphine-induced reward, extinction and reinstatement. Repeated intra-circulatory infusions of 2.5 microg/g, 5.0 microg/g and 10.0 microg/g doses of morphine over 5 days serve as a reward when paired with a distinct visual or tactile environment. Morphine-induced CPP was extinguished after repeated saline injections for 5 days in the previously morphine-paired compartment. After the previously established CPP had been eliminated during the extinction phase, morphine-experienced crayfish were challenged with 2.5 microg/g, 5.0 microg/g and 10.0 microg/g, respectively. The priming injections of morphine reinstated CPP in all training doses, suggesting that morphine-induced CPP is unrelenting, and that with time, it can be reinstated by morphine following extinction in an invertebrate model just like in mammals. Together with other recent studies, this work demonstrates the advantage of using crayfish as an invertebrate animal model to investigate the basic biological processes that underline exposure to mammalian drugs of abuse.

  3. Morphine-induced antinociception and reward in "humanized" mice expressing the mu opioid receptor A118G polymorphism.

    PubMed

    Henderson-Redmond, Angela N; Yuill, Matthew B; Lowe, Tammy E; Kline, Aaron M; Zee, Michael L; Guindon, Josée; Morgan, Daniel J

    2016-05-01

    The rewarding and antinociceptive effects of opioids are mediated through the mu-opioid receptor. The A118G single nucleotide polymorphism in this receptor has been implicated in drug addiction and differences in pain response. Clinical and preclinical studies have found that the G allele is associated with increased heroin reward and self-administration, elevated post-operative pain, and reduced analgesic responsiveness to opioids. Male and female mice homozygous for the "humanized" 118AA or 118GG alleles were evaluated to test the hypothesis that 118GG mice are less sensitive to the rewarding and antinociceptive effects of morphine. We found that 118AA and 118GG mice of both genders developed conditioned place preference for morphine. All mice developed tolerance to the antinociceptive and hypothermic effects of morphine. However, morphine tolerance was not different between AA and GG mice. We also examined sensitivity to the antinociceptive and hypothermic effects of cumulative morphine doses. We found that 118GG mice show reduced hypothermic and antinociceptive responses on the hotplate for 10mg/kg morphine. Finally, we examined basal pain response and morphine-induced antinociception in the formalin test for inflammatory pain. We found no gender or genotype differences in either basal pain response or morphine-induced antinociception in the formalin test. Our data suggests that homozygous expression of the GG allele in mice blunts morphine-induced hypothermia and hotplate antinociception but does not alter morphine CPP, morphine tolerance, or basal inflammatory pain response. PMID:26521067

  4. Effects of swimming exercise on morphine-induced reward and behavioral sensitization in maternally-separated rat pups in the conditioned place preference procedure.

    PubMed

    Abad, Atiyeh Taghavi-Khalil; Miladi-Gorji, Hossein; Bigdeli, Imanollah

    2016-09-19

    This study was designed to examine the effects of swimming exercise during adolescence on morphine-induced conditioned place preference (CPP) and behavioral sensitization in maternally separated male and female rat pups. Male Wistar rats were allowed to mate with female virgin Wistar rats. Pups were separated from the dam daily for 180min during postnatal days 2-14. All pups were weaned on day 21.The exercising pups were allowed to swim (60min/d, five days per a week, for 30days) during adolescence. Then, rat pups were tested for behavioral sensitization and the CPP induced by morphine. Maternal separation produced a significant increase in morphine-induced CPP in both sexes, behavioral sensitization in male pups and tolerance to morphine-induced motor activity in female pups. Swimmer pups separated from the dam exhibited a decrease in morphine-induced CPP in both sexes and behavioral sensitization in male pups than those of their control pups. The present results have shown that swimming exercise during adolescence may exert a protective effect against morphine-induced reward and behavioral sensitization in adult male and female rats following maternal separation. PMID:27519931

  5. Morphine-induced mu opioid receptor trafficking enhances reward yet prevents compulsive drug use.

    PubMed

    Berger, Amy Chang; Whistler, Jennifer L

    2011-07-01

    Morphine, heroin and other commonly abused opioids induce little mu opioid receptor (MOR) trafficking compared to endogenous opioids. We utilized knock-in mice expressing a mutant recycling MOR (RMOR) that desensitizes and is internalized in response to morphine to show that facilitating MOR trafficking not only enhances morphine reward but, despite this, reduces the development of addiction-like behaviours. To demonstrate this, we developed a novel model of the transition from controlled to compulsive drug use that recapitulates many features of human addiction, including persistent drug seeking despite adverse consequences and a decreased preference for alternative rewards. These behaviours emerged spontaneously in wild-type but not RMOR mice, and their intensity predicted the reinstatement of morphine seeking after extended abstinence, while prior morphine intake did not. These results confirm previous findings in the rat that addiction can be dissociated from both reward and consumption. Most importantly, these results demonstrate that one can simultaneously reduce the 'addictiveness' of morphine and enhance its desirable effects by promoting agonist-induced MOR trafficking.

  6. Corticotropin-releasing factor 1 receptor mediates the activity of the reward system evoked by morphine-induced conditioned place preference.

    PubMed

    Lasheras, M Carmen; Laorden, M Luisa; Milanés, M Victoria; Núñez, Cristina

    2015-08-01

    Different neurotransmitter systems are involved in behavioural and molecular responses to morphine. The brain stress system is activated by acute administration of drugs of abuse, being CRF the main neuropeptide of this circuitry. In this study we have studied the role of CRF1R in the rewarding effects of morphine using the CPP paradigm. For that, animals were treated with a CRF1R antagonist (CP-154,526) or vehicle during 6 days. Thirty min after receiving the antagonist, mice were injected with morphine on the same days that CP-154,526 was administered; another group received saline on the same days that vehicle was administered, and both groups were immediately conditioned. Control animals received vehicle and saline every day. On day 7, animals were tested for morphine-induced CPP. c-Fos, TH and OXA immunohistochemistry, NA turnover (HPLC), and corticosterone plasma concentration (RIA) were evaluated. Administration of a CRF1R antagonist CP-154,526 blocked the morphine-induced CPP and the increased NA turnover in the NAc in morphine-paired mice. CP-154-526 antagonised the enhancement in c-Fos expression evoked by morphine-induced CPP in the VTA and NAc, and the activation of the orexinergic neurons in the LLH. Present work demonstrates that morphine-induced CPP activates different brain areas involved in reward, and points out a critical role of CRF1R in molecular changes involved in morphine-conducted behaviours. Thus, our study supports a therapeutic potential of CRF1R antagonists in addictive disorders. PMID:25556110

  7. Corticotropin-releasing factor 1 receptor mediates the activity of the reward system evoked by morphine-induced conditioned place preference.

    PubMed

    Lasheras, M Carmen; Laorden, M Luisa; Milanés, M Victoria; Núñez, Cristina

    2015-08-01

    Different neurotransmitter systems are involved in behavioural and molecular responses to morphine. The brain stress system is activated by acute administration of drugs of abuse, being CRF the main neuropeptide of this circuitry. In this study we have studied the role of CRF1R in the rewarding effects of morphine using the CPP paradigm. For that, animals were treated with a CRF1R antagonist (CP-154,526) or vehicle during 6 days. Thirty min after receiving the antagonist, mice were injected with morphine on the same days that CP-154,526 was administered; another group received saline on the same days that vehicle was administered, and both groups were immediately conditioned. Control animals received vehicle and saline every day. On day 7, animals were tested for morphine-induced CPP. c-Fos, TH and OXA immunohistochemistry, NA turnover (HPLC), and corticosterone plasma concentration (RIA) were evaluated. Administration of a CRF1R antagonist CP-154,526 blocked the morphine-induced CPP and the increased NA turnover in the NAc in morphine-paired mice. CP-154-526 antagonised the enhancement in c-Fos expression evoked by morphine-induced CPP in the VTA and NAc, and the activation of the orexinergic neurons in the LLH. Present work demonstrates that morphine-induced CPP activates different brain areas involved in reward, and points out a critical role of CRF1R in molecular changes involved in morphine-conducted behaviours. Thus, our study supports a therapeutic potential of CRF1R antagonists in addictive disorders.

  8. Effects of the histaminergic system on the morphine-induced conditioned place preference in mice.

    PubMed

    Suzuki, T; Takamori, K; Misawa, M; Onodera, K

    1995-03-27

    The effects of an H2 receptor antagonist, a histidine decarboxylase inhibitor and a histamine precursor on the morphine-induced place preference in mice were examined. Morphine (1-7 mg/kg) produced a place preference in a dose-dependent manner. This morphine-induced place preference was significantly antagonized by the dopamine (DA) D1 receptor antagonist SCH 23390. The histamine precursor, L-histidine, attenuated the morphine (7 mg/kg)-induced place preference. On the other hand, the histidine decarboxylase inhibitor, alpha-fluoromethylhistidine (alpha-FMH), significantly potentiated the morphine (1 mg/kg)-induced place preference. This potentiation was antagonized by SCH 23390. The H2 receptor antagonist zolantidine (0.3 mg/kg) significantly potentiated the morphine-induced place preference. Surprisingly, zolantidine (1 mg/kg) alone also produced a significant place preference. The zolantidine-induced place preference was antagonized by SCH 23390. In addition, zolantidine (1, 3 and 10 mg/kg) significantly increased DA turnover (DA ratio) in the limbic forebrain (nucleus accumbens and olfactory tubercle), implying that zolantidine may activate the mesolimbic DA system. Moreover, co-administration of zolantidine dose-dependently increased morphine (10 mg/kg)-induced DA turnover in the limbic forebrain. These results suggest that the activation of histaminergic neurons may attenuate the rewarding effect of morphine, while the inhibition of histaminergic neurons may potentiate the rewarding effect of morphine. Furthermore, potentiation of the morphine-induced rewarding effect by inhibition of histaminergic neurons may be mediated by D1 receptors. We also demonstrated that the H2 receptor antagonist zolantidine may activate the mesolimbic DA system, and as a result, zolantidine itself produces a rewarding effect and potentiates the morphine-induced rewarding effect.

  9. Effects of berberine on acquisition and reinstatement of morphine-induced conditioned place preference in mice

    PubMed Central

    Vahdati Hassani, Faezeh; Hashemzaei, Mahmoud; Akbari, Edris; Imenshahidi, Mohsen; Hosseinzadeh, Hossein

    2016-01-01

    Objective: It has been shown that berberine, a major component of Berberis vulgaris extract, modulates the activity of several neurotransmitter systems including dopamine (Da) and N-methyl-D-aspartate (NMDA) contributing to rewarding and reinforcing effects of morphine. Drug craving and relapsing even after a long time of abstinence therapy are the most important problems of addiction. In the present study, we investigated the alleviating effects of berberine on the acquisition and reinstatement of morphine-induced conditioned place preference (CPP) in mice. Materials and Methods: In male NMRI mice, the acquisition of CPP was established by 40 mg/kg of morphine sulphate injection and extinguished after the extinction training and reinstated by a 10 mg/kg injection of morphine. The effects of different doses of berberine (5, 10, and 20 mg/kg) on the acquisition and reinstatement induced by morphine were evaluated in a conditioned place preference test. Results: The results showed that intraperitoneal administration of berberine (5, 10, and 20 mg/kg) did not induce conditioned appetitive or aversive effects. Injection of berberine (10 and 20 mg/kg) 2 h before the morphine administration reduced acquisition of morphine-induced CPP. In addition, same doses of berberine significantly prevented the reinstatement of morphine-induced CPP. Conclusion: These results suggest that berberine can reduce the acquisition and reinstatement of morphine-induced conditioned place preference and may be useful in treatment of morphine addiction. PMID:27222833

  10. Blockage of glucocorticoid receptors during memory acquisition, retrieval and reconsolidation prevents the expression of morphine-induced conditioned place preferences in mice.

    PubMed

    Fan, Yao-Dong; Niu, Hai-Chen; Huma, Tanzeel; Li, Ling; Wang, Gui-Mei; Xu, Li-Qi; Ren, He; Ma, Yuan-Ye; Yu, Hua-Lin

    2013-01-01

    Association between the reward caused by consuming drugs and the context in which they are consumed is essential in the formation of morphine-induced conditioned place preference (CPP). Glucocorticoid receptor (GRs) activation in different regions of the brain affects reward-based reinforcement and memory processing. A wide array of studies have demonstrated that blockage of GRs in some brain areas can have an effect on reward-related memory; however, to date there have been no systematic studies about the involvement of glucocorticoids (GCs) in morphine-related reward memory. Here, we used the GR antagonist RU38486 to investigate how GRs blockage affects the sensitization and CPP behavior during different phases of reward memory included acquisition, retrieval and reconsolidation. Interestingly, our results showed RU38486 has the ability to impair the acquisition, retrieval and reconsolidation of reward-based memory in CPP and sensitization behavior. But RU38486 by itself cannot induce CPP or conditioned place aversion (CPA) behavior. Our data provide a much more complete picture of the potential effects that glucocorticoids have on the reward memory of different phases and inhibit the sensitization behavior.

  11. Blocking α4β2 and α7 nicotinic acetylcholine receptors inhibits the reinstatement of morphine-induced CPP by drug priming in mice.

    PubMed

    Feng, Bin; Xing, Jiang-hao; Jia, Dong; Liu, Shui-bing; Guo, Hong-ju; Li, Xiao-qiang; He, Xiao-sheng; Zhao, Ming-gao

    2011-06-20

    Investigating the interaction between nicotinic and opioid receptors is of great interest for both basic mechanistic and clinical reasons. Morphine and nicotine, two common drugs of abuse, share several behavioral and rewarding properties. However, little is known about the subtypes of nicotinic acetylcholine receptors (nAChR) in the reinstatement of morphine-induced conditioned place preference (CPP). In this study, we found that a non-specific nAChR agonist, nicotine (0.5mg/kg), had no effects on the reinstatement of morphine-induced CPP. However, we found that pretreatment with specific α(4)β(2) and α(7) nAChR subtype antagonists, dihydroxy-β-erithroidine (DHβE, 5mg/kg) and methyllycaconitine (MLA, 4 mg/kg), 20 min prior to administration of morphine, inhibited the reinstatement of morphine-induced CPP by drug priming in mice. Furthermore, depression of the reinstatement of morphine-induced CPP by a single DHβE or MLA treatment lasted at least three days later when the reinstatement was induced by morphine priming. The data suggest that specific nAChR subtypes, i.e., α(4)β(2) and α(7), may contribute to the reinstatement of morphine-induced CPP by drug priming in mice.

  12. Morphine-Induced Constipation Develops With Increased Aquaporin-3 Expression in the Colon via Increased Serotonin Secretion.

    PubMed

    Kon, Risako; Ikarashi, Nobutomo; Hayakawa, Akio; Haga, Yusuke; Fueki, Aika; Kusunoki, Yoshiki; Tajima, Masataka; Ochiai, Wataru; Machida, Yoshiaki; Sugiyama, Kiyoshi

    2015-06-01

    Aquaporin-3 (AQP3) is a water channel that is predominantly expressed in the colon, where it plays a critical role in the regulation of fecal water content. This study investigated the role of AQP3 in the colon in morphine-induced constipation. AQP3 expression levels in the colon were analyzed after oral morphine administration to rats. The degree of constipation was analyzed after the combined administration of HgCl(2) (AQP3 inhibitor) or fluoxetine (5-HT reuptake transporter [SERT] inhibitor) and morphine. The mechanism by which morphine increased AQP3 expression was examined in HT-29 cells. AQP3 expression levels in rat colon were increased during morphine-induced constipation. The combination of HgCl(2) and morphine improved morphine-induced constipation. Treatment with morphine in HT-29 cells did not change AQP3 expression. However, 5-HT treatment significantly increased the AQP3 expression level and the nuclear translocation of peroxisome proliferator-activated receptor gamma (PPARγ) 1 h after treatment. Pretreatment with fluoxetine significantly suppressed these increases. Fluoxetine pretreatment suppressed the development of morphine-induced constipation and the associated increase in AQP3 expression in the colon. The results suggest that morphine increases the AQP3 expression level in the colon, which promotes water absorption from the luminal side to the vascular side and causes constipation. This study also showed that morphine-induced 5-HT secreted from the colon was taken into cells by SERT and activated PPARγ, which subsequently increased AQP3 expression levels.

  13. Severe dopaminergic neuron loss in rhesus monkey brain impairs morphine-induced conditioned place preference

    PubMed Central

    Yan, Ting; Rizak, Joshua Dominic; Wang, Jianhong; Yang, Shangchuan; Ma, Yuanye; Hu, Xintian

    2015-01-01

    It is well known that dopamine (DA) is critical for reward, but the precise role of DA in reward remains uncertain. The aim of this study was to determine what percentage of dopaminergic neurons in the primate brain is required for the expression of conditioned reward by measuring the performance of DA-deficient rhesus monkeys in a morphine-induced conditioned place preference (CPP) paradigm. Animals with mild Parkinsonian symptoms successfully developed and retained a morphine preference that was equivalent to control monkeys. However, these monkeys could not maintain the preference as well as controls when they retained severe Parkinsonian symptoms. On the other hand, monkeys initially in a severe Parkinsonian state developed a preference for morphine, but this preference was weaker than that of the controls. Histological results showed that the loss of dopaminergic neurons in monkeys that had severe Parkinsonian symptoms was about 80% in comparison to the control monkeys. All these data suggest that a severely impaired DA system alters rewarding-seeking behavior in non-human primates. PMID:26528155

  14. The possible role of medial prefrontal cortex beta-1-adrenoceptors in morphine-induced amnesia.

    PubMed

    Torkaman-Boutorabi, Anahita; Hashemi-Hezaveh, Seyed-Milad; Sheidadoust, Hadi; Zarrindast, Mohammad-Reza

    2014-01-01

    The prelimbic region of the medial prefrontal cortex (mPFC) in the brain is crucial for memory. Norepinephrine elicits an important influence on mPFC functions. The stimulation of β-adrenoceptors (β-ARs) may play a critical role in the consolidation of long-term memory. The present study examines the possible role of β₁-ARs located in the mPFC on morphine-induced amnesia in rats. The animals were bilaterally implanted with chronic cannulas in the mPFC, trained in a step-through-type passive avoidance task and tested 24 h after training to measure step-through latency. Our present results indicated that posttraining intraperitoneal administration of morphine (2.5, 5 and 7.5 mg/kg) dose-dependently reduced the step-through latency. Different doses of xamoterol (0.01, 0.1 and 1 µg/rat) have shown no significant change in the step-through latency, but posttraining intra-mPFC microinjection of atenolol (0.2 and 0.4 µg/rat) had an amnesic effect. Moreover, atenolol-caused amnesia was reversed by an ineffective dose of xamoterol (0.1 µg/rat). On the other hand, coadministration of an ineffective dose of atenolol (0.1 µg/rat) with an ineffective dose of morphine (2.5 mg/kg) induced an amnesic effect. Meanwhile, xamoterol had no effect on morphine-induced amnesia. These results suggest that β₁-ARs of the prelimbic region in the mPFC may play an important role in morphine-induced amnesia.

  15. Blockage of acquisition and expression of morphine-induced conditioned place preference in rats due to activation of glutamate receptors type II/III in nucleus accumbens.

    PubMed

    Baharlouei, Negar; Sarihi, Abdolrahman; Komaki, Alireza; Shahidi, Siamak; Haghparast, Abbas

    2015-08-01

    Numerous studies have shown that glutamate in the nucleus accumbens (NAc) is an essential neurotransmitter for the extension of morphine-induced place preference. mGlu2/3 glutamate receptors in the NAc have important roles in the reward pathway. However, less is known about the role of this glutamate receptor subtype in morphine-induced conditioned place preference (CPP). In this study, we examined the effects of bilateral intra-accumbal administration of LY379268, an mGlu2/3 receptor agonist on the acquisition and expression of morphine-induced CPP in rats. Adult male Wistar rats (n=136; 220-250g) were evaluated in a CPP paradigm. Doses of LY379268 (0.3, 1 and 3μg/0.5μL saline per side) were administered into the NAc on both sides during the 3days of the conditioning (acquisition) or post-conditioning (expression) phase. The results show that bilateral intra-accumbal administration of LY379268 (0.3, 1 and 3μg) markedly decreased the acquisition of morphine-induced CPP in a dose-dependent manner. In a second series of experiments, we determined that injection of LY379268 into the NAc considerably attenuated the expression of morphine CPP only at the highest dose (3μg). Our findings suggest that activation of mGlu2/3 receptors in the NAc dose-dependently blocked both the establishment and the maintenance of morphine-induced CPP and confirmed the role of this system as a potential therapeutic target for addiction.

  16. Saffron (Crocus sativus) ethanolic extract and its constituent, safranal, inhibits morphine-induced place preference in mice.

    PubMed

    Ghoshooni, H; Daryaafzoon, M; Sadeghi-Gharjehdagi, S; Zardooz, H; Sahraei, H; Tehrani, S P; Noroozzadeh, A; Bahrami-Shenasfandi, F; Kaka, G H; Sadraei, S H

    2011-10-15

    The effects of saffron ethanolic extract and its constituent, safranal, on the acquisition and expression of morphine-induced place preference (CPP) in male Swiss Webster mice (20-25 g) were investigated in the present study. An unbiased place conditioning method was applied for assessment of morphine reward properties. The saffron extract and safranal were administered intraperitoneally (i.p.) during (acquisition) or after induction (expression) of morphine CPP. In a pilot study, the extract and safranal were alone administered to the animals to assess if they have any reward properties. Subcutaneous (s.c.) of morphine (4 and 8 mg kg(-1)) and extract (50 mg kg(-1); i.p.) induced CPP. Extract (10, 50 and 100 mg kg(-1); i.p.) reduced the acquisition and expression of morphine CPP. The same results were obtained when safranal (1, 5 and 10 mg kg(-1), i.p.) was used. It may be concluded that both ethanolic saffron extract and safranal can inhibit the acquisition and expression of morphine-induced CPP in the mice.

  17. A ghrelin receptor (GHS-R1A) antagonist attenuates the rewarding properties of morphine and increases opioid peptide levels in reward areas in mice.

    PubMed

    Engel, Jörgen A; Nylander, Ingrid; Jerlhag, Elisabet

    2015-12-01

    Gut-brain hormones such as ghrelin have recently been suggested to have a role in reward regulation. Ghrelin was traditionally known to regulate food intake and body weight homoeostasis. In addition, recent work has pin-pointed that this peptide has a novel role in drug-induced reward, including morphine-induced increase in the extracellular levels of accumbal dopamine in rats. Herein the effect of the ghrelin receptor (GHS-R1A) antagonist, JMV2959, on morphine-induced activation of the mesolimbic dopamine system was investigated in mice. In addition, the effects of JMV2959 administration on opioid peptide levels in reward related areas were investigated. In the present series of experiment we showed that peripheral JMV2959 administration, at a dose with no effect per se, attenuates the ability of morphine to cause locomotor stimulation, increase the extracellular levels of accumbal dopamine and to condition a place preference in mice. JMV2959 administration significantly increased tissue levels of Met-enkephalin-Arg(6)Phe(7) in the ventral tegmental area, dynorphin B in hippocampus and Leu-enkephalin-Arg(6) in striatum. We therefore hypothesise that JMV2959 prevents morphine-induced reward via stimulation of delta receptor active peptides in striatum and ventral tegmental areas. In addition, hippocampal peptides that activate kappa receptor may be involved in JMV2959׳s ability to regulate memory formation of reward. Given that development of drug addiction depends, at least in part, of the effects of addictive drugs on the mesolimbic dopamine system the present data suggest that GHS-R1A antagonists deserve to be elucidated as novel treatment strategies of opioid addiction.

  18. Effects of the fruit essential oil of Cuminum cyminum L. on the acquisition and expression of morphine-induced conditioned place preference in mice.

    PubMed

    Khatibi, Ali; Haghparast, Abbas; Shams, Jamal; Dianati, Elham; Komaki, Alireza; Kamalinejad, Mohammad

    2008-12-19

    Rewarding properties of opioids are now accepted and widely discussed. These properties can lead to long-term usage of these substances. The main purpose of this study was to investigate the effects of Cuminum cyminum fruit essential oil (FEO) on the acquisition and expression of morphine-induced conditioned place preference (CPP) in mice. CPP was induced by subcutaneous (s.c.) injection of morphine (5mg/kg) in 3 days conditioning schedule. Intraperitoneal (i.p.) administration of Cumin FEO (0.001%, 0.01%, 0.1%, 0.5%, 1% and 2%; 5 ml/kg) or Tween-80 (0.5%; 5 ml/kg) did not show any conditioning effects. Administration of Cumin FEO (0.001-2%; 5 ml/kg; i.p.), 60 min before test on day 5 (expression) decreased the conditioning scores at the doses of 1% and 2% while i.p. injection of Cumin FEO (0.001-2%; 5 ml/kg), 60 min before morphine injection (5mg/kg; s.c.) during 3 days of conditioning session (acquisition) significantly resulted in decrement of rewarding properties of morphine at the doses of 0.1%, 0.5%, 1% and 2% in dose-dependent manner. Tween-80 as a vehicle did not suppress the acquisition and expression of morphine-induced CPP. The results showed that the C. cyminum fruit essential oil reduces the acquisition and expression of morphine-induced conditioned place preference in mice.

  19. Stress antagonizes morphine-induced analgesia in rats

    NASA Technical Reports Server (NTRS)

    Vernikos, J.; Shannon, L.; Heybach, J. P.

    1981-01-01

    Exposure to restraint stress resulted in antagonism of the analgesic effect of administered morphine in adult male rats. This antagonism of morphine-induced analgesia by restraint stress was not affected by adrenalectomy one day prior to testing, suggesting that stress-induced secretion of corticosteroids is not critical to this antagonism. In addition, parenteral administration of exogenous adrenocorticotropin (ACTH) mimicked the effect of stress in antagonizing morphine's analgesic efficacy. The hypothesis that ACTH is an endogenous opiate antagonist involved in modulating pain sensitivity is supported.

  20. Influence of cholinesterase inhibitors, donepezil and rivastigmine on the acquisition, expression, and reinstatement of morphine-induced conditioned place preference in rats.

    PubMed

    Gawel, Kinga; Labuz, Krzysztof; Jenda, Malgorzata; Silberring, Jerzy; Kotlinska, Jolanta H

    2014-07-15

    The influence of systemic administration of cholinesterase inhibitors, donepezil and rivastigmine on the acquisition, expression, and reinstatement of morphine-induced conditioned place preference (CPP) was examined in rats. Additionally, this study aimed to compare the effects of donepezil, which selectively inhibits acetylcholinesterase, and rivastigmine, which inhibits both acetylcholinesterase and butyrylcholinesterase on morphine reward. Morphine-induced CPP (unbiased method) was induced by four injections of morphine (5 mg/kg, i.p.). Donepezil (0.5, 1, and 3 mg/kg, i.p.) or rivastigmine (0.03, 0.5, and 1 mg/kg, i.p.) were given 20 min before morphine during conditioning phase and 20 min before the expression or reinstatement of morphine-induced CPP. Our results indicated that both inhibitors of cholinesterase attenuated the acquisition and expression of morphine CPP. The results were more significant after rivastigmine due to a broader inhibitory spectrum of this drug. Moreover, donepezil (1 mg/kg) and rivastigmine (0.5 mg/kg) attenuated the morphine CPP reinstated by priming injection of 5mg/kg morphine. These properties of both cholinesterase inhibitors were reversed by mecamylamine (3 mg/kg, i.p.), a nicotinic acetylcholine receptor antagonist but not scopolamine (0.5 mg/kg, i.p.), a muscarinic acetylcholine receptor antagonist. All effects of cholinesterase inhibitors were observed at the doses that had no effects on locomotor activity of animals. Our results suggest beneficial role of cholinesterase inhibitors in reduction of morphine reward and morphine-induced seeking behavior. Finally, we found that the efficacy of cholinesterase inhibitors in attenuating reinstatement of morphine CPP provoked by priming injection may be due to stimulation of nicotinic acetylcholine receptors.

  1. Rewards.

    PubMed

    Gunderman, Richard B; Kamer, Aaron P

    2011-05-01

    For much of the 20th century, psychologists and economists operated on the assumption that work is devoid of intrinsic rewards, and the only way to get people to work harder is through the use of rewards and punishments. This so-called carrot-and-stick model of workplace motivation, when applied to medical practice, emphasizes the use of financial incentives and disincentives to manipulate behavior. More recently, however, it has become apparent that, particularly when applied to certain kinds of work, such approaches can be ineffective or even frankly counterproductive. Instead of focusing on extrinsic rewards such as compensation, organizations and their leaders need to devote more attention to the intrinsic rewards of work itself. This article reviews this new understanding of rewards and traces out its practical implications for radiology today. PMID:21531311

  2. Rewards.

    PubMed

    Gunderman, Richard B; Kamer, Aaron P

    2011-05-01

    For much of the 20th century, psychologists and economists operated on the assumption that work is devoid of intrinsic rewards, and the only way to get people to work harder is through the use of rewards and punishments. This so-called carrot-and-stick model of workplace motivation, when applied to medical practice, emphasizes the use of financial incentives and disincentives to manipulate behavior. More recently, however, it has become apparent that, particularly when applied to certain kinds of work, such approaches can be ineffective or even frankly counterproductive. Instead of focusing on extrinsic rewards such as compensation, organizations and their leaders need to devote more attention to the intrinsic rewards of work itself. This article reviews this new understanding of rewards and traces out its practical implications for radiology today.

  3. Quaternary naltrexone reverses radiogenic and morphine-induced locomotor hyperactivity

    SciTech Connect

    Mickley, G.A.; Stevens, K.E.; Galbraith, J.A.; White, G.A.; Gibbs, G.L.

    1984-04-01

    The present study attempted to determine the relative role of the peripheral and central nervous system in the production of morphine-induced or radiation-induced locomotor hyperactivity of the mouse. Toward this end, we used a quaternary derivative of an opiate antagonist (naltrexone methobromide), which presumably does not cross the blood-brain barrier. Quaternary naltrexone was used to challenge the stereotypic locomotor response observed in these mice after either an i.p. injection of morphine or exposure to 1500 rads /sup 60/Co. The quaternary derivative of naltrexone reversed the locomotor hyperactivity normally observed in the C57BL/6J mouse after an injection of morphine. It also significantly attenuated radiation-induced locomotion. The data reported here support the hypothesis of endorphin involvement in radiation-induced and radiogenic behaviors. However, these conclusions are contingent upon further research which more fully evaluates naltrexone methobromide's capacity to cross the blood-brain barrier.

  4. Reward-seeking behavior and addiction: cause or cog?

    PubMed

    Arias-Carrión, Oscar; Salama, Mohamed

    2012-09-01

    Although dopaminergic system represents the cornerstone in rewarding, other neurotransmitters can modulate both the reward system and the psychomotor effects of addictive drugs. Many hypotheses have been proposed for a better understanding of the reward system and its role in drug addiction. However, after many years of investigation, no single theory can completely explain the neural basis of drug addiction. Recent reports introduce novel neurotransmitters into the game e.g. dynorphins, orexins, histamine, gheralin and galanin. The interacting functions of these neurotransmitters have shown that the reward system and its role in drug dependence, is far more complicated than was thought before. Individual variations exist regarding response to drug exposure, vulnerability for addiction and the effects of different cues on reward systems. Consequently, genetic variations of neurotransmission are thought to influence reward processing that in turn may affect distinctive social behavior and susceptibility to addiction. However, the individual variations can not be based mainly on genetics; environmental factors seem to play a role too. Here we discuss the current knowledge about the orquestic regulation of different neurotransmitters on reward-seeking behavior and their potential effect on drug addiction.

  5. Differential effects of intra-accumbal orexin-1 and -2 receptor antagonists on the expression and extinction of morphine-induced conditioned place preference in rats.

    PubMed

    Sadeghzadeh, Fatemeh; Namvar, Parastoo; Naghavi, Farzaneh Sadat; Haghparast, Abbas

    2016-03-01

    Orexinergic neurons originate from the hypothalamic nuclei, sending projections toward mesolimbic regions such as the nucleus accumbens (NAc). In this study, an attempt was made to determine the effects of intra-accumbal administration of SB334867 as an orexin-1 receptor (OX1R) antagonist and TCS OX2 29 as an orexin-2 receptor (OX2R) antagonist in the expression and maintenance of morphine-induced conditioned place preference (CPP) in rats. One hundred and five adult Wistar rats weighing 200-280g were bilaterally implanted with cannulae into the NAc. During the 3-day conditioning phase, animals received daily subcutaneous administration of morphine (5mg/kg). CPP score and locomotor activity of animals were recorded by Ethovision software. Different doses of bilateral injections of the OX1R and OX2R antagonists (3, 30 and 300μg/0.5μl DMSO) were administered just before the conditioning test or daily injection during extinction phase. Our finding revealed that intra-accumbal administration of OX1R not OX2R antagonist just before the CPP test attenuated the expression of the morphine-induced CPP. However, the blockade of these two kinds of receptors shortened the extinction phase in the rats. This effect was more significant in intra-NAc OX1R antagonist-treated animals. The results suggested that OX1R within the NAc may be necessary for the morphine-induced expression. Additionally, it seems that the existence of the orexin receptors in the NAc was important for the maintenance of morphine rewarding properties during the extinction phase. Therefore, orexins may be considered as a promising therapeutic agent in preventing the expression and maintenance of morphine rewarding effects on dependent individuals.

  6. Intrathecal rapamycin attenuates morphine-induced analgesic tolerance and hyperalgesia in rats with neuropathic pain

    PubMed Central

    Xu, Ji-Tian; Sun, Linlin; Lutz, Brianna Marie; Bekker, Alex; Tao, Yuan-Xiang

    2015-01-01

    Repeated and long-term administration of opioids is often accompanied by the initiation of opioid-induced analgesic tolerance and hyperalgesia in chronic pain patients. Our previous studies showed that repeated intrathecal morphine injection activated the mammalian target of rapamycin complex 1 (mTORC1) in spinal dorsal horn neurons and that blocking this activation prevented the initiation of morphine-induced tolerance and hyperalgesia in healthy rats. However, whether spinal mTORC1 is required for morphine-induced tolerance and hyperalgesia under neuropathic pain conditions remains elusive. We here observed the effect of intrathecal infusion of rapamycin, a specific mTORC1 inhibitor, on morphine-induced tolerance and hyperalgesia in a neuropathic pain model in rats induced by the fifth lumbar spinal nerve ligation (SNL). Continuous intrathecal infusion of morphine for one week starting on day 8 post-SNL led to morphine tolerance demonstrated by morphine-induced reduction in maximal possible analgesic effect (MPAE) to tail heat stimuli and ipsilateral paw withdrawal threshold (PWT) to mechanical stimuli in SNL rats. Such reduction was attenuated by co-infusion of rapamycin. Co-infusion of rapamycin also blocked morphine tolerance demonstrated by attenuation of morphine-induced reduction in MPAE in sham rats and morphine-induced hyperalgesia demonstrated by the reverse of morphine-induced reduction in PWT on both sides of sham rats and on the contralateral side of SNL rats. The results suggest that mTORC1 inhibitors could serve as promising medications for use as adjuvants with opioids in clinical neuropathic pain management. PMID:26339682

  7. Orexin Signaling in the VTA Gates Morphine-Induced Synaptic Plasticity.

    PubMed

    Baimel, Corey; Borgland, Stephanie L

    2015-05-01

    Dopamine neurons in the ventral tegmental area (VTA) are a key target of addictive drugs, and neuroplasticity in this region may underlie some of the core features of addiction. From the very first exposure, all drugs of abuse induce synaptic plasticity in the VTA. However, it is not well understood how this diverse group of drugs brings about common synaptic change. Orexin (also known as hypocretin) is a lateral hypothalamic neuropeptide released into the VTA that promotes drug-seeking behaviors and potentiates excitatory synaptic transmission onto VTA dopamine neurons. Here we show that signaling at orexin receptor type 1 (OxR1) in the VTA is required for morphine-induced plasticity of dopamine neurons. Systemic or intra-VTA administration of the OxR1 antagonist SB 334867 in rats blocked a morphine-induced increase in the AMPAR/NMDAR ratio, an increase in presynaptic glutamate release, and a postsynaptic change in AMPAR number or function, including a switch in subunit composition. Furthermore, SB 334867 blocked a morphine-induced decrease in presynaptic GABA release, and a morphine-induced shift in the balance of excitatory and inhibitory synaptic inputs to dopamine neurons. These findings identify a novel role for orexin in morphine-induced plasticity in the VTA and provide a mechanism by which orexin can gate the output of dopamine neurons.

  8. Effects of Estrogen Receptor Modulators on Morphine Induced Sensitization in Mice Memory

    PubMed Central

    Anoush, Mahdieh; Jani, Ali; Sahebgharani, Moosa; Jafari, Mohammad Reza

    2015-01-01

    Objective: In this study, the effects of estradiol valerate and raloxifenea selective estrogen receptor modulator; (SERM) on morphine induced sensitization were examined in mice memory, according to the step-down passive avoidance task. Method: The mice received morphine or estradiol and raloxifene for three days alone or in combination with morphine. After a drug free period of 5 days, the subjects received saline or morphine as pre- training treatments followed by a pre-test saline administration. The memory retrieval was evaluated using step-down passive avoidance test both on the training and test day. Results: The results illustrated that the three- day administration of morphine induced sensitization through the enhancement of memory retrieval (morphine induced sensitization in mice memory). Both the three- day administration of estradiol valerate alone and with morphine (5 mg/kg) restored memory. On the other hand, the three- day administration of raloxifene had no effect on memory retrieval alone, but declined morphine induced sensitization in mice memory. Conclusion: The results of the study indicated that there is an interaction between estrogen receptor modulators and morphine induced sensitization in mice memory. PMID:26877753

  9. Peripheral injection of DNS-RFa, a FMRFa agonist, suppresses morphine-induced analgesia in rats.

    PubMed

    Brussaard, A B; Kits, K S; Ter Maat, A; Mulder, A H; Schoffelmeer, A N

    1989-01-01

    The present results demonstrate an antagonistic effect of DNS-RFa on morphine-induced analgesia in rats. This confirms previous evidence presented by others on the effects of FMRFa-related peptides when applied centrally. Unlike these peptides, however, it is shown here that DNS-RFa is effective upon peripheral injection. The effects of DNS-RFa on morphine-induced analgesia were dose-dependent (ED50 = 0.5 mg/kg). DNS-RFa alone (5 mg/kg) did not affect the control level of nociception. Peripheral injection of FMRFa (5 mg/kg) did not affect morphine-induced analgesia. DNS-RFa defines the minimal configuration to activate neuronal FMRFa receptors in the pond snail. The present report suggests also that in vertebrates the Arg-Phe-NH2 sequence is essential and that DNS-RFa readily penetrates the blood-brain barrier.

  10. Central amygdala nicotinic and 5-HT1A receptors mediate the reversal effect of nicotine and MDMA on morphine-induced amnesia.

    PubMed

    Tirgar, F; Rezayof, A; Zarrindast, M-R

    2014-09-26

    The present study was designed to investigate possible involvement of the central amygdala (CeA) nicotinic acetylcholine (nACh) and 5-hydroxytryptamine 1A (5-HT1A) receptors in the reversal effect of nicotine and 3,4-methylenedioxy-N-methylamphetamine (MDMA or ecstasy) on morphine-induced amnesia. Two guide cannulas were stereotaxically implanted in the CeA regions and a step-through passive avoidance task was used for the assessment of memory retrieval in adult male Wistar rats. Our results indicated that post-training s.c. administration of morphine (3-7-mg/kg) impaired memory retrieval. Pre-test administration of nicotine (0.3- and 0.5-mg/kg, s.c.) reversed morphine-induced amnesia. In addition, pre-test intra-CeA injection of MDMA (1-2-μg/rat) with an ineffective dose of nicotine (0.1-mg/kg, s.c.) improved memory retrieval, suggesting the interactive effect of the drugs on memory formation. It should be noted that that pre-test intra-CeA injection of 2-μg/rat of MDMA by itself produced amnesia. Interestingly, pre-test intra-CeA injection of mecamylamine, a nACh receptor antagonist (1-2-μg/rat) or (S)-WAY 100135 (0.25-1-μg/rat), a selective 5-HT1A receptor antagonist inhibited the improvement of morphine-induced amnesia which was produced by pre-test co-injection of nicotine and MDMA. Pre-test intra-CeA injection of the same doses of MDMA, mecamylamine or (S)-WAY 100135 by itself had no effect on morphine-induced amnesia. Moreover, pre-test injection of the same doses of mecamylamine or (S)-WAY 100135 into the CeA alone could not change memory retrieval. Taken together, it can be concluded that there is a functional interaction between morphine, nicotine and MDMA via the CeA nicotinic and serotonergic receptor mechanisms in passive avoidance memory retrieval. Moreover, cross state-dependent memory retrieval may have been induced between the drugs and this probably depends on the rewarding effects of the drugs.

  11. Contributions of spinal D-amino acid oxidase to chronic morphine-induced hyperalgesia.

    PubMed

    Ma, Shuai; Li, Xin-Yan; Gong, Nian; Wang, Yong-Xiang

    2015-12-10

    Spinal D-amino acid oxidase (DAAO) is an FAD-dependent peroxisomal flavoenzyme which mediates the conversion of neutral and polar D-amino acids (including D-serine) to the corresponding α-keto acids, and simultaneously produces hydrogen peroxide and ammonia. This study has aimed to explore the potential contributions of spinal DAAO and its mediated hydrogen peroxide/D-serine metabolism to the development of morphine-induced hyperalgesia. Bi-daily subcutaneous injections of morphine to mice over 7 days induced thermal hyperalgesia as measured by both the hot-plate and tail-immersion tests, and spinal astroglial activation with increased spinal gene expression of DAAO, glial fibrillary acidic protein (GFAP) and pro-inflammatory cytokines (interleukin-1β (IL-1β), interleukin-6 (IL-6) and tumor necrosis factor-α (TNF-α)). Subcutaneous injections of the potent DAAO inhibitor CBIO (5-chloro-benzo[D]isoxazol-3-ol) prevented and reversed the chronic morphine-induced hyperalgesia. CBIO also inhibited both astrocyte activation and the expression of pro-inflammatory cytokines. Intrathecal injection of the hydrogen peroxide scavenger PBN (phenyl-N-tert-butylnitrone) and of catalase completely reversed established morphine hyperalgesia, whereas subcutaneous injections of exogenous D-serine failed to alter chronic morphine-induced hyperalgesia. These results provided evidence that spinal DAAO and its subsequent production of hydrogen peroxide rather than the D-serine metabolism contributed to the development of morphine-induced hyperalgesia.

  12. Proteomic analysis of rat prefrontal cortex in three phases of morphine-induced conditioned place preference.

    PubMed

    Yang, Liu; Sun, Zhong Sheng; Zhu, Yong-ping

    2007-06-01

    Morphological alterations of synapse are found after morphine administration, suggesting that regulation of synaptic plasticity may be one of the mechanisms of neuroadaptation in addiction. However, the molecular basis underlying the abnormal synapse morphological and physiological changes in the morphine-induced dependence, withdraw, and relapse is not well understood. As prefrontal cortex (PFC) is one of the most important brain regions, which provides executive control over drug use and is severely impaired in many addicts, systematic analysis of the biochemical and molecular alteration of synaptic fraction of PFC in morphine-induced neuroadaptation is necessary. In this study, differential protein expression profiling of synaptic fraction of rat PFC based on morphine-induced conditioned place preference (CPP) model was performed with two-dimensional gel electrophoresis (2-DE). Our results showed that a total of 80 proteins were differentially expressed by 2-DE analysis during three phases of CPP assay. Of them, 58 were further identified by mass spectrometry. These proteins were classified into multiple categories, such as energy metabolism, signal transduction, synaptic transmission, cytoskeletal proteins, chaperones, and local synaptic protein synthetic machinery according to their biological functions. Our study provides a global view of synaptic-related molecular networking in PFC under morphine-induced dependence, withdraw, and relapse, indicative of a concerted biological process in neuroadaptation under chronic morphine exposure. PMID:17444669

  13. Proteome Analysis of Rat Hippocampus Following Morphine-induced Amnesia and State-dependent Learning

    PubMed Central

    Jafarinejad-Farsangi, Saeideh; Farazmand, Ali; Rezayof, Ameneh; Darbandi, Niloufar

    2015-01-01

    Morphine’s effects on learning and memory processes are well known to depend on synaptic plasticity in the hippocampus. Whereas the role of the hippocampus in morphine-induced amnesia and state-dependent learning is established, the biochemical and molecular mechanisms underlying these processes are poorly understood. The present study intended to investigate whether administration of morphine can change the expression level of rat hippocampal proteins during learning of a passive avoidance task. A step-through type passive avoidance task was used for the assessment of memory retention. To identify the complex pattern of protein expression induced by morphine, we compared rat hippocampal proteome either in morphine-induced amnesia or in state-dependent learning by two-dimensional gel electerophoresis and combined mass spectrometry (MS and MS/MS). Post-training administration of morphine decreased step-through latency. Pre-test administration of morphine induced state-dependent retrieval of the memory acquired under post-training morphine influence. In the hippocampus, a total of 18 proteins were identified whose MASCOT (Modular Approach to Software Construction Operation and Test) scores were inside 95% confidence level. Of these, five hippocampal proteins altered in morphine-induced amnesia and ten proteins were found to change in the hippocampus of animals that had received post-training and pre-test morphine. These proteins show known functions in cytoskeletal architecture, cell metabolism, neurotransmitter secretion and neuroprotection. The findings indicate that the effect of morphine on memory formation in passive avoidance learning has a morphological correlate on the hippocampal proteome level. In addition, our proteomicscreensuggests that morphine induces memory impairment and state-dependent learning through modulating neuronal plasticity. PMID:25901168

  14. Modulation of opiate-related signaling molecules in morphine-dependent conditioned behavior: conditioned place preference to morphine induces CREB phosphorylation.

    PubMed

    Morón, José A; Gullapalli, Srinivas; Taylor, Chirisse; Gupta, Achla; Gomes, Ivone; Devi, Lakshmi A

    2010-03-01

    Opiate addiction is a chronic, relapsing behavioral disorder where learned associations that develop between the abused opiate and the environment in which it is consumed are brought about through Pavlovian (classical) conditioning processes. However, the signaling mechanisms/pathways regulating the mechanisms that underlie the responses to opiate-associated cues or the development of sensitization as a consequence of repeated context-independent administration of opiates are unknown. In this study we examined the phosphorylation levels of various classic signaling molecules in brain regions implicated in addictive behaviors after acute and repeated morphine administration. An unbiased place conditioning protocol was used to examine changes in phosphorylation that are associated with (1) the expression of the rewarding effects of morphine and (2) the sensitization that develops to this effect. We also examined the effects of a delta-receptor antagonist on morphine-induced conditioned behavior and on the phosphorylation of classic signaling molecules in view of data showing that blockade of delta-opioid receptor (deltaOR) prevents the development of sensitization to the rewarding effects of morphine. We find that CREB phosphorylation is specifically induced upon the expression of a sensitized response to morphine-induced conditioned behavior in brain areas related to memory consolidation, such as the hippocampus and cortex. A similar effect is also observed, albeit to a lesser extent, in the case of the GluR1 subunit of AMPA glutamate receptor. These increases in the phosphorylation levels of CREB and pGluR1 are significantly blocked by pretreatment with a deltaOR antagonist. These results indicate a critical role for phospho-CREB, AMPA, and deltaOR activities in mediating the expression of a sensitized response to morphine-dependent conditioned behavior. PMID:19956087

  15. Morphine-induced conditioned place preference in rhesus monkeys: Resistance to inactivation of insula and extinction.

    PubMed

    Wu, XuJun; Zhao, Ning; Bai, Fan; Li, ChuanYu; Liu, CiRong; Wei, JingKuan; Zong, Wei; Yang, LiXin; Ryabinin, Andrey E; Ma, YuanYe; Wang, JianHong

    2016-05-01

    Drug addicts experience strong craving episodes in response to drug-associated cues. Attenuating these responses using pharmacological or behavioral approaches could aid recovery from addiction. Cue-induced drug seeking can be modeled using the conditioned place preference procedure (CPP). Our previous work showed that conditioned place preference (CPP) can be induced by administration of increasing doses of morphine in rhesus monkeys. Here, we investigated whether expression of morphine-induced CPP can be attenuated by inhibiting activity of insular cortex or by repeated unreinforced exposures to the CPP test. The insula has been demonstrated to be involved in addiction to several drugs of abuse. To test its role in morphine CPP, bilateral cannulae were implanted into the insula in seven adult monkeys. The CPP was established using a biased apparatus by intramuscular injections of morphine at increasing doses (1.5, 3.0 and 4.5mg/kg) for each monkey. After the monkeys established morphine CPP, their insulae were reversibly inactivated by bilateral microinjection with 5% lidocaine (40μl) prior to the post-conditioning test (expression) of CPP using a within-subject design. The microinjections of lidocaine failed to affect CPP expression when compared to saline injections. We subsequently investigated morphine-associated memory during six episodes of CPP tests performed in these monkeys over the following 75.0±0.2months. While the preference score showed a declining trend with repeated testing, morphine-induced CPP was maintained even on the last test performed at 75months post-conditioning. This observation indicated strong resistance of morphine-induced memories to extinction in rhesus monkeys. Although these data do not confirm involvement of insula in morphine-induced CPP, our observation that drug-associated memories can be maintained over six drug-free years following initial experience with morphine has important implications for treatment of drug addiction

  16. Morphine-induced conditioned place preference in rhesus monkeys: Resistance to inactivation of insula and extinction.

    PubMed

    Wu, XuJun; Zhao, Ning; Bai, Fan; Li, ChuanYu; Liu, CiRong; Wei, JingKuan; Zong, Wei; Yang, LiXin; Ryabinin, Andrey E; Ma, YuanYe; Wang, JianHong

    2016-05-01

    Drug addicts experience strong craving episodes in response to drug-associated cues. Attenuating these responses using pharmacological or behavioral approaches could aid recovery from addiction. Cue-induced drug seeking can be modeled using the conditioned place preference procedure (CPP). Our previous work showed that conditioned place preference (CPP) can be induced by administration of increasing doses of morphine in rhesus monkeys. Here, we investigated whether expression of morphine-induced CPP can be attenuated by inhibiting activity of insular cortex or by repeated unreinforced exposures to the CPP test. The insula has been demonstrated to be involved in addiction to several drugs of abuse. To test its role in morphine CPP, bilateral cannulae were implanted into the insula in seven adult monkeys. The CPP was established using a biased apparatus by intramuscular injections of morphine at increasing doses (1.5, 3.0 and 4.5mg/kg) for each monkey. After the monkeys established morphine CPP, their insulae were reversibly inactivated by bilateral microinjection with 5% lidocaine (40μl) prior to the post-conditioning test (expression) of CPP using a within-subject design. The microinjections of lidocaine failed to affect CPP expression when compared to saline injections. We subsequently investigated morphine-associated memory during six episodes of CPP tests performed in these monkeys over the following 75.0±0.2months. While the preference score showed a declining trend with repeated testing, morphine-induced CPP was maintained even on the last test performed at 75months post-conditioning. This observation indicated strong resistance of morphine-induced memories to extinction in rhesus monkeys. Although these data do not confirm involvement of insula in morphine-induced CPP, our observation that drug-associated memories can be maintained over six drug-free years following initial experience with morphine has important implications for treatment of drug addiction

  17. Pavlovian conditioning of morphine-induced alterations of immune status: evidence for opioid receptor involvement.

    PubMed

    Coussons-Read, M E; Dykstra, L A; Lysle, D T

    1994-12-01

    Prior work in our laboratory has shown that morphine's immunomodulatory effects can become conditioned to environmental stimuli that predict drug administration. These immune alterations include conditioned changes in natural killer cell activity, interleukin-2 production, and mitogen-induced lymphocyte proliferation. The present study examined the involvement of opioid receptor activity in the establishment and expression of conditioned morphine-induced alterations of immune status. During the training phase of the experiment, Lewis rats received two conditioning sessions during which a subcutaneous injection of 15 mg/kg morphine sulfate was paired with exposure to a distinctive environment. On the test day, animals were re-exposed to the distinctive environment alone prior to sacrifice. Saline or naltrexone (0.3, 1.0, 3.0 or 10.0 mg/kg) was administered during either the training or the test session. Administration of naltrexone prior to training antagonized the development of all of the conditioned alterations of immune status including changes in the mitogenic responsiveness of splenocytes, suppression of natural killer cell activity, and interleukin-2 production by splenocytes. Naltrexone administration prior to testing also was effective in antagonizing the expression of a subset of morphine-induced conditioned alterations in immune status. Taken together, these studies indicate that opioid receptor activity is involved in the establishment of conditioned morphine-induced immune alterations, as well as in the expression of a subset of these conditioned alterations of immune status.

  18. Calmodulin inhibitor trifluoperazine attenuates the development and expression of morphine-induced conditioned place preference in rats.

    PubMed

    Ye, Xiang-Feng; Lu, Ying; Zhang, Pan; Liang, Jian-Hui

    2004-02-23

    The effect of trifluoperazine, a calmodulin inhibitor, on morphine-induced conditioned place preference was examined in rats. Morphine (5, 10 mg/kg, i.p.) produced significant place preference for the drug-associated place. Trifluoperazine significantly suppressed the development as well as the expression of morphine-induced place preference in a dose-dependent manner, but it neither produced place preference or aversion, nor affected locomotor activity. Injection of 0.5 and 1.0 mg/kg apomorphine, a dopamine receptor agonist, did not alter the inhibition by trifluoperazine of morphine-induced place preference. Verapamil, at the dose that failed to change the place preference induced by morphine, enhanced the inhibition by trifluoperazine of morphine-induced place preference. These findings provide the first demonstration that trifluoperazine attenuates morphine-induced conditioned place preference in rats. The action of trifluoperazine might be produced through its inhibition of calmodulin, but is probably not related to dopamine receptor blockade.

  19. Neuroprotection of donepezil against morphine-induced apoptosis is mediated through Toll-like receptors.

    PubMed

    Shafie, Alireza; Moradi, Farshid; Izadpanah, Esmael; Mokarizadeh, Aram; Moloudi, Mohammad Raman; Nikzaban, Mehrnoush; Hassanzadeh, Kambiz

    2015-10-01

    Previously, we had shown that donepezil provides anti-apoptotic effects associated with the prevention of morphine tolerance to the analgesic effect. In this regard, the present study aimed to evaluate the molecular mechanisms involved in this effect considering the possible role of Toll-like receptor (TLR) 2,4, and the balance between pre-apoptotic and anti-apoptotic Bcl family proteins. To this end, male Wistar rats received daily morphine in combination with either normal saline or donepezil (0.5, 1, or 1.5 mg/kg, ip). The analgesic effect was assessed by the plantar test apparatus. The latency was recorded when the animal responded to the light stimulus. On the 15th day, when no significant difference was observed between morphine and saline groups in terms of analgesia, the frontal cortex and lumbar spinal cord of the animals were dissected. Then, TLR2 and 4, Bcl2, and Bax mRNA fold changes were calculated using Real-time PCR method. The results indicated no significant analgesic effect in the morphine group compared with the saline treated animals after 15 days of injection, while daily co-administration of donepezil with morphine preserved significant analgesia. Moreover, Quantitative PCR showed that morphine significantly increased TLRs and Bax gene expressions and decreased the anti-apoptotic Bcl2. In contrast, donepezil prevented these morphine induced changes in the mentioned gene expressions. Taken together, the results suggest that the neuroprotective effects of donepezil in attenuating morphine-induced tolerance and apoptosis are mediated by preventing morphine-induced changes in TLR2 and 4 gene expressions.

  20. [Morphine-induced Anaphylaxis before Induction of Anesthesia].

    PubMed

    Takahashi, Kei; Suzuki, Hiroaki; Arai, Takero; Okuda, Yasuhisa

    2016-04-01

    We describe a case of anaphylaxia that occurred in a 67-year-old man. He was planned to have an operation on mitral valve prolapse (MVP) for mitral regurgitation (MR). Morphine 5 mg was injected intramusculaly 45 min before operation. Since then, he felt itchy sensation around his inguinal region. After he came to the operating room, he felt itchy sensation all over the body. Initially, his vatal signs were stable. We started to give extracellular fluid including ulinastatin 300,000 U, methylprednisolone 2 g, and ranitidine 50 mg. A few minutes later, he had nettle rash all over the body and his blood pressure decreased to 40/20 mmHg, and the heart rate increased to 120 beats x min(-1). Soon after, he had pulseless electric activity (PEA). We started chest compression and tracheal intubation. We injected adrenaline 1 mg. After doing the continuous chest compression for 2 min, he revived. He had continuous medications including dopamine 5 μg x kg(-1) x min(-1), dobutamine 5 μg x kg(-1) x min(-1), noradrenaline 0.05 μg x kg(-1) x min(-1). We cancelled the operation, and he was transfered to the high care unit (HCU), where his blood pressure was 120/65 mmHg, and heart rate 120 beats x min(-1). After 24 hours, we extubated his trachea. In this case, morphine was considered to be the most likely cause for anaphylaxis. PMID:27188106

  1. Sex differences in morphine-induced behavioral sensitization and social behaviors in ICR mice.

    PubMed

    Zhan, Bo; Ma, Hong-Yuan; Wang, Jian-Li; Liu, Chao-Bao

    2015-03-18

    Gender and genetic strain are two prominent variants that influence drug abuse. Although certain sex-related behavioral responses have been previously characterized in ICR mice, little is known about the effects of sex on morphine-induced behavioral responses in this outbred strain. Therefore, in this study, we investigated the sex differences of morphine-induced locomotion, anxiety-like and social behaviors in ICR mice. After morphine or saline exposure for four consecutive days (twice daily), increased locomotion, more time spent in the central area, as well as attenuated rearing and self-grooming behaviors were found in morphine-treated females in an open field; no differences were found in locomotion and the time spent in the central area between male and female controls. When interacting with the same-sex individuals, female controls were engaged in more social investigation, following, body contacting and self-grooming behaviors than controls; morphine exposure reduced contacting and self-grooming behaviors in females; in contrast, these effects were not found in males. These results indicate that female ICR mice are more prosocial and are more susceptible to morphine exposure than males.

  2. Sex differences in morphine-induced behavioral sensitization and social behaviors in ICR mice

    PubMed Central

    ZHAN, Bo; MA, Hong-Yuan; WANG, Jian-Li; LIU, Chao-Bao

    2015-01-01

    Gender and genetic strain are two prominent variants that influence drug abuse. Although certain sex-related behavioral responses have been previously characterized in ICR mice, little is known about the effects of sex on morphine-induced behavioral responses in this outbred strain. Therefore, in this study, we investigated the sex differences of morphine-induced locomotion, anxiety-like and social behaviors in ICR mice. After morphine or saline exposure for four consecutive days (twice daily), increased locomotion, more time spent in the central area, as well as attenuated rearing and self-grooming behaviors were found in morphine-treated females in an open field; no differences were found in locomotion and the time spent in the central area between male and female controls. When interacting with the same-sex individuals, female controls were engaged in more social investigation, following, body contacting and self-grooming behaviors than controls; morphine exposure reduced contacting and self-grooming behaviors in females; in contrast, these effects were not found in males. These results indicate that female ICR mice are more prosocial and are more susceptible to morphine exposure than males. PMID:25855229

  3. Protective Effect of Bacoside-A against Morphine-Induced Oxidative Stress in Rats.

    PubMed

    Sumathi, T; Nathiya, V C; Sakthikumar, M

    2011-07-01

    In the present study, we investigated the protective effect of bacoside-A the active principle isolated from the plant Bacopa monniera against oxidative damage induced by morphine in rat brain. Morphine intoxicated rats received 10-160 mg/kg b.w. of morphine hydrochloride intraperitoneally for 21 days. Bacoside-A pretreated rats were administered with bacoside-A (10 mg/kg b.w/day) orally, 2 h before the injection of morphine for 21 days. Pretreatment with bacoside-A has shown to possess a significant protective role against morphine induced brain oxidative damage in the antioxidant status (total reduced glutathione, superoxide dismutase, catalase, glutathione peroxidase and lipid peroxidation) and membrane bound ATP-ases(Na(+)/K(+)ATPase. Ca(2+) and Mg(2+) ATPases) activities in rat. The results of the present study indicate that bacoside-A protects the brain from oxidative stress induced by morphine.

  4. Protective Effect of Bacoside-A against Morphine-Induced Oxidative Stress in Rats

    PubMed Central

    Sumathi, T.; Nathiya, V. C.; Sakthikumar, M.

    2011-01-01

    In the present study, we investigated the protective effect of bacoside-A the active principle isolated from the plant Bacopa monniera against oxidative damage induced by morphine in rat brain. Morphine intoxicated rats received 10-160 mg/kg b.w. of morphine hydrochloride intraperitoneally for 21 days. Bacoside-A pretreated rats were administered with bacoside-A (10 mg/kg b.w/day) orally, 2 h before the injection of morphine for 21 days. Pretreatment with bacoside-A has shown to possess a significant protective role against morphine induced brain oxidative damage in the antioxidant status (total reduced glutathione, superoxide dismutase, catalase, glutathione peroxidase and lipid peroxidation) and membrane bound ATP-ases(Na+/K+ATPase. Ca2+ and Mg2+ ATPases) activities in rat. The results of the present study indicate that bacoside-A protects the brain from oxidative stress induced by morphine. PMID:22707825

  5. BK channels in microglia are required for morphine-induced hyperalgesia

    PubMed Central

    Hayashi, Yoshinori; Morinaga, Saori; Zhang, Jing; Satoh, Yasushi; Meredith, Andrea L.; Nakata, Takahiro; Wu, Zhou; Kohsaka, Shinichi; Inoue, Kazuhide; Nakanishi, Hiroshi

    2016-01-01

    Although morphine is a gold standard medication, long-term opioid use is associated with serious side effects, such as morphine-induced hyperalgesia (MIH) and anti-nociceptive tolerance. Microglia-to-neuron signalling is critically involved in pain hypersensitivity. However, molecules that control microglial cellular state under chronic morphine treatment remain unknown. Here we show that the microglia-specific subtype of Ca2+-activated K+ (BK) channel is responsible for generation of MIH and anti-nociceptive tolerance. We find that, after chronic morphine administration, an increase in arachidonic acid levels through the μ-opioid receptors leads to the sole activation of microglial BK channels in the spinal cord. Silencing BK channel auxiliary β3 subunit significantly attenuates the generation of MIH and anti-nociceptive tolerance, and increases neurotransmission after chronic morphine administration. Therefore, microglia-specific BK channels contribute to the generation of MIH and anti-nociceptive tolerance. PMID:27241733

  6. BK channels in microglia are required for morphine-induced hyperalgesia.

    PubMed

    Hayashi, Yoshinori; Morinaga, Saori; Zhang, Jing; Satoh, Yasushi; Meredith, Andrea L; Nakata, Takahiro; Wu, Zhou; Kohsaka, Shinichi; Inoue, Kazuhide; Nakanishi, Hiroshi

    2016-05-31

    Although morphine is a gold standard medication, long-term opioid use is associated with serious side effects, such as morphine-induced hyperalgesia (MIH) and anti-nociceptive tolerance. Microglia-to-neuron signalling is critically involved in pain hypersensitivity. However, molecules that control microglial cellular state under chronic morphine treatment remain unknown. Here we show that the microglia-specific subtype of Ca(2+)-activated K(+) (BK) channel is responsible for generation of MIH and anti-nociceptive tolerance. We find that, after chronic morphine administration, an increase in arachidonic acid levels through the μ-opioid receptors leads to the sole activation of microglial BK channels in the spinal cord. Silencing BK channel auxiliary β3 subunit significantly attenuates the generation of MIH and anti-nociceptive tolerance, and increases neurotransmission after chronic morphine administration. Therefore, microglia-specific BK channels contribute to the generation of MIH and anti-nociceptive tolerance.

  7. Effects of sweetening agents on morphine-induced analgesia in mice by formalin test.

    PubMed

    Nikfar, S; Abdollahi, M; Etemad, F; Sharifzadeh, M

    1997-10-01

    1. There is evidence that sweet-tasting substances such as sucrose and saccharin can interact with endogenous opioid systems. Further evidence showed that feeding mice different concentrations of sucrose and saccharin alter the latency in the tail-flick test. 2. In the current study, the effects of a 12-day regimen of different sweetening agents [sucrose (32%), saccharin (0.08%) and aspartame (0.16%)] on morphine-induced analgesia with the formalin test were investigated. 3. Male albino mice (20-27 g) were used for the experiments. Animals were given 12 days to adapt to dietary conditions. Animals were first given saline or morphine subcutaneously (1.5, 3.0, 6.0, or 9.0 mg/kg) 30 min before the observation period. The recording of the early phase started immediately and lasted for 10 min. The recording of the late response started 20 min after formalin injection and lasted for 10 min. Statistical analysis was performed by using analysis of variance followed by Newman-Keuls test, and P < or = 0.05 was considered significant. 4. Sucrose and aspartame increased morphine analgesia in the early phase, but saccharin had no effect on the early phase. On the other hand, saccharin and sucrose decreased the effect of morphine in the late phase, but aspartame increased the effect of morphine-induced analgesia. 5. In conclusion, the present data provide further evidence for an important role for dietary variables in determining the effects of exogenous opioids on pain sensitivity.

  8. PKC and PKA inhibitors reinstate morphine-induced behaviors in morphine tolerant mice.

    PubMed

    Smith, Forrest L; Javed, Ruby R; Smith, Paul A; Dewey, William L; Gabra, Bichoy H

    2006-12-01

    Male Swiss Webster mice exhibited antinociception, hypothermia and Straub tail 3h following a 75mg morphine pellet implantation. These signs disappeared by 72h, and the morphine-pelleted mice were indistinguishable from placebo-pelleted ones, although brain morphine concentrations ranged from 200 to 400ng/gm. We previously demonstrated that chemical inhibitors of protein kinase C (PKC) and A (PKA) are able to reverse morphine tolerance in acutely morphine-challenged mice. However, it was not known whether the reversal of tolerance was due to the interaction of kinase inhibitors with the morphine released from the pellet, the acutely injected morphine to challenge tolerant mice, or both. The present study aimed at determining the interaction between the PKC and PKA inhibitors and the morphine released "solely" from the pellet to reinstate the morphine-induced behavioral and physiological effects, 72h after implantation of morphine pellets. Placebo or 75mg morphine pellets were surgically implanted, and testing was conducted 72h later. Our results showed that the intracerebroventricular (i.c.v.) administration of the PKC inhibitors, bisindolylmaleimide I and Gö-6976 as well as the PKA inhibitors, 4-cyano-3-methylisoquinoline and KT-5720, restored the morphine-induced behaviors of antinociception, Straub tail and hypothermia in morphine-pelleted mice to the same extent observed 3h following the pellet implantation. The tail withdrawal and the hot plate reaction time expressed as percent maximum possible effect (%MPE) was increased to 80-100 and 41-90%, respectively, in PKC and PKA inhibitor-treated morphine tolerant mice compared to 2-10% in non-treated mice. Similarly, a significant hypothermia (1.3-4.0 degrees C decrease in body temperature) was detected in PKC and PKA inhibitor-treated morphine tolerant mice compared to an euthermic state in non-treated morphine tolerant mice. Finally, the Straub tail score was increased to 1.1-1.6 in PKC and PKA inhibitor

  9. Pavlovian conditioning of morphine-induced alterations of immune status: evidence for peripheral beta-adrenergic receptor involvement.

    PubMed

    Coussons-Read, M E; Dykstra, L A; Lysle, D T

    1994-09-01

    The present studies examined the involvement of peripheral beta-adrenergic receptor activity in the establishment and expression of conditioned morphine-induced alterations of immune status. Previous work in our laboratory has shown that morphine's immunomodulatory effects can become conditioned to environmental stimuli which predict drug administration. These immune alterations include conditioned changes in natural killer cell activity, interleukin-2 production, and mitogen-induced lymphocyte proliferation. During the training phase of these experiments, Lewis rats received two conditioning sessions during which a subcutaneous injection of 15 mg/kg morphine sulfate was paired with exposure to a distinctive environment. On the test day, rats were reexposed to the conditioned stimulus prior to sacrifice. Saline or nadolol (0.002, 0.02, 0.2, or 2.0 mg/kg) was administered either prior to the training sessions or prior to the test session. Administration of nadolol prior to training did not affect the development of conditioned alterations of immune status. Conversely, nadolol administration prior to testing completely attenuated the expression of a subset of the conditioned morphine-induced changes in immune status. Taken together, these studies suggest that whereas peripheral beta-adrenergic receptor activity is not required for the establishment of conditioned morphine-induced alterations of immune status, it is involved in the expression of a subset of these conditioned immunomodulatory effects.

  10. The α1 adrenoceptors in ventrolateral orbital cortex contribute to the expression of morphine-induced behavioral sensitization in rats.

    PubMed

    Wei, Lai; Zhu, Yuan-Mei; Zhang, Yu-Xiang; Liang, Feng; Li, Teng; Gao, Hong-Yu; Huo, Fu-Quan; Yan, Chun-Xia

    2016-01-01

    The aim of the present study was to investigate the effect of microinjection of benoxathian, selective α1 adrenoceptor antagonist, into the ventrolateral orbital cortex (VLO) on morphine-induced behavioral sensitization and its underlying molecular mechanism in rats. A single morphine treatment protocol was used in establishing the behavioral sensitization model. The effect of bilateral intra-VLO benoxathian injection on locomotor activity was examined and the protein expression levels of α1 adrenoceptors and activation of extracellular signal-regulated kinase (ERK) in the VLO were detected after locomotor test. The results showed that a single injection of morphine could induce behavioral sensitization by a low challenge dosage of morphine after a 7-days drug free period. Benoxathian significantly suppressed the expression but not the development of morphine-induced behavioral sensitization. Morphine treatment significantly elicited ERK phosphorylation and downregulated the expression level of α1 adrenoceptors in the VLO. In addition, intra-VLO benoxathian injection enhanced the expression levels of α1 adrenoceptors and phosphorylated ERK. These results suggest that α1 adrenoceptors in the VLO are involved in regulating the expression of morphine-induced behavioral sensitization. The effect of decreased locomotor activity by blocking α1 adrenoceptors might be associated with activation of ERK in the VLO.

  11. A new pharmacological role for donepezil: attenuation of morphine-induced tolerance and apoptosis in rat central nervous system

    PubMed Central

    2014-01-01

    Background Tolerance to the analgesic effect of opioids is a pharmacological phenomenon that occurs after their prolonged administration. It has been shown that morphine-induced tolerance is associated with apoptosis in the central nervous system and neuroprotective agents which prevented apoptosis signaling could attenuate tolerance to the analgesic effects. On the other hand donepezil, an acetylcholinesterase inhibitor, has been reported to have neuroprotective effects. Therefore in this study, the effect of systemic administration of donepezil on morphine-induced tolerance and apoptosis in the rat cerebral cortex and lumbar spinal cord was evaluated. Various groups of rats received morphine (ip) and different doses of donepezil (0, 0.5, 1, 1.5 mg/kg/day). Nociception was assessed using tail flick apparatus. Tail flick latency was recorded when the rat shook its tail. For apoptosis assay other groups of rats received the above treatment and apoptosis was evaluated by in situ terminal deoxynucleotidyl transferase-mediated dUTP-biotin nick end-labeling (TUNEL) method. Results The results showed that administration of donepezil (0.5, 1, 1.5 mg/kg, ip) delayed the morphine tolerance for 9, 12 and 17 days, respectively. Furthermore pretreatment injection of donepezil attenuated the number of apoptotic cells in the cerebral cortex and lumbar spinal cord compared to the control group. Conclusion In conclusion, we found that systemic administration of donepezil attenuated morphine-induced tolerance and apoptosis in the rat cerebral cortex and lumbar spinal cord. PMID:24455992

  12. Morphine-induced receptor endocytosis in a novel knockin mouse reduces tolerance and dependence.

    PubMed

    Kim, Joseph A; Bartlett, Selena; He, Li; Nielsen, Carsten K; Chang, Amy M; Kharazia, Viktor; Waldhoer, Maria; Ou, Chrissi J; Taylor, Stacy; Ferwerda, Madeline; Cado, Dragana; Whistler, Jennifer L

    2008-01-22

    Opioid drugs, such as morphine, are among the most effective analgesics available. However, their utility for the treatment of chronic pain is limited by side effects including tolerance and dependence. Morphine acts primarily through the mu-opioid receptor (MOP-R) , which is also a target of endogenous opioids. However, unlike endogenous ligands, morphine fails to promote substantial receptor endocytosis both in vitro, and in vivo. Receptor endocytosis serves at least two important functions in signal transduction. First, desensitization and endocytosis act as an "off" switch by uncoupling receptors from G protein. Second, endocytosis functions as an "on" switch, resensitizing receptors by recycling them to the plasma membrane. Thus, both the off and on function of the MOP-R are altered in response to morphine compared to endogenous ligands. To examine whether the low degree of endocytosis induced by morphine contributes to tolerance and dependence, we generated a knockin mouse that expresses a mutant MOP-R that undergoes morphine-induced endocytosis. Morphine remains an excellent antinociceptive agent in these mice. Importantly, these mice display substantially reduced antinociceptive tolerance and physical dependence. These data suggest that opioid drugs with a pharmacological profile similar to morphine but the ability to promote endocytosis could provide analgesia while having a reduced liability for promoting tolerance and dependence.

  13. Role of phosphodiesterase inhibitor Ibudilast in morphine-induced hippocampal injury

    PubMed Central

    Zhaleh, Mohsen; Panahi, Marzieh; Ghafurian Broujerdnia, Mehri; Ghorbani, Rostam; Ahmadi Angali, Kambiz; Saki, Ghasem

    2014-01-01

    Abstract: Background: Opioid drugs are used in the treatment of acute post-surgical pain and chronic pain, such as those associated with cancer. Opioid used is associated with complications such as analgesic tolerance, dependence and opioid abuse. The molecular mechanisms of unwanted opioid responses are varied but recent advances have highlighted elevations in pro-inflammatory cytokines and pro-inflammatory glial following chronic administration of morphine. In this study we investigated the neurodegenerative effects of morphine through its effects on Toll-Like Receptor 4 (TLR4) in the male rat hippocampus and evaluated the level of Interleukin-1 beta (IL-1β). Then we compared the difference between inhibitory effects on mu opioid receptors (by β-Funaltrexamine, β-FNA) and TLR4 (by Ibudilast). Subsequently, we assessed the amount of IL-1β and the number of granular cells in male rat hippocampus. Methods: Adult male rats (n=24) were treated with sucrose, morphine, Ibudilast (7.5 mg/kg) and β-FNA (20 mg/kg) for 30 days. Their brains were isolated and hemisected with one hippocampus for granular cell and the other used for IL-1 β immunoblotting. Results: Data showed that Ibudilast suppresses IL-1 β expression significantly more than β-FNA. The granular cell count displayed significant differences. Conclusions: Our results suggested that Ibudilast can be used for controlling and treatment of morphine-induced CNS inflammations or traumatic conditions. PMID:24121451

  14. Gastric pentadecapeptide BPC 157 counteracts morphine-induced analgesia in mice.

    PubMed

    Boban Blagaic, A; Turcic, P; Blagaic, V; Dubovecak, M; Jelovac, N; Zemba, M; Radic, B; Becejac, T; Stancic Rokotov, D; Sikiric, P

    2009-12-01

    Previously, the gastric pentadecapeptide BPC 157, (PL 14736, Pliva) has been shown to have several beneficial effects, it exert gastroprotective, anti-inflammatory actions, stimulates would healing and has therapeutic value in inflammatory bowel disease. The present study aimed to study the effect of naloxone and BPC 157 on morphine-induced antinociceptive action in hot plate test in the mouse. It was found that naloxone and BPC 157 counteracted the morphine (16 mg/kg s.c.) - analgesia. Naloxone (10 mg/kg s.c.) immediately antagonised the analgesic action and the reaction time returned to the basic values, the development of BPC 157-induced action (10 pg/kg, 10 ng/kg, 10 microg/kg i.p.) required 30 minutes. When haloperidol, a central dopamine-antagonist (1 mg/kg i.p.), enhanced morphine-analgesia, BPC 157 counteracted this enhancement and naloxone reestablished the basic values of pain reaction. BPC 157, naloxone, and haloperidol per se failed to exert analgesic action. In summary, interaction between dopamine-opioid systems was demonstrated in analgesia, BPC 157 counteracted the haloperidol-induced enhancement of the antinociceptive action of morphine, indicating that BPC acts mainly through the central dopaminergic system. PMID:20388962

  15. Role of fosaprepitant, a neurokinin Type 1 receptor antagonist, in morphine-induced antinociception in rats

    PubMed Central

    Prasoon, Pranav; Gupta, Shivani; Kumar, Rahul; Gautam, Mayank; Kaler, Saroj; Ray, Subrata Basu

    2016-01-01

    Objectives: Opioids such as morphine form the cornerstone in the treatment of moderate to severe pain. However, opioids also produce serious side effects such as tolerance. Fosaprepitant is a substance P (SP) receptor antagonist, which is used for treating chemotherapy-induced nausea and vomiting. SP is an important neuropeptide mediating transmission of pain at the spinal level. Thus, it was hypothesized that combining morphine with fosaprepitant would increase the antinociceptive effect of morphine. The objectives were to evaluate the effect of fosaprepitant on morphine-induced antinociception in rats and to investigate its mechanism of action. Methods: Sprague-Dawley rats were injected with morphine (10 mg/kg twice daily) and/or fosaprepitant (30 mg/kg once daily) for 7 days. Pain threshold was assessed by the hot plate test. Expression of SP and calcitonin gene-related peptide (CGRP) in the spinal cords of these rats was evaluated by immunohistochemistry. Results: Morphine administration resulted in an antinociceptive effect compared to the control group (day 1 and to a lesser extent on day 4). The decreased antinociception despite continued morphine treatment indicated development of tolerance. Co-administration of fosaprepitant attenuated tolerance to morphine (days 1 and 3) and increased the antinociceptive effect compared to control group (days 1–4). Expression of SP was increased in the morphine + fosaprepitant group. Conclusions: The results show that fosaprepitant attenuates the development of tolerance to morphine and thereby, increases the antinociceptive effect. This is likely linked to decreased release of SP from presynaptic terminals.

  16. Reinstatement of Morphine-Induced Conditioned Place Preference in Mice by Priming Injections

    PubMed Central

    Do Couto, B. Ribeiro; Aguilar, M. A.; Manzanedo, C.; Rodríguez-Arias, M.; Miñarro, J.

    2003-01-01

    To construct a model of relapse of drug abuse in mice, the induction, we evaluated the extinction and reinstatement of morphine-induced place preference. In Experiment 1, we examined the effects of morphine (0, 2, 3, 5, 10, 20 and 40 mg/kg) in the conditioned place preference (CPP) paradigm. Mice showed CPP with 5, 10, 20 and 40 mg/kg. In Experiment 2, we evaluated the effects of two different extinction procedures. After conditioning with 40 mg/kg of morphine, the mice underwent daily extinction sessions of 60 or 15 min of duration. CPP was extinguished after seven and nine sessions, respectively. In Experiment 3, we tested the reinstating effects of several priming doses of morphine. Mice were conditioned with 40 mg/kg of morphine and underwent the daily 15 min extinction sessions until CPP was no longer evident. Then, the effects of morphine (0, 2, 3, 5, 10, 20, 40 mg/kg, i.p.) were evaluated. CPP was reinstated by doses from 5 mg/kg upward. The results show that morphine priming injections are effective in reactivating opiateseeking behavior in mice, and thus, the CPP paradigm might be useful to investigate the mechanisms underlying relapse of drug abuse. PMID:15152982

  17. Opiates selectively increase intracellular calcium in developing type-1 astrocytes: role of calcium in morphine-induced morphologic differentiation.

    PubMed

    Stiene-Martin, A; Mattson, M P; Hauser, K F

    1993-12-17

    Endogenous opioids and opiate drugs inhibit nervous system maturation, in part, by affecting the growth of astrocytes. Opiates inhibit astrocyte proliferation and cause premature differentiation. The emerging importance of Ca2+ in astrocyte function prompted us to explore whether opiates might affect astrocyte development by altering Ca2+ homeostasis. Astrocyte-enriched cultures were derived from newborn ICR mouse cerebra. Quantitative fluorescent measurements of intracellular free Ca2+ ([Ca2+]i) using Fura-2 as well as fluo-3 and computer-aided image analysis showed that 1 microM morphine significantly increased [Ca2+]i in flat, polyhedral, glial fibrillary acidic protein (GFAP) immunoreactive astrocytes at 2 and 6 min, and at 72 h. Co-administration of 3 microM naloxone blocked morphine-dependent increases in [Ca2+]i. Treatment with 1 microM concentrations of the kappa-opioid receptor agonist, U69,593, but not equimolar amounts of mu ([D-Ala2,MePhe4,Gly(ol)5]enkephalin)- or delta ([D-Pen2,D-Pen5]enkephalin)-opioid receptor agonists, significantly increased [Ca2+]i in astrocytes. To assess the role of Ca2+ in morphine-induced astrocyte differentiation, untreated and 1 microM morphine-treated astrocyte cultures were incubated for 5 days in < 0.01, 0.3, 1.0, or 3.0 mM extracellular Ca2+ ([Ca2+]o), or incubated with 1.0 mM [Ca2+]o in the presence of 1 microM of the Ca2+ ionophore, A23187. The areas of single astrocytes were measured and there was a positive correlation between astrocyte area and [Ca2+]o. Morphine had an additive effect on area and form factor measures when [Ca2+]o was 1.0 mM. High [Ca2+]o (3.0 mM) alone mimicked the action of morphine. Morphine alone had no effect on astrocyte area in the presence of 3.0 mM Ca2+.(ABSTRACT TRUNCATED AT 250 WORDS)

  18. Effects of cholecystokinin-8 on morphine-induced spatial reference memory impairment in mice.

    PubMed

    Yang, Shengchang; Wen, Di; Dong, Mei; Li, Dong; Sun, Donglei; Ma, Chunling; Cong, Bin

    2013-11-01

    Acute and chronic exposure to opiate drugs impaired various types of memory processes. To date, there is no preventive treatment for opiate-induced memory impairment and the related mechanism is still unclear. CCK-8 is the most potent endogenous anti-opioid peptide and has been shown to exert memory-enhancing effect, but the effect of CCK-8 on morphine-induced memory impairment has not been reported. By using Morris water maze, we found that escape latency to the hidden platform in navigation test was not influenced, but performance in the probe test was seriously poor in morphine dependency mice. Amnesia induced by chronic morphine treatment was significantly alleviated by pre-treatment with CCK-8 (0.01, 0.1 and 1 μg, i.c.v.), and CCK-8 (0.1 and 1 μg, i.c.v.) treatment alone could improve performance in either navigation or probe test. Furthermore, Golgi-Cox staining analysis revealed that pre-treatment with CCK-8 (1 μg, i.c.v.) reversed spine density decreased in CA1 region of hippocampus in morphine dependency mice, and CCK-8 (1 μg, i.c.v.) alone obviously increased spine density in CA1. Our findings conclude spine density change in CA1 region of hippocampus may be the structural plasticity mechanism which is responsible for enhancing effect of CCK-8 on spatial reference memory. Therefore, CCK-8 could effectively improve memory impairment in morphine dependency mice.

  19. Morphine-induced conditioned place preference and the alterations of p-ERK, p-CREB and c-fos levels in hypothalamus and hippocampus: the effects of physical stress.

    PubMed

    Pahlevani, P; Fatahi, Z; Moradi, M; Haghparast, A

    2014-12-08

    The hypothalamus and hippocampus are important areas involved in stress responses and reward processing. In addition, ERK/CREB pathway plays a critical role in the control of cellular responses to stress and reward. In the current study, effects of acute and subchronic stress on the alteration of p-ERK, p-CREB and c-fos levels in the hypothalamus and hippocampus of saline- or morphine-treated animals during morphine-induced conditioned place preference (CPP) procedure were investigated. Male Wistar rats were divided into two saline- and morphine-treated supergroups. Each supergroup includes of control, acute stress and subchronic stress groups. In all of groups, the CPP procedure was done, afterward the alternation of p-ERK/ERK ratio, p-CREB/CREB ratio and c-fos level in the hypothalamus and hippocampus were estimated by Western blot analysis. The results indicated that in saline- or morphine-treated animals, p-ERK/ERK ratio, p-CREB/CREB ratio and c-fos level increased after application of acute and subchronic stress (except for p-ERK/ERK ratio in morphine-control group). Our findings revealed that in saline- or morphine-treated animals, acute and subcronic stress increased the p-ERK/ERK ratio, p-CREB/CREB ratio and c-fos level in the hypothalamus and hippocampus and this enhancement in morphine-treated animals, was more considerable than that in saline-treated animals.

  20. Biomarkers of morphine tolerance and dependence are prevented by morphine-induced endocytosis of a mutant mu-opioid receptor.

    PubMed

    He, Li; Kim, Joseph A; Whistler, Jennifer L

    2009-12-01

    Growing evidence shows that trafficking of the mu-opioid receptor (MOR) is a critical process in functional recovery from desensitization following activation and plays important roles in morphine tolerance and dependence largely because of the failure of morphine to promote such trafficking. However, morphine tolerance and dependence are believed to be mediated by multiple mechanisms, including well-documented biochemical changes in cAMP activity, N-methyl-D-aspartate receptors (NMDARs), glucocorticoid receptors (GRs), and c-fos. Here, we assess the consequences of promoting morphine-induced endocytosis on these biochemical changes utilizing a knock-in mouse model, RMOR, in which MORs undergo morphine-induced endocytosis. Chronic morphine treatment of wild-type (WT) mice promoted superactivation of adenylyl cyclase, alterations in NMDARs, and up-regulation of GR and c-fos in distinct brain regions. Notably, none of these biochemical changes occurred in the RMOR-knock-in mice. Together, these data demonstrate that morphine tolerance and dependence are mediated by multiple biochemical mechanisms and that MOR endocytosis plays a critical role in each of these mechanisms.

  1. Interaction between calcium channel blockers and sweetening agents on morphine-induced analgesia in mice by formalin test.

    PubMed

    Nikfar, S; Abdollahi, M; Sarkarati, F; Etemad, F

    1998-09-01

    1. Calcium is known to be an important ion in the modulation of nociception and inflammation. Previous research has shown that mice drinking sweet-tasting solutions such as sucrose, saccharin and aspartame exhibit significant changes in morphine-induced analgesia in both phases of the formalin test. 2. In this study, the role of calcium channel blockers on the effectivity of a 12-day regimen of different sweetening agents (sucrose 32%, saccharin 0.08% and aspartame 0.16%) on the alteration of the morphine response has been investigated. 3. Male albino mice weighing 20-27 g were used for experiments. Animals were given 12 days to adapt to dietary conditions. Animals were given morphine (1.5, 3, 6, 9 mg/kg) subcutaneously 30 min before observation. Nifedipine (5 mg/kg), verapamil (5 mg/kg) and diltiazem (10 mg/kg) were administered intraperitoneally 20 min before morphine injection. 4. Recording of the early phase started immediately and lasted for 10 min after formalin injection. Recording of the late response started 20 min after formalin injection and lasted for 10 min. 5. Calcium channel blockers potentiated the antinociceptive effects of sweetening agents and diminished the antagonistic effects of these compounds on morphine-induced analgesia in the early and late phases of the formalin test. 6. It is proposed that calcium has a role for the interactive effects of sweetening agents and morphine on pain sensitivity.

  2. Ginger (Zingiber Officinale Roscoe) Prevents Morphine-Induced Addictive Behaviors in Conditioned Place Preference Test in Rats

    PubMed Central

    Torkzadeh-Mahani, Shima; Nasri, Sima; Esmaeili-Mahani, Saeed

    2014-01-01

    Background Consumption of chronic morphine induces neuro-inflammation and addictive seeking behavior. Ginger (Zingiber Officinale Roscoe), a well-known spice plant, has been used traditionally in the treatment of a wide variety of ailments. It has been shown that ginger has anti-inflammatory, anti-oxidative and antinociceptive properties. However, its influences on morphine-induced addictive behaviors have not yet been clarified. The aim of the present study was the inhibition of exploratory behavior of morphine addiction in the conditioned place preference test in male desert rats through ginger. Methods For conditioning to the morphine, the male Wistar rats received morphine (12 mg/kg intraperitoneally or i.p.) for 6 consecutive days and treatment groups were given different doses of ginger (25, 50 and 100 mg/kg intragastrically or i.g.) 30 min before morphine injection. For investigating addictive seeking behavior, conditioned place preference test (CPP) was used. Findings Our result demonstrated that injection of morphine for 6 days induces dependency to morphine and creates addictive seeking behavior and ginger (100 mg/kg) could decrease time spend in conditioning box (addictive seeking behavior). Conclusion The data indicated that ginger extract has a potential anti-addictive property against chronic usage of morphine. PMID:25140219

  3. Drug-sensitive reward in crayfish: an invertebrate model system for the study of SEEKING, reward, addiction, and withdrawal.

    PubMed

    Huber, Robert; Panksepp, Jules B; Nathaniel, Thomas; Alcaro, Antonio; Panksepp, Jaak

    2011-10-01

    In mammals, rewarding properties of drugs depend on their capacity to activate appetitive motivational states. With the underlying mechanisms strongly conserved in evolution, invertebrates have recently emerged as a powerful new model in addiction research. In crayfish natural reward has proven surprisingly sensitive to human drugs of abuse, opening an unlikely avenue of research into the basic biological mechanisms of drug addiction. In a series of studies we first examined the presence of natural reward systems in crayfish, then characterized its sensitivity to a wide range of human drugs of abuse. A conditioned place preference (CPP) paradigm was used to demonstrate that crayfish seek out those environments that had previously been paired with the psychostimulants cocaine and amphetamine, and the opioid morphine. The administration of amphetamine exerted its effects at a number of sites, including the stimulation of circuits for active exploratory behaviors (i.e., SEEKING). A further study examined morphine-induced reward, extinction and reinstatement in crayfish. Repeated intra-circulatory infusions of morphine served as a reward when paired with distinct visual or tactile cues. Morphine-induced CPP was extinguished after repeated saline injections. Following this extinction phase, morphine-experienced crayfish were once again challenged with the drug. The priming injections of morphine reinstated CPP at all tested doses, suggesting that morphine-induced CPP is unrelenting. In an exploration of drug-associated behavioral sensitization in crayfish we concurrently mapped measures of locomotion and rewarding properties of morphine. Single and repeated intra-circulatory infusions of morphine resulted in persistent locomotory sensitization, even 5 days following the infusion. Moreover, a single dose of morphine was sufficient to induce long-term behavioral sensitization. CPP for morphine and context-dependent cues could not be disrupted over a drug free period of 5

  4. The antipsychotic aripiprazole selectively prevents the stimulant and rewarding effects of morphine in mice.

    PubMed

    Almeida-Santos, Ana F; Gobira, Pedro H; Souza, Diego P; Ferreira, Renata C M; Romero, Thiago R; Duarte, Igor D; Aguiar, Daniele C; Moreira, Fabricio A

    2014-11-01

    Aripiprazole is an antipsychotic that acts as a partial agonist at dopamine D2 receptors, with a favorable pharmacological profile. Due to its unique mechanism of action, this compound has potential application as a substitutive therapy for drug addiction. Considering that distinct neural systems subserve the addictive and analgesic actions of opioids, we tested the hypothesis that aripiprazole selectively inhibit the abuse-related, but not the antinociceptive, effects of morphine. The drugs were tested in male Swiss mice for their effects on locomotion, conditioned place preference (CPP) and nociception. Morphine (20mg/kg) increased motor activity, whereas aripiprazole (0.1, 1 and 10mg/kg) did not induce any change. This antipsychotic, however, prevented morphine-induced locomotion. In the conditioning box, aripiprazole did not induce either reward or aversion. Yet, it prevented both the acquisition and the expression of morphine-induced CPP. Finally, none of the doses of this antipsychotic interfere with morphine (5mg/kg)-induced antinociception in the tail-flick test. In conclusion, aripiprazole inhibited the abuse-related effects of morphine at doses that do not interfere with basal locomotion, reward or aversion. Also, it did not alter morphine-induced antinociceptive effects. This antipsychotic should be further investigated as a possible substitutive strategy for treating certain aspects of opioid addiction.

  5. Effects of Intrathecal κ-Opioid Receptor Agonist on Morphine-Induced Itch and Antinociception in Mice.

    PubMed

    Sakakihara, Manabu; Imamachi, Noritaka; Saito, Yoji

    2016-01-01

    The μ-opioid receptor (MOR) agonist-induced itch is a significant issue associated with analgesic therapies. Research suggested that systemically administered κ-opioid receptor (KOR) agonists inhibit intrathecal morphine-induced itch in primates. However, serious adverse effects induced by systemically administered KOR agonists may restrict their usefulness in humans. We investigated the effects of intrathecal KOR agonists on intrathecal morphine-mediated itch and antinociception in mice.Mice received intrathecal injections of one of the following drugs: morphine (0.1-1.0 nmol), the selective KOR agonist TRK-820 100 pmol, the combination of morphine 0.3 nmol + TRK-820 (10-100 pmol), and 5 μL of saline. One hour after intraperitoneal administration of the selective KOR antagonist nor-binaltorphimine 1.0 μmol, the effect of TRK-820 100 pmol on intrathecal morphine 0.3 nmol-induced scratching was tested. Total numbers of scratches after intrathecal injection were analyzed. After observing scratching behavior, sedation level was evaluated subjectively. Nociceptive threshold was determined by tail immersion test with intrathecal injections of the following agents: morphine (0.1-1.0 nmol), TRK-820 (10-100 pmol), morphine 0.1 nmol + TRK-820 10 pmol, and 5 μL of saline.Intrathecal TRK-820 dose-dependently inhibited intrathecal morphine-induced scratching compared with that in the saline group. Intraperitoneal nor-binaltorphimine completely inhibited the antiscratching effect of intrathecal TRK-820 100 pmol. The combination of morphine 0.3 nmol and TRK-820 did not alter the sedation score compared with that in the morphine 0.3 nmol group. Morphine 0.1 nmol + TRK-820 10 pmol significantly produced greater thermal antinociceptive effects than morphine 0.1 nmol.We demonstrated that intrathecal KOR agonists exert antipruritic effects on intrathecal morphine-induced itch without affecting sedation. The combination of intrathecal morphine and intrathecal KOR agonists

  6. Differential effects of gram-positive and gram-negative bacterial products on morphine induced inhibition of phagocytosis

    PubMed Central

    Jana, Ninkovic; Vidhu, Anand; Raini, Dutta; Zhang, Li; Saluja, Anuj; Meng, Jingjing; Lisa, Koodie; Santanu, Banerjee; Sabita, Roy

    2016-01-01

    Opioid drug abusers have a greater susceptibility to gram positive (Gram (+)) bacterial infections. However, the mechanism underlying opioid modulation of Gram (+) versus Gram (−) bacterial clearance has not been investigated. In this study, we show that opioid treatment resulted in reduced phagocytosis of Gram (+), when compared to Gram (−) bacteria. We further established that LPS priming of chronic morphine treated macrophages leads to potentiated phagocytosis and killing of both Gram (+) and Gram (−) bacteria in a P-38 MAP kinase dependent signaling pathway. In contrast, LTA priming lead to inhibition of both phagocytosis and bacterial killing. This study demonstrates for the first time the differential effects of TLR4 and TLR2 agonists on morphine induced inhibition of phagocytosis. Our results suggest that the incidence and severity of secondary infections with Gram (+) bacteria would be higher in opioid abusers. PMID:26891899

  7. Differential effects of gram-positive and gram-negative bacterial products on morphine induced inhibition of phagocytosis.

    PubMed

    Ninkovic, Jana; Jana, Ninkovic; Anand, Vidhu; Vidhu, Anand; Dutta, Raini; Raini, Dutta; Zhang, Li; Saluja, Anuj; Meng, Jingjing; Koodie, Lisa; Lisa, Koodie; Banerjee, Santanu; Santanu, Banerjee; Roy, Sabita; Sabita, Roy

    2016-02-19

    Opioid drug abusers have a greater susceptibility to gram positive (Gram (+)) bacterial infections. However, the mechanism underlying opioid modulation of Gram (+) versus Gram (-) bacterial clearance has not been investigated. In this study, we show that opioid treatment resulted in reduced phagocytosis of Gram (+), when compared to Gram (-) bacteria. We further established that LPS priming of chronic morphine treated macrophages leads to potentiated phagocytosis and killing of both Gram (+) and Gram (-) bacteria in a P-38 MAP kinase dependent signaling pathway. In contrast, LTA priming lead to inhibition of both phagocytosis and bacterial killing. This study demonstrates for the first time the differential effects of TLR4 and TLR2 agonists on morphine induced inhibition of phagocytosis. Our results suggest that the incidence and severity of secondary infections with Gram (+) bacteria would be higher in opioid abusers.

  8. Changes in the antitumour effect of some cytostatic agents applied under conditions of morphine-induced hyperthermia.

    PubMed

    Ovtcharov, R; Mircheva, Y; Yakimova, K; Stoichkov, Y

    1987-01-01

    The effect of the cytostatic agents bleomycetin, vincristine and methotrexate on the growth of the Lewis lung carcinoma was investigated under conditions of normothermia and morphine-induced hyperthermia. Morphine was administered 1, 3, 5, 7, 9 and 11 days after the tumour transplantation (in a single of 20 mg/kg), 75 min prior to the administration of bleomycetin (in a single dose of 2 mg/kg), vincristine (in a single dose of 0.3 mg/kg) and methotrexate (in a single dose of 5 mg/kg). The therapeutic effect was assessed on the 24th hour after the end of the treatment through determining the tumour growth inhibition. The administration of morphine to mice was found to be accompanied by the development of a hyperthermal reaction, with a maximum between the 90th and 120th min after the treatment, the change in the rectal temperature of the animals being of the order of 2.2 +/- 0.14 degrees C. Hyperthermia potentiates the effect of the antitumour antibiotic bleomycetin which, unlike bleomycin, does not manifest a threshold effect of interaction with the hyperthermia. Temperatures of the order of 40 degrees C are found to result in sensitization of the relatively resistant cells of the Lewis lung carcinoma to the antitumour effect of vincristine. Hyperthermia did not affect the activity of methotrexate. The analysis of the data obtained suggests that morphine-induced hyperthermia is a convenient model in mice for testing the behaviour of the cytostatic agents under conditions of increased temperature.

  9. Intracerebroventricular effects of histaminergic agents on morphine-induced anxiolysis in the elevated plus-maze in rats.

    PubMed

    Zarrindast, Mohammad-Reza; Rostami, Parvin; Zarei, Morteza; Roohbakhsh, Ali

    2005-11-01

    Some reports indicate that morphine can induce anxiolytic effects both in animal and in man. It has also been reported that histaminergic system can interfere with some pharmacological effects of morphine. The effects of histaminergic agents on morphine-induced anxiolysis in rats, using elevated plus-maze were investigated in the present study. Intraperitoneal injection of morphine (3, 6 and 9 mg/kg) induced antianxiety effects. Intracerebroventricular administration of histamine at the doses of (5, 10 and 20 microg/rat) also increased anxiety-related behaviours. Intracerebroventricular injection of pyrilamine, a H1 receptor antagonist (25, 50 and 100 microg/rat), increased anxiety whereas injection of ranitidine, a H2 receptor antagonist (5, 10 and 20 microg/rat) at the same site, decreased anxiety. Therefore, it seems that histamine induces anxiogenic response through activation of H2 receptors, while the response of H1 blocker may be due to release of histamine. We also evaluated the interactions between morphine and histaminergic agents. Our data show that histamine (10 microg/rat), pyrilamine (50 microg/rat) and ranitidine (5 microg/rat) did not alter the response induced by different doses of morphine (3, 6 and 9 mg/kg). Similarly, a single dose of morphine did not alter the response induced by different doses of histamine (5, 10 and 20 microg/rat), pyrilamine (25, 50 and 100 microg/rat) or ranitidine (5, 10 and 20 microg/rat). In conclusion, the histaminergic system plays an important role in the modulation of anxiety, although in our experiments, no interaction was found between the effects of histaminergic agents and morphine on anxiety-related indices in the elevated plus-maze. This may imply that morphine-induced anxiolysis probably is independent of the histaminergic system.

  10. The effects of lamotrigine on the acquisition and expression of morphine-induced place preference in mice.

    PubMed

    Tehrani, S Pournaghash; Daryaafzoon, M; Bakhtiarian, A; Ejtemaeemehr, S; Sahraei, H

    2009-01-01

    The purpose of the present study is to determine the effects of the anticonvulsant drug, lamotrigine, on the acquisition and expression of morphine-induced place preference in mice. Lamotrigine prevents the release of glutamate from presynaptic neurons and inhibits action potential in postsynaptic area by inhibiting presynaptic sodium and calcium channels. Because of such properties, lamotrigine is used for reducing craving for and use of cocaine, alcohol and abused inhalant. So, to determine the effects of lamotrigine on opiates; specifically morphine, 180 male Swiss-Webster mice (20-35 g) were used in this study. Conditioned place preference, was assessed using a biased place conditioning paradigm. In a pilot study the effects of various doses of morphine (2.5, 5 and 10 mg kg(-1)), alone, or in combination with lamotrigine (1, 5 and 25 mg kg(-1)) on the place conditioning paradigm were examined. Animals were injected with the aforementioned doses of lamotrigine 60 min either prior to each morphine injections (acquisition) or prior to the start of the expression on the test day (expression). Administration of different doses of morphine (2.5, 5 and 10 mg kg(-1)) induced conditioned place preference whereas the administration of different doses of lamotrigine (1, 5 and 25 mg kg(-1)) failed to induce place preference. Acquisition and expression of morphine-induced CPP were reduced by lamotrigine at doses of 1, 5 and 25 mg kg(-1) and 5 and 25 mg kg(-1), respectively. Physiological mechanisms of action of lamotrigine and its potential therapeutic use in the treatment of drug-dependence are discussed.

  11. α-Terpineol attenuates morphine-induced physical dependence and tolerance in mice: role of nitric oxide

    PubMed Central

    Parvardeh, Siavash; Moghimi, Mahsa; Eslami, Pegah; Masoudi, Alireza

    2016-01-01

    Objective(s): Dependence and tolerance to opioid analgesics are major problems limiting their clinical application. α-Terpineol is a monoterpenoid alcohol with neuroprotective effects which is found in several medicinal plants such as Myrtus communis, Laurus nobilis, and Stachys byzantina. It has been shown that some of these medicinal plants such as S. byzantina attenuate dependence and tolerance to morphine. Since α-terpineol is one of the bioactive phytochemical constituent of these medicinal plants, the present study was conducted to investigate the effects of α-terpineol on morphine-induced dependence and tolerance in mice. Materials and Methods: The mice were rendered dependent or tolerant to morphine by a 3-day administration schedule. The hot-plate test and naloxone-induced withdrawal syndrome were used to evaluate tolerance and dependence on morphine, respectively. To investigate a possible role for nitric oxide (NO) in the protective effect of α-terpineol, the NO synthase inhibitor, L-N(G)-nitroarginine methyl ester (L-NAME) and NO precursor, L-arginine, were used. Results: Administration of α-terpineol (5, 10, and 20 mg/kg, IP) significantly decreased the number of jumps in morphine dependent animals. Moreover, α-terpineol (20 and 40 mg/kg, IP) attenuated tolerance to the analgesic effect of morphine. The inhibitory effects of α-terpineol on morphine-induced dependence and tolerance were enhanced by pretreatment with L-NAME (10 mg/kg, IP). However, L-arginine (300 mg/kg, IP) antagonized the protective effects of α-terpineol on dependence and tolerance to morphine. Conclusion: These findings indicate that α-terpineol prevents the development of dependence and tolerance to morphine probably through the influence on NO production. PMID:27081466

  12. MicroRNA-219-5p Inhibits Morphine-Induced Apoptosis by Targeting Key Cell Cycle Regulator WEE1

    PubMed Central

    Lou, Wei; Zhang, Xingwang; Hu, Xiao-Ying; Hu, Ai-Rong

    2016-01-01

    Background To identify the effects of microRNA (miR)-219-5p on morphine-induced apoptosis by targeting WEE1. Material/Methods Forty Balb/C mice (Toll-like receptor 9, TLR9 knockout) were randomly allocated to the experimental and control groups (20 in each group). The baseline miR-219-5p expression was detected using quantitative real-time PCR (qRT-PCR). After morphine was injected at 6 h on the 2nd and 6th days, experimental and control groups received miR-219-5p mimics or miRNA-negative control (NC), respectively, compound injection. Tissues and cells were later obtained from subjects in each group separately after mice were killed. TUNEL assay was used to investigate apoptosis in both groups. RAW264.7 cells were treated with miR-219-5p mimics and controls, respectively. After 24 h, 10 μM of morphine was added at 24 h. Cell apoptosis was assessed by flow cytometer. The WEE1 and Phospho-cdc2 (Tyr15) expressions were examined by Western blotting. Results MiR-219-5p expression in the experimental group was significantly lower than that in the control group (P<0.05). Mice injected with miR-219-5p mimic experienced an evident increase in apoptosis rate compared with the control group (P<0.05). The miR-219-5p NC group and the morphine group both presented an elevated apoptosis rate compared with the blank control group (both, P<0.05). The apoptosis rate in the miR-219-5p mimic group was 10.06%, remarkably lower than in the miR-219-5p NC group and blank control group (both P<0.05). WEE1 and Tyr15 protein expressions in the miR-219-5p NC group and morphine group were obviously stronger than those in the blank control group (all P<0.05). In the miR-219-5p mimic group, WEE1 and Tyr15 protein expressions were significantly lower compared with those in the miR-219-5p NC group and morphine group (all P<0.05). Conclusions Morphine significantly downregulated the expression of miRNA-219-5p, which targets WEE1 to suppress Tyr15 expressions and activate Cdc2, thus inhibiting the

  13. MicroRNA-219-5p Inhibits Morphine-Induced Apoptosis by Targeting Key Cell Cycle Regulator WEE1.

    PubMed

    Lou, Wei; Zhang, Xingwang; Hu, Xiao-Ying; Hu, Ai-Rong

    2016-01-01

    BACKGROUND To identify the effects of microRNA (miR)-219-5p on morphine-induced apoptosis by targeting WEE1. MATERIAL AND METHODS Forty Balb/C mice (Toll-like receptor 9, TLR9 knockout) were randomly allocated to the experimental and control groups (20 in each group). The baseline miR-219-5p expression was detected using quantitative real-time PCR (qRT-PCR). After morphine was injected at 6 h on the 2nd and 6th days, experimental and control groups received miR-219-5p mimics or miRNA-negative control (NC), respectively, compound injection. Tissues and cells were later obtained from subjects in each group separately after mice were killed. TUNEL assay was used to investigate apoptosis in both groups. RAW264.7 cells were treated with miR-219-5p mimics and controls, respectively. After 24 h, 10 μM of morphine was added at 24 h. Cell apoptosis was assessed by flow cytometer. The WEE1 and Phospho-cdc2 (Tyr15) expressions were examined by Western blotting. RESULTS MiR-219-5p expression in the experimental group was significantly lower than that in the control group (P<0.05). Mice injected with miR-219-5p mimic experienced an evident increase in apoptosis rate compared with the control group (P<0.05). The miR-219-5p NC group and the morphine group both presented an elevated apoptosis rate compared with the blank control group (both, P<0.05). The apoptosis rate in the miR-219-5p mimic group was 10.06%, remarkably lower than in the miR-219-5p NC group and blank control group (both P<0.05). WEE1 and Tyr15 protein expressions in the miR-219-5p NC group and morphine group were obviously stronger than those in the blank control group (all P<0.05). In the miR-219-5p mimic group, WEE1 and Tyr15 protein expressions were significantly lower compared with those in the miR-219-5p NC group and morphine group (all P<0.05). CONCLUSIONS Morphine significantly downregulated the expression of miRNA-219-5p, which targets WEE1 to suppress Tyr15 expressions and activate Cdc2, thus inhibiting

  14. Differences in the morphine-induced inhibition of small and large intestinal transit: Involvement of central and peripheral μ-opioid receptors in mice.

    PubMed

    Matsumoto, Kenjiro; Umemoto, Hiroyuki; Mori, Tomohisa; Akatsu, Ryuya; Saito, Shinichiro; Tashima, Kimihito; Shibasaki, Masahiro; Kato, Shinichi; Suzuki, Tsutomu; Horie, Syunji

    2016-01-15

    Constipation is the most common side effect of morphine. Morphine acts centrally and on peripheral sites within the enteric nervous system. There are a few comprehensive studies on morphine-induced constipation in the small and large intestine by the activation of central and peripheral μ-opioid receptors. We investigated the differences in the inhibition of the small and large intestinal transit in normal and morphine-tolerant mice. Morphine reduced the geometric center in the fluorescein isothiocyanate-dextran assay and prolonged the bead expulsion time in a dose-dependent manner. The inhibitory effects of morphine were blocked by μ-opioid antagonist β-funaltrexamine, but not by δ- and κ-opioid antagonists. The peripheral opioid receptor antagonist, naloxone methiodide, partially blocked morphine's effect in the small intestine and completely blocked its effect in the large intestine. The intracerebroventricular administration of naloxone significantly reversed the delay of small intestinal transit but did not affect morphine-induced inhibition of large intestinal transit. Naloxone methiodide completely reversed the inhibition of large intestinal transit in normal and morphine-tolerant mice. Naloxone methiodide partially reversed the morphine-induced inhibition of small intestinal transit in normal mice but completely reversed the effects of morphine in tolerant mice. Chronic treatment with morphine results in tolerance to its inhibitory effect on field-stimulated contraction in the isolated small intestine but not in the large intestine. These results suggest that peripheral and central opioid receptors are involved in morphine-induced constipation in the small and large intestine during the early stage of treatment, but the peripheral receptors mainly regulate constipation during long-term morphine treatment.

  15. Inhibition of Spinal Oxidative Stress by Bergamot Polyphenolic Fraction Attenuates the Development of Morphine Induced Tolerance and Hyperalgesia in Mice

    PubMed Central

    Lauro, Filomena; Giancotti, Luigino Antonio; Ilari, Sara; Dagostino, Concetta; Gliozzi, Micaela; Morabito, Chiara; Malafoglia, Valentina; Raffaeli, William; Muraca, Maurizio; Goffredo, Bianca M.; Mollace, Vincenzo; Muscoli, Carolina

    2016-01-01

    Citrus Bergamia Risso, commonly known as Bergamot, is a fruit whose Essential Oil and Bergamot Polyphenolic Fraction have numerous medicinal properties. It is also an excellent antioxidant and in this study, for the first time, its potential effect on morphine induced tolerance in mice has been investigated. Our studies revealed that development of antinociceptive tolerance to repeated doses of morphine in mice is consistently associated with increased formation of superoxide, malondialdehyde and tyrosine-nitrated proteins in the dorsal horn of the spinal cord such as the enzyme glutamine synthase. Nitration of this protein is intimately linked to inactivation of its biological function and resulting increase of glutamate levels in the spinal cord. Administration of Bergamot Polyphenolic Fraction (5–50 mg/kg) attenuated tolerance development. This effect was accompanied by reduction of superoxide and malondialdehyde production, prevention of GS nitration, re-establishment of its activity and of glutamate levels. Our studies confirmed the main role of free radicals during the cascade of events induced by prolonged morphine treatment and the co-administration of natural derivatives antioxidant such as Bergamot Polyphenolic Fraction can be an important therapeutic approach to restore opioids analgesic efficacy. PMID:27227548

  16. [Effects of propranolol on acquisition and retrieval of morphine- induced conditioned place preference memories in ICR mice].

    PubMed

    Mao, Yu; Yang, Shang-Chuan; Liu, Chang; Ma, Yuan-Ye; Hu, Xin-Tian

    2011-12-01

    To interfere with the drug-cue memory processes of addicts such as reconsolidation by the administration of the β-adrenergic receptor (β-AR) of norepinephrine (NE) antagonist propranolol (PRO) has become a potential therapy in the future to decrease or inhibit relapse. However, the relationship between PRO and the acquisition or retrieval of morphine-cue memory is not clear. This study examined the effects of PRO on the acquisition and retrieval of memories in morphine-induced conditioned place preference (CPP) mice model. We found that during memory acquisition period, PRO had no effects on the expression and extinction of morphine-CPP, which suggests that the β-AR was irrelevant to the CPP memory acquisition. However, during memory retrieval period, although PRO did not affect the expression of CPP, but it delayed the occurrence of CPP extinction, which indicates that PRO has an inhibit effect on CPP memory extinction, and β-AR plays an important role in modulating the extinction of morphine-CPP. Our study further improved the relationship between drug addiction and β-AR, and proposed a new theory to help developing potential therapy to cure addiction and other neuropsychiatric disorders.

  17. [Effects of propranolol on acquisition and retrieval of morphine- induced conditioned place preference memories in ICR mice].

    PubMed

    Mao, Yu; Yang, Shang-Chuan; Liu, Chang; Ma, Yuan-Ye; Hu, Xin-Tian

    2011-12-01

    To interfere with the drug-cue memory processes of addicts such as reconsolidation by the administration of the β-adrenergic receptor (β-AR) of norepinephrine (NE) antagonist propranolol (PRO) has become a potential therapy in the future to decrease or inhibit relapse. However, the relationship between PRO and the acquisition or retrieval of morphine-cue memory is not clear. This study examined the effects of PRO on the acquisition and retrieval of memories in morphine-induced conditioned place preference (CPP) mice model. We found that during memory acquisition period, PRO had no effects on the expression and extinction of morphine-CPP, which suggests that the β-AR was irrelevant to the CPP memory acquisition. However, during memory retrieval period, although PRO did not affect the expression of CPP, but it delayed the occurrence of CPP extinction, which indicates that PRO has an inhibit effect on CPP memory extinction, and β-AR plays an important role in modulating the extinction of morphine-CPP. Our study further improved the relationship between drug addiction and β-AR, and proposed a new theory to help developing potential therapy to cure addiction and other neuropsychiatric disorders. PMID:22184028

  18. Assessment of Morphine-induced Hyperalgesia and Analgesic Tolerance in Mice Using Thermal and Mechanical Nociceptive Modalities

    PubMed Central

    Elhabazi, Khadija; Ayachi, Safia; Ilien, Brigitte; Simonin, Frédéric

    2014-01-01

    Opioid-induced hyperalgesia and tolerance severely impact the clinical efficacy of opiates as pain relievers in animals and humans. The molecular mechanisms underlying both phenomena are not well understood and their elucidation should benefit from the study of animal models and from the design of appropriate experimental protocols. We describe here a methodological approach for inducing, recording and quantifying morphine-induced hyperalgesia as well as for evidencing analgesic tolerance, using the tail-immersion and tail pressure tests in wild-type mice. As shown in the video, the protocol is divided into five sequential steps. Handling and habituation phases allow a safe determination of the basal nociceptive response of the animals. Chronic morphine administration induces significant hyperalgesia as shown by an increase in both thermal and mechanical sensitivity, whereas the comparison of analgesia time-courses after acute or repeated morphine treatment clearly indicates the development of tolerance manifested by a decline in analgesic response amplitude. This protocol may be similarly adapted to genetically modified mice in order to evaluate the role of individual genes in the modulation of nociception and morphine analgesia. It also provides a model system to investigate the effectiveness of potential therapeutic agents to improve opiate analgesic efficacy. PMID:25145878

  19. An IL-1 receptor antagonist blocks a morphine-induced attenuation of locomotor recovery after spinal cord injury.

    PubMed

    Hook, Michelle A; Washburn, Stephanie N; Moreno, Georgina; Woller, Sarah A; Puga, Denise; Lee, Kuan H; Grau, James W

    2011-02-01

    Morphine is one of the most commonly prescribed medications for the treatment of chronic pain after a spinal cord injury (SCI). Despite widespread use, however, little is known about the secondary consequences of morphine use after SCI. Unfortunately, our previous studies show that administration of a single dose of morphine, in the acute phase of a moderate spinal contusion injury, significantly attenuates locomotor function, reduces weight gain, and produces symptoms of paradoxical pain (Hook et al., 2009). The current study focused on the cellular mechanisms that mediate these effects. Based on data from other models, we hypothesized that pro-inflammatory cytokines might play a role in the morphine-induced attenuation of function. Experiment 1 confirmed that systemic morphine (20 mg/kg) administered one day after a contusion injury significantly increased expression levels of spinal IL-1β 24 h later. Experiment 2 extended these findings, demonstrating that a single dose of morphine (90 μg, i.t.) applied directly onto the spinal cord increased expression levels of spinal IL-1β at both 30 min and 24 h after administration. Experiment 3 showed that administration of an interleukin-1 receptor antagonist (IL-1ra, i.t.) prior to intrathecal morphine (90 μg), blocked the adverse effects of morphine on locomotor recovery. Further, pre-treatment with 3 μg IL-1ra prevented the increased expression of at-level neuropathic pain symptoms that was observed 28 days later in the group treated with morphine-alone. However, the IL-1ra also had adverse effects that were independent of morphine. Treatment with the IL-1ra alone undermined recovery of locomotor function, potentiated weight loss and significantly increased tissue loss at the injury site. Overall, these data suggest that morphine disrupts a critical balance in concentrations of pro-inflammatory cytokines in the spinal cord, and this undermines recovery of function. PMID:20974246

  20. Role of hippocampal and prefrontal cortical signaling pathways in dextromethorphan effect on morphine-induced memory impairment in rats.

    PubMed

    Ghasemzadeh, Zahra; Rezayof, Ameneh

    2016-02-01

    Evidence suggests that dextromethorphan (DM), an NMDA receptor antagonist, induces memory impairment. Considering that DM is widely used in cough-treating medications, and the co-abuse of DM with morphine has recently been reported, the aims of the present study was (1) to investigate whether there is a functional interaction between morphine and DM in passive avoidance learning and (2) to assess the possible role of the hippocampal and prefrontal cortical (PFC) signaling pathways in the effects of the drugs on memory formation. Our findings indicated that post-training or pre-test administration of morphine (2 and 6 mg/kg) or DM (10-30 mg/kg) impaired memory consolidation and retrieval which was associated with the attenuation of the levels of phosphorylated Ca(2+)/calmodulin-dependent protein kinase II (p-CAMKII) and cAMP responsive element-binding protein (p-CREB) in the targeted sites. Moreover, the memory impairment induced by post-training administration of morphine was reversed by pre-test administration of the same dose of morphine or DM (30 mg/kg), indicating state-dependent learning (SDL) and a cross-SDL between the drugs. It is important to note that the levels of p-CAMKII/CAMKII and p-CREB/CREB in the hippocampus and the PFC increased in drugs-induced SDL. In addition, DM administration potentiated morphine-induced SDL which was related to the enhanced levels of hippocampal and PFC CAMKII-CREB signaling pathways. It can be concluded that there is a relationship between the hippocampus and the PFC in the effect of DM and/or morphine on memory retrieval. Moreover, a cross SDL can be induced between the co-administration of DM and morphine. Interestingly, CAMKII-CREB signaling pathways also mediate the drugs-induced SDL.

  1. Involvement of protein kinase C in the modulation of morphine-induced analgesia and the inhibitory effects of exposure to 60-hz magnetic fields in the land snail, Cepaea nemoralis

    SciTech Connect

    Kavaliers, M.; Ossenkopp, K.P. )

    1990-02-26

    One of the more consistent and dramatic effects of exposure to magnetic fields is the attenuation of morphine-induced analgesia. Results of previous studies have implicated alterations in calcium channel functioning and Ca{sup ++} flux in the mediation of these effects. It is generally accepted that Ca{sup ++}-activated-phospholipid-dependent protein kinase (Protein kinase C; PKC) plays an important role in relaying trans-membrane signaling in diverse Ca{sup ++} dependent cellular processes. In experiment 1 we observed that morphine-induced analgesia in the land snail, Cepaea nemoralis, as measured by the latency of an avoidance behavior to a warmed surface, was reduced by the PKC activator, SC-9, and was enhanced by the PKC inhibitors, H-7 and H-9. In contrast, HA-10004, a potent inhibitor of other protein kinases, but only a very weak inhibitor of PKC, had no effect on morphine-induced analgesia. In experiment 2 exposure of snails for 30 minutes to a 1.0 gauss (rms) 60-Hz magnetic field reduced morphine-induced analgesia. This inhibitory effect of the magnetic field was reduced by the PKC inhibitors, H-7 and H-9, and was augmented by the PKC activator SC-9. These results suggest that: (i) PKC is involved in the modulation of morphine-induced analgesia and, (ii) the inhibitory effects of magnetic fields involve PKC.

  2. Blockade of morphine-induced behavioral sensitization by a combination of amisulpride and RB101, comparison with classical opioid maintenance treatments

    PubMed Central

    Cordonnier, L; Sanchez, M; Roques, B P; Noble, F

    2007-01-01

    Background and purpose: Maintenance treatments with methadone or buprenorphine are more or less efficient procedures for helping heroin addicts to stop or reduce drug abuse. Another approach to treat opiate dependence could be to target the endogenous opioid system by enhancing the effects of enkephalins by protecting them from enzymic degradation by the dual peptidase inhibitor RB101. Experimental approach: As chronic treatment with the dopamine D2 antagonist amisulpride facilitates RB101-induced behavioral effects, we chose in this study to treat mice previously sensitized to the hyperlocomotor effects induced by morphine with a combination of amisulpride and RB101. Key results: Expression of morphine-induced locomotor sensitization was abolished after combined treatment with amisulpride (20 mg.kg−1, i.p.) and RB101 (80 mg.kg−1, i.p.), whereas these drugs were not effective when used alone. We then compared these results with the effects of amisulpride combined with buprenorphine (0.1 mg.kg−1, i.p.) or methadone (2.5 mg.kg−1, i.p.) upon morphine-induced behavioral sensitization. Whereas the combination of amisulpride and buprenorphine partially blocked the expression of morphine sensitization, amisulpride+methadone was not effective in this paradigm. Conclusions and implications: The combination of amisulpride+RB101 appears to be very efficient in blocking the expression of morphine-induced behavioral sensitization. This could reflect a reinstatement of a balance between the function of the dopamine and opioid systems and could represent a new approach in maintenance treatments for opiate addiction. PMID:17351659

  3. Dopamine D4 Receptor Counteracts Morphine-Induced Changes in μ Opioid Receptor Signaling in the Striosomes of the Rat Caudate Putamen

    PubMed Central

    Suárez-Boomgaard, Diana; Gago, Belén; Valderrama-Carvajal, Alejandra; Roales-Buján, Ruth; Van Craenenbroeck, Kathleen; Duchou, Jolien; Borroto-Escuela, Dasiel O.; Medina-Luque, José; de la Calle, Adelaida; Fuxe, Kjell; Rivera, Alicia

    2014-01-01

    The mu opioid receptor (MOR) is critical in mediating morphine analgesia. However, prolonged exposure to morphine induces adaptive changes in this receptor leading to the development of tolerance and addiction. In the present work we have studied whether the continuous administration of morphine induces changes in MOR protein levels, its pharmacological profile, and MOR-mediated G-protein activation in the striosomal compartment of the rat CPu, by using immunohistochemistry and receptor and DAMGO-stimulated [35S]GTPγS autoradiography. MOR immunoreactivity, agonist binding density and its coupling to G proteins are up-regulated in the striosomes by continuous morphine treatment in the absence of changes in enkephalin and dynorphin mRNA levels. In addition, co-treatment of morphine with the dopamine D4 receptor (D4R) agonist PD168,077 fully counteracts these adaptive changes in MOR, in spite of the fact that continuous PD168,077 treatment increases the [3H]DAMGO Bmax values to the same degree as seen after continuous morphine treatment. Thus, in spite of the fact that both receptors can be coupled to Gi/0 protein, the present results give support for the existence of antagonistic functional D4R-MOR receptor-receptor interactions in the adaptive changes occurring in MOR of striosomes on continuous administration of morphine. PMID:24451133

  4. Prohormone convertase 2 (PC2) null mice have increased mu opioid receptor levels accompanied by altered morphine-induced antinociception, tolerance and dependence.

    PubMed

    Lutfy, K; Parikh, D; Lee, D L; Liu, Y; Ferrini, M G; Hamid, A; Friedman, T C

    2016-08-01

    Chronic morphine treatment increases the levels of prohormone convertase 2 (PC2) in brain regions involved in nociception, tolerance and dependence. Thus, we tested if PC2 null mice exhibit altered morphine-induced antinociception, tolerance and dependence. PC2 null mice and their wild-type controls were tested for baseline hot plate latency, injected with morphine (1.25-10mg/kg) and tested for antinociception 30min later. For tolerance studies, mice were tested in the hot plate test before and 30min following morphine (5mg/kg) on day 1. Mice then received an additional dose so that the final dose of morphine was 10mg/kg on this day. On days 2-4, mice received additional doses of morphine (20, 40 and 80mg/kg on days 1, 2, 3, and 4, respectively). On day 5, mice were tested in the hot plate test before and 30min following morphine (5mg/kg). For withdrawal studies, mice were treated with the escalating doses of morphine (10, 20, 40 and 80mg/kg) for 4days, implanted with a morphine pellet on day 5 and 3 days later injected with naloxone (1mg/kg) and signs of withdrawal were recorded. Morphine dose-dependently induced antinociception and the magnitude of this response was greater in PC2 null mice. Tolerance to morphine was observed in wild-type mice and this phenomenon was blunted in PC2 null mice. Withdrawal signs were also reduced in PC2 null mice. Immunohistochemical studies showed up-regulation of the mu opioid receptor (MOP) protein expression in the periaqueductal gray area, ventral tegmental area, lateral hypothalamus, medial hypothalamus, nucleus accumbens, and somatosensory cortex in PC2 null mice. Likewise, naloxone specific binding was increased in the brains of these mice compared to their wild-type controls. The results suggest that the PC2-derived peptides may play a functional role in morphine-induced antinociception, tolerance and dependence. Alternatively, lack of opioid peptides led to up-regulation of the MOP and altered morphine-induced

  5. Neuro-Genetics of Reward Deficiency Syndrome (RDS) as the Root Cause of “Addiction Transfer”: A New Phenomenon Common after Bariatric Surgery

    PubMed Central

    Blum, Kenneth; Bailey, John; Gonzalez, Anthony M; Oscar-Berman, Marlene; Liu, Yijun; Giordano, John; Braverman, Eric; Gold, Mark

    2012-01-01

    Now after many years of successful bariatric (weight-loss) surgeries directed at the obesity epidemic clinicians are reporting that some patients are replacing compulsive overeating with newly acquired compulsive disorders such as alcoholism, gambling, drugs, and other addictions like compulsive shopping and exercise. This review article explores evidence from psychiatric genetic animal and human studies that link compulsive overeating and other compulsive disorders to explain the phenomenon of addiction transfer. Possibly due to neurochemical similarities, overeating and obesity may act as protective factors reducing drug reward and addictive behaviors. In animal models of addiction withdrawal from sugar induces imbalances in the neurotransmitters, acetylcholine and dopamine, similar to opiate withdrawal. Many human neuroimaging studies have supported the concept of linking food craving to drug craving behavior. Previously our laboratory coined the term Reward Deficiency Syndrome (RDS) for common genetic determinants in predicting addictive disorders and reported that the predictive value for future RDS behaviors in subjects carrying the DRD2 Taq A1 allele was 74%. While poly genes play a role in RDS, we have also inferred that disruptions in dopamine function may predispose certain individuals to addictive behaviors and obesity. It is now known that family history of alcoholism is a significant obesity risk factor. Therefore, we hypothesize here that RDS is the root cause of substituting food addiction for other dependencies and potentially explains this recently described Phenomenon (addiction transfer) common after bariatric surgery. PMID:23483116

  6. Morphine-Induced Analgesic Tolerance Effect on Gene Expression of the NMDA Receptor Subunit 1 in Rat Striatum and Prefrontal Cortex

    PubMed Central

    Ahmadi, Shamseddin; Rafieenia, Fatemeh; Rostamzadeh, Jalal

    2016-01-01

    Introduction: Morphine is a potent analgesic but its continual use results in analgesic tolerance. Mechanisms of this tolerance remain to be clarified. However, changes in the functions of μ-opioid and N-Methyl-D-aspartate (NMDA) receptors have been proposed in morphine tolerance. We examined changes in gene expression of the NMDA receptor subunit 1 (NR1) at mRNA levels in rat striatum and prefrontal cortex (PFC) after induction of morphine tolerance. Methods: Morphine (10 mg/kg, IP) was injected in male Wistar rats for 7 consecutive days (intervention group), but control rats received just normal saline (1 mL/kg, IP). We used a hotplate test of analgesia to assess induction of tolerance to analgesic effects of morphine on days 1 and 8 of injections. Later, two groups of rats were sacrificed one day after 7 days of injections, their whole brains removed, and the striatum and PFC immediately dissected. Then, the NR1 gene expression was examined with a semi-quantitative RT-PCR method. Results: The results showed that long-term morphine a administration induces tolerance to analgesic effect of the opioid, as revealed by a significant decrease in morphine-induced analgesia on day 8 compared to day 1 of the injections (P<0.001). The results also showed that the NR1 gene expression at mRNA level in rats tolerant to morphine was significantly increased in the striatum (P<0.01) but decreased in the PFC (P<0.001). Conclusion: Therefore, changes in the NR1 gene expression in rat striatum and PFC have a region-specific association with morphine-induced analgesic tolerance. PMID:27563417

  7. Effect of nociceptin/orphanin FQ on the rewarding properties of morphine.

    PubMed

    Ciccocioppo, R; Angeletti, S; Sanna, P P; Weiss, F; Massi, M

    2000-09-15

    The present study investigated the effect of nociceptin/orphanin FQ, the endogenous ligand of the opioid receptor-like 1 (ORL1) receptor, on the rewarding properties of morphine in the place conditioning paradigm. Intracerebroventricular (i.c.v.) injections of nociceptin/orphanin FQ, 500 or 1000 (but not 250) ng/rat, abolished conditioned place preference induced by subcutaneous (s.c.) injections of morphine (3 mg/kg). These doses of nociceptin/orphanin FQ induced neither place aversion nor preference per se. The same doses did not modify the rat performance in the Morris water test, suggesting that they do not disrupt spatial learning and memory. Moreover, these doses of nociceptin/orphanin FQ did not modify the development of morphine-induced locomotor sensitization, suggesting that they do not interfere with sensitization processes to morphine. The present results confirm and extend previous reports that nociceptin/orphanin FQ is able to abolish morphine-induced conditioned place preference, and raise interest for the possible role of nociceptin/orphanin FQ and ORL1 receptors in the control of opiate abuse.

  8. The role of nitric oxide in the effects of cumin (Cuminum Cyminum L.) fruit essential oil on the acquisition of morphine-induced conditioned place preference in adult male mice.

    PubMed

    Kermani, Mojtaba; Azizi, Pegah; Haghparast, Abbas

    2012-01-12

    OBJECTIVE: Nitric oxide is a neural messenger molecule in the central nervous system that is generated from L-arginine via the nitric oxide synthase (NOS) and is involved in many important oplold-induced effects. In Iranian ancient medicine, Cuminum cyminum L (green seed) has been used for the treatment of some diseases. In the present study, the effect of intraperitoneal (ip) administration of different doses of cumin fruit essential oil (FEO) on the acquisition of morphine-induced conditioned place preference (GPP) in L-arginine-treated mice was investigated. METHODS: A total of 213 adult male albino Wistar mice were used in these experiments. The CPP paradigm was carried out in 5 continuous days, pre-conditioning, conditioning and post-conditioning. Animals were randomly assigned to one of the two groups for place conditioning. CPP was induced by subcutaneous (sc) injection of morphine (5 mg/kg) in 3 days conditioning schedule. On the test day, conditioning scores and locomotor activity were recorded by Ethovision software. RESULTS: Sole administration of different doses of cumin FEO (0.01%, 0.1%, 0.5%, 1% and 2%; lp) or L-arginine (50, 100 and 200 mg/kg; lp) during the CPP protocol could not induce CPP. Nonetheless, morphine-induced CPP was decreased by different doses of cumin FEO (0.01%-2%), whereas it was increased by L-arginine (50-200 mg/kg) when they were injected before morphine (5 rug/kg) during a 3-day conditioning phase (acquisition period). Additionally, cumin FEO could interestingly attenuate the raising effect of L-arginine on morphine-induced CPP in a dose-dependent manner. CONCLUSIONS: It is suggested that some components of the Cuminum cyminum L. seed attenuate the excessive effect of L-arginine on morphine-induced CPP through the NOS inhibitory mechanism. It seems that cumin FEO possibly acts as a NOS inhibitor.

  9. Ginger (Zingiber officinale Roscoe) elicits antinociceptive properties and potentiates morphine-induced analgesia in the rat radiant heat tail-flick test.

    PubMed

    Sepahvand, Reza; Esmaeili-Mahani, Saeed; Arzi, Ardeshir; Rasoulian, Bahram; Abbasnejad, Mehdi

    2010-12-01

    Ginger (Zingiber officinale Roscoe), a well-known spice plant, has been used traditionally in the treatment of a wide variety of ailments. It has been shown that ginger is a calcium channel blocker; however, its influence on morphine analgesic effects has not been elucidated. We examined the effect of ginger root extract on nociceptive threshold and morphine-induced analgesia in male Wistar rats. To determine the effect of ginger on morphine analgesia, ginger extract (200, 400, and 600 mg/kg i.p.) was injected before a subeffective dose of morphine (2.5 mg/kg i.p.). The radiant heat tail-flick test was used to assess the nociceptive threshold before and at different times after drug administration. Our results showed that ginger extract elicited a significant antinociceptive effect. In addition, in groups that received both morphine and ginger, the observed analgesia was higher than that in groups treated with either morphine or ginger extract alone. Thus, the data indicate that ginger extract has a beneficial influence on morphine analgesia and can be an efficacious adjunct for pain management. PMID:21091253

  10. Morphine Induces Redox-Based Changes in Global DNA Methylation and Retrotransposon Transcription by Inhibition of Excitatory Amino Acid Transporter Type 3–Mediated Cysteine Uptake

    PubMed Central

    Trivedi, Malav; Shah, Jayni; Hodgson, Nathaniel; Byun, Hyang-Min

    2014-01-01

    Canonically, opioids influence cells by binding to a G protein–coupled opioid receptor, initiating intracellular signaling cascades, such as protein kinase, phosphatidylinositol 3-kinase, and extracellular receptor kinase pathways. This results in several downstream effects, including decreased levels of the reduced form of glutathione (GSH) and elevated oxidative stress, as well as epigenetic changes, especially in retrotransposons and heterochromatin, although the mechanism and consequences of these actions are unclear. We characterized the acute and long-term influence of morphine on redox and methylation status (including DNA methylation levels) in cultured neuronal SH-SY5Y cells. Acting via μ-opioid receptors, morphine inhibits excitatory amino acid transporter type 3–mediated cysteine uptake via multiple signaling pathways, involving different G proteins and protein kinases in a temporal manner. Decreased cysteine uptake was associated with decreases in both the redox and methylation status of neuronal cells, as defined by the ratios of GSH to oxidized forms of glutathione and S-adenosylmethionine to S-adenosylhomocysteine levels, respectively. Further, morphine induced global DNA methylation changes, including CpG sites in long interspersed nuclear elements (LINE-1) retrotransposons, resulting in increased LINE-1 mRNA. Together, these findings illuminate the mechanism by which morphine, and potentially other opioids, can influence neuronal-cell redox and methylation status including DNA methylation. Since epigenetic changes are implicated in drug addiction and tolerance phenomenon, this study could potentially extrapolate to elucidate a novel mechanism of action for other drugs of abuse. PMID:24569088

  11. Can the chronic administration of the combination of buprenorphine and naloxone block dopaminergic activity causing anti-reward and relapse potential?

    PubMed Central

    Blum, Kenneth; Chen, Thomas JH; Bailey, John; Bowirrat, Abdulla; Femino, John; Chen, Amanda LC; Simpatico, Thomas; Morse, Siobhan; Giordano, John; Damle, Uma; Kerner, Mallory; Braverman, Eric R.; Fornari, Frank; Downs, B.William; Rector, Cynthia; Barh, Debmayla; Oscar-Berman, Marlene

    2013-01-01

    Opiate addiction is associated with many adverse health and social harms, fatal overdose, infectious disease transmission, elevated health care costs, public disorder, and crime. Although community-based addiction treatment programs continue to reduce the harms of opiate addiction with narcotic substitution therapy such as methadone maintenance, there remains a need to find a substance that not only blocks opiate-type receptors (mu, delta, etc.) but also provides agonistic activity; hence the impetus arose for the development of a combination of narcotic antagonism and mu receptor agonist therapy. After three decades of extensive research the federal Drug Abuse Treatment Act 2000 (DATA) opened a window of opportunity for patients with addiction disorders by providing increased access to options for treatment. DATA allows physicians who complete a brief specialty-training course to become certified to prescribe buprenorphine and buprenorphine/naloxone (Subutex, Suboxone) for treatment of patients with opioid dependence. Clinical studies indicate buprenorphine maintenance is as effective as methadone maintenance in retaining patients in substance abuse treatment and in reducing illicit opioid use. With that stated, we must consider the long-term benefits or potential toxicity attributed to Subutex or Suboxone. We describe a mechanism whereby chronic blockade of opiate receptors, in spite of only partial opiate agonist action, may ultimately block dopaminergic activity causing anti-reward and relapse potential. While the direct comparison is not as yet available, toxicity to buprenorphine can be found in the scientific literature. In considering our cautionary note in this commentary, we are cognizant that to date this is what we have available, and until such a time when the real magic bullet is discovered, we will have to endure. However, more than anything else this commentary should at least encourage the development of thoughtful new strategies to target the

  12. Can the chronic administration of the combination of buprenorphine and naloxone block dopaminergic activity causing anti-reward and relapse potential?

    PubMed

    Blum, Kenneth; Chen, Thomas J H; Bailey, John; Bowirrat, Abdalla; Femino, John; Chen, Amanda L C; Simpatico, Thomas; Morse, Siobhan; Giordano, John; Damle, Uma; Kerner, Mallory; Braverman, Eric R; Fornari, Frank; Downs, B William; Rector, Cynthia; Barh, Debmayla; Oscar-Berman, Marlene

    2011-12-01

    Opiate addiction is associated with many adverse health and social harms, fatal overdose, infectious disease transmission, elevated health care costs, public disorder, and crime. Although community-based addiction treatment programs continue to reduce the harms of opiate addiction with narcotic substitution therapy such as methadone maintenance, there remains a need to find a substance that not only blocks opiate-type receptors (mu, delta, etc.) but also provides agonistic activity; hence, the impetus arose for the development of a combination of narcotic antagonism and mu receptor agonist therapy. After three decades of extensive research, the federal Drug Abuse Treatment Act 2000 (DATA) opened a window of opportunity for patients with addiction disorders by providing increased access to options for treatment. DATA allows physicians who complete a brief specialty-training course to become certified to prescribe buprenorphine and buprenorphine/naloxone (Subutex, Suboxone) for treatment of patients with opioid dependence. Clinical studies indicate that buprenorphine maintenance is as effective as methadone maintenance in retaining patients in substance abuse treatment and in reducing illicit opioid use. With that stated, we must consider the long-term benefits or potential toxicity attributed to Subutex or Suboxone. We describe a mechanism whereby chronic blockade of opiate receptors, in spite of only partial opiate agonist action, may ultimately block dopaminergic activity causing anti-reward and relapse potential. While the direct comparison is not as yet available, toxicity to buprenorphine can be found in the scientific literature. In considering our cautionary note in this commentary, we are cognizant that, to date, this is what we have available, and until such a time when the real magic bullet is discovered, we will have to endure. However, more than anything else this commentary should at least encourage the development of thoughtful new strategies to target

  13. Toll-like receptor 4-mediated nuclear factor-κB activation in spinal cord contributes to chronic morphine-induced analgesic tolerance and hyperalgesia in rats.

    PubMed

    Bai, Liying; Zhai, Caihong; Han, Kun; Li, Zhisong; Qian, Junliang; Jing, Ying; Zhang, Wei; Xu, Ji-Tian

    2014-12-01

    Nuclear factor kappa B (NF-κB) in the spinal cord is involved in pro-inflammatory cytokine-mediated pain facilitation. However, the role of NF-κB activation in chronic morphine-induced analgesic tolerance and the underlying mechanisms remain unclear. In the present study, we found that the level of phosphorylated NF-κB p65 (p-p65) was increased in the dorsal horn of the lumbar 4-6 segments after intrathecal administration of morphine for 7 consecutive days, and the p-p65 was co-localized with neurons and astrocytes. The expression of TNF-α and IL-1β was also increased in the same area. In addition, pretreatment with pyrrolidinedithiocarbamate (PDTC) or SN50, inhibitors of NF-κB, prevented the development of morphine analgesic tolerance and alleviated morphine withdrawal-induced allodynia and hyperalgesia. The increase in TNF-α and IL-1β expression induced by chronic morphine exposure was also partially blocked by PDTC pretreatment. In another experiment, rats receiving PDTC or SN50 beginning on day 7 of morphine injection showed partial recovery of the anti-nociceptive effects of morphine and attenuation of the withdrawal-induced abnormal pain. Meanwhile, intrathecal pretreatment with lipopolysaccharide from Rhodobacter sphaeroides, an antagonist of toll-like receptor 4 (TLR4), blocked the activation of NF-κB, and prevented the development of morphine tolerance and withdrawal-induced abnormal pain. These data indicated that TLR4-mediated NF-κB activation in the spinal cord is involved in the development and maintenance of morphine analgesic tolerance and withdrawal-induced pain hypersensitivity.

  14. Chronic morphine induces up-regulation of the pro-apoptotic Fas receptor and down-regulation of the anti-apoptotic Bcl-2 oncoprotein in rat brain

    PubMed Central

    Boronat, M Assumpció; García-Fuster, M Julia; García-Sevilla, Jesús A

    2001-01-01

    This study was designed to assess the influence of activation and blockade of the endogenous opioid system in the brain on two key proteins involved in the regulation of programmed cell death: the pro-apoptotic Fas receptor and the anti-apoptotic Bcl-2 oncoprotein. The acute treatment of rats with the μ-opioid receptor agonist morphine (3 – 30 mg kg−1, i.p., 2 h) did not modify the immunodensity of Fas or Bcl-2 proteins in the cerebral cortex. Similarly, the acute treatment with low and high doses of the antagonist naloxone (1 and 100 mg kg−1, i.p., 2 h) did not alter Fas or Bcl-2 protein expression in brain cortex. These results discounted a tonic regulation through opioid receptors on Fas and Bcl-2 proteins in rat brain. Chronic morphine (10 – 100 mg kg−1, 5 days, and 10 mg kg−1, 13 days) induced marked increases (47 – 123%) in the immunodensity of Fas receptor in the cerebral cortex. In contrast, chronic morphine (5 and 13 days) decreased the immunodensity of Bcl-2 protein (15 – 30%) in brain cortex. Chronic naloxone (10 mg kg−1, 13 days) did not alter the immunodensities of Fas and Bcl-2 proteins in the cerebral cortex. The concurrent chronic treatment (13 days) of naloxone (10 mg kg−1) and morphine (10 mg kg−1) completely prevented the morphine-induced increase in Fas receptor and decrease in Bcl-2 protein immunoreactivities in the cerebral cortex. The results indicate that morphine, through the sustained activation of opioid receptors, can promote abnormal programmed cell death by enhancing the expression of pro-apoptotic Fas receptor protein and damping the expression of anti-apoptotic Bcl-2 oncoprotein. PMID:11704646

  15. Toll-like receptor 4-mediated nuclear factor-κB activation in spinal cord contributes to chronic morphine-induced analgesic tolerance and hyperalgesia in rats.

    PubMed

    Bai, Liying; Zhai, Caihong; Han, Kun; Li, Zhisong; Qian, Junliang; Jing, Ying; Zhang, Wei; Xu, Ji-Tian

    2014-12-01

    Nuclear factor kappa B (NF-κB) in the spinal cord is involved in pro-inflammatory cytokine-mediated pain facilitation. However, the role of NF-κB activation in chronic morphine-induced analgesic tolerance and the underlying mechanisms remain unclear. In the present study, we found that the level of phosphorylated NF-κB p65 (p-p65) was increased in the dorsal horn of the lumbar 4-6 segments after intrathecal administration of morphine for 7 consecutive days, and the p-p65 was co-localized with neurons and astrocytes. The expression of TNF-α and IL-1β was also increased in the same area. In addition, pretreatment with pyrrolidinedithiocarbamate (PDTC) or SN50, inhibitors of NF-κB, prevented the development of morphine analgesic tolerance and alleviated morphine withdrawal-induced allodynia and hyperalgesia. The increase in TNF-α and IL-1β expression induced by chronic morphine exposure was also partially blocked by PDTC pretreatment. In another experiment, rats receiving PDTC or SN50 beginning on day 7 of morphine injection showed partial recovery of the anti-nociceptive effects of morphine and attenuation of the withdrawal-induced abnormal pain. Meanwhile, intrathecal pretreatment with lipopolysaccharide from Rhodobacter sphaeroides, an antagonist of toll-like receptor 4 (TLR4), blocked the activation of NF-κB, and prevented the development of morphine tolerance and withdrawal-induced abnormal pain. These data indicated that TLR4-mediated NF-κB activation in the spinal cord is involved in the development and maintenance of morphine analgesic tolerance and withdrawal-induced pain hypersensitivity. PMID:25446875

  16. Association of morphine-induced analgesic tolerance with changes in gene expression of GluN1 and MOR1 in rat spinal cord and midbrain

    PubMed Central

    Ahmadi, Shamseddin; Miraki, Fatemeh; Rostamzadeh, Jalal

    2016-01-01

    Objective(s): We aimed to examine association of gene expression of MOR1 and GluN1 at mRNA level in the lumbosacral cord and midbrain with morphine tolerance in male Wistar rats. Materials and Methods: Analgesic effects of morphine administrated intraperitoneally at doses of 0.1, 1, 5 and 10 mg/kg were examined using a hot plate test in rats with and without a history of 15 days morphine (10 mg/kg) treatment. Morphine-induced analgesic tolerance was also assessed on days 1, 5, 10 and 15 of chronic morphine injections. Two groups with history of 15 days injections of saline or morphine (10 mg/kg) were decapitated on day 15 and their lumbosacral cord and midbrain were dissected for evaluating MOR1 and GluN1 gene expression. Results: The results of the hot plate test showed that morphine (5 and 10 mg/kg) induced significant analgesia in naïve rats but its analgesic effects in rats receiving 15 days injections of morphine (10 mg/kg) was decreased, indicating tolerance to morphine analgesia. The results also showed that the GluN1 gene expression in tolerant rats was decreased by 71% in the lumbosacral cord but increased by 110 % in the midbrain compared to the control group. However, no significant change was observed for the MOR1 gene expression in both areas. Conclusion: It can be concluded that tolerance following administration of morphine (10 mg/kg) for 15 days is associated with site specific changes in the GluN1 gene expression in the spinal cord and midbrain but the MOR1 gene expression is not affected. PMID:27803778

  17. STEP signaling pathway mediates psychomotor stimulation and morphine withdrawal symptoms, but not for reward, analgesia and tolerance

    PubMed Central

    Kim, Yoon-Jung; Kang, Young; Park, Hye-Yeon; Lee, Jae-Ran; Yu, Dae-Yeul; Murata, Takuya; Gondo, Yoichi; Hwang, Jung Hwan; Kim, Yong-Hoon; Lee, Chul-Ho; Rhee, Myungchull; Han, Pyung-Lim; Chung, Bong-Hyun; Lee, Hyun-Jun; Kim, Kyoung-Shim

    2016-01-01

    Striatal-enriched protein tyrosine phosphatase (STEP) is abundantly expressed in the striatum, which strongly expresses dopamine and opioid receptors and mediates the effects of many drugs of abuse. However, little is known about the role of STEP in opioid receptor function. In the present study, we generated STEP-targeted mice carrying a nonsense mutation (C230X) in the kinase interaction domain of STEP by screening the N-ethyl-N-nitrosourea (ENU)-driven mutant mouse genomic DNA library and subsequent in vitro fertilization. It was confirmed that the C230X nonsense mutation completely abolished functional STEP protein expression in the brain. STEPC230X−/− mice showed attenuated acute morphine-induced psychomotor activity and withdrawal symptoms, whereas morphine-induced analgesia, tolerance and reward behaviors were unaffected. STEPC230X−/− mice displayed reduced hyperlocomotion in response to intrastriatal injection of the μ-opioid receptor agonist DAMGO, but the behavioral responses to δ- and κ-opioid receptor agonists remained intact. These results suggest that STEP has a key role in the regulation of psychomotor action and physical dependency to morphine. These data suggest that STEP inhibition may be a critical target for the treatment of withdrawal symptoms associated with morphine. PMID:26915673

  18. Attenuation of tolerance to opioid-induced antinociception and protection against morphine-induced decrease of neurofilament proteins by idazoxan and other I2-imidazoline ligands

    PubMed Central

    Boronat, M Assumpció; Olmos, Gabriel; García-Sevilla, Jesús A

    1998-01-01

    Agmatine, the proposed endogenous ligand for imidazoline receptors, has been shown to attenuate tolerance to morphine-induced antinociception (Kolesnikov et al., 1996). The main aim of this study was to assess if idazoxan, an α2-adrenoceptor antagonist that also interacts with imidazoline receptors, could also modulate opioid tolerance in rats and to establish which type of imidazoline receptors (or other receptors) are involved. Antinociceptive responses to opioid drugs were determined by the tail-flick test. The acute administration of morphine (10 mg kg−1, i.p., 30 min) or pentazocine (10 mg kg−1, i.p., 30 min) resulted in marked increases in tail-flick latencies (TFLs). As expected, the initial antinociceptive response to the opiates was lost after chronic (13 days) treatment (tolerance). When idazoxan (10 mg kg−1, i.p.) was given chronically 30 min before the opiates it completely prevented morphine tolerance and markedly attenuated tolerance to pentazocine (TFLs increased by 71–143% at day 13). Idazoxan alone did not modify TFLs. The concurrent chronic administration (10 mg kg−1, i.p., 13 days) of 2-BFI, LSL 60101, and LSL 61122 (valldemossine), selective and potent I2-imidazoline receptor ligands, and morphine (10 mg kg−1, i.p.), also prevented or attenuated morphine tolerance (TFLs increased by 64–172% at day 13). This attenuation of morphine tolerance was still apparent six days after discontinuation of the chronic treatment with LSL 60101-morphine. The acute treatment with these drugs did not potentiate morphine-induced antinociception. These drugs alone did not modify TFLs. Together, these results indicated the specific involvement of I2-imidazoline receptors in the modulation of opioid tolerance. The concurrent chronic (13 days) administration of RX821002 (10 mg kg−1, i.p.) and RS-15385-197 (1 mg kg−1, i.p.), selective α2-adrenoceptor antagonists, and morphine (10 mg kg−1, i.p.), did not

  19. The Rewards of Learning.

    ERIC Educational Resources Information Center

    Chance, Paul

    1992-01-01

    Although intrinsic rewards are important, they (along with punishment and encouragement) are insufficient for efficient learning. Teachers must supplement intrinsic rewards with extrinsic rewards, such as praising, complimenting, applauding, and providing other forms of recognition for good work. Teachers should use the weakest reward required to…

  20. MeCP2 repression of G9a in regulation of pain and morphine reward.

    PubMed

    Zhang, Zhi; Tao, Wenjuan; Hou, Yuan-Yuan; Wang, Wei; Kenny, Paul J; Pan, Zhizhong Z

    2014-07-01

    Opioids are commonly used for pain relief, but their strong rewarding effects drive opioid misuse and abuse. How pain affects the liability of opioid abuse is unknown at present. In this study, we identified an epigenetic regulating cascade activated by both pain and the opioid morphine. Both persistent pain and repeated morphine upregulated the transcriptional regulator MeCP2 in mouse central nucleus of the amygdala (CeA). Chromatin immunoprecipitation analysis revealed that MeCP2 bound to and repressed the transcriptional repressor histone dimethyltransferase G9a, reducing G9a-catalyzed repressive mark H3K9me2 in CeA. Repression of G9a activity increased expression of brain-derived neurotrophic factor (BDNF). Behaviorally, persistent inflammatory pain increased the sensitivity to acquiring morphine-induced, reward-related behavior of conditioned place preference in mice. Local viral vector-mediated MeCP2 overexpression, Cre-induced G9a knockdown, and CeA application of BDNF mimicked, whereas MeCP2 knockdown inhibited, the pain effect. These results suggest that MeCP2 directly represses G9a as a shared mechanism in central amygdala for regulation of emotional responses to pain and opioid reward, and for their behavioral interaction.

  1. NPY mediates reward activity of morphine, via NPY Y1 receptors, in the nucleus accumbens shell.

    PubMed

    Desai, Sagar J; Upadhya, Manoj A; Subhedar, Nishikant K; Kokare, Dadasaheb M

    2013-06-15

    Although the interaction between endogenous neuropeptide Y (NPY) and opioidergic systems in processing of reward has been speculated, experimental evidence is lacking. We investigated the role of NPY, and its Y1 receptors, in the nucleus accumbens shell (AcbSh) in morphine induced reward and reinforcement behavior. Rats were implanted with cannulae targeted at AcbSh for drug administration, and with stimulating electrode in the medial forebrain bundle (MFB). The rats were then conditioned in an operant conditioning chamber for electrical self-stimulation of the MFB. Increased rate of lever pressings was evaluated against the frequency of the stimulating current. Increase in rate of lever presses was considered as a measure of reward and reinforcement. About 30-70% increase in self-stimulation was observed following bilateral intra-AcbSh treatment with morphine, NPY or [Leu(31), Pro(34)]-NPY (NPY Y1/Y5 receptors agonist), however, BIBP3226 (selective NPY Y1 receptors antagonist) produced opposite effect. The reward effect of morphine was significantly potentiated by NPY or [Leu(31), Pro(34)]-NPY, but antagonized by BIBP3226. NPY-immunoreactivity in the AcbSh, arcuate nucleus (ARC) and lateral part of bed nucleus of stria terminalis (BNSTl) was significantly more in the operant conditioned rats than in naïve control. However, morphine administration to the conditioned rats resulted in significant decrease in the NPY-immunoreactivity in all these anatomical regions. Since the role of morphine in modulation of mesolimbic-dopaminergic pathway is well established, we suggest that NPY system in AcbSh, ARC and BNSTl, perhaps acting via Y1-receptor system, may be an important component of the mesolimbic-AcbSh reward circuitry triggered by endogenous opioids.

  2. Punished by Rewards?

    ERIC Educational Resources Information Center

    Brandt, Ron

    1995-01-01

    The author of "Punished by Rewards" (1993), claims that rewards and punishments serve to manipulate behavior and destroy the potential for real learning. Praise is especially tricky, since intangible rewards can also foster compliance, not motivation. An engaging curriculum and a caring atmosphere encourage kids to exercise their natural…

  3. Markov reward processes

    NASA Technical Reports Server (NTRS)

    Smith, R. M.

    1991-01-01

    Numerous applications in the area of computer system analysis can be effectively studied with Markov reward models. These models describe the behavior of the system with a continuous-time Markov chain, where a reward rate is associated with each state. In a reliability/availability model, upstates may have reward rate 1 and down states may have reward rate zero associated with them. In a queueing model, the number of jobs of certain type in a given state may be the reward rate attached to that state. In a combined model of performance and reliability, the reward rate of a state may be the computational capacity, or a related performance measure. Expected steady-state reward rate and expected instantaneous reward rate are clearly useful measures of the Markov reward model. More generally, the distribution of accumulated reward or time-averaged reward over a finite time interval may be determined from the solution of the Markov reward model. This information is of great practical significance in situations where the workload can be well characterized (deterministically, or by continuous functions e.g., distributions). The design process in the development of a computer system is an expensive and long term endeavor. For aerospace applications the reliability of the computer system is essential, as is the ability to complete critical workloads in a well defined real time interval. Consequently, effective modeling of such systems must take into account both performance and reliability. This fact motivates our use of Markov reward models to aid in the development and evaluation of fault tolerant computer systems.

  4. Exposure to opiates in female adolescents alters mu opiate receptor expression and increases the rewarding effects of morphine in future offspring.

    PubMed

    Vassoler, Fair M; Wright, Siobhan J; Byrnes, Elizabeth M

    2016-04-01

    Prescription opiate use and abuse has increased dramatically over the past two decades, including increased use in adolescent populations. Recently, it has been proposed that use during this critical period may affect future offspring even when use is discontinued prior to conception. Here, we utilize a rodent model to examine the effects of adolescent morphine exposure on the reward functioning of the offspring. Female Sprague Dawley rats were administered morphine for 10 days during early adolescence (post-natal day 30-39) using an escalating dosing regimen. Animals then remained drug free until adulthood at which point they were mated with naïve males. Adult offspring (F1 animals) were tested for their response to morphine-induced (0, 1, 2.5, 5, and 10 mg/kg, s.c.) conditioned place preference (CPP) and context-independent morphine-induced sensitization. Naïve littermates were used to examine mu opiate receptor expression in the nucleus accumbens and ventral tegmental area. Results indicate that F1 females whose mothers were exposed to morphine during adolescence (Mor-F1) demonstrate significantly enhanced CPP to the lowest doses of morphine compared with Sal-F1 females. There were no differences in context-independent sensitization between maternal treatment groups. Protein expression analysis showed significantly increased levels of accumbal mu opiate receptor in Mor-F1 offspring and decreased levels in the VTA. Taken together, these findings demonstrate a shift in the dose response curve with regard to the rewarding effects of morphine in Mor-F1 females which may in part be due to altered mu opiate receptor expression in the nucleus accumbens and VTA. PMID:26700246

  5. Clavulanic acid reduces rewarding, hyperthermic and locomotor-sensitizing effects of morphine in rats: a new indication for an old drug?

    PubMed Central

    Schroeder, Joseph A.; Tolman, Nicholas G.; McKenna, Faye F.; Watkins, Kelly L.; Passeri, Sara M.; Hsu, Alexander H.; Shinn, Brittany R.; Rawls, Scott M.

    2014-01-01

    Background Despite the efficacy of ceftriaxone (CTX) in animal models of CNS diseases, including drug addiction, its utility as a CNS-active therapeutic may be limited by poor brain penetrability and cumbersome parenteral administration. An alternative is the β-lactamase inhibitor clavulanic acid (CA), a constituent of Augmentin that prevents antibiotic degradation. CA possesses the β-lactam core necessary for CNS activity but, relative to CTX, possesses: 1) oral activity; 2) 2.5-fold greater brain penetrability; and 3) negligible antibiotic activity. Methods To compare the effectiveness of CA (10 mg/kg) and CTX (200 mg/kg) against centrally-mediated endpoints, we investigated their effects against morphine’s rewarding, hyperthermic, and locomotor-sensitizing actions. Endpoints were based on prior evidence that CTX attenuates morphine-induced physical dependence, tolerance, and hyperthermia. Results As expected, rats treated with morphine (4 mg/kg) displayed hyperthermia and conditioned place preference (CPP). Co-treatment with CTX or CA inhibited development of morphine-induced CPP by approximately 70%. Morphine’s hyperthermic effect was also suppressed, with CTX and CA producing 57% and 47% inhibition, respectively. Locomotor sensitization induced by repeated morphine exposures was inhibited by CA but not CTX. Conclusions The present findings are the first to suggest that CA disrupts the in vivo actions of morphine and point toward further studying CA as a potential therapy for drug addiction. Further, its ability to disrupt morphine’s rewarding effects at 20-fold lower doses than CTX identifies CA as an existing, orally-active alternative to direct CTX therapy for CNS diseases. PMID:24998018

  6. Dopamine reward prediction error coding.

    PubMed

    Schultz, Wolfram

    2016-03-01

    Reward prediction errors consist of the differences between received and predicted rewards. They are crucial for basic forms of learning about rewards and make us strive for more rewards-an evolutionary beneficial trait. Most dopamine neurons in the midbrain of humans, monkeys, and rodents signal a reward prediction error; they are activated by more reward than predicted (positive prediction error), remain at baseline activity for fully predicted rewards, and show depressed activity with less reward than predicted (negative prediction error). The dopamine signal increases nonlinearly with reward value and codes formal economic utility. Drugs of addiction generate, hijack, and amplify the dopamine reward signal and induce exaggerated, uncontrolled dopamine effects on neuronal plasticity. The striatum, amygdala, and frontal cortex also show reward prediction error coding, but only in subpopulations of neurons. Thus, the important concept of reward prediction errors is implemented in neuronal hardware.

  7. Sticking Up for Rewards.

    ERIC Educational Resources Information Center

    Chance, Paul

    1993-01-01

    Argues, in response to Kohn's article in the same "Kappan" issue, that honest feedback on student performance (informational rewards) are usually necessary for initial learning to occur successfully. Some rewards do work and have long-term benefits. The current philosophy of assigning teachers a facilitative role renders them impotent and blames…

  8. Rewarding the Resident Teacher

    ERIC Educational Resources Information Center

    McBride, Jennifer M.; Drake, Richard L.

    2011-01-01

    Residents routinely make significant contributions to the education of medical students. However, little attention has been paid to rewarding these individuals for their involvement in these academic activities. This report describes a program that rewards resident teachers with an academic appointment as a Clinical Instructor. The residents…

  9. Dopamine signaling in reward-related behaviors.

    PubMed

    Baik, Ja-Hyun

    2013-01-01

    Dopamine (DA) regulates emotional and motivational behavior through the mesolimbic dopaminergic pathway. Changes in DA mesolimbic neurotransmission have been found to modify behavioral responses to various environmental stimuli associated with reward behaviors. Psychostimulants, drugs of abuse, and natural reward such as food can cause substantial synaptic modifications to the mesolimbic DA system. Recent studies using optogenetics and DREADDs, together with neuron-specific or circuit-specific genetic manipulations have improved our understanding of DA signaling in the reward circuit, and provided a means to identify the neural substrates of complex behaviors such as drug addiction and eating disorders. This review focuses on the role of the DA system in drug addiction and food motivation, with an overview of the role of D1 and D2 receptors in the control of reward-associated behaviors.

  10. Dopamine reward prediction error coding

    PubMed Central

    Schultz, Wolfram

    2016-01-01

    Reward prediction errors consist of the differences between received and predicted rewards. They are crucial for basic forms of learning about rewards and make us strive for more rewards—an evolutionary beneficial trait. Most dopamine neurons in the midbrain of humans, monkeys, and rodents signal a reward prediction error; they are activated by more reward than predicted (positive prediction error), remain at baseline activity for fully predicted rewards, and show depressed activity with less reward than predicted (negative prediction error). The dopamine signal increases nonlinearly with reward value and codes formal economic utility. Drugs of addiction generate, hijack, and amplify the dopamine reward signal and induce exaggerated, uncontrolled dopamine effects on neuronal plasticity. The striatum, amygdala, and frontal cortex also show reward prediction error coding, but only in subpopulations of neurons. Thus, the important concept of reward prediction errors is implemented in neuronal hardware. PMID:27069377

  11. Reward feedback accelerates motor learning.

    PubMed

    Nikooyan, Ali A; Ahmed, Alaa A

    2015-01-15

    Recent findings have demonstrated that reward feedback alone can drive motor learning. However, it is not yet clear whether reward feedback alone can lead to learning when a perturbation is introduced abruptly, or how a reward gradient can modulate learning. In this study, we provide reward feedback that decays continuously with increasing error. We asked whether it is possible to learn an abrupt visuomotor rotation by reward alone, and if the learning process could be modulated by combining reward and sensory feedback and/or by using different reward landscapes. We designed a novel visuomotor learning protocol during which subjects experienced an abruptly introduced rotational perturbation. Subjects received either visual feedback or reward feedback, or a combination of the two. Two different reward landscapes, where the reward decayed either linearly or cubically with distance from the target, were tested. Results demonstrate that it is possible to learn from reward feedback alone and that the combination of reward and sensory feedback accelerates learning. An analysis of the underlying mechanisms reveals that although reward feedback alone does not allow for sensorimotor remapping, it can nonetheless lead to broad generalization, highlighting a dissociation between remapping and generalization. Also, the combination of reward and sensory feedback accelerates learning without compromising sensorimotor remapping. These findings suggest that the use of reward feedback is a promising approach to either supplement or substitute sensory feedback in the development of improved neurorehabilitation techniques. More generally, they point to an important role played by reward in the motor learning process.

  12. Reward, context, and human behaviour.

    PubMed

    Blaukopf, Clare L; DiGirolamo, Gregory J

    2007-01-01

    Animal models of reward processing have revealed an extensive network of brain areas that process different aspects of reward, from expectation and prediction to calculation of relative value. These results have been confirmed and extended in human neuroimaging to encompass secondary rewards more unique to humans, such as money. The majority of the extant literature covers the brain areas associated with rewards whilst neglecting analysis of the actual behaviours that these rewards generate. This review strives to redress this imbalance by illustrating the importance of looking at the behavioural outcome of rewards and the context in which they are produced. Following a brief review of the literature of reward-related activity in the brain, we examine the effect of reward context on actions. These studies reveal how the presence of reward vs. reward and punishment, or being conscious vs. unconscious of reward-related actions, differentially influence behaviour. The latter finding is of particular importance given the extent to which animal models are used in understanding the reward systems of the human mind. It is clear that further studies are needed to learn about the human reaction to reward in its entirety, including any distinctions between conscious and unconscious behaviours. We propose that studies of reward entail a measure of the animal's (human or nonhuman) knowledge of the reward and knowledge of its own behavioural outcome to achieve that reward. PMID:17619748

  13. Promising High Monetary Rewards for Future Task Performance Increases Intermediate Task Performance

    PubMed Central

    Zedelius, Claire M.; Veling, Harm; Bijleveld, Erik; Aarts, Henk

    2012-01-01

    In everyday life contexts and work settings, monetary rewards are often contingent on future performance. Based on research showing that the anticipation of rewards causes improved task performance through enhanced task preparation, the present study tested the hypothesis that the promise of monetary rewards for future performance would not only increase future performance, but also performance on an unrewarded intermediate task. Participants performed an auditory Simon task in which they responded to two consecutive tones. While participants could earn high vs. low monetary rewards for fast responses to every second tone, their responses to the first tone were not rewarded. Moreover, we compared performance under conditions in which reward information could prompt strategic performance adjustments (i.e., when reward information was presented for a relatively long duration) to conditions preventing strategic performance adjustments (i.e., when reward information was presented very briefly). Results showed that high (vs. low) rewards sped up both rewarded and intermediate, unrewarded responses, and the effect was independent of the duration of reward presentation. Moreover, long presentation led to a speed-accuracy trade-off for both rewarded and unrewarded tones, whereas short presentation sped up responses to rewarded and unrewarded tones without this trade-off. These results suggest that high rewards for future performance boost intermediate performance due to enhanced task preparation, and they do so regardless whether people respond to rewards in a strategic or non-strategic manner. PMID:22905145

  14. 39 CFR 233.2 - Circulars and rewards.

    Code of Federal Regulations, 2011 CFR

    2011-07-01

    ...) Rewards will be paid up to the amounts and under the conditions stated in Poster 296, Notice of Reward... property of the United States under the custody or control of the Postal Service, including property of the... mail to facilitate any crime relating to the sexual exploitation of children. (x) Mailing or causing...

  15. 39 CFR 233.2 - Circulars and rewards.

    Code of Federal Regulations, 2013 CFR

    2013-07-01

    ...) Rewards will be paid up to the amounts and under the conditions stated in Poster 296, Notice of Reward... property of the United States under the custody or control of the Postal Service, including property of the... mail to facilitate any crime relating to the sexual exploitation of children. (x) Mailing or causing...

  16. 39 CFR 233.2 - Circulars and rewards.

    Code of Federal Regulations, 2014 CFR

    2014-07-01

    ...) Rewards will be paid up to the amounts and under the conditions stated in Poster 296, Notice of Reward... property of the United States under the custody or control of the Postal Service, including property of the... mail to facilitate any crime relating to the sexual exploitation of children. (x) Mailing or causing...

  17. 39 CFR 233.2 - Circulars and rewards.

    Code of Federal Regulations, 2010 CFR

    2010-07-01

    ...) Rewards will be paid up to the amounts and under the conditions stated in Poster 296, Notice of Reward... property of the United States under the custody or control of the Postal Service, including property of the... mail to facilitate any crime relating to the sexual exploitation of children. (x) Mailing or causing...

  18. The shared reward dilemma.

    PubMed

    Cuesta, J A; Jiménez, R; Lugo, H; Sánchez, A

    2008-03-21

    One of the most direct human mechanisms of promoting cooperation is rewarding it. We study the effect of sharing a reward among cooperators in the most stringent form of social dilemma, namely the prisoner's dilemma (PD). Specifically, for a group of players that collect payoffs by playing a pairwise PD game with their partners, we consider an external entity that distributes a fixed reward equally among all cooperators. Thus, individuals confront a new dilemma: on the one hand, they may be inclined to choose the shared reward despite the possibility of being exploited by defectors; on the other hand, if too many players do that, cooperators will obtain a poor reward and defectors will outperform them. By appropriately tuning the amount to be shared a vast variety of scenarios arises, including the traditional ones in the study of cooperation as well as more complex situations where unexpected behavior can occur. We provide a complete classification of the equilibria of the n-player game as well as of its evolutionary dynamics.

  19. Updating dopamine reward signals.

    PubMed

    Schultz, Wolfram

    2013-04-01

    Recent work has advanced our knowledge of phasic dopamine reward prediction error signals. The error signal is bidirectional, reflects well the higher order prediction error described by temporal difference learning models, is compatible with model-free and model-based reinforcement learning, reports the subjective rather than physical reward value during temporal discounting and reflects subjective stimulus perception rather than physical stimulus aspects. Dopamine activations are primarily driven by reward, and to some extent risk, whereas punishment and salience have only limited activating effects when appropriate controls are respected. The signal is homogeneous in terms of time course but heterogeneous in many other aspects. It is essential for synaptic plasticity and a range of behavioural learning situations.

  20. The Rewards of Mentoring

    ERIC Educational Resources Information Center

    Green-Powell, Patricia

    2012-01-01

    A growing body of knowledge exists which describes the rewards and importance of mentors in the professional development of young men and women, particularly with relation to their interactions in professional and organizational settings. Research in both educational settings and the workplace indicates that students and employees alike are more…

  1. Performance Rewards in Athletics.

    ERIC Educational Resources Information Center

    Jones, Dianne; Mungai, Diana

    2001-01-01

    Discusses ways that college athletic coaches can motivate student athletes to improve performance, describing a model that recognizes the multiple factors that contribute to success. The model draws from experiences in corporate America, which uses performance reward systems to supplement base compensation. The model illustrates how one…

  2. Do Economic Rewards Work?

    ERIC Educational Resources Information Center

    Wallace, Brian D.

    2009-01-01

    The love of learning--that intrinsic desire to gain knowledge and insight into new subjects--was once its own reward. That was altered decades ago when parents started using the proverbial "stick and carrot" to motivate their children to do well in school, or even just show up. Today, educators across the country have taken hold of this approach…

  3. Rewards and Supports

    ERIC Educational Resources Information Center

    Hershberg, Theodore; Robertson-Kraft, Claire

    2010-01-01

    Pay-for-performance systems in public schools have long been burdened with controversy. Critics of performance pay systems contend that because teachers' impact cannot be measured without error, it is impossible to create fair and accurate systems for evaluating and rewarding performance. By this standard, however, current practice fails on both…

  4. A Rewarding Partnership

    ERIC Educational Resources Information Center

    Abbott, Cheryl; Swanson, Marc

    2006-01-01

    A collaborating scientist--a rewarding addition to any high school science program--can help students collect and analyze data that either replicates or parallels the work of the partnering scientist. This type of partnership is beneficial for both students and scientists, and perhaps there has never been a better time to consider such a…

  5. Reward positivity: Reward prediction error or salience prediction error?

    PubMed

    Heydari, Sepideh; Holroyd, Clay B

    2016-08-01

    The reward positivity is a component of the human ERP elicited by feedback stimuli in trial-and-error learning and guessing tasks. A prominent theory holds that the reward positivity reflects a reward prediction error signal that is sensitive to outcome valence, being larger for unexpected positive events relative to unexpected negative events (Holroyd & Coles, 2002). Although the theory has found substantial empirical support, most of these studies have utilized either monetary or performance feedback to test the hypothesis. However, in apparent contradiction to the theory, a recent study found that unexpected physical punishments also elicit the reward positivity (Talmi, Atkinson, & El-Deredy, 2013). The authors of this report argued that the reward positivity reflects a salience prediction error rather than a reward prediction error. To investigate this finding further, in the present study participants navigated a virtual T maze and received feedback on each trial under two conditions. In a reward condition, the feedback indicated that they would either receive a monetary reward or not and in a punishment condition the feedback indicated that they would receive a small shock or not. We found that the feedback stimuli elicited a typical reward positivity in the reward condition and an apparently delayed reward positivity in the punishment condition. Importantly, this signal was more positive to the stimuli that predicted the omission of a possible punishment relative to stimuli that predicted a forthcoming punishment, which is inconsistent with the salience hypothesis. PMID:27184070

  6. Reward positivity: Reward prediction error or salience prediction error?

    PubMed

    Heydari, Sepideh; Holroyd, Clay B

    2016-08-01

    The reward positivity is a component of the human ERP elicited by feedback stimuli in trial-and-error learning and guessing tasks. A prominent theory holds that the reward positivity reflects a reward prediction error signal that is sensitive to outcome valence, being larger for unexpected positive events relative to unexpected negative events (Holroyd & Coles, 2002). Although the theory has found substantial empirical support, most of these studies have utilized either monetary or performance feedback to test the hypothesis. However, in apparent contradiction to the theory, a recent study found that unexpected physical punishments also elicit the reward positivity (Talmi, Atkinson, & El-Deredy, 2013). The authors of this report argued that the reward positivity reflects a salience prediction error rather than a reward prediction error. To investigate this finding further, in the present study participants navigated a virtual T maze and received feedback on each trial under two conditions. In a reward condition, the feedback indicated that they would either receive a monetary reward or not and in a punishment condition the feedback indicated that they would receive a small shock or not. We found that the feedback stimuli elicited a typical reward positivity in the reward condition and an apparently delayed reward positivity in the punishment condition. Importantly, this signal was more positive to the stimuli that predicted the omission of a possible punishment relative to stimuli that predicted a forthcoming punishment, which is inconsistent with the salience hypothesis.

  7. Luteinizing hormone-releasing hormone (LHRH) attenuates morphine-induced inhibition of cyclic AMP (cAMP) in opioid-responsive SK-N-SH cells.

    PubMed

    Ratka, A; Simpkins, J W

    1997-04-01

    SK-N-SH cells were used to assess the effects of luteinizing hormone-releasing hormone (LHRH) on opioid receptor-mediated changes in cyclic AMP (cAMP). Prostaglandin E1 (PGE1, 1 microM) caused a dramatic increase in cAMP levels. Treatment with 10 microM morphine (MOR) significantly inhibited the stimulatory effect of PGE1, LHRH (0.8 microM) caused an increase in the basal level of intracellular cAMP and potentiated the stimulatory effect of PGE1 on cAMP accumulation. In cells pretreated with LHRH the inhibitory effect of MOR on cAMP accumulation was significantly attenuated. An LHRH antagonist had no effect on cAMP. The involvement of pertussis toxin (PTX)-sensitive G proteins in the actions of LHRH was studied. PTX increased the stimulatory effect of PGE1 on cAMP and attenuated the inhibitory effect of MOR. However, PTX pretreatment prevented the effects of LHRH on the intracellular actions of PGE1 but exerted an additive effect with LHRH in blocking the MOR-induced decrease in cAMP levels. We conclude that LHRH attenuates the inhibitory, opioid receptor-mediated effect of MOR on intracellular cAMP accumulation in SK-N-SH cells, and that the G protein-independent mechanism may be involved in LHRH-induced attenuation of the inhibitory effect of MOR on neuronal cAMP.

  8. Biological auctions with multiple rewards.

    PubMed

    Reiter, Johannes G; Kanodia, Ayush; Gupta, Raghav; Nowak, Martin A; Chatterjee, Krishnendu

    2015-08-01

    The competition for resources among cells, individuals or species is a fundamental characteristic of evolution. Biological all-pay auctions have been used to model situations where multiple individuals compete for a single resource. However, in many situations multiple resources with various values exist and single reward auctions are not applicable. We generalize the model to multiple rewards and study the evolution of strategies. In biological all-pay auctions the bid of an individual corresponds to its strategy and is equivalent to its payment in the auction. The decreasingly ordered rewards are distributed according to the decreasingly ordered bids of the participating individuals. The reproductive success of an individual is proportional to its fitness given by the sum of the rewards won minus its payments. Hence, successful bidding strategies spread in the population. We find that the results for the multiple reward case are very different from the single reward case. While the mixed strategy equilibrium in the single reward case with more than two players consists of mostly low-bidding individuals, we show that the equilibrium can convert to many high-bidding individuals and a few low-bidding individuals in the multiple reward case. Some reward values lead to a specialization among the individuals where one subpopulation competes for the rewards and the other subpopulation largely avoids costly competitions. Whether the mixed strategy equilibrium is an evolutionarily stable strategy (ESS) depends on the specific values of the rewards. PMID:26180069

  9. Biological auctions with multiple rewards.

    PubMed

    Reiter, Johannes G; Kanodia, Ayush; Gupta, Raghav; Nowak, Martin A; Chatterjee, Krishnendu

    2015-08-01

    The competition for resources among cells, individuals or species is a fundamental characteristic of evolution. Biological all-pay auctions have been used to model situations where multiple individuals compete for a single resource. However, in many situations multiple resources with various values exist and single reward auctions are not applicable. We generalize the model to multiple rewards and study the evolution of strategies. In biological all-pay auctions the bid of an individual corresponds to its strategy and is equivalent to its payment in the auction. The decreasingly ordered rewards are distributed according to the decreasingly ordered bids of the participating individuals. The reproductive success of an individual is proportional to its fitness given by the sum of the rewards won minus its payments. Hence, successful bidding strategies spread in the population. We find that the results for the multiple reward case are very different from the single reward case. While the mixed strategy equilibrium in the single reward case with more than two players consists of mostly low-bidding individuals, we show that the equilibrium can convert to many high-bidding individuals and a few low-bidding individuals in the multiple reward case. Some reward values lead to a specialization among the individuals where one subpopulation competes for the rewards and the other subpopulation largely avoids costly competitions. Whether the mixed strategy equilibrium is an evolutionarily stable strategy (ESS) depends on the specific values of the rewards.

  10. Theory meets pigeons: the influence of reward-magnitude on discrimination-learning.

    PubMed

    Rose, Jonas; Schmidt, Robert; Grabemann, Marco; Güntürkün, Onur

    2009-03-01

    Modern theoretical accounts on reward-based learning are commonly based on reinforcement learning algorithms. Most noted in this context is the temporal-difference (TD) algorithm in which the difference between predicted and obtained reward, the prediction-error, serves as a learning signal. Consequently, larger rewards cause bigger prediction-errors and lead to faster learning than smaller rewards. Therefore, if animals employ a neural implementation of TD learning, reward-magnitude should affect learning in animals accordingly. Here we test this prediction by training pigeons on a simple color-discrimination task with two pairs of colors. In each pair, correct discrimination is rewarded; in pair one with a large-reward, in pair two with a small-reward. Pigeons acquired the 'large-reward' discrimination faster than the 'small-reward' discrimination. Animal behavior and an implementation of the TD-algorithm yielded comparable results with respect to the difference between learning curves in the large-reward and in the small-reward conditions. We conclude that the influence of reward-magnitude on the acquisition of a simple discrimination paradigm is accurately reflected by a TD implementation of reinforcement learning.

  11. Ser⁄ Thr residues at α3⁄β5 loop of Gαs are important in morphine-induced adenylyl cyclase sensitization but not mitogen-activated protein kinase phosphorylation

    PubMed Central

    Seyedabadi, Mohammad; Ostad, Seyed Nasser; Albert, Paul R.; Dehpour, Ahmad R.; Rahimian, Reza; Ghazi-Khansari, Mahmoud; Ghahremani, Mohammad H.

    2015-01-01

    The signaling switch of β2-adrenergic and μ1-opioid receptors from stimulatory G-protein (Gαs) to inhibitory G-protein (Gαi) (and vice versa) influences adenylyl cyclase (AC) and extracellular-regulated kinase (ERK)1 ⁄ 2 activation. Post-translational modifications, including dephosphorylation of Gαs, enhance opioid receptor coupling to Gαs. In the present study, we substituted the Ser ⁄ Thr residues of Gαs at the α3 ⁄ β5 and α4 ⁄ β6 loops aiming to study the role of Gαs lacking Ser ⁄ Thr phosphorylation with respect to AC sensitization and mitogen-activated protein kinase activation. Isoproterenol increased the cAMP concentration (EC50 = 22.8 ± 3.4 μM) in Gαs-transfected S49 cyc– cells but not in nontransfected cells. However, there was no significant difference between the Gαs-wild-type (wt) and mutants. Morphine (10 μM) inhibited AC activity more efficiently in cyc– compared to Gαs-wt introduced cells (P < 0.05); however, we did not find a notable difference between Gαs-wt and mutants. Interestingly, Gαs-wt transfected cells showed more sensitization with respect to AC after chronic morphine compared to nontransfected cells (101 ± 12% versus 34 ± 6%; P < 0.001); μ1-opioid receptor interacted with Gαs, and both co-immunoprecipitated after chronic morphine exposure. Furthermore, mutation of T270A and S272A (P < 0.01), as well as T270A, S272A and S261A (P < 0.05), in α3 ⁄ β5, resulted in a higher level of AC supersensitization. ERK1⁄ 2 phosphorylation was rapidly induced by isoproterenol (by 9.5 ± 2.4-fold) and morphine (22 ± 2.2-fold) in Gαs-transfected cells; mutations of α3 ⁄ β5 and α4 ⁄ β6 did not affect the pattern or extent of mitogen-activated protein kinase activation. The findings of the present study show that Gαs interacts with the μ1-opioid receptor, and the Ser ⁄ Thr mutation to Ala at the α3 ⁄ β5 loop of Gαs enhances morphine-induced AC sensitization. In addition, Gαs was required for

  12. Prior morphine experience induces long-term increases in social interest and in appetitive behavior for natural reward.

    PubMed

    Nocjar, Christine; Panksepp, Jaak

    2007-08-01

    Brain opioids regulate social emotional responsivity. One neuro-evolutionary theory of addiction suggests that exogenous opiates may induce addiction via opioid-controlled emotional changes; with the drug eventually fulfilling the need for social comfort that is normally provided by endogenous opioids. This view predicts that past opiate experience may enduringly alter social responsivity. Although the acute social effects of opiates are well known, little evidence is available concerning the enduring effects of past opiate experience on social motivation aside from copulatory behaviors. This study evaluated the long-term effects of 10 daily morphine (10mg/kg/day) or saline injections on social and non-social motivated behaviors. Following 3 days or 2 weeks drug abstinence, social interest, food-seeking, and sexual pursuit were assessed. After 2-weeks opiate withdrawal, sexual pursuit and food-seeking behaviors were significantly increased. After a shorter 3-day withdrawal, these effects were not seen. Importantly, social interest was consistently magnified, even after short-term 3-day opiate withdrawal, and it was magnified more than sexual or food pursuit. These findings indicate that the incentive for social and non-social natural rewards were increased following withdrawal from intermittent opiate treatment, but that different morphine-induced neuroadaptations may regulate their expression.

  13. Social reward shapes attentional biases.

    PubMed

    Anderson, Brian A

    2016-01-01

    Paying attention to stimuli that predict a reward outcome is important for an organism to survive and thrive. When visual stimuli are associated with tangible, extrinsic rewards such as money or food, these stimuli acquire high attentional priority and come to automatically capture attention. In humans and other primates, however, many behaviors are not motivated directly by such extrinsic rewards, but rather by the social feedback that results from performing those behaviors. In the present study, I examine whether positive social feedback can similarly influence attentional bias. The results show that stimuli previously associated with a high probability of positive social feedback elicit value-driven attentional capture, much like stimuli associated with extrinsic rewards. Unlike with extrinsic rewards, however, such stimuli also influence task-specific motivation. My findings offer a potential mechanism by which social reward shapes the information that we prioritize when perceiving the world around us. PMID:25941868

  14. Nutritional controls of food reward.

    PubMed

    Fernandes, Maria F; Sharma, Sandeep; Hryhorczuk, Cecile; Auguste, Stephanie; Fulton, Stephanie

    2013-08-01

    The propensity to select and consume palatable nutrients is strongly influenced by the rewarding effects of food. Neural processes integrating reward, emotional states and decision-making can supersede satiety signals to promote excessive caloric intake and weight gain. While nutritional habits are influenced by reward-based neural mechanisms, nutrition and its impact on energy metabolism, in turn, plays an important role in the control of food reward. Feeding modulates the release of metabolic hormones that have an important influence on central controls of appetite. Nutrients themselves are also an essential source of energy fuel, while serving as key metabolites and acting as signalling molecules in the neural pathways that control feeding and food reward. Along these lines, this review discusses the impact of nutritionally regulated hormones and select macronutrients on the behavioural and neural processes underlying the rewarding effects of food. PMID:24070891

  15. Mesolimbic recruitment by nondrug rewards in detoxified alcoholics: effort anticipation, reward anticipation and reward delivery

    PubMed Central

    Bjork, James M.; Smith, Ashley R.; Chen, Gang; Hommer, Daniel W.

    2011-01-01

    Aberrant sensitivity of incentive neurocircuitry to nondrug rewards has been suggested as either a risk factor for or consequence of drug addiction. Using functional magnetic resonance imaging, we tested whether alcohol-dependent patients (ADP: n = 29) showed altered recruitment of ventral striatal (VS) incentive neurocircuitry compared to controls (n = 23) by: 1) cues to respond for monetary rewards, 2) post-response anticipation of rewards, or 3) delivery of rewards. Using an instrumental task with two-stage presentation of reward-predictive information, subjects saw cues signaling opportunities to win $0, $1, or $10 for responding to a target. Following this response, subjects were notified whether their success would be indicated by a lexical notification (“Hit?”) or by delivery of a monetary reward (“Win?”). After a variable interval, subjects then viewed the trial outcome. We found no significant group differences in voxelwise activation by task contrasts, or in signal change extracted from VS. Both ADP and controls showed significant VS and other limbic recruitment by pre-response reward anticipation. In addition, controls also showed VS recruitment by post-response reward-anticipation, and ADP had appreciable subthreshold VS activation. Both groups also showed similar mesolimbic responses to reward deliveries. Across all subjects, a questionnaire measure of “hot” impulsivity correlated with VS recruitment by post-response anticipation of low rewards and with VS recruitment by delivery of low rewards. These findings indicate that incentive-motivational processing of nondrug rewards is substantially maintained in recovering alcoholics, and that reward-elicited VS recruitment correlates more with individual differences in trait impulsivity irrespective of addiction. PMID:22281932

  16. Reward processing in adolescent rodents

    PubMed Central

    Simon, Nicholas W; Moghaddam, Bita

    2015-01-01

    Immaturities in adolescent reward processing are thought to contribute to poor decision making and increased susceptibility to develop addictive and psychiatric disorders. Very little is known; however, about how the adolescent brain processes reward. The current mechanistic theories of reward processing are derived from adult models. Here we review recent research focused on understanding of how the adolescent brain responds to rewards and reward-associated events. A critical aspect of this work is that age-related differences are evident in neuronal processing of reward-related events across multiple brain regions even when adolescent rats demonstrate behavior similar to adults. These include differences in reward processing between adolescent and adult rats in orbitofrontal cortex and dorsal striatum. Surprisingly, minimal age related differences are observed in ventral striatum, which has been a focal point of developmental studies. We go on to discuss the implications of these differences for behavioral traits affected in adolescence, such as impulsivity, risk-taking, and behavioral flexibility. Collectively, this work suggests that reward-evoked neural activity differs as a function of age and that regions such as the dorsal striatum that are not traditionally associated with affective processing in adults may be critical for reward processing and psychiatric vulnerability in adolescents. PMID:25524828

  17. Rewarding with dignity.

    PubMed

    Davidhizar, R; Shearer, R

    1998-11-01

    Job satisfaction affects employee morale, which in turn affects employee productivity. Therefore, managers need to learn about contributing factors and use the factors within their power to improve job satisfaction. Extrinsic rewards, such as a high salary and good work benefits, are important, but studies show that how a job makes an employee feel is the greatest determinant of job satisfaction. Managers can influence the emotional effect of work on an employee through, among other strategies, recognizing the employee's efforts, providing opportunities for the employee to participate in decision making, and allowing the employee to grow professionally.

  18. Reward Modulates Adaptations to Conflict

    ERIC Educational Resources Information Center

    Braem, Senne; Verguts, Tom; Roggeman, Chantal; Notebaert, Wim

    2012-01-01

    Both cognitive conflict (e.g. Verguts & Notebaert, 2009) and reward signals (e.g. Waszak & Pholulamdeth, 2009) have been proposed to enhance task-relevant associations. Bringing these two notions together, we predicted that reward modulates conflict-based sequential adaptations in cognitive control. This was tested combining either a single…

  19. Rewards Are a Rat Trap.

    ERIC Educational Resources Information Center

    Maydosz, Ann S.

    1998-01-01

    Argues against the use of rewards for students. Discusses their origin in Skinner's behaviorism and their application in behavior modification in the classroom. Describes the problems with using rewards, as noted by Alfie Kohn and others, including the erosion of intrinsic motivation and the distortion of the focus of learning. Presents…

  20. Recognition without Rewards: Building Connections.

    ERIC Educational Resources Information Center

    Cameron, Caren; Tate, Betty; MacNaughton, Daphne; Politano, Colleen

    Noting that the use of rewards in the form of stickers, trophies, prizes, points, tokens, and grades is commonplace in elementary education today, this book explores the differences between rewards and recognition and shows how teachers can build student confidence, motivate learning, and develop skills for lifelong learning through recognition.…

  1. Reward deficiency and anti-reward in pain chronification.

    PubMed

    Borsook, D; Linnman, C; Faria, V; Strassman, A M; Becerra, L; Elman, I

    2016-09-01

    Converging lines of evidence suggest that the pathophysiology of pain is mediated to a substantial degree via allostatic neuroadaptations in reward- and stress-related brain circuits. Thus, reward deficiency (RD) represents a within-system neuroadaptation to pain-induced protracted activation of the reward circuits that leads to depletion-like hypodopaminergia, clinically manifested anhedonia, and diminished motivation for natural reinforcers. Anti-reward (AR) conversely pertains to a between-systems neuroadaptation involving over-recruitment of key limbic structures (e.g., the central and basolateral amygdala nuclei, the bed nucleus of the stria terminalis, the lateral tegmental noradrenergic nuclei of the brain stem, the hippocampus and the habenula) responsible for massive outpouring of stressogenic neurochemicals (e.g., norepinephrine, corticotropin releasing factor, vasopressin, hypocretin, and substance P) giving rise to such negative affective states as anxiety, fear and depression. We propose here the Combined Reward deficiency and Anti-reward Model (CReAM), in which biopsychosocial variables modulating brain reward, motivation and stress functions can interact in a 'downward spiral' fashion to exacerbate the intensity, chronicity and comorbidities of chronic pain syndromes (i.e., pain chronification). PMID:27246519

  2. Adaptive Reward Pursuit: How Effort Requirements Affect Unconscious Reward Responses and Conscious Reward Decisions

    ERIC Educational Resources Information Center

    Bijleveld, Erik; Custers, Ruud; Aarts, Henk

    2012-01-01

    When in pursuit of rewards, humans weigh the value of potential rewards against the amount of effort that is required to attain them. Although previous research has generally conceptualized this process as a deliberate calculation, recent work suggests that rudimentary mechanisms--operating without conscious intervention--play an important role as…

  3. Reward-Guided Learning with and without Causal Attribution.

    PubMed

    Jocham, Gerhard; Brodersen, Kay H; Constantinescu, Alexandra O; Kahn, Martin C; Ianni, Angela M; Walton, Mark E; Rushworth, Matthew F S; Behrens, Timothy E J

    2016-04-01

    When an organism receives a reward, it is crucial to know which of many candidate actions caused this reward. However, recent work suggests that learning is possible even when this most fundamental assumption is not met. We used novel reward-guided learning paradigms in two fMRI studies to show that humans deploy separable learning mechanisms that operate in parallel. While behavior was dominated by precise contingent learning, it also revealed hallmarks of noncontingent learning strategies. These learning mechanisms were separable behaviorally and neurally. Lateral orbitofrontal cortex supported contingent learning and reflected contingencies between outcomes and their causal choices. Amygdala responses around reward times related to statistical patterns of learning. Time-based heuristic mechanisms were related to activity in sensorimotor corticostriatal circuitry. Our data point to the existence of several learning mechanisms in the human brain, of which only one relies on applying known rules about the causal structure of the task. PMID:26971947

  4. Reward-Guided Learning with and without Causal Attribution.

    PubMed

    Jocham, Gerhard; Brodersen, Kay H; Constantinescu, Alexandra O; Kahn, Martin C; Ianni, Angela M; Walton, Mark E; Rushworth, Matthew F S; Behrens, Timothy E J

    2016-04-01

    When an organism receives a reward, it is crucial to know which of many candidate actions caused this reward. However, recent work suggests that learning is possible even when this most fundamental assumption is not met. We used novel reward-guided learning paradigms in two fMRI studies to show that humans deploy separable learning mechanisms that operate in parallel. While behavior was dominated by precise contingent learning, it also revealed hallmarks of noncontingent learning strategies. These learning mechanisms were separable behaviorally and neurally. Lateral orbitofrontal cortex supported contingent learning and reflected contingencies between outcomes and their causal choices. Amygdala responses around reward times related to statistical patterns of learning. Time-based heuristic mechanisms were related to activity in sensorimotor corticostriatal circuitry. Our data point to the existence of several learning mechanisms in the human brain, of which only one relies on applying known rules about the causal structure of the task.

  5. Reward-Guided Learning with and without Causal Attribution

    PubMed Central

    Jocham, Gerhard; Brodersen, Kay H.; Constantinescu, Alexandra O.; Kahn, Martin C.; Ianni, Angela M.; Walton, Mark E.; Rushworth, Matthew F.S.; Behrens, Timothy E.J.

    2016-01-01

    Summary When an organism receives a reward, it is crucial to know which of many candidate actions caused this reward. However, recent work suggests that learning is possible even when this most fundamental assumption is not met. We used novel reward-guided learning paradigms in two fMRI studies to show that humans deploy separable learning mechanisms that operate in parallel. While behavior was dominated by precise contingent learning, it also revealed hallmarks of noncontingent learning strategies. These learning mechanisms were separable behaviorally and neurally. Lateral orbitofrontal cortex supported contingent learning and reflected contingencies between outcomes and their causal choices. Amygdala responses around reward times related to statistical patterns of learning. Time-based heuristic mechanisms were related to activity in sensorimotor corticostriatal circuitry. Our data point to the existence of several learning mechanisms in the human brain, of which only one relies on applying known rules about the causal structure of the task. PMID:26971947

  6. Reward Associations Reduce Behavioral Interference by Changing the Temporal Dynamics of Conflict Processing

    PubMed Central

    Krebs, Ruth M.; Boehler, Carsten N.; Appelbaum, Lawrence G.; Woldorff, Marty G.

    2013-01-01

    Associating stimuli with the prospect of reward typically facilitates responses to those stimuli due to an enhancement of attentional and cognitive-control processes. Such reward-induced facilitation might be especially helpful when cognitive-control mechanisms are challenged, as when one must overcome interference from irrelevant inputs. Here, we investigated the neural dynamics of reward effects in a color-naming Stroop task by employing event-related potentials (ERPs). We found that behavioral facilitation in potential-reward trials, as compared to no-reward trials, was paralleled by early ERP modulations likely indexing increased attention to the reward-predictive stimulus. Moreover, reward changed the temporal dynamics of conflict-related ERP components, which may be a consequence of an early access to the various stimulus features and their relationships. Finally, although word meanings referring to potential-reward colors were always task-irrelevant, they caused greater interference compared to words referring to no-reward colors, an effect that was accompanied by a relatively early fronto-central ERP modulation. This latter observation suggests that task-irrelevant reward information can undermine goal-directed behavior at an early processing stage, presumably reflecting priming of a goal-incompatible response. Yet, these detrimental effects of incongruent reward-related words were absent in potential-reward trials, apparently due to the prioritized processing of task-relevant reward information. Taken together, the present data demonstrate that reward associations can influence conflict processing by changing the temporal dynamics of stimulus processing and subsequent cognitive-control mechanisms. PMID:23326530

  7. Reward functions of the basal ganglia.

    PubMed

    Schultz, Wolfram

    2016-07-01

    Besides their fundamental movement function evidenced by Parkinsonian deficits, the basal ganglia are involved in processing closely linked non-motor, cognitive and reward information. This review describes the reward functions of three brain structures that are major components of the basal ganglia or are closely associated with the basal ganglia, namely midbrain dopamine neurons, pedunculopontine nucleus, and striatum (caudate nucleus, putamen, nucleus accumbens). Rewards are involved in learning (positive reinforcement), approach behavior, economic choices and positive emotions. The response of dopamine neurons to rewards consists of an early detection component and a subsequent reward component that reflects a prediction error in economic utility, but is unrelated to movement. Dopamine activations to non-rewarded or aversive stimuli reflect physical impact, but not punishment. Neurons in pedunculopontine nucleus project their axons to dopamine neurons and process sensory stimuli, movements and rewards and reward-predicting stimuli without coding outright reward prediction errors. Neurons in striatum, besides their pronounced movement relationships, process rewards irrespective of sensory and motor aspects, integrate reward information into movement activity, code the reward value of individual actions, change their reward-related activity during learning, and code own reward in social situations depending on whose action produces the reward. These data demonstrate a variety of well-characterized reward processes in specific basal ganglia nuclei consistent with an important function in non-motor aspects of motivated behavior. PMID:26838982

  8. Complex effects of reward upshift on consummatory behavior.

    PubMed

    Annicchiarico, Ivan; Glueck, Amanda C; Cuenya, Lucas; Kawasaki, Katsuyoshi; Conrad, Shannon E; Papini, Mauricio R

    2016-08-01

    Exposing rats to an upshift from a small reward to a larger reward sometimes yields evidence of consummatory successive positive contrast (cSPC), an effect that could be a suitable animal model of positive emotion. However, cSPC is an unreliable effect. Ten experiments explored the effects of an upshift in sucrose or saccharin concentration on consummatory behavior under several conditions. There was occasional evidence of cSPC, but mostly a combination of increased consummatory behavior relative to preshift reward concentrations and a reduced behavioral level relative to unshifted controls. Such a pattern is consistent with processes causing opposite changes on behavior. Reward upshift may induce processes that suppress behavior, such as taste neophobia (induced by an intense sucrose taste) and generalization decrement (induced by novelty in reward conditions after the upshift). An experiment tested the role of such novelty-related effects by preexposing animals to either the upshift concentration (12% sucrose) or water during three days before the start of the experiment. Sucrose-preexposed animals drank significantly more than water-preexposed animals during the upshift, but just as much as unshifted controls (i.e., no evidence of cSPC). These results suggest that cSPC may be difficult to obtain reliably because reward upshift induces opposing processes. However, they also seriously question the ontological status of cSPC. PMID:27298234

  9. Replicator dynamics in public goods games with reward funds.

    PubMed

    Sasaki, Tatsuya; Unemi, Tatsuo

    2011-10-21

    Which punishment or rewards are most effective at maintaining cooperation in public goods interactions and deterring defectors who are willing to freeload on others' contribution? The sanction system is itself a public good and can cause problematic "second-order free riders" who do not contribute to the provisions of the sanctions and thus may subvert the cooperation supported by sanctioning. Recent studies have shown that public goods games with punishment can lead to a coercion-based regime if participation in the game is optional. Here, we reveal that even with compulsory participation, rewards can maintain cooperation within an infinitely large population. We consider three strategies for players in a standard public goods game: to be a cooperator or a defector in a standard public goods game, or to be a rewarder who contributes to the public good and to a fund that rewards players who contribute during the game. Cooperators do not contribute to the reward fund and are therefore classified as second-order free riders. The replicator dynamics for the three strategies exhibit a rock-scissors-paper cycle, and can be analyzed fully, despite the fact that the expected payoffs are nonlinear. The model does not require repeated interaction, spatial structure, group selection, or reputation. We also discuss a simple method for second-order sanctions, which can lead to a globally stable state where 100% of the population are rewarders.

  10. Premotor and Motor Cortices Encode Reward.

    PubMed

    Ramkumar, Pavan; Dekleva, Brian; Cooler, Sam; Miller, Lee; Kording, Konrad

    2016-01-01

    Rewards associated with actions are critical for motivation and learning about the consequences of one's actions on the world. The motor cortices are involved in planning and executing movements, but it is unclear whether they encode reward over and above limb kinematics and dynamics. Here, we report a categorical reward signal in dorsal premotor (PMd) and primary motor (M1) neurons that corresponds to an increase in firing rates when a trial was not rewarded regardless of whether or not a reward was expected. We show that this signal is unrelated to error magnitude, reward prediction error, or other task confounds such as reward consumption, return reach plan, or kinematic differences across rewarded and unrewarded trials. The availability of reward information in motor cortex is crucial for theories of reward-based learning and motivational influences on actions. PMID:27564707

  11. Premotor and Motor Cortices Encode Reward

    PubMed Central

    Ramkumar, Pavan; Dekleva, Brian; Cooler, Sam; Miller, Lee; Kording, Konrad

    2016-01-01

    Rewards associated with actions are critical for motivation and learning about the consequences of one’s actions on the world. The motor cortices are involved in planning and executing movements, but it is unclear whether they encode reward over and above limb kinematics and dynamics. Here, we report a categorical reward signal in dorsal premotor (PMd) and primary motor (M1) neurons that corresponds to an increase in firing rates when a trial was not rewarded regardless of whether or not a reward was expected. We show that this signal is unrelated to error magnitude, reward prediction error, or other task confounds such as reward consumption, return reach plan, or kinematic differences across rewarded and unrewarded trials. The availability of reward information in motor cortex is crucial for theories of reward-based learning and motivational influences on actions. PMID:27564707

  12. The effects of reward quality on risk-sensitivity in Rattus norvegicus.

    PubMed

    Craft, Baine B; Church, Anna C; Rohrbach, Caitlyn M; Bennett, Jessica M

    2011-09-01

    Risk-sensitive foraging theory (RSFT) was developed to explain a choice between a variable (risk-prone) or constant (risk-averse) option. In the RSFT literature, qualitative shifts in risk-sensitivity have been explained by fluctuations in daily caloric energy budget (DEB). The DEB rule describes foragers' choices as being based on fitness and rate of gain. If the DEB rule is correct, rewards that differ in caloric returns should cause differences in foragers' sensitivity to risk. However, few studies have explored the influence of reward quality on risk-sensitivity in mammals. The present study was designed to examine the effects of reward quality on risk-sensitivity when reward magnitude, delay to reward, body mass, and response effort were controlled. Results from the current study demonstrated that subjects rewarded with a high calorie reward (i.e., sugar) made significantly fewer choices for a variable option than subjects rewarded with a lower calorie reward (i.e., grain). These results are consistent with the predictions of the DEB rule, and add to the RSFT literature where reward quality was manipulated by describing difference in risk-sensitivity in mammals. Suggestions for future research include an examination of risk-sensitivity where flavor and caloric return are manipulated.

  13. The evolution of anti-social rewarding and its countermeasures in public goods games.

    PubMed

    dos Santos, Miguel

    2015-01-01

    Cooperation in joint enterprises can easily break down when self-interests are in conflict with collective benefits, causing a tragedy of the commons. In such social dilemmas, the possibility for contributors to invest in a common pool-rewards fund, which will be shared exclusively among contributors, can be powerful for averting the tragedy, as long as the second-order dilemma (i.e. withdrawing contribution to reward funds) can be overcome (e.g. with second-order sanctions). However, the present paper reveals the vulnerability of such pool-rewarding mechanisms to the presence of reward funds raised by defectors and shared among them (i.e. anti-social rewarding), as it causes a cooperation breakdown, even when second-order sanctions are possible. I demonstrate that escaping this social trap requires the additional condition that coalitions of defectors fare poorly compared with pro-socials, with either (i) better rewarding abilities for the latter or (ii) reward funds that are contingent upon the public good produced beforehand, allowing groups of contributors to invest more in reward funds than groups of defectors. These results suggest that the establishment of cooperation through a collective positive incentive mechanism is highly vulnerable to anti-social rewarding and requires additional countermeasures to act in combination with second-order sanctions.

  14. The evolution of anti-social rewarding and its countermeasures in public goods games

    PubMed Central

    dos Santos, Miguel

    2015-01-01

    Cooperation in joint enterprises can easily break down when self-interests are in conflict with collective benefits, causing a tragedy of the commons. In such social dilemmas, the possibility for contributors to invest in a common pool-rewards fund, which will be shared exclusively among contributors, can be powerful for averting the tragedy, as long as the second-order dilemma (i.e. withdrawing contribution to reward funds) can be overcome (e.g. with second-order sanctions). However, the present paper reveals the vulnerability of such pool-rewarding mechanisms to the presence of reward funds raised by defectors and shared among them (i.e. anti-social rewarding), as it causes a cooperation breakdown, even when second-order sanctions are possible. I demonstrate that escaping this social trap requires the additional condition that coalitions of defectors fare poorly compared with pro-socials, with either (i) better rewarding abilities for the latter or (ii) reward funds that are contingent upon the public good produced beforehand, allowing groups of contributors to invest more in reward funds than groups of defectors. These results suggest that the establishment of cooperation through a collective positive incentive mechanism is highly vulnerable to anti-social rewarding and requires additional countermeasures to act in combination with second-order sanctions. PMID:25429015

  15. The evolution of anti-social rewarding and its countermeasures in public goods games.

    PubMed

    dos Santos, Miguel

    2015-01-01

    Cooperation in joint enterprises can easily break down when self-interests are in conflict with collective benefits, causing a tragedy of the commons. In such social dilemmas, the possibility for contributors to invest in a common pool-rewards fund, which will be shared exclusively among contributors, can be powerful for averting the tragedy, as long as the second-order dilemma (i.e. withdrawing contribution to reward funds) can be overcome (e.g. with second-order sanctions). However, the present paper reveals the vulnerability of such pool-rewarding mechanisms to the presence of reward funds raised by defectors and shared among them (i.e. anti-social rewarding), as it causes a cooperation breakdown, even when second-order sanctions are possible. I demonstrate that escaping this social trap requires the additional condition that coalitions of defectors fare poorly compared with pro-socials, with either (i) better rewarding abilities for the latter or (ii) reward funds that are contingent upon the public good produced beforehand, allowing groups of contributors to invest more in reward funds than groups of defectors. These results suggest that the establishment of cooperation through a collective positive incentive mechanism is highly vulnerable to anti-social rewarding and requires additional countermeasures to act in combination with second-order sanctions. PMID:25429015

  16. Evolutionary advantages of adaptive rewarding

    NASA Astrophysics Data System (ADS)

    Szolnoki, Attila; Perc, Matjaž

    2012-09-01

    Our well-being depends on both our personal success and the success of our society. The realization of this fact makes cooperation an essential trait. Experiments have shown that rewards can elevate our readiness to cooperate, but since giving a reward inevitably entails paying a cost for it, the emergence and stability of such behavior remains elusive. Here we show that allowing for the act of rewarding to self-organize in dependence on the success of cooperation creates several evolutionary advantages that instill new ways through which collaborative efforts are promoted. Ranging from indirect territorial battle to the spontaneous emergence and destruction of coexistence, phase diagrams and the underlying spatial patterns reveal fascinatingly rich social dynamics that explain why this costly behavior has evolved and persevered. Comparisons with adaptive punishment, however, uncover an Achilles heel of adaptive rewarding, coming from over-aggression, which in turn hinders optimal utilization of network reciprocity. This may explain why, despite its success, rewarding is not as firmly embedded into our societal organization as punishment.

  17. Reward and learning in the goldfish.

    PubMed

    Lowes, G; Bitterman, M E

    1967-07-28

    An experiment with goldfish showed the effects of change in amount of reward that are predicted from reinforcement theory. The performance of animals shifted from small to large reward improved gradually to the level of unshifted large-reward controls, while the performance of animals shifted from large to small reward remained at the large-reward level. The difference between these results and those obtained in analogous experiments with the rat suggests that reward functions differently in the instrumental learning of the two animals.

  18. [Treatment of Cancer Pain and Medical Narcotics].

    PubMed

    Suzuki, Tsutomu

    2015-01-01

    The World Health Organization has reported that when morphine is used to control pain in cancer patients, psychological dependence is not a major concern. Our studies were undertaken to ascertain the modulation of psychological dependence on morphine under a chronic pain-like state in rats. Morphine induced a dose-dependent place preference. We found that inflammatory and neuropathic pain-like states significantly suppressed the morphine-induced rewarding effect. In an inflammatory pain-like state, the suppressive effect was significantly recovered by treatment with a κ-opioid receptor antagonist. In addition, in vivo microdialysis studies clearly showed that the morphine-induced increase in the extracellular levels of dopamine (DA) in the nucleus accumbens (N.Acc.) was significantly decreased in rats pretreated with formalin. This effect was in turn reversed by the microinjection of a specific dynorphin A antibody into the N.Acc. These findings suggest that the inflammatory pain-like state may have caused the sustained activation of the κ-opioidergic system within the N.Acc., resulting in suppression of the morphine-induced rewarding effect in rats. On the other hand, we found that attenuation of the morphine-induced place preference under neuropathic pain may result from a decrease in the morphine-induced DA release in the N.Acc with a reduction in the μ-opioid receptor-mediated G-protein activation in the ventral tegmental area (VTA). Moreover, nerve injury results in the continuous release of endogenous β-endorphin to cause the dysfunction of μ-opioid receptors in the VTA. This paper also provides a review to clarify misunderstandings of opioid analgesic use to control pain in cancer patients.

  19. [Treatment of Cancer Pain and Medical Narcotics].

    PubMed

    Suzuki, Tsutomu

    2015-01-01

    The World Health Organization has reported that when morphine is used to control pain in cancer patients, psychological dependence is not a major concern. Our studies were undertaken to ascertain the modulation of psychological dependence on morphine under a chronic pain-like state in rats. Morphine induced a dose-dependent place preference. We found that inflammatory and neuropathic pain-like states significantly suppressed the morphine-induced rewarding effect. In an inflammatory pain-like state, the suppressive effect was significantly recovered by treatment with a κ-opioid receptor antagonist. In addition, in vivo microdialysis studies clearly showed that the morphine-induced increase in the extracellular levels of dopamine (DA) in the nucleus accumbens (N.Acc.) was significantly decreased in rats pretreated with formalin. This effect was in turn reversed by the microinjection of a specific dynorphin A antibody into the N.Acc. These findings suggest that the inflammatory pain-like state may have caused the sustained activation of the κ-opioidergic system within the N.Acc., resulting in suppression of the morphine-induced rewarding effect in rats. On the other hand, we found that attenuation of the morphine-induced place preference under neuropathic pain may result from a decrease in the morphine-induced DA release in the N.Acc with a reduction in the μ-opioid receptor-mediated G-protein activation in the ventral tegmental area (VTA). Moreover, nerve injury results in the continuous release of endogenous β-endorphin to cause the dysfunction of μ-opioid receptors in the VTA. This paper also provides a review to clarify misunderstandings of opioid analgesic use to control pain in cancer patients. PMID:26632147

  20. Caudate clues to rewarding cues.

    PubMed

    Platt, Michael L

    2002-01-31

    Behavioral studies indicate that prior experience can influence discrimination of subsequent stimuli. The mechanisms responsible for highlighting a particular aspect of the stimulus, such as motion or color, as most relevant and thus deserving further scrutiny, however, remain poorly understood. In the current issue of Neuron, demonstrate that neurons in the caudate nucleus of the basal ganglia signal which dimension of a visual cue, either color or location, is associated with reward in an eye movement task. These findings raise the possibility that this structure participates in the reward-based control of visual attention.

  1. Predictive reward signal of dopamine neurons.

    PubMed

    Schultz, W

    1998-07-01

    The effects of lesions, receptor blocking, electrical self-stimulation, and drugs of abuse suggest that midbrain dopamine systems are involved in processing reward information and learning approach behavior. Most dopamine neurons show phasic activations after primary liquid and food rewards and conditioned, reward-predicting visual and auditory stimuli. They show biphasic, activation-depression responses after stimuli that resemble reward-predicting stimuli or are novel or particularly salient. However, only few phasic activations follow aversive stimuli. Thus dopamine neurons label environmental stimuli with appetitive value, predict and detect rewards and signal alerting and motivating events. By failing to discriminate between different rewards, dopamine neurons appear to emit an alerting message about the surprising presence or absence of rewards. All responses to rewards and reward-predicting stimuli depend on event predictability. Dopamine neurons are activated by rewarding events that are better than predicted, remain uninfluenced by events that are as good as predicted, and are depressed by events that are worse than predicted. By signaling rewards according to a prediction error, dopamine responses have the formal characteristics of a teaching signal postulated by reinforcement learning theories. Dopamine responses transfer during learning from primary rewards to reward-predicting stimuli. This may contribute to neuronal mechanisms underlying the retrograde action of rewards, one of the main puzzles in reinforcement learning. The impulse response releases a short pulse of dopamine onto many dendrites, thus broadcasting a rather global reinforcement signal to postsynaptic neurons. This signal may improve approach behavior by providing advance reward information before the behavior occurs, and may contribute to learning by modifying synaptic transmission. The dopamine reward signal is supplemented by activity in neurons in striatum, frontal cortex, and

  2. Introduction: Addiction and Brain Reward and Anti-Reward Pathways

    PubMed Central

    Gardner, Eliot L.

    2013-01-01

    Addictive drugs have in common that they are voluntarily self-administered by laboratory animals (usually avidly) and that they enhance the functioning of the reward circuitry of the brain (producing the “high” that the drug-user seeks). The core reward circuitry consists of an “in series” circuit linking the ventral tegmental area, nucleus accumbens, and ventral pallidum - via the medial forebrain bundle. Although originally believed to encode simply the set-point of hedonic tone, these circuits are now believed to be functionally far more complex - also encoding attention, expectancy of reward, disconfirmation of reward expectancy, and incentive motivation. “Hedonic dysregulation” within these circuits may lead to addiction. The “second-stage” dopaminergic component in this reward circuitry is the crucial addictive-drug-sensitive component. All addictive drugs have in common that they enhance (directly or indirectly or even transsynaptically) dopaminergic reward synaptic function in the nucleus accumbens. Drug self-administration is regulated by nucleus accumbens dopamine levels, and is done to keep nucleus accumbens dopamine within a specific elevated range (to maintain a desired hedonic level). For some classes of addictive drugs (e.g., opiates), tolerance to the euphoric effects develops with chronic use. Post-use dysphoria then comes to dominate reward circuit hedonic tone, and addicts no longer use drugs to get “high,” but simply to get back to normal (“get straight”). The brain circuits mediating the pleasurable effects of addictive drugs are anatomically, neurophysiologically, and neurochemically different from those mediating physical dependence, and from those mediating craving and relapse. There are important genetic variations in vulnerability to drug addiction, yet environmental factors such as stress and social defeat also alter brain-reward mechanisms in such a manner as to impart vulnerability to addiction. In short, the

  3. Enriched encoding: reward motivation organizes cortical networks for hippocampal detection of unexpected events.

    PubMed

    Murty, Vishnu P; Adcock, R Alison

    2014-08-01

    Learning how to obtain rewards requires learning about their contexts and likely causes. How do long-term memory mechanisms balance the need to represent potential determinants of reward outcomes with the computational burden of an over-inclusive memory? One solution would be to enhance memory for salient events that occur during reward anticipation, because all such events are potential determinants of reward. We tested whether reward motivation enhances encoding of salient events like expectancy violations. During functional magnetic resonance imaging, participants performed a reaction-time task in which goal-irrelevant expectancy violations were encountered during states of high- or low-reward motivation. Motivation amplified hippocampal activation to and declarative memory for expectancy violations. Connectivity of the ventral tegmental area (VTA) with medial prefrontal, ventrolateral prefrontal, and visual cortices preceded and predicted this increase in hippocampal sensitivity. These findings elucidate a novel mechanism whereby reward motivation can enhance hippocampus-dependent memory: anticipatory VTA-cortical-hippocampal interactions. Further, the findings integrate literatures on dopaminergic neuromodulation of prefrontal function and hippocampus-dependent memory. We conclude that during reward motivation, VTA modulation induces distributed neural changes that amplify hippocampal signals and records of expectancy violations to improve predictions-a potentially unique contribution of the hippocampus to reward learning.

  4. Interaction of satiety and reward response to food stimulation.

    PubMed

    James, G Andrew; Gold, Mark S; Liu, Yijun

    2004-01-01

    Obesity is among the most pressing health issues affecting developed countries. The etiology of obesity remains unclear despite its associated health risks. We propose a framework for obesity modeled upon overeating as a substance dependence disorder arising from a combination of abnormal cognitive and neuroendocrine processes. While significant work in both of these fields has investigated the body's regulation of satiety signals, fewer studies have focused upon the mechanisms by which these two seemingly disparate systems interact. Although emotional states have been shown to mediate reward processing, the implications for hunger mediating reward have not previously been addressed. We review the interaction between central satiety signals and reward responses to food stimuli and discuss the implications of this research for understanding the causes of obesity.

  5. What Rewards Do Students Want?

    ERIC Educational Resources Information Center

    Ware, Barbara Ann

    1978-01-01

    In general, students ranked personal kinds of recognition high and teachers ranked tangible sources of recognition high in surveys of the kinds of rewards that motivate students. The students' top two kinds of recognition were ranked as the bottom two by teachers. (Author/IRT)

  6. Virtual Rewards for Driving Green

    ERIC Educational Resources Information Center

    Pritchard, Josh

    2010-01-01

    Carbon dioxide from automobiles is a major contributor to global climate change. In "Virtual Rewards for Driving Green," Josh Pritchard proposes a computer application that will enable fuel-efficient drivers to earn "green" dollars with which to buy digital merchandise on the Web. Can getting items that exist only in cyberspace actually change a…

  7. The Hidden Costs of Rewards.

    ERIC Educational Resources Information Center

    Deci, Edward L.

    1976-01-01

    This paper discusses ways managers can motivate their employees to work and at the same time to increase their performance. Two theories of motivation--Vroom's theory and Atkinson's theory--focus on the use of extrinsic and intrinsic rewards respectively. A managerial strategy that combines the best of both intrinsic and extrinsic approaches to…

  8. Addiction: Beyond dopamine reward circuitry

    SciTech Connect

    Volkow, N.D.; Wang, G.; Volkow, N.D.; Wang, G.-J.; Fowler, J.S.; Tomasi, D.; Telang, F.

    2011-09-13

    Dopamine (DA) is considered crucial for the rewarding effects of drugs of abuse, but its role in addiction is much less clear. This review focuses on studies that used PET to characterize the brain DA system in addicted subjects. These studies have corroborated in humans the relevance of drug-induced fast DA increases in striatum [including nucleus accumbens (NAc)] in their rewarding effects but have unexpectedly shown that in addicted subjects, drug-induced DA increases (as well as their subjective reinforcing effects) are markedly blunted compared with controls. In contrast, addicted subjects show significant DA increases in striatum in response to drug-conditioned cues that are associated with self-reports of drug craving and appear to be of a greater magnitude than the DA responses to the drug. We postulate that the discrepancy between the expectation for the drug effects (conditioned responses) and the blunted pharmacological effects maintains drug taking in an attempt to achieve the expected reward. Also, whether tested during early or protracted withdrawal, addicted subjects show lower levels of D2 receptors in striatum (including NAc), which are associated with decreases in baseline activity in frontal brain regions implicated in salience attribution (orbitofrontal cortex) and inhibitory control (anterior cingulate gyrus), whose disruption results in compulsivity and impulsivity. These results point to an imbalance between dopaminergic circuits that underlie reward and conditioning and those that underlie executive function (emotional control and decision making), which we postulate contributes to the compulsive drug use and loss of control in addiction.

  9. Academic Rewards in Higher Education.

    ERIC Educational Resources Information Center

    Lewis, Darrel R., Ed.; Becker, William E., Jr., Ed.

    A colloquium series in higher education at the University of Minnesota in the fall and winter of 1977-1978 examined the influence of academic reward systems on faculty behavior and academic productivity. These essays are the collective results of their findings and recommendations. Essays include: "Perspectives from Psychology: Financial…

  10. Effects of Varying Contingency and Directness of Rewards upon Children's Performance under Implicit Reward Conditions.

    ERIC Educational Resources Information Center

    Sharpley, Christopher F.

    1988-01-01

    Investigated the application of verbal praise as a reward with 84 third and fourth grade children who completed a digit-symbol coding task under contingent versus noncontingent and direct versus implicit reward conditions. Noncontingent rewards possessed no significant reinforcer effect under either reward condition. (SKC)

  11. Defining rewardable innovation in drug therapy.

    PubMed

    Aronson, Jeffrey K; Ferner, Robin E; Hughes, Dyfrig A

    2012-03-30

    Implementing mechanisms for rewarding those who introduce innovative medicinal products requires a definition of 'rewardable innovation'. Here, we propose a definition of innovation with respect to medicinal products, accompanied by a ranking of the importance of different types of innovativeness, with the aim of providing a basis for rewarding such innovation.

  12. Management compensation. A reward systems approach.

    PubMed

    Flarey, D L

    1991-01-01

    Across the nation, businesses are rethinking the way performance is rewarded. We are witnessing the emergence of newer, more innovative compensation systems. Today's nurse executive is challenged to design systems for management compensation that reward achievement, performance, and contribution. The author describes a reward systems approach to compensation based on contemporary concepts related to pay. PMID:1870005

  13. Management compensation. A reward systems approach.

    PubMed

    Flarey, D L

    1991-01-01

    Across the nation, businesses are rethinking the way performance is rewarded. We are witnessing the emergence of newer, more innovative compensation systems. Today's nurse executive is challenged to design systems for management compensation that reward achievement, performance, and contribution. The author describes a reward systems approach to compensation based on contemporary concepts related to pay.

  14. Critical role for the mediodorsal thalamus in permitting rapid reward-guided updating in stochastic reward environments

    PubMed Central

    Chakraborty, Subhojit; Kolling, Nils; Walton, Mark E; Mitchell, Anna S

    2016-01-01

    Adaptive decision-making uses information gained when exploring alternative options to decide whether to update the current choice strategy. Magnocellular mediodorsal thalamus (MDmc) supports adaptive decision-making, but its causal contribution is not well understood. Monkeys with excitotoxic MDmc damage were tested on probabilistic three-choice decision-making tasks. They could learn and track the changing values in object-reward associations, but they were severely impaired at updating choices after reversals in reward contingencies or when there were multiple options associated with reward. These deficits were not caused by perseveration or insensitivity to negative feedback though. Instead, monkeys with MDmc lesions exhibited an inability to use reward to promote choice repetition after switching to an alternative option due to a diminished influence of recent past choices and the last outcome to guide future behavior. Together, these data suggest MDmc allows for the rapid discovery and persistence with rewarding options, particularly in uncertain or changing environments. DOI: http://dx.doi.org/10.7554/eLife.13588.001 PMID:27136677

  15. Reward-associated stimuli capture the eyes in spite of strategic attentional set.

    PubMed

    Hickey, Clayton; van Zoest, Wieske

    2013-11-01

    Theories of reinforcement learning have proposed that the association of reward to visual stimuli may cause these objects to become fundamentally salient and thus attention-drawing. A number of recent studies have investigated the oculomotor correlates of this reward-priming effect, but there is some ambiguity in this literature regarding the involvement of top-down attentional set. Existing paradigms tend to create a situation where participants are actively looking for a reward-associated stimulus before subsequently showing that this selective bias sustains when it no longer has strategic purpose. This perseveration of attentional set is potentially different in nature than the direct impact of reward proposed by theory. Here we investigate the effect of reward on saccadic selection in a paradigm where strategic attentional set is decoupled from the effect of reward. We find that during search for a uniquely oriented target, the receipt of reward following selection of a target characterized by an irrelevant unique color causes subsequent stimuli characterized by this color to be preferentially selected. Importantly, this occurs regardless of whether the color characterizes the target or distractor. Other analyses demonstrate that only features associated with correct selection of the target prime the target representation, and that the magnitude of this effect can be predicted by variability in saccadic indices of feedback processing. These results add to a growing literature demonstrating that reward guides visual selection, often in spite of our strategic efforts otherwise.

  16. Reward and punishment processing in depression.

    PubMed

    Eshel, Neir; Roiser, Jonathan P

    2010-07-15

    Depression is a complex and heterogeneous disorder whose cause is poorly understood. Theories on the mechanisms of the disease have often focused on either its neurobiology or its cognitive and behavioral manifestations. Recently, studies exploring how depressed patients process reward and punishment have linked these two facets together. It has been suggested that individuals with a dysfunction in a specialized network of brain regions are unable to exploit affective information to guide behavior. Deficits in this ability might predispose such individuals to develop depression, whereas subsequent restoration of this ability--whether through pharmacological or behavioral treatments--might enable recovery from the disorder. Here we review behavioral, neuroimaging, and computational findings relevant to this hypothesis. There is good evidence that depressed patients exhibit abnormal behavioral responses to rewards and punishments and that these tendencies correspond to aberrant function in frontostriatal systems modulated by the monoamine systems. Furthermore, computational studies have generated testable predictions for how these neural signaling and neurochemical abnormalities might contribute to the symptoms of depression. Combining these approaches--as well as molecular and behavioral work in animals--provides great promise for furthering our understanding of this common and debilitating disease.

  17. Detrimental effects of reward. Reality or myth?

    PubMed

    Eisenberger, R; Cameron, J

    1996-11-01

    Based on seemingly overwhelming empirical evidence of the decremental effects of reward on intrinsic task interest and creativity, the use of reward to alter human behavior has been challenged in literature reviews, textbooks, and the popular media. An analysis of a quarter century of research on intrinsic task interest and creativity revealed, however, that (a) detrimental effects of reward occur under highly restricted, easily avoidable conditions; (b) mechanisms of instrumental and classical conditioning are basic for understanding incremental and decremental effects of reward on task motivation; and (c) positive effects of reward on generalized creativity are easily attainable using procedures derived from behavior theory.

  18. Basal ganglia orient eyes to reward.

    PubMed

    Hikosaka, Okihide; Nakamura, Kae; Nakahara, Hiroyuki

    2006-02-01

    Expectation of reward motivates our behaviors and influences our decisions. Indeed, neuronal activity in many brain areas is modulated by expected reward. However, it is still unclear where and how the reward-dependent modulation of neuronal activity occurs and how the reward-modulated signal is transformed into motor outputs. Recent studies suggest an important role of the basal ganglia. Sensorimotor/cognitive activities of neurons in the basal ganglia are strongly modulated by expected reward. Through their abundant outputs to the brain stem motor areas and the thalamocortical circuits, the basal ganglia appear capable of producing body movements based on expected reward. A good behavioral measure to test this hypothesis is saccadic eye movement because its brain stem mechanism has been extensively studied. Studies from our laboratory suggest that the basal ganglia play a key role in guiding the gaze to the location where reward is available. Neurons in the caudate nucleus and the substantia nigra pars reticulata are extremely sensitive to the positional difference in expected reward, which leads to a bias in excitability between the superior colliculi such that the saccade to the to-be-rewarded position occurs more quickly. It is suggested that the reward modulation occurs in the caudate where cortical inputs carrying spatial signals and dopaminergic inputs carrying reward-related signals are integrated. These data support a specific form of reinforcement learning theories, but also suggest further refinement of the theory.

  19. Incremental effects of reward on creativity.

    PubMed

    Eisenberger, R; Rhoades, L

    2001-10-01

    The authors examined 2 ways reward might increase creativity. First, reward contingent on creativity might increase extrinsic motivation. Studies 1 and 2 found that repeatedly giving preadolescent students reward for creative performance in 1 task increased their creativity in subsequent tasks. Study 3 reported that reward promised for creativity increased college students' creative task performance. Second, expected reward for high performance might increase creativity by enhancing perceived self-determination and, therefore, intrinsic task interest. Study 4 found that employees' intrinsic job interest mediated a positive relationship between expected reward for high performance and creative suggestions offered at work. Study 5 found that employees' perceived self-determination mediated a positive relationship between expected reward for high performance and the creativity of anonymous suggestions for helping the organization. PMID:11642357

  20. Adolescent Development of the Reward System

    PubMed Central

    Galvan, Adriana

    2009-01-01

    Adolescence is a developmental period characterized by increased reward-seeking behavior. Investigators have used functional magnetic resonance imaging (fMRI) in conjunction with reward paradigms to test two opposing hypotheses about adolescent developmental changes in the striatum, a region implicated in reward processing. One hypothesis posits that the striatum is relatively hypo-responsive to rewards during adolescence, such that heightened reward-seeking behavior is necessary to achieve the same activation as adults. Another view suggests that during adolescence the striatal reward system is hyper-responsive, which subsequently results in greater reward-seeking. While evidence for both hypotheses has been reported, the field has generally converged on this latter hypothesis based on compelling evidence. In this review, I describe the evidence to support this notion, speculate on the disparate fMRI findings and conclude with future areas of inquiry to this fascinating question. PMID:20179786

  1. Brain Circuits Encoding Reward from Pain Relief

    PubMed Central

    Navratilova, Edita; Atcherley, Christopher; Porreca, Frank

    2015-01-01

    Relief from pain in humans is rewarding and pleasurable. Primary rewards, or reward predictive cues, are encoded in brain reward/motivational circuits. While considerable advances have been made in our understanding of reward circuits underlying positive reinforcement, less is known about the circuits underlying the hedonic and reinforcing actions of pain relief. We review findings from electrophysiological, neuroimaging and behavioral studies supporting the concept that the rewarding effect of pain relief requires opioid signaling in the anterior cingulate cortex, activation of midbrain dopamine neurons and release of dopamine in the nucleus accumbens. Understanding of circuits that govern the reward of pain relief may allow the discovery of more effective and satisfying therapies for patients with acute and chronic pain. PMID:26603560

  2. Effort increases sensitivity to reward and loss magnitude in the human brain

    PubMed Central

    Hernandez Lallement, Julen; Kuss, Katarina; Trautner, Peter; Weber, Bernd; Falk, Armin; Fliessbach, Klaus

    2014-01-01

    It is ecologically adaptive that the amount of effort invested to achieve a reward increases the relevance of the resulting outcome. Here, we investigated the effect of effort on activity in reward and loss processing brain areas by using functional magnetic resonance imaging. In total, 28 subjects were endowed with monetary rewards of randomly varying magnitude after performing arithmetic calculations that were either difficult (high effort), easy (low effort) or already solved (no effort). Subsequently, a forced donation took place, where a varying part of the endowment was transferred to a charity organization, causing a loss for the subject. Results show that reward magnitude positively modulates activity in reward-processing brain areas (subgenual anterior cingulate cortex and nucleus accumbens) only in the high effort condition. Furthermore, anterior insular activity was positively modulated by loss magnitude only after high effort. The results strongly suggest an increasing relevance of outcomes with increasing previous effort. PMID:23202663

  3. When unconscious rewards boost cognitive task performance inefficiently: the role of consciousness in integrating value and attainability information.

    PubMed

    Zedelius, Claire M; Veling, Harm; Aarts, Henk

    2012-01-01

    Research has shown that high vs. low value rewards improve cognitive task performance independent of whether they are perceived consciously or unconsciously. However, efficient performance in response to high value rewards also depends on whether or not rewards are attainable. This raises the question of whether unconscious reward processing enables people to take into account such attainability information. Building on a theoretical framework according to which conscious reward processing is required to enable higher level cognitive processing, the present research tested the hypothesis that conscious but not unconscious reward processing enables integration of reward value with attainability information. In two behavioral experiments, participants were exposed to mask high and low value coins serving as rewards on a working memory (WM) task. The likelihood for conscious processing was manipulated by presenting the coins relatively briefly (17 ms) or long and clearly visible (300 ms). Crucially, rewards were expected to be attainable or unattainable. Requirements to integrate reward value with attainability information varied across experiments. Results showed that when integration of value and attainability was required (Experiment 1), long reward presentation led to efficient performance, i.e., selectively improved performance for high value attainable rewards. In contrast, in the short presentation condition, performance was increased for high value rewards even when these were unattainable. This difference between the effects of long and short presentation time disappeared when integration of value and attainability information was not required (Experiment 2). Together these findings suggest that unconsciously processed reward information is not integrated with attainability expectancies, causing inefficient effort investment. These findings are discussed in terms of a unique role of consciousness in efficient allocation of effort to cognitive control

  4. Reward guides attention to object categories in real-world scenes.

    PubMed

    Hickey, Clayton; Kaiser, Daniel; Peelen, Marius V

    2015-04-01

    Reward is thought to motivate animal-approach behavior in part by automatically facilitating the perceptual processing of reward-associated visual stimuli. Studies have demonstrated this effect for low-level visual features such as color and orientation. However, outside of the laboratory, it is rare that low-level features uniquely characterize objects relevant for behavior. Here, we test whether reward can prime representations at the level of object category. Participants detected category exemplars (cars, trees, people) in briefly presented photographs of real-world scenes. On a subset of trials, successful target detection was rewarded and the effect of this reward was measured on the subsequent trial. Results show that rewarded selection of a category exemplar caused other members of this category to become visually salient, disrupting search when subsequently presented as distractors. It is important to note that this occurred even when there was little opportunity for the repetition of visual features between examples, with the rewarded selection of a human body increasing the salience of a subsequently presented face. Thus, selection of a category example appears to activate representations of prototypical category characteristics even when these are not present in the stimulus. In this way, reward can guide attention to categories of stimuli even when individual examples share no visual characteristics.

  5. Reward system dysfunction in autism spectrum disorders

    PubMed Central

    Schulte-Rüther, Martin; Nehrkorn, Barbara; Müller, Kristin; Fink, Gereon R.; Kamp-Becker, Inge; Herpertz-Dahlmann, Beate; Schultz, Robert T.; Konrad, Kerstin

    2013-01-01

    Although it has been suggested that social deficits of autism spectrum disorders (ASDs) are related to reward circuitry dysfunction, very little is known about the neural reward mechanisms in ASD. In the current functional magnetic resonance imaging study, we investigated brain activations in response to both social and monetary reward in a group of children with ASD, relative to matched controls. Participants with ASD showed the expected hypoactivation in the mesocorticolimbic circuitry in response to both reward types. In particular, diminished activation in the nucleus accumbens was observed when money, but not when social reward, was at stake, whereas the amygdala and anterior cingulate cortex were hypoactivated within the ASD group in response to both rewards. These data indicate that the reward circuitry is compromised in ASD in social as well as in non-social, i.e. monetary conditions, which likely contributes to atypical motivated behaviour. Taken together, with incentives used in this study sample, there is evidence for a general reward dysfunction in ASD. However, more ecologically valid social reward paradigms are needed to fully understand, whether there is any domain specificity to the reward deficit that appears evident in ASD, which would be most consistent with the ASD social phenotype. PMID:22419119

  6. Evaluating the neurobiology of sexual reward.

    PubMed

    Paredes, Raúl G

    2009-01-01

    There is much evidence that naturally occurring behaviors (e.g., the ingestion of food and water) and social behaviors (e.g., play, maternal behavior) can induce a reward state. This review includes definitions to distinguish between "reward" and "reinforcement," and a description of methods to assess reward and demonstrate that social interactions can indeed produce a positive affective (PA) state. Operant responses, partner preference, and sexual incentive motivation are all effective methods for evaluating approach behaviors under different conditions. The method most frequently used to evaluate a positive affective or reward state is conditioned place preference (CPP), which entails modification of an animal's initial preference after alternating exposure to a control stimulus in one chamber and a rewarding condition in the other. At the end of the training the animal shows a clear preference for the compartment associated with the rewarding stimulus. CPP demonstrates that it is possible to use different treatments and naturally occurring behaviors (e.g., water or food consumption, exercise) to induce a reward state. Sexual interactions and other social behaviors also produce a clear change of preference, indicating the induction of a reward or PA state. The reward state in males and females is mediated by opioids, and the medial preoptic area of the anterior hypothalamus is a crucial site for sexual reward. PMID:19106449

  7. Reward circuitry function in autism spectrum disorders

    PubMed Central

    Felder, Jennifer N.; Green, Steven R.; Rittenberg, Alison M.; Sasson, Noah J.; Bodfish, James W.

    2012-01-01

    Social interaction deficits and restricted repetitive behaviors and interests that characterize autism spectrum disorders (ASDs) may both reflect aberrant functioning of brain reward circuits. However, no neuroimaging study to date has investigated the integrity of reward circuits using an incentive delay paradigm in individuals with ASDs. In the present study, we used functional magnetic resonance imaging to assess blood-oxygen level-dependent activation during reward anticipation and outcomes in 15 participants with an ASD and 16 matched control participants. Brain activation was assessed during anticipation of and in response to monetary incentives and object image incentives previously shown to be visually salient for individuals with ASDs (e.g. trains, electronics). Participants with ASDs showed decreased nucleus accumbens activation during monetary anticipation and outcomes, but not during object anticipation or outcomes. Group × reward-type-interaction tests revealed robust interaction effects in bilateral nucleus accumbens during reward anticipation and in ventromedial prefrontal cortex during reward outcomes, indicating differential responses contingent on reward type in these regions. Results suggest that ASDs are characterized by reward-circuitry hypoactivation in response to monetary incentives but not in response to autism-relevant object images. The clinical implications of the double dissociation of reward type and temporal phase in reward circuitry function in ASD are discussed. PMID:21148176

  8. Monetary reward speeds up voluntary saccades

    PubMed Central

    Chen, Lewis L.; Chen, Y. Mark; Zhou, Wu; Mustain, William D.

    2014-01-01

    Past studies have shown that reward contingency is critical for sensorimotor learning, and reward expectation speeds up saccades in animals. Whether monetary reward speeds up saccades in human remains unknown. Here we addressed this issue by employing a conditional saccade task, in which human subjects performed a series of non-reflexive, visually-guided horizontal saccades. The subjects were (or were not) financially compensated for making a saccade in response to a centrally-displayed visual congruent (or incongruent) stimulus. Reward modulation of saccadic velocities was quantified independently of the amplitude-velocity coupling. We found that reward expectation significantly sped up voluntary saccades up to 30°/s, and the reward modulation was consistent across tests. These findings suggest that monetary reward speeds up saccades in human in a fashion analogous to how juice reward sped up saccades in monkeys. We further noticed that the idiosyncratic nasal-temporal velocity asymmetry was highly consistent regardless of test order, and its magnitude was not correlated with the magnitude of reward modulation. This suggests that reward modulation and the intrinsic velocity asymmetry may be governed by separate mechanisms that regulate saccade generation. PMID:24994970

  9. Inflated Reward Value in Early Opiate Withdrawal

    PubMed Central

    Wassum, Kate M.; Greenfield, Venuz Y.; Linker, Kay E.; Maidment, Nigel T.; Ostlund, Sean B.

    2014-01-01

    Through incentive learning the emotional experience of a reward in a relevant need state (e.g., hunger for food) sets the incentive value that guides the performance actions that earn that reward when the need state is encountered again. Opiate withdrawal has been proposed as a need state in which, through experience, opiate value can be increased resulting in escalated opiate self-administration. Endogenous opioid transmission plays anatomically dissociable roles in the positive emotional experience of reward consumption and incentive learning. We, therefore, sought to determine if chronic opiate exposure and withdrawal produces a disruption in the fundamental incentive learning process such that reward seeking, even for non-opiate rewards, can become maladaptive, inconsistent with the emotional experience of reward consumption and irrespective of need. Rats trained to earn sucrose or water on a reward-seeking chain were treated with morphine (10-30 mg/k.g., s.c.) daily for 11 d prior to testing in withdrawal. Opiate withdrawn rats showed elevated reward-seeking actions, but only after they experienced the reward in withdrawal, an effect that was strongest in early (1-3 d), as opposed to late (14-16 d) withdrawal. This was sufficient to overcome a negative reward value change induced by sucrose experience in satiety and, in certain circumstances, was inconsistent with the emotional experience of reward consumption. Lastly, we found that early opiate withdrawal-induced inflation of reward value was blocked by inactivation of basolateral amygdala mu opioid receptors. These data suggest that in early opiate withdrawal the incentive learning process is disrupted resulting in maladaptive reward seeking. PMID:25081350

  10. Public goods games with reward in finite populations.

    PubMed

    Forsyth, Peter A I; Hauert, Christoph

    2011-07-01

    Public goods games paraphrase the problem of cooperation in game theoretical terms. Cooperators contribute to a public good and thereby increase the welfare of others at a cost to themselves. Defectors consume the public good but do not pay its cost and therefore outperform cooperators. Hence, according to genetic or cultural evolution, defectors should be favored and the public good disappear - despite the fact that groups of cooperators are better off than groups of defectors. The maximization of short term individual profits causes the demise of the common resource to the detriment of all. This outcome can be averted by introducing incentives to cooperate. Negative incentives based on the punishment of defectors efficiently stabilize cooperation once established but cannot initiate cooperation. Here we consider the complementary case of positive incentives created by allowing individuals to reward those that contribute to the public good. The finite-population stochastic dynamics of the public goods game with reward demonstrate that reward initiates cooperation by providing an escape hatch out of states of mutual defection. However, in contrast to punishment, reward is unable to stabilize cooperation but, instead, gives rise to a persistent minority of cooperators.

  11. Attention-deficit-hyperactivity disorder and reward deficiency syndrome

    PubMed Central

    Blum, Kenneth; Chen, Amanda Lih-Chuan; Braverman, Eric R; Comings, David E; Chen, Thomas JH; Arcuri, Vanessa; Blum, Seth H; Downs, Bernard W; Waite, Roger L; Notaro, Alison; Lubar, Joel; Williams, Lonna; Prihoda, Thomas J; Palomo, Tomas; Oscar-Berman, Marlene

    2008-01-01

    Molecular genetic studies have identified several genes that may mediate susceptibility to attention deficit hyperactivity disorder (ADHD). A consensus of the literature suggests that when there is a dysfunction in the “brain reward cascade,” especially in the dopamine system, causing a low or hypo-dopaminergic trait, the brain may require dopamine for individuals to avoid unpleasant feelings. This high-risk genetic trait leads to multiple drug-seeking behaviors, because the drugs activate release of dopamine, which can diminish abnormal cravings. Moreover, this genetic trait is due in part to a form of a gene (DRD2 A1 allele) that prevents the expression of the normal laying down of dopamine receptors in brain reward sites. This gene, and others involved in neurophysiological processing of specific neurotransmitters, have been associated with deficient functions and predispose individuals to have a high risk for addictive, impulsive, and compulsive behavioral propensities. It has been proposed that genetic variants of dopaminergic genes and other “reward genes” are important common determinants of reward deficiency syndrome (RDS), which we hypothesize includes ADHD as a behavioral subtype. We further hypothesize that early diagnosis through genetic polymorphic identification in combination with DNA-based customized nutraceutical administration to young children may attenuate behavioral symptoms associated with ADHD. Moreover, it is concluded that dopamine and serotonin releasers might be useful therapeutic adjuncts for the treatment of other RDS behavioral subtypes, including addictions. PMID:19183781

  12. Behavioral theories and the neurophysiology of reward.

    PubMed

    Schultz, Wolfram

    2006-01-01

    The functions of rewards are based primarily on their effects on behavior and are less directly governed by the physics and chemistry of input events as in sensory systems. Therefore, the investigation of neural mechanisms underlying reward functions requires behavioral theories that can conceptualize the different effects of rewards on behavior. The scientific investigation of behavioral processes by animal learning theory and economic utility theory has produced a theoretical framework that can help to elucidate the neural correlates for reward functions in learning, goal-directed approach behavior, and decision making under uncertainty. Individual neurons can be studied in the reward systems of the brain, including dopamine neurons, orbitofrontal cortex, and striatum. The neural activity can be related to basic theoretical terms of reward and uncertainty, such as contiguity, contingency, prediction error, magnitude, probability, expected value, and variance.

  13. Reward positivity elicited by predictive cues.

    PubMed

    Holroyd, Clay B; Krigolson, Olav E; Lee, Seung

    2011-03-30

    A recent theory holds that a component of the human event-related brain potential called the reward positivity reflects a reward prediction error signal. We investigated this idea in gambling-like task in which, on each trial, a visual stimulus predicted a subsequent rewarding or nonrewarding outcome with 80% probability. Consistent with earlier results, we found that the reward positivity was larger to unexpected than to expected outcomes. In addition, we found that the predictive cues also elicited a reward positivity, as proposed by the theory. These results indicate that the reward positivity reflects the initial assessment of whether a trial will end in success or failure and the reappraisal of that information once the outcome actually occurs.

  14. Learning Reward Uncertainty in the Basal Ganglia.

    PubMed

    Mikhael, John G; Bogacz, Rafal

    2016-09-01

    Learning the reliability of different sources of rewards is critical for making optimal choices. However, despite the existence of detailed theory describing how the expected reward is learned in the basal ganglia, it is not known how reward uncertainty is estimated in these circuits. This paper presents a class of models that encode both the mean reward and the spread of the rewards, the former in the difference between the synaptic weights of D1 and D2 neurons, and the latter in their sum. In the models, the tendency to seek (or avoid) options with variable reward can be controlled by increasing (or decreasing) the tonic level of dopamine. The models are consistent with the physiology of and synaptic plasticity in the basal ganglia, they explain the effects of dopaminergic manipulations on choices involving risks, and they make multiple experimental predictions. PMID:27589489

  15. Learning Reward Uncertainty in the Basal Ganglia

    PubMed Central

    Bogacz, Rafal

    2016-01-01

    Learning the reliability of different sources of rewards is critical for making optimal choices. However, despite the existence of detailed theory describing how the expected reward is learned in the basal ganglia, it is not known how reward uncertainty is estimated in these circuits. This paper presents a class of models that encode both the mean reward and the spread of the rewards, the former in the difference between the synaptic weights of D1 and D2 neurons, and the latter in their sum. In the models, the tendency to seek (or avoid) options with variable reward can be controlled by increasing (or decreasing) the tonic level of dopamine. The models are consistent with the physiology of and synaptic plasticity in the basal ganglia, they explain the effects of dopaminergic manipulations on choices involving risks, and they make multiple experimental predictions. PMID:27589489

  16. Action controls dopaminergic enhancement of reward representations

    PubMed Central

    Guitart-Masip, Marc; Chowdhury, Rumana; Sharot, Tali; Dayan, Peter; Duzel, Emrah; Dolan, Raymond J.

    2012-01-01

    Dopamine is widely observed to signal anticipation of future rewards and thus thought to be a key contributor to affectively charged decision making. However, the experiments supporting this view have not dissociated rewards from the actions that lead to, or are occasioned by, them. Here, we manipulated dopamine pharmacologically and examined the effect on a task that explicitly dissociates action and reward value. We show that dopamine enhanced the neural representation of rewarding actions, without significantly affecting the representation of reward value as such. Thus, increasing dopamine levels with levodopa selectively boosted striatal and substantia nigra/ventral tegmental representations associated with actions leading to reward, but not with actions leading to the avoidance of punishment. These findings highlight a key role for dopamine in the generation of appetitively motivated actions. PMID:22529363

  17. Reward-Dependent Modulation of Movement Variability

    PubMed Central

    Izawa, Jun; Shadmehr, Reza

    2015-01-01

    Movement variability is often considered an unwanted byproduct of a noisy nervous system. However, variability can signal a form of implicit exploration, indicating that the nervous system is intentionally varying the motor commands in search of actions that yield the greatest success. Here, we investigated the role of the human basal ganglia in controlling reward-dependent motor variability as measured by trial-to-trial changes in performance during a reaching task. We designed an experiment in which the only performance feedback was success or failure and quantified how reach variability was modulated as a function of the probability of reward. In healthy controls, reach variability increased as the probability of reward decreased. Control of variability depended on the history of past rewards, with the largest trial-to-trial changes occurring immediately after an unrewarded trial. In contrast, in participants with Parkinson's disease, a known example of basal ganglia dysfunction, reward was a poor modulator of variability; that is, the patients showed an impaired ability to increase variability in response to decreases in the probability of reward. This was despite the fact that, after rewarded trials, reach variability in the patients was comparable to healthy controls. In summary, we found that movement variability is partially a form of exploration driven by the recent history of rewards. When the function of the human basal ganglia is compromised, the reward-dependent control of movement variability is impaired, particularly affecting the ability to increase variability after unsuccessful outcomes. PMID:25740529

  18. Reward and non-reward learning of flower colours in the butterfly Byasa alcinous (Lepidoptera: Papilionidae)

    NASA Astrophysics Data System (ADS)

    Kandori, Ikuo; Yamaki, Takafumi

    2012-09-01

    Learning plays an important role in food acquisition for a wide range of insects. To increase their foraging efficiency, flower-visiting insects may learn to associate floral cues with the presence (so-called reward learning) or the absence (so-called non-reward learning) of a reward. Reward learning whilst foraging for flowers has been demonstrated in many insect taxa, whilst non-reward learning in flower-visiting insects has been demonstrated only in honeybees, bumblebees and hawkmoths. This study examined both reward and non-reward learning abilities in the butterfly Byasa alcinous whilst foraging among artificial flowers of different colours. This butterfly showed both types of learning, although butterflies of both sexes learned faster via reward learning. In addition, females learned via reward learning faster than males. To the best of our knowledge, these are the first empirical data on the learning speed of both reward and non-reward learning in insects. We discuss the adaptive significance of a lower learning speed for non-reward learning when foraging on flowers.

  19. Natural and Drug Rewards Act on Common Neural Plasticity Mechanisms with ΔFosB as a Key Mediator

    PubMed Central

    Pitchers, Kyle K.; Vialou, Vincent; Nestler, Eric J.; Laviolette, Steven R.; Lehman, Michael N.

    2013-01-01

    Drugs of abuse induce neuroplasticity in the natural reward pathway, specifically the nucleus accumbens (NAc), thereby causing development and expression of addictive behavior. Recent evidence suggests that natural rewards may cause similar changes in the NAc, suggesting that drugs may activate mechanisms of plasticity shared with natural rewards, and allowing for unique interplay between natural and drug rewards. In this study, we demonstrate that sexual experience in male rats when followed by short or prolonged periods of loss of sex reward causes enhanced amphetamine reward, indicated by sensitized conditioned place preference for low-dose (0.5 mg/kg) amphetamine. Moreover, the onset, but not the longer-term expression, of enhanced amphetamine reward was correlated with a transient increase in dendritic spines in the NAc. Next, a critical role for the transcription factor ΔFosB in sex experience-induced enhanced amphetamine reward and associated increases in dendritic spines on NAc neurons was established using viral vector gene transfer of the dominant-negative binding partner ΔJunD. Moreover, it was demonstrated that sexual experience-induced enhanced drug reward, ΔFosB, and spinogenesis are dependent on mating-induced dopamine D1 receptor activation in the NAc. Pharmacological blockade of D1 receptor, but not D2 receptor, in the NAc during sexual behavior attenuated ΔFosB induction and prevented increased spinogenesis and sensitized amphetamine reward. Together, these findings demonstrate that drugs of abuse and natural reward behaviors act on common molecular and cellular mechanisms of plasticity that control vulnerability to drug addiction, and that this increased vulnerability is mediated by ΔFosB and its downstream transcriptional targets. PMID:23426671

  20. Cognitive processing of food rewards.

    PubMed

    Higgs, Suzanne

    2016-09-01

    Cues associated with tasty foods, such as their smell or taste, are strong motivators of eating, but the power of food cues on behaviour varies from moment to moment and from person to person. Variation in the rewarding value of a food with metabolic state explains why food cues are more attractive when hungry. However, cognitive processes are also important determinants of our responses to food cues. An urge to consume a tempting food may be resisted if, for example, a person has a longer term goal of weight loss. There is also evidence that responses to food cues can be facilitated or inhibited by memory processes. The aim of this review is to add to the literature on cognitive control of eating by reviewing recent evidence on the influence of working memory and episodic memory processes on responses to food cues. It is argued that processing of food information in working memory affects how much attention is paid to food cues in the environment and promotes the motivation to seek out food in the absence of direct contact with food cues. It is further argued that memories of specific recent eating episodes play an important role in directing food choices and influencing when and how much we eat. However, these memory processes are prone to disruption. When this happens, eating behaviour may become more cue-driven and less flexible. In the modern food environment, disruption of cognitive processing of food reward cues may lead to overconsumption and obesity. PMID:26458961

  1. Cognitive processing of food rewards.

    PubMed

    Higgs, Suzanne

    2016-09-01

    Cues associated with tasty foods, such as their smell or taste, are strong motivators of eating, but the power of food cues on behaviour varies from moment to moment and from person to person. Variation in the rewarding value of a food with metabolic state explains why food cues are more attractive when hungry. However, cognitive processes are also important determinants of our responses to food cues. An urge to consume a tempting food may be resisted if, for example, a person has a longer term goal of weight loss. There is also evidence that responses to food cues can be facilitated or inhibited by memory processes. The aim of this review is to add to the literature on cognitive control of eating by reviewing recent evidence on the influence of working memory and episodic memory processes on responses to food cues. It is argued that processing of food information in working memory affects how much attention is paid to food cues in the environment and promotes the motivation to seek out food in the absence of direct contact with food cues. It is further argued that memories of specific recent eating episodes play an important role in directing food choices and influencing when and how much we eat. However, these memory processes are prone to disruption. When this happens, eating behaviour may become more cue-driven and less flexible. In the modern food environment, disruption of cognitive processing of food reward cues may lead to overconsumption and obesity.

  2. Mechanisms of habitual approach: Failure to suppress irrelevant responses evoked by previously reward-associated stimuli.

    PubMed

    Anderson, Brian A; Folk, Charles L; Garrison, Rebecca; Rogers, Leeland

    2016-06-01

    Reward learning has a powerful influence on the attention system, causing previously reward-associated stimuli to automatically capture attention. Difficulty ignoring stimuli associated with drug reward has been linked to addiction relapse, and the attention system of drug-dependent patients seems especially influenced by reward history. This and other evidence suggests that value-driven attention has consequences for behavior and decision-making, facilitating a bias to approach and consume the previously reward-associated stimulus even when doing so runs counter to current goals and priorities. Yet, a mechanism linking value-driven attention to behavioral responding and a general approach bias is lacking. Here we show that previously reward-associated stimuli escape inhibitory processing in a go/no-go task. Control experiments confirmed that this value-dependent failure of goal-directed inhibition could not be explained by search history or residual motivation, but depended specifically on the learned association between particular stimuli and reward outcome. When a previously high-value stimulus is encountered, the response codes generated by that stimulus are automatically afforded high priority, bypassing goal-directed cognitive processes involved in suppressing task-irrelevant behavior. (PsycINFO Database Record PMID:27054684

  3. Video game training and the reward system.

    PubMed

    Lorenz, Robert C; Gleich, Tobias; Gallinat, Jürgen; Kühn, Simone

    2015-01-01

    Video games contain elaborate reinforcement and reward schedules that have the potential to maximize motivation. Neuroimaging studies suggest that video games might have an influence on the reward system. However, it is not clear whether reward-related properties represent a precondition, which biases an individual toward playing video games, or if these changes are the result of playing video games. Therefore, we conducted a longitudinal study to explore reward-related functional predictors in relation to video gaming experience as well as functional changes in the brain in response to video game training. Fifty healthy participants were randomly assigned to a video game training (TG) or control group (CG). Before and after training/control period, functional magnetic resonance imaging (fMRI) was conducted using a non-video game related reward task. At pretest, both groups showed strongest activation in ventral striatum (VS) during reward anticipation. At posttest, the TG showed very similar VS activity compared to pretest. In the CG, the VS activity was significantly attenuated. This longitudinal study revealed that video game training may preserve reward responsiveness in the VS in a retest situation over time. We suggest that video games are able to keep striatal responses to reward flexible, a mechanism which might be of critical value for applications such as therapeutic cognitive training.

  4. Video game training and the reward system.

    PubMed

    Lorenz, Robert C; Gleich, Tobias; Gallinat, Jürgen; Kühn, Simone

    2015-01-01

    Video games contain elaborate reinforcement and reward schedules that have the potential to maximize motivation. Neuroimaging studies suggest that video games might have an influence on the reward system. However, it is not clear whether reward-related properties represent a precondition, which biases an individual toward playing video games, or if these changes are the result of playing video games. Therefore, we conducted a longitudinal study to explore reward-related functional predictors in relation to video gaming experience as well as functional changes in the brain in response to video game training. Fifty healthy participants were randomly assigned to a video game training (TG) or control group (CG). Before and after training/control period, functional magnetic resonance imaging (fMRI) was conducted using a non-video game related reward task. At pretest, both groups showed strongest activation in ventral striatum (VS) during reward anticipation. At posttest, the TG showed very similar VS activity compared to pretest. In the CG, the VS activity was significantly attenuated. This longitudinal study revealed that video game training may preserve reward responsiveness in the VS in a retest situation over time. We suggest that video games are able to keep striatal responses to reward flexible, a mechanism which might be of critical value for applications such as therapeutic cognitive training. PMID:25698962

  5. Reward modulates perception in binocular rivalry.

    PubMed

    Marx, Svenja; Einhäuser, Wolfgang

    2015-01-01

    Our perception does not provide us with an exact imprint of the outside world, but is continuously adapted to our internal expectations, task sets, and behavioral goals. Although effects of reward-or value in general-on perception therefore seem likely, how valuation modulates perception and how such modulation relates to attention is largely unknown. We probed effects of reward on perception by using a binocular-rivalry paradigm. Distinct gratings drifting in opposite directions were presented to each observer's eyes. To objectify their subjective perceptual experience, the optokinetic nystagmus was used as measure of current perceptual dominance. In a first experiment, one of the percepts was either rewarded or attended. We found that reward and attention similarly biased perception. In a second experiment, observers performed an attentionally demanding task either on the rewarded stimulus, the other stimulus, or both. We found that-on top of an attentional effect on perception-at each level of attentional load, reward still modulated perception by increasing the dominance of the rewarded percept. Similarly, penalizing one percept increased dominance of the other at each level of attentional load. In turn, rewarding-and similarly nonpunishing-a percept yielded performance benefits that are typically associated with selective attention. In conclusion, our data show that value modulates perception in a similar way as the volitional deployment of attention, even though the relative effect of value is largely unaffected by an attention task. PMID:25589295

  6. Adolescent Depression: Stress and Reward Dysfunction

    PubMed Central

    Auerbach, Randy P.; Admon, Roee; Pizzagalli, Diego A.

    2014-01-01

    Adolescence is a peak period for the onset of depression, and it is also a time marked by substantial stress as well as neural development within the brain reward circuitry. In the current review, we provide a selective overview of current animal and human research investigating the relationship among reward processes, stress, and depression. Three separate, but related, etiological models examine the differential roles that stress may play with regard to reward dysfunction and adolescent depression. First, the reward mediation model suggests that acute and chronic stress contribute to reward deficits, which in turn, potentiate depressive symptoms and/or increase the risk for depression. Second, in line with the stress generation perspective, it is plausible that premorbid reward-related dysfunction generates stress, in particular interpersonal stress, which then leads to the manifestation of depressive symptoms. Last, consistent with a diathesis-stress model, the interaction between stress and premorbid reward dysfunction may contribute to the onset of depression. Given the equifinal nature of depression, these models could shed important light on different etiological pathways during adolescence, particularly as they may relate to understanding the heterogeneity of depression. To highlight the translational potential of these insights, a hypothetical case study is provided as means of demonstrating the importance of targeting reward dysfunction in both assessment and treatment of adolescent depression. PMID:24704785

  7. Reward Magnitude Effects on Temporal Discrimination

    ERIC Educational Resources Information Center

    Galtress, Tiffany; Kirkpatrick, Kimberly

    2010-01-01

    Changes in reward magnitude or value have been reported to produce effects on timing behavior, which have been attributed to changes in the speed of an internal pacemaker in some instances and to attentional factors in other cases. The present experiments therefore aimed to clarify the effects of reward magnitude on timing processes. In Experiment…

  8. Course Budgeting: Balancing Rewards and Risks.

    ERIC Educational Resources Information Center

    Matkin, Gary W.

    Continuing education programmers must be risk takers; however, they should not be gamblers. The most successful of them are able to estimate a balance between potential rewards and risks, taking chances when the odds are favorable. Although it is essential that course planners balance potential financial rewards and risks, it is important to bear…

  9. Performance-Based Rewards and Work Stress

    ERIC Educational Resources Information Center

    Ganster, Daniel C.; Kiersch, Christa E.; Marsh, Rachel E.; Bowen, Angela

    2011-01-01

    Even though reward systems play a central role in the management of organizations, their impact on stress and the well-being of workers is not well understood. We review the literature linking performance-based reward systems to various indicators of employee stress and well-being. Well-controlled experiments in field settings suggest that certain…

  10. Video game training and the reward system

    PubMed Central

    Lorenz, Robert C.; Gleich, Tobias; Gallinat, Jürgen; Kühn, Simone

    2015-01-01

    Video games contain elaborate reinforcement and reward schedules that have the potential to maximize motivation. Neuroimaging studies suggest that video games might have an influence on the reward system. However, it is not clear whether reward-related properties represent a precondition, which biases an individual toward playing video games, or if these changes are the result of playing video games. Therefore, we conducted a longitudinal study to explore reward-related functional predictors in relation to video gaming experience as well as functional changes in the brain in response to video game training. Fifty healthy participants were randomly assigned to a video game training (TG) or control group (CG). Before and after training/control period, functional magnetic resonance imaging (fMRI) was conducted using a non-video game related reward task. At pretest, both groups showed strongest activation in ventral striatum (VS) during reward anticipation. At posttest, the TG showed very similar VS activity compared to pretest. In the CG, the VS activity was significantly attenuated. This longitudinal study revealed that video game training may preserve reward responsiveness in the VS in a retest situation over time. We suggest that video games are able to keep striatal responses to reward flexible, a mechanism which might be of critical value for applications such as therapeutic cognitive training. PMID:25698962

  11. Discrete coding of stimulus value, reward expectation, and reward prediction error in the dorsal striatum.

    PubMed

    Oyama, Kei; Tateyama, Yukina; Hernádi, István; Tobler, Philippe N; Iijima, Toshio; Tsutsui, Ken-Ichiro

    2015-11-01

    To investigate how the striatum integrates sensory information with reward information for behavioral guidance, we recorded single-unit activity in the dorsal striatum of head-fixed rats participating in a probabilistic Pavlovian conditioning task with auditory conditioned stimuli (CSs) in which reward probability was fixed for each CS but parametrically varied across CSs. We found that the activity of many neurons was linearly correlated with the reward probability indicated by the CSs. The recorded neurons could be classified according to their firing patterns into functional subtypes coding reward probability in different forms such as stimulus value, reward expectation, and reward prediction error. These results suggest that several functional subgroups of dorsal striatal neurons represent different kinds of information formed through extensive prior exposure to CS-reward contingencies. PMID:26378201

  12. Attention as reward-driven optimization of sensory processing.

    PubMed

    Chalk, Matthew; Murray, Iain; Seriès, Peggy

    2013-11-01

    Attention causes diverse changes to visual neuron responses, including alterations in receptive field structure, and firing rates. A common theoretical approach to investigate why sensory neurons behave as they do is based on the efficient coding hypothesis: that sensory processing is optimized toward the statistics of the received input. We extend this approach to account for the influence of task demands, hypothesizing that the brain learns a probabilistic model of both the sensory input and reward received for performing different actions. Attention-dependent changes to neural responses reflect optimization of this internal model to deal with changes in the sensory environment (stimulus statistics) and behavioral demands (reward statistics). We use this framework to construct a simple model of visual processing that is able to replicate a number of attention-dependent changes to the responses of neurons in the midlevel visual cortices. The model is consistent with and provides a normative explanation for recent divisive normalization models of attention (Reynolds & Heeger, 2009).

  13. Behavioral suppression using intracranial reward and punishment: effects of benzodiazepines.

    PubMed

    Moriyama, M; Ichimaru, Y; Gomita, Y

    1984-11-01

    Rats were chronically implanted with electrodes aimed at the lateral hypothalamus (LH) and the dorsal central gray (DCG) and trained to press a lever that delivered rewarding stimulation of the LH and punishing stimulation of the DCG. In this situation, both diazepam (5-20 mg/kg, PO) and bromazepam (2-10 mg/kg, PO) caused a marked dose-dependent increase of the lever pressing response in the punished period. In addition, the facilitation of lever pressing in unpunished period was also seen in diazepam (5 and 10 mg/kg). These results show that behavioral suppression on lever pressing maintained self-stimulation reward is inducible following DCG stimulation, and that benzodiazepines exhibit an anti-behavioral suppression effect in this situation.

  14. A glutamatergic reward input from the dorsal raphe to ventral tegmental area dopamine neurons

    PubMed Central

    Qi, Jia; Zhang, Shiliang; Wang, Hui-Ling; Wang, Huikun; de Jesus Aceves Buendia, Jose; Hoffman, Alexander F.; Lupica, Carl R.; Seal, Rebecca P.; Morales, Marisela

    2014-01-01

    Electrical stimulation of the dorsal raphe (DR) and ventral tegmental area (VTA) activates the fibers of the same reward pathway but the phenotype of this pathway and the direction of the reward-relevant fibers have not been determined. Here we report rewarding effects following activation of a DR-originating pathway consisting of vesicular glutamate transporter 3 (VGluT3) containing neurons that form asymmetric synapses onto VTA dopamine neurons that project to nucleus accumbens. Optogenetic VTA activation of this projection elicits AMPA-mediated synaptic excitatory currents in VTA mesoaccumbens dopaminergic neurons and causes dopamine release innucleus accumbens. Activation also reinforces instrumental behavior and establishes conditioned place preferences. These findings indicate that the DR-VGluT3 pathway to VTA utilizes glutamate as a neurotransmitter and is a substrate linking the DR—one of the most sensitive reward sites in the brain—to VTA dopaminergic neurons. PMID:25388237

  15. CLEANing the Reward: Counterfactual Actions to Remove Exploratory Action Noise in Multiagent Learning

    NASA Technical Reports Server (NTRS)

    HolmesParker, Chris; Taylor, Mathew E.; Tumer, Kagan; Agogino, Adrian

    2014-01-01

    Learning in multiagent systems can be slow because agents must learn both how to behave in a complex environment and how to account for the actions of other agents. The inability of an agent to distinguish between the true environmental dynamics and those caused by the stochastic exploratory actions of other agents creates noise in each agent's reward signal. This learning noise can have unforeseen and often undesirable effects on the resultant system performance. We define such noise as exploratory action noise, demonstrate the critical impact it can have on the learning process in multiagent settings, and introduce a reward structure to effectively remove such noise from each agent's reward signal. In particular, we introduce Coordinated Learning without Exploratory Action Noise (CLEAN) rewards and empirically demonstrate their benefits

  16. A glutamatergic reward input from the dorsal raphe to ventral tegmental area dopamine neurons.

    PubMed

    Qi, Jia; Zhang, Shiliang; Wang, Hui-Ling; Wang, Huikun; de Jesus Aceves Buendia, Jose; Hoffman, Alexander F; Lupica, Carl R; Seal, Rebecca P; Morales, Marisela

    2014-11-12

    Electrical stimulation of the dorsal raphe (DR) and ventral tegmental area (VTA) activates the fibres of the same reward pathway but the phenotype of this pathway and the direction of the reward-relevant fibres have not been determined. Here we report rewarding effects following activation of a DR-originating pathway consisting of vesicular glutamate transporter 3 (VGluT3) containing neurons that form asymmetric synapses onto VTA dopamine neurons that project to nucleus accumbens. Optogenetic VTA activation of this projection elicits AMPA-mediated synaptic excitatory currents in VTA mesoaccumbens dopaminergic neurons and causes dopamine release in nucleus accumbens. Activation also reinforces instrumental behaviour and establishes conditioned place preferences. These findings indicate that the DR-VGluT3 pathway to VTA utilizes glutamate as a neurotransmitter and is a substrate linking the DR-one of the most sensitive reward sites in the brain--to VTA dopaminergic neurons.

  17. Abnormal Striatal BOLD Responses to Reward Anticipation and Reward Delivery in ADHD

    PubMed Central

    Furukawa, Emi; Bado, Patricia; Tripp, Gail; Mattos, Paulo; Wickens, Jeff R.; Bramati, Ivanei E.; Alsop, Brent; Ferreira, Fernanda Meireles; Lima, Debora; Tovar-Moll, Fernanda; Sergeant, Joseph A.; Moll, Jorge

    2014-01-01

    Altered reward processing has been proposed to contribute to the symptoms of attention deficit hyperactivity disorder (ADHD). The neurobiological mechanism underlying this alteration remains unclear. We hypothesize that the transfer of dopamine release from reward to reward-predicting cues, as normally observed in animal studies, may be deficient in ADHD. Functional magnetic resonance imaging (fMRI) was used to investigate striatal responses to reward-predicting cues and reward delivery in a classical conditioning paradigm. Data from 14 high-functioning and stimulant-naïve young adults with elevated lifetime symptoms of ADHD (8 males, 6 females) and 15 well-matched controls (8 males, 7 females) were included in the analyses. During reward anticipation, increased blood-oxygen-level-dependent (BOLD) responses in the right ventral and left dorsal striatum were observed in controls, but not in the ADHD group. The opposite pattern was observed in response to reward delivery; the ADHD group demonstrated significantly greater BOLD responses in the ventral striatum bilaterally and the left dorsal striatum relative to controls. In the ADHD group, the number of current hyperactivity/impulsivity symptoms was inversely related to ventral striatal responses during reward anticipation and positively associated with responses to reward. The BOLD response patterns observed in the striatum are consistent with impaired predictive dopamine signaling in ADHD, which may explain altered reward-contingent behaviors and symptoms of ADHD. PMID:24586543

  18. Empathy Modulates the Rewarding Effect of Mimicry

    PubMed Central

    Neufeld, J.; Chakrabarti, B.

    2016-01-01

    We tend to like those who mimic us. In this study we formally test if mimicry changes the reward value of the mimicker, using gaze bias as a proxy for reward. Previous research has demonstrated that people show gaze bias towards more rewarding targets, suggesting that gaze bias can be considered a proxy for relative reward value. Forty adults participated in a conditioning task, where they were mimicked by one face and ‘anti-mimicked’ by another. Subsequently, they were found to show gaze-bias towards faces that mimicked them compared to those that did not, in a preferential looking task. The strength of this effect correlated positively with individual levels of trait empathy. In a separate, similar task, these participants showed a gaze bias for faces paired with high vs low monetary rewards, thus validating the use of gaze bias as a proxy for learnt reward. Together, these results demonstrate that mimicry changes the reward value of social stimuli, and empathy influences the extent of this change. This can potentially inform conditions marked by deficits in forming social bonds, such as Autism. PMID:27297317

  19. Prosocial Reward Learning in Children and Adolescents

    PubMed Central

    Kwak, Youngbin; Huettel, Scott A.

    2016-01-01

    Adolescence is a period of increased sensitivity to social contexts. To evaluate how social context sensitivity changes over development—and influences reward learning—we investigated how children and adolescents perceive and integrate rewards for oneself and others during a dynamic risky decision-making task. Children and adolescents (N = 75, 8–16 years) performed the Social Gambling Task (SGT, Kwak et al., 2014) and completed a set of questionnaires measuring other-regarding behavior. In the SGT, participants choose amongst four card decks that have different payout structures for oneself and for a charity. We examined patterns of choices, overall decision strategies, and how reward outcomes led to trial-by-trial adjustments in behavior, as estimated using a reinforcement-learning model. Performance of children and adolescents was compared to data from a previously collected sample of adults (N = 102) performing the identical task. We found that that children/adolescents were not only more sensitive to rewards directed to the charity than self but also showed greater prosocial tendencies on independent measures of other-regarding behavior. Children and adolescents also showed less use of a strategy that prioritizes rewards for self at the expense of rewards for others. These results support the conclusion that, compared to adults, children and adolescents show greater sensitivity to outcomes for others when making decisions and learning about potential rewards. PMID:27761125

  20. Reward Systems in the Brain and Nutrition.

    PubMed

    Rolls, Edmund T

    2016-07-17

    The taste cortex in the anterior insula provides separate and combined representations of the taste, temperature, and texture of food in the mouth independently of hunger and thus of reward value and pleasantness. One synapse on, in the orbitofrontal cortex, these sensory inputs are combined by associative learning with olfactory and visual inputs for some neurons, and these neurons encode food reward value in that they respond to food only when hunger is present and in that activations correlate linearly with subjective pleasantness. Cognitive factors, including word-level descriptions and selective attention to affective value, modulate the representation of the reward value of taste, olfactory, and flavor stimuli in the orbitofrontal cortex and a region to which it projects, the anterior cingulate cortex. These food reward representations are important in the control of appetite and food intake. Individual differences in reward representations may contribute to obesity, and there are age-related differences in these reward representations. Implications of how reward systems in the brain operate for understanding, preventing, and treating obesity are described.

  1. Forebrain substrates of reward and motivation.

    PubMed

    Wise, Roy A

    2005-12-01

    Electrical stimulation of the medial forebrain bundle can reward arbitrary acts or motivate biologically primitive, species-typical behaviors like feeding or copulation. The subsystems involved in these behaviors are only partially characterized, but they appear to transsynaptically activate the mesocorticolimbic dopamine system. Basal function of the dopamine system is essential for arousal and motor function; phasic activation of this system is rewarding and can potentiate the effectiveness of reward-predictors that guide learned behaviors. This system is phasically activated by most drugs of abuse and such activation contributes to the habit-forming actions of these drugs.

  2. Forebrain substrates of reward and motivation

    PubMed Central

    Wise, Roy A.

    2008-01-01

    Electrical stimulation of the medial forebrain bundle can reward arbitrary acts or motivate biologically primitive, species-typical behaviors like feeding or copulation. The sub-systems involved in these behaviors are only partially characterized, but they appear to trans-synaptically activate the mesocorticolimbic dopamine system. Basal function of the dopamine system is essential for arousal and motor function; phasic activation of this system is rewarding and can potentiate the effectiveness of reward-predictors that guide learned behaviors. This system is phasically activated by most drugs of abuse and such activation contributes to the habit-forming actions of these drugs. PMID:16254990

  3. Endocannabinoid signalling in reward and addiction.

    PubMed

    Parsons, Loren H; Hurd, Yasmin L

    2015-10-01

    Brain endocannabinoid (eCB) signalling influences the motivation for natural rewards (such as palatable food, sexual activity and social interaction) and modulates the rewarding effects of addictive drugs. Pathological forms of natural and drug-induced reward are associated with dysregulated eCB signalling that may derive from pre-existing genetic factors or from prolonged drug exposure. Impaired eCB signalling contributes to dysregulated synaptic plasticity, increased stress responsivity, negative emotional states and cravings that propel addiction. Understanding the contributions of eCB disruptions to behavioural and physiological traits provides insight into the eCB influence on addiction vulnerability.

  4. Endocannabinoid signaling in reward and addiction

    PubMed Central

    Parsons, Loren H.; Hurd, Yasmin L.

    2015-01-01

    Brain endocannabinoid signaling influences the motivation for natural rewards (such as palatable food, sexual activity and social interaction) and modulates the rewarding effects of addictive drugs. Pathological forms of natural and drug-induced reward are associated with dysregulated endocannabinoid signaling that may derive from pre-existing genetic factors or from prolonged drug exposure. Impaired endocannabinoid signaling contributes to dysregulated synaptic plasticity, increased stress responsivity, negative emotional states, and craving that propel addiction. Understanding the contributions of endocannabinoid disruptions to behavioral and physiological traits provides insight into the endocannabinoid influence on addiction vulnerability. PMID:26373473

  5. Effects of anabolic-androgens on brain reward function

    PubMed Central

    Mhillaj, Emanuela; Morgese, Maria G.; Tucci, Paolo; Bove, Maria; Schiavone, Stefania; Trabace, Luigia

    2015-01-01

    Androgens are mainly prescribed to treat several diseases caused by testosterone deficiency. However, athletes try to promote muscle growth by manipulating testosterone levels or assuming androgen anabolic steroids (AAS). These substances were originally synthesized to obtain anabolic effects greater than testosterone. Although AAS are rarely prescribed compared to testosterone, their off-label utilization is very wide. Furthermore, combinations of different steroids and doses generally higher than those used in therapy are common. Symptoms of the chronic use of supra-therapeutic doses of AAS include anxiety, depression, aggression, paranoia, distractibility, confusion, amnesia. Interestingly, some studies have shown that AAS elicited electroencephalographic changes similar to those observed with amphetamine abuse. The frequency of side effects is higher among AAS abusers, with psychiatric complications such as labile mood, lack of impulse control and high violence. On the other hand, AAS addiction studies are complex because data collection is very difficult due to the subjects' reticence and can be biased by many variables, including physical exercise, that alter the reward system. Moreover, it has been reported that AAS may imbalance neurotransmitter systems involved in the reward process, leading to increased sensitivity toward opioid narcotics and central stimulants. The goal of this article is to review the literature on steroid abuse and changes to the reward system in preclinical and clinical studies. PMID:26379484

  6. Effects of anabolic-androgens on brain reward function.

    PubMed

    Mhillaj, Emanuela; Morgese, Maria G; Tucci, Paolo; Bove, Maria; Schiavone, Stefania; Trabace, Luigia

    2015-01-01

    Androgens are mainly prescribed to treat several diseases caused by testosterone deficiency. However, athletes try to promote muscle growth by manipulating testosterone levels or assuming androgen anabolic steroids (AAS). These substances were originally synthesized to obtain anabolic effects greater than testosterone. Although AAS are rarely prescribed compared to testosterone, their off-label utilization is very wide. Furthermore, combinations of different steroids and doses generally higher than those used in therapy are common. Symptoms of the chronic use of supra-therapeutic doses of AAS include anxiety, depression, aggression, paranoia, distractibility, confusion, amnesia. Interestingly, some studies have shown that AAS elicited electroencephalographic changes similar to those observed with amphetamine abuse. The frequency of side effects is higher among AAS abusers, with psychiatric complications such as labile mood, lack of impulse control and high violence. On the other hand, AAS addiction studies are complex because data collection is very difficult due to the subjects' reticence and can be biased by many variables, including physical exercise, that alter the reward system. Moreover, it has been reported that AAS may imbalance neurotransmitter systems involved in the reward process, leading to increased sensitivity toward opioid narcotics and central stimulants. The goal of this article is to review the literature on steroid abuse and changes to the reward system in preclinical and clinical studies. PMID:26379484

  7. Effects of anabolic-androgens on brain reward function.

    PubMed

    Mhillaj, Emanuela; Morgese, Maria G; Tucci, Paolo; Bove, Maria; Schiavone, Stefania; Trabace, Luigia

    2015-01-01

    Androgens are mainly prescribed to treat several diseases caused by testosterone deficiency. However, athletes try to promote muscle growth by manipulating testosterone levels or assuming androgen anabolic steroids (AAS). These substances were originally synthesized to obtain anabolic effects greater than testosterone. Although AAS are rarely prescribed compared to testosterone, their off-label utilization is very wide. Furthermore, combinations of different steroids and doses generally higher than those used in therapy are common. Symptoms of the chronic use of supra-therapeutic doses of AAS include anxiety, depression, aggression, paranoia, distractibility, confusion, amnesia. Interestingly, some studies have shown that AAS elicited electroencephalographic changes similar to those observed with amphetamine abuse. The frequency of side effects is higher among AAS abusers, with psychiatric complications such as labile mood, lack of impulse control and high violence. On the other hand, AAS addiction studies are complex because data collection is very difficult due to the subjects' reticence and can be biased by many variables, including physical exercise, that alter the reward system. Moreover, it has been reported that AAS may imbalance neurotransmitter systems involved in the reward process, leading to increased sensitivity toward opioid narcotics and central stimulants. The goal of this article is to review the literature on steroid abuse and changes to the reward system in preclinical and clinical studies.

  8. 21 CFR 203.70 - Application for a reward.

    Code of Federal Regulations, 2010 CFR

    2010-04-01

    ... 21 Food and Drugs 4 2010-04-01 2010-04-01 false Application for a reward. 203.70 Section 203.70 Food and Drugs FOOD AND DRUG ADMINISTRATION, DEPARTMENT OF HEALTH AND HUMAN SERVICES (CONTINUED) DRUGS: GENERAL PRESCRIPTION DRUG MARKETING Rewards § 203.70 Application for a reward. (a) Reward for...

  9. Axiomatic methods, dopamine and reward prediction error.

    PubMed

    Caplin, Andrew; Dean, Mark

    2008-04-01

    The phasic firing rate of midbrain dopamine neurons has been shown to respond both to the receipt of rewarding stimuli, and the degree to which such stimuli are anticipated by the recipient. This has led to the hypothesis that these neurons encode reward prediction error (RPE)-the difference between how rewarding an event is, and how rewarding it was expected to be. However, the RPE model is one of a number of competing explanations for dopamine activity that have proved hard to disentangle, mainly because they are couched in terms of latent, or unobservable, variables. This article describes techniques for dealing with latent variables common in economics and decision theory, and reviews work that uses these techniques to provide simple, non-parametric tests of the RPE hypothesis, allowing clear differentiation between competing explanations.

  10. Brain Reward Circuits in Morphine Addiction

    PubMed Central

    Kim, Juhwan; Ham, Suji; Hong, Heeok; Moon, Changjong; Im, Heh-In

    2016-01-01

    Morphine is the most potent analgesic for chronic pain, but its clinical use has been limited by the opiate’s innate tendency to produce tolerance, severe withdrawal symptoms and rewarding properties with a high risk of relapse. To understand the addictive properties of morphine, past studies have focused on relevant molecular and cellular changes in the brain, highlighting the functional roles of reward-related brain regions. Given the accumulated findings, a recent, emerging trend in morphine research is that of examining the dynamics of neuronal interactions in brain reward circuits under the influence of morphine action. In this review, we highlight recent findings on the roles of several reward circuits involved in morphine addiction based on pharmacological, molecular and physiological evidences. PMID:27506251

  11. Dorsomedial striatum lesions affect adjustment to reward uncertainty, but not to reward devaluation or omission.

    PubMed

    Torres, Carmen; Glueck, Amanda C; Conrad, Shannon E; Morón, Ignacio; Papini, Mauricio R

    2016-09-22

    The dorsomedial striatum (DMS) has been implicated in the acquisition of reward representations, a proposal leading to the hypothesis that it should play a role in situations involving reward loss. We report the results of an experiment in which the effects of DMS excitotoxic lesions were tested in consummatory successive negative contrast (reward devaluation), autoshaping training with partial vs. continuous reinforcement (reward uncertainty), and appetitive extinction (reward omission). Animals with DMS lesions exhibited reduced lever pressing responding, but enhanced goal entries, during partial reinforcement training in autoshaping. However, they showed normal negative contrast, acquisition under continuous reinforcement (CR), appetitive extinction, and response facilitation in early extinction trials. Open-field testing also indicated normal motor behavior. Thus, DMS lesions selectively affected the behavioral adjustment to a situation involving reward uncertainty, producing a behavioral reorganization according to which goal tracking (goal entries) became predominant at the expense of sign tracking (lever pressing). This pattern of results shows that the function of the DMS in situations involving reward loss is not general, but restricted to reward uncertainty. We suggest that a nonassociative, drive-related process induced by reward uncertainty requires normal output from DMS neurons. PMID:27365171

  12. [Reward processing of the basal ganglia--reward function of pedunculopontine tegmental nucleus].

    PubMed

    Kobayashi-, Yasushi; Okada, Ken-Ichi

    2009-04-01

    We address the role of neuronal activity in the pathways of the brainstem-midbrain circuit in reward and the basis for the hypothesis that this circuit provides advantages over previous reinforcement learning theories. Several lines of evidence support the reward-based learning theory proposing that midbrain dopamine (DA) neurons emit a teaching signal (the reward prediction error signal) to control synaptic plasticity of the projection area. However, the underlying mechanism of the location and manner in which the reward prediction error signal is computed remains unclear. Since the pedunculopontine tegmental nucleus (PPTN) in the brainstem is one of the strongest excitatory input sources to DA neurons, we hypothesized that the PPTN may play an important role in activating the DA neurons and reinforce learning by relaying necessary signals for reward prediction error computation to those neurons. To investigate the involvement of PPTN neurons in reward prediction error computation, we employed a visually guided saccade task while recording the neuronal activity in monkeys. Here, we predict that PPTN neurons may relay the excitatory component of tonic reward prediction and phasic primary reward signals, and derive a new computational theory of reward prediction error in DA neurons.

  13. Individual differences in sensitivity to reward and punishment and neural activity during reward and avoidance learning.

    PubMed

    Kim, Sang Hee; Yoon, HeungSik; Kim, Hackjin; Hamann, Stephan

    2015-09-01

    In this functional neuroimaging study, we investigated neural activations during the process of learning to gain monetary rewards and to avoid monetary loss, and how these activations are modulated by individual differences in reward and punishment sensitivity. Healthy young volunteers performed a reinforcement learning task where they chose one of two fractal stimuli associated with monetary gain (reward trials) or avoidance of monetary loss (avoidance trials). Trait sensitivity to reward and punishment was assessed using the behavioral inhibition/activation scales (BIS/BAS). Functional neuroimaging results showed activation of the striatum during the anticipation and reception periods of reward trials. During avoidance trials, activation of the dorsal striatum and prefrontal regions was found. As expected, individual differences in reward sensitivity were positively associated with activation in the left and right ventral striatum during reward reception. Individual differences in sensitivity to punishment were negatively associated with activation in the left dorsal striatum during avoidance anticipation and also with activation in the right lateral orbitofrontal cortex during receiving monetary loss. These results suggest that learning to attain reward and learning to avoid loss are dependent on separable sets of neural regions whose activity is modulated by trait sensitivity to reward or punishment.

  14. Motivating interdependent teams: individual rewards, shared rewards, or something in between?

    PubMed

    Pearsall, Matthew J; Christian, Michael S; Ellis, Aleksander P J

    2010-01-01

    The primary purpose in this study was to extend theory and research regarding the motivational process in teams by examining the effects of hybrid rewards on team performance. Further, to better understand the underlying team level mechanisms, the authors examined whether the hypothesized benefits of hybrid over shared and individual rewards were due to increased information allocation and reduced social loafing. Results from 90 teams working on a command-and-control simulation supported the hypotheses. Hybrid rewards led to higher levels of team performance than did individual and shared rewards; these effects were due to improvements in information allocation and reductions in social loafing.

  15. Motivating interdependent teams: individual rewards, shared rewards, or something in between?

    PubMed

    Pearsall, Matthew J; Christian, Michael S; Ellis, Aleksander P J

    2010-01-01

    The primary purpose in this study was to extend theory and research regarding the motivational process in teams by examining the effects of hybrid rewards on team performance. Further, to better understand the underlying team level mechanisms, the authors examined whether the hypothesized benefits of hybrid over shared and individual rewards were due to increased information allocation and reduced social loafing. Results from 90 teams working on a command-and-control simulation supported the hypotheses. Hybrid rewards led to higher levels of team performance than did individual and shared rewards; these effects were due to improvements in information allocation and reductions in social loafing. PMID:20085415

  16. Reward employees, achieve goals with incentive compensation.

    PubMed

    Vergara, G H; Bourke, J

    1985-08-01

    Incentive compensation, rewarding employees financially for extraordinary performance, can be a motivational tool for healthcare organizations. This method of compensation uses a financial reward as an incentive for executives to achieve certain predetermined, agreed-upon goals. Incentive compensation provides two advantages for the healthcare organization--it provides a mechanism to maximize organizational productivity and it gives executives a means to achieve greater compensation.

  17. Adolescent behavioral and neural reward sensitivity: a test of the differential susceptibility theory.

    PubMed

    Richards, J S; Arias Vásquez, A; von Rhein, D; van der Meer, D; Franke, B; Hoekstra, P J; Heslenfeld, D J; Oosterlaan, J; Faraone, S V; Buitelaar, J K; Hartman, C A

    2016-01-01

    Little is known about the causes of individual differences in reward sensitivity. We investigated gene-environment interactions (GxE) on behavioral and neural measures of reward sensitivity, in light of the differential susceptibility theory. This theory states that individuals carrying plasticity gene variants will be more disadvantaged in negative, but more advantaged in positive environments. Reward responses were assessed during a monetary incentive delay task in 178 participants with and 265 without attention-deficit/hyperactivity disorder (ADHD), from N=261 families. We examined interactions between variants in candidate plasticity genes (DAT1, 5-HTT and DRD4) and social environments (maternal expressed emotion and peer affiliation). HTTLPR short allele carriers showed the least reward speeding when exposed to high positive peer affiliation, but the most when faced with low positive peer affiliation or low maternal warmth. DAT1 10-repeat homozygotes displayed similar GxE patterns toward maternal warmth on general task performance. At the neural level, DRD4 7-repeat carriers showed the least striatal activation during reward anticipation when exposed to high maternal warmth, but the most when exposed to low warmth. Findings were independent of ADHD severity. Our results partially confirm the differential susceptibility theory and indicate the importance of positive social environments in reward sensitivity and general task performance for persons with specific genotypes. PMID:27045841

  18. Adolescent behavioral and neural reward sensitivity: a test of the differential susceptibility theory

    PubMed Central

    Richards, J S; Arias Vásquez, A; von Rhein, D; van der Meer, D; Franke, B; Hoekstra, P J; Heslenfeld, D J; Oosterlaan, J; Faraone, S V; Buitelaar, J K; Hartman, C A

    2016-01-01

    Little is known about the causes of individual differences in reward sensitivity. We investigated gene–environment interactions (GxE) on behavioral and neural measures of reward sensitivity, in light of the differential susceptibility theory. This theory states that individuals carrying plasticity gene variants will be more disadvantaged in negative, but more advantaged in positive environments. Reward responses were assessed during a monetary incentive delay task in 178 participants with and 265 without attention-deficit/hyperactivity disorder (ADHD), from N=261 families. We examined interactions between variants in candidate plasticity genes (DAT1, 5-HTT and DRD4) and social environments (maternal expressed emotion and peer affiliation). HTTLPR short allele carriers showed the least reward speeding when exposed to high positive peer affiliation, but the most when faced with low positive peer affiliation or low maternal warmth. DAT1 10-repeat homozygotes displayed similar GxE patterns toward maternal warmth on general task performance. At the neural level, DRD4 7-repeat carriers showed the least striatal activation during reward anticipation when exposed to high maternal warmth, but the most when exposed to low warmth. Findings were independent of ADHD severity. Our results partially confirm the differential susceptibility theory and indicate the importance of positive social environments in reward sensitivity and general task performance for persons with specific genotypes. PMID:27045841

  19. Incentive-Rewarding Mechanism for User-position Control in Mobile Services

    NASA Astrophysics Data System (ADS)

    Yoshino, Makoto; Sato, Kenichiro; Shinkuma, Ryoichi; Takahashi, Tatsuro

    When the number of users in a service area increases in mobile multimedia services, no individual user can obtain satisfactory radio resources such as bandwidth and signal power because the resources are limited and shared. A solution for such a problem is user-position control. In the user-position control, the operator informs users of better communication areas (or spots) and navigates them to these positions. However, because of subjective costs caused by subjects moving from their original to a new position, they do not always attempt to move. To motivate users to contribute their resources in network services that require resource contributions for users, incentive-rewarding mechanisms have been proposed. However, there are no mechanisms that distribute rewards appropriately according to various subjective factors involving users. Furthermore, since the conventional mechanisms limit how rewards are paid, they are applicable only for the network service they targeted. In this paper, we propose a novel incentive-rewarding mechanism to solve these problems, using an external evaluator and interactive learning agents. We also investigated ways of appropriately controlling rewards based on user contributions and system service quality. We applied the proposed mechanism and reward control to the user-position control, and demonstrated its validity.

  20. Anabolic-androgenic steroids and brain reward.

    PubMed

    Clark, A S; Lindenfeld, R C; Gibbons, C H

    1996-03-01

    Anabolic-androgenic steroid (AAS) effects on brain reward were investigated in male rats with electrodes implanted in the lateral hypothalamus using the rate-frequency curve shift paradigm of brain stimulation reward. In the first experiment, treatment for 2 weeks with the AAS methandrostenolone had no effect on either the reward or performance components of intracranial self-stimulation. In the second experiment, treatment for 15 weeks with an AAS "cocktail" consisting of testosterone cypionate, nandrolone decanoate, and boldenone undecylenate did not alter brain reward but did produce a slight but significant change in bar press rate. In addition to the AAS treatment, animals in the second study were administered a single injection of d-amphetamine before and after 15 weeks of AAS exposure. The rate-frequency curve shift observed in response to a systemic injection of amphetamine was significantly greater in animals after 15 weeks of treatment with the AAS cocktail. Although AAS do not appear to alter the rewarding properties of brain stimulation, AAS may influence the sensitivity of brain reward systems. PMID:8866980

  1. Explicit neural signals reflecting reward uncertainty.

    PubMed

    Schultz, Wolfram; Preuschoff, Kerstin; Camerer, Colin; Hsu, Ming; Fiorillo, Christopher D; Tobler, Philippe N; Bossaerts, Peter

    2008-12-12

    The acknowledged importance of uncertainty in economic decision making has stimulated the search for neural signals that could influence learning and inform decision mechanisms. Current views distinguish two forms of uncertainty, namely risk and ambiguity, depending on whether the probability distributions of outcomes are known or unknown. Behavioural neurophysiological studies on dopamine neurons revealed a risk signal, which covaried with the standard deviation or variance of the magnitude of juice rewards and occurred separately from reward value coding. Human imaging studies identified similarly distinct risk signals for monetary rewards in the striatum and orbitofrontal cortex (OFC), thus fulfilling a requirement for the mean variance approach of economic decision theory. The orbitofrontal risk signal covaried with individual risk attitudes, possibly explaining individual differences in risk perception and risky decision making. Ambiguous gambles with incomplete probabilistic information induced stronger brain signals than risky gambles in OFC and amygdala, suggesting that the brain's reward system signals the partial lack of information. The brain can use the uncertainty signals to assess the uncertainty of rewards, influence learning, modulate the value of uncertain rewards and make appropriate behavioural choices between only partly known options.

  2. Increases in rewards promote flexible behavior.

    PubMed

    Shen, Y Jeremy; Chun, Marvin M

    2011-04-01

    Offering reward for performance can motivate people to perform a task better, but better preparation for one task usually means decreased flexibility to perform different tasks. In six experiments in which reward varied between low and high levels, we found that reward can encourage people to prepare more flexibly for different tasks, but only as it increased from the level on the previous trial. When the same high rewards were offered continuously trial after trial, people were more inclined to simply stick with doing what had worked previously. We demonstrated such enhancements in flexibility in task switching, a difficult visual search task, and an easier priming of pop-out search task, which shows that this effect generalizes from executive tasks to perceptual processes that require relatively little executive control. These findings suggest that relative, transient changes in reward can exert more potent effects on behavioral flexibility than can the absolute amount of reward, whether it consists of money or points in a social competition.

  3. Musical pleasure and reward: mechanisms and dysfunction.

    PubMed

    Zatorre, Robert J

    2015-03-01

    Most people derive pleasure from music. Neuroimaging studies show that the reward system of the human brain is central to this experience. Specifically, the dorsal and ventral striatum release dopamine when listening to pleasurable music, and activity in these structures also codes the reward value of musical excerpts. Moreover, the striatum interacts with cortical mechanisms involved in perception and valuation of musical stimuli. Recent studies have begun to explore individual differences in the way that this complex system functions. Development of a questionnaire for music reward experiences has allowed the identification of separable factors associated with musical pleasure, described as music-seeking, emotion-evocation, mood regulation, sensorimotor, and social factors. Applying this questionnaire to a large sample uncovered approximately 5% of the population with low sensitivity to musical reward in the absence of generalized anhedonia or depression. Further study of this group revealed that there are individuals who respond normally both behaviorally and psychophysiologically to rewards other than music (e.g., monetary value) but do not experience pleasure from music despite normal music perception ability and preserved ability to identify intended emotions in musical passages. This specific music anhedonia bears further study, as it may shed light on the function and dysfunction of the reward system. PMID:25773636

  4. Subjective neuronal coding of reward: temporal value discounting and risk.

    PubMed

    Schultz, Wolfram

    2010-06-01

    A key question in the neurobiology of reward relates to the nature of coding. Rewards are objects that are advantageous or necessary for the survival of individuals in a variety of environmental situations. Thus reward appears to depend on the individual and its environment. The question arises whether neuronal systems in humans and monkeys code reward in subjective terms, objective terms or both. The present review addresses this issue by dealing with two important reward processes, namely the individual discounting of reward value across temporal delays, and the processing of information about risky rewards that depends on individual risk attitudes. The subjective value of rewards decreases with the temporal distance to the reward. In experiments using neurophysiology and brain imaging, dopamine neurons and striatal systems discount reward value across temporal delays of a few seconds, despite unchanged objective reward value, suggesting subjective value coding. The subjective values of risky outcomes depend on the risk attitude of individual decision makers; these values decrease for risk-avoiders and increase for risk-seekers. The signal for risk and the signal for the value of risky reward covary with individual risk attitudes in regions of the human prefrontal cortex, suggesting subjective rather than objective coding of risk and risky value. These data demonstrate that important parameters of reward are coded in a subjective manner in key reward structures of the brain. However, these data do not rule out that other neurons or brain structures may code reward according to its objective value and risk. PMID:20497474

  5. Neural Sensitivity to Absolute and Relative Anticipated Reward in Adolescents

    PubMed Central

    Vaidya, Jatin G.; Knutson, Brian; O'Leary, Daniel S.; Block, Robert I.; Magnotta, Vincent

    2013-01-01

    Adolescence is associated with a dramatic increase in risky and impulsive behaviors that have been attributed to developmental differences in neural processing of rewards. In the present study, we sought to identify age differences in anticipation of absolute and relative rewards. To do so, we modified a commonly used monetary incentive delay (MID) task in order to examine brain activity to relative anticipated reward value (neural sensitivity to the value of a reward as a function of other available rewards). This design also made it possible to examine developmental differences in brain activation to absolute anticipated reward magnitude (the degree to which neural activity increases with increasing reward magnitude). While undergoing fMRI, 18 adolescents and 18 adult participants were presented with cues associated with different reward magnitudes. After the cue, participants responded to a target to win money on that trial. Presentation of cues was blocked such that two reward cues associated with $.20, $1.00, or $5.00 were in play on a given block. Thus, the relative value of the $1.00 reward varied depending on whether it was paired with a smaller or larger reward. Reflecting age differences in neural responses to relative anticipated reward (i.e., reference dependent processing), adults, but not adolescents, demonstrated greater activity to a $1 reward when it was the larger of the two available rewards. Adults also demonstrated a more linear increase in ventral striatal activity as a function of increasing absolute reward magnitude compared to adolescents. Additionally, reduced ventral striatal sensitivity to absolute anticipated reward (i.e., the difference in activity to medium versus small rewards) correlated with higher levels of trait Impulsivity. Thus, ventral striatal activity in anticipation of absolute and relative rewards develops with age. Absolute reward processing is also linked to individual differences in Impulsivity. PMID:23544046

  6. Neural sensitivity to absolute and relative anticipated reward in adolescents.

    PubMed

    Vaidya, Jatin G; Knutson, Brian; O'Leary, Daniel S; Block, Robert I; Magnotta, Vincent

    2013-01-01

    Adolescence is associated with a dramatic increase in risky and impulsive behaviors that have been attributed to developmental differences in neural processing of rewards. In the present study, we sought to identify age differences in anticipation of absolute and relative rewards. To do so, we modified a commonly used monetary incentive delay (MID) task in order to examine brain activity to relative anticipated reward value (neural sensitivity to the value of a reward as a function of other available rewards). This design also made it possible to examine developmental differences in brain activation to absolute anticipated reward magnitude (the degree to which neural activity increases with increasing reward magnitude). While undergoing fMRI, 18 adolescents and 18 adult participants were presented with cues associated with different reward magnitudes. After the cue, participants responded to a target to win money on that trial. Presentation of cues was blocked such that two reward cues associated with $.20, $1.00, or $5.00 were in play on a given block. Thus, the relative value of the $1.00 reward varied depending on whether it was paired with a smaller or larger reward. Reflecting age differences in neural responses to relative anticipated reward (i.e., reference dependent processing), adults, but not adolescents, demonstrated greater activity to a $1 reward when it was the larger of the two available rewards. Adults also demonstrated a more linear increase in ventral striatal activity as a function of increasing absolute reward magnitude compared to adolescents. Additionally, reduced ventral striatal sensitivity to absolute anticipated reward (i.e., the difference in activity to medium versus small rewards) correlated with higher levels of trait Impulsivity. Thus, ventral striatal activity in anticipation of absolute and relative rewards develops with age. Absolute reward processing is also linked to individual differences in Impulsivity. PMID:23544046

  7. Reproductive isolation and pollination success of rewarding Galearis diantha and non-rewarding Ponerorchis chusua (Orchidaceae)

    PubMed Central

    Sun, Hai-Qin; Huang, Bao-Qiang; Yu, Xiao-Hong; Kou, Yong; An, De-Jun; Luo, Yi-Bo; Ge, Song

    2011-01-01

    Background and Aims Increasing evidence challenges the conventional perception that orchids are the most distinct example of floral diversification due to floral or prezygotic isolation. Regarding the relationship between co-flowering plants, rewarding and non-rewarding orchids in particular, few studies have investigated whether non-rewarding plants affect the pollination success of rewarding plants. Here, floral isolation and mutual effects between the rewarding orchid Galearis diantha and the non-rewarding orchid Ponerorchis chusua were investigated. Methods Flowering phenological traits were monitored by noting the opening and wilting dates of the chosen individual plants. The pollinator pool and pollinator behaviour were assessed from field observations. Key morphological traits of the flowers and pollinators were measured directly in the field. Pollinator limitation and interspecific compatibility were evaluated by hand-pollination experiments. Fruit set was surveyed in monospecific and heterospecific plots. Key Results The species had overlapping peak flowering periods. Pollinators of both species displayed a certain degree of constancy in visiting each species, but they also visited other flowers before landing on the focal orchids. A substantial difference in spur size between the species resulted in the deposition of pollen on different regions of the body of the shared pollinator. Hand-pollination experiments revealed that fruit set was strongly pollinator-limited in both species. No significant difference in fruit set was found between monospecific plots and heterospecific plots. Conclusions A combination of mechanical isolation and incomplete ethological isolation eliminates the possibility of pollen transfer between the species. These results do not support either the facilitation or competition hypothesis regarding the effect of nearby rewarding flowers on non-rewarding plants. The absence of a significant effect of non-rewarding P. chusua on

  8. Serotonin neurons in the dorsal raphe nucleus encode reward signals.

    PubMed

    Li, Yi; Zhong, Weixin; Wang, Daqing; Feng, Qiru; Liu, Zhixiang; Zhou, Jingfeng; Jia, Chunying; Hu, Fei; Zeng, Jiawei; Guo, Qingchun; Fu, Ling; Luo, Minmin

    2016-01-28

    The dorsal raphe nucleus (DRN) is involved in organizing reward-related behaviours; however, it remains unclear how genetically defined neurons in the DRN of a freely behaving animal respond to various natural rewards. Here we addressed this question using fibre photometry and single-unit recording from serotonin (5-HT) neurons and GABA neurons in the DRN of behaving mice. Rewards including sucrose, food, sex and social interaction rapidly activate 5-HT neurons, but aversive stimuli including quinine and footshock do not. Both expected and unexpected rewards activate 5-HT neurons. After mice learn to wait for sucrose delivery, most 5-HT neurons fire tonically during waiting and then phasically on reward acquisition. Finally, GABA neurons are activated by aversive stimuli but inhibited when mice seek rewards. Thus, DRN 5-HT neurons positively encode a wide range of reward signals during anticipatory and consummatory phases of reward responses. Moreover, GABA neurons play a complementary role in reward processing.

  9. Serotonin neurons in the dorsal raphe nucleus encode reward signals

    PubMed Central

    Li, Yi; Zhong, Weixin; Wang, Daqing; Feng, Qiru; Liu, Zhixiang; Zhou, Jingfeng; Jia, Chunying; Hu, Fei; Zeng, Jiawei; Guo, Qingchun; Fu, Ling; Luo, Minmin

    2016-01-01

    The dorsal raphe nucleus (DRN) is involved in organizing reward-related behaviours; however, it remains unclear how genetically defined neurons in the DRN of a freely behaving animal respond to various natural rewards. Here we addressed this question using fibre photometry and single-unit recording from serotonin (5-HT) neurons and GABA neurons in the DRN of behaving mice. Rewards including sucrose, food, sex and social interaction rapidly activate 5-HT neurons, but aversive stimuli including quinine and footshock do not. Both expected and unexpected rewards activate 5-HT neurons. After mice learn to wait for sucrose delivery, most 5-HT neurons fire tonically during waiting and then phasically on reward acquisition. Finally, GABA neurons are activated by aversive stimuli but inhibited when mice seek rewards. Thus, DRN 5-HT neurons positively encode a wide range of reward signals during anticipatory and consummatory phases of reward responses. Moreover, GABA neurons play a complementary role in reward processing. PMID:26818705

  10. Reward contexts extend dopamine signals to unrewarded stimuli.

    PubMed

    Kobayashi, Shunsuke; Schultz, Wolfram

    2014-01-01

    Basic tenets of sensory processing emphasize the importance of accurate identification and discrimination of environmental objects [1]. Although this principle holds also for reward, the crucial acquisition of reward for survival would be aided by the capacity to detect objects whose rewarding properties may not be immediately apparent. Animal learning theory conceptualizes how unrewarded stimuli induce behavioral reactions in rewarded contexts due to pseudoconditioning and higher-order context conditioning [2-6]. We hypothesized that the underlying mechanisms may involve context-sensitive reward neurons. We studied short-latency activations of dopamine neurons to unrewarded, physically salient stimuli while systematically changing reward context. Dopamine neurons showed substantial activations to unrewarded stimuli and their conditioned stimuli in highly rewarded contexts. The activations decreased and often disappeared entirely with stepwise separation from rewarded contexts. The influence of reward context suggests that dopamine neurons respond to real and potential reward. The influence of reward context is compatible with the reward nature of phasic dopamine responses. The responses may facilitate rapid, default initiation of behavioral reactions in environments usually containing reward. Agents would encounter more and miss less reward, resulting in survival advantage and enhanced evolutionary fitness.

  11. Distinct Reward Properties are Encoded via Corticostriatal Interactions

    PubMed Central

    Smith, David V.; Rigney, Anastasia E.; Delgado, Mauricio R.

    2016-01-01

    The striatum serves as a critical brain region for reward processing. Yet, understanding the link between striatum and reward presents a challenge because rewards are composed of multiple properties. Notably, affective properties modulate emotion while informative properties help obtain future rewards. We approached this problem by emphasizing affective and informative reward properties within two independent guessing games. We found that both reward properties evoked activation within the nucleus accumbens, a subregion of the striatum. Striatal responses to informative, but not affective, reward properties predicted subsequent utilization of information for obtaining monetary reward. We hypothesized that activation of the striatum may be necessary but not sufficient to encode distinct reward properties. To investigate this possibility, we examined whether affective and informative reward properties were differentially encoded in corticostriatal interactions. Strikingly, we found that the striatum exhibited dissociable connectivity patterns with the ventrolateral prefrontal cortex, with increasing connectivity for affective reward properties and decreasing connectivity for informative reward properties. Our results demonstrate that affective and informative reward properties are encoded via corticostriatal interactions. These findings highlight how corticostriatal systems contribute to reward processing, potentially advancing models linking striatal activation to behavior. PMID:26831208

  12. Listening to music in a risk-reward context: The roles of the temporoparietal junction and the orbitofrontal/insular cortices in reward-anticipation, reward-gain, and reward-loss.

    PubMed

    Li, Chia-Wei; Chen, Jyh-Horng; Tsai, Chen-Gia

    2015-12-10

    Artificial rewards, such as visual arts and music, produce pleasurable feelings. Popular songs in the verse-chorus form provide a useful model for understanding the neural mechanisms underlying the processing of artificial rewards, because the chorus is usually the most rewarding element of a song. In this functional magnetic resonance imaging (fMRI) study, the stimuli were excerpts of 10 popular songs with a tensioned verse-to-chorus transition. We examined the neural correlates of three phases of reward processing: (1) reward-anticipation during the verse-to-chorus transition, (2) reward-gain during the first phrase of the chorus, and (3) reward-loss during the unexpected noise followed by the verse-to-chorus transition. Participants listened to these excerpts in a risk-reward context because the verse was followed by either the chorus or noise with equal probability. The results showed that reward-gain and reward-loss were associated with left- and right-biased temporoparietal junction activation, respectively. The bilateral temporoparietal junctions were active during reward-anticipation. Moreover, we observed left-biased lateral orbitofrontal activation during reward-anticipation, whereas the medial orbitofrontal cortex was activated during reward-gain. The findings are discussed in relation to the cognitive and emotional aspects of reward processing. PMID:26499261

  13. Listening to music in a risk-reward context: The roles of the temporoparietal junction and the orbitofrontal/insular cortices in reward-anticipation, reward-gain, and reward-loss.

    PubMed

    Li, Chia-Wei; Chen, Jyh-Horng; Tsai, Chen-Gia

    2015-12-10

    Artificial rewards, such as visual arts and music, produce pleasurable feelings. Popular songs in the verse-chorus form provide a useful model for understanding the neural mechanisms underlying the processing of artificial rewards, because the chorus is usually the most rewarding element of a song. In this functional magnetic resonance imaging (fMRI) study, the stimuli were excerpts of 10 popular songs with a tensioned verse-to-chorus transition. We examined the neural correlates of three phases of reward processing: (1) reward-anticipation during the verse-to-chorus transition, (2) reward-gain during the first phrase of the chorus, and (3) reward-loss during the unexpected noise followed by the verse-to-chorus transition. Participants listened to these excerpts in a risk-reward context because the verse was followed by either the chorus or noise with equal probability. The results showed that reward-gain and reward-loss were associated with left- and right-biased temporoparietal junction activation, respectively. The bilateral temporoparietal junctions were active during reward-anticipation. Moreover, we observed left-biased lateral orbitofrontal activation during reward-anticipation, whereas the medial orbitofrontal cortex was activated during reward-gain. The findings are discussed in relation to the cognitive and emotional aspects of reward processing.

  14. Single pulse TMS differentially modulates reward behavior.

    PubMed

    Stanford, Arielle D; Luber, Bruce; Unger, Layla; Cycowicz, Yael M; Malaspina, Dolores; Lisanby, Sarah H

    2013-12-01

    Greater knowledge of cortical brain regions in reward processing may set the stage for using transcranial magnetic stimulation (TMS) as a treatment in patients with avolition, apathy or other drive-related symptoms. This study examined the effects of single pulse (sp) TMS to two reward circuit targets on drive in healthy subjects. Fifteen healthy subjects performed the monetary incentive delay task (MID) while receiving fMRI-guided spTMS to either inferior parietal lobe (IPL) or supplemental motor area (SMA). The study demonstrated decreasing reaction times (RT) for increasing reward. It also showed significant differences in RT modulation for TMS pulses to the IPL versus the SMA. TMS pulses during the delay period produced significantly more RT slowing when targeting the IPL than those to the SMA. This RT slowing carried over into subsequent trials without TMS stimulation, with significantly slower RTs in sessions that had targeted the IPL compared to those targeting SMA. The results of this study suggest that both SMA and IPL are involved in reward processing, with opposite effects on RT in response to TMS stimulation. TMS to these target cortical regions may be useful in modulating reward circuit deficits in psychiatric populations.

  15. Reward disrupts reactivated human skill memory

    PubMed Central

    Dayan, Eran; Laor-Maayany, Rony; Censor, Nitzan

    2016-01-01

    Accumulating evidence across species and memory domains shows that when an existing memory is reactivated, it becomes susceptible to modifications. However, the potential role of reward signals in these mechanisms underlying human memory dynamics is unknown. Leaning on a wealth of findings on the role of reward in reinforcing memory, we tested the impact of reinforcing a skill memory trace with monetary reward following memory reactivation, on strengthening of the memory trace. Reinforcing reactivated memories did not strengthen the memory, but rather led to disruption of the memory trace, breaking down the link between memory reactivation and subsequent memory strength. Statistical modeling further revealed a strong mediating role for memory reactivation in linking between memory encoding and subsequent memory strength only when the memory was replayed without reinforcement. We suggest that, rather than reinforcing the existing memory trace, reward creates a competing memory trace, impairing expression of the original reward-free memory. This mechanism sheds light on the processes underlying skill acquisition, having wide translational implications. PMID:27306380

  16. Giving is self-rewarding for monkeys

    PubMed Central

    de Waal, Frans B. M.; Leimgruber, Kristin; Greenberg, Amanda R.

    2008-01-01

    Helping and sharing among humans is often motivated by empathy and accompanied by a sense of satisfaction. To determine whether similar self-rewarding mechanisms may underpin assistance among nonhuman primates, eight female brown capuchin monkeys (Cebus apella) underwent testing in a simple choice paradigm. Paired with a partner, subjects could select either a “selfish” option that rewarded only themselves, or a “prosocial” option that rewarded both of them. Subjects systematically favored the prosocial option provided their partner was a) familiar, b) visible, and c) receiving rewards of equal value. Prosocial tendencies increased with social closeness, being lowest toward strangers and highest toward kin. That the monkeys understood the options was suggested by greater orientation to the partner during prosocial than selfish choices. Prosocial preferences were reduced by inequity, when the partner received a superior reward. If the view between both monkeys was blocked, choices became strikingly selfish. Thus, under certain conditions, delivering benefits to others seems gratifying to nonhuman primates. PMID:18757730

  17. Reward disrupts reactivated human skill memory.

    PubMed

    Dayan, Eran; Laor-Maayany, Rony; Censor, Nitzan

    2016-01-01

    Accumulating evidence across species and memory domains shows that when an existing memory is reactivated, it becomes susceptible to modifications. However, the potential role of reward signals in these mechanisms underlying human memory dynamics is unknown. Leaning on a wealth of findings on the role of reward in reinforcing memory, we tested the impact of reinforcing a skill memory trace with monetary reward following memory reactivation, on strengthening of the memory trace. Reinforcing reactivated memories did not strengthen the memory, but rather led to disruption of the memory trace, breaking down the link between memory reactivation and subsequent memory strength. Statistical modeling further revealed a strong mediating role for memory reactivation in linking between memory encoding and subsequent memory strength only when the memory was replayed without reinforcement. We suggest that, rather than reinforcing the existing memory trace, reward creates a competing memory trace, impairing expression of the original reward-free memory. This mechanism sheds light on the processes underlying skill acquisition, having wide translational implications. PMID:27306380

  18. Dopamine, reward learning, and active inference

    PubMed Central

    FitzGerald, Thomas H. B.; Dolan, Raymond J.; Friston, Karl

    2015-01-01

    Temporal difference learning models propose phasic dopamine signaling encodes reward prediction errors that drive learning. This is supported by studies where optogenetic stimulation of dopamine neurons can stand in lieu of actual reward. Nevertheless, a large body of data also shows that dopamine is not necessary for learning, and that dopamine depletion primarily affects task performance. We offer a resolution to this paradox based on an hypothesis that dopamine encodes the precision of beliefs about alternative actions, and thus controls the outcome-sensitivity of behavior. We extend an active inference scheme for solving Markov decision processes to include learning, and show that simulated dopamine dynamics strongly resemble those actually observed during instrumental conditioning. Furthermore, simulated dopamine depletion impairs performance but spares learning, while simulated excitation of dopamine neurons drives reward learning, through aberrant inference about outcome states. Our formal approach provides a novel and parsimonious reconciliation of apparently divergent experimental findings. PMID:26581305

  19. Food after deprivation rewards the earlier eating.

    PubMed

    Booth, David A; Jarvandi, Soghra; Thibault, Louise

    2012-12-01

    Food intake can be increased by learning to anticipate the omission of subsequent meals. We present here a new theory that such anticipatory eating depends on an associative process of instrumental reinforcement by the nutritional repletion that occurs when access to food is restored. Our evidence over the last decade from a smooth-brained omnivore has been that food after deprivation rewards intake even when those reinforced ingestive responses occur long before the physiological signals from renewed assimilation. Effects of food consumed after self-deprivation might therefore reward extra eating in human beings, through brain mechanisms that could operate outside awareness. That would have implications for efforts to reduce body weight. This food reward mechanism could be contributing to the failure of the dietary component of interventions on obesity within controlled trials of the management or prevention of disorders such as hypertension, atherosclerosis and type 2 diabetes.

  20. Food after deprivation rewards the earlier eating.

    PubMed

    Booth, David A; Jarvandi, Soghra; Thibault, Louise

    2012-12-01

    Food intake can be increased by learning to anticipate the omission of subsequent meals. We present here a new theory that such anticipatory eating depends on an associative process of instrumental reinforcement by the nutritional repletion that occurs when access to food is restored. Our evidence over the last decade from a smooth-brained omnivore has been that food after deprivation rewards intake even when those reinforced ingestive responses occur long before the physiological signals from renewed assimilation. Effects of food consumed after self-deprivation might therefore reward extra eating in human beings, through brain mechanisms that could operate outside awareness. That would have implications for efforts to reduce body weight. This food reward mechanism could be contributing to the failure of the dietary component of interventions on obesity within controlled trials of the management or prevention of disorders such as hypertension, atherosclerosis and type 2 diabetes. PMID:22841813

  1. Instrumental vigour in punishment and reward.

    PubMed

    Dayan, Peter

    2012-04-01

    Recent notions about the vigour of responding in operant conditioning suggest that the long-run average rate of reward should control the alacrity of action in cases in which the actual cost of speed is balanced against the opportunity cost of sloth. The average reward rate is suggested as being reported by tonic activity in the dopamine system and thereby influencing all actions, including ones that do not themselves lead directly to the rewards. This idea is syntactically problematical for the case of punishment. Here, we broaden the scope of the original suggestion, providing a two-factor analysis of obviated punishment in a variety of operant circumstances. We also consider the effects of stochastically successful actions, which turn out to differ rather markedly between appetitive and aversive cases. Finally, we study how to fit these ideas into nascent treatments that extend concepts of opponency between dopamine and serotonin from valence to invigoration.

  2. Incentive sensitization by previous amphetamine exposure: increased cue-triggered "wanting" for sucrose reward.

    PubMed

    Wyvell, C L; Berridge, K C

    2001-10-01

    We reported previously that an amphetamine microinjection into the nucleus accumbens enables Pavlovian reward cues in a conditioned incentive paradigm to trigger excessive instrumental pursuit. Here we show that sensitization caused by previous amphetamine administration also causes reward cues to trigger excessive pursuit of their associated reward, even when sensitized rats are tested in a drug-free state. Rats learned to lever press for sucrose pellets, and they separately learned to associate sucrose pellets with Pavlovian cues (30 sec auditory cues). Amphetamine sensitization was induced by six daily injections of amphetamine (3 mg/kg, i.p.; controls received saline). Rats were tested for lever pressing under extinction conditions 10 d later, after a bilateral microinjection of intra-accumbens vehicle or amphetamine (5 microg/0.5 microl per side). Cue-triggered pursuit of sucrose reward was assessed by increases in pressing on the sucrose-associated lever during intermittent presentations of a free conditioned stimulus (CS+) sucrose cue. Sensitized rats pressed at normal levels during baseline and during the CS-, but the CS+ triggered 100% greater increases in pressing from sensitized rats than from control rats after vehicle microinjection. Sensitization therefore enhanced the incentive salience attributed to the CS+ even when rats were tested while drug-free. For control rats, a microinjection of intra-accumbens amphetamine was needed to produce the same enhancement of cue-triggered reward "wanting." The amphetamine microinjection also interacted synergistically in sensitized rats to produce intrusive cue-triggered pursuit behaviors (e.g., investigatory sniffing) that interfered with goal-directed lever pressing. These results support the incentive-sensitization theory postulate that sensitization causes excessive cue-triggered "wanting" for an associated reward.

  3. 36 CFR 262.1 - Rewards in connection with fire or property prosecutions.

    Code of Federal Regulations, 2013 CFR

    2013-07-01

    ... grass upon the lands of the United States within the National Forest System or nearby. (2) Not exceeding... kindled or caused to be kindled a fire on lands of the United States within the National Forest System or... Agriculture reserves the right to refuse payments of any claim for reward when, in its opinion, collusion...

  4. 36 CFR 262.1 - Rewards in connection with fire or property prosecutions.

    Code of Federal Regulations, 2011 CFR

    2011-07-01

    ... grass upon the lands of the United States within the National Forest System or nearby. (2) Not exceeding... kindled or caused to be kindled a fire on lands of the United States within the National Forest System or... Agriculture reserves the right to refuse payments of any claim for reward when, in its opinion, collusion...

  5. Reward from bugs to bipeds: a comparative approach to understanding how reward circuits function.

    PubMed

    Scaplen, Kristin M; Kaun, Karla R

    2016-06-01

    In a complex environment, animals learn from their responses to stimuli and events. Appropriate response to reward and punishment can promote survival, reproduction and increase evolutionary fitness. Interestingly, the neural processes underlying these responses are remarkably similar across phyla. In all species, dopamine is central to encoding reward and directing motivated behaviors, however, a comprehensive understanding of how circuits encode reward and direct motivated behaviors is still lacking. In part, this is a result of the sheer diversity of neurons, the heterogeneity of their responses and the complexity of neural circuits within which they are found. We argue that general features of reward circuitry are common across model organisms, and thus principles learned from invertebrate model organisms can inform research across species. In particular, we discuss circuit motifs that appear to be functionally equivalent from flies to primates. We argue that a comparative approach to studying and understanding reward circuit function provides a more comprehensive understanding of reward circuitry, and informs disorders that affect the brain's reward circuitry. PMID:27328845

  6. Reward from bugs to bipeds: a comparative approach to understanding how reward circuits function

    PubMed Central

    Scaplen, Kristin M.; Kaun, Karla R.

    2016-01-01

    Abstract In a complex environment, animals learn from their responses to stimuli and events. Appropriate response to reward and punishment can promote survival, reproduction and increase evolutionary fitness. Interestingly, the neural processes underlying these responses are remarkably similar across phyla. In all species, dopamine is central to encoding reward and directing motivated behaviors, however, a comprehensive understanding of how circuits encode reward and direct motivated behaviors is still lacking. In part, this is a result of the sheer diversity of neurons, the heterogeneity of their responses and the complexity of neural circuits within which they are found. We argue that general features of reward circuitry are common across model organisms, and thus principles learned from invertebrate model organisms can inform research across species. In particular, we discuss circuit motifs that appear to be functionally equivalent from flies to primates. We argue that a comparative approach to studying and understanding reward circuit function provides a more comprehensive understanding of reward circuitry, and informs disorders that affect the brain’s reward circuitry. PMID:27328845

  7. Effects of striatal lesions on components of choice: Reward discrimination, preference, and relative valuation.

    PubMed

    Ricker, Joshua M; Kopchock, Richard J; Drown, Rachel M; Cromwell, Howard C

    2016-12-15

    The striatum is a key structure involved in reward processing and choice. Recently, we have developed a paradigm to explore how components of reward processing work together or independently during choice behavior. These components include reward discrimination, preference and relative valuation, and the goal of the present study was to determine how the striatum is involved in these dissociable components during this novel free choice paradigm. We tested choice utilizing two different outcome series with one being a more straightforward single-option discrimination anchored by a 0 reward outcome, and the other as a multi-option outcome discrimination of greater difficulty. We compared the free choice reward task to a sequential reward task and an extinction task. Striatal lesions impaired responding only in the free choice version with alterations in both appetitive and consummatory measures. Ventral striatal lesions had greater impact altering discrimination, preference and relative valuation in both the single and multi-option week studies. A major factor involved in these deficits was a significant aversion to the multi-option that contained a larger outcome option but with a longer delay to reward. Dorsal striatal lesions caused less impairment even leading to enhanced choice behavior compared to control animals during the more difficult multi-option free choice series. Overall, the results suggest that the context of action is crucial when linking striatal function to choice behavior and its diverse components. The implications include the idea that striatal involvement in decision-making is increased when responses are self-paced and diverse in a more naturalistic environment. PMID:27544873

  8. Effects of striatal lesions on components of choice: Reward discrimination, preference, and relative valuation.

    PubMed

    Ricker, Joshua M; Kopchock, Richard J; Drown, Rachel M; Cromwell, Howard C

    2016-12-15

    The striatum is a key structure involved in reward processing and choice. Recently, we have developed a paradigm to explore how components of reward processing work together or independently during choice behavior. These components include reward discrimination, preference and relative valuation, and the goal of the present study was to determine how the striatum is involved in these dissociable components during this novel free choice paradigm. We tested choice utilizing two different outcome series with one being a more straightforward single-option discrimination anchored by a 0 reward outcome, and the other as a multi-option outcome discrimination of greater difficulty. We compared the free choice reward task to a sequential reward task and an extinction task. Striatal lesions impaired responding only in the free choice version with alterations in both appetitive and consummatory measures. Ventral striatal lesions had greater impact altering discrimination, preference and relative valuation in both the single and multi-option week studies. A major factor involved in these deficits was a significant aversion to the multi-option that contained a larger outcome option but with a longer delay to reward. Dorsal striatal lesions caused less impairment even leading to enhanced choice behavior compared to control animals during the more difficult multi-option free choice series. Overall, the results suggest that the context of action is crucial when linking striatal function to choice behavior and its diverse components. The implications include the idea that striatal involvement in decision-making is increased when responses are self-paced and diverse in a more naturalistic environment.

  9. Shift of Circadian Feeding Pattern by High-Fat Diets Is Coincident with Reward Deficits in Obese Mice

    PubMed Central

    Valladolid-Acebes, Ismael; Fole, Alberto; Cano, Victoria; Merino, Beatriz; Stucchi, Paula; Ruggieri, Daniela; López, Laura; Alguacil, Luis Fernando; Ruiz-Gayo, Mariano

    2012-01-01

    Recent studies provide evidence that high-fat diets (HF) trigger both i) a deficit of reward responses linked to a decrease of mesolimbic dopaminergic activity, and ii) a disorganization of circadian feeding behavior that switch from a structured meal-based schedule to a continuous snacking, even during periods normally devoted to rest. This feeding pattern has been shown to be a cause of HF-induced overweight and obesity. Our hypothesis deals with the eventual link between the rewarding properties of food and the circadian distribution of meals. We have investigated the effect of circadian feeding pattern on reward circuits by means of the conditioned-place preference (CPP) paradigm and we have characterized the rewarding properties of natural (food) and artificial (cocaine) reinforcers both in free-feeding ad libitum HF mice and in HF animals submitted to a re-organized feeding schedule based on the standard feeding behavior displayed by mice feeding normal chow (“forced synchronization”). We demonstrate that i) ad libitum HF diet attenuates cocaine and food reward in the CPP protocol, and ii) forced synchronization of feeding prevents this reward deficit. Our study provides further evidence that the rewarding impact of food with low palatability is diminished in mice exposed to a high-fat diet and strongly suggest that the decreased sensitivity to chow as a positive reinforcer triggers a disorganized feeding pattern which might account for metabolic disorders leading to obesity. PMID:22570696

  10. Attentional modulation of reward processing in the human brain.

    PubMed

    Rothkirch, Marcus; Schmack, Katharina; Deserno, Lorenz; Darmohray, Dana; Sterzer, Philipp

    2014-07-01

    Although neural signals of reward anticipation have been studied extensively, the functional relationship between reward and attention has remained unclear: Neural signals implicated in reward processing could either reflect attentional biases towards motivationally salient stimuli, or proceed independently of attentional processes. Here, we sought to disentangle reward and attention-related neural processes by independently modulating reward value and attentional task demands in a functional magnetic resonance imaging study in healthy human participants. During presentation of a visual reward cue that indicated whether monetary reward could be obtained in a subsequent reaction time task, participants either attended to the reward cue or performed an unrelated attention-demanding task at two different levels of difficulty. In ventral striatum and ventral tegmental area, neural responses were modulated by reward anticipation irrespective of attentional demands, thus indicating attention-independent processing of reward cues. By contrast, additive effects of reward and attention were observed in visual cortex. Critically, reward-related activations in right anterior insula strongly depended on attention to the reward cue. Dynamic causal modelling revealed that the attentional modulation of reward processing in insular cortex was mediated by enhanced effective connectivity from ventral striatum to anterior insula. Our results provide evidence for distinct functional roles of the brain regions involved in the processing of reward-indicating information: While subcortical structures signal the motivational salience of reward cues even when attention is fully engaged elsewhere, reward-related responses in anterior insula depend on available attentional resources, likely reflecting the conscious evaluation of sensory information with respect to motivational value. PMID:24307490

  11. Reward motivation accelerates the onset of neural novelty signals in humans to 85 milliseconds.

    PubMed

    Bunzeck, Nico; Doeller, Christian F; Fuentemilla, Lluis; Dolan, Raymond J; Duzel, Emrah

    2009-08-11

    The neural responses that distinguish novel from familiar items in recognition memory tasks are remarkably fast in both humans and nonhuman primates. In humans, the earliest onsets of neural novelty effects emerge at about approximately 150-200 ms after stimulus onset. However, in recognition memory studies with nonhuman primates, novelty effects can arise at as early as 70-80 ms. Here, we address the possibility that this large species difference in onset latencies is caused experimentally by the necessity of using reward reinforcement to motivate the detection of novel or familiar items in nonhuman primates but not in humans. Via magnetoencephalography in humans, we show in two experiments that the onset of neural novelty signals is accelerated from approximately 200 ms to approximately 85 ms if correct recognition memory for either novel or familiar items is rewarded. Importantly, this acceleration is independent of whether the detection of the novel or the familiar scenes is rewarded. Furthermore, this early novelty effect contributed to memory retrieval because neural reward responses, which were contingent upon novelty detection, followed approximately 100 ms later. Thus, under the contextual influence of reward motivation, behaviorally relevant novelty signals emerge much faster than previously held possible in humans.

  12. Obesity and the neurocognitive basis of food reward and the control of intake.

    PubMed

    Ziauddeen, Hisham; Alonso-Alonso, Miguel; Hill, James O; Kelley, Michael; Khan, Naiman A

    2015-07-01

    With the rising prevalence of obesity, hedonic eating has become an important theme in obesity research. Hedonic eating is thought to be that driven by the reward of food consumption and not metabolic need, and this has focused attention on the brain reward system and how its dysregulation may cause overeating and obesity. Here, we begin by examining the brain reward system and the evidence for its dysregulation in human obesity. We then consider the issue of how individuals are able to control their hedonic eating in the present obesogenic environment and compare 2 contrasting perspectives on the control of hedonic eating, specifically, enhanced control of intake via higher cognitive control and loss of control over intake as captured by the food addiction model. We conclude by considering what these perspectives offer in terms of directions for future research and for potential interventions to improve control over food intake at the population and the individual levels.

  13. Obesity and the neurocognitive basis of food reward and the control of intake.

    PubMed

    Ziauddeen, Hisham; Alonso-Alonso, Miguel; Hill, James O; Kelley, Michael; Khan, Naiman A

    2015-07-01

    With the rising prevalence of obesity, hedonic eating has become an important theme in obesity research. Hedonic eating is thought to be that driven by the reward of food consumption and not metabolic need, and this has focused attention on the brain reward system and how its dysregulation may cause overeating and obesity. Here, we begin by examining the brain reward system and the evidence for its dysregulation in human obesity. We then consider the issue of how individuals are able to control their hedonic eating in the present obesogenic environment and compare 2 contrasting perspectives on the control of hedonic eating, specifically, enhanced control of intake via higher cognitive control and loss of control over intake as captured by the food addiction model. We conclude by considering what these perspectives offer in terms of directions for future research and for potential interventions to improve control over food intake at the population and the individual levels. PMID:26178031

  14. Obesity and the Neurocognitive Basis of Food Reward and the Control of Intake12

    PubMed Central

    Ziauddeen, Hisham; Alonso-Alonso, Miguel; Hill, James O; Kelley, Michael; Khan, Naiman A

    2015-01-01

    With the rising prevalence of obesity, hedonic eating has become an important theme in obesity research. Hedonic eating is thought to be that driven by the reward of food consumption and not metabolic need, and this has focused attention on the brain reward system and how its dysregulation may cause overeating and obesity. Here, we begin by examining the brain reward system and the evidence for its dysregulation in human obesity. We then consider the issue of how individuals are able to control their hedonic eating in the present obesogenic environment and compare 2 contrasting perspectives on the control of hedonic eating, specifically, enhanced control of intake via higher cognitive control and loss of control over intake as captured by the food addiction model. We conclude by considering what these perspectives offer in terms of directions for future research and for potential interventions to improve control over food intake at the population and the individual levels. PMID:26178031

  15. "Small Steps, Big Rewards": Preventing Type 2 Diabetes

    MedlinePlus

    ... please turn Javascript on. Feature: Diabetes "Small Steps, Big Rewards": Preventing Type 2 Diabetes Past Issues / Fall ... These are the plain facts in "Small Steps. Big Rewards: Prevent Type 2 Diabetes," an education campaign ...

  16. Components and characteristics of the dopamine reward utility signal.

    PubMed

    Stauffer, William R; Lak, Armin; Kobayashi, Shunsuke; Schultz, Wolfram

    2016-06-01

    Rewards are defined by their behavioral functions in learning (positive reinforcement), approach behavior, economic choices, and emotions. Dopamine neurons respond to rewards with two components, similar to higher order sensory and cognitive neurons. The initial, rapid, unselective dopamine detection component reports all salient environmental events irrespective of their reward association. It is highly sensitive to factors related to reward and thus detects a maximal number of potential rewards. It also senses aversive stimuli but reports their physical impact rather than their aversiveness. The second response component processes reward value accurately and starts early enough to prevent confusion with unrewarded stimuli and objects. It codes reward value as a numeric, quantitative utility prediction error, consistent with formal concepts of economic decision theory. Thus, the dopamine reward signal is fast, highly sensitive and appropriate for driving and updating economic decisions. PMID:26272220

  17. Differential brain activation according to chronic social reward frustration.

    PubMed

    Siegrist, Johannes; Menrath, Ingo; Stöcker, Tony; Klein, Martina; Kellermann, Thilo; Shah, N Jon; Zilles, Karl; Schneider, Frank

    2005-11-28

    Neural correlates of reward frustration are increasingly studied in humans. In line with prediction error theory, omission of an expected reward is associated with relative decreases of cerebral activation in dopaminergic brain areas. We investigated whether a history of chronic work-related reward frustration influences this reward-dependent activation pattern by means of functional magnetic resonance imaging. Solving arithmetic tasks was followed by either monetary reward or omission of reward. Hyperactivations in the medial prefrontal, anterior cingulate and dorsolateral prefrontal cortex were observed in a group of healthy adults with high susceptibility to reward frustration as compared with a group with low susceptibility. Findings indicate a compromised ability of adapting brain activation among those suffering form chronic social reward frustration.

  18. Components and characteristics of the dopamine reward utility signal.

    PubMed

    Stauffer, William R; Lak, Armin; Kobayashi, Shunsuke; Schultz, Wolfram

    2016-06-01

    Rewards are defined by their behavioral functions in learning (positive reinforcement), approach behavior, economic choices, and emotions. Dopamine neurons respond to rewards with two components, similar to higher order sensory and cognitive neurons. The initial, rapid, unselective dopamine detection component reports all salient environmental events irrespective of their reward association. It is highly sensitive to factors related to reward and thus detects a maximal number of potential rewards. It also senses aversive stimuli but reports their physical impact rather than their aversiveness. The second response component processes reward value accurately and starts early enough to prevent confusion with unrewarded stimuli and objects. It codes reward value as a numeric, quantitative utility prediction error, consistent with formal concepts of economic decision theory. Thus, the dopamine reward signal is fast, highly sensitive and appropriate for driving and updating economic decisions.

  19. Circadian Mechanisms Underlying Reward-Related Neurophysiology and Synaptic Plasticity

    PubMed Central

    Parekh, Puja K.; McClung, Colleen A.

    2016-01-01

    Evidence from clinical and preclinical research provides an undeniable link between disruptions in the circadian clock and the development of psychiatric diseases, including mood and substance abuse disorders. The molecular clock, which controls daily patterns of physiological and behavioral activity in living organisms, when desynchronized, may exacerbate or precipitate symptoms of psychiatric illness. One of the outstanding questions remaining in this field is that of cause and effect in the relationship between circadian rhythm disruption and psychiatric disease. Focus has recently turned to uncovering the role of circadian proteins beyond the maintenance of homeostatic systems and outside of the suprachiasmatic nucleus (SCN), the master pacemaker region of the brain. In this regard, several groups, including our own, have sought to understand how circadian proteins regulate mechanisms of synaptic plasticity and neurotransmitter signaling in mesocorticolimbic brain regions, which are known to be critically involved in reward processing and mood. This regulation can come in the form of direct transcriptional control of genes central to mood and reward, including those associated with dopaminergic activity in the midbrain. It can also be seen at the circuit level through indirect connections of mesocorticolimbic regions with the SCN. Circadian misalignment paradigms as well as genetic models of circadian disruption have helped to elucidate some of the complex interactions between these systems and neural activity influencing behavior. In this review, we explore findings that link circadian protein function with synaptic adaptations underlying plasticity as it may contribute to the development of mood disorders and addiction. In light of recent advances in technology and sophisticated methods for molecular and circuit-level interrogation, we propose future directions aimed at teasing apart mechanisms through which the circadian system modulates mood and reward

  20. Circadian Mechanisms Underlying Reward-Related Neurophysiology and Synaptic Plasticity.

    PubMed

    Parekh, Puja K; McClung, Colleen A

    2015-01-01

    Evidence from clinical and preclinical research provides an undeniable link between disruptions in the circadian clock and the development of psychiatric diseases, including mood and substance abuse disorders. The molecular clock, which controls daily patterns of physiological and behavioral activity in living organisms, when desynchronized, may exacerbate or precipitate symptoms of psychiatric illness. One of the outstanding questions remaining in this field is that of cause and effect in the relationship between circadian rhythm disruption and psychiatric disease. Focus has recently turned to uncovering the role of circadian proteins beyond the maintenance of homeostatic systems and outside of the suprachiasmatic nucleus (SCN), the master pacemaker region of the brain. In this regard, several groups, including our own, have sought to understand how circadian proteins regulate mechanisms of synaptic plasticity and neurotransmitter signaling in mesocorticolimbic brain regions, which are known to be critically involved in reward processing and mood. This regulation can come in the form of direct transcriptional control of genes central to mood and reward, including those associated with dopaminergic activity in the midbrain. It can also be seen at the circuit level through indirect connections of mesocorticolimbic regions with the SCN. Circadian misalignment paradigms as well as genetic models of circadian disruption have helped to elucidate some of the complex interactions between these systems and neural activity influencing behavior. In this review, we explore findings that link circadian protein function with synaptic adaptations underlying plasticity as it may contribute to the development of mood disorders and addiction. In light of recent advances in technology and sophisticated methods for molecular and circuit-level interrogation, we propose future directions aimed at teasing apart mechanisms through which the circadian system modulates mood and reward

  1. Social and monetary reward processing in autism spectrum disorders

    PubMed Central

    2012-01-01

    Background Social motivation theory suggests that deficits in social reward processing underlie social impairments in autism spectrum disorders (ASD). However, the extent to which abnormalities in reward processing generalize to other classes of stimuli remains unresolved. The aim of the current study was to examine if reward processing abnormalities in ASD are specific to social stimuli or can be generalized to other classes of reward. Additionally, we sought to examine the results in the light of behavioral impairments in ASD. Methods Participants performed adapted versions of the social and monetary incentive delay tasks. Data from 21 unmedicated right-handed male participants with ASD and 21 age- and IQ-matched controls were analyzed using a factorial design to examine the blood-oxygen-level-dependent (BOLD) response during the anticipation and receipt of both reward types. Results Behaviorally, the ASD group showed less of a reduction in reaction time (RT) for rewarded compared to unrewarded trials than the control group. In terms of the fMRI results, there were no significant group differences in reward circuitry during reward anticipation. During the receipt of rewards, there was a significant interaction between group and reward type in the left dorsal striatum (DS). The ASD group showed reduced activity in the DS compared to controls for social rewards but not monetary rewards and decreased activation for social rewards compared to monetary rewards. Controls showed no significant difference between the two reward types. Increased activation in the DS during social reward processing was associated with faster response times for rewarded trials, compared to unrewarded trials, in both groups. This is in line with behavioral results indicating that the ASD group showed less of a reduction in RT for rewarded compared to unrewarded trials. Additionally, de-activation to social rewards was associated with increased repetitive behavior in ASD. Conclusions In line

  2. Identifying nurses' rewards: a qualitative categorization study in Belgium

    PubMed Central

    De Gieter, Sara; De Cooman, Rein; Pepermans, Roland; Caers, Ralf; Du Bois, Cindy; Jegers, Marc

    2006-01-01

    Background Rewards are important in attracting, motivating and retaining the most qualified employees, and nurses are no exception to this rule. This makes the establishment of an efficient reward system for nurses a true challenge for every hospital manager. A reward does not necessarily have a financial connotation: non-financial rewards may matter too, or may even be more important. Therefore, the present study examines nurses' reward perceptions, in order to identify potential reward options. Methods To answer the research question "What do nurses consider a reward and how can these rewards be categorized?", 20 in-depth semi-structured interviews with nurses were conducted and analysed using discourse and content analyses. In addition, the respondents received a list of 34 rewards (derived from the literature) and were asked to indicate the extent to which they perceived each of them to be rewarding. Results Discourse analysis revealed three major reward categories: financial, non-financial and psychological, each containing different subcategories. In general, nurses more often mentioned financial rewards spontaneously in the interview, compared to non-financial and psychological rewards. The questionnaire results did not, however, indicate a significant difference in the rewarding potential of these three categories. Both the qualitative and quantitative data revealed that a number of psychological and non-financial rewards were important for nurses in addition to their monthly pay and other remunerations. In particular, appreciation for their work by others, compliments from others, presents from others and contact with patients were highly valued. Moreover, some demographical variables influenced the reward perceptions. Younger and less experienced nurses considered promotion possibilities as more rewarding than the older and more senior ones. The latter valued job security and working for a hospital with a good reputation higher than their younger and more

  3. Functional connectivity in obesity during reward processing.

    PubMed

    García-García, I; Jurado, M A; Garolera, M; Segura, B; Marqués-Iturria, I; Pueyo, R; Vernet-Vernet, M; Sender-Palacios, M J; Sala-Llonch, R; Ariza, M; Narberhaus, A; Junqué, C

    2013-02-01

    Obesity is a health problem that has become a major focus of attention in recent years. There is growing evidence of an association between obesity and differences in reward processing. However, it is not known at present whether these differences are linked exclusively to food, or whether they can be detected in other rewarding stimuli. We compared responses to food, rewarding non-food and neutral pictures in 18 young adults with obesity and 19 normal-weight subjects using independent component analysis. Both groups modulated task-related activity in a plausible way. However, in response to both food and non-food rewarding stimuli, participants with obesity showed weaker connectivity in a network involving activation of frontal and occipital areas and deactivation of the posterior part of the default mode network. In addition, obesity was related with weaker activation of the default mode network and deactivation of frontal and occipital areas while viewing neutral stimuli. Together, our findings suggest that obesity is related to a different allocation of cognitive resources in a fronto-occipital network and in the default mode network. PMID:23103690

  4. Associations between sleep parameters and food reward.

    PubMed

    McNeil, Jessica; Cadieux, Sébastien; Finlayson, Graham; Blundell, John E; Doucet, Éric

    2015-06-01

    This study examined the effects of acute, isocaloric aerobic and resistance exercise on different sleep parameters, and whether changes in these sleep parameters between sessions were related to next morning food reward. Fourteen men and women (age: 21.9 ± 2.7 years; body mass index: 22.7 ± 1.9 kg m(-) ²) participated in three randomized crossover sessions: aerobic exercise; resistance exercise; and sedentary control. Target exercise energy expenditure was matched at 4 kcal kg(-1) of body weight, and performed at 70% of VO2peak or 70% of 1 repetition-maximal. Sleep was measured (accelerometry) for 22 h following each session. The 'wanting' for visual food cues (validated computer task) was assessed the next morning. There were no differences in sleep parameters and food 'wanting' between conditions. Decreases in sleep duration and earlier wake-times were significantly associated with increased food 'wanting' between sessions (P = 0.001). However, these associations were no longer significant after controlling for elapsed time between wake-time and the food reward task. These findings suggest that shorter sleep durations and earlier wake-times are associated with increased food reward, but these associations are driven by elapsed time between awakening and completion of the food reward task.

  5. Motivating Intrapreneurs: The Relevance of Rewards

    ERIC Educational Resources Information Center

    de Villiers-Scheepers, M. J.

    2011-01-01

    A challenge faced by management graduates in promoting intrapreneurship to achieve competitive advantage is the use of motivational techniques that build commitment to entrepreneurial behaviour. Despite the acknowledged importance of rewards to encourage innovation, there is surprisingly little empirical evidence to provide guidance on which…

  6. Value Orientation, Organizational Rewards, and Job Satisfaction.

    ERIC Educational Resources Information Center

    Cascio, Wayne F.

    The nationwide sales force (N=540) of a large food and beverage firm responded to a mail survey designed to investigate the role of value orientation as a moderator of the relationship between organizational rewards and job satisfaction. Of the two main elements in the investigation, the first was concerned with the predictive efficiency of two…

  7. Anticipated Reward Enhances Offline Learning during Sleep

    ERIC Educational Resources Information Center

    Fischer, Stefan; Born, Jan

    2009-01-01

    Sleep is known to promote the consolidation of motor memories. In everyday life, typically more than 1 isolated motor skill is acquired at a time, and this possibly gives rise to interference during consolidation. Here, it is shown that reward expectancy determines the amount of sleep-dependent memory consolidation. Subjects were trained on 2…

  8. Associations between sleep parameters and food reward.

    PubMed

    McNeil, Jessica; Cadieux, Sébastien; Finlayson, Graham; Blundell, John E; Doucet, Éric

    2015-06-01

    This study examined the effects of acute, isocaloric aerobic and resistance exercise on different sleep parameters, and whether changes in these sleep parameters between sessions were related to next morning food reward. Fourteen men and women (age: 21.9 ± 2.7 years; body mass index: 22.7 ± 1.9 kg m(-) ²) participated in three randomized crossover sessions: aerobic exercise; resistance exercise; and sedentary control. Target exercise energy expenditure was matched at 4 kcal kg(-1) of body weight, and performed at 70% of VO2peak or 70% of 1 repetition-maximal. Sleep was measured (accelerometry) for 22 h following each session. The 'wanting' for visual food cues (validated computer task) was assessed the next morning. There were no differences in sleep parameters and food 'wanting' between conditions. Decreases in sleep duration and earlier wake-times were significantly associated with increased food 'wanting' between sessions (P = 0.001). However, these associations were no longer significant after controlling for elapsed time between wake-time and the food reward task. These findings suggest that shorter sleep durations and earlier wake-times are associated with increased food reward, but these associations are driven by elapsed time between awakening and completion of the food reward task. PMID:25644582

  9. Volunteer Motivations and Rewards: Shaping Future Programs.

    ERIC Educational Resources Information Center

    McClam, Tricia

    Volunteerism is increasing today and helps to fill in the gaps created by funding and staff cutbacks in service-oriented agencies. It is critical not only to recruit new volunteers but to retain volunteers. This study examines hospice volunteers for motivation and rewards. Previous studies have found motivations to include altruism and…

  10. Utilizing reward systems to mobilize change.

    PubMed

    Wilson, T B

    1995-01-01

    The pressures for change in health care organizations mean that people need to do things differently. Reward systems offer an opportunity to share in the success of the enterprise if they are designed and managed effectively. This article shows how and why they work. Case studies illustrate the key principles in action.

  11. Addiction and brain reward and antireward pathways.

    PubMed

    Gardner, Eliot L

    2011-01-01

    Addictive drugs have in common that they are voluntarily self-administered by laboratory animals (usually avidly), and that they enhance the functioning of the reward circuitry of the brain (producing the 'high' that the drug user seeks). The core reward circuitry consists of an 'in-series' circuit linking the ventral tegmental area, nucleus accumbens and ventral pallidum via the medial forebrain bundle. Although originally believed to simply encode the set point of hedonic tone, these circuits are now believed to be functionally far more complex, also encoding attention, expectancy of reward, disconfirmation of reward expectancy, and incentive motivation. 'Hedonic dysregulation' within these circuits may lead to addiction. The 'second-stage' dopaminergic component in this reward circuitry is the crucial addictive-drug-sensitive component. All addictive drugs have in common that they enhance (directly or indirectly or even transsynaptically) dop-aminergic reward synaptic function in the nucleus accumbens. Drug self-administration is regulated by nucleus accumbens dopamine levels, and is done to keep nucleus accumbens dopamine within a specific elevated range (to maintain a desired hedonic level). For some classes of addictive drugs (e.g. opiates), tolerance to the euphoric effects develops with chronic use. Postuse dysphoria then comes to dominate reward circuit hedonic tone, and addicts no longer use drugs to get high, but simply to get back to normal ('get straight'). The brain circuits mediating the pleasurable effects of addictive drugs are anatomically, neurophysiologically and neurochemically different from those mediating physical dependence, and from those mediating craving and relapse. There are important genetic variations in vulnerability to drug addiction, yet environmental factors such as stress and social defeat also alter brain-reward mechanisms in such a manner as to impart vulnerability to addiction. In short, the 'bio-psycho-social' model of

  12. Reward Allocation and Academic versus Social Orientation toward School.

    ERIC Educational Resources Information Center

    Peterson, Candida C.; Peterson, James L.

    1978-01-01

    Correlates 138 elementary school children's views about the purposes of school to their styles of reward allocation: academically motivated students allocated rewards equally to two hypothetical performers who had unequally helped a teacher perform a manual chore, while socially motivated children allocated rewards in an equity (performance-based)…

  13. Motivating Inhibition--Reward Prospect Speeds up Response Cancellation

    ERIC Educational Resources Information Center

    Boehler, Carsten N.; Hopf, Jens-Max; Stoppel, Christian M.; Krebs, Ruth M.

    2012-01-01

    Reward prospect has been demonstrated to facilitate various cognitive and behavioral operations, particularly by enhancing the speed and vigor of processes linked to approaching reward. Studies in this domain typically employed task regimes in which participants' overt responses are facilitated by prospective rewards. In contrast, we demonstrate…

  14. Time, Not Size, Matters for Striatal Reward Predictions to Dopamine.

    PubMed

    Burke, Christopher J; Tobler, Philippe N

    2016-07-01

    Midbrain dopamine neurons encode reward prediction errors. In this issue of Neuron, Takahashi et al. (2016) show that the ventral striatum provides dopamine neurons with prediction information specific to the timing, but not the quantity, of reward, suggesting a surprisingly nuanced neural implementation of reward prediction errors. PMID:27387646

  15. Neural response to reward anticipation is modulated by Gray's impulsivity.

    PubMed

    Hahn, Tim; Dresler, Thomas; Ehlis, Ann-Christine; Plichta, Michael M; Heinzel, Sebastian; Polak, Thomas; Lesch, Klaus-Peter; Breuer, Felix; Jakob, Peter M; Fallgatter, Andreas J

    2009-07-15

    According to the Reinforcement Sensitivity Theory (RST), Gray's dimension of impulsivity, reflecting human trait reward sensitivity, determines the extent to which stimuli activate the Behavioural Approach System (BAS). The potential neural underpinnings of the BAS, however, remain poorly understood. In the present study, we examined the association between Gray's impulsivity as defined by the RST and event-related fMRI BOLD-response to anticipation of reward in twenty healthy human subjects in brain regions previously associated with reward processing. Anticipation of reward during a Monetary Incentive Delay Task elicited activation in key components of the human reward circuitry such as the ventral striatum, the amygdala and the orbitofrontal cortex. Interindividual differences in Gray's impulsivity accounted for a significant amount of variance of the reward-related BOLD-response in the ventral striatum and the orbitofrontal cortex. Specifically, higher trait reward sensitivity was associated with increased activation in response to cues indicating potential reward. Extending previous evidence, here we show that variance in functional brain activation during anticipation of reward is attributed to interindividual differences regarding Gray's dimension of impulsivity. Thus, trait reward sensitivity contributes to the modulation of responsiveness in major components of the human reward system which thereby display a core property of the BAS. Generally, fostering our understanding of the neural underpinnings of the association of reward-related interindividual differences in affective traits might aid researchers in quest for custom-tailored treatments of psychiatric disorders, further disentangling the complex relationship between personality traits, emotion, and health.

  16. Modeling the Effect of Reward Amount on Probability Discounting

    ERIC Educational Resources Information Center

    Myerson, Joel; Green, Leonard; Morris, Joshua

    2011-01-01

    The present study with college students examined the effect of amount on the discounting of probabilistic monetary rewards. A hyperboloid function accurately described the discounting of hypothetical rewards ranging in amount from $20 to $10,000,000. The degree of discounting increased continuously with amount of probabilistic reward. This effect…

  17. Delay Discounting of Reward in ADHD: Application in Young Children

    ERIC Educational Resources Information Center

    Wilson, Vanessa B.; Mitchell, Suzanne H.; Musser, Erica D.; Schmitt, Colleen F.; Nigg, Joel T.

    2011-01-01

    Background: A key underlying process that may contribute to attention-deficit/hyperactivity disorder (ADHD) involves alterations in reward evaluation, including assessing the relative value of immediate over delayed rewards. This study examines whether children with ADHD discount the value of delayed rewards to a greater degree than typically…

  18. Reward Circuitry Function in Autism during Face Anticipation and Outcomes

    ERIC Educational Resources Information Center

    Dichter, Gabriel S.; Richey, J. Anthony; Rittenberg, Alison M.; Sabatino, Antoinette; Bodfish, James W.

    2012-01-01

    The aim of this study was to investigate reward circuitry responses in autism during reward anticipation and outcomes for monetary and social rewards. During monetary anticipation, participants with autism spectrum disorders (ASDs) showed hypoactivation in right nucleus accumbens and hyperactivation in right hippocampus, whereas during monetary…

  19. Reward Improves Cancellation and Restraint Inhibition Across Childhood and Adolescence

    PubMed Central

    Sinopoli, Katia J.; Schachar, Russell; Dennis, Maureen

    2011-01-01

    Inhibitory control allows for the regulation of thought and action, and interacts with motivational variables, such as reward, to modify behavior adaptively as environments change. We examined the effects of reward on two distinct forms of inhibitory control, cancellation and restraint. Typically developing children and adolescents completed two versions of the stop signal task (cancellation and restraint) under three reward conditions (neutral, low reward, and high reward), where rewards were earned for successful inhibitory control. Rewards improved both cancellation and restraint inhibition, with similar effects of reward on each form of inhibitory control. Rewards did not alter the speed of response execution in either task, suggesting that rewards specifically altered inhibition processes without influencing processes related to response execution. Adolescents were faster and less variable than children when executing and inhibiting their responses. There were similar developmental effects of reward on the speed of inhibitory control, but group differences were found in terms of accuracy of inhibition in the restraint task. These results clarify how reward modulates two different forms of regulatory behavior in children and adolescents. PMID:21744952

  20. Reward Allocation among Chinese High School Students in Hong Kong.

    ERIC Educational Resources Information Center

    Chiu, Chi-Yue

    1989-01-01

    Examined effects of personality and performance on reward allocation. Subjects were 89 Hong Kong senior high school students. Results showed that the subjects took into consideration the recipient's personality when they allocated reward to a relatively low performer. Personality was not a factor in allocation of reward to a high performer. (GG)

  1. 28 CFR 13.6 - Criteria for reward.

    Code of Federal Regulations, 2014 CFR

    2014-07-01

    ... Judicial Administration DEPARTMENT OF JUSTICE ATOMIC WEAPONS AND SPECIAL NUCLEAR MATERIALS REWARDS... reward under the Atomic Weapons and Special Nuclear Materials Rewards Act must be original, and must..., acquire or export special nuclear material or atomic weapons, or (5) Loss, diversion or disposal...

  2. 28 CFR 13.6 - Criteria for reward.

    Code of Federal Regulations, 2012 CFR

    2012-07-01

    ... Judicial Administration DEPARTMENT OF JUSTICE ATOMIC WEAPONS AND SPECIAL NUCLEAR MATERIALS REWARDS... reward under the Atomic Weapons and Special Nuclear Materials Rewards Act must be original, and must..., acquire or export special nuclear material or atomic weapons, or (5) Loss, diversion or disposal...

  3. 28 CFR 13.6 - Criteria for reward.

    Code of Federal Regulations, 2011 CFR

    2011-07-01

    ... Judicial Administration DEPARTMENT OF JUSTICE ATOMIC WEAPONS AND SPECIAL NUCLEAR MATERIALS REWARDS... reward under the Atomic Weapons and Special Nuclear Materials Rewards Act must be original, and must..., acquire or export special nuclear material or atomic weapons, or (5) Loss, diversion or disposal...

  4. 28 CFR 13.6 - Criteria for reward.

    Code of Federal Regulations, 2013 CFR

    2013-07-01

    ... Judicial Administration DEPARTMENT OF JUSTICE ATOMIC WEAPONS AND SPECIAL NUCLEAR MATERIALS REWARDS... reward under the Atomic Weapons and Special Nuclear Materials Rewards Act must be original, and must..., acquire or export special nuclear material or atomic weapons, or (5) Loss, diversion or disposal...

  5. Should Rewards Have a Place in Early Childhood Programs?

    ERIC Educational Resources Information Center

    Shiller, Virginia M.; O'Flynn, Janet C.; Reineke, June; Sonsteng, Kathleen; Gartrell, Dan

    2008-01-01

    Does the use of rewards to motivate children to learn or to follow classroom rules run counter to fostering a true desire for mastery? This column, which consists of two separate articles, provides the opposing opinions of the authors regarding the appropriateness of giving rewards in an early childhood classroom. In "Using Rewards in the Early…

  6. Rewards, Intrinsic Motivation, and Achievement in Intact Classrooms

    ERIC Educational Resources Information Center

    Luis, Melissa Ann

    2011-01-01

    The purpose of this study was to examine the effects of performance-contingent rewards in a real-world setting, namely the sixth grade math classroom. This study is significant in that it represents a field study on the effects of rewards in the classroom. The purpose of this study was to investigate what effect, if any, the choice of a reward had…

  7. 28 CFR 13.6 - Criteria for reward.

    Code of Federal Regulations, 2010 CFR

    2010-07-01

    ... Judicial Administration DEPARTMENT OF JUSTICE ATOMIC WEAPONS AND SPECIAL NUCLEAR MATERIALS REWARDS... reward under the Atomic Weapons and Special Nuclear Materials Rewards Act must be original, and must..., acquire or export special nuclear material or atomic weapons, or (5) Loss, diversion or disposal...

  8. Rewards versus Learning: A Response to Paul Chance.

    ERIC Educational Resources Information Center

    Kohn, Alfie

    1993-01-01

    Responding to Paul Chance's November 1992 "Kappan" article on motivational value of rewards, this article argues that manipulating student behavior with either punishments or rewards is unnecessary and counterproductive. Extrinsic rewards can never buy more than short-term compliance because they are inherently controlling and ineffective and make…

  9. Agent Reward Shaping for Alleviating Traffic Congestion

    NASA Technical Reports Server (NTRS)

    Tumer, Kagan; Agogino, Adrian

    2006-01-01

    Traffic congestion problems provide a unique environment to study how multi-agent systems promote desired system level behavior. What is particularly interesting in this class of problems is that no individual action is intrinsically "bad" for the system but that combinations of actions among agents lead to undesirable outcomes, As a consequence, agents need to learn how to coordinate their actions with those of other agents, rather than learn a particular set of "good" actions. This problem is ubiquitous in various traffic problems, including selecting departure times for commuters, routes for airlines, and paths for data routers. In this paper we present a multi-agent approach to two traffic problems, where far each driver, an agent selects the most suitable action using reinforcement learning. The agent rewards are based on concepts from collectives and aim to provide the agents with rewards that are both easy to learn and that if learned, lead to good system level behavior. In the first problem, we study how agents learn the best departure times of drivers in a daily commuting environment and how following those departure times alleviates congestion. In the second problem, we study how agents learn to select desirable routes to improve traffic flow and minimize delays for. all drivers.. In both sets of experiments,. agents using collective-based rewards produced near optimal performance (93-96% of optimal) whereas agents using system rewards (63-68%) barely outperformed random action selection (62-64%) and agents using local rewards (48-72%) performed worse than random in some instances.

  10. Dopamine in the Brain: Hypothesizing Surfeit or Deficit Links to Reward and Addiction

    PubMed Central

    Blum, Kenneth; Thanos, Peter K.; Oscar-Berman, Marlene; Febo, Marcelo; Baron, David; Badgaiyan, Rajendra D.; Gardner, Eliot; Demetrovics, Zsolt; Fahlke, Claudia; Haberstick, Brett C.; Dushaj, Kristina; Gold, Mark S.

    2016-01-01

    Recently there has been debate concerning the role of brain dopamine in reward and addiction. David Nutt and associates eloquently proposed that dopamine (DA) may be central to psycho stimulant dependence and some what important for alcohol, but not important for opiates, nicotine or even cannabis. Others have also argued that surfeit theories can explain for example cocaine seeking behavior as well as non-substance-related addictive behaviors. It seems prudent to distinguish between what constitutes “surfeit” compared to” deficit” in terms of short-term (acute) and long-term (chronic) brain reward circuitry responsivity. In an attempt to resolve controversy regarding the contributions of mesolimbic DA systems to reward, we review the three main competing explanatory categories: “liking”, “learning”, and “wanting”. They are (a) the hedonic impact -liking reward, (b) the ability to predict rewarding effects-learning and (c) the incentive salience of reward-related stimuli -wanting. In terms of acute effects, most of the evidence seems to favor the “surfeit theory”. Due to preferential dopamine release at mesolimbic-VTA-caudate-accumbens loci most drugs of abuse and Reward Deficiency Syndrome (RDS) behaviors have been linked to heightened feelings of well-being and hyperdopaminergic states.The “dopamine hypotheses” originally thought to be simple, is now believed to be quite complex and involves encoding the set point of hedonic tone, encoding attention, reward expectancy, and incentive motivation. Importantly, Willuhn et al. shows that in a self-administration paradigm, (chronic) excessive use of cocaine is caused by decreased phasic dopamine signaling in the striatum. In terms of chronic addictions, others have shown a blunted responsivity at brain reward sites with food, nicotine, and even gambling behavior. Finally, we are cognizant of the differences in dopaminergic function as addiction progresses and argue that relapse may be tied

  11. Dopamine and glucose, obesity, and reward deficiency syndrome.

    PubMed

    Blum, Kenneth; Thanos, Panayotis K; Gold, Mark S

    2014-01-01

    Obesity as a result of overeating as well as a number of well described eating disorders has been accurately considered to be a world-wide epidemic. Recently a number of theories backed by a plethora of scientifically sound neurochemical and genetic studies provide strong evidence that food addiction is similar to psychoactive drug addiction. Our laboratory has published on the concept known as Reward Deficiency Syndrome (RDS) which is a genetic and epigenetic phenomena leading to impairment of the brain reward circuitry resulting in a hypo-dopaminergic function. RDS involves the interactions of powerful neurotransmitters and results in abnormal craving behavior. A number of important facts which could help translate to potential therapeutic targets espoused in this focused review include: (1) consumption of alcohol in large quantities or carbohydrates binging stimulates the brain's production of and utilization of dopamine; (2) in the meso-limbic system the enkephalinergic neurons are in close proximity, to glucose receptors; (3) highly concentrated glucose activates the calcium channel to stimulate dopamine release from P12 cells; (4) a significant correlation between blood glucose and cerebrospinal fluid concentrations of homovanillic acid the dopamine metabolite; (5) 2-deoxyglucose (2DG), the glucose analog, in pharmacological doses is associated with enhanced dopamine turnover and causes acute glucoprivation. Evidence from animal studies and fMRI in humans support the hypothesis that multiple, but similar brain circuits are disrupted in obesity and drug dependence and for the most part, implicate the involvement of DA-modulated reward circuits in pathologic eating behaviors. Based on a consensus of neuroscience research treatment of both glucose and drug like cocaine, opiates should incorporate dopamine agonist therapy in contrast to current theories and practices that utilizes dopamine antagonistic therapy. Considering that up until now clinical utilization

  12. Dopamine and glucose, obesity, and reward deficiency syndrome

    PubMed Central

    Blum, Kenneth; Thanos, Panayotis K.; Gold, Mark S.

    2014-01-01

    Obesity as a result of overeating as well as a number of well described eating disorders has been accurately considered to be a world-wide epidemic. Recently a number of theories backed by a plethora of scientifically sound neurochemical and genetic studies provide strong evidence that food addiction is similar to psychoactive drug addiction. Our laboratory has published on the concept known as Reward Deficiency Syndrome (RDS) which is a genetic and epigenetic phenomena leading to impairment of the brain reward circuitry resulting in a hypo-dopaminergic function. RDS involves the interactions of powerful neurotransmitters and results in abnormal craving behavior. A number of important facts which could help translate to potential therapeutic targets espoused in this focused review include: (1) consumption of alcohol in large quantities or carbohydrates binging stimulates the brain’s production of and utilization of dopamine; (2) in the meso-limbic system the enkephalinergic neurons are in close proximity, to glucose receptors; (3) highly concentrated glucose activates the calcium channel to stimulate dopamine release from P12 cells; (4) a significant correlation between blood glucose and cerebrospinal fluid concentrations of homovanillic acid the dopamine metabolite; (5) 2-deoxyglucose (2DG), the glucose analog, in pharmacological doses is associated with enhanced dopamine turnover and causes acute glucoprivation. Evidence from animal studies and fMRI in humans support the hypothesis that multiple, but similar brain circuits are disrupted in obesity and drug dependence and for the most part, implicate the involvement of DA-modulated reward circuits in pathologic eating behaviors. Based on a consensus of neuroscience research treatment of both glucose and drug like cocaine, opiates should incorporate dopamine agonist therapy in contrast to current theories and practices that utilizes dopamine antagonistic therapy. Considering that up until now clinical utilization

  13. Behavioral reactions reflecting differential reward expectations in monkeys.

    PubMed

    Watanabe, M; Cromwell, H C; Tremblay, L; Hollerman, J R; Hikosaka, K; Schultz, W

    2001-10-01

    Learning theory emphasizes the importance of expectations in the control of instrumental action. This study investigated the variation of behavioral reactions toward different rewards as an expression of differential expectations of outcomes in primates. We employed several versions of two basic behavioral paradigms, the spatial delayed response task and the delayed reaction task. These tasks are commonly used in neurobiological studies of working memory, movement preparation, and event expectation involving the frontal cortex and basal ganglia. An initial visual instruction stimulus indicated to the animal which one of several food or liquid rewards would be delivered after each correct behavioral response, or whether or not a reward could be obtained. We measured the reaction times of the operantly conditioned arm movement necessary for obtaining the reward, and the durations of anticipatory licking prior to liquid reward delivery as a Pavlovian conditioned response. The results showed that both measures varied depending on the reward predicted by the initial instruction. Arm movements were performed with significantly shorter reaction times for foods or liquids that were more preferred by the animal than for less preferred ones. Still larger differences were observed between rewarded and unrewarded trials. An interesting effect was found in unrewarded trials, in which reaction times were significantly shorter when a highly preferred reward was delivered in the alternative rewarded trials of the same trial block as compared to a less preferred reward. Anticipatory licks preceding the reward were significantly longer when highly preferred rather than less preferred rewards, or no rewards, were predicted. These results demonstrate that behavioral reactions preceding rewards may vary depending on the predicted future reward and suggest that monkeys differentially expect particular outcomes in the presently investigated tasks.

  14. Neural Processing of Calories in Brain Reward Areas Can be Modulated by Reward Sensitivity

    PubMed Central

    van Rijn, Inge; Griffioen-Roose, Sanne; de Graaf, Cees; Smeets, Paul A. M.

    2016-01-01

    A food's reward value is dependent on its caloric content. Furthermore, a food's acute reward value also depends on hunger state. The drive to obtain rewards (reward sensitivity), however, differs between individuals. Here, we assessed the association between brain responses to calories in the mouth and trait reward sensitivity in different hunger states. Firstly, we assessed this in data from a functional neuroimaging study (van Rijn et al., 2015), in which participants (n = 30) tasted simple solutions of a non-caloric sweetener with or without a non-sweet carbohydrate (maltodextrin) during hunger and satiety. Secondly, we expanded these analyses to regular drinks by assessing the same relationship in data from a study in which soft drinks sweetened with either sucrose or a non-caloric sweetener were administered during hunger (n = 18) (Griffioen-Roose et al., 2013). First, taste activation by the non-caloric solution/soft drink was subtracted from that by the caloric solution/soft drink to eliminate sweetness effects and retain activation induced by calories. Subsequently, this difference in taste activation was correlated with reward sensitivity as measured with the BAS drive subscale of the Behavioral Activation System (BAS) questionnaire. When participants were hungry and tasted calories from the simple solution, brain activation in the right ventral striatum (caudate), right amygdala and anterior cingulate cortex (bilaterally) correlated negatively with BAS drive scores. In contrast, when participants were satiated, taste responses correlated positively with BAS drive scores in the left caudate. These results were not replicated for soft drinks. Thus, neural responses to oral calories from maltodextrin were modulated by reward sensitivity in reward-related brain areas. This was not the case for sucrose. This may be due to the direct detection of maltodextrin, but not sucrose in the oral cavity. Also, in a familiar beverage, detection of calories per se may be

  15. Finding intrinsic rewards by embodied evolution and constrained reinforcement learning.

    PubMed

    Uchibe, Eiji; Doya, Kenji

    2008-12-01

    Understanding the design principle of reward functions is a substantial challenge both in artificial intelligence and neuroscience. Successful acquisition of a task usually requires not only rewards for goals, but also for intermediate states to promote effective exploration. This paper proposes a method for designing 'intrinsic' rewards of autonomous agents by combining constrained policy gradient reinforcement learning and embodied evolution. To validate the method, we use Cyber Rodent robots, in which collision avoidance, recharging from battery packs, and 'mating' by software reproduction are three major 'extrinsic' rewards. We show in hardware experiments that the robots can find appropriate 'intrinsic' rewards for the vision of battery packs and other robots to promote approach behaviors.

  16. Food reward system: current perspectives and future research needs.

    PubMed

    Alonso-Alonso, Miguel; Woods, Stephen C; Pelchat, Marcia; Grigson, Patricia Sue; Stice, Eric; Farooqi, Sadaf; Khoo, Chor San; Mattes, Richard D; Beauchamp, Gary K

    2015-05-01

    This article reviews current research and cross-disciplinary perspectives on the neuroscience of food reward in animals and humans, examines the scientific hypothesis of food addiction, discusses methodological and terminology challenges, and identifies knowledge gaps and future research needs. Topics addressed herein include the role of reward and hedonic aspects in the regulation of food intake, neuroanatomy and neurobiology of the reward system in animals and humans, responsivity of the brain reward system to palatable foods and drugs, translation of craving versus addiction, and cognitive control of food reward. The content is based on a workshop held in 2013 by the North American Branch of the International Life Sciences Institute. PMID:26011903

  17. Receipt of reward leads to altered estimation of effort.

    PubMed

    Pooresmaeili, Arezoo; Wannig, Aurel; Dolan, Raymond J

    2015-10-27

    Effort and reward jointly shape many human decisions. Errors in predicting the required effort needed for a task can lead to suboptimal behavior. Here, we show that effort estimations can be biased when retrospectively reestimated following receipt of a rewarding outcome. These biases depend on the contingency between reward and task difficulty and are stronger for highly contingent rewards. Strikingly, the observed pattern accords with predictions from Bayesian cue integration, indicating humans deploy an adaptive and rational strategy to deal with inconsistencies between the efforts they expend and the ensuing rewards. PMID:26460026

  18. Food reward system: current perspectives and future research needs.

    PubMed

    Alonso-Alonso, Miguel; Woods, Stephen C; Pelchat, Marcia; Grigson, Patricia Sue; Stice, Eric; Farooqi, Sadaf; Khoo, Chor San; Mattes, Richard D; Beauchamp, Gary K

    2015-05-01

    This article reviews current research and cross-disciplinary perspectives on the neuroscience of food reward in animals and humans, examines the scientific hypothesis of food addiction, discusses methodological and terminology challenges, and identifies knowledge gaps and future research needs. Topics addressed herein include the role of reward and hedonic aspects in the regulation of food intake, neuroanatomy and neurobiology of the reward system in animals and humans, responsivity of the brain reward system to palatable foods and drugs, translation of craving versus addiction, and cognitive control of food reward. The content is based on a workshop held in 2013 by the North American Branch of the International Life Sciences Institute.

  19. Receipt of reward leads to altered estimation of effort

    PubMed Central

    Pooresmaeili, Arezoo; Wannig, Aurel; Dolan, Raymond J.

    2015-01-01

    Effort and reward jointly shape many human decisions. Errors in predicting the required effort needed for a task can lead to suboptimal behavior. Here, we show that effort estimations can be biased when retrospectively reestimated following receipt of a rewarding outcome. These biases depend on the contingency between reward and task difficulty and are stronger for highly contingent rewards. Strikingly, the observed pattern accords with predictions from Bayesian cue integration, indicating humans deploy an adaptive and rational strategy to deal with inconsistencies between the efforts they expend and the ensuing rewards. PMID:26460026

  20. Food reward system: current perspectives and future research needs

    PubMed Central

    Woods, Stephen C.; Pelchat, Marcia; Grigson, Patricia Sue; Stice, Eric; Farooqi, Sadaf; Khoo, Chor San; Mattes, Richard D.; Beauchamp, Gary K.

    2015-01-01

    This article reviews current research and cross-disciplinary perspectives on the neuroscience of food reward in animals and humans, examines the scientific hypothesis of food addiction, discusses methodological and terminology challenges, and identifies knowledge gaps and future research needs. Topics addressed herein include the role of reward and hedonic aspects in the regulation of food intake, neuroanatomy and neurobiology of the reward system in animals and humans, responsivity of the brain reward system to palatable foods and drugs, translation of craving versus addiction, and cognitive control of food reward. The content is based on a workshop held in 2013 by the North American Branch of the International Life Sciences Institute. PMID:26011903

  1. Associations among smoking, anhedonia, and reward learning in depression.

    PubMed

    Liverant, Gabrielle I; Sloan, Denise M; Pizzagalli, Diego A; Harte, Christopher B; Kamholz, Barbara W; Rosebrock, Laina E; Cohen, Andrew L; Fava, Maurizio; Kaplan, Gary B

    2014-09-01

    Depression and cigarette smoking co-occur at high rates. However, the etiological mechanisms that contribute to this relationship remain unclear. Anhedonia and associated impairments in reward learning are key features of depression, which also have been linked to the onset and maintenance of cigarette smoking. However, few studies have investigated differences in anhedonia and reward learning among depressed smokers and depressed nonsmokers. The goal of this study was to examine putative differences in anhedonia and reward learning in depressed smokers (n=36) and depressed nonsmokers (n=44). To this end, participants completed self-report measures of anhedonia and behavioral activation (BAS reward responsiveness scores) and as well as a probabilistic reward task rooted in signal detection theory, which measures reward learning (Pizzagalli, Jahn, & O'Shea, 2005). When considering self-report measures, depressed smokers reported higher trait anhedonia and reduced BAS reward responsiveness scores compared to depressed nonsmokers. In contrast to self-report measures, nicotine-satiated depressed smokers demonstrated greater acquisition of reward-based learning compared to depressed nonsmokers as indexed by the probabilistic reward task. Findings may point to a potential mechanism underlying the frequent co-occurrence of smoking and depression. These results highlight the importance of continued investigation of the role of anhedonia and reward system functioning in the co-occurrence of depression and nicotine abuse. Results also may support the use of treatments targeting reward learning (e.g., behavioral activation) to enhance smoking cessation among individuals with depression.

  2. A neuronal reward inequity signal in primate striatum

    PubMed Central

    van Coeverden, Charlotte R.; Schultz, Wolfram

    2015-01-01

    Primates are social animals, and their survival depends on social interactions with others. Especially important for social interactions and welfare is the observation of rewards obtained by other individuals and the comparison with own reward. The fundamental social decision variable for the comparison process is reward inequity, defined by an asymmetric reward distribution among individuals. An important brain structure for coding reward inequity may be the striatum, a component of the basal ganglia involved in goal-directed behavior. Two rhesus monkeys were seated opposite each other and contacted a touch-sensitive table placed between them to obtain specific magnitudes of reward that were equally or unequally distributed among them. Response times in one of the animals demonstrated differential behavioral sensitivity to reward inequity. A group of neurons in the striatum showed distinct signals reflecting disadvantageous and advantageous reward inequity. These neuronal signals occurred irrespective of, or in conjunction with, own reward coding. These data demonstrate that striatal neurons of macaque monkeys sense the differences between other's and own reward. The neuronal activities are likely to contribute crucial reward information to neuronal mechanisms involved in social interactions. PMID:26378202

  3. The cerebellum is involved in reward-based reversal learning.

    PubMed

    Thoma, Patrizia; Bellebaum, Christian; Koch, Benno; Schwarz, Michael; Daum, Irene

    2008-01-01

    The cerebellum has recently been discussed in terms of a possible involvement in reward-based associative learning. To clarify the cerebellar contribution, eight patients with focal vascular lesions of the cerebellum and a group of 24 healthy subjects matched for age and IQ were compared on a range of different probabilistic outcome-based associative learning tasks, assessing acquisition, reversal, cognitive transfer, and generalization as well as the effect of reward magnitude. Cerebellar patients showed intact acquisition of stimulus contingencies, while reward-based reversal learning was significantly impaired. In addition, the patients showed slower acquisition of new stimulus contingencies in a second reward-based learning task, which might reflect reduced carry-over effects. Reward magnitude affected learning only during initial acquisition, with better learning on trials with high rewards in patients and control subjects. Overall, the findings suggest that the cerebellum is implicated in reversal learning as a dissociable component of reward-based learning. PMID:18592331

  4. Prefrontal cortex mediation of cognitive enhancement in rewarding motivational contexts.

    PubMed

    Jimura, Koji; Locke, Hannah S; Braver, Todd S

    2010-05-11

    Increasing the reward value of behavioral goals can facilitate cognitive processes required for goal achievement. This facilitation may be accomplished by the dynamic and flexible engagement of cognitive control mechanisms operating in distributed brain regions. It is still not clear, however, what are the characteristics of individuals, situations, and neural activation dynamics that optimize motivation-linked cognitive enhancement. Here we show that highly reward-sensitive individuals exhibited greater improvement of working memory performance in rewarding contexts, but exclusively on trials that were not rewarded. This effect was mediated by a shift in the temporal dynamics of activation within right lateral prefrontal cortex, from a transient to predominantly tonic mode, with an additional anticipatory transient boost. In contexts with intermittent rewards, a strategy of proactive cognitive control may enable globally optimal performance to facilitate reward attainment. Reward-sensitive individuals appear preferentially motivated to adopt this resource-demanding strategy, resulting in paradoxical benefits selectively for nonrewarded events.

  5. Orquestic regulation of neurotransmitters on reward-seeking behavior.

    PubMed

    Arias-Carrión, Oscar; Caraza-Santiago, Xanic; Salgado-Licona, Sergio; Salama, Mohamed; Machado, Sergio; Nardi, Antonio Egidio; Menéndez-González, Manuel; Murillo-Rodríguez, Eric

    2014-01-01

    The ventral tegmental area is strongly associated with the reward system. Dopamine is released in areas such as the nucleus accumbens and prefrontal cortex as a result of rewarding experiences such as food, sex, and neutral stimuli that become associated with them. Electrical stimulation of the ventral tegmental area or its output pathways can itself serve as a potent reward. Different drugs that increase dopamine levels are intrinsically rewarding. Although the dopaminergic system represent the cornerstone of the reward system, other neurotransmitters such as endogenous opioids, glutamate, γ-Aminobutyric acid, acetylcholine, serotonin, adenosine, endocannabinoids, orexins, galanin and histamine all affect this mesolimbic dopaminergic system. Consequently, genetic variations of neurotransmission are thought influence reward processing that in turn may affect distinctive social behavior and susceptibility to addiction. Here, we discuss current evidence on the orquestic regulation of different neurotranmitters on reward-seeking behavior and its potential effect on drug addiction. PMID:25061480

  6. Orquestic regulation of neurotransmitters on reward-seeking behavior.

    PubMed

    Arias-Carrión, Oscar; Caraza-Santiago, Xanic; Salgado-Licona, Sergio; Salama, Mohamed; Machado, Sergio; Nardi, Antonio Egidio; Menéndez-González, Manuel; Murillo-Rodríguez, Eric

    2014-01-01

    The ventral tegmental area is strongly associated with the reward system. Dopamine is released in areas such as the nucleus accumbens and prefrontal cortex as a result of rewarding experiences such as food, sex, and neutral stimuli that become associated with them. Electrical stimulation of the ventral tegmental area or its output pathways can itself serve as a potent reward. Different drugs that increase dopamine levels are intrinsically rewarding. Although the dopaminergic system represent the cornerstone of the reward system, other neurotransmitters such as endogenous opioids, glutamate, γ-Aminobutyric acid, acetylcholine, serotonin, adenosine, endocannabinoids, orexins, galanin and histamine all affect this mesolimbic dopaminergic system. Consequently, genetic variations of neurotransmission are thought influence reward processing that in turn may affect distinctive social behavior and susceptibility to addiction. Here, we discuss current evidence on the orquestic regulation of different neurotranmitters on reward-seeking behavior and its potential effect on drug addiction.

  7. Orquestic regulation of neurotransmitters on reward-seeking behavior

    PubMed Central

    2014-01-01

    The ventral tegmental area is strongly associated with the reward system. Dopamine is released in areas such as the nucleus accumbens and prefrontal cortex as a result of rewarding experiences such as food, sex, and neutral stimuli that become associated with them. Electrical stimulation of the ventral tegmental area or its output pathways can itself serve as a potent reward. Different drugs that increase dopamine levels are intrinsically rewarding. Although the dopaminergic system represent the cornerstone of the reward system, other neurotransmitters such as endogenous opioids, glutamate, γ-Aminobutyric acid, acetylcholine, serotonin, adenosine, endocannabinoids, orexins, galanin and histamine all affect this mesolimbic dopaminergic system. Consequently, genetic variations of neurotransmission are thought influence reward processing that in turn may affect distinctive social behavior and susceptibility to addiction. Here, we discuss current evidence on the orquestic regulation of different neurotranmitters on reward-seeking behavior and its potential effect on drug addiction. PMID:25061480

  8. Reward system and temporal pole contributions to affective evaluation during a first person shooter video game

    PubMed Central

    2011-01-01

    Background Violent content in video games evokes many concerns but there is little research concerning its rewarding aspects. It was demonstrated that playing a video game leads to striatal dopamine release. It is unclear, however, which aspects of the game cause this reward system activation and if violent content contributes to it. We combined functional Magnetic Resonance Imaging (fMRI) with individual affect measures to address the neuronal correlates of violence in a video game. Results Thirteen male German volunteers played a first-person shooter game (Tactical Ops: Assault on Terror) during fMRI measurement. We defined success as eliminating opponents, and failure as being eliminated themselves. Affect was measured directly before and after game play using the Positive and Negative Affect Schedule (PANAS). Failure and success events evoked increased activity in visual cortex but only failure decreased activity in orbitofrontal cortex and caudate nucleus. A negative correlation between negative affect and responses to failure was evident in the right temporal pole (rTP). Conclusions The deactivation of the caudate nucleus during failure is in accordance with its role in reward-prediction error: it occurred whenever subject missed an expected reward (being eliminated rather than eliminating the opponent). We found no indication that violence events were directly rewarding for the players. We addressed subjective evaluations of affect change due to gameplay to study the reward system. Subjects reporting greater negative affect after playing the game had less rTP activity associated with failure. The rTP may therefore be involved in evaluating the failure events in a social context, to regulate the players' mood. PMID:21749711

  9. Dimensional reduction for reward-based learning.

    PubMed

    Swinehart, Christian D; Abbott, L F

    2006-09-01

    Reward-based learning in neural systems is challenging because a large number of parameters that affect network function must be optimized solely on the basis of a reward signal that indicates improved performance. Searching the parameter space for an optimal solution is particularly difficult if the network is large. We show that Hebbian forms of synaptic plasticity applied to synapses between a supervisor circuit and the network it is controlling can effectively reduce the dimension of the space of parameters being searched to support efficient reinforcement-based learning in large networks. The critical element is that the connections between the supervisor units and the network must be reciprocal. Once the appropriate connections have been set up by Hebbian plasticity, a reinforcement-based learning procedure leads to rapid learning in a function approximation task. Hebbian plasticity within the network being supervised ultimately allows the network to perform the task without input from the supervisor.

  10. 'Nursing is the most emotionally rewarding career'.

    PubMed

    Waters, Adele

    This artie presents a brand manifesto for the profession, based on work carried out by consultants Red Spider as part of our Nursing the Future campaign. We have also used the 'redprint' to commission a film that promotes nursing and midwifery. How the work was carried out: --Interviews with a number of experienced 'stakeholder' nurses. --A one-day workshop involving experts from a variety of fields. Findings include: --Nursing needs a modern image. --Nursing is the most emotionally rewarding career. PMID:15835432

  11. Rewarding safe behavior: strategies for change.

    PubMed

    Fell-Carlson, Deborah

    2004-12-01

    Effective, sustainable safety incentives are integrated into a performance management system designed to encourage long term behavior change. Effective incentive program design integrates the fundamental considerations of compensation (i.e., valence, instrumentality, expectancy, equity) with behavior change theory in the context of a strong merit based performance management system. Clear expectations are established and communicated from the time applicants apply for the position. Feedback and social recognition are leveraged and used as rewards, in addition to financial incentives built into the compensation system and offered periodically as short term incentives. Rewards are tied to specific objectives intended to influence specific behaviors. Objectives are designed to challenge employees, providing opportunities to grow and enhance their sense of belonging. Safety contests and other awareness activities are most effective when used to focus safety improvement efforts on specific behaviors or processes, for a predetermined period of time, in the context of a comprehensive safety system. Safety incentive programs designed around injury outcomes can result in unintended, and undesirable, consequences. Safety performance can be leveraged by integrating safety into corporate cultural indicators. Symbols of safety remind employees of corporate safety goals and objectives (e.g., posted safety goals and integrating safety into corporate mission and vision). Rites and ceremonies provide opportunities for social recognition and feedback and demonstrate safety is a corporate value. Feedback opportunities, rewards, and social recognition all provide content for corporate legends, those stories embellished over time, that punctuate the overall system of organizational norms, and provide examples of the organizational safety culture in action.

  12. The value of numbers in economic rewards.

    PubMed

    Kanayet, Frank J; Opfer, John E; Cunningham, William A

    2014-08-01

    Previous work has identified a distributed network of neural systems involved in appraising the value of rewards, such as when winning $100 versus $1. These studies, however, confounded monetary value and the number used to represent it, which leads to the possibility that some elements in the network may be specialized for processing numeric rather than monetary value. To test this hypothesis, we manipulated numeric magnitude and units to construct a range of economic rewards for simple decisions (e.g., 1¢, $1, 100¢, $100). Consistent with previous research in numerical cognition, results showed that blood-oxygen-level-dependent (BOLD) activity in intraparietal sulcus was correlated with changes in numeric magnitude, independent of monetary value, whereas activity in orbitofrontal cortex was correlated with monetary value, independent of numeric magnitude. Finally, region-of-interest analyses revealed that the BOLD response to numeric magnitude, but not monetary value, described a compressive function. Together, these findings highlight the importance of numerical cognition for understanding how the brain processes monetary rewards. PMID:24958687

  13. Studying Food Reward and Motivation in Humans

    PubMed Central

    Ziauddeen, Hisham; Subramaniam, Naresh; Cambridge, Victoria C.; Medic, Nenad; Farooqi, Ismaa Sadaf; Fletcher, Paul C.

    2014-01-01

    A key challenge in studying reward processing in humans is to go beyond subjective self-report measures and quantify different aspects of reward such as hedonics, motivation, and goal value in more objective ways. This is particularly relevant for the understanding of overeating and obesity as well as their potential treatments. In this paper are described a set of measures of food-related motivation using handgrip force as a motivational measure. These methods can be used to examine changes in food related motivation with metabolic (satiety) and pharmacological manipulations and can be used to evaluate interventions targeted at overeating and obesity. However to understand food-related decision making in the complex food environment it is essential to be able to ascertain the reward goal values that guide the decisions and behavioral choices that people make. These values are hidden but it is possible to ascertain them more objectively using metrics such as the willingness to pay and a method for this is described. Both these sets of methods provide quantitative measures of motivation and goal value that can be compared within and between individuals. PMID:24686284

  14. The value of numbers in economic rewards.

    PubMed

    Kanayet, Frank J; Opfer, John E; Cunningham, William A

    2014-08-01

    Previous work has identified a distributed network of neural systems involved in appraising the value of rewards, such as when winning $100 versus $1. These studies, however, confounded monetary value and the number used to represent it, which leads to the possibility that some elements in the network may be specialized for processing numeric rather than monetary value. To test this hypothesis, we manipulated numeric magnitude and units to construct a range of economic rewards for simple decisions (e.g., 1¢, $1, 100¢, $100). Consistent with previous research in numerical cognition, results showed that blood-oxygen-level-dependent (BOLD) activity in intraparietal sulcus was correlated with changes in numeric magnitude, independent of monetary value, whereas activity in orbitofrontal cortex was correlated with monetary value, independent of numeric magnitude. Finally, region-of-interest analyses revealed that the BOLD response to numeric magnitude, but not monetary value, described a compressive function. Together, these findings highlight the importance of numerical cognition for understanding how the brain processes monetary rewards.

  15. Developmental changes in the reward positivity: an electrophysiological trajectory of reward processing.

    PubMed

    Lukie, Carmen N; Montazer-Hojat, Somayyeh; Holroyd, Clay B

    2014-07-01

    Children and adolescents learn to regulate their behavior by utilizing feedback from the environment but exactly how this ability develops remains unclear. To investigate this question, we recorded the event-related brain potential (ERP) from children (8-13 years), adolescents (14-17 years) and young adults (18-23 years) while they navigated a "virtual maze" in pursuit of monetary rewards. The amplitude of the reward positivity, an ERP component elicited by feedback stimuli, was evaluated for each age group. A current theory suggests the reward positivity is produced by the impact of reinforcement learning signals carried by the midbrain dopamine system on anterior cingulate cortex, which utilizes the signals to learn and execute extended behaviors. We found that the three groups produced a reward positivity of comparable size despite relatively longer ERP component latencies for the children, suggesting that the reward processing system reaches maturity early in development. We propose that early development of the midbrain dopamine system facilitates the development of extended goal-directed behaviors in anterior cingulate cortex.

  16. Extinction Can Reduce the Impact of Reward Cues on Reward-Seeking Behavior.

    PubMed

    Lovibond, Peter F; Satkunarajah, Michelle; Colagiuri, Ben

    2015-07-01

    Reward-associated cues are thought to promote relapse after treatment of appetitive disorders such as drug-taking, binge eating, and gambling. This process has been modelled in the laboratory using a Pavlovian-instrumental transfer (PIT) design in which Pavlovian cues facilitate instrumental reward-directed action. Attempts to reduce facilitation by cue exposure (extinction) have produced mixed results. We tested the effect of extinction in a recently developed PIT procedure using a natural reward, chocolate, in human participants. Facilitation of instrumental responding was only observed in participants who were aware of the Pavlovian contingencies. Pavlovian extinction successfully reduced, but did not completely eliminate, expectancy of reward and facilitation of instrumental responding. The results indicate that exposure can reduce the ability of cues to promote reward-directed behavior in the laboratory. However, the residual potency of extinguished cues means that additional active strategies may be needed in clinical practice to train patients to resist the impact of these cues in their environment. PMID:26163708

  17. Baseline reward circuitry activity and trait reward responsiveness predict expression of opioid analgesia in healthy subjects

    PubMed Central

    Wanigasekera, Vishvarani; Lee, Michael C.; Rogers, Richard; Kong, Yazhuo; Leknes, Siri; Andersson, Jesper; Tracey, Irene

    2012-01-01

    Variability in opioid analgesia has been attributed to many factors. For example, genetic variability of the μ-opioid receptor (MOR)-encoding gene introduces variability in MOR function and endogenous opioid neurotransmission. Emerging evidence suggests that personality trait related to the experience of reward is linked to endogenous opioid neurotransmission. We hypothesized that opioid-induced behavioral analgesia would be predicted by the trait reward responsiveness (RWR) and the response of the brain reward circuitry to noxious stimuli at baseline before opioid administration. In healthy volunteers using functional magnetic resonance imaging and the μ-opioid agonist remifentanil, we found that the magnitude of behavioral opioid analgesia is positively correlated with the trait RWR and predicted by the neuronal response to painful noxious stimuli before infusion in key structures of the reward circuitry, such as the orbitofrontal cortex, nucleus accumbens, and the ventral tegmental area. These findings highlight the role of the brain reward circuitry in the expression of behavioral opioid analgesia. We also show a positive correlation between behavioral opioid analgesia and opioid-induced suppression of neuronal responses to noxious stimuli in key structures of the descending pain modulatory system (amygdala, periaqueductal gray, and rostral–ventromedial medulla), as well as the hippocampus. Further, these activity changes were predicted by the preinfusion period neuronal response to noxious stimuli within the ventral tegmentum. These results support the notion of future imaging-based subject-stratification paradigms that can guide therapeutic decisions. PMID:23045652

  18. Striatal dopamine, reward, and decision making in schizophrenia.

    PubMed

    Deserno, Lorenz; Schlagenhauf, Florian; Heinz, Andreas

    2016-03-01

    Elevated striatal dopamine function is one of the best-established findings in schizophrenia. In this review, we discuss causes and consequences of this striata! dopamine alteration. We first summarize earlier findings regarding striatal reward processing and anticipation using functional neuroimaging. Secondly, we present a series of recent studies that are exemplary for a particular research approach: a combination of theory-driven reinforcement learning and decision-making tasks in combination with computational modeling and functional neuroimaging. We discuss why this approach represents a promising tool to understand underlying mechanisms of symptom dimensions by dissecting the contribution of multiple behavioral control systems working in parallel. We also discuss how it can advance our understanding of the neurobiological implementation of such functions. Thirdly, we review evidence regarding the topography of dopamine dysfunction within the striatum. Finally, we present conclusions and outline important aspects to be considered in future studies.

  19. Striatal dopamine, reward, and decision making in schizophrenia.

    PubMed

    Deserno, Lorenz; Schlagenhauf, Florian; Heinz, Andreas

    2016-03-01

    Elevated striatal dopamine function is one of the best-established findings in schizophrenia. In this review, we discuss causes and consequences of this striata! dopamine alteration. We first summarize earlier findings regarding striatal reward processing and anticipation using functional neuroimaging. Secondly, we present a series of recent studies that are exemplary for a particular research approach: a combination of theory-driven reinforcement learning and decision-making tasks in combination with computational modeling and functional neuroimaging. We discuss why this approach represents a promising tool to understand underlying mechanisms of symptom dimensions by dissecting the contribution of multiple behavioral control systems working in parallel. We also discuss how it can advance our understanding of the neurobiological implementation of such functions. Thirdly, we review evidence regarding the topography of dopamine dysfunction within the striatum. Finally, we present conclusions and outline important aspects to be considered in future studies. PMID:27069382

  20. Striatal dopamine, reward, and decision making in schizophrenia

    PubMed Central

    Deserno, Lorenz; Schlagenhauf, Florian; Heinz, Andreas

    2016-01-01

    Elevated striatal dopamine function is one of the best-established findings in schizophrenia. In this review, we discuss causes and consequences of this striata! dopamine alteration. We first summarize earlier findings regarding striatal reward processing and anticipation using functional neuroimaging. Secondly, we present a series of recent studies that are exemplary for a particular research approach: a combination of theory-driven reinforcement learning and decision-making tasks in combination with computational modeling and functional neuroimaging. We discuss why this approach represents a promising tool to understand underlying mechanisms of symptom dimensions by dissecting the contribution of multiple behavioral control systems working in parallel. We also discuss how it can advance our understanding of the neurobiological implementation of such functions. Thirdly, we review evidence regarding the topography of dopamine dysfunction within the striatum. Finally, we present conclusions and outline important aspects to be considered in future studies. PMID:27069382

  1. Reward signals, attempted suicide, and impulsivity in late-life depression.

    PubMed

    Dombrovski, Alexandre Y; Szanto, Katalin; Clark, Luke; Reynolds, Charles F; Siegle, Greg J

    2013-10-01

    IMPORTANCE—Suicide can be viewed as an escape from unendurable punishment at the cost of any future rewards. Could faulty estimation of these outcomes predispose to suicidal behavior? In behavioral studies, many of those who have attempted suicide misestimate expected rewards on gambling and probabilistic learning tasks.OBJECTIVES—To describe the neural circuit abnormalities that underlie disadvantageous choices in people at risk for suicide and to relate these abnormalities to impulsivity, which is one of the components of vulnerability to suicide.DESIGN—Case-control functional magnetic resonance imaging study of reward learning using are inforcement learning model.SETTING—University hospital and outpatient clinic.PATIENTS—Fifty-three participants 60 years or older, including 15 depressed patients who had attempted suicide, 18 depressed patients who had never attempted suicide (depressed control subjects), and 20 psychiatrically healthy controls.MAIN OUTCOMES AND MEASURES—Components of the cortical blood oxygenation level–dependent response tracking expected and unpredicted rewards.RESULTS—Depressed elderly participants displayed 2 distinct disruptions of control over reward-guided behavior. First, impulsivity and a history of suicide attempts (particularly poorly planned ones) were associated with a weakened expected reward signal in the paralimbic cortex,which in turn predicted the behavioral insensitivity to contingency change. Second, depression was associated with disrupted corticostriatothalamic encoding of unpredicted rewards, which in turn predicted the behavioral over sensitivity to punishment. These results were robust to the effects of possible brain damage from suicide attempts, depressive severity, co-occurring substance use and anxiety disorders, antidepressant and anticholinergic exposure, lifetime exposure to electroconvulsive therapy, vascular illness, and incipient dementia.CONCLUSIONS AND RELEVANCE—Altered paralimbic reward

  2. Influence of supraliminal reward information on unconsciously triggered response inhibition.

    PubMed

    Diao, Liuting; Ding, Cody; Qi, Senqing; Zeng, Qinghong; Huang, Bo; Xu, Mengsi; Fan, Lingxia; Yang, Dong

    2014-01-01

    Although executive functions (e.g., response inhibition) are often thought to interact consciously with reward, recent studies have demonstrated that they can also be triggered by unconscious stimuli. Further research has suggested a close relationship between consciously and unconsciously triggered response inhibition. To date, however, the effect of reward on unconsciously triggered response inhibition has not been explored. To address this issue, participants in this study performed runs of a modified Go/No-Go task during which they were exposed to both high and low value monetary rewards presented both supraliminally and subliminally. Participants were informed that they would earn the reward displayed if they responded correctly to each trial of the run. According to the results, when rewards were presented supraliminally, a greater unconsciously triggered response inhibition was observed for high-value rewards than for low-value rewards. In contrast, when rewards were presented subliminally, no enhanced unconsciously triggered response inhibition was observed. Results revealed that supraliminal and subliminal rewards have distinct effects on unconsciously triggered response inhibition. These findings have important implications for extending our understanding of the relationship between reward and response inhibition. PMID:25268227

  3. Contextual Novelty Modulates the Neural Dynamics of Reward Anticipation

    PubMed Central

    Bunzeck, Nico; Guitart-Masip, Marc; Dolan, Ray J.; Duzel, Emrah

    2011-01-01

    We investigated how rapidly the reward predicting properties of visual cues are signaled in the human brain and the extent these reward prediction signals are contextually modifiable. In a magnetoencephalography (MEG) study, we presented participants with fractal visual cues that predicted monetary rewards with different probabilities. These cues were presented in the temporal context of a preceding novel or familiar image of a natural scene. Starting at ~100ms after cue onset, reward probability was signalled in the event-related fields (ERFs) over temporo-occipital sensors and in the power of theta (5-8Hz) and beta (20-30Hz) band oscillations over frontal sensors. While theta decreased with reward probability beta power showed the opposite effect. Thus, in humans anticipatory reward responses are generated rapidly, within 100ms after the onset of reward-predicting cues, which is similar to the timing established in non-human primates. Contextual novelty enhanced the reward anticipation responses in both ERFs and in beta oscillations starting at ~100 ms after cue onset. This very early context effect is compatible with a physiological model that invokes the mediation of a hippocampal-VTA loop according to which novelty modulates neural response properties within the reward circuitry. We conclude that the neural processing of cues that predict future rewards is temporally highly efficient and contextually modifiable. PMID:21900560

  4. Reward associations impact both iconic and visual working memory.

    PubMed

    Infanti, Elisa; Hickey, Clayton; Turatto, Massimo

    2015-02-01

    Reward plays a fundamental role in human behavior. A growing number of studies have shown that stimuli associated with reward become salient and attract attention. The aim of the present study was to extend these results into the investigation of iconic memory and visual working memory. In two experiments we asked participants to perform a visual-search task where different colors of the target stimuli were paired with high or low reward. We then tested whether the pre-established feature-reward association affected performance on a subsequent visual memory task, in which no reward was provided. In this test phase participants viewed arrays of 8 objects, one of which had unique color that could match the color associated with reward during the previous visual-search task. A probe appeared at varying intervals after stimulus offset to identify the to-be-reported item. Our results suggest that reward biases the encoding of visual information such that items characterized by a reward-associated feature interfere with mnemonic representations of other items in the test display. These results extend current knowledge regarding the influence of reward on early cognitive processes, suggesting that feature-reward associations automatically interact with the encoding and storage of visual information, both in iconic memory and visual working memory.

  5. Influence of Supraliminal Reward Information on Unconsciously Triggered Response Inhibition

    PubMed Central

    Diao, Liuting; Ding, Cody; Qi, Senqing; Zeng, Qinghong; Huang, Bo; Xu, Mengsi; Fan, Lingxia; Yang, Dong

    2014-01-01

    Although executive functions (e.g., response inhibition) are often thought to interact consciously with reward, recent studies have demonstrated that they can also be triggered by unconscious stimuli. Further research has suggested a close relationship between consciously and unconsciously triggered response inhibition. To date, however, the effect of reward on unconsciously triggered response inhibition has not been explored. To address this issue, participants in this study performed runs of a modified Go/No-Go task during which they were exposed to both high and low value monetary rewards presented both supraliminally and subliminally. Participants were informed that they would earn the reward displayed if they responded correctly to each trial of the run. According to the results, when rewards were presented supraliminally, a greater unconsciously triggered response inhibition was observed for high-value rewards than for low-value rewards. In contrast, when rewards were presented subliminally, no enhanced unconsciously triggered response inhibition was observed. Results revealed that supraliminal and subliminal rewards have distinct effects on unconsciously triggered response inhibition. These findings have important implications for extending our understanding of the relationship between reward and response inhibition. PMID:25268227

  6. Pain and suicidality: insights from reward and addiction neuroscience.

    PubMed

    Elman, Igor; Borsook, David; Volkow, Nora D

    2013-10-01

    Suicidality is exceedingly prevalent in pain patients. Although the pathophysiology of this link remains unclear, it may be potentially related to the partial congruence of physical and emotional pain systems. The latter system's role in suicide is also conspicuous during setbacks and losses sustained in the context of social attachments. Here we propose a model based on the neural pathways mediating reward and anti-reward (i.e., allostatic adjustment to recurrent activation of the reward circuitry); both are relevant etiologic factors in pain, suicide and social attachments. A comprehensive literature search on neurobiology of pain and suicidality was performed. The collected articles were critically reviewed and relevant data were extracted and summarized within four key areas: (1) physical and emotional pain, (2) emotional pain and social attachments, (3) pain- and suicide-related alterations of the reward and anti-reward circuits as compared to addiction, which is the premier probe for dysfunction of these circuits and (4) mechanistically informed treatments of co-occurring pain and suicidality. Pain-, stress- and analgesic drugs-induced opponent and proponent states of the mesolimbic dopaminergic pathways may render reward and anti-reward systems vulnerable to sensitization, cross-sensitization and aberrant learning of contents and contexts associated with suicidal acts and behaviors. These findings suggest that pain patients exhibit alterations in the brain circuits mediating reward (depressed function) and anti-reward (sensitized function) that may affect their proclivity for suicide and support pain and suicidality classification among other "reward deficiency syndromes" and a new proposal for "enhanced anti-reward syndromes". We suggest that interventions aimed at restoring the balance between the reward and anti-reward networks in patients with chronic pain may help decreasing their suicide risk.

  7. Pain and suicidality: insights from reward and addiction neuroscience.

    PubMed

    Elman, Igor; Borsook, David; Volkow, Nora D

    2013-10-01

    Suicidality is exceedingly prevalent in pain patients. Although the pathophysiology of this link remains unclear, it may be potentially related to the partial congruence of physical and emotional pain systems. The latter system's role in suicide is also conspicuous during setbacks and losses sustained in the context of social attachments. Here we propose a model based on the neural pathways mediating reward and anti-reward (i.e., allostatic adjustment to recurrent activation of the reward circuitry); both are relevant etiologic factors in pain, suicide and social attachments. A comprehensive literature search on neurobiology of pain and suicidality was performed. The collected articles were critically reviewed and relevant data were extracted and summarized within four key areas: (1) physical and emotional pain, (2) emotional pain and social attachments, (3) pain- and suicide-related alterations of the reward and anti-reward circuits as compared to addiction, which is the premier probe for dysfunction of these circuits and (4) mechanistically informed treatments of co-occurring pain and suicidality. Pain-, stress- and analgesic drugs-induced opponent and proponent states of the mesolimbic dopaminergic pathways may render reward and anti-reward systems vulnerable to sensitization, cross-sensitization and aberrant learning of contents and contexts associated with suicidal acts and behaviors. These findings suggest that pain patients exhibit alterations in the brain circuits mediating reward (depressed function) and anti-reward (sensitized function) that may affect their proclivity for suicide and support pain and suicidality classification among other "reward deficiency syndromes" and a new proposal for "enhanced anti-reward syndromes". We suggest that interventions aimed at restoring the balance between the reward and anti-reward networks in patients with chronic pain may help decreasing their suicide risk. PMID:23827972

  8. Pain and suicidality: Insights from reward and addiction neuroscience

    PubMed Central

    Elman, Igor; Borsook, David; Volkow, Nora D.

    2016-01-01

    Suicidality is exceedingly prevalent in pain patients. Although the pathophysiology of this link remains unclear, it may be potentially related to the partial congruence of physical and emotional pain systems. The latter system’s role in suicide is also conspicuous during setbacks and losses sustained in the context of social attachments. Here we propose a model based on the neural pathways mediating reward and anti-reward (i.e., allostatic adjustment to recurrent activation of the reward circuitry); both are relevant etiologic factors in pain, suicide and social attachments. A comprehensive literature search on neurobiology of pain and suicidality was performed. The collected articles were critically reviewed and relevant data were extracted and summarized within four key areas: (1) physical and emotional pain, (2) emotional pain and social attachments, (3) pain-and suicide-related alterations of the reward and anti-reward circuits as compared to addiction, which is the premier probe for dysfunction of these circuits and (4) mechanistically informed treatments of co-occurring pain and suicidality. Pain-, stress- and analgesic drugs-induced opponent and proponent states of the mesolimbic dopaminergic pathways may render reward and anti-reward systems vulnerable to sensitization, cross-sensitization and aberrant learning of contents and contexts associated with suicidal acts and behaviors. These findings suggest that pain patients exhibit alterations in the brain circuits mediating reward (depressed function) and anti-reward (sensitized function) that may affect their proclivity for suicide and support pain and suicidality classification among other “reward deficiency syndromes” and a new proposal for “enhanced anti-reward syndromes”. We suggest that interventions aimed at restoring the balance between the reward and anti-reward networks in patients with chronic pain may help decreasing their suicide risk. PMID:23827972

  9. Inferring reward prediction errors in patients with schizophrenia: a dynamic reward task for reinforcement learning.

    PubMed

    Li, Chia-Tzu; Lai, Wen-Sung; Liu, Chih-Min; Hsu, Yung-Fong

    2014-01-01

    Abnormalities in the dopamine system have long been implicated in explanations of reinforcement learning and psychosis. The updated reward prediction error (RPE)-a discrepancy between the predicted and actual rewards-is thought to be encoded by dopaminergic neurons. Dysregulation of dopamine systems could alter the appraisal of stimuli and eventually lead to schizophrenia. Accordingly, the measurement of RPE provides a potential behavioral index for the evaluation of brain dopamine activity and psychotic symptoms. Here, we assess two features potentially crucial to the RPE process, namely belief formation and belief perseveration, via a probability learning task and reinforcement-learning modeling. Forty-five patients with schizophrenia [26 high-psychosis and 19 low-psychosis, based on their p1 and p3 scores in the positive-symptom subscales of the Positive and Negative Syndrome Scale (PANSS)] and 24 controls were tested in a feedback-based dynamic reward task for their RPE-related decision making. While task scores across the three groups were similar, matching law analysis revealed that the reward sensitivities of both psychosis groups were lower than that of controls. Trial-by-trial data were further fit with a reinforcement learning model using the Bayesian estimation approach. Model fitting results indicated that both psychosis groups tend to update their reward values more rapidly than controls. Moreover, among the three groups, high-psychosis patients had the lowest degree of choice perseveration. Lumping patients' data together, we also found that patients' perseveration appears to be negatively correlated (p = 0.09, trending toward significance) with their PANSS p1 + p3 scores. Our method provides an alternative for investigating reward-related learning and decision making in basic and clinical settings.

  10. Dual roles of dopamine in food and drug seeking: the drive-reward paradox.

    PubMed

    Wise, Roy A

    2013-05-01

    The question of whether (or to what degree) obesity reflects addiction to high-energy foods often narrows to the question of whether the overeating of these foods causes the same long-term neuroadaptations as are identified with the late stages of addiction. Of equal or perhaps greater interest is the question of whether common brain mechanisms mediate the acquisition and development of eating and drug-taking habits. The earliest evidence on this question is rooted in early studies of brain stimulation reward. Lateral hypothalamic electrical stimulation can be reinforcing in some conditions and can motivate feeding in others. That stimulation of the same brain region should be both reinforcing and drive inducing is paradoxical; why should an animal work to induce a drive-like state such as hunger? This is known as the drive-reward paradox. Insights into the substrates of the drive-reward paradox suggest an answer to the controversial question of whether the dopamine system--a system downstream from the stimulated fibers of the lateral hypothalamus--is more critically involved in wanting or in liking of various rewards including food and addictive drugs. That the same brain circuitry is implicated in the motivation for and the reinforcement by both food and addictive drugs extends the argument for a common mechanism underlying compulsive overeating and compulsive drug taking.

  11. Extrinsic Rewards Diminish Costly Sharing in 3-Year-Olds.

    PubMed

    Ulber, Julia; Hamann, Katharina; Tomasello, Michael

    2016-07-01

    Two studies investigated the influence of external rewards and social praise in young children's fairness-related behavior. The motivation of ninety-six 3-year-olds' to equalize unfair resource allocations was measured in three scenarios (collaboration, windfall, and dictator game) following three different treatments (material reward, verbal praise, and neutral response). In all scenarios, children's willingness to engage in costly sharing was negatively influenced when they had received a reward for equal sharing during treatment than when they had received praise or no reward. The negative effect of material rewards was not due to subjects responding in kind to their partner's termination of rewards. These results provide new evidence for the intrinsic motivation of prosociality-in this case, costly sharing behavior-in preschool children. PMID:27084549

  12. Neural basis of reward anticipation and its genetic determinants.

    PubMed

    Jia, Tianye; Macare, Christine; Desrivières, Sylvane; Gonzalez, Dante A; Tao, Chenyang; Ji, Xiaoxi; Ruggeri, Barbara; Nees, Frauke; Banaschewski, Tobias; Barker, Gareth J; Bokde, Arun L W; Bromberg, Uli; Büchel, Christian; Conrod, Patricia J; Dove, Rachel; Frouin, Vincent; Gallinat, Jürgen; Garavan, Hugh; Gowland, Penny A; Heinz, Andreas; Ittermann, Bernd; Lathrop, Mark; Lemaitre, Hervé; Martinot, Jean-Luc; Paus, Tomáš; Pausova, Zdenka; Poline, Jean-Baptiste; Rietschel, Marcella; Robbins, Trevor; Smolka, Michael N; Müller, Christian P; Feng, Jianfeng; Rothenfluh, Adrian; Flor, Herta; Schumann, Gunter

    2016-04-01

    Dysfunctional reward processing is implicated in various mental disorders, including attention deficit hyperactivity disorder (ADHD) and addictions. Such impairments might involve different components of the reward process, including brain activity during reward anticipation. We examined brain nodes engaged by reward anticipation in 1,544 adolescents and identified a network containing a core striatal node and cortical nodes facilitating outcome prediction and response preparation. Distinct nodes and functional connections were preferentially associated with either adolescent hyperactivity or alcohol consumption, thus conveying specificity of reward processing to clinically relevant behavior. We observed associations between the striatal node, hyperactivity, and the vacuolar protein sorting-associated protein 4A (VPS4A) gene in humans, and the causal role of Vps4 for hyperactivity was validated in Drosophila Our data provide a neurobehavioral model explaining the heterogeneity of reward-related behaviors and generate a hypothesis accounting for their enduring nature.

  13. Neural basis of reward anticipation and its genetic determinants.

    PubMed

    Jia, Tianye; Macare, Christine; Desrivières, Sylvane; Gonzalez, Dante A; Tao, Chenyang; Ji, Xiaoxi; Ruggeri, Barbara; Nees, Frauke; Banaschewski, Tobias; Barker, Gareth J; Bokde, Arun L W; Bromberg, Uli; Büchel, Christian; Conrod, Patricia J; Dove, Rachel; Frouin, Vincent; Gallinat, Jürgen; Garavan, Hugh; Gowland, Penny A; Heinz, Andreas; Ittermann, Bernd; Lathrop, Mark; Lemaitre, Hervé; Martinot, Jean-Luc; Paus, Tomáš; Pausova, Zdenka; Poline, Jean-Baptiste; Rietschel, Marcella; Robbins, Trevor; Smolka, Michael N; Müller, Christian P; Feng, Jianfeng; Rothenfluh, Adrian; Flor, Herta; Schumann, Gunter

    2016-04-01

    Dysfunctional reward processing is implicated in various mental disorders, including attention deficit hyperactivity disorder (ADHD) and addictions. Such impairments might involve different components of the reward process, including brain activity during reward anticipation. We examined brain nodes engaged by reward anticipation in 1,544 adolescents and identified a network containing a core striatal node and cortical nodes facilitating outcome prediction and response preparation. Distinct nodes and functional connections were preferentially associated with either adolescent hyperactivity or alcohol consumption, thus conveying specificity of reward processing to clinically relevant behavior. We observed associations between the striatal node, hyperactivity, and the vacuolar protein sorting-associated protein 4A (VPS4A) gene in humans, and the causal role of Vps4 for hyperactivity was validated in Drosophila Our data provide a neurobehavioral model explaining the heterogeneity of reward-related behaviors and generate a hypothesis accounting for their enduring nature. PMID:27001827

  14. The cultural dynamics of rewarding honesty and punishing deception.

    PubMed

    Wang, Cynthia S; Leung, Angela K-Y

    2010-11-01

    Recent research suggests that individuals reward honesty more than they punish deception. Five experiments showed that different patterns of rewards and punishments emerge for North American and East Asian cultures. Experiment 1 demonstrated that Americans rewarded more than they punished, whereas East Asians rewarded and punished in equivalent amounts. Experiments 2 and 3 revealed that these divergent patterns by culture could be explained by greater social mobility experienced by Americans. Experiments 4 and 5 examined how certain consequences of social mobility, approach-avoidance behavioral motivations and trust and felt obligation, can lead to disparate reward and punishment decisions within the two cultures. Moreover, Experiment 4 revealed that Americans exhibited stronger evaluative reactions toward deception but stronger behavioral intentions toward honesty; East Asians did not exhibit this evaluative-behavioral asymmetry. The cross-cultural implications for understanding rewards and punishments in an increasingly globalized world are discussed.

  15. Neural basis of reward anticipation and its genetic determinants

    PubMed Central

    Jia, Tianye; Macare, Christine; Desrivières, Sylvane; Gonzalez, Dante A.; Tao, Chenyang; Ji, Xiaoxi; Ruggeri, Barbara; Nees, Frauke; Banaschewski, Tobias; Barker, Gareth J.; Bokde, Arun L. W.; Bromberg, Uli; Büchel, Christian; Conrod, Patricia J.; Dove, Rachel; Gallinat, Jürgen; Garavan, Hugh; Gowland, Penny A.; Heinz, Andreas; Ittermann, Bernd; Lathrop, Mark; Lemaitre, Hervé; Martinot, Jean-Luc; Paus, Tomáš; Pausova, Zdenka; Poline, Jean-Baptiste; Rietschel, Marcella; Robbins, Trevor; Müller, Christian P.; Feng, Jianfeng; Rothenfluh, Adrian; Flor, Herta; Schumann, Gunter

    2016-01-01

    Dysfunctional reward processing is implicated in various mental disorders, including attention deficit hyperactivity disorder (ADHD) and addictions. Such impairments might involve different components of the reward process, including brain activity during reward anticipation. We examined brain nodes engaged by reward anticipation in 1,544 adolescents and identified a network containing a core striatal node and cortical nodes facilitating outcome prediction and response preparation. Distinct nodes and functional connections were preferentially associated with either adolescent hyperactivity or alcohol consumption, thus conveying specificity of reward processing to clinically relevant behavior. We observed associations between the striatal node, hyperactivity, and the vacuolar protein sorting-associated protein 4A (VPS4A) gene in humans, and the causal role of Vps4 for hyperactivity was validated in Drosophila. Our data provide a neurobehavioral model explaining the heterogeneity of reward-related behaviors and generate a hypothesis accounting for their enduring nature. PMID:27001827

  16. A Positive Affective Neuroendocrinology Approach to Reward and Behavioral Dysregulation

    PubMed Central

    Welker, Keith M.; Gruber, June; Mehta, Pranjal H.

    2015-01-01

    Emerging lines of research suggest that both testosterone and maladaptive reward processing can modulate behavioral dysregulation. Yet, to date, no integrative account has been provided that systematically explains neuroendocrine function, dysregulation of reward, and behavioral dysregulation in a unified perspective. This is particularly important given specific neuroendocrine systems are potential mechanisms underlying and giving rise to reward-relevant behaviors. In this review, we propose a forward-thinking approach to study the mechanisms of reward and behavioral dysregulation from a positive affective neuroendocrinology (PANE) perspective. This approach holds that testosterone increases reward processing and motivation, which increase the likelihood of behavioral dysregulation. Additionally, the PANE framework holds that reward processing mediates the effects of testosterone on behavioral dysregulation. We also explore sources of potential sex differences and the roles of age, cortisol, and individual differences within the PANE framework. Finally, we discuss future prospects for research questions and methodology in the emerging field of affective neuroendocrinology. PMID:26191007

  17. Effects of monetary reward and punishment on information checking behaviour.

    PubMed

    Li, Simon Y W; Cox, Anna L; Or, Calvin; Blandford, Ann

    2016-03-01

    Two experiments were conducted to examine whether checking one's own work can be motivated by monetary reward and punishment. Participants were randomly assigned to one of three conditions: a flat-rate payment for completing the task (Control); payment increased for error-free performance (Reward); payment decreased for error performance (Punishment). Experiment 1 (N = 90) was conducted with liberal arts students, using a general data-entry task. Experiment 2 (N = 90) replicated Experiment 1 with clinical students and a safety-critical 'cover story' for the task. In both studies, Reward and Punishment resulted in significantly fewer errors, more frequent and longer checking, than Control. No such differences were obtained between the Reward and Punishment conditions. It is concluded that error consequences in terms of monetary reward and punishment can result in more accurate task performance and more rigorous checking behaviour than errors without consequences. However, whether punishment is more effective than reward, or vice versa, remains inconclusive.

  18. Effects of monetary reward and punishment on information checking behaviour.

    PubMed

    Li, Simon Y W; Cox, Anna L; Or, Calvin; Blandford, Ann

    2016-03-01

    Two experiments were conducted to examine whether checking one's own work can be motivated by monetary reward and punishment. Participants were randomly assigned to one of three conditions: a flat-rate payment for completing the task (Control); payment increased for error-free performance (Reward); payment decreased for error performance (Punishment). Experiment 1 (N = 90) was conducted with liberal arts students, using a general data-entry task. Experiment 2 (N = 90) replicated Experiment 1 with clinical students and a safety-critical 'cover story' for the task. In both studies, Reward and Punishment resulted in significantly fewer errors, more frequent and longer checking, than Control. No such differences were obtained between the Reward and Punishment conditions. It is concluded that error consequences in terms of monetary reward and punishment can result in more accurate task performance and more rigorous checking behaviour than errors without consequences. However, whether punishment is more effective than reward, or vice versa, remains inconclusive. PMID:26549151

  19. Rewards modulate saccade latency but not exogenous spatial attention

    PubMed Central

    Dunne, Stephen; Ellison, Amanda; Smith, Daniel T.

    2015-01-01

    The eye movement system is sensitive to reward. However, whilst the eye movement system is extremely flexible, the extent to which changes to oculomotor behavior induced by reward paradigms persist beyond the training period or transfer to other oculomotor tasks is unclear. To address these issues we examined the effects of presenting feedback that represented small monetary rewards to spatial locations on the latency of saccadic eye movements, the time-course of learning and extinction of the effects of rewarding saccades on exogenous spatial attention and oculomotor inhibition of return. Reward feedback produced a relative facilitation of saccadic latency in a stimulus driven saccade task which persisted for three blocks of extinction trials. However, this hemifield-specific effect failed to transfer to peripheral cueing tasks. We conclude that rewarding specific spatial locations is unlikely to induce long-term, systemic changes to the human oculomotor or attention systems. PMID:26284004

  20. Action Initiation Shapes Mesolimbic Dopamine Encoding of Future Rewards

    PubMed Central

    Syed, Emilie C.J.; Grima, Laura L.; Magill, Peter J.; Bogacz, Rafal; Brown, Peter; Walton, Mark E.

    2015-01-01

    It is widely held that dopamine signaling encodes predictions of future rewards and such predictions are regularly used to drive behavior, but the relationship between these two is poorly defined. Here, we demonstrate in rats that nucleus accumbens dopamine following a reward-predicting cue is attenuated unless movement is correctly initiated. These results demonstrate that dopamine release in this region is contingent upon correct action initiation and not just reward prediction. PMID:26642087

  1. Hypoalgesia Induced by Reward Devaluation in Rats

    PubMed Central

    Jiménez-García, Ana María; Ruíz-Leyva, Leandro; Cendán, Cruz Miguel; Torres, Carmen; Papini, Mauricio R.; Morón, Ignacio

    2016-01-01

    Reduced sensitivity to physical pain (hypoalgesia) has been reported after events involving reward devaluation. Reward devaluation was implemented in a consummatory successive negative contrast (cSNC) task. Food-deprived Wistar rats had access to 32% sucrose during 16 sessions followed by access to 4% sucrose during 3 additional sessions. An unshifted control group had access to 4% sucrose throughout the 19 sessions. Pain sensitivity was measured using von Frey filaments (Experiment 1) and Hargreaves thermal stimuli (Experiment 2) in pretraining baseline, 5 min, and 300 min after either the first (session 17) or second (session 18) devaluation session in the cSNC situation. Sucrose consumption was lower in downshifted groups relative to unshifted groups during postshift sessions—the cSNC effect. Hypoalgesia was observed in downshifted groups relative to unshifted controls when pain sensitivity was assessed 5 min after either the first or second devaluation session, regardless of the pain sensitivity test used. Both pain sensitivity tests yielded evidence of hypoalgesia 300 min after the second downshift session, but not 300 min after the first devaluation session. Whereas hypoalgesia was previously shown only after the second devaluation session, here we report evidence of hypoalgesia after both the first and second devaluation sessions using mechanical and thermal nociceptive stimuli. Moreover, the hypoalgesia observed 300 min after the second devaluation session in both experiments provides unique evidence of the effects of reward loss on sensitivity to physical pain 5 hours after the loss episode. The underlying neurobehavioral mechanisms remain to be identified. PMID:27764142

  2. Rewarding safe behavior: strategies for change.

    PubMed

    Fell-Carlson, Deborah

    2004-12-01

    Effective, sustainable safety incentives are integrated into a performance management system designed to encourage long term behavior change. Effective incentive program design integrates the fundamental considerations of compensation (i.e., valence, instrumentality, expectancy, equity) with behavior change theory in the context of a strong merit based performance management system. Clear expectations are established and communicated from the time applicants apply for the position. Feedback and social recognition are leveraged and used as rewards, in addition to financial incentives built into the compensation system and offered periodically as short term incentives. Rewards are tied to specific objectives intended to influence specific behaviors. Objectives are designed to challenge employees, providing opportunities to grow and enhance their sense of belonging. Safety contests and other awareness activities are most effective when used to focus safety improvement efforts on specific behaviors or processes, for a predetermined period of time, in the context of a comprehensive safety system. Safety incentive programs designed around injury outcomes can result in unintended, and undesirable, consequences. Safety performance can be leveraged by integrating safety into corporate cultural indicators. Symbols of safety remind employees of corporate safety goals and objectives (e.g., posted safety goals and integrating safety into corporate mission and vision). Rites and ceremonies provide opportunities for social recognition and feedback and demonstrate safety is a corporate value. Feedback opportunities, rewards, and social recognition all provide content for corporate legends, those stories embellished over time, that punctuate the overall system of organizational norms, and provide examples of the organizational safety culture in action. PMID:15635933

  3. 42 CFR 422.134 - Reward and incentive programs.

    Code of Federal Regulations, 2014 CFR

    2014-10-01

    ... illness, and promoting efficient use of health care resources. (b) Non-discrimination. Reward and... limited English proficiency, gender, disability, chronic disease, whether a person resides or...

  4. Human ventromedial prefrontal lesions alter incentivisation by reward

    PubMed Central

    Manohar, Sanjay G.; Husain, Masud

    2016-01-01

    Although medial frontal brain regions are implicated in valuation of rewards, evidence from focal lesions to these areas is scant, with many conflicting results regarding motivation and affect, and no human studies specifically examining incentivisation by reward. Here, 19 patients with isolated, focal damage in ventral and medial prefrontal cortex were selected from a database of 453 individuals with subarachnoid haemorrhage. Using a speeded saccadic task based on the oculomotor capture paradigm, we manipulated the maximum reward available on each trial using an auditory incentive cue. Modulation of behaviour by motivation permitted quantification of reward sensitivity. At the group level, medial frontal damage was overall associated with significantly reduced effects of reward on invigorating saccadic velocity and autonomic (pupil) responses compared to age-matched, healthy controls. Crucially, however, some individuals instead showed abnormally strong incentivisation effects for vigour. Increased sensitivity to rewards within the lesion group correlated with damage in subgenual ventromedial prefrontal cortex (vmPFC) areas, which have recently become the target for deep brain stimulation (DBS) in depression. Lesion correlations with clinical apathy suggested that the apathy associated with prefrontal damage is in fact reduced by damage at those coordinates. Reduced reward sensitivity showed a trend to correlate with damage near nucleus accumbens. Lesions did not, on the other hand, influence reward sensitivity of cognitive control, as measured by distractibility. Thus, although medial frontal lesions may generally reduce reward sensitivity, damage to key subregions paradoxically protect from this effect. PMID:26874940

  5. Reward Comparison: The Achilles’ heel and hope for addiction

    PubMed Central

    Grigson, Patricia Sue

    2009-01-01

    In the words of the late Charles Flaherty, reward comparison is commonplace. Rats and man, it appears, compare all rewards and this capacity likely contributes to our ability to select the most appropriate reward/behavior (food, water, salt, sex), at the most ideal level (e.g., a certain sweetness), at any given time. A second advantage of our predisposition for reward comparison is that the availability of rich alternative rewards can protect against our becoming addicted to any single reward/behavior. Thus, the potential protective effects of natural rewards/enrichment are addressed. Despite this, behavior can become inflexible when, through the development of addiction, stress, drug, or cues elicit craving, withdrawal, and ultimately, drug-seeking. Drug-seeking corresponds with a ‘window of inopportunity’, when even potent natural rewards have little or no impact on behavior. During this time, there is a unitary solution to the need state, and that solution is drug. The present animal model explores this ‘window of inopportunity’ when natural rewards are devalued and drug-seeking is engaged and considers a mode of possible intervention. PMID:20016772

  6. Reward prediction error computation in the pedunculopontine tegmental nucleus neurons.

    PubMed

    Kobayashi, Yasushi; Okada, Ken-Ichi

    2007-05-01

    In this article, we address the role of neuronal activity in the pathways of the brainstem-midbrain circuit in reward and the basis for believing that this circuit provides advantages over previous reinforcement learning theory. Several lines of evidence support the reward-based learning theory proposing that midbrain dopamine (DA) neurons send a teaching signal (the reward prediction error signal) to control synaptic plasticity of the projection area. However, the underlying mechanism of where and how the reward prediction error signal is computed still remains unclear. Since the pedunculopontine tegmental nucleus (PPTN) in the brainstem is one of the strongest excitatory input sources to DA neurons, we hypothesized that the PPTN may play an important role in activating DA neurons and reinforcement learning by relaying necessary signals for reward prediction error computation to DA neurons. To investigate the involvement of the PPTN neurons in computation of reward prediction error, we used a visually guided saccade task (VGST) during recording of neuronal activity in monkeys. Here, we predict that PPTN neurons may relay the excitatory component of tonic reward prediction and phasic primary reward signals, and derive a new computational theory of the reward prediction error in DA neurons.

  7. Ventral Striatum Connectivity During Reward Anticipation in Adolescent Smokers.

    PubMed

    Jollans, Lee; Zhipeng, Cao; Icke, Ilknur; Greene, Ciara; Kelly, Clare; Banaschewski, Tobias; Bokde, Arun L W; Bromberg, Uli; Büchel, Christian; Cattrell, Anna; Conrod, Patricia J; Desrivières, Sylvane; Flor, Herta; Frouin, Vincent; Gallinat, Jürgen; Garavan, Hugh; Gowland, Penny; Heinz, Andreas; Ittermann, Bernd; Martinot, Jean-Luc; Artiges, Eric; Nees, Frauke; Papadopoulos Orfanos, Dimitri; Paus, Tomáš; Smolka, Michael N; Walter, Henrik; Schumann, Gunter; Whelan, Robert

    2016-01-01

    Substance misusers, including adolescent smokers, often have reduced reward system activity during processing of non-drug rewards. Using a psychophysiological interaction approach, we examined functional connectivity with the ventral striatum during reward anticipation in a large (N = 206) sample of adolescent smokers. Increased smoking frequency was associated with (1) increased connectivity with regions involved in saliency and valuation, including the orbitofrontal cortex and (2) reduced connectivity between the ventral striatum and regions associated with inhibition and risk aversion, including the right inferior frontal gyrus. These results demonstrate that functional connectivity during reward processing is relevant to adolescent addiction. PMID:27074029

  8. A selective role for dopamine in stimulus-reward learning.

    PubMed

    Flagel, Shelly B; Clark, Jeremy J; Robinson, Terry E; Mayo, Leah; Czuj, Alayna; Willuhn, Ingo; Akers, Christina A; Clinton, Sarah M; Phillips, Paul E M; Akil, Huda

    2011-01-01

    Individuals make choices and prioritize goals using complex processes that assign value to rewards and associated stimuli. During Pavlovian learning, previously neutral stimuli that predict rewards can acquire motivational properties, becoming attractive and desirable incentive stimuli. However, whether a cue acts solely as a predictor of reward, or also serves as an incentive stimulus, differs between individuals. Thus, individuals vary in the degree to which cues bias choice and potentially promote maladaptive behaviour. Here we use rats that differ in the incentive motivational properties they attribute to food cues to probe the role of the neurotransmitter dopamine in stimulus-reward learning. We show that intact dopamine transmission is not required for all forms of learning in which reward cues become effective predictors. Rather, dopamine acts selectively in a form of stimulus-reward learning in which incentive salience is assigned to reward cues. In individuals with a propensity for this form of learning, reward cues come to powerfully motivate and control behaviour. This work provides insight into the neurobiology of a form of stimulus-reward learning that confers increased susceptibility to disorders of impulse control.

  9. Reward and cooperation in the spatial public goods game

    NASA Astrophysics Data System (ADS)

    Szolnoki, A.; Perc, M.

    2010-11-01

    The promise of punishment and reward in promoting public cooperation is debatable. While punishment is traditionally considered more successful than reward, the fact that the cost of punishment frequently fails to offset gains from enhanced cooperation has lead some to reconsider reward as the main catalyst behind collaborative efforts. Here we elaborate on the "stick vs. carrot" dilemma by studying the evolution of cooperation in the spatial public goods game, where besides the traditional cooperators and defectors, rewarding cooperators supplement the array of possible strategies. The latter are willing to reward cooperative actions at a personal cost, thus effectively downgrading pure cooperators to second-order free-riders due to their unwillingness to bear these additional costs. Consequently, we find that defection remains viable, especially if the rewarding is costly. Rewards, however, can promote cooperation, especially if the synergetic effects of cooperation are low. Surprisingly, moderate rewards may promote cooperation better than high rewards, which is due to the spontaneous emergence of cyclic dominance between the three strategies.

  10. Validation and extension of the reward-mountain model

    PubMed Central

    Breton, Yannick-André; Mullett, Ada; Conover, Kent; Shizgal, Peter

    2013-01-01

    The reward-mountain model relates the vigor of reward seeking to the strength and cost of reward. Application of this model provides information about the stage of processing at which manipulations such as drug administration, lesions, deprivation states, and optogenetic interventions act to alter reward seeking. The model has been updated by incorporation of new information about frequency following in the directly stimulated neurons responsible for brain stimulation reward and about the function that maps objective opportunity costs into subjective ones. The behavioral methods for applying the model have been updated and improved as well. To assess the impact of these changes, two related predictions of the model that were supported by earlier work have been retested: (1) altering the duration of rewarding brain stimulation should change the pulse frequency required to produce a reward of half-maximal intensity, and (2) this manipulation should not change the opportunity cost at which half-maximal performance is directed at earning a maximally intense reward. Prediction 1 was supported in all six subjects, but prediction 2 was supported in only three. The latter finding is interpreted to reflect recruitment, at some stimulation sites, of a heterogeneous reward substrate comprising dual, parallel circuits that integrate the stimulation-induced neural signals. PMID:24098275

  11. COMT val158met predicts reward responsiveness in humans.

    PubMed

    Lancaster, T M; Linden, D E; Heerey, E A

    2012-11-01

    A functional variant of the catechol-O-methyltransferase (COMT) gene [val158met (rs4680)] is frequently implicated in decision-making and higher cognitive functions. It may achieve its effects by modulating dopamine-related decision-making and reward-guided behaviour. Here we demonstrate that individuals with the met/met polymorphism have greater responsiveness to reward than carriers of the val allele and that this correlates with risk-seeking behaviour. We assessed performance on a reward responsiveness task and the Balloon analogue risk task, which measure how participants (N = 70, western European, university and postgraduate students) respond to reward and take risks in the presence of available reward. Individuals with the met/met genotype (n = 19) showed significantly higher reward responsiveness, F2,64 = 4.02, P = 0.02, and reward-seeking behaviour, F(2,68) = 4.52, P = 0.01, than did either val/met (n = 25) or val/val (n = 26) carriers. These results highlight a scenario in which genotype-dependent reward responsiveness shapes reward-seeking, therefore suggesting a novel framework by which COMT may modulate behaviour. PMID:22900954

  12. A Typology Framework of Loyalty Reward Programs

    NASA Astrophysics Data System (ADS)

    Cao, Yuheng; Nsakanda, Aaron Luntala; Mann, Inder Jit Singh

    Loyalty reward programs (LRPs), initially developed as marketing programs to enhance customer retention, have now become an important part of customer-focused business strategy. With the proliferation and increasing economy impact of the programs, the management complexity in the programs has also increased. However, despite widespread adoption of LRPs in business, academic research in the field seems to lag behind its practical application. Even the fundamental questions such as what LRPs are and how to classify them have not yet been fully addressed. In this paper, a comprehensive framework for LRP classification is proposed, which provides a foundation for further study of LRP design and planning issues.

  13. Communicating total rewards to the generations.

    PubMed

    Reynolds, Leah A

    2005-01-01

    This is the first time in American history that four distinct generations have been in the workforce at the same time. Because employers have finite resources with which to compete for talent, they must understand the generations, what matters most to them and what they can do to motivate different generations of workers. Perhaps surprisingly, the author argues that the generations share in most valuing "soft cost" rewards over "hard dollar cost" items. This article advises employers on how to make their company a great place to work for all generations.

  14. Auto-exploratory average reward reinforcement learning

    SciTech Connect

    Ok, DoKyeong; Tadepalli, P.

    1996-12-31

    We introduce a model-based average reward Reinforcement Learning method called H-learning and compare it with its discounted counterpart, Adaptive Real-Time Dynamic Programming, in a simulated robot scheduling task. We also introduce an extension to H-learning, which automatically explores the unexplored parts of the state space, while always choosing greedy actions with respect to the current value function. We show that this {open_quotes}Auto-exploratory H-learning{close_quotes} performs better than the original H-learning under previously studied exploration methods such as random, recency-based, or counter-based exploration.

  15. Communicating total rewards to the generations.

    PubMed

    Reynolds, Leah A

    2005-01-01

    This is the first time in American history that four distinct generations have been in the workforce at the same time. Because employers have finite resources with which to compete for talent, they must understand the generations, what matters most to them and what they can do to motivate different generations of workers. Perhaps surprisingly, the author argues that the generations share in most valuing "soft cost" rewards over "hard dollar cost" items. This article advises employers on how to make their company a great place to work for all generations. PMID:15977748

  16. Reward expectancy promotes generalized increases in attentional bias for rewarding stimuli.

    PubMed

    Jones, Andrew; Hogarth, Lee; Christiansen, Paul; Rose, Abigail K; Martinovic, Jasna; Field, Matt

    2012-01-01

    Expectations of drug availability increase the magnitude of attentional biases for drug-related cues. However, it is unknown whether these effects are outcome specific, or whether expectation of a specific reinforcer produces a general enhancement of attentional bias for other types of rewarding cues. In the present study, 31 social drinkers completed an eye-tracking task in which attentional bias for alcohol- and chocolate-related cues was assessed while the expectation of receiving alcohol and chocolate was manipulated on a trial-by-trial basis. Participants showed attentional bias for alcohol and chocolate cues (relative to neutral cues) overall. Importantly, these attentional biases for reward cues were magnified when participants expected to receive alcohol and chocolate, but effects were not outcome specific: The expectation of receiving either alcohol or chocolate increased attentional bias for both alcohol and chocolate cues. Results suggest that anticipation of reward produces a general rather than an outcome-specific enhancement of attentional bias for reward-related stimuli.

  17. The dopaminergic mediation of a sweet reward in normal and VMH hyperphagic rats.

    PubMed

    Xenakis, S; Sclafani, A

    1982-02-01

    The role of dopamine in mediating the rewarding quality of a sweet saccharin-glucose (SG) solution was investigated by comparing the effects of the dopamine receptor blocker pimozide, the bitter adulterant quinine, and solution dilution on the consummatory response to the solution in normal and VMH rats. Experiments 1 and 2 demonstrated that pimozide and quinine caused a dose/concentration dependent dependent reduction in the intake of and the licking response to a SG solution. Pimozide treatment caused an equivalent suppression in the intake of the normal and VMH rats, in both the dynamic and static phases, whereas quinine adulteration caused a greater suppression in the intake of the VMH rats. The effects of pimozide and quinine on initial lick rate were also different. Experiment 3 demonstrated that dilution of a SG solution produced a concentration related decrease in intake and licking response. Dilution of the SG solution, like pimozide treatment, affected the intake of the normal and VMH rats in an equivalent manner. The effects of solution dilution and pimozide treatment on the licking response were also similar. The results suggest that the mechanisms by which pimozide and quinine reduce the hedonic quality of natural rewards are functionally dissimilar. The similarity between pimozide treatment and solution dilution suggests that pimozide reduces the positive affective quality of natural reinforcers. The results are discussed in terms of the dopamine theory of reward, the role of dopamine in hypothalamic hyperphagia, and VMH finickiness.

  18. Cannabinoids reward sensitivity in a neurodevelopmental animal model of schizophrenia: a brain stimulation reward study.

    PubMed

    Gallo, Alexandra; Bouchard, Claude; Fortier, Emmanuel; Ducrot, Charles; Rompré, Pierre-Paul

    2014-09-01

    The comorbidity schizophrenia and cannabis has a high prevalence. The consumption of cannabis is ten times higher among schizophrenia patients, suggesting that these patients could be differentially sensitive to its motivational effects. To study this question, we investigated the motivational effects of cannabinoid agonists using the brain stimulation reward paradigm and a neurodevelopmental model of schizophrenia: neonatal ventral hippocampus lesions (NVHL). Using the curve-shift paradigm, we first compared the effect single dose (0.75mg/kg) of amphetamine in sham and NVHL rats on reward and operant responding. Then, in different groups of NVHL and sham rats, we studied the effect of delta-9-tetrahydrocannabinnol (THC, 0.5mg/kg, i.p.) and WIN55,212-2 (WIN, 1 and 3mg/kg, i.p.) Rats were initially trained to self-administer an electrical stimulation to the posterio-medial mesencephalon. Once responding was stable, reward threshold defined as the frequency required to induce a half maximum response rate was measured before and after injection of the drug or the vehicle. Results show that amphetamine enhanced reward in sham and NVHL rats, an effect that was shorter in duration in NVHL rats. THC produced a weak attenuation of reward in sham rats while WIN produced a dose-dependent attenuation in NVHL; the attenuation effect of WIN was blocked by the cannabinoid antagonist, AM251. WIN also produced an attenuation of performance in sham and NVHL rats, and this effect was partially prevented by AM251. These results provide the additional evidence that the motivational effect of cannabinoids is altered in animals with a schizophrenia-like phenotype.

  19. Abnormal reward functioning across substance use disorders and major depressive disorder: Considering reward as a transdiagnostic mechanism.

    PubMed

    Baskin-Sommers, Arielle R; Foti, Dan

    2015-11-01

    A common criticism of the Diagnostic and Statistical Manual of Mental Disorders (American Psychiatric Association, 2013) is that its criteria are based more on behavioral descriptions than on underlying biological mechanisms. Increasingly, calls have intensified for a more biologically-based approach to conceptualizing, studying, and treating psychological disorders, as exemplified by the Research Domain Criteria Project (RDoC). Among the most well-studied neurobiological mechanisms is reward processing. Moreover, individual differences in reward sensitivity are related to risk for substance abuse and depression. The current review synthesizes the available preclinical, electrophysiological, and neuroimaging literature on reward processing from a transdiagnostic, multidimensional perspective. Findings are organized with respect to key reward constructs within the Positive Valence Systems domain of the RDoC matrix, including initial responsiveness to reward (physiological 'liking'), approach motivation (physiological 'wanting'), and reward learning/habit formation. In the current review, we (a) describe the neural basis of reward, (b) elucidate differences in reward activity in substance abuse and depression, and (c) suggest a framework for integrating these disparate literatures and discuss the utility of shifting focus from diagnosis to process for understanding liability and co-morbidity. Ultimately, we believe that an integrative focus on abnormal reward functioning across the full continuum of clinically heterogeneous samples, rather than within circumscribed diagnostic categories, might actually help to refine the phenotypes and improve the prediction of onset and recovery of these disorders.

  20. Preference for unpredictable food rewards occurs with high proportion of reinforced trials or alcohol if rewards are not delayed.

    PubMed

    Daly, H B

    1989-01-01

    Organisms typically prefer situations where reward and nonreward are predictable rather than unpredictable. Although many theories can account for this result (e.g., information theory and delay-reduction theory), a recently developed mathematical model (DMOD) also predicts that subjects prefer the unpredictable reward situation under conditions that substantially decrease aversiveness of unpredictable nonreward (Daly & Daly, 1982). Because a high proportion of reinforced trials (lenient schedule) and alcohol injections decrease aversive conditioning, these variables were tested with rats in five E-maze experiments. A choice to one side of the maze resulted in a stimulus uncorrelated with reward outcome (unpredictable situation). A choice to the other side resulted in stimuli correlated with reward and nonreward (predictable situation). The stimuli were not visible until after the choice was made. A lenient reinforcement schedule resulted in preference for the unpredictable reward situation if rewards were not delayed. Alcohol resulted in preference for the unpredictable reward situation if a medium five-pellet reward was given. A lenient reinforcement schedule combined with an alcohol injection resulted in faster acquisition of the preference for the unpredictable reward situation than did a lenient schedule combined with a saline control injection. These results pose a major challenge to most theories, yet were predicted by DMOD.

  1. [Sucrose reward promotes rats' motivation for cocaine].

    PubMed

    Li, Yan-Qing; LE, Qiu-Min; Yu, Xiang-Chen; Ma, Lan; Wang, Fei-Fei

    2016-06-25

    Caloric diet, such as fat and sugar intake, has rewarding effects, and has been indicated to affect the responses to addictive substances in animal experiments. However, the possible association between sucrose reward and the motivation for addictive drugs remains to be elucidated. Thus, we carried out behavioral tests after sucrose self-administration training to determine the effects of sucrose experience on rats' motivation for cocaine, locomotor sensitivity to cocaine, basal locomotor activity, anxiety level, and associative learning ability. The sucrose-experienced (sucrose) group exhibited higher lever press, cocaine infusion and break point, as well as upshift of cocaine dose-response curve in cocaine self-administration test, as compared with the control (chow) group. Additionally, despite similar locomotor activity in open field test and comparable score in cocaine-induced conditioned place preference, the sucrose group showed higher cocaine-induced locomotor sensitivity as compared with the chow group. The anxiety level and the performance in vocal-cue induced fear memory were similar between these two groups in elevated plus maze and fear conditioning tests, respectively. Taken together, our work indicates that sucrose experience promotes the rats' motivation for cocaine. PMID:27350195

  2. Dopamine Replacement Therapy, Learning and Reward Prediction in Parkinson's Disease: Implications for Rehabilitation.

    PubMed

    Ferrazzoli, Davide; Carter, Adrian; Ustun, Fatma S; Palamara, Grazia; Ortelli, Paola; Maestri, Roberto; Yücel, Murat; Frazzitta, Giuseppe

    2016-01-01

    The principal feature of Parkinson's disease (PD) is the impaired ability to acquire and express habitual-automatic actions due to the loss of dopamine in the dorsolateral striatum, the region of the basal ganglia associated with the control of habitual behavior. Dopamine replacement therapy (DRT) compensates for the lack of dopamine, representing the standard treatment for different motor symptoms of PD (such as rigidity, bradykinesia and resting tremor). On the other hand, rehabilitation treatments, exploiting the use of cognitive strategies, feedbacks and external cues, permit to "learn to bypass" the defective basal ganglia (using the dorsolateral area of the prefrontal cortex) allowing the patients to perform correct movements under executive-volitional control. Therefore, DRT and rehabilitation seem to be two complementary and synergistic approaches. Learning and reward are central in rehabilitation: both of these mechanisms are the basis for the success of any rehabilitative treatment. Anyway, it is known that "learning resources" and reward could be negatively influenced from dopaminergic drugs. Furthermore, DRT causes different well-known complications: among these, dyskinesias, motor fluctuations, and dopamine dysregulation syndrome (DDS) are intimately linked with the alteration in the learning and reward mechanisms and could impact seriously on the rehabilitative outcomes. These considerations highlight the need for careful titration of DRT to produce the desired improvement in motor symptoms while minimizing the associated detrimental effects. This is important in order to maximize the motor re-learning based on repetition, reward and practice during rehabilitation. In this scenario, we review the knowledge concerning the interactions between DRT, learning and reward, examine the most impactful DRT side effects and provide suggestions for optimizing rehabilitation in PD. PMID:27378872

  3. Dopamine Replacement Therapy, Learning and Reward Prediction in Parkinson’s Disease: Implications for Rehabilitation

    PubMed Central

    Ferrazzoli, Davide; Carter, Adrian; Ustun, Fatma S.; Palamara, Grazia; Ortelli, Paola; Maestri, Roberto; Yücel, Murat; Frazzitta, Giuseppe

    2016-01-01

    The principal feature of Parkinson’s disease (PD) is the impaired ability to acquire and express habitual-automatic actions due to the loss of dopamine in the dorsolateral striatum, the region of the basal ganglia associated with the control of habitual behavior. Dopamine replacement therapy (DRT) compensates for the lack of dopamine, representing the standard treatment for different motor symptoms of PD (such as rigidity, bradykinesia and resting tremor). On the other hand, rehabilitation treatments, exploiting the use of cognitive strategies, feedbacks and external cues, permit to “learn to bypass” the defective basal ganglia (using the dorsolateral area of the prefrontal cortex) allowing the patients to perform correct movements under executive-volitional control. Therefore, DRT and rehabilitation seem to be two complementary and synergistic approaches. Learning and reward are central in rehabilitation: both of these mechanisms are the basis for the success of any rehabilitative treatment. Anyway, it is known that “learning resources” and reward could be negatively influenced from dopaminergic drugs. Furthermore, DRT causes different well-known complications: among these, dyskinesias, motor fluctuations, and dopamine dysregulation syndrome (DDS) are intimately linked with the alteration in the learning and reward mechanisms and could impact seriously on the rehabilitative outcomes. These considerations highlight the need for careful titration of DRT to produce the desired improvement in motor symptoms while minimizing the associated detrimental effects. This is important in order to maximize the motor re-learning based on repetition, reward and practice during rehabilitation. In this scenario, we review the knowledge concerning the interactions between DRT, learning and reward, examine the most impactful DRT side effects and provide suggestions for optimizing rehabilitation in PD. PMID:27378872

  4. Neuroethics of deep brain stimulation for mental disorders: brain stimulation reward in humans.

    PubMed

    Oshima, Hideki; Katayama, Yoichi

    2010-01-01

    The theoretical basis of some deep brain stimulation (DBS) trials undertaken in the early years was the phenomenon of "brain stimulation reward (BSR)," which was first identified in rats. The animals appeared to be rewarded by pleasure caused by the stimulation of certain brain regions (reward system), such as the septal area. "Self-stimulation" experiments, in which rats were allowed to stimulate their own brain by pressing a freely accessible lever, they quickly learned lever pressing and sometimes continued to stimulate until they exhausted themselves. BSR was also observed with DBS of the septal area in humans. DBS trials in later years were undertaken on other theoretical bases, but unexpected BSR was sometimes induced by stimulation of some areas, such as the locus coeruleus complex. When BSR was induced, the subjects experienced feelings that were described as "cheerful," "alert," "good," "well-being," "comfort," "relaxation," "joy," or "satisfaction." Since the DBS procedure is equivalent to a "self-stimulation" experiment, they could become "addicted to the stimulation itself" or "compulsive about the stimulation," and stimulate themselves "for the entire day," "at maximum amplitude" and, in some instances, "into convulsions." DBS of the reward system has recently been applied to alleviate anhedonia in patients with refractory major depression. Although this approach appears promising, there remains a difficult problem: who can adjust their feelings and reward-oriented behavior within the normal range? With a self-stimulation procedure, the BSR may become uncontrollable. To develop DBS to the level of a standard therapy for mental disorders, we need to discuss "Who has the right to control the mental condition?" and "Who makes decisions" on "How much control is appropriate?" in daily life. PMID:20885119

  5. Neuroethics of deep brain stimulation for mental disorders: brain stimulation reward in humans.

    PubMed

    Oshima, Hideki; Katayama, Yoichi

    2010-01-01

    The theoretical basis of some deep brain stimulation (DBS) trials undertaken in the early years was the phenomenon of "brain stimulation reward (BSR)," which was first identified in rats. The animals appeared to be rewarded by pleasure caused by the stimulation of certain brain regions (reward system), such as the septal area. "Self-stimulation" experiments, in which rats were allowed to stimulate their own brain by pressing a freely accessible lever, they quickly learned lever pressing and sometimes continued to stimulate until they exhausted themselves. BSR was also observed with DBS of the septal area in humans. DBS trials in later years were undertaken on other theoretical bases, but unexpected BSR was sometimes induced by stimulation of some areas, such as the locus coeruleus complex. When BSR was induced, the subjects experienced feelings that were described as "cheerful," "alert," "good," "well-being," "comfort," "relaxation," "joy," or "satisfaction." Since the DBS procedure is equivalent to a "self-stimulation" experiment, they could become "addicted to the stimulation itself" or "compulsive about the stimulation," and stimulate themselves "for the entire day," "at maximum amplitude" and, in some instances, "into convulsions." DBS of the reward system has recently been applied to alleviate anhedonia in patients with refractory major depression. Although this approach appears promising, there remains a difficult problem: who can adjust their feelings and reward-oriented behavior within the normal range? With a self-stimulation procedure, the BSR may become uncontrollable. To develop DBS to the level of a standard therapy for mental disorders, we need to discuss "Who has the right to control the mental condition?" and "Who makes decisions" on "How much control is appropriate?" in daily life.

  6. Delay discounting of hypothetical monetary rewards with decoys.

    PubMed

    Kowal, Benjamin P; Faulkner, Jennifer L

    2016-01-01

    The current research attempted to decrease individuals' rates of delay discounting by introducing decoys that are similar but inferior to delayed rewards. Two experiments in the current study compared patterns of delay discounting generated by repeated choices between two hypothetical monetary rewards in the absence or presence of a decoy. Binary questionnaires (i.e., decoy absent) included questions with two options: a smaller-sooner (SS) reward and a larger-later (LL) reward. Trinary questionnaires (i.e., decoy present) included questions with three options: an SS reward, an LL reward, and a decoy. If an option is at least as rewarding on every dimension of value as an alternative and the option is more rewarding than an alternative on at least one dimension, then the option is considered to dominate the alternative (Wedell, 1991). The first experiment assessed the influence of decoys dominated by LL rewards (LL(-) decoys), which were constructed to be similar (on the dimension of amount) but inferior (on the dimension of delay) to LL rewards. The second experiment examined the effects of counterbalancing the order of binary and trinary questionnaires. In the first experiment, participants discounted to a lesser degree when LL(-) decoys were present as compared to when they were absent. In the second experiment, participants only discounted to a lesser degree on trinary questionnaires with LL(-) decoys when they had not previously completed binary questionnaires. Patterns of discounting generated by binary questionnaires were similar to those generated by trinary questionnaires when decoys are present; however, the degree to which individuals discounted delayed rewards was affected by the number of and type of options that were available. The current results join previous evidence suggesting that rates of delay discounting are sensitive to a variety of contextual influences. PMID:26521171

  7. Delay discounting of hypothetical monetary rewards with decoys.

    PubMed

    Kowal, Benjamin P; Faulkner, Jennifer L

    2016-01-01

    The current research attempted to decrease individuals' rates of delay discounting by introducing decoys that are similar but inferior to delayed rewards. Two experiments in the current study compared patterns of delay discounting generated by repeated choices between two hypothetical monetary rewards in the absence or presence of a decoy. Binary questionnaires (i.e., decoy absent) included questions with two options: a smaller-sooner (SS) reward and a larger-later (LL) reward. Trinary questionnaires (i.e., decoy present) included questions with three options: an SS reward, an LL reward, and a decoy. If an option is at least as rewarding on every dimension of value as an alternative and the option is more rewarding than an alternative on at least one dimension, then the option is considered to dominate the alternative (Wedell, 1991). The first experiment assessed the influence of decoys dominated by LL rewards (LL(-) decoys), which were constructed to be similar (on the dimension of amount) but inferior (on the dimension of delay) to LL rewards. The second experiment examined the effects of counterbalancing the order of binary and trinary questionnaires. In the first experiment, participants discounted to a lesser degree when LL(-) decoys were present as compared to when they were absent. In the second experiment, participants only discounted to a lesser degree on trinary questionnaires with LL(-) decoys when they had not previously completed binary questionnaires. Patterns of discounting generated by binary questionnaires were similar to those generated by trinary questionnaires when decoys are present; however, the degree to which individuals discounted delayed rewards was affected by the number of and type of options that were available. The current results join previous evidence suggesting that rates of delay discounting are sensitive to a variety of contextual influences.

  8. Anticipatory reward signals in ventral striatal neurons of behaving rats.

    PubMed

    Khamassi, Mehdi; Mulder, Antonius B; Tabuchi, Eiichi; Douchamps, Vincent; Wiener, Sidney I

    2008-11-01

    It has been proposed that the striatum plays a crucial role in learning to select appropriate actions, optimizing rewards according to the principles of 'Actor-Critic' models of trial-and-error learning. The ventral striatum (VS), as Critic, would employ a temporal difference (TD) learning algorithm to predict rewards and drive dopaminergic neurons. This study examined this model's adequacy for VS responses to multiple rewards in rats. The respective arms of a plus-maze provided rewards of varying magnitudes; multiple rewards were provided at 1-s intervals while the rat stood still. Neurons discharged phasically prior to each reward, during both initial approach and immobile waiting, demonstrating that this signal is predictive and not simply motor-related. In different neurons, responses could be greater for early, middle or late droplets in the sequence. Strikingly, this activity often reappeared after the final reward, as if in anticipation of yet another. In contrast, previous TD learning models show decremental reward-prediction profiles during reward consumption due to a temporal-order signal introduced to reproduce accurate timing in dopaminergic reward-prediction error signals. To resolve this inconsistency in a biologically plausible manner, we adapted the TD learning model such that input information is nonhomogeneously distributed among different neurons. By suppressing reward temporal-order signals and varying richness of spatial and visual input information, the model reproduced the experimental data. This validates the feasibility of a TD-learning architecture where different groups of neurons participate in solving the task based on varied input information. PMID:18973599

  9. Autistic traits modulate mimicry of social but not nonsocial rewards.

    PubMed

    Haffey, Anthony; Press, Clare; O'Connell, Garret; Chakrabarti, Bhismadev

    2013-12-01

    Autism Spectrum Conditions (ASC) are associated with diminished responsiveness to social stimuli, and especially to social rewards such as smiles. Atypical responsiveness to social rewards, which reinforce socially appropriate behavior in children, can potentially lead to a cascade of deficits in social behavior. Individuals with ASC often show diminished spontaneous mimicry of social stimuli in a natural setting. In the general population, mimicry is modulated both by the reward value and the sociality of the stimulus (i.e., whether the stimulus is perceived to belong to a conspecific or an inanimate object). Since empathy and autistic traits are distributed continuously in the general population, this study aimed to test if and how these traits modulated automatic mimicry of rewarded social and nonsocial stimuli. High and low rewards were associated with human and robot hands using a conditioned learning paradigm. Thirty-six participants from the general population then completed a mimicry task involving performing a prespecified hand movement which was either compatible or incompatible with a hand movement presented to the participant. High autistic traits (measured using the Autism Spectrum Quotient, AQ) predicted lesser mimicry of high-reward than low-reward conditioned human hands, whereas trait empathy showed an opposite pattern of correlations. No such relations were observed for high-reward vs. low-reward conditioned robot hands. These results demonstrate how autistic traits and empathy modulate the effects of reward on mimicry of social compared to nonsocial stimuli. This evidence suggests a potential role for the reward system in underlying the atypical social behavior in individuals with ASC, who constitute the extreme end of the spectrum of autistic traits.

  10. Effect of locomotion score on sows' performances in a feed reward collection test.

    PubMed

    Bos, E-J; Nalon, E; Maes, D; Ampe, B; Buijs, S; van Riet, M M J; Millet, S; Janssens, G P J; Tuyttens, F A M

    2015-10-01

    Sows housed in groups have to move through their pen to fulfil their behavioural and physiological needs such as feeding and resting. In addition to causing pain and discomfort, lameness may restrict the ability of sows to fulfil such needs. The aim of our study was to investigate the extent to which the mobility of sows is affected by different degrees of lameness. Mobility was measured as the sow's willingness or capability to cover distances. Feed-restricted hybrid sows with different gait scores were subjected to a feed reward collection test in which they had to walk distances to obtain subsequent rewards. In all, 29 group-housed sows at similar gestation stage (day 96.6 ± 7 s.d.) were visually recorded for gait and classified as non-lame, mildly lame, moderately lame or severely lame. All sows received 2.6 kg of standard commercial gestation feed per day. The test arena consisted of two feeding locations separated from each other by a Y-shaped middle barrier. Feed rewards were presented at the two feeders in turn, using both light and sound cues to signal the availability of a new feed reward. Sows were individually trained during 5 non-consecutive days for 10 min/day with increasing barrier length (range: 0 to 3.5 m) each day. After training, sows were individually tested once per day on 3 non-consecutive days with the maximum barrier length such that they had to cover 9.3 m to walk from one feeder to the other. The outcome variable was the number of rewards collected in a 15-min time span. Non-lame and mildly lame sows obtained more rewards than moderately lame and severely lame sows (P<0.01). However, no significant difference was found between non-lame and mildly lame sows (P=0.69), nor between moderately lame and severely lame sows (P=1.00). This feed reward collection test indicates that both moderately lame and severely lame sows are limited in their combined ability and willingness to walk, but did not reveal an effect of mild lameness on mobility

  11. Effects of Trace Amine-associated Receptor 1 Agonists on the Expression, Reconsolidation, and Extinction of Cocaine Reward Memory

    PubMed Central

    Liu, Jian-Feng; Thorn, David A; Zhang, Yanan

    2016-01-01

    Background: As a modulator of dopaminergic system, trace amine-associated receptor 1 has been shown to play a critical role in regulating the rewarding properties of additive drugs. It has been demonstrated that activation of trace amine-associated receptor 1 decreased the abuse-related behaviors of cocaine in rats. However, the role of trace amine-associated receptor 1 in specific stages of cocaine reward memory is still unclear. Methods: Here, using a cocaine-induced conditioned place preference model, we tested the effects of a selective trace amine-associated receptor 1 agonist RO5166017 on the expression, reconsolidation, and extinction of cocaine reward memory. Results: We found that RO5166017 inhibited the expression but not retention of cocaine-induced conditioned place preference. RO5166017 had no effect on the reconsolidation of cocaine reward memory. Pretreatment with RO5166017 before extinction hindered the formation of extinction long-term memory. RO5166017 did not affect the movement during the conditioned place preference test, indicating the inhibitory effect of RO5166017 on the expression of cocaine-induced conditioned place preference was not caused by locomotion inhibition. Using a cocaine i.v. self-administration model, we found that the combined trace amine-associated receptor 1 partial agonist RO5263397 with extinction had no effect on the following cue- and drug-induced reinstatement of cocaine-seeking behavior. Repeated administration of the trace amine-associated receptor 1 agonist during extinction showed a continually inhibitory effect on the expression of cocaine reward memory both in cocaine-induced conditioned place preference and cocaine self-administration models. Conclusions: Taken together, these results indicate that activation of trace amine-associated receptor 1 specifically inhibited the expression of cocaine reward memory. The inhibitory effect of trace amine-associated receptor 1 agonists on cocaine reward memory suggests

  12. Reward contingencies and the recalibration of task monitoring and reward systems: a high-density electrical mapping study.

    PubMed

    Morie, K P; De Sanctis, P; Foxe, J J

    2014-07-25

    Task execution almost always occurs in the context of reward-seeking or punishment-avoiding behavior. As such, ongoing task-monitoring systems are influenced by reward anticipation systems. In turn, when a task has been executed either successfully or unsuccessfully, future iterations of that task will be re-titrated on the basis of the task outcome. Here, we examined the neural underpinnings of the task-monitoring and reward-evaluation systems to better understand how they govern reward-seeking behavior. Twenty-three healthy adult participants performed a task where they accrued points that equated to real world value (gift cards) by responding as rapidly as possible within an allotted timeframe, while success rate was titrated online by changing the duration of the timeframe dependent on participant performance. Informative cues initiated each trial, indicating the probability of potential reward or loss (four levels from very low to very high). We manipulated feedback by first informing participants of task success/failure, after which a second feedback signal indicated actual magnitude of reward/loss. High-density electroencephalography (EEG) recordings allowed for examination of event-related potentials (ERPs) to the informative cues and in turn, to both feedback signals. Distinct ERP components associated with reward cues, task-preparatory and task-monitoring processes, and reward feedback processes were identified. Unsurprisingly, participants displayed increased ERP amplitudes associated with task-preparatory processes following cues that predicted higher chances of reward. They also rapidly updated reward and loss prediction information dependent on task performance after the first feedback signal. Finally, upon reward receipt, initial reward probability was no longer taken into account. Rather, ERP measures suggested that only the magnitude of actual reward or loss was now processed. Reward and task-monitoring processes are clearly dissociable, but

  13. Reward Contingencies and the Recalibration of Task Monitoring and Reward Systems: A high-density electrical mapping study

    PubMed Central

    Morie, Kristen P.; De Sanctis, Pierfilippo; Foxe, John J.

    2014-01-01

    Task execution almost always occurs in the context of reward-seeking or punishment-avoiding behavior. As such, ongoing task monitoring systems are influenced by reward anticipation systems. In turn, when a task has been executed either successfully or unsuccessfully, future iterations of that task will be re-titrated on the basis of the task outcome. Here, we examined the neural underpinnings of the task-monitoring and reward-evaluation systems to better understand how they govern reward seeking behavior. Twenty-three healthy adult participants performed a task where they accrued points that equated to real world value (gift cards) by responding as rapidly as possible within an allotted timeframe, while success rate was titrated online by changing the duration of the timeframe dependent on participant performance. Informative cues initiated each trial, indicating the probability of potential reward or loss (four levels from very low to very high). We manipulated feedback by first informing participants of task success/failure, after which a second feedback signal indicated actual magnitude of reward/loss. High-density EEG recordings allowed for examination of event-related potentials (ERPs) to the informative cues and in turn, to both feedback signals. Distinct ERP components associated with reward cues, task preparatory and task monitoring processes, and reward feedback processes were identified. Unsurprisingly, participants displayed increased ERP amplitudes associated with task preparatory processes following cues that predicted higher chances of reward. They also rapidly updated reward and loss prediction information dependent on task performance after the first feedback signal. Finally, upon reward receipt, initial reward probability was no longer taken into account. Rather, ERP measures suggested that only the magnitude of actual reward or loss was now processed. Reward and task monitoring processes are clearly dissociable, but interact across very fast

  14. Reward contingencies and the recalibration of task monitoring and reward systems: a high-density electrical mapping study.

    PubMed

    Morie, K P; De Sanctis, P; Foxe, J J

    2014-07-25

    Task execution almost always occurs in the context of reward-seeking or punishment-avoiding behavior. As such, ongoing task-monitoring systems are influenced by reward anticipation systems. In turn, when a task has been executed either successfully or unsuccessfully, future iterations of that task will be re-titrated on the basis of the task outcome. Here, we examined the neural underpinnings of the task-monitoring and reward-evaluation systems to better understand how they govern reward-seeking behavior. Twenty-three healthy adult participants performed a task where they accrued points that equated to real world value (gift cards) by responding as rapidly as possible within an allotted timeframe, while success rate was titrated online by changing the duration of the timeframe dependent on participant performance. Informative cues initiated each trial, indicating the probability of potential reward or loss (four levels from very low to very high). We manipulated feedback by first informing participants of task success/failure, after which a second feedback signal indicated actual magnitude of reward/loss. High-density electroencephalography (EEG) recordings allowed for examination of event-related potentials (ERPs) to the informative cues and in turn, to both feedback signals. Distinct ERP components associated with reward cues, task-preparatory and task-monitoring processes, and reward feedback processes were identified. Unsurprisingly, participants displayed increased ERP amplitudes associated with task-preparatory processes following cues that predicted higher chances of reward. They also rapidly updated reward and loss prediction information dependent on task performance after the first feedback signal. Finally, upon reward receipt, initial reward probability was no longer taken into account. Rather, ERP measures suggested that only the magnitude of actual reward or loss was now processed. Reward and task-monitoring processes are clearly dissociable, but

  15. Opportunity NYC--Family Rewards: Qualitative Study of Family Communication

    ERIC Educational Resources Information Center

    Fraker, Carolyn A.; Greenberg, David

    2011-01-01

    Aimed at low-income families in six of New York City's highest-poverty communities, the Family Rewards program ties cash rewards to a pre-specified set of activities. This paper presents the qualitative findings from interviews with 77 families. It examines how families incorporated the program into their households, and specifically the…

  16. Cognitive regulation of saccadic velocity by reward prospect.

    PubMed

    Chen, Lewis L; Hung, Leroy Y; Quinet, Julie; Kosek, Kevin

    2013-08-01

    It is known that expectation of reward speeds up saccades. Past studies have also shown the presence of a saccadic velocity bias in the orbit, resulting from a biomechanical regulation over varying eccentricities. Nevertheless, whether and how reward expectation interacts with the biomechanical regulation of saccadic velocities over varying eccentricities remains unknown. We addressed this question by conducting a visually guided double-step saccade task. The role of reward expectation was tested in monkeys performing two consecutive horizontal saccades, one associated with reward prospect and the other not. To adequately assess saccadic velocity and avoid adaptation, we systematically varied initial eye positions, saccadic directions and amplitudes. Our results confirmed the existence of a velocity bias in the orbit, i.e., saccadic peak velocity decreased linearly as the initial eye position deviated in the direction of the saccade. The slope of this bias increased as saccadic amplitudes increased. Nevertheless, reward prospect facilitated velocity to a greater extent for saccades away from than for saccades toward the orbital centre, rendering an overall reduction in the velocity bias. The rate (slope) and magnitude (intercept) of reward modulation over this velocity bias were linearly correlated with amplitudes, similar to the amplitude-modulated velocity bias without reward prospect, which presumably resulted from a biomechanical regulation. Small-amplitude (≤ 5°) saccades received little modulation. These findings together suggest that reward expectation modulated saccadic velocity not as an additive signal but as a facilitating mechanism that interacted with the biomechanical regulation.

  17. Developmental Continuity in Reward-Related Enhancement of Cognitive Control

    PubMed Central

    Strang, Nicole M.; Pollak, Seth D.

    2015-01-01

    Adolescents engage in more risky behavior than children or adults. The most prominent hypothesis for this phenomenon is that brain systems governing reward sensitivity and brain systems governing self-regulation mature at different rates. Those systems governing reward sensitivity mature in advance of those governing self-control. This hypothesis has substantial empirical support, however, the evidence supporting this theory has been exclusively derived from contexts where self-control systems are required to regulate reward sensitivity in order to promote adaptive behavior. In adults, reward promotes a shift to a proactive control strategy and better cognitive control performance. It is unclear whether children and adolescents will respond to reward in the same way. Using fMRI methodology, we explored whether children and adolescents would demonstrate a shift to proactive control in the context of reward. We tested 22 children, 20 adolescents, and 23 adults. In contrast to our hypothesis, children, adolescents, and adults all demonstrated a shift to proactive cognitive control in the context of reward. In light of the results, current neurobiological theories of adolescent behavior need to be refined to reflect that in certain contexts there is continuity in the manner reward and cognitive control systems interact across development. PMID:25160678

  18. Trait Anticipatory Pleasure Predicts Effort Expenditure for Reward.

    PubMed

    Geaney, Joachim T; Treadway, Michael T; Smillie, Luke D

    2015-01-01

    Research in motivation and emotion has been increasingly influenced by the perspective that processes underpinning the motivated approach of rewarding goals are distinct from those underpinning enjoyment during reward consummation. This distinction recently inspired the construction of the Temporal Experience of Pleasure Scale (TEPS), a self-report measure that distinguishes trait anticipatory pleasure (pre-reward feelings of desire) from consummatory pleasure (feelings of enjoyment and gratification upon reward attainment). In a university community sample (N = 97), we examined the TEPS subscales as predictors of (1) the willingness to expend effort for monetary rewards, and (2) affective responses to a pleasant mood induction procedure. Results showed that both anticipatory pleasure and a well-known trait measure of reward motivation predicted effort-expenditure for rewards when the probability of being rewarded was relatively low. Against expectations, consummatory pleasure was unrelated to induced pleasant affect. Taken together, our findings provide support for the validity of the TEPS anticipatory pleasure scale, but not the consummatory pleasure scale. PMID:26115223

  19. Effects of Teacher Rewards on Recognition and Job Enrichment.

    ERIC Educational Resources Information Center

    Frase, Larry E.

    1989-01-01

    Implications of Herzberg's motivation-hygiene theory for teacher reward programs were tested by comparing changes in teachers' (N=38) job-enrichment opportunities and recognition after the teachers had chosen one of two rewards (travel to professional training conferences or cash). Results were consistent with the motivation-hygiene theory. (IAH)

  20. The Use of Different Rules to Allocate Reward and Punishment.

    ERIC Educational Resources Information Center

    Mueller, Charles W.

    Much research has been conducted about how and when individuals allocate rewards, yet little research exists concerning the allocation of punishment. The process of allocating negative outcomes may be different from the decision making process for positive outcomes. To examine the decision making process for allocating rewards and punishment,…

  1. Situational Influences and Sex Differences in Children's Reward Allocation Behavior.

    ERIC Educational Resources Information Center

    Barnett, Mark A.

    The effects of situational influences and sex differences in the reward allocation behavior of children was investigated in four studies. Experiment 1 focused on the distribution of rewards to workers presented as being in either a unit or non-unit relationship with each other. The second experiment determined whether a similar pattern of sex…

  2. Do substantia nigra dopaminergic neurons differentiate between reward and punishment?

    PubMed

    Frank, Michael J; Surmeier, D James

    2009-10-01

    The activity of dopaminergic neurons are thought to be increased by stimuli that predict reward and decreased by stimuli that predict aversive outcomes. Recent work by Matsumoto and Hikosaka challenges this model by asserting that stimuli associated with either rewarding or aversive outcomes increase the activity of dopaminergic neurons in the substantia nigra pars compacta.

  3. Antisocial pool rewarding does not deter public cooperation.

    PubMed

    Szolnoki, Attila; Perc, Matjaž

    2015-10-01

    Rewarding cooperation is in many ways expected behaviour from social players. However, strategies that promote antisocial behaviour are also surprisingly common, not just in human societies, but also among eusocial insects and bacteria. Examples include sanctioning of individuals who behave prosocially, or rewarding of free-riders who do not contribute to collective enterprises. We therefore study the public goods game with antisocial and prosocial pool rewarding in order to determine the potential negative consequences on the effectiveness of positive incentives to promote cooperation. Contrary to a naive expectation, we show that the ability of defectors to distribute rewards to their like does not deter public cooperation as long as cooperators are able to do the same. Even in the presence of antisocial rewarding, the spatial selection for cooperation in evolutionary social dilemmas is enhanced. Since the administration of rewards to either strategy requires a considerable degree of aggregation, cooperators can enjoy the benefits of their prosocial contributions as well as the corresponding rewards. Defectors when aggregated, on the other hand, can enjoy antisocial rewards, but due to their lack of contributions to the public good they ultimately succumb to their inherent inability to secure a sustainable future. Strategies that facilitate the aggregation of akin players, even if they seek to promote antisocial behaviour, thus always enhance the long-term benefits of cooperation. PMID:26400746

  4. Antisocial pool rewarding does not deter public cooperation.

    PubMed

    Szolnoki, Attila; Perc, Matjaž

    2015-10-01

    Rewarding cooperation is in many ways expected behaviour from social players. However, strategies that promote antisocial behaviour are also surprisingly common, not just in human societies, but also among eusocial insects and bacteria. Examples include sanctioning of individuals who behave prosocially, or rewarding of free-riders who do not contribute to collective enterprises. We therefore study the public goods game with antisocial and prosocial pool rewarding in order to determine the potential negative consequences on the effectiveness of positive incentives to promote cooperation. Contrary to a naive expectation, we show that the ability of defectors to distribute rewards to their like does not deter public cooperation as long as cooperators are able to do the same. Even in the presence of antisocial rewarding, the spatial selection for cooperation in evolutionary social dilemmas is enhanced. Since the administration of rewards to either strategy requires a considerable degree of aggregation, cooperators can enjoy the benefits of their prosocial contributions as well as the corresponding rewards. Defectors when aggregated, on the other hand, can enjoy antisocial rewards, but due to their lack of contributions to the public good they ultimately succumb to their inherent inability to secure a sustainable future. Strategies that facilitate the aggregation of akin players, even if they seek to promote antisocial behaviour, thus always enhance the long-term benefits of cooperation.

  5. Developmental continuity in reward-related enhancement of cognitive control.

    PubMed

    Strang, Nicole M; Pollak, Seth D

    2014-10-01

    Adolescents engage in more risky behavior than children or adults. The most prominent hypothesis for this phenomenon is that brain systems governing reward sensitivity and brain systems governing self-regulation mature at different rates. Those systems governing reward sensitivity mature in advance of those governing self-control. This hypothesis has substantial empirical support, however, the evidence supporting this theory has been exclusively derived from contexts where self-control systems are required to regulate reward sensitivity in order to promote adaptive behavior. In adults, reward promotes a shift to a proactive control strategy and better cognitive control performance. It is unclear whether children and adolescents will respond to reward in the same way. Using fMRI methodology, we explored whether children and adolescents would demonstrate a shift to proactive control in the context of reward. We tested 22 children, 20 adolescents, and 23 adults. In contrast to our hypothesis, children, adolescents, and adults all demonstrated a shift to proactive cognitive control in the context of reward. In light of the results, current neurobiological theories of adolescent behavior need to be refined to reflect that in certain contexts there is continuity in the manner reward and cognitive control systems interact across development.

  6. Motivation and Competence as Determinants of Young Children's Reward Allocation

    ERIC Educational Resources Information Center

    Nelson, Sharon A.; Dweck, Carol S.

    1977-01-01

    This study examined the effects of allocation instructions and self-interest on preschool children's use of the rule of equity in situations involving reward allocation. Results showed that when the demand for equity was explicit and self-interest was removed, all children used equity in allocating rewards. (Author/JMB)

  7. Reinforcement, Reward, and Intrinsic Motivation: A Meta-Analysis.

    ERIC Educational Resources Information Center

    Cameron, Judy; Pierce, W. David

    1994-01-01

    A meta-analysis including 96 experimental studies considers the effects of reinforcement/reward on intrinsic motivation. Results indicate that reward does not decrease intrinsic motivation, although interaction effects must be examined. An analysis with five studies also indicates that reinforcement does not harm intrinsic motivation. (SLD)

  8. Representation of reward feedback in primate auditory cortex.

    PubMed

    Brosch, Michael; Selezneva, Elena; Scheich, Henning

    2011-01-01

    It is well established that auditory cortex is plastic on different time scales and that this plasticity is driven by the reinforcement that is used to motivate subjects to learn or to perform an auditory task. Motivated by these findings, we study in detail properties of neuronal firing in auditory cortex that is related to reward feedback. We recorded from the auditory cortex of two monkeys while they were performing an auditory categorization task. Monkeys listened to a sequence of tones and had to signal when the frequency of adjacent tones stepped in downward direction, irrespective of the tone frequency and step size. Correct identifications were rewarded with either a large or a small amount of water. The size of reward depended on the monkeys' performance in the previous trial: it was large after a correct trial and small after an incorrect trial. The rewards served to maintain task performance. During task performance we found three successive periods of neuronal firing in auditory cortex that reflected (1) the reward expectancy for each trial, (2) the reward-size received, and (3) the mismatch between the expected and delivered reward. These results, together with control experiments suggest that auditory cortex receives reward feedback that could be used to adapt auditory cortex to task requirements. Additionally, the results presented here extend previous observations of non-auditory roles of auditory cortex and shows that auditory cortex is even more cognitively influenced than lately recognized.

  9. The Effects of Extrinsic Rewards on Admissions Counselors' Performance

    ERIC Educational Resources Information Center

    Gardner-Engel, Miriam

    2010-01-01

    This study examines the best ways to motivate college admissions counselors. A review of literature revealed multiple perspectives on intrinsic and extrinsic as well as tangible and intangible rewards. Primary research was designed to examine the impact of tangible rewards and verbal reinforcements with a convenience sample of nine college…

  10. Rewards for Reading: Their Effects on Reading Motivation

    ERIC Educational Resources Information Center

    Chen, Pin-Hwa; Wu, Jen-Rung

    2010-01-01

    In recent years, many Taiwanese elementary schools have implemented extensive reading activities in their respective campuses. In order to motivate pupils to read, teachers and parents would offer pupils contingent rewards. As we know, the use of rewards in educational settings as a way to improve motivation is a controversial issue. Previous…

  11. 5 CFR 9701.409 - Rating and rewarding performance.

    Code of Federal Regulations, 2012 CFR

    2012-01-01

    ... SECURITY HUMAN RESOURCES MANAGEMENT SYSTEM Performance Management § 9701.409 Rating and rewarding... performance. Such policies must comply with 5 U.S.C. chapter 35 and 5 CFR 351.504. ... 5 Administrative Personnel 3 2012-01-01 2012-01-01 false Rating and rewarding performance....

  12. 5 CFR 9701.409 - Rating and rewarding performance.

    Code of Federal Regulations, 2014 CFR

    2014-01-01

    ... SECURITY HUMAN RESOURCES MANAGEMENT SYSTEM Performance Management § 9701.409 Rating and rewarding... performance. Such policies must comply with 5 U.S.C. chapter 35 and 5 CFR 351.504. ... 5 Administrative Personnel 3 2014-01-01 2014-01-01 false Rating and rewarding performance....

  13. 5 CFR 9701.409 - Rating and rewarding performance.

    Code of Federal Regulations, 2011 CFR

    2011-01-01

    ... SECURITY HUMAN RESOURCES MANAGEMENT SYSTEM Performance Management § 9701.409 Rating and rewarding... performance. Such policies must comply with 5 U.S.C. chapter 35 and 5 CFR 351.504. ... 5 Administrative Personnel 3 2011-01-01 2011-01-01 false Rating and rewarding performance....

  14. Trait Anticipatory Pleasure Predicts Effort Expenditure for Reward

    PubMed Central

    Geaney, Joachim T.; Treadway, Michael T.; Smillie, Luke D.

    2015-01-01

    Research in motivation and emotion has been increasingly influenced by the perspective that processes underpinning the motivated approach of rewarding goals are distinct from those underpinning enjoyment during reward consummation. This distinction recently inspired the construction of the Temporal Experience of Pleasure Scale (TEPS), a self-report measure that distinguishes trait anticipatory pleasure (pre-reward feelings of desire) from consummatory pleasure (feelings of enjoyment and gratification upon reward attainment). In a university community sample (N = 97), we examined the TEPS subscales as predictors of (1) the willingness to expend effort for monetary rewards, and (2) affective responses to a pleasant mood induction procedure. Results showed that both anticipatory pleasure and a well-known trait measure of reward motivation predicted effort-expenditure for rewards when the probability of being rewarded was relatively low. Against expectations, consummatory pleasure was unrelated to induced pleasant affect. Taken together, our findings provide support for the validity of the TEPS anticipatory pleasure scale, but not the consummatory pleasure scale. PMID:26115223

  15. When Rewards Go Wrong: A Tale of Five Motivational Misdirects

    ERIC Educational Resources Information Center

    Steel, Piers; MacDonnell, Rhiannon

    2012-01-01

    At the heart of most performance management systems is a reward program. However, even when we are doing everything else right, rewards can go wrong. Here, we explore five ways that external incentives can damage performance, from destroying altruistic behavior to distracting people from the task. Fortunately, most of these downfalls are…

  16. Reward Improves Cancellation and Restraint Inhibition across Childhood and Adolescence

    ERIC Educational Resources Information Center

    Sinopoli, Katia J.; Schachar, Russell; Dennis, Maureen

    2011-01-01

    Inhibitory control allows for the regulation of thought and action and interacts with motivational variables, such as reward, to modify behavior adaptively as environments change. The authors examined the effects of reward on two distinct forms of inhibitory control, cancellation and restraint. Typically developing children and adolescents…

  17. The Environmental Reward Observation Scale (EROS): Development, Validity, and Reliability

    ERIC Educational Resources Information Center

    Armento, Maria E. A.; Hopko, Derek R.

    2007-01-01

    Researchers acknowledge a strong association between the frequency and duration of environmental reward and affective mood states, particularly in relation to the etiology, assessment, and treatment of depression. Given behavioral theories that outline environmental reward as a strong mediator of affect and the unavailability of an efficient,…

  18. Managing Reward in Developing Economies: The Challenge for Multinational Corporations

    ERIC Educational Resources Information Center

    Opute, John

    2010-01-01

    Reward has been, and continues to be, subject to significant changes in developing economies; the industrial relations model prevalent being driven by the complex socio-economic and cultural paradigms and the increasing demands of globalisation. The issue of reward in developing economies is therefore central and dependent on numerous contextual…

  19. Neural Reward and Punishment Sensitivity in Cigarette Smokers

    PubMed Central

    Potts, Geoffrey F.; Bloom, Erika; Evans, David E.; Drobes, David J.

    2014-01-01

    Background Nicotine addiction remains a major public health problem but the neural substrates of addictive behavior remain unknown. One characteristic of smoking behavior is impulsive choice, selecting the immediate reward of smoking despite the potential long-term negative consequences. This suggests that drug users, including cigarette smokers, may be more sensitive to rewards and less sensitive to punishment. Methods We used event-related potentials (ERPs) to test the hypothesis that smokers are more responsive to reward signals and less responsive to punishment, potentially predisposing them to risky behavior. We conducted two experiments, one using a reward prediction design to elicit a Medial Frontal Negativity (MFN) and one using a reward- and punishment-motivated flanker task to elicit an Error Related Negativity (ERN), ERP components thought to index activity in the cortical projection of the dopaminergic reward system. Results and Conclusions The smokers had a greater MFN response to unpredicted rewards, and non-smokers, but not smokers, had a larger ERN on punishment motivated trials indicating that smokers are more reward sensitive and less punishment sensitive than nonsmokers, overestimating the appetitive value and underestimating aversive outcomes of stimuli and actions. PMID:25292454

  20. Multi Agent Reward Analysis for Learning in Noisy Domains

    NASA Technical Reports Server (NTRS)

    Tumer, Kagan; Agogino, Adrian K.

    2005-01-01

    In many multi agent learning problems, it is difficult to determine, a priori, the agent reward structure that will lead to good performance. This problem is particularly pronounced in continuous, noisy domains ill-suited to simple table backup schemes commonly used in TD(lambda)/Q-learning. In this paper, we present a new reward evaluation method that allows the tradeoff between coordination among the agents and the difficulty of the learning problem each agent faces to be visualized. This method is independent of the learning algorithm and is only a function of the problem domain and the agents reward structure. We then use this reward efficiency visualization method to determine an effective reward without performing extensive simulations. We test this method in both a static and a dynamic multi-rover learning domain where the agents have continuous state spaces and where their actions are noisy (e.g., the agents movement decisions are not always carried out properly). Our results show that in the more difficult dynamic domain, the reward efficiency visualization method provides a two order of magnitude speedup in selecting a good reward. Most importantly it allows one to quickly create and verify rewards tailored to the observational limitations of the domain.

  1. The Use of Rewards and Punishment in Early Childhood Classrooms

    ERIC Educational Resources Information Center

    Moberly, Deborah A.; Waddle, Jerry L.; Duff, R. Eleanor

    2005-01-01

    Much has been written about the problems associated with reliance on extrinsic rewards and punishment in controlling behavior and motivating students. This study explores the use of extrinsic rewards and punishment by prekindergarten-grade 3 teachers in Missouri. The purpose of the study was to (a) determine the most common motivational practices…

  2. Developmental continuity in reward-related enhancement of cognitive control.

    PubMed

    Strang, Nicole M; Pollak, Seth D

    2014-10-01

    Adolescents engage in more risky behavior than children or adults. The most prominent hypothesis for this phenomenon is that brain systems governing reward sensitivity and brain systems governing self-regulation mature at different rates. Those systems governing reward sensitivity mature in advance of those governing self-control. This hypothesis has substantial empirical support, however, the evidence supporting this theory has been exclusively derived from contexts where self-control systems are required to regulate reward sensitivity in order to promote adaptive behavior. In adults, reward promotes a shift to a proactive control strategy and better cognitive control performance. It is unclear whether children and adolescents will respond to reward in the same way. Using fMRI methodology, we explored whether children and adolescents would demonstrate a shift to proactive control in the context of reward. We tested 22 children, 20 adolescents, and 23 adults. In contrast to our hypothesis, children, adolescents, and adults all demonstrated a shift to proactive cognitive control in the context of reward. In light of the results, current neurobiological theories of adolescent behavior need to be refined to reflect that in certain contexts there is continuity in the manner reward and cognitive control systems interact across development. PMID:25160678

  3. U.S. Geological Survey Rewarding Environment Culture Study, 2002

    USGS Publications Warehouse

    Nash, Janis C.; Paradise-Tornow, Carol A.; Gray, Vicki K.; Griffin-Bemis, Sarah P.; Agnew, Pamela R.; Bouchet, Nicole M.

    2010-01-01

    In its 2001 review of the U.S. Geological Survey (USGS), the National Research Council (NRC, p. 126) cautioned that ?high-quality personnel are essential for developing high-quality science information? and urged the USGS to ?devote substantial efforts to recruiting and retaining excellent staff.? Recognizing the importance of the NRC recommendation, the USGS has committed time and resources to create a rewarding work environment with the goal of achieving the following valued outcomes: ? USGS science vitality ? Customer satisfaction with USGS products and services ? Employee perceptions of the USGS as a rewarding place to work ? Heightened employee morale and commitment ? The ability to recruit and retain employees with critical skills To determine whether this investment of time and resources was proving to be successful, the USGS Human Resources Office conducted a Rewarding Environment Culture Study to answer the following four questions. ? Question 1: Does a rewarding work environment lead to the valued outcomes (identified above) that the USGS is seeking? ? Question 2: Which management, supervisory, and leadership behaviors contribute most to creating a rewarding work environment and to achieving the valued outcomes that the USGS is seeking? ? Question 3: Do USGS employees perceive that the USGS is a rewarding place to work? ? Question 4: What actions can and should be taken to enhance the USGS work environment? To begin the study, a conceptual model of a rewarding USGS environment was developed to test assumptions about a rewarding work environment. The Rewarding Environment model identifies the key components that are thought to contribute to a rewarding work environment and the valued outcomes that are thought to result from having a rewarding work environment. The 2002 Organizational Assessment Survey (OAS) was used as the primary data source for the study because it provided the most readily available data. Additional survey data were included as they

  4. Natural rewards, neuroplasticity, and non-drug addictions.

    PubMed

    Olsen, Christopher M

    2011-12-01

    There is a high degree of overlap between brain regions involved in processing natural rewards and drugs of abuse. "Non-drug" or "behavioral" addictions have become increasingly documented in the clinic, and pathologies include compulsive activities such as shopping, eating, exercising, sexual behavior, and gambling. Like drug addiction, non-drug addictions manifest in symptoms including craving, impaired control over the behavior, tolerance, withdrawal, and high rates of relapse. These alterations in behavior suggest that plasticity may be occurring in brain regions associated with drug addiction. In this review, I summarize data demonstrating that exposure to non-drug rewards can alter neural plasticity in regions of the brain that are affected by drugs of abuse. Research suggests that there are several similarities between neuroplasticity induced by natural and drug rewards and that, depending on the reward, repeated exposure to natural rewards might induce neuroplasticity that either promotes or counteracts addictive behavior.

  5. Motivating inhibition - reward prospect speeds up response cancellation.

    PubMed

    Boehler, Carsten N; Hopf, Jens-Max; Stoppel, Christian M; Krebs, Ruth M

    2012-12-01

    Reward prospect has been demonstrated to facilitate various cognitive and behavioral operations, particularly by enhancing the speed and vigor of processes linked to approaching reward. Studies in this domain typically employed task regimes in which participants' overt responses are facilitated by prospective rewards. In contrast, we demonstrate here that even the cancellation of a motor response can be accelerated by reward prospect, thus signifying reward-related benefits on restraint rather than approach behavior. Importantly, this facilitation occurred independent of strategy-related adjustments of response speed, which are known to systematically distort the estimation of response-cancellation speed. The fact that motivational factors can indeed facilitate response inhibition is not only relevant for understanding how motivation and response inhibition interact in healthy participants but also for work on various patient groups that display response-inhibition deficits, suggesting that core differences in the ability to inhibit motor responses have to be differentiated from motivational factors.

  6. Natural Rewards, Neuroplasticity, and Non-Drug Addictions

    PubMed Central

    Olsen, Christopher M.

    2011-01-01

    There is a high degree of overlap between brain regions involved in processing natural rewards and drugs of abuse. “Non-drug” or “behavioral” addictions have become increasingly documented in the clinic, and pathologies include compulsive activities such as shopping, eating, exercising, sexual behavior, and gambling. Like drug addiction, non-drug addictions manifest in symptoms including craving, impaired control over the behavior, tolerance, withdrawal, and high rates of relapse. These alterations in behavior suggest that plasticity may be occurring in brain regions associated with drug addiction. In this review, I summarize data demonstrating that exposure to non-drug rewards can alter neural plasticity in regions of the brain that are affected by drugs of abuse. Research suggests that there are several similarities between neuroplasticity induced by natural and drug rewards and that, depending on the reward, repeated exposure to natural rewards might induce neuroplasticity that either promotes or counteracts addictive behavior. PMID:21459101

  7. Finding intrinsic rewards by embodied evolution and constrained reinforcement learning.

    PubMed

    Uchibe, Eiji; Doya, Kenji

    2008-12-01

    Understanding the design principle of reward functions is a substantial challenge both in artificial intelligence and neuroscience. Successful acquisition of a task usually requires not only rewards for goals, but also for intermediate states to promote effective exploration. This paper proposes a method for designing 'intrinsic' rewards of autonomous agents by combining constrained policy gradient reinforcement learning and embodied evolution. To validate the method, we use Cyber Rodent robots, in which collision avoidance, recharging from battery packs, and 'mating' by software reproduction are three major 'extrinsic' rewards. We show in hardware experiments that the robots can find appropriate 'intrinsic' rewards for the vision of battery packs and other robots to promote approach behaviors. PMID:19013054

  8. Autistic traits modulate frontostriatal connectivity during processing of rewarding faces

    PubMed Central

    Neufeld, Janina; Johnstone, Tom; Chakrabarti, Bhismadev

    2014-01-01

    Deficits in facial mimicry have been widely reported in autism. Some studies have suggested that these deficits are restricted to spontaneous mimicry and do not extend to volitional mimicry. We bridge these apparently inconsistent observations by testing the impact of reward value on neural indices of mimicry and how autistic traits modulate this impact. Neutral faces were conditioned with high and low reward. Subsequently, functional connectivity between the ventral striatum (VS) and inferior frontal gyrus (IFG) was measured while neurotypical adults (n = 30) watched happy expressions made by these conditioned faces. We found greater VS–IFG connectivity in response to high reward vs low reward happy faces. This difference was negatively proportional to autistic traits, suggesting that reduced spontaneous mimicry of social stimuli seen in autism, may be related to a failure in the modulation of the mirror system by the reward system rather than a circumscribed deficit in the mirror system. PMID:24493838

  9. Exit, punishment and rewards in commons dilemmas: an experimental study.

    PubMed

    Bravo, Giangiacomo; Squazzoni, Flaminio

    2013-01-01

    Commons dilemmas are interaction situations where a common good is provided or exploited by a group of individuals so that optimal collective outcomes clash with private interests. Although in these situations, social norms and institutions exist that might help individuals to cooperate, little is known about the interaction effects between positive and negative incentives and exit options by individuals. We performed a modified public good game experiment to examine the effect of exit, rewards and punishment, as well as the interplay between exit and rewards and punishment. We found that punishment had a stronger effect than rewards on cooperation if considered by itself, whereas rewards had a stronger effect when combined with voluntary participation. This can be explained in terms of the 'framing effect', i.e., as the combination of exit and rewards might induce people to attach higher expected payoffs to cooperative strategies and expect better behaviour from others. PMID:23936356

  10. Parabolic discounting of monetary rewards by physical effort.

    PubMed

    Hartmann, Matthias N; Hager, Oliver M; Tobler, Philippe N; Kaiser, Stefan

    2013-11-01

    When humans and other animals make decisions in their natural environments prospective rewards have to be weighed against costs. It is well established that increasing costs lead to devaluation or discounting of reward. While our knowledge about discount functions for time and probability costs is quite advanced, little is known about how physical effort discounts reward. In the present study we compared three different models in a binary choice task in which human participants had to squeeze a handgrip to earn monetary rewards: a linear, a hyperbolic, and a parabolic model. On the group as well as the individual level, the concave parabolic model explained most variance of the choice data, thus contrasting with the typical hyperbolic discounting of reward value by delay. Research on effort discounting is not only important to basic science but also holds the potential to quantify aberrant motivational states in neuropsychiatric disorders.

  11. Optogenetics in Freely Moving Mammals: Dopamine and Reward.

    PubMed

    Zhang, Feng; Tsai, Hsing-Chen; Airan, Raag D; Stuber, Garret D; Adamantidis, Antoine R; de Lecea, Luis; Bonci, Antonello; Deisseroth, Karl

    2015-08-03

    Brain reward systems play a central role in the cognitive and hedonic behaviors of mammals. Multiple neuron types and brain regions are involved in reward processing, posing fascinating scientific questions, and major experimental challenges. Using diverse approaches including genetics, electrophysiology, imaging, and behavioral analysis, a large body of research has focused on both normal functioning of the reward circuitry and on its potential significance in neuropsychiatric diseases. In this introduction, we illustrate a real-world application of optogenetics to mammalian behavior and physiology, delineating procedures and technologies for optogenetic control of individual components of the reward circuitry. We describe the experimental setup and protocol for integrating optogenetic modulation of dopamine neurons with fast-scan cyclic voltammetry, conditioned place preference, and operant conditioning to assess the causal role of well-defined electrical and biochemical signals in reward-related behavior.

  12. Motivating inhibition - reward prospect speeds up response cancellation.

    PubMed

    Boehler, Carsten N; Hopf, Jens-Max; Stoppel, Christian M; Krebs, Ruth M

    2012-12-01

    Reward prospect has been demonstrated to facilitate various cognitive and behavioral operations, particularly by enhancing the speed and vigor of processes linked to approaching reward. Studies in this domain typically employed task regimes in which participants' overt responses are facilitated by prospective rewards. In contrast, we demonstrate here that even the cancellation of a motor response can be accelerated by reward prospect, thus signifying reward-related benefits on restraint rather than approach behavior. Importantly, this facilitation occurred independent of strategy-related adjustments of response speed, which are known to systematically distort the estimation of response-cancellation speed. The fact that motivational factors can indeed facilitate response inhibition is not only relevant for understanding how motivation and response inhibition interact in healthy participants but also for work on various patient groups that display response-inhibition deficits, suggesting that core differences in the ability to inhibit motor responses have to be differentiated from motivational factors. PMID:22921189

  13. Effort-reward imbalance and depression in Japanese medical residents.

    PubMed

    Sakata, Yumi; Wada, Koji; Tsutsumi, Akizumi; Ishikawa, Hiroyasu; Aratake, Yutaka; Watanabe, Mayumi; Katoh, Noritada; Aizawa, Yoshiharu; Tanaka, Katsutoshi

    2008-01-01

    The effort-reward imbalance is an important psychosocial factor which is related to poor health among employees. However, there are few studies that have evaluated effort-reward imbalance among medical residents. The present study was done to determine the association between psychosocial factors at work as defined by the effort-reward imbalance model and depression among Japanese medical residents. We distributed a questionnaire to 227 medical residents at 16 teaching hospitals in Japan at the end of August 2005. We asked participants to answer questions which included demographic information, depressive symptoms, effort-reward imbalance, over-commitment and social support. Depression was evaluated using the Japanese version of the Center for Epidemiologic Studies-Depression (CES-D) scale. The effort-reward imbalance and over-commitment were assessed by the Effort-Reward Imbalance (ERI) questionnaire which Siegrist developed. Social support was determined on a visual analog scale. Logistic regression analysis was performed to determine the associations between effort-reward imbalance and depressive symptoms. Depressive symptoms were found in 35 (29.2%) 1st-year residents and 21 (27.6%) 2nd-year residents. The effort-reward ratio >1 (OR, 8.83; 95% CI, 2.87-27.12) and low social support score (OR, 2.77, 95% CI, 1.36-5.64) were associated with depressive symptoms among medical residents. Effort-reward imbalance was independently related to depression among Japanese medical residents. The present study suggests that balancing between effort and reward at work is important for medical residents' mental health.

  14. Work Motivation and the Negative Effects of Extrinsic Rewards: A Reward With Implications for Theory and Practice

    ERIC Educational Resources Information Center

    Notz, William W.

    1975-01-01

    Summarizes and discusses findings on two hypotheses predicting interaction between intrinsic and extrinsic motivation: extrinsic rewards are those which provide satisfaction independent of the actual activity itself and are controlled by someone other than the employee, whereas intrinsic rewards are those over which the employee has a high degree…

  15. Lateral hypothalamic circuits for feeding and reward.

    PubMed

    Stuber, Garret D; Wise, Roy A

    2016-02-01

    In experiments conducted over 60 years ago, the lateral hypothalamic area (LHA) was identified as a critical neuroanatomical substrate for motivated behavior. Electrical stimulation of the LHA induces voracious feeding even in well-fed animals. In the absence of food, animals will work tirelessly, often lever-pressing thousands of times per hour, for electrical stimulation at the same site that provokes feeding, drinking and other species-typical motivated behaviors. Here we review the classic findings from electrical stimulation studies and integrate them with more recent work that has used contemporary circuit-based approaches to study the LHA. We identify specific anatomically and molecularly defined LHA elements that integrate diverse information arising from cortical, extended amygdala and basal forebrain networks to ultimately generate a highly specified and invigorated behavioral state conveyed via LHA projections to downstream reward and feeding-specific circuits. PMID:26814589

  16. Lateral Hypothalamic Circuits for Feeding and Reward

    PubMed Central

    Stuber, Garret D.; Wise, Roy A.

    2016-01-01

    In experiments conducted over 60 years ago, the lateral hypothalamic area (LHA) was identified as a critical neuroanatomical substrate for motivated behavior. Electrical stimulation of the LHA induces voracious feeding even in non-restricted animals. In the absence of food, animals will work tirelessly, often lever-pressing 1000’s of times per hour, for electrical stimulation at the same site that provokes feeding, drinking, and other species-typical motivated behaviors. Here we review the classic findings from electrical stimulation studies and integrate them with more recent work that has utilized contemporary circuit-based approaches to study the LHA. We identify specific anatomically and molecularly defined LHA elements that integrate diverse information arising from cortical, extended amygdala, and basal forebrain networks to ultimately generate a highly specified and invigorated behavioral state conveyed via LHA projections to downstream reward and feeding specific circuits. PMID:26814589

  17. Walks with optimal reward on metric spaces

    NASA Astrophysics Data System (ADS)

    Behrends, Ehrhard

    2006-03-01

    Let (M, d) be a complete metric space and suppose that there are given finitely many contractions Γρ:M→ M and Lipschitz maps \\varphi_{\\rho}:M\\rightarrow{\\Bbb R} (ρ = 1, ..., r). We consider 'walks' of length m with a given starting point x0 in M. They are defined as follows: one chooses a sequence (ρμ)μ=1,..., m of length m in {1, ..., r}, and this choice induces the 'walk' \\[ \\begin{eqnarray*}\\fl x_{0},\\ x_{1}:=\\Gamma_{\\rho_{1}}(x_{0}),\\tqs x_{2}:=\\Gamma_{\\rho_{2}}(x_{1}), \\ldots,\\tqs x_{m}:=\\Gamma_{\\rho_{m}}(x_{m-1}).\\end{eqnarray*} \\] Associated with x1, ..., xm is the 'reward' \\[ \\begin{equation*}\\varphi_{\\rho_{1}}(x_{0})+\\varphi_{\\rho_{2}}(x_{1})+\\cdots+\\varphi_{\\rho_{m}}(x_{m-1}).\\end{equation*} \\] We denote by R^{\\max}_{x_{0}}(m) the maximal possible reward. The aim of this paper is to investigate the behaviour of the sequence (R^{\\max}_{x_{0}}(m)) for large m. It will be shown that the growth is nearly linear: there is a constant γ (which does not depend on x0) such that R^{\\max}_{x_{0}}(m)/m tends to γ. However, an explicit calculation of γ might be hard. The complexity depends on the fractal dimension of the smallest nonempty compact subset of M which is invariant with respect to all Γρ. In the case of finite M one can say much more. Then—after a suitable rescaling—the sequence (R^{\\max}_{x_{0}}(m)) is periodic where the length of the period can be described in terms of the length of certain cycles of a graph associated with M. The motivation to study this problem came from a variant of Parrondo's paradox from probability theory: what is the optimal choice of games if a great number of players is involved?

  18. Motor Cortex-Evoked Activity in Reciprocal Muscles Is Modulated by Reward Probability

    PubMed Central

    Suzuki, Makoto; Kirimoto, Hikari; Sugawara, Kazuhiro; Oyama, Mineo; Yamada, Sumio; Yamamoto, Jun-ichi; Matsunaga, Atsuhiko; Fukuda, Michinari; Onishi, Hideaki

    2014-01-01

    Horizontal intracortical projections for agonist and antagonist muscles exist in the primary motor cortex (M1), and reward may induce a reinforcement of transmission efficiency of intracortical circuits. We investigated reward-induced change in M1 excitability for agonist and antagonist muscles. Participants were 8 healthy volunteers. Probabilistic reward tasks comprised 3 conditions of 30 trials each: 30 trials contained 10% reward, 30 trials contained 50% reward, and 30 trials contained 90% reward. Each trial began with a cue (red fixation cross), followed by blue circle for 1 s. The subjects were instructed to perform wrist flexion and press a button with the dorsal aspect of middle finger phalanx as quickly as possible in response to disappearance of the blue circle without looking at their hand or the button. Two seconds after the button press, reward/non-reward stimulus was randomly presented for 2-s duration. The reward stimulus was a picture of Japanese 10-yen coin, and each subject received monetary reward at the end of experiment. Subjects were not informed of the reward probabilities. We delivered transcranial magnetic stimulation of the left M1 at the midpoint between center of gravities of agonist flexor carpi radialis (FCR) and antagonist extensor carpi radialis (ECR) muscles at 2 s after the red fixation cross and 1 s after the reward/non-reward stimuli. Relative motor evoked potential (MEP) amplitudes at 2 s after the red fixation cross were significantly higher for 10% reward probability than for 90% reward probability, whereas relative MEP amplitudes at 1 s after reward/non-reward stimuli were significantly higher for 90% reward probability than for 10% and 50% reward probabilities. These results implied that reward could affect the horizontal intracortical projections in M1 for agonist and antagonist muscles, and M1 excitability including the reward-related circuit before and after reward stimulus could be differently altered by reward

  19. Aversive Counterconditioning Attenuates Reward Signaling in the Ventral Striatum

    PubMed Central

    Kaag, Anne Marije; Schluter, Renée S.; Karel, Peter; Homberg, Judith; van den Brink, Wim; Reneman, Liesbeth; van Wingen, Guido A.

    2016-01-01

    Appetitive conditioning refers to the process of learning cue-reward associations and is mediated by the mesocorticolimbic system. Appetitive conditioned responses are difficult to extinguish, especially for highly salient reward such as food and drugs. We investigate whether aversive counterconditioning can alter reward reinstatement in the ventral striatum in healthy volunteers using functional magnetic resonance imaging (fMRI). In the initial conditioning phase, two different stimuli were reinforced with a monetary reward. In the subsequent counterconditioning phase, one of these stimuli was paired with an aversive shock to the wrist. In the following extinction phase, none of the stimuli were reinforced. In the final reinstatement phase, reward was reinstated by informing the participants that the monetary gain could be doubled. Our fMRI data revealed that reward signaling in the ventral striatum and ventral tegmental area following reinstatement was smaller for the stimulus that was counterconditioned with an electrical shock, compared to the non-counterconditioned stimulus. A functional connectivity analysis showed that aversive counterconditioning strengthened striatal connectivity with the hippocampus and insula. These results suggest that reward signaling in the ventral striatum can be attenuated through aversive counterconditioning, possibly by concurrent retrieval of the aversive association through enhanced connectivity with hippocampus and insula. PMID:27594829

  20. Asymmetric frontal cortical activity predicts effort expenditure for reward.

    PubMed

    Hughes, David M; Yates, Mark J; Morton, Emma E; Smillie, Luke D

    2015-07-01

    An extensive literature shows that greater left, relative to right, frontal cortical activity (LFA) is involved in approach-motivated affective states and reflects stable individual differences in approach motivation. However, relatively few studies have linked LFA to behavioral indices of approach motivation. In this study, we examine the relation between LFA and effort expenditure for reward, a behavioral index of approach motivation. LFA was calculated for 51 right-handed participants (55% female) using power spectral analysis of electroencephalogram recorded at rest. Participants also completed the effort expenditure for rewards task (EEfRT), which presents a series of trials requiring a choice between a low-reward low-effort task and a high-reward high-effort task. We found that individuals with greater resting LFA were more willing to expend greater effort in the pursuit of larger rewards, particularly when reward delivery was less likely. Our findings offer a more nuanced understanding of the motivational significance of LFA, in terms of processes that mitigate the effort- and uncertainty-related costs of pursuing rewarding goals. PMID:25479792

  1. Aversive Counterconditioning Attenuates Reward Signaling in the Ventral Striatum

    PubMed Central

    Kaag, Anne Marije; Schluter, Renée S.; Karel, Peter; Homberg, Judith; van den Brink, Wim; Reneman, Liesbeth; van Wingen, Guido A.

    2016-01-01

    Appetitive conditioning refers to the process of learning cue-reward associations and is mediated by the mesocorticolimbic system. Appetitive conditioned responses are difficult to extinguish, especially for highly salient reward such as food and drugs. We investigate whether aversive counterconditioning can alter reward reinstatement in the ventral striatum in healthy volunteers using functional magnetic resonance imaging (fMRI). In the initial conditioning phase, two different stimuli were reinforced with a monetary reward. In the subsequent counterconditioning phase, one of these stimuli was paired with an aversive shock to the wrist. In the following extinction phase, none of the stimuli were reinforced. In the final reinstatement phase, reward was reinstated by informing the participants that the monetary gain could be doubled. Our fMRI data revealed that reward signaling in the ventral striatum and ventral tegmental area following reinstatement was smaller for the stimulus that was counterconditioned with an electrical shock, compared to the non-counterconditioned stimulus. A functional connectivity analysis showed that aversive counterconditioning strengthened striatal connectivity with the hippocampus and insula. These results suggest that reward signaling in the ventral striatum can be attenuated through aversive counterconditioning, possibly by concurrent retrieval of the aversive association through enhanced connectivity with hippocampus and insula.

  2. Neuronal Reward and Decision Signals: From Theories to Data.

    PubMed

    Schultz, Wolfram

    2015-07-01

    Rewards are crucial objects that induce learning, approach behavior, choices, and emotions. Whereas emotions are difficult to investigate in animals, the learning function is mediated by neuronal reward prediction error signals which implement basic constructs of reinforcement learning theory. These signals are found in dopamine neurons, which emit a global reward signal to striatum and frontal cortex, and in specific neurons in striatum, amygdala, and frontal cortex projecting to select neuronal populations. The approach and choice functions involve subjective value, which is objectively assessed by behavioral choices eliciting internal, subjective reward preferences. Utility is the formal mathematical characterization of subjective value and a prime decision variable in economic choice theory. It is coded as utility prediction error by phasic dopamine responses. Utility can incorporate various influences, including risk, delay, effort, and social interaction. Appropriate for formal decision mechanisms, rewards are coded as object value, action value, difference value, and chosen value by specific neurons. Although all reward, reinforcement, and decision variables are theoretical constructs, their neuronal signals constitute measurable physical implementations and as such confirm the validity of these concepts. The neuronal reward signals provide guidance for behavior while constraining the free will to act. PMID:26109341

  3. Cortisol alters reward processing in the human brain.

    PubMed

    Kinner, Valerie L; Wolf, Oliver T; Merz, Christian J

    2016-08-01

    Dysfunctional reward processing is known to play a central role for the development of psychiatric disorders. Glucocorticoids that are secreted in response to stress have been shown to attenuate reward sensitivity and thereby might promote the onset of psychopathology. However, the underlying neurobiological mechanisms mediating stress hormone effects on reward processing as well as potential sex differences remain elusive. In this neuroimaging study, we administered 30mg cortisol or a placebo to 30 men and 30 women and subsequently tested them in the Monetary Incentive Delay Task. Cortisol attenuated anticipatory neural responses to a verbal and a monetary reward in the left pallidum and the right anterior parahippocampal gyrus. Furthermore, in men, activation in the amygdala, the precuneus, the anterior cingulate, and in hippocampal regions was reduced under cortisol, whereas in cortisol-treated women a signal increase was observed in these regions. Behavioral performance also indicated that reward learning in men is impaired under high cortisol concentrations, while it is augmented in women. These findings illustrate that the stress hormone cortisol substantially diminishes reward anticipation and provide first evidence that cortisol effects on the neural reward system are sensitive to sex differences, which might translate into different vulnerabilities for psychiatric disorders.

  4. Working memory and reward association learning impairments in obesity

    PubMed Central

    Coppin, Géraldine; Nolan-Poupart, Sarah; Jones-Gotman, Marilyn; Small, Dana M.

    2014-01-01

    Obesity has been associated with impaired executive functions including working memory. Less explored is the influence of obesity on learning and memory. In the current study we assessed stimulus reward association learning, explicit learning and memory and working memory in healthy weight, overweight and obese individuals. Explicit learning and memory did not differ as a function of group. In contrast, working memory was significantly and similarly impaired in both overweight and obese individuals compared to the healthy weight group. In the first reward association learning task the obese, but not healthy weight or overweight participants consistently formed paradoxical preferences for a pattern associated with a negative outcome (fewer food rewards). To determine if the deficit was specific to food reward a second experiment was conducted using money. Consistent with experiment 1, obese individuals selected the pattern associated with a negative outcome (fewer monetary rewards) more frequently than healthy weight individuals and thus failed to develop a significant preference for the most rewarded patterns as was observed in the healthy weight group. Finally, on a probabilistic learning task, obese compared to healthy weight individuals showed deficits in negative, but not positive outcome learning. Taken together, our results demonstrate deficits in working memory and stimulus reward learning in obesity and suggest that obese individuals are impaired in learning to avoid negative outcomes. PMID:25447070

  5. Neuronal Reward and Decision Signals: From Theories to Data.

    PubMed

    Schultz, Wolfram

    2015-07-01

    Rewards are crucial objects that induce learning, approach behavior, choices, and emotions. Whereas emotions are difficult to investigate in animals, the learning function is mediated by neuronal reward prediction error signals which implement basic constructs of reinforcement learning theory. These signals are found in dopamine neurons, which emit a global reward signal to striatum and frontal cortex, and in specific neurons in striatum, amygdala, and frontal cortex projecting to select neuronal populations. The approach and choice functions involve subjective value, which is objectively assessed by behavioral choices eliciting internal, subjective reward preferences. Utility is the formal mathematical characterization of subjective value and a prime decision variable in economic choice theory. It is coded as utility prediction error by phasic dopamine responses. Utility can incorporate various influences, including risk, delay, effort, and social interaction. Appropriate for formal decision mechanisms, rewards are coded as object value, action value, difference value, and chosen value by specific neurons. Although all reward, reinforcement, and decision variables are theoretical constructs, their neuronal signals constitute measurable physical implementations and as such confirm the validity of these concepts. The neuronal reward signals provide guidance for behavior while constraining the free will to act.

  6. Early Effects of Reward Anticipation Are Modulated by Dopaminergic Stimulation

    PubMed Central

    Apitz, Thore; Bunzeck, Nico

    2014-01-01

    The abilities to predict future rewards and assess the value of reward delivery are crucial aspects of adaptive behavior. While the mesolimbic system, including dopaminergic midbrain, ventral striatum and prefrontal cortex have long been associated with reward processing, recent studies also indicate a prominent role of early visual brain regions. However, the precise underlying neural mechanisms still remain unclear. To address this issue, we presented participants with visual cues predicting rewards of high and low magnitudes and probability (2×2 factorial design), while neural activity was scanned using magnetoencephalography. Importantly, one group of participants received 150 mg of the dopamine precursor levodopa prior to the experiment, while another group received a placebo. For the placebo group, neural signals of reward probability (but not magnitude) emerged at ∼100 ms after cue presentation at occipital sensors in the event-related magnetic fields. Importantly, these probability signals were absent in the levodopa group indicating a close link. Moreover, levodopa administration reduced oscillatory power in the high (20–30 Hz) and low (13–20 Hz) beta band during both reward anticipation and delivery. Taken together, our findings indicate that visual brain regions are involved in coding prospective reward probability but not magnitude and that these effects are modulated by dopamine. PMID:25285436

  7. Neuronal Reward and Decision Signals: From Theories to Data

    PubMed Central

    Schultz, Wolfram

    2015-01-01

    Rewards are crucial objects that induce learning, approach behavior, choices, and emotions. Whereas emotions are difficult to investigate in animals, the learning function is mediated by neuronal reward prediction error signals which implement basic constructs of reinforcement learning theory. These signals are found in dopamine neurons, which emit a global reward signal to striatum and frontal cortex, and in specific neurons in striatum, amygdala, and frontal cortex projecting to select neuronal populations. The approach and choice functions involve subjective value, which is objectively assessed by behavioral choices eliciting internal, subjective reward preferences. Utility is the formal mathematical characterization of subjective value and a prime decision variable in economic choice theory. It is coded as utility prediction error by phasic dopamine responses. Utility can incorporate various influences, including risk, delay, effort, and social interaction. Appropriate for formal decision mechanisms, rewards are coded as object value, action value, difference value, and chosen value by specific neurons. Although all reward, reinforcement, and decision variables are theoretical constructs, their neuronal signals constitute measurable physical implementations and as such confirm the validity of these concepts. The neuronal reward signals provide guidance for behavior while constraining the free will to act. PMID:26109341

  8. The absence of reward induces inequity aversion in dogs

    PubMed Central

    Range, Friederike; Horn, Lisa; Viranyi, Zsófia; Huber, Ludwig

    2009-01-01

    One crucial element for the evolution of cooperation may be the sensitivity to others' efforts and payoffs compared with one's own costs and gains. Inequity aversion is thought to be the driving force behind unselfish motivated punishment in humans constituting a powerful device for the enforcement of cooperation. Recent research indicates that non-human primates refuse to participate in cooperative problem-solving tasks if they witness a conspecific obtaining a more attractive reward for the same effort. However, little is known about non-primate species, although inequity aversion may also be expected in other cooperative species. Here, we investigated whether domestic dogs show sensitivity toward the inequity of rewards received for giving the paw to an experimenter on command in pairs of dogs. We found differences in dogs tested without food reward in the presence of a rewarded partner compared with both a baseline condition (both partners rewarded) and an asocial control situation (no reward, no partner), indicating that the presence of a rewarded partner matters. Furthermore, we showed that it was not the presence of the second dog but the fact that the partner received the food that was responsible for the change in the subjects' behavior. In contrast to primate studies, dogs did not react to differences in the quality of food or effort. Our results suggest that species other than primates show at least a primitive version of inequity aversion, which may be a precursor of a more sophisticated sensitivity to efforts and payoffs of joint interactions. PMID:19064923

  9. Reward and punishment act as distinct factors in guiding behavior.

    PubMed

    Kubanek, Jan; Snyder, Lawrence H; Abrams, Richard A

    2015-06-01

    Behavior rests on the experience of reinforcement and punishment. It has been unclear whether reinforcement and punishment act as oppositely valenced components of a single behavioral factor, or whether these two kinds of outcomes play fundamentally distinct behavioral roles. To this end, we varied the magnitude of a reward or a penalty experienced following a choice using monetary tokens. The outcome of each trial was independent of the outcome of the previous trial, which enabled us to isolate and study the effect on behavior of each outcome magnitude in single trials. We found that a reward led to a repetition of the previous choice, whereas a penalty led to an avoidance of the previous choice. Surprisingly, the effects of the reward magnitude and the penalty magnitude revealed a pronounced asymmetry. The choice repetition effect of a reward scaled with the magnitude of the reward. In a marked contrast, the avoidance effect of a penalty was flat, not influenced by the magnitude of the penalty. These effects were mechanistically described using a reinforcement learning model after the model was updated to account for the penalty-based asymmetry. The asymmetry in the effects of the reward magnitude and the punishment magnitude was so striking that it is difficult to conceive that one factor is just a weighted or transformed form of the other factor. Instead, the data suggest that rewards and penalties are fundamentally distinct factors in governing behavior.

  10. The influence of contextual reward statistics on risk preference

    PubMed Central

    Rigoli, Francesco; Rutledge, Robb B.; Dayan, Peter; Dolan, Raymond J.

    2016-01-01

    Decision theories mandate that organisms should adjust their behaviour in the light of the contextual reward statistics. We tested this notion using a gambling choice task involving distinct contexts with different reward distributions. The best fitting model of subjects' behaviour indicated that the subjective values of options depended on several factors, including a baseline gambling propensity, a gambling preference dependent on reward amount, and a contextual reward adaptation factor. Combining this behavioural model with simultaneous functional magnetic resonance imaging we probed neural responses in three key regions linked to reward and value, namely ventral tegmental area/substantia nigra (VTA/SN), ventromedial prefrontal cortex (vmPFC) and ventral striatum (VST). We show that activity in the VTA/SN reflected contextual reward statistics to the extent that context affected behaviour, activity in the vmPFC represented a value difference between chosen and unchosen options while VST responses reflected a non-linear mapping between the actual objective rewards and their subjective value. The findings highlight a multifaceted basis for choice behaviour with distinct mappings between components of this behaviour and value sensitive brain regions. PMID:26707890

  11. Aversive Counterconditioning Attenuates Reward Signaling in the Ventral Striatum.

    PubMed

    Kaag, Anne Marije; Schluter, Renée S; Karel, Peter; Homberg, Judith; van den Brink, Wim; Reneman, Liesbeth; van Wingen, Guido A

    2016-01-01

    Appetitive conditioning refers to the process of learning cue-reward associations and is mediated by the mesocorticolimbic system. Appetitive conditioned responses are difficult to extinguish, especially for highly salient reward such as food and drugs. We investigate whether aversive counterconditioning can alter reward reinstatement in the ventral striatum in healthy volunteers using functional magnetic resonance imaging (fMRI). In the initial conditioning phase, two different stimuli were reinforced with a monetary reward. In the subsequent counterconditioning phase, one of these stimuli was paired with an aversive shock to the wrist. In the following extinction phase, none of the stimuli were reinforced. In the final reinstatement phase, reward was reinstated by informing the participants that the monetary gain could be doubled. Our fMRI data revealed that reward signaling in the ventral striatum and ventral tegmental area following reinstatement was smaller for the stimulus that was counterconditioned with an electrical shock, compared to the non-counterconditioned stimulus. A functional connectivity analysis showed that aversive counterconditioning strengthened striatal connectivity with the hippocampus and insula. These results suggest that reward signaling in the ventral striatum can be attenuated through aversive counterconditioning, possibly by concurrent retrieval of the aversive association through enhanced connectivity with hippocampus and insula. PMID:27594829

  12. Aversive Counterconditioning Attenuates Reward Signaling in the Ventral Striatum.

    PubMed

    Kaag, Anne Marije; Schluter, Renée S; Karel, Peter; Homberg, Judith; van den Brink, Wim; Reneman, Liesbeth; van Wingen, Guido A

    2016-01-01

    Appetitive conditioning refers to the process of learning cue-reward associations and is mediated by the mesocorticolimbic system. Appetitive conditioned responses are difficult to extinguish, especially for highly salient reward such as food and drugs. We investigate whether aversive counterconditioning can alter reward reinstatement in the ventral striatum in healthy volunteers using functional magnetic resonance imaging (fMRI). In the initial conditioning phase, two different stimuli were reinforced with a monetary reward. In the subsequent counterconditioning phase, one of these stimuli was paired with an aversive shock to the wrist. In the following extinction phase, none of the stimuli were reinforced. In the final reinstatement phase, reward was reinstated by informing the participants that the monetary gain could be doubled. Our fMRI data revealed that reward signaling in the ventral striatum and ventral tegmental area following reinstatement was smaller for the stimulus that was counterconditioned with an electrical shock, compared to the non-counterconditioned stimulus. A functional connectivity analysis showed that aversive counterconditioning strengthened striatal connectivity with the hippocampus and insula. These results suggest that reward signaling in the ventral striatum can be attenuated through aversive counterconditioning, possibly by concurrent retrieval of the aversive association through enhanced connectivity with hippocampus and insula.

  13. Reward and punishment act as distinct factors in guiding behavior

    PubMed Central

    Kubanek, Jan; Snyder, Lawrence H; Abrams, Richard A

    2015-01-01

    Behavior rests on the experience of reinforcement and punishment. It has been unclear whether reinforcement and punishment act as oppositely valenced components of a single behavioral factor, or whether these two kinds of outcomes play fundamentally distinct behavioral roles. To this end, we varied the magnitude of a reward or a penalty experienced following a choice using monetary tokens. The outcome of each trial was independent of the outcome of the previous trial, which enabled us to isolate and study the effect on behavior of each outcome magnitude in single trials. As expected, we found that a reward led to a repetition of the previous choice, whereas a penalty led to an avoidance of the previous choice. However, the effects of the reward magnitude and the penalty magnitude revealed a striking asymmetry. The choice repetition effect of a reward strongly scaled with the magnitude of the reward. In a marked contrast, the avoidance effect of a penalty was flat, not influenced by the magnitude of the penalty. These effects were mechanistically described using the Reinforcement Learning model after the model was updated to account for the penalty-based asymmetry. The asymmetry in the effects of the reward magnitude and the punishment magnitude was so striking that it is diffcult to conceive that one factor is just a weighted or transformed form of the other factor. Instead, the data suggest that rewards and penalties are fundamentally distinct factors in governing behavior. PMID:25824862

  14. Adaptive and aberrant reward prediction signals in the human brain.

    PubMed

    Roiser, Jonathan P; Stephan, Klaas E; den Ouden, Hanneke E M; Friston, Karl J; Joyce, Eileen M

    2010-04-01

    Theories of the positive symptoms of schizophrenia hypothesize a role for aberrant reinforcement signaling driven by dysregulated dopamine transmission. Recently, we provided evidence of aberrant reward learning in symptomatic, but not asymptomatic patients with schizophrenia, using a novel paradigm, the Salience Attribution Test (SAT). The SAT is a probabilistic reward learning game that employs cues that vary across task-relevant and task-irrelevant dimensions; it provides behavioral indices of adaptive and aberrant reward learning. As an initial step prior to future clinical studies, here we used functional magnetic resonance imaging to examine the neural basis of adaptive and aberrant reward learning during the SAT in healthy volunteers. As expected, cues associated with high relative to low reward probabilities elicited robust hemodynamic responses in a network of structures previously implicated in motivational salience; the midbrain, in the vicinity of the ventral tegmental area, and regions targeted by its dopaminergic projections, i.e. medial dorsal thalamus, ventral striatum and prefrontal cortex (PFC). Responses in the medial dorsal thalamus and polar PFC were strongly correlated with the degree of adaptive reward learning across participants. Finally, and most importantly, differential dorsolateral PFC and middle temporal gyrus (MTG) responses to cues with identical reward probabilities were very strongly correlated with the degree of aberrant reward learning. Participants who showed greater aberrant learning exhibited greater dorsolateral PFC responses, and reduced MTG responses, to cues erroneously inferred to be less strongly associated with reward. The results are discussed in terms of their implications for different theories of associative learning. PMID:19969090

  15. Food reward. What it is and how to measure it.

    PubMed

    Rogers, Peter J; Hardman, Charlotte A

    2015-07-01

    We investigated the contribution of hunger and food liking to food reward, and the relationship between food reward and food intake. We defined liking as the pleasantness of taste of food in the mouth, and food reward as the momentary value of a food to the individual at the time of ingestion. Liking and food reward were measured, respectively, by ratings of the pleasantness of the taste of a mouthful, and ratings of desire to eat a portion, of the food in question. Hunger, which we view as primarily the absence of fullness, was rated without food being present. Study 1 provided evidence that hunger and liking contribute independently to food reward, with little effect of hunger on liking. Food intake reduced liking and reward value more for the eaten food than uneaten foods. The results were ambiguous as to whether this food-specific decline in reward value ('sensory-specific satiety') involved a decrease in 'wanting' in addition to the decrease in liking. Studies 2 and 3 compared desire to eat ratings with work-for-food and pay-for-food measures of food reward, and found desire to eat to be equal or superior in respect of effects of hunger and liking, and superior in predicting ad libitum food intake. A further general observation was that in making ratings of food liking participants may confuse the pleasantness of the taste of food with the pleasantness of eating it. The latter, which some call 'palatability,' decreases more with eating because it is significantly affected by hunger/fullness. Together, our results demonstrate the validity of ratings of desire to eat a portion of a tasted food as a measure of food reward and as a predictor of food intake.

  16. Modulation of corticospinal excitability by reward depends on task framing.

    PubMed

    Mooshagian, Eric; Keisler, Aysha; Zimmermann, Trelawny; Schweickert, Janell M; Wassermann, Eric M

    2015-02-01

    Findings from previous transcranial magnetic stimulation (TMS) experiments suggest that the primary motor cortex (M1) is sensitive to reward conditions in the environment. However, the nature of this influence on M1 activity is poorly understood. The dopamine neuron response to conditioned stimuli encodes reward probability and outcome uncertainty, or the extent to which the outcome of a situation is known. Reward uncertainty and probability are related: uncertainty is maximal when probability is 0.5 and minimal when probability is 0 or 1 (i.e., certain outcome). Previous TMS-reward studies did not examine these factors independently. Here, we used single-pulse TMS to measure corticospinal excitability in 40 individuals while they performed a simple computer task, making guesses to find or avoid a hidden target. The task stimuli implied three levels of reward probability and two levels of uncertainty. We found that reward probability level interacted with the trial search condition. That is, motor evoked potential (MEP) amplitude, a measure of corticospinal neuron excitability, increased with increasing reward probability when participants were instructed to "find" a target, but not when they were instructed to "avoid" a target. There was no effect of uncertainty on MEPs. Response times varied with the number of choices. A subset of participants also received paired-pulse stimulation to evaluate changes in short-intracortical inhibition (SICI). No effects of SICI were observed. Taken together, the results suggest that the reward-contingent modulation of M1 activity reflects reward probability or a related aspect of utility, not outcome uncertainty, and that this effect is sensitive to the conceptual framing of the task. PMID:25543022

  17. Modulation of corticospinal excitability by reward depends on task framing

    PubMed Central

    Mooshagian, Eric; Keisler, Aysha; Zimmermann, Trelawny; Schweickert, Janell M.; Wassermann, Eric M.

    2015-01-01

    Findings from previous transcranial magnetic stimulation (TMS) experiments suggest that the primary motor cortex (M1) is sensitive to reward conditions in the environment. However, the nature of this influence on M1 activity is poorly understood. The dopamine neuron response to conditioned stimuli encodes reward probability and outcome uncertainty, or the extent to which the outcome of a situation is known. Reward uncertainty and probability are related: uncertainty is maximal when probability is 0.5 and minimal when probability is 0 or 1 (i.e., certain outcome). Previous TMS-reward studies did not examine these factors independently. Here, we used single-pulse TMS to measure corticospinal excitability in 40 individuals while they performed a simple computer task, making guesses to find or avoid a hidden target. The task stimuli implied three levels of reward probability and two levels of uncertainty. We found that reward probability level interacted with the trial search condition. That is, motor evoked potential (MEP) amplitude, a measure of corticospinal neuron excitability, increased with increasing reward probability when participants were instructed to “find” a target, but not when they were instructed to “avoid” a target. There was no effect of uncertainty on MEPs. Response times varied with the number of choices. A subset of participants also received paired-pulse stimulation to evaluate changes in short-intracortical inhibition (SICI). No effects of SICI were observed. Taken together, the results suggest that the reward-contingent modulation of M1 activity reflects reward probability or a related aspect of utility, not outcome uncertainty, and that this effect is sensitive to the conceptual framing of the task. PMID:25543022

  18. Motivated to win: Relationship between anticipatory and outcome reward-related neural activity.

    PubMed

    Pornpattananangkul, Narun; Nusslock, Robin

    2015-11-01

    Reward-processing involves two temporal stages characterized by two distinct neural processes: reward-anticipation and reward-outcome. Intriguingly, very little research has examined the relationship between neural processes involved in reward-anticipation and reward-outcome. To investigate this, one needs to consider the heterogeneity of reward-processing within each stage. To identify different stages of reward processing, we adapted a reward time-estimation task. While EEG data were recorded, participants were instructed to button-press 3.5s after the onset of an Anticipation-Cue and received monetary reward for good time-estimation on the Reward trials, but not on No-Reward trials. We first separated reward-anticipation into event related potentials (ERPs) occurring at three sub-stages: reward/no-reward cue-evaluation, motor-preparation and feedback-anticipation. During reward/no-reward cue-evaluation, the Reward-Anticipation Cue led to a smaller N2 and larger P3. During motor-preparation, we report, for the first time, that the Reward-Anticipation Cue enhanced the Readiness Potential (RP), starting approximately 1s before movement. At the subsequent feedback-anticipation stage, the Reward-Anticipation Cue elevated the Stimulus-Preceding Negativity (SPN). We also separated reward-outcome ERPs into different components occurring at different time-windows: the Feedback-Related Negativity (FRN), Feedback-P3 (FB-P3) and Late-Positive Potentials (LPP). Lastly, we examined the relationship between reward-anticipation and reward-outcome ERPs. We report that individual-differences in specific reward-anticipation ERPs uniquely predicted specific reward-outcome ERPs. In particular, the reward-anticipation Early-RP (1-.8s before movement) predicted early reward-outcome ERPs (FRN and FB-P3), whereas, the reward-anticipation SPN most strongly predicted a later reward-outcome ERP (LPP). Results have important implications for understanding the nature of the relationship

  19. Motivated to win: Relationship between anticipatory and outcome reward-related neural activity.

    PubMed

    Pornpattananangkul, Narun; Nusslock, Robin

    2015-11-01

    Reward-processing involves two temporal stages characterized by two distinct neural processes: reward-anticipation and reward-outcome. Intriguingly, very little research has examined the relationship between neural processes involved in reward-anticipation and reward-outcome. To investigate this, one needs to consider the heterogeneity of reward-processing within each stage. To identify different stages of reward processing, we adapted a reward time-estimation task. While EEG data were recorded, participants were instructed to button-press 3.5s after the onset of an Anticipation-Cue and received monetary reward for good time-estimation on the Reward trials, but not on No-Reward trials. We first separated reward-anticipation into event related potentials (ERPs) occurring at three sub-stages: reward/no-reward cue-evaluation, motor-preparation and feedback-anticipation. During reward/no-reward cue-evaluation, the Reward-Anticipation Cue led to a smaller N2 and larger P3. During motor-preparation, we report, for the first time, that the Reward-Anticipation Cue enhanced the Readiness Potential (RP), starting approximately 1s before movement. At the subsequent feedback-anticipation stage, the Reward-Anticipation Cue elevated the Stimulus-Preceding Negativity (SPN). We also separated reward-outcome ERPs into different components occurring at different time-windows: the Feedback-Related Negativity (FRN), Feedback-P3 (FB-P3) and Late-Positive Potentials (LPP). Lastly, we examined the relationship between reward-anticipation and reward-outcome ERPs. We report that individual-differences in specific reward-anticipation ERPs uniquely predicted specific reward-outcome ERPs. In particular, the reward-anticipation Early-RP (1-.8s before movement) predicted early reward-outcome ERPs (FRN and FB-P3), whereas, the reward-anticipation SPN most strongly predicted a later reward-outcome ERP (LPP). Results have important implications for understanding the nature of the relationship

  20. Reconsidering Food Reward, Brain Stimulation, and Dopamine: Incentives Act Forward.

    PubMed

    Newquist, Gunnar; Gardner, R Allen

    2015-01-01

    In operant conditioning, rats pressing levers and pigeons pecking keys depend on contingent food reinforcement. Food reward agrees with Skinner's behaviorism, undergraduate textbooks, and folk psychology. However, nearly a century of experimental evidence shows, instead, that food in an operant conditioning chamber acts forward to evoke species-specific feeding behavior rather than backward to reinforce experimenter-defined responses. Furthermore, recent findings in neuroscience show consistently that intracranial stimulation to reward centers and dopamine release, the proposed reward molecule, also act forward to evoke inborn species-specific behavior. These results challenge longstanding views of hedonic learning and must be incorporated into contemporary learning theory. PMID:26721172

  1. The role of rewards in motivating participation in simple warfare.

    PubMed

    Glowacki, Luke; Wrangham, Richard W

    2013-12-01

    In the absence of explicit punitive sanctions, why do individuals voluntarily participate in intergroup warfare when doing so incurs a mortality risk? Here we consider the motivation of individuals for participating in warfare. We hypothesize that in addition to other considerations, individuals are incentivized by the possibility of rewards. We test a prediction of this "cultural rewards war-risk hypothesis" with ethnographic literature on warfare in small-scale societies. We find that a greater number of benefits from warfare is associated with a higher rate of death from conflict. This provides preliminary support for the relationship between rewards and participation in warfare.

  2. Two tales of how expectation of reward modulates behavior.

    PubMed

    Ding, Long; Perkel, David J

    2014-12-01

    Expectation of reward modulates many types of behaviors. Here we highlight two lines of research on reward-modulated perceptual decision making in primates and social context-modulated singing in songbirds, respectively. These two seemingly distinct behaviors are both known to involve cortico-basal ganglia-thalamic circuits. The underlying computations may be conceptualized using a simple, common framework. We summarize and compare our current knowledge of the two fields to motivate new experiments for each field, with the goal of finding general principles for how the brain implements reward-modulated behavior.

  3. Reconsidering Food Reward, Brain Stimulation, and Dopamine: Incentives Act Forward.

    PubMed

    Newquist, Gunnar; Gardner, R Allen

    2015-01-01

    In operant conditioning, rats pressing levers and pigeons pecking keys depend on contingent food reinforcement. Food reward agrees with Skinner's behaviorism, undergraduate textbooks, and folk psychology. However, nearly a century of experimental evidence shows, instead, that food in an operant conditioning chamber acts forward to evoke species-specific feeding behavior rather than backward to reinforce experimenter-defined responses. Furthermore, recent findings in neuroscience show consistently that intracranial stimulation to reward centers and dopamine release, the proposed reward molecule, also act forward to evoke inborn species-specific behavior. These results challenge longstanding views of hedonic learning and must be incorporated into contemporary learning theory.

  4. Inhibiting food reward: delay discounting, food reward sensitivity, and palatable food intake in overweight and obese women.

    PubMed

    Appelhans, Bradley M; Woolf, Kathleen; Pagoto, Sherry L; Schneider, Kristin L; Whited, Matthew C; Liebman, Rebecca

    2011-11-01

    Overeating is believed to result when the appetitive motivation to consume palatable food exceeds an individual's capacity for inhibitory control of eating. This hypothesis was supported in recent studies involving predominantly normal weight women, but has not been tested in obese populations. The current study tested the interaction between food reward sensitivity and inhibitory control in predicting palatable food intake among energy-replete overweight and obese women (N = 62). Sensitivity to palatable food reward was measured with the Power of Food Scale. Inhibitory control was assessed with a computerized choice task that captures the tendency to discount large delayed rewards relative to smaller immediate rewards. Participants completed an eating in the absence of hunger protocol in which homeostatic energy needs were eliminated with a bland preload of plain oatmeal, followed by a bogus laboratory taste test of palatable and bland snacks. The interaction between food reward sensitivity and inhibitory control was a significant predictor of palatable food intake in regression analyses controlling for BMI and the amount of preload consumed. Probing this interaction indicated that higher food reward sensitivity predicted greater palatable food intake at low levels of inhibitory control, but was not associated with intake at high levels of inhibitory control. As expected, no associations were found in a similar regression analysis predicting intake of bland foods. Findings support a neurobehavioral model of eating behavior in which sensitivity to palatable food reward drives overeating only when accompanied by insufficient inhibitory control. Strengthening inhibitory control could enhance weight management programs. PMID:21475139

  5. Experiential reward learning outweighs instruction prior to adulthood

    PubMed Central

    Decker, Johannes H.; Lourenco, Frederico S.; Doll, Bradley B.; Hartley, Catherine A.

    2015-01-01

    Throughout our lives, we face the important task of distinguishing rewarding actions from those that are best avoided. Importantly, there are multiple means by which we acquire this information. Through trial and error, we use experiential feedback to evaluate our actions. We also learn which actions are advantageous through explicit instruction from others. Here, we examined whether the influence of these two forms of learning on choice changes across development by placing instruction and experience in competition in a probabilistic-learning task. Whereas inaccurate instruction markedly biased adults’ estimations of a stimulus’s value, children and adolescents were better able to objectively estimate stimulus values through experience. Instructional control of learning is thought to recruit prefrontal–striatal brain circuitry, which continues to mature into adulthood. Our behavioral data suggest that this protracted neurocognitive maturation may cause the motivated actions of children and adolescents to be less influenced by explicit instruction than are those of adults. This absence of a confirmation bias in children and adolescents represents a paradoxical developmental advantage of youth over adults in the unbiased evaluation of actions through positive and negative experience. PMID:25582607

  6. Comparing apples and oranges: using reward-specific and reward-general subjective value representation in the brain.

    PubMed

    Levy, Dino J; Glimcher, Paul W

    2011-10-12

    The ability of human subjects to choose between disparate kinds of rewards suggests that the neural circuits for valuing different reward types must converge. Economic theory suggests that these convergence points represent the subjective values (SVs) of different reward types on a common scale for comparison. To examine these hypotheses and to map the neural circuits for reward valuation we had food and water-deprived subjects make risky choices for money, food, and water both in and out of a brain scanner. We found that risk preferences across reward types were highly correlated; the level of risk aversion an individual showed when choosing among monetary lotteries predicted their risk aversion toward food and water. We also found that partially distinct neural networks represent the SVs of monetary and food rewards and that these distinct networks showed specific convergence points. The hypothalamic region mainly represented the SV for food, and the posterior cingulate cortex mainly represented the SV for money. In both the ventromedial prefrontal cortex (vmPFC) and striatum there was a common area representing the SV of both reward types, but only the vmPFC significantly represented the SVs of money and food on a common scale appropriate for choice in our data set. A correlation analysis demonstrated interactions across money and food valuation areas and the common areas in the vmPFC and striatum. This may suggest that partially distinct valuation networks for different reward types converge on a unified valuation network, which enables a direct comparison between different reward types and hence guides valuation and choice.

  7. Inverted Social Reward: Associations between Psychopathic Traits and Self-Report and Experimental Measures of Social Reward

    PubMed Central

    Foulkes, Lucy; McCrory, Eamon J.; Neumann, Craig S.; Viding, Essi

    2014-01-01

    Individuals with high levels of psychopathic traits tend to undervalue long-term, affiliative relationships, but it remains unclear what motivates them to engage in social interactions at all. Their experience of social reward may provide an important clue. In Study 1 of this paper, a large sample of participants (N = 505) completed a measure of psychopathic traits (Self-Report Psychopathy Scale Short-Form) and a measure of social reward value (Social Reward Questionnaire) to explore what aspects of social reward are associated with psychopathic traits. In Study 2 (N = 110), the same measures were administered to a new group of participants along with two experimental tasks investigating monetary and social reward value. Psychopathic traits were found to be positively correlated with the enjoyment of callous treatment of others and negatively associated with the enjoyment of positive social interactions. This indicates a pattern of ‘inverted’ social reward in which being cruel is enjoyable and being kind is not. Interpersonal psychopathic traits were also positively associated with the difference between mean reaction times (RTs) in the monetary and social experimental reward tasks; individuals with high levels of these traits responded comparatively faster to social than monetary reward. We speculate that this may be because social approval/admiration has particular value for these individuals, who have a tendency to use and manipulate others. Together, these studies provide evidence that the self-serving and cruel social behaviour seen in psychopathy may in part be explained by what these individuals find rewarding. PMID:25162519

  8. Comparing Apples and Oranges: Using Reward-Specific and Reward-General Subjective Value Representation in the Brain

    PubMed Central

    Glimcher, Paul W.

    2011-01-01

    The ability of human subjects to choose between disparate kinds of rewards suggests that the neural circuits for valuing different reward types must converge. Economic theory suggests that these convergence points represent the subjective values (SVs) of different reward types on a common scale for comparison. To examine these hypotheses and to map the neural circuits for reward valuation we had food and water-deprived subjects make risky choices for money, food, and water both in and out of a brain scanner. We found that risk preferences across reward types were highly correlated; the level of risk aversion an individual showed when choosing among monetary lotteries predicted their risk aversion toward food and water. We also found that partially distinct neural networks represent the SVs of monetary and food rewards and that these distinct networks showed specific convergence points. The hypothalamic region mainly represented the SV for food, and the posterior cingulate cortex mainly represented the SV for money. In both the ventromedial prefrontal cortex (vmPFC) and striatum there was a common area representing the SV of both reward types, but only the vmPFC significantly represented the SVs of money and food on a common scale appropriate for choice in our data set. A correlation analysis demonstrated interactions across money and food valuation areas and the common areas in the vmPFC and striatum. This may suggest that partially distinct valuation networks for different reward types converge on a unified valuation network, which enables a direct comparison between different reward types and hence guides valuation and choice. PMID:21994386

  9. Behavioral and neural evidence of incentive bias for immediate rewards relative to preference-matched delayed rewards.

    PubMed

    Luo, Shan; Ainslie, George; Giragosian, Lisa; Monterosso, John R

    2009-11-25

    Several theories of self-control [including intertemporal bargaining (Ainslie, 1992) and self-signaling (Bodner and Prelec, 2001)] imply that intertemporal decisions can be more farsighted than would be predicted by the incentive associated with rewards outside a decision context. We examined this hypothesis using behavior and functional neuroimaging. First, subjects expressed preferences between amounts of money delayed by 4 months and smaller amounts available that day. This allowed us to establish "indifference pairs" individualized to each participant: immediate and delayed amounts that were equally preferred. Participants subsequently performed a reaction time functional magnetic resonance imaging task (Knutson et al., 2001a) that provided them with distinct opportunities to win each of the rewards that comprised the indifference pairs. Anatomical region of interest analysis as well as whole-brain analysis indicated greater response recruited by the immediate rewards (relative to the preference-matched delayed rewards) in regions previously implicated as sensitive to incentive value using the same task (including bilateral putamen, bilateral anterior insula, and midbrain). Reaction time to the target was also faster during the immediate relative to delayed reward trials (p < 0.01), and individual differences in reaction time between immediate versus delayed reward trials correlated with variance in magnetic resonance signal in those clusters that responded preferentially to immediate rewards (r = 0.33, p < 0.05). These findings indicate a discrepancy in incentive associated with the immediate versus the preference-matched delayed rewards. This discrepancy may mark the contribution of self-control processes that are recruited during decision-making but that are absent when rewards are individually anticipated. PMID:19940177

  10. Effect of yohimbine on reinstatement of operant responding in rats is dependent on cue contingency but not food reward history.

    PubMed

    Chen, Yu-Wei; Fiscella, Kimberly A; Bacharach, Samuel Z; Tanda, Gianluigi; Shaham, Yavin; Calu, Donna J

    2015-07-01

    Yohimbine is an alpha-2 adrenoceptor antagonist that has been used in numerous studies as a pharmacological stressor in rodents, monkeys and humans. Recently, yohimbine has become the most common stress manipulation in studies on reinstatement of drug and food seeking. However, the wide range of conditions under which yohimbine promotes reward seeking is significantly greater than that of stressors like intermittent footshock. Here, we addressed two fundamental questions regarding yohimbine's effect on reinstatement of reward seeking: (1) whether the drug's effect on operant responding is dependent on previous reward history or cue contingency, and (2) whether yohimbine is aversive or rewarding under conditions typically used in reinstatement studies. We also used in vivo microdialysis to determine yohimbine's effect on dopamine levels in nucleus accumbens (NAc) and medial prefrontal cortex (mPFC). We found that the magnitude of yohimbine-induced (0.5, 1.0, 2.0 mg/kg) operant responding during the reinstatement tests was critically dependent on the contingency between lever pressing and discrete tone-light cue delivery but not the previous history with food reward during training. We also found that yohimbine (2 mg/kg) did not cause conditioned place aversion. Finally, we found that yohimbine modestly increased dopamine levels in mPFC but not NAc. Results suggest that yohimbine's effects on operant responding in reinstatement studies are likely independent of the history of contingent self-administration of food or drug rewards and may not be related to the commonly assumed stress-like effects of yohimbine.

  11. Effect of yohimbine on reinstatement of operant responding in rats is dependent on cue contingency but not food reward history

    PubMed Central

    Chen, Yu-Wei; Fiscella, Kimberly A.; Bacharach, Samuel Z.; Tanda, Gianluigi; Shaham, Yavin; Calu, Donna J.

    2014-01-01

    Yohimbine is an alpha-2 adrenoceptor antagonist that has been used in numerous studies as a pharmacological stressor in rodents, monkeys, and humans. Recently, yohimbine has become the most common stress manipulation in studies on reinstatement of drug and food seeking. However, the wide range of conditions under which yohimbine promotes reward seeking is significantly greater than that of stressors like intermittent footshock. Here we addressed two fundamental questions regarding yohimbine’s effect on reinstatement of reward seeking: (1) whether the drug’s effect on operant responding is dependent on previous reward history or cue contingency, and (2) whether yohimbine is aversive or rewarding under conditions typically used in reinstatement studies. We also used in vivo microdialysis to determine yohimbine’s effect on dopamine levels in nucleus accumbens (NAc) and medial prefrontal cortex (mPFC). We found that the magnitude of yohimbine-induced (0.5, 1.0, 2.0 mg/kg) operant responding during the reinstatement tests was critically dependent on the contingency between lever-pressing and discrete tone-light cue delivery but not the previous history with food reward during training. We also found that yohimbine (2 mg/kg) did not cause conditioned place aversion. Finally, we found that yohimbine modestly increased dopamine levels in mPFC but not NAc. Results suggest that yohimbine’s effects on operant responding in reinstatement studies are likely independent of the history of contingent self-administration of food or drug rewards and may not be related to the commonly assumed stress-like effects of yohimbine. PMID:25065697

  12. Learned helplessness and learned prevalence: exploring the causal relations among perceived controllability, reward prevalence, and exploration.

    PubMed

    Teodorescu, Kinneret; Erev, Ido

    2014-10-01

    Exposure to uncontrollable outcomes has been found to trigger learned helplessness, a state in which the agent, because of lack of exploration, fails to take advantage of regained control. Although the implications of this phenomenon have been widely studied, its underlying cause remains undetermined. One can learn not to explore because the environment is uncontrollable, because the average reinforcement for exploring is low, or because rewards for exploring are rare. In the current research, we tested a simple experimental paradigm that contrasts the predictions of these three contributors and offers a unified psychological mechanism that underlies the observed phenomena. Our results demonstrate that learned helplessness is not correlated with either the perceived controllability of one's environment or the average reward, which suggests that reward prevalence is a better predictor of exploratory behavior than the other two factors. A simple computational model in which exploration decisions were based on small samples of past experiences captured the empirical phenomena while also providing a cognitive basis for feelings of uncontrollability.

  13. Cholinergic Mesopontine Signals Govern Locomotion and Reward through Dissociable Midbrain Pathways.

    PubMed

    Xiao, Cheng; Cho, Jounhong Ryan; Zhou, Chunyi; Treweek, Jennifer B; Chan, Ken; McKinney, Sheri L; Yang, Bin; Gradinaru, Viviana

    2016-04-20

    The mesopontine tegmentum, including the pedunculopontine and laterodorsal tegmental nuclei (PPN and LDT), provides major cholinergic inputs to midbrain and regulates locomotion and reward. To delineate the underlying projection-specific circuit mechanisms, we employed optogenetics to control mesopontine cholinergic neurons at somata and at divergent projections within distinct midbrain areas. Bidirectional manipulation of PPN cholinergic cell bodies exerted opposing effects on locomotor behavior and reinforcement learning. These motor and reward effects were separable via limiting photostimulation to PPN cholinergic terminals in the ventral substantia nigra pars compacta (vSNc) or to the ventral tegmental area (VTA), respectively. LDT cholinergic neurons also form connections with vSNc and VTA neurons; however, although photo-excitation of LDT cholinergic terminals in the VTA caused positive reinforcement, LDT-to-vSNc modulation did not alter locomotion or reward. Therefore, the selective targeting of projection-specific mesopontine cholinergic pathways may offer increased benefit in treating movement and addiction disorders. PMID:27100197

  14. The Influence of Palatable Diets in Reward System Activation: A Mini Review

    PubMed Central

    de Macedo, Isabel Cristina; de Freitas, Joice Soares; da Silva Torres, Iraci Lucena

    2016-01-01

    The changes in eating patterns that have occurred in recent decades are an important cause of obesity. Food intake and energy expenditure are controlled by a complex neural system involving the hypothalamic centers and peripheral satiety system (gastrointestinal and pancreatic hormones). Highly palatable and caloric food disrupts appetite regulation; however, palatable foods induce pleasure and reward. The cafeteria diet is such a palatable diet and has been shown consistently to increase body weight and induce hyperplasia in animal obesity models. Moreover, palatable high-fat foods (such as those of the cafeteria diet) can induce addiction-like deficits in brain reward function and are considered to be an important source of motivation that might drive overeating and contribute to the development of obesity. The mechanism of neural adaptation triggered by palatable foods is similar to those that have been reported for nondrug addictions and long-term drug use. Thus, this review attempts to describe the potential mechanisms that might lead to highly palatable diets, such as the cafeteria diet, triggering addiction, or compulsion through the reward system. PMID:27087806

  15. Cholinergic Mesopontine Signals Govern Locomotion and Reward through Dissociable Midbrain Pathways.

    PubMed

    Xiao, Cheng; Cho, Jounhong Ryan; Zhou, Chunyi; Treweek, Jennifer B; Chan, Ken; McKinney, Sheri L; Yang, Bin; Gradinaru, Viviana

    2016-04-20

    The mesopontine tegmentum, including the pedunculopontine and laterodorsal tegmental nuclei (PPN and LDT), provides major cholinergic inputs to midbrain and regulates locomotion and reward. To delineate the underlying projection-specific circuit mechanisms, we employed optogenetics to control mesopontine cholinergic neurons at somata and at divergent projections within distinct midbrain areas. Bidirectional manipulation of PPN cholinergic cell bodies exerted opposing effects on locomotor behavior and reinforcement learning. These motor and reward effects were separable via limiting photostimulation to PPN cholinergic terminals in the ventral substantia nigra pars compacta (vSNc) or to the ventral tegmental area (VTA), respectively. LDT cholinergic neurons also form connections with vSNc and VTA neurons; however, although photo-excitation of LDT cholinergic terminals in the VTA caused positive reinforcement, LDT-to-vSNc modulation did not alter locomotion or reward. Therefore, the selective targeting of projection-specific mesopontine cholinergic pathways may offer increased benefit in treating movement and addiction disorders.

  16. Learned Helplessness in Learning Disabled Adolescents as a Function of Noncontingent Rewards.

    ERIC Educational Resources Information Center

    Kleinhammer-Tramill, P. Jeannie; And Others

    1983-01-01

    Twenty-four learning disabled students (10 to 14 years old) assigned to three reward schedules (response contingent reward, 100 percent noncontingent reward, and 50 percent random noncontingent reward) were asked to replicate block designs and solve coding problems. No differences were found in errors, but Ss in noncontingent conditions…

  17. Increased lever pressing for amphetamine after pimozide in rats: implications for a dopamine theory of reward.

    PubMed

    Yokel, R A; Wise, R A

    1975-02-14

    Low and high doses of a dopamine blocking agent had effects on lever pressing for intravenous amphetamine reward which resembled the effects of reward reduction and reward termination, respectively. Noradrenaline blockade had no such effects. A role in central mediation of reward perception is suggested for dopamine but not for noradrenaline.

  18. ADHD Related Behaviors Are Associated with Brain Activation in the Reward System

    ERIC Educational Resources Information Center

    Stark, R.; Bauer, E.; Merz, C. J.; Zimmermann, M.; Reuter, M.; Plichta, M. M.; Kirsch, P.; Lesch, K. P.; Fallgatter, A. J.; Vaitl, D.; Herrmann, M. J.

    2011-01-01

    Neuroimaging studies on attention-deficit/hyperactivity disorder (ADHD) suggest dysfunctional reward processing, with hypo-responsiveness during reward anticipation in the reward system including the nucleus accumbens (NAcc). In this study, we investigated the association between ADHD related behaviors and the reward system using functional…

  19. Intrinsic Motivation and Rewards: What Sustains Young Children's Engagement with Text?

    ERIC Educational Resources Information Center

    Marinak, Barbara A.; Gambrell, Linda B.

    2008-01-01

    This study investigated the effects of reward proximity and choice of reward on the reading motivation of third-grade students as measured by indicators of task persistence. The major finding from this study was that students who were given a book as a reward and students who received no reward were more motivated to engage in subsequent reading…

  20. Intolerance of uncertainty and decisions about delayed, probabilistic rewards.

    PubMed

    Luhmann, Christian C; Ishida, Kanako; Hajcak, Greg

    2011-09-01

    Worry is the inflated concern about potential future threats and is a hallmark feature of generalized anxiety disorder. Previous theoretical work has suggested that worry may be a consequence of intolerance of uncertainty (IU). The current study seeks to explore the behavioral consequences of IU. Specifically, we examine how IU might be associated with aspects of reward-based decision making. We utilized a simple laboratory gambling task in which participants chose between small, low-probability rewards available immediately at the beginning of each trial and large, high-probability rewards only available after some variable delay. Results demonstrate that higher levels of intolerance of uncertainty were associated with a tendency to select the immediately available, but less valuable and less probable rewards. IU also predicted decision-makers' sensitivity to outcomes. We discuss the cognitive and affective mechanisms that are likely to underlie the observed decision-making behavior and the implications for anxiety disorders.

  1. Fairness influences early signatures of reward-related neural processing.

    PubMed

    Massi, Bart; Luhmann, Christian C

    2015-12-01

    Many humans exhibit a strong preference for fairness during decision-making. Although there is evidence that social factors influence reward-related and affective neural processing, it is unclear if this effect is mediated by compulsory outcome evaluation processes or results from slower deliberate cognition. Here we show that the feedback-related negativity (FRN) and late positive potential (LPP), two signatures of early hedonic processing, are modulated by the fairness of rewards during a passive rating task. We find that unfair payouts elicit larger FRNs than fair payouts, whereas fair payouts elicit larger LPPs than unfair payouts. This is true both in the time-domain, where the FRN and LPP are related, and in the time-frequency domain, where the two signals are largely independent. Ultimately, this work demonstrates that fairness affects the early stages of reward and affective processing, suggesting a common biological mechanism for social and personal reward evaluation.

  2. A Spiking Network Model of Decision Making Employing Rewarded STDP

    PubMed Central

    Bazhenov, Maxim

    2014-01-01

    Reward-modulated spike timing dependent plasticity (STDP) combines unsupervised STDP with a reinforcement signal that modulates synaptic changes. It was proposed as a learning rule capable of solving the distal reward problem in reinforcement learning. Nonetheless, performance and limitations of this learning mechanism have yet to be tested for its ability to solve biological problems. In our work, rewarded STDP was implemented to model foraging behavior in a simulated environment. Over the course of training the network of spiking neurons developed the capability of producing highly successful decision-making. The network performance remained stable even after significant perturbations of synaptic structure. Rewarded STDP alone was insufficient to learn effective decision making due to the difficulty maintaining homeostatic equilibrium of synaptic weights and the development of local performance maxima. Our study predicts that successful learning requires stabilizing mechanisms that allow neurons to balance their input and output synapses as well as synaptic noise. PMID:24632858

  3. Dopamine in motivational control: rewarding, aversive, and alerting

    PubMed Central

    Bromberg-Martin, Ethan S.; Matsumoto, Masayuki; Hikosaka, Okihide

    2010-01-01

    SUMMARY Midbrain dopamine neurons are well known for their strong responses to rewards and their critical role in positive motivation. It has become increasingly clear, however, that dopamine neurons also transmit signals related to salient but non-rewarding experiences such as aversive and alerting events. Here we review recent advances in understanding the reward and non-reward functions of dopamine. Based on this data, we propose that dopamine neurons come in multiple types that are connected with distinct brain networks and have distinct roles in motivational control. Some dopamine neurons encode motivational value, supporting brain networks for seeking, evaluation, and value learning. Others encode motivational salience, supporting brain networks for orienting, cognition, and general motivation. Both types of dopamine neurons are augmented by an alerting signal involved in rapid detection of potentially important sensory cues. We hypothesize that these dopaminergic pathways for value, salience, and alerting cooperate to support adaptive behavior. PMID:21144997

  4. 39 CFR 233.2 - Circulars and rewards.

    Code of Federal Regulations, 2012 CFR

    2012-07-01

    ... circular is not listed in the periodic Postal Bulletin notices of current wanted circulars. (b) Rewards. (1... employees assigned to the Postal Inspection Service or the Law Department are not eligible to receive...

  5. "Small Steps, Big Rewards": You Can Prevent Type 2 Diabetes

    MedlinePlus

    ... Steps, Big Rewards": You Can Prevent Type 2 Diabetes Past Issues / Winter 2008 Table of Contents For ... million Americans are at risk for type 2 diabetes." "Fifty four million Americans are at risk for ...

  6. Homeostatic reinforcement learning for integrating reward collection and physiological stability.

    PubMed

    Keramati, Mehdi; Gutkin, Boris

    2014-12-02

    Efficient regulation of internal homeostasis and defending it against perturbations requires adaptive behavioral strategies. However, the computational principles mediating the interaction between homeostatic and associative learning processes remain undefined. Here we use a definition of primary rewards, as outcomes fulfilling physiological needs, to build a normative theory showing how learning motivated behaviors may be modulated by internal states. Within this framework, we mathematically prove that seeking rewards is equivalent to the fundamental objective of physiological stability, defining the notion of physiological rationality of behavior. We further suggest a formal basis for temporal discounting of rewards by showing that discounting motivates animals to follow the shortest path in the space of physiological variables toward the desired setpoint. We also explain how animals learn to act predictively to preclude prospective homeostatic challenges, and several other behavioral patterns. Finally, we suggest a computational role for interaction between hypothalamus and the brain reward system.

  7. The roles of the reward system in sleep and dreaming.

    PubMed

    Perogamvros, Lampros; Schwartz, Sophie

    2012-09-01

    The mesolimbic dopaminergic system (ML-DA) allows adapted interactions with the environment and is therefore of critical significance for the individual's survival. The ML-DA system is implicated in reward and emotional functions, and it is perturbed in schizophrenia, addiction, and depression. The ML-DA reward system is not only recruited during wakeful behaviors, it is also active during sleep. Here, we introduce the Reward Activation Model (RAM) for sleep and dreaming, according to which activation of the ML-DA reward system during sleep contributes to memory processes, to the regulation of rapid-eye movement (REM) sleep, and to the generation and motivational content of dreams. In particular, the engagement of ML-DA and associated limbic structures prioritizes information with high emotional or motivational relevance for (re)processing during sleep and dreaming. The RAM provides testable predictions and has clinical implications for our understanding of the pathogenesis of major depression and addiction.

  8. Homeostatic reinforcement learning for integrating reward collection and physiological stability.

    PubMed

    Keramati, Mehdi; Gutkin, Boris

    2014-01-01

    Efficient regulation of internal homeostasis and defending it against perturbations requires adaptive behavioral strategies. However, the computational principles mediating the interaction between homeostatic and associative learning processes remain undefined. Here we use a definition of primary rewards, as outcomes fulfilling physiological needs, to build a normative theory showing how learning motivated behaviors may be modulated by internal states. Within this framework, we mathematically prove that seeking rewards is equivalent to the fundamental objective of physiological stability, defining the notion of physiological rationality of behavior. We further suggest a formal basis for temporal discounting of rewards by showing that discounting motivates animals to follow the shortest path in the space of physiological variables toward the desired setpoint. We also explain how animals learn to act predictively to preclude prospective homeostatic challenges, and several other behavioral patterns. Finally, we suggest a computational role for interaction between hypothalamus and the brain reward system. PMID:25457346

  9. The relationship between food reward and satiation revisited.

    PubMed

    Sclafani, Anthony; Ackroff, Karen

    2004-08-01

    The postingestive satiating action of food is often viewed as producing a positive affective state that rewards eating. However, in an early test of this idea, Van Vort and Smith [Physiol. Behav. 30 (1983) 279] reported that rats did not learn to prefer a food that was "real-fed" and satiating over a food that was "sham-fed" and not satiating. Subsequent investigators obtained similar findings with concentrated nutrient sources. With dilute nutrient sources, however, rats learned to prefer the real-fed to the sham-fed food. These and other findings demonstrate that nutrients have rewarding postingestive effects that enhance food preferences via a conditioning process. These reward effects appear separate from the satiating actions of nutrients, which may actually reduce food reward. Food intake and preference are controlled by a complex interaction of positive and negative signals generated by nutrients in the mouth and at postingestive sites. PMID:15234596

  10. Effects of fictive reward on rat's choice behavior.

    PubMed

    Kim, Ko-Un; Huh, Namjung; Jang, Yunsil; Lee, Daeyeol; Jung, Min Whan

    2015-01-27

    Choices of humans and non-human primates are influenced by both actually experienced and fictive outcomes. To test whether this is also the case in rodents, we examined rat's choice behavior in a binary choice task in which variable magnitudes of actual and fictive rewards were delivered. We found that the animal's choice was significantly influenced by the magnitudes of both actual and fictive rewards in the previous trial. A model-based analysis revealed, however, that the effect of fictive reward was more transient and influenced mostly the choice in the next trial, whereas the effect of actual reward was more sustained, consistent with incremental learning of action values. Our results suggest that the capacity to modify future choices based on fictive outcomes might be shared by many different animal species, but fictive outcomes are less effective than actual outcomes in the incremental value learning system.

  11. Motivating forces of human actions. Neuroimaging reward and social interaction.

    PubMed

    Walter, Henrik; Abler, Birgit; Ciaramidaro, Angela; Erk, Susanne

    2005-11-15

    In neuroeconomics, reward and social interaction are central concepts to understand what motivates human behaviour. Both concepts are investigated in humans using neuroimaging methods. In this paper, we provide an overview about these results and discuss their relevance for economic behaviour. For reward it has been shown that a system exists in humans that is involved in predicting rewards and thus guides behaviour, involving a circuit including the striatum, the orbitofrontal cortex and the amygdala. Recent studies on social interaction revealed a mentalizing system representing the mental states of others. A central part of this system is the medial prefrontal cortex, in particular the anterior paracingulate cortex. The reward as well as the mentalizing system is engaged in economic decision-making. We will discuss implications of this study for neuromarketing as well as general implications of these results that may help to provide deeper insights into the motivating forces of human behaviour.

  12. Serotonergic neurons signal reward and punishment on multiple timescales.

    PubMed

    Cohen, Jeremiah Y; Amoroso, Mackenzie W; Uchida, Naoshige

    2015-02-25

    Serotonin's function in the brain is unclear. One challenge in testing the numerous hypotheses about serotonin's function has been observing the activity of identified serotonergic neurons in animals engaged in behavioral tasks. We recorded the activity of dorsal raphe neurons while mice experienced a task in which rewards and punishments varied across blocks of trials. We 'tagged' serotonergic neurons with the light-sensitive protein channelrhodopsin-2 and identified them based on their responses to light. We found three main features of serotonergic neuron activity: (1) a large fraction of serotonergic neurons modulated their tonic firing rates over the course of minutes during reward vs punishment blocks; (2) most were phasically excited by punishments; and (3) a subset was phasically excited by reward-predicting cues. By contrast, dopaminergic neurons did not show firing rate changes across blocks of trials. These results suggest that serotonergic neurons signal information about reward and punishment on multiple timescales.

  13. Affective modulation of eyeblink startle with reward and threat.

    PubMed

    Skolnick, Alexander I; Davidson, Richard I

    2002-11-01

    An emotion-modulated acoustic startle paradigm for inducing positive and negative affect was used to address pregoal and postgoal affect. Participants played a computerized lottery task in which they chose digits that could match a subsequently displayed, random set of numbers. In the positive conditions, matches led to monetary rewards. In the negative condition, matches led to an aversive noise blast. In three experiments, we found eyeblink startle magnitude was potentiated just prior to feedback concerning reward outcome, suppressed following the feedback that a monetary reward was won, and potentiated when threatened with an aversive noise. When presented with a 0%, 45%, 90%, or 100% chance of winning, higher probabilities suppressed startle response after feedback whereas the 45% trials did not. These data indicate that postgoal positive affect (winning reward) reliably suppressed the startle response whereas pregoal positive affect did not.

  14. The Reward Circuit: Linking Primate Anatomy and Human Imaging

    PubMed Central

    Haber, Suzanne N; Knutson, Brian

    2010-01-01

    Although cells in many brain regions respond to reward, the cortical-basal ganglia circuit is at the heart of the reward system. The key structures in this network are the anterior cingulate cortex, the orbital prefrontal cortex, the ventral striatum, the ventral pallidum, and the midbrain dopamine neurons. In addition, other structures, including the dorsal prefrontal cortex, amygdala, hippocampus, thalamus, and lateral habenular nucleus, and specific brainstem structures such as the pedunculopontine nucleus, and the raphe nucleus, are key components in regulating the reward circuit. Connectivity between these areas forms a complex neural network that mediates different aspects of reward processing. Advances in neuroimaging techniques allow better spatial and temporal resolution. These studies now demonstrate that human functional and structural imaging results map increasingly close to primate anatomy. PMID:19812543

  15. Motivating forces of human actions. Neuroimaging reward and social interaction.

    PubMed

    Walter, Henrik; Abler, Birgit; Ciaramidaro, Angela; Erk, Susanne

    2005-11-15

    In neuroeconomics, reward and social interaction are central concepts to understand what motivates human behaviour. Both concepts are investigated in humans using neuroimaging methods. In this paper, we provide an overview about these results and discuss their relevance for economic behaviour. For reward it has been shown that a system exists in humans that is involved in predicting rewards and thus guides behaviour, involving a circuit including the striatum, the orbitofrontal cortex and the amygdala. Recent studies on social interaction revealed a mentalizing system representing the mental states of others. A central part of this system is the medial prefrontal cortex, in particular the anterior paracingulate cortex. The reward as well as the mentalizing system is engaged in economic decision-making. We will discuss implications of this study for neuromarketing as well as general implications of these results that may help to provide deeper insights into the motivating forces of human behaviour. PMID:16216683

  16. Caffeine in floral nectar enhances a pollinator's memory of reward.

    PubMed

    Wright, G A; Baker, D D; Palmer, M J; Stabler, D; Mustard, J A; Power, E F; Borland, A M; Stevenson, P C

    2013-03-01

    Plant defense compounds occur in floral nectar, but their ecological role is not well understood. We provide evidence that plant compounds pharmacologically alter pollinator behavior by enhancing their memory of reward. Honeybees rewarded with caffeine, which occurs naturally in nectar of Coffea and Citrus species, were three times as likely to remember a learned floral scent as were honeybees rewarded with sucrose alone. Caffeine potentiated responses of mushroom body neurons involved in olfactory learning and memory by acting as an adenosine receptor antagonist. Caffeine concentrations in nectar did not exceed the bees' bitter taste threshold, implying that pollinators impose selection for nectar that is pharmacologically active but not repellent. By using a drug to enhance memories of reward, plants secure pollinator fidelity and improve reproductive success.

  17. A community program to reward children's use of seat belts.

    PubMed

    Roberts, M C; Fanurik, D; Wilson, D R

    1988-06-01

    This paper reports on a community-wide effort to increase elementary school children's use of seat belts. Twenty-five schools serving over 9,000 children participated in a program of rewards (stickers, bumper strips, and chances on pizza dinners) administered by parent-teacher organization volunteers. Comprehensive observations were made at three representative schools. Categorization of compliance with safety rules required all passengers to be buckled into safety devices before the children received the rewards. The rewards, on average across schools, increased compliance from baseline of 18.1% to 62.4% during the interventions. Withdrawal of the rewards resulted in a decrease to 49% compliance, but this rate remained above baseline. The involvement of community groups and institutions in this safety program is highlighted.

  18. Serotonergic neurons signal reward and punishment on multiple timescales.

    PubMed

    Cohen, Jeremiah Y; Amoroso, Mackenzie W; Uchida, Naoshige

    2015-01-01

    Serotonin's function in the brain is unclear. One challenge in testing the numerous hypotheses about serotonin's function has been observing the activity of identified serotonergic neurons in animals engaged in behavioral tasks. We recorded the activity of dorsal raphe neurons while mice experienced a task in which rewards and punishments varied across blocks of trials. We 'tagged' serotonergic neurons with the light-sensitive protein channelrhodopsin-2 and identified them based on their responses to light. We found three main features of serotonergic neuron activity: (1) a large fraction of serotonergic neurons modulated their tonic firing rates over the course of minutes during reward vs punishment blocks; (2) most were phasically excited by punishments; and (3) a subset was phasically excited by reward-predicting cues. By contrast, dopaminergic neurons did not show firing rate changes across blocks of trials. These results suggest that serotonergic neurons signal information about reward and punishment on multiple timescales. PMID:25714923

  19. Effects of fictive reward on rat's choice behavior

    PubMed Central

    Kim, Ko-Un; Huh, Namjung; Jang, Yunsil; Lee, Daeyeol; Jung, Min Whan

    2015-01-01

    Choices of humans and non-human primates are influenced by both actually experienced and fictive outcomes. To test whether this is also the case in rodents, we examined rat's choice behavior in a binary choice task in which variable magnitudes of actual and fictive rewards were delivered. We found that the animal's choice was significantly influenced by the magnitudes of both actual and fictive rewards in the previous trial. A model-based analysis revealed, however, that the effect of fictive reward was more transient and influenced mostly the choice in the next trial, whereas the effect of actual reward was more sustained, consistent with incremental learning of action values. Our results suggest that the capacity to modify future choices based on fictive outcomes might be shared by many different animal species, but fictive outcomes are less effective than actual outcomes in the incremental value learning system. PMID:25623929

  20. Perspective: Recognizing and rewarding clinical scholarship.

    PubMed

    Grigsby, R Kevin; Thorndyke, Luanne

    2011-01-01

    Faculty members in medical schools and academic medical centers are in a constant process of generating new knowledge. The cornerstone of academia--and academic medicine--is scholarship. Traditionally, tenure and/or academic promotion in the professorial ranks is awarded to those who meet institutional criteria in the missions of research, teaching, and service, including patient care. In the academic review process, priority is often placed on a record of demonstrated, consistent success in traditional laboratory research, also known as the scholarship of discovery. More recently, there has been greater recognition of other forms of scholarship: education, application, and integration. These forms of scholarship, although less recognized, also result in the generation of new knowledge. In an attempt to understand the breadth and scope of clinical scholarship, the authors searched the extant literature in academic medicine for a definition of clinical scholarship and expanded the search to disciplines outside of medicine. They found that succinct, discrete definitions of clinical scholarship have been published in other disciplines, but not in academic medicine. After reviewing definitions of clinical scholarship from other disciplines, adapting definitions of educational scholarship in academic medicine, and including qualities unique to clinical scholarship, the authors developed a framework for understanding clinical scholarship in academic medicine as a means for opening a dialogue within the academic medical community. This dialogue hopefully will lead to formulating a succinct, discrete definition of clinical scholarship that will allow greater recognition and reward for clinical scholars in the promotion and tenure process.