Reward-related neural activity and structure predict future substance use in dysregulated youth.

PubMed

Bertocci, M A; Bebko, G; Versace, A; Iyengar, S; Bonar, L; Forbes, E E; Almeida, J R C; Perlman, S B; Schirda, C; Travis, M J; Gill, M K; Diwadkar, V A; Sunshine, J L; Holland, S K; Kowatch, R A; Birmaher, B; Axelson, D A; Frazier, T W; Arnold, L E; Fristad, M A; Youngstrom, E A; Horwitz, S M; Findling, R L; Phillips, M L

2017-06-01

Identifying youth who may engage in future substance use could facilitate early identification of substance use disorder vulnerability. We aimed to identify biomarkers that predicted future substance use in psychiatrically un-well youth. LASSO regression for variable selection was used to predict substance use 24.3 months after neuroimaging assessment in 73 behaviorally and emotionally dysregulated youth aged 13.9 (s.d. = 2.0) years, 30 female, from three clinical sites in the Longitudinal Assessment of Manic Symptoms (LAMS) study. Predictor variables included neural activity during a reward task, cortical thickness, and clinical and demographic variables. Future substance use was associated with higher left middle prefrontal cortex activity, lower left ventral anterior insula activity, thicker caudal anterior cingulate cortex, higher depression and lower mania scores, not using antipsychotic medication, more parental stress, older age. This combination of variables explained 60.4% of the variance in future substance use, and accurately classified 83.6%. These variables explained a large proportion of the variance, were useful classifiers of future substance use, and showed the value of combining multiple domains to provide a comprehensive understanding of substance use development. This may be a step toward identifying neural measures that can identify future substance use disorder risk, and act as targets for therapeutic interventions.

Neural and personality correlates of individual differences related to the effects of acute tryptophan depletion on future reward evaluation.

PubMed

Demoto, Yoshihiko; Okada, Go; Okamoto, Yasumasa; Kunisato, Yoshihiko; Aoyama, Shiori; Onoda, Keiichi; Munakata, Ayumi; Nomura, Michio; Tanaka, Saori C; Schweighofer, Nicolas; Doya, Kenji; Yamawaki, Shigeto

2012-01-01

In general, humans tend to discount the value of delayed reward. An increase in the rate of discounting leads to an inability to select a delayed reward over a smaller immediate reward (reward-delay impulsivity). Although deficits in the serotonergic system are implicated in this reward-delay impulsivity, there is individual variation in response to serotonin depletion. The aim of the present study was to investigate whether the effects of serotonin depletion on the ability to evaluate future reward are affected by individual personality traits or brain activation. Personality traits were assessed using the NEO-Five Factor Inventory and Temperament and Character Inventory. The central serotonergic levels of 16 healthy volunteers were manipulated by dietary tryptophan depletion. Subjects performed a delayed reward choice task that required the continuous estimation of reward value during functional magnetic resonance imaging scanning. Discounting rates were increased in 9 participants, but were unchanged or decreased in 7 participants in response to tryptophan depletion. Participants whose discounting rate was increased by tryptophan depletion had significantly higher neuroticism and lower self-directedness. Furthermore, tryptophan depletion differentially affected the groups in terms of hemodynamic responses to the value of predicted future reward in the right insula. These results suggest that individuals who have high neuroticism and low self-directedness as personality traits are particularly vulnerable to the effect of low serotonin on future reward evaluation accompanied by altered brain activation patterns. Copyright © 2012 S. Karger AG, Basel.

INCREASING SAVING BEHAVIOR THROUGH AGE-PROGRESSED RENDERINGS OF THE FUTURE SELF.

PubMed

Hershfield, Hal E; Goldstein, Daniel G; Sharpe, William F; Fox, Jesse; Yeykelis, Leo; Carstensen, Laura L; Bailenson, Jeremy N

2011-11-01

Many people fail to save what they need to for retirement (Munnell, Webb, and Golub-Sass 2009). Research on excessive discounting of the future suggests that removing the lure of immediate rewards by pre-committing to decisions, or elaborating the value of future rewards can both make decisions more future-oriented. In this article, we explore a third and complementary route, one that deals not with present and future rewards, but with present and future selves. In line with thinkers who have suggested that people may fail, through a lack of belief or imagination, to identify with their future selves (Parfit 1971; Schelling 1984), we propose that allowing people to interact with age-progressed renderings of themselves will cause them to allocate more resources toward the future. In four studies, participants interacted with realistic computer renderings of their future selves using immersive virtual reality hardware and interactive decision aids. In all cases, those who interacted with virtual future selves exhibited an increased tendency to accept later monetary rewards over immediate ones.

Neural correlates of RDoC reward constructs in adolescents with diverse psychiatric symptoms: A Reward Flanker Task pilot study.

PubMed

Bradley, Kailyn A L; Case, Julia A C; Freed, Rachel D; Stern, Emily R; Gabbay, Vilma

2017-07-01

There has been growing interest under the Research Domain Criteria initiative to investigate behavioral constructs and their underlying neural circuitry. Abnormalities in reward processes are salient across psychiatric conditions and may precede future psychopathology in youth. However, the neural circuitry underlying such deficits has not been well defined. Therefore, in this pilot, we studied youth with diverse psychiatric symptoms and examined the neural underpinnings of reward anticipation, attainment, and positive prediction error (PPE, unexpected reward gain). Clinically, we focused on anhedonia, known to reflect deficits in reward function. Twenty-two psychotropic medication-free youth, 16 with psychiatric symptoms, exhibiting a full range of anhedonia, were scanned during the Reward Flanker Task. Anhedonia severity was quantified using the Snaith-Hamilton Pleasure Scale. Functional magnetic resonance imaging analyses were false discovery rate corrected for multiple comparisons. Anticipation activated a broad network, including the medial frontal cortex and ventral striatum, while attainment activated memory and emotion-related regions such as the hippocampus and parahippocampal gyrus, but not the ventral striatum. PPE activated a right-dominant fronto-temporo-parietal network. Anhedonia was only correlated with activation of the right angular gyrus during anticipation and the left precuneus during PPE at an uncorrected threshold. Findings are preliminary due to the small sample size. This pilot characterized the neural circuitry underlying different aspects of reward processing in youth with diverse psychiatric symptoms. These results highlight the complexity of the neural circuitry underlying reward anticipation, attainment, and PPE. Furthermore, this study underscores the importance of RDoC research in youth. Copyright © 2016 Elsevier B.V. All rights reserved.

Neuropharmacological mechanisms of drug reward: beyond dopamine in the nucleus accumbens.

PubMed

Bardo, M T

1998-01-01

Multiple lines of research have implicated the mesolimbic dopamine system in drug reward measured by either the drug self-administration or conditioned place preference paradigm. The present review summarizes recent work that examines the neuropharmacological mechanisms by which drugs impinge on this dopaminergic neural circuitry, as well as other systems that provide input and output circuits to the mesolimbic dopamine system. Studies examining the effect of selective agonist and antagonist drugs administered systemically have indicated that multiple neurotransmitters are involved, including dopamine, serotonin, acetylcholine, glutamate, GABA, and various peptides. Direct microinjection studies have also provided crucial evidence indicating that, in addition to the mesolimbic dopamine system, other structures play a role in drug reward, including the ventral pallidum, amygdala, hippocampus, hypothalamus, and pedunculopontine tegmental nucleus. GABAergic circuitry descending from the nucleus accumbens to the pedunculopontine tegmental nucleus via the ventral pallidum appears to be especially important in directing the behavioral sequelae associated with reward produced by various drugs of abuse. However, activation of the reward circuitry is achieved differently for various drugs of abuse. With amphetamine and cocaine, initiation of reward is controlled within the nucleus accumbens and prefrontal cortex, respectively. With opiates, initiation of reward involves the ventral tegmental area, nucleus accumbens, hippocampus, and hypothalamus. It is not clear presently if these multiple anatomical structures mediate opiate reward by converging on a single output system or multiple output systems.

Altered Reward Function in Adolescent Depression: What, When, and How?

PubMed Central

Forbes, Erika E.; Dahl, Ronald E.

2011-01-01

Background Conceptual models and recent evidence indicate that neural response to reward is altered in depression. Taking a developmental approach to investigating reward function in adolescent depression can elucidate the etiology, pathophysiology, and course of depression, a disorder that typically begins during adolescence and has high rates of recurrence. Methods This conceptual review describes the what, when, and how of altered reward function in adolescent depression. With the goal of generating new, testable hypotheses within a developmental affective neuroscience framework, we critically review findings and suggest future directions. Peer-reviewed empirical papers for inclusion in this critical review were obtained by searching PubMed, PsycInfo, and ScienceDirect for the years 1990–2010. Results A pattern of low striatal response and high medial prefrontal response to reward is evident in adolescents and adults with depression. Given the salience of social stimuli for positive affect and depression, reward function might be especially disrupted in response to social rewards. Because of changes in the dopamine system and reward function with aging, altered reward function in depression might be more evident during adolescence than later in life; however, low reward function may also be a stable characteristic of people who experience depression. Mechanisms of altered reward function in depression could include disrupted balance of corticostriatal circuit function, with disruption occurring as aberrant adolescent brain development. Conclusions Future studies should examine responses to social rewards; employ longitudinal and prospective designs; and investigate patterns of functional connectivity in reward circuits. Understanding altered reward function in depression has potential implications for treatment development. A more rigorous approach to investigating anhedonia, threat-reward interactions, and comorbid anxiety will be valuable to future progress in describing the role of reward function in the pathophysiology of depression. PMID:22117893

Characterization of the decision-making deficit of patients with ventromedial prefrontal cortex lesions.

PubMed

Bechara, A; Tranel, D; Damasio, H

2000-11-01

On a gambling task that models real-life decisions, patients with bilateral lesions of the ventromedial prefrontal cortex (VM) opt for choices that yield high immediate gains in spite of higher future losses. In this study, we addressed three possibilities that may account for this behaviour: (i) hypersensitivity to reward; (ii) insensitivity to punishment; and (iii) insensitivity to future consequences, such that behaviour is always guided by immediate prospects. For this purpose, we designed a variant of the original gambling task in which the advantageous decks yielded high immediate punishment but even higher future reward. The disadvantageous decks yielded low immediate punishment but even lower future reward. We measured the skin conductance responses (SCRs) of subjects after they had received a reward or punishment. Patients with VM lesions opted for the disadvantageous decks in both the original and variant versions of the gambling task. The SCRs of VM lesion patients after they had received a reward or punishment were not significantly different from those of controls. In a second experiment, we investigated whether increasing the delayed punishment in the disadvantageous decks of the original task or decreasing the delayed reward in the disadvantageous decks of the variant task would shift the behaviour of VM lesion patients towards an advantageous strategy. Both manipulations failed to shift the behaviour of VM lesion patients away from the disadvantageous decks. These results suggest that patients with VM lesions are insensitive to future consequences, positive or negative, and are primarily guided by immediate prospects. This 'myopia for the future' in VM lesion patients persists in the face of severe adverse consequences, i.e. rising future punishment or declining future reward.

Progression of coronary artery calcification in black and white women: do the stresses and rewards of multiple roles matter?

PubMed

Janssen, Imke; Powell, Lynda H; Jasielec, Mateusz S; Matthews, Karen A; Hollenberg, Steven M; Sutton-Tyrrell, Kim; Everson-Rose, Susan A

2012-02-01

Black women experience higher rates of cardiovascular disease (CVD) than white women, though evidence for racial differences in subclinical CVD is mixed. Few studies have examined multiple roles (number, perceived stress, and/or reward) in relation to subclinical CVD, or whether those effects differ by race. The aim of this study was to investigate the effects of multiple roles on 2-year progression of coronary artery calcium. Subjects were 104 black and 232 white women (mean age 50.8 years). Stress and reward from four roles (spouse, parent, employee, caregiver) were assessed on five-point scales. Coronary artery calcium progression was defined as an increase of ≥10 Agatston units. White women reported higher rewards from their multiple roles than black women, yet black women showed cardiovascular benefits from role rewards. Among black women only, higher role rewards were related significantly to lower progression of coronary artery calcium, adjusting for body mass index, blood pressure, and other known CVD risk factors. Blacks reported fewer roles but similar role stress as whites; role number and stress were unrelated to coronary artery calcium progression. Rewarding roles may be a novel protective psychosocial factor for progression of coronary calcium among black women.

INCREASING SAVING BEHAVIOR THROUGH AGE-PROGRESSED RENDERINGS OF THE FUTURE SELF

PubMed Central

HERSHFIELD, HAL E.; GOLDSTEIN, DANIEL G.; SHARPE, WILLIAM F.; FOX, JESSE; YEYKELIS, LEO; CARSTENSEN, LAURA L.; BAILENSON, JEREMY N.

2014-01-01

Many people fail to save what they need to for retirement (Munnell, Webb, and Golub-Sass 2009). Research on excessive discounting of the future suggests that removing the lure of immediate rewards by pre-committing to decisions, or elaborating the value of future rewards can both make decisions more future-oriented. In this article, we explore a third and complementary route, one that deals not with present and future rewards, but with present and future selves. In line with thinkers who have suggested that people may fail, through a lack of belief or imagination, to identify with their future selves (Parfit 1971; Schelling 1984), we propose that allowing people to interact with age-progressed renderings of themselves will cause them to allocate more resources toward the future. In four studies, participants interacted with realistic computer renderings of their future selves using immersive virtual reality hardware and interactive decision aids. In all cases, those who interacted with virtual future selves exhibited an increased tendency to accept later monetary rewards over immediate ones. PMID:24634544

Food reward system: current perspectives and future research needs

PubMed Central

Woods, Stephen C.; Pelchat, Marcia; Grigson, Patricia Sue; Stice, Eric; Farooqi, Sadaf; Khoo, Chor San; Mattes, Richard D.; Beauchamp, Gary K.

2015-01-01

This article reviews current research and cross-disciplinary perspectives on the neuroscience of food reward in animals and humans, examines the scientific hypothesis of food addiction, discusses methodological and terminology challenges, and identifies knowledge gaps and future research needs. Topics addressed herein include the role of reward and hedonic aspects in the regulation of food intake, neuroanatomy and neurobiology of the reward system in animals and humans, responsivity of the brain reward system to palatable foods and drugs, translation of craving versus addiction, and cognitive control of food reward. The content is based on a workshop held in 2013 by the North American Branch of the International Life Sciences Institute. PMID:26011903

Explorative Function in Williams Syndrome Analyzed through a Large-Scale Task with Multiple Rewards

ERIC Educational Resources Information Center

Foti, F.; Petrosini, L.; Cutuli, D.; Menghini, D.; Chiarotti, F.; Vicari, S.; Mandolesi, L.

2011-01-01

This study aimed to evaluate spatial function in subjects with Williams syndrome (WS) by using a large-scale task with multiple rewards and comparing the spatial abilities of WS subjects with those of mental age-matched control children. In the present spatial task, WS participants had to explore an open space to search nine rewards placed in…

Reward circuit connectivity relates to delay discounting in children with attention-deficit/hyperactivity disorder

PubMed Central

Costa Dias, Taciana G.; Wilson, Vanessa B.; Bathula, Deepti R.; Iyer, Swathi P.; Mills, Kathryn L.; Thurlow, Bria L.; Stevens, Corinne A.; Musser, Erica D.; Carpenter, Samuel D.; Grayson, David S.; Mitchell, Suzanne H.; Nigg, Joel T.; Fair, Damien A.

2012-01-01

Attention-deficit/hyperactivity disorder (ADHD) is a prevalent psychiatric disorder that has poor long-term outcomes and remains a major public health concern. Recent theories have proposed that ADHD arises from alterations in multiple neural pathways. Alterations in reward circuits are hypothesized as one core dysfunction, leading to altered processing of anticipated rewards. The nucleus accumbens (NAcc) is particularly important for reward processes; task-based fMRI studies have found atypical activation of this region while the participants performed a reward task. Understanding how reward circuits are involved with ADHD may be further enhanced by considering how the NAcc interacts with other brain regions. Here we used the technique of resting-state functional connectivity MRI (rs-fcMRI) to examine the alterations in the NAcc interactions and how they relate to impulsive decision making in ADHD. Using rs-fcMRI, this study: examined differences in functional connectivity of the NAcc between children with ADHD and control children; correlated the functional connectivity of NAcc with impulsivity, as measured by a delay discounting task; and combined these two initial segments to identify the atypical NAcc connections that were associated with impulsive decision making in ADHD. We found that functional connectivity of NAcc was atypical in children with ADHD and the ADHD-related increased connectivity between NAcc and the prefrontal cortex was associated with greater impulsivity (steeper delayed-reward discounting). These findings are consistent with the hypothesis that atypical signaling of the NAcc to the prefrontal cortex in ADHD may lead to excessive approach and failure in estimating future consequences; thus, leading to impulsive behavior. PMID:23206930

Decision-making and addiction (part II): myopia for the future or hypersensitivity to reward?

PubMed

Bechara, Antoine; Dolan, Sara; Hindes, Andrea

2002-01-01

On a decision-making instrument known as the "gambling task" (GT), a subgroup of substance dependent individuals (SDI) opted for choices that yield high immediate gains in spite of higher future losses. This resembles the behavior of patients with ventromedial (VM) prefrontal cortex lesions. In this study, we addressed the possibility that hypersensitivity to reward may account for the "myopia" for the future in this subgroup of SDI. We used a variant version of the GT, in which the good decks yielded high immediate punishment but higher delayed reward. The bad decks yielded low immediate punishment and lower delayed reward. We measured the skin conductance response (SCR) of subjects after receiving reward (reward SCR) and during their pondering from which deck to choose (anticipatory SCR). A subgroup of SDI who was not impaired on the original GT performed normally on the variant GT. The subgroup of SDI who was impaired on the original GT showed two levels of performance on the variant GT. One subgroup (36% of the sample) performed poorly on the variant GT, and showed similar behavioral and physiological impairments to VM patients. The other subgroup of SDI (64% of the sample) performed normally on the variant task, but had abnormally large physiological responses to reward, i.e. large SCR after receiving reward (reward SCR) and large SCR in anticipation of outcomes that yield large reward. Thus, the combined cognitive and physiological approach of assessing decision-making characterizes three sub-populations of SDI. One sub-population is without impairments that can be detected by any measure of the GT paradigm. Another sub-population is similar to VM patients in that they are insensitive to the future, both positive and negative. A third sub-population is hypersensitive to reward, so that the presence or the prospect of receiving, reward dominates their behavior.

Research Review: altered reward function in adolescent depression: what, when and how?

PubMed

Forbes, Erika E; Dahl, Ronald E

2012-01-01

Conceptual models and recent evidence indicate that neural response to reward is altered in depression. Taking a developmental approach to investigating reward function in adolescent depression can elucidate the etiology, pathophysiology and course of depression, a disorder that typically begins during adolescence and has high rates of recurrence. This conceptual review describes the what, when and how of altered reward function in adolescent depression. With the goal of generating new, testable hypotheses within a developmental affective neuroscience framework, we critically review findings and suggest future directions. Peer-reviewed empirical papers for inclusion in this critical review were obtained by searching PubMed, PsycInfo and ScienceDirect for the years 1990-2010. A pattern of low striatal response and high medial prefrontal response to reward is evident in adolescents and adults with depression. Given the salience of social stimuli for positive affect and depression, reward function might be especially disrupted in response to social rewards. Because of changes in the dopamine system and reward function with aging, altered reward function in depression might be more evident during adolescence than later in life; however, low reward function may also be a stable characteristic of people who experience depression. Mechanisms of altered reward function in depression could include disrupted balance of corticostriatal circuit function, with disruption occurring as aberrant adolescent brain development. Future studies should examine responses to social rewards; employ longitudinal and prospective designs; and investigate patterns of functional connectivity in reward circuits. Understanding altered reward function in depression has potential implications for treatment development. A more rigorous approach to investigating anhedonia, threat-reward interactions and comorbid anxiety will be valuable to future progress in describing the role of reward function in the pathophysiology of depression. © 2011 The Authors. Journal of Child Psychology and Psychiatry © 2011 Association for Child and Adolescent Mental Health.

Dynamics of rapid dopamine release in the nucleus accumbens during goal-directed behaviors for cocaine versus natural rewards

PubMed Central

Cameron, Courtney M.; Wightman, R. Mark; Carelli, Regina M.

2014-01-01

Electrophysiological studies show that distinct subsets of nucleus accumbens (NAc) neurons differentially encode information about goal-directed behaviors for intravenous cocaine versus natural (food/water) rewards. Further, NAc rapid dopamine signaling occurs on a timescale similar to phasic cell firing during cocaine and natural reward-seeking behaviors. However, it is not known whether dopamine signaling is reinforcer specific (i.e., is released during responding for only one type of reinforcer) within discrete NAc locations, similar to neural firing dynamics. Here, fast-scan cyclic voltammetry (FSCV) was used to measure rapid dopamine release during multiple schedules involving sucrose reward and cocaine self-administration (n=8 rats) and, in a separate group of rats (n = 6), during a sucrose/food multiple schedule. During the sucrose/cocaine multiple schedule, dopamine increased within seconds of operant responding for both reinforcers. Although dopamine release was not reinforcer specific, more subtle differences were observed in peak dopamine concentration [DA] across reinforcer conditions. Specifically, peak [DA] was higher during the first phase of the multiple schedule, regardless of reinforcer type. Further, the time to reach peak [DA] was delayed during cocaine-responding compared to sucrose. During the sucrose/food multiple schedule, increases in dopamine release were also observed relative to operant responding for both natural rewards. However, peak [DA] was higher relative to responding for sucrose than food, regardless of reinforcer order. Overall, the results reveal the dynamics of rapid dopamine signaling in discrete locations in the NAc across reward conditions, and provide novel insight into the functional role of this system in reward-seeking behaviors. PMID:25174553

Effects of emotion on prospection during decision-making.

PubMed

Worthy, Darrell A; Byrne, Kaileigh A; Fields, Sherecce

2014-01-01

In two experiments we examined the role of emotion, specifically worry, anxiety, and mood, on prospection during decision-making. Worry is a particularly relevant emotion to study in the context of prospection because high levels of worry may make individuals more aversive toward the uncertainty associated with the prospect of obtaining future improvements in rewards or states. Thus, high levels of worry might lead to reduced prospection during decision-making and enhance preference for immediate over delayed rewards. In Experiment 1 participants performed a two-choice dynamic decision-making task where they were required to choose between one option (the decreasing option) which provided larger immediate rewards but declines in future states, and another option (the increasing option) which provided smaller immediate rewards but improvements in future states, making it the optimal choice. High levels of worry were associated with poorer performance in the task. Additionally, fits of a sophisticated reinforcement-learning model that incorporated both reward-based and state-based information suggested that individuals reporting high levels of worry gave greater weight to the immediate rewards they would receive on each trial than to the degree to which each action would lead to improvements in their future state. In Experiment 2 we found that high levels of worry were associated with greater delay discounting using a standard delay discounting task. Combined, the results suggest that high levels of worry are associated with reduced prospection during decision-making. We attribute these results to high worriers' aversion toward the greater uncertainty associated with attempting to improve future rewards than to maximize immediate reward. These results have implications for researchers interested in the effects of emotion on cognition, and suggest that emotion strongly affects the focus on temporal outcomes during decision-making.

Temporal discounting in major depressive disorder.

PubMed

Pulcu, E; Trotter, P D; Thomas, E J; McFarquhar, M; Juhasz, G; Sahakian, B J; Deakin, J F W; Zahn, R; Anderson, I M; Elliott, R

2014-07-01

Major depressive disorder (MDD) is associated with abnormalities in financial reward processing. Previous research suggests that patients with MDD show reduced sensitivity to frequency of financial rewards. However, there is a lack of conclusive evidence from studies investigating the evaluation of financial rewards over time, an important aspect of reward processing that influences the way people plan long-term investments. Beck's cognitive model posits that patients with MDD hold a negative view of the future that may influence the amount of resources patients are willing to invest into their future selves. We administered a delay discounting task to 82 participants: 29 healthy controls, 29 unmedicated participants with fully remitted MDD (rMDD) and 24 participants with current MDD (11 on medication). Patients with current MDD, relative to remitted patients and healthy subjects, discounted large-sized future rewards at a significantly higher rate and were insensitive to changes in reward size from medium to large. There was a main effect of clinical group on discounting rates for large-sized rewards, and discounting rates for large-sized rewards correlated with severity of depressive symptoms, particularly hopelessness. Higher discounting of delayed rewards in MDD seems to be state dependent and may be a reflection of depressive symptoms, specifically hopelessness. Discounting distant rewards at a higher rate means that patients are more likely to choose immediate financial options. Such impairments related to long-term investment planning may be important for understanding value-based decision making in MDD, and contribute to ongoing functional impairment.

Temporal discounting of monetary rewards in children and adolescents with ADHD and autism spectrum disorders.

PubMed

Demurie, Ellen; Roeyers, Herbert; Baeyens, Dieter; Sonuga-Barke, Edmund

2012-11-01

It has been difficult to differentiate attention-deficit/hyperactivity disorder (ADHD) and autism spectrum disorder (ASD) in terms of some aspects of their cognitive profile. While both show deficits in executive functions, it has been suggested that they may differ in their response to monetary reward. For instance, children with ADHD prefer small immediate over large delayed rewards more than typically developing controls. One explanation for this is that they discount the value of rewards to a higher degree as they are moved into the future. The current study investigated whether children with ADHD can be differentiated from those with ASD in terms of reward discounting. Thirty-nine children (8-16 y) with ADHD, 34 children with ASD and 46 typically developing controls performed a hypothetical monetary temporal discounting task. Participants were instructed to make repeated choices between small variable rewards (0, 5, 10, 20, 30€) delivered immediately and large rewards delivered after a variable delay. Children with ADHD but not ASD discounted future rewards at a higher rate than typically developing controls. These data confirm steeper discounting of future rewards in ADHD and add to a small but growing literature showing that the psychological profile of ADHD can be distinguished from that of ASD in terms of disrupted motivational processes. © 2012 Blackwell Publishing Ltd.

Framing Reinforcement Learning from Human Reward: Reward Positivity, Temporal Discounting, Episodicity, and Performance

DTIC Science & Technology

2014-09-29

Framing Reinforcement Learning from Human Reward: Reward Positivity, Temporal Discounting, Episodicity , and Performance W. Bradley Knox...positive a trainer’s reward values are; temporal discounting, the extent to which future reward is discounted in value; episodicity , whether task...learning occurs in discrete learning episodes instead of one continuing session; and task performance, the agent’s performance on the task the trainer

Sensitivity to value-driven attention is predicted by how we learn from value.

PubMed

Jahfari, Sara; Theeuwes, Jan

2017-04-01

Reward learning is known to influence the automatic capture of attention. This study examined how the rate of learning, after high- or low-value reward outcomes, can influence future transfers into value-driven attentional capture. Participants performed an instrumental learning task that was directly followed by an attentional capture task. A hierarchical Bayesian reinforcement model was used to infer individual differences in learning from high or low reward. Results showed a strong relationship between high-reward learning rates (or the weight that is put on learning after a high reward) and the magnitude of attentional capture with high-reward colors. Individual differences in learning from high or low rewards were further related to performance differences when high- or low-value distractors were present. These findings provide novel insight into the development of value-driven attentional capture by showing how information updating after desired or undesired outcomes can influence future deployments of automatic attention.

Food reward system: current perspectives and future research needs.

PubMed

Alonso-Alonso, Miguel; Woods, Stephen C; Pelchat, Marcia; Grigson, Patricia Sue; Stice, Eric; Farooqi, Sadaf; Khoo, Chor San; Mattes, Richard D; Beauchamp, Gary K

2015-05-01

This article reviews current research and cross-disciplinary perspectives on the neuroscience of food reward in animals and humans, examines the scientific hypothesis of food addiction, discusses methodological and terminology challenges, and identifies knowledge gaps and future research needs. Topics addressed herein include the role of reward and hedonic aspects in the regulation of food intake, neuroanatomy and neurobiology of the reward system in animals and humans, responsivity of the brain reward system to palatable foods and drugs, translation of craving versus addiction, and cognitive control of food reward. The content is based on a workshop held in 2013 by the North American Branch of the International Life Sciences Institute. © The Author(s) 2015. Published by Oxford University Press on behalf of the International Life Sciences Institute.

Basolateral Amygdala to Orbitofrontal Cortex Projections Enable Cue-Triggered Reward Expectations.

PubMed

Lichtenberg, Nina T; Pennington, Zachary T; Holley, Sandra M; Greenfield, Venuz Y; Cepeda, Carlos; Levine, Michael S; Wassum, Kate M

2017-08-30

To make an appropriate decision, one must anticipate potential future rewarding events, even when they are not readily observable. These expectations are generated by using observable information (e.g., stimuli or available actions) to retrieve often quite detailed memories of available rewards. The basolateral amygdala (BLA) and orbitofrontal cortex (OFC) are two reciprocally connected key nodes in the circuitry supporting such outcome-guided behaviors. But there is much unknown about the contribution of this circuit to decision making, and almost nothing known about the whether any contribution is via direct, monosynaptic projections, or the direction of information transfer. Therefore, here we used designer receptor-mediated inactivation of OFC→BLA or BLA→OFC projections to evaluate their respective contributions to outcome-guided behaviors in rats. Inactivation of BLA terminals in the OFC, but not OFC terminals in the BLA, disrupted the selective motivating influence of cue-triggered reward representations over reward-seeking decisions as assayed by Pavlovian-to-instrumental transfer. BLA→OFC projections were also required when a cued reward representation was used to modify Pavlovian conditional goal-approach responses according to the reward's current value. These projections were not necessary when actions were guided by reward expectations generated based on learned action-reward contingencies, or when rewards themselves, rather than stored memories, directed action. These data demonstrate that BLA→OFC projections enable the cue-triggered reward expectations that can motivate the execution of specific action plans and allow adaptive conditional responding. SIGNIFICANCE STATEMENT Deficits anticipating potential future rewarding events are associated with many psychiatric diseases. Presently, we know little about the neural circuits supporting such reward expectation. Here we show that basolateral amygdala to orbitofrontal cortex projections are required for expectations of specific available rewards to influence reward seeking and decision making. The necessity of these projections was limited to situations in which expectations were elicited by reward-predictive cues. These projections therefore facilitate adaptive behavior by enabling the orbitofrontal cortex to use environmental stimuli to generate expectations of potential future rewarding events. Copyright © 2017 the authors 0270-6474/17/378374-11$15.00/0.

Basolateral Amygdala to Orbitofrontal Cortex Projections Enable Cue-Triggered Reward Expectations

PubMed Central

Lichtenberg, Nina T.; Pennington, Zachary T.; Holley, Sandra M.; Greenfield, Venuz Y.; Levine, Michael S.

2017-01-01

To make an appropriate decision, one must anticipate potential future rewarding events, even when they are not readily observable. These expectations are generated by using observable information (e.g., stimuli or available actions) to retrieve often quite detailed memories of available rewards. The basolateral amygdala (BLA) and orbitofrontal cortex (OFC) are two reciprocally connected key nodes in the circuitry supporting such outcome-guided behaviors. But there is much unknown about the contribution of this circuit to decision making, and almost nothing known about the whether any contribution is via direct, monosynaptic projections, or the direction of information transfer. Therefore, here we used designer receptor-mediated inactivation of OFC→BLA or BLA→OFC projections to evaluate their respective contributions to outcome-guided behaviors in rats. Inactivation of BLA terminals in the OFC, but not OFC terminals in the BLA, disrupted the selective motivating influence of cue-triggered reward representations over reward-seeking decisions as assayed by Pavlovian-to-instrumental transfer. BLA→OFC projections were also required when a cued reward representation was used to modify Pavlovian conditional goal-approach responses according to the reward's current value. These projections were not necessary when actions were guided by reward expectations generated based on learned action-reward contingencies, or when rewards themselves, rather than stored memories, directed action. These data demonstrate that BLA→OFC projections enable the cue-triggered reward expectations that can motivate the execution of specific action plans and allow adaptive conditional responding. SIGNIFICANCE STATEMENT Deficits anticipating potential future rewarding events are associated with many psychiatric diseases. Presently, we know little about the neural circuits supporting such reward expectation. Here we show that basolateral amygdala to orbitofrontal cortex projections are required for expectations of specific available rewards to influence reward seeking and decision making. The necessity of these projections was limited to situations in which expectations were elicited by reward-predictive cues. These projections therefore facilitate adaptive behavior by enabling the orbitofrontal cortex to use environmental stimuli to generate expectations of potential future rewarding events. PMID:28743727

A test of the reward-value hypothesis.

PubMed

Smith, Alexandra E; Dalecki, Stefan J; Crystal, Jonathon D

2017-03-01

Rats retain source memory (memory for the origin of information) over a retention interval of at least 1 week, whereas their spatial working memory (radial maze locations) decays within approximately 1 day. We have argued that different forgetting functions dissociate memory systems. However, the two tasks, in our previous work, used different reward values. The source memory task used multiple pellets of a preferred food flavor (chocolate), whereas the spatial working memory task provided access to a single pellet of standard chow-flavored food at each location. Thus, according to the reward-value hypothesis, enhanced performance in the source memory task stems from enhanced encoding/memory of a preferred reward. We tested the reward-value hypothesis by using a standard 8-arm radial maze task to compare spatial working memory accuracy of rats rewarded with either multiple chocolate or chow pellets at each location using a between-subjects design. The reward-value hypothesis predicts superior accuracy for high-valued rewards. We documented equivalent spatial memory accuracy for high- and low-value rewards. Importantly, a 24-h retention interval produced equivalent spatial working memory accuracy for both flavors. These data are inconsistent with the reward-value hypothesis and suggest that reward value does not explain our earlier findings that source memory survives unusually long retention intervals.

Dynamics of rapid dopamine release in the nucleus accumbens during goal-directed behaviors for cocaine versus natural rewards.

PubMed

Cameron, Courtney M; Wightman, R Mark; Carelli, Regina M

2014-11-01

Electrophysiological studies show that distinct subsets of nucleus accumbens (NAc) neurons differentially encode information about goal-directed behaviors for intravenous cocaine versus natural (food/water) rewards. Further, NAc rapid dopamine signaling occurs on a timescale similar to phasic cell firing during cocaine and natural reward-seeking behaviors. However, it is not known whether dopamine signaling is reinforcer specific (i.e., is released during responding for only one type of reinforcer) within discrete NAc locations, similar to neural firing dynamics. Here, fast-scan cyclic voltammetry (FSCV) was used to measure rapid dopamine release during multiple schedules involving sucrose reward and cocaine self-administration (n = 8 rats) and, in a separate group of rats (n = 6), during a sucrose/food multiple schedule. During the sucrose/cocaine multiple schedule, dopamine increased within seconds of operant responding for both reinforcers. Although dopamine release was not reinforcer specific, more subtle differences were observed in peak dopamine concentration [DA] across reinforcer conditions. Specifically, peak [DA] was higher during the first phase of the multiple schedule, regardless of reinforcer type. Further, the time to reach peak [DA] was delayed during cocaine-responding compared to sucrose. During the sucrose/food multiple schedule, increases in dopamine release were also observed relative to operant responding for both natural rewards. However, peak [DA] was higher relative to responding for sucrose than food, regardless of reinforcer order. Overall, the results reveal the dynamics of rapid dopamine signaling in discrete locations in the NAc across reward conditions, and provide novel insight into the functional role of this system in reward-seeking behaviors. Copyright © 2014 Elsevier Ltd. All rights reserved.

Dopamine prediction error responses integrate subjective value from different reward dimensions

PubMed Central

Lak, Armin; Stauffer, William R.; Schultz, Wolfram

2014-01-01

Prediction error signals enable us to learn through experience. These experiences include economic choices between different rewards that vary along multiple dimensions. Therefore, an ideal way to reinforce economic choice is to encode a prediction error that reflects the subjective value integrated across these reward dimensions. Previous studies demonstrated that dopamine prediction error responses reflect the value of singular reward attributes that include magnitude, probability, and delay. Obviously, preferences between rewards that vary along one dimension are completely determined by the manipulated variable. However, it is unknown whether dopamine prediction error responses reflect the subjective value integrated from different reward dimensions. Here, we measured the preferences between rewards that varied along multiple dimensions, and as such could not be ranked according to objective metrics. Monkeys chose between rewards that differed in amount, risk, and type. Because their choices were complete and transitive, the monkeys chose “as if” they integrated different rewards and attributes into a common scale of value. The prediction error responses of single dopamine neurons reflected the integrated subjective value inferred from the choices, rather than the singular reward attributes. Specifically, amount, risk, and reward type modulated dopamine responses exactly to the extent that they influenced economic choices, even when rewards were vastly different, such as liquid and food. This prediction error response could provide a direct updating signal for economic values. PMID:24453218

Effects of Diet-Induced Obesity on Motivation and Pain Behavior in an Operant Assay

PubMed Central

Rossi, Heather L.; Luu, Anthony K.S.; Kothari, Sunny D.; Kuburas, Adisa; Neubert, John K.; Caudle, Robert M.; Recober, Ana

2013-01-01

Obesity has been associated with multiple chronic pain disorders, including migraine. We hypothesized that diet-induced obesity would be associated with a reduced threshold for thermal nociception in the trigeminal system. In this study, we sought to examine the effect of diet-induced obesity on facial pain behavior. Mice of two different strains were fed high-fat or regular diet and tested using a well-established operant facial pain assay. We found that the effects of diet on behavior in this assay were strain and reward dependent. Obesity prone C57BL/6J mice fed high-fat diet display lower number of licks of a caloric, palatable reward (33% sweetened condensed milk or 30% sucrose) than control mice. This occurred at all temperatures, in both sexes, and was evident even before the onset of obesity. This diminished reward-seeking behavior was not observed in obesity resistant SKH1E mice. These findings suggest that diet and strain interact to modulate reward-seeking behavior. Furthermore, we observed a difference between diet groups in operant behavior with caloric, palatable rewards, but not with a non-caloric neutral reward (water). Importantly, we found no effect of diet-induced obesity on acute thermal nociception in the absence of inflammation or injury. This indicates that thermal sensation in the face is not affected by obesity-associated peripheral neuropathy as it occurs when studying pain behaviors in the rodent hindpaw. Future studies using this model may reveal whether obesity facilitates the development of chronic pain after injury or inflammation. PMID:23333672

Self-Control Assessments of Capuchin Monkeys With the Rotating Tray Task and the Accumulation Task

PubMed Central

Beran, Michael J.; Perdue, Bonnie M.; Rossettie, Mattea S.; James, Brielle T.; Whitham, Will; Walker, Bradlyn; Futch, Sara E.; Parrish, Audrey E.

2016-01-01

Recent studies of delay of gratification in capuchin monkeys using a rotating tray (RT) task have shown improved self-control performance in these animals in comparison to the accumulation (AC) task. In this study, we investigated whether this improvement resulted from the difference in methods between the rotating tray task and previous tests, or whether it was the result of greater overall experience with delay of gratification tasks. Experiment 1 produced similar performance levels by capuchins monkeys in the RT and AC tasks when identical reward and temporal parameters were used. Experiment 2 demonstrated a similar result using reward amounts that were more similar to previous AC experiments with these monkeys. In Experiment 3, monkeys performed multiple versions of the AC task with varied reward and temporal parameters. Their self-control behavior was found to be dependent on the overall delay to reward consumption, rather than the overall reward amount ultimately consumed. These findings indicate that these capuchin monkeys’ self-control capacities were more likely to have improved across studies because of the greater experience they had with delay of gratification tasks. Experiment 4 and Experiment 5 tested new, task-naïve monkeys on both tasks, finding more limited evidence of self-control, and no evidence that one task was more beneficial than the other in promoting self-control. The results of this study suggest that future testing of this kind should focus on temporal parameters and reward magnitude parameters to establish accurate measures of delay of gratification capacity and development in this species and perhaps others. PMID:27298233

The contribution of brain reward circuits to the obesity epidemic

PubMed Central

Stice, Eric; Figlewicz, Dianne P.; Gosnell, Blake A.; Levine, Allen S.; Pratt, Wayne E.

2012-01-01

One of the defining characteristics of the research of Ann E. Kelley was her recognition that the neuroscience underlying basic learning and motivation processes also shed significant light upon mechanisms underlying drug addiction and maladaptive eating patterns. In this review, we examine the parallels that exist in the neural pathways that process both food and drug reward, as determined by recent studies in animal models and human neuroimaging experiments. We discuss contemporary research that suggests that hyperphagia leading to obesity is associated with substantial neurochemical changes in the brain. These findings verify the relevance of reward pathways for promoting consumption of palatable, calorically dense foods, and lead to the important question of whether changes in reward circuitry in response to intake of such foods serve a causal role in the development and maintenance of some cases of obesity. Finally, we discuss the potential value for future studies at the intersection of the obesity epidemic and the neuroscience of motivation, as well as the potential concerns that arise from viewing excessive food intake as an “addiction”. We suggest that it might be more useful to focus on overeating that results in frank obesity, and multiple health, interpersonal, and occupational negative consequences as a form of food “abuse”. PMID:23237885

Interactions between target location and reward size modulate the rate of microsaccades in monkeys

PubMed Central

Tokiyama, Stefanie; Lisberger, Stephen G.

2015-01-01

We have studied how rewards modulate the occurrence of microsaccades by manipulating the size of an expected reward and the location of the cue that sets the expectations for future reward. We found an interaction between the size of the reward and the location of the cue. When monkeys fixated on a cue that signaled the size of future reward, the frequency of microsaccades was higher if the monkey expected a large vs. a small reward. When the cue was presented at a site in the visual field that was remote from the position of fixation, reward size had the opposite effect: the frequency of microsaccades was lower when the monkey was expecting a large reward. The strength of pursuit initiation also was affected by reward size and by the presence of microsaccades just before the onset of target motion. The gain of pursuit initiation increased with reward size and decreased when microsaccades occurred just before or after the onset of target motion. The effect of the reward size on pursuit initiation was much larger than any indirect effects reward might cause through modulation of the rate of microsaccades. We found only a weak relationship between microsaccade direction and the location of the exogenous cue relative to fixation position, even in experiments where the location of the cue indicated the direction of target motion. Our results indicate that the expectation of reward is a powerful modulator of the occurrence of microsaccades, perhaps through attentional mechanisms. PMID:26311180

Reward Selectively Modulates the Lingering Neural Representation of Recently Attended Objects in Natural Scenes.

PubMed

Hickey, Clayton; Peelen, Marius V

2017-08-02

Theories of reinforcement learning and approach behavior suggest that reward can increase the perceptual salience of environmental stimuli, ensuring that potential predictors of outcome are noticed in the future. However, outcome commonly follows visual processing of the environment, occurring even when potential reward cues have long disappeared. How can reward feedback retroactively cause now-absent stimuli to become attention-drawing in the future? One possibility is that reward and attention interact to prime lingering visual representations of attended stimuli that sustain through the interval separating stimulus and outcome. Here, we test this idea using multivariate pattern analysis of fMRI data collected from male and female humans. While in the scanner, participants searched for examples of target categories in briefly presented pictures of cityscapes and landscapes. Correct task performance was followed by reward feedback that could randomly have either high or low magnitude. Analysis showed that high-magnitude reward feedback boosted the lingering representation of target categories while reducing the representation of nontarget categories. The magnitude of this effect in each participant predicted the behavioral impact of reward on search performance in subsequent trials. Other analyses show that sensitivity to reward-as expressed in a personality questionnaire and in reactivity to reward feedback in the dopaminergic midbrain-predicted reward-elicited variance in lingering target and nontarget representations. Credit for rewarding outcome thus appears to be assigned to the target representation, causing the visual system to become sensitized for similar objects in the future. SIGNIFICANCE STATEMENT How do reward-predictive visual stimuli become salient and attention-drawing? In the real world, reward cues precede outcome and reward is commonly received long after potential predictors have disappeared. How can the representation of environmental stimuli be affected by outcome that occurs later in time? Here, we show that reward acts on lingering representations of environmental stimuli that sustain through the interval between stimulus and outcome. Using naturalistic scene stimuli and multivariate pattern analysis of fMRI data, we show that reward boosts the representation of attended objects and reduces the representation of unattended objects. This interaction of attention and reward processing acts to prime vision for stimuli that may serve to predict outcome. Copyright © 2017 the authors 0270-6474/17/377297-08$15.00/0.

A little rein on addiction.

PubMed

Mathuru, Ajay S

2018-06-01

Rewarding and aversive experiences influence emotions, motivate specific behaviors, and modify future action in animals. Multiple conserved vertebrate neural circuits have been discovered that act in a species-specific manner to reinforce behaviors that are rewarding, while attenuating those with an adverse outcome. A growing body of research now suggests that malfunction of the same circuits is an underlying cause for many human disorders and mental ailments. The habenula (Latin for "little rein") complex, an epithalamic structure that regulates midbrain monoaminergic activity has emerged in recent years as one such region in the vertebrate brain that modulates behavior. Its dysfunction, on the other hand, is implicated in a spectrum of psychiatric disorders in humans such as schizophrenia, depression and addiction. Here, I review the progress in identification of potential mechanisms involving the habenula in addiction. Copyright © 2017. Published by Elsevier Ltd.

Multi-layer network utilizing rewarded spike time dependent plasticity to learn a foraging task

PubMed Central

2017-01-01

Neural networks with a single plastic layer employing reward modulated spike time dependent plasticity (STDP) are capable of learning simple foraging tasks. Here we demonstrate advanced pattern discrimination and continuous learning in a network of spiking neurons with multiple plastic layers. The network utilized both reward modulated and non-reward modulated STDP and implemented multiple mechanisms for homeostatic regulation of synaptic efficacy, including heterosynaptic plasticity, gain control, output balancing, activity normalization of rewarded STDP and hard limits on synaptic strength. We found that addition of a hidden layer of neurons employing non-rewarded STDP created neurons that responded to the specific combinations of inputs and thus performed basic classification of the input patterns. When combined with a following layer of neurons implementing rewarded STDP, the network was able to learn, despite the absence of labeled training data, discrimination between rewarding patterns and the patterns designated as punishing. Synaptic noise allowed for trial-and-error learning that helped to identify the goal-oriented strategies which were effective in task solving. The study predicts a critical set of properties of the spiking neuronal network with STDP that was sufficient to solve a complex foraging task involving pattern classification and decision making. PMID:28961245

Orbitofrontal Cortical Neurons Encode Expectation-Driven Initiation of Reward-Seeking

PubMed Central

Aston-Jones, Gary

2014-01-01

Adaptive execution and inhibition of behavior are guided by the activity of neuronal populations across multiple frontal cortical areas. The rodent medial prefrontal cortex has been well studied with respect to these behaviors, influencing behavioral execution/inhibition based on context. Other frontal regions, in particular the orbitofrontal cortex (OFC), are critical in directing behavior to obtain rewards, but the relationship between OFC neuronal activity and response execution or inhibition has been poorly characterized. In particular, little is known about OFC with respect to extinction learning, an important example of context-guided response inhibition. Here, we recorded the activity of OFC neurons while rats performed a discriminative-stimulus (DS)-driven sucrose-seeking task followed by multiple days of extinction of the DS. OFC neuronal activity was maximally responsive (1) to reward-predicting stimuli (RS) that triggered a lever press (i.e., lever-response initiation) and (2) during reward-well approach in pursuit of sucrose (i.e., well-response initiation). RS presentation that was not followed by a lever press or RS presentation during extinction produced weak activation, as did nonrewarded stimulus (NS) presentation regardless of response (press or withhold) or session (DS-sucrose or extinction). Activity related to nonrewarded well entry was minor, and activity was significantly inhibited during reward consumption. Finally, OFC neuronal activity switched selectivity to track rewarded behaviors when the RS/NS contingencies were reversed. Thus, rather than signaling variables related to extinction or response inhibition, activity in OFC was strongest at the initiation of multiple components of reward-seeking behavior, most prominently when valid reward-predicting cues drove these behaviors. PMID:25080585

Effects of diet-induced obesity on motivation and pain behavior in an operant assay.

PubMed

Rossi, H L; Luu, A K S; Kothari, S D; Kuburas, A; Neubert, J K; Caudle, R M; Recober, A

2013-04-03

Obesity has been associated with multiple chronic pain disorders, including migraine. We hypothesized that diet-induced obesity would be associated with a reduced threshold for thermal nociception in the trigeminal system. In this study, we sought to examine the effect of diet-induced obesity on facial pain behavior. Mice of two different strains were fed high-fat or regular diet (RD) and tested using a well-established operant facial pain assay. We found that the effects of diet on behavior in this assay were strain and reward dependent. Obesity-prone C57BL/6J mice fed a high-fat diet (HFD) display lower number of licks of a caloric, palatable reward (33% sweetened condensed milk or 30% sucrose) than control mice. This occurred at all temperatures, in both sexes, and was evident even before the onset of obesity. This diminished reward-seeking behavior was not observed in obesity-resistant SKH1-E (SK) mice. These findings suggest that diet and strain interact to modulate reward-seeking behavior. Furthermore, we observed a difference between diet groups in operant behavior with caloric, palatable rewards, but not with a non-caloric neutral reward (water). Importantly, we found no effect of diet-induced obesity on acute thermal nociception in the absence of inflammation or injury. This indicates that thermal sensation in the face is not affected by obesity-associated peripheral neuropathy as it occurs when studying pain behaviors in the rodent hindpaw. Future studies using this model may reveal whether obesity facilitates the development of chronic pain after injury or inflammation. Copyright © 2013 IBRO. Published by Elsevier Ltd. All rights reserved.

Self-control assessments of capuchin monkeys with the rotating tray task and the accumulation task.

PubMed

Beran, Michael J; Perdue, Bonnie M; Rossettie, Mattea S; James, Brielle T; Whitham, Will; Walker, Bradlyn; Futch, Sara E; Parrish, Audrey E

2016-08-01

Recent studies of delay of gratification in capuchin monkeys using a rotating tray (RT) task have shown improved self-control performance in these animals in comparison to the accumulation (AC) task. In this study, we investigated whether this improvement resulted from the difference in methods between the rotating tray task and previous tests, or whether it was the result of greater overall experience with delay of gratification tasks. Experiment 1 produced similar performance levels by capuchins monkeys in the RT and AC tasks when identical reward and temporal parameters were used. Experiment 2 demonstrated a similar result using reward amounts that were more similar to previous AC experiments with these monkeys. In Experiment 3, monkeys performed multiple versions of the AC task with varied reward and temporal parameters. Their self-control behavior was found to be dependent on the overall delay to reward consumption, rather than the overall reward amount ultimately consumed. These findings indicate that these capuchin monkeys' self-control capacities were more likely to have improved across studies because of the greater experience they had with delay of gratification tasks. Experiment 4 and Experiment 5 tested new, task-naïve monkeys on both tasks, finding more limited evidence of self-control, and no evidence that one task was more beneficial than the other in promoting self-control. The results of this study suggest that future testing of this kind should focus on temporal parameters and reward magnitude parameters to establish accurate measures of delay of gratification capacity and development in this species and perhaps others. Copyright © 2016 Elsevier B.V. All rights reserved.

The Surprisingly Low Motivational Power of Future Rewards: Comparing Conventional Money-Based Measures of Discounting with Motivation-Based Measures

ERIC Educational Resources Information Center

Ebert, Jane E. J.

2010-01-01

Temporal discount rates are often poor predictors of behaviors that we expect will be motivated by the future. The current research suggests this may be because conventional discounting measures are poor measures of the motivational value of future rewards. In six studies, I develop motivation-based measures of the present value (PV) of future…

Reward and decision processes in the brains of humans and nonhuman primates.

PubMed

Sirigu, Angela; Duhamel, Jean-René

2016-03-01

Choice behavior requires weighing multiple decision variables, such as utility, uncertainty, delay, or effort, that combine to define a subjective value for each considered option or course of action. This capacity is based on prior learning about potential rewards (and punishments) that result from prior actions. When made in a social context, decisions can involve strategic thinking about the intentions of others and about the impact of others' behavior on one's own outcome. Valuation is also influenced by different emotions that serve to adaptively regulate our choices in order to, for example, stay away from excessively risky gambles, prevent future regrets, or avoid personal rejection or conflicts. Drawing on economic theory and on advances in the study of neuronal mechanisms, we review relevant recent experiments in nonhuman primates and clinical observations made in neurologically impaired patients suffering from impaired decision-making capacities.

Reward and decision processes in the brains of humans and nonhuman primates

PubMed Central

Sirigu, Angela; Duhamel, Jean-René

2016-01-01

Choice behavior requires weighing multiple decision variables, such as utility, uncertainty, delay, or effort, that combine to define a subjective value for each considered option or course of action. This capacity is based on prior learning about potential rewards (and punishments) that result from prior actions. When made in a social context, decisions can involve strategic thinking about the intentions of others and about the impact of others' behavior on one's own outcome. Valuation is also influenced by different emotions that serve to adaptively regulate our choices in order to, for example, stay away from excessively risky gambles, prevent future regrets, or avoid personal rejection or conflicts. Drawing on economic theory and on advances in the study of neuronal mechanisms, we review relevant recent experiments in nonhuman primates and clinical observations made in neurologically impaired patients suffering from impaired decision-making capacities. PMID:27069379

The Effects of Extrinsic Rewards on Admissions Counselors' Performance

ERIC Educational Resources Information Center

Gardner-Engel, Miriam

2010-01-01

This study examines the best ways to motivate college admissions counselors. A review of literature revealed multiple perspectives on intrinsic and extrinsic as well as tangible and intangible rewards. Primary research was designed to examine the impact of tangible rewards and verbal reinforcements with a convenience sample of nine college…

Future Research Directions in the Positive Valence Systems: Measurement, Development, and Implications for Youth Unipolar Depression.

PubMed

Olino, Thomas M

2016-01-01

The Positive Valence Systems (PVS) have been introduced by the National Institute of Mental Health as a domain to help organize multiple constructs focusing on reward-seeking behaviors. However, the initial working model for this domain is strongly influenced by adult constructs and measures. Thus, the present review focuses on extending the PVS into a developmental context. Specifically, the review provides some hypotheses about the structure of the PVS, how PVS components may change throughout development, how family history of depression may influence PVS development, and potential means of intervening on PVS function to reduce onsets of depression. Future research needs in each of these areas are highlighted.

Blunted ventral striatal responses to anticipated rewards foreshadow problematic drug use in novelty-seeking adolescents

PubMed Central

Büchel, Christian; Peters, Jan; Banaschewski, Tobias; Bokde, Arun L. W.; Bromberg, Uli; Conrod, Patricia J.; Flor, Herta; Papadopoulos, Dimitri; Garavan, Hugh; Gowland, Penny; Heinz, Andreas; Walter, Henrik; Ittermann, Bernd; Mann, Karl; Martinot, Jean-Luc; Paillère-Martinot, Marie-Laure; Nees, Frauke; Paus, Tomas; Pausova, Zdenka; Poustka, Luise; Rietschel, Marcella; Robbins, Trevor W.; Smolka, Michael N.; Gallinat, Juergen; Schumann, Gunter; Knutson, Brian; Arroyo, Mercedes; Artiges, Eric; Aydin, Semiha; Bach, Christine; Barbot, Alexis; Barker, Gareth; Bruehl, Ruediger; Cattrell, Anna; Constant, Patrick; Crombag, Hans; Czech, Katharina; Dalley, Jeffrey; Decideur, Benjamin; Desrivieres, Sylvane; Fadai, Tahmine; Fauth-Buhler, Mira; Feng, Jianfeng; Filippi, Irinia; Frouin, Vincent; Fuchs, Birgit; Gemmeke, Isabel; Genauck, Alexander; Hanratty, Eanna; Heinrichs, Bert; Heym, Nadja; Hubner, Thomas; Ihlenfeld, Albrecht; Ing, Alex; Ireland, James; Jia, Tianye; Jones, Jennifer; Jurk, Sarah; Kaviani, Mehri; Klaassen, Arno; Kruschwitz, Johann; Lalanne, Christophe; Lanzerath, Dirk; Lathrop, Mark; Lawrence, Claire; Lemaitre, Hervé; Macare, Christine; Mallik, Catherine; Mar, Adam; Martinez-Medina, Lourdes; Mennigen, Eva; de Carvahlo, Fabiana Mesquita; Mignon, Xavier; Millenet, Sabina; Miranda, Ruben; Müller, Kathrin; Nymberg, Charlotte; Parchetka, Caroline; Pena-Oliver, Yolanda; Pentilla, Jani; Poline, Jean-Baptiste; Quinlan, Erin Burke; Rapp, Michael; Ripke, Stephan; Ripley, Tamzin; Robert, Gabriel; Rogers, John; Romanowski, Alexander; Ruggeri, Barbara; Schmäl, Christine; Schmidt, Dirk; Schneider, Sophia; Schubert, Florian; Schwartz, Yannick; Sommer, Wolfgang; Spanagel, Rainer; Speiser, Claudia; Spranger, Tade; Stedman, Alicia; Stephens, Dai; Strache, Nicole; Ströhle, Andreas; Struve, Maren; Subramaniam, Naresh; Theobald, David; Vetter, Nora; Vulser, Helene; Weiss, Katharina; Whelan, Robert; Williams, Steve; Xu, Bing; Yacubian, Juliana; Yu, Tao; Ziesch, Veronika

2017-01-01

Novelty-seeking tendencies in adolescents may promote innovation as well as problematic impulsive behaviour, including drug abuse. Previous research has not clarified whether neural hyper- or hypo-responsiveness to anticipated rewards promotes vulnerability in these individuals. Here we use a longitudinal design to track 144 novelty-seeking adolescents at age 14 and 16 to determine whether neural activity in response to anticipated rewards predicts problematic drug use. We find that diminished BOLD activity in mesolimbic (ventral striatal and midbrain) and prefrontal cortical (dorsolateral prefrontal cortex) regions during reward anticipation at age 14 predicts problematic drug use at age 16. Lower psychometric conscientiousness and steeper discounting of future rewards at age 14 also predicts problematic drug use at age 16, but the neural responses independently predict more variance than psychometric measures. Together, these findings suggest that diminished neural responses to anticipated rewards in novelty-seeking adolescents may increase vulnerability to future problematic drug use. PMID:28221370

Developmental changes in autonomic responses are associated with future reward/punishment expectations: A study of sympathetic skin responses in the Markov decision task.

PubMed

Hosaka, Hiromi; Aoyagi, Kakuro; Kaga, Yoshimi; Kanemura, Hideaki; Sugita, Kanji; Aihara, Masao

2017-08-01

Autonomic nervous system activity is recognized as a major component of emotional responses. Future reward/punishment expectations depend upon the process of decision making in the frontal lobe, which is considered to play an important role in executive function. The aim of this study was to investigate the relationship between autonomic responses and decision making during reinforcement tasks using sympathetic skin responses (SSR). Nine adult and 9 juvenile (mean age, 10.2years) volunteers were enrolled in this study. SSRs were measured during the Markov decision task (MDT), which is a reinforcement task. In this task, subjects must endure a small immediate loss to ultimately get a large reward. The subjects had to undergo three sets of tests and their scores in these tests were assessed and evaluated. All adults showed gradually increasing scores for the MDT from the first to third set. As the trial progressed from the first to second set in adults, SSR appearance ratios remarkably increased for both punishment and reward expectations. In comparison with adults, children showed decreasing scores from the first to second set. There were no significant inter-target differences in the SSR appearance ratio in the first and second set in children. In the third set, the SSR appearance ratio for reward expectations was higher than that in the neutral condition. In reinforcement tasks, such as MDT, autonomic responses play an important role in decision making. We assume that SSRs are elicited during efficient decision making tasks associated with future reward/punishment expectations, which demonstrates the importance of autonomic function. In contrast, in children around the age of 10years, the autonomic system does not react as an organized response specific to reward/punishment expectations. This suggests the immaturity of the future reward/punishment expectations process in children. Copyright © 2017 The Japanese Society of Child Neurology. Published by Elsevier B.V. All rights reserved.

Taking the Show on the Road: The Multiple Rewards of Teaching Information Systems Abroad.

ERIC Educational Resources Information Center

Chepaitis, Elia

This paper discusses the multiple rewards of teaching information systems (IS) abroad, drawing on the experience of an IS professor who has been awarded three Fulbright scholarships in the 1990s. The author draws extensively upon personal experiences in Russia to illustrate the challenges and benefits of teaching in foreign institutions. The…

Intolerance to Delayed Reward in Girls with Multiple Suicide Attempts

PubMed Central

Mathias, Charles W.; Dougherty, Donald M.; James, Lisa M.; Richard, Dawn M.; Dawes, Michael A.; Acheson, Ashley; Hill-Kapturczak, Nathalie

2011-01-01

Impulsivity has been conceptualized as influencing the expression of suicidal behavior. Adolescence is a developmental period characterized both by a relatively high rate of suicide attempts and a high level of impulsivity. The current study examined two behavioral measures (delay reward and disinhibition) and one self-report measure of impulsivity among girls with suicide attempt histories. Girls with multiple suicide attempts performed more impulsively on measures of delayed reward, and had higher self-ratings of depression and aggression than girls with either one or no suicide attempts. The multiple attempter girl's preference for immediate gratification may directly increase vulnerability to suicidal acts in the context of distressing states or indirectly increase risk by creating poor life experiences over time. PMID:21463352

Evidence for opioid involvement in the motivation to sing

PubMed Central

Riters, Lauren V.

2009-01-01

Songbirds produce high rates of song within multiple social contexts, suggesting that they are highly motivated to sing and that song production itself may be rewarding. Progress has been made in understanding the neural basis of song learning and sensorimotor processing, however little is known about neurobiological mechanisms regulating the motivation to sing. Neural systems involved in motivation and reward have been conserved across species and in songbirds are neuroanatomically well-positioned to influence the song control system. Opioid neuropeptides within these systems play a primary role in hedonic reward, at least in mammals. In songbirds, opioid neuropeptides and receptors are found throughout the song control system and within several brain regions implicated in both motivation and reward, including the medial preoptic nucleus (POM) and ventral tegmental area (VTA). Growing research shows these regions to play a role in birdsong that differs depending upon whether song is sexually-motivated in response to a female, used for territorial defense or sung as part of a flock but not directed towards an individual (undirected song). Opioid pharmacological manipulations and immunocytochemical data demonstrate a role for opioid activity possibly within VTA and POM in the regulation of song production. Although future research is needed, data suggest that opioids may be most critically involved in reinforcing song that does not result in any obvious form of immediate externally-mediated reinforcement, such as undirected song produced in large flocks or during song learning. Data are reviewed supporting the idea that dopamine activity underlies the motivation or drive to sing, but that opioid release is what makes song production rewarding. PMID:19995531

Discounting of Monetary Rewards that are Both Delayed and Probabilistic: Delay and Probability Combine Multiplicatively, not Additively

PubMed Central

Vanderveldt, Ariana; Green, Leonard; Myerson, Joel

2014-01-01

The value of an outcome is affected both by the delay until its receipt (delay discounting) and by the likelihood of its receipt (probability discounting). Despite being well-described by the same hyperboloid function, delay and probability discounting involve fundamentally different processes, as revealed, for example, by the differential effects of reward amount. Previous research has focused on the discounting of delayed and probabilistic rewards separately, with little research examining more complex situations in which rewards are both delayed and probabilistic. In two experiments, participants made choices between smaller rewards that were both immediate and certain and larger rewards that were both delayed and probabilistic. Analyses revealed significant interactions between delay and probability factors inconsistent with an additive model. In contrast, a hyperboloid discounting model in which delay and probability were combined multiplicatively provided an excellent fit to the data. These results suggest that the hyperboloid is a good descriptor of decision making in complicated monetary choice situations like those people encounter in everyday life. PMID:24933696

From prediction error to incentive salience: mesolimbic computation of reward motivation

PubMed Central

Berridge, Kent C.

2011-01-01

Reward contains separable psychological components of learning, incentive motivation and pleasure. Most computational models have focused only on the learning component of reward, but the motivational component is equally important in reward circuitry, and even more directly controls behavior. Modeling the motivational component requires recognition of additional control factors besides learning. Here I will discuss how mesocorticolimbic mechanisms generate the motivation component of incentive salience. Incentive salience takes Pavlovian learning and memory as one input and as an equally important input takes neurobiological state factors (e.g., drug states, appetite states, satiety states) that can vary independently of learning. Neurobiological state changes can produce unlearned fluctuations or even reversals in the ability of a previously-learned reward cue to trigger motivation. Such fluctuations in cue-triggered motivation can dramatically depart from all previously learned values about the associated reward outcome. Thus a consequence of the difference between incentive salience and learning can be to decouple cue-triggered motivation of the moment from previously learned values of how good the associated reward has been in the past. Another consequence can be to produce irrationally strong motivation urges that are not justified by any memories of previous reward values (and without distorting associative predictions of future reward value). Such irrationally strong motivation may be especially problematic in addiction. To comprehend these phenomena, future models of mesocorticolimbic reward function should address the neurobiological state factors that participate to control generation of incentive salience. PMID:22487042

Graded Multiple Choice Questions: Rewarding Understanding and Preventing Plagiarism

NASA Astrophysics Data System (ADS)

Denyer, G. S.; Hancock, D.

2002-08-01

This paper describes an easily implemented method that allows the generation and analysis of graded multiple-choice examinations. The technique, which uses standard functions in user-end software (Microsoft Excel 5+), can also produce several different versions of an examination that can be employed to prevent the reward of plagarism. The manuscript also discusses the advantages of having a graded marking system for the elimination of ambiguities, use in multi-step calculation questions, and questions that require extrapolation or reasoning. The advantages of the scrambling strategy, which maintains the same question order, is discussed with reference to student equity. The system provides a non-confrontational mechanism for dealing with cheating in large-class multiple-choice examinations, as well as providing a reward for problem solving over surface learning.

Serotonergic neurons signal reward and punishment on multiple timescales

PubMed Central

Cohen, Jeremiah Y; Amoroso, Mackenzie W; Uchida, Naoshige

2015-01-01

Serotonin's function in the brain is unclear. One challenge in testing the numerous hypotheses about serotonin's function has been observing the activity of identified serotonergic neurons in animals engaged in behavioral tasks. We recorded the activity of dorsal raphe neurons while mice experienced a task in which rewards and punishments varied across blocks of trials. We ‘tagged’ serotonergic neurons with the light-sensitive protein channelrhodopsin-2 and identified them based on their responses to light. We found three main features of serotonergic neuron activity: (1) a large fraction of serotonergic neurons modulated their tonic firing rates over the course of minutes during reward vs punishment blocks; (2) most were phasically excited by punishments; and (3) a subset was phasically excited by reward-predicting cues. By contrast, dopaminergic neurons did not show firing rate changes across blocks of trials. These results suggest that serotonergic neurons signal information about reward and punishment on multiple timescales. DOI: http://dx.doi.org/10.7554/eLife.06346.001 PMID:25714923

fMRI of alterations in reward selection, anticipation, and feedback in major depressive disorder.

PubMed

Smoski, Moria J; Felder, Jennifer; Bizzell, Joshua; Green, Steven R; Ernst, Monique; Lynch, Thomas R; Dichter, Gabriel S

2009-11-01

The purpose of the present investigation was to evaluate reward processing in unipolar major depressive disorder (MDD). Specifically, we investigated whether adults with MDD demonstrated hyporesponsivity in striatal brain regions and/or hyperresponsivity in cortical brain regions involved in conflict monitoring using a Wheel of Fortune task designed to probe responses during reward selection, reward anticipation, and reward feedback. Functional magnetic resonance imaging (fMRI) data indicated that the MDD group was characterized by reduced activation of striatal reward regions during reward selection, reward anticipation, and reward feedback, supporting previous data indicating hyporesponsivity of reward systems in MDD. Support was not found for hyperresponsivity of cognitive control regions during reward selection or reward anticipation. Instead, MDD participants showed hyperresponsivity in orbitofrontal cortex, a region associated with assessment of risk and reward, during reward selection, as well as decreased activation of the middle frontal gyrus and the rostral cingulate gyrus during reward selection and anticipation. Finally, depression severity was predicted by activation in bilateral midfrontal gyrus during reward selection. Results indicate that MDD is characterized by striatal hyporesponsivity, and that future studies of MDD treatments that seek to improve responses to rewarding stimuli should assess striatal functioning.

Rewards and unique challenges faced by African-American custodial grandmothers: the importance of future planning.

PubMed

Crowther, Martha R; Huang, Chao-Hui Sylvia; Allen, Rebecca S

2015-01-01

This exploratory study examined the context and consequences of custodial grandparenting, along with attitudes and preferences regarding future planning among 22 African-American custodial grandmothers. A mixed-method research design was employed. Based on our integration of two theories regarding future planning and health behavior change, caregiving, emotional distress, religiosity and spirituality, and future planning were assessed using questionnaires along with semi-structured interviews. African-American custodial grandmothers (mean age M = 53.64, SD = 9.58) perceived their caregiving role as rewarding (72%) yet challenging (86%). More than 40% reported significant emotional distress (CES-D ≥ 16) that warrants clinical attention. Findings showed that while 64% of study participants had future plans regarding who will substitute in their caregiving role if they become incapacitated, only 9% had completed a living will. Three major themes emerged regarding custodial grandmothers' caregiving role which includes: (1) rewards; (2) challenges including feeling overwhelmed and health concerns; and (3) caregiving decisions including conflicts between 'My plan was…/put self on-hold' for grandchildren and difficulty with future planning. These themes highlighted the dynamics of caregiving across time, including current context and the ongoing process of decision-making. Findings suggest that while African-American custodial grandmothers find caregiving rewarding, they face unique challenges in contemplating and developing future plans. Custodial grandmothers think about substitute caregivers for their grandchildren but need assistance communicating a plan focused on their own needs for future care. Culturally sensitive interventions designed to facilitate effective utilization of future plans within this caregiver population are needed.

Reward contingencies and the recalibration of task monitoring and reward systems: a high-density electrical mapping study.

PubMed

Morie, K P; De Sanctis, P; Foxe, J J

2014-07-25

Task execution almost always occurs in the context of reward-seeking or punishment-avoiding behavior. As such, ongoing task-monitoring systems are influenced by reward anticipation systems. In turn, when a task has been executed either successfully or unsuccessfully, future iterations of that task will be re-titrated on the basis of the task outcome. Here, we examined the neural underpinnings of the task-monitoring and reward-evaluation systems to better understand how they govern reward-seeking behavior. Twenty-three healthy adult participants performed a task where they accrued points that equated to real world value (gift cards) by responding as rapidly as possible within an allotted timeframe, while success rate was titrated online by changing the duration of the timeframe dependent on participant performance. Informative cues initiated each trial, indicating the probability of potential reward or loss (four levels from very low to very high). We manipulated feedback by first informing participants of task success/failure, after which a second feedback signal indicated actual magnitude of reward/loss. High-density electroencephalography (EEG) recordings allowed for examination of event-related potentials (ERPs) to the informative cues and in turn, to both feedback signals. Distinct ERP components associated with reward cues, task-preparatory and task-monitoring processes, and reward feedback processes were identified. Unsurprisingly, participants displayed increased ERP amplitudes associated with task-preparatory processes following cues that predicted higher chances of reward. They also rapidly updated reward and loss prediction information dependent on task performance after the first feedback signal. Finally, upon reward receipt, initial reward probability was no longer taken into account. Rather, ERP measures suggested that only the magnitude of actual reward or loss was now processed. Reward and task-monitoring processes are clearly dissociable, but interact across very fast timescales to update reward predictions as information about task success or failure is accrued. Careful delineation of these processes will be useful in future investigations in clinical groups where such processes are suspected of having gone awry. Copyright © 2014 IBRO. Published by Elsevier Ltd. All rights reserved.

Reward Contingencies and the Recalibration of Task Monitoring and Reward Systems: A high-density electrical mapping study

PubMed Central

Morie, Kristen P.; De Sanctis, Pierfilippo; Foxe, John J.

2014-01-01

Task execution almost always occurs in the context of reward-seeking or punishment-avoiding behavior. As such, ongoing task monitoring systems are influenced by reward anticipation systems. In turn, when a task has been executed either successfully or unsuccessfully, future iterations of that task will be re-titrated on the basis of the task outcome. Here, we examined the neural underpinnings of the task-monitoring and reward-evaluation systems to better understand how they govern reward seeking behavior. Twenty-three healthy adult participants performed a task where they accrued points that equated to real world value (gift cards) by responding as rapidly as possible within an allotted timeframe, while success rate was titrated online by changing the duration of the timeframe dependent on participant performance. Informative cues initiated each trial, indicating the probability of potential reward or loss (four levels from very low to very high). We manipulated feedback by first informing participants of task success/failure, after which a second feedback signal indicated actual magnitude of reward/loss. High-density EEG recordings allowed for examination of event-related potentials (ERPs) to the informative cues and in turn, to both feedback signals. Distinct ERP components associated with reward cues, task preparatory and task monitoring processes, and reward feedback processes were identified. Unsurprisingly, participants displayed increased ERP amplitudes associated with task preparatory processes following cues that predicted higher chances of reward. They also rapidly updated reward and loss prediction information dependent on task performance after the first feedback signal. Finally, upon reward receipt, initial reward probability was no longer taken into account. Rather, ERP measures suggested that only the magnitude of actual reward or loss was now processed. Reward and task monitoring processes are clearly dissociable, but interact across very fast timescales to update reward predictions as information about task success or failure is accrued. Careful delineation of these processes will be useful in future investigations in clinical groups where such processes are suspected of having gone awry. PMID:24836852

Prospective Optimization with Limited Resources

PubMed Central

Snider, Joseph; Lee, Dongpyo; Poizner, Howard; Gepshtein, Sergei

2015-01-01

The future is uncertain because some forthcoming events are unpredictable and also because our ability to foresee the myriad consequences of our own actions is limited. Here we studied how humans select actions under such extrinsic and intrinsic uncertainty, in view of an exponentially expanding number of prospects on a branching multivalued visual stimulus. A triangular grid of disks of different sizes scrolled down a touchscreen at a variable speed. The larger disks represented larger rewards. The task was to maximize the cumulative reward by touching one disk at a time in a rapid sequence, forming an upward path across the grid, while every step along the path constrained the part of the grid accessible in the future. This task captured some of the complexity of natural behavior in the risky and dynamic world, where ongoing decisions alter the landscape of future rewards. By comparing human behavior with behavior of ideal actors, we identified the strategies used by humans in terms of how far into the future they looked (their “depth of computation”) and how often they attempted to incorporate new information about the future rewards (their “recalculation period”). We found that, for a given task difficulty, humans traded off their depth of computation for the recalculation period. The form of this tradeoff was consistent with a complete, brute-force exploration of all possible paths up to a resource-limited finite depth. A step-by-step analysis of the human behavior revealed that participants took into account very fine distinctions between the future rewards and that they abstained from some simple heuristics in assessment of the alternative paths, such as seeking only the largest disks or avoiding the smaller disks. The participants preferred to reduce their depth of computation or increase the recalculation period rather than sacrifice the precision of computation. PMID:26367309

Prospective Optimization with Limited Resources.

PubMed

Snider, Joseph; Lee, Dongpyo; Poizner, Howard; Gepshtein, Sergei

2015-09-01

The future is uncertain because some forthcoming events are unpredictable and also because our ability to foresee the myriad consequences of our own actions is limited. Here we studied how humans select actions under such extrinsic and intrinsic uncertainty, in view of an exponentially expanding number of prospects on a branching multivalued visual stimulus. A triangular grid of disks of different sizes scrolled down a touchscreen at a variable speed. The larger disks represented larger rewards. The task was to maximize the cumulative reward by touching one disk at a time in a rapid sequence, forming an upward path across the grid, while every step along the path constrained the part of the grid accessible in the future. This task captured some of the complexity of natural behavior in the risky and dynamic world, where ongoing decisions alter the landscape of future rewards. By comparing human behavior with behavior of ideal actors, we identified the strategies used by humans in terms of how far into the future they looked (their "depth of computation") and how often they attempted to incorporate new information about the future rewards (their "recalculation period"). We found that, for a given task difficulty, humans traded off their depth of computation for the recalculation period. The form of this tradeoff was consistent with a complete, brute-force exploration of all possible paths up to a resource-limited finite depth. A step-by-step analysis of the human behavior revealed that participants took into account very fine distinctions between the future rewards and that they abstained from some simple heuristics in assessment of the alternative paths, such as seeking only the largest disks or avoiding the smaller disks. The participants preferred to reduce their depth of computation or increase the recalculation period rather than sacrifice the precision of computation.

The date-delay framing effect in temporal discounting depends on substance abuse.

PubMed

Klapproth, Florian

2012-07-01

In the present study, individuals with substance use disorders (n=30) and non-addicted controls (n=30) were presented with a delay-discounting task with time being described either as dates or as temporal intervals. Three main results were obtained. First, in both groups reward size had a large impact on discounting future rewards, with discount rates becoming larger with smaller reward sizes. Second, participants discounted future rewards less strongly when their time of delivery was presented as a date instead of a temporal distance. Third, whereas discount rates of individuals with substance use disorders varied substantially with regard to the presentation of time in the task, the controls changed their choices depending on time presentation only slightly. Copyright © 2012 Elsevier B.V. All rights reserved.

Use of multiple-site performance-contingent SEMG reward programming in pediatric rehabilitation: a retrospective review.

PubMed

Bolek, Jeffrey E

2006-09-01

We completed a retrospective review of the effectiveness of multi-site, performance-contingent reward programming on functional change in motor performance of 16 treatment resistant children. Patients were previously treated in physical or occupational therapy for head control, standing balance training, sitting and upper extremity use (brachial plexus injury). They then participated in a program that utilized multiple surface electromyography sites the use of which was rewarded with videos for performing the correct constellation of recruitment pattern (e.g., contracting some muscles while relaxing others). Onset of reward was calibrated for each patient and transfer of skill to outside the clinic was encouraged by linking a verbal cue to the correct motor plan. Fourteen of the 16 patients improved. The implications of the use of this technique in the treatment of motor dysfunction is discussed.

The Effects of Direct Instruction Flashcards and Rewards with Math Facts at School and in the Home: Acquisition and Maintenance

ERIC Educational Resources Information Center

Mann, Zennetta; McLaughlin, T. F.; Williams, Randy Lee; Derby, K. Mark; Everson, Mary

2012-01-01

The purpose of the present study was to evaluate the effects of Direct Instruction (DI) flashcard procedure, combined with strategies and rewards on multiplication fact accuracy of two elementary school-age students. A single subject replication design across three and four sets of multiplication facts was used to evaluate outcomes. The results…

From prediction error to incentive salience: mesolimbic computation of reward motivation.

PubMed

Berridge, Kent C

2012-04-01

Reward contains separable psychological components of learning, incentive motivation and pleasure. Most computational models have focused only on the learning component of reward, but the motivational component is equally important in reward circuitry, and even more directly controls behavior. Modeling the motivational component requires recognition of additional control factors besides learning. Here I discuss how mesocorticolimbic mechanisms generate the motivation component of incentive salience. Incentive salience takes Pavlovian learning and memory as one input and as an equally important input takes neurobiological state factors (e.g. drug states, appetite states, satiety states) that can vary independently of learning. Neurobiological state changes can produce unlearned fluctuations or even reversals in the ability of a previously learned reward cue to trigger motivation. Such fluctuations in cue-triggered motivation can dramatically depart from all previously learned values about the associated reward outcome. Thus, one consequence of the difference between incentive salience and learning can be to decouple cue-triggered motivation of the moment from previously learned values of how good the associated reward has been in the past. Another consequence can be to produce irrationally strong motivation urges that are not justified by any memories of previous reward values (and without distorting associative predictions of future reward value). Such irrationally strong motivation may be especially problematic in addiction. To understand these phenomena, future models of mesocorticolimbic reward function should address the neurobiological state factors that participate to control generation of incentive salience. © 2012 The Author. European Journal of Neuroscience © 2012 Federation of European Neuroscience Societies and Blackwell Publishing Ltd.

Temporal Discounting and Inter-Temporal Choice in Rhesus Monkeys

PubMed Central

Hwang, Jaewon; Kim, Soyoun; Lee, Daeyeol

2009-01-01

Humans and animals are more likely to take an action leading to an immediate reward than actions with delayed rewards of similar magnitudes. Although such devaluation of delayed rewards has been almost universally described by hyperbolic discount functions, the rate of this temporal discounting varies substantially among different animal species. This might be in part due to the differences in how the information about reward is presented to decision makers. In previous animal studies, reward delays or magnitudes were gradually adjusted across trials, so the animals learned the properties of future rewards from the rewards they waited for and consumed previously. In contrast, verbal cues have been used commonly in human studies. In the present study, rhesus monkeys were trained in a novel inter-temporal choice task in which the magnitude and delay of reward were indicated symbolically using visual cues and varied randomly across trials. We found that monkeys could extract the information about reward delays from visual symbols regardless of the number of symbols used to indicate the delay. The rate of temporal discounting observed in the present study was comparable to the previous estimates in other mammals, and the animal's choice behavior was largely consistent with hyperbolic discounting. Our results also suggest that the rate of temporal discounting might be influenced by contextual factors, such as the novelty of the task. The flexibility furnished by this new inter-temporal choice task might be useful for future neurobiological investigations on inter-temporal choice in non-human primates. PMID:19562091

Theory of choice in bandit, information sampling and foraging tasks.

PubMed

Averbeck, Bruno B

2015-03-01

Decision making has been studied with a wide array of tasks. Here we examine the theoretical structure of bandit, information sampling and foraging tasks. These tasks move beyond tasks where the choice in the current trial does not affect future expected rewards. We have modeled these tasks using Markov decision processes (MDPs). MDPs provide a general framework for modeling tasks in which decisions affect the information on which future choices will be made. Under the assumption that agents are maximizing expected rewards, MDPs provide normative solutions. We find that all three classes of tasks pose choices among actions which trade-off immediate and future expected rewards. The tasks drive these trade-offs in unique ways, however. For bandit and information sampling tasks, increasing uncertainty or the time horizon shifts value to actions that pay-off in the future. Correspondingly, decreasing uncertainty increases the relative value of actions that pay-off immediately. For foraging tasks the time-horizon plays the dominant role, as choices do not affect future uncertainty in these tasks.

Brain reward region responsivity of adolescents with and without parental substance use disorders.

PubMed

Stice, Eric; Yokum, Sonja

2014-09-01

The present study tested the competing hypotheses that adolescents at risk for future substance abuse and dependence by virtue of parental substance use disorders show either weaker or stronger responsivity of brain regions implicated in reward relative to youth without parental history of substance use disorders. Adolescents (n = 52) matched on demographics with and without parental substance use disorders, as determined by diagnostic interviews, who denied substance use in the past year were compared on functional MRI (fMRI) paradigms assessing neural response to receipt and anticipated receipt of monetary and food reward. Parental-history-positive versus -negative adolescents showed greater activation in the left dorsolateral prefrontal cortex and bilateral putamen, and less activation in the fusiform gyrus and inferior temporal gyrus in response to anticipating winning money, as well as greater activation in the left midbrain and right paracentral lobule, and less activation in the right middle frontal gyrus in response to milkshake receipt. Results indicate that adolescents at risk for future onset of substance use disorders show elevated responsivity of brain regions implicated in reward, extending results from 2 smaller prior studies that found that individuals with versus without parental alcohol use disorders showed greater reward region response to anticipated monetary reward and pictures of alcohol. Collectively, results provide support for the reward surfeit model of substance use disorders, rather than the reward deficit model.

Evidence for opioid involvement in the motivation to sing.

PubMed

Riters, Lauren V

2010-03-01

Songbirds produce high rates of song within multiple social contexts, suggesting that they are highly motivated to sing and that song production itself may be rewarding. Progress has been made in understanding the neural basis of song learning and sensorimotor processing, however little is known about neurobiological mechanisms regulating the motivation to sing. Neural systems involved in motivation and reward have been conserved across species and in songbirds are neuroanatomically well-positioned to influence the song control system. Opioid neuropeptides within these systems play a primary role in hedonic reward, at least in mammals. In songbirds, opioid neuropeptides and receptors are found throughout the song control system and within several brain regions implicated in both motivation and reward, including the medial preoptic nucleus (POM) and ventral tegmental area (VTA). Growing research shows these regions to play a role in birdsong that differs depending upon whether song is sexually motivated in response to a female, used for territorial defense or sung as part of a flock but not directed towards an individual (undirected song). Opioid pharmacological manipulations and immunocytochemical data demonstrate a role for opioid activity possibly within VTA and POM in the regulation of song production. Although future research is needed, data suggest that opioids may be most critically involved in reinforcing song that does not result in any obvious form of immediate externally mediated reinforcement, such as undirected song produced in large flocks or during song learning. Data are reviewed supporting the idea that dopamine activity underlies the motivation or drive to sing, but that opioid release is what makes song production rewarding. Copyright 2009 Elsevier B.V. All rights reserved.

Reward Retroactively Enhances Memory Consolidation for Related Items

ERIC Educational Resources Information Center

Patil, Anuya; Murty, Vishnu P.; Dunsmoor, Joseph E.; Phelps, Elizabeth A.; Davachi, Lila

2017-01-01

Reward motivation has been shown to modulate episodic memory processes in order to support future adaptive behavior. However, for a memory system to be truly adaptive, it should enhance memory for rewarded events as well as for neutral events that may seem inconsequential at the time of encoding but can gain importance later. Here, we investigated…

Gratitude intervention modulates P3 amplitude in a temporal discounting task.

PubMed

Patalano, Andrea L; Lolli, Sydney L; Sanislow, Charles A

2018-06-23

Gratitude has been shown to reduce economic impatience. In particular, individuals induced to experience heightened gratitude are more willing to choose delayed larger rewards over immediate smaller rewards (i.e., they have lower discounting rates) than those in a neutral condition. Using the event-related potential (ERP) method, we investigated the relation between gratitude level and neurophysiological correlates. Of interest was motivated information processing, as indexed by the P3 component. Participants were administered a gratitude or a neutral mood induction followed by a temporal discounting task (choosing between a fixed immediate reward versus a future reward that varied across trials) while electroencephalogram (EEG) activity was recorded. Individuals in the gratitude condition had greater P3 amplitude, suggesting greater attention to the future-reward option (the choice option that varied across trials), even when this option was not selected, and providing the first evidence of gratitude-induced changes in electrophysiological activity. Copyright © 2018. Published by Elsevier B.V.

Does Goal Relevant Episodic Future Thinking Amplify the Effect on Delay Discounting?

PubMed Central

O’Donnell, Sara; Daniel, Tinuke Oluyomi; Epstein, Leonard H.

2017-01-01

Delay discounting (DD) is the preference for smaller immediate rewards over larger delayed rewards. Research shows episodic future thinking (EFT), or mentally simulating future experiences, reframes the choice between small immediate and larger delayed rewards, and can reduce DD. Only general EFT has been studied, whereby people reframe decisions in terms of non-goal related future events. Since future thinking is often goal-oriented and leads to greater activation of brain regions involved in prospection, goal-oriented EFT may be associated with greater reductions in DD than general goal-unrelated EFT. The present study (n = 104, Mage = 22.25, SD = 3.42; 50% Female) used a between-subjects 2×2 factorial design with type of episodic thinking (Goal, General) and temporal perspective (Episodic future versus recent thinking; EFT vs ERT) as between factors. Results showed a significant reduction in DD for EFT groups (p < 0.001, Cohen’s d effect size = 0.89), and goal-EFT was more effective than general-EFT on reducing DD (p = 0.03, d = 0.64). PMID:28282631

Does goal relevant episodic future thinking amplify the effect on delay discounting?

PubMed

O'Donnell, Sara; Oluyomi Daniel, Tinuke; Epstein, Leonard H

2017-05-01

Delay discounting (DD) is the preference for smaller immediate rewards over larger delayed rewards. Research shows episodic future thinking (EFT), or mentally simulating future experiences, reframes the choice between small immediate and larger delayed rewards, and can reduce DD. Only general EFT has been studied, whereby people reframe decisions in terms of non-goal related future events. Since future thinking is often goal-oriented and leads to greater activation of brain regions involved in prospection, goal-oriented EFT may be associated with greater reductions in DD than general goal-unrelated EFT. The present study (n=104, M age =22.25, SD=3.42; 50% Female) used a between-subjects 2×2 factorial design with type of episodic thinking (Goal, General) and temporal perspective (Episodic future versus recent thinking; EFT vs ERT) as between factors. Results showed a significant reduction in DD for EFT groups (p<0.001, Cohen's d effect size=0.89), and goal-EFT was more effective than general-EFT on reducing DD (p=0.03, d=0.64). Copyright © 2017 Elsevier Inc. All rights reserved.

Taking two to tango: a role for ghrelin receptor heterodimerization in stress and reward.

PubMed

Schellekens, Harriët; Dinan, Timothy G; Cryan, John F

2013-08-30

The gut hormone, ghrelin, is the only known peripherally derived orexigenic signal. It activates its centrally expressed receptor, the growth hormone secretagogue receptor (GHS-R1a), to stimulate food intake. The ghrelin signaling system has recently been suggested to play a key role at the interface of homeostatic control of appetite and the hedonic aspects of food intake, as a critical role for ghrelin in dopaminergic mesolimbic circuits involved in reward signaling has emerged. Moreover, enhanced plasma ghrelin levels are associated with conditions of physiological stress, which may underline the drive to eat calorie-dense "comfort-foods" and signifies a role for ghrelin in stress-induced food reward behaviors. These complex and diverse functionalities of the ghrelinergic system are not yet fully elucidated and likely involve crosstalk with additional signaling systems. Interestingly, accumulating data over the last few years has shown the GHS-R1a receptor to dimerize with several additional G-protein coupled receptors (GPCRs) involved in appetite signaling and reward, including the GHS-R1b receptor, the melanocortin 3 receptor (MC3), dopamine receptors (D1 and D2), and more recently, the serotonin 2C receptor (5-HT2C). GHS-R1a dimerization was shown to affect downstream signaling and receptor trafficking suggesting a potential novel mechanism for fine-tuning GHS-R1a receptor mediated activity. This review summarizes ghrelin's role in food reward and stress and outlines the GHS-R1a dimer pairs identified to date. In addition, the downstream signaling and potential functional consequences of dimerization of the GHS-R1a receptor in appetite and stress-induced food reward behavior are discussed. The existence of multiple GHS-R1a heterodimers has important consequences for future pharmacotherapies as it significantly increases the pharmacological diversity of the GHS-R1a receptor and has the potential to enhance specificity of novel ghrelin-targeted drugs.

Taking two to tango: a role for ghrelin receptor heterodimerization in stress and reward

PubMed Central

Schellekens, Harriët; Dinan, Timothy G.; Cryan, John F.

2013-01-01

The gut hormone, ghrelin, is the only known peripherally derived orexigenic signal. It activates its centrally expressed receptor, the growth hormone secretagogue receptor (GHS-R1a), to stimulate food intake. The ghrelin signaling system has recently been suggested to play a key role at the interface of homeostatic control of appetite and the hedonic aspects of food intake, as a critical role for ghrelin in dopaminergic mesolimbic circuits involved in reward signaling has emerged. Moreover, enhanced plasma ghrelin levels are associated with conditions of physiological stress, which may underline the drive to eat calorie-dense “comfort-foods” and signifies a role for ghrelin in stress-induced food reward behaviors. These complex and diverse functionalities of the ghrelinergic system are not yet fully elucidated and likely involve crosstalk with additional signaling systems. Interestingly, accumulating data over the last few years has shown the GHS-R1a receptor to dimerize with several additional G-protein coupled receptors (GPCRs) involved in appetite signaling and reward, including the GHS-R1b receptor, the melanocortin 3 receptor (MC3), dopamine receptors (D1 and D2), and more recently, the serotonin 2C receptor (5-HT2C). GHS-R1a dimerization was shown to affect downstream signaling and receptor trafficking suggesting a potential novel mechanism for fine-tuning GHS-R1a receptor mediated activity. This review summarizes ghrelin's role in food reward and stress and outlines the GHS-R1a dimer pairs identified to date. In addition, the downstream signaling and potential functional consequences of dimerization of the GHS-R1a receptor in appetite and stress-induced food reward behavior are discussed. The existence of multiple GHS-R1a heterodimers has important consequences for future pharmacotherapies as it significantly increases the pharmacological diversity of the GHS-R1a receptor and has the potential to enhance specificity of novel ghrelin-targeted drugs. PMID:24009547

Neural dynamics of reward probability coding: a Magnetoencephalographic study in humans

PubMed Central

Thomas, Julie; Vanni-Mercier, Giovanna; Dreher, Jean-Claude

2013-01-01

Prediction of future rewards and discrepancy between actual and expected outcomes (prediction error) are crucial signals for adaptive behavior. In humans, a number of fMRI studies demonstrated that reward probability modulates these two signals in a large brain network. Yet, the spatio-temporal dynamics underlying the neural coding of reward probability remains unknown. Here, using magnetoencephalography, we investigated the neural dynamics of prediction and reward prediction error computations while subjects learned to associate cues of slot machines with monetary rewards with different probabilities. We showed that event-related magnetic fields (ERFs) arising from the visual cortex coded the expected reward value 155 ms after the cue, demonstrating that reward value signals emerge early in the visual stream. Moreover, a prediction error was reflected in ERF peaking 300 ms after the rewarded outcome and showing decreasing amplitude with higher reward probability. This prediction error signal was generated in a network including the anterior and posterior cingulate cortex. These findings pinpoint the spatio-temporal characteristics underlying reward probability coding. Together, our results provide insights into the neural dynamics underlying the ability to learn probabilistic stimuli-reward contingencies. PMID:24302894

Evaluation of the comprehensive palatability of Japanese sake paired with dishes by multiple regression analysis based on subdomains.

PubMed

Nakamura, Ryo; Nakano, Kumiko; Tamura, Hiroyasu; Mizunuma, Masaki; Fushiki, Tohru; Hirata, Dai

2017-08-01

Many factors contribute to palatability. In order to evaluate the palatability of Japanese alcohol sake paired with certain dishes by integrating multiple factors, here we applied an evaluation method previously reported for palatability of cheese by multiple regression analysis based on 3 subdomain factors (rewarding, cultural, and informational). We asked 94 Japanese participants/subjects to evaluate the palatability of sake (1st evaluation/E1 for the first cup, 2nd/E2 and 3rd/E3 for the palatability with aftertaste/afterglow of certain dishes) and to respond to a questionnaire related to 3 subdomains. In E1, 3 factors were extracted by a factor analysis, and the subsequent multiple regression analyses indicated that the palatability of sake was interpreted by mainly the rewarding. Further, the results of attribution-dissections in E1 indicated that 2 factors (rewarding and informational) contributed to the palatability. Finally, our results indicated that the palatability of sake was influenced by the dish eaten just before drinking.

The experience of art: insights from neuroimaging.

PubMed

Nadal, Marcos

2013-01-01

The experience of art is a complex one. It emerges from the interaction of multiple cognitive and affective processes. Neuropsychological and neuroimaging studies are revealing the broadly distributed network of brain regions upon which it relies. This network can be divided into three functional components: (i) prefrontal, parietal, and temporal cortical regions support evaluative judgment, attentional processing, and memory retrieval; (ii) the reward circuit, including cortical, subcortical regions, and some of its regulators, is involved in the generation of pleasurable feelings and emotions, and the valuation and anticipation of reward; and (iii) attentional modulation of activity in low-, mid-, and high-level cortical sensory regions enhances the perceptual processing of certain features, relations, locations, or objects. Understanding how these regions act in concert to produce unique and moving art experiences and determining the impact of personal and cultural meaning and context on this network the biological foundation of the experience of art--remain future challenges. © 2013 Elsevier B.V. All rights reserved.

Responses to a simple barter task in chimpanzees, Pan troglodytes.

PubMed

Brosnan, Sarah F; de Waal, Frans B M

2005-07-01

Chimpanzees (Pan troglodytes) frequently participate in social exchange involving multiple goods and services of variable value, yet they have not been tested in a formalized situation to see whether they can barter using multiple tokens and rewards. We set up a simple barter economy with two tokens and two associated rewards and tested chimpanzees on their ability to obtain rewards by returning the matching token in situations in which their access to tokens was unlimited or limited. Chimpanzees easily learned to associate value with the tokens, as expected, and did barter, but followed a simple strategy of favoring the higher-value token, regardless of the reward proffered, instead of a more complex but more effective strategy of returning the token that matched the reward. This response is similar to that shown by capuchin monkeys in our previous study. We speculate that this response, while not ideal, may be sufficient to allow for stability of the social exchange system in these primates, and that the importance of social barter to both species may have led to this convergence of strategies.

Learning Reward Uncertainty in the Basal Ganglia

PubMed Central

Bogacz, Rafal

2016-01-01

Learning the reliability of different sources of rewards is critical for making optimal choices. However, despite the existence of detailed theory describing how the expected reward is learned in the basal ganglia, it is not known how reward uncertainty is estimated in these circuits. This paper presents a class of models that encode both the mean reward and the spread of the rewards, the former in the difference between the synaptic weights of D1 and D2 neurons, and the latter in their sum. In the models, the tendency to seek (or avoid) options with variable reward can be controlled by increasing (or decreasing) the tonic level of dopamine. The models are consistent with the physiology of and synaptic plasticity in the basal ganglia, they explain the effects of dopaminergic manipulations on choices involving risks, and they make multiple experimental predictions. PMID:27589489

Using future thinking to reduce temporal discounting: Under what circumstances are the medial temporal lobes critical?

PubMed

Palombo, D J; Keane, M M; Verfaellie, M

2016-08-01

The capacity to envision the future plays an important role in many aspects of cognition, including our ability to make optimal, adaptive choices. Past work has shown that the medial temporal lobe (MTL) is necessary for decisions that draw on episodic future thinking. By contrast, little is known about the role of the MTL in decisions that draw on semantic future thinking. Accordingly, the present study investigated whether the MTL contributes to one form of decision making, namely intertemporal choice, when such decisions depend on semantic consideration of the future. In an intertemporal choice task, participants must select either a smaller amount of money that is available in the present or a larger amount of money that would be available at a future date. Amnesic individuals with MTL damage and healthy control participants performed such a task in which, prior to making a choice, they engaged in a semantic generation exercise, wherein they generated items that they would purchase with the future reward. In experiment 1, we found that, relative to a baseline condition involving standard intertemporal choice, healthy individuals were more inclined to select a larger, later reward over a smaller, present reward after engaging in semantic future thinking. By contrast, amnesic participants were paradoxically less inclined to wait for a future reward following semantic future thinking. This finding suggests that amnesics may have had difficulty "tagging" the generated item(s) as belonging to the future. Critically, experiment 2 showed that when the generated items were presented alongside the intertemporal choices, both controls and amnesic participants shifted to more patient choices. These findings suggest that the MTL is not needed for making optimal decisions that draw on semantic future thinking as long as scaffolding is provided to support accurate time tagging. Together, these findings stand to better clarify the role of the MTL in decision making. Published by Elsevier Ltd.

Reward inference by primate prefrontal and striatal neurons.

PubMed

Pan, Xiaochuan; Fan, Hongwei; Sawa, Kosuke; Tsuda, Ichiro; Tsukada, Minoru; Sakagami, Masamichi

2014-01-22

The brain contains multiple yet distinct systems involved in reward prediction. To understand the nature of these processes, we recorded single-unit activity from the lateral prefrontal cortex (LPFC) and the striatum in monkeys performing a reward inference task using an asymmetric reward schedule. We found that neurons both in the LPFC and in the striatum predicted reward values for stimuli that had been previously well experienced with set reward quantities in the asymmetric reward task. Importantly, these LPFC neurons could predict the reward value of a stimulus using transitive inference even when the monkeys had not yet learned the stimulus-reward association directly; whereas these striatal neurons did not show such an ability. Nevertheless, because there were two set amounts of reward (large and small), the selected striatal neurons were able to exclusively infer the reward value (e.g., large) of one novel stimulus from a pair after directly experiencing the alternative stimulus with the other reward value (e.g., small). Our results suggest that although neurons that predict reward value for old stimuli in the LPFC could also do so for new stimuli via transitive inference, those in the striatum could only predict reward for new stimuli via exclusive inference. Moreover, the striatum showed more complex functions than was surmised previously for model-free learning.

Reward Inference by Primate Prefrontal and Striatal Neurons

PubMed Central

Pan, Xiaochuan; Fan, Hongwei; Sawa, Kosuke; Tsuda, Ichiro; Tsukada, Minoru

2014-01-01

The brain contains multiple yet distinct systems involved in reward prediction. To understand the nature of these processes, we recorded single-unit activity from the lateral prefrontal cortex (LPFC) and the striatum in monkeys performing a reward inference task using an asymmetric reward schedule. We found that neurons both in the LPFC and in the striatum predicted reward values for stimuli that had been previously well experienced with set reward quantities in the asymmetric reward task. Importantly, these LPFC neurons could predict the reward value of a stimulus using transitive inference even when the monkeys had not yet learned the stimulus–reward association directly; whereas these striatal neurons did not show such an ability. Nevertheless, because there were two set amounts of reward (large and small), the selected striatal neurons were able to exclusively infer the reward value (e.g., large) of one novel stimulus from a pair after directly experiencing the alternative stimulus with the other reward value (e.g., small). Our results suggest that although neurons that predict reward value for old stimuli in the LPFC could also do so for new stimuli via transitive inference, those in the striatum could only predict reward for new stimuli via exclusive inference. Moreover, the striatum showed more complex functions than was surmised previously for model-free learning. PMID:24453328

Willing to Wait: Elevated Reward-Processing EEG Activity Associated with a Greater Preference for Larger-But-Delayed Rewards

PubMed Central

Pornpattananangkul, Narun; Nusslock, Robin

2016-01-01

While almost everyone discounts the value of future rewards over immediate rewards, people differ in their so-called delay-discounting. One of the several factors that may explain individual differences in delay-discounting is reward-processing. To study individual-differences in reward-processing, however, one needs to consider the heterogeneity of neural-activity at each reward-processing stage. Here using EEG, we separated reward-related neural activity into distinct reward-anticipation and reward-outcome stages using time-frequency characteristics. Thirty-seven individuals completed a behavioral delay-discounting task. Reward-processing EEG activity was assessed using a separate reward-learning task, called a reward time-estimation task. During this task, participants were instructed to estimate time duration and were provided performance feedback on a trial-by-trial basis. Participants received monetary-reward for accurate-performance on Reward trials, but not on No-Reward trials. Reward trials, relative to No-Reward trials, enhanced EEG activity during both reward-anticipation stage (including, cued-locked delta power during cue-evaluation and pre-feedback alpha suppression during feedback-anticipation) and at the reward-outcome stage (including, feedback-locked delta, theta and beta power). Moreover, all of these EEG indices correlated with behavioral performance in the time-estimation task, suggesting their essential roles in learning and adjusting performance to maximize winnings in a reward-learning situation. Importantly, enhanced EEG power during Reward trials for 1) pre-feedback alpha suppression, 2) feedback-locked theta and 3) feedback-locked beta was associated with a greater preference for larger-but-delayed rewards. Results highlight the association between a stronger preference toward larger-but-delayed rewards and enhanced reward-processing. Moreover, our reward-processing EEG indices detail the specific stages of reward-processing where these associations occur. PMID:27477630

Working memory accuracy for multiple targets is driven by reward expectation and stimulus contrast with different time-courses.

PubMed

Klink, P Christiaan; Jeurissen, Danique; Theeuwes, Jan; Denys, Damiaan; Roelfsema, Pieter R

2017-08-22

The richness of sensory input dictates that the brain must prioritize and select information for further processing and storage in working memory. Stimulus salience and reward expectations influence this prioritization but their relative contributions and underlying mechanisms are poorly understood. Here we investigate how the quality of working memory for multiple stimuli is determined by priority during encoding and later memory phases. Selective attention could, for instance, act as the primary gating mechanism when stimuli are still visible. Alternatively, observers might still be able to shift priorities across memories during maintenance or retrieval. To distinguish between these possibilities, we investigated how and when reward cues determine working memory accuracy and found that they were only effective during memory encoding. Previously learned, but currently non-predictive, color-reward associations had a similar influence, which gradually weakened without reinforcement. Finally, we show that bottom-up salience, manipulated through varying stimulus contrast, influences memory accuracy during encoding with a fundamentally different time-course than top-down reward cues. While reward-based effects required long stimulus presentation, the influence of contrast was strongest with brief presentations. Our results demonstrate how memory resources are distributed over memory targets and implicates selective attention as a main gating mechanism between sensory and memory systems.

Emotional arousal and discount rate in intertemporal choice are reference dependent.

PubMed

Lempert, Karolina M; Glimcher, Paul W; Phelps, Elizabeth A

2015-04-01

Many decisions involve weighing immediate gratification against future consequences. In such intertemporal choices, people often choose smaller, immediate rewards over larger delayed rewards. It has been proposed that emotional responses to immediate rewards lead us to choose them at our long-term expense. Here we utilize an objective measure of emotional arousal-pupil dilation-to examine the role of emotion in these decisions. We show that emotional arousal responses, as well as choices, in intertemporal choice tasks are reference-dependent and reflect the decision-maker's recent history of offers. Arousal increases when less predictable rewards are better than expected, whether those rewards are immediate or delayed. Furthermore, when immediate rewards are less predictable than delayed rewards, participants tend to be patient. When delayed rewards are less predictable, immediate rewards are preferred. Our findings suggest that we can encourage people to be more patient by changing the context in which intertemporal choices are made. (c) 2015 APA, all rights reserved).

Older Adult Spouses with Multiple Chronic Conditions: Challenges, Rewards, and Coping Strategies.

PubMed

Peacock, Shelley; Sethi, Bharati; Williams, Allison; Duggleby, Wendy; Bayly, Melanie; Swindle, Jenny; Ploeg, Jenny; Markle-Reid, Maureen

2017-06-01

There is a paucity of research exploring how spouses to older adults with multiple chronic conditions make meaning of their caregiving experience. For this study, we asked: What is the experience of spousal caregivers to persons with multiple chronic conditions? We applied Thorne's interpretive description approach, interviewing 18 spouses who provided a rich description of their caregiving experience; interviews were transcribed verbatim and thematically analysed. Themes were categorized according to challenges encountered, rewards gleaned, and sustaining strategies employed by participants in caregiving to their spouse with multiple chronic conditions. Unique findings relate to the challenges inherent in decision-making within the context of multiple chronic conditions. This article begins to address the gap in the literature regarding the caregiving experience within the context of multiple chronic conditions.

Real and hypothetical monetary rewards modulate risk taking in the brain.

PubMed

Xu, Sihua; Pan, Yu; Wang, You; Spaeth, Andrea M; Qu, Zhe; Rao, Hengyi

2016-07-07

Both real and hypothetical monetary rewards are widely used as reinforcers in risk taking and decision making studies. However, whether real and hypothetical monetary rewards modulate risk taking and decision making in the same manner remains controversial. In this study, we used event-related potentials (ERP) with a balloon analogue risk task (BART) paradigm to examine the effects of real and hypothetical monetary rewards on risk taking in the brain. Behavioral data showed reduced risk taking after negative feedback (money loss) during the BART with real rewards compared to those with hypothetical rewards, suggesting increased loss aversion with real monetary rewards. The ERP data demonstrated a larger feedback-related negativity (FRN) in response to money loss during risk taking with real rewards compared to those with hypothetical rewards, which may reflect greater prediction error or regret emotion after real monetary losses. These findings demonstrate differential effects of real versus hypothetical monetary rewards on risk taking behavior and brain activity, suggesting a caution when drawing conclusions about real choices from hypothetical studies of intended behavior, especially when large rewards are used. The results have implications for future utility of real and hypothetical monetary rewards in studies of risk taking and decision making.

Reward-centricity and attenuated aversions: An adolescent phenotype emerging from studies in laboratory animals

PubMed Central

Doremus-Fitzwater, Tamara L.; Spear, Linda P.

2016-01-01

Adolescence is an evolutionarily conserved developmental period, with neural circuits and behaviors contributing to the detection, procurement, and receipt of rewards bearing similarity across species. Studies with laboratory animals suggest that adolescence is typified by a “reward-centric” phenotype—an increased sensitivity to rewards relative to adults. In contrast, adolescent rodents are reportedly less sensitive to the aversive properties of many drugs and naturally aversive stimuli. Alterations within the mesocorticolimbic dopamine and endocannabinoid systems likely contribute to an adolescent reward-sensitive, yet aversion-resistant, phenotype. Although early hypotheses postulated that developmental changes in dopaminergic circuitry would result in a “reward deficiency” syndrome, evidence now suggests the opposite: that adolescents are uniquely poised to seek out hedonic stimuli, experience greater “pleasure” from rewards, and consume rewarding stimuli in excess. Future studies that more clearly define the role of specific brain regions and neurotransmitter systems in the expression of behaviors toward reward- and aversive-related cues and stimuli are necessary to more fully understand an adolescent-proclivity for and vulnerability to rewards and drugs of potential abuse. PMID:27524639

Reward-centricity and attenuated aversions: An adolescent phenotype emerging from studies in laboratory animals.

PubMed

Doremus-Fitzwater, Tamara L; Spear, Linda P

2016-11-01

Adolescence is an evolutionarily conserved developmental period, with neural circuits and behaviors contributing to the detection, procurement, and receipt of rewards bearing similarity across species. Studies with laboratory animals suggest that adolescence is typified by a "reward-centric" phenotype-an increased sensitivity to rewards relative to adults. In contrast, adolescent rodents are reportedly less sensitive to the aversive properties of many drugs and naturally aversive stimuli. Alterations within the mesocorticolimbic dopamine and endocannabinoid systems likely contribute to an adolescent reward-sensitive, yet aversion-resistant, phenotype. Although early hypotheses postulated that developmental changes in dopaminergic circuitry would result in a "reward deficiency" syndrome, evidence now suggests the opposite: that adolescents are uniquely poised to seek out hedonic stimuli, experience greater "pleasure" from rewards, and consume rewarding stimuli in excess. Future studies that more clearly define the role of specific brain regions and neurotransmitter systems in the expression of behaviors toward reward- and aversive-related cues and stimuli are necessary to more fully understand an adolescent-proclivity for and vulnerability to rewards and drugs of potential abuse. Copyright © 2016 Elsevier Ltd. All rights reserved.

The alcoholic brain: neural bases of impaired reward-based decision-making in alcohol use disorders.

PubMed

Galandra, Caterina; Basso, Gianpaolo; Cappa, Stefano; Canessa, Nicola

2018-03-01

Neuroeconomics is providing insights into the neural bases of decision-making in normal and pathological conditions. In the neuropsychiatric domain, this discipline investigates how abnormal functioning of neural systems associated with reward processing and cognitive control promotes different disorders, and whether such evidence may inform treatments. This endeavor is crucial when studying different types of addiction, which share a core promoting mechanism in the imbalance between impulsive subcortical neural signals associated with immediate pleasurable outcomes and inhibitory signals mediated by a prefrontal reflective system. The resulting impairment in behavioral control represents a hallmark of alcohol use disorders (AUDs), a chronic relapsing disorder characterized by excessive alcohol consumption despite devastating consequences. This review aims to summarize available magnetic resonance imaging (MRI) evidence on reward-related decision-making alterations in AUDs, and to envision possible future research directions. We review functional MRI (fMRI) studies using tasks involving monetary rewards, as well as MRI studies relating decision-making parameters to neurostructural gray- or white-matter metrics. The available data suggest that excessive alcohol exposure affects neural signaling within brain networks underlying adaptive behavioral learning via the implementation of prediction errors. Namely, weaker ventromedial prefrontal cortex activity and altered connectivity between ventral striatum and dorsolateral prefrontal cortex likely underpin a shift from goal-directed to habitual actions which, in turn, might underpin compulsive alcohol consumption and relapsing episodes despite adverse consequences. Overall, these data highlight abnormal fronto-striatal connectivity as a candidate neurobiological marker of impaired choice in AUDs. Further studies are needed, however, to unveil its implications in the multiple facets of decision-making.

I want to media multitask and I want to do it now: Individual differences in media multitasking predict delay of gratification and system-1 thinking.

PubMed

Schutten, Dan; Stokes, Kirk A; Arnell, Karen M

2017-01-01

Media multitasking, the concurrent use of multiple media forms, has been shown to be related to greater self-reported impulsivity and less self-control. These measures are both hallmarks of the need for immediate gratification which has been associated with fast, intuitive 'system-1' decision making, as opposed to more deliberate and effortful 'system-2' decision making. In Study 1, we used the Cognitive Reflection Task (CRT) to examine whether individuals who engage heavily in media multitasking differ from those who are light media multitaskers in their degree of system-1 versus system-2 thinking. In Study 2 we examined whether heavy and light media multitaskers differ in delay of gratification, using the delay discounting measure which estimates the preference for smaller immediate rewards, relative to larger delayed rewards in a hypothetical monetary choice task. We found that heavy media multitaskers were more likely than light media multitaskers to endorse intuitive, but wrong, decisions on the CRT indicating a greater reliance on 'system-1' thinking. Heavy media multitaskers were also willing to settle for less money immediately relative to light media multitaskers who were more willing to wait for the larger delayed reward. These results suggest that heavy media multitaskers have a reactive decision-making style that promotes current desires (money, ease of processing) at the expense of accuracy and future rewards. These findings highlight the potential for heavy media multitaskers to be at risk for problematic behaviors associated with delay discounting - behaviors such as substance abuse, overeating, problematic gambling, and poor financial management.

Lateral habenula neurons signal errors in the prediction of reward information

PubMed Central

Bromberg-Martin, Ethan S.; Hikosaka, Okihide

2011-01-01

Humans and animals have a remarkable ability to predict future events, which they achieve by persistently searching their environment for sources of predictive information. Yet little is known about the neural systems that motivate this behavior. We hypothesized that information-seeking is assigned value by the same circuits that support reward-seeking, so that neural signals encoding conventional “reward prediction errors” include analogous “information prediction errors”. To test this we recorded from neurons in the lateral habenula, a nucleus which encodes reward prediction errors, while monkeys chose between cues that provided different amounts of information about upcoming rewards. We found that a subpopulation of lateral habenula neurons transmitted signals resembling information prediction errors, responding when reward information was unexpectedly cued, delivered, or denied. Their signals evaluated information sources reliably even when the animal’s decisions did not. These neurons could provide a common instructive signal for reward-seeking and information-seeking behavior. PMID:21857659

Modulation of value representation by social context in the primate orbitofrontal cortex.

PubMed

Azzi, João C B; Sirigu, Angela; Duhamel, Jean-René

2012-02-07

Primates depend for their survival on their ability to understand their social environment, and their behavior is often shaped by social circumstances. We report that the orbitofrontal cortex, a brain region involved in motivation and reward, is tuned to social information. Macaque monkeys worked to collect rewards for themselves and two monkey partners. Behaviorally, monkeys discriminated between cues signaling large and small [corrected] rewards, and between cues signaling rewards to self only and reward to both self and another monkey, with a preference for the former over the latter in both instances. Single neurons recorded during this task encoded the meaning of visual cues that predicted the magnitude of future rewards, as well as the motivational value of rewards obtained in a social context. Furthermore, neuronal activity was found to track momentary social preferences and partner's identity and social rank. The orbitofrontal cortex thus contains key neuronal mechanisms for the evaluation of social information.

A Positive Affective Neuroendocrinology Approach to Reward and Behavioral Dysregulation

PubMed Central

Welker, Keith M.; Gruber, June; Mehta, Pranjal H.

2015-01-01

Emerging lines of research suggest that both testosterone and maladaptive reward processing can modulate behavioral dysregulation. Yet, to date, no integrative account has been provided that systematically explains neuroendocrine function, dysregulation of reward, and behavioral dysregulation in a unified perspective. This is particularly important given specific neuroendocrine systems are potential mechanisms underlying and giving rise to reward-relevant behaviors. In this review, we propose a forward-thinking approach to study the mechanisms of reward and behavioral dysregulation from a positive affective neuroendocrinology (PANE) perspective. This approach holds that testosterone increases reward processing and motivation, which increase the likelihood of behavioral dysregulation. Additionally, the PANE framework holds that reward processing mediates the effects of testosterone on behavioral dysregulation. We also explore sources of potential sex differences and the roles of age, cortisol, and individual differences within the PANE framework. Finally, we discuss future prospects for research questions and methodology in the emerging field of affective neuroendocrinology. PMID:26191007

Food Approach and Food Avoidance in Young Children: Relation with Reward Sensitivity and Punishment Sensitivity

PubMed Central

Vandeweghe, Laura; Vervoort, Leentje; Verbeken, Sandra; Moens, Ellen; Braet, Caroline

2016-01-01

It has recently been suggested that individual differences in Reward Sensitivity and Punishment Sensitivity may determine how children respond to food. These temperamental traits reflect activity in two basic brain systems that respond to rewarding and punishing stimuli, respectively, with approach and avoidance. Via parent-report questionnaires, we investigate the associations of the general motivational temperamental traits Reward Sensitivity and Punishment Sensitivity with Food Approach and Food Avoidance in 98 preschool children. Consistent with the conceptualization of Reward Sensitivity in terms of approach behavior and Punishment Sensitivity in terms of avoidance behavior, Reward Sensitivity was positively related to Food Approach, while Punishment Sensitivity was positively related to Food Avoidance. Future research should integrate these perspectives (i.e., general temperamental traits Reward Sensitivity and Punishment Sensitivity, and Food Approach and Avoidance) to get a better understanding of eating behavior and related body weight. PMID:27445898

Lighting up the brain's reward circuitry.

PubMed

Lobo, Mary Kay

2012-07-01

The brain's reward circuit is critical for mediating natural reward behaviors including food, sex, and social interaction. Drugs of abuse take over this circuit and produce persistent molecular and cellular alterations in the brain regions and their neural circuitry that make up the reward pathway. Recent use of optogenetic technologies has provided novel insights into the functional and molecular role of the circuitry and cell subtypes within these circuits that constitute this pathway. This perspective will address the current and future use of light-activated proteins, including those involved in modulating neuronal activity, cellular signaling, and molecular properties in the neural circuitry mediating rewarding stimuli and maladaptive responses to drugs of abuse. © 2012 New York Academy of Sciences.

The Medial Temporal Lobes are Critical for Reward-Based Decision Making under Conditions that Promote Episodic Future Thinking

PubMed Central

Palombo, Daniela J.; Keane, Margaret M.; Verfaellie, Mieke

2014-01-01

In the present study, we investigated the effect of medial temporal lobe (MTL) damage on human decision making in the context of reward-based intertemporal choice. During intertemporal choice, humans typically devalue (or discount) a future reward to account for its delayed arrival (e.g., preferring $30 now over $42 in 2 months), but this effect is attenuated when participants engage in episodic future thinking, i.e., project themselves into the future to imagine a specific event. We hypothesized that this attenuation would be selectively impaired in amnesic patients, who have deficits in episodic future thinking. Replicating previous work, in a standard intertemporal choice task, amnesic patients showed temporal discounting indices similar to healthy controls. Consistent with our hypothesis, while healthy controls demonstrated attenuated temporal discounting in a condition that required participants first to engage in episodic future thinking (e.g., to imagine spending $42 at a theatre in 2 months), amnesic patients failed to demonstrate this effect. Moreover, as expected, amnesic patients’ narratives were less episodically rich than those of controls. These findings extend the range of tasks that are shown to be MTL dependent to include not only memory-based decision-making tasks but also future-oriented ones. PMID:25284804

High monetary reward rates and caloric rewards decrease temporal persistence

PubMed Central

Bode, Stefan; Murawski, Carsten

2017-01-01

Temporal persistence refers to an individual's capacity to wait for future rewards, while forgoing possible alternatives. This requires a trade-off between the potential value of delayed rewards and opportunity costs, and is relevant to many real-world decisions, such as dieting. Theoretical models have previously suggested that high monetary reward rates, or positive energy balance, may result in decreased temporal persistence. In our study, 50 fasted participants engaged in a temporal persistence task, incentivised with monetary rewards. In alternating blocks of this task, rewards were delivered at delays drawn randomly from distributions with either a lower or higher maximum reward rate. During some blocks participants received either a caloric drink or water. We used survival analysis to estimate participants' probability of quitting conditional on the delay distribution and the consumed liquid. Participants had a higher probability of quitting in blocks with the higher reward rate. Furthermore, participants who consumed the caloric drink had a higher probability of quitting than those who consumed water. Our results support the predictions from the theoretical models, and importantly, suggest that both higher monetary reward rates and physiologically relevant rewards can decrease temporal persistence, which is a crucial determinant for survival in many species. PMID:28228517

High monetary reward rates and caloric rewards decrease temporal persistence.

PubMed

Fung, Bowen J; Bode, Stefan; Murawski, Carsten

2017-02-22

Temporal persistence refers to an individual's capacity to wait for future rewards, while forgoing possible alternatives. This requires a trade-off between the potential value of delayed rewards and opportunity costs, and is relevant to many real-world decisions, such as dieting. Theoretical models have previously suggested that high monetary reward rates, or positive energy balance, may result in decreased temporal persistence. In our study, 50 fasted participants engaged in a temporal persistence task, incentivised with monetary rewards. In alternating blocks of this task, rewards were delivered at delays drawn randomly from distributions with either a lower or higher maximum reward rate. During some blocks participants received either a caloric drink or water. We used survival analysis to estimate participants' probability of quitting conditional on the delay distribution and the consumed liquid. Participants had a higher probability of quitting in blocks with the higher reward rate. Furthermore, participants who consumed the caloric drink had a higher probability of quitting than those who consumed water. Our results support the predictions from the theoretical models, and importantly, suggest that both higher monetary reward rates and physiologically relevant rewards can decrease temporal persistence, which is a crucial determinant for survival in many species. © 2017 The Authors.

Depression in high voltage power line workers.

PubMed

de Souza, Suerda Fortaleza; Carvalho, Fernando Martins; de Araújo, Tânia Maria; Koifman, Sergio; Porto, Lauro Antonio

2012-06-01

To investigate the association between effort-reward imbalance and depressive symptoms among workers in high voltage power lines. A cross-sectional study among 158 workers from an electric power company in Northeast Brazil. The main independent variables were the Effort-Reward Imbalance Model (ERI) dimensions and the main dependent variable was the prevalence of depression, as measured by the Center for Epidemiologic Studies Depression (CES-D) scale. Data were analyzed by multiple logistic regression techniques. The group of low reward workers presented a depression prevalence rate 6.2 times greater than those in the high reward group. The depression prevalence rate was 3.3 greater in workers in the situation of imbalanced effort-reward than in those in effort-reward equilibrium. The prevalence of depression was strongly associated with psychosocial factors present in the work of electricity workers.

Real and hypothetical rewards

PubMed Central

Locey, Matthew L.; Jones, Bryan A.; Rachlin, Howard

2012-01-01

Laboratory studies of choice and decision making among real monetary rewards typically use smaller real rewards than those common in real life. When laboratory rewards are large, they are almost always hypothetical. In applying laboratory results meaningfully to real-life situations, it is important to know the extent to which choices among hypothetical rewards correspond to choices among real rewards and whether variation of the magnitude of hypothetical rewards affects behavior in meaningful ways. The present study compared real and hypothetical monetary rewards in two experiments. In Experiment 1, participants played a temporal discounting game that incorporates the logic of a repeated prisoner’s-dilemma (PD) type game versus tit-for-tat; choice of one alternative (“defection” in PD terminology) resulted in a small-immediate reward; choice of the other alternative (“cooperation” in PD terminology) resulted in a larger reward delayed until the following trial. The larger-delayed reward was greater for half of the groups than for the other half. Rewards also differed in type across groups: multiples of real nickels, hypothetical nickels or hypothetical hundred-dollar bills. All groups significantly increased choice of the larger delayed reward over the 40 trials of the experiment. Over the last 10 trials, cooperation was significantly higher when the difference between larger and smaller hypothetical rewards was greater. Reward type (real or hypothetical) made no significant difference in cooperation. In Experiment 2, real and hypothetical rewards were compared in social discounting – the decrease in value to the giver of a reward as social distance increases to the receiver of the reward. Social discount rates were well described by a hyperbolic function. Discounting rates for real and hypothetical rewards did not significantly differ. These results add to the evidence that results of experiments with hypothetical rewards validly apply in everyday life. PMID:22582110

The Differential Effects of Reward on Space- and Object-Based Attentional Allocation

PubMed Central

Shomstein, Sarah

2013-01-01

Estimating reward contingencies and allocating attentional resources to a subset of relevant information are the most important contributors to increasing adaptability of an organism. Although recent evidence suggests that reward- and attention-based guidance recruits overlapping cortical regions and has similar effects on sensory responses, the exact nature of the relationship between the two remains elusive. Here, using event-related fMRI on human participants, we contrasted the effects of reward on space- and object-based selection in the same experimental setting. Reward was either distributed randomly or biased a particular object. Behavioral and neuroimaging results show that space- and object-based attention is influenced by reward differentially. Space-based attentional allocation is mandatory, integrating reward information over time, whereas object-based attentional allocation is a default setting that is completely replaced by the reward signal. Nonadditivity of the effects of reward and object-based attention was observed consistently at multiple levels of analysis in early visual areas as well as in control regions. These results provide strong evidence that space- and object-based allocation are two independent attentional mechanisms, and suggest that reward serves to constrain attentional selection. PMID:23804086

Pervasive competition between threat and reward in the brain

PubMed Central

Choi, Jong Moon; Padmala, Srikanth; Spechler, Philip

2014-01-01

In the current functional MRI study, we investigated interactions between reward and threat processing. Visual cues at the start of each trial informed participants about the chance of winning monetary reward and/or receiving a mild aversive shock. We tested two competing hypothesis: according to the ‘salience hypothesis’, in the condition involving both reward and threat, enhanced activation would be observed because of increased salience; according to the ‘competition hypothesis’, the processing of reward and threat would trade-off against each other, leading to reduced activation. Analysis of skin conductance data during a delay phase revealed an interaction between reward and threat processing, such that the effect of reward was reduced during threat and the effect of threat was reduced during reward. Analysis of imaging data during the same task phase revealed interactions between reward and threat processing in several regions, including the midbrain/ventral tegmental area, caudate, putamen, bed nucleus of the stria terminalis, anterior insula, middle frontal gyrus and dorsal anterior cingulate cortex. Taken together, our findings reveal conditions during which reward and threat trade-off against each other across multiple sites. Such interactions are suggestive of competitive processes and may reflect the organization of opponent systems in the brain. PMID:23547242

Reward modulates oculomotor competition between differently valued stimuli.

PubMed

Bucker, Berno; Silvis, Jeroen D; Donk, Mieke; Theeuwes, Jan

2015-03-01

The present work explored the effects of reward in the well-known global effect paradigm in which two objects appear simultaneously in close spatial proximity. The experiment consisted of three phases (i) a pre-training phase that served as a baseline, (ii) a reward-training phase to associate differently colored stimuli with high, low and no reward value, and (iii) a post-training phase in which rewards were no longer delivered, to examine whether objects previously associated with higher reward value attracted the eyes more strongly than those associated with low or no reward value. Unlike previous reward studies, the differently valued objects directly competed with each other on the same trial. The results showed that initially eye movements were not biased towards any particular stimulus, while in the reward-training phase, eye movements started to land progressively closer towards stimuli that were associated with a high reward value. Even though rewards were no longer delivered, this bias remained robustly present in the post-training phase. A time course analysis showed that the effect of reward was present for the fastest saccades (around 170 ms) and increased with increasing latency. Although strategic effects for slower saccades cannot be ruled out, we suggest that fast oculomotor responses became habituated and were no longer under strategic attentional control. Together the results imply that reward affects oculomotor competition in favor of stimuli previously associated high reward, when multiple reward associated objects compete for selection. Copyright © 2015 Elsevier Ltd. All rights reserved.

Modulation of neural activity by reward in medial intraparietal cortex is sensitive to temporal sequence of reward

PubMed Central

Rajalingham, Rishi; Stacey, Richard Greg; Tsoulfas, Georgios

2014-01-01

To restore movements to paralyzed patients, neural prosthetic systems must accurately decode patients' intentions from neural signals. Despite significant advancements, current systems are unable to restore complex movements. Decoding reward-related signals from the medial intraparietal area (MIP) could enhance prosthetic performance. However, the dynamics of reward sensitivity in MIP is not known. Furthermore, reward-related modulation in premotor areas has been attributed to behavioral confounds. Here we investigated the stability of reward encoding in MIP by assessing the effect of reward history on reward sensitivity. We recorded from neurons in MIP while monkeys performed a delayed-reach task under two reward schedules. In the variable schedule, an equal number of small- and large-rewards trials were randomly interleaved. In the constant schedule, one reward size was delivered for a block of trials. The memory period firing rate of most neurons in response to identical rewards varied according to schedule. Using systems identification tools, we attributed the schedule sensitivity to the dependence of neural activity on the history of reward. We did not find schedule-dependent behavioral changes, suggesting that reward modulates neural activity in MIP. Neural discrimination between rewards was less in the variable than in the constant schedule, degrading our ability to decode reach target and reward simultaneously. The effect of schedule was mitigated by adding Haar wavelet coefficients to the decoding model. This raises the possibility of multiple encoding schemes at different timescales and reinforces the potential utility of reward information for prosthetic performance. PMID:25008408

Modulation of neural activity by reward in medial intraparietal cortex is sensitive to temporal sequence of reward.

PubMed

Rajalingham, Rishi; Stacey, Richard Greg; Tsoulfas, Georgios; Musallam, Sam

2014-10-01

To restore movements to paralyzed patients, neural prosthetic systems must accurately decode patients' intentions from neural signals. Despite significant advancements, current systems are unable to restore complex movements. Decoding reward-related signals from the medial intraparietal area (MIP) could enhance prosthetic performance. However, the dynamics of reward sensitivity in MIP is not known. Furthermore, reward-related modulation in premotor areas has been attributed to behavioral confounds. Here we investigated the stability of reward encoding in MIP by assessing the effect of reward history on reward sensitivity. We recorded from neurons in MIP while monkeys performed a delayed-reach task under two reward schedules. In the variable schedule, an equal number of small- and large-rewards trials were randomly interleaved. In the constant schedule, one reward size was delivered for a block of trials. The memory period firing rate of most neurons in response to identical rewards varied according to schedule. Using systems identification tools, we attributed the schedule sensitivity to the dependence of neural activity on the history of reward. We did not find schedule-dependent behavioral changes, suggesting that reward modulates neural activity in MIP. Neural discrimination between rewards was less in the variable than in the constant schedule, degrading our ability to decode reach target and reward simultaneously. The effect of schedule was mitigated by adding Haar wavelet coefficients to the decoding model. This raises the possibility of multiple encoding schemes at different timescales and reinforces the potential utility of reward information for prosthetic performance. Copyright © 2014 the American Physiological Society.

Willing to wait: Elevated reward-processing EEG activity associated with a greater preference for larger-but-delayed rewards.

PubMed

Pornpattananangkul, Narun; Nusslock, Robin

2016-10-01

While almost everyone discounts the value of future rewards over immediate rewards, people differ in their so-called delay-discounting. One of the several factors that may explain individual differences in delay-discounting is reward-processing. To study individual-differences in reward-processing, however, one needs to consider the heterogeneity of neural-activity at each reward-processing stage. Here using EEG, we separated reward-related neural activity into distinct reward-anticipation and reward-outcome stages using time-frequency characteristics. Thirty-seven individuals first completed a behavioral delay-discounting task. Then reward-processing EEG activity was assessed using a separate reward-learning task, called a reward time-estimation task. During this EEG task, participants were instructed to estimate time duration and were provided performance feedback on a trial-by-trial basis. Participants received monetary-reward for accurate-performance on Reward trials, but not on No-Reward trials. Reward trials, relative to No-Reward trials, enhanced EEG activity during both reward-anticipation (including, cued-locked delta power during cue-evaluation and pre-feedback alpha suppression during feedback-anticipation) and reward-outcome (including, feedback-locked delta, theta and beta power) stages. Moreover, all of these EEG indices correlated with behavioral performance in the time-estimation task, suggesting their essential roles in learning and adjusting performance to maximize winnings in a reward-learning situation. Importantly, enhanced EEG power during Reward trials, as reflected by stronger 1) pre-feedback alpha suppression, 2) feedback-locked theta and 3) feedback-locked beta, was associated with a greater preference for larger-but-delayed rewards in a separate, behavioral delay-discounting task. Results highlight the association between a stronger preference toward larger-but-delayed rewards and enhanced reward-processing. Moreover, our reward-processing EEG indices detail the specific stages of reward-processing where these associations occur. Copyright © 2016 Elsevier Ltd. All rights reserved.

Ventromedial Frontal Cortex Is Critical for Guiding Attention to Reward-Predictive Visual Features in Humans.

PubMed

Vaidya, Avinash R; Fellows, Lesley K

2015-09-16

Adaptively interacting with our environment requires extracting information that will allow us to successfully predict reward. This can be a challenge, particularly when there are many candidate cues, and when rewards are probabilistic. Recent work has demonstrated that visual attention is allocated to stimulus features that have been associated with reward on previous trials. The ventromedial frontal lobe (VMF) has been implicated in learning in dynamic environments of this kind, but the mechanism by which this region influences this process is not clear. Here, we hypothesized that the VMF plays a critical role in guiding attention to reward-predictive stimulus features based on feedback. We tested the effects of VMF damage in human subjects on a visual search task in which subjects were primed to attend to task-irrelevant colors associated with different levels of reward, incidental to the search task. Consistent with previous work, we found that distractors had a greater influence on reaction time when they appeared in colors associated with high reward in the previous trial compared with colors associated with low reward in healthy control subjects and patients with prefrontal damage sparing the VMF. However, this reward modulation of attentional priming was absent in patients with VMF damage. Thus, an intact VMF is necessary for directing attention based on experience with cue-reward associations. We suggest that this region plays a role in selecting reward-predictive cues to facilitate future learning. There has been a swell of interest recently in the ventromedial frontal cortex (VMF), a brain region critical to associative learning. However, the underlying mechanism by which this region guides learning is not well understood. Here, we tested the effects of damage to this region in humans on a task in which rewards were linked incidentally to visual features, resulting in trial-by-trial attentional priming. Controls and subjects with prefrontal damage sparing the VMF showed normal reward priming, but VMF-damaged patients did not. This work sheds light on a potential mechanism through which this region influences behavior. We suggest that the VMF is necessary for directing attention to reward-predictive visual features based on feedback, facilitating future learning and decision-making. Copyright © 2015 the authors 0270-6474/15/3512813-11$15.00/0.

Ventral Striatum Functional Connectivity as a Predictor of Adolescent Depressive Disorder in a Longitudinal Community-Based Sample.

PubMed

Pan, Pedro Mario; Sato, João R; Salum, Giovanni A; Rohde, Luis A; Gadelha, Ary; Zugman, Andre; Mari, Jair; Jackowski, Andrea; Picon, Felipe; Miguel, Eurípedes C; Pine, Daniel S; Leibenluft, Ellen; Bressan, Rodrigo A; Stringaris, Argyris

2017-11-01

Previous studies have implicated aberrant reward processing in the pathogenesis of adolescent depression. However, no study has used functional connectivity within a distributed reward network, assessed using resting-state functional MRI (fMRI), to predict the onset of depression in adolescents. This study used reward network-based functional connectivity at baseline to predict depressive disorder at follow-up in a community sample of adolescents. A total of 637 children 6-12 years old underwent resting-state fMRI. Discovery and replication analyses tested intrinsic functional connectivity (iFC) among nodes of a putative reward network. Logistic regression tested whether striatal node strength, a measure of reward-related iFC, predicted onset of a depressive disorder at 3-year follow-up. Further analyses investigated the specificity of this prediction. Increased left ventral striatum node strength predicted increased risk for future depressive disorder (odds ratio=1.54, 95% CI=1.09-2.18), even after excluding participants who had depressive disorders at baseline (odds ratio=1.52, 95% CI=1.05-2.20). Among 11 reward-network nodes, only the left ventral striatum significantly predicted depression. Striatal node strength did not predict other common adolescent psychopathology, such as anxiety, attention deficit hyperactivity disorder, and substance use. Aberrant ventral striatum functional connectivity specifically predicts future risk for depressive disorder. This finding further emphasizes the need to understand how brain reward networks contribute to youth depression.

Effects of alexithymia and empathy on the neural processing of social and monetary rewards.

PubMed

Goerlich, Katharina Sophia; Votinov, Mikhail; Lammertz, Sarah E; Winkler, Lina; Spreckelmeyer, Katja N; Habel, Ute; Gründer, Gerhard; Gossen, Anna

2017-07-01

Empathy has been found to affect the neural processing of social and monetary rewards. Alexithymia, a subclinical condition showing a close inverse relationship with empathy is linked to dysfunctions of socio-emotional processing in the brain. Whether alexithymia alters the neural processing of rewards, which is currently unknown. Here, we investigated the influence of both alexithymia and empathy on reward processing using a social incentive delay (SID) task and a monetary incentive delay (MID) task in 45 healthy men undergoing functional magnetic resonance imaging. Controlling for temperament-character dimensions and rejection sensitivity, the relationship of alexithymia and empathy with neural activity in several a priori regions of interest (ROIs) was examined by means of partial correlations, while participants anticipated and received social and monetary rewards. Results were considered significant if they survived Holm-Bonferroni correction for multiple comparisons. Alexithymia modulated neural activity in several ROIs of the emotion and reward network, both during the anticipation of social and monetary rewards and in response to the receipt of monetary rewards. In contrast, empathy did not affect reward anticipation and modulated ROI activity only in response to the receipt of social rewards. These results indicate a significant influence of alexithymia on the processing of social and monetary rewards in the healthy brain.

Apes produce tools for future use.

PubMed

Bräuer, Juliane; Call, Josep

2015-03-01

There is now growing evidence that some animal species are able to plan for the future. For example great apes save and exchange tools for future use. Here we raise the question whether chimpanzees, orangutans, and bonobos would produce tools for future use. Subjects only had access to a baited apparatus for a limited duration and therefore should use the time preceding this access to create the appropriate tools in order to get the rewards. The apes were tested in three conditions depending on the need for pre-prepared tools. Either eight tools, one tool or no tools were needed to retrieve the reward. The apes prepared tools in advance for future use and they produced them mainly in conditions when they were really needed. The fact that apes were able to solve this new task indicates that their planning skills are flexible. However, for the condition in which eight tools were needed, apes produced less than two tools per trial in advance. However, they used their chance to produce additional tools in the tool use phase-thus often obtaining most of the reward from the apparatus. Increased pressure to prepare more tools in advance did not have an effect on their performance. © 2014 Wiley Periodicals, Inc.

Cancer Survivors Who Play Recreational Computer Games: Motivations for Playing and Associations with Beneficial Psychological Outcomes.

PubMed

Comello, Maria Leonora G; Francis, Diane B; Marshall, Laura Heisner; Puglia, Deanna R

2016-08-01

Playing recreational videogames is a common activity, yet little is known about its role in the lives of people who are coping with serious illness. These individuals may experience depression and isolation and may turn to games to help alleviate negative experiences and support well-being. We explored these possibilities in the context of cancer survivors. The study aimed to discover motivations underlying game play and the extent to which motivations are associated with psychological health and well-being. We conducted a cross-sectional online survey of survivors who play recreational games (N = 794). Key variables were motivations and indicators of psychological health, including self-efficacy in cancer communications, resilient coping, and beliefs that one is living a fulfilling and meaningful life (flourishing). Participants were most likely to be motivated to play for stimulation and a sense of accomplishment (intrinsic rewards), followed by development of self, sense of community, and personal affirmation. Multiple regression analyses revealed positive associations between playing for intrinsic rewards and all three psychological health outcomes. Playing for a sense of community was also positively associated with coping and flourishing. Playing recreational videogames, particularly to receive intrinsic rewards and to connect with others, may play a supportive role in the psychological health of survivors. Findings suggest future areas for research and implications for development of serious games.

Caudate responses to reward anticipation associated with delay discounting behavior in healthy youth

PubMed Central

Benningfield, Margaret M.; Blackford, Jennifer U.; Ellsworth, Melissa E.; Samanez-Larkin, Gregory R.; Martin, Peter R.; Cowan, Ronald L.; Zald, David H.

2014-01-01

Background Choices requiring delay of gratification made during adolescence can have significant impact on life trajectory. Willingness to delay gratification can be measured using delay discounting tasks that require a choice between a smaller immediate reward and a larger delayed reward. Individual differences in the subjective value of delayed rewards are associated with risk for development of psychopathology including substance abuse. The neurobiological underpinnings related to these individual differences early in life are not fully understood. Using functional magnetic resonance imaging (fMRI), we tested the hypothesis that individual differences in delay discounting behavior in healthy youth are related to differences in responsiveness to potential reward. Method Nineteen 10 to 14 year-olds performed a monetary incentive delay task to assess neural sensitivity to potential reward and a questionnaire to measure discounting of future monetary rewards. Results Left ventromedial caudate activation during anticipation of potential reward was negatively correlated with delay discounting behavior. There were no regions where brain responses during notification of reward outcome were associated with discounting behavior. Conclusions Brain activation during anticipation of potential reward may serve as a marker for individual differences in ability or willingness to delay gratification in healthy youth. PMID:24309299

What Youth Sees in Business Education

ERIC Educational Resources Information Center

Sellman, Helen

1974-01-01

Business students believe that their courses are preparing them not only for rewarding careers but for rewarding lives--that a better understanding of business and economics will give them a greater opportunity to succeed in their personal lives and in their future roles in society. (Author)

Optimum Sensors Integration for Multi-Sensor Multi-Target Environment for Ballistic Missile Defense Applications

DOE Office of Scientific and Technical Information (OSTI.GOV)

Imam, Neena; Barhen, Jacob; Glover, Charles Wayne

2012-01-01

Multi-sensor networks may face resource limitations in a dynamically evolving multiple target tracking scenario. It is necessary to task the sensors efficiently so that the overall system performance is maximized within the system constraints. The central sensor resource manager may control the sensors to meet objective functions that are formulated to meet system goals such as minimization of track loss, maximization of probability of target detection, and minimization of track error. This paper discusses the variety of techniques that may be utilized to optimize sensor performance for either near term gain or future reward over a longer time horizon.

76 FR 36513 - Notice of Intent to Request New Information Collection

Federal Register 2010, 2011, 2012, 2013, 2014

2011-06-22

... rate. In addition to offering mixed survey modes, the design will integrate multiple and mutually... examples of these design elements: The survey request will be distinguishable from other surveys and will... rewards or nonmonetary rewards. A key component of tailored survey design is considering and balancing how...

Intolerance to Delayed Reward in Girls with Multiple Suicide Attempts

ERIC Educational Resources Information Center

Mathias, Charles W.; Dougherty, Donald M.; James, Lisa M.; Richard, Dawn M.; Dawes, Michael A.; Acheson, Ashley; Hill-Kapturczak, Nathalie

2011-01-01

Impulsivity has been conceptualized as influencing the expression of suicidal behavior. Adolescence is a developmental period characterized both by a relatively high rate of suicide attempts and a high level of impulsivity. The current study examined two behavioral measures (delay reward and disinhibition) and one self-report measure of…

Reward modulates the effect of visual cortical microstimulation on perceptual decisions

PubMed Central

Cicmil, Nela; Cumming, Bruce G; Parker, Andrew J; Krug, Kristine

2015-01-01

Effective perceptual decisions rely upon combining sensory information with knowledge of the rewards available for different choices. However, it is not known where reward signals interact with the multiple stages of the perceptual decision-making pathway and by what mechanisms this may occur. We combined electrical microstimulation of functionally specific groups of neurons in visual area V5/MT with performance-contingent reward manipulation, while monkeys performed a visual discrimination task. Microstimulation was less effective in shifting perceptual choices towards the stimulus preferences of the stimulated neurons when available reward was larger. Psychophysical control experiments showed this result was not explained by a selective change in response strategy on microstimulated trials. A bounded accumulation decision model, applied to analyse behavioural performance, revealed that the interaction of expected reward with microstimulation can be explained if expected reward modulates a sensory representation stage of perceptual decision-making, in addition to the better-known effects at the integration stage. DOI: http://dx.doi.org/10.7554/eLife.07832.001 PMID:26402458

Evidence for a shared representation of sequential cues that engage sign-tracking.

PubMed

Smedley, Elizabeth B; Smith, Kyle S

2018-06-19

Sign-tracking is a phenomenon whereby cues that predict rewards come to acquire their own motivational value (incentive salience) and attract appetitive behavior. Typically, sign-tracking paradigms have used single auditory, visual, or lever cues presented prior to a reward delivery. Yet, real world examples of events often can be predicted by a sequence of cues. We have shown that animals will sign-track to multiple cues presented in temporal sequence, and with time develop a bias in responding toward a reward distal cue over a reward proximal cue. Further, extinction of responding to the reward proximal cue directly decreases responding to the reward distal cue. One possible explanation of this result is that serial cues become representationally linked with one another. Here we provide further support of this by showing that extinction of responding to a reward distal cue directly reduces responding to a reward proximal cue. We suggest that the incentive salience of one cue can influence the incentive salience of the other cue. Copyright © 2018. Published by Elsevier B.V.

Cannabinoid Regulation of Brain Reward Processing with an Emphasis on the Role of CB1 Receptors: A Step Back into the Future.

PubMed

Panagis, George; Mackey, Brian; Vlachou, Styliani

2014-01-01

Over the last decades, the endocannabinoid system has been implicated in a large variety of functions, including a crucial modulation of brain-reward circuits and the regulation of motivational processes. Importantly, behavioral studies have shown that cannabinoid compounds activate brain reward mechanisms and circuits in a similar manner to other drugs of abuse, such as nicotine, alcohol, cocaine, and heroin, although the conditions under which cannabinoids exert their rewarding effects may be more limited. Furthermore, there is evidence on the involvement of the endocannabinoid system in the regulation of cue- and drug-induced relapsing phenomena in animal models. The aim of this review is to briefly present the available data obtained using diverse behavioral experimental approaches in experimental animals, namely, the intracranial self-stimulation paradigm, the self-administration procedure, the conditioned place preference procedure, and the reinstatement of drug-seeking behavior procedure, to provide a comprehensive picture of the current status of what is known about the endocannabinoid system mechanisms that underlie modification of brain-reward processes. Emphasis is placed on the effects of cannabinoid 1 (CB1) receptor agonists, antagonists, and endocannabinoid modulators. Further, the role of CB1 receptors in reward processes is investigated through presentation of respective genetic ablation studies in mice. The vast majority of studies in the existing literature suggest that the endocannabinoid system plays a major role in modulating motivation and reward processes. However, much remains to be done before we fully understand these interactions. Further research in the future will shed more light on these processes and, thus, could lead to the development of potential pharmacotherapies designed to treat reward-dysfunction-related disorders.

State-based versus reward-based motivation in younger and older adults.

PubMed

Worthy, Darrell A; Cooper, Jessica A; Byrne, Kaileigh A; Gorlick, Marissa A; Maddox, W Todd

2014-12-01

Recent decision-making work has focused on a distinction between a habitual, model-free neural system that is motivated toward actions that lead directly to reward and a more computationally demanding goal-directed, model-based system that is motivated toward actions that improve one's future state. In this article, we examine how aging affects motivation toward reward-based versus state-based decision making. Participants performed tasks in which one type of option provided larger immediate rewards but the alternative type of option led to larger rewards on future trials, or improvements in state. We predicted that older adults would show a reduced preference for choices that led to improvements in state and a greater preference for choices that maximized immediate reward. We also predicted that fits from a hybrid reinforcement-learning model would indicate greater model-based strategy use in younger than in older adults. In line with these predictions, older adults selected the options that maximized reward more often than did younger adults in three of the four tasks, and modeling results suggested reduced model-based strategy use. In the task where older adults showed similar behavior to younger adults, our model-fitting results suggested that this was due to the utilization of a win-stay-lose-shift heuristic rather than a more complex model-based strategy. Additionally, within older adults, we found that model-based strategy use was positively correlated with memory measures from our neuropsychological test battery. We suggest that this shift from state-based to reward-based motivation may be due to age related declines in the neural structures needed for more computationally demanding model-based decision making.

Spatial Frequency Discrimination: Effects of Age, Reward, and Practice

PubMed Central

Peters, Judith Carolien

2017-01-01

Social interaction starts with perception of the world around you. This study investigated two fundamental issues regarding the development of discrimination of higher spatial frequencies, which are important building blocks of perception. Firstly, it mapped the typical developmental trajectory of higher spatial frequency discrimination. Secondly, it developed and validated a novel design that could be applied to improve atypically developed vision. Specifically, this study examined the effect of age and reward on task performance, practice effects, and motivation (i.e., number of trials completed) in a higher spatial frequency (reference frequency: 6 cycles per degree) discrimination task. We measured discrimination thresholds in children aged between 7 to 12 years and adults (N = 135). Reward was manipulated by presenting either positive reinforcement or punishment. Results showed a decrease in discrimination thresholds with age, thus revealing that higher spatial frequency discrimination continues to develop after 12 years of age. This development continues longer than previously shown for discrimination of lower spatial frequencies. Moreover, thresholds decreased during the run, indicating that discrimination abilities improved. Reward did not affect performance or improvement. However, in an additional group of 5–6 year-olds (N = 28) punishments resulted in the completion of fewer trials compared to reinforcements. In both reward conditions children aged 5–6 years completed only a fourth or half of the run (64 to 128 out of 254 trials) and were not motivated to continue. The design thus needs further adaptation before it can be applied to this age group. Children aged 7–12 years and adults completed the run, suggesting that the design is successful and motivating for children aged 7–12 years. This study thus presents developmental differences in higher spatial frequency discrimination thresholds. Furthermore, it presents a design that can be used in future developmental studies that require multiple stimulus presentations such as visual perceptual learning. PMID:28135272

Spatial Frequency Discrimination: Effects of Age, Reward, and Practice.

PubMed

van den Boomen, Carlijn; Peters, Judith Carolien

2017-01-01

Social interaction starts with perception of the world around you. This study investigated two fundamental issues regarding the development of discrimination of higher spatial frequencies, which are important building blocks of perception. Firstly, it mapped the typical developmental trajectory of higher spatial frequency discrimination. Secondly, it developed and validated a novel design that could be applied to improve atypically developed vision. Specifically, this study examined the effect of age and reward on task performance, practice effects, and motivation (i.e., number of trials completed) in a higher spatial frequency (reference frequency: 6 cycles per degree) discrimination task. We measured discrimination thresholds in children aged between 7 to 12 years and adults (N = 135). Reward was manipulated by presenting either positive reinforcement or punishment. Results showed a decrease in discrimination thresholds with age, thus revealing that higher spatial frequency discrimination continues to develop after 12 years of age. This development continues longer than previously shown for discrimination of lower spatial frequencies. Moreover, thresholds decreased during the run, indicating that discrimination abilities improved. Reward did not affect performance or improvement. However, in an additional group of 5-6 year-olds (N = 28) punishments resulted in the completion of fewer trials compared to reinforcements. In both reward conditions children aged 5-6 years completed only a fourth or half of the run (64 to 128 out of 254 trials) and were not motivated to continue. The design thus needs further adaptation before it can be applied to this age group. Children aged 7-12 years and adults completed the run, suggesting that the design is successful and motivating for children aged 7-12 years. This study thus presents developmental differences in higher spatial frequency discrimination thresholds. Furthermore, it presents a design that can be used in future developmental studies that require multiple stimulus presentations such as visual perceptual learning.

Reward skewness coding in the insula independent of probability and loss

PubMed Central

Tobler, Philippe N.

2011-01-01

Rewards in the natural environment are rarely predicted with complete certainty. Uncertainty relating to future rewards has typically been defined as the variance of the potential outcomes. However, the asymmetry of predicted reward distributions, known as skewness, constitutes a distinct but neuroscientifically underexplored risk term that may also have an impact on preference. By changing only reward magnitudes, we study skewness processing in equiprobable ternary lotteries involving only gains and constant probabilities, thus excluding probability distortion or loss aversion as mechanisms for skewness preference formation. We show that individual preferences are sensitive to not only the mean and variance but also to the skewness of predicted reward distributions. Using neuroimaging, we show that the insula, a structure previously implicated in the processing of reward-related uncertainty, responds to the skewness of predicted reward distributions. Some insula responses increased in a monotonic fashion with skewness (irrespective of individual skewness preferences), whereas others were similarly elevated to both negative and positive as opposed to no reward skew. These data support the notion that the asymmetry of reward distributions is processed in the brain and, taken together with replicated findings of mean coding in the striatum and variance coding in the cingulate, suggest that the brain codes distinct aspects of reward distributions in a distributed fashion. PMID:21849610

Gorillas (Gorilla gorilla) and orangutans (Pongo pygmaeus) encode relevant problem features in a tool-using task.

PubMed

Mulcahy, Nicholas J; Call, Josep; Dunbar, Robin I M

2005-02-01

Two important elements in problem solving are the abilities to encode relevant task features and to combine multiple actions to achieve the goal. The authors investigated these 2 elements in a task in which gorillas (Gorilla gorilla) and orangutans (Pongo pygmaeus) had to use a tool to retrieve an out-of-reach reward. Subjects were able to select tools of an appropriate length to reach the reward even when the position of the reward and tools were not simultaneously visible. When presented with tools that were too short to retrieve the reward, subjects were more likely to refuse to use them than when tools were the appropriate length. Subjects were proficient at using tools in sequence to retrieve the reward.

Combining Dopaminergic Facilitation with Robot-Assisted Upper Limb Therapy in Stroke Survivors

PubMed Central

Tran, Duc A.; Pajaro-Blazquez, Marta; Daneault, Jean-Francois; Gallegos, Jaime G.; Pons, Jose; Fregni, Felipe; Bonato, Paolo; Zafonte, Ross

2016-01-01

ABSTRACT Despite aggressive conventional therapy, lasting hemiplegia persists in a large percentage of stroke survivors. The aim of this article is to critically review the rationale behind targeting multiple sites along the motor learning network by combining robotic therapy with pharmacotherapy and virtual reality–based reward learning to alleviate upper extremity impairment in stroke survivors. Methods for personalizing pharmacologic facilitation to each individual’s unique biology are also reviewed. At the molecular level, treatment with levodopa was shown to induce long-term potentiation-like and practice-dependent plasticity. Clinically, trials combining conventional therapy with levodopa in stroke survivors yielded statistically significant but clinically unconvincing outcomes because of limited personalization, standardization, and reproducibility. Robotic therapy can induce neuroplasticity by delivering intensive, reproducible, and functionally meaningful interventions that are objective enough for the rigors of research. Robotic therapy also provides an apt platform for virtual reality, which boosts learning by engaging reward circuits. The future of stroke rehabilitation should target distinct molecular, synaptic, and cortical sites through personalized multimodal treatments to maximize motor recovery. PMID:26829074

Toward an Empirical Multidimensional Structure of Anhedonia, Reward Sensitivity, and Positive Emotionality: An Exploratory Factor Analytic Study.

PubMed

Olino, Thomas M; McMakin, Dana L; Forbes, Erika E

2016-11-20

Positive emotionality, anhedonia, and reward sensitivity share motivational and experiential elements of approach motivation and pleasure. Earlier work has examined the interrelationships among these constructs from measures of extraversion. More recently, the Research Domain Criteria introduced the Positive Valence Systems as a primary dimension to better understand psychopathology. However, the suggested measures tapping this construct have not yet been integrated within the structural framework of personality, even at the level of self-report. Thus, this study conducted exploratory factor and exploratory bifactor analyses on 17 different dimensions relevant to approach motivation, spanning anhedonia, behavioral activation system functioning, and positive emotionality. Convergent validity of these dimensions is tested by examining associations with depressive symptoms. Relying on multiple indices of fit, our preferred model included a general factor along with specific factors of affiliation, positive emotion, assertiveness, and pleasure seeking. These factors demonstrated different patterns of association with depressive symptoms. We discuss the plausibility of this model and highlight important future directions for work on the structure of a broad Positive Valence Systems construct. © The Author(s) 2016.

Evaluation of the Social Motivation Hypothesis of Autism: A Systematic Review and Meta-analysis.

PubMed

Clements, Caitlin C; Zoltowski, Alisa R; Yankowitz, Lisa D; Yerys, Benjamin E; Schultz, Robert T; Herrington, John D

2018-06-13

The social motivation hypothesis posits that individuals with autism spectrum disorder (ASD) find social stimuli less rewarding than do people with neurotypical activity. However, functional magnetic resonance imaging (fMRI) studies of reward processing have yielded mixed results. To examine whether individuals with ASD process rewarding stimuli differently than typically developing individuals (controls), whether differences are limited to social rewards, and whether contradictory findings in the literature might be due to sample characteristics. Articles were identified in PubMed, Embase, and PsycINFO from database inception until June 1, 2017. Functional MRI data from these articles were provided by most authors. Publications were included that provided brain activation contrasts between a sample with ASD and controls on a reward task, determined by multiple reviewer consensus. When fMRI data were not provided by authors, multiple reviewers extracted peak coordinates and effect sizes from articles to recreate statistical maps using seed-based d mapping software. Random-effects meta-analyses of responses to social, nonsocial, and restricted interest stimuli, as well as all of these domains together, were performed. Secondary analyses included meta-analyses of wanting and liking, meta-regression with age, and correlations with ASD severity. All procedures were conducted in accordance with Meta-analysis of Observational Studies in Epidemiology guidelines. Brain activation differences between groups with ASD and typically developing controls while processing rewards. All analyses except the domain-general meta-analysis were planned before data collection. The meta-analysis included 13 studies (30 total fMRI contrasts) from 259 individuals with ASD and 246 controls. Autism spectrum disorder was associated with aberrant processing of both social and nonsocial rewards in striatal regions and increased activation in response to restricted interests (social reward, caudate cluster: d = -0.25 [95% CI, -0.41 to -0.08]; nonsocial reward, caudate and anterior cingulate cluster: d = -0.22 [95% CI, -0.42 to -0.02]; restricted interests, caudate and nucleus accumbens cluster: d = 0.42 [95% CI, 0.07 to 0.78]). Individuals with ASD show atypical processing of social and nonsocial rewards. Findings support a broader interpretation of the social motivation hypothesis of ASD whereby general atypical reward processing encompasses social reward, nonsocial reward, and perhaps restricted interests. This meta-analysis also suggests that prior mixed results could be driven by sample age differences, warranting further study of the developmental trajectory for reward processing in ASD.

Cerebellar granule cells encode the expectation of reward

PubMed Central

Wagner, Mark J; Kim, Tony Hyun; Savall, Joan; Schnitzer, Mark J; Luo, Liqun

2017-01-01

The human brain contains ~60 billion cerebellar granule cells1, which outnumber all other neurons combined. Classical theories posit that a large, diverse population of granule cells allows for highly detailed representations of sensorimotor context, enabling downstream Purkinje cells to sense fine contextual changes2–6. Although evidence suggests a role for cerebellum in cognition7–10, granule cells are known to encode only sensory11–13 and motor14 context. Using two-photon calcium imaging in behaving mice, here we show that granule cells convey information about the expectation of reward. Mice initiated voluntary forelimb movements for delayed water reward. Some granule cells responded preferentially to reward or reward omission, whereas others selectively encoded reward anticipation. Reward responses were not restricted to forelimb movement, as a Pavlovian task evoked similar responses. Compared to predictable rewards, unexpected rewards elicited markedly different granule cell activity despite identical stimuli and licking responses. In both tasks, reward signals were widespread throughout multiple cerebellar lobules. Tracking the same granule cells over several days of learning revealed that cells with reward-anticipating responses emerged from those that responded at the start of learning to reward delivery, whereas reward omission responses grew stronger as learning progressed. The discovery of predictive, non-sensorimotor encoding in granule cells is a major departure from current understanding of these neurons and dramatically enriches contextual information available to postsynaptic Purkinje cells, with important implications for cognitive processing in the cerebellum. PMID:28321129

Neural processing of reward in adolescent rodents.

PubMed

Simon, Nicholas W; Moghaddam, Bita

2015-02-01

Immaturities in adolescent reward processing are thought to contribute to poor decision making and increased susceptibility to develop addictive and psychiatric disorders. Very little is known; however, about how the adolescent brain processes reward. The current mechanistic theories of reward processing are derived from adult models. Here we review recent research focused on understanding of how the adolescent brain responds to rewards and reward-associated events. A critical aspect of this work is that age-related differences are evident in neuronal processing of reward-related events across multiple brain regions even when adolescent rats demonstrate behavior similar to adults. These include differences in reward processing between adolescent and adult rats in orbitofrontal cortex and dorsal striatum. Surprisingly, minimal age related differences are observed in ventral striatum, which has been a focal point of developmental studies. We go on to discuss the implications of these differences for behavioral traits affected in adolescence, such as impulsivity, risk-taking, and behavioral flexibility. Collectively, this work suggests that reward-evoked neural activity differs as a function of age and that regions such as the dorsal striatum that are not traditionally associated with affective processing in adults may be critical for reward processing and psychiatric vulnerability in adolescents. Copyright © 2014 The Authors. Published by Elsevier Ltd.. All rights reserved.

Pervasive competition between threat and reward in the brain.

PubMed

Choi, Jong Moon; Padmala, Srikanth; Spechler, Philip; Pessoa, Luiz

2014-06-01

In the current functional MRI study, we investigated interactions between reward and threat processing. Visual cues at the start of each trial informed participants about the chance of winning monetary reward and/or receiving a mild aversive shock. We tested two competing hypothesis: according to the 'salience hypothesis', in the condition involving both reward and threat, enhanced activation would be observed because of increased salience; according to the 'competition hypothesis', the processing of reward and threat would trade-off against each other, leading to reduced activation. Analysis of skin conductance data during a delay phase revealed an interaction between reward and threat processing, such that the effect of reward was reduced during threat and the effect of threat was reduced during reward. Analysis of imaging data during the same task phase revealed interactions between reward and threat processing in several regions, including the midbrain/ventral tegmental area, caudate, putamen, bed nucleus of the stria terminalis, anterior insula, middle frontal gyrus and dorsal anterior cingulate cortex. Taken together, our findings reveal conditions during which reward and threat trade-off against each other across multiple sites. Such interactions are suggestive of competitive processes and may reflect the organization of opponent systems in the brain. © The Author (2013). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Will the "Fixes" Fall Flat? Prospects for Quality Measures and Payment Incentives to Control Healthcare Spending.

PubMed

Hauswald, Erik; Sklar, David

2017-04-01

Payment systems in the US healthcare system have rewarded physicians for services and attempted to control healthcare spending, with rewards and penalties based upon projected goals for future spending. The incorporation of quality goals and alternatives to fee-for-service was introduced to replace the previous system of rewards and penalties. We describe the history of the US healthcare payment system, focusing on Medicare and the efforts to control spending through the Sustainable Growth Rate. We describe the latest evolution of the payment system, which emphasizes quality measurement and alternative payment models. We conclude with suggestions for how to influence physician behavior through education and payment reform so that their behavior aligns with alternative care models to control spending in the future.

Theta Oscillations in Visual Cortex Emerge with Experience to Convey Expected Reward Time and Experienced Reward Rate

PubMed Central

Zold, Camila L.

2015-01-01

The primary visual cortex (V1) is widely regarded as faithfully conveying the physical properties of visual stimuli. Thus, experience-induced changes in V1 are often interpreted as improving visual perception (i.e., perceptual learning). Here we describe how, with experience, cue-evoked oscillations emerge in V1 to convey expected reward time as well as to relate experienced reward rate. We show, in chronic multisite local field potential recordings from rat V1, that repeated presentation of visual cues induces the emergence of visually evoked oscillatory activity. Early in training, the visually evoked oscillations relate to the physical parameters of the stimuli. However, with training, the oscillations evolve to relate the time in which those stimuli foretell expected reward. Moreover, the oscillation prevalence reflects the reward rate recently experienced by the animal. Thus, training induces experience-dependent changes in V1 activity that relate to what those stimuli have come to signify behaviorally: when to expect future reward and at what rate. PMID:26134643

Effect of failure/success feedback and the moderating influence of personality on reward motivation.

PubMed

Anand, Deepika; Oehlberg, Katherine A; Treadway, Michael T; Nusslock, Robin

2016-01-01

While motivation to pursue goals is often assumed to be a trait-like characteristic, it is influenced by a variety of situational factors. In particular, recent experiences of success or failure, as well as cognitive responses to these outcomes, may shape subsequent willingness to expend effort for future rewards. To date, however, these effects have not been explicitly tested. In the present study, 131 healthy individuals received either failure or success feedback on a cognitive task. They were then instructed to either ruminate or distract themselves from their emotions. Finally, they completed the Effort Expenditure for Rewards Task, a laboratory measure of reward motivation. Results indicate that participants who received failure feedback relied more strongly on the reward magnitude when choosing whether to exert greater effort to obtain larger rewards, though this effect only held under conditions of significant uncertainty about whether the effort would be rewarded. Further, participants with high levels of trait inhibition were less responsive to reward value and probability when choosing whether to expend greater effort, results that echo past studies of effort-based decision-making in psychological disorders.

Volunteer Motivations and Rewards: Shaping Future Programs.

ERIC Educational Resources Information Center

McClam, Tricia

Volunteerism is increasing today and helps to fill in the gaps created by funding and staff cutbacks in service-oriented agencies. It is critical not only to recruit new volunteers but to retain volunteers. This study examines hospice volunteers for motivation and rewards. Previous studies have found motivations to include altruism and…

Adolescents' thoughts about parents' jobs and their importance for adolescents' future orientation.

PubMed

Neblett, Nicole Gardner; Cortina, Kai Schnabel

2006-10-01

The current study examined the relation between adolescents' perceptions of their parents' jobs and their future orientation, and tested the role of parental support. Four hundred and fifteen ninth through twelfth graders were surveyed about their parents' job rewards, self-direction, and stressors, as well as their expectations for employment and education prospects. Results indicate that perceptions of parents' rewards, self-direction, and stress predict how positively or negatively adolescents perceive the future to be. Results also suggest that higher levels of parental support may weaken the association between perceptions and future orientation when adolescents perceive their parents experience unfavorable conditions at work. These results suggest that adolescents' perceptions of parents' jobs have implications for their preparation for adulthood.

What's the Point?: A Review of Reward Systems Implemented in Gamification Interventions.

PubMed

Lewis, Zakkoyya H; Swartz, Maria C; Lyons, Elizabeth J

2016-04-01

Rewards are commonly used in interventions to change behavior, but they can inhibit development of intrinsic motivation, which is associated with long-term behavior maintenance. Gamification is a novel intervention strategy that may target intrinsic motivation through fun and enjoyment. Before the effects of gamified interventions on motivation can be determined, there must be an understanding of how gamified interventions operationalize rewards, such as point systems. The purpose of this review is to determine the prevalence of different reward types, specifically point systems, within gamified interventions. Electronic databases were searched for relevant articles. Data sources included Medline OVID, Medline PubMed, Web of Science, CINAHL, Cochrane Central, and PsycINFO. Out of the 21 articles retrieved, 18 studies described a reward system and were included in this review. Gamified interventions were designed to target a myriad of clinical outcomes across diverse populations. Rewards included points (n = 14), achievements/badges/medals (n = 7), tangible rewards (n = 7), currency (n = 4), other unspecified rewards (n = 3), likes (n = 2), animated feedback (n = 1), and kudos (n = 1). Rewards, and points in particular, appear to be a foundational component of gamified interventions. Despite their prevalence, authors seldom described the use of noncontingent rewards or how the rewards interacted with other game features. The reward systems relying on tangible rewards and currency may have been limited by inhibited intrinsic motivation. As gamification proliferates, future research should explicitly describe how rewards were operationalized in the intervention and evaluate the effects of gamified rewards on motivation across populations and research outcomes.

The role of intrinsic and extrinsic rewards in committing violence during combat: A cross-sectional study with former combatants in the DR Congo.

PubMed

Haer, Roos; Hermenau, Katharin; Elbert, Thomas; Moran, James K; Hecker, Tobias

2017-05-01

It has been postulated that the violent behavior that characterizes armed conflict is reinforced by the possibility of receiving rewards. The present study examined the potential influence of two types of rewards in an ongoing setting of conflict: extrinsic and intrinsic rewards. Former combatants active in the Democratic Republic of the Congo (N = 198) were interviewed and questioned about the way they were recruited, the offenses they committed during combat, their level of perceived intrinsic rewards (i.e., appetitive perception of violence), and the number of received extrinsic rewards during their time in the armed group (e.g., money, extra food, alcohol, or drugs). A moderated multiple regression analysis showed that the number of received extrinsic rewards and the level of intrinsic rewards were significantly positively related to the number of different types of offenses committed. In contrast to our expectations and previous findings, the recruitment type (forced conscription vs. voluntary enlistment) did not moderate this relation. Our findings suggest that both types of rewards play a role in committing violence during combat. We suggest, therefore, that reintegration programs should not only consider the influence of extrinsic rewards, but also need to address the influence of intrinsic rewards to counter violent behavior among former combatants. Aggr. Behav. 43:241-250, 2017. © 2016 Wiley Periodicals, Inc. © 2016 Wiley Periodicals, Inc.

Impaired associative learning with food rewards in obese women.

PubMed

Zhang, Zhihao; Manson, Kirk F; Schiller, Daniela; Levy, Ifat

2014-08-04

Obesity is a major epidemic in many parts of the world. One of the main factors contributing to obesity is overconsumption of high-fat and high-calorie food, which is driven by the rewarding properties of these types of food. Previous studies have suggested that dysfunction in reward circuits may be associated with overeating and obesity. The nature of this dysfunction, however, is still unknown. Here, we demonstrate impairment in reward-based associative learning specific to food in obese women. Normal-weight and obese participants performed an appetitive reversal learning task in which they had to learn and modify cue-reward associations. To test whether any learning deficits were specific to food reward or were more general, we used a between-subject design in which half of the participants received food reward and the other half received money reward. Our results reveal a marked difference in associative learning between normal-weight and obese women when food was used as reward. Importantly, no learning deficits were observed with money reward. Multiple regression analyses also established a robust negative association between body mass index and learning performance in the food domain in female participants. Interestingly, such impairment was not observed in obese men. These findings suggest that obesity may be linked to impaired reward-based associative learning and that this impairment may be specific to the food domain. Copyright © 2014 Elsevier Ltd. All rights reserved.

Differential reward coding in the subdivisions of the primate caudate during an oculomotor task.

PubMed

Nakamura, Kae; Santos, Gustavo S; Matsuzaki, Ryuichi; Nakahara, Hiroyuki

2012-11-07

The basal ganglia play a pivotal role in reward-oriented behavior. The striatum, an input channel of the basal ganglia, is composed of subdivisions that are topographically connected with different cortical and subcortical areas. To test whether reward information is differentially processed in the different parts of the striatum, we compared reward-related neuronal activity along the dorsolateral-ventromedial axis in the caudate nucleus of monkeys performing an asymmetrically rewarded oculomotor task. In a given block, a target in one position was associated with a large reward, whereas the other target was associated with a small reward. The target position-reward value contingency was switched between blocks. We found the following: (1) activity that reflected the block-wise reward contingency emerged before the appearance of a visual target, and it was more prevalent in the dorsal, rather than central and ventral, caudate; (2) activity that was positively related to the reward size of the current trial was evident, especially after reward delivery, and it was more prevalent in the ventral and central, rather than dorsal, caudate; and (3) activity that was modulated by the memory of the outcomes of the previous trials was evident in the dorsal and central caudate. This multiple reward information, together with the target-direction information, was represented primarily by individual caudate neurons, and the different reward information was represented in caudate subpopulations with distinct electrophysiological properties, e.g., baseline firing and spike width. These results suggest parallel processing of different reward information by the basal ganglia subdivisions defined by extrinsic connections and intrinsic properties.

Pressure to cooperate: is positive reward interdependence really needed in cooperative learning?

PubMed

Buchs, Céline; Gilles, Ingrid; Dutrévis, Marion; Butera, Fabrizio

2011-03-01

BACKGROUND. Despite extensive research on cooperative learning, the debate regarding whether or not its effectiveness depends on positive reward interdependence has not yet found clear evidence. AIMS. We tested the hypothesis that positive reward interdependence, as compared to reward independence, enhances cooperative learning only if learners work on a 'routine task'; if the learners work on a 'true group task', positive reward interdependence induces the same level of learning as reward independence. SAMPLE. The study involved 62 psychology students during regular workshops. METHOD. Students worked on two psychology texts in cooperative dyads for three sessions. The type of task was manipulated through resource interdependence: students worked on either identical (routine task) or complementary (true group task) information. Students expected to be assessed with a Multiple Choice Test (MCT) on the two texts. The MCT assessment type was introduced according to two reward interdependence conditions, either individual (reward independence) or common (positive reward interdependence). A follow-up individual test took place 4 weeks after the third session of dyadic work to examine individual learning. RESULTS. The predicted interaction between the two types of interdependence was significant, indicating that students learned more with positive reward interdependence than with reward independence when they worked on identical information (routine task), whereas students who worked on complementary information (group task) learned the same with or without reward interdependence. CONCLUSIONS. This experiment sheds light on the conditions under which positive reward interdependence enhances cooperative learning, and suggests that creating a real group task allows to avoid the need for positive reward interdependence. © 2010 The British Psychological Society.

Neurophysiology of Reward-Guided Behavior: Correlates Related to Predictions, Value, Motivation, Errors, Attention, and Action.

PubMed

Bissonette, Gregory B; Roesch, Matthew R

2016-01-01

Many brain areas are activated by the possibility and receipt of reward. Are all of these brain areas reporting the same information about reward? Or are these signals related to other functions that accompany reward-guided learning and decision-making? Through carefully controlled behavioral studies, it has been shown that reward-related activity can represent reward expectations related to future outcomes, errors in those expectations, motivation, and signals related to goal- and habit-driven behaviors. These dissociations have been accomplished by manipulating the predictability of positively and negatively valued events. Here, we review single neuron recordings in behaving animals that have addressed this issue. We describe data showing that several brain areas, including orbitofrontal cortex, anterior cingulate, and basolateral amygdala signal reward prediction. In addition, anterior cingulate, basolateral amygdala, and dopamine neurons also signal errors in reward prediction, but in different ways. For these areas, we will describe how unexpected manipulations of positive and negative value can dissociate signed from unsigned reward prediction errors. All of these signals feed into striatum to modify signals that motivate behavior in ventral striatum and guide responding via associative encoding in dorsolateral striatum.

Neurophysiology of Reward-Guided Behavior: Correlates Related to Predictions, Value, Motivation, Errors, Attention, and Action

PubMed Central

Roesch, Matthew R.

2017-01-01

Many brain areas are activated by the possibility and receipt of reward. Are all of these brain areas reporting the same information about reward? Or are these signals related to other functions that accompany reward-guided learning and decision-making? Through carefully controlled behavioral studies, it has been shown that reward-related activity can represent reward expectations related to future outcomes, errors in those expectations, motivation, and signals related to goal- and habit-driven behaviors. These dissociations have been accomplished by manipulating the predictability of positively and negatively valued events. Here, we review single neuron recordings in behaving animals that have addressed this issue. We describe data showing that several brain areas, including orbitofrontal cortex, anterior cingulate, and basolateral amygdala signal reward prediction. In addition, anterior cingulate, basolateral amygdala, and dopamine neurons also signal errors in reward prediction, but in different ways. For these areas, we will describe how unexpected manipulations of positive and negative value can dissociate signed from unsigned reward prediction errors. All of these signals feed into striatum to modify signals that motivate behavior in ventral striatum and guide responding via associative encoding in dorsolateral striatum. PMID:26276036

Tsallis’ non-extensive free energy as a subjective value of an uncertain reward

NASA Astrophysics Data System (ADS)

Takahashi, Taiki

2009-03-01

Recent studies in neuroeconomics and econophysics revealed the importance of reward expectation in decision under uncertainty. Behavioral neuroeconomic studies have proposed that the unpredictability and the probability of an uncertain reward are distinctly encoded as entropy and a distorted probability weight, respectively, in the separate neural systems. However, previous behavioral economic and decision-theoretic models could not quantify reward-seeking and uncertainty aversion in a theoretically consistent manner. In this paper, we have: (i) proposed that generalized Helmholtz free energy in Tsallis’ non-extensive thermostatistics can be utilized to quantify a perceived value of an uncertain reward, and (ii) empirically examined the explanatory powers of the models. Future study directions in neuroeconomics and econophysics by utilizing the Tsallis’ free energy model are discussed.

Reward Processing And Risk For Depression Across Development

PubMed Central

Luking, Katherine R; Pagliaccio, David; Luby, Joan L; Barch, Deanna M

2016-01-01

Striatal response to reward has been of great interest in the typical development and psychopathology literatures. These parallel lines of inquiry demonstrate that while typically developing adolescents show robust striatal response to reward, adolescents with major depressive disorder (MDD) or those at high-risk for MDD show blunted response to reward. Understanding how these findings intersect is critical for the development and application of early preventative interventions in at-risk children, ideally before the sharp increase in the rate of MDD onset that occurs in adolescence. Robust findings relating blunted striatal response to reward and MDD-risk are reviewed and situated within a normative developmental context. We highlight the need for future studies investigating longitudinal development, specificity to MDD, and roles of potential moderators and mediators. PMID:27131776

Monetary, Food, and Social Rewards Induce Similar Pavlovian-to-Instrumental Transfer Effects

PubMed Central

Lehner, Rea; Balsters, Joshua H.; Herger, Andreas; Hare, Todd A.; Wenderoth, Nicole

2017-01-01

Multiple types of reward, such as money, food or social approval, are capable of driving behavior. However, most previous investigations have only focused on one of these reward classes in isolation, as such it is not clear whether different reward classes have a unique influence on instrumental responding or whether the subjective value of the reward, rather than the reward type per se, is most important in driving behavior. Here, we investigate behavior using a well-established reward paradigm, Pavlovian-to-instrumental transfer (PIT), and three different reward types: monetary, food and social rewards. The subjective value of each reward type was matched using a modified Becker-DeGroot-Marschak (BDM) auction where subjective reward value was expressed through physical effort using a bimanual grip force task. We measured the influence of reward-associated stimuli on how participants distributed forces between hands when reaching a target effort range on the screen bimanually and on how much time participants spent in this target range. Participants spent significantly more time in the target range (15% ± 2% maximal voluntary contraction) when a stimulus was presented that was associated with a reward used during instrumental conditioning or Pavlovian conditioning compared to a stimulus associated with a neutral outcome (i.e., general PIT). The strength of the PIT effect was modulated by subjective value (i.e., individuals who showed a stronger PIT effect rated the value of rewards more highly), but not by reward type, demonstrating that stimuli of all reward types were able to act as appetitive reinforcers and influenced instrumental responding, when matched to the same subjective reward value. This is the first demonstration that individually matched monetary, food and social rewards are equally effective as appetitive reinforcers in PIT. These findings strengthen the hypotheses that the subjective value is crucial for how much reward-associated stimuli influence behavior. PMID:28101010

Lethal Forethought: Delayed Reward Discounting Differentiates High- and Low-Lethality Suicide Attempts in Old Age

PubMed Central

Dombrovski, Alexandre Y.; Szanto, Katalin; Siegle, Greg J.; Wallace, Meredith L.; Forman, Steven D.; Sahakian, Barbara; Reynolds, Charles F.; Clark, Luke

2011-01-01

Background The decision to commit suicide may be impulsive, but lethal suicidal acts often involve planning and forethought. People who attempt suicide make disadvantageous decisions in other contexts, but nothing is known about the way they decide about the future. Can the willingness to postpone future gratification differentiate between individuals prone to serious, premeditated and less serious, unplanned suicidal acts? Methods Four groups of depressed participants aged 60+ made choices between smaller immediate and larger delayed monetary rewards: 15 who made high-lethality suicide attempts, 14 who made low-lethality suicide attempts, 12 who seriously contemplated suicide, and 42 people with depression but no history of suicidal thoughts. The reference group was 31 psychiatrically healthy elders. Results Individuals who had made low-lethality attempts displayed an exaggerated preference for immediate rewards compared to non-suicidal depressed and healthy controls. Those who had carried out high-lethality suicide attempts were more willing to delay future rewards, compared to low-lethality attempters. Better planned suicide attempts were also associated with willingness to wait for larger rewards. These effects were unchanged after accounting for education, global cognitive function, substance use disorders, psychotropic medications, and possible brain injury from attempts. Discount rates were correlated with having debt but were not significantly associated with income, hopelessness, depressive severity, premorbid IQ, age at first attempt, or choice of violent means. Conclusions While clinicians often focus on impulsivity in patients at risk for suicide, these data suggest that identifying biological characteristics and treatments for non-impulsive suicidal older people may be even more important. PMID:21329911

Measuring and modeling the interaction among reward size, delay to reward, and satiation level on motivation in monkeys.

PubMed

Minamimoto, Takafumi; La Camera, Giancarlo; Richmond, Barry J

2009-01-01

Motivation is usually inferred from the likelihood or the intensity with which behavior is carried out. It is sensitive to external factors (e.g., the identity, amount, and timing of a rewarding outcome) and internal factors (e.g., hunger or thirst). We trained macaque monkeys to perform a nonchoice instrumental task (a sequential red-green color discrimination) while manipulating two external factors: reward size and delay-to-reward. We also inferred the state of one internal factor, level of satiation, by monitoring the accumulated reward. A visual cue indicated the forthcoming reward size and delay-to-reward in each trial. The fraction of trials completed correctly by the monkeys increased linearly with reward size and was hyperbolically discounted by delay-to-reward duration, relations that are similar to those found in free operant and choice tasks. The fraction of correct trials also decreased progressively as a function of the satiation level. Similar (albeit noiser) relations were obtained for reaction times. The combined effect of reward size, delay-to-reward, and satiation level on the proportion of correct trials is well described as a multiplication of the effects of the single factors when each factor is examined alone. These results provide a quantitative account of the interaction of external and internal factors on instrumental behavior, and allow us to extend the concept of subjective value of a rewarding outcome, usually confined to external factors, to account also for slow changes in the internal drive of the subject.

Measuring and Modeling the Interaction Among Reward Size, Delay to Reward, and Satiation Level on Motivation in Monkeys

PubMed Central

Minamimoto, Takafumi; La Camera, Giancarlo; Richmond, Barry J.

2009-01-01

Motivation is usually inferred from the likelihood or the intensity with which behavior is carried out. It is sensitive to external factors (e.g., the identity, amount, and timing of a rewarding outcome) and internal factors (e.g., hunger or thirst). We trained macaque monkeys to perform a nonchoice instrumental task (a sequential red-green color discrimination) while manipulating two external factors: reward size and delay-to-reward. We also inferred the state of one internal factor, level of satiation, by monitoring the accumulated reward. A visual cue indicated the forthcoming reward size and delay-to-reward in each trial. The fraction of trials completed correctly by the monkeys increased linearly with reward size and was hyperbolically discounted by delay-to-reward duration, relations that are similar to those found in free operant and choice tasks. The fraction of correct trials also decreased progressively as a function of the satiation level. Similar (albeit noiser) relations were obtained for reaction times. The combined effect of reward size, delay-to-reward, and satiation level on the proportion of correct trials is well described as a multiplication of the effects of the single factors when each factor is examined alone. These results provide a quantitative account of the interaction of external and internal factors on instrumental behavior, and allow us to extend the concept of subjective value of a rewarding outcome, usually confined to external factors, to account also for slow changes in the internal drive of the subject. PMID:18987119

Phasic dopamine as a prediction error of intrinsic and extrinsic reinforcements driving both action acquisition and reward maximization: a simulated robotic study.

PubMed

Mirolli, Marco; Santucci, Vieri G; Baldassarre, Gianluca

2013-03-01

An important issue of recent neuroscientific research is to understand the functional role of the phasic release of dopamine in the striatum, and in particular its relation to reinforcement learning. The literature is split between two alternative hypotheses: one considers phasic dopamine as a reward prediction error similar to the computational TD-error, whose function is to guide an animal to maximize future rewards; the other holds that phasic dopamine is a sensory prediction error signal that lets the animal discover and acquire novel actions. In this paper we propose an original hypothesis that integrates these two contrasting positions: according to our view phasic dopamine represents a TD-like reinforcement prediction error learning signal determined by both unexpected changes in the environment (temporary, intrinsic reinforcements) and biological rewards (permanent, extrinsic reinforcements). Accordingly, dopamine plays the functional role of driving both the discovery and acquisition of novel actions and the maximization of future rewards. To validate our hypothesis we perform a series of experiments with a simulated robotic system that has to learn different skills in order to get rewards. We compare different versions of the system in which we vary the composition of the learning signal. The results show that only the system reinforced by both extrinsic and intrinsic reinforcements is able to reach high performance in sufficiently complex conditions. Copyright © 2013 Elsevier Ltd. All rights reserved.

The effort-reward imbalance work-stress model and daytime salivary cortisol and dehydroepiandrosterone (DHEA) among Japanese women.

PubMed

Ota, Atsuhiko; Mase, Junji; Howteerakul, Nopporn; Rajatanun, Thitipat; Suwannapong, Nawarat; Yatsuya, Hiroshi; Ono, Yuichiro

2014-09-17

We examined the influence of work-related effort-reward imbalance and overcommitment to work (OC), as derived from Siegrist's Effort-Reward Imbalance (ERI) model, on the hypothalamic-pituitary-adrenocortical (HPA) axis. We hypothesized that, among healthy workers, both cortisol and dehydroepiandrosterone (DHEA) secretion would be increased by effort-reward imbalance and OC and, as a result, cortisol-to-DHEA ratio (C/D ratio) would not differ by effort-reward imbalance or OC. The subjects were 115 healthy female nursery school teachers. Salivary cortisol, DHEA, and C/D ratio were used as indexes of HPA activity. Mixed-model analyses of variance revealed that neither the interaction between the ERI model indicators (i.e., effort, reward, effort-to-reward ratio, and OC) and the series of measurement times (9:00, 12:00, and 15:00) nor the main effect of the ERI model indicators was significant for daytime salivary cortisol, DHEA, or C/D ratio. Multiple linear regression analyses indicated that none of the ERI model indicators was significantly associated with area under the curve of daytime salivary cortisol, DHEA, or C/D ratio. We found that effort, reward, effort-reward imbalance, and OC had little influence on daytime variation patterns, levels, or amounts of salivary HPA-axis-related hormones. Thus, our hypotheses were not supported.

Attracting and Retaining Exemplary Teachers. Challenge for the Future.

ERIC Educational Resources Information Center

Connecticut State Dept. of Education, Hartford.

The Connecticut State Incentives Project to Identify and Reward Exemplary Teaching began with a twofold purpose: first, to provide assistance to seven local districts in developing plans to identify and reward exemplary teaching, and second, to enable the Connecticut State Department of Education to share the common elements of these plans with…

Motivation and effort in individuals with social anhedonia

PubMed Central

McCarthy, Julie M.; Treadway, Michael T.; Blanchard, Jack J.

2015-01-01

It has been proposed that anhedonia may, in part, reflect difficulties in reward processing and effortful decision-making. The current study aimed to replicate previous findings of effortful decision-making deficits associated with elevated anhedonia and expand upon these findings by investigating whether these decision-making deficits are specific to elevated social anhedonia or are also associated with elevated positive schizotypy characteristics. The current study compared controls (n = 40) to individuals elevated on social anhedonia (n = 30), and individuals elevated on perceptual aberration/magical ideation (n = 30) on the Effort Expenditure for Rewards Task (EEfRT). Across groups, participants chose a higher proportion of hard tasks with increasing probability of reward and reward magnitude, demonstrating sensitivity to probability and reward values. Contrary to our expectations, when the probability of reward was most uncertain (50% probability), at low and medium reward values, the social anhedonia group demonstrated more effortful decision-making than either individuals high in positive schizotypy or controls. The positive schizotypy group only differed from controls (making less effortful choices than controls) when reward probability was lowest (12%) and the magnitude of reward was the smallest. Our results suggest that social anhedonia is related to intact motivation and effort for monetary rewards, but that individuals with this characteristic display a unique and perhaps inefficient pattern of effort allocation when the probability of reward is most uncertain. Future research is needed to better understand effortful decision-making and the processing of reward across a range of individual difference characteristics. PMID:25888337

A review of reward processing and motivational impairment in schizophrenia.

PubMed

Strauss, Gregory P; Waltz, James A; Gold, James M

2014-03-01

This article reviews and synthesizes research on reward processing in schizophrenia, which has begun to provide important insights into the cognitive and neural mechanisms associated with motivational impairments. Aberrant cortical-striatal interactions may be involved with multiple reward processing abnormalities, including: (1) dopamine-mediated basal ganglia systems that support reinforcement learning and the ability to predict cues that lead to rewarding outcomes; (2) orbitofrontal cortex-driven deficits in generating, updating, and maintaining value representations; (3) aberrant effort-value computations, which may be mediated by disrupted anterior cingulate cortex and midbrain dopamine functioning; and (4) altered activation of the prefrontal cortex, which is important for generating exploratory behaviors in environments where reward outcomes are uncertain. It will be important for psychosocial interventions targeting negative symptoms to account for abnormalities in each of these reward processes, which may also have important interactions; suggestions for novel behavioral intervention strategies that make use of external cues, reinforcers, and mobile technology are discussed.

Brain Regions Involved in the Learning and Application of Reward Rules in a Two-Deck Gambling Task

ERIC Educational Resources Information Center

Hartstra, E.; Oldenburg, J. F. E.; Van Leijenhorst, L.; Rombouts, S. A. R. B.; Crone, E. A.

2010-01-01

Decision-making involves the ability to choose between competing actions that are associated with uncertain benefits and penalties. The Iowa Gambling Task (IGT), which mimics real-life decision-making, involves learning a reward-punishment rule over multiple trials. Patients with damage to ventromedial prefrontal cortex (VMPFC) show deficits…

A temporal basis for Weber's law in value perception.

PubMed

Namboodiri, Vijay Mohan K; Mihalas, Stefan; Hussain Shuler, Marshall G

2014-01-01

Weber's law-the observation that the ability to perceive changes in magnitudes of stimuli is proportional to the magnitude-is a widely observed psychophysical phenomenon. It is also believed to underlie the perception of reward magnitudes and the passage of time. Since many ecological theories state that animals attempt to maximize reward rates, errors in the perception of reward magnitudes and delays must affect decision-making. Using an ecological theory of decision-making (TIMERR), we analyze the effect of multiple sources of noise (sensory noise, time estimation noise, and integration noise) on reward magnitude and subjective value perception. We show that the precision of reward magnitude perception is correlated with the precision of time perception and that Weber's law in time estimation can lead to Weber's law in value perception. The strength of this correlation is predicted to depend on the reward history of the animal. Subsequently, we show that sensory integration noise (either alone or in combination with time estimation noise) also leads to Weber's law in reward magnitude perception in an accumulator model, if it has balanced Poisson feedback. We then demonstrate that the noise in subjective value of a delayed reward, due to the combined effect of noise in both the perception of reward magnitude and delay, also abides by Weber's law. Thus, in our theory we prove analytically that the perception of reward magnitude, time, and subjective value change all approximately obey Weber's law.

Dopamine receptor blockade attenuates the general incentive motivational effects of noncontingently delivered rewards and reward-paired cues without affecting their ability to bias action selection.

PubMed

Ostlund, Sean B; Maidment, Nigel T

2012-01-01

Environmental cues affect our behavior in a variety of ways. Despite playing an invaluable role in guiding our daily activities, such cues also appear to trigger the harmful, compulsive behaviors that characterize addiction and other disorders of behavioral control. In instrumental conditioning, rewards and reward-paired cues bias action selection and invigorate reward-seeking behaviors, and appear to do so through distinct neurobehavioral processes. Although reward-paired cues are known to invigorate performance through a dopamine-dependent incentive motivational process, it is not known if dopamine also mediates the influence of rewards and reward-paired cues over action selection. The current study contrasted the effects of systemic administration of the nonspecific dopamine receptor antagonist flupentixol on response invigoration and action bias in Pavlovian-instrumental transfer, a test of cue-elicited responding, and in instrumental reinstatement, a test of noncontingent reward-elicited responding. Hungry rats were trained on two different stimulus-outcome relationships (eg, tone-grain pellets and noise-sucrose solution) and two different action-outcome relationships (eg, left press-grain and right press-sucrose). At test, we found that flupentixol pretreatment blocked the response invigoration generated by the cues but spared their ability to bias action selection to favor the action whose outcome was signaled by the cue being presented. The response-biasing influence of noncontingent reward deliveries was also unaffected by flupentixol. Interestingly, although flupentixol had a modest effect on the immediate response invigoration produced by those rewards, it was particularly potent in countering the lingering enhancement of responding produced by multiple reward deliveries. These findings indicate that dopamine mediates the general incentive motivational effects of noncontingent rewards and reward-paired cues but does not support their ability to bias action selection.

Using fMRI to study reward processing in humans: past, present, and future

PubMed Central

Wang, Kainan S.; Smith, David V.

2016-01-01

Functional magnetic resonance imaging (fMRI) is a noninvasive tool used to probe cognitive and affective processes. Although fMRI provides indirect measures of neural activity, the advent of fMRI has allowed for 1) the corroboration of significant animal findings in the human brain, and 2) the expansion of models to include more common human attributes that inform behavior. In this review, we briefly consider the neural basis of the blood oxygenation level dependent signal to set up a discussion of how fMRI studies have applied it in examining cognitive models in humans and the promise of using fMRI to advance such models. Specifically, we illustrate the contribution that fMRI has made to the study of reward processing, focusing on the role of the striatum in encoding reward-related learning signals that drive anticipatory and consummatory behaviors. For instance, we discuss how fMRI can be used to link neural signals (e.g., striatal responses to rewards) to individual differences in behavior and traits. While this functional segregation approach has been constructive to our understanding of reward-related functions, many fMRI studies have also benefitted from a functional integration approach that takes into account how interconnected regions (e.g., corticostriatal circuits) contribute to reward processing. We contend that future work using fMRI will profit from using a multimodal approach, such as combining fMRI with noninvasive brain stimulation tools (e.g., transcranial electrical stimulation), that can identify causal mechanisms underlying reward processing. Consequently, advancements in implementing fMRI will promise new translational opportunities to inform our understanding of psychopathologies. PMID:26740530

Working-memory load and temporal myopia in dynamic decision making.

PubMed

Worthy, Darrell A; Otto, A Ross; Maddox, W Todd

2012-11-01

We examined the role of working memory (WM) in dynamic decision making by having participants perform decision-making tasks under single-task or dual-task conditions. In 2 experiments participants performed dynamic decision-making tasks in which they chose 1 of 2 options on each trial. The decreasing option always gave a larger immediate reward but caused future rewards for both options to decrease. The increasing option always gave a smaller immediate reward but caused future rewards for both options to increase. In each experiment we manipulated the reward structure such that the decreasing option was the optimal choice in 1 condition and the increasing option was the optimal choice in the other condition. Behavioral results indicated that dual-task participants selected the immediately rewarding decreasing option more often, and single-task participants selected the increasing option more often, regardless of which option was optimal. Thus, dual-task participants performed worse on 1 type of task but better on the other type. Modeling results showed that single-task participants' data were most often best fit by a win-stay, lose-shift (WSLS) rule-based model that tracked differences across trials, and dual-task participants' data were most often best fit by a Softmax reinforcement learning model that tracked recency-weighted average rewards for each option. This suggests that manipulating WM load affects the degree to which participants focus on the immediate versus delayed consequences of their actions and whether they employ a rule-based WSLS strategy, but it does not necessarily affect how well people weigh the immediate versus delayed benefits when determining the long-term utility of each option.

Acute stress selectively reduces reward sensitivity

PubMed Central

Berghorst, Lisa H.; Bogdan, Ryan; Frank, Michael J.; Pizzagalli, Diego A.

2013-01-01

Stress may promote the onset of psychopathology by disrupting reward processing. However, the extent to which stress impairs reward processing, rather than incentive processing more generally, is unclear. To evaluate the specificity of stress-induced reward processing disruption, 100 psychiatrically healthy females were administered a probabilistic stimulus selection task (PSST) that enabled comparison of sensitivity to reward-driven (Go) and punishment-driven (NoGo) learning under either “no stress” or “stress” (threat-of-shock) conditions. Cortisol samples and self-report measures were collected. Contrary to hypotheses, the groups did not differ significantly in task performance or cortisol reactivity. However, further analyses focusing only on individuals under “stress” who were high responders with regard to both cortisol reactivity and self-reported negative affect revealed reduced reward sensitivity relative to individuals tested in the “no stress” condition; importantly, these deficits were reward-specific. Overall, findings provide preliminary evidence that stress-reactive individuals show diminished sensitivity to reward, but not punishment, under stress. While such results highlight the possibility that stress-induced anhedonia might be an important mechanism linking stress to affective disorders, future studies are necessary to confirm this conjecture. PMID:23596406

Serotonergic modulation of reward and punishment: evidence from pharmacological fMRI studies.

PubMed

Macoveanu, Julian

2014-03-27

Until recently, the bulk of research on the human reward system was focused on studying the dopaminergic and opioid neurotransmitter systems. However, extending the initial data from animal studies on reward, recent pharmacological brain imaging studies on human participants bring a new line of evidence on the key role serotonin plays in reward processing. The reviewed research has revealed how central serotonin availability and receptor specific transmission modulates the neural response to both appetitive (rewarding) and aversive (punishing) stimuli in putative reward-related brain regions. Thus, serotonin is suggested to be involved in behavioral control when there is a prospect of reward or punishment. The new findings may have implications in understanding psychiatric disorders such as major depression which is characterized by abnormal serotonergic function and reward-related processing and may also provide a neural correlated for the emotional blunting observed in the clinical treatment of psychiatric disorders with selective serotonin reuptake inhibitors. Given the unique profile of action of each serotonergic receptor subtype, future pharmacological studies may favor receptor specific investigations to complement present research mainly focused on global serotonergic manipulations. Copyright © 2014 Elsevier B.V. All rights reserved.

The temporal dynamics of reversal learning: P3 amplitude predicts valence-specific behavioral adjustment.

PubMed

Donaldson, Kayla R; Ait Oumeziane, Belel; Hélie, Sebastien; Foti, Dan

2016-07-01

Adapting behavior to dynamic stimulus-reward contingences is a core feature of reversal learning and a capacity thought to be critical to socio-emotional behavior. Impairment in reversal learning has been linked to multiple psychiatric outcomes, including depression, Parkinson's disorder, and substance abuse. A recent influential study introduced an innovative laboratory reversal-learning paradigm capable of disentangling the roles of feedback valence and expectancy. Here, we sought to use this paradigm in order to examine the time-course of reward and punishment learning using event-related potentials among a large, representative sample (N=101). Three distinct phases of processing were examined: initial feedback evaluation (reward positivity, or RewP), allocation of attention (P3), and sustained processing (late positive potential, or LPP). Results indicate a differential pattern of valence and expectancy across these processing stages: the RewP was uniquely related to valence (i.e., positive vs. negative feedback), the P3 was uniquely associated with expectancy (i.e., unexpected vs. expected feedback), and the LPP was sensitive to both valence and expectancy (i.e., main effects of each, but no interaction). The link between ERP amplitudes and behavioral performance was strongest for the P3, and this association was valence-specific. Overall, these findings highlight the potential utility of the P3 as a neural marker for feedback processing in reversal-based learning and establish a foundation for future research in clinical populations. Copyright © 2016 Elsevier Inc. All rights reserved.

Examining the interaction between cognitive control and reward sensitivity in substance use dependence.

PubMed

Charles-Walsh, Kathleen; Upton, Daniel J; Hester, Robert

2016-09-01

Drug dependence is characterized by altered reward processing and poor cognitive control, expressed as a preference for immediate rewards and impaired inhibitory control, respectively. To examine the interaction between reward processing (via the presence or absence of reward) and mechanisms of inhibitory control in drug dependence, the current study used the Monetary Incentive Control Task (MICT) to examine whether a group of opiate dependent persons demonstrated greater difficulty exerting control over immediate rewards compared to neutral stimuli. The MICT is a Go/Stop paradigm that examines inhibitory control over immediate rewards. Performance of 32 opiate dependent individuals was compared to 29 healthy controls. Opiate users demonstrated poorer inhibitory performance than controls, irrespective of cues signaling immediate reward. Whereas control participants' responses were modulated by probability cues, the opiate group did not show a capacity to up-regulate their cognitive control performance. The present results suggest a general decrease in cognitive control in opiate dependence, accompanied by a reduced ability to optimally modulate behavior in accordance with external cues. Opiate users and controls did not differ in the interaction between cognitive control and reward. The study highlights important issues for future research to consider when further examining this interaction in drug dependence. Crown Copyright © 2016. Published by Elsevier Ireland Ltd. All rights reserved.

The traveling salesrat: insights into the dynamics of efficient spatial navigation in the rodent

NASA Astrophysics Data System (ADS)

Watkins de Jong, Laurel; Gereke, Brian; Martin, Gerard M.; Fellous, Jean-Marc

2011-10-01

Rodent spatial navigation requires the dynamic evaluation of multiple sources of information, including visual cues, self-motion signals and reward signals. The nature of the evaluation, its dynamics and the relative weighting of the multiple information streams are largely unknown and have generated many hypotheses in the field of robotics. We use the framework of the traveling salesperson problem (TSP) to study how this evaluation may be achieved. The TSP is a classical artificial intelligence NP-hard problem that requires an agent to visit a fixed set of locations once, minimizing the total distance traveled. We show that after a few trials, rats converge on a short route between rewarded food cups. We propose that this route emerges from a series of local decisions that are derived from weighing information embedded in the context of the task. We study the relative weighting of spatial and reward information and establish that, in the conditions of this experiment, when the contingencies are not in conflict, rats choose the spatial or reward optimal solution. There was a trend toward a preference for space when the contingencies were in conflict. We also show that the spatial decision about which cup to go to next is biased by the orientation of the animal. Reward contingencies are also shown to significantly and dynamically modulate the decision-making process. This paradigm will allow for further neurophysiological studies aimed at understanding the synergistic role of brain areas involved in planning, reward processing and spatial navigation. These insights will in turn suggest new neural-like architectures for the control of mobile autonomous robots.

Association of Job Stressors With Panic Attack and Panic Disorder in a Working Population in Japan: A Cross-Sectional Study.

PubMed

Asai, Yumi; Imamura, Kotaro; Kawakami, Norito

2017-06-01

This study aimed to investigate associations of job stressors with panic attack (PA) and panic disorder (PD) among Japanese workers. A cross-sectional online questionnaire survey was conducted of 2060 workers. Job strain, effort/reward imbalance, and workplace social support were measured by the job content questionnaire and effort/reward imbalance questionnaire. These variables were classified into tertiles. PA/PD were measured by self-report based on the mini international neuropsychiatric interview (MINI). Multiple logistic regression was conducted, adjusting for demographic, lifestyle, and health-related covariates. Data from 1965 participants were analyzed. Adjusted odds ratio (OR) of PA/PD was significantly greater for the group with high effort/reward imbalance compared with the group with low effort/reward imbalance (ORs, 2.64 and 2.94, respectively, both P < 0.05). This study found effort/reward imbalance was associated with having PA/PD among Japanese workers.

Dopamine in motivational control: rewarding, aversive, and alerting

PubMed Central

Bromberg-Martin, Ethan S.; Matsumoto, Masayuki; Hikosaka, Okihide

2010-01-01

SUMMARY Midbrain dopamine neurons are well known for their strong responses to rewards and their critical role in positive motivation. It has become increasingly clear, however, that dopamine neurons also transmit signals related to salient but non-rewarding experiences such as aversive and alerting events. Here we review recent advances in understanding the reward and non-reward functions of dopamine. Based on this data, we propose that dopamine neurons come in multiple types that are connected with distinct brain networks and have distinct roles in motivational control. Some dopamine neurons encode motivational value, supporting brain networks for seeking, evaluation, and value learning. Others encode motivational salience, supporting brain networks for orienting, cognition, and general motivation. Both types of dopamine neurons are augmented by an alerting signal involved in rapid detection of potentially important sensory cues. We hypothesize that these dopaminergic pathways for value, salience, and alerting cooperate to support adaptive behavior. PMID:21144997

Reward-based spatial learning in unmedicated adults with obsessive-compulsive disorder.

PubMed

Marsh, Rachel; Tau, Gregory Z; Wang, Zhishun; Huo, Yuankai; Liu, Ge; Hao, Xuejun; Packard, Mark G; Peterson, Bradley S; Simpson, H Blair

2015-04-01

The authors assessed the functioning of mesolimbic and striatal areas involved in reward-based spatial learning in unmedicated adults with obsessive-compulsive disorder (OCD). Functional MRI blood-oxygen-level-dependent response was compared in 33 unmedicated adults with OCD and 33 healthy, age-matched comparison subjects during a reward-based learning task that required learning to use extramaze cues to navigate a virtual eight-arm radial maze to find hidden rewards. The groups were compared in their patterns of brain activation associated with reward-based spatial learning versus a control condition in which rewards were unexpected because they were allotted pseudorandomly to experimentally prevent learning. Both groups learned to navigate the maze to find hidden rewards, but group differences in neural activity during navigation and reward processing were detected in mesolimbic and striatal areas. During navigation, the OCD group, unlike the healthy comparison group, exhibited activation in the left posterior hippocampus. Unlike healthy subjects, participants in the OCD group did not show activation in the left ventral putamen and amygdala when anticipating rewards or in the left hippocampus, amygdala, and ventral putamen when receiving unexpected rewards (control condition). Signal in these regions decreased relative to baseline during unexpected reward receipt among those in the OCD group, and the degree of activation was inversely associated with doubt/checking symptoms. Participants in the OCD group displayed abnormal recruitment of mesolimbic and ventral striatal circuitry during reward-based spatial learning. Whereas healthy comparison subjects exhibited activation in this circuitry in response to the violation of reward expectations, unmedicated OCD participants did not and instead over-relied on the posterior hippocampus during learning. Thus, dopaminergic innervation of reward circuitry may be altered, and future study of anterior/posterior hippocampal dysfunction in OCD is warranted.

Brain activity in valuation regions while thinking about the future predicts individual discount rates.

PubMed

Cooper, Nicole; Kable, Joseph W; Kim, B Kyu; Zauberman, Gal

2013-08-07

People vary widely in how much they discount delayed rewards, yet little is known about the sources of these differences. Here we demonstrate that neural activity in ventromedial prefrontal cortex (VMPFC) and ventral striatum (VS) when human subjects are asked to merely think about the future--specifically, to judge the subjective length of future time intervals--predicts delay discounting. High discounters showed lower activity for longer time delays, while low discounters showed the opposite pattern. Our results demonstrate that the correlation between VMPFC and VS activity and discounting occurs even in the absence of choices about future rewards, and does not depend on a person explicitly evaluating future outcomes or judging their self-relevance. This suggests a link between discounting and basic processes involved in thinking about the future, such as temporal perception. Our results also suggest that reducing impatience requires not suppression of VMPFC and VS activity altogether, but rather modulation of how these regions respond to the present versus the future.

Dissociated roles of the anterior cingulate cortex in reward and conflict processing as revealed by the feedback error-related negativity and N200.

PubMed

Baker, Travis E; Holroyd, Clay B

2011-04-01

The reinforcement learning theory of the error-related negativity (ERN) holds that the impact of reward signals carried by the midbrain dopamine system modulates activity of the anterior cingulate cortex (ACC), alternatively disinhibiting and inhibiting the ACC following unpredicted error and reward events, respectively. According to a recent formulation of the theory, activity that is intrinsic to the ACC produces a component of the event-related brain potential (ERP) called the N200, and following unpredicted rewards, the N200 is suppressed by extrinsically applied positive dopamine reward signals, resulting in an ERP component called the feedback-ERN (fERN). Here we demonstrate that, despite extensive spatial and temporal overlap between the two ERP components, the functional processes indexed by the N200 (conflict) and the fERN (reward) are dissociable. These results point toward avenues for future investigation. Copyright © 2011 Elsevier B.V. All rights reserved.

Neural Response to Reward as a Predictor of Rise in Depressive Symptoms in Adolescence

PubMed Central

Morgan, Judith K.; Olino, Thomas M.; McMakin, Dana L.; Ryan, Neal D.; Forbes, Erika E.

2012-01-01

Adolescence is a developmental period characterized by significant increases in the onset of depression, but also by increases in depressive symptoms, even among psychiatrically healthy youth. Disrupted reward function has been postulated as a critical factor in the development of depression, but it is still unclear which adolescents are particularly at risk for rising depressive symptoms. We provide a conceptual stance on gender, pubertal development, and reward type as potential moderators of the association between neural response to reward and rises in depressive symptoms. In addition, we describe preliminary findings that support claims of this conceptual stance. We propose that (1) status-related rewards may be particularly salient for eliciting neural response relevant to depressive symptoms in boys, whereas social rewards may be more salient for eliciting neural response relevant to depressive symptoms in girls and (2) the pattern of reduced striatal response and enhanced medial prefrontal response to reward may be particularly predictive of depressive symptoms in pubertal adolescents. We found that greater vmPFC activation when winning rewards predicted greater increases in depressive symptoms over two years, for boys only, and less striatal activation when anticipating rewards predicted greater increases in depressive symptoms over two years, for adolescents in mid to late pubertal stages but not those in pre to early puberty. We also propose directions for future studies, including the investigation of social vs. monetary reward directly and the longitudinal assessment of parallel changes in pubertal development, neural response to reward, and depressive symptoms. PMID:22521464

Emotional arousal predicts intertemporal choice

PubMed Central

Lempert, Karolina M.; Johnson, Eli; Phelps, Elizabeth A.

2016-01-01

People generally prefer immediate rewards to rewards received after a delay, often even when the delayed reward is larger. This phenomenon is known as temporal discounting. It has been suggested that preferences for immediate rewards may be due to their being more concrete than delayed rewards. This concreteness may evoke an enhanced emotional response. Indeed, manipulating the representation of a future reward to make it more concrete has been shown to heighten the reward’s subjective emotional intensity, making people more likely to choose it. Here we use an objective measure of arousal – pupil dilation – to investigate if emotional arousal mediates the influence of delayed reward concreteness on choice. We recorded pupil dilation responses while participants made choices between immediate and delayed rewards. We manipulated concreteness through time interval framing: delayed rewards were presented either with the date on which they would be received (e.g., “$30, May 3”; DATE condition, more concrete) or in terms of delay to receipt (e.g., “$30, 7 days; DAYS condition, less concrete). Contrary to prior work, participants were not overall more patient in the DATE condition. However, there was individual variability in response to time framing, and this variability was predicted by differences in pupil dilation between conditions. Emotional arousal increased as the subjective value of delayed rewards increased, and predicted choice of the delayed reward on each trial. This study advances our understanding of the role of emotion in temporal discounting. PMID:26882337

Temporal Discounting of Hypothetical Monetary Rewards by Adolescents, Adults, and Older Adults

ERIC Educational Resources Information Center

Whelan, Robert; McHugh, Louise A.

2009-01-01

The present experiment examined temporal discounting across 3 different age bands: adolescents, adults, and older adults (mean ages 14, 46, and 73 years, respectively). A computerized task was employed in which participants were asked to choose between larger rewards available at a specified time in the future--either 100 British Pounds or 1,000…

Optimism as a Prior Belief about the Probability of Future Reward

PubMed Central

Kalra, Aditi; Seriès, Peggy

2014-01-01

Optimists hold positive a priori beliefs about the future. In Bayesian statistical theory, a priori beliefs can be overcome by experience. However, optimistic beliefs can at times appear surprisingly resistant to evidence, suggesting that optimism might also influence how new information is selected and learned. Here, we use a novel Pavlovian conditioning task, embedded in a normative framework, to directly assess how trait optimism, as classically measured using self-report questionnaires, influences choices between visual targets, by learning about their association with reward progresses. We find that trait optimism relates to an a priori belief about the likelihood of rewards, but not losses, in our task. Critically, this positive belief behaves like a probabilistic prior, i.e. its influence reduces with increasing experience. Contrary to findings in the literature related to unrealistic optimism and self-beliefs, it does not appear to influence the iterative learning process directly. PMID:24853098

Hedonic and incentive signals for body weight control.

PubMed

Egecioglu, Emil; Skibicka, Karolina P; Hansson, Caroline; Alvarez-Crespo, Mayte; Friberg, P Anders; Jerlhag, Elisabet; Engel, Jörgen A; Dickson, Suzanne L

2011-09-01

Here we review the emerging neurobiological understanding of the role of the brain's reward system in the regulation of body weight in health and in disease. Common obesity is characterized by the over-consumption of palatable/rewarding foods, reflecting an imbalance in the relative importance of hedonic versus homeostatic signals. The popular 'incentive salience theory' of food reward recognises not only a hedonic/pleasure component ('liking') but also an incentive motivation component ('wanting' or 'reward-seeking'). Central to the neurobiology of the reward mechanism is the mesoaccumbal dopamine system that confers incentive motivation not only for natural rewards such as food but also by artificial rewards (eg. addictive drugs). Indeed, this mesoaccumbal dopamine system receives and integrates information about the incentive (rewarding) value of foods with information about metabolic status. Problematic over-eating likely reflects a changing balance in the control exerted by hypothalamic versus reward circuits and/or it could reflect an allostatic shift in the hedonic set point for food reward. Certainly, for obesity to prevail, metabolic satiety signals such as leptin and insulin fail to regain control of appetitive brain networks, including those involved in food reward. On the other hand, metabolic control could reflect increased signalling by the stomach-derived orexigenic hormone, ghrelin. We have shown that ghrelin activates the mesoaccumbal dopamine system and that central ghrelin signalling is required for reward from both chemical drugs (eg alcohol) and also from palatable food. Future therapies for problematic over-eating and obesity may include drugs that interfere with incentive motivation, such as ghrelin antagonists.

Hunger does not motivate reward in women remitted from anorexia nervosa

PubMed Central

Wierenga, Christina E.; Bischoff-Grethe, Amanda; Melrose, A. James; Irvine, Zoe; Torres, Laura; Bailer, Ursula F.; Simmons, Alan; Fudge, Julie L.; McClure, Samuel M.; Ely, Alice; Kaye, Walter H.

2014-01-01

Background Hunger enhances sensitivity to reward, yet individuals with anorexia nervosa (AN) are not motivated to eat when starved. This study examined whether diminished response to reward could underlie food restriction in AN by investigating brain response to rewards during hunger and satiated states. Methods Using a delay discounting monetary decision task known to discriminate brain regions contributing to processing of immediate rewards and cognitive control important for decision making regarding future rewards, we compared 23 adults remitted from AN (to reduce the confounding effects of starvation [RAN]) to 17 healthy women (CW). Monetary rewards were used because the rewarding value of food may be confounded by anxiety in AN. Results Interactions of group (RAN, CW) × visit (hunger, satiety) revealed that, for CW, hunger significantly increased activation in reward salience circuitry (ventral striatum, dorsal caudate, anterior cingulate cortex) during processing of immediate reward, whereas satiety increased activation in cognitive control circuitry (ventrolateral prefrontal cortex, insula) during decision-making. In contrast, brain response in reward and cognitive neurocircuitry did not differ during hunger and satiety in RAN. A main effect of group revealed elevated response in the middle frontal gyrus for RAN. Conclusions RAN failed to increase activation of reward valuation circuitry when hungry and showed elevated response in cognitive control circuitry independent of metabolic state. Decreased sensitivity to hunger’s motivational drive may explain AN individuals’ ability to restrict food when emaciated. Moreover, difficulties in valuating emotional salience may contribute to inabilities to appreciate the risks inherent in this deadly disorder. PMID:25481622

Motivation and effort in individuals with social anhedonia.

PubMed

McCarthy, Julie M; Treadway, Michael T; Blanchard, Jack J

2015-06-01

It has been proposed that anhedonia may, in part, reflect difficulties in reward processing and effortful decision making. The current study aimed to replicate previous findings of effortful decision making deficits associated with elevated anhedonia and expand upon these findings by investigating whether these decision making deficits are specific to elevated social anhedonia or are also associated with elevated positive schizotypy characteristics. The current study compared controls (n=40) to individuals elevated on social anhedonia (n=30), and individuals elevated on perceptual aberration/magical ideation (n=30) on the Effort Expenditure for Rewards Task (EEfRT). Across groups, participants chose a higher proportion of hard tasks with increasing probability of reward and reward magnitude, demonstrating sensitivity to probability and reward values. Contrary to our expectations, when the probability of reward was most uncertain (50% probability), at low and medium reward values, the social anhedonia group demonstrated more effortful decision making than either individuals high in positive schizotypy or controls. The positive schizotypy group only differed from controls (making less effortful choices than controls) when reward probability was lowest (12%) and the magnitude of reward was the smallest. Our results suggest that social anhedonia is related to intact motivation and effort for monetary rewards, but that individuals with this characteristic display a unique and perhaps inefficient pattern of effort allocation when the probability of reward is most uncertain. Future research is needed to better understand effortful decision making and the processing of reward across a range of individual difference characteristics. Copyright © 2015 Elsevier B.V. All rights reserved.

Neural reactivity to monetary rewards and losses differentiates social from generalized anxiety in children.

PubMed

Kessel, Ellen M; Kujawa, Autumn; Hajcak Proudfit, Greg; Klein, Daniel N

2015-07-01

The relationship between reward sensitivity and pediatric anxiety is poorly understood. Evidence suggests that alterations in reward processing are more characteristic of depressive than anxiety disorders. However, some studies have reported that anxiety disorders are also associated with perturbations in reward processing. Heterogeneity in the forms of anxiety studied may account for the differences between studies. We used the feedback-negativity, an event-related potential sensitive to monetary gains versus losses (ΔFN), to examine whether different forms of youth anxiety symptoms were uniquely associated with reward sensitivity as indexed by neural reactivity to the receipt of positive and negative monetary outcomes. Participants were 390, eight- to ten-year-old children (175 females) from a large community sample. The ΔFN was measured during a monetary reward task. Self-reports of child anxiety and depression symptoms and temperamental positive emotionality (PE) were obtained. Multiple regression analysis revealed that social anxiety and generalized anxiety symptoms were unique predictors of reward sensitivity after accounting for concurrent depressive symptoms and PE. While social anxiety was associated with a greater ΔFN, generalized anxiety was associated with a reduced ΔFN. Different symptom dimensions of child anxiety are differentially related to alterations in reward sensitivity. This may, in part, explain inconsistent findings in the literature regarding reward processing in anxiety. © 2014 Association for Child and Adolescent Mental Health.

Learning to Cooperate: The Evolution of Social Rewards in Repeated Interactions.

PubMed

Dridi, Slimane; Akçay, Erol

2018-01-01

Understanding the behavioral and psychological mechanisms underlying social behaviors is one of the major goals of social evolutionary theory. In particular, a persistent question about animal cooperation is to what extent it is supported by other-regarding preferences-the motivation to increase the welfare of others. In many situations, animals adjust their behaviors through learning by responding to the rewards they experience as a consequence of their actions. Therefore, we may ask whether learning in social situations can be driven by evolved other-regarding rewards. Here we develop a mathematical model in order to ask whether the mere act of cooperating with a social partner will evolve to be inherently rewarding. Individuals interact repeatedly in pairs and adjust their behaviors through reinforcement learning. We assume that individuals associate with each game outcome an internal reward value. These perceived rewards are genetically evolving traits. We find that conditionally cooperative rewards that value mutual cooperation positively but the sucker's outcome negatively tend to be evolutionarily stable. Purely other-regarding rewards can evolve only under special parameter combinations. On the other hand, selfish rewards that always lead to pure defection are also evolutionarily successful. These findings are consistent with empirical observations showing that humans tend to display conditionally cooperative behavior and also exhibit a diversity of preferences. Our model also demonstrates the need to further integrate multiple levels of biological causation of behavior.

The Effort-reward Imbalance work-stress model and daytime salivary cortisol and dehydroepiandrosterone (DHEA) among Japanese women

PubMed Central

Ota, Atsuhiko; Mase, Junji; Howteerakul, Nopporn; Rajatanun, Thitipat; Suwannapong, Nawarat; Yatsuya, Hiroshi; Ono, Yuichiro

2014-01-01

We examined the influence of work-related effort–reward imbalance and overcommitment to work (OC), as derived from Siegrist's Effort–Reward Imbalance (ERI) model, on the hypothalamic–pituitary–adrenocortical (HPA) axis. We hypothesized that, among healthy workers, both cortisol and dehydroepiandrosterone (DHEA) secretion would be increased by effort–reward imbalance and OC and, as a result, cortisol-to-DHEA ratio (C/D ratio) would not differ by effort–reward imbalance or OC. The subjects were 115 healthy female nursery school teachers. Salivary cortisol, DHEA, and C/D ratio were used as indexes of HPA activity. Mixed-model analyses of variance revealed that neither the interaction between the ERI model indicators (i.e., effort, reward, effort-to-reward ratio, and OC) and the series of measurement times (9:00, 12:00, and 15:00) nor the main effect of the ERI model indicators was significant for daytime salivary cortisol, DHEA, or C/D ratio. Multiple linear regression analyses indicated that none of the ERI model indicators was significantly associated with area under the curve of daytime salivary cortisol, DHEA, or C/D ratio. We found that effort, reward, effort–reward imbalance, and OC had little influence on daytime variation patterns, levels, or amounts of salivary HPA-axis-related hormones. Thus, our hypotheses were not supported. PMID:25228138

Reward and punishment sensitivity in dysfunctional eating and hazardous drinking women: associations with family risk.

PubMed

Loxton, Natalie J; Dawe, Sharon

2006-11-01

Biologically based personality traits such as reward and punishment sensitivity, and family factors, such as maternal dysfunctional eating and parental alcohol abuse, have been linked to hazardous drinking and disordered eating. However, specific relationships between personality and family factors in the development of these disorders are still unclear. A total of 443 women completed measures of reward and punishment sensitivity, family environment, maternal eating and parental drinking. Reward sensitivity was directly associated with both dysfunctional eating and drinking. Punishment sensitivity was associated with dysfunctional eating but not hazardous drinking. Punishment sensitivity mediated a chaotic family environment and daughters' dysfunctional eating. It is suggested that reward and punishment sensitivity are key traits to examine when investigating vulnerability to risky behaviour. Future research into disordered eating is likely to be advanced by an active search for mediators and moderators of family risk.

Belief state representation in the dopamine system.

PubMed

Babayan, Benedicte M; Uchida, Naoshige; Gershman, Samuel J

2018-05-14

Learning to predict future outcomes is critical for driving appropriate behaviors. Reinforcement learning (RL) models have successfully accounted for such learning, relying on reward prediction errors (RPEs) signaled by midbrain dopamine neurons. It has been proposed that when sensory data provide only ambiguous information about which state an animal is in, it can predict reward based on a set of probabilities assigned to hypothetical states (called the belief state). Here we examine how dopamine RPEs and subsequent learning are regulated under state uncertainty. Mice are first trained in a task with two potential states defined by different reward amounts. During testing, intermediate-sized rewards are given in rare trials. Dopamine activity is a non-monotonic function of reward size, consistent with RL models operating on belief states. Furthermore, the magnitude of dopamine responses quantitatively predicts changes in behavior. These results establish the critical role of state inference in RL.

Effects of fictive reward on rat's choice behavior

PubMed Central

Kim, Ko-Un; Huh, Namjung; Jang, Yunsil; Lee, Daeyeol; Jung, Min Whan

2015-01-01

Choices of humans and non-human primates are influenced by both actually experienced and fictive outcomes. To test whether this is also the case in rodents, we examined rat's choice behavior in a binary choice task in which variable magnitudes of actual and fictive rewards were delivered. We found that the animal's choice was significantly influenced by the magnitudes of both actual and fictive rewards in the previous trial. A model-based analysis revealed, however, that the effect of fictive reward was more transient and influenced mostly the choice in the next trial, whereas the effect of actual reward was more sustained, consistent with incremental learning of action values. Our results suggest that the capacity to modify future choices based on fictive outcomes might be shared by many different animal species, but fictive outcomes are less effective than actual outcomes in the incremental value learning system. PMID:25623929

The gains and pains of being a cancer support group leader: a qualitative survey of rewards and challenges.

PubMed

Butow, Phyllis; Beeney, Linda; Juraskova, Ilona; Ussher, Jane; Zordan, Rachel

2009-01-01

Rewards derived from leading a cancer support group are poorly understood yet may be crucial to offset the challenges and difficulties of this role. This study sought to obtain the views of a representative sample of Australian cancer support group leaders (CSGLs) concerning the perceived rewards and challenges of their role. All CSGLs identified by the state-based Cancer Councils were invited to participate by postal questionnaire. Qualitative methods were used to analyze responses to open-ended questions concerning rewards and challenges. A total of 300 CSGLs returned the questionnaire (response rate = 66%) with 272 providing qualitative comments. Four parallel themes emerged from the qualitative analysis: (i) Personal, (ii) Relationship, (iii) Group, and (iv) Community rewards and challenges. These were integrated into a model depicting key positive and negative aspects of the CSGL's role, to provide direction for future training and ongoing support of CSGLs.

A mechanistic hypothesis of the factors that enhance vulnerability to nicotine use in females

PubMed Central

O'Dell, Laura E.; Torres, Oscar V.

2013-01-01

Women are particularly more vulnerable to tobacco use than men. This review proposes a unifying hypothesis that females experience greater rewarding effects of nicotine and more intense stress produced by withdrawal than males. We also provide a neural framework whereby estrogen promotes greater rewarding effects of nicotine in females via enhanced dopamine release in the nucleus accumbens (NAcc). During withdrawal, we suggest that corticotropin-releasing factor (CRF) stress systems are sensitized and promote a greater suppression of dopamine release in the NAcc of females versus males. Taken together, females display enhanced nicotine reward via estrogen and amplified effects of withdrawal via stress systems. Although this framework focuses on sex differences in adult rats, it is also applied to adolescent females who display enhanced rewarding effects of nicotine, but reduced effects of withdrawal from this drug. Since females experience strong rewarding effects of nicotine, a clinical implication of our hypothesis is that specific strategies to prevent smoking initiation among females are critical. Also, anxiolytic medications may be more effective in females that experience intense stress during withdrawal. Furthermore, medications that target withdrawal should not be applied in a unilateral manner across age and sex, given that nicotine withdrawal is lower during adolescence. This review highlights key factors that promote nicotine use in females, and future studies on sex-dependent interactions of stress and reward systems are needed to test our mechanistic hypotheses. Future studies in this area will have important translational value toward reducing health disparities produced by nicotine use in females. PMID:23684991

Risk, Reward, and Decision-Making in a Rodent Model of Cognitive Aging

PubMed Central

Gilbert, Ryan J.; Mitchell, Marci R.; Simon, Nicholas W.; Bañuelos, Cristina; Setlow, Barry; Bizon, Jennifer L.

2011-01-01

Impaired decision-making in aging can directly impact factors (financial security, health care) that are critical to maintaining quality of life and independence at advanced ages. Naturalistic rodent models mimic human aging in other cognitive domains, and afford the opportunity to parse the effects of age on discrete aspects of decision-making in a manner relatively uncontaminated by experiential factors. Young adult (5–7 months) and aged (23–25 months) male F344 rats were trained on a probability discounting task in which they made discrete-trial choices between a small certain reward (one food pellet) and a large but uncertain reward (two food pellets with varying probabilities of delivery ranging from 100 to 0%). Young rats chose the large reward when it was associated with a high probability of delivery and shifted to the small but certain reward as probability of the large reward decreased. As a group, aged rats performed comparably to young, but there was significantly greater variance among aged rats. One subgroup of aged rats showed strong preference for the small certain reward. This preference was maintained under conditions in which large reward delivery was also certain, suggesting decreased sensitivity to reward magnitude. In contrast, another subgroup of aged rats showed strong preference for the large reward at low probabilities of delivery. Interestingly, this subgroup also showed elevated preference for probabilistic rewards when reward magnitudes were equalized. Previous findings using this same aged study population described strongly attenuated discounting of delayed rewards with age, together suggesting that a subgroup of aged rats may have deficits associated with accounting for reward costs (i.e., delay or probability). These deficits in cost-accounting were dissociable from the age-related differences in sensitivity to reward magnitude, suggesting that aging influences multiple, distinct mechanisms that can impact cost–benefit decision-making. PMID:22319463

Risk, reward, and decision-making in a rodent model of cognitive aging.

PubMed

Gilbert, Ryan J; Mitchell, Marci R; Simon, Nicholas W; Bañuelos, Cristina; Setlow, Barry; Bizon, Jennifer L

2011-01-01

Impaired decision-making in aging can directly impact factors (financial security, health care) that are critical to maintaining quality of life and independence at advanced ages. Naturalistic rodent models mimic human aging in other cognitive domains, and afford the opportunity to parse the effects of age on discrete aspects of decision-making in a manner relatively uncontaminated by experiential factors. Young adult (5-7 months) and aged (23-25 months) male F344 rats were trained on a probability discounting task in which they made discrete-trial choices between a small certain reward (one food pellet) and a large but uncertain reward (two food pellets with varying probabilities of delivery ranging from 100 to 0%). Young rats chose the large reward when it was associated with a high probability of delivery and shifted to the small but certain reward as probability of the large reward decreased. As a group, aged rats performed comparably to young, but there was significantly greater variance among aged rats. One subgroup of aged rats showed strong preference for the small certain reward. This preference was maintained under conditions in which large reward delivery was also certain, suggesting decreased sensitivity to reward magnitude. In contrast, another subgroup of aged rats showed strong preference for the large reward at low probabilities of delivery. Interestingly, this subgroup also showed elevated preference for probabilistic rewards when reward magnitudes were equalized. Previous findings using this same aged study population described strongly attenuated discounting of delayed rewards with age, together suggesting that a subgroup of aged rats may have deficits associated with accounting for reward costs (i.e., delay or probability). These deficits in cost-accounting were dissociable from the age-related differences in sensitivity to reward magnitude, suggesting that aging influences multiple, distinct mechanisms that can impact cost-benefit decision-making.

The role of dopamine in reward and pleasure behaviour--review of data from preclinical research.

PubMed

Bressan, R A; Crippa, J A

2005-01-01

The purpose of this article is to review some of the basic aspects of the dopaminergic system and its role in reward and pleasure behaviour. We also discuss the association between dopamine and unpleasant symptoms that are commonly found in neuropsychiatric disorders and may also be side-effects of neuroleptic drugs. A computer-based search of the literature, augmented by extensive bibliography-guided article reviews, were used to find basic information on the dopamine and the reward systems, and symptoms such as dysphoria, anhedonia and depression. Central dopaminergic neurotransmission is complex, having multiple actions at each level of the mesocorticolimbic reward pathway. The role of dopamine in the reward process was classically associated with the ability to experience pleasure; recent data suggest a more motivational role. Dysfunction of the dopamine transmission in the reward circuit is associated with symptoms such as anhedonia, apathy and dysphoria found in several neuropsychiatric disorders, including Parkinson's disease, depression, drug addiction, and neuroleptic-induced dysphoria. Viewing the dysfunctions of the reward pathways within a broader spectrum and exploring its complex relations with the dopaminergic transmission may help understand the pathophysiology of these neuropsychiatric disorders and lead to a rational development of novel treatments.

Decodability of Reward Learning Signals Predicts Mood Fluctuations.

PubMed

Eldar, Eran; Roth, Charlotte; Dayan, Peter; Dolan, Raymond J

2018-05-07

Our mood often fluctuates without warning. Recent accounts propose that these fluctuations might be preceded by changes in how we process reward. According to this view, the degree to which reward improves our mood reflects not only characteristics of the reward itself (e.g., its magnitude) but also how receptive to reward we happen to be. Differences in receptivity to reward have been suggested to play an important role in the emergence of mood episodes in psychiatric disorders [1-16]. However, despite substantial theory, the relationship between reward processing and daily fluctuations of mood has yet to be tested directly. In particular, it is unclear whether the extent to which people respond to reward changes from day to day and whether such changes are followed by corresponding shifts in mood. Here, we use a novel mobile-phone platform with dense data sampling and wearable heart-rate and electroencephalographic sensors to examine mood and reward processing over an extended period of one week. Subjects regularly performed a trial-and-error choice task in which different choices were probabilistically rewarded. Subjects' choices revealed two complementary learning processes, one fast and one slow. Reward prediction errors [17, 18] indicative of these two processes were decodable from subjects' physiological responses. Strikingly, more accurate decodability of prediction-error signals reflective of the fast process predicted improvement in subjects' mood several hours later, whereas more accurate decodability of the slow process' signals predicted better mood a whole day later. We conclude that real-life mood fluctuations follow changes in responsivity to reward at multiple timescales. Copyright © 2018 The Author(s). Published by Elsevier Ltd.. All rights reserved.

Brain Activity in Valuation Regions while Thinking about the Future Predicts Individual Discount Rates

PubMed Central

Cooper, Nicole; Kim, B. Kyu; Zauberman, Gal

2013-01-01

People vary widely in how much they discount delayed rewards, yet little is known about the sources of these differences. Here we demonstrate that neural activity in ventromedial prefrontal cortex (VMPFC) and ventral striatum (VS) when human subjects are asked to merely think about the future—specifically, to judge the subjective length of future time intervals—predicts delay discounting. High discounters showed lower activity for longer time delays, while low discounters showed the opposite pattern. Our results demonstrate that the correlation between VMPFC and VS activity and discounting occurs even in the absence of choices about future rewards, and does not depend on a person explicitly evaluating future outcomes or judging their self-relevance. This suggests a link between discounting and basic processes involved in thinking about the future, such as temporal perception. Our results also suggest that reducing impatience requires not suppression of VMPFC and VS activity altogether, but rather modulation of how these regions respond to the present versus the future. PMID:23926268

Colour learning when foraging for nectar and pollen: bees learn two colours at once.

PubMed

Muth, Felicity; Papaj, Daniel R; Leonard, Anne S

2015-09-01

Bees are model organisms for the study of learning and memory, yet nearly all such research to date has used a single reward, nectar. Many bees collect both nectar (carbohydrates) and pollen (protein) on a single foraging bout, sometimes from different plant species. We tested whether individual bumblebees could learn colour associations with nectar and pollen rewards simultaneously in a foraging scenario where one floral type offered only nectar and the other only pollen. We found that bees readily learned multiple reward-colour associations, and when presented with novel floral targets generalized to colours similar to those trained for each reward type. These results expand the ecological significance of work on bee learning and raise new questions regarding the cognitive ecology of pollination. © 2015 The Author(s).

General functioning predicts reward and punishment learning in schizophrenia.

PubMed

Somlai, Zsuzsanna; Moustafa, Ahmed A; Kéri, Szabolcs; Myers, Catherine E; Gluck, Mark A

2011-04-01

Previous studies investigating feedback-driven reinforcement learning in patients with schizophrenia have provided mixed results. In this study, we explored the clinical predictors of reward and punishment learning using a probabilistic classification learning task. Patients with schizophrenia (n=40) performed similarly to healthy controls (n=30) on the classification learning task. However, more severe negative and general symptoms were associated with lower reward-learning performance, whereas poorer general psychosocial functioning was correlated with both lower reward- and punishment-learning performances. Multiple linear regression analyses indicated that general psychosocial functioning was the only significant predictor of reinforcement learning performance when education, antipsychotic dose, and positive, negative and general symptoms were included in the analysis. These results suggest a close relationship between reinforcement learning and general psychosocial functioning in schizophrenia. Published by Elsevier B.V.

Neural signal during immediate reward anticipation in schizophrenia: Relationship to real-world motivation and function.

PubMed

Subramaniam, Karuna; Hooker, Christine I; Biagianti, Bruno; Fisher, Melissa; Nagarajan, Srikantan; Vinogradov, Sophia

2015-01-01

Amotivation in schizophrenia is a central predictor of poor functioning, and is thought to occur due to deficits in anticipating future rewards, suggesting that impairments in anticipating pleasure can contribute to functional disability in schizophrenia. In healthy comparison (HC) participants, reward anticipation is associated with activity in frontal-striatal networks. By contrast, schizophrenia (SZ) participants show hypoactivation within these frontal-striatal networks during this motivated anticipatory brain state. Here, we examined neural activation in SZ and HC participants during the anticipatory phase of stimuli that predicted immediate upcoming reward and punishment, and during the feedback/outcome phase, in relation to trait measures of hedonic pleasure and real-world functional capacity. SZ patients showed hypoactivation in ventral striatum during reward anticipation. Additionally, we found distinct differences between HC and SZ groups in their association between reward-related immediate anticipatory neural activity and their reported experience of pleasure. HC participants recruited reward-related regions in striatum that significantly correlated with subjective consummatory pleasure, while SZ patients revealed activation in attention-related regions, such as the IPL, which correlated with consummatory pleasure and functional capacity. These findings may suggest that SZ patients activate compensatory attention processes during anticipation of immediate upcoming rewards, which likely contribute to their functional capacity in daily life.

Intranasal oxytocin increases neural responses to social reward in post-traumatic stress disorder

PubMed Central

van Zuiden, Mirjam; Koch, Saskia B.J.; Frijling, Jessie L.; Veltman, Dick J.; Olff, Miranda

2017-01-01

Abstract Therapeutic alliance and perceived social support are important predictors of treatment response for post-traumatic stress disorder (PTSD). Intranasal oxytocin administration may enhance treatment response by increasing sensitivity for social reward and thereby therapeutic alliance and perceived social support. As a first step to investigate this therapeutical potential, we investigated whether intranasal oxytocin enhances neural sensitivity to social reward in PTSD patients. Male and female police officers with (n = 35) and without PTSD (n = 37) were included in a double-blind, randomized, placebo-controlled cross-over fMRI study. After intranasal oxytocin (40 IU) and placebo administration, a social incentive delay task was conducted to investigate neural responses during social reward and punishment anticipation and feedback. Under placebo, PTSD patients showed reduced left anterior insula (AI) responses to social rewards (i.e. happy faces) compared with controls. Oxytocin administration increased left AI responses during social reward in PTSD patients, such that PTSD patients no longer differed from controls under placebo. Furthermore, in PTSD patients, oxytocin increased responses to social reward in the right putamen. By normalizing abberant insula responses and increasing putamen responses to social reward, oxytocin administration may enhance sensitivity for social support and therapeutic alliance in PTSD patients. Future studies are needed to investigate clinical effects of oxytocin. PMID:27614769

Neural signal during immediate reward anticipation in schizophrenia: Relationship to real-world motivation and function

PubMed Central

Subramaniam, Karuna; Hooker, Christine I.; Biagianti, Bruno; Fisher, Melissa; Nagarajan, Srikantan; Vinogradov, Sophia

2015-01-01

Amotivation in schizophrenia is a central predictor of poor functioning, and is thought to occur due to deficits in anticipating future rewards, suggesting that impairments in anticipating pleasure can contribute to functional disability in schizophrenia. In healthy comparison (HC) participants, reward anticipation is associated with activity in frontal–striatal networks. By contrast, schizophrenia (SZ) participants show hypoactivation within these frontal–striatal networks during this motivated anticipatory brain state. Here, we examined neural activation in SZ and HC participants during the anticipatory phase of stimuli that predicted immediate upcoming reward and punishment, and during the feedback/outcome phase, in relation to trait measures of hedonic pleasure and real-world functional capacity. SZ patients showed hypoactivation in ventral striatum during reward anticipation. Additionally, we found distinct differences between HC and SZ groups in their association between reward-related immediate anticipatory neural activity and their reported experience of pleasure. HC participants recruited reward-related regions in striatum that significantly correlated with subjective consummatory pleasure, while SZ patients revealed activation in attention-related regions, such as the IPL, which correlated with consummatory pleasure and functional capacity. These findings may suggest that SZ patients activate compensatory attention processes during anticipation of immediate upcoming rewards, which likely contribute to their functional capacity in daily life. PMID:26413478

A target sample of adolescents and reward processing: same neural and behavioral correlates engaged in common paradigms?

PubMed

Nees, Frauke; Vollstädt-Klein, Sabine; Fauth-Bühler, Mira; Steiner, Sabina; Mann, Karl; Poustka, Luise; Banaschewski, Tobias; Büchel, Christian; Conrod, Patricia J; Garavan, Hugh; Heinz, Andreas; Ittermann, Bernd; Artiges, Eric; Paus, Tomas; Pausova, Zdenka; Rietschel, Marcella; Smolka, Michael N; Struve, Maren; Loth, Eva; Schumann, Gunter; Flor, Herta

2012-11-01

Adolescence is a transition period that is assumed to be characterized by increased sensitivity to reward. While there is growing research on reward processing in adolescents, investigations into the engagement of brain regions under different reward-related conditions in one sample of healthy adolescents, especially in a target age group, are missing. We aimed to identify brain regions preferentially activated in a reaction time task (monetary incentive delay (MID) task) and a simple guessing task (SGT) in a sample of 14-year-old adolescents (N = 54) using two commonly used reward paradigms. Functional magnetic resonance imaging was employed during the MID with big versus small versus no win conditions and the SGT with big versus small win and big versus small loss conditions. Analyses focused on changes in blood oxygen level-dependent contrasts during reward and punishment processing in anticipation and feedback phases. We found clear magnitude-sensitive response in reward-related brain regions such as the ventral striatum during anticipation in the MID task, but not in the SGT. This was also true for reaction times. The feedback phase showed clear reward-related, but magnitude-independent, response patterns, for example in the anterior cingulate cortex, in both tasks. Our findings highlight neural and behavioral response patterns engaged in two different reward paradigms in one sample of 14-year-old healthy adolescents and might be important for reference in future studies investigating reward and punishment processing in a target age group.

Generational Association Studies of Dopaminergic Genes in Reward Deficiency Syndrome (RDS) Subjects: Selecting Appropriate Phenotypes for Reward Dependence Behaviors

PubMed Central

Blum, Kenneth; Chen, Amanda L. C.; Oscar-Berman, Marlene; Chen, Thomas J. H.; Lubar, Joel; White, Nancy; Lubar, Judith; Bowirrat, Abdalla; Braverman, Eric; Schoolfield, John; Waite, Roger L.; Downs, Bernard W.; Madigan, Margaret; Comings, David E.; Davis, Caroline; Kerner, Mallory M.; Knopf, Jennifer; Palomo, Tomas; Giordano, John J.; Morse, Siobhan A.; Fornari, Frank; Barh, Debmalya; Femino, John; Bailey, John A.

2011-01-01

Abnormal behaviors involving dopaminergic gene polymorphisms often reflect an insufficiency of usual feelings of satisfaction, or Reward Deficiency Syndrome (RDS). RDS results from a dysfunction in the “brain reward cascade,” a complex interaction among neurotransmitters (primarily dopaminergic and opioidergic). Individuals with a family history of alcoholism or other addictions may be born with a deficiency in the ability to produce or use these neurotransmitters. Exposure to prolonged periods of stress and alcohol or other substances also can lead to a corruption of the brain reward cascade function. We evaluated the potential association of four variants of dopaminergic candidate genes in RDS (dopamine D1 receptor gene [DRD1]; dopamine D2 receptor gene [DRD2]; dopamine transporter gene [DAT1]; dopamine beta-hydroxylase gene [DBH]). Methodology: We genotyped an experimental group of 55 subjects derived from up to five generations of two independent multiple-affected families compared to rigorously screened control subjects (e.g., N = 30 super controls for DRD2 gene polymorphisms). Data related to RDS behaviors were collected on these subjects plus 13 deceased family members. Results: Among the genotyped family members, the DRD2 Taq1 and the DAT1 10/10 alleles were significantly (at least p < 0.015) more often found in the RDS families vs. controls. The TaqA1 allele occurred in 100% of Family A individuals (N = 32) and 47.8% of Family B subjects (11 of 23). No significant differences were found between the experimental and control positive rates for the other variants. Conclusions: Although our sample size was limited, and linkage analysis is necessary, the results support the putative role of dopaminergic polymorphisms in RDS behaviors. This study shows the importance of a nonspecific RDS phenotype and informs an understanding of how evaluating single subset behaviors of RDS may lead to spurious results. Utilization of a nonspecific “reward” phenotype may be a paradigm shift in future association and linkage studies involving dopaminergic polymorphisms and other neurotransmitter gene candidates. PMID:22408582

Distinct representations for shifts of spatial attention and changes of reward contingencies in the human brain

PubMed Central

Tosoni, Annalisa; Shulman, Gordon L.; Pope, Anna L. W.; McAvoy, Mark P.; Corbetta, Maurizio

2012-01-01

Success in a dynamically changing world requires both rapid shifts of attention to the location of important objects and the detection of changes in motivational contingencies that may alter future behavior. Here we addressed the relationship between these two processes by measuring the blood-oxygenation-level-dependent (BOLD) signal during a visual search task in which the location and the color of a salient cue respectively indicated where a rewarded target would appear and the monetary gain (large or small) associated with its detection. While cues that either shifted or maintained attention were presented every 4 to 8 seconds, the reward magnitude indicated by the cue changed roughly every 30 seconds, allowing us to distinguish a change in expected reward magnitude from a maintained state of expected reward magnitude. Posterior cingulate cortex was modulated by cues signaling an increase in expected reward magnitude, but not by cues for shifting versus maintaining spatial attention. Dorsal fronto-parietal regions in precuneus and FEF also showed increased BOLD activity for changes in expected reward magnitude from low to high, but in addition showed large independent modulations for shifting versus maintaining attention. In particular, the differential activation for shifting versus maintaining attention was not affected by expected reward magnitude. These results indicate that BOLD activations for shifts of attention and increases in expected reward magnitude are largely separate. Finally, visual cortex showed sustained spatially selective signals that were significantly enhanced when greater reward magnitude was expected, but this reward-related modulation was not observed in spatially selective regions of dorsal fronto-parietal cortex. PMID:22578709

Delaying gratification depends on social trust

PubMed Central

Michaelson, Laura; de la Vega, Alejandro; Chatham, Christopher H.; Munakata, Yuko

2013-01-01

Delaying gratification is hard, yet predictive of important life outcomes, such as academic achievement and physical health. Prominent theories focus on the role of self-control, hypersensitivity to immediate rewards, and the cost of time spent waiting. However, delaying gratification may also require trust in people delivering future rewards as promised. To test the role of social trust, participants were presented with character vignettes and faces that varied in trustworthiness, and then choose between hypothetical smaller immediate or larger delayed rewards from those characters. Across two experiments, participants were less willing to wait for delayed rewards from less trustworthy characters, and perceived trustworthiness predicted willingness to delay gratification. These findings provide the first demonstration of a causal role for social trust in willingness to delay gratification, independent of other relevant factors, such as self-control or reward history. Thus, delaying gratification requires choosing not only a later reward, but a reward that is potentially less likely to be delivered, when there is doubt about the person promising it. Implications of this work include the need to revise prominent theories of delay of gratification, and new directions for interventions with populations characterized by impulsivity. PMID:23801977

Pediatric functional magnetic resonance neuroimaging: tactics for encouraging task compliance.

PubMed

Schlund, Michael W; Cataldo, Michael F; Siegle, Greg J; Ladouceur, Cecile D; Silk, Jennifer S; Forbes, Erika E; McFarland, Ashley; Iyengar, Satish; Dahl, Ronald E; Ryan, Neal D

2011-05-06

Neuroimaging technology has afforded advances in our understanding of normal and pathological brain function and development in children and adolescents. However, noncompliance involving the inability to remain in the magnetic resonance imaging (MRI) scanner to complete tasks is one common and significant problem. Task noncompliance is an especially significant problem in pediatric functional magnetic resonance imaging (fMRI) research because increases in noncompliance produces a greater risk that a study sample will not be representative of the study population. In this preliminary investigation, we describe the development and application of an approach for increasing the number of fMRI tasks children complete during neuroimaging. Twenty-eight healthy children ages 9-13 years participated. Generalization of the approach was examined in additional fMRI and event-related potential investigations with children at risk for depression, children with anxiety and children with depression (N=120). Essential features of the approach include a preference assessment for identifying multiple individualized rewards, increasing reinforcement rates during imaging by pairing tasks with chosen rewards and presenting a visual 'road map' listing tasks, rewards and current progress. Our results showing a higher percentage of fMRI task completion by healthy children provides proof of concept data for the recommended tactics. Additional support was provided by results showing our approach generalized to several additional fMRI and event-related potential investigations and clinical populations. We proposed that some forms of task noncompliance may emerge from less than optimal reward protocols. While our findings may not directly support the effectiveness of the multiple reward compliance protocol, increased attention to how rewards are selected and delivered may aid cooperation with completing fMRI tasks. The proposed approach contributes to the pediatric neuroimaging literature by providing a useful way to conceptualize and measure task noncompliance and by providing simple cost effective tactics for improving the effectiveness of common reward-based protocols.

Pediatric functional magnetic resonance neuroimaging: tactics for encouraging task compliance

PubMed Central

2011-01-01

Background Neuroimaging technology has afforded advances in our understanding of normal and pathological brain function and development in children and adolescents. However, noncompliance involving the inability to remain in the magnetic resonance imaging (MRI) scanner to complete tasks is one common and significant problem. Task noncompliance is an especially significant problem in pediatric functional magnetic resonance imaging (fMRI) research because increases in noncompliance produces a greater risk that a study sample will not be representative of the study population. Method In this preliminary investigation, we describe the development and application of an approach for increasing the number of fMRI tasks children complete during neuroimaging. Twenty-eight healthy children ages 9-13 years participated. Generalization of the approach was examined in additional fMRI and event-related potential investigations with children at risk for depression, children with anxiety and children with depression (N = 120). Essential features of the approach include a preference assessment for identifying multiple individualized rewards, increasing reinforcement rates during imaging by pairing tasks with chosen rewards and presenting a visual 'road map' listing tasks, rewards and current progress. Results Our results showing a higher percentage of fMRI task completion by healthy children provides proof of concept data for the recommended tactics. Additional support was provided by results showing our approach generalized to several additional fMRI and event-related potential investigations and clinical populations. Discussion We proposed that some forms of task noncompliance may emerge from less than optimal reward protocols. While our findings may not directly support the effectiveness of the multiple reward compliance protocol, increased attention to how rewards are selected and delivered may aid cooperation with completing fMRI tasks Conclusion The proposed approach contributes to the pediatric neuroimaging literature by providing a useful way to conceptualize and measure task noncompliance and by providing simple cost effective tactics for improving the effectiveness of common reward-based protocols. PMID:21548928

Hunger does not motivate reward in women remitted from anorexia nervosa.

PubMed

Wierenga, Christina E; Bischoff-Grethe, Amanda; Melrose, A James; Irvine, Zoe; Torres, Laura; Bailer, Ursula F; Simmons, Alan; Fudge, Julie L; McClure, Samuel M; Ely, Alice; Kaye, Walter H

2015-04-01

Hunger enhances sensitivity to reward, yet individuals with anorexia nervosa (AN) are not motivated to eat when starved. This study investigated brain response to rewards during hunger and satiated states to examine whether diminished response to reward could underlie food restriction in AN. Using a delay discounting monetary decision task known to discriminate brain regions contributing to processing of immediate rewards and cognitive control important for decision making regarding future rewards, we compared 23 women remitted from AN (RAN group; to reduce the confounding effects of starvation) with 17 healthy comparison women (CW group). Monetary rewards were used because the rewarding value of food may be confounded by anxiety in AN. Interactions of Group (RAN, CW) × Visit (hunger, satiety) revealed that, for the CW group, hunger significantly increased activation in reward salience circuitry (ventral striatum, dorsal caudate, anterior cingulate cortex) during processing of immediate reward, whereas satiety increased activation in cognitive control circuitry (ventrolateral prefrontal cortex, insula) during decision making. In contrast, brain response in reward and cognitive neurocircuitry did not differ during hunger and satiety in the RAN group. A main effect of group revealed elevated response in the middle frontal gyrus for the RAN group compared with the CW group. Women remitted from AN failed to increase activation of reward valuation circuitry when hungry and showed elevated response in cognitive control circuitry independent of metabolic state. Decreased sensitivity to the motivational drive of hunger may explain the ability of individuals with AN to restrict food when emaciated. Difficulties in valuating emotional salience may contribute to inabilities to appreciate the risks inherent in this disorder. Copyright © 2015 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

Community trust reduces myopic decisions of low-income individuals

PubMed Central

Jachimowicz, Jon M.; Chafik, Salah; Munrat, Sabeth; Prabhu, Jaideep C.; Weber, Elke U.

2017-01-01

Why do the poor make shortsighted choices in decisions that involve delayed payoffs? Foregoing immediate rewards for larger, later rewards requires that decision makers (i) believe future payoffs will occur and (ii) are not forced to take the immediate reward out of financial need. Low-income individuals may be both less likely to believe future payoffs will occur and less able to forego immediate rewards due to higher financial need; they may thus appear to discount the future more heavily. We propose that trust in one’s community—which, unlike generalized trust, we find does not covary with levels of income—can partially offset the effects of low income on myopic decisions. Specifically, we hypothesize that low-income individuals with higher community trust make less myopic intertemporal decisions because they believe their community will buffer, or cushion, against their financial need. In archival data and laboratory studies, we find that higher levels of community trust among low-income individuals lead to less myopic decisions. We also test our predictions with a 2-y community trust intervention in rural Bangladesh involving 121 union councils (the smallest rural administrative and local government unit) and find that residents in treated union councils show higher levels of community trust and make less myopic intertemporal choices than residents in control union councils. We discuss the implications of these results for the design of domestic and global policy interventions to help the poor make decisions that could alleviate poverty. PMID:28400516

Now for Me, Later for Us? Effects of Group Context on Temporal Discounting

PubMed Central

Charlton, Shawn R.; Yi, Richard; Porter, Caitlin; Carter, Anne E.; Bickel, Warren; Rachlin, Howard

2013-01-01

Delayed rewards are less valuable than immediate rewards. This well-established finding has focused almost entirely on individual outcomes. However, are delayed rewards similarly discounted if they are shared by a group? The current article reports on three experiments exploring the effect of group context on delay discounting. Results indicate that discount rates of individual and group rewards were highly correlated, but that respondents were more willing to wait (decreased discounting) for shared outcomes than for individual outcomes. An explanatory model is proposed suggesting that decreased discount rates in group contexts may be due to the way the effects of both delay and social discounting are combined. That is, in a group context, a person values both a future reward (discounted by delay) and a present reward to another person (discounted by the social distance between them). The results are explained by a combined discount function containing a delay factor and a factor representing the social distance between the decision maker and group members. Practical implications of the fact that shared consequences can increase individual self-control are also discussed. PMID:23641123

The "highs and lows" of the human brain on dopaminergics: Evidence from neuropharmacology.

PubMed

Martins, Daniel; Mehta, Mitul A; Prata, Diana

2017-09-01

Rewards are appetitive events that elicit approach. Ground-breaking findings from neurophysiological experiments in animals, alongside neuropharmacology and neuroimaging research in human samples have identified dopamine as the main neurochemical messenger of global reward processing in the brain. However, dopamine's contribution to the different components of reward processing remains to be precisely defined. To facilitate the informed design and interpretation of reward studies in humans, we have systematically reviewed all existing human pharmacological studies investigating how drug manipulation of the dopamine system affects reward-related behaviour and its neural correlates. Pharmacological experiments in humans face methodological challenges in terms of the: 1) specificity and safety of the available drugs for administration in humans, 2) uncertainties about pre- or post-synaptic modes of action, and 3) possible interactions with inter-individual neuropsychological or genotypic variables. In order to circumvent some of these limitations, future research should rely on the combination of different levels of observation, in integrative pharmaco-genetics-neurobehavioral approaches, to more completely characterize dopamine's role in both general and modality-specific processing of reward. Copyright © 2017 Elsevier Ltd. All rights reserved.

Temporal and probabilistic discounting of rewards in children and adolescents: effects of age and ADHD symptoms.

PubMed

Scheres, Anouk; Dijkstra, Marianne; Ainslie, Eleanor; Balkan, Jaclyn; Reynolds, Brady; Sonuga-Barke, Edmund; Castellanos, F Xavier

2006-01-01

This study investigated whether age and ADHD symptoms affected choice preferences in children and adolescents when they chose between (1) small immediate rewards and larger delayed rewards and (2) small certain rewards and larger probabilistic uncertain rewards. A temporal discounting (TD) task and a probabilistic discounting (PD) task were used to measure the degree to which the subjective value of a large reward decreased as one had to wait longer for it (TD), and as the probability of obtaining it decreased (PD). Rewards used were small amounts of money. In the TD task, the large reward (10 cents) was delayed by between 0 and 30s, and the immediate reward varied in magnitude (0-10 cents). In the PD task, receipt of the large reward (10 cents) varied in likelihood, with probabilities of 0, 0.25, 0.5, 0.75, and 1.0 used, and the certain reward varied in magnitude (0-10 cents). Age and diagnostic group did not affect the degree of PD of rewards: All participants made choices so that total gains were maximized. As predicted, young children, aged 6-11 years (n = 25) demonstrated steeper TD of rewards than adolescents, aged 12-17 years (n = 21). This effect remained significant even when choosing the immediate reward did not shorten overall task duration. This, together with the lack of interaction between TD task version and age, suggests that steeper discounting in young children is driven by reward immediacy and not by delay aversion. Contrary to our predictions, participants with ADHD (n = 22) did not demonstrate steeper TD of rewards than controls (n = 24). These results raise the possibility that strong preferences for small immediate rewards in ADHD, as found in previous research, depend on factors such as total maximum gain and the use of fixed versus varied delay durations. The decrease in TD as observed in adolescents compared to children may be related to developmental changes in the (dorsolateral) prefrontal cortex. Future research needs to investigate these possibilities.

Measures of Partial Knowledge and Unexpected Responses in Multiple-Choice Tests

ERIC Educational Resources Information Center

Chang, Shao-Hua; Lin, Pei-Chun; Lin, Zih-Chuan

2007-01-01

This study investigates differences in the partial scoring performance of examinees in elimination testing and conventional dichotomous scoring of multiple-choice tests implemented on a computer-based system. Elimination testing that uses the same set of multiple-choice items rewards examinees with partial knowledge over those who are simply…

Novelty Enhances Visual Salience Independently of Reward in the Parietal Lobe

PubMed Central

Foley, Nicholas C.; Jangraw, David C.; Peck, Christopher

2014-01-01

Novelty modulates sensory and reward processes, but it remains unknown how these effects interact, i.e., how the visual effects of novelty are related to its motivational effects. A widespread hypothesis, based on findings that novelty activates reward-related structures, is that all the effects of novelty are explained in terms of reward. According to this idea, a novel stimulus is by default assigned high reward value and hence high salience, but this salience rapidly decreases if the stimulus signals a negative outcome. Here we show that, contrary to this idea, novelty affects visual salience in the monkey lateral intraparietal area (LIP) in ways that are independent of expected reward. Monkeys viewed peripheral visual cues that were novel or familiar (received few or many exposures) and predicted whether the trial will have a positive or a negative outcome—i.e., end in a reward or a lack of reward. We used a saccade-based assay to detect whether the cues automatically attracted or repelled attention from their visual field location. We show that salience—measured in saccades and LIP responses—was enhanced by both novelty and positive reward associations, but these factors were dissociable and habituated on different timescales. The monkeys rapidly recognized that a novel stimulus signaled a negative outcome (and withheld anticipatory licking within the first few presentations), but the salience of that stimulus remained high for multiple subsequent presentations. Therefore, novelty can provide an intrinsic bonus for attention that extends beyond the first presentation and is independent of physical rewards. PMID:24899716

Diminished fronto-striatal activity during processing of monetary rewards and losses in pathological gambling

PubMed Central

Balodis, Iris M.; Kober, Hedy; Worhunsky, Patrick D.; Stevens, Michael C.; Pearlson, Godfrey D.; Potenza, Marc N.

2012-01-01

Background Mesocorticolimbic neurocircuitry and impulsivity have both been implicated in pathological gambling (PG) and in reward processing. However, the neural underpinnings of specific phases of reward and loss processing in PG and their relationships to impulsivity remain only partially understood. The present functional magnetic resonance imaging study examined brain activity associated with different phases of reward and loss processing in PG. Given an inverse relationship between ventral striatal recruitment during anticipation of monetary rewards and impulsivity in alcohol dependence, the current study explored whether a similar association might also be present in PG. Methods Fourteen adults with PG and 14 control comparison (CC) participants performed the Monetary Incentive Delay Task (MIDT) to identify brain activation changes associated with reward/loss prospect, reward/loss anticipation and reward/loss notification. Impulsivity was assessed separately using the Barratt Impulsiveness Scale. Results Relative to the CC group, the PG group exhibited significantly reduced activity in the ventromedial prefrontal cortex, insula and ventral striatum during several phases, including the prospect and anticipation phases of both gain and losses. Activity in the ventral striatum correlated inversely with levels of impulsivity in PG participants, consistent with prior findings in alcohol dependence. Conclusions Relatively decreased activity in cortico-striatal neurocircuitry during multiple phases of reward processing suggests consistent alterations in neurocircuitry underlying incentive valuation and loss prediction. Together with findings in alcohol dependence, these results suggest that impulsive tendencies in addictions may be reflected in diminished ventral striatal activations to reward anticipation and may represent targets for treatment development in addictions. PMID:22336565

Diminished frontostriatal activity during processing of monetary rewards and losses in pathological gambling.

PubMed

Balodis, Iris M; Kober, Hedy; Worhunsky, Patrick D; Stevens, Michael C; Pearlson, Godfrey D; Potenza, Marc N

2012-04-15

Mesocorticolimbic neurocircuitry and impulsivity have both been implicated in pathological gambling (PG) and in reward processing. However, the neural underpinnings of specific phases of reward and loss processing in PG and their relationships to impulsivity remain only partially understood. The present functional magnetic resonance imaging study examined brain activity associated with different phases of reward and loss processing in PG. Given an inverse relationship between ventral striatal recruitment during anticipation of monetary rewards and impulsivity in alcohol dependence, the current study explored whether a similar association might also be present in PG. Fourteen adults with PG and 14 control comparison participants performed the Monetary Incentive Delay Task to identify brain activation changes associated with reward/loss prospect, reward/loss anticipation, and reward/loss notification. Impulsivity was assessed separately using the Barratt Impulsiveness Scale. Relative to the control comparison group, the PG group exhibited significantly reduced activity in the ventromedial prefrontal cortex, insula, and ventral striatum during several phases, including the prospect and anticipation phases of both gains and losses. Activity in the ventral striatum correlated inversely with levels of impulsivity in PG participants, consistent with prior findings in alcohol dependence. Relatively decreased activity in corticostriatal neurocircuitry during multiple phases of reward processing suggests consistent alterations in neurocircuitry underlying incentive valuation and loss prediction. Together with findings in alcohol dependence, these results suggest that impulsive tendencies in addictions may be reflected in diminished ventral striatal activations to reward anticipation and may represent targets for treatment development in addictions. Copyright © 2012 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

Novelty enhances visual salience independently of reward in the parietal lobe.

PubMed

Foley, Nicholas C; Jangraw, David C; Peck, Christopher; Gottlieb, Jacqueline

2014-06-04

Novelty modulates sensory and reward processes, but it remains unknown how these effects interact, i.e., how the visual effects of novelty are related to its motivational effects. A widespread hypothesis, based on findings that novelty activates reward-related structures, is that all the effects of novelty are explained in terms of reward. According to this idea, a novel stimulus is by default assigned high reward value and hence high salience, but this salience rapidly decreases if the stimulus signals a negative outcome. Here we show that, contrary to this idea, novelty affects visual salience in the monkey lateral intraparietal area (LIP) in ways that are independent of expected reward. Monkeys viewed peripheral visual cues that were novel or familiar (received few or many exposures) and predicted whether the trial will have a positive or a negative outcome--i.e., end in a reward or a lack of reward. We used a saccade-based assay to detect whether the cues automatically attracted or repelled attention from their visual field location. We show that salience--measured in saccades and LIP responses--was enhanced by both novelty and positive reward associations, but these factors were dissociable and habituated on different timescales. The monkeys rapidly recognized that a novel stimulus signaled a negative outcome (and withheld anticipatory licking within the first few presentations), but the salience of that stimulus remained high for multiple subsequent presentations. Therefore, novelty can provide an intrinsic bonus for attention that extends beyond the first presentation and is independent of physical rewards. Copyright © 2014 the authors 0270-6474/14/347947-11$15.00/0.

Influence of ventral tegmental area input on cortico-subcortical networks underlying action control and decision making.

PubMed

Richter, Anja; Gruber, Oliver

2018-02-01

It is argued that the mesolimbic system has a more general function in processing all salient events, including and extending beyond rewards. Saliency was defined as an event that is unexpected due to its frequency of occurrence and elicits an attentional-behavioral switch. Using functional magnetic resonance imaging (fMRI), signals were measured in response to the modulation of salience of rewarding and nonrewarding events during a reward-based decision making task, the so called desire-reason dilemma paradigm (DRD). Replicating previous findings, both frequent and infrequent, and therefore salient, reward stimuli elicited reliable activation of the ventral tegmental area (VTA) and ventral striatum (vStr). When immediate reward desiring contradicted the superordinate task-goal, we found an increased activation of the VTA and vStr when the salient reward stimuli were presented compared to the nonsalient reward stimuli, indicating a boosting of activation in these brain regions. Furthermore, we found a significantly increased functional connectivity between the VTA and vStr, confirming the boosting of vStr activation via VTA input. Moreover, saliency per se without a reward association led to an increased activation of brain regions in the mesolimbic reward system as well as the orbitofrontal cortex (OFC), inferior frontal gyrus (IFG), and anterior cingulate cortex (ACC). Finally, findings uncovered multiple increased functional interactions between cortical saliency-processing brain areas and the VTA and vStr underlying detection and processing of salient events and adaptive decision making. © 2017 Wiley Periodicals, Inc.

Reactivation of Reward-Related Patterns from Single Past Episodes Supports Memory-Based Decision Making.

PubMed

Wimmer, G Elliott; Büchel, Christian

2016-03-09

Rewarding experiences exert a strong influence on later decision making. While decades of neuroscience research have shown how reinforcement gradually shapes preferences, decisions are often influenced by single past experiences. Surprisingly, relatively little is known about the influence of single learning episodes. Although recent work has proposed a role for episodes in decision making, it is largely unknown whether and how episodic experiences contribute to value-based decision making and how the values of single episodes are represented in the brain. In multiple behavioral experiments and an fMRI experiment, we tested whether and how rewarding episodes could support later decision making. Participants experienced episodes of high reward or low reward in conjunction with incidental, trial-unique neutral pictures. In a surprise test phase, we found that participants could indeed remember the associated level of reward, as evidenced by accurate source memory for value and preferences to re-engage with rewarded objects. Further, in a separate experiment, we found that high-reward objects shown as primes before a gambling task increased financial risk taking. Neurally, re-exposure to objects in the test phase led to significant reactivation of reward-related patterns. Importantly, individual variability in the strength of reactivation predicted value memory performance. Our results provide a novel demonstration that affect-related neural patterns are reactivated during later experience. Reactivation of value information represents a mechanism by which memory can guide decision making. Copyright © 2016 the authors 0270-6474/16/362868-13$15.00/0.

The Dopamine Prediction Error: Contributions to Associative Models of Reward Learning

PubMed Central

Nasser, Helen M.; Calu, Donna J.; Schoenbaum, Geoffrey; Sharpe, Melissa J.

2017-01-01

Phasic activity of midbrain dopamine neurons is currently thought to encapsulate the prediction-error signal described in Sutton and Barto’s (1981) model-free reinforcement learning algorithm. This phasic signal is thought to contain information about the quantitative value of reward, which transfers to the reward-predictive cue after learning. This is argued to endow the reward-predictive cue with the value inherent in the reward, motivating behavior toward cues signaling the presence of reward. Yet theoretical and empirical research has implicated prediction-error signaling in learning that extends far beyond a transfer of quantitative value to a reward-predictive cue. Here, we review the research which demonstrates the complexity of how dopaminergic prediction errors facilitate learning. After briefly discussing the literature demonstrating that phasic dopaminergic signals can act in the manner described by Sutton and Barto (1981), we consider how these signals may also influence attentional processing across multiple attentional systems in distinct brain circuits. Then, we discuss how prediction errors encode and promote the development of context-specific associations between cues and rewards. Finally, we consider recent evidence that shows dopaminergic activity contains information about causal relationships between cues and rewards that reflect information garnered from rich associative models of the world that can be adapted in the absence of direct experience. In discussing this research we hope to support the expansion of how dopaminergic prediction errors are thought to contribute to the learning process beyond the traditional concept of transferring quantitative value. PMID:28275359

The influence of motherhood on neural systems for reward processing in low income, minority, young women.

PubMed

Moses-Kolko, Eydie L; Forbes, Erika E; Stepp, Stephanie; Fraser, David; Keenan, Kate E; Guyer, Amanda E; Chase, Henry W; Phillips, Mary L; Zevallos, Carlos R; Guo, Chaohui; Hipwell, Alison E

2016-04-01

Given the association between maternal caregiving behavior and heightened neural reward activity in experimental animal studies, the present study examined whether motherhood in humans positively modulates reward-processing neural circuits, even among mothers exposed to various life stressors and depression. Subjects were 77 first-time mothers and 126 nulliparous young women from the Pittsburgh Girls Study, a longitudinal study beginning in childhood. Subjects underwent a monetary reward task during functional magnetic resonance imaging in addition to assessment of current depressive symptoms. Life stress was measured by averaging data collected between ages 8-15 years. Using a region-of-interest approach, we conducted hierarchical regression to examine the relationship of psychosocial factors (life stress and current depression) and motherhood with extracted ventral striatal (VST) response to reward anticipation. Whole-brain regression analyses were performed post-hoc to explore non-striatal regions associated with reward anticipation in mothers vs nulliparous women. Anticipation of monetary reward was associated with increased neural activity in expected regions including caudate, orbitofrontal, occipital, superior and middle frontal cortices. There was no main effect of motherhood nor motherhood-by-psychosocial factor interaction effect on VST response during reward anticipation. Depressive symptoms were associated with increased VST activity across the entire sample. In exploratory whole brain analysis, motherhood was associated with increased somatosensory cortex activity to reward (FWE cluster forming threshold p<0.001). These findings indicate that motherhood is not associated with reward anticipation-related VST activity nor does motherhood modulate the impact of depression or life stress on VST activity. Future studies are needed to evaluate whether earlier postpartum assessment of reward function, inclusion of mothers with more severe depressive symptoms, and use of reward tasks specific for social reward might reveal an impact of motherhood on reward system activity. Copyright © 2016 Elsevier Ltd. All rights reserved.

Is brain response to food rewards related to overeating? A test of the reward surfeit model of overeating in children.

PubMed

Adise, Shana; Geier, Charles F; Roberts, Nicole J; White, Corey N; Keller, Kathleen L

2018-06-08

The reward surfeit model of overeating suggests that heightened brain response to rewards contributes to overeating and subsequent weight gain. However, previous studies have not tested whether brain response to reward is associated with food intake, particularly during childhood, a period of dynamic development in reward and inhibitory control neurocircuitry. We conducted functional magnetic resonance imaging (fMRI) with 7-11-year-old children (n = 59; healthy weight, n = 31; overweight, n = 28; 54% female) while they played a modified card-guessing paradigm to examine blood-oxygen-level-dependent (BOLD) response to anticipating and winning rewards (food, money, neutral). Food intake was assessed at three separate meals that measured different facets of eating behavior: 1) typical consumption (baseline), 2) overindulgence (palatable buffet), and 3) eating in the absence of hunger (EAH). A priori regions of interest included regions implicated in both reward processing and inhibitory control. Multiple stepwise regressions were conducted to examine the relationship between intake and BOLD response to rewards. Corrected results showed that a greater BOLD response in the medial prefrontal cortex for anticipating food compared to money positively correlated with how much children ate at the baseline and palatable buffet meals. BOLD response in the dorsolateral prefrontal cortex for winning food compared to money was positively correlated with intake at the palatable buffet meal and EAH. All aforementioned relationships were independent of child weight status. Findings support the reward surfeit model by showing that increased brain response to food compared to money rewards positively correlates with laboratory measures of food intake in children. Copyright © 2018. Published by Elsevier Ltd.

Ejaculation Induced by the Activation of Crz Neurons Is Rewarding to Drosophila Males.

PubMed

Zer-Krispil, Shir; Zak, Hila; Shao, Lisha; Ben-Shaanan, Shir; Tordjman, Lea; Bentzur, Assa; Shmueli, Anat; Shohat-Ophir, Galit

2018-05-07

The reward system is a collection of circuits that reinforce behaviors necessary for survival [1, 2]. Given the importance of reproduction for survival, actions that promote successful mating induce pleasurable feeling and are positively reinforced [3, 4]. This principle is conserved in Drosophila, where successful copulation is naturally rewarding to male flies, induces long-term appetitive memories [5], increases brain levels of neuropeptide F (NPF, the fly homolog of neuropeptide Y), and prevents ethanol, known otherwise as rewarding to flies [6, 7], from being rewarding [5]. It is not clear which of the multiple sensory and motor responses performed during mating induces perception of reward. Sexual interactions with female flies that do not reach copulation are not sufficient to reduce ethanol consumption [5], suggesting that only successful mating encounters are rewarding. Here, we uncoupled the initial steps of mating from its final steps and tested the ability of ejaculation to mimic the rewarding value of full copulation. We induced ejaculation by activating neurons that express the neuropeptide corazonin (CRZ) [8] and subsequently measured different aspects of reward. We show that activating Crz-expressing neurons is rewarding to male flies, as they choose to reside in a zone that triggers optogenetic stimulation of Crz neurons and display conditioned preference for an odor paired with the activation. Reminiscent of successful mating, repeated activation of Crz neurons increases npf levels and reduces ethanol consumption. Our results demonstrate that ejaculation stimulated by Crz/Crz-receptor signaling serves as an essential part of the mating reward mechanism in Drosophila. VIDEO ABSTRACT. Copyright © 2018 The Authors. Published by Elsevier Ltd.. All rights reserved.

The Serotonin 2C Receptor Agonist Lorcaserin Attenuates Intracranial Self-Stimulation and Blocks the Reward-Enhancing Effects of Nicotine.

PubMed

Zeeb, Fiona D; Higgins, Guy A; Fletcher, Paul J

2015-07-15

Lorcaserin, a serotonin (5-hydroxytryptamine, 5-HT) 2C receptor agonist, was recently approved for the treatment of obesity. We previously suggested that 5-HT2C receptor agonists affect reward processes and reduce the rewarding effects of drugs of abuse. Here, we determined whether lorcaserin (1) decreases responding for brain stimulation reward (BSR) and (2) prevents nicotine from enhancing the efficacy of BSR. Rats were trained on the intracranial self-stimulation (ICSS) paradigm to nosepoke for BSR of either the dorsal raphé nucleus or left medial forebrain bundle. In Experiment 1, lorcaserin (0.3-1.0 mg/kg) dose-dependently reduced the efficacy of BSR. This effect was blocked by prior administration of the 5-HT2C receptor antagonist SB242084. In Experiment 2, separate groups of rats received saline or nicotine (0.4 mg/kg) for eight sessions prior to testing. Although thresholds were unaltered in saline-treated rats, nicotine reduced reward thresholds. An injection of lorcaserin (0.3 mg/kg) prior to nicotine prevented the reward-enhancing effect of nicotine across multiple test sessions. These results demonstrated that lorcaserin reduces the rewarding value of BSR and also prevents nicotine from facilitating ICSS. Hence, lorcaserin may be effective in treating psychiatric disorders, including obesity and nicotine addiction, by reducing the value of food or drug rewards.

Mechanisms of value-learning in the guidance of spatial attention.

PubMed

Anderson, Brian A; Kim, Haena

2018-05-11

The role of associative reward learning in the guidance of feature-based attention is well established. The extent to which reward learning can modulate spatial attention has been much more controversial. At least one demonstration of a persistent spatial attention bias following space-based associative reward learning has been reported. At the same time, multiple other experiments have been published failing to demonstrate enduring attentional biases towards locations at which a target, if found, yields high reward. This is in spite of evidence that participants use reward structures to inform their decisions where to search, leading some to suggest that, unlike feature-based attention, spatial attention may be impervious to the influence of learning from reward structures. Here, we demonstrate a robust bias towards regions of a scene that participants were previously rewarded for selecting. This spatial bias relies on representations that are anchored to the configuration of objects within a scene. The observed bias appears to be driven specifically by reinforcement learning, and can be observed with equal strength following non-reward corrective feedback. The time course of the bias is consistent with a transient shift of attention, rather than a strategic search pattern, and is evident in eye movement patterns during free viewing. Taken together, our findings reconcile previously conflicting reports and offer an integrative account of how learning from feedback shapes the spatial attention system. Copyright © 2018 Elsevier B.V. All rights reserved.

Dissociation of hedonic reaction to reward and incentive motivation in an animal model of the negative symptoms of schizophrenia.

PubMed

Ward, Ryan D; Simpson, Eleanor H; Richards, Vanessa L; Deo, Gita; Taylor, Kathleen; Glendinning, John I; Kandel, Eric R; Balsam, Peter D

2012-06-01

We previously showed that mice that selectively and reversibly overexpress striatal D2 receptors (D2R-OE) model the negative symptoms of schizophrenia. Specifically, D2R-OE mice display a deficit in incentive motivation. The present studies investigated the basis for this deficit. First, we assessed whether hedonic reaction to reward is intact in D2R-OE mice. We assessed licking behavior and video-scored positive hedonic facial reactions to increasing concentrations of sucrose in control and D2R-OE mice. We found no difference between D2R-OE mice and controls in hedonic reactions. To further understand the basis of the motivational deficit, mice were given a choice between pressing a lever for access to a preferred reward (evaporated milk) or consuming a freely available less preferred reward (home-cage chow). D2R-OE mice pressed less for the preferred milk and consumed more of the freely available less preferred chow, indicating that striatal overexpression of postsynaptic D2Rs can alter cost/benefit computations, leading to a motivational deficit. This motivational impairment was ameliorated when the transgene was turned off and D2R levels were normalized. Such a deficit may arise from impaired ability to represent the value of future rewards. To test this, we used operant concurrent schedules and found reduced sensitivity to the value of future outcomes in D2R-OE mice. These results demonstrate for the first time in a transgenic animal model of schizophrenia a dissociation between hedonic reaction to reward and incentive motivation, and show a striking parallel to the proposed neurobiological and psychological mechanisms of impaired incentive motivation in schizophrenia.

Binding oneself to the mast: stimulating frontopolar cortex enhances precommitment

PubMed Central

Ugazio, Giuseppe; Crockett, Molly J.; Ruff, Christian C.; Kalenscher, Tobias; Tobler, Philippe N.

2017-01-01

Abstract Humans often give in to temptations that are in conflict with valuable long-term goals like health or saving for the future. Such willpower failures represent a prevalent problem in everyday life and in many psychiatric disorders. Strategies that increase resistance to temptations could therefore improve overall societal well-being. One important strategy is to voluntarily precommit, i.e. to restrict one’s future action space by removing the tempting short-term option from the choice set, thereby leaving only the long-term option for implementation. The neural mechanisms necessary to implement precommitment have remained unknown. Here, we test whether anodal transcranial direct current stimulation (tDCS) over the frontopolar cortex (FPC) can improve precommitment. Participants performed a self-control task in which they could precommit to obtain a delayed larger reward by removing an immediately available smaller reward from the future choice options. We found that anodal stimulation over FPC selectively increased the propensity to precommit. In contrast, tDCS had no effects on non-binding decisions, impulse control or reward preference. Our data establish a causal role for the FPC in the implementation of precommitment, revealing a novel route to improving resistance against temptations. PMID:28170049

Insight Into the Relationship Between Impulsivity and Substance Abuse From Studies Using Animal Models

PubMed Central

Winstanley, Catharine A.; Olausson, Peter; Taylor, Jane R.; Jentsch, J. David

2010-01-01

Drug use disorders are often accompanied by deficits in the capacity to efficiently process reward-related information and to monitor, suppress, or override reward-controlled behavior when goals are in conflict with aversive or immediate outcomes. This emerging deficit in behavioral flexibility and impulse control may be a central component of the progression to addiction, as behavior becomes increasingly driven by drugs and drug-associated cues at the expense of more advantageous activities. Understanding how neural mechanisms implicated in impulse control are affected by addictive drugs may therefore prove a useful strategy in the search for new treatment options. Animal models of impulsivity and addiction could make a significant contribution to this endeavor. Here, some of the more common behavioral paradigms used to measure different aspects of impulsivity across species are outlined, and the importance of the response to reward-paired cues in such paradigms is discussed. Naturally occurring differences in forms of impulsivity have been found to be predictive of future drug self-administration, but drug exposure can also increase impulsive responding. Such data are in keeping with the suggestion that impulsivity may contribute to multiple stages within the spiral of addiction. From a neurobiological perspective, converging evidence from rat, monkey, and human studies suggest that compromised functioning within the orbitofrontal cortex may critically contribute to the cognitive sequelae of drug abuse. Changes in gene transcription and protein expression within this region may provide insight into the mechanism underlying drug-induced cortical hypofunction, reflecting new molecular targets for the treatment of uncontrolled drug-seeking and drug-taking behavior. PMID:20491734

Computational approaches to schizophrenia: A perspective on negative symptoms.

PubMed

Deserno, Lorenz; Heinz, Andreas; Schlagenhauf, Florian

2017-08-01

Schizophrenia is a heterogeneous spectrum disorder often associated with detrimental negative symptoms. In recent years, computational approaches to psychiatry have attracted growing attention. Negative symptoms have shown some overlap with general cognitive impairments and were also linked to impaired motivational processing in brain circuits implementing reward prediction. In this review, we outline how computational approaches may help to provide a better understanding of negative symptoms in terms of the potentially underlying behavioural and biological mechanisms. First, we describe the idea that negative symptoms could arise from a failure to represent reward expectations to enable flexible behavioural adaptation. It has been proposed that these impairments arise from a failure to use prediction errors to update expectations. Important previous studies focused on processing of so-called model-free prediction errors where learning is determined by past rewards only. However, learning and decision-making arise from multiple cognitive mechanisms functioning simultaneously, and dissecting them via well-designed tasks in conjunction with computational modelling is a promising avenue. Second, we move on to a proof-of-concept example on how generative models of functional imaging data from a cognitive task enable the identification of subgroups of patients mapping on different levels of negative symptoms. Combining the latter approach with behavioural studies regarding learning and decision-making may allow the identification of key behavioural and biological parameters distinctive for different dimensions of negative symptoms versus a general cognitive impairment. We conclude with an outlook on how this computational framework could, at some point, enrich future clinical studies. Copyright © 2016. Published by Elsevier B.V.

Family history density of alcoholism relates to left nucleus accumbens volume in adolescent girls.

PubMed

Cservenka, Anita; Gillespie, Alicia J; Michael, Paul G; Nagel, Bonnie J

2015-01-01

A family history of alcoholism is a significant risk factor for the development of alcohol use disorders (AUDs). Because common structural abnormalities are present in reward and affective brain regions in alcoholics and those with familial alcoholism, the current study examined the relationship between familial loading of AUDs and volumes of the amygdala and nucleus accumbens (NAcc) in largely alcohol-naive adolescents, ages 12-16 years (N = 140). The amygdala and NAcc were delineated on each participant's T1-weighted anatomical scan, using FMRIB Software Library's FMRIB Integrated Registration & Segmentation Tool, and visually inspected for accuracy and volume outliers. In the 140 participants with accurate segmentation (75 male/65 female), subcortical volumes were represented as a ratio to intracranial volume (ICV). A family history density (FHD) score was calculated for each adolescent based on the presence of AUDs in first- and second-degree relatives (range: 0.03-1.50; higher scores represent a greater prevalence of familial AUDs). Multiple regressions, with age and sex controlled for, examined the association between FHD and left and right amygdala and NAcc volume/ICV. There was a significant positive relationship between FHD and left NAcc volume/ICV (ΔR² = .04, p = .02). Post hoc regressions indicated that this effect was only significant in females (ΔR² = .11, p = .006). This finding suggests that the degree of familial alcoholism, genetic or otherwise, is associated with alterations in reward-related brain structure. Further work will be necessary to examine whether FHD is related to future alcohol-related problems and reward-related behaviors.

Pavlovian conditioning to food reward as a function of eating disorder risk.

PubMed

Astur, Robert S; Palmisano, Alexandra N; Hudd, Ellie C; Carew, Andrew W; Deaton, Bonnie E; Kuhney, Franchesca S; Niezrecki, Rachel N; Santos, Melissa

2015-09-15

The aim of this experiment was to examine the extent to which eating disorder risk affects the strength of food-reward conditioning. Eighty food-restricted undergraduates were placed into a VR environment consisting of two visually distinct rooms. Participants underwent multiple pairing sessions in which they were confined into one of the two rooms and explored a VR environment. Room A was paired with real-life M&Ms for three sessions, and Room B was paired with no food for three sessions. After a short delay, a test session was administered, and participants were given free access to the entire VR environment for 5 min. Participants also completed the Eating Attitudes Test (EAT-26; [11]), which is a standard screening tool of eating disorder risk. Participants displayed a significant conditioned place preference for the VR room previously paired with food, and they displayed a significant explicit preference for the M&M-paired room in a forced-choice test. There was a significant positive correlation between place preference strength and scores on the dieting subscale of the EAT-26. Additionally, ratings of the no-food room were significantly lower as dieting scores increased. This suggests that components of eating disorder risk can influence basic conditioning strength to places associated with food reward. For both males and females, additional correlations between eating disorder risk subscales and conditioning variables are discussed, and implications for future research are proposed in hopes of understanding how conditioning paradigms can provide insight into treating and preventing eating disorders. Copyright © 2015 Elsevier B.V. All rights reserved.

Convergence of EEG and fMRI measures of reward anticipation.

PubMed

Gorka, Stephanie M; Phan, K Luan; Shankman, Stewart A

2015-12-01

Deficits in reward anticipation are putative mechanisms for multiple psychopathologies. Research indicates that these deficits are characterized by reduced left (relative to right) frontal electroencephalogram (EEG) activity and blood oxygenation level-dependent (BOLD) signal abnormalities in mesolimbic and prefrontal neural regions during reward anticipation. Although it is often assumed that these two measures capture similar mechanisms, no study to our knowledge has directly examined the convergence between frontal EEG alpha asymmetry and functional magnetic resonance imaging (fMRI) during reward anticipation in the same sample. Therefore, the aim of the current study was to investigate if and where in the brain frontal EEG alpha asymmetry and fMRI measures were correlated in a sample of 40 adults. All participants completed two analogous reward anticipation tasks--once during EEG data collection and the other during fMRI data collection. Results indicated that the two measures do converge and that during reward anticipation, increased relative left frontal activity is associated with increased left anterior cingulate cortex (ACC)/medial prefrontal cortex (mPFC) and left orbitofrontal cortex (OFC) activation. This suggests that the two measures may similarly capture PFC functioning, which is noteworthy given the role of these regions in reward processing and the pathophysiology of disorders such as depression and schizophrenia. Copyright © 2015 Elsevier B.V. All rights reserved.

Neural correlates of pathological gamblers preference for immediate rewards during the iowa gambling task: an fMRI study.

PubMed

Power, Yuri; Goodyear, Bradley; Crockford, David

2012-12-01

The Iowa Gambling Task (IGT) involves exploratory learning via rewards and penalties, where most advantageous task performance requires subjects to forego potential large immediate rewards for small longer-term rewards to avoid larger punishments. Pathological gambling (PG) subjects perform worse on the IGT compared to controls, relating to their persistence at high risk decisions involving the continued choice of potential large immediate rewards despite experiencing larger punishments. We wished to determine if neural processing of risk and reward within striatal and frontal cortex is associated with this behaviour observed in PG. Functional magnetic resonance imaging (fMRI) was used to assess brain activity in response to a computerized version of the IGT. Thirteen male PG subjects with no active comorbidities were compared to 13 demographically matched control subjects. In agreement with previous behavioural studies, PG subjects performed worse on the IGT and made more high-risk choices compared to controls, particularly after experiencing wins and losses. During high-risk gambling decisions, fMRI demonstrated that PG subjects exhibited relatively increased frontal lobe and basal ganglia activation, particularly involving the orbitofrontal cortex (OFC), caudate and amygdala. Increased activation of regions encompassing the extended reward pathway in PG subjects during high risk choices suggests that the persistence of PG may be due to the increased salience of immediate and greater potential monetary rewards relative to lower monetary rewards or potential future losses. Whether this over activation of the reward pathway is associated with the development of PG warrants further investigation.

Distinct representations for shifts of spatial attention and changes of reward contingencies in the human brain.

PubMed

Tosoni, Annalisa; Shulman, Gordon L; Pope, Anna L W; McAvoy, Mark P; Corbetta, Maurizio

2013-06-01

Success in a dynamically changing world requires both rapid shifts of attention to the location of important objects and the detection of changes in motivational contingencies that may alter future behavior. Here we addressed the relationship between these two processes by measuring the blood-oxygenation-level-dependent (BOLD) signal during a visual search task in which the location and the color of a salient cue respectively indicated where a rewarded target would appear and the monetary gain (large or small) associated with its detection. While cues that either shifted or maintained attention were presented every 4 to 8 sec, the reward magnitude indicated by the cue changed roughly every 30 sec, allowing us to distinguish a change in expected reward magnitude from a maintained state of expected reward magnitude. Posterior cingulate cortex was modulated by cues signaling an increase in expected reward magnitude, but not by cues for shifting versus maintaining spatial attention. Dorsal fronto-parietal regions in precuneus and frontal eye field (FEF) also showed increased BOLD activity for changes in expected reward magnitude from low to high, but in addition showed large independent modulations for shifting versus maintaining attention. In particular, the differential activation for shifting versus maintaining attention was not affected by expected reward magnitude. These results indicate that BOLD activations for shifts of attention and increases in expected reward magnitude are largely separate. Finally, visual cortex showed sustained spatially selective signals that were significantly enhanced when greater reward magnitude was expected, but this reward-related modulation was not observed in spatially selective regions of dorsal fronto-parietal cortex. Copyright © 2012 Elsevier Ltd. All rights reserved.

Altered reward system reactivity for personalized circumscribed interests in autism.

PubMed

Kohls, Gregor; Antezana, Ligia; Mosner, Maya G; Schultz, Robert T; Yerys, Benjamin E

2018-01-01

Neurobiological research in autism spectrum disorders (ASD) has paid little attention on brain mechanisms that cause and maintain restricted and repetitive behaviors and interests (RRBIs). Evidence indicates an imbalance in the brain's reward system responsiveness to social and non-social stimuli may contribute to both social deficits and RRBIs. Thus, this study's central aim was to compare brain responsiveness to individual RRBI (i.e., circumscribed interests), with social rewards (i.e., social approval), in youth with ASD relative to typically developing controls (TDCs). We conducted a 3T functional magnetic resonance imaging (fMRI) study to investigate the blood-oxygenation-level-dependent effect of personalized circumscribed interest rewards versus social rewards in 39 youth with ASD relative to 22 TDC. To probe the reward system, we employed short video clips as reinforcement in an instrumental incentive delay task. This optimization increased the task's ecological validity compared to still pictures that are often used in this line of research. Compared to TDCs, youth with ASD had stronger reward system responses for CIs mostly within the non-social realm (e.g., video games) than social rewards (e.g., approval). Additionally, this imbalance within the caudate nucleus' responsiveness was related to greater social impairment. The current data support the idea of reward system dysfunction that may contribute to enhanced motivation for RRBIs in ASD, accompanied by diminished motivation for social engagement. If a dysregulated reward system indeed supports the emergence and maintenance of social and non-social symptoms of ASD, then strategically targeting the reward system in future treatment endeavors may allow for more efficacious treatment practices that help improve outcomes for individuals with ASD and their families.

Decisions in Motion: Decision Dynamics during Intertemporal Choice reflect Subjective Evaluation of Delayed Rewards

NASA Astrophysics Data System (ADS)

O'Hora, Denis; Carey, Rachel; Kervick, Aoife; Crowley, David; Dabrowski, Maciej

2016-02-01

People tend to discount rewards or losses that occur in the future. Such delay discounting has been linked to many behavioral and health problems, since people choose smaller short-term gains over greater long-term gains. We investigated whether the effect of delays on the subjective value of rewards is expressed in how people move when they make choices. Over 600 patrons of the RISK LAB exhibition hosted by the Science Gallery DublinTM played a short computer game in which they used a computer mouse to choose between amounts of money at various delays. Typical discounting effects were observed and decision dynamics indicated that choosing smaller short-term rewards became easier (i.e., shorter response times, tighter trajectories, less vacillation) as the delays until later rewards increased. Based on a sequence of choices, subjective values of delayed outcomes were estimated and decision dynamics during initial choices predicted these values. Decision dynamics are affected by subjective values of available options and thus provide a means to estimate such values.

Planning activity for internally generated reward goals in monkey amygdala neurons

PubMed Central

Schultz, Wolfram

2015-01-01

The best rewards are often distant and can only be achieved by planning and decision-making over several steps. We designed a multi-step choice task in which monkeys followed internal plans to save rewards towards self-defined goals. During this self-controlled behavior, amygdala neurons showed future-oriented activity that reflected the animal’s plan to obtain specific rewards several trials ahead. This prospective activity encoded crucial components of the animal’s plan, including value and length of the planned choice sequence. It began on initial trials when a plan would be formed, reappeared step-by-step until reward receipt, and readily updated with a new sequence. It predicted performance, including errors, and typically disappeared during instructed behavior. Such prospective activity could underlie the formation and pursuit of internal plans characteristic for goal-directed behavior. The existence of neuronal planning activity in the amygdala suggests an important role for this structure in guiding behavior towards internally generated, distant goals. PMID:25622146

The roles of valuation and reward processing in cognitive function and psychiatric disorders

PubMed Central

Hélie, Sébastien; Shamloo, Farzin; Novak, Keisha; Foti, Dan

2017-01-01

In neuroeconomics, valuation refers to the process of assigning values to states and actions based on the animal’s current representation of the environment while reward processing corresponds to processing the feedback received from the environment to update the values of states and actions. In this article, we review the brain circuits associated with valuation and reward processing and argue that these are fundamental processes critical in many cognitive functions. Specifically, we focus on the role of valuation and reward processing in attention, memory, decision–making, and learning. Next, the extant neuroimaging literature on a number of psychiatric disorders is reviewed (i.e., addiction, pathological gambling, schizophrenia, and mood disorders), and an argument is made that associated deficits in cognitive functions can be explained in terms of abnormal valuation and reward processing. The review concludes with the impact of this framework in clinical settings and prescriptions for future research, in particular with regards to the conversions of qualitatively different valuation systems into a system of common currency. PMID:28415138

Reward circuitry dysfunction in psychiatric and neurodevelopmental disorders and genetic syndromes: animal models and clinical findings.

PubMed

Dichter, Gabriel S; Damiano, Cara A; Allen, John A

2012-07-06

This review summarizes evidence of dysregulated reward circuitry function in a range of neurodevelopmental and psychiatric disorders and genetic syndromes. First, the contribution of identifying a core mechanistic process across disparate disorders to disease classification is discussed, followed by a review of the neurobiology of reward circuitry. We next consider preclinical animal models and clinical evidence of reward-pathway dysfunction in a range of disorders, including psychiatric disorders (i.e., substance-use disorders, affective disorders, eating disorders, and obsessive compulsive disorders), neurodevelopmental disorders (i.e., schizophrenia, attention-deficit/hyperactivity disorder, autism spectrum disorders, Tourette's syndrome, conduct disorder/oppositional defiant disorder), and genetic syndromes (i.e., Fragile X syndrome, Prader-Willi syndrome, Williams syndrome, Angelman syndrome, and Rett syndrome). We also provide brief overviews of effective psychopharmacologic agents that have an effect on the dopamine system in these disorders. This review concludes with methodological considerations for future research designed to more clearly probe reward-circuitry dysfunction, with the ultimate goal of improved intervention strategies.

Reward circuitry dysfunction in psychiatric and neurodevelopmental disorders and genetic syndromes: animal models and clinical findings

PubMed Central

2012-01-01

This review summarizes evidence of dysregulated reward circuitry function in a range of neurodevelopmental and psychiatric disorders and genetic syndromes. First, the contribution of identifying a core mechanistic process across disparate disorders to disease classification is discussed, followed by a review of the neurobiology of reward circuitry. We next consider preclinical animal models and clinical evidence of reward-pathway dysfunction in a range of disorders, including psychiatric disorders (i.e., substance-use disorders, affective disorders, eating disorders, and obsessive compulsive disorders), neurodevelopmental disorders (i.e., schizophrenia, attention-deficit/hyperactivity disorder, autism spectrum disorders, Tourette’s syndrome, conduct disorder/oppositional defiant disorder), and genetic syndromes (i.e., Fragile X syndrome, Prader–Willi syndrome, Williams syndrome, Angelman syndrome, and Rett syndrome). We also provide brief overviews of effective psychopharmacologic agents that have an effect on the dopamine system in these disorders. This review concludes with methodological considerations for future research designed to more clearly probe reward-circuitry dysfunction, with the ultimate goal of improved intervention strategies. PMID:22958744

Reward-based training of recurrent neural networks for cognitive and value-based tasks

PubMed Central

Song, H Francis; Yang, Guangyu R; Wang, Xiao-Jing

2017-01-01

Trained neural network models, which exhibit features of neural activity recorded from behaving animals, may provide insights into the circuit mechanisms of cognitive functions through systematic analysis of network activity and connectivity. However, in contrast to the graded error signals commonly used to train networks through supervised learning, animals learn from reward feedback on definite actions through reinforcement learning. Reward maximization is particularly relevant when optimal behavior depends on an animal’s internal judgment of confidence or subjective preferences. Here, we implement reward-based training of recurrent neural networks in which a value network guides learning by using the activity of the decision network to predict future reward. We show that such models capture behavioral and electrophysiological findings from well-known experimental paradigms. Our work provides a unified framework for investigating diverse cognitive and value-based computations, and predicts a role for value representation that is essential for learning, but not executing, a task. DOI: http://dx.doi.org/10.7554/eLife.21492.001 PMID:28084991

Increased neural responses to reward in adolescents and young adults with attention-deficit/hyperactivity disorder and their unaffected siblings.

PubMed

von Rhein, Daniel; Cools, Roshan; Zwiers, Marcel P; van der Schaaf, Marieke; Franke, Barbara; Luman, Marjolein; Oosterlaan, Jaap; Heslenfeld, Dirk J; Hoekstra, Pieter J; Hartman, Catharina A; Faraone, Stephen V; van Rooij, Daan; van Dongen, Eelco V; Lojowska, Maria; Mennes, Maarten; Buitelaar, Jan

2015-05-01

Attention-deficit/hyperactivity disorder (ADHD) is a heritable neuropsychiatric disorder associated with abnormal reward processing. Limited and inconsistent data exist about the neural mechanisms underlying this abnormality. Furthermore, it is not known whether reward processing is abnormal in unaffected siblings of participants with ADHD. We used event-related functional magnetic resonance imaging (fMRI) to investigate brain responses during reward anticipation and receipt with an adapted monetary incentive delay task in a large sample of adolescents and young adults with ADHD (n = 150), their unaffected siblings (n = 92), and control participants (n = 108), all of the same age. Participants with ADHD showed, relative to control participants, increased responses in the anterior cingulate, anterior frontal cortex, and cerebellum during reward anticipation, and in the orbitofrontal, occipital cortex and ventral striatum. Responses of unaffected siblings were increased in these regions as well, except for the cerebellum during anticipation and ventral striatum during receipt. ADHD in adolescents and young adults is associated with enhanced neural responses in frontostriatal circuitry to anticipation and receipt of reward. The findings support models emphasizing aberrant reward processing in ADHD, and suggest that processing of reward is subject to familial influences. Future studies using standard monetary incentive delay task parameters are needed to replicate our findings. Copyright © 2015 American Academy of Child and Adolescent Psychiatry. Published by Elsevier Inc. All rights reserved.

Do capuchin monkeys (Cebus apella) diagnose causal relations in the absence of a direct reward?

PubMed

Edwards, Brian J; Rottman, Benjamin M; Shankar, Maya; Betzler, Riana; Chituc, Vladimir; Rodriguez, Ricardo; Silva, Liara; Wibecan, Leah; Widness, Jane; Santos, Laurie R

2014-01-01

We adapted a method from developmental psychology to explore whether capuchin monkeys (Cebus apella) would place objects on a "blicket detector" machine to diagnose causal relations in the absence of a direct reward. Across five experiments, monkeys could place different objects on the machine and obtain evidence about the objects' causal properties based on whether each object "activated" the machine. In Experiments 1-3, monkeys received both audiovisual cues and a food reward whenever the machine activated. In these experiments, monkeys spontaneously placed objects on the machine and succeeded at discriminating various patterns of statistical evidence. In Experiments 4 and 5, we modified the procedure so that in the learning trials, monkeys received the audiovisual cues when the machine activated, but did not receive a food reward. In these experiments, monkeys failed to test novel objects in the absence of an immediate food reward, even when doing so could provide critical information about how to obtain a reward in future test trials in which the food reward delivery device was reattached. The present studies suggest that the gap between human and animal causal cognition may be in part a gap of motivation. Specifically, we propose that monkey causal learning is motivated by the desire to obtain a direct reward, and that unlike humans, monkeys do not engage in learning for learning's sake.

Do Capuchin Monkeys (Cebus apella) Diagnose Causal Relations in the Absence of a Direct Reward?

PubMed Central

Edwards, Brian J.; Rottman, Benjamin M.; Shankar, Maya; Betzler, Riana; Chituc, Vladimir; Rodriguez, Ricardo; Silva, Liara; Wibecan, Leah; Widness, Jane; Santos, Laurie R.

2014-01-01

We adapted a method from developmental psychology [1] to explore whether capuchin monkeys (Cebus apella) would place objects on a “blicket detector” machine to diagnose causal relations in the absence of a direct reward. Across five experiments, monkeys could place different objects on the machine and obtain evidence about the objects’ causal properties based on whether each object “activated” the machine. In Experiments 1–3, monkeys received both audiovisual cues and a food reward whenever the machine activated. In these experiments, monkeys spontaneously placed objects on the machine and succeeded at discriminating various patterns of statistical evidence. In Experiments 4 and 5, we modified the procedure so that in the learning trials, monkeys received the audiovisual cues when the machine activated, but did not receive a food reward. In these experiments, monkeys failed to test novel objects in the absence of an immediate food reward, even when doing so could provide critical information about how to obtain a reward in future test trials in which the food reward delivery device was reattached. The present studies suggest that the gap between human and animal causal cognition may be in part a gap of motivation. Specifically, we propose that monkey causal learning is motivated by the desire to obtain a direct reward, and that unlike humans, monkeys do not engage in learning for learning’s sake. PMID:24586347

Intranasal oxytocin increases neural responses to social reward in post-traumatic stress disorder.

PubMed

Nawijn, Laura; van Zuiden, Mirjam; Koch, Saskia B J; Frijling, Jessie L; Veltman, Dick J; Olff, Miranda

2017-02-01

Therapeutic alliance and perceived social support are important predictors of treatment response for post-traumatic stress disorder (PTSD). Intranasal oxytocin administration may enhance treatment response by increasing sensitivity for social reward and thereby therapeutic alliance and perceived social support. As a first step to investigate this therapeutical potential, we investigated whether intranasal oxytocin enhances neural sensitivity to social reward in PTSD patients. Male and female police officers with (n = 35) and without PTSD (n = 37) were included in a double-blind, randomized, placebo-controlled cross-over fMRI study. After intranasal oxytocin (40 IU) and placebo administration, a social incentive delay task was conducted to investigate neural responses during social reward and punishment anticipation and feedback. Under placebo, PTSD patients showed reduced left anterior insula (AI) responses to social rewards (i.e. happy faces) compared with controls. Oxytocin administration increased left AI responses during social reward in PTSD patients, such that PTSD patients no longer differed from controls under placebo. Furthermore, in PTSD patients, oxytocin increased responses to social reward in the right putamen. By normalizing abberant insula responses and increasing putamen responses to social reward, oxytocin administration may enhance sensitivity for social support and therapeutic alliance in PTSD patients. Future studies are needed to investigate clinical effects of oxytocin. © The Author (2016). Published by Oxford University Press.

Associations of reward sensitivity with food consumption, activity pattern, and BMI in children.

PubMed

De Decker, Annelies; Sioen, Isabelle; Verbeken, Sandra; Braet, Caroline; Michels, Nathalie; De Henauw, Stefaan

2016-05-01

In the current study, the associations of reward sensitivity with weight related behaviors and body mass index were investigated in a general population sample of 443 Flemish children (50.3% boys) aged 5.5-12 years. Cross-sectional data on palatable food consumption frequency, screen time, physical activity, parental education level and measured length and weight were collected. The Drive subscale of the 'Behavioral Inhibition Scale/Behavioral Activation Scale' was used as a short method to measure reward sensitivity. A significant positive association of reward sensitivity with the fast food and sweet drink consumption frequency was found. Furthermore, a significant positive association of reward sensitivity with the z-score of body mass index was demonstrated, which explained additional variance to the variance explained by palatable food consumption frequency, screen time, physical activity and parental education level. Hence, the assessment of reward sensitivity may have an added value to the assessment of weight-related behavior indicators when evaluating the determinants of overweight in a child. In sum, children high in reward sensitivity might be more attracted to fast food and sweet drinks, and hence, might be more vulnerable to develop unfavorable food habits and overweight. These findings suggest that considering inter-individual differences in reward sensitivity is of importance in future childhood obesity prevention campaigns. Copyright © 2016 Elsevier Ltd. All rights reserved.

Monetary reward processing in obese individuals with and without binge eating disorder.

PubMed

Balodis, Iris M; Kober, Hedy; Worhunsky, Patrick D; White, Marney A; Stevens, Michael C; Pearlson, Godfrey D; Sinha, Rajita; Grilo, Carlos M; Potenza, Marc N

2013-05-01

An important step in obesity research involves identifying neurobiological underpinnings of nonfood reward processing unique to specific subgroups of obese individuals. Nineteen obese individuals seeking treatment for binge eating disorder (BED) were compared with 19 non-BED obese individuals (OB) and 19 lean control subjects (LC) while performing a monetary reward/loss task that parses anticipatory and outcome components during functional magnetic resonance imaging. Differences in regional activation were investigated in BED, OB, and LC groups during reward/loss prospect, anticipation, and notification. Relative to the LC group, the OB group demonstrated increased ventral striatal and ventromedial prefrontal cortex activity during anticipatory phases. In contrast, the BED group relative to the OB group demonstrated diminished bilateral ventral striatal activity during anticipatory reward/loss processing. No differences were observed between the BED and LC groups in the ventral striatum. Heterogeneity exists among obese individuals with respect to the neural correlates of reward/loss processing. Neural differences in separable groups with obesity suggest that multiple, varying interventions might be important in optimizing prevention and treatment strategies for obesity. Copyright © 2013 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

A simple solution for model comparison in bold imaging: the special case of reward prediction error and reward outcomes.

PubMed

Erdeniz, Burak; Rohe, Tim; Done, John; Seidler, Rachael D

2013-01-01

Conventional neuroimaging techniques provide information about condition-related changes of the BOLD (blood-oxygen-level dependent) signal, indicating only where and when the underlying cognitive processes occur. Recently, with the help of a new approach called "model-based" functional neuroimaging (fMRI), researchers are able to visualize changes in the internal variables of a time varying learning process, such as the reward prediction error or the predicted reward value of a conditional stimulus. However, despite being extremely beneficial to the imaging community in understanding the neural correlates of decision variables, a model-based approach to brain imaging data is also methodologically challenging due to the multicollinearity problem in statistical analysis. There are multiple sources of multicollinearity in functional neuroimaging including investigations of closely related variables and/or experimental designs that do not account for this. The source of multicollinearity discussed in this paper occurs due to correlation between different subjective variables that are calculated very close in time. Here, we review methodological approaches to analyzing such data by discussing the special case of separating the reward prediction error signal from reward outcomes.

Modulation of spatial attention by goals, statistical learning, and monetary reward.

PubMed

Jiang, Yuhong V; Sha, Li Z; Remington, Roger W

2015-10-01

This study documented the relative strength of task goals, visual statistical learning, and monetary reward in guiding spatial attention. Using a difficult T-among-L search task, we cued spatial attention to one visual quadrant by (i) instructing people to prioritize it (goal-driven attention), (ii) placing the target frequently there (location probability learning), or (iii) associating that quadrant with greater monetary gain (reward-based attention). Results showed that successful goal-driven attention exerted the strongest influence on search RT. Incidental location probability learning yielded a smaller though still robust effect. Incidental reward learning produced negligible guidance for spatial attention. The 95 % confidence intervals of the three effects were largely nonoverlapping. To understand these results, we simulated the role of location repetition priming in probability cuing and reward learning. Repetition priming underestimated the strength of location probability cuing, suggesting that probability cuing involved long-term statistical learning of how to shift attention. Repetition priming provided a reasonable account for the negligible effect of reward on spatial attention. We propose a multiple-systems view of spatial attention that includes task goals, search habit, and priming as primary drivers of top-down attention.

Modulation of spatial attention by goals, statistical learning, and monetary reward

PubMed Central

Sha, Li Z.; Remington, Roger W.

2015-01-01

This study documented the relative strength of task goals, visual statistical learning, and monetary reward in guiding spatial attention. Using a difficult T-among-L search task, we cued spatial attention to one visual quadrant by (i) instructing people to prioritize it (goal-driven attention), (ii) placing the target frequently there (location probability learning), or (iii) associating that quadrant with greater monetary gain (reward-based attention). Results showed that successful goal-driven attention exerted the strongest influence on search RT. Incidental location probability learning yielded a smaller though still robust effect. Incidental reward learning produced negligible guidance for spatial attention. The 95 % confidence intervals of the three effects were largely nonoverlapping. To understand these results, we simulated the role of location repetition priming in probability cuing and reward learning. Repetition priming underestimated the strength of location probability cuing, suggesting that probability cuing involved long-term statistical learning of how to shift attention. Repetition priming provided a reasonable account for the negligible effect of reward on spatial attention. We propose a multiple-systems view of spatial attention that includes task goals, search habit, and priming as primary drivers of top-down attention. PMID:26105657

Reward history but not search history explains value-driven attentional capture.

PubMed

Marchner, Janina R; Preuschhof, Claudia

2018-04-19

In past years, an extensive amount of research has focused on how past experiences guide future attention. Humans automatically attend to stimuli previously associated with reward and stimuli that have been experienced during visual search, even when it is disadvantageous in present situations. Recently, the relationship between "reward history" and "search history" has been discussed critically. We review results from research on value-driven attentional capture (VDAC) with a focus on these two experience-based attentional selection processes and their distinction. To clarify inconsistencies, we examined VDAC within a design that allows a direct comparison with other mechanisms of attentional selection. Eighty-four healthy adults were trained to incidentally associate colors with reward (10 cents, 2 cents) or with no reward. In a subsequent visual search task, distraction by reward-associated and unrewarded stimuli was contrasted. In the training phase, reward signals facilitated performance. When these value-signaling stimuli appeared as distractors in the test phase, they continuously shaped attentional selection, despite their task irrelevance. Our findings clearly cannot be attributed to a history of target search. We conclude that once an association is established, value signals guide attention automatically in new situations, which can be beneficial or not, depending on the congruency with current goals.

Do Preschoolers Save to Benefit Their Future Selves?

ERIC Educational Resources Information Center

Metcalf, Jennifer L.; Atance, Cristina M.

2011-01-01

Using a new paradigm for measuring children's saving behaviors involving two marble games differing in desirability, we assessed whether 3-, 4-, and 5-year-olds saved marbles for future use, saved increasingly on a second trial, saved increasingly with age, and were sensitive to the relative value of future rewards. We also assessed whether…

Animal models of drug addiction.

PubMed

García Pardo, María Pilar; Roger Sánchez, Concepción; De la Rubia Ortí, José Enrique; Aguilar Calpe, María Asunción

2017-09-29

The development of animal models of drug reward and addiction is an essential factor for progress in understanding the biological basis of this disorder and for the identification of new therapeutic targets. Depending on the component of reward to be studied, one type of animal model or another may be used. There are models of reinforcement based on the primary hedonic effect produced by the consumption of the addictive substance, such as the self-administration (SA) and intracranial self-stimulation (ICSS) paradigms, and there are models based on the component of reward related to associative learning and cognitive ability to make predictions about obtaining reward in the future, such as the conditioned place preference (CPP) paradigm. In recent years these models have incorporated methodological modifications to study extinction, reinstatement and reconsolidation processes, or to model specific aspects of addictive behavior such as motivation to consume drugs, compulsive consumption or drug seeking under punishment situations. There are also models that link different reinforcement components or model voluntary motivation to consume (two-bottle choice, or drinking in the dark tests). In short, innovations in these models allow progress in scientific knowledge regarding the different aspects that lead individuals to consume a drug and develop compulsive consumption, providing a target for future treatments of addiction.

The procrastinators want it now: Behavioral and event-related potential evidence of the procrastination of intertemporal choices.

PubMed

Wu, Haiyan; Gui, Danyang; Lin, Wenzheng; Gu, Ruolei; Zhu, Xiangru; Liu, Xun

2016-08-01

Much past research has focused on the correlation between procrastination and personality traits (e.g., impulsivity). According to the temporal motivation theory, procrastinators are impulsive and sensitive to delays in time. However, there is still a lack of direct evidence of the tendency of procrastinators to prefer immediate over future rewards. To investigate this question, we recorded event-related potentials (ERPs) in the brain while participants performed an intertemporal choice task involving both time delay and reward processing. The participants were assigned to a high procrastination group and a low procrastination group according to their scores on self-report measures. We found that high procrastination participants preferred immediate rewards compared to future ones whereas low procrastination participants did not. High procrastinators also exhibited a larger and delayed P2 component, indicating delay time processing and abnormal reward processing. No significant effect associated with procrastination was found on the P300 component. Taken together, these findings suggest that high procrastinators are more impulsive and encode the information of delay time more slowly but with a higher level of motivation-driven attention. The current study substantiates higher impulsivity in procrastination and verifies that a difference exists in the sensitivity to time delay between high and low procrastinators. Copyright © 2016 Elsevier Inc. All rights reserved.

Imitate or innovate? Children's innovation is influenced by the efficacy of observed behaviour.

PubMed

Carr, Kayleigh; Kendal, Rachel L; Flynn, Emma G

2015-09-01

This study investigated the age at which children judge it futile to imitate unreliable information, in the form of a visibly ineffective demonstrated solution, and deviate to produce novel solutions ('innovations'). Children aged 4-9 years were presented with a novel puzzle box, the Multiple-Methods Box (MMB), which offered multiple innovation opportunities to extract a reward using different tools, access points and exits. 209 children were assigned to conditions in which eight social demonstrations of a reward retrieval method were provided; each condition differed incrementally in terms of the method's efficacy (0%, 25%, 75%, and 100% success at extracting the reward). An additional 47 children were assigned to a no-demonstration control condition. Innovative reward extractions from the MMB increased with decreasing efficacy of the demonstrated method. However, imitation remained a widely used strategy irrespective of the efficacy of the method being reproduced (90% of children produced at least one imitative attempt, and imitated on an average of 4.9 out of 8 attempt trials). Children were more likely to innovate in relation to the tool than exit, even though the latter would have been more effective. Overall, innovation was rare: only 12.4% of children innovated by discovering at least one novel reward exit. Children's prioritisation of social information is consistent with theories of cultural evolution indicating imitation is a prepotent response following observation of behaviour, and that innovation is a rarity; so much so, that even maladaptive behaviour is copied. Copyright © 2015 The Authors. Published by Elsevier B.V. All rights reserved.

Human prosaccades and antisaccades under risk: effects of penalties and rewards on visual selection and the value of actions.

PubMed

Ross, M; Lanyon, L J; Viswanathan, J; Manoach, D S; Barton, J J S

2011-11-24

Monkey studies report greater activity in the lateral intraparietal area and more efficient saccades when targets coincide with the location of prior reward cues, even when cue location does not indicate which responses will be rewarded. This suggests that reward can modulate spatial attention and visual selection independent of the "action value" of the motor response. Our goal was first to determine whether reward modulated visual selection similarly in humans, and next, to discover whether reward and penalty differed in effect, if cue effects were greater for cognitively demanding antisaccades, and if financial consequences that were contingent on stimulus location had spatially selective effects. We found that motivational cues reduced all latencies, more for reward than penalty. There was an "inhibition-of-return"-like effect at the location of the cue, but unlike the results in monkeys, cue valence did not modify this effect in prosaccades, and the inhibition-of-return effect was slightly increased rather than decreased in antisaccades. When financial consequences were contingent on target location, locations without reward or penalty consequences lost the benefits seen in noncontingent trials, whereas locations with consequences maintained their gains. We conclude that unlike monkeys, humans show reward effects not on visual selection but on the value of actions. The human saccadic system has both the capacity to enhance responses to multiple locations simultaneously, and the flexibility to focus motivational enhancement only on locations with financial consequences. Reward is more effective than penalty, and both interact with the additional attentional demands of the antisaccade task. Copyright © 2011 IBRO. Published by Elsevier Ltd. All rights reserved.

Reward and vocal production: song-associated place preference in songbirds.

PubMed

Riters, Lauren V; Stevenson, Sharon A

2012-05-15

Vocal production is crucial for successful social interactions in multiple species. Reward can strongly influence behavior; however, the extent to which reward systems influence vocal behavior is unknown. In songbirds, singing occurs in different contexts. It can be spontaneous and undirected (e.g., song produced alone or as part of a large flock) or directed towards a conspecific (e.g., song used to attract a mate or influence a competitor). In this study, we developed a conditioned place preference paradigm to measure reward associated with different types of singing behavior in two songbird species. Both male zebra finches and European starlings developed a preference for a chamber associated with production of undirected song, suggesting that the production of undirected song is tightly coupled to intrinsic reward. In contrast, neither starlings nor zebra finches developed a place preference in association with directed song; however, male starlings singing directed song that failed to attract a female developed a place aversion. Unsuccessful contact calling behavior was also associated with a place aversion. These findings suggest that directed vocal behavior is not tightly linked to intrinsic reward but may be externally reinforced by social interactions. Data across two species thus support the hypothesis that the production of undirected but not directed song is tightly coupled to intrinsic reward. This study is the first to identify song-associated reward and suggests that reward associated with vocal production differs depending upon the context in which communication occurs. The findings have implications for understanding what motivates animals to engage in social behaviors and ways in which distinct reward mechanisms function to direct socially appropriate behaviors. Copyright © 2012 Elsevier Inc. All rights reserved.

Common Dimensional Reward Deficits Across Mood and Psychotic Disorders: A Connectome-Wide Association Study.

PubMed

Sharma, Anup; Wolf, Daniel H; Ciric, Rastko; Kable, Joseph W; Moore, Tyler M; Vandekar, Simon N; Katchmar, Natalie; Daldal, Aylin; Ruparel, Kosha; Davatzikos, Christos; Elliott, Mark A; Calkins, Monica E; Shinohara, Russell T; Bassett, Danielle S; Satterthwaite, Theodore D

2017-07-01

Anhedonia is central to multiple psychiatric disorders and causes substantial disability. A dimensional conceptualization posits that anhedonia severity is related to a transdiagnostic continuum of reward deficits in specific neural networks. Previous functional connectivity studies related to anhedonia have focused on case-control comparisons in specific disorders, using region-specific seed-based analyses. Here, the authors explore the entire functional connectome in relation to reward responsivity across a population of adults with heterogeneous psychopathology. In a sample of 225 adults from five diagnostic groups (major depressive disorder, N=32; bipolar disorder, N=50; schizophrenia, N=51; psychosis risk, N=39; and healthy control subjects, N=53), the authors conducted a connectome-wide analysis examining the relationship between a dimensional measure of reward responsivity (the reward sensitivity subscale of the Behavioral Activation Scale) and resting-state functional connectivity using multivariate distance-based matrix regression. The authors identified foci of dysconnectivity associated with reward responsivity in the nucleus accumbens, the default mode network, and the cingulo-opercular network. Follow-up analyses revealed dysconnectivity among specific large-scale functional networks and their connectivity with the nucleus accumbens. Reward deficits were associated with decreased connectivity between the nucleus accumbens and the default mode network and increased connectivity between the nucleus accumbens and the cingulo-opercular network. In addition, impaired reward responsivity was associated with default mode network hyperconnectivity and diminished connectivity between the default mode network and the cingulo-opercular network. These results emphasize the centrality of the nucleus accumbens in the pathophysiology of reward deficits and suggest that dissociable patterns of connectivity among large-scale networks are critical to the neurobiology of reward dysfunction across clinical diagnostic categories.

Oscillatory rhythm of reward: anticipation and processing of rewards in children with and without autism.

PubMed

Stavropoulos, Katherine Kuhl-Meltzoff; Carver, Leslie J

2018-01-01

Autism spectrum disorder (ASD) is a complex neurodevelopmental condition, and multiple theories have emerged concerning core social deficits. While the social motivation hypothesis proposes that deficits in the social reward system cause individuals with ASD to engage less in social interaction, the overly intense world hypothesis (sensory over-responsivity) proposes that individuals with ASD find stimuli to be too intense and may have hypersensitivity to social interaction, leading them to avoid these interactions. EEG was recorded during reward anticipation and reward processing. Reward anticipation was measured using alpha asymmetry, and post-feedback theta was utilized to measure reward processing. Additionally, we calculated post-feedback alpha suppression to measure attention and salience. Participants were 6- to 8-year-olds with ( N  = 20) and without ( N  = 23) ASD. Children with ASD showed more left-dominant alpha suppression when anticipating rewards accompanied by nonsocial stimuli compared to social stimuli. During reward processing, children with ASD had less theta activity than typically developing (TD) children. Alpha activity after feedback showed the opposite pattern: children with ASD had greater alpha suppression than TD children. Significant correlations were observed between behavioral measures of autism severity and EEG activity in both the reward anticipation and reward processing time periods. The findings provide evidence that children with ASD have greater approach motivation prior to nonsocial (compared to social) stimuli. Results after feedback suggest that children with ASD evidence less robust activity thought to reflect evaluation and processing of rewards (e.g., theta) compared to TD children. However, children with ASD evidence greater alpha suppression after feedback compared to TD children. We hypothesize that post-feedback alpha suppression reflects general cognitive engagement-which suggests that children with ASD may experience feedback as overly intense. Taken together, these results suggest that aspects of both the social motivation hypothesis and the overly intense world hypothesis may be occurring simultaneously.

Rapid target foraging with reach or gaze: The hand looks further ahead than the eye

PubMed Central

2017-01-01

Real-world tasks typically consist of a series of target-directed actions and often require choices about which targets to act on and in what order. Such choice behavior can be assessed from an optimal foraging perspective whereby target selection is shaped by a balance between rewards and costs. Here we evaluated such decision-making in a rapid movement foraging task. On a given trial, participants were presented with 15 targets of varying size and value and were instructed to harvest as much reward as possible by either moving a handle to the targets (hand task) or by briefly fixating them (eye task). The short trial duration enabled participants to harvest about half the targets, ensuring that total reward was due to choice behavior. We developed a probabilistic model to predict target-by-target harvesting choices that considered the rewards and movement-related costs (i.e., target distance and size) associated with the current target as well as future targets. In the hand task, in comparison to the eye task, target choice was more strongly influenced by movement-related costs and took into account a greater number of future targets, consistent with the greater costs associated with arm movement. In both tasks, participants exhibited near-optimal behaviour and in a constrained version of the hand task in which choices could only be based on target positions, participants consistently chose among the shortest movement paths. Our results demonstrate that people can rapidly and effectively integrate values and movement-related costs associated with current and future targets when sequentially harvesting targets. PMID:28683138

A reservoir of time constants for memory traces in cortical neurons

PubMed Central

Bernacchia, Alberto; Seo, Hyojung; Lee, Daeyeol; Wang, Xiao-Jing

2011-01-01

According to reinforcement learning theory of decision making, reward expectation is computed by integrating past rewards with a fixed timescale. By contrast, we found that a wide range of time constants is available across cortical neurons recorded from monkeys performing a competitive game task. By recognizing that reward modulates neural activity multiplicatively, we found that one or two time constants of reward memory can be extracted for each neuron in prefrontal, cingulate, and parietal cortex. These timescales ranged from hundreds of milliseconds to tens of seconds, according to a power-law distribution, which is consistent across areas and reproduced by a “reservoir” neural network model. These neuronal memory timescales were weakly but significantly correlated with those of monkey's decisions. Our findings suggest a flexible memory system, where neural subpopulations with distinct sets of long or short memory timescales may be selectively deployed according to the task demands. PMID:21317906

Hedging Your Bets by Learning Reward Correlations in the Human Brain

PubMed Central

Wunderlich, Klaus; Symmonds, Mkael; Bossaerts, Peter; Dolan, Raymond J.

2011-01-01

Summary Human subjects are proficient at tracking the mean and variance of rewards and updating these via prediction errors. Here, we addressed whether humans can also learn about higher-order relationships between distinct environmental outcomes, a defining ecological feature of contexts where multiple sources of rewards are available. By manipulating the degree to which distinct outcomes are correlated, we show that subjects implemented an explicit model-based strategy to learn the associated outcome correlations and were adept in using that information to dynamically adjust their choices in a task that required a minimization of outcome variance. Importantly, the experimentally generated outcome correlations were explicitly represented neuronally in right midinsula with a learning prediction error signal expressed in rostral anterior cingulate cortex. Thus, our data show that the human brain represents higher-order correlation structures between rewards, a core adaptive ability whose immediate benefit is optimized sampling. PMID:21943609

Testing the effect of risk on intertemporal choice in the Chinese cultural context.

PubMed

Sun, Yan; Li, Shu

2011-01-01

Previous studies using Western samples have found that introducing uncertainty to an intertemporal choice decreases the degree of discounting future rewards. The authors of this article examined the effect of risk on intertemporal choice using Chinese participants and found that respondents preferred the smaller but sooner (SS) outcome to the larger but later (LL) one in the presence of risk, which indicates that risk increases rather than decreases the degree of discounting future rewards. Thus, variations in response patterns between different cultural groups suggest that culture may play an important role in intertemporal choice and researchers should delve into this topic from an emic rather than an etic perspective.

Interplay between cooperation-enhancing mechanisms in evolutionary games with tag-mediated interactions

NASA Astrophysics Data System (ADS)

Hadzibeganovic, Tarik; Stauffer, Dietrich; Han, Xiao-Pu

2018-04-01

Cooperation is fundamental for the long-term survival of biological, social, and technological networks. Previously, mechanisms for the enhancement of cooperation, such as network reciprocity, have largely been studied in isolation and with often inconclusive findings. Here, we present an evolutionary, multiagent-based, and spatially explicit computer model to specifically address the interactive interplay between such mechanisms. We systematically investigate the effects of phenotypic diversity, network structure, and rewards on cooperative behavior emerging in a population of reproducing artificial decision makers playing tag-mediated evolutionary games. Cooperative interactions are rewarded such that both the benefits of recipients and costs of donators are affected by the reward size. The reward size is determined by the number of cooperative acts occurring within a given reward time frame. Our computational experiments reveal that small reward frames promote unconditional cooperation in populations with both low and high diversity, whereas large reward frames lead to cycles of conditional and unconditional strategies at high but not at low diversity. Moreover, an interaction between rewards and spatial structure shows that relative to small reward frames, there is a strong difference between the frequency of conditional cooperators populating rewired versus non-rewired networks when the reward frame is large. Notably, in a less diverse population, the total number of defections is comparable across different network topologies, whereas in more diverse environments defections become more frequent in a regularly structured than in a rewired, small-world network of contacts. Acknowledging the importance of such interaction effects in social dilemmas will have inevitable consequences for the future design of cooperation-enhancing protocols in large-scale, distributed, and decentralized systems such as peer-to-peer networks.

Trait Rumination Influences Neural Correlates of the Anticipation but Not the Consumption Phase of Reward Processing

PubMed Central

Kocsel, Natália; Szabó, Edina; Galambos, Attila; Édes, Andrea; Pap, Dorottya; Elliott, Rebecca; Kozák, Lajos R.; Bagdy, György; Juhász, Gabriella; Kökönyei, Gyöngyi

2017-01-01

Cumulative evidence suggests that trait rumination can be defined as an abstract information processing mode, which leads people to constantly anticipate the likely impact of present events on future events and experiences. A previous study with remitted depressed patients suggested that enhanced rumination tendencies distort brain mechanisms of anticipatory processes associated with reward and loss cues. In the present study, we explored the impact of trait rumination on neural activity during reward and loss anticipation among never-depressed people. We analyzed the data of 37 healthy controls, who performed the monetary incentive delay (MID) task which was designed for the simultaneous measurement of the anticipation (motivational) and consumption (hedonic) phase of reward processing, during functional magnetic resonance imaging (fMRI). Our results show that rumination—after controlling for age, gender, and current mood—significantly influenced neural responses to reward (win) cues compared to loss cues. Blood-oxygenation-level-dependent (BOLD) activity in the left inferior frontal gyrus (IFG) triangularis, left anterior insula, and left rolandic operculum was positively related to Ruminative Response Scale (RRS) scores. We did not detect any significant rumination-related activations associated with win-neutral or loss-neutral cues and with reward or loss consumption. Our results highlight the influence of trait rumination on reward anticipation in a non-depressed sample. They also suggest that for never-depressed ruminators rewarding cues are more salient than loss cues. BOLD response during reward consumption did not relate to rumination, suggesting that rumination mainly relates to processing of the motivational (wanting) aspect of reward rather than the hedonic (liking) aspect, at least in the absence of pathological mood. PMID:28539875

Heterogeneity in the Effects of Reward- and Deposit-based Financial Incentives on Smoking Cessation.

PubMed

Halpern, Scott D; French, Benjamin; Small, Dylan S; Saulsgiver, Kathryn; Harhay, Michael O; Audrain-McGovern, Janet; Loewenstein, George; Asch, David A; Volpp, Kevin G

2016-10-15

Targeting different smoking cessation programs to smokers most likely to quit when using them could reduce the burden of lung disease. To identify smokers most likely to quit using pure reward-based financial incentives or incentive programs requiring refundable deposits to become eligible for rewards. We conducted prespecified secondary analyses of a randomized trial in which 2,538 smokers were assigned to an $800 reward contingent on sustained abstinence from smoking, a refundable $150 deposit plus a $650 reward, or usual care. Using logistic regression, we identified characteristics of smokers that were most strongly associated with accepting their assigned intervention and ceasing smoking for 6 months. We assessed modification of the acceptance, efficacy, and effectiveness of reward and deposit programs by 11 prospectively selected demographic, smoking-related, and psychological factors. Predictors of sustained smoking abstinence differed among participants assigned to reward- versus deposit-based incentives. However, greater readiness to quit and less steep discounting of future rewards were consistently among the most important predictors. Deposit-based programs were uniquely effective relative to usual care among men, higher-income participants, and participants who more commonly failed to pay their bills (all interaction P values < 0.10). Relative to rewards, deposits were more effective among black persons (P = 0.022) and those who more commonly failed to pay their bills (P = 0.082). Relative to rewards, deposits were more commonly accepted by higher-income participants, men, white persons, and those who less commonly failed to pay their bills (all P < 0.05). Heterogeneity among smokers in their acceptance and response to different forms of incentives suggests potential benefits of targeting behavior-change interventions based on patient characteristics. Clinical trial registered with www.clinicaltrials.gov (NCT 01526265).

Reinforcement Learning Using a Continuous Time Actor-Critic Framework with Spiking Neurons

PubMed Central

Frémaux, Nicolas; Sprekeler, Henning; Gerstner, Wulfram

2013-01-01

Animals repeat rewarded behaviors, but the physiological basis of reward-based learning has only been partially elucidated. On one hand, experimental evidence shows that the neuromodulator dopamine carries information about rewards and affects synaptic plasticity. On the other hand, the theory of reinforcement learning provides a framework for reward-based learning. Recent models of reward-modulated spike-timing-dependent plasticity have made first steps towards bridging the gap between the two approaches, but faced two problems. First, reinforcement learning is typically formulated in a discrete framework, ill-adapted to the description of natural situations. Second, biologically plausible models of reward-modulated spike-timing-dependent plasticity require precise calculation of the reward prediction error, yet it remains to be shown how this can be computed by neurons. Here we propose a solution to these problems by extending the continuous temporal difference (TD) learning of Doya (2000) to the case of spiking neurons in an actor-critic network operating in continuous time, and with continuous state and action representations. In our model, the critic learns to predict expected future rewards in real time. Its activity, together with actual rewards, conditions the delivery of a neuromodulatory TD signal to itself and to the actor, which is responsible for action choice. In simulations, we show that such an architecture can solve a Morris water-maze-like navigation task, in a number of trials consistent with reported animal performance. We also use our model to solve the acrobot and the cartpole problems, two complex motor control tasks. Our model provides a plausible way of computing reward prediction error in the brain. Moreover, the analytically derived learning rule is consistent with experimental evidence for dopamine-modulated spike-timing-dependent plasticity. PMID:23592970

Reinforcement learning using a continuous time actor-critic framework with spiking neurons.

PubMed

Frémaux, Nicolas; Sprekeler, Henning; Gerstner, Wulfram

2013-04-01

Animals repeat rewarded behaviors, but the physiological basis of reward-based learning has only been partially elucidated. On one hand, experimental evidence shows that the neuromodulator dopamine carries information about rewards and affects synaptic plasticity. On the other hand, the theory of reinforcement learning provides a framework for reward-based learning. Recent models of reward-modulated spike-timing-dependent plasticity have made first steps towards bridging the gap between the two approaches, but faced two problems. First, reinforcement learning is typically formulated in a discrete framework, ill-adapted to the description of natural situations. Second, biologically plausible models of reward-modulated spike-timing-dependent plasticity require precise calculation of the reward prediction error, yet it remains to be shown how this can be computed by neurons. Here we propose a solution to these problems by extending the continuous temporal difference (TD) learning of Doya (2000) to the case of spiking neurons in an actor-critic network operating in continuous time, and with continuous state and action representations. In our model, the critic learns to predict expected future rewards in real time. Its activity, together with actual rewards, conditions the delivery of a neuromodulatory TD signal to itself and to the actor, which is responsible for action choice. In simulations, we show that such an architecture can solve a Morris water-maze-like navigation task, in a number of trials consistent with reported animal performance. We also use our model to solve the acrobot and the cartpole problems, two complex motor control tasks. Our model provides a plausible way of computing reward prediction error in the brain. Moreover, the analytically derived learning rule is consistent with experimental evidence for dopamine-modulated spike-timing-dependent plasticity.

48 CFR 16.402-4 - Structuring multiple-incentive contracts.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 48 Federal Acquisition Regulations System 1 2010-10-01 2010-10-01 false Structuring multiple-incentive contracts. 16.402-4 Section 16.402-4 Federal Acquisition Regulations System FEDERAL ACQUISITION... include a cost incentive (or constraint) that operates to preclude rewarding a contractor for superior...

Optogenetically-induced tonic dopamine release from VTA-nucleus accumbens projections inhibits reward consummatory behaviors

PubMed Central

Mikhailova, Maria A.; Bass, Caroline E.; Grinevich, Valentina P.; Chappell, Ann M.; Deal, Alex L.; Bonin, Keith D.; Weiner, Jeff L.; Gainetdinov, Raul R.; Budygin, Evgeny A.

2016-01-01

Recent optogenetic studies demonstrated that phasic dopamine release in the nucleus accumbens may play a causal role in multiple aspects of natural and drug reward-related behaviors. The role of tonic dopamine release in reward consummatory behavior remains unclear. The current study used a combinatorial viral-mediated gene delivery approach to express ChR2 on mesolimbic dopamine neurons in rats. We used optical activation of this dopamine circuit to mimic tonic dopamine release in the nucleus accumbens and to explore the causal relationship between this form of dopamine signaling within the ventral tegmental area (VTA)-nucleus accumbens projection and consumption of a natural reward. Using a two bottle choice paradigm (sucrose vs. water), the experiments revealed that tonic optogenetic stimulation of mesolimbic dopamine transmission significantly decreased reward consummatory behaviors. Specifically, there was a significant decrease in the number of bouts, licks and amount of sucrose obtained during the drinking session. Notably, activation of VTA dopamine cell bodies or dopamine terminals in the nucleus accumbens resulted in identical behavioral consequences. No changes in the water intake were evident under the same experimental conditions. Collectively, these data demonstrate that tonic optogenetic stimulation of VTA-nucleus accumbens dopamine release is sufficient to inhibit reward consummatory behavior, possibly by preventing this circuit from engaging in phasic activity that is thought to be essential for reward-based behaviors. PMID:27421228

Hemispheric dissociation of reward processing in humans: insights from deep brain stimulation.

PubMed

Palminteri, Stefano; Serra, Giulia; Buot, Anne; Schmidt, Liane; Welter, Marie-Laure; Pessiglione, Mathias

2013-01-01

Rewards have various effects on human behavior and multiple representations in the human brain. Behaviorally, rewards notably enhance response vigor in incentive motivation paradigms and bias subsequent choices in instrumental learning paradigms. Neurally, rewards affect activity in different fronto-striatal regions attached to different motor effectors, for instance in left and right hemispheres for the two hands. Here we address the question of whether manipulating reward-related brain activity has local or general effects, with respect to behavioral paradigms and motor effectors. Neuronal activity was manipulated in a single hemisphere using unilateral deep brain stimulation (DBS) in patients with Parkinson's disease. Results suggest that DBS amplifies the representation of reward magnitude within the targeted hemisphere, so as to affect the behavior of the contralateral hand specifically. These unilateral DBS effects on behavior include both boosting incentive motivation and biasing instrumental choices. Furthermore, using computational modeling we show that DBS effects on incentive motivation can predict DBS effects on instrumental learning (or vice versa). Thus, we demonstrate the feasibility of causally manipulating reward-related neuronal activity in humans, in a manner that is specific to a class of motor effectors but that generalizes to different computational processes. As these findings proved independent from therapeutic effects on parkinsonian motor symptoms, they might provide insight into DBS impact on non-motor disorders, such as apathy or hypomania. Copyright © 2013 Elsevier Ltd. All rights reserved.

Hyporesponsive reward anticipation in the basal ganglia following severe institutional deprivation early in life.

PubMed

Mehta, Mitul A; Gore-Langton, Emma; Golembo, Nicole; Colvert, Emma; Williams, Steven C R; Sonuga-Barke, Edmund

2010-10-01

Severe deprivation in the first few years of life is associated with multiple difficulties in cognition and behavior. However, the brain basis for these difficulties is poorly understood. Structural and functional neuroimaging studies have implicated limbic system structures as dysfunctional, and one functional imaging study in a heterogeneous group of maltreated individuals has confirmed the presence of abnormalities in the basal ganglia. Based on these studies and known dopaminergic abnormalities from studies in experimental animals using social isolation, we used a task of monetary reward anticipation to examine the functional integrity of brain regions previously shown to be implicated in reward processing. Our sample included a group of adolescents (n = 12) who had experienced global deprivation early in their lives in Romania prior to adoption into UK families. In contrast to a nonadopted comparison group (n = 11), the adoptees did not recruit the striatum during reward anticipation despite comparable performance accuracy and latency. These results show, for the first time, an association between early institutional deprivation and brain reward systems in humans and highlight potential neural vulnerabilities resulting from such exposures.

Modulation of Food Reward by Endocrine and Environmental Factors: Update and Perspective.

PubMed

Figlewicz, Dianne P

2015-01-01

Palatable foods are frequently high in energy density. Chronic consumption of high-energy density foods can contribute to the development of cardiometabolic pathology including obesity, diabetes, and cardiovascular disease. This article reviews the contributions of extrinsic and intrinsic factors that influence the reward components of food intake. A narrative review was conducted to determine the behavioral and central nervous system (CNS) related processes involved in the reward components of high-energy density food intake. The rewarding aspects of food, particularly palatable and preferred foods, are regulated by CNS circuitry. Overlaying this regulation is modulation by intrinsic endocrine systems and metabolic hormones relating to energy homeostasis, developmental stage, or gender. It is now recognized that extrinsic or environmental factors, including ambient diet composition and the provocation of stress or anxiety, also contribute substantially to the expression of food reward behaviors such as motivation for, and seeking of, preferred foods. High-energy density food intake is influenced by both physiological and pathophysiological processes. Contextual, behavioral, and psychological factors and CNS-related processes represent potential targets for multiple types of therapeutic intervention.

The Role of Multiple Neuromodulators in Reinforcement Learning That Is Based on Competition between Eligibility Traces.

PubMed

Huertas, Marco A; Schwettmann, Sarah E; Shouval, Harel Z

2016-01-01

The ability to maximize reward and avoid punishment is essential for animal survival. Reinforcement learning (RL) refers to the algorithms used by biological or artificial systems to learn how to maximize reward or avoid negative outcomes based on past experiences. While RL is also important in machine learning, the types of mechanistic constraints encountered by biological machinery might be different than those for artificial systems. Two major problems encountered by RL are how to relate a stimulus with a reinforcing signal that is delayed in time (temporal credit assignment), and how to stop learning once the target behaviors are attained (stopping rule). To address the first problem synaptic eligibility traces were introduced, bridging the temporal gap between a stimulus and its reward. Although, these were mere theoretical constructs, recent experiments have provided evidence of their existence. These experiments also reveal that the presence of specific neuromodulators converts the traces into changes in synaptic efficacy. A mechanistic implementation of the stopping rule usually assumes the inhibition of the reward nucleus; however, recent experimental results have shown that learning terminates at the appropriate network state even in setups where the reward nucleus cannot be inhibited. In an effort to describe a learning rule that solves the temporal credit assignment problem and implements a biologically plausible stopping rule, we proposed a model based on two separate synaptic eligibility traces, one for long-term potentiation (LTP) and one for long-term depression (LTD), each obeying different dynamics and having different effective magnitudes. The model has been shown to successfully generate stable learning in recurrent networks. Although, the model assumes the presence of a single neuromodulator, evidence indicates that there are different neuromodulators for expressing the different traces. What could be the role of different neuromodulators for expressing the LTP and LTD traces? Here we expand on our previous model to include several neuromodulators, and illustrate through various examples how different these contribute to learning reward-timing within a wide set of training paradigms and propose further roles that multiple neuromodulators can play in encoding additional information of the rewarding signal.

Personality influences temporal discounting preferences: behavioral and brain evidence.

PubMed

Manning, Joshua; Hedden, Trey; Wickens, Nina; Whitfield-Gabrieli, Susan; Prelec, Drazen; Gabrieli, John D E

2014-09-01

Personality traits are stable predictors of many life outcomes that are associated with important decisions that involve tradeoffs over time. Therefore, a fundamental question is how tradeoffs over time vary from person to person in relation to stable personality traits. We investigated the influence of personality, as measured by the Five-Factor Model, on time preferences and on neural activity engaged by intertemporal choice. During functional magnetic resonance imaging (fMRI), participants made choices between smaller-sooner and larger-later monetary rewards. For each participant, we estimated a constant-sensitivity discount function that dissociates impatience (devaluation of future consequences) from time sensitivity (consistency with rational, exponential discounting). Overall, higher neuroticism was associated with a relatively greater preference for immediate rewards and higher conscientiousness with a relatively greater preference for delayed rewards. Specifically, higher conscientiousness correlated positively with lower short-term impatience and more exponential time preferences, whereas higher neuroticism (lower emotional stability) correlated positively with higher short-term impatience and less exponential time preferences. Cognitive-control and reward brain regions were more activated when higher conscientiousness participants selected a smaller-sooner reward and, conversely, when higher neuroticism participants selected a larger-later reward. The greater activations that occurred when choosing rewards that contradicted personality predispositions may reflect the greater recruitment of mental resources needed to override those predispositions. These findings reveal that stable personality traits fundamentally influence how rewards are chosen over time. Copyright © 2014 Elsevier Inc. All rights reserved.

The modulation of savouring by prediction error and its effects on choice

PubMed Central

Iigaya, Kiyohito; Story, Giles W; Kurth-Nelson, Zeb; Dolan, Raymond J; Dayan, Peter

2016-01-01

When people anticipate uncertain future outcomes, they often prefer to know their fate in advance. Inspired by an idea in behavioral economics that the anticipation of rewards is itself attractive, we hypothesized that this preference of advance information arises because reward prediction errors carried by such information can boost the level of anticipation. We designed new empirical behavioral studies to test this proposal, and confirmed that subjects preferred advance reward information more strongly when they had to wait for rewards for a longer time. We formulated our proposal in a reinforcement-learning model, and we showed that our model could account for a wide range of existing neuronal and behavioral data, without appealing to ambiguous notions such as an explicit value for information. We suggest that such boosted anticipation significantly drives risk-seeking behaviors, most pertinently in gambling. DOI: http://dx.doi.org/10.7554/eLife.13747.001 PMID:27101365

A computational substrate for incentive salience.

PubMed

McClure, Samuel M; Daw, Nathaniel D; Montague, P Read

2003-08-01

Theories of dopamine function are at a crossroads. Computational models derived from single-unit recordings capture changes in dopaminergic neuron firing rate as a prediction error signal. These models employ the prediction error signal in two roles: learning to predict future rewarding events and biasing action choice. Conversely, pharmacological inhibition or lesion of dopaminergic neuron function diminishes the ability of an animal to motivate behaviors directed at acquiring rewards. These lesion experiments have raised the possibility that dopamine release encodes a measure of the incentive value of a contemplated behavioral act. The most complete psychological idea that captures this notion frames the dopamine signal as carrying 'incentive salience'. On the surface, these two competing accounts of dopamine function seem incommensurate. To the contrary, we demonstrate that both of these functions can be captured in a single computational model of the involvement of dopamine in reward prediction for the purpose of reward seeking.

Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex.

PubMed

Takahashi, Yuji K; Roesch, Matthew R; Wilson, Robert C; Toreson, Kathy; O'Donnell, Patricio; Niv, Yael; Schoenbaum, Geoffrey

2011-10-30

The orbitofrontal cortex has been hypothesized to carry information regarding the value of expected rewards. Such information is essential for associative learning, which relies on comparisons between expected and obtained reward for generating instructive error signals. These error signals are thought to be conveyed by dopamine neurons. To test whether orbitofrontal cortex contributes to these error signals, we recorded from dopamine neurons in orbitofrontal-lesioned rats performing a reward learning task. Lesions caused marked changes in dopaminergic error signaling. However, the effect of lesions was not consistent with a simple loss of information regarding expected value. Instead, without orbitofrontal input, dopaminergic error signals failed to reflect internal information about the impending response that distinguished externally similar states leading to differently valued future rewards. These results are consistent with current conceptualizations of orbitofrontal cortex as supporting model-based behavior and suggest an unexpected role for this information in dopaminergic error signaling.

Reward Prediction Errors in Drug Addiction and Parkinson's Disease: from Neurophysiology to Neuroimaging.

PubMed

García-García, Isabel; Zeighami, Yashar; Dagher, Alain

2017-06-01

Surprises are important sources of learning. Cognitive scientists often refer to surprises as "reward prediction errors," a parameter that captures discrepancies between expectations and actual outcomes. Here, we integrate neurophysiological and functional magnetic resonance imaging (fMRI) results addressing the processing of reward prediction errors and how they might be altered in drug addiction and Parkinson's disease. By increasing phasic dopamine responses, drugs might accentuate prediction error signals, causing increases in fMRI activity in mesolimbic areas in response to drugs. Chronic substance dependence, by contrast, has been linked with compromised dopaminergic function, which might be associated with blunted fMRI responses to pleasant non-drug stimuli in mesocorticolimbic areas. In Parkinson's disease, dopamine replacement therapies seem to induce impairments in learning from negative outcomes. The present review provides a holistic overview of reward prediction errors across different pathologies and might inform future clinical strategies targeting impulsive/compulsive disorders.

Relationships between Reward Sensitivity, Risk-Taking and Family History of Alcoholism during an Interactive Competitive fMRI Task

PubMed Central

Yarosh, Haley L.; Hyatt, Christopher J.; Meda, Shashwath A.; Jiantonio-Kelly, Rachel; Potenza, Marc N.; Assaf, Michal; D.Pearlson, Godfrey

2014-01-01

Background Individuals with a positive family history for alcoholism (FHP) have shown differences from family-history-negative (FHN) individuals in the neural correlates of reward processing. FHP, compared to FHN individuals, demonstrate relatively diminished ventral striatal activation during anticipation of monetary rewards, and the degree of ventral striatal activation shows an inverse correlation with specific impulsivity measures in alcohol-dependent individuals. Rewards in socially interactive contexts relate importantly to addictive propensities, yet have not been examined with respect to how their neural underpinnings relate to impulsivity-related measures. Here we describe impulsivity measures in FHN and FHP individuals as they relate to a socially interactive functional magnetic resonance imaging (fMRI) task. Methods Forty FHP and 29 FHN subjects without histories of Axis-I disorders completed a socially interactive Domino task during functional magnetic resonance imaging and completed self-report and behavioral impulsivity-related assessments. Results FHP compared to FHN individuals showed higher scores (p = .004) on one impulsivity-related factor relating to both compulsivity (Padua Inventory) and reward/punishment sensitivity (Sensitivity to Punishment/Sensitivity to Reward Questionnaire). Multiple regression analysis within a reward-related network revealed a correlation between risk-taking (involving another impulsivity-related factor, the Balloon Analog Risk Task (BART)) and right ventral striatum activation under reward >punishment contrast (p<0.05 FWE corrected) in the social task. Conclusions Behavioral risk-taking scores may be more closely associated with neural correlates of reward responsiveness in socially interactive contexts than are FH status or impulsivity-related self-report measures. These findings suggest that risk-taking assessments be examined further in socially interactive settings relevant to addictive behaviors. PMID:24505424

Role stress, role reward, and mental health in a multiethnic sample of midlife women: results from the Study of Women's Health Across the Nation (SWAN).

PubMed

Lanza di Scalea, Teresa; Matthews, Karen A; Avis, Nancy E; Thurston, Rebecca C; Brown, Charlotte; Harlow, Sioban; Bromberger, Joyce T

2012-05-01

Little is known about the independent associations of reward and stress within specific roles with multiple measures of mental health in an ethnically diverse community sample of midlife women. The objective of this study is to examine if (1) role reward (within each role and across roles) contributes directly to mental health and buffers the negative impact of role stress and (2) associations among role occupancy, role stress, and role reward and mental health vary by race/ethnicity. With separate logistic regression analysis, we investigated cross-sectional relationships between role stress and role reward with presence/absence of high depressive symptoms (Center for Epidemiologic Studies Depression Scale [CES-D≥16]), anxiety symptoms (feeling tense or nervous, irritable or grouchy, fearful for no reason, and heart pounding or racing total score≥4), or low social functioning (bottom 25th percentile of the Short-Form-36 [SF-36] social functioning subscale) in 2549 women participating in the third visit of the Study of Women's Health Across the Nation (SWAN), a longitudinal population-based study of menopause. High reward across roles attenuated the negative impact of role stress on social functioning but not on anxiety or depression. High reward marriage buffered the impact of marital stress on depression, and high reward mothering buffered the effect of maternal stress on depression and social functioning. Compared to Caucasians, Hispanics and Chinese with high stress across roles had better social functioning, and African American mothers had lower odds of high depressive symptoms. Role reward buffers the negative impact of stress on social functioning and depression, but not on anxiety. Minorities may respond to role stress by seeking social support.

Role Stress, Role Reward, and Mental Health in a Multiethnic Sample of Midlife Women: Results from the Study of Women's Health Across the Nation (SWAN)

PubMed Central

Lanza di Scalea, Teresa; Matthews, Karen A.; Avis, Nancy E.; Thurston, Rebecca C.; Brown, Charlotte; Harlow, Sioban

2012-01-01

Abstract Background Little is known about the independent associations of reward and stress within specific roles with multiple measures of mental health in an ethnically diverse community sample of midlife women. The objective of this study is to examine if (1) role reward (within each role and across roles) contributes directly to mental health and buffers the negative impact of role stress and (2) associations among role occupancy, role stress, and role reward and mental health vary by race/ethnicity. Methods With separate logistic regression analysis, we investigated cross-sectional relationships between role stress and role reward with presence/absence of high depressive symptoms (Center for Epidemiologic Studies Depression Scale [CES-D≥16]), anxiety symptoms (feeling tense or nervous, irritable or grouchy, fearful for no reason, and heart pounding or racing total score≥4), or low social functioning (bottom 25th percentile of the Short-Form-36 [SF-36] social functioning subscale) in 2549 women participating in the third visit of the Study of Women's Health Across the Nation (SWAN), a longitudinal population-based study of menopause. Results High reward across roles attenuated the negative impact of role stress on social functioning but not on anxiety or depression. High reward marriage buffered the impact of marital stress on depression, and high reward mothering buffered the effect of maternal stress on depression and social functioning. Compared to Caucasians, Hispanics and Chinese with high stress across roles had better social functioning, and African American mothers had lower odds of high depressive symptoms. Conclusions Role reward buffers the negative impact of stress on social functioning and depression, but not on anxiety. Minorities may respond to role stress by seeking social support. PMID:22360697

Motivational effects on the processing of delayed intentions in the anterior prefrontal cortex.

PubMed

Bruening, Jovita; Ludwig, Vera U; Paschke, Lena M; Walter, Henrik; Stelzel, Christine

2018-05-15

Delaying intentions bears the risk of interference from distracting activities during the delay interval. Motivation can increase intention retrieval success but little is known about the underlying brain mechanisms. Here, we investigated whether motivational incentives (monetary reward) modulate the processing of delayed intentions in the anterior prefrontal cortex (aPFC), known to be crucial for intention processing. Using a mixed blocked and event-related functional Magnetic Resonance Imaging design, we specifically tested whether reward affects intention processing in the aPFC in a transient or in a sustained manner and whether this is related to individual differences in retrieval success. We found a generalized effect of reward on both correct intention retrieval and ongoing task performance. Fronto-parietal regions including bilateral lateral aPFC showed sustained activity increases in rewarded compared to non-rewarded blocks as well as transient reward-related activity during the storage phase. Additionally, individual differences in reward-related performance benefits were related to the degree of transient signal increases in right lateral aPFC, specifically during intention encoding. This suggests that the ability to integrate motivational relevance into the encoding of future intentions is crucial for successful intention retrieval in addition to general increases in processing effort. Bilateral aPFC is central to these motivation-cognition interactions. Copyright © 2018 Elsevier Inc. All rights reserved.

Exposure to bright light biases effort-based decisions.

PubMed

Bijleveld, Erik; Knufinke, Melanie

2018-06-01

Secreted in the evening and the night, melatonin suppresses activity of the mesolimbic dopamine pathway, a brain pathway involved in reward processing. However, exposure to bright light diminishes-or even prevents-melatonin secretion. Thus, we hypothesized that reward processing, in the evening, is more pronounced in bright light (vs. dim light). Healthy human participants carried out three tasks that tapped into various aspects of reward processing (effort expenditure for rewards task [EEfRT]; two-armed bandit task [2ABT]; balloon analogue risk task [BART). Brightness was manipulated within-subjects (bright vs. dim light), in separate evening sessions. During the EEfRT, participants used reward-value information more strongly when they were exposed to bright light (vs. dim light). This finding supported our hypothesis. However, exposure to bright light did not significantly affect task behavior on the 2ABT and the BART. While future research is necessary (e.g., to zoom in on working mechanisms), these findings have potential implications for the design of physical work environments. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Decisions in Motion: Decision Dynamics during Intertemporal Choice reflect Subjective Evaluation of Delayed Rewards

PubMed Central

O’Hora, Denis; Carey, Rachel; Kervick, Aoife; Crowley, David; Dabrowski, Maciej

2016-01-01

People tend to discount rewards or losses that occur in the future. Such delay discounting has been linked to many behavioral and health problems, since people choose smaller short-term gains over greater long-term gains. We investigated whether the effect of delays on the subjective value of rewards is expressed in how people move when they make choices. Over 600 patrons of the RISK LAB exhibition hosted by the Science Gallery DublinTM played a short computer game in which they used a computer mouse to choose between amounts of money at various delays. Typical discounting effects were observed and decision dynamics indicated that choosing smaller short-term rewards became easier (i.e., shorter response times, tighter trajectories, less vacillation) as the delays until later rewards increased. Based on a sequence of choices, subjective values of delayed outcomes were estimated and decision dynamics during initial choices predicted these values. Decision dynamics are affected by subjective values of available options and thus provide a means to estimate such values. PMID:26867497

Enhanced functional connectivity and volume between cognitive and reward centers of naïve rodent brain produced by pro-dopaminergic agent KB220Z

PubMed Central

Badgaiyan, Rajendra D.; Thanos, Panayotis K.; Kulkarni, Praveen; Giordano, John; Baron, David; Gold, Mark S.

2017-01-01

Dopaminergic reward dysfunction in addictive behaviors is well supported in the literature. There is evidence that alterations in synchronous neural activity between brain regions subserving reward and various cognitive functions may significantly contribute to substance-related disorders. This study presents the first evidence showing that a pro-dopaminergic nutraceutical (KB220Z) significantly enhances, above placebo, functional connectivity between reward and cognitive brain areas in the rat. These include the nucleus accumbens, anterior cingulate gyrus, anterior thalamic nuclei, hippocampus, prelimbic and infralimbic loci. Significant functional connectivity, increased brain connectivity volume recruitment (potentially neuroplasticity), and dopaminergic functionality were found across the brain reward circuitry. Increases in functional connectivity were specific to these regions and were not broadly distributed across the brain. While these initial findings have been observed in drug naïve rodents, this robust, yet selective response implies clinical relevance for addicted individuals at risk for relapse, who show reductions in functional connectivity after protracted withdrawal. Future studies will evaluate KB220Z in animal models of addiction. PMID:28445527

Discounting of reward sequences: a test of competing formal models of hyperbolic discounting

PubMed Central

Zarr, Noah; Alexander, William H.; Brown, Joshua W.

2014-01-01

Humans are known to discount future rewards hyperbolically in time. Nevertheless, a formal recursive model of hyperbolic discounting has been elusive until recently, with the introduction of the hyperbolically discounted temporal difference (HDTD) model. Prior to that, models of learning (especially reinforcement learning) have relied on exponential discounting, which generally provides poorer fits to behavioral data. Recently, it has been shown that hyperbolic discounting can also be approximated by a summed distribution of exponentially discounted values, instantiated in the μAgents model. The HDTD model and the μAgents model differ in one key respect, namely how they treat sequences of rewards. The μAgents model is a particular implementation of a Parallel discounting model, which values sequences based on the summed value of the individual rewards whereas the HDTD model contains a non-linear interaction. To discriminate among these models, we observed how subjects discounted a sequence of three rewards, and then we tested how well each candidate model fit the subject data. The results show that the Parallel model generally provides a better fit to the human data. PMID:24639662

A money management-based substance use treatment increases valuation of future rewards.

PubMed

Black, Anne C; Rosen, Marc I

2011-01-01

A positive association between delay discounting and substance use has been documented; substance users tend to discount future rewards more than non-users. However, studies detailing the responsiveness of delay discounting to interventions are lacking, and few have examined how any behavioral intervention affects delay discounting and whether these effects moderate changes in substance abuse. This study assesses the effectiveness of a money management intervention, Advisor-Teller Money Manager (ATM), in reducing delay discounting over time and the relationship of these effects to changes in cocaine use. Ninety psychiatric patients with histories of cocaine and/or alcohol use were randomly assigned to 36-weeks of ATM treatment or to a minimal-attention control condition. Delay discounting and cocaine use were measured throughout the intervention with a 52-week follow up measure of cocaine use. Analyses were conducted of (a) the effect of ATM on slopes of delay discounting and cocaine abstinence and (b) the relationship between change in delay discounting and change in cocaine abstinence. The ATM intervention was associated with significantly less delay discounting and less cocaine use over time relative to controls. Increases in delay discounting were associated with decreased abstinence from cocaine. ATM treatment decreased delay discounting rates and these effects extended to cocaine use. Concrete conceptualizations of future events, as occur in financial planning, with higher perceived probability may account for higher valuation of future rewards in counseled patients. Copyright © 2010 Elsevier Ltd. All rights reserved.

The Vivid Present: Visualization Abilities Are Associated with Steep Discounting of Future Rewards

PubMed Central

Parthasarathi, Trishala; McConnell, Mairead H.; Luery, Jeffrey; Kable, Joseph W.

2017-01-01

Humans and other animals discount the value of future rewards, a phenomenon known as delay discounting. Individuals vary widely in the extent to which they discount future rewards, and these tendencies have been associated with important life outcomes. Recent studies have demonstrated that imagining the future reduces subsequent discounting behavior, but no research to date has examined whether a similar principle applies at the trait level, and whether training visualization changes discounting. The current study examined if individual differences in visualization abilities are linked to individual differences in discounting and whether practicing visualization can change discounting behaviors in a lasting way. Participants (n = 48) completed the Vividness of Visual Imagery Questionnaire (VVIQ) and delay discounting task and then underwent a 4-week intervention consisting of visualization training (intervention) or relaxation training (control). Contrary to our hypotheses, participants who reported greater visualization abilities (lower scores) on the VVIQ were higher discounters. To further examine this relationship, an additional 106 participants completed the VVIQ and delay discounting task. In the total sample (n = 154), there was a significant negative correlation between VVIQ scores and discount rates, showing that individuals who are better visualizers are also higher discounters. Consistent with this relationship but again to our surprise, visualization training tended, albeit weakly, to increase discount rates, and those whose VVIQ decreased the most were those whose discount rates increased the most. These results suggest a novel association between visualization abilities and delay discounting. PMID:28321198

Generalized trust predicts young children's willingness to delay gratification.

PubMed

Ma, Fengling; Chen, Biyun; Xu, Fen; Lee, Kang; Heyman, Gail D

2018-05-01

Young children's willingness to delay gratification by forgoing an immediate reward to obtain a more desirable one in the future predicts a wide range of positive social, cognitive, and health outcomes. Standard accounts of this phenomenon have focused on individual differences in cognitive control skills that allow children to engage in goal-oriented behavior, but recent findings suggest that person-specific trust is also important, with children showing a stronger tendency to delay gratification if they have reason to trust the individual who is promising the future reward. The current research builds on those findings by examining generalized trust, which refers to the extent to which others are generally viewed as trustworthy. A total of 150 3- to 5-year-olds in China were tested. Participants were given the opportunity to obtain one sticker immediately, or wait for 15 min for two stickers. Results showed that participants with high levels of generalized trust waited longer even after controlling for age and level of executive function. These results suggest that trust plays a role in delaying gratification even when children have no information about the individual who is promising the future reward. More broadly, the findings build on recent evidence that there is more to delay of gratification than cognitive capacity, and they suggest that there are individual differences in whether children consider sacrificing for a future outcome to be worth the risk. Copyright © 2017 Elsevier Inc. All rights reserved.

The Vivid Present: Visualization Abilities Are Associated with Steep Discounting of Future Rewards.

PubMed

Parthasarathi, Trishala; McConnell, Mairead H; Luery, Jeffrey; Kable, Joseph W

2017-01-01

Humans and other animals discount the value of future rewards, a phenomenon known as delay discounting. Individuals vary widely in the extent to which they discount future rewards, and these tendencies have been associated with important life outcomes. Recent studies have demonstrated that imagining the future reduces subsequent discounting behavior, but no research to date has examined whether a similar principle applies at the trait level, and whether training visualization changes discounting. The current study examined if individual differences in visualization abilities are linked to individual differences in discounting and whether practicing visualization can change discounting behaviors in a lasting way. Participants ( n = 48) completed the Vividness of Visual Imagery Questionnaire (VVIQ) and delay discounting task and then underwent a 4-week intervention consisting of visualization training (intervention) or relaxation training (control). Contrary to our hypotheses, participants who reported greater visualization abilities (lower scores) on the VVIQ were higher discounters. To further examine this relationship, an additional 106 participants completed the VVIQ and delay discounting task. In the total sample ( n = 154), there was a significant negative correlation between VVIQ scores and discount rates, showing that individuals who are better visualizers are also higher discounters. Consistent with this relationship but again to our surprise, visualization training tended, albeit weakly, to increase discount rates, and those whose VVIQ decreased the most were those whose discount rates increased the most. These results suggest a novel association between visualization abilities and delay discounting.

Quicker Q-Learning in Multi-Agent Systems

NASA Technical Reports Server (NTRS)

Agogino, Adrian K.; Tumer, Kagan

2005-01-01

Multi-agent learning in Markov Decisions Problems is challenging because of the presence ot two credit assignment problems: 1) How to credit an action taken at time step t for rewards received at t' greater than t; and 2) How to credit an action taken by agent i considering the system reward is a function of the actions of all the agents. The first credit assignment problem is typically addressed with temporal difference methods such as Q-learning OK TD(lambda) The second credit assi,onment problem is typically addressed either by hand-crafting reward functions that assign proper credit to an agent, or by making certain independence assumptions about an agent's state-space and reward function. To address both credit assignment problems simultaneously, we propose the Q Updates with Immediate Counterfactual Rewards-learning (QUICR-learning) designed to improve both the convergence properties and performance of Q-learning in large multi-agent problems. Instead of assuming that an agent s value function can be made independent of other agents, this method suppresses the impact of other agents using counterfactual rewards. Results on multi-agent grid-world problems over multiple topologies show that QUICR-learning can achieve up to thirty fold improvements in performance over both conventional and local Q-learning in the largest tested systems.

A biased activation theory of the cognitive and attentional modulation of emotion.

PubMed

Rolls, Edmund T

2013-01-01

Cognition can influence emotion by biasing neural activity in the first cortical region in which the reward value and subjective pleasantness of stimuli is made explicit in the representation, the orbitofrontal cortex (OFC). The same effect occurs in a second cortical tier for emotion, the anterior cingulate cortex (ACC). Similar effects are found for selective attention, to for example the pleasantness vs. the intensity of stimuli, which modulates representations of reward value and affect in the orbitofrontal and anterior cingulate cortices. The mechanisms for the effects of cognition and attention on emotion are top-down biased competition and top-down biased activation. Affective and mood states can in turn influence memory and perception, by backprojected biasing influences. Emotion-related decision systems operate to choose between gene-specified rewards such as taste, touch, and beauty. Reasoning processes capable of planning ahead with multiple steps held in working memory in the explicit system can allow the gene-specified rewards not to be selected, or to be deferred. The stochastic, noisy, dynamics of decision-making systems in the brain may influence whether decisions are made by the selfish-gene-specified reward emotion system, or by the cognitive reasoning system that explicitly calculates reward values that are in the interests of the individual, the phenotype.

QUICR-learning for Multi-Agent Coordination

NASA Technical Reports Server (NTRS)

Agogino, Adrian K.; Tumer, Kagan

2006-01-01

Coordinating multiple agents that need to perform a sequence of actions to maximize a system level reward requires solving two distinct credit assignment problems. First, credit must be assigned for an action taken at time step t that results in a reward at time step t > t. Second, credit must be assigned for the contribution of agent i to the overall system performance. The first credit assignment problem is typically addressed with temporal difference methods such as Q-learning. The second credit assignment problem is typically addressed by creating custom reward functions. To address both credit assignment problems simultaneously, we propose the "Q Updates with Immediate Counterfactual Rewards-learning" (QUICR-learning) designed to improve both the convergence properties and performance of Q-learning in large multi-agent problems. QUICR-learning is based on previous work on single-time-step counterfactual rewards described by the collectives framework. Results on a traffic congestion problem shows that QUICR-learning is significantly better than a Q-learner using collectives-based (single-time-step counterfactual) rewards. In addition QUICR-learning provides significant gains over conventional and local Q-learning. Additional results on a multi-agent grid-world problem show that the improvements due to QUICR-learning are not domain specific and can provide up to a ten fold increase in performance over existing methods.

Neural Basis of Reinforcement Learning and Decision Making

PubMed Central

Lee, Daeyeol; Seo, Hyojung; Jung, Min Whan

2012-01-01

Reinforcement learning is an adaptive process in which an animal utilizes its previous experience to improve the outcomes of future choices. Computational theories of reinforcement learning play a central role in the newly emerging areas of neuroeconomics and decision neuroscience. In this framework, actions are chosen according to their value functions, which describe how much future reward is expected from each action. Value functions can be adjusted not only through reward and penalty, but also by the animal’s knowledge of its current environment. Studies have revealed that a large proportion of the brain is involved in representing and updating value functions and using them to choose an action. However, how the nature of a behavioral task affects the neural mechanisms of reinforcement learning remains incompletely understood. Future studies should uncover the principles by which different computational elements of reinforcement learning are dynamically coordinated across the entire brain. PMID:22462543

Evaluations and Future Plans After Casual Sexual Experiences: Differences Across Partner Type.

PubMed

Wesche, Rose; Claxton, Shannon E; Lefkowitz, Eva S; van Dulmen, Manfred H M

2017-03-24

Casual sexual relationships and experiences (CSREs) are common among emerging adults, and their diversity may contribute to variability in their associations with mental health and future romantic relationship development. The present research used multiple regression analyses to examine how CSRE type (casual dating, friends with benefits [FWB], or booty call/one-night stand) is associated with short-term outcomes of these experiences, including positive and negative evaluations, plans to start a romantic relationship with a CSRE partner, and general plans for future CSREs. College students and non-college-attending emerging adults (N = 192, 80% female, mean age = 22.09 years) reported on recent sexual encounters through daily diaries collected around an alcohol consumption holiday. Individuals with casual dating partners evaluated their experiences more positively and/or less negatively than individuals with booty calls/one-night stands; these associations were moderated by gender and sexual behavior type. Individuals with casual dating partners were more oriented toward pursuing a romantic relationship with their partners than individuals with FWB or booty calls/one-night stands. However, no association was found between CSRE type and plans for future CSREs in general. Results highlight the diversity of CSREs and suggest that casual dating may be more rewarding than FWB and booty calls/one-night stands, particularly for women.

Reduced reward-related neural response to mimicry in individuals with autism.

PubMed

Hsu, Chun-Ting; Neufeld, Janina; Chakrabarti, Bhismadev

2018-03-01

Mimicry is a facilitator of social bonds in humans, from infancy. This facilitation is made possible through changing the reward value of social stimuli; for example, we like and affiliate more with people who mimic us. Autism spectrum disorders (ASD) are marked by difficulties in forming social bonds. In this study, we investigate whether the reward-related neural response to being mimicked is altered in individuals with ASD, using a simple conditioning paradigm. Multiple studies in humans and nonhuman primates have established a crucial role for the ventral striatal (VS) region in responding to rewards. In this study, adults with ASD and matched controls first underwent a conditioning task outside the scanner, where they were mimicked by one face and 'anti-mimicked' by another. In the second part, participants passively viewed the conditioned faces in a 3T MRI scanner using a multi-echo sequence. The differential neural response towards mimicking vs. anti-mimicking faces in the VS was tested for group differences as well as an association with self-reported autistic traits. Multiple regression analysis revealed lower left VS response to mimicry (mimicking > anti-mimicking faces) in the ASD group compared to controls. The VS response to mimicry was negatively correlated with autistic traits across the whole sample. Our results suggest that for individuals with ASD and high autistic traits, being mimicked is associated with lower reward-related neural response. This result points to a potential mechanism underlying the difficulties reported by many of individuals with ASD in building social rapport. © 2017 The Authors. European Journal of Neuroscience published by Federation of European Neuroscience Societies and John Wiley & Sons Ltd.

Reward-Related Behavioral Paradigms for Addiction Research in the Mouse: Performance of Common Inbred Strains

PubMed Central

Feyder, Michael; Brigman, Jonathan L.; Crombag, Hans S.; Saksida, Lisa M.; Bussey, Timothy J.; Holmes, Andrew

2011-01-01

The mouse has emerged as a uniquely valuable species for studying the molecular and genetic basis of complex behaviors and modeling neuropsychiatric disease states. While valid and reliable preclinical assays for reward-related behaviors are critical to understanding addiction-related processes, and various behavioral procedures have been developed and characterized in rats and primates, there have been relatively few studies using operant-based addiction-relevant behavioral paradigms in the mouse. Here we describe the performance of the C57BL/6J inbred mouse strain on three major reward-related paradigms, and replicate the same procedures in two other commonly used inbred strains (DBA/2J, BALB/cJ). We examined Pavlovian-instrumental transfer (PIT) by measuring the ability of an auditory cue associated with food reward to promote an instrumental (lever press) response. In a separate experiment, we assessed the acquisition and extinction of a simple stimulus-reward instrumental behavior on a touchscreen-based task. Reinstatement of this behavior was then examined following either continuous exposure to cues (conditioned reinforcers, CRs) associated with reward, brief reward and CR exposure, or brief reward exposure followed by continuous CR exposure. The third paradigm examined sensitivity of an instrumental (lever press) response to devaluation of food reward (a probe for outcome insensitive, habitual behavior) by repeated pairing with malaise. Results showed that C57BL/6J mice displayed robust PIT, as well as clear extinction and reinstatement, but were insensitive to reinforcer devaluation. DBA/2J mice showed good PIT and (rewarded) reinstatement, but were slow to extinguish and did not show reinforcer devaluation or significant CR-reinstatement. BALB/cJ mice also displayed good PIT, extinction and reinstatement, and retained instrumental responding following devaluation, but, unlike the other strains, demonstrated reduced Pavlovian approach behavior (food magazine head entries). Overall, these assays provide robust paradigms for future studies using the mouse to elucidate the neural, molecular and genetic factors underpinning reward-related behaviors relevant to addiction research. PMID:21249214

Reward-related behavioral paradigms for addiction research in the mouse: performance of common inbred strains.

PubMed

Lederle, Lauren; Weber, Susanna; Wright, Tara; Feyder, Michael; Brigman, Jonathan L; Crombag, Hans S; Saksida, Lisa M; Bussey, Timothy J; Holmes, Andrew

2011-01-10

The mouse has emerged as a uniquely valuable species for studying the molecular and genetic basis of complex behaviors and modeling neuropsychiatric disease states. While valid and reliable preclinical assays for reward-related behaviors are critical to understanding addiction-related processes, and various behavioral procedures have been developed and characterized in rats and primates, there have been relatively few studies using operant-based addiction-relevant behavioral paradigms in the mouse. Here we describe the performance of the C57BL/6J inbred mouse strain on three major reward-related paradigms, and replicate the same procedures in two other commonly used inbred strains (DBA/2J, BALB/cJ). We examined Pavlovian-instrumental transfer (PIT) by measuring the ability of an auditory cue associated with food reward to promote an instrumental (lever press) response. In a separate experiment, we assessed the acquisition and extinction of a simple stimulus-reward instrumental behavior on a touch screen based task. Reinstatement of this behavior was then examined following either continuous exposure to cues (conditioned reinforcers, CRs) associated with reward, brief reward and CR exposure, or brief reward exposure followed by continuous CR exposure. The third paradigm examined sensitivity of an instrumental (lever press) response to devaluation of food reward (a probe for outcome insensitive, habitual behavior) by repeated pairing with malaise. Results showed that C57BL/6J mice displayed robust PIT, as well as clear extinction and reinstatement, but were insensitive to reinforcer devaluation. DBA/2J mice showed good PIT and (rewarded) reinstatement, but were slow to extinguish and did not show reinforcer devaluation or significant CR-reinstatement. BALB/cJ mice also displayed good PIT, extinction and reinstatement, and retained instrumental responding following devaluation, but, unlike the other strains, demonstrated reduced Pavlovian approach behavior (food magazine head entries). Overall, these assays provide robust paradigms for future studies using the mouse to elucidate the neural, molecular and genetic factors underpinning reward-related behaviors relevant to addiction research.

A critical appraisal of neuroimaging studies of bipolar disorder: toward a new conceptualization of underlying neural circuitry and roadmap for future research

PubMed Central

Phillips, Mary L; Swartz, Holly A.

2014-01-01

Objective This critical review appraises neuroimaging findings in bipolar disorder in emotion processing, emotion regulation, and reward processing neural circuitry, to synthesize current knowledge of the neural underpinnings of bipolar disorder, and provide a neuroimaging research “roadmap” for future studies. Method We examined findings from all major studies in bipolar disorder that used fMRI, volumetric analyses, diffusion imaging, and resting state techniques, to inform current conceptual models of larger-scale neural circuitry abnormalities in bipolar disorder Results Bipolar disorder can be conceptualized in neural circuitry terms as parallel dysfunction in bilateral prefrontal cortical (especially ventrolateral prefrontal cortical)-hippocampal-amygdala emotion processing and emotion regulation neural circuitries, together with an “overactive” left-sided ventral striatal-ventrolateral and orbitofrontal cortical reward processing circuitry, that result in characteristic behavioral abnormalities associated with bipolar disorder: emotional lability, emotional dysregulation and heightened reward sensitivity. A potential structural basis for these functional abnormalities are gray matter decreases in prefrontal and temporal cortices, amygdala and hippocampus, and fractional anisotropy decreases in white matter tracts connecting prefrontal and subcortical regions. Conclusion Neuroimaging studies of bipolar disorder clearly demonstrate abnormalities in neural circuitries supporting emotion processing, emotion regulation and reward processing, although there are several limitations to these studies. Future neuroimaging research in bipolar disorder should include studies adopting dimensional approaches; larger studies examining neurodevelopmental trajectories in bipolar disorder and at-risk youth; multimodal neuroimaging studies using integrated systems approaches; and studies using pattern recognition approaches to provide clinically useful, individual-level data. Such studies will help identify clinically-relevant biomarkers to guide diagnosis and treatment decision-making for individuals with bipolar disorder. PMID:24626773

Affective decision-making deficits, linked to a dysfunctional ventromedial prefrontal cortex, revealed in 10th grade Chinese adolescent binge drinkers

PubMed Central

Johnson, C. Anderson; Xiao, Lin; Palmer, Paula; Sun, Ping; Wang, Qiong; Wei, Yonglan; Jia, Yong; Grenard, Jerry L.; Stacy, Alan W.; Bechara, Antoine

2011-01-01

The primary aim of this study was to test the hypothesis that adolescent binge drinkers, but not lighter drinkers, would show signs of impairment on tasks of affective decision-making as measured by the Iowa Gambling Test (IGT), when compared to adolescents who never drank. We tested 207 10th grade adolescents in Chengdu City, China, using two versions of the IGT, the original and a variant, in which the reward/punishment contingencies were reversed. This enables one to distinguish among different possibilities of impaired decision-making, such as insensitivity to long-term consequences, or hypersensitivity to reward. Furthermore, we tested working memory capacity using the Self-ordered Pointing Test (SOPT). Paper and pencil questionnaires were used to assess drinking behaviors and school academic performance. Results indicated that relative to never-drinkers, adolescent binge drinkers, but not other (ever, past 30-day) drinkers, showed significantly lower net scores on the original version of the IGT especially in the latter trials. Furthermore, the profiles of behavioral performance from the original and variant versions of the IGT were consistent with a decision-making impairment attributed to hypersensitivity to reward. In addition, working memory and school academic performance revealed no differences between drinkers (at all levels) and never-drinkers. Logistic regression analysis showed that after controlling for demographic variables, working memory, and school academic performance, the IGT significantly predicted binge-drinking. These findings suggest that a “myopia” for future consequences linked to hypersensitivity to reward is a key characteristic of adolescents with binge-drinking behavior, and that underlying neural mechanisms for this “myopia” for future consequences may serve as a predisposing factor that renders some adolescents more susceptible to future addictive behaviors. PMID:17996909

Risk and protective factors in the clinical rehabilitation of chronic back pain

PubMed Central

Wippert, Pia-Maria; Fliesser, Michael; Krause, Matthias

2017-01-01

Objectives Chronic back pain (CBP) can lead to disability and burden. In addition to its medical causes, its development is influenced by psychosocial risk factors, the so-called flag factors, which are categorized and integrated into many treatment guidelines. Currently, most studies investigate single flag factors, which limit the estimation of individual factor significance in the development of chronic pain. Furthermore, factors concerning patients’ lifestyle, biography and treatment history are often neglected. Therefore, the objectives of the present study are to identify commonly neglected factors of CBP and integrate them into an analysis model comparing their significance with established flag factors. Methods A total of 24 patients and therapists were cross-sectionally interviewed to identify commonly neglected factors of CBP. Subsequently, the impact of these factors was surveyed in a longitudinal study. In two rehabilitation clinics, CBP patients (n = 145) were examined before and 6 months after a 3-week inpatient rehabilitation. Outcome variables, chronification factor pain experience (CF-PE) and chronification factor disability (CF-D), were ascertained with confirmatory factor analysis (CFA) of standardized questionnaires. Predictors were evaluated using stepwise calculations of simple and multiple regression models. Results Through interviews, medical history, iatrogenic factors, poor compliance, critical life events (LEs), social support (SS) type and effort–reward were identified as commonly neglected factors. However, only the final three held significance in comparison to established factors such as depression and pain-related cognitions. Longitudinally, lifestyle factors found to influence future pain were initial pain, physically demanding work, nicotine consumption, gender and rehabilitation clinic. LEs were unexpectedly found to be a strong predictor of future pain, as were the protective factors, reward at work and perceived SS. Discussion These findings shed insight regarding often overlooked factors in the development of CBP, suggesting that more detailed operationalization and superordinate frameworks would be beneficial to further research. Conclusion In particular, LEs should be taken into account in future research. Protective factors should be integrated in therapeutic settings. PMID:28740424

Clarifying the Relationship between Impulsive Delay Discounting and Nicotine Dependence

PubMed Central

Amlung, Michael; MacKillop, James

2014-01-01

Impulsive delayed reward discounting (DRD) has been linked to nicotine dependence, but with some inconsistency. This may be related to the considerable variability in the literature with regard to the DRD assessments used, particularly in the case of reward magnitudes assessed. In addition, previous studies have often not considered concurrent substance use when examining the relationship between DRD and nicotine dependence. The current study sought to further clarify the relationship between DRD and nicotine dependence by characterizing DRD across diverse reward magnitudes and incorporating other substance use. Daily smokers (N = 933) were assessed for DRD preferences across nine reward magnitudes (delayed reward range: $2.50–$850), comorbid substance use, and relevant demographic variables (age, education, income). A significant large effect size magnitude effect was found for DRD, reflecting steeper discounting for smaller delayed rewards, but significant correlations across magnitudes also suggested similar relative levels of discounting. Principal components analysis (PCA) was used to generate a single latent index of discounting across all magnitudes that accounted for 67% of the total variance. In both correlation and regression analyses, steeper composite DRD was significantly associated with nicotine dependence severity. This relationship remained statistically significant after incorporating demographic variables and alcohol and illicit drug use. These findings provide evidence of a specific link between impulsive DRD and nicotine dependence, and reveal that this association is robust across a broad range of monetary rewards. The study also demonstrates the utility of using PCA to generate latent indices of delay discounting across multiple magnitudes of delayed reward. PMID:24841186

Interference and Shaping in Sensorimotor Adaptations with Rewards

PubMed Central

Darshan, Ran; Leblois, Arthur; Hansel, David

2014-01-01

When a perturbation is applied in a sensorimotor transformation task, subjects can adapt and maintain performance by either relying on sensory feedback, or, in the absence of such feedback, on information provided by rewards. For example, in a classical rotation task where movement endpoints must be rotated to reach a fixed target, human subjects can successfully adapt their reaching movements solely on the basis of binary rewards, although this proves much more difficult than with visual feedback. Here, we investigate such a reward-driven sensorimotor adaptation process in a minimal computational model of the task. The key assumption of the model is that synaptic plasticity is gated by the reward. We study how the learning dynamics depend on the target size, the movement variability, the rotation angle and the number of targets. We show that when the movement is perturbed for multiple targets, the adaptation process for the different targets can interfere destructively or constructively depending on the similarities between the sensory stimuli (the targets) and the overlap in their neuronal representations. Destructive interferences can result in a drastic slowdown of the adaptation. As a result of interference, the time to adapt varies non-linearly with the number of targets. Our analysis shows that these interferences are weaker if the reward varies smoothly with the subject's performance instead of being binary. We demonstrate how shaping the reward or shaping the task can accelerate the adaptation dramatically by reducing the destructive interferences. We argue that experimentally investigating the dynamics of reward-driven sensorimotor adaptation for more than one sensory stimulus can shed light on the underlying learning rules. PMID:24415925

Irrelevant reward and selection histories have different influences on task-relevant attentional selection.

PubMed

MacLean, Mary H; Giesbrecht, Barry

2015-07-01

Task-relevant and physically salient features influence visual selective attention. In the present study, we investigated the influence of task-irrelevant and physically nonsalient reward-associated features on visual selective attention. Two hypotheses were tested: One predicts that the effects of target-defining task-relevant and task-irrelevant features interact to modulate visual selection; the other predicts that visual selection is determined by the independent combination of relevant and irrelevant feature effects. These alternatives were tested using a visual search task that contained multiple targets, placing a high demand on the need for selectivity, and that was data-limited and required unspeeded responses, emphasizing early perceptual selection processes. One week prior to the visual search task, participants completed a training task in which they learned to associate particular colors with a specific reward value. In the search task, the reward-associated colors were presented surrounding targets and distractors, but were neither physically salient nor task-relevant. In two experiments, the irrelevant reward-associated features influenced performance, but only when they were presented in a task-relevant location. The costs induced by the irrelevant reward-associated features were greater when they oriented attention to a target than to a distractor. In a third experiment, we examined the effects of selection history in the absence of reward history and found that the interaction between task relevance and selection history differed, relative to when the features had previously been associated with reward. The results indicate that under conditions that demand highly efficient perceptual selection, physically nonsalient task-irrelevant and task-relevant factors interact to influence visual selective attention.

The proposed general practice descriptors--will they influence preventive medicine?

PubMed

Moorhead, R G

1989-01-01

The proposed descriptor bill to change Medicare rebates to general practice patients could have a benefit to general practice preventive medicine. This seems possible through rewarding practitioners who spend more time with their patients and the positive effects of continuing medical education. However, the potential exists for whittling away any rewards for these practitioners by future governments and the audit of general practices could become a method of political control of Australian general practice.

Allocating effort and anticipating pleasure in schizophrenia: Relationship with real world functioning.

PubMed

Serper, M; Payne, E; Dill, C; Portillo, C; Taliercio, J

2017-10-01

Poor motivation to engage in goal-oriented behavior has been recognized as a hallmark feature of schizophrenia spectrum disorders (SZ). Low drive in SZ may be related to anticipating rewards as well as to poor working memory. However, few studies to date have examined beliefs about self-efficacy and satisfaction for future rewards (anticipatory pleasure). Additionally, few studies to date have examined how these deficits may impact SZ patients' real world functioning. The present study examined SZ patients' (n=57) anticipatory pleasure, working memory, self-efficacy and real world functioning in relation to their negative symptom severity. Results revealed that SZ patients' negative symptom severity was related to decisions in effort allocation and reward probability, working memory deficits, self-efficacy and anticipatory pleasure for future reward. Effort allocation deficits also predicted patients' daily functioning skills. SZ patients with high levels of negative symptoms are not merely effort averse, but have more difficulty effectively allocating effort and anticipating pleasure engaging in effortful activities. It may be the case that continuously failing to achieve reinforcement from engagement and participation may lead SZ patients to form certain negative beliefs about their abilities which contributes to amotivation and cognitive deficits. Lastly, our findings provide further support for a link between SZ patients functional daily living skills their effort allocation. Copyright © 2017 Elsevier Masson SAS. All rights reserved.

Attention-deficit/hyperactivity disorder, delay discounting, and risky financial behaviors: A preliminary analysis of self-report data.

PubMed

Beauchaine, Theodore P; Ben-David, Itzhak; Sela, Aner

2017-01-01

Delay discounting-often referred to as hyperbolic discounting in the financial literature-is defined by a consistent preference for smaller, immediate rewards over larger, delayed rewards, and by failure of future consequences to curtail current consummatory behaviors. Previous research demonstrates (1) excessive delay discounting among individuals with attention-deficit/hyperactivity disorder (ADHD), (2) common neural substrates of delay discounting and hyperactive-impulsive symptoms of ADHD, and (3) associations between delay discounting and both debt burden and high interest rate borrowing. This study extends prior research by examining associations between ADHD symptoms, delay discounting, and an array of previously unevaluated financial outcomes among 544 individuals (mean age 35 years). Controlling for age, income, sex, education, and substance use, ADHD symptoms were associated with delay discounting, late credit card payments, credit card balances, use of pawn services, personal debt, and employment histories (less time spent at more jobs). Consistent with neural models of reward processing and associative learning, more of these relations were attributable to hyperactive-impulsive symptoms than inattentive symptoms. Implications for financial decision-making and directions for future research are discussed.

Treating Non-Retentive Encopresis with Rewarded Scheduled Toilet Visits

PubMed Central

Boles, Richard E; Roberts, Michael C; Vernberg, Eric M

2008-01-01

We evaluated the effects of rewarded scheduled toilet sits on non-retentive encopretic behavior of an elementary-school student receiving services for serious emotional disturbance. A multidisciplinary team implemented the 8-week intervention using a multiple baseline across settings design. The results showed an increase in sitting on the toilet and a decline in encopretic episodes in both school and home settings. These findings support the use of a behavioral intervention for children with significant behavioral disorders within a classroom setting. PMID:22477690

An Examination of the Multi-Faceted Motivation System in Healthy Young Adults.

PubMed

Da Silva, Susana; Apatsidou, Areti; Saperia, Sarah; Siddiqui, Ishraq; Jeffay, Eliyas; Voineskos, Aristotle N; Daskalakis, Zafiris J; Remington, Gary; Zakzanis, Konstantine K; Foussias, George

2018-01-01

Background: Amotivation is a prevalent symptom in schizophrenia (SZ) and depression (MDD), and is linked to poor functional outcomes in affected individuals. Conceptualizations of motivation have outlined a multi-faceted construct comprised of reward responsiveness, reward expectancy, reward valuation, effort valuation, and action selection/preference-based decision making. To date, findings from studies utilizing variable-centered approaches to examining isolated facets of motivation in SZ and MDD have been inconsistent. Thus, the present study adopted a person-centered approach, and comprehensively examined the reward system in a non-clinical sample in an attempt to explore potential subtypes of motivation impairments, while minimizing the effects of illness-related confounds. Methods: Ninety-six healthy undergraduate students were evaluated for amotivation, schizotypal traits, depressive symptoms, and cognition, and administered objective computerized tasks to measure the different facets of motivation. Cluster analysis was performed to explore subgroups of individuals based on similar motivation task performance. Additionally, correlational analyses were conducted in order to examine inter-relationships between motivation facets, and relations between clinical measures and facets of motivation. Results: Cluster analysis identified two subgroups of individuals with differential motivation performance profiles. Correlational analyses revealed that reward responsiveness was associated with amotivation, depressive symptoms, and negative schizotypy. Further, significant inter-correlations were found between reward responsiveness and reward expectancy, as well as between reward valuation and effort valuation. Conclusions: Our results mark important steps forward in understanding motivation in a non-clinical sample, and guide future dimensional and comprehensive analyses of the multi-faceted reward system. It remains to be seen whether these patterns of results will be similar in clinical populations such as SZ and MDD.

Do Self-Incentives and Self-Rewards Change Behavior? A Systematic Review and Meta-Analysis.

PubMed

Brown, Emma M; Smith, Debbie M; Epton, Tracy; Armitage, Christopher J

2018-01-01

Encouraging people to self-incentivize (i.e., to reward themselves in the future if they are successful in changing their behavior) or self-reward (i.e., prompt people to reward themselves once they have successfully changed their behavior) are techniques that are frequently embedded within complex behavior change interventions. However, it is not clear whether self-incentives or self-rewards per se are effective at bringing about behavior change. Nine databases were searched alongside manual searching of systematic reviews and online research registers. One thousand four hundred papers were retrieved, spanning a range of behaviors, though the majority of included papers were in the domain of "health psychology". Ten studies matched the inclusion criteria for self-incentive but no studies were retrieved for self-reward. The present systematic review and meta-analysis is therefore the first to evaluate the unique effect of self-incentives on behavior change. Effect sizes were retrieved from 7 of the 10 studies. Analysis of the 7 studies produced a very small pooled effect size for self-incentives (k = 7, N = 1,161), which was statistically significant, d + = 0.17, CI [0.06, 0.29]. The weak effect size and dearth of studies raises the question of why self-incentivizing is such a widely employed component of behavior change interventions. The present research opens up a new field of inquiry to establish: (a) whether or not self-incentivizing and self-rewarding are effective behavior change techniques, (b) whether self-incentives and self-rewards need to be deployed alongside other behavior change techniques, and, (c) when and for whom self-incentives and self-rewards could support effective behavior change. Copyright © 2017. Published by Elsevier Ltd.

An Examination of the Multi-Faceted Motivation System in Healthy Young Adults

PubMed Central

Da Silva, Susana; Apatsidou, Areti; Saperia, Sarah; Siddiqui, Ishraq; Jeffay, Eliyas; Voineskos, Aristotle N.; Daskalakis, Zafiris J.; Remington, Gary; Zakzanis, Konstantine K.; Foussias, George

2018-01-01

Background: Amotivation is a prevalent symptom in schizophrenia (SZ) and depression (MDD), and is linked to poor functional outcomes in affected individuals. Conceptualizations of motivation have outlined a multi-faceted construct comprised of reward responsiveness, reward expectancy, reward valuation, effort valuation, and action selection/preference-based decision making. To date, findings from studies utilizing variable-centered approaches to examining isolated facets of motivation in SZ and MDD have been inconsistent. Thus, the present study adopted a person-centered approach, and comprehensively examined the reward system in a non-clinical sample in an attempt to explore potential subtypes of motivation impairments, while minimizing the effects of illness-related confounds. Methods: Ninety-six healthy undergraduate students were evaluated for amotivation, schizotypal traits, depressive symptoms, and cognition, and administered objective computerized tasks to measure the different facets of motivation. Cluster analysis was performed to explore subgroups of individuals based on similar motivation task performance. Additionally, correlational analyses were conducted in order to examine inter-relationships between motivation facets, and relations between clinical measures and facets of motivation. Results: Cluster analysis identified two subgroups of individuals with differential motivation performance profiles. Correlational analyses revealed that reward responsiveness was associated with amotivation, depressive symptoms, and negative schizotypy. Further, significant inter-correlations were found between reward responsiveness and reward expectancy, as well as between reward valuation and effort valuation. Conclusions: Our results mark important steps forward in understanding motivation in a non-clinical sample, and guide future dimensional and comprehensive analyses of the multi-faceted reward system. It remains to be seen whether these patterns of results will be similar in clinical populations such as SZ and MDD.

Tonic or Phasic Stimulation of Dopaminergic Projections to Prefrontal Cortex Causes Mice to Maintain or Deviate from Previously Learned Behavioral Strategies

PubMed Central

Ellwood, Ian T.; Patel, Tosha; Wadia, Varun; Lee, Anthony T.; Liptak, Alayna T.

2017-01-01

Dopamine neurons in the ventral tegmental area (VTA) encode reward prediction errors and can drive reinforcement learning through their projections to striatum, but much less is known about their projections to prefrontal cortex (PFC). Here, we studied these projections and observed phasic VTA–PFC fiber photometry signals after the delivery of rewards. Next, we studied how optogenetic stimulation of these projections affects behavior using conditioned place preference and a task in which mice learn associations between cues and food rewards and then use those associations to make choices. Neither phasic nor tonic stimulation of dopaminergic VTA–PFC projections elicited place preference. Furthermore, substituting phasic VTA–PFC stimulation for food rewards was not sufficient to reinforce new cue–reward associations nor maintain previously learned ones. However, the same patterns of stimulation that failed to reinforce place preference or cue–reward associations were able to modify behavior in other ways. First, continuous tonic stimulation maintained previously learned cue–reward associations even after they ceased being valid. Second, delivering phasic stimulation either continuously or after choices not previously associated with reward induced mice to make choices that deviated from previously learned associations. In summary, despite the fact that dopaminergic VTA–PFC projections exhibit phasic increases in activity that are time locked to the delivery of rewards, phasic activation of these projections does not necessarily reinforce specific actions. Rather, dopaminergic VTA–PFC activity can control whether mice maintain or deviate from previously learned cue–reward associations. SIGNIFICANCE STATEMENT Dopaminergic inputs from ventral tegmental area (VTA) to striatum encode reward prediction errors and reinforce specific actions; however, it is currently unknown whether dopaminergic inputs to prefrontal cortex (PFC) play similar or distinct roles. Here, we used bulk Ca2+ imaging to show that unexpected rewards or reward-predicting cues elicit phasic increases in the activity of dopaminergic VTA–PFC fibers. However, in multiple behavioral paradigms, we failed to observe reinforcing effects after stimulation of these fibers. In these same experiments, we did find that tonic or phasic patterns of stimulation caused mice to maintain or deviate from previously learned cue–reward associations, respectively. Therefore, although they may exhibit similar patterns of activity, dopaminergic inputs to striatum and PFC can elicit divergent behavioral effects. PMID:28739583

Trading Up: Chimpanzees (Pan troglodytes) Show Self-Control Through Their Exchange Behavior

PubMed Central

Beran, Michael J.; Rossettie, Mattea S.; Parrish, Audrey E.

2015-01-01

Self-control is defined as the ability or capacity to obtain an objectively more valuable outcome rather than an objectively less valuable outcome though tolerating a longer delay or a greater effort requirement (or both) in obtaining that more valuable outcome. A number of tests have been devised to assess self-control in nonhuman animals, including exchange tasks. In this study, three chimpanzees (Pan troglodytes) participated in a delay of gratification task that required food exchange as the behavioral response that reflected self-control. The chimpanzees were offered opportunities to inhibit eating and instead exchange a currently possessed food item for a different (and sometimes better) item, often needing to exchange several food items before obtaining the highest-valued reward. We manipulated reward type, reward size, reward visibility, delay to exchange, and location of the highest-valued reward in the sequence of exchange events to compare performance within the same individuals. The chimpanzees successfully traded until obtaining the best item in most cases, although there were individual differences among participants in some variations of the test. These results support the idea that self-control is robust in chimpanzees even in contexts in which they perhaps anticipate future rewards and sustain delay of gratification until they can obtain the ultimately most-valuable item. PMID:26325355

Trading up: chimpanzees (Pan troglodytes) show self-control through their exchange behavior.

PubMed

Beran, Michael J; Rossettie, Mattea S; Parrish, Audrey E

2016-01-01

Self-control is defined as the ability or capacity to obtain an objectively more valuable outcome rather than an objectively less valuable outcome though tolerating a longer delay or a greater effort requirement (or both) in obtaining that more valuable outcome. A number of tests have been devised to assess self-control in non-human animals, including exchange tasks. In this study, three chimpanzees (Pan troglodytes) participated in a delay of gratification task that required food exchange as the behavioral response that reflected self-control. The chimpanzees were offered opportunities to inhibit eating and instead exchange a currently possessed food item for a different (and sometimes better) item, often needing to exchange several food items before obtaining the highest valued reward. We manipulated reward type, reward size, reward visibility, delay to exchange, and location of the highest valued reward in the sequence of exchange events to compare performance within the same individuals. The chimpanzees successfully traded until obtaining the best item in most cases, although there were individual differences among participants in some variations of the test. These results support the idea that self-control is robust in chimpanzees even in contexts in which they perhaps anticipate future rewards and sustain delay of gratification until they can obtain the ultimately most valuable item.

Social identity shapes social valuation: evidence from prosocial behavior and vicarious reward

PubMed Central

Hackel, Leor M.; Zaki, Jamil

2017-01-01

Abstract People frequently engage in more prosocial behavior toward members of their own groups, as compared to other groups. Such group-based prosociality may reflect either strategic considerations concerning one's own future outcomes or intrinsic value placed on the outcomes of in-group members. In a functional magnetic resonance imaging experiment, we examined vicarious reward responses to witnessing the monetary gains of in-group and out-group members, as well as prosocial behavior towards both types of individuals. We found that individuals’ investment in their group—a motivational component of social identification—tracked the intensity of their responses in ventral striatum to in-group (vs out-group) members’ rewards, as well as their tendency towards group-based prosociality. Individuals with strong motivational investment in their group preferred rewards for an in-group member, whereas individuals with low investment preferred rewards for an out-group member. These findings suggest that the motivational importance of social identity—beyond mere similarity to group members—influences vicarious reward and prosocial behavior. More broadly, these findings support a theoretical framework in which salient social identities can influence neural representations of subjective value, and suggest that social preferences can best be understood by examining the identity contexts in which they unfold. PMID:28402506

Third-party punishers are rewarded, but third-party helpers even more so.

PubMed

Raihani, Nichola J; Bshary, Redouan

2015-04-01

Punishers can benefit from a tough reputation, where future partners cooperate because they fear repercussions. Alternatively, punishers might receive help from bystanders if their act is perceived as just and other-regarding. Third-party punishment of selfish individuals arguably fits these conditions, but it is not known whether third-party punishers are rewarded for their investments. Here, we show that third-party punishers are indeed rewarded by uninvolved bystanders. Third parties were presented with the outcome of a dictator game in which the dictator was either selfish or fair and were allocated to one of three treatments in which they could choose to do nothing or (1) punish the dictator, (2) help the receiver, or (3) choose between punishment and helping, respectively. A fourth player (bystander) then sees the third-party's decision and could choose to reward the third party or not. Third parties that punished selfish dictators were more likely to be rewarded by bystanders than third parties that took no action in response to a selfish dictator. However, helpful third parties were rewarded even more than third-party punishers. These results suggest that punishment could in principle evolve via indirect reciprocity, but also provide insights into why individuals typically prefer to invest in positive actions. © 2015 The Author(s).

Heroin and cocaine abusers have higher discount rates for delayed rewards than alcoholics or non-drug-using controls.

PubMed

Kirby, Kris N; Petry, Nancy M

2004-04-01

To test a prediction of the discounting model of impulsiveness that discount rates would be positively associated with addiction. The delay-discount rate refers to the rate of reduction in the present value of a future reward as the delay to that reward increases. We estimated participants' discount rates on the basis of their pattern of choices between smaller immediate rewards ($11-80) and larger, delayed rewards ($25-85; at delays from 1 week to 6 months) in a questionnaire format. Participants had a one-in-six chance of winning a reward that they chose on one randomly selected trial. Heroin (n = 27), cocaine (n = 41) and alcohol (n = 33) abusers and non-drug-using controls (n = 44) were recruited from advertisements. They were tested in a drug abuse research clinic at a medical school. On average, the cocaine and heroin groups had higher rates than controls (both P < 0.001), but alcoholics did not (P = 0.44). Abstinence was associated with lower rates for heroin abusers (P = 0.03), but not for cocaine or alcohol abusers (both P > 0.50). These data suggest that discount rates vary with the preferred drug of abuse, and that high discount rates should be considered in the development of substance abuse prevention and treatment efforts.

Glutamatergic transmission in drug reward: implications for drug addiction.

PubMed

D'Souza, Manoranjan S

2015-01-01

Individuals addicted to drugs of abuse such as alcohol, nicotine, cocaine, and heroin are a significant burden on healthcare systems all over the world. The positive reinforcing (rewarding) effects of the above mentioned drugs play a major role in the initiation and maintenance of the drug-taking habit. Thus, understanding the neurochemical mechanisms underlying the reinforcing effects of drugs of abuse is critical to reducing the burden of drug addiction in society. Over the last two decades, there has been an increasing focus on the role of the excitatory neurotransmitter glutamate in drug addiction. In this review, pharmacological and genetic evidence supporting the role of glutamate in mediating the rewarding effects of the above described drugs of abuse will be discussed. Further, the review will discuss the role of glutamate transmission in two complex heterogeneous brain regions, namely the nucleus accumbens (NAcc) and the ventral tegmental area (VTA), which mediate the rewarding effects of drugs of abuse. In addition, several medications approved by the Food and Drug Administration that act by blocking glutamate transmission will be discussed in the context of drug reward. Finally, this review will discuss future studies needed to address currently unanswered gaps in knowledge, which will further elucidate the role of glutamate in the rewarding effects of drugs of abuse.

Social identity shapes social valuation: evidence from prosocial behavior and vicarious reward.

PubMed

Hackel, Leor M; Zaki, Jamil; Van Bavel, Jay J

2017-08-01

People frequently engage in more prosocial behavior toward members of their own groups, as compared to other groups. Such group-based prosociality may reflect either strategic considerations concerning one's own future outcomes or intrinsic value placed on the outcomes of in-group members. In a functional magnetic resonance imaging experiment, we examined vicarious reward responses to witnessing the monetary gains of in-group and out-group members, as well as prosocial behavior towards both types of individuals. We found that individuals' investment in their group-a motivational component of social identification-tracked the intensity of their responses in ventral striatum to in-group (vs out-group) members' rewards, as well as their tendency towards group-based prosociality. Individuals with strong motivational investment in their group preferred rewards for an in-group member, whereas individuals with low investment preferred rewards for an out-group member. These findings suggest that the motivational importance of social identity-beyond mere similarity to group members-influences vicarious reward and prosocial behavior. More broadly, these findings support a theoretical framework in which salient social identities can influence neural representations of subjective value, and suggest that social preferences can best be understood by examining the identity contexts in which they unfold. © The Author (2017). Published by Oxford University Press.

Students with Multiple Sclerosis Participating in Recess

ERIC Educational Resources Information Center

Lucas, Matthew D.; Brentlinger, Jamie

2012-01-01

The participation of a student with Multiple Sclerosis (MS) in recess can often be both challenging and rewarding for the student and teacher. This paper will address common characteristics of students with MS and present basic solutions to improve the experience of these students in the recess setting. Initially, the definition and prevalence of…

Using Multiple-Stimulus without Replacement Preference Assessments to Increase Student Engagement and Performance

ERIC Educational Resources Information Center

Weaver, Adam D.; McKevitt, Brian C.; Farris, Allie M.

2017-01-01

Multiple-stimulus without replacement preference assessment is a research-based method for identifying appropriate rewards for students with emotional and behavioral disorders. This article presents a brief history of how this technology evolved and describes a step-by-step approach for conducting the procedure. A discussion of necessary materials…

Prefrontal cortex as a meta-reinforcement learning system.

PubMed

Wang, Jane X; Kurth-Nelson, Zeb; Kumaran, Dharshan; Tirumala, Dhruva; Soyer, Hubert; Leibo, Joel Z; Hassabis, Demis; Botvinick, Matthew

2018-06-01

Over the past 20 years, neuroscience research on reward-based learning has converged on a canonical model, under which the neurotransmitter dopamine 'stamps in' associations between situations, actions and rewards by modulating the strength of synaptic connections between neurons. However, a growing number of recent findings have placed this standard model under strain. We now draw on recent advances in artificial intelligence to introduce a new theory of reward-based learning. Here, the dopamine system trains another part of the brain, the prefrontal cortex, to operate as its own free-standing learning system. This new perspective accommodates the findings that motivated the standard model, but also deals gracefully with a wider range of observations, providing a fresh foundation for future research.

Concave utility, transaction costs, and risk in measuring discounting of delayed rewards.

PubMed

Kirby, Kris N; Santiesteban, Mariana

2003-01-01

Research has consistently found that the decline in the present values of delayed rewards as delay increases is better fit by hyperbolic than by exponential delay-discounting functions. However, concave utility, transaction costs, and risk each could produce hyperbolic-looking data, even when the underlying discounting function is exponential. In Experiments 1 (N = 45) and 2 (N = 103), participants placed bids indicating their present values of real future monetary rewards in computer-based 2nd-price auctions. Both experiments suggest that utility is not sufficiently concave to account for the superior fit of hyperbolic functions. Experiment 2 provided no evidence that the effects of transaction costs and risk are large enough to account for the superior fit of hyperbolic functions.

A big data analysis of the relationship between future thinking and decision-making.

PubMed

Thorstad, Robert; Wolff, Phillip

2018-02-20

We use big data methods to investigate how decision-making might depend on future sightedness (that is, on how far into the future people's thoughts about the future extend). In study 1, we establish a link between future thinking and decision-making at the population level in showing that US states with citizens having relatively far future sightedness, as reflected in their tweets, take fewer risks than citizens in states having relatively near future sightedness. In study 2, we analyze people's tweets to confirm a connection between future sightedness and decision-making at the individual level in showing that people with long future sightedness are more likely to choose larger future rewards over smaller immediate rewards. In study 3, we show that risk taking decreases with increases in future sightedness as reflected in people's tweets. The ability of future sightedness to predict decisions suggests that future sightedness is a relatively stable cognitive characteristic. This implication was supported in an analysis of tweets by over 38,000 people that showed that future sightedness has both state and trait characteristics (study 4). In study 5, we provide evidence for a potential mechanism by which future sightedness can affect decisions in showing that far future sightedness can make the future seem more connected to the present, as reflected in how people refer to the present, past, and future in their tweets over the course of several minutes. Our studies show how big data methods can be applied to naturalistic data to reveal underlying psychological properties and processes.

FMRQ-A Multiagent Reinforcement Learning Algorithm for Fully Cooperative Tasks.

PubMed

Zhang, Zhen; Zhao, Dongbin; Gao, Junwei; Wang, Dongqing; Dai, Yujie

2017-06-01

In this paper, we propose a multiagent reinforcement learning algorithm dealing with fully cooperative tasks. The algorithm is called frequency of the maximum reward Q-learning (FMRQ). FMRQ aims to achieve one of the optimal Nash equilibria so as to optimize the performance index in multiagent systems. The frequency of obtaining the highest global immediate reward instead of immediate reward is used as the reinforcement signal. With FMRQ each agent does not need the observation of the other agents' actions and only shares its state and reward at each step. We validate FMRQ through case studies of repeated games: four cases of two-player two-action and one case of three-player two-action. It is demonstrated that FMRQ can converge to one of the optimal Nash equilibria in these cases. Moreover, comparison experiments on tasks with multiple states and finite steps are conducted. One is box-pushing and the other one is distributed sensor network problem. Experimental results show that the proposed algorithm outperforms others with higher performance.

Parietal neurons encode expected gains in instrumental information

PubMed Central

Foley, Nicholas C.; Kelly, Simon P.; Mhatre, Himanshu; Gottlieb, Jacqueline

2017-01-01

In natural behavior, animals have access to multiple sources of information, but only a few of these sources are relevant for learning and actions. Beyond choosing an appropriate action, making good decisions entails the ability to choose the relevant information, but fundamental questions remain about the brain’s information sampling policies. Recent studies described the neural correlates of seeking information about a reward, but it remains unknown whether, and how, neurons encode choices of instrumental information, in contexts in which the information guides subsequent actions. Here we show that parietal cortical neurons involved in oculomotor decisions encode, before an information sampling saccade, the reduction in uncertainty that the saccade is expected to bring for a subsequent action. These responses were distinct from the neurons’ visual and saccadic modulations and from signals of expected reward or reward prediction errors. Therefore, even in an instrumental context when information and reward gains are closely correlated, individual cells encode decision variables that are based on informational factors and can guide the active sampling of action-relevant cues. PMID:28373569

Coordinated Acetylcholine Release in Prefrontal Cortex and Hippocampus Is Associated with Arousal and Reward on Distinct Timescales.

PubMed

Teles-Grilo Ruivo, Leonor M; Baker, Keeley L; Conway, Michael W; Kinsley, Peter J; Gilmour, Gary; Phillips, Keith G; Isaac, John T R; Lowry, John P; Mellor, Jack R

2017-01-24

Cholinergic neurotransmission throughout the neocortex and hippocampus regulates arousal, learning, and attention. However, owing to the poorly characterized timing and location of acetylcholine release, its detailed behavioral functions remain unclear. Using electrochemical biosensors chronically implanted in mice, we made continuous measurements of the spatiotemporal dynamics of acetylcholine release across multiple behavioral states. We found that tonic levels of acetylcholine release were coordinated between the prefrontal cortex and hippocampus and maximal during training on a rewarded working memory task. Tonic release also increased during REM sleep but was contingent on subsequent wakefulness. In contrast, coordinated phasic acetylcholine release occurred only during the memory task and was strongly localized to reward delivery areas without being contingent on trial outcome. These results show that coordinated acetylcholine release between the prefrontal cortex and hippocampus is associated with reward and arousal on distinct timescales, providing dual mechanisms to support learned behavior acquisition during cognitive task performance. Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.

White Matter Correlates of Musical Anhedonia: Implications for Evolution of Music.

PubMed

Loui, Psyche; Patterson, Sean; Sachs, Matthew E; Leung, Yvonne; Zeng, Tima; Przysinda, Emily

2017-01-01

Recent theoretical advances in the evolution of music posit that affective communication is an evolutionary function of music through which the mind and brain are transformed. A rigorous test of this view should entail examining the neuroanatomical mechanisms for affective communication of music, specifically by comparing individual differences in the general population with a special population who lacks specific affective responses to music. Here we compare white matter connectivity in BW, a case with severe musical anhedonia, with a large sample of control subjects who exhibit normal variability in reward sensitivity to music. We show for the first time that structural connectivity within the reward system can predict individual differences in musical reward in a large population, but specific patterns in connectivity between auditory and reward systems are special in an extreme case of specific musical anhedonia. Results support and extend the Mixed Origins of Music theory by identifying multiple neural pathways through which music might operate as an affective signaling system.

White Matter Correlates of Musical Anhedonia: Implications for Evolution of Music

PubMed Central

Loui, Psyche; Patterson, Sean; Sachs, Matthew E.; Leung, Yvonne; Zeng, Tima; Przysinda, Emily

2017-01-01

Recent theoretical advances in the evolution of music posit that affective communication is an evolutionary function of music through which the mind and brain are transformed. A rigorous test of this view should entail examining the neuroanatomical mechanisms for affective communication of music, specifically by comparing individual differences in the general population with a special population who lacks specific affective responses to music. Here we compare white matter connectivity in BW, a case with severe musical anhedonia, with a large sample of control subjects who exhibit normal variability in reward sensitivity to music. We show for the first time that structural connectivity within the reward system can predict individual differences in musical reward in a large population, but specific patterns in connectivity between auditory and reward systems are special in an extreme case of specific musical anhedonia. Results support and extend the Mixed Origins of Music theory by identifying multiple neural pathways through which music might operate as an affective signaling system. PMID:28993748

The role of motivation and reward neural systems in vocal communication in songbirds

PubMed Central

Riters, Lauren V.

2012-01-01

Many vertebrates are highly motivated to communicate, suggesting that the consequences of communication may be rewarding. Past studies show that dopamine and opioids in the medial preoptic nucleus (mPOA) and ventral tegmental area (VTA) play distinct roles in motivation and reward. In songbirds, multiple lines of recent evidence indicate that the roles of dopamine and opioid activity in mPOA and VTA in male birdsong differ depending upon whether song is used to attract females (sexually-motivated) or is produced spontaneously (undirected). Evidence is reviewed supporting the hypotheses that 1) mPOA and VTA interact to influence the context in which a male sings, 2) distinct patterns of dopamine activity underlie the motivation to produce sexually-motivated and undirected song, 3) sexually-motivated communication is externally reinforced by opioids released as part of social interactions, and 4) undirected communication is facilitated and rewarded by immediate opioid release linked to the act of singing. PMID:22569510

The role of motivation and reward neural systems in vocal communication in songbirds.

PubMed

Riters, Lauren V

2012-04-01

Many vertebrates are highly motivated to communicate, suggesting that the consequences of communication may be rewarding. Past studies show that dopamine and opioids in the medial preoptic nucleus (mPOA) and ventral tegmental area (VTA) play distinct roles in motivation and reward. In songbirds, multiple lines of recent evidence indicate that the roles of dopamine and opioid activity in mPOA and VTA in male birdsong differ depending upon whether song is used to attract females (sexually-motivated) or is produced spontaneously (undirected). Evidence is reviewed supporting the hypotheses that (1) mPOA and VTA interact to influence the context in which a male sings, (2) distinct patterns of dopamine activity underlie the motivation to produce sexually-motivated and undirected song, (3) sexually-motivated communication is externally reinforced by opioids released as part of social interactions, and (4) undirected communication is facilitated and rewarded by immediate opioid release linked to the act of singing. Copyright © 2012 Elsevier Inc. All rights reserved.

Job demands, job resources, and job performance in japanese workers: a cross-sectional study.

PubMed

Nakagawa, Yuko; Inoue, Akiomi; Kawakami, Norito; Tsuno, Kanami; Tomioka, Kimiko; Nakanishi, Mayuko; Mafune, Kosuke; Hiro, Hisanori

2014-01-01

This study investigated the cross-sectional association of job demands (i.e., psychological demands) and job resources (i.e., decision latitude, supervisor support, co-worker support, and extrinsic reward) with job performance. A total of 1,198 workers (458 males and 740 females) from a manufacturing company in Japan completed a self-administered questionnaire that included the Job Content Questionnaire, Effort-Reward Imbalance Questionnaire, World Health Organization Health and Work Performance Questionnaire, and demographic survey. Hierarchical multiple regression analyses were conducted. After adjusting for demographic characteristics, decision latitude (β=0.107, p=0.001) and extrinsic reward (β=0.158, p<0.001) were positively and significantly associated with job performance while supervisor support (β=-0.102, p=0.002) was negatively and significantly associated with job performance. On the other hand, psychological demands or co-worker support was not significantly associated with job performance. These findings suggest that higher decision latitude and extrinsic reward enhance job performance among Japanese employees.

Job Demands, Job Resources, and Job Performance in Japanese Workers: A Cross-sectional Study

PubMed Central

NAKAGAWA, Yuko; INOUE, Akiomi; KAWAKAMI, Norito; TSUNO, Kanami; TOMIOKA, Kimiko; NAKANISHI, Mayuko; MAFUNE, Kosuke; HIRO, Hisanori

2014-01-01

This study investigated the cross-sectional association of job demands (i.e., psychological demands) and job resources (i.e., decision latitude, supervisor support, co-worker support, and extrinsic reward) with job performance. A total of 1,198 workers (458 males and 740 females) from a manufacturing company in Japan completed a self-administered questionnaire that included the Job Content Questionnaire, Effort-Reward Imbalance Questionnaire, World Health Organization Health and Work Performance Questionnaire, and demographic survey. Hierarchical multiple regression analyses were conducted. After adjusting for demographic characteristics, decision latitude (β=0.107, p=0.001) and extrinsic reward (β=0.158, p<0.001) were positively and significantly associated with job performance while supervisor support (β=−0.102, p=0.002) was negatively and significantly associated with job performance. On the other hand, psychological demands or co-worker support was not significantly associated with job performance. These findings suggest that higher decision latitude and extrinsic reward enhance job performance among Japanese employees. PMID:25016948

Evolution of cooperation in a heterogeneous population with influential individuals

NASA Astrophysics Data System (ADS)

Zhuang, Qian; Wang, Dong; Fan, Ying; Di, Zengru

2012-02-01

Influential individuals are introduced and integrated with the public goods game (PGG) to investigate their influence on the emergence and evolution of cooperation. In the model, some influential individuals whose behaviors can be controlled by us are introduced into a homogeneous population on a square lattice. The influential individuals can play three kinds of roles: I. exemplar, II. supervisor with the power to punish defectors, and III. supervisor with the power to reward cooperative co-players. It is found that the existence of influential individuals who play Role I turns out to be detrimental to cooperation and that the larger the number of influential individuals is, the more difficult it is for cooperation to be maintained. For those playing supervisory roles, both punishment and reward are found to be effective ways for the influential individuals to promote and stabilize cooperative behavior. By comparing the critical costs and the mean payoffs for a low multiplication factor under the role of punishment and the role of reward, it is found that reward is a more effective intervention measure than punishment for influential individuals seeking to improve cooperation and that reward leads to a higher mean payoff.

Heterogeneity in the Effects of Reward- and Deposit-based Financial Incentives on Smoking Cessation

PubMed Central

French, Benjamin; Small, Dylan S.; Saulsgiver, Kathryn; Harhay, Michael O.; Audrain-McGovern, Janet; Loewenstein, George; Asch, David A.; Volpp, Kevin G.

2016-01-01

Rationale: Targeting different smoking cessation programs to smokers most likely to quit when using them could reduce the burden of lung disease. Objectives: To identify smokers most likely to quit using pure reward-based financial incentives or incentive programs requiring refundable deposits to become eligible for rewards. Methods: We conducted prespecified secondary analyses of a randomized trial in which 2,538 smokers were assigned to an $800 reward contingent on sustained abstinence from smoking, a refundable $150 deposit plus a $650 reward, or usual care. Measurements and Main Results: Using logistic regression, we identified characteristics of smokers that were most strongly associated with accepting their assigned intervention and ceasing smoking for 6 months. We assessed modification of the acceptance, efficacy, and effectiveness of reward and deposit programs by 11 prospectively selected demographic, smoking-related, and psychological factors. Predictors of sustained smoking abstinence differed among participants assigned to reward- versus deposit-based incentives. However, greater readiness to quit and less steep discounting of future rewards were consistently among the most important predictors. Deposit-based programs were uniquely effective relative to usual care among men, higher-income participants, and participants who more commonly failed to pay their bills (all interaction P values < 0.10). Relative to rewards, deposits were more effective among black persons (P = 0.022) and those who more commonly failed to pay their bills (P = 0.082). Relative to rewards, deposits were more commonly accepted by higher-income participants, men, white persons, and those who less commonly failed to pay their bills (all P < 0.05). Conclusions: Heterogeneity among smokers in their acceptance and response to different forms of incentives suggests potential benefits of targeting behavior-change interventions based on patient characteristics. Clinical trial registered with www.clinicaltrials.gov (NCT 01526265). PMID:27064456

Perceived Challenges and Rewards of Forming a Sexual Agreement Among HIV-Negative Male Couples.

PubMed

Mitchell, Jason W; Lee, Ji-Young; Woodyatt, Cory; Bauermeister, José; Sullivan, Patrick; Stephenson, Rob

2016-08-01

Sexual agreements, explicit mutual understandings made between two partners about which sexual and related behaviors they agree to engage in within and/or outside of their relationship, are common among male couples. However, little is known about the perceived rewards and challenges partnered men face in the process of forming a sexual agreement. Such knowledge may be useful for the development of future HIV preventive and sexual health programs that encourage male couples to establish a sexual agreement in their relationship. By using qualitative dyadic data from a sample of 29 self-reported concordant HIV-negative male couples who had a sexual agreement, the present qualitative study sought to assess partnered men's perceived rewards and challenges of forming a sexual agreement in their relationship and examine whether both men in the couple concurred about their perceived rewards and challenges of forming a sexual agreement. Themes for perceived rewards were (1) being honest, (2) improving communication, (3) increasing understanding about expectations and permitted behaviors, (4) enhancing intimacy and relational bond, and (5) building trust. Themes for perceived challenges were: (1) stigma about having an open agreement; (2) awkwardness about the topic and talking about it; (3) jealousy; and (4) no perceived challenges. Few couples had both partners concur about their perceived rewards or challenges toward establishing a sexual agreement. The variety of perceived rewards and challenges highlight the need for tailoring given that a variety of factors may influence partnered men's establishment of a sexual agreement in their relationship.

Coexistence of Reward and Unsupervised Learning During the Operant Conditioning of Neural Firing Rates

PubMed Central

Kerr, Robert R.; Grayden, David B.; Thomas, Doreen A.; Gilson, Matthieu; Burkitt, Anthony N.

2014-01-01

A fundamental goal of neuroscience is to understand how cognitive processes, such as operant conditioning, are performed by the brain. Typical and well studied examples of operant conditioning, in which the firing rates of individual cortical neurons in monkeys are increased using rewards, provide an opportunity for insight into this. Studies of reward-modulated spike-timing-dependent plasticity (RSTDP), and of other models such as R-max, have reproduced this learning behavior, but they have assumed that no unsupervised learning is present (i.e., no learning occurs without, or independent of, rewards). We show that these models cannot elicit firing rate reinforcement while exhibiting both reward learning and ongoing, stable unsupervised learning. To fix this issue, we propose a new RSTDP model of synaptic plasticity based upon the observed effects that dopamine has on long-term potentiation and depression (LTP and LTD). We show, both analytically and through simulations, that our new model can exhibit unsupervised learning and lead to firing rate reinforcement. This requires that the strengthening of LTP by the reward signal is greater than the strengthening of LTD and that the reinforced neuron exhibits irregular firing. We show the robustness of our findings to spike-timing correlations, to the synaptic weight dependence that is assumed, and to changes in the mean reward. We also consider our model in the differential reinforcement of two nearby neurons. Our model aligns more strongly with experimental studies than previous models and makes testable predictions for future experiments. PMID:24475240

Incentive motivation deficits in schizophrenia reflect effort computation impairments during cost-benefit decision-making.

PubMed

Fervaha, Gagan; Graff-Guerrero, Ariel; Zakzanis, Konstantine K; Foussias, George; Agid, Ofer; Remington, Gary

2013-11-01

Motivational impairments are a core feature of schizophrenia and although there are numerous reports studying this feature using clinical rating scales, objective behavioural assessments are lacking. Here, we use a translational paradigm to measure incentive motivation in individuals with schizophrenia. Sixteen stable outpatients with schizophrenia and sixteen matched healthy controls completed a modified version of the Effort Expenditure for Rewards Task that accounts for differences in motoric ability. Briefly, subjects were presented with a series of trials where they may choose to expend a greater amount of effort for a larger monetary reward versus less effort for a smaller reward. Additionally, the probability of receiving money for a given trial was varied at 12%, 50% and 88%. Clinical and other reward-related variables were also evaluated. Patients opted to expend greater effort significantly less than controls for trials of high, but uncertain (i.e. 50% and 88% probability) incentive value, which was related to amotivation and neurocognitive deficits. Other abnormalities were also noted but were related to different clinical variables such as impulsivity (low reward and 12% probability). These motivational deficits were not due to group differences in reward learning, reward valuation or hedonic capacity. Our findings offer novel support for incentive motivation deficits in schizophrenia. Clinical amotivation is associated with impairments in the computation of effort during cost-benefit decision-making. This objective translational paradigm may guide future investigations of the neural circuitry underlying these motivational impairments. Copyright © 2013 Elsevier Ltd. All rights reserved.

Cocaine dependent individuals discount future rewards more than future losses for both cocaine and monetary outcomes.

PubMed

Johnson, Matthew W; Bruner, Natalie R; Johnson, Patrick S

2015-01-01

Cocaine dependence and other forms of drug dependence are associated with steeper devaluation of future outcomes (delay discounting). Although studies in this domain have typically assessed choices between monetary gains (e.g., receive less money now versus receive more money after a delay), delay discounting is also applicable to decisions involving losses (e.g., small loss now versus larger delayed loss), with gains typically discounted more than losses (the "sign effect"). It is also known that drugs are discounted more than equivalently valued money. In the context of drug dependence, however, relatively little is known about the discounting of delayed monetary and drug losses and the presence of the sign effect. In this within-subject, laboratory study, delay discounting for gains and losses was assessed for cocaine and money outcomes in cocaine-dependent individuals (n=89). Both cocaine and monetary gains were discounted at significantly greater rates than cocaine and monetary losses, respectively (i.e., the sign effect). Cocaine gains were discounted significantly more than monetary gains, but cocaine and monetary losses were discounted similarly. Results suggest that cocaine is discounted by cocaine-dependent individuals in a systematic manner similar to other rewards. Because the sign effect was shown for both cocaine and money, delayed aversive outcomes may generally have greater impact than delayed rewards in shaping present behavior in this population. Copyright © 2014. Published by Elsevier Ltd.

Maximizing Total QoS-Provisioning of Image Streams with Limited Energy Budget

NASA Astrophysics Data System (ADS)

Lee, Wan Yeon; Kim, Kyong Hoon; Ko, Young Woong

To fully utilize the limited battery energy of mobile electronic devices, we propose an adaptive adjustment method of processing quality for multiple image stream tasks running with widely varying execution times. This adjustment method completes the worst-case executions of the tasks with a given budget of energy, and maximizes the total reward value of processing quality obtained during their executions by exploiting the probability distribution of task execution times. The proposed method derives the maximum reward value for the tasks being executable with arbitrary processing quality, and near maximum value for the tasks being executable with a finite number of processing qualities. Our evaluation on a prototype system shows that the proposed method achieves larger reward values, by up to 57%, than the previous method.

Greater Food Reward Sensitivity Is Associated with More Frequent Intake of Discretionary Foods in a Nationally Representative Sample of Young Adults.

PubMed

Nansel, Tonja R; Lipsky, Leah M; Eisenberg, Miriam H; Haynie, Denise L; Liu, Danping; Simons-Morton, Bruce

2016-01-01

Food reward sensitivity may influence individual susceptibility to an environment replete with highly palatable foods of minimal nutritional value. These foods contain combinations of added sugar, fat, and/or salt that may enhance their motivational salience. This study examined associations of food reward sensitivity with eating behaviors in the NEXT Generation Health Study, a nationally representative sample of U.S. young adults. Participants (n = 2202) completed self-report measures including the Power of Food Scale, assessing food reward sensitivity, and intake frequency of 14 food groups. Multiple linear regressions estimated associations of food reward sensitivity with each of the eating behaviors adjusting for covariates. Higher food reward sensitivity was associated with more frequent intake of fast food (b ± linearized SE = 0.24 ± 0.05, p < 0.001), sweet and salty snacks (0.21 ± 0.05, p < 0.001), foods made with cheese (0.14 ± 0.06, p = 0.03), soda (0.12 ± 0.04, p = 0.009), processed meats (0.12 ± 0.05, p = 0.045), and fish (0.08 ± 0.03, p = 0.03) but was not associated with intake frequency of fruit or juice, green or orange vegetables, beans, whole grains, nuts/seeds, or dairy products. Food reward sensitivity was associated with greater intake of discretionary foods but was not associated with intake of most health-promoting foods, suggesting food reward sensitivity may lead to preferential intake of unhealthful foods.

Greater Food Reward Sensitivity Is Associated with More Frequent Intake of Discretionary Foods in a Nationally Representative Sample of Young Adults

PubMed Central

Nansel, Tonja R.; Lipsky, Leah M.; Eisenberg, Miriam H.; Haynie, Denise L.; Liu, Danping; Simons-Morton, Bruce

2016-01-01

Food reward sensitivity may influence individual susceptibility to an environment replete with highly palatable foods of minimal nutritional value. These foods contain combinations of added sugar, fat, and/or salt that may enhance their motivational salience. This study examined associations of food reward sensitivity with eating behaviors in the NEXT Generation Health Study, a nationally representative sample of U.S. young adults. Participants (n = 2202) completed self-report measures including the Power of Food Scale, assessing food reward sensitivity, and intake frequency of 14 food groups. Multiple linear regressions estimated associations of food reward sensitivity with each of the eating behaviors adjusting for covariates. Higher food reward sensitivity was associated with more frequent intake of fast food (b ± linearized SE = 0.24 ± 0.05, p < 0.001), sweet and salty snacks (0.21 ± 0.05, p < 0.001), foods made with cheese (0.14 ± 0.06, p = 0.03), soda (0.12 ± 0.04, p = 0.009), processed meats (0.12 ± 0.05, p = 0.045), and fish (0.08 ± 0.03, p = 0.03) but was not associated with intake frequency of fruit or juice, green or orange vegetables, beans, whole grains, nuts/seeds, or dairy products. Food reward sensitivity was associated with greater intake of discretionary foods but was not associated with intake of most health-promoting foods, suggesting food reward sensitivity may lead to preferential intake of unhealthful foods. PMID:27588287

Specificity of Reward Sensitivity and Parasympathetic-Based Regulation among Children with Attention-Deficit/Hyperactivity and Disruptive Behavior Disorders.

PubMed

Tenenbaum, Rachel B; Musser, Erica D; Raiker, Joseph S; Coles, Erika K; Gnagy, Elizabeth M; Pelham, William E

2018-07-01

Attention-deficit/hyperactivity disorder (ADHD) is associated with disruptionsin reward sensitivity and regulatory processes. However, it is unclear whether thesedisruptions are better explained by comorbid disruptive behavior disorder (DBD)symptomology. This study sought to examine this question using multiple levels ofanalysis (i.e., behavior, autonomic reactivity). One hundred seventeen children (aged 6 to 12 years; 72.6% male; 69 with ADHD) completed theBalloon-Analogue Risk Task (BART) to assess external reward sensitivity behaviorally.Sympathetic-based internal reward sensitivity and parasympathetic-based regulationwere indexed via cardiac pre-ejection period (PEP) and respiratory sinus arrhythmia(RSA), respectively. Children with ADHD exhibited reduced internal reward sensitivity (i.e.,lengthened PEP; F(1,112)=4.01, p=0.047) compared to healthy controls and werecharacterized by greater parasympathetic-based dysregulation (i.e., reduced RSAaugmentation F(1,112)=10.12, p=0.002). However, follow-up analyses indicated theADHD effect was better accounted for by comorbid DBD diagnoses; that is, childrenwith ADHD and comorbid ODD were characterized by reduced internal rewardsensitivity (i.e., lengthened PEP; t=2.47, p=0.046) and by parasympathetic-baseddysregulation (i.e., reduced RSA augmentation; t=3.51, p=0.002) in response to rewardwhen compared to typically developing youth. Furthermore, children with ADHD and comorbid CD exhibited greater behaviorally-based external reward sensitivity (i.e.,more total pops; F(3,110)= 5.96, p=0.001) compared to children with ADHD only (t=3.87, p=0.001) and children with ADHD and ODD (t=3.56, p=0.003). Results suggest that disruptions in sensitivity to reward may be betteraccounted for, in part, by comorbid DBD.Key Words: attention-deficit/hyperactivity disorder, autonomic nervous system,disruptive behavior disorders, reward sensitivityPowered.

Insights on the effectiveness of reward schemes from 10-year longitudinal case studies in 2 Italian regions.

PubMed

Vainieri, Milena; Lungu, Daniel Adrian; Nuti, Sabina

2018-01-30

Pay for performance (P4P) programs have been widely analysed in literature, and the results regarding their impact on performance are mixed. Moreover, in the real-life setting, reward schemes are designed combining multiple elements altogether, yet, it is not clear what happens when they are applied using different combinations. To provide insights on how P4P programs are influenced by 5 key elements: whom, what, how, how many targets, and how much to reward. A qualitative longitudinal analysis of 10 years of P4P reward schemes adopted by the regional administrations of Tuscany and Lombardy (Italy) was conducted. The effects of the P4P features on performance are discussed considering both overall and specific indicators. Both regions applied financial reward schemes for General Managers by linking the variable pay to performance. While Tuscany maintained a relatively stable financial incentive design and governance tools, Lombardy changed some elements of the design and introduced, in 2012, a P4P program aimed to reward the providers. The main differences between the 2 cases regard the number of targets (how many), the type (what), and the method applied to set targets (how). Considering the overall performance obtained by the 2 regions, it seems that whom, how, and how much to reward are not relevant in the success of P4P programs; instead, the number (how many) and the type (what) of targets set may influence the performance improvement processes driven by financial reward schemes. © 2018 The Authors. The International Journal of Health Planning and Management published by John Wiley & Sons Ltd.

Reward Capacity Predicts Leptin Dynamics During Laboratory-Controlled Eating in Women as a Function of Body Mass Index

PubMed Central

Holsen, Laura M.; Jackson, Benita

2017-01-01

Objective The role of leptin in mesolimbic signaling non-food-related reward has been well established at the pre-clinical level, yet studies in humans are lacking. The present investigation explored the association between hedonic capacity and leptin dynamics, and whether this association differed by BMI class. Methods In this cross-sectional study of 75 women (42 with lean BMIs, 33 with obese BMIs), we measured serum leptin before/after meal consumption. Reward capacity was assessed using the Snaith-Hamilton Pleasure Scale (SHAPS). Multiple regression tested whether reward capacity was associated with leptin AUC, with an interaction term to test differences between lean (LN) and obese (OB) groups. Results The interaction of SHAPS by BMI group was robust (β=−.40, p=.005); among women with obesity, greater SHAPS score was associated with lower leptin AUC (β=−.35, p=.002, adjusted R-squared=.66). Among the lean group, the association was not statistically significant (β=−.16, p=.252, adjusted R-squared=.22). Findings were above and beyond BMI and age. Conclusions In this sample a robust, negative association between reward capacity and circulating leptin was stronger in women with obesity compared to lean counterparts. These findings suggest that despite likely leptin resistance, inhibitory leptin functioning related to non-food reward may be spared in women with obesity. PMID:28722317

Affective-associative two-process theory: a neurocomputational account of partial reinforcement extinction effects.

PubMed

Lowe, Robert; Almér, Alexander; Billing, Erik; Sandamirskaya, Yulia; Balkenius, Christian

2017-12-01

The partial reinforcement extinction effect (PREE) is an experimentally established phenomenon: behavioural response to a given stimulus is more persistent when previously inconsistently rewarded than when consistently rewarded. This phenomenon is, however, controversial in animal/human learning theory. Contradictory findings exist regarding when the PREE occurs. One body of research has found a within-subjects PREE, while another has found a within-subjects reversed PREE (RPREE). These opposing findings constitute what is considered the most important problem of PREE for theoreticians to explain. Here, we provide a neurocomputational account of the PREE, which helps to reconcile these seemingly contradictory findings of within-subjects experimental conditions. The performance of our model demonstrates how omission expectancy, learned according to low probability reward, comes to control response choice following discontinuation of reward presentation (extinction). We find that a PREE will occur when multiple responses become controlled by omission expectation in extinction, but not when only one omission-mediated response is available. Our model exploits the affective states of reward acquisition and reward omission expectancy in order to differentially classify stimuli and differentially mediate response choice. We demonstrate that stimulus-response (retrospective) and stimulus-expectation-response (prospective) routes are required to provide a necessary and sufficient explanation of the PREE versus RPREE data and that Omission representation is key for explaining the nonlinear nature of extinction data.

Deepened extinction following compound stimulus presentation: Noradrenergic modulation

PubMed Central

Janak, Patricia H.; Corbit, Laura H.

2011-01-01

Behavioral extinction is an active form of new learning involving the prediction of nonreward where reward has previously been present. The expression of extinction learning can be disrupted by the presentation of reward itself or reward-predictive stimuli (reinstatement) as well as the passage of time (spontaneous recovery) or contextual changes (renewal). The following experiments replicated the demonstration that presenting multiple previously rewarded stimuli in compound during extinction enhances extinction learning. To explore the pharmacological basis for this we next examined the effects of pharmacological treatments that either facilitated or blocked noradrenergic activity to test the hypothesis that increased noradrenergic activity at the time of extinction training would improve, whereas blockade of noradrenergic activity would impair the extinction of appetitive stimulus–reward memories. Different groups of rats were trained in a discriminative stimulus paradigm to lever-press for food reward. Once stable responding was achieved, responding was extinguished for 2 d. Prior to a third extinction session, rats received systemic administration of either saline, yohimbine (α2 antagonist), atomoxetine (norepinephrine reuptake inhibitor), or propranolol (β-receptor antagonist). Spontaneous recovery of responding to the stimuli was tested 4 wk later. Our results indicate that increasing noradrenergic activity during extinction augments extinction learning resulting in less recovery of responding at test. These results have important implications for models of relapse to drug seeking and the development of extinction-based therapies. PMID:21224211

Understanding a Nonlinear Causal Relationship Between Rewards and Physicians' Contributions in Online Health Care Communities: Longitudinal Study.

PubMed

Wang, Jying-Nan; Chiu, Ya-Ling; Yu, Haiyan; Hsu, Yuan-Teng

2017-12-21

The online health care community is not just a place for the public to share physician reviews or medical knowledge, but also a physician-patient communication platform. The medical resources of developing countries are relatively inadequate, and the online health care community is a potential solution to alleviate the phenomenon of long hospital queues and the lack of medical resources in rural areas. However, the success of the online health care community depends on online contributions by physicians. The aim of this study is to examine the effect of incentive mechanisms on physician's online contribution behavior in the online health community. We addressed the following questions: (1) from which specialty area are physicians more likely to participate in online health care community activities, (2) what are the factors affecting physician online contributions, and (3) do incentive mechanisms, including psychological and material rewards, result in differences of physician online contributions? We designed a longitudinal study involving a data sample in three waves. All data were collected from the Good Doctor website, which is the largest online health care community in China. We first used descriptive statistics to investigate the physician online contribution behavior in its entirety. Then multiple linear and quadratic regression models were applied to verify the causal relationship between rewards and physician online contribution. Our sample included 40,300 physicians from 3607 different hospitals, 10 different major specialty areas, and 31 different provinces or municipalities. Based on the multiple quadratic regression model, we found that the coefficients of the control variables, past physician online contributions, doctor review rating, clinic title, hospital level, and city level, were .415, .189, -.099, -.106, and -.143, respectively. For the psychological (or material) rewards, the standardized coefficient of the main effect was 0.261 (or 0.688) and the standardized coefficient of the quadratic effect was -0.015 (or -0.049). All estimates were statistically significant (P<.001). Physicians with more past physician online contribution, with higher review ratings, coming from lower level clinics, not coming from tertiary hospitals, and not coming from big cities were more willing to participate in online health care community activities. To promote physician online contribution, it is necessary to establish an appropriate incentive mechanism including psychological and material rewards. Finally, our findings suggest two guidelines for designing a useful incentive mechanism to facilitate physician online contribution. First, material reward is more useful than psychological reward. Second, as indicated by the concave-down-increasing causal relationship between rewards and physician online contribution, although an appropriate reward is effective in encouraging willingness on the part of physicians to contribute to the online health care community, the effect of additional rewards is limited. ©Jying-Nan Wang, Ya-Ling Chiu, Haiyan Yu, Yuan-Teng Hsu. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 21.12.2017.

Understanding a Nonlinear Causal Relationship Between Rewards and Physicians’ Contributions in Online Health Care Communities: Longitudinal Study

PubMed Central

2017-01-01

Background The online health care community is not just a place for the public to share physician reviews or medical knowledge, but also a physician-patient communication platform. The medical resources of developing countries are relatively inadequate, and the online health care community is a potential solution to alleviate the phenomenon of long hospital queues and the lack of medical resources in rural areas. However, the success of the online health care community depends on online contributions by physicians. Objective The aim of this study is to examine the effect of incentive mechanisms on physician’s online contribution behavior in the online health community. We addressed the following questions: (1) from which specialty area are physicians more likely to participate in online health care community activities, (2) what are the factors affecting physician online contributions, and (3) do incentive mechanisms, including psychological and material rewards, result in differences of physician online contributions? Methods We designed a longitudinal study involving a data sample in three waves. All data were collected from the Good Doctor website, which is the largest online health care community in China. We first used descriptive statistics to investigate the physician online contribution behavior in its entirety. Then multiple linear and quadratic regression models were applied to verify the causal relationship between rewards and physician online contribution. Results Our sample included 40,300 physicians from 3607 different hospitals, 10 different major specialty areas, and 31 different provinces or municipalities. Based on the multiple quadratic regression model, we found that the coefficients of the control variables, past physician online contributions, doctor review rating, clinic title, hospital level, and city level, were .415, .189, –.099, –.106, and –.143, respectively. For the psychological (or material) rewards, the standardized coefficient of the main effect was 0.261 (or 0.688) and the standardized coefficient of the quadratic effect was –0.015 (or –0.049). All estimates were statistically significant (P<.001). Conclusions Physicians with more past physician online contribution, with higher review ratings, coming from lower level clinics, not coming from tertiary hospitals, and not coming from big cities were more willing to participate in online health care community activities. To promote physician online contribution, it is necessary to establish an appropriate incentive mechanism including psychological and material rewards. Finally, our findings suggest two guidelines for designing a useful incentive mechanism to facilitate physician online contribution. First, material reward is more useful than psychological reward. Second, as indicated by the concave-down-increasing causal relationship between rewards and physician online contribution, although an appropriate reward is effective in encouraging willingness on the part of physicians to contribute to the online health care community, the effect of additional rewards is limited. PMID:29269344

How we value the future affects our desire to learn.

PubMed

Moore, Alana L; Hauser, Cindy E; McCarthy, Michael A

2008-06-01

Active adaptive management is increasingly advocated in natural resource management and conservation biology. Active adaptive management looks at the benefit of employing strategies that may be suboptimal in the near term but which may provide additional information that will facilitate better management in future years. However, when comparing management policies it is traditional to weigh future rewards geometrically (at a constant discount rate) which results in far-distant rewards making a negligible contribution to the total benefit. Under such a discounting scheme active adaptive management is rarely of much benefit, especially if learning is slow. A growing number of authors advocate the use of alternative forms of discounting when evaluating optimal strategies for long-term decisions which have a social component. We consider a theoretical harvested population for which the recovery rate from an unharvestably small population size is unknown and look at the effects on the benefit of experimental management when three different forms of discounting are employed. Under geometric discounting, with a discount rate of 5% per annum, managing to learn actively had little benefit. This study demonstrates that discount functions which weigh future rewards more heavily result in more conservative harvesting strategies, but do not necessarily encourage active learning. Furthermore, the optimal management strategy is not equivalent to employing geometric discounting at a lower rate. If alternative discount functions are made mandatory in calculating optimal management strategies for environmental management then this will affect the structure of optimal management regimes and change when and how much we are willing to invest in learning.

Place field assembly distribution encodes preferred locations

PubMed Central

Mamad, Omar; Stumpp, Lars; McNamara, Harold M.; Ramakrishnan, Charu; Deisseroth, Karl; Reilly, Richard B.

2017-01-01

The hippocampus is the main locus of episodic memory formation and the neurons there encode the spatial map of the environment. Hippocampal place cells represent location, but their role in the learning of preferential location remains unclear. The hippocampus may encode locations independently from the stimuli and events that are associated with these locations. We have discovered a unique population code for the experience-dependent value of the context. The degree of reward-driven navigation preference highly correlates with the spatial distribution of the place fields recorded in the CA1 region of the hippocampus. We show place field clustering towards rewarded locations. Optogenetic manipulation of the ventral tegmental area demonstrates that the experience-dependent place field assembly distribution is directed by tegmental dopaminergic activity. The ability of the place cells to remap parallels the acquisition of reward context. Our findings present key evidence that the hippocampal neurons are not merely mapping the static environment but also store the concurrent context reward value, enabling episodic memory for past experience to support future adaptive behavior. PMID:28898248

A dynamic code for economic object valuation in prefrontal cortex neurons

PubMed Central

Tsutsui, Ken-Ichiro; Grabenhorst, Fabian; Kobayashi, Shunsuke; Schultz, Wolfram

2016-01-01

Neuronal reward valuations provide the physiological basis for economic behaviour. Yet, how such valuations are converted to economic decisions remains unclear. Here we show that the dorsolateral prefrontal cortex (DLPFC) implements a flexible value code based on object-specific valuations by single neurons. As monkeys perform a reward-based foraging task, individual DLPFC neurons signal the value of specific choice objects derived from recent experience. These neuronal object values satisfy principles of competitive choice mechanisms, track performance fluctuations and follow predictions of a classical behavioural model (Herrnstein’s matching law). Individual neurons dynamically encode both, the updating of object values from recently experienced rewards, and their subsequent conversion to object choices during decision-making. Decoding from unselected populations enables a read-out of motivational and decision variables not emphasized by individual neurons. These findings suggest a dynamic single-neuron and population value code in DLPFC that advances from reward experiences to economic object values and future choices. PMID:27618960

Continuous track paths reveal additive evidence integration in multistep decision making.

PubMed

Buc Calderon, Cristian; Dewulf, Myrtille; Gevers, Wim; Verguts, Tom

2017-10-03

Multistep decision making pervades daily life, but its underlying mechanisms remain obscure. We distinguish four prominent models of multistep decision making, namely serial stage, hierarchical evidence integration, hierarchical leaky competing accumulation (HLCA), and probabilistic evidence integration (PEI). To empirically disentangle these models, we design a two-step reward-based decision paradigm and implement it in a reaching task experiment. In a first step, participants choose between two potential upcoming choices, each associated with two rewards. In a second step, participants choose between the two rewards selected in the first step. Strikingly, as predicted by the HLCA and PEI models, the first-step decision dynamics were initially biased toward the choice representing the highest sum/mean before being redirected toward the choice representing the maximal reward (i.e., initial dip). Only HLCA and PEI predicted this initial dip, suggesting that first-step decision dynamics depend on additive integration of competing second-step choices. Our data suggest that potential future outcomes are progressively unraveled during multistep decision making.

Obesity and the Neurocognitive Basis of Food Reward and the Control of Intake12

PubMed Central

Ziauddeen, Hisham; Alonso-Alonso, Miguel; Hill, James O; Kelley, Michael; Khan, Naiman A

2015-01-01

With the rising prevalence of obesity, hedonic eating has become an important theme in obesity research. Hedonic eating is thought to be that driven by the reward of food consumption and not metabolic need, and this has focused attention on the brain reward system and how its dysregulation may cause overeating and obesity. Here, we begin by examining the brain reward system and the evidence for its dysregulation in human obesity. We then consider the issue of how individuals are able to control their hedonic eating in the present obesogenic environment and compare 2 contrasting perspectives on the control of hedonic eating, specifically, enhanced control of intake via higher cognitive control and loss of control over intake as captured by the food addiction model. We conclude by considering what these perspectives offer in terms of directions for future research and for potential interventions to improve control over food intake at the population and the individual levels. PMID:26178031

A general theory of intertemporal decision-making and the perception of time.

PubMed

Namboodiri, Vijay M K; Mihalas, Stefan; Marton, Tanya M; Hussain Shuler, Marshall G

2014-01-01

Animals and humans make decisions based on their expected outcomes. Since relevant outcomes are often delayed, perceiving delays and choosing between earlier vs. later rewards (intertemporal decision-making) is an essential component of animal behavior. The myriad observations made in experiments studying intertemporal decision-making and time perception have not yet been rationalized within a single theory. Here we present a theory-Training-Integrated Maximized Estimation of Reinforcement Rate (TIMERR)-that explains a wide variety of behavioral observations made in intertemporal decision-making and the perception of time. Our theory postulates that animals make intertemporal choices to optimize expected reward rates over a limited temporal window which includes a past integration interval-over which experienced reward rate is estimated-as well as the expected delay to future reward. Using this theory, we derive mathematical expressions for both the subjective value of a delayed reward and the subjective representation of the delay. A unique contribution of our work is in finding that the past integration interval directly determines the steepness of temporal discounting and the non-linearity of time perception. In so doing, our theory provides a single framework to understand both intertemporal decision-making and time perception.

A general theory of intertemporal decision-making and the perception of time

PubMed Central

Namboodiri, Vijay M. K.; Mihalas, Stefan; Marton, Tanya M.; Hussain Shuler, Marshall G.

2014-01-01

Animals and humans make decisions based on their expected outcomes. Since relevant outcomes are often delayed, perceiving delays and choosing between earlier vs. later rewards (intertemporal decision-making) is an essential component of animal behavior. The myriad observations made in experiments studying intertemporal decision-making and time perception have not yet been rationalized within a single theory. Here we present a theory—Training-Integrated Maximized Estimation of Reinforcement Rate (TIMERR)—that explains a wide variety of behavioral observations made in intertemporal decision-making and the perception of time. Our theory postulates that animals make intertemporal choices to optimize expected reward rates over a limited temporal window which includes a past integration interval—over which experienced reward rate is estimated—as well as the expected delay to future reward. Using this theory, we derive mathematical expressions for both the subjective value of a delayed reward and the subjective representation of the delay. A unique contribution of our work is in finding that the past integration interval directly determines the steepness of temporal discounting and the non-linearity of time perception. In so doing, our theory provides a single framework to understand both intertemporal decision-making and time perception. PMID:24616677

Analysis of medical student's book reports on Cronin's The Citadel: would young doctors give up ideals for prestige and wealth?

PubMed

Hwang, Se Won; Kim, Hun; Kim, Ae Yang; Hwang, Kun

2016-06-01

The purpose of this study is to find what medical students think the reward for their future work should be and whether they would keep their ideals or abandon them for prestige and wealth by analyzing the book reports of Cronin's The Citadel. Participants were 50 medical students of junior class. A month before the classroom lecture, the book and digital video disk were provided. Students had discussions in groups of seven and wrote book reports which include answers of three questions. Regarding what should be the reward for the medical doctor, two-thirds of students (66.7%) answered with spiritual compensation, while one-third (33.3%) chose material reward. In the situation presented to Manson, three-fifths (60.0%) answered they would keep their ideals (idealist), while the remaining two-fifths (40.0%) decided they would abandon them. Less than one-third of students (30.0%) answered they would reveal the corruptions of the doctor's society, while two-thirds (64.0%) would not. The larger number of idealists who prefer spiritual reward rather than a material reward represents the innocence of youth as in portrayed in The Citadel.

Physiological Response to Reward and Extinction Predicts Alcohol, Marijuana, and Cigarette Use Two Years Later

PubMed Central

Derefinko, Karen J.; Eisenlohr-Moul, Tory A.; Peters, Jessica R.; Roberts, Walter; Walsh, Erin C.; Milich, Richard; Lynam, Donald R.

2017-01-01

Background Physiological responses to reward and extinction are believed to represent the Behavioral Activation System (BAS) and Behavioral Inhibition System (BIS) constructs of Reinforcement Sensitivity Theory and underlie externalizing behaviors, including substance use. However, little research has examined these relations directly. Methods We assessed individuals’ cardiac pre-ejection periods (PEP) and electrodermal responses (EDR) during reward and extinction trials through the “Number Elimination Game” paradigm. Responses represented BAS and BIS, respectively. We then examined whether these responses provided incremental utility in the prediction of future alcohol, marijuana, and cigarette use. Results Zero-inflated Poisson (ZIP) regression models were used to examine the predictive utility of physiological BAS and BIS responses above and beyond previous substance use. Physiological responses accounted for incremental variance over previous use. Low BAS responses during reward predicted frequency of alcohol use at year 3. Low BAS responses during reward and extinction and high BIS responses during extinction predicted frequency of marijuana use at year 3. For cigarette use, low BAS response during extinction predicted use at year 3. Conclusions These findings suggest that the constructs of Reinforcement Sensitivity Theory, as assessed through physiology, contribute to the longitudinal maintenance of substance use. PMID:27306728

Making Decisions about Now and Later: Development of Future-Oriented Self-Control

ERIC Educational Resources Information Center

Garon, Nancy M.; Longard, Julie; Bryson, Susan E.; Moore, Chris

2012-01-01

This study explored factors underlying preschoolers' ability to make future-oriented choices. In a delay-of-gratification choice task, quantity and visibility of the reward was systematically varied. Participants included 90 typically developing children aged 2-4 years. Children made more choices to delay gratification as the quantity of the…

Adolescents' Thoughts about Parents' Jobs and Their Importance for Adolescents' Future Orientation

ERIC Educational Resources Information Center

Neblett, Nicole Gardner; Cortina, Kai Schnabel

2006-01-01

The current study examined the relation between adolescents' perceptions of their parents' jobs and their future orientation, and tested the role of parental support. Four hundred and fifteen ninth through twelfth graders were surveyed about their parents' job rewards, self-direction, and stressors, as well as their expectations for employment and…

Motivators for Alzheimer's disease clinical trial participation.

PubMed

Bardach, Shoshana H; Holmes, Sarah D; Jicha, Gregory A

2018-02-01

Alzheimer's disease (AD) research progress is impeded due to participant recruitment challenges. This study seeks to better understand, from the perspective of individuals engaged in clinical trials (CTs), research motivations. Participants, or their caregivers, from AD treatment and prevention CTs were surveyed about research motivators. The 87 respondents had a mean age of 72.2, were predominantly Caucasian, 55.2% were male, and 56.3% had cognitive impairment. An overwhelming majority rated the potential to help themselves or a loved one and the potential to help others in the future as important motivators. Relatively few respondents were motivated by free healthcare, monetary rewards, or to make others happy. Recruitment efforts should focus on the potential benefit for the individual, their loved ones, and others in the future rather than free healthcare or monetary rewards.

Effort–Reward Imbalance at Work and Incident Coronary Heart Disease

PubMed Central

Siegrist, Johannes; Nyberg, Solja T.; Lunau, Thorsten; Fransson, Eleonor I.; Alfredsson, Lars; Bjorner, Jakob B.; Borritz, Marianne; Burr, Hermann; Erbel, Raimund; Fahlén, Göran; Goldberg, Marcel; Hamer, Mark; Heikkilä, Katriina; Jöckel, Karl-Heinz; Knutsson, Anders; Madsen, Ida E. H.; Nielsen, Martin L.; Nordin, Maria; Oksanen, Tuula; Pejtersen, Jan H.; Pentti, Jaana; Rugulies, Reiner; Salo, Paula; Schupp, Jürgen; Singh-Manoux, Archana; Steptoe, Andrew; Theorell, Töres; Vahtera, Jussi; Westerholm, Peter J. M.; Westerlund, Hugo; Virtanen, Marianna; Zins, Marie; Batty, G. David; Kivimäki, Mika

2017-01-01

Background: Epidemiologic evidence for work stress as a risk factor for coronary heart disease is mostly based on a single measure of stressful work known as job strain, a combination of high demands and low job control. We examined whether a complementary stress measure that assesses an imbalance between efforts spent at work and rewards received predicted coronary heart disease. Methods: This multicohort study (the “IPD-Work” consortium) was based on harmonized individual-level data from 11 European prospective cohort studies. Stressful work in 90,164 men and women without coronary heart disease at baseline was assessed by validated effort–reward imbalance and job strain questionnaires. We defined incident coronary heart disease as the first nonfatal myocardial infarction or coronary death. Study-specific estimates were pooled by random effects meta-analysis. Results: At baseline, 31.7% of study members reported effort–reward imbalance at work and 15.9% reported job strain. During a mean follow-up of 9.8 years, 1,078 coronary events were recorded. After adjustment for potential confounders, a hazard ratio of 1.16 (95% confidence interval, 1.00–1.35) was observed for effort–reward imbalance compared with no imbalance. The hazard ratio was 1.16 (1.01–1.34) for having either effort–reward imbalance or job strain and 1.41 (1.12–1.76) for having both these stressors compared to having neither effort–reward imbalance nor job strain. Conclusions: Individuals with effort–reward imbalance at work have an increased risk of coronary heart disease, and this appears to be independent of job strain experienced. These findings support expanding focus beyond just job strain in future research on work stress. PMID:28570388

Further support for association between GWAS variant for positive emotion and reward systems.

PubMed

Lancaster, T M; Ihssen, N; Brindley, L M; Linden, D E J

2017-01-31

A recent genome-wide association study (GWAS) identified a significant single-nucleotide polymorphism (SNP) for trait-positive emotion at rs322931 on chromosome 1, which was also associated with brain activation in the reward system of healthy individuals when observing positive stimuli in a functional magnetic resonance imaging (fMRI) study. In the current study, we aimed to further validate the role of variation at rs322931 in reward processing. Using a similar fMRI approach, we use two paradigms that elicit a strong ventral striatum (VS) blood oxygen-level dependency (BOLD) response in a sample of young, healthy individuals (N=82). In the first study we use a similar picture-viewing task to the discovery sample (positive>neutral stimuli) to replicate an effect of the variant on emotion processing. In the second study we use a probabilistic reversal learning procedure to identify reward processing during decision-making under uncertainly (reward>punishment). In a region of interest (ROI) analysis of the bilateral VS, we show that the rs322931 genotype was associated with BOLD in the left VS during the positive>neutral contrast (P ROI-CORRECTED =0.045) and during the reward>punishment contrast (P ROI-CORRECTED =0.018), although the effect of passive picture viewing was in the opposite direction from that reported in the discovery sample. These findings suggest that the recently identified GWAS hit may influence positive emotion via individual differences in activity in the key hubs of the brain's reward system. Furthermore, these effects may not be limited to the passive viewing of positive emotional scenes, but may also be observed during dynamic decision-making. This study suggests that future studies of this GWAS locus may yield further insight into the biological mechanisms of psychopathologies characterised by deficits in reward processing and positive emotion.

Effort-Reward Imbalance at Work and Incident Coronary Heart Disease: A Multicohort Study of 90,164 Individuals.

PubMed

Dragano, Nico; Siegrist, Johannes; Nyberg, Solja T; Lunau, Thorsten; Fransson, Eleonor I; Alfredsson, Lars; Bjorner, Jakob B; Borritz, Marianne; Burr, Hermann; Erbel, Raimund; Fahlén, Göran; Goldberg, Marcel; Hamer, Mark; Heikkilä, Katriina; Jöckel, Karl-Heinz; Knutsson, Anders; Madsen, Ida E H; Nielsen, Martin L; Nordin, Maria; Oksanen, Tuula; Pejtersen, Jan H; Pentti, Jaana; Rugulies, Reiner; Salo, Paula; Schupp, Jürgen; Singh-Manoux, Archana; Steptoe, Andrew; Theorell, Töres; Vahtera, Jussi; Westerholm, Peter J M; Westerlund, Hugo; Virtanen, Marianna; Zins, Marie; Batty, G David; Kivimäki, Mika

2017-07-01

Epidemiologic evidence for work stress as a risk factor for coronary heart disease is mostly based on a single measure of stressful work known as job strain, a combination of high demands and low job control. We examined whether a complementary stress measure that assesses an imbalance between efforts spent at work and rewards received predicted coronary heart disease. This multicohort study (the "IPD-Work" consortium) was based on harmonized individual-level data from 11 European prospective cohort studies. Stressful work in 90,164 men and women without coronary heart disease at baseline was assessed by validated effort-reward imbalance and job strain questionnaires. We defined incident coronary heart disease as the first nonfatal myocardial infarction or coronary death. Study-specific estimates were pooled by random effects meta-analysis. At baseline, 31.7% of study members reported effort-reward imbalance at work and 15.9% reported job strain. During a mean follow-up of 9.8 years, 1,078 coronary events were recorded. After adjustment for potential confounders, a hazard ratio of 1.16 (95% confidence interval, 1.00-1.35) was observed for effort-reward imbalance compared with no imbalance. The hazard ratio was 1.16 (1.01-1.34) for having either effort-reward imbalance or job strain and 1.41 (1.12-1.76) for having both these stressors compared to having neither effort-reward imbalance nor job strain. Individuals with effort-reward imbalance at work have an increased risk of coronary heart disease, and this appears to be independent of job strain experienced. These findings support expanding focus beyond just job strain in future research on work stress.

Applying economic incentives to increase effectiveness of an outpatient weight loss program (TRIO) - A randomized controlled trial.

PubMed

Finkelstein, Eric A; Tham, Kwang-Wei; Haaland, Benjamin A; Sahasranaman, Aarti

2017-07-01

The prevalence of overweight and obesity has more than doubled in the past three decades, leading to rising rates of non-communicable diseases. This study tests whether adding a payment/rewards (term reward) program to an existing evidence-based weight loss program can increase weight loss and weight loss maintenance. We conducted a parallel-group randomized controlled trial from October 2012 to October 2015 with 161 overweight or obese individuals randomized to either control or reward arm in a 1:2 ratio. Control and reward arm participants received a four month weight loss program at the LIFE (Lifestyle Improvement and Fitness Enhancement) Centre at Singapore General Hospital. Those in the reward arm paid a fee of S$165.00 (1US$ = 1.35S$) to access a program that provided rewards of up to S$660 for meeting weight loss and physical activity goals. Participants could choose to receive rewards as guaranteed cash payments or a lottery ticket with a 1 in 10 chance of winning but with the same expected value. The primary outcome was weight loss at months 4, 8, and 12. 161 participants were randomized to control (n = 54) or reward (n = 107) arms. Average weight loss was more than twice as great in the reward arm compared to the control arm at month 4 when the program concluded (3.4 kg vs 1.4 kg, p < 0.01), month 8 when rewards concluded (3.3 kg vs 1.8 kg, p < 0.05), and at month 12 (2.3 kg vs 0.8 kg, p < 0.05). These results reveal that a payment/rewards program can be used to improve weight loss and weight loss maintenance when combined with an evidence-based weight loss program. Future efforts should attempt to replicate this approach and identify how to cost effectively expand these programs to maximize their reach. This study is registered at www.clinicaltrials.gov (Identifier: NCT01533454). Copyright © 2017 Elsevier Ltd. All rights reserved.

Neural correlates of reward-based spatial learning in persons with cocaine dependence.

PubMed

Tau, Gregory Z; Marsh, Rachel; Wang, Zhishun; Torres-Sanchez, Tania; Graniello, Barbara; Hao, Xuejun; Xu, Dongrong; Packard, Mark G; Duan, Yunsuo; Kangarlu, Alayar; Martinez, Diana; Peterson, Bradley S

2014-02-01

Dysfunctional learning systems are thought to be central to the pathogenesis of and impair recovery from addictions. The functioning of the brain circuits for episodic memory or learning that support goal-directed behavior has not been studied previously in persons with cocaine dependence (CD). Thirteen abstinent CD and 13 healthy participants underwent MRI scanning while performing a task that requires the use of spatial cues to navigate a virtual-reality environment and find monetary rewards, allowing the functional assessment of the brain systems for spatial learning, a form of episodic memory. Whereas both groups performed similarly on the reward-based spatial learning task, we identified disturbances in brain regions involved in learning and reward in CD participants. In particular, CD was associated with impaired functioning of medial temporal lobe (MTL), a brain region that is crucial for spatial learning (and episodic memory) with concomitant recruitment of striatum (which normally participates in stimulus-response, or habit, learning), and prefrontal cortex. CD was also associated with enhanced sensitivity of the ventral striatum to unexpected rewards but not to expected rewards earned during spatial learning. We provide evidence that spatial learning in CD is characterized by disturbances in functioning of an MTL-based system for episodic memory and a striatum-based system for stimulus-response learning and reward. We have found additional abnormalities in distributed cortical regions. Consistent with findings from animal studies, we provide the first evidence in humans describing the disruptive effects of cocaine on the coordinated functioning of multiple neural systems for learning and memory.

Sleep spindles during a nap correlate with post sleep memory performance for highly rewarded word-pairs.

PubMed

Studte, Sara; Bridger, Emma; Mecklinger, Axel

2017-04-01

The consolidation of new associations is thought to depend in part on physiological processes engaged during non-REM (NREM) sleep, such as slow oscillations and sleep spindles. Moreover, NREM sleep is thought to selectively benefit associations that are adaptive for the future. In line with this, the current study investigated whether different reward cues at encoding are associated with changes in sleep physiology and memory retention. Participants' associative memory was tested after learning a list of arbitrarily paired words both before and after taking a 90-min nap. During learning, word-pairs were preceded by a cue indicating either a high or a low reward for correct memory performance at test. The motivation manipulation successfully impacted retention such that memory declined to a greater extent from pre- to post sleep for low rewarded than for high rewarded word-pairs. In line with previous studies, positive correlations between spindle density during NREM sleep and general memory performance pre- and post-sleep were found. In addition to this, however, a selective positive relationship between memory performance for highly rewarded word-pairs at posttest and spindle density during NREM sleep was also observed. These results support the view that motivationally salient memories are preferentially consolidated and that sleep spindles may be an important underlying mechanism for selective consolidation. Copyright © 2016 Elsevier Inc. All rights reserved.

Reward-Related Dorsal Striatal Activity Differences between Former and Current Cocaine Dependent Individuals during an Interactive Competitive Game

PubMed Central

Hyatt, Christopher J.; Assaf, Michal; Muska, Christine E.; Rosen, Rivkah I.; Thomas, Andre D.; Johnson, Matthew R.; Hylton, Jennifer L.; Andrews, Melissa M.; Reynolds, Brady A.; Krystal, John H.; Potenza, Marc N.; Pearlson, Godfrey D.

2012-01-01

Cocaine addiction is characterized by impulsivity, impaired social relationships, and abnormal mesocorticolimbic reward processing, but their interrelationships relative to stages of cocaine addiction are unclear. We assessed blood-oxygenation-level dependent (BOLD) signal in ventral and dorsal striatum during functional magnetic resonance imaging (fMRI) in current (CCD; n = 30) and former (FCD; n = 28) cocaine dependent subjects as well as healthy control (HC; n = 31) subjects while playing an interactive competitive Domino game involving risk-taking and reward/punishment processing. Out-of-scanner impulsivity-related measures were also collected. Although both FCD and CCD subjects scored significantly higher on impulsivity-related measures than did HC subjects, only FCD subjects had differences in striatal activation, specifically showing hypoactivation during their response to gains versus losses in right dorsal caudate, a brain region linked to habituation, cocaine craving and addiction maintenance. Right caudate activity in FCD subjects also correlated negatively with impulsivity-related measures of self-reported compulsivity and sensitivity to reward. These findings suggest that remitted cocaine dependence is associated with striatal dysfunction during social reward processing in a manner linked to compulsivity and reward sensitivity measures. Future research should investigate the extent to which such differences might reflect underlying vulnerabilities linked to cocaine-using propensities (e.g., relapses). PMID:22606228

Attention Diversion Improves Response Inhibition of Immediate Reward, But Only When it Is Beneficial: An fMRI Study

PubMed Central

Scalzo, Franco; O’Connor, David A.; Orr, Catherine; Murphy, Kevin; Hester, Robert

2016-01-01

Deficits of self-control are associated with a number of mental state disorders. The ability to direct attention away from an alluring stimulus appears to aid inhibition of an impulsive response. However, further functional imaging research is required to assess the impact of shifts in attention on self-regulating processes. We varied the level of attentional disengagement in an functional magnetic resonance imaging (fMRI)-based Go/No-go task to probe whether diversion of attention away from alluring stimuli facilitates response inhibition. We used the attention-grabbing characteristic of faces to exogenously direct attention away from stimuli and investigated the relative importance of attention and response inhibition mechanisms under different delayed reward scenarios [i.e., where forgoing an immediate reward ($1) led to a higher ($10) or no payoff in the future]. We found that diverting attention improved response inhibition performance, but only when resistance to an alluring stimulus led to delayed reward. Region of interest analyses indicated significant increased activity in posterior right inferior frontal gyrus during successful No-go trials for delayed reward trials compared to no delayed reward trials, and significant reduction in activity in the superior temporal gyri and left caudate in contexts of high attentional diversion. Our findings imply that strategies that increase the perceived benefits of response inhibition might assist individuals in abstaining from problematic impulsive behaviors. PMID:27616988

Myopia for the future or hypersensitivity to reward? Age-related changes in decision making on the Iowa Gambling Task.

PubMed

Bauer, A S; Timpe, J; Edmonds, E C; Bechara, A; Tranel, D; Denburg, N L

2013-02-01

It has been shown that older adults perform less well than younger adults on the Iowa Gambling Task (IGT), a real-world type decision-making task that factors together reward, punishment, and uncertainty. To explore the reasons behind this age-related decrement, we administered to an adult life span sample of 265 healthy participants (Mdn age = 62.00 +/- 16.17 years; range [23-88]) 2 versions of the IGT, which have different contingencies for successful performance: A'B'C'D' requires choosing lower immediate reward (paired with lower delayed punishment); E'F'G'H' requires choosing higher immediate punishment (paired with higher delayed reward). There was a significant negative correlation between age and performance on the A'B'C'D' version of the IGT (r = -.16, p = .01), while there was essentially no correlation between age and performance on the E'F'G'H' version (r = -.07, p = .24). In addition, the rate of impaired performance in older participants was significantly higher for the A'B'C'D' version (23%) compared with the E'F'G'H' version (13%). A parsimonious account of these findings is an age-related increase in hypersensitivity to reward, whereby the decisions of older adults are disproportionately influenced by prospects of receiving reward, irrespective of the presence or degree of punishment. PsycINFO Database Record (c) 2013 APA, all rights reserved.

Cultivating Engagement and Enjoyment in Exergames Using Feedback, Challenge, and Rewards.

PubMed

Lyons, Elizabeth J

2015-02-01

This article reviews theoretical and empirical evidence related to three mechanisms for encouraging enjoyment during exergame play: Feedback, challenge, and rewards. A literature search and narrative review were conducted. Feedback is found in nearly all exergames, and richer, more in-depth feedback is associated with increased activity. Challenge is a vital component of any videogame, and exergames include physical as well as cognitive challenges. Flow states have traditionally been conceptualized as occurring when an optimal match between player skills and game challenge occurs. However, failure and retrial are necessary for feelings of overall satisfaction and fun, despite not necessarily being ideally fun or satisfying themselves. Rewards are a more complicated issue, with significant theoretical and empirical evidence suggesting positive and negative effects of reward systems. How rewards are integrated into the mechanics and storyline of the game likely impacts how they are perceived and, thus, their effectiveness. Finally, integration of these mechanisms into exergames requires specific attention to both cognitive and physical implementations. Movements that are not themselves enjoyable or engaging may lead to cheating and lower energy expenditure. Feedback, challenge, and rewards are promising mechanisms by which exergames could become more enjoyable. How these concepts are operationalized can affect physical and psychological reactions to exergames. Attention to these concepts in future exergame development and implementation would benefit theory, research, and practice.

Cultivating Engagement and Enjoyment in Exergames Using Feedback, Challenge, and Rewards

PubMed Central

2015-01-01

Abstract Objective: This article reviews theoretical and empirical evidence related to three mechanisms for encouraging enjoyment during exergame play: Feedback, challenge, and rewards. Materials and Methods: A literature search and narrative review were conducted. Results: Feedback is found in nearly all exergames, and richer, more in-depth feedback is associated with increased activity. Challenge is a vital component of any videogame, and exergames include physical as well as cognitive challenges. Flow states have traditionally been conceptualized as occurring when an optimal match between player skills and game challenge occurs. However, failure and retrial are necessary for feelings of overall satisfaction and fun, despite not necessarily being ideally fun or satisfying themselves. Rewards are a more complicated issue, with significant theoretical and empirical evidence suggesting positive and negative effects of reward systems. How rewards are integrated into the mechanics and storyline of the game likely impacts how they are perceived and, thus, their effectiveness. Finally, integration of these mechanisms into exergames requires specific attention to both cognitive and physical implementations. Movements that are not themselves enjoyable or engaging may lead to cheating and lower energy expenditure. Conclusions: Feedback, challenge, and rewards are promising mechanisms by which exergames could become more enjoyable. How these concepts are operationalized can affect physical and psychological reactions to exergames. Attention to these concepts in future exergame development and implementation would benefit theory, research, and practice. PMID:26181675

Attention-deficit/hyperactivity disorder, delay discounting, and risky financial behaviors: A preliminary analysis of self-report data

PubMed Central

2017-01-01

Delay discounting—often referred to as hyperbolic discounting in the financial literature—is defined by a consistent preference for smaller, immediate rewards over larger, delayed rewards, and by failure of future consequences to curtail current consummatory behaviors. Previous research demonstrates (1) excessive delay discounting among individuals with attention-deficit/hyperactivity disorder (ADHD), (2) common neural substrates of delay discounting and hyperactive-impulsive symptoms of ADHD, and (3) associations between delay discounting and both debt burden and high interest rate borrowing. This study extends prior research by examining associations between ADHD symptoms, delay discounting, and an array of previously unevaluated financial outcomes among 544 individuals (mean age 35 years). Controlling for age, income, sex, education, and substance use, ADHD symptoms were associated with delay discounting, late credit card payments, credit card balances, use of pawn services, personal debt, and employment histories (less time spent at more jobs). Consistent with neural models of reward processing and associative learning, more of these relations were attributable to hyperactive-impulsive symptoms than inattentive symptoms. Implications for financial decision-making and directions for future research are discussed. PMID:28481903

Effort-reward imbalance and self-rated health among Gambian healthcare professionals.

PubMed

Darboe, Amadou; Lin, I-Feng; Kuo, Hsien-Wen

2016-04-11

The effort-reward imbalance (ERI) model of work stress has been widely applied in investigating association between psychosocial factors at work and health. This study examined associations between perceived psychosocial work stress as measured by the ERI model and self-rated health (SRH) among nurses and environmental health officers (EHOs) working in secondary public healthcare facilities in the Gambia. A cross-sectional study on a random sample of 287 health care professionals (201 nurses and 86 EHOs). A 22-item ERI questionnaire was used to collect data on the psychosocial factors defined by the ERI model. SRH was assessed using a single item measure. The distribution of subjective health was not statistically different between nurses and EHOs. However, our study uncovered significant associations between perceived psychosocial work stress and subjective health. Specifically, we found that a perceived high effort-reward imbalance (ER-ratio > 1) is a significant risk factor for poor SRH, in both occupational groups. However, over-commitment was not significantly associated with poor SRH in the two groups. When efforts and rewards were considered as separate variables in the analysis, rewards were inversely associated with poor SRH in both groups. Because of the high perceived Effort-Reward Imbalance among healthcare professionals at secondary public healthcare facilities, it is necessary to modify working conditions through improvement of psychosocial work environment, such as reasonable allocation of resources to increase pay, incentives or other forms of rewards from government. Interventions that could mitigate and prevent stress at work are worth considering in future healthcare policies.

Anticipatory Reward Processing in Addicted Populations: A Focus on the Monetary Incentive Delay Task

PubMed Central

Balodis, Iris M.; Potenza, Marc N.

2014-01-01

Advances in brain imaging techniques have allowed neurobiological research to temporally analyze signals coding for the anticipation of rewards. In addicted populations, both hypo- and hyper-responsiveness of brain regions (e.g., ventral striatum) implicated in drug effects and reward system processing have been reported during anticipation of generalized reward. Here, we discuss the current state of knowledge of reward processing in addictive disorders from a widely used and validated task: the Monetary Incentive Delay Task (MIDT). The current paper constrains review to those studies applying the MIDT in addicted and at-risk adult populations, with a focus on anticipatory processing and striatal regions activated during task performance, as well as the relationship of these regions with individual difference (e.g., impulsivity) and treatment outcome variables. We further review drug influences in challenge studies as a means to examine acute influences on reward processing in abstinent, recreationally using and addicted populations. Here, we discuss that generalized reward processing in addicted and at-risk populations is often characterized by divergent anticipatory signaling in the ventral striatum. Although methodological/task variations may underlie some discrepant findings, anticipatory signaling in the ventral striatum may also be influenced by smoking status, drug metabolites and treatment status in addicted populations. Divergent results across abstinent, recreationally using and addicted populations demonstrate complexities in interpreting findings. Future studies will benefit from focusing on characterizing how impulsivity and other addiction-related features relate to anticipatory striatal signaling over time. Additionally, identifying how anticipatory signals recover/adjust following protracted abstinence will be important in understanding recovery processes. PMID:25481621

Perceived Challenges and Rewards of Forming a Sexual Agreement among HIV-Negative Male Couples

PubMed Central

Mitchell, Jason W.; Lee, Ji-Young; Woodyatt, Cory; Bauermeister, José; Sullivan, Patrick; Stephenson, Rob

2016-01-01

Sexual agreements, explicit mutual understandings made between two partners about which sexual and related behaviors they agree to engage in within and/or outside of their relationship, are common among male couples. However, little is known about the perceived rewards and challenges partnered men face in the process of forming a sexual agreement. Such knowledge may be useful for development of future HIV preventive and sexual health programs that encourage male couples to establish a sexual agreement in their relationship. By using qualitative dyadic data from a sample of 29 self-reported concordant HIV-negative male couples who had a sexual agreement, the present qualitative study sought to: assess partnered men’s perceived rewards and challenges of forming a sexual agreement in their relationship; and examine whether both men in the couple concurred about their perceived rewards and challenges of forming a sexual agreement. Themes for perceived rewards were: 1) being honest, 2) improving communication, 3) increasing understanding about expectations and permitted behaviors, 4) enhancing intimacy and relational bond, and 5) building trust. Themes for perceived challenges were: 1) stigma about having an open agreement; 2) awkwardness about the topic and talking about it; 3) jealousy; 4) no perceived challenges. Few couples had both partners concur about their perceived rewards or challenges toward establishing a sexual agreement. The variety of perceived rewards and challenges highlight the need for tailoring given that a variety of factors may influence partnered men’s establishment of a sexual agreement in their relationship. PMID:26964794

Reward signals, attempted suicide, and impulsivity in late-life depression.

PubMed

Dombrovski, Alexandre Y; Szanto, Katalin; Clark, Luke; Reynolds, Charles F; Siegle, Greg J

2013-10-01

IMPORTANCE—Suicide can be viewed as an escape from unendurable punishment at the cost of any future rewards. Could faulty estimation of these outcomes predispose to suicidal behavior? In behavioral studies, many of those who have attempted suicide misestimate expected rewards on gambling and probabilistic learning tasks.OBJECTIVES—To describe the neural circuit abnormalities that underlie disadvantageous choices in people at risk for suicide and to relate these abnormalities to impulsivity, which is one of the components of vulnerability to suicide.DESIGN—Case-control functional magnetic resonance imaging study of reward learning using are inforcement learning model.SETTING—University hospital and outpatient clinic.PATIENTS—Fifty-three participants 60 years or older, including 15 depressed patients who had attempted suicide, 18 depressed patients who had never attempted suicide (depressed control subjects), and 20 psychiatrically healthy controls.MAIN OUTCOMES AND MEASURES—Components of the cortical blood oxygenation level–dependent response tracking expected and unpredicted rewards.RESULTS—Depressed elderly participants displayed 2 distinct disruptions of control over reward-guided behavior. First, impulsivity and a history of suicide attempts (particularly poorly planned ones) were associated with a weakened expected reward signal in the paralimbic cortex,which in turn predicted the behavioral insensitivity to contingency change. Second, depression was associated with disrupted corticostriatothalamic encoding of unpredicted rewards, which in turn predicted the behavioral over sensitivity to punishment. These results were robust to the effects of possible brain damage from suicide attempts, depressive severity, co-occurring substance use and anxiety disorders, antidepressant and anticholinergic exposure, lifetime exposure to electroconvulsive therapy, vascular illness, and incipient dementia.CONCLUSIONS AND RELEVANCE—Altered paralimbic reward signals and impulsivity and/or carelessness may facilitate unplanned suicidal acts. This pattern, also seen in gambling and cocaine use, may reflect a primary deficit in the paralimbic cortex or in its mesolimbic input. The over reactivity to punishment in depression may be caused in part by a disruption of appetitive learning in the corticostriatothalamic circuits.

Reward Signals, Attempted Suicide, and Impulsivity in Late-Life Depression

PubMed Central

Dombrovski, Alexandre Y.; Szanto, Katalin; Clark, Luke; Reynolds, Charles F.; Siegle, Greg J.

2013-01-01

IMPORTANCE Suicide can be viewed as an escape from unendurable punishment at the cost of any future rewards. Could faulty estimation of these outcomes predispose to suicidal behavior? In behavioral studies, many of those who have attempted suicide misestimate expected rewards on gambling and probabilistic learning tasks. OBJECTIVES To describe the neural circuit abnormalities that underlie disadvantageous choices in people at risk for suicide and to relate these abnormalities to impulsivity, which is one of the components of vulnerability to suicide. DESIGN Case-control functional magnetic resonance imaging study of reward learning using a reinforcement learning model. SETTING University hospital and outpatient clinic. PATIENTS Fifty-three participants 60 years or older, including 15 depressed patients who had attempted suicide, 18 depressed patients who had never attempted suicide (depressed control subjects), and 20 psychiatrically healthy controls. MAIN OUTCOMES AND MEASURES Components of the cortical blood oxygenation level–dependent response tracking expected and unpredicted rewards. RESULTS Depressed elderly participants displayed 2 distinct disruptions of control over reward-guided behavior. First, impulsivity and a history of suicide attempts (particularly poorly planned ones) were associated with a weakened expected reward signal in the paralimbic cortex, which in turn predicted the behavioral insensitivity to contingency change. Second, depression was associated with disrupted corticostriatothalamic encoding of unpredicted rewards, which in turn predicted the behavioral oversensitivity to punishment. These results were robust to the effects of possible brain damage from suicide attempts, depressive severity, co-occurring substance use and anxiety disorders, antidepressant and anticholinergic exposure, lifetime exposure to electroconvulsive therapy, vascular illness, and incipient dementia. CONCLUSIONS AND RELEVANCE Altered paralimbic reward signals and impulsivity and/or carelessness may facilitate unplanned suicidal acts. This pattern, also seen in gambling and cocaine use, may reflect a primary deficit in the paralimbic cortex or in its mesolimbic input. The overreactivity to punishment in depression may be caused in part by a disruption of appetitive learning in the corticostriatothalamic circuits. PMID:23925710

Hope grounded in belief: Influences of reward for application and social cynicism on dispositional hope.

PubMed

Bernardo, Allan B I

2013-12-01

Two studies explore whether general beliefs about the social world or social axioms may be antecedents of dispositional hope. Social axioms are generalized cognitive representations that provide frames for constructing individuals' hope-related cognitions. Considering social axioms' instrumental and ego-defensive functions, two social axioms, social cynicism and reward for application are hypothesized to be negative and positive predictors of hope, respectively. Study 1 used multiple regression analysis to test the hypothesis. Study 2 used structural equation modeling to test the model with a pathway linking reward for application with hope, and another pathway linking social cynicism and hope that is mediated by self-esteem. The results are discussed in terms of extending the range of psychological constructs and processes that foster the development of hope. © 2013 The Scandinavian Psychological Associations.

Circadian clock genes: effects on dopamine, reward and addiction.

PubMed

Parekh, Puja K; Ozburn, Angela R; McClung, Colleen A

2015-06-01

Addiction is a widespread public health issue with social and economic ramifications. Substance abuse disorders are often accompanied by disruptions in circadian rhythms including sleep/wake cycles, which can exacerbate symptoms of addiction and dependence. Additionally, genetic disturbance of circadian molecular mechanisms can predispose some individuals to substance abuse disorders. In this review, we will discuss how circadian genes can regulate midbrain dopaminergic activity and subsequently, drug intake and reward. We will also suggest future directions for research on circadian genes and drugs of abuse. Copyright © 2015 Elsevier Inc. All rights reserved.

A Role for the Lateral Dorsal Tegmentum in Memory and Decision Neural Circuitry

PubMed Central

Redila, Van; Kinzel, Chantelle; Jo, Yong Sang; Puryear, Corey B.; Mizumori, Sheri J.Y.

2017-01-01

A role for the hippocampus in memory is clear, although the mechanism for its contribution remains a matter of debate. Converging evidence suggests that hippocampus evaluates the extent to which context-defining features of events occur as expected. The consequence of mismatches, or prediction error, signals from hippocampus is discussed in terms of its impact on neural circuitry that evaluates the significance of prediction errors: Ventral tegmental area (VTA) dopamine cells burst fire to rewards or cues that predict rewards (Schultz et al., 1997). Although the lateral dorsal tegmentum (LDTg) importantly controls dopamine cell burst firing (Lodge & Grace, 2006) the behavioral significance of the LDTg control is not known. Therefore, we evaluated LDTg functional activity as rats performed a spatial memory task that generates task-dependent reward codes in VTA (Jo et al., 2013; Puryear et al., 2010) and another VTA afferent, the pedunculopontine nucleus (PPTg, Norton et al., 2011). Reversible inactivation of the LDTg significantly impaired choice accuracy. LDTg neurons coded primarily egocentric information in the form of movement velocity, turning behaviors, and behaviors leading up to expected reward locations. A subset of the velocity-tuned LDTg cells also showed high frequency bursts shortly before or after reward encounters, after which they showed tonic elevated firing during consumption of small, but not large, rewards. Cells that fired before reward encounters showed stronger correlations with velocity as rats moved toward, rather than away from, rewarded sites. LDTg neural activity was more strongly regulated by egocentric behaviors than that observed for PPTg or VTA cells that were recorded by Puryear et al. and Norton et al. While PPTg activity was uniquely sensitive to ongoing sensory input, all three regions encoded reward magnitude (although in different ways), reward expectation, and reward encounters. Only VTA encoded reward prediction errors. LDTg may inform VTA about learned goal-directed movement that reflects the current motivational state, and this in turn may guide VTA determination of expected subjective goal values. When combined it is clear the LDTg and PPTg provide only a portion of the information that dopamine cells need to assess the value of prediction errors, a process that is essential to future adaptive decisions and switches of cognitive (i.e. memorial) strategies and behavioral responses. PMID:24910282

The Influence of Instrumentality Beliefs on Intrinsic Motivation: A Study of High-Achieving Adolescents

ERIC Educational Resources Information Center

Kover, David J.; Worrell, Frank C.

2010-01-01

For many students, school is a forward-looking endeavor, with implications for future educational opportunity, job prospects, and financial success. How does believing that school is linked to a desired future outcome--known as an instrumentality belief--influence motivation? A number of studies have indicated that rewards, or other concerns that…

Future Discounting by Slum-Dwelling Youth versus University Students in Rio de Janeiro

ERIC Educational Resources Information Center

Ramos, Dandara; Victor, Tania; Seidl-de-Moura, Maria Lucia; Daly, Martin

2013-01-01

We compared Future Discounting (FD, preference for smaller, sooner rewards over larger, later ones) by 160 Brazilian youth (16-30 years old; 71 women and 89 men). University students and slum-dwelling (favela) youth were compared. Participants completed a monetary FD task, a scale of youngsters' view of their neighborhood, and self-reported…

Necessary Contributions of Human Frontal Lobe Subregions to Reward Learning in a Dynamic, Multidimensional Environment.

PubMed

Vaidya, Avinash R; Fellows, Lesley K

2016-09-21

Real-world decisions are typically made between options that vary along multiple dimensions, requiring prioritization of the important dimensions to support optimal choice. Learning in this setting depends on attributing decision outcomes to the dimensions with predictive relevance rather than to dimensions that are irrelevant and nonpredictive. This attribution problem is computationally challenging, and likely requires an interplay between selective attention and reward learning. Both these processes have been separately linked to the prefrontal cortex, but little is known about how they combine to support learning the reward value of multidimensional stimuli. Here, we examined the necessary contributions of frontal lobe subregions in attributing feedback to relevant and irrelevant dimensions on a trial-by-trial basis in humans. Patients with focal frontal lobe damage completed a demanding reward learning task where options varied on three dimensions, only one of which predicted reward. Participants with left lateral frontal lobe damage attributed rewards to irrelevant dimensions, rather than the relevant dimension. Damage to the ventromedial frontal lobe also impaired learning about the relevant dimension, but did not increase reward attribution to irrelevant dimensions. The results argue for distinct roles for these two regions in learning the value of multidimensional decision options under dynamic conditions, with the lateral frontal lobe required for selecting the relevant dimension to associate with reward, and the ventromedial frontal lobe required to learn the reward association itself. The real world is complex and multidimensional; how do we attribute rewards to predictive features when surrounded by competing cues? Here, we tested the critical involvement of human frontal lobe subregions in a probabilistic, multidimensional learning environment, asking whether focal lesions affected trial-by-trial attribution of feedback to relevant and irrelevant dimensions. The left lateral frontal lobe was required for filtering option dimensions to allow appropriate feedback attribution, while the ventromedial frontal lobe was necessary for learning the value of features in the relevant dimension. These findings argue that selective attention and associative learning processes mediated by anatomically distinct frontal lobe subregions are both critical for adaptive choice in more complex, ecologically valid settings. Copyright © 2016 the authors 0270-6474/16/369843-16$15.00/0.

Patterns of pollen and nectar foraging specialization by bumblebees over multiple timescales using RFID

PubMed Central

Russell, Avery L.; Morrison, Sarah J.; Moschonas, Eleni H.; Papaj, Daniel R.

2017-01-01

The ecological success of social insects is frequently ascribed to improvements in task performance due to division of labour amongst workers. While much research has focused on improvements associated with lifetime task specialization, members of colonies can specialize on a given task over shorter time periods. Eusocial bees in particular must collect pollen and nectar rewards to survive, but most workers appear to mix collection of both rewards over their lifetimes. We asked whether bumblebees specialize over timescales shorter than their lifetime. We also explored factors that govern such patterns, and asked whether reward specialists made more foraging bouts than generalists. In particular, we described antennal morphology and size of all foragers in a single colony and related these factors to each forager’s complete foraging history, obtained using radio frequency identification (RFID). Only a small proportion of foragers were lifetime specialists; nevertheless, >50% of foragers specialized daily on a given reward. Contrary to expectations, daily and lifetime reward specialists were not better foragers (being neither larger nor making more bouts); larger bees with more antennal olfactory sensilla made more bouts, but were not more specialized. We discuss causes and functions of short and long-term patterns of specialization for bumblebee colonies. PMID:28181584

Exploration for Agents with Different Personalities in Unknown Environments

NASA Astrophysics Data System (ADS)

Doumit, Sarjoun; Minai, Ali

We present in this paper a personality-based architecture (PA) that combines elements from the subsumption architecture and reinforcement learning to find alternate solutions for problems facing artificial agents exploring unknown environments. The underlying PA algorithm is decomposed into layers according to the different (non-contiguous) stages that our agent passes in, which in turn are influenced by the sources of rewards present in the environment. The cumulative rewards collected by an agent, in addition to its internal composition serve as factors in shaping its personality. In missions where multiple agents are deployed, our solution-goal is to allow each of the agents develop its own distinct personality in order for the collective to reach a balanced society, which then can accumulate the largest possible amount of rewards for the agent and society as well. The architecture is tested in a simulated matrix world which embodies different types of positive rewards and negative rewards. Varying experiments are performed to compare the performance of our algorithm with other algorithms under the same environment conditions. The use of our architecture accelerates the overall adaptation of the agents to their environment and goals by allowing the emergence of an optimal society of agents with different personalities. We believe that our approach achieves much efficient results when compared to other more restrictive policy designs.

Acquisition of decision making criteria: reward rate ultimately beats accuracy.

PubMed

Balci, Fuat; Simen, Patrick; Niyogi, Ritwik; Saxe, Andrew; Hughes, Jessica A; Holmes, Philip; Cohen, Jonathan D

2011-02-01

Speed-accuracy trade-offs strongly influence the rate of reward that can be earned in many decision-making tasks. Previous reports suggest that human participants often adopt suboptimal speed-accuracy trade-offs in single session, two-alternative forced-choice tasks. We investigated whether humans acquired optimal speed-accuracy trade-offs when extensively trained with multiple signal qualities. When performance was characterized in terms of decision time and accuracy, our participants eventually performed nearly optimally in the case of higher signal qualities. Rather than adopting decision criteria that were individually optimal for each signal quality, participants adopted a single threshold that was nearly optimal for most signal qualities. However, setting a single threshold for different coherence conditions resulted in only negligible decrements in the maximum possible reward rate. Finally, we tested two hypotheses regarding the possible sources of suboptimal performance: (1) favoring accuracy over reward rate and (2) misestimating the reward rate due to timing uncertainty. Our findings provide support for both hypotheses, but also for the hypothesis that participants can learn to approach optimality. We find specifically that an accuracy bias dominates early performance, but diminishes greatly with practice. The residual discrepancy between optimal and observed performance can be explained by an adaptive response to uncertainty in time estimation.

Song practice as a rewarding form of play in songbirds.

PubMed

Riters, Lauren V; Spool, Jeremy A; Merullo, Devin P; Hahn, Allison H

2017-10-12

In adult songbirds, the primary functions of song are mate attraction and territory defense; yet, many songbirds sing at high rates as juveniles and outside these primary contexts as adults. Singing outside primary contexts is critical for song learning and maintenance, and ultimately necessary for breeding success. However, this type of singing (i.e., song "practice") occurs even in the absence of immediate or obvious extrinsic reinforcement; that is, it does not attract mates or repel competitors. Here we review studies that support the hypothesis that song practice is stimulated and maintained by intrinsic reward mechanisms (i.e., that it is associated with a positive affective state). Additionally, we propose that song practice can be considered a rewarding form of play behavior similar to forms of play observed in multiple young animals as they practice sequences of motor events that are used later in primary adult reproductive contexts. This review highlights research suggesting at least partially overlapping roles for neural reward systems in birdsong and mammalian play and evidence that steroid hormones modify these systems to shift animals from periods of intrinsically rewarded motor exploration (i.e., singing in birds and play in mammals) to the use of similar motor patterns in primary reproductive contexts. Copyright © 2017 Elsevier B.V. All rights reserved.

Theoretical Frameworks and Mechanistic Aspects of Alcohol Addiction: Alcohol Addiction as a Reward Deficit Disorder

PubMed Central

2012-01-01

Alcoholism can be defined by a compulsion to seek and take drug, loss of control in limiting intake, and the emergence of a negative emotional state when access to the drug is prevented. Alcoholism impacts multiple motivational mechanisms and can be conceptualized as a disorder that includes a progression from impulsivity (positive reinforcement) to compulsivity (negative reinforcement). The compulsive drug seeking associated with alcoholism can be derived from multiple neuroadaptations, but the thesis argued here is that a key component involves the construct of negative reinforcement. Negative reinforcement is defined as drug taking that alleviates a negative emotional state. The negative emotional state that drives such negative reinforcement is hypothesized to derive from dysregulation of specific neurochemical elements involved in reward and stress within the basal forebrain structures involving the ventral striatum and extended amygdala, respectively. Specific neurochemical elements in these structures include not only decreases in reward neurotransmission, such as decreased dopamine and γ-aminobutyric acid function in the ventral striatum, but also recruitment of brain stress systems, such as corticotropin-releasing factor (CRF), in the extended amygdala. Acute withdrawal from chronic alcohol, sufficient to produce dependence, increases reward thresholds, increases anxiety-like responses, decreases dopamine system function, and increases extracellular levels of CRF in the central nucleus of the amygdala. CRF receptor antagonists also block excessive drug intake produced by dependence. A brain stress response system is hypothesized to be activated by acute excessive drug intake, to be sensitized during repeated withdrawal, to persist into protracted abstinence, and to contribute to the compulsivity of alcoholism. Other components of brain stress systems in the extended amygdala that interact with CRF and that may contribute to the negative motivational state of withdrawal include norepinephrine, dynorphin, and neuropeptide Y. The combination of loss of reward function and recruitment of brain stress systems provides a powerful neurochemical basis for a negative emotional state that is responsible for the negative reinforcement driving, at least partially, the compulsivity of alcoholism. PMID:21744309

Future Discounting in Congo Basin Hunter-Gatherers Declines with Socio-Economic Transitions.

PubMed

Salali, Gul Deniz; Migliano, Andrea Bamberg

2015-01-01

Humans have a tendency to discount the future; that is we value small, short-term rewards over larger, long-term rewards. The degree of future discounting, however, changes in response to socio-ecological factors. Here, we study Mbendjele BaYaka hunter-gatherers of northern Congo and their farmer neighbours to investigate adaptations in inter-temporal preferences in humans. We argue that in immediate-return systems, where food storage is absent and egalitarianism is enforced through levelling mechanisms, future discounting is an adaptive strategy to prevent wealth accumulation and the emergence of hierarchies. This ensures food sharing and allows for survival in unpredictable environments where there is risk of an energy shortfall. On the other hand, when food storage is made possible by the emergence of agriculture or as seen in some delayed-return hunter-gatherer populations, wealth accumulation, hierarchies and lower discount rates become the adaptive strategy. Therefore, individuals in immediate-return, egalitarian societies will discount the future more than those in non-egalitarian, delayed-return societies. Consistent with the predictions we found that market integration and socio-economic transitions decrease the future discounting in Mbendjele hunter-gatherers. Our measures of socio-economic differences marked this transition in hunter-gatherers living in a logging town. The degree of future-discounting was the same between more market-integrated hunter-gatherers and their farmer neighbours.

The effect of REM sleep deprivation on motivation for food reward.

PubMed

Hanlon, Erin C; Andrzejewski, Matthew E; Harder, Bridgette K; Kelley, Ann E; Benca, Ruth M

2005-08-30

Prolonged sleep deprivation in rats produces a characteristic syndrome consisting of an increase in food intake yet a decrease in weight. Moreover, the increase in food intake generally precedes the weight loss, suggesting that sleep deprivation may affect appetitive behaviors. Using the multiple platform method to produce rapid eye movement (REM) sleep deprivation, we investigated the effect of REM sleep deprivation (REMSD) on motivation for food reward utilizing food-reinforced operant tasks. In acquisition or maintenance of an operant task, REM sleep-deprived rats, with or without simultaneous food restriction, decreased responding for sucrose pellet reward in comparison to controls, despite the fact that all REM sleep-deprived rats lost weight. Furthermore, the overall response deficit of the REM sleep-deprived rats was due to a within-session decline in responding. REM sleep-deprived rats showed evidence of understanding the contingency of the task comparable to controls throughout deprivation period, suggesting that the decrements in responding were not primarily related to deficits in learning or memory. Rather, REM sleep deprivation appears to alter systems involved in motivational processes, reward, and/or attention.

Failure analysis and modeling of a VAXcluster system

NASA Technical Reports Server (NTRS)

Tang, Dong; Iyer, Ravishankar K.; Subramani, Sujatha S.

1990-01-01

This paper discusses the results of a measurement-based analysis of real error data collected from a DEC VAXcluster multicomputer system. In addition to evaluating basic system dependability characteristics such as error and failure distributions and hazard rates for both individual machines and for the VAXcluster, reward models were developed to analyze the impact of failures on the system as a whole. The results show that more than 46 percent of all failures were due to errors in shared resources. This is despite the fact that these errors have a recovery probability greater than 0.99. The hazard rate calculations show that not only errors, but also failures occur in bursts. Approximately 40 percent of all failures occur in bursts and involved multiple machines. This result indicates that correlated failures are significant. Analysis of rewards shows that software errors have the lowest reward (0.05 vs 0.74 for disk errors). The expected reward rate (reliability measure) of the VAXcluster drops to 0.5 in 18 hours for the 7-out-of-7 model and in 80 days for the 3-out-of-7 model.

The Neural Systems of Forgiveness: An Evolutionary Psychological Perspective

PubMed Central

Billingsley, Joseph; Losin, Elizabeth A. R.

2017-01-01

Evolution-minded researchers posit that the suite of human cognitive adaptations may include forgiveness systems. According to these researchers, forgiveness systems regulate interpersonal motivation toward a transgressor in the wake of harm by weighing multiple factors that influence both the potential gains of future interaction with the transgressor and the likelihood of future harm. Although behavioral research generally supports this evolutionary model of forgiveness, the model’s claims have not been examined with available neuroscience specifically in mind, nor has recent neuroscientific research on forgiveness generally considered the evolutionary literature. The current review aims to help bridge this gap by using evolutionary psychology and cognitive neuroscience to mutually inform and interrogate one another. We briefly summarize the evolutionary research on forgiveness, then review recent neuroscientific findings on forgiveness in light of the evolutionary model. We emphasize neuroscientific research that links desire for vengeance to reward-based areas of the brain, that singles out prefrontal areas likely associated with inhibition of vengeful feelings, and that correlates the activity of a theory-of-mind network with assessments of the intentions and blameworthiness of those who commit harm. In addition, we identify gaps in the existing neuroscientific literature, and propose future research directions that might address them, at least in part. PMID:28539904

Attenuation of Frontostriatal Connectivity During Reward Processing Predicts Response to Psychotherapy in Major Depressive Disorder.

PubMed

Walsh, Erin; Carl, Hannah; Eisenlohr-Moul, Tory; Minkel, Jared; Crowther, Andrew; Moore, Tyler; Gibbs, Devin; Petty, Chris; Bizzell, Josh; Smoski, Moria J; Dichter, Gabriel S

2017-03-01

There are few reliable predictors of response to antidepressant treatments. In the present investigation, we examined pretreatment functional brain connectivity during reward processing as a potential predictor of response to Behavioral Activation Treatment for Depression (BATD), a validated psychotherapy that promotes engagement with rewarding stimuli and reduces avoidance behaviors. Thirty-three outpatients with major depressive disorder (MDD) and 20 matched controls completed two runs of the monetary incentive delay task during functional magnetic resonance imaging after which participants with MDD received up to 15 sessions of BATD. Seed-based generalized psychophysiological interaction analyses focused on task-based connectivity across task runs, as well as the attenuation of connectivity from the first to the second run of the task. The average change in Beck Depression Inventory-II scores due to treatment was 10.54 points, a clinically meaningful response. Groups differed in seed-based functional connectivity among multiple frontostriatal regions. Hierarchical linear modeling revealed that improved treatment response to BATD was predicted by greater connectivity between the left putamen and paracingulate gyrus during reward anticipation. In addition, MDD participants with greater attenuation of connectivity between several frontostriatal seeds, and midline subcallosal cortex and left paracingulate gyrus demonstrated improved response to BATD. These findings indicate that pretreatment frontostriatal functional connectivity during reward processing is predictive of response to a psychotherapy modality that promotes improving approach-related behaviors in MDD. Furthermore, connectivity attenuation among reward-processing regions may be a particularly powerful endophenotypic predictor of response to BATD in MDD.

Prefrontal neurons encode context-based response execution and inhibition in reward seeking and extinction

PubMed Central

Moorman, David E.; Aston-Jones, Gary

2015-01-01

The prefrontal cortex (PFC) guides execution and inhibition of behavior based on contextual demands. In rodents, the dorsal/prelimbic (PL) medial PFC (mPFC) is frequently considered essential for execution of goal-directed behavior (“go”) whereas ventral/infralimbic (IL) mPFC is thought to control behavioral suppression (“stop”). This dichotomy is commonly seen for fear-related behaviors, and for some behaviors related to cocaine seeking. Overall, however, data for reward-directed behaviors are ambiguous, and few recordings of PL/IL activity have been performed to demonstrate single-neuron correlates. We recorded neuronal activity in PL and IL during discriminative stimulus driven sucrose seeking followed by multiple days of extinction of the reward-predicting stimulus. Contrary to a generalized PL-go/IL-stop hypothesis, we found cue-evoked activity in PL and IL during reward seeking and extinction. Upon analyzing this activity based on resultant behavior (lever press or withhold), we found that neurons in both areas encoded contextually appropriate behavioral initiation (during reward seeking) and withholding (during extinction), where context was dictated by response–outcome contingencies. Our results demonstrate that PL and IL signal contextual information for regulation of behavior, irrespective of whether that involves initiation or suppression of behavioral responses, rather than topographically encoding go vs. stop behaviors. The use of context to optimize behavior likely plays an important role in maximizing utility-promoting exertion of activity when behaviors are rewarded and conservation of energy when not. PMID:26170333

Endogenous opioid system: a promising target for future smoking cessation medications.

PubMed

Norman, Haval; D'Souza, Manoranjan S

2017-05-01

Nicotine addiction continues to be a health challenge across the world. Despite several approved medications, smokers continue to relapse. Several human and animal studies have evaluated the role of the endogenous opioid system as a potential target for smoking cessation medications. In this review, studies that have elucidated the role of the mu (MORs), delta (DORs), and kappa (KORs) opioid receptors in nicotine reward, nicotine withdrawal, and reinstatement of nicotine seeking will be discussed. Additionally, the review will discuss discrepancies in the literature and therapeutic potential of the endogenous opioid system, and suggest studies to address gaps in knowledge with respect to the role of the opioid receptors in nicotine dependence. Data available till date suggest that blockade of the MORs and DORs decreased the rewarding effects of nicotine, while activation of the MORs and DORs decreased nicotine withdrawal-induced aversive effects. In contrast, activation of the KORs decreased the rewarding effects of nicotine, while blockade of the KORs decreased nicotine withdrawal-induced aversive effects. Interestingly, blockade of the MORs and KORs attenuated reinstatement of nicotine seeking. In humans, MOR antagonists have shown benefits in select subpopulations of smokers and further investigation is required to realize their full therapeutic potential. Future work must assess the influence of polymorphisms in opioid receptor-linked genes in nicotine dependence, which will help in both identifying individuals vulnerable to nicotine addiction and the development of opioid-based smoking cessation medications. Overall, the endogenous opioid system continues to be a promising target for future smoking cessation medications.

Acute stress-induced cortisol elevations mediate reward system activity during subconscious processing of sexual stimuli.

PubMed

Oei, Nicole Y L; Both, Stephanie; van Heemst, Diana; van der Grond, Jeroen

2014-01-01

Stress is thought to alter motivational processes by increasing dopamine (DA) secretion in the brain's "reward system", and its key region, the nucleus accumbens (NAcc). However, stress studies using functional magnetic resonance imaging (fMRI), mainly found evidence for stress-induced decreases in NAcc responsiveness toward reward cues. Results from both animal and human PET studies indicate that the stress hormone cortisol may be crucial in the interaction between stress and dopaminergic actions. In the present study we therefore investigated whether cortisol mediated the effect of stress on DA-related responses to -subliminal-presentation of reward cues using the Trier Social Stress Test (TSST), which is known to reliably enhance cortisol levels. Young healthy males (n = 37) were randomly assigned to the TSST or control condition. After stress induction, brain activation was assessed using fMRI during a backward-masking paradigm in which potentially rewarding (sexual), emotionally negative and neutral stimuli were presented subliminally, masked by pictures of inanimate objects. A region of interest analysis showed that stress decreased activation in the NAcc in response to masked sexual cues (voxel-corrected, p<05). Furthermore, with mediation analysis it was found that high cortisol levels were related to stronger NAcc activation, showing that cortisol acted as a suppressor variable in the negative relation between stress and NAcc activation. The present findings indicate that cortisol is crucially involved in the relation between stress and the responsiveness of the reward system. Although generally stress decreases activation in the NAcc in response to rewarding stimuli, high stress-induced cortisol levels suppress this relation, and are associated with stronger NAcc activation. Individuals with a high cortisol response to stress might on one hand be protected against reductions in reward sensitivity, which has been linked to anhedonia and depression, but they may ultimately be more vulnerable to increased reward sensitivity, and addictions. Future studies investigating effects of stress on reward sensitivity should take into account the severity of the stressor and the individual cortisol response to stress. Copyright © 2013 Elsevier Ltd. All rights reserved.

Population Health and Occupational Therapy.

PubMed

Braveman, Brent

2016-01-01

Occupational therapy practitioners play an important role in improving the health of populations through the development of occupational therapy interventions at the population level and through advocacy to address occupational participation and the multiple determinants of health. This article defines and explores population health as a concept and describes the appropriateness of occupational therapy practice in population health. Support of population health practice as evidenced in the official documents of the American Occupational Therapy Association and the relevance of population health for occupational therapy as a profession are reviewed. Recommendations and directions for the future are included related to celebration of the achievements of occupational therapy practitioners in the area of population health, changes to the Occupational Therapy Practice Framework and educational accreditation standards, and the importance of supporting, recognizing, rewarding, and valuing occupational therapy practitioners who assume roles in which direct care is not their primary function. Copyright © 2016 by the American Occupational Therapy Association, Inc.

Heuristic and optimal policy computations in the human brain during sequential decision-making.

PubMed

Korn, Christoph W; Bach, Dominik R

2018-01-23

Optimal decisions across extended time horizons require value calculations over multiple probabilistic future states. Humans may circumvent such complex computations by resorting to easy-to-compute heuristics that approximate optimal solutions. To probe the potential interplay between heuristic and optimal computations, we develop a novel sequential decision-making task, framed as virtual foraging in which participants have to avoid virtual starvation. Rewards depend only on final outcomes over five-trial blocks, necessitating planning over five sequential decisions and probabilistic outcomes. Here, we report model comparisons demonstrating that participants primarily rely on the best available heuristic but also use the normatively optimal policy. FMRI signals in medial prefrontal cortex (MPFC) relate to heuristic and optimal policies and associated choice uncertainties. Crucially, reaction times and dorsal MPFC activity scale with discrepancies between heuristic and optimal policies. Thus, sequential decision-making in humans may emerge from integration between heuristic and optimal policies, implemented by controllers in MPFC.

Maintained Physical Activity Induced Changes in Delay Discounting.

PubMed

Sofis, Michael J; Carrillo, Ale; Jarmolowicz, David P

2017-07-01

Those who discount the subjective value of delayed rewards less steeply are more likely to engage in physical activity. There is limited research, however, showing whether physical activity can change rates of delay discounting. In a two-experiment series, treatment and maintenance effects of a novel, effort-paced physical activity intervention on delay discounting were evaluated with multiple baseline designs. Using a lap-based method, participants were instructed to exercise at individualized high and low effort levels and to track their own perceived effort. The results suggest that treatment-induced changes in discounting were maintained at follow-up for 13 of 16 participants. In Experiment 2, there were statistically significant group-level improvements in physical activity and delay discounting when comparing baseline with both treatment and maintenance phases. Percentage change in delay discounting was significantly correlated with session attendance and relative pace (min/mile) improvement over the course of the 7-week treatment. Implications for future research are discussed.

Effort-reward imbalance and burnout among German nurses in medical compared with psychiatric hospital settings.

PubMed

Schulz, M; Damkröger, A; Heins, C; Wehlitz, L; Löhr, M; Driessen, M; Behrens, J; Wingenfeld, K

2009-04-01

The aim of this study was to investigate whether nurses' efforts and rewards, as well as the effort-reward imbalance (ERI) and burnout, differ between subjects working in psychiatric vs. medical hospitals and between nurses under education and examined nurses respectively. Furthermore, the relationship between ERI and burnout was evaluated. Nursing is associated with high levels of emotional strain and heavy workloads. Burnout and a negative ERI can result in high absenteeism and turnover and have been identified as reasons why nurses leave their profession. In the last decade, working conditions of the nursing profession have changed in Germany, but somatic and psychiatric hospitals developed in different ways. This development may lead to different profiles. A sample of 389 nurses (78.8% female) in four German hospitals was investigated. A total of 147 nurses worked in psychiatric hospitals and 236 nurses worked in medical (somatic) hospitals. Fifty participants were still under education. The Effort-Reward Imbalance Inventory measures effort, reward and overcommitment at job and provides an imbalance score between effort and reward. The Maslach Burnout Inventory with the subscales, emotional exhaustion, lack of accomplishment and depersonalization, was also used. Nurses working in medical hospitals reported more burnout and had higher ERI scores. Subjects under education were comparable to examined nurses in terms of burnout but had lower ERI scores. Multiple regression analyses showed all ERI scales to be significant predictors for emotional exhaustion, while age, field of work and educational status further predict effort or ERI respectively. At present, the working situation of nurses in different settings appears to be characterized by a perceived imbalance of effort and reward and is associated with a high risk of developing burnout symptoms.

Different effort constructs and effort-reward imbalance: effects on employee well-being in ancillary health care workers.

PubMed

van Vegchel, N; de Jonge, J; Meijer, T; Hamers, J P

2001-04-01

The present study investigates the relationship between Effort-Reward Imbalance (ERI) and employee well-being, using three different concepts of efforts (i.e. psychological demands, physical demands and emotional demands). The ERI model had been used as a theoretical framework, indicating that work stress is related to high efforts (i.e. job demands) and low occupational rewards (e.g. money, esteem and security/career opportunities). The ERI model also predicts that, in overcommitted workers, effects of ERI on employee well-being are stronger compared with their less committed counterparts. A cross-sectional survey among 167 ancillary health care workers of two nursing homes was conducted. Multiple univariate logistic regression analyses were used to test the relationship between ERI and employee well-being. Results of the logistic regression analyses showed that employees with both high (psychological, physical and emotional) efforts and low rewards had higher risks of psychosomatic health complaints, physical health symptoms and job dissatisfaction (odds ratios (ORs) ranged from 5.09 to 18.55). Moreover, employees who reported both high efforts and high rewards had elevated risks of physical symptoms and exhaustion (ORs ranged from 6.17 to 9.39). No support was found for the hypothesis on the moderating effect of overcommitment. Results show some support for the ERI model; ancillary health care workers with high effort/low reward imbalance had elevated risks of poor employee well-being. In addition, results show that the combination of high efforts and high rewards is important for employee well-being. Finally, some practical implications are discussed to combat work stress in health care work.

Diet-Induced Obesity and Diet-Resistant rats: differences in the rewarding and anorectic effects of D-amphetamine

PubMed Central

Valenza, Marta; Steardo, Luca; Cottone, Pietro; Sabino, Valentina

2015-01-01

Rationale Obesity is a leading public health problem worldwide. Multiple lines of evidence associate deficits in the brain reward circuit with obesity. Objective Whether alterations in brain reward sensitivity precede or are a consequence of obesity is unknown. This study aimed to investigate both innate and obesity-induced differences in the sensitivity to the effects of an indirect dopaminergic agonist. Methods Rats genetically prone to diet-induced obesity (DIO) and their counterpart diet-resistant (DR) were fed a chow diet and their response to D-amphetamine on intracranial self-stimulation and food intake were assessed. The same variables were then evaluated after exposing the rats to a high-fat diet, after DIO rats selectively developed obesity. Finally, gene expression levels of dopamine receptor 1 and 2 as well as tyrosine hydroxylase were measured in reward-related brain regions. Results In a pre-obesity state, DIO rats showed innate decreased sensitivity to the reward-enhancing and anorectic effects of D-amphetamine, as compared to DR rats. In a diet-induced obese state, the insensitivity to the potentiating effects of D-amphetamine on ICSS threshold persisted and became more marked in DIO rats, while the anorectic effects were comparable between genotypes. Finally, innate and obesity-induced differences in the gene expression of dopamine receptors were observed. Conclusions Our results demonstrate that brain reward deficits antedate the development of obesity and worsen after obesity is fully developed, suggesting that these alterations represent vulnerability factors for its development. Moreover, our data suggests that the reward-enhancing and anorectic effects of D-amphetamine are dissociable in the context of obesity. PMID:26047964

The source of dual-task limitations: Serial or parallel processing of multiple response selections?

PubMed Central

Marois, René

2014-01-01

Although it is generally recognized that the concurrent performance of two tasks incurs costs, the sources of these dual-task costs remain controversial. The serial bottleneck model suggests that serial postponement of task performance in dual-task conditions results from a central stage of response selection that can only process one task at a time. Cognitive-control models, by contrast, propose that multiple response selections can proceed in parallel, but that serial processing of task performance is predominantly adopted because its processing efficiency is higher than that of parallel processing. In the present study, we empirically tested this proposition by examining whether parallel processing would occur when it was more efficient and financially rewarded. The results indicated that even when parallel processing was more efficient and was incentivized by financial reward, participants still failed to process tasks in parallel. We conclude that central information processing is limited by a serial bottleneck. PMID:23864266

No costly prosociality among related long-tailed macaques (Macaca fascicularis).

PubMed

Sterck, Elisabeth H M; Olesen, Caroline U; Massen, Jorg J M

2015-08-01

Altruism, benefiting another at a cost to the donor, may be achieved through prosocial behavior. Studies of nonhuman animals typically investigate prosocial behavior with paradigms in which the donor can choose to give a recipient a food item, and the choice does not affect the donor's reward (which is either present or absent). In such tasks, long-tailed macaques (Macaca fascicularis) show prosocial behavior, especially toward kin. Here, we tested captive long-tailed macaques with related recipients in an alternative task, in which the donor had to give up a preferred reward to benefit the recipient; that is, they had to choose a lower valued reward for themselves to provide food to their kin. Overall, the macaques did not provide their kin with food. The task forced the donor to balance its prosocial behavior with its selfish choice for a higher value reward, a balance that turned out to favor selfish motives. Consequently, our study shows that a prosocial tendency is not sufficient to elicit costly prosocial behavior in long-tailed macaques. Subsequently, we feel that tasks in which the donor must choose a lower value reward to benefit another individual may allow the titration of the strength of prosocial behavior, and thus provides interesting possibilities for future comparative studies. (c) 2015 APA, all rights reserved).

Analysis of medical student’s book reports on Cronin’s The Citadel: would young doctors give up ideals for prestige and wealth?

PubMed Central

2016-01-01

Purpose: The purpose of this study is to find what medical students think the reward for their future work should be and whether they would keep their ideals or abandon them for prestige and wealth by analyzing the book reports of Cronin’s The Citadel. Methods: Participants were 50 medical students of junior class. A month before the classroom lecture, the book and digital video disk were provided. Students had discussions in groups of seven and wrote book reports which include answers of three questions. Results: Regarding what should be the reward for the medical doctor, two-thirds of students (66.7%) answered with spiritual compensation, while one-third (33.3%) chose material reward. In the situation presented to Manson, three-fifths (60.0%) answered they would keep their ideals (idealist), while the remaining two-fifths (40.0%) decided they would abandon them. Less than one-third of students (30.0%) answered they would reveal the corruptions of the doctor’s society, while two-thirds (64.0%) would not. Conclusion: The larger number of idealists who prefer spiritual reward rather than a material reward represents the innocence of youth as in portrayed in The Citadel. PMID:27240894

Reviewing the effort-reward imbalance model: drawing up the balance of 45 empirical studies.

PubMed

van Vegchel, Natasja; de Jonge, Jan; Bosma, Hans; Schaufeli, Wilmar

2005-03-01

The present paper provides a review of 45 studies on the Effort-Reward Imbalance (ERI) Model published from 1986 to 2003 (inclusive). In 1986, the ERI Model was introduced by Siegrist et al. (Biological and Psychological Factors in Cardiovascular Disease, Springer, Berlin, 1986, pp. 104-126; Social Science & Medicine 22 (1986) 247). The central tenet of the ERI Model is that an imbalance between (high) efforts and (low) rewards leads to (sustained) strain reactions. Besides efforts and rewards, overcommitment (i.e., a personality characteristic) is a crucial aspect of the model. Essentially, the ERI Model contains three main assumptions, which could be labeled as (1) the extrinsic ERI hypothesis: high efforts in combination with low rewards increase the risk of poor health, (2) the intrinsic overcommitment hypothesis: a high level of overcommitment may increase the risk of poor health, and (3) the interaction hypothesis: employees reporting an extrinsic ERI and a high level of overcommitment have an even higher risk of poor health. The review showed that the extrinsic ERI hypothesis has gained considerable empirical support. Results for overcommitment remain inconsistent and the moderating effect of overcommitment on the relation between ERI and employee health has been scarcely examined. Based on these review results suggestions for future research are proposed.

Insula and striatum activity in effort-related monetary reward processing in gambling disorder: the role of depressive symptomatology.

PubMed

Fauth-Bühler, Mira; Zois, Evangelos; Vollstädt-Klein, Sabine; Lemenager, Tagrid; Beutel, Martin; Mann, Karl

2014-01-01

The neurobiological underpinnings of effort-related monetary reward processing of gambling disorder have not been previously studied. To date neuroimaging studies lack in large sample sizes and as a consequence less attention has been given to brain reward processing that could potentially be attributed to comorbid conditions such as depressive mood state. We assessed monetary reward processing using an effort-dependent task during 3 tesla functional magnetic resonance imaging. We investigated a large sample of male, right-handed, slot-machine-playing disordered gamblers (DGs; N = 80) as well as age- and smoking-matched male healthy controls (HCs; N = 89). Depressive symptoms were assessed using the Beck Depression Inventory (BDI). DGs and HCs were divided into subgroups ("high" and "low") based on their BDI scores. Effort-related monetary reward processing did not differ between the complete groups of HCs and DGs. Brain activation during receipt of monetary reward though revealed a significant Group × BDI interaction: DGs with higher BDI scores compared to DGs with lower BDI scores showed greater brain activity in the right insula cortex and dorsal striatum while no differences were observed for HCs with higher versus lower BDI scores. Our results suggest that effort-related aspects of monetary motivation, i.e. when monetary output is tied to performance, are not altered in DG. Additionally, our findings strengthen the need for subgroup comparisons in future investigations of the disorder as part of a personalized medicine approach.

Motivated encoding selectively promotes memory for future inconsequential semantically-related events.

PubMed

Oyarzún, Javiera P; Packard, Pau A; de Diego-Balaguer, Ruth; Fuentemilla, Lluis

2016-09-01

Neurobiological models of long-term memory explain how memory for inconsequential events fades, unless these happen before or after other relevant (i.e., rewarding or aversive) or novel events. Recently, it has been shown in humans that retrospective and prospective memories are selectively enhanced if semantically related events are paired with aversive stimuli. However, it remains unclear whether motivating stimuli, as opposed to aversive, have the same effect in humans. Here, participants performed a three phase incidental encoding task where one semantic category was rewarded during the second phase. A memory test 24h after, but not immediately after encoding, revealed that memory for inconsequential items was selectively enhanced only if items from the same category had been previously, but not subsequently, paired with rewards. This result suggests that prospective memory enhancement of reward-related information requires, like previously reported for aversive memories, of a period of memory consolidation. The current findings provide the first empirical evidence in humans that the effects of motivated encoding are selectively and prospectively prolonged over time. Copyright © 2016 Elsevier Inc. All rights reserved.

Relation of dietary restraint scores to activation of reward-related brain regions in response to food intake, anticipated intake, and food pictures.

PubMed

Burger, Kyle S; Stice, Eric

2011-03-01

Prospective studies indicate that individuals with elevated dietary restraint scores are at increased risk for future bulimic symptom onset, suggesting that these individuals may show hyper-responsivity of reward regions to food and food cues. Thus, we used functional magnetic resonance imaging (fMRI) to examine the relation of dietary restraint scores to activation of reward-related brain regions in response to receipt and anticipated receipt of chocolate milkshake and exposure to pictures of appetizing foods in 39 female adolescents (mean age=15.5 ± 0.94). Dietary restraint scores were positively correlated with activation in the right orbitofrontal cortex (OFC) and bilateral dorsolateral prefrontal cortex (DLPFC) in response to milkshake receipt. However, dietary restraint scores did not correlate with activation in response to anticipated milkshake receipt or exposure to food pictures. Results indicate that individuals who report high dietary restraint have a hyper-responsivity in reward-related brain regions when food intake is occurring, which may increase risk for overeating and binge eating. Copyright © 2010 Elsevier Inc. All rights reserved.

Living in contained environments: Research implications from undersea habitats. [undersea habitats

NASA Technical Reports Server (NTRS)

Helmreich, Robert L.

1986-01-01

A cost-reward model is used to frame a discussion of differences in observed behavior of individuals and groups in confined environments. It has been observed that the high cost of functioning in a stressful environment is likely to produce poor performance when anticipated rewards are low but that participants can manage the stress and achieve high performance if they anticipate high rewards. The high-reward environment is exemplified by early undersea habitats such as Sealab and Tektite and by early space missions. Other aspects of behavior occur in all confined environments and point to an important area for future research. Of particular interest are intergroup conflicts arising between the confined group and its external control. Also, individual differences in personality seem always to have an impact in confined environments. Recent research has focused on: (1) predicting performance and adjustment based on instrumental and expressive aspects of the self; (2) the differential predictive power of achievement striving and irritation/irritability in Type A personalities; and (3) the nature and role of leadership in small, isolated groups.

Reinforcement active learning in the vibrissae system: optimal object localization.

PubMed

Gordon, Goren; Dorfman, Nimrod; Ahissar, Ehud

2013-01-01

Rats move their whiskers to acquire information about their environment. It has been observed that they palpate novel objects and objects they are required to localize in space. We analyze whisker-based object localization using two complementary paradigms, namely, active learning and intrinsic-reward reinforcement learning. Active learning algorithms select the next training samples according to the hypothesized solution in order to better discriminate between correct and incorrect labels. Intrinsic-reward reinforcement learning uses prediction errors as the reward to an actor-critic design, such that behavior converges to the one that optimizes the learning process. We show that in the context of object localization, the two paradigms result in palpation whisking as their respective optimal solution. These results suggest that rats may employ principles of active learning and/or intrinsic reward in tactile exploration and can guide future research to seek the underlying neuronal mechanisms that implement them. Furthermore, these paradigms are easily transferable to biomimetic whisker-based artificial sensors and can improve the active exploration of their environment. Copyright © 2012 Elsevier Ltd. All rights reserved.

The neural mechanisms of learning from competitors.

PubMed

Howard-Jones, Paul A; Bogacz, Rafal; Yoo, Jee H; Leonards, Ute; Demetriou, Skevi

2010-11-01

Learning from competitors poses a challenge for existing theories of reward-based learning, which assume that rewarded actions are more likely to be executed in the future. Such a learning mechanism would disadvantage a player in a competitive situation because, since the competitor's loss is the player's gain, reward might become associated with an action the player should themselves avoid. Using fMRI, we investigated the neural activity of humans competing with a computer in a foraging task. We observed neural activity that represented the variables required for learning from competitors: the actions of the competitor (in the player's motor and premotor cortex) and the reward prediction error arising from the competitor's feedback. In particular, regions positively correlated with the unexpected loss of the competitor (which was beneficial to the player) included the striatum and those regions previously implicated in response inhibition. Our results suggest that learning in such contexts may involve the competitor's unexpected losses activating regions of the player's brain that subserve response inhibition, as the player learns to avoid the actions that produced them. Copyright 2010 Elsevier Inc. All rights reserved.

The role of orgasm in the development and shaping of partner preferences.

PubMed

Coria-Avila, Genaro A; Herrera-Covarrubias, Deissy; Ismail, Nafissa; Pfaus, James G

2016-01-01

The effect of orgasm on the development and shaping of partner preferences may involve a catalysis of the neurochemical mechanisms of bonding. Therefore, understanding such process is relevant for neuroscience and psychology. A systematic review was carried out using the terms Orgasm, Sexual Reward, Partner Preference, Pair Bonding, Brain, Learning, Sex, Copulation. In humans, concentrations of arousing neurotransmitters and potential bonding neurotransmitters increase during orgasm in the cerebrospinal fluid and the bloodstream. Similarly, studies in animals indicate that those neurotransmitters (noradrenaline, oxytocin, prolactin) and others (e.g. dopamine, opioids, serotonin) modulate the appetitive and consummatory phases of sexual behavior and reward. This suggests a link between the experience of orgasm/sexual reward and the neurochemical mechanisms of pair bonding. Orgasm/reward functions as an unconditioned stimulus (UCS). Some areas in the nervous system function as UCS-detection centers, which become activated during orgasm. Partner-related cues function as conditioned stimuli (CS) and are processed in CS-detector centers. Throughout the article, we discuss how UCS- and CS-detection centers must interact to facilitate memory consolidation and produce recognition and motivation during future social encounters.

From conflict management to reward-based decision making: actors and critics in primate medial frontal cortex.

PubMed

Silvetti, Massimo; Alexander, William; Verguts, Tom; Brown, Joshua W

2014-10-01

The role of the medial prefrontal cortex (mPFC) and especially the anterior cingulate cortex has been the subject of intense debate for the last decade. A number of theories have been proposed to account for its function. Broadly speaking, some emphasize cognitive control, whereas others emphasize value processing; specific theories concern reward processing, conflict detection, error monitoring, and volatility detection, among others. Here we survey and evaluate them relative to experimental results from neurophysiological, anatomical, and cognitive studies. We argue for a new conceptualization of mPFC, arising from recent computational modeling work. Based on reinforcement learning theory, these new models propose that mPFC is an Actor-Critic system. This system is aimed to predict future events including rewards, to evaluate errors in those predictions, and finally, to implement optimal skeletal-motor and visceromotor commands to obtain reward. This framework provides a comprehensive account of mPFC function, accounting for and predicting empirical results across different levels of analysis, including monkey neurophysiology, human ERP, human neuroimaging, and human behavior. Copyright © 2013 Elsevier Ltd. All rights reserved.

Neural response to reward anticipation under risk is nonlinear in probabilities.

PubMed

Hsu, Ming; Krajbich, Ian; Zhao, Chen; Camerer, Colin F

2009-02-18

A widely observed phenomenon in decision making under risk is the apparent overweighting of unlikely events and the underweighting of nearly certain events. This violates standard assumptions in expected utility theory, which requires that expected utility be linear (objective) in probabilities. Models such as prospect theory have relaxed this assumption and introduced the notion of a "probability weighting function," which captures the key properties found in experimental data. This study reports functional magnetic resonance imaging (fMRI) data that neural response to expected reward is nonlinear in probabilities. Specifically, we found that activity in the striatum during valuation of monetary gambles are nonlinear in probabilities in the pattern predicted by prospect theory, suggesting that probability distortion is reflected at the level of the reward encoding process. The degree of nonlinearity reflected in individual subjects' decisions is also correlated with striatal activity across subjects. Our results shed light on the neural mechanisms of reward processing, and have implications for future neuroscientific studies of decision making involving extreme tails of the distribution, where probability weighting provides an explanation for commonly observed behavioral anomalies.

The Development and Course of Bipolar Spectrum Disorders: An Integrated Reward and Circadian Rhythm Dysregulation Model

PubMed Central

Alloy, Lauren B.; Nusslock, Robin; Boland, Elaine M.

2014-01-01

In this article, we present and review the evidence for two major biopsychosocial theories of the onset and course of bipolar spectrum disorders (BSDs) that integrate behavioral, environmental, and neurobiological mechanisms: the reward hypersensitivity and the social and circadian rhythm disruption models. We describe the clinical features, spectrum, age of onset, and course of BSDs. We then discuss research designs relevant to demonstrating whether a hypothesized mechanism represents a correlate, vulnerability, or predictor of the course of BSDs, as well as important methodological issues. We next present the reward hypersensitivity model of BSD, followed by the social/circadian rhythm disruption model of BSD. For each model, we review evidence regarding whether the proposed underlying mechanism is associated with BSDs, provides vulnerability to the onset of BSDs, and predicts the course of BSDs. We then present a new integrated reward/circadian rhythm (RCR) dysregulation model of BSD and discuss how the RCR model explains the symptoms, onset, and course of BSDs. We end with recommendations for future research directions. PMID:25581235

Future so bright? Delay discounting and consideration of future consequences predict academic performance among college drinkers.

PubMed

Acuff, Samuel F; Soltis, Kathryn E; Dennhardt, Ashley A; Borsari, Brian; Martens, Matthew P; Murphy, James G

2017-10-01

College student drinking is a major public health concern and can result in a range of negative consequences, from acute health risks to decreased academic performance and drop out. Harm reduction interventions have been developed to reduce problems associated with drinking but there is a need to identify specific risk/protective factors related to academic performance among college drinkers. Behavioral economics suggests that chronic alcohol misuse reflects a dysregulated behavioral process or reinforcer pathology-alcohol is overvalued and the value of prosocial rewards are sharply discounted due, in part, to their delay. This study examined delay discounting, consideration of future consequences (CFC) and protective behavioral strategies (PBS) as predictors of academic success (grade point average; GPA) and engagement (time devoted to academic activities) among 393 college drinkers (61% female). In multivariate models, PBS were associated with greater academic engagement, but were not with academic success. Lower discounting of delayed rewards and greater CFC were associated with both academic success and engagement among drinkers. Previous research suggests that future time orientation is malleable, and the current results provide support for efforts to enhance future time orientation as part of alcohol harm-reduction approaches. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Synaptic plasticity in drug reward circuitry.

PubMed

Winder, Danny G; Egli, Regula E; Schramm, Nicole L; Matthews, Robert T

2002-11-01

Drug addiction is a major public health issue worldwide. The persistence of drug craving coupled with the known recruitment of learning and memory centers in the brain has led investigators to hypothesize that the alterations in glutamatergic synaptic efficacy brought on by synaptic plasticity may play key roles in the addiction process. Here we review the present literature, examining the properties of synaptic plasticity within drug reward circuitry, and the effects that drugs of abuse have on these forms of plasticity. Interestingly, multiple forms of synaptic plasticity can be induced at glutamatergic synapses within the dorsal striatum, its ventral extension the nucleus accumbens, and the ventral tegmental area, and at least some of these forms of plasticity are regulated by behaviorally meaningful administration of cocaine and/or amphetamine. Thus, the present data suggest that regulation of synaptic plasticity in reward circuits is a tractable candidate mechanism underlying aspects of addiction.

Motivational deficit in childhood depression and hyperactivity.

PubMed

Layne, C; Berry, E

1983-07-01

A recent theory states that the immediate cause of adult depression is low motivation, where motivation is the multiplicative product of a person's expectation for a reward times his value for that reward. The present experiment supported the extension of this theory to childhood depression. The expectations, values, and motivations of three groups of children (Ns = 18; mean ages = 10) were measured: A depressed group and a hyperactive control group were selected from a population of clinically disturbed children, while normal controls were selected from regular classrooms. As predicted, the depressed children exhibited reduced motivation, primarily because their expectations were pessimistic. Unexpected findings were that the depressives' expectations were not abnormally irrational; and that hyperactives exhibited optimistic expectations, inflated values, and, hence, inflated motivation--especially for tangible rewards. Cognitive therapy techniques that focus upon expectations were recommended for the treatment of both depressed and hyperactive children.

Bayesian Cue Integration as a Developmental Outcome of Reward Mediated Learning

PubMed Central

Weisswange, Thomas H.; Rothkopf, Constantin A.; Rodemann, Tobias; Triesch, Jochen

2011-01-01

Average human behavior in cue combination tasks is well predicted by Bayesian inference models. As this capability is acquired over developmental timescales, the question arises, how it is learned. Here we investigated whether reward dependent learning, that is well established at the computational, behavioral, and neuronal levels, could contribute to this development. It is shown that a model free reinforcement learning algorithm can indeed learn to do cue integration, i.e. weight uncertain cues according to their respective reliabilities and even do so if reliabilities are changing. We also consider the case of causal inference where multimodal signals can originate from one or multiple separate objects and should not always be integrated. In this case, the learner is shown to develop a behavior that is closest to Bayesian model averaging. We conclude that reward mediated learning could be a driving force for the development of cue integration and causal inference. PMID:21750717

Nurse practitioners: leadership behaviors and organizational climate.

PubMed

Jones, L C; Guberski, T D; Soeken, K L

1990-01-01

The purpose of this article is to examine the relationships of individual nurse practitioners' perceptions of the leadership climate in their organizations and self-reported formal and informal leadership behaviors. The nine climate dimensions (Structure, Responsibility, Reward, Perceived Support of Risk Taking, Warmth, Support, Standard Setting, Conflict, and Identity) identified by Litwin and Stringer in 1968 were used to predict five leadership dimensions (Meeting Organizational Needs, Managing Resources, Leadership Competence, Task Accomplishment, and Communications). Demographic variables of age, educational level, and percent of time spent performing administrative functions were forced as a first step in each multiple regression analysis and used to explain a significant amount of variance in all but one analysis. All leadership dimensions were predicted by at least one organizational climate dimension: (1) Meeting Organizational Needs by Risk and Reward; (2) Managing Resources by Risk and Structure; (3) Leadership Competence by Risk and Standards; (4) Task Accomplishment by Structure, Risk, and Standards; and (5) Communication by Rewards.

Socioeconomic status and the reward value of smoking following tobacco abstinence: a laboratory study.

PubMed

Reitzel, Lorraine R; Leventhal, Adam M

2014-11-01

Socioeconomic status (SES) indicators are robustly associated with smoking behaviors. Yet, the psychological mechanisms underlying relations are unclear. This study merged the socioecological construct of SES with laboratory psychological science to investigate how income, education, and employment status predicted the reward value of smoking following tobacco abstinence among a diverse sample of adult daily smokers. We hypothesized that participants with lower SES (i.e., less education, lower income, and unemployed) would experience greater abstinence-induced enhancement of the reward value of smoking. Adult smokers (N = 240; 68.7% male; 51.7% Black, 33.8% White, 7.1% Latino, and 7.5% other) attended 2 laboratory sessions (1 nonabstinent and 1 following 16-hr tobacco abstinence) involving behavioral assessment of (a) latency to smoking when delaying smoking was monetarily rewarded and (b) purchasing individual cigarettes. Generalized estimating equations were used to test the interaction between each SES variable (education, income, and employment) and abstinence state to illustrate whether participants with certain SES characteristics were more sensitive to the abstinence-induced enhancement of the relative reward value of smoking. Participants who never attended college (vs. college attendees) exhibited greater abstinence-induced enhancement of the reward value of smoking, which was indicated by reduced willingness to delay smoking for money (ps = .03). Income and employment status did not moderate abstinence effects. Less-educated smokers were particularly motivated to smoke during acute abstinence. Observed educational disparities in smoking behaviors and smoking cessation might reflect a biased valuation of immediate drug-related (over less immediate alternative) rewards. Future research should explore potential mediators of this association. © The Author 2014. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Anticipatory reward processing in addicted populations: a focus on the monetary incentive delay task.

PubMed

Balodis, Iris M; Potenza, Marc N

2015-03-01

Advances in brain imaging techniques have allowed neurobiological research to temporally analyze signals coding for the anticipation of reward. In addicted populations, both hyporesponsiveness and hyperresponsiveness of brain regions (e.g., ventral striatum) implicated in drug effects and reward system processing have been reported during anticipation of generalized reward. We discuss the current state of knowledge of reward processing in addictive disorders from a widely used and validated task: the monetary incentive delay task. Only studies applying the monetary incentive delay task in addicted and at-risk adult populations are reviewed, with a focus on anticipatory processing and striatal regions activated during task performance as well as the relationship of these regions with individual difference (e.g., impulsivity) and treatment outcome variables. We further review drug influences in challenge studies as a means to examine acute influences on reward processing in abstinent, recreationally using, and addicted populations. Generalized reward processing in addicted and at-risk populations is often characterized by divergent anticipatory signaling in the ventral striatum. Although methodologic and task variations may underlie some discrepant findings, anticipatory signaling in the ventral striatum may also be influenced by smoking status, drug metabolites, and treatment status in addicted populations. Divergent results across abstinent, recreationally using, and addicted populations demonstrate complexities in interpreting findings. Future studies would benefit from focusing on characterizing how impulsivity and other addiction-related features relate to anticipatory striatal signaling over time. Additionally, identifying how anticipatory signals recover or adjust after protracted abstinence will be important in understanding recovery processes. Copyright © 2015 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

Socioeconomic Status and the Reward Value of Smoking Following Tobacco Abstinence: A Laboratory Study

PubMed Central

Leventhal, Adam M.

2014-01-01

Introduction: Socioeconomic status (SES) indicators are robustly associated with smoking behaviors. Yet, the psychological mechanisms underlying relations are unclear. This study merged the socioecological construct of SES with laboratory psychological science to investigate how income, education, and employment status predicted the reward value of smoking following tobacco abstinence among a diverse sample of adult daily smokers. We hypothesized that participants with lower SES (i.e., less education, lower income, and unemployed) would experience greater abstinence-induced enhancement of the reward value of smoking. Methods: Adult smokers (N = 240; 68.7% male; 51.7% Black, 33.8% White, 7.1% Latino, and 7.5% other) attended 2 laboratory sessions (1 nonabstinent and 1 following 16-hr tobacco abstinence) involving behavioral assessment of (a) latency to smoking when delaying smoking was monetarily rewarded and (b) purchasing individual cigarettes. Generalized estimating equations were used to test the interaction between each SES variable (education, income, and employment) and abstinence state to illustrate whether participants with certain SES characteristics were more sensitive to the abstinence-induced enhancement of the relative reward value of smoking. Results: Participants who never attended college (vs. college attendees) exhibited greater abstinence-induced enhancement of the reward value of smoking, which was indicated by reduced willingness to delay smoking for money (ps = .03). Income and employment status did not moderate abstinence effects. Conclusions: Less-educated smokers were particularly motivated to smoke during acute abstinence. Observed educational disparities in smoking behaviors and smoking cessation might reflect a biased valuation of immediate drug-related (over less immediate alternative) rewards. Future research should explore potential mediators of this association. PMID:24935756

Perturbations in reward-related decision-making induced by reduced prefrontal cortical GABA transmission: Relevance for psychiatric disorders.

PubMed

Piantadosi, Patrick T; Khayambashi, Shahin; Schluter, Magdalen G; Kutarna, Agnes; Floresco, Stan B

2016-02-01

The prefrontal cortex (PFC) is critical for higher-order cognitive functions, including decision-making. In psychiatric conditions such as schizophrenia, prefrontal dysfunction co-occurs with pronounced alterations in decision-making ability. These alterations include a diminished ability to utilize probabilistic reinforcement in guiding future choice, and a reduced willingness to expend effort to receive reward. Among the neurochemical abnormalities observed in the PFC of individuals with schizophrenia are alterations in the production and function of the inhibitory neurotransmitter gamma-aminobutyric acid (GABA). To probe how PFC GABA hypofunction may contribute to alterations in cost/benefit decision-making, we assessed the effects GABAA-receptor antagonist bicuculline (BIC; 50 ng in 0.5 μl saline/hemisphere) infusion in the medial PFC of rats during performance on a series of well-validated cost/benefit decision-making tasks. Intra-PFC BIC reduced risky choice and reward sensitivity during probabilistic discounting and decreased the preference for larger rewards associated with a greater effort cost, similar to the behavioral sequelae observed in schizophrenia. Additional experiments revealed that these treatments did not alter instrumental responding on a progressive ratio schedule, nor did they impair the ability to discriminate between reward and no reward. However, BIC induced a subtle but consistent impairment in preference for larger vs. smaller rewards of equal cost. BIC infusion also increased decision latencies and impaired the ability to "stay on task" as indexed by reduced rates of instrumental responding. Collectively, these results implicate prefrontal GABAergic dysfunction as a key contributing factor to abnormal decision-making observed in schizophrenia and other neuropsychiatric conditions with similar neurobiological and behavioral alterations. Copyright © 2015 Elsevier Ltd. All rights reserved.

Ventral–striatal responsiveness during reward anticipation in ADHD and its relation to trait impulsivity in the healthy population: A meta-analytic review of the fMRI literature

PubMed Central

Plichta, Michael M.; Scheres, Anouk

2013-01-01

A review of the existing functional magnetic resonance imaging (fMRI) studies on reward anticipation in patients with attention-deficit/hyperactivity disorder (ADHD) is provided. Meta-analysis showed a significant medium effect size (Cohen’s d = 0.48–0.58) in terms of ventral–striatal (VS)-hyporesponsiveness in ADHD. Studies on VS-responsiveness and trait impulsivity in the healthy population demonstrate the opposite relationship, i.e. impulsivity-scores positively correlated with VS activation during reward processing. Against the background that ADHD may represent an extreme on a continuum of normal variability, the question arises as to how these contrasting findings can be integrated. We discuss three theoretical approaches, each of which integrates the opposing findings: (1) an inverted-u-shape model; (2) a (genetic) moderator model; and (3) the “unrelated model”. We conclude that at the present stage the number of existing studies in the healthy population as well as in ADHD groups is too small for a final answer. Therefore, our presented integrative approaches should be understood as an attempt to frame future research directions by generating testable hypotheses and giving practical suggestions for future studies. PMID:23928090

An Initial Examination of Performance on Two Versions of the Iowa Gambling Task.

PubMed

Buelow, Melissa T; Barnhart, Wesley R

2018-06-01

To examine differences between two versions of the Iowa Gambling Task (IGT). A total of 282 undergraduate students completed one of two versions of the IGT: the original version from 1994 (n = 132), or the 2007 version available through Psychological Assessment Resources (PAR) (n = 150). PAR (2007 version) IGT participants decided more advantageously (i.e., selected more from the small immediate reward but long-term positive/gain decks than the large immediate reward but long-term negative/loss decks) than original IGT participants during Trials 21-60. This difference was likely due to fewer Deck B selections by the PAR IGT participants during the early (Trials 1-40) and later (Trials 41-100) trials. The PAR IGT may result in a greater ability to make future-oriented, advantageous decisions more quickly than on the original IGT. Implications for future assessment of decision-making impairments in clinical and research settings are discussed.

DISRUPTION OF CONDITIONED REWARD ASSOCIATION BY TYPICAL AND ATYPICAL ANTIPSYCHOTICS

PubMed Central

Danna, C.L.; Elmer, G.I.

2013-01-01

Antipsychotic drugs are broadly classified into typical and atypical compounds; they vary in their pharmacological profile however a common component is their antagonist effects at the D2 dopamine receptors (DRD2). Unfortunately, diminished DRD2 activation is generally thought to be associated with the severity of neuroleptic-induced anhedonia. The purpose of this study was to determine the effect of the atypical antipsychotic olanzapine and typical antipsychotic haloperidol in a paradigm that reflects the learned transfer of incentive motivational properties to previously neutral stimuli, namely autoshaping. In order to provide a dosing comparison to a therapeutically relevant endpoint, both drugs were tested against amphetamine-induced disruption of prepulse inhibition as well. In the autoshaping task, rats were exposed to repeated pairings of stimuli that were differentially predictive of reward delivery. Conditioned approach to the reward predictive cue (sign-tracking) and to the reward (goal-tracking) increased during repeated pairings in the vehicle treated rats. Haloperidol and olanzapine completely abolished this behavior at relatively low doses (100 μg/kg). This same dose was the threshold dose for each drug to antagonize the sensorimotor gating deficits produced by amphetamine. At lower doses (3–30 μg/kg) both drugs produced a dose-dependent decrease in conditioned approach to the reward predictive cue. There was no difference between drugs at this dose range which indicates that olanzapine disrupts autoshaping at a significantly lower proposed DRD2 receptor occupancy. Interestingly, neither drug disrupted conditioned approach to the reward at the same dose range that disrupted conditioned approach to the reward predictive cue. Thus, haloperidol and olanzapine, at doses well below what is considered therapeutically relevant, disrupts the attribution of incentive motivational value to previously neutral cues. Drug effects on this dimension of reward processing are an important consideration in the development of future pharmacological treatments for schizophrenia. PMID:20416333

Memory Transformation Enhances Reinforcement Learning in Dynamic Environments.

PubMed

Santoro, Adam; Frankland, Paul W; Richards, Blake A

2016-11-30

Over the course of systems consolidation, there is a switch from a reliance on detailed episodic memories to generalized schematic memories. This switch is sometimes referred to as "memory transformation." Here we demonstrate a previously unappreciated benefit of memory transformation, namely, its ability to enhance reinforcement learning in a dynamic environment. We developed a neural network that is trained to find rewards in a foraging task where reward locations are continuously changing. The network can use memories for specific locations (episodic memories) and statistical patterns of locations (schematic memories) to guide its search. We find that switching from an episodic to a schematic strategy over time leads to enhanced performance due to the tendency for the reward location to be highly correlated with itself in the short-term, but regress to a stable distribution in the long-term. We also show that the statistics of the environment determine the optimal utilization of both types of memory. Our work recasts the theoretical question of why memory transformation occurs, shifting the focus from the avoidance of memory interference toward the enhancement of reinforcement learning across multiple timescales. As time passes, memories transform from a highly detailed state to a more gist-like state, in a process called "memory transformation." Theories of memory transformation speak to its advantages in terms of reducing memory interference, increasing memory robustness, and building models of the environment. However, the role of memory transformation from the perspective of an agent that continuously acts and receives reward in its environment is not well explored. In this work, we demonstrate a view of memory transformation that defines it as a way of optimizing behavior across multiple timescales. Copyright © 2016 the authors 0270-6474/16/3612228-15$15.00/0.

Elevated outcome-anticipation and outcome-evaluation ERPs associated with a greater preference for larger-but-delayed rewards.

PubMed

Pornpattananangkul, Narun; Nadig, Ajay; Heidinger, Storm; Walden, Keegan; Nusslock, Robin

2017-06-01

Although waiting for a reward reduces or discounts its value, some people have a stronger tendency to wait for larger rewards and forgo smaller-but-immediate rewards. This ability to delay gratification is captured by individual differences in so-called intertemporal choices in which individuals are asked to choose between larger-but-delayed versus smaller-but-immediate rewards. The current study used event-related potentials (ERPs) to examine whether enhancement in two neurocognitive processes, outcome anticipation and outcome evaluation, modulate individual variability in intertemporal responses. After completing a behavioral intertemporal choice task, 34 participants performed an ERP gambling task. From this ERP task, we separately examined individual differences in outcome anticipation (stimulus-preceding negativity; SPN), early outcome valuation (feedback-related negativity; FRN), and late outcome evaluation (P3). We observed that both elevated outcome-anticipation (SPN) and late outcome-evaluation (P3) neural processes predicted a stronger preference toward larger-but-delayed rewards. No relationship was observed between intertemporal responses and early outcome evaluation (FRN), indicating that the relationship between outcome evaluation and intertemporal responses was specific to the late outcome-evaluation processing stream. Moreover, multiple regression analyses indicated that the SPN and P3 independently modulate individual differences in intertemporal responses, suggesting separate mechanisms underlie the relationship between these two neurocognitive processes and intertemporal responses. Accordingly, we identify two potential neurocognitive modulators of individual variability in intertemporal responses. We discuss the mechanisms underlying these modulators in terms of anticipation-related processing (SPN) and a saliency bias toward gain (compared to loss) outcomes (P3).

Do gamblers eat more salt? Testing a latent trait model of covariance in consumption

PubMed Central

Goodwin, Belinda C.; Browne, Matthew; Rockloff, Matthew; Donaldson, Phillip

2015-01-01

A diverse class of stimuli, including certain foods, substances, media, and economic behaviours, may be described as ‘reward-oriented’ in that they provide immediate reinforcement with little initial investment. Neurophysiological and personality concepts, including dopaminergic dysfunction, reward sensitivity and rash impulsivity, each predict the existence of a latent behavioural trait that leads to increased consumption of all stimuli in this class. Whilst bivariate relationships (co-morbidities) are often reported in the literature, to our knowledge, a multivariate investigation of this possible trait has not been done. We surveyed 1,194 participants (550 male) on their typical weekly consumption of 11 types of reward-oriented stimuli, including fast food, salt, caffeine, television, gambling products, and illicit drugs. Confirmatory factor analysis was used to compare models in a 3×3 structure, based on the definition of a single latent factor (none, fixed loadings, or estimated loadings), and assumed residual covariance structure (none, a-priori / literature based, or post-hoc / data-driven). The inclusion of a single latent behavioural ‘consumption’ factor significantly improved model fit in all cases. Also confirming theoretical predictions, estimated factor loadings on reward-oriented indicators were uniformly positive, regardless of assumptions regarding residual covariances. Additionally, the latent trait was found to be negatively correlated with the non-reward-oriented indicators of fruit and vegetable consumption. The findings support the notion of a single behavioural trait leading to increased consumption of reward-oriented stimuli across multiple modalities. We discuss implications regarding the concentration of negative lifestyle-related health behaviours. PMID:26551907

Fluctuations in Nucleus Accumbens Extracellular Glutamate and Glucose during Motivated Glucose-drinking Behavior: Dissecting the Neurochemistry of Reward

PubMed Central

Wakabayashi, Ken T.; Myal, Stephanie E.; Kiyatkin, Eugene A.

2015-01-01

While motivated behavior involves multiple neurochemical systems, few studies have focused on the role of glutamate, the brain’s excitatory neurotransmitter, and glucose, the energetic substrate of neural activity in reward-related neural processes. Here, we used high-speed amperometry with enzyme-based substrate-sensitive and control, enzyme-free biosensors to examine second-scale fluctuations in the extracellular levels of these substances in the nucleus accumbens shell during glucose-drinking behavior in trained rats. Glutamate rose rapidly after the presentation of a glucose-containing cup and before the initiation of drinking (reward seeking), decreased more slowly to levels below baseline during consumption (sensory reward), and returned to baseline when the ingested glucose reached the brain (metabolic reward). When water was substituted for glucose, glutamate rapidly increased with cup presentation and in contrast to glucose drinking, increased above baseline after rats tasted the water and refused to drink further. Therefore, extracellular glutamate show distinct changes associated with key events of motivated drinking behavior and opposite dynamics during sensory and metabolic components of reward. In contrast to glutamate, glucose increased at each stimulus and behavioral event, showing a sustained elevation during the entire behavior and a robust post-ingestion rise that correlated with the gradual return of glutamate levels to their baseline. By comparing active drinking with passive intra-gastric glucose delivery, we revealed that fluctuations in extracellular glucose are highly dynamic, reflecting a balance between rapid delivery due to neural activity, intense metabolism, and the influence of ingested glucose reaching the brain. PMID:25393775

Do gamblers eat more salt? Testing a latent trait model of covariance in consumption.

PubMed

Goodwin, Belinda C; Browne, Matthew; Rockloff, Matthew; Donaldson, Phillip

2015-09-01

A diverse class of stimuli, including certain foods, substances, media, and economic behaviours, may be described as 'reward-oriented' in that they provide immediate reinforcement with little initial investment. Neurophysiological and personality concepts, including dopaminergic dysfunction, reward sensitivity and rash impulsivity, each predict the existence of a latent behavioural trait that leads to increased consumption of all stimuli in this class. Whilst bivariate relationships (co-morbidities) are often reported in the literature, to our knowledge, a multivariate investigation of this possible trait has not been done. We surveyed 1,194 participants (550 male) on their typical weekly consumption of 11 types of reward-oriented stimuli, including fast food, salt, caffeine, television, gambling products, and illicit drugs. Confirmatory factor analysis was used to compare models in a 3×3 structure, based on the definition of a single latent factor (none, fixed loadings, or estimated loadings), and assumed residual covariance structure (none, a-priori / literature based, or post-hoc / data-driven). The inclusion of a single latent behavioural 'consumption' factor significantly improved model fit in all cases. Also confirming theoretical predictions, estimated factor loadings on reward-oriented indicators were uniformly positive, regardless of assumptions regarding residual covariances. Additionally, the latent trait was found to be negatively correlated with the non-reward-oriented indicators of fruit and vegetable consumption. The findings support the notion of a single behavioural trait leading to increased consumption of reward-oriented stimuli across multiple modalities. We discuss implications regarding the concentration of negative lifestyle-related health behaviours.

Altering spatial priority maps via reward-based learning.

PubMed

Chelazzi, Leonardo; Eštočinová, Jana; Calletti, Riccardo; Lo Gerfo, Emanuele; Sani, Ilaria; Della Libera, Chiara; Santandrea, Elisa

2014-06-18

Spatial priority maps are real-time representations of the behavioral salience of locations in the visual field, resulting from the combined influence of stimulus driven activity and top-down signals related to the current goals of the individual. They arbitrate which of a number of (potential) targets in the visual scene will win the competition for attentional resources. As a result, deployment of visual attention to a specific spatial location is determined by the current peak of activation (corresponding to the highest behavioral salience) across the map. Here we report a behavioral study performed on healthy human volunteers, where we demonstrate that spatial priority maps can be shaped via reward-based learning, reflecting long-lasting alterations (biases) in the behavioral salience of specific spatial locations. These biases exert an especially strong influence on performance under conditions where multiple potential targets compete for selection, conferring competitive advantage to targets presented in spatial locations associated with greater reward during learning relative to targets presented in locations associated with lesser reward. Such acquired biases of spatial attention are persistent, are nonstrategic in nature, and generalize across stimuli and task contexts. These results suggest that reward-based attentional learning can induce plastic changes in spatial priority maps, endowing these representations with the "intelligent" capacity to learn from experience. Copyright © 2014 the authors 0270-6474/14/348594-11$15.00/0.

Convergent evolution of floral signals underlies the success of Neotropical orchids

PubMed Central

Papadopulos, Alexander S. T.; Powell, Martyn P.; Pupulin, Franco; Warner, Jorge; Hawkins, Julie A.; Salamin, Nicolas; Chittka, Lars; Williams, Norris H.; Whitten, W. Mark; Loader, Deniz; Valente, Luis M.; Chase, Mark W.; Savolainen, Vincent

2013-01-01

The great majority of plant species in the tropics require animals to achieve pollination, but the exact role of floral signals in attraction of animal pollinators is often debated. Many plants provide a floral reward to attract a guild of pollinators, and it has been proposed that floral signals of non-rewarding species may converge on those of rewarding species to exploit the relationship of the latter with their pollinators. In the orchid family (Orchidaceae), pollination is almost universally animal-mediated, but a third of species provide no floral reward, which suggests that deceptive pollination mechanisms are prevalent. Here, we examine floral colour and shape convergence in Neotropical plant communities, focusing on certain food-deceptive Oncidiinae orchids (e.g. Trichocentrum ascendens and Oncidium nebulosum) and rewarding species of Malpighiaceae. We show that the species from these two distantly related families are often more similar in floral colour and shape than expected by chance and propose that a system of multifarious floral mimicry—a form of Batesian mimicry that involves multiple models and is more complex than a simple one model–one mimic system—operates in these orchids. The same mimetic pollination system has evolved at least 14 times within the species-rich Oncidiinae throughout the Neotropics. These results help explain the extraordinary diversification of Neotropical orchids and highlight the complexity of plant–animal interactions. PMID:23804617

Effort-reward imbalance and social support are associated with chronic fatigue among medical residents in Japan.

PubMed

Wada, Koji; Sakata, Yumi; Theriault, Gilles; Aratake, Yutaka; Shimizu, Midori; Tsutsumi, Akizumi; Tanaka, Katsutoshi; Aizawa, Yoshiharu

2008-01-01

The purpose of this study was to determine the associations of effort-reward imbalance and social support with chronic fatigue among medical residents in Japan. A total of 104 men and 42 women at 14 teaching hospitals participated in this study. Chronic fatigue was measured by the checklist individual strength questionnaire. Effort, reward and overcommitment were determined by the effort-reward questionnaire developed by Siegrist. Social support was determined by a visual analog scale. Sleeping hours for the last 30 days were estimated based on the number of overnight shifts worked, the average number of sleeping hours, and the number of hours of napping during overnight work. Multiple regression analysis was used to examine the multivariate relationship between these variables and chronic fatigue. In both men and women, effort-reward imbalance was positively associated, and higher social support was negatively associated with chronic fatigue. In men, higher overcommitment was positively associated with chronic fatigue. In women, longer sleeping hours was negatively associated with chronic fatigue and an interaction between sleeping hours and social support was found. The adjusted variance in fatigue explained by the exposure variables was 34% in men and 51% in women. The result of this study suggested that it is desirable to take these factors into consideration in the management of chronic fatigue among medical residents.

Convergent evolution of floral signals underlies the success of Neotropical orchids.

PubMed

Papadopulos, Alexander S T; Powell, Martyn P; Pupulin, Franco; Warner, Jorge; Hawkins, Julie A; Salamin, Nicolas; Chittka, Lars; Williams, Norris H; Whitten, W Mark; Loader, Deniz; Valente, Luis M; Chase, Mark W; Savolainen, Vincent

2013-08-22

The great majority of plant species in the tropics require animals to achieve pollination, but the exact role of floral signals in attraction of animal pollinators is often debated. Many plants provide a floral reward to attract a guild of pollinators, and it has been proposed that floral signals of non-rewarding species may converge on those of rewarding species to exploit the relationship of the latter with their pollinators. In the orchid family (Orchidaceae), pollination is almost universally animal-mediated, but a third of species provide no floral reward, which suggests that deceptive pollination mechanisms are prevalent. Here, we examine floral colour and shape convergence in Neotropical plant communities, focusing on certain food-deceptive Oncidiinae orchids (e.g. Trichocentrum ascendens and Oncidium nebulosum) and rewarding species of Malpighiaceae. We show that the species from these two distantly related families are often more similar in floral colour and shape than expected by chance and propose that a system of multifarious floral mimicry--a form of Batesian mimicry that involves multiple models and is more complex than a simple one model-one mimic system--operates in these orchids. The same mimetic pollination system has evolved at least 14 times within the species-rich Oncidiinae throughout the Neotropics. These results help explain the extraordinary diversification of Neotropical orchids and highlight the complexity of plant-animal interactions.

The Influence of Divine Rewards and Punishments on Religious Prosociality

PubMed Central

Saleam, James; Moustafa, Ahmed A.

2016-01-01

A common finding across many cultures has been that religious people behave more prosocially than less (or non-) religious people. Numerous priming studies have demonstrated that the activation of religious concepts via implicit and explicit cues (e.g., ‘God,’ ‘salvation,’ among many others) increases prosociality in religious people. However, the factors underlying such findings are less clear. In this review we discuss hypotheses (e.g., the supernatural punishment hypothesis) that explain the religion-prosociality link, and also how recent findings in the empirical literature converge to suggest that the divine rewards (e.g., heaven) and punishments (e.g., hell) promised by various religious traditions may play a significant role. In addition, we further discuss inconsistencies in the religion-prosociality literature, as well as existing and future psychological studies which could improve our understanding of whether, and how, concepts of divine rewards and punishments may influence prosociality. PMID:27536262

SARA: A Mobile App to Engage Users in Health Data Collection

PubMed Central

Rabbi, Mashfiqui; Philyaw-Kotov, Meredith; Lee, Jinseok; Mansour, Anthony; Dent, Laura; Wang, Xiaolei; Cunningham, Rebecca; Bonar, Erin; Nahum-Shani, Inbal; Klasnja, Predrag; Walton, Maureen; Murphy, Susan

2017-01-01

Despite the recent progress in sensor technologies, many relevant health data can be only captured with manual input (e.g., food intake, stress appraisal, subjective emotion, substance use). A common problem of manual logging is that users often disengage within a short time because of high burden. In this work, we propose SARA, a novel app to engage users with ongoing tracking using timely rewards thereby reinforcing users for data input. SARA is developed for adolescents and emerging adults at risk for substance abuse. The rewards in SARA are designed to be developmentally and culturally appropriate to the target demographic and are theoretically grounded in the behavioral science literature. In this paper, we describe SARA and its rewards to increase data collection. We also briefly discuss future plans to evaluate SARA and develop just in time adaptive interventions for engagement and behavior change. PMID:29503985

High on food: the interaction between the neural circuits for feeding and for reward.

PubMed

Liu, Jing-Jing; Mukherjee, Diptendu; Haritan, Doron; Ignatowska-Jankowska, Bogna; Liu, Ji; Citri, Ami; Pang, Zhiping P

2015-04-01

Hunger, mostly initiated by a deficiency in energy, induces food seeking and intake. However, the drive toward food is not only regulated by physiological needs, but is motivated by the pleasure derived from ingestion of food, in particular palatable foods. Therefore, feeding is viewed as an adaptive motivated behavior that involves integrated communication between homeostatic feeding circuits and reward circuits. The initiation and termination of a feeding episode are instructed by a variety of neuronal signals, and maladaptive plasticity in almost any component of the network may lead to the development of pathological eating disorders. In this review we will summarize the latest understanding of how the feeding circuits and reward circuits in the brain interact. We will emphasize communication between the hypothalamus and the mesolimbic dopamine system and highlight complexities, discrepancies, open questions and future directions for the field.

Adolescent Female Cannabinoid Exposure Diminishes the Reward-Facilitating Effects of Δ9-Tetrahydrocannabinol and d-Amphetamine in the Adult Male Offspring.

PubMed

Pitsilis, George; Spyridakos, Dimitrios; Nomikos, George G; Panagis, George

2017-01-01

Marijuana is currently the most commonly abused illicit drug. According to recent studies, cannabinoid use occurring prior to pregnancy can impact brain plasticity and behavior in future generations. The purpose of the present study was to determine whether adolescent exposure of female rats to Δ 9 -tetrahydrocannabinol (Δ 9 -THC) induces transgenerational effects on the reward-facilitating effects of Δ 9 -THC and d -amphetamine in their adult male offspring. Female Sprague-Dawley rats received Δ 9 -THC (0.1 or 1 mg/kg, i.p.) or vehicle during postnatal days 28-50. As adults, females were mated with drug-naïve males. We then assessed potential alterations of the Δ 9 -THC's (0, 0.1, 0.5, and 1 mg/kg, i.p.) and d -amphetamine's (0, 0.1, 0.5, and 1 mg/kg, i.p.) reward-modifying effects using the curve-shift variant of the intracranial self-stimulation (ICSS) procedure in their adult male F1 offspring. The reward-facilitating effect of the 0.1 mg dose of Δ 9 -THC was abolished in the F1 offspring of females that were exposed to Δ 9 -THC (0.1 or 1 mg/kg), whereas the reward-attenuating effect of the 1 mg dose of Δ 9 -THC remained unaltered. The reward-facilitating effects of 0.5 and 1 mg of d -amphetamine were significantly decreased in the F1 offspring of females that were exposed to Δ 9 -THC (1 mg/kg and 0.1 or 1 mg, respectively). The present results reveal that female Δ 9 -THC exposure during adolescence can diminish the reward-facilitating effects of Δ 9 -THC and d -amphetamine in the adult male offspring. These transgenerational effects occur in the absence of in utero exposure. It is speculated that Δ 9 -THC exposure during female adolescence may affect neural mechanisms that are shaping reward-related behavioral responses in a subsequent generation, as indicated by the shifts in the reward-facilitating effects of commonly used and abused drugs.

A Simple Network Architecture Accounts for Diverse Reward Time Responses in Primary Visual Cortex

PubMed Central

Hussain Shuler, Marshall G.; Shouval, Harel Z.

2015-01-01

Many actions performed by animals and humans depend on an ability to learn, estimate, and produce temporal intervals of behavioral relevance. Exemplifying such learning of cued expectancies is the observation of reward-timing activity in the primary visual cortex (V1) of rodents, wherein neural responses to visual cues come to predict the time of future reward as behaviorally experienced in the past. These reward-timing responses exhibit significant heterogeneity in at least three qualitatively distinct classes: sustained increase or sustained decrease in firing rate until the time of expected reward, and a class of cells that reach a peak in firing at the expected delay. We elaborate upon our existing model by including inhibitory and excitatory units while imposing simple connectivity rules to demonstrate what role these inhibitory elements and the simple architectures play in sculpting the response dynamics of the network. We find that simply adding inhibition is not sufficient for obtaining the different distinct response classes, and that a broad distribution of inhibitory projections is necessary for obtaining peak-type responses. Furthermore, although changes in connection strength that modulate the effects of inhibition onto excitatory units have a strong impact on the firing rate profile of these peaked responses, the network exhibits robustness in its overall ability to predict the expected time of reward. Finally, we demonstrate how the magnitude of expected reward can be encoded at the expected delay in the network and how peaked responses express this reward expectancy. SIGNIFICANCE STATEMENT Heterogeneity in single-neuron responses is a common feature of neuronal systems, although sometimes, in theoretical approaches, it is treated as a nuisance and seldom considered as conveying a different aspect of a signal. In this study, we focus on the heterogeneous responses in the primary visual cortex of rodents trained with a predictable delayed reward time. We describe under what conditions this heterogeneity can arise by self-organization, and what information it can convey. This study, while focusing on a specific system, provides insight onto how heterogeneity can arise in general while also shedding light onto mechanisms of reinforcement learning using realistic biological assumptions. PMID:26377457

Altered reward processing in adolescents with prenatal exposure to maternal cigarette smoking.

PubMed

Müller, Kathrin U; Mennigen, Eva; Ripke, Stephan; Banaschewski, Tobias; Barker, Gareth J; Büchel, Christian; Conrod, Patricia; Fauth-Bühler, Mira; Flor, Herta; Garavan, Hugh; Heinz, Andreas; Lawrence, Claire; Loth, Eva; Mann, Karl; Martinot, Jean-Luc; Pausova, Zdenka; Rietschel, Marcella; Ströhle, Andreas; Struve, Maren; Walaszek, Bernadeta; Schumann, Gunter; Paus, Tomáš; Smolka, Michael N

2013-08-01

Higher rates of substance use and dependence have been observed in the offspring of mothers who smoked during pregnancy. Animal studies indicate that prenatal exposure to nicotine alters the development of brain areas related to reward processing, which might be a risk factor for substance use and addiction later in life. However, no study has examined the effect of maternal smoking on the offspring's brain response during reward processing. To determine whether adolescents with prenatal exposure to maternal cigarette smoking differ from their nonexposed peers in the response of the ventral striatum to the anticipation or the receipt of a reward. An observational case-control study. Data were obtained from the IMAGEN Study, a European multicenter study of impulsivity, reinforcement sensitivity, and emotional reactivity in adolescents. The IMAGEN sample consists of 2078 healthy adolescents (age range, 13-15 years) recruited from March 1, 2008, through December 31, 2011, in local schools. We assessed an IMAGEN subsample of 177 adolescents with prenatal exposure to maternal cigarette smoking and 177 nonexposed peers (age range, 13-15 years) matched by sex, maternal educational level, and imaging site. Response to reward in the ventral striatum measured with functional magnetic resonance imaging. In prenatally exposed adolescents, we observed a weaker response in the ventral striatum during reward anticipation (left side, F = 14.98 [P < .001]; right side, F = 15.95 [P < .001]) compared with their nonexposed peers. No differences were found regarding the responsivity of the ventral striatum to the receipt of a reward (left side, F = 0.21 [P = .65]; right side, F = 0.47 [P = .49]). The weaker responsivity of the ventral striatum to reward anticipation in prenatally exposed adolescents may represent a risk factor for substance use and development of addiction later in life. This result highlights the need for education and preventive measures to reduce smoking during pregnancy. Future analyses should assess whether prenatally exposed adolescents develop an increased risk for substance use and addiction and which role the reported neuronal differences during reward anticipation plays in this development.

The amygdala and decision-making.

PubMed

Gupta, Rupa; Koscik, Timothy R; Bechara, Antoine; Tranel, Daniel

2011-03-01

Decision-making is a complex process that requires the orchestration of multiple neural systems. For example, decision-making is believed to involve areas of the brain involved in emotion (e.g., amygdala, ventromedial prefrontal cortex) and memory (e.g., hippocampus, dorsolateral prefrontal cortex). In this article, we will present findings related to the amygdala's role in decision-making, and differentiate the contributions of the amygdala from those of other structurally and functionally connected neural regions. Decades of research have shown that the amygdala is involved in associating a stimulus with its emotional value. This tradition has been extended in newer work, which has shown that the amygdala is especially important for decision-making, by triggering autonomic responses to emotional stimuli, including monetary reward and punishment. Patients with amygdala damage lack these autonomic responses to reward and punishment, and consequently, cannot utilize "somatic marker" type cues to guide future decision-making. Studies using laboratory decision-making tests have found deficient decision-making in patients with bilateral amygdala damage, which resembles their real-world difficulties with decision-making. Additionally, we have found evidence for an interaction between sex and laterality of amygdala functioning, such that unilateral damage to the right amygdala results in greater deficits in decision-making and social behavior in men, while left amygdala damage seems to be more detrimental for women. We have posited that the amygdala is part of an "impulsive," habit type system that triggers emotional responses to immediate outcomes. Copyright © 2010 Elsevier Ltd. All rights reserved.

Organizational justice, psychological distress, and work engagement in Japanese workers.

PubMed

Inoue, Akiomi; Kawakami, Norito; Ishizaki, Masao; Shimazu, Akihito; Tsuchiya, Masao; Tabata, Masaji; Akiyama, Miki; Kitazume, Akiko; Kuroda, Mitsuyo

2010-01-01

To investigate the cross-sectional association between organizational justice (i.e., procedural justice and interactional justice) and psychological distress or work engagement, as well as the mediating roles of other job stressors (i.e., job demands and job control, or their combination, effort-reward imbalance [ERI], and worksite support). A total of 243 workers (185 males and 58 females) from a manufacturing factory in Japan were surveyed using a self-administered questionnaire including the Organizational Justice Questionnaire, Job Content Questionnaire, Effort-Reward Imbalance Questionnaire, K6 scale, Utrecht Work Engagement Scale, and other covariates. Multiple mediation analyses with the bootstrap technique were conducted. In the bivariate analysis, procedural justice and interactional justice were significantly and negatively associated with psychological distress; they were significantly and positively associated with work engagement. In the mediation analysis, reward at work (or ERI) significantly mediated between procedural justice or interactional justice and psychological distress; worksite support significantly mediated between procedural justice or interactional justice and work engagement. The effects of organizational justice on psychological distress seem to be mediated by reward at work (or ERI) while those regarding work engagement may be mediated by worksite support to a large extent, at least in Japanese workers.

Observed Parenting Behavior with Teens: Measurement Invariance and Predictive Validity Across Race

PubMed Central

Skinner, Martie L.; MacKenzie, Elizabeth P.; Haggerty, Kevin P.; Hill, Karl G.; Roberson, Kendra C.

2011-01-01

Previous reports supporting measurement equality between European American and African American families have often focused on self-reported risk factors or observed parent behavior with young children. This study examines equality of measurement of observer ratings of parenting behavior with adolescents during structured tasks; mean levels of observed parenting; and predictive validity of teen self-reports of antisocial behaviors and beliefs using a sample of 163 African American and 168 European American families. Multiple-group confirmatory factor analyses supported measurement invariance across ethnic groups for 4 measures of observed parenting behavior: prosocial rewards, psychological costs, antisocial rewards, and problem solving. Some mean-level differences were found: African American parents exhibited lower levels of prosocial rewards, higher levels of psychological costs, and lower problem solving when compared to European Americans. No significant mean difference was found in rewards for antisocial behavior. Multigroup structural equation models suggested comparable relationships across race (predictive validity) between parenting constructs and youth antisocial constructs (i.e., drug initiation, positive drug attitudes, antisocial attitudes, problem behaviors) in all but one of the tested relationships. This study adds to existing evidence that family-based interventions targeting parenting behaviors can be generalized to African American families. PMID:21787057

No Trade-Off between Learning Speed and Associative Flexibility in Bumblebees: A Reversal Learning Test with Multiple Colonies

PubMed Central

Raine, Nigel E.; Chittka, Lars

2012-01-01

Potential trade-offs between learning speed and memory-related performance could be important factors in the evolution of learning. Here, we test whether rapid learning interferes with the acquisition of new information using a reversal learning paradigm. Bumblebees (Bombus terrestris) were trained to associate yellow with a floral reward. Subsequently the association between colour and reward was reversed, meaning bees then had to learn to visit blue flowers. We demonstrate that individuals that were fast to learn yellow as a predictor of reward were also quick to reverse this association. Furthermore, overnight memory retention tests suggest that faster learning individuals are also better at retaining previously learned information. There is also an effect of relatedness: colonies whose workers were fast to learn the association between yellow and reward also reversed this association rapidly. These results are inconsistent with a trade-off between learning speed and the reversal of a previously made association. On the contrary, they suggest that differences in learning performance and cognitive (behavioural) flexibility could reflect more general differences in colony learning ability. Hence, this study provides additional evidence to support the idea that rapid learning and behavioural flexibility have adaptive value. PMID:23028779

A management guide for northern hardwoods in New England

Treesearch

Adrian M. Gilbert; Victor S. Jensen

1958-01-01

Northern hardwood forests occupy about 9 million acres of land in New England. In recent years, these hardwood forests have made increasing contributions to the economy of this region. Their future management should be even more rewarding.

Optogenetic activation of dorsal raphe serotonin neurons enhances patience for future rewards.

PubMed

Miyazaki, Kayoko W; Miyazaki, Katsuhiko; Tanaka, Kenji F; Yamanaka, Akihiro; Takahashi, Aki; Tabuchi, Sawako; Doya, Kenji

2014-09-08

Serotonin is a neuromodulator that is involved extensively in behavioral, affective, and cognitive functions in the brain. Previous recording studies of the midbrain dorsal raphe nucleus (DRN) revealed that the activation of putative serotonin neurons correlates with the levels of behavioral arousal [1], rhythmic motor outputs [2], salient sensory stimuli [3-6], reward, and conditioned cues [5-8]. The classic theory on serotonin states that it opposes dopamine and inhibits behaviors when aversive events are predicted [9-14]. However, the therapeutic effects of serotonin signal-enhancing medications have been difficult to reconcile with this theory [15, 16]. In contrast, a more recent theory states that serotonin facilitates long-term optimal behaviors and suppresses impulsive behaviors [17-21]. To test these theories, we developed optogenetic mice that selectively express channelrhodopsin in serotonin neurons and tested how the activation of serotonergic neurons in the DRN affects animal behavior during a delayed reward task. The activation of serotonin neurons reduced the premature cessation of waiting for conditioned cues and food rewards. In reward omission trials, serotonin neuron stimulation prolonged the time animals spent waiting. This effect was observed specifically when the animal was engaged in deciding whether to keep waiting and was not due to motor inhibition. Control experiments showed that the prolonged waiting times observed with optogenetic stimulation were not due to behavioral inhibition or the reinforcing effects of serotonergic activation. These results show, for the first time, that the timed activation of serotonin neurons during waiting promotes animals' patience to wait for a delayed reward. Copyright © 2014 Elsevier Ltd. All rights reserved.

Bridging the Gap Between Extrinsic and Intrinsic Motivation in the Cognitive Remediation of Schizophrenia

PubMed Central

Silverstein, Steven M.

2010-01-01

An important development in cognitive remediation of schizophrenia is a focus on motivation. However, following a distinction between the concepts of intrinsic motivation (IM) and extrinsic motivation, discussions of IM-based methods have downplayed or misrepresented the role that extrinsic rewards can, and actually do, serve to promote positive treatment outcomes in cognitive remediation. Therefore, the purpose of this article is to explore the rationale for using techniques incorporating extrinsic rewards into cognitive treatment of people with schizophrenia. To do this, evidence is presented on each of the following points: (1) there is a long history of research demonstrating that delivery of extrinsic reward is associated with positive outcomes in both behavioral and cognitive rehabilitation; (2) basic human brain systems respond strongly to tangible rewards, and this can directly enhance attention, working memory, and other cognitive functions; (3) nearly all data on the negative effects of extrinsic reward on IM have come from studies of healthy children and adults in school or work settings who have adequate IM for target tasks; these findings do not generalize well to cognitive remediation settings for people with schizophrenia, who often have abnormally low levels of IM and low base rates of attentive behaviors; and (4) in real-world situations, cognitive remediation interventions already utilize a combination of intrinsic and extrinsic reinforcers. Future studies are needed to clarify state and trait factors responsible for individual differences in the extent to which extrinsic rewards are necessary to set the conditions under which IM can develop. PMID:20064900

Insula and striatum activity in effort-related monetary reward processing in gambling disorder: The role of depressive symptomatology

PubMed Central

Fauth-Bühler, Mira; Zois, Evangelos; Vollstädt-Klein, Sabine; Lemenager, Tagrid; Beutel, Martin; Mann, Karl

2014-01-01

The neurobiological underpinnings of effort-related monetary reward processing of gambling disorder have not been previously studied. To date neuroimaging studies lack in large sample sizes and as a consequence less attention has been given to brain reward processing that could potentially be attributed to comorbid conditions such as depressive mood state. We assessed monetary reward processing using an effort-dependent task during 3 tesla functional magnetic resonance imaging. We investigated a large sample of male, right-handed, slot-machine-playing disordered gamblers (DGs; N = 80) as well as age- and smoking-matched male healthy controls (HCs; N = 89). Depressive symptoms were assessed using the Beck Depression Inventory (BDI). DGs and HCs were divided into subgroups (“high” and “low”) based on their BDI scores. Effort-related monetary reward processing did not differ between the complete groups of HCs and DGs. Brain activation during receipt of monetary reward though revealed a significant Group × BDI interaction: DGs with higher BDI scores compared to DGs with lower BDI scores showed greater brain activity in the right insula cortex and dorsal striatum while no differences were observed for HCs with higher versus lower BDI scores. Our results suggest that effort-related aspects of monetary motivation, i.e. when monetary output is tied to performance, are not altered in DG. Additionally, our findings strengthen the need for subgroup comparisons in future investigations of the disorder as part of a personalized medicine approach. PMID:25379437

Bridging the gap between extrinsic and intrinsic motivation in the cognitive remediation of schizophrenia.

PubMed

Silverstein, Steven M

2010-09-01

An important development in cognitive remediation of schizophrenia is a focus on motivation. However, following a distinction between the concepts of intrinsic motivation (IM) and extrinsic motivation, discussions of IM-based methods have downplayed or misrepresented the role that extrinsic rewards can, and actually do, serve to promote positive treatment outcomes in cognitive remediation. Therefore, the purpose of this article is to explore the rationale for using techniques incorporating extrinsic rewards into cognitive treatment of people with schizophrenia. To do this, evidence is presented on each of the following points: (1) there is a long history of research demonstrating that delivery of extrinsic reward is associated with positive outcomes in both behavioral and cognitive rehabilitation; (2) basic human brain systems respond strongly to tangible rewards, and this can directly enhance attention, working memory, and other cognitive functions; (3) nearly all data on the negative effects of extrinsic reward on IM have come from studies of healthy children and adults in school or work settings who have adequate IM for target tasks; these findings do not generalize well to cognitive remediation settings for people with schizophrenia, who often have abnormally low levels of IM and low base rates of attentive behaviors; and (4) in real-world situations, cognitive remediation interventions already utilize a combination of intrinsic and extrinsic reinforcers. Future studies are needed to clarify state and trait factors responsible for individual differences in the extent to which extrinsic rewards are necessary to set the conditions under which IM can develop.

'Proactive' use of cue-context congruence for building reinforcement learning's reward function.

PubMed

Zsuga, Judit; Biro, Klara; Tajti, Gabor; Szilasi, Magdolna Emma; Papp, Csaba; Juhasz, Bela; Gesztelyi, Rudolf

2016-10-28

Reinforcement learning is a fundamental form of learning that may be formalized using the Bellman equation. Accordingly an agent determines the state value as the sum of immediate reward and of the discounted value of future states. Thus the value of state is determined by agent related attributes (action set, policy, discount factor) and the agent's knowledge of the environment embodied by the reward function and hidden environmental factors given by the transition probability. The central objective of reinforcement learning is to solve these two functions outside the agent's control either using, or not using a model. In the present paper, using the proactive model of reinforcement learning we offer insight on how the brain creates simplified representations of the environment, and how these representations are organized to support the identification of relevant stimuli and action. Furthermore, we identify neurobiological correlates of our model by suggesting that the reward and policy functions, attributes of the Bellman equitation, are built by the orbitofrontal cortex (OFC) and the anterior cingulate cortex (ACC), respectively. Based on this we propose that the OFC assesses cue-context congruence to activate the most context frame. Furthermore given the bidirectional neuroanatomical link between the OFC and model-free structures, we suggest that model-based input is incorporated into the reward prediction error (RPE) signal, and conversely RPE signal may be used to update the reward-related information of context frames and the policy underlying action selection in the OFC and ACC, respectively. Furthermore clinical implications for cognitive behavioral interventions are discussed.

Iowa Gambling Task (IGT): twenty years after – gambling disorder and IGT

PubMed Central

Brevers, Damien; Bechara, Antoine; Cleeremans, Axel; Noël, Xavier

2013-01-01

The Iowa Gambling Task (IGT) involves probabilistic learning via monetary rewards and punishments, where advantageous task performance requires subjects to forego potential large immediate rewards for small longer-term rewards to avoid larger losses. Pathological gamblers (PG) perform worse on the IGT compared to controls, relating to their persistent preference toward high, immediate, and uncertain rewards despite experiencing larger losses. In this contribution, we review studies that investigated processes associated with poor IGT performance in PG. Findings from these studies seem to fit with recent neurocognitive models of addiction, which argue that the diminished ability of addicted individuals to ponder short-term against long-term consequences of a choice may be the product of an hyperactive automatic attentional and memory system for signaling the presence of addiction-related cues (e.g., high uncertain rewards associated with disadvantageous decks selection during the IGT) and for attributing to such cues pleasure and excitement. This incentive-salience associated with gambling-related choice in PG may be so high that it could literally “hijack” resources [“hot” executive functions (EFs)] involved in emotional self-regulation and necessary to allow the enactment of further elaborate decontextualized problem-solving abilities (“cool” EFs). A framework for future research is also proposed, which highlights the need for studies examining how these processes contribute specifically to the aberrant choice profile displayed by PG on the IGT. PMID:24137138

An fMRI Study of Nicotine-Deprived Smokers' Reactivity to Smoking Cues during Novel/Exciting Activity

PubMed Central

Xu, Xiaomeng; Aron, Arthur; Westmaas, J. Lee; Wang, Jin; Sweet, Lawrence H.

2014-01-01

Engaging in novel/exciting (“self-expanding”) activities activates the mesolimbic dopamine pathway, a brain reward pathway also associated with the rewarding effects of nicotine. This suggests that self-expanding activities can potentially substitute for the reward from nicotine. We tested this model among nicotine-deprived smokers who, during fMRI scanning, played a series of two-player cooperative games with a relationship partner. Games were randomized in a 2 (self-expanding vs. not) x 2 (cigarette cue present vs. absent) design. Self-expansion conditions yielded significantly greater activation in a reward region (caudate) than did non-self-expansion conditions. Moreover, when exposed to smoking cues during the self-expanding versus the non-self-expanding cooperative games, smokers showed less activation in a cigarette cue-reactivity region, a priori defined [temporo-parietal junction (TPJ)] from a recent meta-analysis of cue-reactivity. In smoking cue conditions, increases in excitement associated with the self-expanding condition (versus the non-self-expanding condition) were also negatively correlated with TPJ activation. These results support the idea that a self-expanding activity promoting reward activation attenuates cigarette cue-reactivity among nicotine-deprived smokers. Future research could focus on the parameters of self-expanding activities that produce this effect, as well as test the utility of self-expansion in clinical interventions for smoking cessation. PMID:24727905

Comorbidity of Alcohol Use Disorder and Chronic Pain: Genetic Influences on Brain Reward and Stress Systems.

PubMed

Yeung, Ellen W; Craggs, Jason G; Gizer, Ian R

2017-11-01

Alcohol use disorder (AUD) is highly comorbid with chronic pain (CP). Evidence has suggested that neuroadaptive processes characterized by reward deficit and stress surfeit are involved in the development of AUD and pain chronification. Neurological data suggest that shared genetic architecture associated with the reward and stress systems may contribute to the comorbidity of AUD and CP. This monograph first delineates the prevailing theories of the development of AUD and pain chronification focusing on the reward and stress systems. It then provides a brief summary of relevant neurological findings followed by an evaluation of evidence documented by molecular genetic studies. Candidate gene association studies have provided some initial support for the genetic overlap between AUD and CP; however, these results must be interpreted with caution until studies with sufficient statistical power are conducted and replications obtained. Genomewide association studies have suggested a number of genes (e.g., TBX19, HTR7, and ADRA1A) that are either directly or indirectly related to the reward and stress systems in the AUD and CP literature. Evidence reviewed in this monograph suggests that shared genetic liability underlying the comorbidity between AUD and CP, if present, is likely to be complex. As the advancement in molecular genetic methods continues, future studies may show broader central nervous system involvement in AUD-CP comorbidity. Copyright © 2017 by the Research Society on Alcoholism.

Time and decision making: differential contribution of the posterior insular cortex and the striatum during a delay discounting task.

PubMed

Wittmann, Marc; Leland, David S; Paulus, Martin P

2007-06-01

Delay discounting refers to the fact that an immediate reward is valued more than the same reward if it occurs some time in the future. To examine the neural substrates underlying this process, we studied 13 healthy volunteers who repeatedly had to decide between an immediate and parametrically varied delayed hypothetical reward using a delay discounting task during event-related functional magnetic resonance imaging. Subject's preference judgments resulted in different discounting slopes for shorter (<1 year) and for longer (> or =1 year) delays. Neural activation associated with the shorter delays relative to the longer delays was associated with increased activation in the head of the left caudate nucleus and putamen. When individuals selected the delayed relative to the immediate reward, a strong activation was found in bilateral posterior insular cortex. Several brain areas including the left caudate nucleus showed a correlation between the behaviorally determined discounting and brain activation for the contrast of intervals with delays <1 and > or =1 year. These results suggest that (1) the posterior insula, which is a critical component of the decision-making neural network, is involved in delaying gratification and (2) the degree of neural activation in the striatum, which plays a fundamental role in reward prediction and in time estimation, may code for the time delay.

Pilot test of a novel food response and attention training treatment for obesity: Brain imaging data suggest actions shape valuation.

PubMed

Stice, Eric; Yokum, Sonja; Veling, Harm; Kemps, Eva; Lawrence, Natalia S

2017-07-01

Elevated brain reward and attention region response, and weaker inhibitory region response to high-calorie food images have been found to predict future weight gain. These findings suggest that an intervention that reduces reward and attention region response and increases inhibitory control region response to such foods might reduce overeating. We conducted a randomized pilot experiment that tested the hypothesis that a multi-faceted food response and attention training with personalized high- and low-calorie food images would produce changes in behavioral and neural responses to food images and body fat compared to a control training with non-food images among community-recruited overweight/obese adults. Compared to changes observed in controls, completing the intervention was associated with significant reductions in reward and attention region response to high-calorie food images (Mean Cohen's d = 1.54), behavioral evidence of learning, reductions in palatability ratings and monetary valuation of high-calorie foods (p = 0.009, d's = 0.92), and greater body fat loss over a 4-week period (p = 0.009, d = 0.90), though body fat effects were not significant by 6-month follow-up. Results suggest that this multifaceted response and attention training intervention was associated with reduced reward and attention region responsivity to food cues, and a reduction in body fat. Because this implicit training treatment is both easy and inexpensive to deliver, and does not require top-down executive control that is necessary for negative energy balance obesity treatment, it may prove useful in treating obesity if future studies can determine how to create more enduring effects. Copyright © 2017 Elsevier Ltd. All rights reserved.

Test of a mediated performance-turnover relationship highlighting the moderating roles of visibility and reward contingency.

PubMed

Allen, D G; Griffeth, R W

2001-10-01

Despite the importance of understanding the conditions under which high performing employees are more likely or less likely to voluntarily leave an organization, the nature of the relationship between job performance and voluntary turnover has proven to be elusive. A model of the performance-turnover relationship that highlights important moderators and mediators is proposed and tested. Data consisted of organizational performance and turnover records and survey responses for 130 employees of a medical services organization. Results indicate that visibility and reward contingencies moderate performance relationships with alternatives and job satisfaction, respectively, and that performance may influence turnover through multiple mechanisms.

Breaking Away

ERIC Educational Resources Information Center

Panettieri, Joseph C.

2007-01-01

This article discusses open source projects which may free universities from expensive, rigid commercial software. But will the rewards outweigh the potential risks? The Kuali Project involves multiple universities writing and sharing code for their financial and operational systems. Another, the Sakai Project, is a community source platform for…

Supporting ELLs before, during, and after Reading

ERIC Educational Resources Information Center

DelliCarpini, Margo

2011-01-01

Working with English language learners in mainstream ELA classrooms can provide rich rewards in terms of developing multiple perspectives, sharing diverse experiences, and developing understanding of different cultural practices. However, these students can also challenge mainstream teachers. Supporting ELLs throughout the reading process can…

Impairment of decision-making in multiple sclerosis: A neuroeconomic approach.

PubMed

Sepúlveda, Maria; Fernández-Diez, Begoña; Martínez-Lapiscina, Elena H; Llufriu, Sara; Sola-Valls, Nuria; Zubizarreta, Irati; Blanco, Yolanda; Saiz, Albert; Levy, Dino; Glimcher, Paul; Villoslada, Pablo

2017-11-01

To assess the decision-making impairment in patients with multiple sclerosis (MS) and how they relate to other cognitive domains. We performed a cross-sectional analysis in 84 patients with MS, and 21 matched healthy controls using four tasks taken from behavioral economics: (1) risk preferences, (2) choice consistency, (3) delay of gratification, and (4) rate of learning. All tasks were conducted using real-world reward outcomes (food or money) in different real-life conditions. Participants underwent cognitive examination using the Brief Repeatable Battery-Neuropsychology. Patients showed higher risk aversion (general propensity to choose the lottery was 0.51 vs 0.64, p = 0.009), a trend to choose more immediate rewards over larger but delayed rewards ( p = 0.108), and had longer reactions times ( p = 0.033). Choice consistency and learning rates were not different between groups. Progressive patients chose slower than relapsing patients. In relation to general cognitive impairments, we found correlations between impaired decision-making and impaired verbal memory ( r = 0.29, p = 0.009), visual memory ( r = -0.37, p = 0.001), and reduced processing speed ( r = -0.32, p = 0.001). Normalized gray matter volume correlated with deliberation time ( r = -0.32, p = 0.005). Patients with MS suffer significant decision-making impairments, even at the early stages of the disease, and may affect patients' quality and social life.

Modulation of the mesolimbic dopamine system by leptin.

PubMed

Opland, Darren M; Leinninger, Gina M; Myers, Martin G

2010-09-02

Nutritional status modulates many forms of reward-seeking behavior, with caloric restriction increasing the drive for drugs of abuse as well as for food. Understanding the interactions between the mesolimbic dopamine (DA) system (which mediates the incentive salience of natural and artificial rewards) and the neural and hormonal systems that sense and regulate energy balance is thus of significant importance. Leptin, which is produced by adipocytes in proportion to fat content as a hormonal signal of long-term energy stores, acts via its receptor (LepRb) on multiple populations of central nervous system neurons to modulate neural circuits in response to body energy stores. Leptin suppresses feeding and plays a central role in the control of energy balance. In addition to demonstrating that leptin modulates hypothalamic and brainstem circuits to promote satiety, recent work has begun to explore the mechanisms by which leptin influences the mesolimbic DA system and related behaviors. Indeed, leptin diminishes several measures of drug and food reward, and promotes a complex set of changes in the mesolimbic DA system. While many of the details remain to be worked out, several lines of evidence suggest that leptin regulates the mesolimbic DA system via multiple neural pathways and processes, and that distinct sets of LepRb neurons each modulate unique aspects of the mesolimbic DA system and behavior in response to leptin. 2010 Elsevier B.V. All rights reserved.

Capturing a Commander's decision making style

NASA Astrophysics Data System (ADS)

Santos, Eugene; Nguyen, Hien; Russell, Jacob; Kim, Keumjoo; Veenhuis, Luke; Boparai, Ramnjit; Stautland, Thomas Kristoffer

2017-05-01

A Commander's decision making style represents how he weighs his choices and evaluates possible solutions with regards to his goals. Specifically, in the naval warfare domain, it relates the way he processes a large amount of information in dynamic, uncertain environments, allocates resources, and chooses appropriate actions to pursue. In this paper, we describe an approach to capture a Commander's decision style by creating a cognitive model that captures his decisionmaking process and evaluate this model using a set of scenarios using an online naval warfare simulation game. In this model, we use the Commander's past behaviors and generalize Commander's actions across multiple problems and multiple decision making sequences in order to recommend actions to a Commander in a manner that he may have taken. Our approach builds upon the Double Transition Model to represent the Commander's focus and beliefs to estimate his cognitive state. Each cognitive state reflects a stage in a Commander's decision making process, each action reflects the tasks that he has taken to move himself closer to a final decision, and the reward reflects how close he is to achieving his goal. We then use inverse reinforcement learning to compute a reward for each of the Commander's actions. These rewards and cognitive states are used to compare between different styles of decision making. We construct a set of scenarios in the game where rational, intuitive and spontaneous decision making styles will be evaluated.

Reward Devaluation: Dot-Probe Meta-Analytic Evidence of Avoidance of Positive Information in Depressed Persons

PubMed Central

Winer, E. Samuel; Salem, Taban

2015-01-01

Cognitive theories of depression and anxiety have traditionally emphasized the role of attentional biases in the processing of negative information. The dot-probe task has been widely used to study this phenomenon. Recent findings suggest that biased processing of positive information might also be an important aspect of developing psychopathological symptoms. However, despite some evidence suggesting persons with symptoms of depression and anxiety may avoid positive information, many dot-probe studies have produced null findings. The present review used conventional and novel meta-analytic methods to evaluate dot-probe attentional biases away from positive information and, for comparison, toward negative information, in depressed and anxious individuals. Results indicated that avoidance of positive information is a real effect exhibiting substantial evidential value among persons experiencing psychopathology, with individuals evidencing primary symptoms of depression clearly demonstrating this effect. Different theoretical explanations for these findings are evaluated, including those positing threat-processing structures, even-handedness, self-regulation, and reward devaluation, with the novel theory of reward devaluation emphasized and expanded. These novel findings and theory suggest that avoidance of prospective reward helps to explain the cause and sustainability of depressed states. Suggestions for future research and methodological advances are discussed. PMID:26619211

Scalar utility theory and proportional processing: what does it actually imply?

PubMed Central

Rosenström, Tom; Wiesner, Karoline; Houston, Alasdair I

2017-01-01

Scalar Utility Theory (SUT) is a model used to predict animal and human choice behaviour in the context of reward amount, delay to reward, and variability in these quantities (risk preferences). This article reviews and extends SUT, deriving novel predictions. We show that, contrary to what has been implied in the literature, (1) SUT can predict both risk averse and risk prone behaviour for both reward amounts and delays to reward depending on experimental parameters, (2) SUT implies violations of several concepts of rational behaviour (e.g. it violates strong stochastic transitivity and its equivalents, and leads to probability matching) and (3) SUT can predict, but does not always predict, a linear relationship between risk sensitivity in choices and coefficient of variation in the decision-making experiment. SUT derives from Scalar Expectancy Theory which models uncertainty in behavioural timing using a normal distribution. We show that the above conclusions also hold for other distributions, such as the inverse Gaussian distribution derived from drift-diffusion models. A straightforward way to test the key assumptions of SUT is suggested and possible extensions, future prospects and mechanistic underpinnings are discussed. PMID:27288541

Ventral striatum dysfunction in children and adolescents with reactive attachment disorder: functional MRI study

PubMed Central

Takiguchi, Shinichiro; Fujisawa, Takashi X.; Mizushima, Sakae; Saito, Daisuke N.; Okamoto, Yuko; Shimada, Koji; Koizumi, Michiko; Kumazaki, Hirokazu; Jung, Minyoung; Kosaka, Hirotaka; Hiratani, Michio; Ohshima, Yusei; Teicher, Martin H.

2015-01-01

Background Child maltreatment is a major risk factor for psychopathology, including reactive attachment disorder (RAD). Aims To examine whether neural activity during reward processing was altered in children and adolescents with RAD. Method Sixteen children and adolescents with RAD and 20 typically developing (TD) individuals performed tasks with high and low monetary rewards while undergoing functional magnetic resonance imaging. Results Significantly reduced activity in the caudate and nucleus accumbens was observed during the high monetary reward condition in the RAD group compared with the TD group (P=0.015, family-wise error-corrected cluster level). Significant negative correlations between bilateral striatal activity and avoidant attachment were observed in the RAD and TD groups. Conclusions Striatal neural reward activity in the RAD group was markedly decreased. The present results suggest that dopaminergic dysfunction occurs in the striatum of children and adolescents with RAD, leading towards potential future risks for psychopathology. Declaration of interest None. Copyright and usage © The Royal College of Psychiatrists 2015. This is an open access article distributed under the terms of the Creative Commons Non-Commercial, No Derivatives (CC BY-NC-ND) licence. PMID:27703736

Psychosocial work environment and well-being: a cross-sectional study at a thermal power plant in China.

PubMed

Yu, Shanfa; Gu, Guizhen; Zhou, Wenhui; Wang, Sheng

2008-01-01

To investigate the effects of the job demand-control (DC) model and the effort-reward imbalance (ERI) model on worker's well-being, self-reports for psychosocial work conditions and well-being were made by a sample of 878 workers at a thermal power plant in China using the main dimensions of DC and ERI questionnaires. Logistic regression analyses were employed controlling for age, gender, and educational level, and negative and positive affection among others. Workers reporting high job demands and low job control or high efforts and low rewards had elevated risks of job dissatisfaction, psychosomatic complaints and depressive symptoms. Odds ratios were generally higher in workers reporting both high efforts and low rewards. Furthermore, low reward proved to be a stronger predictor of poor well-being when both job stress models were simultaneously adjusted. To some extent, interaction effects were found for social support, but no interaction effects were found for overcommitment. The findings indicate independent effects of both the DC model and the ERI model on well-being. Future work should explore the combined effects of these two models of psychosocial stress at work on health more thoroughly.

The use of preferred social stimuli as rewards for rhesus macaques in behavioural neuroscience

PubMed Central

Pearce, Bradley; Thiele, Alexander; Rowe, Candy

2017-01-01

Macaques are often motivated to perform in neuroscientific experiments by implementing fluid restriction protocols. Daily access to water is controlled and the monkeys are rewarded with droplets of fluid for performing correct trials in the laboratory. Although these protocols are widely used and highly effective, it is important from a 3Rs perspective to investigate refinements that may help to lessen the severity of the fluid restriction applied. We assessed the use of social stimuli (images of conspecifics) as rewards for four rhesus macaques performing simple cognitive tasks. We found that individual preferences for images of male faces, female perinea and control stimuli could be identified in each monkey. However, using preferred images did not translate into effective motivators on a trial-by-trial basis: animals preferred fluid rewards, even when fluid restriction was relaxed. There was no difference in the monkeys’ performance of a task when using greyscale versus colour images. Based on our findings, we cannot recommend the use of social stimuli, in this form, as a refinement to current fluid restriction protocols. We discuss the potential alternatives and possibilities for future research. PMID:28542356

Scalar utility theory and proportional processing: What does it actually imply?

PubMed

Rosenström, Tom; Wiesner, Karoline; Houston, Alasdair I

2016-09-07

Scalar Utility Theory (SUT) is a model used to predict animal and human choice behaviour in the context of reward amount, delay to reward, and variability in these quantities (risk preferences). This article reviews and extends SUT, deriving novel predictions. We show that, contrary to what has been implied in the literature, (1) SUT can predict both risk averse and risk prone behaviour for both reward amounts and delays to reward depending on experimental parameters, (2) SUT implies violations of several concepts of rational behaviour (e.g. it violates strong stochastic transitivity and its equivalents, and leads to probability matching) and (3) SUT can predict, but does not always predict, a linear relationship between risk sensitivity in choices and coefficient of variation in the decision-making experiment. SUT derives from Scalar Expectancy Theory which models uncertainty in behavioural timing using a normal distribution. We show that the above conclusions also hold for other distributions, such as the inverse Gaussian distribution derived from drift-diffusion models. A straightforward way to test the key assumptions of SUT is suggested and possible extensions, future prospects and mechanistic underpinnings are discussed. Copyright © 2016 Elsevier Ltd. All rights reserved.

The role of orgasm in the development and shaping of partner preferences

PubMed Central

Coria-Avila, Genaro A.; Herrera-Covarrubias, Deissy; Ismail, Nafissa; Pfaus, James G.

2016-01-01

Background The effect of orgasm on the development and shaping of partner preferences may involve a catalysis of the neurochemical mechanisms of bonding. Therefore, understanding such process is relevant for neuroscience and psychology. Methods A systematic review was carried out using the terms Orgasm, Sexual Reward, Partner Preference, Pair Bonding, Brain, Learning, Sex, Copulation. Results In humans, concentrations of arousing neurotransmitters and potential bonding neurotransmitters increase during orgasm in the cerebrospinal fluid and the bloodstream. Similarly, studies in animals indicate that those neurotransmitters (noradrenaline, oxytocin, prolactin) and others (e.g. dopamine, opioids, serotonin) modulate the appetitive and consummatory phases of sexual behavior and reward. This suggests a link between the experience of orgasm/sexual reward and the neurochemical mechanisms of pair bonding. Orgasm/reward functions as an unconditioned stimulus (UCS). Some areas in the nervous system function as UCS-detection centers, which become activated during orgasm. Partner-related cues function as conditioned stimuli (CS) and are processed in CS-detector centers. Conclusions Throughout the article, we discuss how UCS- and CS-detection centers must interact to facilitate memory consolidation and produce recognition and motivation during future social encounters. PMID:27799080

Future Issues Facing Administrators in Pharmaceutical Education.

ERIC Educational Resources Information Center

Fink, Joseph L., III

1986-01-01

Issues facing pharmaceutical education include the need to keep up with advancing technology, the need to keep faculty from overemphasizing technology to the detriment of other responsibilities, motivating and rewarding faculty, dealing with loss of faculty productivity, and part-time faculty. (MSE)

Information processing in decision-making systems.

PubMed

van der Meer, Matthijs; Kurth-Nelson, Zeb; Redish, A David

2012-08-01

Decisions result from an interaction between multiple functional systems acting in parallel to process information in very different ways, each with strengths and weaknesses. In this review, the authors address three action-selection components of decision-making: The Pavlovian system releases an action from a limited repertoire of potential actions, such as approaching learned stimuli. Like the Pavlovian system, the habit system is computationally fast but, unlike the Pavlovian system permits arbitrary stimulus-action pairings. These associations are a "forward'' mechanism; when a situation is recognized, the action is released. In contrast, the deliberative system is flexible but takes time to process. The deliberative system uses knowledge of the causal structure of the world to search into the future, planning actions to maximize expected rewards. Deliberation depends on the ability to imagine future possibilities, including novel situations, and it allows decisions to be taken without having previously experienced the options. Various anatomical structures have been identified that carry out the information processing of each of these systems: hippocampus constitutes a map of the world that can be used for searching/imagining the future; dorsal striatal neurons represent situation-action associations; and ventral striatum maintains value representations for all three systems. Each system presents vulnerabilities to pathologies that can manifest as psychiatric disorders. Understanding these systems and their relation to neuroanatomy opens up a deeper way to treat the structural problems underlying various disorders.

Information Processing in Decision-Making Systems

PubMed Central

van der Meer, Matthijs; Kurth-Nelson, Zeb; Redish, A. David

2015-01-01

Decisions result from an interaction between multiple functional systems acting in parallel to process information in very different ways, each with strengths and weaknesses. In this review, the authors address three action-selection components of decision-making: The Pavlovian system releases an action from a limited repertoire of potential actions, such as approaching learned stimuli. Like the Pavlovian system, the habit system is computationally fast but, unlike the Pavlovian system permits arbitrary stimulus-action pairings. These associations are a “forward” mechanism; when a situation is recognized, the action is released. In contrast, the deliberative system is flexible but takes time to process. The deliberative system uses knowledge of the causal structure of the world to search into the future, planning actions to maximize expected rewards. Deliberation depends on the ability to imagine future possibilities, including novel situations, and it allows decisions to be taken without having previously experienced the options. Various anatomical structures have been identified that carry out the information processing of each of these systems: hippocampus constitutes a map of the world that can be used for searching/imagining the future; dorsal striatal neurons represent situation-action associations; and ventral striatum maintains value representations for all three systems. Each system presents vulnerabilities to pathologies that can manifest as psychiatric disorders. Understanding these systems and their relation to neuroanatomy opens up a deeper way to treat the structural problems underlying various disorders. PMID:22492194

Documentary Linguistics: Methodological Challenges and Innovatory Responses

ERIC Educational Resources Information Center

Thieberger, Nick

2016-01-01

Seeing the present situation, I think that, at the very least, it behooves us as scientists and as human beings to work responsibly both for the future of our science and for the future of our languages, not so much for reward according to the fashion of the day, but for the sake of posterity. What we need to do now stares us in the face. If we do…

Job Attitudes of USAF Administrative Personnel

DTIC Science & Technology

1986-04-01

34opportunities for training, giving supervisory feedback, and -developing future leaders. Their findings were bas-ed on researrch Sdate similar to those upon...chance to move in and out of this rewarding functional area, could have a significant effect on the outcome of future attitudinal surveys of the admin...admin personnal to mission accomplishment at newcomer orientetions , commander’s calls, and similar gatherings, especially when families are present. (c

The SOF Experience in the Philippines and the Implications for Future Defense Strategy

DTIC Science & Technology

2016-12-07

developed communications products including leaflets that advertised rewards for information on local insurgents and the various programs that were...and intelligence (2) Conducting civil–military operations (CMO) (3) Conducting information operations ( IO ) PRISM 6, no. 3 FROM THE FIELD | 155 THE...FUTURE DEFENSE STRATEGY the development of an intelligence fusion cen- ter and campaign assessment products . At Fort Magsaysay, U.S. SOF helped establish

Elevated Outcome-Anticipation and Outcome-Evaluation ERPs Associated with a Greater Preference for Larger-But-Delayed Rewards

PubMed Central

Pornpattananangkul, Narun; Nadig, Ajay; Heidinger, Storm; Walden, Keegan; Nusslock, Robin

2017-01-01

Although waiting for a reward reduces or discounts its value, some people have a stronger tendency to wait for larger rewards and forgo smaller-but-immediate rewards. This ability to delay gratification is captured by individual differences in so-called inter-temporal choices in which individuals are asked to choose between larger-but-delayed versus smaller-but-immediate rewards. The current study used event-related potentials (ERPs) to examine whether enhancement in two neuro-cognitive processes, outcome-anticipation and outcome-evaluation, modulate individual variability in inter-temporal responses. After completing a behavioral inter-temporal choice task, 34 participants performed an ERP gambling task. From this ERP task, we separately examined individual differences in outcome-anticipation (Stimulus-Preceding Negativity, SPN), early outcome-evaluation (Feedback-Related Negativity; FRN) and late outcome-evaluation (P3). We observed that both elevated outcome-anticipation (SPN) and late outcome-evaluation (P3) neural processes predicted a stronger preference toward larger-but-delayed rewards. No relationship was observed between inter-temporal responses and early outcome-evaluation (FRN), indicating that the relationship between outcome-evaluation and inter-temporal responses was specific to the late outcome-evaluation processing stream. Moreover, multiple regression analyses indicated that the SPN and P3 independently modulate individual differences in inter-temporal responses, suggesting separate mechanisms underlie the relationship between these two neuro-cognitive processes and inter-temporal responses. Accordingly, we identify two potential neural-cognitive modulators of individual variability in inter-temporal responses. We discuss the mechanisms underlying these modulators in terms of anticipation-related processing (SPN) and a saliency-bias toward gain (compared to loss) outcomes (P3). PMID:28224457

Fluctuations in nucleus accumbens extracellular glutamate and glucose during motivated glucose-drinking behavior: dissecting the neurochemistry of reward.

PubMed

Wakabayashi, Ken T; Myal, Stephanie E; Kiyatkin, Eugene A

2015-02-01

While motivated behavior involves multiple neurochemical systems, few studies have focused on the role of glutamate, the brain's excitatory neurotransmitter, and glucose, the energetic substrate of neural activity in reward-related neural processes. Here, we used high-speed amperometry with enzyme-based substrate-sensitive and control, enzyme-free biosensors to examine second-scale fluctuations in the extracellular levels of these substances in the nucleus accumbens shell during glucose-drinking behavior in trained rats. Glutamate rose rapidly after the presentation of a glucose-containing cup and before the initiation of drinking (reward seeking), decreased more slowly to levels below baseline during consumption (sensory reward), and returned to baseline when the ingested glucose reached the brain (metabolic reward). When water was substituted for glucose, glutamate rapidly increased with cup presentation and in contrast to glucose drinking, increased above baseline after rats tasted the water and refused to drink further. Therefore, extracellular glutamate show distinct changes associated with key events of motivated drinking behavior and opposite dynamics during sensory and metabolic components of reward. In contrast to glutamate, glucose increased at each stimulus and behavioral event, showing a sustained elevation during the entire behavior and a robust post-ingestion rise that correlated with the gradual return of glutamate levels to their baseline. By comparing active drinking with passive intra-gastric glucose delivery, we revealed that fluctuations in extracellular glucose are highly dynamic, reflecting a balance between rapid delivery because of neural activity, intense metabolism, and the influence of ingested glucose reaching the brain. Published 2014. This article is a U.S. Government work and is in the public domain in the USA.

The effects of HIV-1 regulatory TAT protein expression on brain reward function, response to psychostimulants and delay-dependent memory in mice.

PubMed

Kesby, James P; Markou, Athina; Semenova, Svetlana

2016-10-01

Depression and psychostimulant abuse are common comorbidities among humans with immunodeficiency virus (HIV) disease. The HIV regulatory protein TAT is one of multiple HIV-related proteins associated with HIV-induced neurotoxicity. TAT-induced dysfunction of dopamine and serotonin systems in corticolimbic brain areas may result in impaired reward function, thus, contributing to depressive symptoms and psychostimulant abuse. Transgenic mice with doxycycline-induced TAT protein expression in the brain (TAT+, TAT- control) show neuropathology resembling brain abnormalities in HIV+ humans. We evaluated brain reward function in response to TAT expression, nicotine and methamphetamine administration in TAT+ and TAT- mice using the intracranial self-stimulation procedure. We evaluated the brain dopamine and serotonin systems with high-performance liquid chromatography. The effects of TAT expression on delay-dependent working memory in TAT+ and TAT- mice using the operant delayed nonmatch-to-position task were also assessed. During doxycycline administration, reward thresholds were elevated by 20% in TAT+ mice compared with TAT- mice. After the termination of doxycycline treatment, thresholds of TAT+ mice remained significantly higher than those of TAT- mice and this was associated with changes in mesolimbic serotonin and dopamine levels. TAT+ mice showed a greater methamphetamine-induced threshold lowering compared with TAT- mice. TAT expression did not alter delay-dependent working memory. These results indicate that TAT expression in mice leads to reward deficits, a core symptom of depression, and a greater sensitivity to methamphetamine-induced reward enhancement. Our findings suggest that the TAT protein may contribute to increased depressive-like symptoms and continued methamphetamine use in HIV-positive individuals. Copyright © 2016 Elsevier Ltd. All rights reserved.

Learning Enhances Sensory and Multiple Non-sensory Representations in Primary Visual Cortex

PubMed Central

Poort, Jasper; Khan, Adil G.; Pachitariu, Marius; Nemri, Abdellatif; Orsolic, Ivana; Krupic, Julija; Bauza, Marius; Sahani, Maneesh; Keller, Georg B.; Mrsic-Flogel, Thomas D.; Hofer, Sonja B.

2015-01-01

Summary We determined how learning modifies neural representations in primary visual cortex (V1) during acquisition of a visually guided behavioral task. We imaged the activity of the same layer 2/3 neuronal populations as mice learned to discriminate two visual patterns while running through a virtual corridor, where one pattern was rewarded. Improvements in behavioral performance were closely associated with increasingly distinguishable population-level representations of task-relevant stimuli, as a result of stabilization of existing and recruitment of new neurons selective for these stimuli. These effects correlated with the appearance of multiple task-dependent signals during learning: those that increased neuronal selectivity across the population when expert animals engaged in the task, and those reflecting anticipation or behavioral choices specifically in neuronal subsets preferring the rewarded stimulus. Therefore, learning engages diverse mechanisms that modify sensory and non-sensory representations in V1 to adjust its processing to task requirements and the behavioral relevance of visual stimuli. PMID:26051421

Psychometric properties of neural responses to monetary and social rewards across development.

PubMed

Ethridge, Paige; Weinberg, Anna

2018-02-02

Reward-related event-related potentials (ERPs) are often used to index individual differences that signal the presence or predict the onset of psychopathology. However, relatively little research has explored the psychometric properties of reward-related ERPs. Without understanding their psychometric properties, the value of using ERPs as biomarkers for psychopathology is limited. The present study, therefore, sought to establish the internal consistency reliability and convergent validity of the reward positivity (RewP) and feedback negativity (FN) elicited by two types of incentives commonly used in individual differences research - monetary and social rewards. A large, developmentally-diverse sample completed a forced-choice guessing task in which they won or lost money, as well as a social interaction task in which they received acceptance and rejection feedback. Data were analyzed at both Cz and at a frontocentral region of interest (ROI) using techniques derived from classical test theory and generalizability theory. Results demonstrated good to excellent internal consistency of the RewP and FN within 20 trials in both tasks, in addition to convergent validity between the two tasks. Results from a regression-based approach to isolating activity specific to a single response demonstrated acceptable to good internal consistency within 20 trials in both tasks, while a subtraction-based approach (∆RewP) did not achieve acceptable internal consistency in either task. Internal consistency was not moderated by age and did not differ between Cz and the frontocentral ROI; however, the magnitudes of the RewP and FN were significantly associated with age at Cz but not at the ROI. This work replicates previous studies demonstrating good psychometric properties of the monetary RewP/FN and provides novel information about the psychometric properties of the social RewP/FN. These data support the use of reward-related ERPs elicited by multiple reward types in studies of biomarkers of psychopathology. Copyright © 2018 Elsevier B.V. All rights reserved.

The effectiveness of loyalty rewards to promote the use of an Internet-based heart health program.

PubMed

Liu, Sam; Hodgson, Corinne; Zbib, Ahmad M; Payne, Ada Y M; Nolan, Robert P

2014-07-02

Internet-based health programs have been shown to be effective in reducing risk for cardiovascular disease. However, their rates of enrollment and engagement remain low. It is currently unclear whether rewards from established loyalty programs can serve as a conditioned stimulus to improve the use of a freely available Internet-based program. The objectives of the study were to (1) examine enrollment rates and levels of engagement with the My Health eSupport program between a Conditioned Reward group and a Control group, and (2) investigate the influence of loyalty rewards and participant characteristics on levels of enrollment and program engagement. The study sample (n=142,726) consisted of individuals who were offered enrollment in an Internet-based health intervention (My Health eSupport) after completing the Heart&Stroke Risk Assessment on the Heart and Stroke Foundation website. My Health eSupport programs provided encouragement and tips for lifestyle change. This is a free, self-guided, fully automated program that proactively delivers tailored email messages at 2-week intervals based on the participant's stage of motivational "readiness" and priority for lifestyle change. Participants in the Conditioned Reward group were offered a single exposure of 20 loyalty reward points from the Air Miles loyalty program for completing the Heart&Stroke Risk Assessment (10 reward points) and enrolling in the Internet-based program (10 reward points). Meanwhile, no rewards were given to the Control group participants. All data were collected between February 1, 2011 and February 10, 2012. In total, 51.38% (73,327/142,726) of individuals in the Conditioned Reward group and 48.62% (69,399/142,726) of individuals in the Control group completed the Heart&Stroke Risk Assessment. Subsequently, significantly more individuals from the Conditioned Reward group (52.96%, 38,835/73,327) enrolled in the My Health eSupport program than Controls (4.07%, 2826/69,399). Regression analyses indicated that individuals were 27.9 times (95% CI 26.4-29.4; P<.001) more likely to join the My Health eSupport program when presented with loyalty rewards controlling for gender, age, education, ethnicity, employment, and number of modifiable risk factors. However, ongoing engagement level was low in both groups and it was not influenced by loyalty rewards. Instead, individuals were more likely to engage with the My Health eSupport program if they were greater than 60 years of age (OR 12.56, 95% CI 5.66-27.8; P<.001), were female (OR 1.27, 95% CI 1.09-1.46; P=.002), or had one or more modifiable risk factors (OR 1.38, 95% CI 1.31-1.45; P<.001). Our findings suggest that a single exposure of loyalty rewards may be used to encourage individuals to enroll in an Internet-based preventative health program, but additional strategies are required to maintain engagement level. Future studies need to examine the schedules of loyalty reward reinforcement on the long-term engagement level of Internet-based health programs.

The Effectiveness of Loyalty Rewards to Promote the Use of an Internet-Based Heart Health Program

PubMed Central

Liu, Sam; Hodgson, Corinne; Zbib, Ahmad M; Payne, Ada YM

2014-01-01

Background Internet-based health programs have been shown to be effective in reducing risk for cardiovascular disease. However, their rates of enrollment and engagement remain low. It is currently unclear whether rewards from established loyalty programs can serve as a conditioned stimulus to improve the use of a freely available Internet-based program. Objective The objectives of the study were to (1) examine enrollment rates and levels of engagement with the My Health eSupport program between a Conditioned Reward group and a Control group, and (2) investigate the influence of loyalty rewards and participant characteristics on levels of enrollment and program engagement. Methods The study sample (n=142,726) consisted of individuals who were offered enrollment in an Internet-based health intervention (My Health eSupport) after completing the Heart&Stroke Risk Assessment on the Heart and Stroke Foundation website. My Health eSupport programs provided encouragement and tips for lifestyle change. This is a free, self-guided, fully automated program that proactively delivers tailored email messages at 2-week intervals based on the participant’s stage of motivational “readiness” and priority for lifestyle change. Participants in the Conditioned Reward group were offered a single exposure of 20 loyalty reward points from the Air Miles loyalty program for completing the Heart&Stroke Risk Assessment (10 reward points) and enrolling in the Internet-based program (10 reward points). Meanwhile, no rewards were given to the Control group participants. All data were collected between February 1, 2011 and February 10, 2012. Results In total, 51.38% (73,327/142,726) of individuals in the Conditioned Reward group and 48.62% (69,399/142,726) of individuals in the Control group completed the Heart&Stroke Risk Assessment. Subsequently, significantly more individuals from the Conditioned Reward group (52.96%, 38,835/73,327) enrolled in the My Health eSupport program than Controls (4.07%, 2826/69,399). Regression analyses indicated that individuals were 27.9 times (95% CI 26.4-29.4; P<.001) more likely to join the My Health eSupport program when presented with loyalty rewards controlling for gender, age, education, ethnicity, employment, and number of modifiable risk factors. However, ongoing engagement level was low in both groups and it was not influenced by loyalty rewards. Instead, individuals were more likely to engage with the My Health eSupport program if they were greater than 60 years of age (OR 12.56, 95% CI 5.66-27.8; P<.001), were female (OR 1.27, 95% CI 1.09-1.46; P=.002), or had one or more modifiable risk factors (OR 1.38, 95% CI 1.31-1.45; P<.001). Conclusions Our findings suggest that a single exposure of loyalty rewards may be used to encourage individuals to enroll in an Internet-based preventative health program, but additional strategies are required to maintain engagement level. Future studies need to examine the schedules of loyalty reward reinforcement on the long-term engagement level of Internet-based health programs. PMID:24989982

A cross-sectional study of the relationship between job demand-control, effort-reward imbalance and cardiovascular heart disease risk factors.

PubMed

Söderberg, Mia; Rosengren, Annika; Hillström, Jenny; Lissner, Lauren; Torén, Kjell

2012-12-21

This cross-sectional study explored relationships between psychosocial work environment, captured by job demand-control (JDC) and effort-reward imbalance (ERI), and seven cardiovascular heart disease (CHD) risk factors in a general population. The sampled consists of randomly-selected men and women from Gothenburg, Sweden and the city's surrounding metropolitan areas. Associations between psychosocial variables and biomarkers were analysed with multiple linear regression adjusted for age, smoking, education and occupational status. The study included 638 men and 668 women aged 24-71. Analysis between JDC and CHD risk factors illustrated that, for men, JDC was associated with impaired scores in several biomarkers, especially among those in high strain jobs. For women, there were no relationships between JDC and biomarkers. In the analysis of links between ERI and CHD risk factors, most associations tested null. The only findings were raised triglycerides and BMI among men in the fourth quartile of the ERI-ratio distribution, and lowered LDL-cholesterol for women. An complementary ERI analysis, combining high/low effort and reward into categories, illustrated lowered triglycerides and elevated HDL-cholesterol values among women reporting high efforts and high rewards, compared to women experiencing low effort and high reward. There were some associations between psychosocial stressors and CHD risk factors. The cross-sectional design did not allow conclusions about causality but some results indicated gender differences regarding sensitivity to work stressors and also how the models might capture different psychosocial dimensions.

Psychosocial and organizational work environment of nurse managers and self-reported depressive symptoms: cross-sectional analysis from a cohort of nurse managers.

PubMed

Nourry, Nathalie; Luc, Amandine; Lefebvre, François; Sultan-Taïeb, Hélène; Béjean, Sophie

2014-04-01

The association between depressive symptoms and psycho-organisational work environment has been established in the literature. Some studies have evaluated depressive symptoms in healthcare workers, but little research has been carried out among nurse managers. The aim of the study is to evaluate the depressive symptoms prevalence among nurse managers' population and work environment factors. A descriptive correlational research design was used. Data were collected from 296 nurse managers in five hospitals in the eastern area of France between 2007 and 2008. Health outcomes were evaluated by measuring depressive symptoms (CES-D scale), the exposure data by assessing psycho-organisational work environment with effort-reward imbalance-model of Siegrist. Multiple logistic regressions were used to describe the strength of the association between depressive symptoms and effort-reward imbalance adjusted for personal and occupational characteristics of the nurse managers. Among the nurse managers, a third had depressive symptoms, and 18% presented an effort-reward imbalance (ratio: ≥ 1). A significant association was found between depressive symptoms and effort-reward imbalance (OR = 10.81, 95% CI: 5.1-23, p < 10(-3)), and with esteem as a reward (OR = 3.21, 95% CI: 1.6-6.3, p < 10(-2)). In view of the hierarchical situation of nurse managers and their primary roles in hospitals, it is necessary to take prevention measures to improve their work environment and health.

Antireward, compulsivity, and addiction: seminal contributions of Dr. Athina Markou to motivational dysregulation in addiction.

PubMed

Koob, George F

2017-05-01

Addiction is defined as a chronically relapsing disorder characterized by compulsive drug seeking that is hypothesized to derive from multiple sources of motivational dysregulation. Dr. Athina Markou made seminal contributions to our understanding of the neurobiology of addiction with her studies on the dysregulation of reward function using animal models with construct validity. Repeated overstimulation of the reward systems with drugs of abuse decreases reward function, characterized by brain stimulation reward and presumbably reflecting dysphoria-like states. The construct of negative reinforcement, defined as drug taking that alleviates a negative emotional state that is created by drug abstinence, is particularly relevant as a driving force in both the withdrawal/negative affect and preoccupation/anticipation stages of the addiction cycle. The negative emotional state that drives such negative reinforcement is hypothesized to derive from the dysregulation of key neurochemical circuits that drive incentive-salience/reward systems (dopamine, opioid peptides) in the ventral striatum and from the recruitment of brain stress systems (corticotropin-releasing factor, dynorphin) within the extended amygdala. As drug taking becomes compulsive-like, the factors that motivate behavior are hypothesized to shift to drug-seeking behavior that is driven not only by positive reinforcement but also by negative reinforcement. This shift in motivation is hypothesized to reflect the allostatic misregulation of hedonic tone such that drug taking makes the hedonic negative emotional state worse during the process of seeking temporary relief with compulsive drug taking.

Neural Correlates of Temporal Credit Assignment in the Parietal Lobe

PubMed Central

Eisenberg, Ian; Gottlieb, Jacqueline

2014-01-01

Empirical studies of decision making have typically assumed that value learning is governed by time, such that a reward prediction error arising at a specific time triggers temporally-discounted learning for all preceding actions. However, in natural behavior, goals must be acquired through multiple actions, and each action can have different significance for the final outcome. As is recognized in computational research, carrying out multi-step actions requires the use of credit assignment mechanisms that focus learning on specific steps, but little is known about the neural correlates of these mechanisms. To investigate this question we recorded neurons in the monkey lateral intraparietal area (LIP) during a serial decision task where two consecutive eye movement decisions led to a final reward. The underlying decision trees were structured such that the two decisions had different relationships with the final reward, and the optimal strategy was to learn based on the final reward at one of the steps (the “F” step) but ignore changes in this reward at the remaining step (the “I” step). In two distinct contexts, the F step was either the first or the second in the sequence, controlling for effects of temporal discounting. We show that LIP neurons had the strongest value learning and strongest post-decision responses during the transition after the F step regardless of the serial position of this step. Thus, the neurons encode correlates of temporal credit assignment mechanisms that allocate learning to specific steps independently of temporal discounting. PMID:24523935

Ventral striatum response during reward and punishment reversal learning in unmedicated major depressive disorder.

PubMed

Robinson, Oliver J; Cools, Roshan; Carlisi, Christina O; Sahakian, Barbara J; Drevets, Wayne C

2012-02-01

Affective biases may underlie many of the key symptoms of major depressive disorder, from anhedonia to altered cognitive performance. Understanding the cause of these biases is therefore critical in the quest for improved treatments. Depression is associated, for example, with a negative affective bias in reversal learning. However, despite the fact that reversal learning is associated with striatal response in healthy individuals and depressed individuals exhibit attenuated striatal function on multiple tasks, studies to date have not demonstrated striatal involvement in the negative bias in reversal learning in depression. In this study, the authors sought to determine whether this may be because reversal learning tasks conventionally used to study behavior examine reversals only on the basis of unexpected punishment and therefore do not adequately separate reward- and punishment-based behavior. The authors used functional MRI to compare the hemodynamic response to a reversal learning task with mixed reward- and punishment-based reversal stages between individuals with unmedicated major depressive disorder (N=13) and healthy comparison subjects (N=14). Impaired reward (but not punishment) reversal accuracy was found alongside attenuated anteroventral striatal response to unexpected reward in depression. Attenuated neurophysiological response of the anteroventral striatum may reflect dysfunction in circuits involving afferent projections from the orbitofrontal, limbic, and/or mesostriatal dopaminergic pathways, which conceivably may, together with the ventral striatum, underlie anhedonia in depression. Learning to appreciate and enjoy positive life experiences is critical for recovery from depression. This study pinpoints a neural target for such recovery.