Social and monetary reward processing in autism spectrum disorders

PubMed Central

2012-01-01

Background Social motivation theory suggests that deficits in social reward processing underlie social impairments in autism spectrum disorders (ASD). However, the extent to which abnormalities in reward processing generalize to other classes of stimuli remains unresolved. The aim of the current study was to examine if reward processing abnormalities in ASD are specific to social stimuli or can be generalized to other classes of reward. Additionally, we sought to examine the results in the light of behavioral impairments in ASD. Methods Participants performed adapted versions of the social and monetary incentive delay tasks. Data from 21 unmedicated right-handed male participants with ASD and 21 age- and IQ-matched controls were analyzed using a factorial design to examine the blood-oxygen-level-dependent (BOLD) response during the anticipation and receipt of both reward types. Results Behaviorally, the ASD group showed less of a reduction in reaction time (RT) for rewarded compared to unrewarded trials than the control group. In terms of the fMRI results, there were no significant group differences in reward circuitry during reward anticipation. During the receipt of rewards, there was a significant interaction between group and reward type in the left dorsal striatum (DS). The ASD group showed reduced activity in the DS compared to controls for social rewards but not monetary rewards and decreased activation for social rewards compared to monetary rewards. Controls showed no significant difference between the two reward types. Increased activation in the DS during social reward processing was associated with faster response times for rewarded trials, compared to unrewarded trials, in both groups. This is in line with behavioral results indicating that the ASD group showed less of a reduction in RT for rewarded compared to unrewarded trials. Additionally, de-activation to social rewards was associated with increased repetitive behavior in ASD. Conclusions In line with social motivation theory, the ASD group showed reduced activation, compared to controls, during the receipt of social rewards in the DS. Groups did not differ significantly during the processing of monetary rewards. BOLD activation in the DS, during social reward processing, was associated with behavioral impairments in ASD. PMID:23014171

Identifying nurses' rewards: a qualitative categorization study in Belgium

PubMed Central

De Gieter, Sara; De Cooman, Rein; Pepermans, Roland; Caers, Ralf; Du Bois, Cindy; Jegers, Marc

2006-01-01

Background Rewards are important in attracting, motivating and retaining the most qualified employees, and nurses are no exception to this rule. This makes the establishment of an efficient reward system for nurses a true challenge for every hospital manager. A reward does not necessarily have a financial connotation: non-financial rewards may matter too, or may even be more important. Therefore, the present study examines nurses' reward perceptions, in order to identify potential reward options. Methods To answer the research question "What do nurses consider a reward and how can these rewards be categorized?", 20 in-depth semi-structured interviews with nurses were conducted and analysed using discourse and content analyses. In addition, the respondents received a list of 34 rewards (derived from the literature) and were asked to indicate the extent to which they perceived each of them to be rewarding. Results Discourse analysis revealed three major reward categories: financial, non-financial and psychological, each containing different subcategories. In general, nurses more often mentioned financial rewards spontaneously in the interview, compared to non-financial and psychological rewards. The questionnaire results did not, however, indicate a significant difference in the rewarding potential of these three categories. Both the qualitative and quantitative data revealed that a number of psychological and non-financial rewards were important for nurses in addition to their monthly pay and other remunerations. In particular, appreciation for their work by others, compliments from others, presents from others and contact with patients were highly valued. Moreover, some demographical variables influenced the reward perceptions. Younger and less experienced nurses considered promotion possibilities as more rewarding than the older and more senior ones. The latter valued job security and working for a hospital with a good reputation higher than their younger and more junior colleagues. Conclusion When trying to establish an efficient reward system for nurses, hospital managers should not concentrate on the financial reward possibilities alone. They also ought to consider non-financial and psychological rewards (in combination with financial rewards), since nurses value these as well and they may lead to a more personalized reward system. PMID:16824227

Social and monetary reward processing in autism spectrum disorders.

PubMed

Delmonte, Sonja; Balsters, Joshua H; McGrath, Jane; Fitzgerald, Jacqueline; Brennan, Sean; Fagan, Andrew J; Gallagher, Louise

2012-09-26

Social motivation theory suggests that deficits in social reward processing underlie social impairments in autism spectrum disorders (ASD). However, the extent to which abnormalities in reward processing generalize to other classes of stimuli remains unresolved. The aim of the current study was to examine if reward processing abnormalities in ASD are specific to social stimuli or can be generalized to other classes of reward. Additionally, we sought to examine the results in the light of behavioral impairments in ASD. Participants performed adapted versions of the social and monetary incentive delay tasks. Data from 21 unmedicated right-handed male participants with ASD and 21 age- and IQ-matched controls were analyzed using a factorial design to examine the blood-oxygen-level-dependent (BOLD) response during the anticipation and receipt of both reward types. Behaviorally, the ASD group showed less of a reduction in reaction time (RT) for rewarded compared to unrewarded trials than the control group. In terms of the fMRI results, there were no significant group differences in reward circuitry during reward anticipation. During the receipt of rewards, there was a significant interaction between group and reward type in the left dorsal striatum (DS). The ASD group showed reduced activity in the DS compared to controls for social rewards but not monetary rewards and decreased activation for social rewards compared to monetary rewards. Controls showed no significant difference between the two reward types. Increased activation in the DS during social reward processing was associated with faster response times for rewarded trials, compared to unrewarded trials, in both groups. This is in line with behavioral results indicating that the ASD group showed less of a reduction in RT for rewarded compared to unrewarded trials. Additionally, de-activation to social rewards was associated with increased repetitive behavior in ASD. In line with social motivation theory, the ASD group showed reduced activation, compared to controls, during the receipt of social rewards in the DS. Groups did not differ significantly during the processing of monetary rewards. BOLD activation in the DS, during social reward processing, was associated with behavioral impairments in ASD.

Addictive drugs and brain stimulation reward.

PubMed

Wise, R A

1996-01-01

Direct electrical or chemical stimulation of specific brain regions can establish response habits similar to those established by natural rewards such as food or sexual contact. Cocaine, mu and delta opiates, nicotine, phencyclidine, and cannabis each have actions that summate with rewarding electrical stimulation of the medial forebrain bundle (MFB). The reward-potentiating effects of amphetamine and opiates are associated with central sites of action where these drugs also have their direct rewarding effects, suggesting common mechanisms for drug reward per se and for drug potentiation of brain stimulation reward. The central sites at which these and perhaps other drugs of abuse potentiate brain stimulation reward and are rewarding in their own right are consistent with the hypothesis that the laboratory reward of brain stimulation and the pharmacological rewards of addictive drugs are habit forming because they act in the brain circuits that subserve more natural and biologically significant rewards.

Regulating task-monitoring systems in response to variable reward contingencies and outcomes in cocaine addicts.

PubMed

Morie, Kristen P; De Sanctis, Pierfilippo; Garavan, Hugh; Foxe, John J

2016-03-01

We investigated anticipatory and consummatory reward processing in cocaine addiction. In addition, we set out to assess whether task-monitoring systems were appropriately recalibrated in light of variable reward schedules. We also examined neural measures of task-monitoring and reward processing as a function of hedonic tone, since anhedonia is a vulnerability marker for addiction that is obviously germane in the context of reward processing. High-density event-related potentials were recorded while participants performed a speeded response task that systematically varied anticipated probabilities of reward receipt. The paradigm dissociated feedback regarding task success (or failure) from feedback regarding the value of reward (or loss), so that task-monitoring and reward processing could be examined in partial isolation. Twenty-three active cocaine abusers and 23 age-matched healthy controls participated. Cocaine abusers showed amplified anticipatory responses to reward predictive cues, but crucially, these responses were not as strongly modulated by reward probability as in controls. Cocaine users also showed blunted responses to feedback about task success or failure and did not use this information to update predictions about reward. In turn, they showed clearly blunted responses to reward feedback. In controls and users, measures of anhedonia were associated with reward motivation. In cocaine users, anhedonia was also associated with diminished monitoring and reward feedback responses. Findings imply that reward anticipation and monitoring deficiencies in addiction are associated with increased responsiveness to reward cues but impaired ability to predict reward in light of task contingencies, compounded by deficits in responding to actual reward outcomes.

Fuel not fun: Reinterpreting attenuated brain responses to reward in obesity.

PubMed

Kroemer, Nils B; Small, Dana M

2016-08-01

There is a well-established literature linking obesity to altered dopamine signaling and brain response to food-related stimuli. Neuroimaging studies frequently report enhanced responses in dopaminergic regions during food anticipation and decreased responses during reward receipt. This has been interpreted as reflecting anticipatory "reward surfeit", and consummatory "reward deficiency". In particular, attenuated response in the dorsal striatum to primary food rewards is proposed to reflect anhedonia, which leads to overeating in an attempt to compensate for the reward deficit. In this paper, we propose an alternative view. We consider brain response to food-related stimuli in a reinforcement-learning framework, which can be employed to separate the contributions of reward sensitivity and reward-related learning that are typically entangled in the brain response to reward. Consequently, we posit that decreased striatal responses to milkshake receipt reflect reduced reward-related learning rather than reward deficiency or anhedonia because reduced reward sensitivity would translate uniformly into reduced anticipatory and consummatory responses to reward. By re-conceptualizing reward deficiency as a shift in learning about subjective value of rewards, we attempt to reconcile neuroimaging findings with the putative role of dopamine in effort, energy expenditure and exploration and suggest that attenuated brain responses to energy dense foods reflect the "fuel", not the fun entailed by the reward. Copyright © 2016 Elsevier Inc. All rights reserved.

Promising high monetary rewards for future task performance increases intermediate task performance.

PubMed

Zedelius, Claire M; Veling, Harm; Bijleveld, Erik; Aarts, Henk

2012-01-01

In everyday life contexts and work settings, monetary rewards are often contingent on future performance. Based on research showing that the anticipation of rewards causes improved task performance through enhanced task preparation, the present study tested the hypothesis that the promise of monetary rewards for future performance would not only increase future performance, but also performance on an unrewarded intermediate task. Participants performed an auditory Simon task in which they responded to two consecutive tones. While participants could earn high vs. low monetary rewards for fast responses to every second tone, their responses to the first tone were not rewarded. Moreover, we compared performance under conditions in which reward information could prompt strategic performance adjustments (i.e., when reward information was presented for a relatively long duration) to conditions preventing strategic performance adjustments (i.e., when reward information was presented very briefly). Results showed that high (vs. low) rewards sped up both rewarded and intermediate, unrewarded responses, and the effect was independent of the duration of reward presentation. Moreover, long presentation led to a speed-accuracy trade-off for both rewarded and unrewarded tones, whereas short presentation sped up responses to rewarded and unrewarded tones without this trade-off. These results suggest that high rewards for future performance boost intermediate performance due to enhanced task preparation, and they do so regardless whether people respond to rewards in a strategic or non-strategic manner.

Promising High Monetary Rewards for Future Task Performance Increases Intermediate Task Performance

PubMed Central

Zedelius, Claire M.; Veling, Harm; Bijleveld, Erik; Aarts, Henk

2012-01-01

In everyday life contexts and work settings, monetary rewards are often contingent on future performance. Based on research showing that the anticipation of rewards causes improved task performance through enhanced task preparation, the present study tested the hypothesis that the promise of monetary rewards for future performance would not only increase future performance, but also performance on an unrewarded intermediate task. Participants performed an auditory Simon task in which they responded to two consecutive tones. While participants could earn high vs. low monetary rewards for fast responses to every second tone, their responses to the first tone were not rewarded. Moreover, we compared performance under conditions in which reward information could prompt strategic performance adjustments (i.e., when reward information was presented for a relatively long duration) to conditions preventing strategic performance adjustments (i.e., when reward information was presented very briefly). Results showed that high (vs. low) rewards sped up both rewarded and intermediate, unrewarded responses, and the effect was independent of the duration of reward presentation. Moreover, long presentation led to a speed-accuracy trade-off for both rewarded and unrewarded tones, whereas short presentation sped up responses to rewarded and unrewarded tones without this trade-off. These results suggest that high rewards for future performance boost intermediate performance due to enhanced task preparation, and they do so regardless whether people respond to rewards in a strategic or non-strategic manner. PMID:22905145

Registered nurses' perceptions of rewarding and its significance.

PubMed

Seitovirta, Jaana; Lehtimäki, Aku-Ville; Vehviläinen-Julkunen, Katri; Mitronen, Lasse; Kvist, Tarja

2017-11-07

To examine reward type preferences and their relationships with the significance of rewarding perceived by registered nurses in Finland. Previous studies have found relationships between nurses' rewarding and their motivation at work, job satisfaction and organisational commitment. Data were collected in a cross-sectional, descriptive, questionnaire survey from 402 registered nurses using the Registered Nurses' Perceptions of Rewarding Scale in 2015, and analysed with descriptive and multivariate statistical methods. Registered nurses assigned slightly higher values to several non-financial than to financial rewards. The non-financial reward types appreciation and feedback from work community, worktime arrangements, work content, and opportunity to develop, influence and participate were highly related to the significance of rewarding. We identified various rewards that registered nurses value, and indications that providing an appropriate array of rewards, particularly non-financial rewards, is a highly beneficial element of nursing management. It is important to understand the value of rewards for nursing management. Nurse managers should offer diverse rewards to their registered nurses to promote excellent performance and to help efforts to secure and maintain high-quality, safe patient care. The use of appropriate rewards is especially crucial to improving registered nurses' reward satisfaction and job satisfaction globally in the nursing profession. © 2017 John Wiley & Sons Ltd.

Reward abundance interferes with error-based learning in a visuomotor adaptation task

PubMed Central

Oostwoud Wijdenes, Leonie; Rigterink, Tessa; Overvliet, Krista E.; Smeets, Joeren B. J.

2018-01-01

The brain rapidly adapts reaching movements to changing circumstances by using visual feedback about errors. Providing reward in addition to error feedback facilitates the adaptation but the underlying mechanism is unknown. Here, we investigate whether the proportion of trials rewarded (the ‘reward abundance’) influences how much participants adapt to their errors. We used a 3D multi-target pointing task in which reward alone is insufficient for motor adaptation. Participants (N = 423) performed the pointing task with feedback based on a shifted hand-position. On a proportion of trials we gave them rewarding feedback that their hand hit the target. Half of the participants only received this reward feedback. The other half also received feedback about endpoint errors. In different groups, we varied the proportion of trials that was rewarded. As expected, participants who received feedback about their errors did adapt, but participants who only received reward-feedback did not. Critically, participants who received abundant rewards adapted less to their errors than participants who received less reward. Thus, reward abundance negatively influences how much participants learn from their errors. Probably participants used a mechanism that relied more on the reward feedback when the reward was abundant. Because participants could not adapt to the reward, this interfered with adaptation to errors. PMID:29513681

Differential encoding of factors influencing predicted reward value in monkey rostral anterior cingulate cortex.

PubMed

Toda, Koji; Sugase-Miyamoto, Yasuko; Mizuhiki, Takashi; Inaba, Kiyonori; Richmond, Barry J; Shidara, Munetaka

2012-01-01

The value of a predicted reward can be estimated based on the conjunction of both the intrinsic reward value and the length of time to obtain it. The question we addressed is how the two aspects, reward size and proximity to reward, influence the responses of neurons in rostral anterior cingulate cortex (rACC), a brain region thought to play an important role in reward processing. We recorded from single neurons while two monkeys performed a multi-trial reward schedule task. The monkeys performed 1-4 sequential color discrimination trials to obtain a reward of 1-3 liquid drops. There were two task conditions, a valid cue condition, where the number of trials and reward amount were associated with visual cues, and a random cue condition, where the cue was picked from the cue set at random. In the valid cue condition, the neuronal firing is strongly modulated by the predicted reward proximity during the trials. Information about the predicted reward amount is almost absent at those times. In substantial subpopulations, the neuronal responses decreased or increased gradually through schedule progress to the predicted outcome. These two gradually modulating signals could be used to calculate the effect of time on the perception of reward value. In the random cue condition, little information about the reward proximity or reward amount is encoded during the course of the trial before reward delivery, but when the reward is actually delivered the responses reflect both the reward proximity and reward amount. Our results suggest that the rACC neurons encode information about reward proximity and amount in a manner that is dependent on utility of reward information. The manner in which the information is represented could be used in the moment-to-moment calculation of the effect of time and amount on predicted outcome value.

Major depressive disorder is characterized by greater reward network activation to monetary than pleasant image rewards

PubMed Central

Smoski, Moria J.; Rittenberg, Alison; Dichter, Gabriel S.

2011-01-01

Anhedonia, the loss of interest or pleasure in normally rewarding activities, is a hallmark feature of unipolar Major Depressive Disorder (MDD). A growing body of literature has identified frontostriatal dysfunction during reward anticipation and outcomes in MDD. However, no study to date has directly compared responses to different types of rewards such as pleasant images and monetary rewards in MDD. To investigate the neural responses to monetary and pleasant image rewards in MDD, a modified Monetary Incentive Delay task was used during fMRI scanning to assess neural responses during anticipation and receipt of monetary and pleasant image rewards. Participants included nine adults with MDD and thirteen affectively healthy controls. The MDD group showed lower activation than controls when anticipating monetary rewards in right orbitofrontal cortex and subcallosal cortex, and when anticipating pleasant image rewards in paracingulate and supplementary motor cortex. The MDD group had relatively greater activation in right putamen when anticipating monetary versus pleasant image rewards, relative to the control group. Results suggest reduced reward network activation in MDD when anticipating rewards, as well as relatively greater hypoactivation to pleasant image than monetary rewards. PMID:22079658

Major depressive disorder is characterized by greater reward network activation to monetary than pleasant image rewards.

PubMed

Smoski, Moria J; Rittenberg, Alison; Dichter, Gabriel S

2011-12-30

Anhedonia, the loss of interest or pleasure in normally rewarding activities, is a hallmark feature of unipolar Major Depressive Disorder (MDD). A growing body of literature has identified frontostriatal dysfunction during reward anticipation and outcomes in MDD. However, no study to date has directly compared responses to different types of rewards such as pleasant images and monetary rewards in MDD. To investigate the neural responses to monetary and pleasant image rewards in MDD, a modified Monetary Incentive Delay task was used during functional magnetic resonance imaging to assess neural responses during anticipation and receipt of monetary and pleasant image rewards. Participants included nine adults with MDD and 13 affectively healthy controls. The MDD group showed lower activation than controls when anticipating monetary rewards in right orbitofrontal cortex and subcallosal cortex, and when anticipating pleasant image rewards in paracingulate and supplementary motor cortex. The MDD group had relatively greater activation in right putamen when anticipating monetary versus pleasant image rewards, relative to the control group. Results suggest reduced reward network activation in MDD when anticipating rewards, as well as relatively greater hypoactivation to pleasant image than monetary rewards. 2011 Elsevier Ireland Ltd. All rights reserved.

Caloric primary rewards systematically alter time perception.

PubMed

Fung, Bowen J; Murawski, Carsten; Bode, Stefan

2017-11-01

Human time perception can be influenced by contextual factors, such as the presence of reward. Yet, the exact nature of the relationship between time perception and reward has not been conclusively characterized. We implemented a novel experimental paradigm to measure estimations of time across a range of suprasecond intervals, during the anticipation and after the consumption of fruit juice, a physiologically relevant primary reward. We show that average time estimations were systematically affected by the consumption of reward, but not by the anticipation of reward. Compared with baseline estimations of time, reward consumption was associated with subsequent overproductions of time, and this effect increased for larger magnitudes of reward. Additional experiments demonstrated that the effect of consumption did not extend to a secondary reward (money), a tasteless, noncaloric primary reward (water), or a sweet, noncaloric reward (aspartame). However, a tasteless caloric reward (maltodexrin) did induce overproductions of time, although this effect did not scale with reward magnitude. These results suggest that the consumption of caloric primary rewards can alter time perception, which may be a psychophysiological mechanism by which organisms regulate homeostatic balance. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Reward Improves Cancellation and Restraint Inhibition Across Childhood and Adolescence

PubMed Central

Sinopoli, Katia J.; Schachar, Russell; Dennis, Maureen

2011-01-01

Inhibitory control allows for the regulation of thought and action, and interacts with motivational variables, such as reward, to modify behavior adaptively as environments change. We examined the effects of reward on two distinct forms of inhibitory control, cancellation and restraint. Typically developing children and adolescents completed two versions of the stop signal task (cancellation and restraint) under three reward conditions (neutral, low reward, and high reward), where rewards were earned for successful inhibitory control. Rewards improved both cancellation and restraint inhibition, with similar effects of reward on each form of inhibitory control. Rewards did not alter the speed of response execution in either task, suggesting that rewards specifically altered inhibition processes without influencing processes related to response execution. Adolescents were faster and less variable than children when executing and inhibiting their responses. There were similar developmental effects of reward on the speed of inhibitory control, but group differences were found in terms of accuracy of inhibition in the restraint task. These results clarify how reward modulates two different forms of regulatory behavior in children and adolescents. PMID:21744952

Differential effects of social and non-social reward on response inhibition in children and adolescents.

PubMed

Kohls, Gregor; Peltzer, Judith; Herpertz-Dahlmann, Beate; Konrad, Kerstin

2009-07-01

An important issue in the field of clinical and developmental psychopathology is whether cognitive control processes, such as response inhibition, can be specifically enhanced by motivation. To determine whether non-social (i.e. monetary) and social (i.e. positive facial expressions) rewards are able to differentially improve response inhibition accuracy in typically developing children and adolescents, an 'incentive' go/no-go task was applied with reward contingencies for successful inhibition. In addition, the impact of children's personality traits (such as reward seeking and empathy) on monetary and social reward responsiveness was assessed in 65 boys, ages 8 to 12 years. All subjects were tested twice: At baseline, inhibitory control was assessed without reward, and then subjects were pseudorandomly assigned to one of four experimental conditions, including (1) social reward only, (2) monetary reward only, (3) mixed social and monetary reward, or (4) a retest condition without reward. Both social and non-social reward significantly improved task performance, although larger effects were observed for monetary reward. The higher the children scored on reward seeking scales, the larger was their improvement in response inhibition, but only if monetary reward was used. In addition, there was a tendency for an association between empathic skills and benefits from social reward. These data suggest that social incentives do not have an equally strong reinforcing value as compared to financial incentives. However, different personality traits seem to determine to what extent a child profits from different types of reward. Clinical implications regarding probable hyposensitivity to social reward in subjects with autism and dysregulated reward-seeking behaviour in children with attention-deficit/hyperactivity disorder (ADHD) are discussed.

Pavlovian reward learning underlies value driven attentional capture.

PubMed

Bucker, Berno; Theeuwes, Jan

2017-02-01

Recent evidence shows that distractors that signal high compared to low reward availability elicit stronger attentional capture, even when this is detrimental for task-performance. This suggests that simply correlating stimuli with reward administration, rather than their instrumental relationship with obtaining reward, produces value-driven attentional capture. However, in previous studies, reward delivery was never response independent, as only correct responses were rewarded, nor was it completely task-irrelevant, as the distractor signaled the magnitude of reward that could be earned on that trial. In two experiments, we ensured that associative reward learning was completely response independent by letting participants perform a task at fixation, while high and low rewards were automatically administered following the presentation of task-irrelevant colored stimuli in the periphery (Experiment 1) or at fixation (Experiment 2). In a following non-reward test phase, using the additional singleton paradigm, the previously reward signaling stimuli were presented as distractors to assess truly task-irrelevant value driven attentional capture. The results showed that high compared to low reward-value associated distractors impaired performance, and thus captured attention more strongly. This suggests that genuine Pavlovian conditioning of stimulus-reward contingencies is sufficient to obtain value-driven attentional capture. Furthermore, value-driven attentional capture can occur following associative reward learning of temporally and spatially task-irrelevant distractors that signal the magnitude of available reward (Experiment 1), and is independent of training spatial shifts of attention towards the reward signaling stimuli (Experiment 2). This confirms and strengthens the idea that Pavlovian reward learning underlies value driven attentional capture.

Modulation of neural activity by reward in medial intraparietal cortex is sensitive to temporal sequence of reward

PubMed Central

Rajalingham, Rishi; Stacey, Richard Greg; Tsoulfas, Georgios

2014-01-01

To restore movements to paralyzed patients, neural prosthetic systems must accurately decode patients' intentions from neural signals. Despite significant advancements, current systems are unable to restore complex movements. Decoding reward-related signals from the medial intraparietal area (MIP) could enhance prosthetic performance. However, the dynamics of reward sensitivity in MIP is not known. Furthermore, reward-related modulation in premotor areas has been attributed to behavioral confounds. Here we investigated the stability of reward encoding in MIP by assessing the effect of reward history on reward sensitivity. We recorded from neurons in MIP while monkeys performed a delayed-reach task under two reward schedules. In the variable schedule, an equal number of small- and large-rewards trials were randomly interleaved. In the constant schedule, one reward size was delivered for a block of trials. The memory period firing rate of most neurons in response to identical rewards varied according to schedule. Using systems identification tools, we attributed the schedule sensitivity to the dependence of neural activity on the history of reward. We did not find schedule-dependent behavioral changes, suggesting that reward modulates neural activity in MIP. Neural discrimination between rewards was less in the variable than in the constant schedule, degrading our ability to decode reach target and reward simultaneously. The effect of schedule was mitigated by adding Haar wavelet coefficients to the decoding model. This raises the possibility of multiple encoding schemes at different timescales and reinforces the potential utility of reward information for prosthetic performance. PMID:25008408

Modulation of neural activity by reward in medial intraparietal cortex is sensitive to temporal sequence of reward.

PubMed

Rajalingham, Rishi; Stacey, Richard Greg; Tsoulfas, Georgios; Musallam, Sam

2014-10-01

To restore movements to paralyzed patients, neural prosthetic systems must accurately decode patients' intentions from neural signals. Despite significant advancements, current systems are unable to restore complex movements. Decoding reward-related signals from the medial intraparietal area (MIP) could enhance prosthetic performance. However, the dynamics of reward sensitivity in MIP is not known. Furthermore, reward-related modulation in premotor areas has been attributed to behavioral confounds. Here we investigated the stability of reward encoding in MIP by assessing the effect of reward history on reward sensitivity. We recorded from neurons in MIP while monkeys performed a delayed-reach task under two reward schedules. In the variable schedule, an equal number of small- and large-rewards trials were randomly interleaved. In the constant schedule, one reward size was delivered for a block of trials. The memory period firing rate of most neurons in response to identical rewards varied according to schedule. Using systems identification tools, we attributed the schedule sensitivity to the dependence of neural activity on the history of reward. We did not find schedule-dependent behavioral changes, suggesting that reward modulates neural activity in MIP. Neural discrimination between rewards was less in the variable than in the constant schedule, degrading our ability to decode reach target and reward simultaneously. The effect of schedule was mitigated by adding Haar wavelet coefficients to the decoding model. This raises the possibility of multiple encoding schemes at different timescales and reinforces the potential utility of reward information for prosthetic performance. Copyright © 2014 the American Physiological Society.

Spontaneous Eye-Blink Rate as an Index of Reward Responsivity: Validation and Links to Bipolar Disorder

PubMed Central

Peckham, Andrew D.; Johnson, Sheri L.

2015-01-01

Extensive research supports the role of striatal dopamine in pursuing and responding to reward, and that eye-blink rate is a valid indicator of striatal dopamine. This study tested whether phasic changes in blink rate could provide an index of reward pursuit. This hypothesis was tested in people with bipolar I disorder (BD; a population with aberrations in reward responsivity), and in those without BD. Thirty-one adults with BD and 28 control participants completed a laboratory task involving effort towards monetary reward. Blink rate was recorded using eye-tracking at baseline, reward anticipation, and post-reward. Those in the BD group completed self-report measures relating to reward and ambition. Results showed that across all participants, blink rates increased from reward anticipation to post-reward. In the BD group, reward-relevant measures were strongly correlated with variation in blink rate. These findings provide validation for phasic changes in blink rate as an index of reward response. PMID:27274949

Adaptive scaling of reward in episodic memory: a replication study.

PubMed

Mason, Alice; Ludwig, Casimir; Farrell, Simon

2017-11-01

Reward is thought to enhance episodic memory formation via dopaminergic consolidation. Bunzeck, Dayan, Dolan, and Duzel [(2010). A common mechanism for adaptive scaling of reward and novelty. Human Brain Mapping, 31, 1380-1394] provided functional magnetic resonance imaging (fMRI) and behavioural evidence that reward and episodic memory systems are sensitive to the contextual value of a reward-whether it is relatively higher or lower-as opposed to absolute value or prediction error. We carried out a direct replication of their behavioural study and did not replicate their finding that memory performance associated with reward follows this pattern of adaptive scaling. An effect of reward outcome was in the opposite direction to that in the original study, with lower reward outcomes leading to better memory than higher outcomes. There was a marginal effect of reward context, suggesting that expected value affected memory performance. We discuss the robustness of the reward memory relationship to variations in reward context, and whether other reward-related factors have a more reliable influence on episodic memory.

A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation.

PubMed

Deci, E L; Koestner, R; Ryan, R M

1999-11-01

A meta-analysis of 128 studies examined the effects of extrinsic rewards on intrinsic motivation. As predicted, engagement-contingent, completion-contingent, and performance-contingent rewards significantly undermined free-choice intrinsic motivation (d = -0.40, -0.36, and -0.28, respectively), as did all rewards, all tangible rewards, and all expected rewards. Engagement-contingent and completion-contingent rewards also significantly undermined self-reported interest (d = -0.15, and -0.17), as did all tangible rewards and all expected rewards. Positive feedback enhanced both free-choice behavior (d = 0.33) and self-reported interest (d = 0.31). Tangible rewards tended to be more detrimental for children than college students, and verbal rewards tended to be less enhancing for children than college students. The authors review 4 previous meta-analyses of this literature and detail how this study's methods, analyses, and results differed from the previous ones.

Reward Processing, Neuroeconomics, and Psychopathology.

PubMed

Zald, David H; Treadway, Michael T

2017-05-08

Abnormal reward processing is a prominent transdiagnostic feature of psychopathology. The present review provides a framework for considering the different aspects of reward processing and their assessment, and highlights recent insights from the field of neuroeconomics that may aid in understanding these processes. Although altered reward processing in psychopathology has often been treated as a general hypo- or hyperresponsivity to reward, increasing data indicate that a comprehensive understanding of reward dysfunction requires characterization within more specific reward-processing domains, including subjective valuation, discounting, hedonics, reward anticipation and facilitation, and reinforcement learning. As such, more nuanced models of the nature of these abnormalities are needed. We describe several processing abnormalities capable of producing the types of selective alterations in reward-related behavior observed in different forms of psychopathology, including (mal)adaptive scaling and anchoring, dysfunctional weighting of reward and cost variables, competition between valuation systems, and reward prediction error signaling.

Rewarded visual items capture attention only in heterogeneous contexts.

PubMed

Feldmann-Wüstefeld, Tobias; Brandhofer, Ruben; Schubö, Anna

2016-07-01

Reward is known to affect visual search performance. Rewarding targets can increase search performance, whereas rewarding distractors can decrease search performance. We used subcomponents of the N2pc in the event-related EEG, the NT (target negativity) and ND /PD (distractor negativity/positivity), in a visual search task to disentangle target and distractor processing related to reward. The visual search task comprised homogeneous and heterogeneous contexts in which a target and a colored distractor were embedded. After each correct trial, participants were given a monetary reward that depended on the color of the distractor. We found longer response times for displays with high-reward distractors compared to displays with low-reward distractors, indicating reward-induced interference, however, only for heterogeneous contexts. The NT component, indicative of attention deployment to the target, showed that target selection was impaired by high-reward distractors, regardless of the context homogeneity. Processing of distractors was not affected by reward in homogeneous contexts. In heterogeneous contexts, however, high-reward distractors were more likely to capture attention (ND ) and required more effort to be suppressed (PD ) than low-reward distractors. In sum the results showed that, despite the fact that target selection is impaired by high-reward distractors in both homogeneous and heterogeneous background contexts, high-reward distractors capture attention only in scenarios that foster attentional capture. © 2016 Society for Psychophysiological Research.

Monetary, Food, and Social Rewards Induce Similar Pavlovian-to-Instrumental Transfer Effects

PubMed Central

Lehner, Rea; Balsters, Joshua H.; Herger, Andreas; Hare, Todd A.; Wenderoth, Nicole

2017-01-01

Multiple types of reward, such as money, food or social approval, are capable of driving behavior. However, most previous investigations have only focused on one of these reward classes in isolation, as such it is not clear whether different reward classes have a unique influence on instrumental responding or whether the subjective value of the reward, rather than the reward type per se, is most important in driving behavior. Here, we investigate behavior using a well-established reward paradigm, Pavlovian-to-instrumental transfer (PIT), and three different reward types: monetary, food and social rewards. The subjective value of each reward type was matched using a modified Becker-DeGroot-Marschak (BDM) auction where subjective reward value was expressed through physical effort using a bimanual grip force task. We measured the influence of reward-associated stimuli on how participants distributed forces between hands when reaching a target effort range on the screen bimanually and on how much time participants spent in this target range. Participants spent significantly more time in the target range (15% ± 2% maximal voluntary contraction) when a stimulus was presented that was associated with a reward used during instrumental conditioning or Pavlovian conditioning compared to a stimulus associated with a neutral outcome (i.e., general PIT). The strength of the PIT effect was modulated by subjective value (i.e., individuals who showed a stronger PIT effect rated the value of rewards more highly), but not by reward type, demonstrating that stimuli of all reward types were able to act as appetitive reinforcers and influenced instrumental responding, when matched to the same subjective reward value. This is the first demonstration that individually matched monetary, food and social rewards are equally effective as appetitive reinforcers in PIT. These findings strengthen the hypotheses that the subjective value is crucial for how much reward-associated stimuli influence behavior. PMID:28101010

When performance and risk taking are related: Working for rewards is related to risk taking when the value of rewards is presented briefly.

PubMed

Veling, Harm; Bijleveld, Erik

2015-12-01

Valuable monetary rewards can boost human performance on various effortful tasks even when the value of the rewards is presented too briefly to allow for strategic decision making. However, the mechanism by which briefly-presented reward information influences performance has remained unclear. One possibility is that performance after briefly-presented reward information is primarily boosted via activation of the dopamine reward system, whereas performance after very visible reward information is driven more by strategic processes. To examine this hypothesis, we first presented participants with a task in which they could earn rewards of relatively low (1 cent) or high (10 cents) value, and the value information was presented either briefly (17 ms) or for an extended duration (300 ms). Furthermore, responsiveness of the dopamine system was indirectly estimated with a measure of risk taking, the Balloon Analogue Risk Task (BART). Results showed that performance after high- compared to low-value rewards was indeed related to the BART scores only when reward information was presented briefly. These results are suggestive of the possibility that brief presentation of reward information boosts performance directly via activating the dopamine system, whereas extended presentation of reward information leads to more strategic reward-driven behavior. Copyright © 2015 Elsevier Inc. All rights reserved.

Differential patterns of nucleus accumbens activation during anticipation of monetary and social reward in young and older adults

PubMed Central

Salama, Aallaa; Gründer, Gerhard; Spreckelmeyer, Katja N.

2014-01-01

Recent studies have reported inconsistent results regarding the loss of reward sensitivity in the aging brain. Although such an age effect might be due to a decline of physiological processes, it may also be a consequence of age-related changes in motivational preference for different rewards. Here, we examined whether the age effects on neural correlates of reward anticipation are modulated by the type of expected reward. Functional magnetic resonance images were acquired in 24 older (60–78 years) and 24 young participants (20–28 years) while they performed an incentive delay task offering monetary or social rewards. Anticipation of either reward type recruited brain structures associated with reward, including the nucleus accumbens (NAcc). Region of interest analysis revealed an interaction effect of reward type and age group in the right NAcc: enhanced activation to cues of social reward was detected in the older subsample while enhanced activation to cues of monetary reward was detected in the younger subsample. Our results suggest that neural sensitivity to reward-predicting cues does not generally decrease with age. Rather, neural responses in the NAcc appear to be modulated by the type of reward, presumably reflecting age-related changes in motivational value attributed to different types of reward. PMID:23547243

Reward-based plasticity of spatial priority maps: Exploiting inter-subject variability to probe the underlying neurobiology.

PubMed

Della Libera, Chiara; Calletti, Riccardo; Eštočinová, Jana; Chelazzi, Leonardo; Santandrea, Elisa

2017-04-01

Recent evidence indicates that the attentional priority of objects and locations is altered by the controlled delivery of reward, reflecting reward-based attentional learning. Here, we take an approach hinging on intersubject variability to probe the neurobiological bases of the reward-driven plasticity of spatial priority maps. Specifically, we ask whether an individual's susceptibility to the reward-based treatment can be accounted for by specific predictors, notably personality traits that are linked to reward processing (along with more general personality traits), but also gender. Using a visual search protocol, we show that when different target locations are associated with unequal reward probability, different priorities are acquired by the more rewarded relative to the less rewarded locations. However, while males exhibit the expected pattern of results, with greater priority for locations associated with higher reward, females show an opposite trend. Critically, both the extent and the direction of reward-based adjustments are further predicted by personality traits indexing reward sensitivity, indicating that not only male and female brains are differentially sensitive to reward, but also that specific personality traits further contribute to shaping their learning-dependent attentional plasticity. These results contribute to a better understanding of the neurobiology underlying reward-dependent attentional learning and cross-subject variability in this domain.

Reward inference by primate prefrontal and striatal neurons.

PubMed

Pan, Xiaochuan; Fan, Hongwei; Sawa, Kosuke; Tsuda, Ichiro; Tsukada, Minoru; Sakagami, Masamichi

2014-01-22

The brain contains multiple yet distinct systems involved in reward prediction. To understand the nature of these processes, we recorded single-unit activity from the lateral prefrontal cortex (LPFC) and the striatum in monkeys performing a reward inference task using an asymmetric reward schedule. We found that neurons both in the LPFC and in the striatum predicted reward values for stimuli that had been previously well experienced with set reward quantities in the asymmetric reward task. Importantly, these LPFC neurons could predict the reward value of a stimulus using transitive inference even when the monkeys had not yet learned the stimulus-reward association directly; whereas these striatal neurons did not show such an ability. Nevertheless, because there were two set amounts of reward (large and small), the selected striatal neurons were able to exclusively infer the reward value (e.g., large) of one novel stimulus from a pair after directly experiencing the alternative stimulus with the other reward value (e.g., small). Our results suggest that although neurons that predict reward value for old stimuli in the LPFC could also do so for new stimuli via transitive inference, those in the striatum could only predict reward for new stimuli via exclusive inference. Moreover, the striatum showed more complex functions than was surmised previously for model-free learning.

Reward Inference by Primate Prefrontal and Striatal Neurons

PubMed Central

Pan, Xiaochuan; Fan, Hongwei; Sawa, Kosuke; Tsuda, Ichiro; Tsukada, Minoru

2014-01-01

The brain contains multiple yet distinct systems involved in reward prediction. To understand the nature of these processes, we recorded single-unit activity from the lateral prefrontal cortex (LPFC) and the striatum in monkeys performing a reward inference task using an asymmetric reward schedule. We found that neurons both in the LPFC and in the striatum predicted reward values for stimuli that had been previously well experienced with set reward quantities in the asymmetric reward task. Importantly, these LPFC neurons could predict the reward value of a stimulus using transitive inference even when the monkeys had not yet learned the stimulus–reward association directly; whereas these striatal neurons did not show such an ability. Nevertheless, because there were two set amounts of reward (large and small), the selected striatal neurons were able to exclusively infer the reward value (e.g., large) of one novel stimulus from a pair after directly experiencing the alternative stimulus with the other reward value (e.g., small). Our results suggest that although neurons that predict reward value for old stimuli in the LPFC could also do so for new stimuli via transitive inference, those in the striatum could only predict reward for new stimuli via exclusive inference. Moreover, the striatum showed more complex functions than was surmised previously for model-free learning. PMID:24453328

Components of reward-driven attentional capture.

PubMed

Sha, Li Z; Jiang, Yuhong V

2016-02-01

Recent research reported that task-irrelevant colors captured attention if these colors previously served as search targets and received high monetary reward. We showed that both monetary reward and value-independent mechanisms influenced selective attention. Participants searched for two potential target colors among distractor colors in the training phase. Subsequently, they searched for a shape singleton in a testing phase. Experiment 1 found that participants were slower in the testing phase if a distractor of a previous target color was present rather than absent. Such slowing was observed even when no monetary reward was used during training. Experiment 2 associated monetary rewards with the target colors during the training phase. Participants were faster finding the target associated with higher monetary reward. However, reward training did not yield value-dependent attentional capture in the testing phase. Attentional capture by the previous target colors was not significantly greater for the previously high-reward color than the previously low or no-reward color. These findings revealed both the power and limitations of monetary reward on attention. Although monetary reward can increase attentional priority for the high-reward target during training, subsequent attentional capture effects may not be reward-based, but reflect, in part, attentional capture by previous targets.

Extinction and renewal of cue-elicited reward-seeking.

PubMed

Bezzina, Louise; Lee, Jessica C; Lovibond, Peter F; Colagiuri, Ben

2016-12-01

Reward cues can contribute to overconsumption of food and drugs and can relapse. The failure of exposure therapies to reduce overconsumption and relapse is generally attributed to the context-specificity of extinction. However, no previous study has examined whether cue-elicited reward-seeking (as opposed to cue-reactivity) is sensitive to context renewal. We tested this possibility in 160 healthy volunteers using a Pavlovian-instrumental transfer (PIT) design involving voluntary responding for a high value natural reward (chocolate). One reward cue underwent Pavlovian extinction in the same (Group AAA) or different context (Group ABA) to all other phases. This cue was compared with a second non-extinguished reward cue and an unpaired control cue. There was a significant overall PIT effect with both reward cues eliciting reward-seeking on test relative to the unpaired cue. Pavlovian extinction substantially reduced this effect, with the extinguished reward cue eliciting less reward-seeking than the non-extinguished reward cue. Most interestingly, extinction of cue-elicited reward-seeking was sensitive to renewal, with extinction less effective for reducing PIT when conducted in a different context. These findings have important implications for extinction-based interventions for reducing maladaptive reward-seeking in practice. Copyright © 2016 Elsevier Ltd. All rights reserved.

Reward Draws the Eye, Uncertainty Holds the Eye: Associative Learning Modulates Distractor Interference in Visual Search

PubMed Central

Koenig, Stephan; Kadel, Hanna; Uengoer, Metin; Schubö, Anna; Lachnit, Harald

2017-01-01

Stimuli in our sensory environment differ with respect to their physical salience but moreover may acquire motivational salience by association with reward. If we repeatedly observed that reward is available in the context of a particular cue but absent in the context of another cue the former typically attracts more attention than the latter. However, we also may encounter cues uncorrelated with reward. A cue with 50% reward contingency may induce an average reward expectancy but at the same time induces high reward uncertainty. In the current experiment we examined how both values, reward expectancy and uncertainty, affected overt attention. Two different colors were established as predictive cues for low reward and high reward respectively. A third color was followed by high reward on 50% of the trials and thus induced uncertainty. Colors then were introduced as distractors during search for a shape target, and we examined the relative potential of the color distractors to capture and hold the first fixation. We observed that capture frequency corresponded to reward expectancy while capture duration corresponded to uncertainty. The results may suggest that within trial reward expectancy is represented at an earlier time window than uncertainty. PMID:28744206

Attention to nurses' rewarding - an interview study of registered nurses working in primary and private healthcare in Finland.

PubMed

Seitovirta, Jaana; Vehviläinen-Julkunen, Katri; Mitronen, Lasse; De Gieter, Sara; Kvist, Tarja

2017-04-01

To identify meaningful types of rewards and the consequences of rewards as expressed by Finnish registered nurses working in primary and private healthcare. Previous studies have found significant associations between nurses' rewards and both their commitment and job satisfaction. Furthermore, appropriate rewards can have beneficial effects on factors including workforce stability and occupational satisfaction that are highly important in times of nurse shortages. A cross-sectional, qualitative interview study. Data were collected via individual semi-structured interviews (n = 20) with registered nurses working in Finland's primary and private healthcare, and subjected to qualitative content analysis. Six meaningful types of rewards were identified by the registered nurses: Financial compensation and benefits, Work-Life balance, Work content, Professional development, Recognition, and Supportive leadership. Rewards encouraged respondents to perform their work correctly and reinforced occupational satisfaction, but also caused feelings of envy and stress. It is essential to pay attention to nurses' preferences for particular rewards and to reward management. When designing effective reward systems for registered nurses, it is not sufficient to provide financial rewards alone, as various kinds of non-financial rewards are both meaningful and necessary. When trying to improve registered nurses' commitment and job satisfaction through reward management, it is important to listen to nurses' opinions to create a reward system that integrates financial and non-financial rewards and is fair from their perspective. Healthcare organisations that offer registered nurses a holistic reward system are more likely to retain satisfied and committed nurses at a time of increasing nursing shortages. © 2016 John Wiley & Sons Ltd.

Mesolimbic recruitment by nondrug rewards in detoxified alcoholics: effort anticipation, reward anticipation, and reward delivery.

PubMed

Bjork, James M; Smith, Ashley R; Chen, Gang; Hommer, Daniel W

2012-09-01

Aberrant sensitivity of incentive neurocircuitry to nondrug rewards has been suggested as either a risk factor for or consequence of drug addiction. Using functional magnetic resonance imaging, we tested whether alcohol-dependent patients (ADP: n = 29) showed altered recruitment of ventral striatal (VS) incentive neurocircuitry compared to controls (n = 23) by: (1) cues to respond for monetary rewards, (2) post-response anticipation of rewards, or (3) delivery of rewards. Using an instrumental task with two-stage presentation of reward-predictive information, subjects saw cues signaling opportunities to win $0, $1, or $10 for responding to a target. Following this response, subjects were notified whether their success would be indicated by a lexical notification (“Hit?”) or by delivery of a monetary reward (“Win?”). After a variable interval, subjects then viewed the trial outcome. We found no significant group differences in voxelwise activation by task contrasts, or in signal change extracted from VS. Both ADP and controls showed significant VS and other limbic recruitment by pre-response reward anticipation. In addition, controls also showed VS recruitment by post-response reward-anticipation, and ADP had appreciable subthreshold VS activation. Both groups also showed similar mesolimbic responses to reward deliveries. Across all subjects, a questionnaire measure of “hot” impulsivity correlated with VS recruitment by post-response anticipation of low rewards and with VS recruitment by delivery of low rewards. These findings indicate that incentive-motivational processing of nondrug rewards is substantially maintained in recovering alcoholics, and that reward-elicited VS recruitment correlates more with individual differences in trait impulsivity irrespective of addiction.

Cigarette craving is associated with blunted reward processing in nicotine-dependent smokers.

PubMed

Peechatka, Alyssa L; Whitton, Alexis E; Farmer, Stacey L; Pizzagalli, Diego A; Janes, Amy C

2015-10-01

Dysfunctional reward processing leading to the undervaluation of non-drug rewards is hypothesized to play a crucial role in nicotine dependence. However, it is unclear if blunted reward responsivity and the desire to use nicotine are directly linked after a brief period of abstinence. Such an association would suggest that individuals with reduced reward responsivity may be at increased risk to experience nicotine craving. Reward function was evaluated with a probabilistic reward task (PRT), which measures reward responsivity to monetary incentives. To identify whether smoking status influenced reward function, PRT performance was compared between non-depressed, nicotine-dependent smokers and non-smokers. Within smokers, correlations were conducted to determine if blunted reward responsivity on the PRT was associated with increased nicotine craving. Time since last nicotine exposure was standardized to 4h for all smokers. Smokers and non-smokers did not differ in reward responsivity on the PRT. However, within smokers, a significant negative correlation was found between reward responsivity and intensity of nicotine craving. The current findings show that, among smokers, the intensity of nicotine craving is linked to lower sensitivity to non-drug rewards. This finding is in line with prior theories that suggest reward dysfunction in some clinical populations (e.g., depressive disorders, schizophrenia) may facilitate nicotine use. The current study expands on such theories by indicating that sub-clinical variations in reward function are related to motivation for nicotine use. Identifying smokers who show blunted sensitivity to non-drug rewards may help guide treatments aimed at mitigating the motivation to smoke. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Monetary reward magnitude effects on behavior and brain function during goal-directed behavior.

PubMed

Rosell-Negre, P; Bustamante, J C; Fuentes-Claramonte, P; Costumero, V; Benabarre, S; Barrós-Loscertales, A

2017-08-01

Reward may modulate the cognitive processes required for goal achievement, while individual differences in personality may affect reward modulation. Our aim was to test how different monetary reward magnitudes modulate brain activation and performance during goal-directed behavior, and whether individual differences in reward sensitivity affect this modulation. For this purpose, we scanned 37 subjects with a parametric design in which we varied the magnitude of monetary rewards (€0, €0.01, €0.5, €1 or €1.5) in a blocked fashion while participants performed an interference counting-Stroop condition. The results showed that the brain activity of left dorsolateral prefrontal cortex (DLPFC) and the striatum were modulated by increasing and decreasing reward magnitudes, respectively. Behavioral performance improved as the magnitude of monetary reward increased while comparing the non reward (€0) condition to any other reward condition, or the lower €0.01 to any other reward condition, and this improvement was related with individual differences in reward sensitivity. In conclusion, the locus of influence of monetary incentives overlaps the activity of the regions commonly involved in cognitive control.

Adaptive neural reward processing during anticipation and receipt of monetary rewards in mindfulness meditators.

PubMed

Kirk, Ulrich; Brown, Kirk Warren; Downar, Jonathan

2015-05-01

Reward seeking is ubiquitous and adaptive in humans. But excessive reward seeking behavior, such as chasing monetary rewards, may lead to diminished subjective well-being. This study examined whether individuals trained in mindfulness meditation show neural evidence of lower susceptibility to monetary rewards. Seventy-eight participants (34 meditators, 44 matched controls) completed the monetary incentive delay task while undergoing functional magnetic resonance imaging. The groups performed equally on the task, but meditators showed lower neural activations in the caudate nucleus during reward anticipation, and elevated bilateral posterior insula activation during reward anticipation. Meditators also evidenced reduced activations in the ventromedial prefrontal cortex during reward receipt compared with controls. Connectivity parameters between the right caudate and bilateral anterior insula were attenuated in meditators during incentive anticipation. In summary, brain regions involved in reward processing-both during reward anticipation and receipt of reward-responded differently in mindfulness meditators than in nonmeditators, indicating that the former are less susceptible to monetary incentives. © The Author (2014). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Common and distinct networks underlying reward valence and processing stages: A meta-analysis of functional neuroimaging studies

PubMed Central

Liu, Xun; Hairston, Jacqueline; Schrier, Madeleine; Fan, Jin

2011-01-01

To better understand the reward circuitry in human brain, we conducted activation likelihood estimation (ALE) and parametric voxel-based meta-analyses (PVM) on 142 neuroimaging studies that examined brain activation in reward-related tasks in healthy adults. We observed several core brain areas that participated in reward-related decision making, including the nucleus accumbens (NAcc), caudate, putamen, thalamus, orbitofrontal cortex (OFC), bilateral anterior insula, anterior (ACC) and posterior (PCC) cingulate cortex, as well as cognitive control regions in the inferior parietal lobule and prefrontal cortex (PFC). The NAcc was commonly activated by both positive and negative rewards across various stages of reward processing (e.g., anticipation, outcome, and evaluation). In addition, the medial OFC and PCC preferentially responded to positive rewards, whereas the ACC, bilateral anterior insula, and lateral PFC selectively responded to negative rewards. Reward anticipation activated the ACC, bilateral anterior insula, and brain stem, whereas reward outcome more significantly activated the NAcc, medial OFC, and amygdala. Neurobiological theories of reward-related decision making should therefore distributed and interrelated representations of reward valuation and valence assessment into account. PMID:21185861

Neural dynamics of reward probability coding: a Magnetoencephalographic study in humans

PubMed Central

Thomas, Julie; Vanni-Mercier, Giovanna; Dreher, Jean-Claude

2013-01-01

Prediction of future rewards and discrepancy between actual and expected outcomes (prediction error) are crucial signals for adaptive behavior. In humans, a number of fMRI studies demonstrated that reward probability modulates these two signals in a large brain network. Yet, the spatio-temporal dynamics underlying the neural coding of reward probability remains unknown. Here, using magnetoencephalography, we investigated the neural dynamics of prediction and reward prediction error computations while subjects learned to associate cues of slot machines with monetary rewards with different probabilities. We showed that event-related magnetic fields (ERFs) arising from the visual cortex coded the expected reward value 155 ms after the cue, demonstrating that reward value signals emerge early in the visual stream. Moreover, a prediction error was reflected in ERF peaking 300 ms after the rewarded outcome and showing decreasing amplitude with higher reward probability. This prediction error signal was generated in a network including the anterior and posterior cingulate cortex. These findings pinpoint the spatio-temporal characteristics underlying reward probability coding. Together, our results provide insights into the neural dynamics underlying the ability to learn probabilistic stimuli-reward contingencies. PMID:24302894

A neuronal reward inequity signal in primate striatum

PubMed Central

van Coeverden, Charlotte R.; Schultz, Wolfram

2015-01-01

Primates are social animals, and their survival depends on social interactions with others. Especially important for social interactions and welfare is the observation of rewards obtained by other individuals and the comparison with own reward. The fundamental social decision variable for the comparison process is reward inequity, defined by an asymmetric reward distribution among individuals. An important brain structure for coding reward inequity may be the striatum, a component of the basal ganglia involved in goal-directed behavior. Two rhesus monkeys were seated opposite each other and contacted a touch-sensitive table placed between them to obtain specific magnitudes of reward that were equally or unequally distributed among them. Response times in one of the animals demonstrated differential behavioral sensitivity to reward inequity. A group of neurons in the striatum showed distinct signals reflecting disadvantageous and advantageous reward inequity. These neuronal signals occurred irrespective of, or in conjunction with, own reward coding. These data demonstrate that striatal neurons of macaque monkeys sense the differences between other's and own reward. The neuronal activities are likely to contribute crucial reward information to neuronal mechanisms involved in social interactions. PMID:26378202

"I'll have one of each": how separating rewards into (meaningless) categories increases motivation.

PubMed

Wiltermuth, Scott S; Gino, Francesca

2013-01-01

We propose that separating rewards into categories can increase motivation, even when those categories are meaningless. Across six experiments, people were more motivated to obtain one reward from one category and another reward from another category than they were to obtain two rewards from a pool that included all items from either reward category. As a result, they worked longer when potential rewards for their work were separated into meaningless categories. This categorization effect persisted regardless of whether the rewards were presented using a gain or loss frame. Using both moderation and mediation analyses, we found that categorizing rewards had these positive effects on motivation by increasing the degree to which people felt they would "miss out" if they did not obtain the second reward. We discuss implications for research on motivation and incentives.

Three real-time architectures - A study using reward models

NASA Technical Reports Server (NTRS)

Sjogren, J. A.; Smith, R. M.

1990-01-01

Numerous applications in the area of computer system analysis can be effectively studied with Markov reward models. These models describe the evolutionary behavior of the computer system by a continuous-time Markov chain, and a reward rate is associated with each state. In reliability/availability models, upstates have reward rate 1, and down states have reward rate zero associated with them. In a combined model of performance and reliability, the reward rate of a state may be the computational capacity, or a related performance measure. Steady-state expected reward rate and expected instantaneous reward rate are clearly useful measures which can be extracted from the Markov reward model. The diversity of areas where Markov reward models may be used is illustrated with a comparative study of three examples of interest to the fault tolerant computing community.

Reward modulates oculomotor competition between differently valued stimuli.

PubMed

Bucker, Berno; Silvis, Jeroen D; Donk, Mieke; Theeuwes, Jan

2015-03-01

The present work explored the effects of reward in the well-known global effect paradigm in which two objects appear simultaneously in close spatial proximity. The experiment consisted of three phases (i) a pre-training phase that served as a baseline, (ii) a reward-training phase to associate differently colored stimuli with high, low and no reward value, and (iii) a post-training phase in which rewards were no longer delivered, to examine whether objects previously associated with higher reward value attracted the eyes more strongly than those associated with low or no reward value. Unlike previous reward studies, the differently valued objects directly competed with each other on the same trial. The results showed that initially eye movements were not biased towards any particular stimulus, while in the reward-training phase, eye movements started to land progressively closer towards stimuli that were associated with a high reward value. Even though rewards were no longer delivered, this bias remained robustly present in the post-training phase. A time course analysis showed that the effect of reward was present for the fastest saccades (around 170 ms) and increased with increasing latency. Although strategic effects for slower saccades cannot be ruled out, we suggest that fast oculomotor responses became habituated and were no longer under strategic attentional control. Together the results imply that reward affects oculomotor competition in favor of stimuli previously associated high reward, when multiple reward associated objects compete for selection. Copyright © 2015 Elsevier Ltd. All rights reserved.

Atypical valuation of monetary and cigarette rewards in substance dependent smokers.

PubMed

Baker, Travis E; Wood, Jonathan M A; Holroyd, Clay B

2016-02-01

Substance dependent (SD) relative to non-dependent (ND) individuals exhibit an attenuated reward positivity, an electrophysiological signal believed to index sensitivity of anterior cingulate cortex (ACC) to rewards. Here we asked whether this altered neural response reflects a specific devaluation of monetary rewards relative to drug-related rewards by ACC. We recorded the reward positivity from SD and ND individuals who currently smoke, following an overnight period of abstinence, while they engaged in two feedback tasks. In a money condition the feedback indicated either a monetary reward or no reward, and in a cigarette condition the feedback indicated either a drug-related reward or no reward. Overall, cigarette relative to monetary rewards elicited a larger reward positivity. Further, for the subjects who engaged in the money condition first, the reward positivity was smaller for the SD compared to the ND participants, but for the subjects who engaged in the cigarette condition first, the reward positivity was larger for the SD compared to the ND participants. Our results suggest that the initial category of feedback "primed" the response of the ACC to the alternative feedback type on subsequent trials, and that SD and ND individuals responded differently to this priming effect. We propose that for people who misuse addictive substances, the prospect of obtaining drug-related rewards engages the ACC to exert control over extended behaviors. Copyright © 2015 International Federation of Clinical Neurophysiology. Published by Elsevier Ireland Ltd. All rights reserved.

Deficits in context-dependent adaptive coding of reward in schizophrenia

PubMed Central

Kirschner, Matthias; Hager, Oliver M; Bischof, Martin; Hartmann-Riemer, Matthias N; Kluge, Agne; Seifritz, Erich; Tobler, Philippe N; Kaiser, Stefan

2016-01-01

Theoretical principles of information processing and empirical findings suggest that to efficiently represent all possible rewards in the natural environment, reward-sensitive neurons have to adapt their coding range dynamically to the current reward context. Adaptation ensures that the reward system is most sensitive for the most likely rewards, enabling the system to efficiently represent a potentially infinite range of reward information. A deficit in neural adaptation would prevent precise representation of rewards and could have detrimental effects for an organism’s ability to optimally engage with its environment. In schizophrenia, reward processing is known to be impaired and has been linked to different symptom dimensions. However, despite the fundamental significance of coding reward adaptively, no study has elucidated whether adaptive reward processing is impaired in schizophrenia. We therefore studied patients with schizophrenia (n=27) and healthy controls (n=25), using functional magnetic resonance imaging in combination with a variant of the monetary incentive delay task. Compared with healthy controls, patients with schizophrenia showed less efficient neural adaptation to the current reward context, which leads to imprecise neural representation of reward. Importantly, the deficit correlated with total symptom severity. Our results suggest that some of the deficits in reward processing in schizophrenia might be due to inefficient neural adaptation to the current reward context. Furthermore, because adaptive coding is a ubiquitous feature of the brain, we believe that our findings provide an avenue in defining a general impairment in neural information processing underlying this debilitating disorder. PMID:27430009

Reward Anticipation in Ventral Striatum and Individual Sensitivity to Reward: A Pilot Study of a Child-Friendly fMRI Task.

PubMed

van Hulst, Branko M; de Zeeuw, Patrick; Lupas, Kellina; Bos, Dienke J; Neggers, Sebastiaan F W; Durston, Sarah

2015-01-01

Reward processing has been implicated in developmental disorders. However, the classic task to probe reward anticipation, the monetary incentive delay task, has an abstract coding of reward and no storyline and may therefore be less appropriate for use with developmental populations. We modified the task to create a version appropriate for use with children. We investigated whether this child-friendly version could elicit ventral striatal activation during reward anticipation in typically developing children and young adolescents (aged 9.5-14.5). In addition, we tested whether our performance-based measure of reward sensitivity was associated with anticipatory activity in ventral striatum. Reward anticipation was related to activity in bilateral ventral striatum. Moreover, we found an association between individual reward sensitivity and activity in ventral striatum. We conclude that this task assesses ventral striatal activity in a child-friendly paradigm. The combination with a performance-based measure of reward sensitivity potentially makes the task a powerful tool for developmental imaging studies of reward processing.

It's about time: Earlier rewards increase intrinsic motivation.

PubMed

Woolley, Kaitlin; Fishbach, Ayelet

2018-06-01

Can immediate (vs. delayed) rewards increase intrinsic motivation? Prior research compared the presence versus absence of rewards. By contrast, this research compared immediate versus delayed rewards, predicting that more immediate rewards increase intrinsic motivation by creating a perceptual fusion between the activity and its goal (i.e., the reward). In support of the hypothesis, framing a reward from watching a news program as more immediate (vs. delayed) increased intrinsic motivation to watch the program (Study 1), and receiving more immediate bonus (vs. delayed, Study 2; and vs. delayed and no bonus, Study 3) increased intrinsic motivation in an experimental task. The effect of reward timing was mediated by the strength of the association between an activity and a reward, and was specific to intrinsic (vs. extrinsic) motivation-immediacy influenced the positive experience of an activity, but not perceived outcome importance (Study 4). In addition, the effect of the timing of rewards was independent of the effect of the magnitude of the rewards (Study 5). (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Distinct Roles for the Amygdala and Orbitofrontal Cortex in Representing the Relative Amount of Expected Reward.

PubMed

Saez, Rebecca A; Saez, Alexandre; Paton, Joseph J; Lau, Brian; Salzman, C Daniel

2017-07-05

The same reward can possess different motivational meaning depending upon its magnitude relative to other rewards. To study the neurophysiological mechanisms mediating assignment of motivational meaning, we recorded the activity of neurons in the amygdala and orbitofrontal cortex (OFC) of monkeys during a Pavlovian task in which the relative amount of liquid reward associated with one conditioned stimulus (CS) was manipulated by changing the reward amount associated with a second CS. Anticipatory licking tracked relative reward magnitude, implying that monkeys integrated information about recent rewards to adjust the motivational meaning of a CS. Upon changes in relative reward magnitude, neural responses to reward-predictive cues updated more rapidly in OFC than amygdala, and activity in OFC but not the amygdala was modulated by recent reward history. These results highlight a distinction between the amygdala and OFC in assessing reward history to support the flexible assignment of motivational meaning to sensory cues. Copyright © 2017 Elsevier Inc. All rights reserved.

Facilitation of voluntary goal-directed action by reward cues.

PubMed

Lovibond, Peter F; Colagiuri, Ben

2013-10-01

Reward-associated cues are known to influence motivation to approach both natural and man-made rewards, such as food and drugs. However, the mechanisms underlying these effects are not well understood. To model these processes in the laboratory with humans, we developed an appetitive Pavlovian-instrumental transfer procedure with a chocolate reward. We used a single unconstrained response that led to an actual rather than symbolic reward to assess the strength of reward motivation. Presentation of a chocolate-paired cue, but not an unpaired cue, markedly enhanced instrumental responding over a 30-s period. The same pattern was observed with 10-s and 30-s cues, showing that close cue-reward contiguity is not necessary for facilitation of reward-directed action. The results confirm that reward-related cues can instigate voluntary action to obtain that reward. The effectiveness of long-duration cues suggests that in clinical settings, attention should be directed to both proximal and distal cues for reward.

Nectar quality perception by honey bees (Apis mellifera ligustica).

PubMed

Sanderson, Charlotte E; Cook, Peyton; Hill, Peggy S M; Orozco, Benjamin S; Abramson, Charles I; Wells, Harrington

2013-11-01

In exploring how foragers perceive rewards, we often find that well-motivated individuals are not too choosy and unmotivated individuals are unreliable and inconsistent. Nevertheless, when given a choice we see that individuals can clearly distinguish between rewards. Here we develop the logic of using responses to two-choice problems as a derivative function of perceived reward, and utilize this model to examine honey bee perception of nectar quality. Measuring the derivative allows us to deduce the perceived reward function. The derivative function of the perceived reward equation gives the rate of change of the reward perceived for each reward value. This approach depends on presenting free-flying foragers with a series of two different rewards presented simultaneously (i.e., two-choice, binomial tests). We also examine how honey bees integrate information from a range of reward qualities to formulate a functional response. Results suggest that honey bees overestimate higher quality rewards and that direct comparison is an important step in the integration of information from a range of rewards.

Differential patterns of nucleus accumbens activation during anticipation of monetary and social reward in young and older adults.

PubMed

Rademacher, Lena; Salama, Aallaa; Gründer, Gerhard; Spreckelmeyer, Katja N

2014-06-01

Recent studies have reported inconsistent results regarding the loss of reward sensitivity in the aging brain. Although such an age effect might be due to a decline of physiological processes, it may also be a consequence of age-related changes in motivational preference for different rewards. Here, we examined whether the age effects on neural correlates of reward anticipation are modulated by the type of expected reward. Functional magnetic resonance images were acquired in 24 older (60-78 years) and 24 young participants (20-28 years) while they performed an incentive delay task offering monetary or social rewards. Anticipation of either reward type recruited brain structures associated with reward, including the nucleus accumbens (NAcc). Region of interest analysis revealed an interaction effect of reward type and age group in the right NAcc: enhanced activation to cues of social reward was detected in the older subsample while enhanced activation to cues of monetary reward was detected in the younger subsample. Our results suggest that neural sensitivity to reward-predicting cues does not generally decrease with age. Rather, neural responses in the NAcc appear to be modulated by the type of reward, presumably reflecting age-related changes in motivational value attributed to different types of reward. © The Author (2013). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Impaired Learning of Social Compared to Monetary Rewards in Autism

PubMed Central

Lin, Alice; Rangel, Antonio; Adolphs, Ralph

2012-01-01

A leading hypothesis to explain the social dysfunction in people with autism spectrum disorders (ASD) is that they exhibit a deficit in reward processing and motivation specific to social stimuli. However, there have been few direct tests of this hypothesis to date. Here we used an instrumental reward learning task that contrasted learning with social rewards (pictures of positive and negative faces) against learning with monetary reward (winning and losing money). The two tasks were structurally identical except for the type of reward, permitting direct comparisons. We tested 10 high-functioning people with ASD (7M, 3F) and 10 healthy controls who were matched on gender, age, and education. We found no significant differences between the two groups in terms of overall ability behaviorally to discriminate positive from negative slot machines, reaction-times, and valence ratings, However, there was a specific impairment in the ASD group in learning to choose social rewards, compared to monetary rewards: they had a significantly lower cumulative number of choices of the most rewarding social slot machine, and had a significantly slower initial learning rate for the socially rewarding slot machine, compared to the controls. The findings show a deficit in reward learning in ASD that is greater for social rewards than for monetary rewards, and support the hypothesis of a disproportionate impairment in social reward processing in ASD. PMID:23060743

Altered Reward Function in Adolescent Depression: What, When, and How?

PubMed Central

Forbes, Erika E.; Dahl, Ronald E.

2011-01-01

Background Conceptual models and recent evidence indicate that neural response to reward is altered in depression. Taking a developmental approach to investigating reward function in adolescent depression can elucidate the etiology, pathophysiology, and course of depression, a disorder that typically begins during adolescence and has high rates of recurrence. Methods This conceptual review describes the what, when, and how of altered reward function in adolescent depression. With the goal of generating new, testable hypotheses within a developmental affective neuroscience framework, we critically review findings and suggest future directions. Peer-reviewed empirical papers for inclusion in this critical review were obtained by searching PubMed, PsycInfo, and ScienceDirect for the years 1990–2010. Results A pattern of low striatal response and high medial prefrontal response to reward is evident in adolescents and adults with depression. Given the salience of social stimuli for positive affect and depression, reward function might be especially disrupted in response to social rewards. Because of changes in the dopamine system and reward function with aging, altered reward function in depression might be more evident during adolescence than later in life; however, low reward function may also be a stable characteristic of people who experience depression. Mechanisms of altered reward function in depression could include disrupted balance of corticostriatal circuit function, with disruption occurring as aberrant adolescent brain development. Conclusions Future studies should examine responses to social rewards; employ longitudinal and prospective designs; and investigate patterns of functional connectivity in reward circuits. Understanding altered reward function in depression has potential implications for treatment development. A more rigorous approach to investigating anhedonia, threat-reward interactions, and comorbid anxiety will be valuable to future progress in describing the role of reward function in the pathophysiology of depression. PMID:22117893

Effects of reward and punishment on brain activations associated with inhibitory control in cigarette smokers.

PubMed

Luijten, Maartje; O'Connor, David A; Rossiter, Sarah; Franken, Ingmar H A; Hester, Robert

2013-11-01

Susceptibility to use of addictive substances may result, in part, from a greater preference for an immediate small reward relative to a larger delayed reward or relative insensitivity to punishment. This functional magnetic resonance imaging (fMRI) study examined the neural basis of inhibiting an immediately rewarding stimulus to obtain a larger delayed reward in smokers. We also investigated whether punishment could modulate inhibitory control. The Monetary Incentive Go/NoGo (MI-Go/NoGo) task was administered that provided three types of reward outcomes contingent upon inhibitory control performance over rewarding stimuli: inhibition failure was either followed by no monetary reward (neutral condition), a small monetary reward with immediate feedback (reward condition) or immediate monetary punishment (punishment condition). In the reward and punishment conditions, successful inhibitory control resulted in larger delayed rewards. Community sample of smokers in the Melbourne (Australia) area. Nineteen smokers were compared with 17 demographically matched non-smoking controls. Accuracy, reaction times and brain activation associated with the MI-Go/NoGo task. Smokers showed hyperactivation in the right insula (P < 0.01), inferior and middle frontal gyrus (P < 0.01), dorsolateral prefrontal cortex (P = 0.001) and inferior parietal lobe (P < 0.01) both during inhibition of an immediately rewarding stimulus to obtain a larger delayed reward, and during inhibition of neutral stimuli. Group differences in brain activity were not significant in the punishment condition in the right insula and dorsolateral prefrontal cortex, most probably as a result of increased activation in non-smoking controls. Compared with non-smokers, smokers showed increased neural activation when resisting immediately rewarding stimuli and may be less sensitive to punishment as a strategy to increase control over rewarding stimuli. © 2013 Society for the Study of Addiction.

Mesolimbic recruitment by nondrug rewards in detoxified alcoholics: effort anticipation, reward anticipation and reward delivery

PubMed Central

Bjork, James M.; Smith, Ashley R.; Chen, Gang; Hommer, Daniel W.

2011-01-01

Aberrant sensitivity of incentive neurocircuitry to nondrug rewards has been suggested as either a risk factor for or consequence of drug addiction. Using functional magnetic resonance imaging, we tested whether alcohol-dependent patients (ADP: n = 29) showed altered recruitment of ventral striatal (VS) incentive neurocircuitry compared to controls (n = 23) by: 1) cues to respond for monetary rewards, 2) post-response anticipation of rewards, or 3) delivery of rewards. Using an instrumental task with two-stage presentation of reward-predictive information, subjects saw cues signaling opportunities to win $0, $1, or $10 for responding to a target. Following this response, subjects were notified whether their success would be indicated by a lexical notification (“Hit?”) or by delivery of a monetary reward (“Win?”). After a variable interval, subjects then viewed the trial outcome. We found no significant group differences in voxelwise activation by task contrasts, or in signal change extracted from VS. Both ADP and controls showed significant VS and other limbic recruitment by pre-response reward anticipation. In addition, controls also showed VS recruitment by post-response reward-anticipation, and ADP had appreciable subthreshold VS activation. Both groups also showed similar mesolimbic responses to reward deliveries. Across all subjects, a questionnaire measure of “hot” impulsivity correlated with VS recruitment by post-response anticipation of low rewards and with VS recruitment by delivery of low rewards. These findings indicate that incentive-motivational processing of nondrug rewards is substantially maintained in recovering alcoholics, and that reward-elicited VS recruitment correlates more with individual differences in trait impulsivity irrespective of addiction. PMID:22281932

Effects of motivation on reward and attentional networks: an fMRI study.

PubMed

Ivanov, Iliyan; Liu, Xun; Clerkin, Suzanne; Schulz, Kurt; Friston, Karl; Newcorn, Jeffrey H; Fan, Jin

2012-11-01

Existing evidence suggests that reward and attentional networks function in concert and that activation in one system influences the other in a reciprocal fashion; however, the nature of these influences remains poorly understood. We therefore developed a three-component task to assess the interaction effects of reward anticipation and conflict resolution on the behavioral performance and the activation of brain reward and attentional systems. Sixteen healthy adult volunteers aged 21-45 years were scanned with functional magnetic resonance imaging (fMRI) while performing the task. A two-way repeated measures analysis of variance (ANOVA) with cue (reward vs. non-reward) and target (congruent vs. incongruent) as within-subjects factors was used to test for main and interaction effects. Neural responses to anticipation, conflict, and reward outcomes were tested. Behaviorally there were main effects of both reward cue and target congruency on reaction time. Neuroimaging results showed that reward anticipation and expected reward outcomes activated components of the attentional networks, including the inferior parietal and occipital cortices, whereas surprising non-rewards activated the frontoinsular cortex bilaterally and deactivated the ventral striatum. In turn, conflict activated a broad network associated with cognitive control and motor functions. Interaction effects showed decreased activity in the thalamus, anterior cingulated gyrus, and middle frontal gyrus bilaterally when difficult conflict trials (e.g., incongruent targets) were preceded by reward cues; in contrast, the ventral striatum and orbitofrontal cortex showed greater activation during congruent targets preceded by reward cues. These results suggest that reward anticipation is associated with lower activation in attentional networks, possibly due to increased processing efficiency, whereas more difficult, conflict trials are associated with lower activity in regions of the reward system, possibly because such trials are experienced as less rewarding.

Common alterations in sensitivity to type but not amount of reward in ADHD and autism spectrum disorders.

PubMed

Demurie, Ellen; Roeyers, Herbert; Baeyens, Dieter; Sonuga-Barke, Edmund

2011-11-01

Children with attention deficit/hyperactivity disorder (ADHD) display abnormalities in reward processing. Most reward studies have focused on the effects of material or monetary rewards. Studies with autism spectrum disorder (ASD) have focused on social rewards. In this study we compared the effects of amount and type of reward in children with ADHD and those with ASD. Two adapted versions of the Monetary Incentive Delay Task were used to study the effects of monetary and social reward anticipation on performance in 40 typically developing (TD) children and adolescents (8-16y), 35 children and adolescents with ADHD and 31 children and adolescents with ASD. Monetary and social reward improved accuracy and response time (RT) in all groups. The higher the anticipated reward, the more accurate and faster were responses. Independent of these effects, there was a differential effect of reward type. Both clinical groups, but not TD, responded faster for monetary than social rewards. The results, while not supporting hyposensitivity to changes in reward amount in ADHD and ASD, do suggest that both groups are generally less motivated in settings where social as opposed to monetary rewards can be earned. © 2011 The Authors. Journal of Child Psychology and Psychiatry. © 2011 Association for Child and Adolescent Mental Health.

Common and distinct neural features of social and non-social reward processing in autism and social anxiety disorder.

PubMed

Richey, John A; Rittenberg, Alison; Hughes, Lauren; Damiano, Cara R; Sabatino, Antoinette; Miller, Stephanie; Hanna, Eleanor; Bodfish, James W; Dichter, Gabriel S

2014-03-01

Autism spectrum disorders (ASDs) and social anxiety disorder (SAD) are both characterized by social dysfunction, but no study to date has compared neural responses to social rewards in ASDs and SAD. Neural responses during social and non-social reward anticipation and outcomes were examined in individuals with ASD (n = 16), SAD (n = 15) and a control group (n = 19) via functional magnetic resonance imaging. Analyses modeling all three groups revealed increased nucleus accumbens (NAc) activation in SAD relative to ASD during monetary reward anticipation, whereas both the SAD and ASD group demonstrated decreased bilateral NAc activation relative to the control group during social reward anticipation. During reward outcomes, the SAD group did not differ significantly from the other two groups in ventromedial prefrontal cortex activation to either reward type. Analyses comparing only the ASD and SAD groups revealed greater bilateral amygdala activation to social rewards in SAD relative to ASD during both anticipation and outcome phases, and the magnitude of left amygdala hyperactivation in the SAD group during social reward anticipation was significantly correlated with the severity of trait anxiety symptoms. Results suggest reward network dysfunction to both monetary and social rewards in SAD and ASD during reward anticipation and outcomes, but that NAc hypoactivation during monetary reward anticipation differentiates ASD from SAD.

Immaturities in Reward Processing and Its Influence on Inhibitory Control in Adolescence

PubMed Central

Terwilliger, R.; Teslovich, T.; Velanova, K.; Luna, B.

2010-01-01

The nature of immature reward processing and the influence of rewards on basic elements of cognitive control during adolescence are currently not well understood. Here, during functional magnetic resonance imaging, healthy adolescents and adults performed a modified antisaccade task in which trial-by-trial reward contingencies were manipulated. The use of a novel fast, event-related design enabled developmental differences in brain function underlying temporally distinct stages of reward processing and response inhibition to be assessed. Reward trials compared with neutral trials resulted in faster correct inhibitory responses across ages and in fewer inhibitory errors in adolescents. During reward trials, the blood oxygen level–dependent signal was attenuated in the ventral striatum in adolescents during cue assessment, then overactive during response preparation, suggesting limitations during adolescence in reward assessment and heightened reactivity in anticipation of reward compared with adults. Importantly, heightened activity in the frontal cortex along the precentral sulcus was also observed in adolescents during reward-trial response preparation, suggesting reward modulation of oculomotor control regions supporting correct inhibitory responding. Collectively, this work characterizes specific immaturities in adolescent brain systems that support reward processing and describes the influence of reward on inhibitory control. In sum, our findings suggest mechanisms that may underlie adolescents’ vulnerability to poor decision-making and risk-taking behavior. PMID:19875675

Neurons in Anterior Cingulate Cortex Multiplex Information about Reward and Action

PubMed Central

Hayden, Benjamin Y.; Platt, Michael L.

2010-01-01

The dorsal anterior cingulate cortex (dACC) is thought to play a critical role in forming associations between rewards and actions. Currently available physiological data, however, remain inconclusive regarding the question of whether dACC neurons carry information linking particular actions to reward or, instead, encode abstract reward information independent of specific actions. Here we show that firing rates of a majority of dACC neurons in a population studied in an eight-option variably rewarded choice task were sensitive to both saccade direction and reward value. Furthermore, the influences of reward and saccade direction on neuronal activity were roughly equal in magnitude over the range of rewards tested and were statistically independent. Our results indicate that dACC neurons multiplex information about both reward and action, endorsing the idea that this area links motivational outcomes to behavior and undermining the notion that its neurons solely contribute to reward processing in the abstract. PMID:20203193

I endeavor to make it: effort increases valuation of subsequent monetary reward.

PubMed

Ma, Qingguo; Meng, Liang; Wang, Lei; Shen, Qiang

2014-03-15

Although it is commonly accepted that the amount of effort we put into accomplishing a task would exert an influence on subsequent reward processing and outcome evaluation, whether effort is incorporated as a cost or it would increase the valuation of concomitant reward is still under debate. In this study, EEGs were recorded while subjects performed calculation tasks that required different amount of effort, correct responses of which were followed by either no reward or fixed compensation. Results showed that high effort induced larger differentiated FRN responses to the reward and non-reward discrepancy across two experimental conditions. Furthermore, P300 manifested valence effect during reward feedback, with more positive amplitudes for reward than for non-reward only in the high effort condition. These results suggest that effort might increase subjective evaluation toward subsequent reward. Copyright © 2013 Elsevier B.V. All rights reserved.

Neural coding of basic reward terms of animal learning theory, game theory, microeconomics and behavioural ecology.

PubMed

Schultz, Wolfram

2004-04-01

Neurons in a small number of brain structures detect rewards and reward-predicting stimuli and are active during the expectation of predictable food and liquid rewards. These neurons code the reward information according to basic terms of various behavioural theories that seek to explain reward-directed learning, approach behaviour and decision-making. The involved brain structures include groups of dopamine neurons, the striatum including the nucleus accumbens, the orbitofrontal cortex and the amygdala. The reward information is fed to brain structures involved in decision-making and organisation of behaviour, such as the dorsolateral prefrontal cortex and possibly the parietal cortex. The neural coding of basic reward terms derived from formal theories puts the neurophysiological investigation of reward mechanisms on firm conceptual grounds and provides neural correlates for the function of rewards in learning, approach behaviour and decision-making.

Reward Processing, Neuroeconomics, and Psychopathology

PubMed Central

Zald, David H.; Treadway, Michael

2018-01-01

Abnormal reward processing is a prominent transdiagnostic feature of psychopathology. The present review provides a framework for considering the different aspects of reward processing and their assessment and highlight recent insights from the field of neuroeconomics that may aid in understanding these processes. Although altered reward processing in psychopathology has often been treated as a general hypo- or hyper-responsivity to reward, increasing data indicate that a comprehensive understanding of reward dysfunction requires characterization within more specific reward processing domains, including subjective valuation, discounting, hedonics, reward anticipation and facilitation, and reinforcement learning. As such, more nuanced models of the nature of these abnormalities are needed. We describe several processing abnormalities capable of producing the types of selective alterations in reward related behavior observed in different forms of psychopathology, including (mal)adaptive scaling and anchoring, dysfunctional weighting of reward and cost variables, completion between valuation systems, and positive prediction error signaling. PMID:28301764

Self-stimulating rats combine subjective reward magnitude and subjective reward rate multiplicatively.

PubMed

Leon, M I; Gallistel, C R

1998-07-01

For rats that bar pressed for intracranial electrical stimulation in a 2-lever matching paradigm with concurrent variable interval schedules of reward, the authors found that the time allocation ratio is based on a multiplicative combination of the ratio of subjective reward magnitudes and the ratio of the rates of reward. Multiplicative combining was observed in a range covering approximately 2 orders of magnitude in the ratio of the rates of reward from about 1:10 to 10:1) and an order of magnitude change in the size of rewards. After determining the relation between the pulse frequency of stimulation and subjective reward magnitude, the authors were able to predict from knowledge of the subjective magnitudes of the rewards and the obtained relative rates of reward the subject's time allocation ratio over a range in which it varied by more than 3 orders of magnitude.

What's the Point?: A Review of Reward Systems Implemented in Gamification Interventions.

PubMed

Lewis, Zakkoyya H; Swartz, Maria C; Lyons, Elizabeth J

2016-04-01

Rewards are commonly used in interventions to change behavior, but they can inhibit development of intrinsic motivation, which is associated with long-term behavior maintenance. Gamification is a novel intervention strategy that may target intrinsic motivation through fun and enjoyment. Before the effects of gamified interventions on motivation can be determined, there must be an understanding of how gamified interventions operationalize rewards, such as point systems. The purpose of this review is to determine the prevalence of different reward types, specifically point systems, within gamified interventions. Electronic databases were searched for relevant articles. Data sources included Medline OVID, Medline PubMed, Web of Science, CINAHL, Cochrane Central, and PsycINFO. Out of the 21 articles retrieved, 18 studies described a reward system and were included in this review. Gamified interventions were designed to target a myriad of clinical outcomes across diverse populations. Rewards included points (n = 14), achievements/badges/medals (n = 7), tangible rewards (n = 7), currency (n = 4), other unspecified rewards (n = 3), likes (n = 2), animated feedback (n = 1), and kudos (n = 1). Rewards, and points in particular, appear to be a foundational component of gamified interventions. Despite their prevalence, authors seldom described the use of noncontingent rewards or how the rewards interacted with other game features. The reward systems relying on tangible rewards and currency may have been limited by inhibited intrinsic motivation. As gamification proliferates, future research should explicitly describe how rewards were operationalized in the intervention and evaluate the effects of gamified rewards on motivation across populations and research outcomes.

Reward loss and the basolateral amygdala: A function in reward comparisons.

PubMed

Kawasaki, Katsuyoshi; Annicchiarico, Iván; Glueck, Amanda C; Morón, Ignacio; Papini, Mauricio R

2017-07-28

The neural circuitry underlying behavior in reward loss situations is poorly understood. We considered two such situations: reward devaluation (from large to small rewards) and reward omission (from large rewards to no rewards). There is evidence that the central nucleus of the amygdala (CeA) plays a role in the negative emotion accompanying reward loss. However, little is known about the function of the basolateral nucleus (BLA) in reward loss. Two hypotheses of BLA function in reward loss, negative emotion and reward comparisons, were tested in an experiment involving pretraining excitotoxic BLA lesions followed by training in four tasks: consummatory successive negative contrast (cSNC), autoshaping (AS) acquisition and extinction, anticipatory negative contrast (ANC), and open field testing (OF). Cell counts in the BLA (but not in the CeA) were significantly lower in animals with lesions vs. shams. BLA lesions eliminated cSNC and ANC, and accelerated extinction of lever pressing in AS. BLA lesions had no effect on OF testing: higher activity in the periphery than in the central area. This pattern of results provides support for the hypothesis that BLA neurons are important for reward comparison. The three affected tasks (cSNC, ANC, and AS extinction) involve reward comparisons. However, ANC does not seem to involve negative emotions and it was affected, whereas OF activity is known to involve negative emotion, but it was not affected. It is hypothesized that a circuit involving the thalamus, insular cortex, and BLA is critically involved in the mechanism comparing current and expected rewards. Copyright © 2017 Elsevier B.V. All rights reserved.

Common Alterations in Sensitivity to Type but Not Amount of Reward in ADHD and Autism Spectrum Disorders

ERIC Educational Resources Information Center

Demurie, Ellen; Roeyers, Herbert; Baeyens, Dieter; Sonuga-Barke, Edmund

2011-01-01

Background: Children with attention deficit/hyperactivity disorder (ADHD) display abnormalities in reward processing. Most reward studies have focused on the effects of material or monetary rewards. Studies with autism spectrum disorder (ASD) have focused on social rewards. In this study we compared the effects of amount and type of reward in…

Social Influences on Creativity: Interactive Effects of Reward and Choice.

ERIC Educational Resources Information Center

Amabile, Teresa M.

In a test of intrinsic motivation hypothesis of creativity, 60 undergraduate women did an artistic creativity task with either the expectation of receiving a reward or no expectation of reward. Reward was crossed with choice in task engagement, such that half of the reward Ss contracted to do the task in order to receive reward, and half simply…

Registered nurses' experiences of rewarding in a Finnish University Hospital - an interview study.

PubMed

Seitovirta, Jaana; Partanen, Pirjo; Vehviläinen-Julkunen, Katri; Kvist, Tarja

2015-10-01

The purpose was to describe Finnish registered nurses' experiences of rewarding. The aim was to gather detailed information on the rewarding of nurses to help nurse managers and leaders to update existing reward strategy and to develop an effective reward system. Rewarding has been found positively to influence nurses' occupational well-being and commitment to their work, and the attractiveness of the health care field. A series of focused interviews with 10 registered nurses was conducted in 2011. Qualitative content analysis method was used. The nurses reported positive experiences with rewarding in the form of monetary compensation and other benefits, the positive aspects of nursing work and opportunities for professional development. The experiences of unsatisfactory rewarding generally stemmed from negative emotional experiences, lacking rewards and inequality in rewarding. It is essential to listen to nurses and to provide appropriate acknowledgement and appreciation of their work in order to develop an effective reward system. It is important to listen to nurses' experiences of rewarding because it enables nurse managers to maintain and increase the attractiveness of nursing and health care work in general. © 2014 John Wiley & Sons Ltd.

Real and hypothetical monetary rewards modulate risk taking in the brain.

PubMed

Xu, Sihua; Pan, Yu; Wang, You; Spaeth, Andrea M; Qu, Zhe; Rao, Hengyi

2016-07-07

Both real and hypothetical monetary rewards are widely used as reinforcers in risk taking and decision making studies. However, whether real and hypothetical monetary rewards modulate risk taking and decision making in the same manner remains controversial. In this study, we used event-related potentials (ERP) with a balloon analogue risk task (BART) paradigm to examine the effects of real and hypothetical monetary rewards on risk taking in the brain. Behavioral data showed reduced risk taking after negative feedback (money loss) during the BART with real rewards compared to those with hypothetical rewards, suggesting increased loss aversion with real monetary rewards. The ERP data demonstrated a larger feedback-related negativity (FRN) in response to money loss during risk taking with real rewards compared to those with hypothetical rewards, which may reflect greater prediction error or regret emotion after real monetary losses. These findings demonstrate differential effects of real versus hypothetical monetary rewards on risk taking behavior and brain activity, suggesting a caution when drawing conclusions about real choices from hypothetical studies of intended behavior, especially when large rewards are used. The results have implications for future utility of real and hypothetical monetary rewards in studies of risk taking and decision making.

Domain independence and stability in young and older adults' discounting of delayed rewards

PubMed Central

Jimura, Koji; Myerson, Joel; Hilgard, Joseph; Keighley, Julia; Braver, Todd S.; Green, Leonard

2011-01-01

Individual discounting rates for different types of delayed reward are typically assumed to reflect a single, underlying trait of impulsivity. Recently, we showed that discounting rates are orders of magnitude steeper for directly consumable liquid rewards than for monetary rewards (Jimura et al. 2009), raising the question of whether discounting rates for different types of reward covary at the individual level. Accordingly, the present study examined the relation between discounting of hypothetical money and real liquid rewards in young adults (Experiment 1) and older adults (Experiment 2). At the group level, young adults discounted monetary rewards more steeply than the older adults, but the reverse pattern was observed with liquid rewards. At the individual level, the rates at which young and older participants discounted each reward type were stable over a two- to fifteen-week interval (rs >.70), but there was no significant correlation between the rates at which they discounted the two reward types. These results suggest that although similar decision-making processes may underlie the discounting of different types of rewards, the rates at which individuals discount money and directly consumable rewards may reflect separate, stable traits, rather than a single trait of impulsivity. PMID:21550384

Facilitating or undermining? The effect of reward on food acceptance. A narrative review.

PubMed

Cooke, Lucy J; Chambers, Lucy C; Añez, Elizabeth V; Wardle, Jane

2011-10-01

Using rewards in child feeding is commonplace and viewed as effective by parents, although some express concern about using 'bribery'. Psychological and economic theorists emphasize the beneficial effects of rewards in enhancing performance, although, there is evidence that the offer of rewards undermines intrinsic motivation and decreases enjoyment of the rewarded task. In the food domain, results have been mixed, but this may be explained, at least partly in terms of the measured outcome (liking vs intake) and the initial level of motivation towards the target foods (liked vs disliked). Where intake is the outcome, rewards have had broadly positive effects, but when it is liking, rewards can have negative effects if the target food is already liked. Another issue concerns the type of reward offered. While offering food as a reward appear to be universally negative, there is evidence to suggest that non-food tangible rewards (e.g., stickers), or non-tangible rewards (praise) can be highly effective in encouraging children to taste new or less liked foods sufficiently often to benefit from the 'mere exposure' effect. We suggest that the judicious use of rewards may facilitate children's acceptance of healthy foods. Copyright © 2011 Elsevier Ltd. All rights reserved.

Role of Reward Sensitivity and Processing in Major Depressive and Bipolar Spectrum Disorders

PubMed Central

Alloy, Lauren B.; Olino, Thomas; Freed, Rachel D.; Nusslock, Robin

2016-01-01

Since Costello’s (1972) seminal Behavior Therapy article on loss of reinforcers or reinforcer effectiveness in depression, the role of reward sensitivity and processing in both depression and bipolar disorder has become a central area of investigation. In this article, we review the evidence for a model of reward sensitivity in mood disorders, with unipolar depression characterized by reward hyposensitivity and bipolar disorders by reward hypersensitivity. We address whether aberrant reward sensitivity and processing are correlates of, mood-independent traits of, vulnerabilities for, and/or predictors of the course of depression and bipolar spectrum disorders, covering evidence from self-report, behavioral, neurophysiological, and neural levels of analysis. We conclude that substantial evidence documents that blunted reward sensitivity and processing are involved in unipolar depression and heightened reward sensitivity and processing are characteristic of hypomania/mania. We further conclude that aberrant reward sensitivity has a trait component, but more research is needed to clearly demonstrate that reward hyposensitivity and hypersensitivity are vulnerabilities for depression and bipolar disorder, respectively. Moreover, additional research is needed to determine whether bipolar depression is similar to unipolar depression and characterized by reward hyposensitivity, or whether like bipolar hypomania/mania, it involves reward hypersensitivity. PMID:27816074

Altered neural reward representations in pathological gamblers revealed by delay and probability discounting.

PubMed

Miedl, Stephan F; Peters, Jan; Büchel, Christian

2012-02-01

The neural basis of excessive delay discounting and reduced risk sensitivity of pathological gamblers with a particular focus on subjective neural reward representations has not been previously examined. To examine how pathological gamblers represent subjective reward value at a neural level and how this is affected by gambling severity. Model-based functional magnetic resonance imaging study with patients and control subjects. Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf. Participants were recruited from the local community by advertisement and through self-help groups. A sample of 16 pathological gamblers (according to the DSM-IV definition) was matched by age, sex, smoking status, income, educational level, and handedness to 16 healthy controls. Pathological gamblers showed increased discounting of delayed rewards and a trend toward decreased discounting of probabilistic rewards compared with matched controls. At the neural level, a significant group × condition interaction indicated that reward representations in the gamblers were modulated in a condition-specific manner, such that they exhibited increased (delay discounting) and decreased (probability discounting) neural value correlations in the reward system. In addition, throughout the reward system, neuronal value signals for delayed rewards were negatively correlated with gambling severity. The results extend previous reports of a generally hypoactive reward system in pathological gamblers by showing that, even when subjective reward valuation is accounted for, gamblers still show altered reward representations. Furthermore, results point toward a gradual degradation of mesolimbic reward representations for delayed rewards during the course of pathological gambling.

Neural activation to monetary reward is associated with amphetamine reward sensitivity.

PubMed

Crane, Natania A; Gorka, Stephanie M; Weafer, Jessica; Langenecker, Scott A; de Wit, Harriet; Phan, K Luan

2018-03-14

One known risk factor for drug use and abuse is sensitivity to rewarding effects of drugs. It is not known whether this risk factor extends to sensitivity to non-drug rewards. In this study with healthy young adults, we examined the association between sensitivity to the subjective rewarding effects of amphetamine and a neural indicator of anticipation of monetary reward. We hypothesized that greater euphorigenic response to amphetamine would be associated with greater neural activation to anticipation of monetary reward (Win > Loss). Healthy participants (N = 61) completed four laboratory sessions in which they received d-amphetamine (20 mg) and placebo in alternating order, providing self-report measures of euphoria and stimulation at regular intervals. At a separate visit 1-3 weeks later, participants completed the guessing reward task (GRT) during fMRI in a drug-free state. Participants reporting greater euphoria after amphetamine also exhibited greater neural activation during monetary reward anticipation in mesolimbic reward regions, including the bilateral caudate and putamen. This is the first study to show a relationship between neural correlates of monetary reward and sensitivity to the subjective rewarding effects of amphetamine in humans. These findings support growing evidence that sensitivity to reward in general is a risk factor for drug use and abuse, and suggest that sensitivity of drug-induced euphoria may reflect a general sensitivity to rewards. This may be an index of vulnerability for drug use or abuse.

Differences in delay discounting between smokers and nonsmokers remain when both rewards are delayed

PubMed Central

Mitchell, Suzanne H.; Wilson, Vanessa B.

2013-01-01

Rationale When offered a choice between a small monetary reward available immediately (SmallNow) versus a larger reward available after a delay (LargeLater), smokers select the SmallNow alternative more than nonsmokers. That is, smokers discount the value of the LargeLater reward more than nonsmokers. Objectives To investigate whether this group difference was due to smokers overweighing the value of rewards available immediately compared with nonsmokers, we examined whether the group difference was also seen when both alternatives were delayed, i.e., when choosing between a SmallSoon reward and a LargeLater reward. Methods In Experiment 1, smokers and nonsmokers completed a task including SmallNow versus LargeLater choices and SmallSoon versus LargeLater choices. In Experiment 2, smokers and nonsmokers completed the same task but with hypothetical choices. Results Analyses using hyperbolic and double exponential (β-δ) models replicate prior findings that smokers discount the LargeLater reward more than nonsmokers when the smaller reward is available immediately. The smoker-nonsmoker difference was also seen when the smaller reward was slightly delayed, though this effect was primarily driven by heightened discounting in male smokers. However, for potentially real rewards only, this smoker-nonsmoker difference was significantly reduced when the smaller reward was delayed. Conclusions The smoker-nonsmoker difference in discounting is not confined to situations involving immediate rewards. Differences associated with potentially real vs. hypothetical rewards and gender underscore the complexity of the smoking-delay discounting relationship. PMID:21983917

Interactions between target location and reward size modulate the rate of microsaccades in monkeys

PubMed Central

Tokiyama, Stefanie; Lisberger, Stephen G.

2015-01-01

We have studied how rewards modulate the occurrence of microsaccades by manipulating the size of an expected reward and the location of the cue that sets the expectations for future reward. We found an interaction between the size of the reward and the location of the cue. When monkeys fixated on a cue that signaled the size of future reward, the frequency of microsaccades was higher if the monkey expected a large vs. a small reward. When the cue was presented at a site in the visual field that was remote from the position of fixation, reward size had the opposite effect: the frequency of microsaccades was lower when the monkey was expecting a large reward. The strength of pursuit initiation also was affected by reward size and by the presence of microsaccades just before the onset of target motion. The gain of pursuit initiation increased with reward size and decreased when microsaccades occurred just before or after the onset of target motion. The effect of the reward size on pursuit initiation was much larger than any indirect effects reward might cause through modulation of the rate of microsaccades. We found only a weak relationship between microsaccade direction and the location of the exogenous cue relative to fixation position, even in experiments where the location of the cue indicated the direction of target motion. Our results indicate that the expectation of reward is a powerful modulator of the occurrence of microsaccades, perhaps through attentional mechanisms. PMID:26311180

Markov reward processes

NASA Technical Reports Server (NTRS)

Smith, R. M.

1991-01-01

Numerous applications in the area of computer system analysis can be effectively studied with Markov reward models. These models describe the behavior of the system with a continuous-time Markov chain, where a reward rate is associated with each state. In a reliability/availability model, upstates may have reward rate 1 and down states may have reward rate zero associated with them. In a queueing model, the number of jobs of certain type in a given state may be the reward rate attached to that state. In a combined model of performance and reliability, the reward rate of a state may be the computational capacity, or a related performance measure. Expected steady-state reward rate and expected instantaneous reward rate are clearly useful measures of the Markov reward model. More generally, the distribution of accumulated reward or time-averaged reward over a finite time interval may be determined from the solution of the Markov reward model. This information is of great practical significance in situations where the workload can be well characterized (deterministically, or by continuous functions e.g., distributions). The design process in the development of a computer system is an expensive and long term endeavor. For aerospace applications the reliability of the computer system is essential, as is the ability to complete critical workloads in a well defined real time interval. Consequently, effective modeling of such systems must take into account both performance and reliability. This fact motivates our use of Markov reward models to aid in the development and evaluation of fault tolerant computer systems.

Influence of supraliminal reward information on unconsciously triggered response inhibition.

PubMed

Diao, Liuting; Ding, Cody; Qi, Senqing; Zeng, Qinghong; Huang, Bo; Xu, Mengsi; Fan, Lingxia; Yang, Dong

2014-01-01

Although executive functions (e.g., response inhibition) are often thought to interact consciously with reward, recent studies have demonstrated that they can also be triggered by unconscious stimuli. Further research has suggested a close relationship between consciously and unconsciously triggered response inhibition. To date, however, the effect of reward on unconsciously triggered response inhibition has not been explored. To address this issue, participants in this study performed runs of a modified Go/No-Go task during which they were exposed to both high and low value monetary rewards presented both supraliminally and subliminally. Participants were informed that they would earn the reward displayed if they responded correctly to each trial of the run. According to the results, when rewards were presented supraliminally, a greater unconsciously triggered response inhibition was observed for high-value rewards than for low-value rewards. In contrast, when rewards were presented subliminally, no enhanced unconsciously triggered response inhibition was observed. Results revealed that supraliminal and subliminal rewards have distinct effects on unconsciously triggered response inhibition. These findings have important implications for extending our understanding of the relationship between reward and response inhibition.

Monetary reward speeds up voluntary saccades.

PubMed

Chen, Lewis L; Chen, Y Mark; Zhou, Wu; Mustain, William D

2014-01-01

Past studies have shown that reward contingency is critical for sensorimotor learning, and reward expectation speeds up saccades in animals. Whether monetary reward speeds up saccades in human remains unknown. Here we addressed this issue by employing a conditional saccade task, in which human subjects performed a series of non-reflexive, visually-guided horizontal saccades. The subjects were (or were not) financially compensated for making a saccade in response to a centrally-displayed visual congruent (or incongruent) stimulus. Reward modulation of saccadic velocities was quantified independently of the amplitude-velocity coupling. We found that reward expectation significantly sped up voluntary saccades up to 30°/s, and the reward modulation was consistent across tests. These findings suggest that monetary reward speeds up saccades in human in a fashion analogous to how juice reward sped up saccades in monkeys. We further noticed that the idiosyncratic nasal-temporal velocity asymmetry was highly consistent regardless of test order, and its magnitude was not correlated with the magnitude of reward modulation. This suggests that reward modulation and the intrinsic velocity asymmetry may be governed by separate mechanisms that regulate saccade generation.

Basolateral amygdala rapid glutamate release encodes an outcome-specific representation vital for reward-predictive cues to selectively invigorate reward-seeking actions

PubMed Central

Malvaez, Melissa; Greenfield, Venuz Y.; Wang, Alice S.; Yorita, Allison M.; Feng, Lili; Linker, Kay E.; Monbouquette, Harold G.; Wassum, Kate M.

2015-01-01

Environmental stimuli have the ability to generate specific representations of the rewards they predict and in so doing alter the selection and performance of reward-seeking actions. The basolateral amygdala participates in this process, but precisely how is unknown. To rectify this, we monitored, in near-real time, basolateral amygdala glutamate concentration changes during a test of the ability of reward-predictive cues to influence reward-seeking actions (Pavlovian-instrumental transfer). Glutamate concentration was found to be transiently elevated around instrumental reward seeking. During the Pavlovian-instrumental transfer test these glutamate transients were time-locked to and correlated with only those actions invigorated by outcome-specific motivational information provided by the reward-predictive stimulus (i.e., actions earning the same specific outcome as predicted by the presented CS). In addition, basolateral amygdala AMPA, but not NMDA glutamate receptor inactivation abolished the selective excitatory influence of reward-predictive cues over reward seeking. These data the hypothesis that transient glutamate release in the BLA can encode the outcome-specific motivational information provided by reward-predictive stimuli. PMID:26212790

Influence of Supraliminal Reward Information on Unconsciously Triggered Response Inhibition

PubMed Central

Diao, Liuting; Ding, Cody; Qi, Senqing; Zeng, Qinghong; Huang, Bo; Xu, Mengsi; Fan, Lingxia; Yang, Dong

2014-01-01

Although executive functions (e.g., response inhibition) are often thought to interact consciously with reward, recent studies have demonstrated that they can also be triggered by unconscious stimuli. Further research has suggested a close relationship between consciously and unconsciously triggered response inhibition. To date, however, the effect of reward on unconsciously triggered response inhibition has not been explored. To address this issue, participants in this study performed runs of a modified Go/No-Go task during which they were exposed to both high and low value monetary rewards presented both supraliminally and subliminally. Participants were informed that they would earn the reward displayed if they responded correctly to each trial of the run. According to the results, when rewards were presented supraliminally, a greater unconsciously triggered response inhibition was observed for high-value rewards than for low-value rewards. In contrast, when rewards were presented subliminally, no enhanced unconsciously triggered response inhibition was observed. Results revealed that supraliminal and subliminal rewards have distinct effects on unconsciously triggered response inhibition. These findings have important implications for extending our understanding of the relationship between reward and response inhibition. PMID:25268227

Framing Reinforcement Learning from Human Reward: Reward Positivity, Temporal Discounting, Episodicity, and Performance

DTIC Science & Technology

2014-09-29

Framing Reinforcement Learning from Human Reward: Reward Positivity, Temporal Discounting, Episodicity , and Performance W. Bradley Knox...positive a trainer’s reward values are; temporal discounting, the extent to which future reward is discounted in value; episodicity , whether task...learning occurs in discrete learning episodes instead of one continuing session; and task performance, the agent’s performance on the task the trainer

Basolateral amygdala lesions abolish mutual reward preferences in rats.

PubMed

Hernandez-Lallement, Julen; van Wingerden, Marijn; Schäble, Sandra; Kalenscher, Tobias

2016-01-01

In a recent study, we demonstrated that rats prefer mutual rewards in a Prosocial Choice Task. Here, employing the same task, we show that the integrity of basolateral amygdala was necessary for the expression of mutual reward preferences. Actor rats received bilateral excitotoxic (n=12) or sham lesions (n=10) targeting the basolateral amygdala and were subsequently tested in a Prosocial Choice Task where they could decide between rewarding ("Both Reward") or not rewarding a partner rat ("Own Reward"), either choice yielding identical reward to the actors themselves. To manipulate the social context and control for secondary reinforcement sources, actor rats were paired with either a partner rat (partner condition) or with an inanimate rat toy (toy condition). Sham-operated animals revealed a significant preference for the Both-Reward-option in the partner condition, but not in the toy condition. Amygdala-lesioned animals exhibited significantly lower Both-Reward preferences than the sham group in the partner but not in the toy condition, suggesting that basolateral amygdala was required for the expression of mutual reward preferences. Critically, in a reward magnitude discrimination task in the same experimental setup, both sham-operated and amygdala-lesioned animals preferred large over small rewards, suggesting that amygdala lesion effects were restricted to decision making in social contexts, leaving self-oriented behavior unaffected. Copyright © 2015 Elsevier Inc. All rights reserved.

When unconscious rewards boost cognitive task performance inefficiently: the role of consciousness in integrating value and attainability information

PubMed Central

Zedelius, Claire M.; Veling, Harm; Aarts, Henk

2012-01-01

Research has shown that high vs. low value rewards improve cognitive task performance independent of whether they are perceived consciously or unconsciously. However, efficient performance in response to high value rewards also depends on whether or not rewards are attainable. This raises the question of whether unconscious reward processing enables people to take into account such attainability information. Building on a theoretical framework according to which conscious reward processing is required to enable higher level cognitive processing, the present research tested the hypothesis that conscious but not unconscious reward processing enables integration of reward value with attainability information. In two behavioral experiments, participants were exposed to mask high and low value coins serving as rewards on a working memory (WM) task. The likelihood for conscious processing was manipulated by presenting the coins relatively briefly (17 ms) or long and clearly visible (300 ms). Crucially, rewards were expected to be attainable or unattainable. Requirements to integrate reward value with attainability information varied across experiments. Results showed that when integration of value and attainability was required (Experiment 1), long reward presentation led to efficient performance, i.e., selectively improved performance for high value attainable rewards. In contrast, in the short presentation condition, performance was increased for high value rewards even when these were unattainable. This difference between the effects of long and short presentation time disappeared when integration of value and attainability information was not required (Experiment 2). Together these findings suggest that unconsciously processed reward information is not integrated with attainability expectancies, causing inefficient effort investment. These findings are discussed in terms of a unique role of consciousness in efficient allocation of effort to cognitive control processes. PMID:22848198

A Monetary Reward Alters Pacing but Not Performance in Competitive Cyclists.

PubMed

Skorski, Sabrina; Thompson, Kevin G; Keegan, Richard J; Meyer, Tim; Abbiss, Chris R

2017-01-01

Money has frequently been used as an extrinsic motivator since it is assumed that humans are willing to invest more effort for financial reward. However, the influence of a monetary reward on pacing and performance in trained athletes is not well-understood. Therefore, the aim of this study was to analyse the influence of a monetary reward in well-trained cyclists on their pacing and performance during short and long cycling time trials (TT). Twentythree cyclists (6 ♀, 17 ♂) completed 4 self-paced time trials (TTs, 2 short: 4 km and 6 min; 2 long: 20 km and 30 min); in a randomized order. Participants were separated into parallel, non-randomized "rewarded" and "non-rewarded" groups. Cyclists in the rewarded group received a monetary reward based on highest mean power output across all TTs. Cyclists in the non-rewarded group did not receive a monetary reward. Overall performance was not significantly different between groups in short or long TTs ( p > 0.48). Power output showed moderatly lower effect sizes at comencement of the short TTs ( P meandiff = 36.6 W; d > 0.44) and the 20 km TT ( P meandiff = 22.6 W; d = 0.44) in the rewarded group. No difference was observed in pacing during the 30 min TT ( p = 0.95). An external reward seems to have influenced pacing at the commencement of time trials. Participants in the non-rewarded group adopted a typical parabolic shaped pattern, whereas participants in the rewarded group started trials more conservatively. Results raise the possibility that using money as an extrinsic reward may interfere with regulatory processes required for effective pacing.

Optogenetic activation of the central amygdala generates addiction-like preference for reward.

PubMed

Tom, Rebecca L; Ahuja, Aarit; Maniates, Hannah; Freeland, Charlotte M; Robinson, Mike J F

2018-05-23

Drug and behavioural addictions are characterized by an intense and focused pursuit of a single reward above all others. Pursuit of the addictive reward is often compulsively sought despite adverse consequences and better alternative outcomes. Here, we explored the ability of the central amygdala (CeA) to powerfully bias choice, causing specific rewards to be almost compulsively preferred. Rats were trained on an operant choice task in which they could choose to respond on either of the two levers to receive a sucrose reward, one of which was paired with optogenetic stimulation of the CeA using channelrhodopsin-2 (ChR2). Rats developed an almost exclusive preference for the laser-paired reward over the otherwise equal unpaired reward. We found that this preference for stimulation-paired reward persists even when a much larger sucrose reward is offered as an alternative (contingency management) or when this preferred reward is paired with adverse consequences such as progressively larger electric foot shock, time delays or effort requirements. We also report that when challenged with foot shock, a small proportion of these animals (≈20%) retained an exclusive laser-paired reward preference, whereas others began to seek the alternate reward when the shock reached high levels. Lastly, we confirmed that optogenetic CeA stimulation was not independently rewarding if delivered in the absence of a paired sucrose reward. These results suggest a role for the CeA in focusing motivation and desire to excessive levels, generating addiction-like behaviour that persists in the face of more rewarding alternatives and adverse consequences. © 2018 Federation of European Neuroscience Societies and John Wiley & Sons Ltd.

Social comparison modulates reward-driven attentional capture.

PubMed

Jiao, Jun; Du, Feng; He, Xiaosong; Zhang, Kan

2015-10-01

It is well established that attention can be captured by task irrelevant and non-salient objects associated with value through reward learning. However, it is unknown whether social comparison influences reward-driven attentional capture. The present study created four social contexts to examine whether different social comparisons modulate the reward-driven capture of attention. The results showed that reward-driven attentional capture varied with different social comparison conditions. Most prominently, reward-driven attentional capture is dramatically reduced in the disadvantageous social comparison context, in which an individual is informed that the other participant is earning more monetary reward for performing the same task. These findings suggest that social comparison can affect the reward-driven capture of attention.

Shaping Attention with Reward: Effects of Reward on Space- and Object-Based Selection

PubMed Central

Shomstein, Sarah; Johnson, Jacoba

2014-01-01

The contribution of rewarded actions to automatic attentional selection remains obscure. We hypothesized that some forms of automatic orienting, such as object-based selection, can be completely abandoned in lieu of reward maximizing strategy. While presenting identical visual stimuli to the observer, in a set of two experiments, we manipulate what is being rewarded (different object targets or random object locations) and the type of reward received (money or points). It was observed that reward alone guides attentional selection, entirely predicting behavior. These results suggest that guidance of selective attention, while automatic, is flexible and can be adjusted in accordance with external non-sensory reward-based factors. PMID:24121412

Role of delay-based reward in the spatial cooperation

NASA Astrophysics Data System (ADS)

Wang, Xu-Wen; Nie, Sen; Jiang, Luo-Luo; Wang, Bing-Hong; Chen, Shi-Ming

2017-01-01

Strategy selection in games, a typical decision making, usually brings noticeable reward for players which have discounted value if the delay appears. The discounted value is measure: earning sooner with a small reward or later with a delayed larger reward. Here, we investigate effects of delayed rewards on the cooperation in structured population. It is found that delayed reward supports the spreading of cooperation in square lattice, small-world and random networks. In particular, intermediate reward differences between delays impel the highest cooperation level. Interestingly, cooperative individuals with the same delay time steps form clusters to resist the invasion of defects, and cooperative individuals with lowest delay reward survive because they form the largest clusters in the lattice.

Discrete coding of stimulus value, reward expectation, and reward prediction error in the dorsal striatum.

PubMed

Oyama, Kei; Tateyama, Yukina; Hernádi, István; Tobler, Philippe N; Iijima, Toshio; Tsutsui, Ken-Ichiro

2015-11-01

To investigate how the striatum integrates sensory information with reward information for behavioral guidance, we recorded single-unit activity in the dorsal striatum of head-fixed rats participating in a probabilistic Pavlovian conditioning task with auditory conditioned stimuli (CSs) in which reward probability was fixed for each CS but parametrically varied across CSs. We found that the activity of many neurons was linearly correlated with the reward probability indicated by the CSs. The recorded neurons could be classified according to their firing patterns into functional subtypes coding reward probability in different forms such as stimulus value, reward expectation, and reward prediction error. These results suggest that several functional subgroups of dorsal striatal neurons represent different kinds of information formed through extensive prior exposure to CS-reward contingencies. Copyright © 2015 the American Physiological Society.

Discrete coding of stimulus value, reward expectation, and reward prediction error in the dorsal striatum

PubMed Central

Oyama, Kei; Tateyama, Yukina; Hernádi, István; Tobler, Philippe N.; Iijima, Toshio

2015-01-01

To investigate how the striatum integrates sensory information with reward information for behavioral guidance, we recorded single-unit activity in the dorsal striatum of head-fixed rats participating in a probabilistic Pavlovian conditioning task with auditory conditioned stimuli (CSs) in which reward probability was fixed for each CS but parametrically varied across CSs. We found that the activity of many neurons was linearly correlated with the reward probability indicated by the CSs. The recorded neurons could be classified according to their firing patterns into functional subtypes coding reward probability in different forms such as stimulus value, reward expectation, and reward prediction error. These results suggest that several functional subgroups of dorsal striatal neurons represent different kinds of information formed through extensive prior exposure to CS-reward contingencies. PMID:26378201

Time of Day Differences in Neural Reward Functioning in Healthy Young Men.

PubMed

Byrne, Jamie E M; Hughes, Matthew E; Rossell, Susan L; Johnson, Sheri L; Murray, Greg

2017-09-13

Reward function appears to be modulated by the circadian system, but little is known about the neural basis of this interaction. Previous research suggests that the neural reward response may be different in the afternoon; however, the direction of this effect is contentious. Reward response may follow the diurnal rhythm in self-reported positive affect, peaking in the early afternoon. An alternative is that daily reward response represents a type of prediction error, with neural reward activation relatively high at times of day when rewards are unexpected (i.e., early and late in the day). The present study measured neural reward activation in the context of a validated reward task at 10.00 h, 14.00 h, and 19.00 h in healthy human males. A region of interest BOLD fMRI protocol was used to investigate the diurnal waveform of activation in reward-related brain regions. Multilevel modeling found, as expected, a highly significant quadratic time-of-day effect focusing on the left putamen ( p < 0.001). Consistent with the "prediction error" hypothesis, activation was significantly higher at 10.00 h and 19.00 h compared with 14.00 h. It is provisionally concluded that the putamen may be particularly important in endogenous priming of reward motivation at different times of day, with the pattern of activation consistent with circadian-modulated reward expectancies in neural pathways (i.e., greater activation to reward stimuli at unexpected times of day). This study encourages further research into circadian modulation of reward and underscores the methodological importance of accounting for time of day in fMRI protocols. SIGNIFICANCE STATEMENT This is one of the first studies to use a repeated-measures imaging procedure to explore the diurnal rhythm of reward activation. Although self-reported reward (most often operationalized as positive affect) peaks in the afternoon, the present findings indicate that neural activation is lowest at this time. We conclude that the diurnal neural activation pattern may reflect a prediction error of the brain, where rewards at unexpected times (10.00 h and 19.00 h) elicit higher activation in reward brain regions than at expected (14.00 h) times. These data also have methodological significance, suggesting that there may be a time of day influence, which should be accounted for in neural reward studies. Copyright © 2017 the authors 0270-6474/17/378895-06$15.00/0.

A comparison of the electrocortical response to monetary and social reward

PubMed Central

Distefano, Amanda; Jackson, Felicia; Levinson, Amanda R; Infantolino, Zachary P; Jarcho, Johanna M; Nelson, Brady D

2018-01-01

Abstract Affective science research on reward processing has primarily focused on monetary rewards. There has been a growing interest in evaluating the neural basis of social decision-making and reward processing. The present study employed a within-subject design and compared the reward positivity (RewP), an event-related potential component that is present following favorable feedback and absent or reduced following unfavorable feedback, during monetary and social reward tasks. Specifically, 114 participants (75 females) completed a monetary reward task and a novel social reward task that were matched on trial structure, timing, and feedback stimuli in a counterbalanced order. Results indicated that the monetary and social RewP were of similar magnitude, positively correlated and demonstrated comparable psychometric properties, including reliability and dependability. Across both the monetary and social tasks, women demonstrated a greater RewP compared with men. This study provides a novel methodological approach toward examining the electrocortical response to social reward that is comparable to monetary reward. PMID:29373743

Dopamine neurons learn relative chosen value from probabilistic rewards

PubMed Central

Lak, Armin; Stauffer, William R; Schultz, Wolfram

2016-01-01

Economic theories posit reward probability as one of the factors defining reward value. Individuals learn the value of cues that predict probabilistic rewards from experienced reward frequencies. Building on the notion that responses of dopamine neurons increase with reward probability and expected value, we asked how dopamine neurons in monkeys acquire this value signal that may represent an economic decision variable. We found in a Pavlovian learning task that reward probability-dependent value signals arose from experienced reward frequencies. We then assessed neuronal response acquisition during choices among probabilistic rewards. Here, dopamine responses became sensitive to the value of both chosen and unchosen options. Both experiments showed also the novelty responses of dopamine neurones that decreased as learning advanced. These results show that dopamine neurons acquire predictive value signals from the frequency of experienced rewards. This flexible and fast signal reflects a specific decision variable and could update neuronal decision mechanisms. DOI: http://dx.doi.org/10.7554/eLife.18044.001 PMID:27787196

Role of expected reward in frontal eye field during natural scene search

PubMed Central

Lawlor, Patrick N.; Ramkumar, Pavan; Kording, Konrad P.; Segraves, Mark A.

2016-01-01

When a saccade is expected to result in a reward, both neural activity in oculomotor areas and the saccade itself (e.g., its vigor and latency) are altered (compared with when no reward is expected). As such, it is unclear whether the correlations of neural activity with reward indicate a representation of reward beyond a movement representation; the modulated neural activity may simply represent the differences in motor output due to expected reward. Here, to distinguish between these possibilities, we trained monkeys to perform a natural scene search task while we recorded from the frontal eye field (FEF). Indeed, when reward was expected (i.e., saccades to the target), FEF neurons showed enhanced responses. Moreover, when monkeys accidentally made eye movements to the target, firing rates were lower than when they purposively moved to the target. Thus, neurons were modulated by expected reward rather than simply the presence of the target. We then fit a model that simultaneously included components related to expected reward and saccade parameters. While expected reward led to shorter latency and higher velocity saccades, these behavioral changes could not fully explain the increased FEF firing rates. Thus, FEF neurons appear to encode motivational factors such as reward expectation, above and beyond the kinematic and behavioral consequences of imminent reward. PMID:27169506

Remembering with gains and losses: effects of monetary reward and punishment on successful encoding activation of source memories.

PubMed

Shigemune, Yayoi; Tsukiura, Takashi; Kambara, Toshimune; Kawashima, Ryuta

2014-05-01

The motivation of getting rewards or avoiding punishments reinforces learning behaviors. Although the neural mechanisms underlying the effect of rewards on episodic memory have been demonstrated, there is little evidence of the effect of punishments on this memory. Our functional magnetic resonance imaging (fMRI) study investigated the effects of monetary rewards and punishments on activation during the encoding of source memories. During encoding, participants memorized words (item) and locations of presented words (source) under 3 conditions (Reward, Punishment, and Control). During retrieval, participants retrieved item and source memories of the words and were rewarded or penalized according to their performance. Source memories encoded with rewards or punishments were remembered better than those without such encoding. fMRI data demonstrated that the ventral tegmental area and substantia nigra and nucleus accumbens activations reflected both the processes of reward and punishment, whereas insular activation increased as a linear function of punishment. Activation in the hippocampus and parahippocampal cortex predicted subsequent retrieval success of source memories. Additionally, correlations between these reward/punishment-related regions and the hippocampus were significant. The successful encoding of source memories could be enhanced by punishments and rewards, and interactions between reward/punishment-related regions and memory-related regions could contribute to memory enhancement by reward and/or punishment.

Domain independence and stability in young and older adults' discounting of delayed rewards.

PubMed

Jimura, Koji; Myerson, Joel; Hilgard, Joseph; Keighley, Julia; Braver, Todd S; Green, Leonard

2011-07-01

Individual discounting rates for different types of delayed reward are typically assumed to reflect a single, underlying trait of impulsivity. Recently, we showed that discounting rates are orders of magnitude steeper for directly consumable liquid rewards than for monetary rewards (Jimura et al., 2009), raising the question of whether discounting rates for different types of reward covary at the individual level. Accordingly, the present study examined the relation between discounting of hypothetical money and real liquid rewards in young adults (Experiment 1) and older adults (Experiment 2). At the group level, young adults discounted monetary rewards more steeply than the older adults, but there was no significant age difference with respect to liquid rewards. At the individual level, the rates at which young and older participants discounted each reward type were stable over a two- to fifteen-week interval (rs>70), but there was no significant correlation between the rates at which they discounted the two reward types. These results suggest that although similar decision-making processes may underlie the discounting of different types of rewards, the rates at which individuals discount money and directly consumable rewards may reflect separate, stable traits, rather than a single trait of impulsivity. Copyright © 2011 Elsevier B.V. All rights reserved.

Diminished social reward anticipation in the broad autism phenotype as revealed by event-related brain potentials

PubMed Central

Cox, Anthony; Kohls, Gregor; Naples, Adam J.; Mukerji, Cora E.; Coffman, Marika C.; Rutherford, Helena J. V.; Mayes, Linda C.

2015-01-01

Diminished responsivity to reward incentives is a key contributor to the social-communication problems seen in autism spectrum disorders (ASDs). Social motivation theories suggest that individuals with ASD do not experience social interactions as rewarding, leading to negative consequences for the development of brain circuitry subserving social information. In this study, we examined neural responses to social and non-social reward anticipation in 35 typically developing young adults, examining modulation of reward sensitivity by level of autistic traits. Using an Event-related potential incentive-delay task incorporating novel, more ecologically valid forms of reward, higher expression of autistic traits was associated with an attenuated P3 response to the anticipation of social (simulated real-time video feedback from an observer), but not non-social (candy), rewards. Exploratory analyses revealed that this was unrelated to mentalizing ability. The P3 component reflects motivated attention to reward signals, suggesting attenuated motivation allocation specific to social incentives. The study extends prior findings of atypical reward anticipation in ASD, demonstrating that attenuated social reward responsiveness extends to autistic traits in the range of typical functioning. Results support the development of innovative paradigms for investigating social and non-social reward responsiveness. Insight into vulnerabilities in reward processing is critical for understanding social function in ASD. PMID:25752905

EEG to Primary Rewards: Predictive Utility and Malleability by Brain Stimulation

PubMed Central

Prause, Nicole; Siegle, Greg J.; Deblieck, Choi; Wu, Allan; Iacoboni, Marco

2016-01-01

Theta burst stimulation (TBS) is thought to affect reward processing mechanisms, which may increase and decrease reward sensitivity. To test the ability of TBS to modulate response to strong primary rewards, participants hypersensitive to primary rewards were recruited. Twenty men and women with at least two opposite-sex, sexual partners in the last year received two forms of TBS. Stimulations were randomized to avoid order effects and separated by 2 hours to reduce carryover. The two TBS forms have been demonstrated to inhibit (continuous) or excite (intermittent) the left dorsolateral prefrontal cortex using different pulse patterns, which links to brain areas associated with reward conditioning. After each TBS, participants completed tasks assessing their reward responsiveness to monetary and sexual rewards. Electroencephalography (EEG) was recorded. They also reported their number of orgasms in the weekend following stimulation. This signal was malleable by TBS, where excitatory TBS resulted in lower EEG alpha relative to inhibitory TBS to primary rewards. EEG responses to sexual rewards in the lab (following both forms of TBS) predicted the number of orgasms experienced over the forthcoming weekend. TBS may be useful in modifying hypersensitivity or hyposensitivity to primary rewards that predict sexual behaviors. Since TBS altered the anticipation of a sexual reward, TBS may offer a novel treatment for sexual desire problems. PMID:27902711

EEG to Primary Rewards: Predictive Utility and Malleability by Brain Stimulation.

PubMed

Prause, Nicole; Siegle, Greg J; Deblieck, Choi; Wu, Allan; Iacoboni, Marco

2016-01-01

Theta burst stimulation (TBS) is thought to affect reward processing mechanisms, which may increase and decrease reward sensitivity. To test the ability of TBS to modulate response to strong primary rewards, participants hypersensitive to primary rewards were recruited. Twenty men and women with at least two opposite-sex, sexual partners in the last year received two forms of TBS. Stimulations were randomized to avoid order effects and separated by 2 hours to reduce carryover. The two TBS forms have been demonstrated to inhibit (continuous) or excite (intermittent) the left dorsolateral prefrontal cortex using different pulse patterns, which links to brain areas associated with reward conditioning. After each TBS, participants completed tasks assessing their reward responsiveness to monetary and sexual rewards. Electroencephalography (EEG) was recorded. They also reported their number of orgasms in the weekend following stimulation. This signal was malleable by TBS, where excitatory TBS resulted in lower EEG alpha relative to inhibitory TBS to primary rewards. EEG responses to sexual rewards in the lab (following both forms of TBS) predicted the number of orgasms experienced over the forthcoming weekend. TBS may be useful in modifying hypersensitivity or hyposensitivity to primary rewards that predict sexual behaviors. Since TBS altered the anticipation of a sexual reward, TBS may offer a novel treatment for sexual desire problems.

Remembering with Gains and Losses: Effects of Monetary Reward and Punishment on Successful Encoding Activation of Source Memories

PubMed Central

Shigemune, Yayoi; Tsukiura, Takashi; Kambara, Toshimune; Kawashima, Ryuta

2014-01-01

The motivation of getting rewards or avoiding punishments reinforces learning behaviors. Although the neural mechanisms underlying the effect of rewards on episodic memory have been demonstrated, there is little evidence of the effect of punishments on this memory. Our functional magnetic resonance imaging (fMRI) study investigated the effects of monetary rewards and punishments on activation during the encoding of source memories. During encoding, participants memorized words (item) and locations of presented words (source) under 3 conditions (Reward, Punishment, and Control). During retrieval, participants retrieved item and source memories of the words and were rewarded or penalized according to their performance. Source memories encoded with rewards or punishments were remembered better than those without such encoding. fMRI data demonstrated that the ventral tegmental area and substantia nigra and nucleus accumbens activations reflected both the processes of reward and punishment, whereas insular activation increased as a linear function of punishment. Activation in the hippocampus and parahippocampal cortex predicted subsequent retrieval success of source memories. Additionally, correlations between these reward/punishment-related regions and the hippocampus were significant. The successful encoding of source memories could be enhanced by punishments and rewards, and interactions between reward/punishment-related regions and memory-related regions could contribute to memory enhancement by reward and/or punishment. PMID:23314939

Stimulus-related activity during conditional associations in monkey perirhinal cortex neurons depends on upcoming reward outcome.

PubMed

Ohyama, Kaoru; Sugase-Miyamoto, Yasuko; Matsumoto, Narihisa; Shidara, Munetaka; Sato, Chikara

2012-11-28

Acquiring the significance of events based on reward-related information is critical for animals to survive and to conduct social activities. The importance of the perirhinal cortex for reward-related information processing has been suggested. To examine whether or not neurons in this cortex represent reward information flexibly when a visual stimulus indicates either a rewarded or unrewarded outcome, neuronal activity in the macaque perirhinal cortex was examined using a conditional-association cued-reward task. The task design allowed us to study how the neuronal responses depended on the animal's prediction of whether it would or would not be rewarded. Two visual stimuli, a color stimulus as Cue1 followed by a pattern stimulus as Cue2, were sequentially presented. Each pattern stimulus was conditionally associated with both rewarded and unrewarded outcomes depending on the preceding color stimulus. We found an activity depending upon the two reward conditions during Cue2, i.e., pattern stimulus presentation. The response appeared after the response dependent upon the image identity of Cue2. The response delineating a specific cue sequence also appeared between the responses dependent upon the identity of Cue2 and reward conditions. Thus, when Cue1 sets the context for whether or not Cue2 indicates a reward, this region represents the meaning of Cue2, i.e., the reward conditions, independent of the identity of Cue2. These results suggest that neurons in the perirhinal cortex do more than associate a single stimulus with a reward to achieve flexible representations of reward information.

Overt and covert attention to location-based reward.

PubMed

McCoy, Brónagh; Theeuwes, Jan

2018-01-01

Recent research on the impact of location-based reward on attentional orienting has indicated that reward factors play an influential role in spatial priority maps. The current study investigated whether and how reward associations based on spatial location translate from overt eye movements to covert attention. If reward associations can be tied to locations in space, and if overt and covert attention rely on similar overlapping neuronal populations, then both overt and covert attentional measures should display similar spatial-based reward learning. Our results suggest that location- and reward-based changes in one attentional domain do not lead to similar changes in the other. Specifically, although we found similar improvements at differentially rewarded locations during overt attentional learning, this translated to the least improvement at a highly rewarded location during covert attention. We interpret this as the result of an increased motivational link between the high reward location and the trained eye movement response acquired during learning, leading to a relative slowing during covert attention when the eyes remained fixated and the saccade response was suppressed. In a second experiment participants were not required to keep fixated during the covert attention task and we no longer observed relative slowing at the high reward location. Furthermore, the second experiment revealed no covert spatial priority of rewarded locations. We conclude that the transfer of location-based reward associations is intimately linked with the reward-modulated motor response employed during learning, and alternative attentional and task contexts may interfere with learned spatial priorities. Copyright © 2017 The Authors. Published by Elsevier Ltd.. All rights reserved.

Altered subjective reward valuation among female heavy marijuana users.

PubMed

Hefner, Kathryn R; Starr, Mark J

2017-02-01

Maladaptive decision-making is a cardinal feature of drug use, contributing to ongoing use, and reflecting alterations in how drug users assess uncertain reward value. Accumulating evidence indicates the consequences of heavy marijuana use are worse for female versus male animals and humans, but research assessing sex differences in reward-related decision-making among marijuana users remains scarce. We examined sex differences in the subjective valuation of certain and uncertain rewards among heavy marijuana users (52; 26 male and 26 female) and controls (52; 26 male and 26 female). We offered male and female heavy marijuana users and controls monetary rewards of certain and uncertain (probabilistic) values. We measured how preferences for uncertain rewards varied by the objective value of those rewards, moderators of reward uncertainty, Marijuana Group and Sex. Men were more sensitive to changes in the objective value of uncertain rewards than women. However, this effect of Sex differed by Marijuana Group. Female heavy marijuana users were more sensitive to changes in uncertain reward value, particularly when the "stakes" were high (i.e., greater difference between potential uncertain rewards), than female controls. Female heavy marijuana users' sensitivity to changes in the value of high stakes uncertain rewards was comparable to male marijuana users and controls. In contrast, male marijuana users' sensitivity to changes in the value of high stakes uncertain rewards did not differ from male controls. These results suggest sex differences in sensitivity to high risk rewards may be one pathway contributing to severer consequences of heavy marijuana use among women. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Altered subjective reward valuation among female heavy marijuana users

PubMed Central

Hefner, Kathryn R.; Starr, Mark. J.

2016-01-01

Maladaptive decision-making is a cardinal feature of drug use, contributing to ongoing use, and reflecting alterations in how drug users assess uncertain reward value. Accumulating evidence indicates the consequences of heavy marijuana use are worse for female versus male animals and humans, but research assessing sex differences in reward-related decision-making among marijuana users remains scarce. We examined sex differences in the subjective valuation of certain and uncertain rewards among heavy marijuana users (52; 26 male and 26 female) and controls (52; 26 male and 26 female). We offered male and female heavy marijuana users and controls monetary rewards of certain and uncertain (probabilistic) values. We measured how preferences for uncertain rewards varied by the objective value of those rewards, moderators of reward uncertainty, marijuana use, and sex. Men were more sensitive to changes in the objective value of uncertain rewards than women. However, this effect of sex differed by marijuana group. Female heavy marijuana users were more sensitive to changes in uncertain reward value, particularly when the ‘stakes’ were high (i.e., greater difference between potential uncertain rewards), than female controls. Female heavy marijuana users’ sensitivity to changes in the value of high stakes uncertain rewards was comparable to male marijuana users and controls. In contrast, male marijuana users’ sensitivity to changes in the value of high stakes uncertain rewards did not differ from male controls. These results suggest sex differences in sensitivity to high risk rewards may be one pathway contributing to severer consequences of heavy marijuana use among women. PMID:27936816

Differential reward coding in the subdivisions of the primate caudate during an oculomotor task.

PubMed

Nakamura, Kae; Santos, Gustavo S; Matsuzaki, Ryuichi; Nakahara, Hiroyuki

2012-11-07

The basal ganglia play a pivotal role in reward-oriented behavior. The striatum, an input channel of the basal ganglia, is composed of subdivisions that are topographically connected with different cortical and subcortical areas. To test whether reward information is differentially processed in the different parts of the striatum, we compared reward-related neuronal activity along the dorsolateral-ventromedial axis in the caudate nucleus of monkeys performing an asymmetrically rewarded oculomotor task. In a given block, a target in one position was associated with a large reward, whereas the other target was associated with a small reward. The target position-reward value contingency was switched between blocks. We found the following: (1) activity that reflected the block-wise reward contingency emerged before the appearance of a visual target, and it was more prevalent in the dorsal, rather than central and ventral, caudate; (2) activity that was positively related to the reward size of the current trial was evident, especially after reward delivery, and it was more prevalent in the ventral and central, rather than dorsal, caudate; and (3) activity that was modulated by the memory of the outcomes of the previous trials was evident in the dorsal and central caudate. This multiple reward information, together with the target-direction information, was represented primarily by individual caudate neurons, and the different reward information was represented in caudate subpopulations with distinct electrophysiological properties, e.g., baseline firing and spike width. These results suggest parallel processing of different reward information by the basal ganglia subdivisions defined by extrinsic connections and intrinsic properties.

Pressure to cooperate: is positive reward interdependence really needed in cooperative learning?

PubMed

Buchs, Céline; Gilles, Ingrid; Dutrévis, Marion; Butera, Fabrizio

2011-03-01

BACKGROUND. Despite extensive research on cooperative learning, the debate regarding whether or not its effectiveness depends on positive reward interdependence has not yet found clear evidence. AIMS. We tested the hypothesis that positive reward interdependence, as compared to reward independence, enhances cooperative learning only if learners work on a 'routine task'; if the learners work on a 'true group task', positive reward interdependence induces the same level of learning as reward independence. SAMPLE. The study involved 62 psychology students during regular workshops. METHOD. Students worked on two psychology texts in cooperative dyads for three sessions. The type of task was manipulated through resource interdependence: students worked on either identical (routine task) or complementary (true group task) information. Students expected to be assessed with a Multiple Choice Test (MCT) on the two texts. The MCT assessment type was introduced according to two reward interdependence conditions, either individual (reward independence) or common (positive reward interdependence). A follow-up individual test took place 4 weeks after the third session of dyadic work to examine individual learning. RESULTS. The predicted interaction between the two types of interdependence was significant, indicating that students learned more with positive reward interdependence than with reward independence when they worked on identical information (routine task), whereas students who worked on complementary information (group task) learned the same with or without reward interdependence. CONCLUSIONS. This experiment sheds light on the conditions under which positive reward interdependence enhances cooperative learning, and suggests that creating a real group task allows to avoid the need for positive reward interdependence. © 2010 The British Psychological Society.

Differences in reward processing between putative cell types in primate prefrontal cortex

PubMed Central

Fan, Hongwei; Wang, Rubin; Sakagami, Masamichi

2017-01-01

Single-unit studies in monkeys have demonstrated that neurons in the prefrontal cortex predict the reward type, reward amount or reward availability associated with a stimulus. To examine contributions of pyramidal cells and interneurons in reward processing, single-unit activity was extracellularly recorded in prefrontal cortices of four monkeys performing a reward prediction task. Based on their shapes of spike waveforms, prefrontal neurons were classified into broad-spike and narrow-spike units that represented putative pyramidal cells and interneurons, respectively. We mainly observed that narrow-spike neurons showed higher firing rates but less bursty discharges than did broad-spike neurons. Both narrow-spike and broad-spike cells selectively responded to the stimulus, reward and their interaction, and the proportions of each type of selective neurons were similar between the two cell classes. Moreover, the two types of cells displayed equal reliability of reward or stimulus discrimination. Furthermore, we found that broad-spike and narrow-spike cells showed distinct mechanisms for encoding reward or stimulus information. Broad-spike neurons raised their firing rate relative to the baseline rate to represent the preferred reward or stimulus information, whereas narrow-spike neurons inhibited their firing rate lower than the baseline rate to encode the non-preferred reward or stimulus information. Our results suggest that narrow-spike and broad-spike cells were equally involved in reward and stimulus processing in the prefrontal cortex. They utilized a binary strategy to complementarily represent reward or stimulus information, which was consistent with the task structure in which the monkeys were required to remember two reward conditions and two visual stimuli. PMID:29261734

Differences in reward processing between putative cell types in primate prefrontal cortex.

PubMed

Fan, Hongwei; Pan, Xiaochuan; Wang, Rubin; Sakagami, Masamichi

2017-01-01

Single-unit studies in monkeys have demonstrated that neurons in the prefrontal cortex predict the reward type, reward amount or reward availability associated with a stimulus. To examine contributions of pyramidal cells and interneurons in reward processing, single-unit activity was extracellularly recorded in prefrontal cortices of four monkeys performing a reward prediction task. Based on their shapes of spike waveforms, prefrontal neurons were classified into broad-spike and narrow-spike units that represented putative pyramidal cells and interneurons, respectively. We mainly observed that narrow-spike neurons showed higher firing rates but less bursty discharges than did broad-spike neurons. Both narrow-spike and broad-spike cells selectively responded to the stimulus, reward and their interaction, and the proportions of each type of selective neurons were similar between the two cell classes. Moreover, the two types of cells displayed equal reliability of reward or stimulus discrimination. Furthermore, we found that broad-spike and narrow-spike cells showed distinct mechanisms for encoding reward or stimulus information. Broad-spike neurons raised their firing rate relative to the baseline rate to represent the preferred reward or stimulus information, whereas narrow-spike neurons inhibited their firing rate lower than the baseline rate to encode the non-preferred reward or stimulus information. Our results suggest that narrow-spike and broad-spike cells were equally involved in reward and stimulus processing in the prefrontal cortex. They utilized a binary strategy to complementarily represent reward or stimulus information, which was consistent with the task structure in which the monkeys were required to remember two reward conditions and two visual stimuli.

Social defeat disrupts reward learning and potentiates striatal nociceptin/orphanin FQ mRNA in rats.

PubMed

Der-Avakian, Andre; D'Souza, Manoranjan S; Potter, David N; Chartoff, Elena H; Carlezon, William A; Pizzagalli, Diego A; Markou, Athina

2017-05-01

Mood disorders can be triggered by stress and are characterized by deficits in reward processing, including disrupted reward learning (the ability to modulate behavior according to past rewards). Reward learning is regulated by the anterior cingulate cortex (ACC) and striatal circuits, both of which are implicated in the pathophysiology of mood disorders. Here, we assessed in rats the effects of a potent stressor (social defeat) on reward learning and gene expression in the ACC, ventral tegmental area (VTA), and striatum. Adult male Wistar rats were trained on an operant probabilistic reward task (PRT) and then exposed to 3 days of social defeat before assessment of reward learning. After testing, the ACC, VTA, and striatum were dissected, and expression of genes previously implicated in stress was assessed. Social defeat blunted reward learning (manifested as reduced response bias toward a more frequently rewarded stimulus) and was associated with increased nociceptin/orphanin FQ (N/OFQ) peptide mRNA levels in the striatum and decreased Fos mRNA levels in the VTA. Moreover, N/OFQ peptide and nociceptin receptor mRNA levels in the ACC, VTA and striatum were inversely related to reward learning. The behavioral findings parallel previous data in humans, suggesting that stress similarly disrupts reward learning in both species. Increased striatal N/OFQ mRNA in stressed rats characterized by impaired reward learning is consistent with accumulating evidence that antagonism of nociceptin receptors, which bind N/OFQ, has antidepressant-like effects. These results raise the possibility that nociceptin systems represent a molecular substrate through which stress produces reward learning deficits in mood disorders.

A Fly's Eye View of Natural and Drug Reward.

PubMed

Lowenstein, Eve G; Velazquez-Ulloa, Norma A

2018-01-01

Animals encounter multiple stimuli each day. Some of these stimuli are innately appetitive or aversive, while others are assigned valence based on experience. Drugs like ethanol can elicit aversion in the short term and attraction in the long term. The reward system encodes the predictive value for different stimuli, mediating anticipation for attractive or punishing stimuli and driving animal behavior to approach or avoid conditioned stimuli. The neurochemistry and neurocircuitry of the reward system is partly evolutionarily conserved. In both vertebrates and invertebrates, including Drosophila melanogaster , dopamine is at the center of a network of neurotransmitters and neuromodulators acting in concert to encode rewards. Behavioral assays in D. melanogaster have become increasingly sophisticated, allowing more direct comparison with mammalian research. Moreover, recent evidence has established the functional modularity of the reward neural circuits in Drosophila . This functional modularity resembles the organization of reward circuits in mammals. The powerful genetic and molecular tools for D. melanogaster allow characterization and manipulation at the single-cell level. These tools are being used to construct a detailed map of the neural circuits mediating specific rewarding stimuli and have allowed for the identification of multiple genes and molecular pathways that mediate the effects of reinforcing stimuli, including their rewarding effects. This report provides an overview of the research on natural and drug reward in D. melanogaster , including natural rewards such as sugar and other food nutrients, and drug rewards including ethanol, cocaine, amphetamine, methamphetamine, and nicotine. We focused mainly on the known genetic and neural mechanisms underlying appetitive reward for sugar and reward for ethanol. We also include genes, molecular pathways, and neural circuits that have been identified using assays that test the palatability of the rewarding stimulus, the preference for the rewarding stimulus, or other effects of the stimulus that indicate how it can modify behavior. Commonalities between mechanisms of natural and drug reward are highlighted and future directions are presented, putting forward questions best suited for research using D. melanogaster as a model organism.

Research Review: altered reward function in adolescent depression: what, when and how?

PubMed

Forbes, Erika E; Dahl, Ronald E

2012-01-01

Conceptual models and recent evidence indicate that neural response to reward is altered in depression. Taking a developmental approach to investigating reward function in adolescent depression can elucidate the etiology, pathophysiology and course of depression, a disorder that typically begins during adolescence and has high rates of recurrence. This conceptual review describes the what, when and how of altered reward function in adolescent depression. With the goal of generating new, testable hypotheses within a developmental affective neuroscience framework, we critically review findings and suggest future directions. Peer-reviewed empirical papers for inclusion in this critical review were obtained by searching PubMed, PsycInfo and ScienceDirect for the years 1990-2010. A pattern of low striatal response and high medial prefrontal response to reward is evident in adolescents and adults with depression. Given the salience of social stimuli for positive affect and depression, reward function might be especially disrupted in response to social rewards. Because of changes in the dopamine system and reward function with aging, altered reward function in depression might be more evident during adolescence than later in life; however, low reward function may also be a stable characteristic of people who experience depression. Mechanisms of altered reward function in depression could include disrupted balance of corticostriatal circuit function, with disruption occurring as aberrant adolescent brain development. Future studies should examine responses to social rewards; employ longitudinal and prospective designs; and investigate patterns of functional connectivity in reward circuits. Understanding altered reward function in depression has potential implications for treatment development. A more rigorous approach to investigating anhedonia, threat-reward interactions and comorbid anxiety will be valuable to future progress in describing the role of reward function in the pathophysiology of depression. © 2011 The Authors. Journal of Child Psychology and Psychiatry © 2011 Association for Child and Adolescent Mental Health.

Trial-by-Trial Modulation of Associative Memory Formation by Reward Prediction Error and Reward Anticipation as Revealed by a Biologically Plausible Computational Model.

PubMed

Aberg, Kristoffer C; Müller, Julia; Schwartz, Sophie

2017-01-01

Anticipation and delivery of rewards improves memory formation, but little effort has been made to disentangle their respective contributions to memory enhancement. Moreover, it has been suggested that the effects of reward on memory are mediated by dopaminergic influences on hippocampal plasticity. Yet, evidence linking memory improvements to actual reward computations reflected in the activity of the dopaminergic system, i.e., prediction errors and expected values, is scarce and inconclusive. For example, different previous studies reported that the magnitude of prediction errors during a reinforcement learning task was a positive, negative, or non-significant predictor of successfully encoding simultaneously presented images. Individual sensitivities to reward and punishment have been found to influence the activation of the dopaminergic reward system and could therefore help explain these seemingly discrepant results. Here, we used a novel associative memory task combined with computational modeling and showed independent effects of reward-delivery and reward-anticipation on memory. Strikingly, the computational approach revealed positive influences from both reward delivery, as mediated by prediction error magnitude, and reward anticipation, as mediated by magnitude of expected value, even in the absence of behavioral effects when analyzed using standard methods, i.e., by collapsing memory performance across trials within conditions. We additionally measured trait estimates of reward and punishment sensitivity and found that individuals with increased reward (vs. punishment) sensitivity had better memory for associations encoded during positive (vs. negative) prediction errors when tested after 20 min, but a negative trend when tested after 24 h. In conclusion, modeling trial-by-trial fluctuations in the magnitude of reward, as we did here for prediction errors and expected value computations, provides a comprehensive and biologically plausible description of the dynamic interplay between reward, dopamine, and associative memory formation. Our results also underline the importance of considering individual traits when assessing reward-related influences on memory.

Reward- and attention-related biasing of sensory selection in visual cortex.

PubMed

Buschschulte, Antje; Boehler, Carsten N; Strumpf, Hendrik; Stoppel, Christian; Heinze, Hans-Jochen; Schoenfeld, Mircea A; Hopf, Jens-Max

2014-05-01

Attention to task-relevant features leads to a biasing of sensory selection in extrastriate cortex. Features signaling reward seem to produce a similar bias, but how modulatory effects due to reward and attention relate to each other is largely unexplored. To address this issue, it is critical to separate top-down settings defining reward relevance from those defining attention. To this end, we used a visual search paradigm in which the target's definition (attention to color) was dissociated from reward relevance by delivering monetary reward on search frames where a certain task-irrelevant color was combined with the target-defining color to form the target object. We assessed the state of neural biasing for the attended and reward-relevant color by analyzing the neuromagnetic brain response to asynchronously presented irrelevant distractor probes drawn in the target-defining color, the reward-relevant color, and a completely irrelevant color as a reference. We observed that for the prospect of moderate rewards, the target-defining color but not the reward-relevant color produced a selective enhancement of the neuromagnetic response between 180 and 280 msec in ventral extrastriate visual cortex. Increasing reward prospect caused a delayed attenuation (220-250 msec) of the response to reward probes, which followed a prior (160-180 msec) response enhancement in dorsal ACC. Notably, shorter latency responses in dorsal ACC were associated with stronger attenuation in extrastriate visual cortex. Finally, an analysis of the brain response to the search frames revealed that the presence of the reward-relevant color in search distractors elicited an enhanced response that was abolished after increasing reward size. The present data together indicate that when top-down definitions of reward relevance and attention are separated, the behavioral significance of reward-associated features is still rapidly coded in higher-level cortex areas, thereby commanding effective top-down inhibitory control to counter a selection bias for those features in extrastriate visual cortex.

A Fly’s Eye View of Natural and Drug Reward

PubMed Central

Lowenstein, Eve G.; Velazquez-Ulloa, Norma A.

2018-01-01

Animals encounter multiple stimuli each day. Some of these stimuli are innately appetitive or aversive, while others are assigned valence based on experience. Drugs like ethanol can elicit aversion in the short term and attraction in the long term. The reward system encodes the predictive value for different stimuli, mediating anticipation for attractive or punishing stimuli and driving animal behavior to approach or avoid conditioned stimuli. The neurochemistry and neurocircuitry of the reward system is partly evolutionarily conserved. In both vertebrates and invertebrates, including Drosophila melanogaster, dopamine is at the center of a network of neurotransmitters and neuromodulators acting in concert to encode rewards. Behavioral assays in D. melanogaster have become increasingly sophisticated, allowing more direct comparison with mammalian research. Moreover, recent evidence has established the functional modularity of the reward neural circuits in Drosophila. This functional modularity resembles the organization of reward circuits in mammals. The powerful genetic and molecular tools for D. melanogaster allow characterization and manipulation at the single-cell level. These tools are being used to construct a detailed map of the neural circuits mediating specific rewarding stimuli and have allowed for the identification of multiple genes and molecular pathways that mediate the effects of reinforcing stimuli, including their rewarding effects. This report provides an overview of the research on natural and drug reward in D. melanogaster, including natural rewards such as sugar and other food nutrients, and drug rewards including ethanol, cocaine, amphetamine, methamphetamine, and nicotine. We focused mainly on the known genetic and neural mechanisms underlying appetitive reward for sugar and reward for ethanol. We also include genes, molecular pathways, and neural circuits that have been identified using assays that test the palatability of the rewarding stimulus, the preference for the rewarding stimulus, or other effects of the stimulus that indicate how it can modify behavior. Commonalities between mechanisms of natural and drug reward are highlighted and future directions are presented, putting forward questions best suited for research using D. melanogaster as a model organism. PMID:29720947

ADHD Related Behaviors Are Associated with Brain Activation in the Reward System

ERIC Educational Resources Information Center

Stark, R.; Bauer, E.; Merz, C. J.; Zimmermann, M.; Reuter, M.; Plichta, M. M.; Kirsch, P.; Lesch, K. P.; Fallgatter, A. J.; Vaitl, D.; Herrmann, M. J.

2011-01-01

Neuroimaging studies on attention-deficit/hyperactivity disorder (ADHD) suggest dysfunctional reward processing, with hypo-responsiveness during reward anticipation in the reward system including the nucleus accumbens (NAcc). In this study, we investigated the association between ADHD related behaviors and the reward system using functional…

Incremental effects of reward on creativity.

PubMed

Eisenberger, R; Rhoades, L

2001-10-01

The authors examined 2 ways reward might increase creativity. First, reward contingent on creativity might increase extrinsic motivation. Studies 1 and 2 found that repeatedly giving preadolescent students reward for creative performance in 1 task increased their creativity in subsequent tasks. Study 3 reported that reward promised for creativity increased college students' creative task performance. Second, expected reward for high performance might increase creativity by enhancing perceived self-determination and, therefore, intrinsic task interest. Study 4 found that employees' intrinsic job interest mediated a positive relationship between expected reward for high performance and creative suggestions offered at work. Study 5 found that employees' perceived self-determination mediated a positive relationship between expected reward for high performance and the creativity of anonymous suggestions for helping the organization.

Thalamic regulation of sucrose-seeking during unexpected reward omission

PubMed Central

Do-Monte, Fabricio H.; Minier-Toribio, Angélica; Quiñones-Laracuente, Kelvin; Medina-Colón, Estefanía M.; Quirk, Gregory J.

2017-01-01

SUMMARY The paraventricular nucleus of the thalamus (PVT) is thought to regulate behavioral responses under emotionally arousing conditions. Reward-associated cues activate PVT neurons, however, the specific PVT efferents regulating reward-seeking remain elusive. Using a cued sucrose-seeking task, we manipulated PVT activity under two emotionally distinct conditions: 1) when reward was available during the cue as expected, or 2) when reward was unexpectedly omitted during the cue. Pharmacological inactivation of the anterior PVT (aPVT), but not the posterior PVT, increased sucrose-seeking only when reward was omitted. Consistent with this, photoactivation of aPVT neurons abolished sucrose-seeking, and the firing of aPVT neurons differentiated reward availability. Photoinhibition of aPVT projections to the nucleus accumbens or to the amygdala increased or decreased, respectively, sucrose-seeking only when reward was omitted. Our findings suggest that PVT bidirectionally modulates sucrose-seeking under the negative (frustrative) conditions of reward omission. PMID:28426970

Elevated Striatal Reactivity Across Monetary and Social Rewards in Bipolar I Disorder

PubMed Central

Dutra, Sunny J.; Cunningham, William A.; Kober, Hedy; Gruber, June

2016-01-01

Bipolar disorder (BD) is associated with increased reactivity to rewards and heightened positive affectivity. It is less clear to what extent this heightened reward sensitivity is evident across contexts and what the associated neural mechanisms might be. The present investigation employed both a monetary and social incentive delay task among adults with remitted BD type I (N=24) and a healthy non-psychiatric control group (HC; N=25) using fMRI. Both whole-brain and region-of-interest analyses revealed elevated ventral and dorsal striatal reactivity across monetary and social reward receipt, but not anticipation, in the BD group. Post-hoc analyses further suggested that greater striatal reactivity to reward receipt across monetary and social reward tasks predicted decreased self-reported positive affect when anticipating subsequent rewards in the HC, but not BD, group. Results point toward elevated striatal reactivity to reward receipt as a potential neural mechanism of reward reactivity. PMID:26390194

Pay attention to your manipulation checks! Reward impact on cardiac reactivity is moderated by task context.

PubMed

Richter, Michael

2010-05-01

Two experiments assessed the moderating impact of task context on the relationship between reward and cardiovascular response. Randomly assigned to the cells of a 2 (task context: reward vs. demand) x 2 (reward value: low vs. high) between-persons design, participants performed either a memory task with an unclear performance standard (Experiment 1) or a visual scanning task with an unfixed performance standard (Experiment 2). Before performing the task--where participants could earn either a low or a high reward--participants responded to questions about either task reward or task demand. In accordance with the theoretical predictions derived from Wright's (1996) integrative model, reactivity of pre-ejection period increased with reward value if participants had rated aspects of task reward before performing the task. If they had rated task demand, pre-ejection period did not differ as a function of reward. Copyright 2010 Elsevier B.V. All rights reserved.

RM-SORN: a reward-modulated self-organizing recurrent neural network.

PubMed

Aswolinskiy, Witali; Pipa, Gordon

2015-01-01

Neural plasticity plays an important role in learning and memory. Reward-modulation of plasticity offers an explanation for the ability of the brain to adapt its neural activity to achieve a rewarded goal. Here, we define a neural network model that learns through the interaction of Intrinsic Plasticity (IP) and reward-modulated Spike-Timing-Dependent Plasticity (STDP). IP enables the network to explore possible output sequences and STDP, modulated by reward, reinforces the creation of the rewarded output sequences. The model is tested on tasks for prediction, recall, non-linear computation, pattern recognition, and sequence generation. It achieves performance comparable to networks trained with supervised learning, while using simple, biologically motivated plasticity rules, and rewarding strategies. The results confirm the importance of investigating the interaction of several plasticity rules in the context of reward-modulated learning and whether reward-modulated self-organization can explain the amazing capabilities of the brain.

Personality correlates of individual differences in the recruitment of cognitive mechanisms when rewards are at stake.

PubMed

Heritage, Allan J; Long, Laura J; Woodman, Geoffrey F; Zald, David H

2018-02-01

Individuals differ greatly in their sensitivity to rewards and punishments. In the extreme, these differences are implicated in a range of psychiatric disorders from addiction to depression. However, it is unclear how these differences influence the recruitment of attention, working memory, and long-term memory when responding to potential rewards. Here, we used a rewarded memory-guided visual search task and ERPs to examine the influence of individual differences in self-reported reward/punishment sensitivity, as measured by the Behavioral Inhibition System (BIS)/Behavioral Activation System (BAS) scales, on the recruitment of cognitive mechanisms in conditions of potential reward. Select subscales of the BAS, including the fun seeking and reward responsiveness scales, showed unique relationships with context updating to reward cues and working memory maintenance of potentially rewarded stimuli. In contrast, BIS scores showed unique relationships with deployment of attention at different points in the task. These results suggest that sensitivity to rewards (i.e., BAS) and to punishment (i.e., BIS) may play an important role in the recruitment of specific and distinct cognitive mechanisms in conditions of potential rewards. © 2017 Society for Psychophysiological Research.

High monetary reward rates and caloric rewards decrease temporal persistence

PubMed Central

Bode, Stefan; Murawski, Carsten

2017-01-01

Temporal persistence refers to an individual's capacity to wait for future rewards, while forgoing possible alternatives. This requires a trade-off between the potential value of delayed rewards and opportunity costs, and is relevant to many real-world decisions, such as dieting. Theoretical models have previously suggested that high monetary reward rates, or positive energy balance, may result in decreased temporal persistence. In our study, 50 fasted participants engaged in a temporal persistence task, incentivised with monetary rewards. In alternating blocks of this task, rewards were delivered at delays drawn randomly from distributions with either a lower or higher maximum reward rate. During some blocks participants received either a caloric drink or water. We used survival analysis to estimate participants' probability of quitting conditional on the delay distribution and the consumed liquid. Participants had a higher probability of quitting in blocks with the higher reward rate. Furthermore, participants who consumed the caloric drink had a higher probability of quitting than those who consumed water. Our results support the predictions from the theoretical models, and importantly, suggest that both higher monetary reward rates and physiologically relevant rewards can decrease temporal persistence, which is a crucial determinant for survival in many species. PMID:28228517

High monetary reward rates and caloric rewards decrease temporal persistence.

PubMed

Fung, Bowen J; Bode, Stefan; Murawski, Carsten

2017-02-22

Temporal persistence refers to an individual's capacity to wait for future rewards, while forgoing possible alternatives. This requires a trade-off between the potential value of delayed rewards and opportunity costs, and is relevant to many real-world decisions, such as dieting. Theoretical models have previously suggested that high monetary reward rates, or positive energy balance, may result in decreased temporal persistence. In our study, 50 fasted participants engaged in a temporal persistence task, incentivised with monetary rewards. In alternating blocks of this task, rewards were delivered at delays drawn randomly from distributions with either a lower or higher maximum reward rate. During some blocks participants received either a caloric drink or water. We used survival analysis to estimate participants' probability of quitting conditional on the delay distribution and the consumed liquid. Participants had a higher probability of quitting in blocks with the higher reward rate. Furthermore, participants who consumed the caloric drink had a higher probability of quitting than those who consumed water. Our results support the predictions from the theoretical models, and importantly, suggest that both higher monetary reward rates and physiologically relevant rewards can decrease temporal persistence, which is a crucial determinant for survival in many species. © 2017 The Authors.

Reward system dysfunction in autism spectrum disorders

PubMed Central

Schulte-Rüther, Martin; Nehrkorn, Barbara; Müller, Kristin; Fink, Gereon R.; Kamp-Becker, Inge; Herpertz-Dahlmann, Beate; Schultz, Robert T.; Konrad, Kerstin

2013-01-01

Although it has been suggested that social deficits of autism spectrum disorders (ASDs) are related to reward circuitry dysfunction, very little is known about the neural reward mechanisms in ASD. In the current functional magnetic resonance imaging study, we investigated brain activations in response to both social and monetary reward in a group of children with ASD, relative to matched controls. Participants with ASD showed the expected hypoactivation in the mesocorticolimbic circuitry in response to both reward types. In particular, diminished activation in the nucleus accumbens was observed when money, but not when social reward, was at stake, whereas the amygdala and anterior cingulate cortex were hypoactivated within the ASD group in response to both rewards. These data indicate that the reward circuitry is compromised in ASD in social as well as in non-social, i.e. monetary conditions, which likely contributes to atypical motivated behaviour. Taken together, with incentives used in this study sample, there is evidence for a general reward dysfunction in ASD. However, more ecologically valid social reward paradigms are needed to fully understand, whether there is any domain specificity to the reward deficit that appears evident in ASD, which would be most consistent with the ASD social phenotype. PMID:22419119

The anticipation and outcome phases of reward and loss processing: A neuroimaging meta-analysis of the monetary incentive delay task.

PubMed

Oldham, Stuart; Murawski, Carsten; Fornito, Alex; Youssef, George; Yücel, Murat; Lorenzetti, Valentina

2018-04-25

The processing of rewards and losses are crucial to everyday functioning. Considerable interest has been attached to investigating the anticipation and outcome phases of reward and loss processing, but results to date have been inconsistent. It is unclear if anticipation and outcome of a reward or loss recruit similar or distinct brain regions. In particular, while the striatum has widely been found to be active when anticipating a reward, whether it activates in response to the anticipation of losses as well remains ambiguous. Furthermore, concerning the orbitofrontal/ventromedial prefrontal regions, activation is often observed during reward receipt. However, it is unclear if this area is active during reward anticipation as well. We ran an Activation Likelihood Estimation meta-analysis of 50 fMRI studies, which used the Monetary Incentive Delay Task (MIDT), to identify which brain regions are implicated in the anticipation of rewards, anticipation of losses, and the receipt of reward. Anticipating rewards and losses recruits overlapping areas including the striatum, insula, amygdala and thalamus, suggesting that a generalised neural system initiates motivational processes independent of valence. The orbitofrontal/ventromedial prefrontal regions were recruited only during the reward outcome, likely representing the value of the reward received. Our findings help to clarify the neural substrates of the different phases of reward and loss processing, and advance neurobiological models of these processes. © 2018 The Authors Human Brain Mapping Published by Wiley Periodicals, Inc.

Integration of reward with cost anticipation during performance monitoring revealed by ERPs and EEG spectral perturbations.

PubMed

Gheza, Davide; De Raedt, Rudi; Baeken, Chris; Pourtois, Gilles

2018-06-01

Effort expenditure has an aversive connotation and it can lower hedonic feelings. In this study, we explored the electrophysiological correlates of the complex interplay of reward processing with cost anticipation. To this aim, healthy adult participants performed a gambling task where the outcome (monetary reward vs. no-reward) and its expectancy were manipulated on a trial by trial basis while 64-channel EEG was recorded. Crucially, on some trials, the no-reward outcome could be transformed to a rewarding one, pending effort expenditure by means of an orthogonal dot clicking task, enabling us to compare at the electrophysiological level reward processing when cost was anticipated or not. We extracted and compared different markers of reward processing at the feedback level using both classical ERPs and EEG spectral perturbations in specific bands (theta, delta and beta-gamma). At the behavioral level, participants reported enhanced pleasure and relief when the outcome was rewarding but effort expenditure could be avoided, relative to a control condition where the outcome was rewarding but no extra effort was anticipated. In this condition, EEG results showed a larger Reward Positivity ERP component and increased power in the Delta and Beta-gamma bands. By comparison, cost anticipation did not influence the processing of the no-reward outcome at the FRN and frontal midline theta levels. All together, these neurophysiological results suggest that effort avoidance is associated with increased reward processing. Copyright © 2018 Elsevier Inc. All rights reserved.

Reward Sensitivity for a Palatable Food Reward Peaks During Pubertal Developmental in Rats

PubMed Central

Friemel, Chris M.; Spanagel, Rainer; Schneider, Miriam

2010-01-01

Puberty is a critical period for the initiation of drug use and abuse. Because early drug use onset often accounts for a more severe progression of addiction, it is of importance to understand the underlying mechanisms and neurodevelopmental changes during puberty that are contributing to enhanced reward processing in teenagers. The present study investigated the progression of reward sensitivity toward a natural food reward over the whole course of adolescence in male rats (postnatal days 30–90) by monitoring consummatory, motivational behavior and neurobiological correlates of reward. Using a limited-free intake paradigm, consumption of sweetened condensed milk (SCM) was measured repeatedly in adolescent and adult rats. Additionally, early- and mid-pubertal animals were tested in Progressive Ratio responding for SCM and c-fos protein expression in reward-associated brain structures was examined after odor conditioning for SCM. We found a transient increase in SCM consumption and motivational incentive for SCM during puberty. This increased reward sensitivity was most pronounced around mid-puberty. The behavioral findings are paralleled by enhanced c-fos staining in reward-related structures revealing an intensified neuronal response after reward-cue presentation, distinctive for pubertal animals. Taken together, these data indicate an increase in reward sensitivity during adolescence accompanied by enhanced responsiveness of reward-associated brain structures to incentive stimuli, and it seems that both is strongly pronounced around mid-puberty. Therefore, higher reward sensitivity during pubertal maturation might contribute to the enhanced vulnerability of teenagers for the initiation of experimental drug use. PMID:20700386

Activity of striatal neurons reflects social action and own reward.

PubMed

Báez-Mendoza, Raymundo; Harris, Christopher J; Schultz, Wolfram

2013-10-08

Social interactions provide agents with the opportunity to earn higher benefits than when acting alone and contribute to evolutionary stable strategies. A basic requirement for engaging in beneficial social interactions is to recognize the actor whose movement results in reward. Despite the recent interest in the neural basis of social interactions, the neurophysiological mechanisms identifying the actor in social reward situations are unknown. A brain structure well suited for exploring this issue is the striatum, which plays a role in movement, reward, and goal-directed behavior. In humans, the striatum is involved in social processes related to reward inequity, donations to charity, and observational learning. We studied the neurophysiology of social action for reward in rhesus monkeys performing a reward-giving task. The behavioral data showed that the animals distinguished between their own and the conspecific's reward and knew which individual acted. Striatal neurons coded primarily own reward but rarely other's reward. Importantly, the activations occurred preferentially, and in approximately similar fractions, when either the own or the conspecific's action was followed by own reward. Other striatal neurons showed social action coding without reward. Some of the social action coding disappeared when the conspecific's role was simulated by a computer, confirming a social rather than observational relationship. These findings demonstrate a role of striatal neurons in identifying the social actor and own reward in a social setting. These processes may provide basic building blocks underlying the brain's function in social interactions.

Reward Promotes Self-Face Processing: An Event-Related Potential Study

PubMed Central

Zhan, Youlong; Chen, Jie; Xiao, Xiao; Li, Jin; Yang, Zilu; Fan, Wei; Zhong, Yiping

2016-01-01

The present study adopted a reward-priming paradigm to investigate whether and how monetary reward cues affected self-face processing. Event-related potentials were recorded during judgments of head orientation of target faces (self, friend, and stranger), with performance associated with a monetary reward. The results showed self-faces elicited larger N2 mean amplitudes than other-faces, and mean N2 amplitudes increased after monetary reward as compared with no reward cue. Moreover, an interaction effect between cue type and face type was observed for the P3 component, suggesting that both self-faces and friend-faces elicited larger P3 mean amplitudes than stranger-faces after no reward cue, with no significant difference between self-faces and friend-faces under this condition. However, self-faces elicited larger P3 mean amplitudes than friend-faces when monetary reward cues were provided. Interestingly, the enhancement of reward on friend-faces processing was observed at late positive potentials (LPP; 450–600 ms), suggesting that the LPP difference between friend-faces and stranger-faces was enhanced with monetary reward cues. Thus, we found that the enhancement effect of reward on self-relevant processing occurred at the later stages, but not at the early stage. These findings suggest that the activation of the reward expectations can enhance self-face processing, yielding a robust and sustained modulation over their overlapped brain areas where reward and self-relevant processing mechanisms may operate together. PMID:27242637

The endocannabinoid system in brain reward processes.

PubMed

Solinas, M; Goldberg, S R; Piomelli, D

2008-05-01

Food, drugs and brain stimulation can serve as strong rewarding stimuli and are all believed to activate common brain circuits that evolved in mammals to favour fitness and survival. For decades, endogenous dopaminergic and opioid systems have been considered the most important systems in mediating brain reward processes. Recent evidence suggests that the endogenous cannabinoid (endocannabinoid) system also has an important role in signalling of rewarding events. First, CB(1) receptors are found in brain areas involved in reward processes, such as the dopaminergic mesolimbic system. Second, activation of CB(1) receptors by plant-derived, synthetic or endogenous CB(1) receptor agonists stimulates dopaminergic neurotransmission, produces rewarding effects and increases rewarding effects of abused drugs and food. Third, pharmacological or genetic blockade of CB(1) receptors prevents activation of dopaminergic neurotransmission by several addictive drugs and reduces rewarding effects of food and these drugs. Fourth, brain levels of the endocannabinoids anandamide and 2-arachidonoylglycerol are altered by activation of reward processes. However, the intrinsic activity of the endocannabinoid system does not appear to play a facilitatory role in brain stimulation reward and some evidence suggests it may even oppose it. The influence of the endocannabinoid system on brain reward processes may depend on the degree of activation of the different brain areas involved and might represent a mechanism for fine-tuning dopaminergic activity. Although involvement of the various components of the endocannabinoid system may differ depending on the type of rewarding event investigated, this system appears to play a major role in modulating reward processes.

Cerebellar granule cells encode the expectation of reward

PubMed Central

Wagner, Mark J; Kim, Tony Hyun; Savall, Joan; Schnitzer, Mark J; Luo, Liqun

2017-01-01

The human brain contains ~60 billion cerebellar granule cells1, which outnumber all other neurons combined. Classical theories posit that a large, diverse population of granule cells allows for highly detailed representations of sensorimotor context, enabling downstream Purkinje cells to sense fine contextual changes2–6. Although evidence suggests a role for cerebellum in cognition7–10, granule cells are known to encode only sensory11–13 and motor14 context. Using two-photon calcium imaging in behaving mice, here we show that granule cells convey information about the expectation of reward. Mice initiated voluntary forelimb movements for delayed water reward. Some granule cells responded preferentially to reward or reward omission, whereas others selectively encoded reward anticipation. Reward responses were not restricted to forelimb movement, as a Pavlovian task evoked similar responses. Compared to predictable rewards, unexpected rewards elicited markedly different granule cell activity despite identical stimuli and licking responses. In both tasks, reward signals were widespread throughout multiple cerebellar lobules. Tracking the same granule cells over several days of learning revealed that cells with reward-anticipating responses emerged from those that responded at the start of learning to reward delivery, whereas reward omission responses grew stronger as learning progressed. The discovery of predictive, non-sensorimotor encoding in granule cells is a major departure from current understanding of these neurons and dramatically enriches contextual information available to postsynaptic Purkinje cells, with important implications for cognitive processing in the cerebellum. PMID:28321129

Reward positivity: Reward prediction error or salience prediction error?

PubMed

Heydari, Sepideh; Holroyd, Clay B

2016-08-01

The reward positivity is a component of the human ERP elicited by feedback stimuli in trial-and-error learning and guessing tasks. A prominent theory holds that the reward positivity reflects a reward prediction error signal that is sensitive to outcome valence, being larger for unexpected positive events relative to unexpected negative events (Holroyd & Coles, 2002). Although the theory has found substantial empirical support, most of these studies have utilized either monetary or performance feedback to test the hypothesis. However, in apparent contradiction to the theory, a recent study found that unexpected physical punishments also elicit the reward positivity (Talmi, Atkinson, & El-Deredy, 2013). The authors of this report argued that the reward positivity reflects a salience prediction error rather than a reward prediction error. To investigate this finding further, in the present study participants navigated a virtual T maze and received feedback on each trial under two conditions. In a reward condition, the feedback indicated that they would either receive a monetary reward or not and in a punishment condition the feedback indicated that they would receive a small shock or not. We found that the feedback stimuli elicited a typical reward positivity in the reward condition and an apparently delayed reward positivity in the punishment condition. Importantly, this signal was more positive to the stimuli that predicted the omission of a possible punishment relative to stimuli that predicted a forthcoming punishment, which is inconsistent with the salience hypothesis. © 2016 Society for Psychophysiological Research.

Temporal and probabilistic discounting of rewards in children and adolescents: effects of age and ADHD symptoms.

PubMed

Scheres, Anouk; Dijkstra, Marianne; Ainslie, Eleanor; Balkan, Jaclyn; Reynolds, Brady; Sonuga-Barke, Edmund; Castellanos, F Xavier

2006-01-01

This study investigated whether age and ADHD symptoms affected choice preferences in children and adolescents when they chose between (1) small immediate rewards and larger delayed rewards and (2) small certain rewards and larger probabilistic uncertain rewards. A temporal discounting (TD) task and a probabilistic discounting (PD) task were used to measure the degree to which the subjective value of a large reward decreased as one had to wait longer for it (TD), and as the probability of obtaining it decreased (PD). Rewards used were small amounts of money. In the TD task, the large reward (10 cents) was delayed by between 0 and 30s, and the immediate reward varied in magnitude (0-10 cents). In the PD task, receipt of the large reward (10 cents) varied in likelihood, with probabilities of 0, 0.25, 0.5, 0.75, and 1.0 used, and the certain reward varied in magnitude (0-10 cents). Age and diagnostic group did not affect the degree of PD of rewards: All participants made choices so that total gains were maximized. As predicted, young children, aged 6-11 years (n = 25) demonstrated steeper TD of rewards than adolescents, aged 12-17 years (n = 21). This effect remained significant even when choosing the immediate reward did not shorten overall task duration. This, together with the lack of interaction between TD task version and age, suggests that steeper discounting in young children is driven by reward immediacy and not by delay aversion. Contrary to our predictions, participants with ADHD (n = 22) did not demonstrate steeper TD of rewards than controls (n = 24). These results raise the possibility that strong preferences for small immediate rewards in ADHD, as found in previous research, depend on factors such as total maximum gain and the use of fixed versus varied delay durations. The decrease in TD as observed in adolescents compared to children may be related to developmental changes in the (dorsolateral) prefrontal cortex. Future research needs to investigate these possibilities.

Impaired Feedback Processing for Symbolic Reward in Individuals with Internet Game Overuse

PubMed Central

Kim, Jinhee; Kim, Hackjin; Kang, Eunjoo

2017-01-01

Reward processing, which plays a critical role in adaptive behavior, is impaired in addiction disorders, which are accompanied by functional abnormalities in brain reward circuits. Internet gaming disorder, like substance addiction, is thought to be associated with impaired reward processing, but little is known about how it affects learning, especially when feedback is conveyed by less-salient motivational events. Here, using both monetary (±500 KRW) and symbolic (Chinese characters “right” or “wrong”) rewards and penalties, we investigated whether behavioral performance and feedback-related neural responses are altered in Internet game overuse (IGO) group. Using functional MRI, brain responses for these two types of reward/penalty feedback were compared between young males with problems of IGO (IGOs, n = 18, mean age = 22.2 ± 2.0 years) and age-matched control subjects (Controls, n = 20, mean age = 21.2 ± 2.1) during a visuomotor association task where associations were learned between English letters and one of four responses. No group difference was found in adjustment of error responses following the penalty or in brain responses to penalty, for either monetary or symbolic penalties. The IGO individuals, however, were more likely to fail to choose the response previously reinforced by symbolic (but not monetary) reward. A whole brain two-way ANOVA analysis for reward revealed reduced activations in the IGO group in the rostral anterior cingulate cortex/ventromedial prefrontal cortex (vmPFC) in response to both reward types, suggesting impaired reward processing. However, the responses to reward in the inferior parietal region and medial orbitofrontal cortex/vmPFC were affected by the types of reward in the IGO group. Unlike the control group, in the IGO group the reward response was reduced only for symbolic reward, suggesting lower attentional and value processing specific to symbolic reward. Furthermore, the more severe the Internet gaming overuse symptoms in the IGO group, the greater the activations of the ventral striatum for monetary relative to symbolic reward. These findings suggest that IGO is associated with bias toward motivationally salient reward, which would lead to poor goal-directed behavior in everyday life. PMID:29051739

Basolateral Amygdala to Orbitofrontal Cortex Projections Enable Cue-Triggered Reward Expectations.

PubMed

Lichtenberg, Nina T; Pennington, Zachary T; Holley, Sandra M; Greenfield, Venuz Y; Cepeda, Carlos; Levine, Michael S; Wassum, Kate M

2017-08-30

To make an appropriate decision, one must anticipate potential future rewarding events, even when they are not readily observable. These expectations are generated by using observable information (e.g., stimuli or available actions) to retrieve often quite detailed memories of available rewards. The basolateral amygdala (BLA) and orbitofrontal cortex (OFC) are two reciprocally connected key nodes in the circuitry supporting such outcome-guided behaviors. But there is much unknown about the contribution of this circuit to decision making, and almost nothing known about the whether any contribution is via direct, monosynaptic projections, or the direction of information transfer. Therefore, here we used designer receptor-mediated inactivation of OFC→BLA or BLA→OFC projections to evaluate their respective contributions to outcome-guided behaviors in rats. Inactivation of BLA terminals in the OFC, but not OFC terminals in the BLA, disrupted the selective motivating influence of cue-triggered reward representations over reward-seeking decisions as assayed by Pavlovian-to-instrumental transfer. BLA→OFC projections were also required when a cued reward representation was used to modify Pavlovian conditional goal-approach responses according to the reward's current value. These projections were not necessary when actions were guided by reward expectations generated based on learned action-reward contingencies, or when rewards themselves, rather than stored memories, directed action. These data demonstrate that BLA→OFC projections enable the cue-triggered reward expectations that can motivate the execution of specific action plans and allow adaptive conditional responding. SIGNIFICANCE STATEMENT Deficits anticipating potential future rewarding events are associated with many psychiatric diseases. Presently, we know little about the neural circuits supporting such reward expectation. Here we show that basolateral amygdala to orbitofrontal cortex projections are required for expectations of specific available rewards to influence reward seeking and decision making. The necessity of these projections was limited to situations in which expectations were elicited by reward-predictive cues. These projections therefore facilitate adaptive behavior by enabling the orbitofrontal cortex to use environmental stimuli to generate expectations of potential future rewarding events. Copyright © 2017 the authors 0270-6474/17/378374-11$15.00/0.

Basolateral Amygdala to Orbitofrontal Cortex Projections Enable Cue-Triggered Reward Expectations

PubMed Central

Lichtenberg, Nina T.; Pennington, Zachary T.; Holley, Sandra M.; Greenfield, Venuz Y.; Levine, Michael S.

2017-01-01

To make an appropriate decision, one must anticipate potential future rewarding events, even when they are not readily observable. These expectations are generated by using observable information (e.g., stimuli or available actions) to retrieve often quite detailed memories of available rewards. The basolateral amygdala (BLA) and orbitofrontal cortex (OFC) are two reciprocally connected key nodes in the circuitry supporting such outcome-guided behaviors. But there is much unknown about the contribution of this circuit to decision making, and almost nothing known about the whether any contribution is via direct, monosynaptic projections, or the direction of information transfer. Therefore, here we used designer receptor-mediated inactivation of OFC→BLA or BLA→OFC projections to evaluate their respective contributions to outcome-guided behaviors in rats. Inactivation of BLA terminals in the OFC, but not OFC terminals in the BLA, disrupted the selective motivating influence of cue-triggered reward representations over reward-seeking decisions as assayed by Pavlovian-to-instrumental transfer. BLA→OFC projections were also required when a cued reward representation was used to modify Pavlovian conditional goal-approach responses according to the reward's current value. These projections were not necessary when actions were guided by reward expectations generated based on learned action-reward contingencies, or when rewards themselves, rather than stored memories, directed action. These data demonstrate that BLA→OFC projections enable the cue-triggered reward expectations that can motivate the execution of specific action plans and allow adaptive conditional responding. SIGNIFICANCE STATEMENT Deficits anticipating potential future rewarding events are associated with many psychiatric diseases. Presently, we know little about the neural circuits supporting such reward expectation. Here we show that basolateral amygdala to orbitofrontal cortex projections are required for expectations of specific available rewards to influence reward seeking and decision making. The necessity of these projections was limited to situations in which expectations were elicited by reward-predictive cues. These projections therefore facilitate adaptive behavior by enabling the orbitofrontal cortex to use environmental stimuli to generate expectations of potential future rewarding events. PMID:28743727

Reward contingencies and the recalibration of task monitoring and reward systems: a high-density electrical mapping study.

PubMed

Morie, K P; De Sanctis, P; Foxe, J J

2014-07-25

Task execution almost always occurs in the context of reward-seeking or punishment-avoiding behavior. As such, ongoing task-monitoring systems are influenced by reward anticipation systems. In turn, when a task has been executed either successfully or unsuccessfully, future iterations of that task will be re-titrated on the basis of the task outcome. Here, we examined the neural underpinnings of the task-monitoring and reward-evaluation systems to better understand how they govern reward-seeking behavior. Twenty-three healthy adult participants performed a task where they accrued points that equated to real world value (gift cards) by responding as rapidly as possible within an allotted timeframe, while success rate was titrated online by changing the duration of the timeframe dependent on participant performance. Informative cues initiated each trial, indicating the probability of potential reward or loss (four levels from very low to very high). We manipulated feedback by first informing participants of task success/failure, after which a second feedback signal indicated actual magnitude of reward/loss. High-density electroencephalography (EEG) recordings allowed for examination of event-related potentials (ERPs) to the informative cues and in turn, to both feedback signals. Distinct ERP components associated with reward cues, task-preparatory and task-monitoring processes, and reward feedback processes were identified. Unsurprisingly, participants displayed increased ERP amplitudes associated with task-preparatory processes following cues that predicted higher chances of reward. They also rapidly updated reward and loss prediction information dependent on task performance after the first feedback signal. Finally, upon reward receipt, initial reward probability was no longer taken into account. Rather, ERP measures suggested that only the magnitude of actual reward or loss was now processed. Reward and task-monitoring processes are clearly dissociable, but interact across very fast timescales to update reward predictions as information about task success or failure is accrued. Careful delineation of these processes will be useful in future investigations in clinical groups where such processes are suspected of having gone awry. Copyright © 2014 IBRO. Published by Elsevier Ltd. All rights reserved.

Reward Contingencies and the Recalibration of Task Monitoring and Reward Systems: A high-density electrical mapping study

PubMed Central

Morie, Kristen P.; De Sanctis, Pierfilippo; Foxe, John J.

2014-01-01

Task execution almost always occurs in the context of reward-seeking or punishment-avoiding behavior. As such, ongoing task monitoring systems are influenced by reward anticipation systems. In turn, when a task has been executed either successfully or unsuccessfully, future iterations of that task will be re-titrated on the basis of the task outcome. Here, we examined the neural underpinnings of the task-monitoring and reward-evaluation systems to better understand how they govern reward seeking behavior. Twenty-three healthy adult participants performed a task where they accrued points that equated to real world value (gift cards) by responding as rapidly as possible within an allotted timeframe, while success rate was titrated online by changing the duration of the timeframe dependent on participant performance. Informative cues initiated each trial, indicating the probability of potential reward or loss (four levels from very low to very high). We manipulated feedback by first informing participants of task success/failure, after which a second feedback signal indicated actual magnitude of reward/loss. High-density EEG recordings allowed for examination of event-related potentials (ERPs) to the informative cues and in turn, to both feedback signals. Distinct ERP components associated with reward cues, task preparatory and task monitoring processes, and reward feedback processes were identified. Unsurprisingly, participants displayed increased ERP amplitudes associated with task preparatory processes following cues that predicted higher chances of reward. They also rapidly updated reward and loss prediction information dependent on task performance after the first feedback signal. Finally, upon reward receipt, initial reward probability was no longer taken into account. Rather, ERP measures suggested that only the magnitude of actual reward or loss was now processed. Reward and task monitoring processes are clearly dissociable, but interact across very fast timescales to update reward predictions as information about task success or failure is accrued. Careful delineation of these processes will be useful in future investigations in clinical groups where such processes are suspected of having gone awry. PMID:24836852

Reward Selectively Modulates the Lingering Neural Representation of Recently Attended Objects in Natural Scenes.

PubMed

Hickey, Clayton; Peelen, Marius V

2017-08-02

Theories of reinforcement learning and approach behavior suggest that reward can increase the perceptual salience of environmental stimuli, ensuring that potential predictors of outcome are noticed in the future. However, outcome commonly follows visual processing of the environment, occurring even when potential reward cues have long disappeared. How can reward feedback retroactively cause now-absent stimuli to become attention-drawing in the future? One possibility is that reward and attention interact to prime lingering visual representations of attended stimuli that sustain through the interval separating stimulus and outcome. Here, we test this idea using multivariate pattern analysis of fMRI data collected from male and female humans. While in the scanner, participants searched for examples of target categories in briefly presented pictures of cityscapes and landscapes. Correct task performance was followed by reward feedback that could randomly have either high or low magnitude. Analysis showed that high-magnitude reward feedback boosted the lingering representation of target categories while reducing the representation of nontarget categories. The magnitude of this effect in each participant predicted the behavioral impact of reward on search performance in subsequent trials. Other analyses show that sensitivity to reward-as expressed in a personality questionnaire and in reactivity to reward feedback in the dopaminergic midbrain-predicted reward-elicited variance in lingering target and nontarget representations. Credit for rewarding outcome thus appears to be assigned to the target representation, causing the visual system to become sensitized for similar objects in the future. SIGNIFICANCE STATEMENT How do reward-predictive visual stimuli become salient and attention-drawing? In the real world, reward cues precede outcome and reward is commonly received long after potential predictors have disappeared. How can the representation of environmental stimuli be affected by outcome that occurs later in time? Here, we show that reward acts on lingering representations of environmental stimuli that sustain through the interval between stimulus and outcome. Using naturalistic scene stimuli and multivariate pattern analysis of fMRI data, we show that reward boosts the representation of attended objects and reduces the representation of unattended objects. This interaction of attention and reward processing acts to prime vision for stimuli that may serve to predict outcome. Copyright © 2017 the authors 0270-6474/17/377297-08$15.00/0.

Heterogeneity of reward mechanisms.

PubMed

Lajtha, A; Sershen, H

2010-06-01

The finding that many drugs that have abuse potential and other natural stimuli such as food or sexual activity cause similar chemical changes in the brain, an increase in extracellular dopamine (DA) in the shell of the nucleus accumbens (NAccS), indicated some time ago that the reward mechanism is at least very similar for all stimuli and that the mechanism is relatively simple. The presently available information shows that the mechanisms involved are more complex and have multiple elements. Multiple brain regions, multiple receptors, multiple distinct neurons, multiple transmitters, multiple transporters, circuits, peptides, proteins, metabolism of transmitters, and phosphorylation, all participate in reward mechanisms. The system is variable, is changed during development, is sex-dependent, and is influenced by genetic differences. Not all of the elements participate in the reward of all stimuli. Different set of mechanisms are involved in the reward of different drugs of abuse, yet different mechanisms in the reward of natural stimuli such as food or sexual activity; thus there are different systems that distinguish different stimuli. Separate functions of the reward system such as anticipation, evaluation, consummation and identification; all contain function-specific elements. The level of the stimulus also influences the participation of the elements of the reward system, there are possible reactions to even below threshold stimuli, and excessive stimuli can change reward to aversion involving parts of the system. Learning and memory of past reward is an important integral element of reward and addictive behavior. Many of the reward elements are altered by repeated or chronic stimuli, and chronic exposure to one drug is likely to alter the response to another stimulus. To evaluate and identify the reward stimulus thus requires heterogeneity of the reward components in the brain.

Electrophysiological evidence for the involvement of proactive and reactive control in a rewarded stop-signal task.

PubMed

Schevernels, Hanne; Bombeke, Klaas; Van der Borght, Liesbet; Hopf, Jens-Max; Krebs, Ruth M; Boehler, C Nicolas

2015-11-01

Reward availability is known to facilitate various cognitive operations, which is usually studied in cue-based paradigms that allow for enhanced preparation in reward-related trials. However, recent research using tasks that signal reward availability via task-relevant stimuli suggests that reward can also rapidly promote performance independent of global strategic preparation. Notably, this effect was also observed in a reward-related stop-signal task, in which behavioral measures of inhibition speed were found to be shorter in trials signaling reward. Corresponding fMRI results implied that this effect relies on boosted reactive control as indicated by increased activity in the 'inhibition-related network' in the reward-related condition. Here, we used EEG to better characterize transient modulations of attentional processes likely preceding this ultimate implementation of response inhibition. Importantly, such modulations would probably reflect enhanced proactive control in the form of more top-down attention to reward-related features. Counter to the notion that behavioral benefits would rely purely on reactive control, we found increased stop-evoked attentional processing (larger N1 component) on reward-related trials. This effect was accompanied by enhanced frontal P3 amplitudes reflecting successful stopping, and earlier and larger ERP differences between successful and failed stop trials in the reward-related condition. Finally, more global proactive control processes in the form of a reward context modulation of reward-unrelated trials did not have an effect on stopping performance but did influence attentional processing of go stimuli. Together, these results suggest that proactive and reactive processes can interact to bring about stimulus-specific reward benefits when the task precludes differential global preparation. Copyright © 2015 Elsevier Inc. All rights reserved.

Examinations of the reward comparison hypothesis: The modulation of gender and footshock.

PubMed

Huang, Andrew Chih Wei; Wang, Cheng Chung; Wang, Shiun

2015-11-01

The reward comparison hypothesis suggests that drugs of abuse-induced conditioned saccharin suppression intake is due to the reward value of drugs of abuse that outweighs that of a saccharin solution dissociating from the aversive LiCl-induced conditioned taste aversion (CTA). Huang and Hsiao (2008) provided some conflict data to challenge the reward comparison hypothesis. Whether the rewarding drugs of abuse-induced conditioned suppression and the aversive LiCl-induced CTA resulted from aversion or reward should be addressed. The present study investigated how gender and footshock affect aversive LiCl- and rewarding morphine- and methamphetamine (MAMPH)-induced conditioned suppression to re-examine the reward comparison hypothesis. The results indicated that gender and footshock did not directly influence the aversive LiCl-induced CTA or rewarding morphine- and MAMPH-induced conditioned suppression. The gender effect interacted with the drug effect in the aversive LiCl- and rewarding MAMPH-induced conditioned suppression but did not interact with the drug effect in the rewarding morphine-induced conditioned suppression. Footshock interacted with the drug effect in rewarding morphine- and MAMPH-induced conditioned suppression, but footshock did not interact with the drug effect in the aversive LiCl-induced CTA. Therefore, the gender and footshock effects might play a modulatory (but not a mediating) role with the drug effect. The present data indicated that footshock modulates drugs of abuse-induced conditioned suppression, which is consistent with the reward comparison hypothesis, but our findings with regard to the modulatory role of the gender effect and the drug effect do not support this hypothesis. The reward comparison hypothesis should be discussed and possibly reconsidered. Copyright © 2015. Published by Elsevier Inc.

Orbitofrontal reward sensitivity and impulsivity in adult attention deficit hyperactivity disorder.

PubMed

Wilbertz, Gregor; van Elst, Ludger Tebartz; Delgado, Mauricio R; Maier, Simon; Feige, Bernd; Philipsen, Alexandra; Blechert, Jens

2012-03-01

Impulsivity symptoms of adult attention deficit hyperactivity disorder (ADHD) such as increased risk taking have been linked with impaired reward processing. Previous studies have focused on reward anticipation or on rewarded executive functioning tasks and have described a striatal hyporesponsiveness and orbitofrontal alterations in adult and adolescent ADHD. Passive reward delivery and its link to behavioral impulsivity are less well understood. To study this crucial aspect of reward processing we used functional magnetic resonance imaging (fMRI) combined with electrodermal assessment in male and female adult ADHD patients (N=28) and matched healthy control participants (N=28) during delivery of monetary and non-monetary rewards. Further, two behavioral tasks assessed risky decision making (game of dice task) and delay discounting. Results indicated that both groups activated ventral and dorsal striatum and the medial orbitofrontal cortex (mOFC) in response to high-incentive (i.e. monetary) rewards. A similar, albeit less strong activation pattern was found for low-incentive (i.e. non-monetary) rewards. Group differences emerged when comparing high and low incentive rewards directly: activation in the mOFC coded for the motivational change in reward delivery in healthy controls, but not ADHD patients. Additionally, this dysfunctional mOFC activity in patients correlated with risky decision making and delay discounting and was paralleled by physiological arousal. Together, these results suggest that the mOFC codes reward value and type in healthy individuals whereas this function is deficient in ADHD. The brain-behavior correlations suggest that this deficit might be related to behavioral impulsivity. Reward value processing difficulties in ADHD should be considered when assessing reward anticipation and emotional learning in research and applied settings. Copyright © 2011 Elsevier Inc. All rights reserved.

Blunted striatal response to monetary reward anticipation during smoking abstinence predicts lapse during a contingency-managed quit attempt

PubMed Central

Sweitzer, Maggie M.; Geier, Charles F.; Denlinger, Rachel; Forbes, Erika E.; Raiff, Bethany R.; Dallery, Jesse; McClernon, F.J.; Donny, Eric C.

2017-01-01

Rationale Tobacco smoking is associated with dysregulated reward processing within the striatum, characterized by hypersensitivity to smoking rewards and hyposensitivity to non-smoking rewards. This bias toward smoking reward at the expense of alternative rewards is further exacerbated by deprivation from smoking, which may contribute to difficulty maintaining abstinence during a quit attempt. Objective We examined whether abstinence-induced changes in striatal processing of rewards predicted lapse likelihood during a quit attempt supported by contingency management (CM), in which abstinence from smoking was reinforced with money. Methods Thirty-six non-treatment seeking smokers participated in two fMRI sessions, one following 24-hr abstinence and one following smoking as usual. During each scan, participants completed a rewarded guessing task designed to elicit striatal activation in which they could earn smoking and monetary rewards delivered after the scan. Participants then engaged in a 3-week CM-supported quit attempt. Results As previously reported, 24-hr abstinence was associated with increased striatal activation in anticipation of smoking reward and decreased activation in anticipation of monetary reward. Individuals exhibiting greater decrements in right striatal activation to monetary reward during abstinence (controlling for activation during non-abstinence) were more likely to lapse during CM (p<.05), even when controlling for other predictors of lapse outcome (e.g., craving); no association was seen for smoking reward. Conclusions These results are consistent with a growing number of studies indicating the specific importance of disrupted striatal processing of non-drug reward in nicotine dependence, and highlight the importance of individual differences in abstinence-induced deficits in striatal function for smoking cessation. PMID:26660448

Reward-based spatial learning in unmedicated adults with obsessive-compulsive disorder.

PubMed

Marsh, Rachel; Tau, Gregory Z; Wang, Zhishun; Huo, Yuankai; Liu, Ge; Hao, Xuejun; Packard, Mark G; Peterson, Bradley S; Simpson, H Blair

2015-04-01

The authors assessed the functioning of mesolimbic and striatal areas involved in reward-based spatial learning in unmedicated adults with obsessive-compulsive disorder (OCD). Functional MRI blood-oxygen-level-dependent response was compared in 33 unmedicated adults with OCD and 33 healthy, age-matched comparison subjects during a reward-based learning task that required learning to use extramaze cues to navigate a virtual eight-arm radial maze to find hidden rewards. The groups were compared in their patterns of brain activation associated with reward-based spatial learning versus a control condition in which rewards were unexpected because they were allotted pseudorandomly to experimentally prevent learning. Both groups learned to navigate the maze to find hidden rewards, but group differences in neural activity during navigation and reward processing were detected in mesolimbic and striatal areas. During navigation, the OCD group, unlike the healthy comparison group, exhibited activation in the left posterior hippocampus. Unlike healthy subjects, participants in the OCD group did not show activation in the left ventral putamen and amygdala when anticipating rewards or in the left hippocampus, amygdala, and ventral putamen when receiving unexpected rewards (control condition). Signal in these regions decreased relative to baseline during unexpected reward receipt among those in the OCD group, and the degree of activation was inversely associated with doubt/checking symptoms. Participants in the OCD group displayed abnormal recruitment of mesolimbic and ventral striatal circuitry during reward-based spatial learning. Whereas healthy comparison subjects exhibited activation in this circuitry in response to the violation of reward expectations, unmedicated OCD participants did not and instead over-relied on the posterior hippocampus during learning. Thus, dopaminergic innervation of reward circuitry may be altered, and future study of anterior/posterior hippocampal dysfunction in OCD is warranted.

Dopamine receptor blockade attenuates the general incentive motivational effects of noncontingently delivered rewards and reward-paired cues without affecting their ability to bias action selection.

PubMed

Ostlund, Sean B; Maidment, Nigel T

2012-01-01

Environmental cues affect our behavior in a variety of ways. Despite playing an invaluable role in guiding our daily activities, such cues also appear to trigger the harmful, compulsive behaviors that characterize addiction and other disorders of behavioral control. In instrumental conditioning, rewards and reward-paired cues bias action selection and invigorate reward-seeking behaviors, and appear to do so through distinct neurobehavioral processes. Although reward-paired cues are known to invigorate performance through a dopamine-dependent incentive motivational process, it is not known if dopamine also mediates the influence of rewards and reward-paired cues over action selection. The current study contrasted the effects of systemic administration of the nonspecific dopamine receptor antagonist flupentixol on response invigoration and action bias in Pavlovian-instrumental transfer, a test of cue-elicited responding, and in instrumental reinstatement, a test of noncontingent reward-elicited responding. Hungry rats were trained on two different stimulus-outcome relationships (eg, tone-grain pellets and noise-sucrose solution) and two different action-outcome relationships (eg, left press-grain and right press-sucrose). At test, we found that flupentixol pretreatment blocked the response invigoration generated by the cues but spared their ability to bias action selection to favor the action whose outcome was signaled by the cue being presented. The response-biasing influence of noncontingent reward deliveries was also unaffected by flupentixol. Interestingly, although flupentixol had a modest effect on the immediate response invigoration produced by those rewards, it was particularly potent in countering the lingering enhancement of responding produced by multiple reward deliveries. These findings indicate that dopamine mediates the general incentive motivational effects of noncontingent rewards and reward-paired cues but does not support their ability to bias action selection.

Blunted striatal response to monetary reward anticipation during smoking abstinence predicts lapse during a contingency-managed quit attempt.

PubMed

Sweitzer, Maggie M; Geier, Charles F; Denlinger, Rachel; Forbes, Erika E; Raiff, Bethany R; Dallery, Jesse; McClernon, F J; Donny, Eric C

2016-03-01

Tobacco smoking is associated with dysregulated reward processing within the striatum, characterized by hypersensitivity to smoking rewards and hyposensitivity to non-smoking rewards. This bias toward smoking reward at the expense of alternative rewards is further exacerbated by deprivation from smoking, which may contribute to difficulty maintaining abstinence during a quit attempt. We examined whether abstinence-induced changes in striatal processing of rewards predicted lapse likelihood during a quit attempt supported by contingency management (CM), in which abstinence from smoking was reinforced with money. Thirty-six non-treatment-seeking smokers participated in two functional MRI (fMRI) sessions, one following 24-h abstinence and one following smoking as usual. During each scan, participants completed a rewarded guessing task designed to elicit striatal activation in which they could earn smoking and monetary rewards delivered after the scan. Participants then engaged in a 3-week CM-supported quit attempt. As previously reported, 24-h abstinence was associated with increased striatal activation in anticipation of smoking reward and decreased activation in anticipation of monetary reward. Individuals exhibiting greater decrements in right striatal activation to monetary reward during abstinence (controlling for activation during non-abstinence) were more likely to lapse during CM (p < 0.025), even when controlling for other predictors of lapse outcome (e.g., craving); no association was seen for smoking reward. These results are consistent with a growing number of studies indicating the specific importance of disrupted striatal processing of non-drug reward in nicotine dependence and highlight the importance of individual differences in abstinence-induced deficits in striatal function for smoking cessation.

Pain and suicidality: Insights from reward and addiction neuroscience

PubMed Central

Elman, Igor; Borsook, David; Volkow, Nora D.

2016-01-01

Suicidality is exceedingly prevalent in pain patients. Although the pathophysiology of this link remains unclear, it may be potentially related to the partial congruence of physical and emotional pain systems. The latter system’s role in suicide is also conspicuous during setbacks and losses sustained in the context of social attachments. Here we propose a model based on the neural pathways mediating reward and anti-reward (i.e., allostatic adjustment to recurrent activation of the reward circuitry); both are relevant etiologic factors in pain, suicide and social attachments. A comprehensive literature search on neurobiology of pain and suicidality was performed. The collected articles were critically reviewed and relevant data were extracted and summarized within four key areas: (1) physical and emotional pain, (2) emotional pain and social attachments, (3) pain-and suicide-related alterations of the reward and anti-reward circuits as compared to addiction, which is the premier probe for dysfunction of these circuits and (4) mechanistically informed treatments of co-occurring pain and suicidality. Pain-, stress- and analgesic drugs-induced opponent and proponent states of the mesolimbic dopaminergic pathways may render reward and anti-reward systems vulnerable to sensitization, cross-sensitization and aberrant learning of contents and contexts associated with suicidal acts and behaviors. These findings suggest that pain patients exhibit alterations in the brain circuits mediating reward (depressed function) and anti-reward (sensitized function) that may affect their proclivity for suicide and support pain and suicidality classification among other “reward deficiency syndromes” and a new proposal for “enhanced anti-reward syndromes”. We suggest that interventions aimed at restoring the balance between the reward and anti-reward networks in patients with chronic pain may help decreasing their suicide risk. PMID:23827972

Pain and suicidality: insights from reward and addiction neuroscience.

PubMed

Elman, Igor; Borsook, David; Volkow, Nora D

2013-10-01

Suicidality is exceedingly prevalent in pain patients. Although the pathophysiology of this link remains unclear, it may be potentially related to the partial congruence of physical and emotional pain systems. The latter system's role in suicide is also conspicuous during setbacks and losses sustained in the context of social attachments. Here we propose a model based on the neural pathways mediating reward and anti-reward (i.e., allostatic adjustment to recurrent activation of the reward circuitry); both are relevant etiologic factors in pain, suicide and social attachments. A comprehensive literature search on neurobiology of pain and suicidality was performed. The collected articles were critically reviewed and relevant data were extracted and summarized within four key areas: (1) physical and emotional pain, (2) emotional pain and social attachments, (3) pain- and suicide-related alterations of the reward and anti-reward circuits as compared to addiction, which is the premier probe for dysfunction of these circuits and (4) mechanistically informed treatments of co-occurring pain and suicidality. Pain-, stress- and analgesic drugs-induced opponent and proponent states of the mesolimbic dopaminergic pathways may render reward and anti-reward systems vulnerable to sensitization, cross-sensitization and aberrant learning of contents and contexts associated with suicidal acts and behaviors. These findings suggest that pain patients exhibit alterations in the brain circuits mediating reward (depressed function) and anti-reward (sensitized function) that may affect their proclivity for suicide and support pain and suicidality classification among other "reward deficiency syndromes" and a new proposal for "enhanced anti-reward syndromes". We suggest that interventions aimed at restoring the balance between the reward and anti-reward networks in patients with chronic pain may help decreasing their suicide risk. Published by Elsevier Ltd.

Using food as a reward: An examination of parental reward practices.

PubMed

Roberts, Lindsey; Marx, Jenna M; Musher-Eizenman, Dara R

2018-01-01

Eating patterns and taste preferences are often established early in life. Many studies have examined how parental feeding practices may affect children's outcomes, including food intake and preference. The current study focused on a common food parenting practice, using food as a reward, and used Latent Profile Analysis (LPA) to examine whether mothers (n = 376) and fathers (n = 117) of children ages 2.8 to 7.5 (M = 4.7; SD = 1.1) grouped into profiles (i.e., subgroups) based on how they use of food as a reward. The 4-class model was the best-fitting LPA model, with resulting classes based on both the frequency and type of reward used. Classes were: infrequent reward (33%), tangible reward (21%), food reward (27%), and frequent reward (19%). The current study also explored whether children's eating styles (emotional overeating, rood fussiness, food responsiveness, and satiety responsiveness) and parenting style (Authoritative, Authoritarian, and Permissive) varied by reward profile. Analyses of Variance (ANOVA) revealed that the four profiles differed significantly for all outcome variables except satiety responsiveness. It appears that the use of tangible and food-based rewards have important implications in food parenting. More research is needed to better understand how the different rewarding practices affect additional child outcomes. Copyright © 2017 Elsevier Ltd. All rights reserved.

Reward speeds up and increases consistency of visual selective attention: a lifespan comparison.

PubMed

Störmer, Viola; Eppinger, Ben; Li, Shu-Chen

2014-06-01

Children and older adults often show less favorable reward-based learning and decision making, relative to younger adults. It is unknown, however, whether reward-based processes that influence relatively early perceptual and attentional processes show similar lifespan differences. In this study, we investigated whether stimulus-reward associations affect selective visual attention differently across the human lifespan. Children, adolescents, younger adults, and older adults performed a visual search task in which the target colors were associated with either high or low monetary rewards. We discovered that high reward value speeded up response times across all four age groups, indicating that reward modulates attentional selection across the lifespan. This speed-up in response time was largest in younger adults, relative to the other three age groups. Furthermore, only younger adults benefited from high reward value in increasing response consistency (i.e., reduction of trial-by-trial reaction time variability). Our findings suggest that reward-based modulations of relatively early and implicit perceptual and attentional processes are operative across the lifespan, and the effects appear to be greater in adulthood. The age-specific effect of reward on reducing intraindividual response variability in younger adults likely reflects mechanisms underlying the development and aging of reward processing, such as lifespan age differences in the efficacy of dopaminergic modulation. Overall, the present results indicate that reward shapes visual perception across different age groups by biasing attention to motivationally salient events.

Reward Responsiveness Varies by Smoking Status in Women with a History of Major Depressive Disorder

PubMed Central

Janes, Amy C; Pedrelli, Paola; Whitton, Alexis E; Pechtel, Pia; Douglas, Samuel; Martinson, Max A; Huz, Ilana; Fava, Maurizio; Pizzagalli, Diego A; Evins, A Eden

2015-01-01

Major depressive disorder (MDD) and nicotine dependence are highly comorbid, with studies showing that ~50% of individuals with MDD smoke. The link between these disorders persists even after the clinical symptoms of depression subside, as indicated by high levels of nicotine dependence among individuals with remitted depression (rMDD). Recent evidence indicates that individuals with rMDD show blunted responses to reward as measured by a probabilistic reward task (PRT), which assesses the ability to modify behavior as a function of reward history. Given nicotine's ability to enhance reward responsiveness, individuals with rMDD might smoke to address this persistent reward deficit. However, it is unclear whether smokers with rMDD show enhanced reward responsiveness relative to rMDD individuals who do not smoke. To test this hypothesis, we evaluated reward responsiveness on the PRT in four groups (N=198): individuals with and without rMDD who were or were not nicotine dependent. As hypothesized, rMDD nonsmokers had lower reward responsiveness relative to both control nonsmokers and rMDD smokers; conversely, smokers with rMDD showed behavioral patterns comparable to those without a history of depression. Given nicotine's ability to enhance reward sensitivity, it is possible that nicotine normalizes the otherwise blunted reward responsiveness in individuals with rMDD. Therapies aimed at enhancing this reward-based deficit may be beneficial in the treatment of both nicotine dependence and MDD. PMID:25662839

Dopamine prediction error responses integrate subjective value from different reward dimensions

PubMed Central

Lak, Armin; Stauffer, William R.; Schultz, Wolfram

2014-01-01

Prediction error signals enable us to learn through experience. These experiences include economic choices between different rewards that vary along multiple dimensions. Therefore, an ideal way to reinforce economic choice is to encode a prediction error that reflects the subjective value integrated across these reward dimensions. Previous studies demonstrated that dopamine prediction error responses reflect the value of singular reward attributes that include magnitude, probability, and delay. Obviously, preferences between rewards that vary along one dimension are completely determined by the manipulated variable. However, it is unknown whether dopamine prediction error responses reflect the subjective value integrated from different reward dimensions. Here, we measured the preferences between rewards that varied along multiple dimensions, and as such could not be ranked according to objective metrics. Monkeys chose between rewards that differed in amount, risk, and type. Because their choices were complete and transitive, the monkeys chose “as if” they integrated different rewards and attributes into a common scale of value. The prediction error responses of single dopamine neurons reflected the integrated subjective value inferred from the choices, rather than the singular reward attributes. Specifically, amount, risk, and reward type modulated dopamine responses exactly to the extent that they influenced economic choices, even when rewards were vastly different, such as liquid and food. This prediction error response could provide a direct updating signal for economic values. PMID:24453218

Delay discounting of oral morphine and sweetened juice rewards in dependent and non-dependent rats.

PubMed

Harvey-Lewis, Colin; Perdrizet, Johnna; Franklin, Keith B J

2014-07-01

Opioid-dependent humans are reported to show accelerated delay discounting of opioid rewards when compared to monetary rewards. It has been suggested that this may reflect a difference in discounting of consumable and non-consumable goods not specific to dependent individuals. Here, we evaluate the discounting of similar morphine and non-morphine oral rewards in dependent and non-dependent rats We first tested the analgesic and rewarding effects of our morphine solution. In a second experiment, we assigned rats randomly to either dependent or non-dependent groups that, 30 min after daily testing, received 30 mg/kg subcutaneous dose of morphine, or saline, respectively. Delay discounting of drug-free reward was examined prior to initiation of the dosing regimen. We tested discounting of the morphine reward in half the rats and retested the discounting of the drug-free reward in the other half. All tests were run 22.5 h after the daily maintenance dose. Rats preferred the morphine cocktail to the drug-free solution and consumed enough to induce significant analgesia. The control quinine solution did not produce these effects. Dependent rats discounted morphine rewards more rapidly than before dependence and when compared to discounting drug-free rewards. In non-dependent rats both reward types were discounted similarly. These results show that morphine dependence increases impulsiveness specifically towards a drug reward while morphine experience without dependence does not.

Neural dissociation of food- and money-related reward processing using an abstract incentive delay task.

PubMed

Simon, Joe J; Skunde, Mandy; Wu, Mudan; Schnell, Knut; Herpertz, Sabine C; Bendszus, Martin; Herzog, Wolfgang; Friederich, Hans-Christoph

2015-08-01

Food is an innate reward stimulus related to energy homeostasis and survival, whereas money is considered a more general reward stimulus that gains a rewarding value through learning experiences. Although the underlying neural processing for both modalities of reward has been investigated independently from one another, a more detailed investigation of neural similarities and/or differences between food and monetary reward is still missing. Here, we investigated the neural processing of food compared with monetary-related rewards in 27 healthy, normal-weight women using functional magnetic resonance imaging. We developed a task distinguishing between the anticipation and the receipt of either abstract food or monetary reward. Both tasks activated the ventral striatum during the expectation of a reward. Compared with money, greater food-related activations were observed in prefrontal, parietal and central midline structures during the anticipation and lateral orbitofrontal cortex (lOFC) during the receipt of food reward. Furthermore, during the receipt of food reward, brain activation in the secondary taste cortex was positively related to the body mass index. These results indicate that food-dependent activations encompass to a greater extent brain regions involved in self-control and self-reflection during the anticipation and phylogenetically older parts of the lOFC during the receipt of reward. © The Author (2014). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Diminished social reward anticipation in the broad autism phenotype as revealed by event-related brain potentials.

PubMed

Cox, Anthony; Kohls, Gregor; Naples, Adam J; Mukerji, Cora E; Coffman, Marika C; Rutherford, Helena J V; Mayes, Linda C; McPartland, James C

2015-10-01

Diminished responsivity to reward incentives is a key contributor to the social-communication problems seen in autism spectrum disorders (ASDs). Social motivation theories suggest that individuals with ASD do not experience social interactions as rewarding, leading to negative consequences for the development of brain circuitry subserving social information. In this study, we examined neural responses to social and non-social reward anticipation in 35 typically developing young adults, examining modulation of reward sensitivity by level of autistic traits. Using an Event-related potential incentive-delay task incorporating novel, more ecologically valid forms of reward, higher expression of autistic traits was associated with an attenuated P3 response to the anticipation of social (simulated real-time video feedback from an observer), but not non-social (candy), rewards. Exploratory analyses revealed that this was unrelated to mentalizing ability. The P3 component reflects motivated attention to reward signals, suggesting attenuated motivation allocation specific to social incentives. The study extends prior findings of atypical reward anticipation in ASD, demonstrating that attenuated social reward responsiveness extends to autistic traits in the range of typical functioning. Results support the development of innovative paradigms for investigating social and non-social reward responsiveness. Insight into vulnerabilities in reward processing is critical for understanding social function in ASD. © The Author (2015). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Biological auctions with multiple rewards

PubMed Central

Reiter, Johannes G.; Kanodia, Ayush; Gupta, Raghav; Nowak, Martin A.; Chatterjee, Krishnendu

2015-01-01

The competition for resources among cells, individuals or species is a fundamental characteristic of evolution. Biological all-pay auctions have been used to model situations where multiple individuals compete for a single resource. However, in many situations multiple resources with various values exist and single reward auctions are not applicable. We generalize the model to multiple rewards and study the evolution of strategies. In biological all-pay auctions the bid of an individual corresponds to its strategy and is equivalent to its payment in the auction. The decreasingly ordered rewards are distributed according to the decreasingly ordered bids of the participating individuals. The reproductive success of an individual is proportional to its fitness given by the sum of the rewards won minus its payments. Hence, successful bidding strategies spread in the population. We find that the results for the multiple reward case are very different from the single reward case. While the mixed strategy equilibrium in the single reward case with more than two players consists of mostly low-bidding individuals, we show that the equilibrium can convert to many high-bidding individuals and a few low-bidding individuals in the multiple reward case. Some reward values lead to a specialization among the individuals where one subpopulation competes for the rewards and the other subpopulation largely avoids costly competitions. Whether the mixed strategy equilibrium is an evolutionarily stable strategy (ESS) depends on the specific values of the rewards. PMID:26180069

Probability differently modulating the effects of reward and punishment on visuomotor adaptation.

PubMed

Song, Yanlong; Smiley-Oyen, Ann L

2017-12-01

Recent human motor learning studies revealed that punishment seemingly accelerated motor learning but reward enhanced consolidation of motor memory. It is not evident how intrinsic properties of reward and punishment modulate the potentially dissociable effects of reward and punishment on motor learning and motor memory. It is also not clear what causes the dissociation of the effects of reward and punishment. By manipulating probability of distribution, a critical property of reward and punishment, the present study demonstrated that probability had distinct modulation on the effects of reward and punishment in adapting to a sudden visual rotation and consolidation of the adaptation memory. Specifically, two probabilities of monetary reward and punishment distribution, 50 and 100%, were applied during young adult participants adapting to a sudden visual rotation. Punishment and reward showed distinct effects on motor adaptation and motor memory. The group that received punishments in 100% of the adaptation trials adapted significantly faster than the other three groups, but the group that received rewards in 100% of the adaptation trials showed marked savings in re-adapting to the same rotation. In addition, the group that received punishments in 50% of the adaptation trials that were randomly selected also had savings in re-adapting to the same rotation. Sensitivity to sensory prediction error or difference in explicit process induced by reward and punishment may likely contribute to the distinct effects of reward and punishment.

Abnormal Striatal BOLD Responses to Reward Anticipation and Reward Delivery in ADHD

PubMed Central

Furukawa, Emi; Bado, Patricia; Tripp, Gail; Mattos, Paulo; Wickens, Jeff R.; Bramati, Ivanei E.; Alsop, Brent; Ferreira, Fernanda Meireles; Lima, Debora; Tovar-Moll, Fernanda; Sergeant, Joseph A.; Moll, Jorge

2014-01-01

Altered reward processing has been proposed to contribute to the symptoms of attention deficit hyperactivity disorder (ADHD). The neurobiological mechanism underlying this alteration remains unclear. We hypothesize that the transfer of dopamine release from reward to reward-predicting cues, as normally observed in animal studies, may be deficient in ADHD. Functional magnetic resonance imaging (fMRI) was used to investigate striatal responses to reward-predicting cues and reward delivery in a classical conditioning paradigm. Data from 14 high-functioning and stimulant-naïve young adults with elevated lifetime symptoms of ADHD (8 males, 6 females) and 15 well-matched controls (8 males, 7 females) were included in the analyses. During reward anticipation, increased blood-oxygen-level-dependent (BOLD) responses in the right ventral and left dorsal striatum were observed in controls, but not in the ADHD group. The opposite pattern was observed in response to reward delivery; the ADHD group demonstrated significantly greater BOLD responses in the ventral striatum bilaterally and the left dorsal striatum relative to controls. In the ADHD group, the number of current hyperactivity/impulsivity symptoms was inversely related to ventral striatal responses during reward anticipation and positively associated with responses to reward. The BOLD response patterns observed in the striatum are consistent with impaired predictive dopamine signaling in ADHD, which may explain altered reward-contingent behaviors and symptoms of ADHD. PMID:24586543

36 CFR 262.1 - Rewards in connection with fire or property prosecutions.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 36 Parks, Forests, and Public Property 2 2010-07-01 2010-07-01 false Rewards in connection with..., DEPARTMENT OF AGRICULTURE LAW ENFORCEMENT SUPPORT ACTIVITIES Rewards and Payments § 262.1 Rewards in... appropriation or authorize the payment thereof, the Department of Agriculture will pay the following rewards: (1...

How performance-contingent reward prospect modulates cognitive control: Increased cue maintenance at the cost of decreased flexibility.

PubMed

Hefer, Carmen; Dreisbach, Gesine

2017-10-01

Growing evidence suggests that reward prospect promotes cognitive stability in terms of increased context or cue maintenance. In 3 Experiments, using different versions of the AX-continuous performance task, we investigated whether this reward effect comes at the cost of decreased cognitive flexibility. Experiment 1 shows that the reward induced increase of cue maintenance perseverates even when reward is no longer available. Experiment 2 shows that this reward effect not only survives the withdrawal of reward but also delays the adaptation to changed task conditions that make cue usage maladaptive. And finally in Experiment 3, it is shown that this reduced flexibility to adapt is observed in a more demanding modified version of the AX-continuous performance task and is even stronger under conditions of sustained reward. Taken together, all 3 Experiments thus speak to the idea that the prospect of reward increases cue maintenance and thereby cognitive stability. This increased cognitive stability however comes at the cost of decreased flexibility in terms of delayed adaptation to new reward and task conditions. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

The Effects of Stability and Presentation Order of Rewards on Justice Evaluations

PubMed Central

Park, Hyomin; Melamed, David

2016-01-01

Justice research has evolved by elucidating the factors that affect justice evaluations, as well as their consequences. Unfortunately, few researchers have paid attention to the pattern of rewards over time as a predictor of justice evaluations. There are two main objectives of this research. First, it aims to test the effect of reward stability on justice evaluations. Based on justice theory and prospect theory, we assume that an under-reward at one time cannot be fully offset by an equivalent over-reward at another time. Therefore, in unstable reward systems the asymmetry of the effect of unjust rewards with opposite directions will produce a lower level of justice evaluations over time. The second objective of this research is to show the moderating effect of the presentation order (primacy vs. recency) of unstable rewards on justice evaluations. The results from a controlled experiment with five conditions, which presents the instability of rewards in different orders, confirm both the negative effect of unstable rewards and the stronger effect of primacy on justice evaluations. PMID:28005957

Music-related reward responses predict episodic memory performance.

PubMed

Ferreri, Laura; Rodriguez-Fornells, Antoni

2017-12-01

Music represents a special type of reward involving the recruitment of the mesolimbic dopaminergic system. According to recent theories on episodic memory formation, as dopamine strengthens the synaptic potentiation produced by learning, stimuli triggering dopamine release could result in long-term memory improvements. Here, we behaviourally test whether music-related reward responses could modulate episodic memory performance. Thirty participants rated (in terms of arousal, familiarity, emotional valence, and reward) and encoded unfamiliar classical music excerpts. Twenty-four hours later, their episodic memory was tested (old/new recognition and remember/know paradigm). Results revealed an influence of music-related reward responses on memory: excerpts rated as more rewarding were significantly better recognized and remembered. Furthermore, inter-individual differences in the ability to experience musical reward, measured through the Barcelona Music Reward Questionnaire, positively predicted memory performance. Taken together, these findings shed new light on the relationship between music, reward and memory, showing for the first time that music-driven reward responses are directly implicated in higher cognitive functions and can account for individual differences in memory performance.

"I won, but I’m not getting my hopes up": Depression Moderates the Relationship Outcomes and Reward Anticipation

PubMed Central

Olino, Thomas M.; McMakin, Dana L.; Dahl, Ronald E.; Ryan, Neal D.; Silk, Jennifer S.; Birmaher, Boris; Axelson, David A.; Forbes, Erika E.

2011-01-01

Major Depressive Disorder (MDD) in adolescents is characterized by alterations in positive emotions and reward processing. Recent investigations using functional magnetic resonance imaging (fMRI) find depression-related differences in reward anticipation. However, it is unknown whether feedback influences subsequent reward anticipation, which may highlight the context of reward processing. Ten youth with MDD and sixteen youth with no history of MDD completed an fMRI assessment using a reward task. Reward anticipation was indexed by blood oxygen level dependent signal change in the striatum following winning; losing; non-winning; and non-losing outcomes. A significant interaction between diagnostic status and outcome condition predicted reward anticipation in the caudate. Decomposition of the interaction indicated that following winning outcomes, depressed youth demonstrated reduced reward anticipation relative to healthy youth. However, no significant differences between depressed and healthy youth were found after other outcomes. Reward anticipation is altered following winning outcomes. This finding has implications for understanding the developmental pathophysiology of MDD and suggests specific contexts where altered motivational system functioning may play a role in maintaining depression. PMID:22079656

Goal or gold: overlapping reward processes in soccer players upon scoring and winning money.

PubMed

Häusler, Alexander Niklas; Becker, Benjamin; Bartling, Marcel; Weber, Bernd

2015-01-01

Social rewards are important incentives for human behavior. This is especially true in team sports such as the most popular one worldwide: soccer. We investigated reward processing upon scoring a soccer goal in a standard two-versus-one situation and in comparison to winning in a monetary incentive task. The results show a strong overlap in brain activity between the two conditions in established reward regions of the mesolimbic dopaminergic system, including the ventral striatum and ventromedial pre-frontal cortex. The three main components of reward-associated learning, i.e., reward probability (RP), reward reception (RR) and reward prediction errors (RPE) showed highly similar activation in both con-texts, with only the RR and RPE components displaying overlapping reward activity. Passing and shooting behavior did not correlate with individual egoism scores, but we observe a positive correlation be-tween egoism and activity in the left middle frontal gyrus upon scoring after a pass versus a direct shot. Our findings suggest that rewards in the context of soccer and monetary incentives are based on similar neural processes.

Goal or Gold: Overlapping Reward Processes in Soccer Players upon Scoring and Winning Money

PubMed Central

Häusler, Alexander Niklas; Becker, Benjamin; Bartling, Marcel; Weber, Bernd

2015-01-01

Social rewards are important incentives for human behavior. This is especially true in team sports such as the most popular one worldwide: soccer. We investigated reward processing upon scoring a soccer goal in a standard two-versus-one situation and in comparison to winning in a monetary incentive task. The results show a strong overlap in brain activity between the two conditions in established reward regions of the mesolimbic dopaminergic system, including the ventral striatum and ventromedial pre-frontal cortex. The three main components of reward-associated learning i.e. reward probability (RP), reward reception (RR) and reward prediction errors (RPE) showed highly similar activation in both con-texts, with only the RR and RPE components displaying overlapping reward activity. Passing and shooting behavior did not correlate with individual egoism scores, but we observe a positive correlation be-tween egoism and activity in the left middle frontal gyrus upon scoring after a pass versus a direct shot. Our findings suggest that rewards in the context of soccer and monetary incentives are based on similar neural processes. PMID:25875594

Distractors associated with reward break through the focus of attention.

PubMed

Munneke, Jaap; Belopolsky, Artem V; Theeuwes, Jan

2016-10-01

In the present study, we investigated the conditions in which rewarded distractors have the ability to capture attention, even when attention is directed toward the target location. Experiment 1 showed that when the probability of obtaining reward was high, all salient distractors captured attention, even when they were not associated with reward. This effect may have been caused by participants suboptimally using the 100%-valid endogenous location cue. Experiment 2 confirmed this result by showing that salient distractors did not capture attention in a block in which no reward was expected. In Experiment 3, the probability of the presence of a distractor was high, but it only signaled reward availability on a low number of trials. The results showed that those very infrequent distractors that signaled reward captured attention, whereas the distractors (both frequent and infrequent ones) not associated with reward were simply ignored. The latter experiment indicates that even when attention is directed to a location in space, stimuli associated with reward break through the focus of attention, but equally salient stimuli not associated with reward do not.

Reward-centricity and attenuated aversions: An adolescent phenotype emerging from studies in laboratory animals

PubMed Central

Doremus-Fitzwater, Tamara L.; Spear, Linda P.

2016-01-01

Adolescence is an evolutionarily conserved developmental period, with neural circuits and behaviors contributing to the detection, procurement, and receipt of rewards bearing similarity across species. Studies with laboratory animals suggest that adolescence is typified by a “reward-centric” phenotype—an increased sensitivity to rewards relative to adults. In contrast, adolescent rodents are reportedly less sensitive to the aversive properties of many drugs and naturally aversive stimuli. Alterations within the mesocorticolimbic dopamine and endocannabinoid systems likely contribute to an adolescent reward-sensitive, yet aversion-resistant, phenotype. Although early hypotheses postulated that developmental changes in dopaminergic circuitry would result in a “reward deficiency” syndrome, evidence now suggests the opposite: that adolescents are uniquely poised to seek out hedonic stimuli, experience greater “pleasure” from rewards, and consume rewarding stimuli in excess. Future studies that more clearly define the role of specific brain regions and neurotransmitter systems in the expression of behaviors toward reward- and aversive-related cues and stimuli are necessary to more fully understand an adolescent-proclivity for and vulnerability to rewards and drugs of potential abuse. PMID:27524639

Reward-centricity and attenuated aversions: An adolescent phenotype emerging from studies in laboratory animals.

PubMed

Doremus-Fitzwater, Tamara L; Spear, Linda P

2016-11-01

Adolescence is an evolutionarily conserved developmental period, with neural circuits and behaviors contributing to the detection, procurement, and receipt of rewards bearing similarity across species. Studies with laboratory animals suggest that adolescence is typified by a "reward-centric" phenotype-an increased sensitivity to rewards relative to adults. In contrast, adolescent rodents are reportedly less sensitive to the aversive properties of many drugs and naturally aversive stimuli. Alterations within the mesocorticolimbic dopamine and endocannabinoid systems likely contribute to an adolescent reward-sensitive, yet aversion-resistant, phenotype. Although early hypotheses postulated that developmental changes in dopaminergic circuitry would result in a "reward deficiency" syndrome, evidence now suggests the opposite: that adolescents are uniquely poised to seek out hedonic stimuli, experience greater "pleasure" from rewards, and consume rewarding stimuli in excess. Future studies that more clearly define the role of specific brain regions and neurotransmitter systems in the expression of behaviors toward reward- and aversive-related cues and stimuli are necessary to more fully understand an adolescent-proclivity for and vulnerability to rewards and drugs of potential abuse. Copyright © 2016 Elsevier Ltd. All rights reserved.

Reward magnitude tracking by neural populations in ventral striatum

PubMed Central

Fiallos, Ana M.; Bricault, Sarah J.; Cai, Lili X.; Worku, Hermoon A.; Colonnese, Matthew T.; Westmeyer, Gil; Jasanoff, Alan

2017-01-01

Evaluation of the magnitudes of intrinsically rewarding stimuli is essential for assigning value and guiding behavior. By combining parametric manipulation of a primary reward, medial forebrain bundle (MFB) microstimulation, with functional magnetic imaging (fMRI) in rodents, we delineated a broad network of structures activated by behaviorally characterized levels of rewarding stimulation. Correlation of psychometric behavioral measurements with fMRI response magnitudes revealed regions whose activity corresponded closely to the subjective magnitude of rewards. The largest and most reliable focus of reward magnitude tracking was observed in the shell region of the nucleus accumbens (NAc). Although the nonlinear nature of neurovascular coupling complicates interpretation of fMRI findings in precise neurophysiological terms, reward magnitude tracking was not observed in vascular compartments and could not be explained by saturation of region-specific hemodynamic responses. In addition, local pharmacological inactivation of NAc changed the profile of animals’ responses to rewards of different magnitudes without altering mean reward response rates, further supporting a hypothesis that neural population activity in this region contributes to assessment of reward magnitudes. PMID:27789262

Extending overjustification: the effect of perceived reward-giver intention on response to rewards.

PubMed

Forehand, M R

2000-12-01

The perceived intention model incorporates a new moderator, beliefs about reward-giver intention, into the overjustification paradigm. In 2 simulated shopping studies featuring products paired with promotional rewards, consumers who believed the marketer was promotion focused (reward used to encourage purchase) reported lower purchase intentions and brand attitudes for promoted products after promotion, whereas consumers who believed the marketer was reward focused (promotion used to distribute the reward) showed no attitude change. Promotion-focus beliefs lowered attitudes by heightening the contingency between the promotion and purchase and thereby increasing the perceived causal role of the reward. This effect was contingent on initial behavior--postpromotion attitude change occurred for consumers who actively engaged in product decisions but not for consumers who passively observed the choice sets.

Risk, Reward, and Decision-Making in a Rodent Model of Cognitive Aging

PubMed Central

Gilbert, Ryan J.; Mitchell, Marci R.; Simon, Nicholas W.; Bañuelos, Cristina; Setlow, Barry; Bizon, Jennifer L.

2011-01-01

Impaired decision-making in aging can directly impact factors (financial security, health care) that are critical to maintaining quality of life and independence at advanced ages. Naturalistic rodent models mimic human aging in other cognitive domains, and afford the opportunity to parse the effects of age on discrete aspects of decision-making in a manner relatively uncontaminated by experiential factors. Young adult (5–7 months) and aged (23–25 months) male F344 rats were trained on a probability discounting task in which they made discrete-trial choices between a small certain reward (one food pellet) and a large but uncertain reward (two food pellets with varying probabilities of delivery ranging from 100 to 0%). Young rats chose the large reward when it was associated with a high probability of delivery and shifted to the small but certain reward as probability of the large reward decreased. As a group, aged rats performed comparably to young, but there was significantly greater variance among aged rats. One subgroup of aged rats showed strong preference for the small certain reward. This preference was maintained under conditions in which large reward delivery was also certain, suggesting decreased sensitivity to reward magnitude. In contrast, another subgroup of aged rats showed strong preference for the large reward at low probabilities of delivery. Interestingly, this subgroup also showed elevated preference for probabilistic rewards when reward magnitudes were equalized. Previous findings using this same aged study population described strongly attenuated discounting of delayed rewards with age, together suggesting that a subgroup of aged rats may have deficits associated with accounting for reward costs (i.e., delay or probability). These deficits in cost-accounting were dissociable from the age-related differences in sensitivity to reward magnitude, suggesting that aging influences multiple, distinct mechanisms that can impact cost–benefit decision-making. PMID:22319463

Monetary rewards modulate inhibitory control

PubMed Central

Herrera, Paula M.; Speranza, Mario; Hampshire, Adam; Bekinschtein, Tristán A.

2014-01-01

The ability to override a dominant response, often referred to as behavioral inhibition, is considered a key element of executive cognition. Poor behavioral inhibition is a defining characteristic of several neurological and psychiatric populations. Recently, there has been increasing interest in the motivational dimension of behavioral inhibition, with some experiments incorporating emotional contingencies in classical inhibitory paradigms such as the Go/NoGo and Stop Signal Tasks (SSTs). Several studies have reported a positive modulatory effect of reward on performance in pathological conditions such as substance abuse, pathological gambling, and Attention Deficit Hyperactive Disorder (ADHD). However, experiments that directly investigate the modulatory effects of reward magnitudes on the performance of inhibitory tasks are scarce and little is known about the finer grained relationship between motivation and inhibitory control. Here we probed the effect of reward magnitude and context on behavioral inhibition with three modified versions of the widely used SST. The pilot study compared inhibition performance during six blocks alternating neutral feedback, low, medium, and high monetary rewards. Study One compared increasing vs. decreasing rewards, with low, high rewards, and neutral feedback; whilst Study Two compared low and high reward magnitudes alone also in an increasing and decreasing reward design. The reward magnitude effect was not demonstrated in the pilot study, probably due to a learning effect induced by practice in this lengthy task. The reward effect per se was weak but the context (order of reward) was clearly suggested in Study One, and was particularly strongly confirmed in study two. In addition, these findings revealed a “kick start effect” over global performance measures. Specifically, there was a long lasting improvement in performance throughout the task when participants received the highest reward magnitudes at the beginning of the protocol. These results demonstrate a dynamical behavioral inhibition capacity in humans, as illustrated by the reward magnitude modulation and initial reward history effects. PMID:24860469

Risk, reward, and decision-making in a rodent model of cognitive aging.

PubMed

Gilbert, Ryan J; Mitchell, Marci R; Simon, Nicholas W; Bañuelos, Cristina; Setlow, Barry; Bizon, Jennifer L

2011-01-01

Impaired decision-making in aging can directly impact factors (financial security, health care) that are critical to maintaining quality of life and independence at advanced ages. Naturalistic rodent models mimic human aging in other cognitive domains, and afford the opportunity to parse the effects of age on discrete aspects of decision-making in a manner relatively uncontaminated by experiential factors. Young adult (5-7 months) and aged (23-25 months) male F344 rats were trained on a probability discounting task in which they made discrete-trial choices between a small certain reward (one food pellet) and a large but uncertain reward (two food pellets with varying probabilities of delivery ranging from 100 to 0%). Young rats chose the large reward when it was associated with a high probability of delivery and shifted to the small but certain reward as probability of the large reward decreased. As a group, aged rats performed comparably to young, but there was significantly greater variance among aged rats. One subgroup of aged rats showed strong preference for the small certain reward. This preference was maintained under conditions in which large reward delivery was also certain, suggesting decreased sensitivity to reward magnitude. In contrast, another subgroup of aged rats showed strong preference for the large reward at low probabilities of delivery. Interestingly, this subgroup also showed elevated preference for probabilistic rewards when reward magnitudes were equalized. Previous findings using this same aged study population described strongly attenuated discounting of delayed rewards with age, together suggesting that a subgroup of aged rats may have deficits associated with accounting for reward costs (i.e., delay or probability). These deficits in cost-accounting were dissociable from the age-related differences in sensitivity to reward magnitude, suggesting that aging influences multiple, distinct mechanisms that can impact cost-benefit decision-making.

Running is rewarding and antidepressive.

PubMed

Brené, Stefan; Bjørnebekk, Astrid; Aberg, Elin; Mathé, Aleksander A; Olson, Lars; Werme, Martin

2007-09-10

Natural behaviors such as eating, drinking, reproduction and exercise activate brain reward pathways and consequently the individual engages in these behaviors to receive the reward. However, drugs of abuse are even more potent in activating the reward pathways. Rewarding behaviors and addictive drugs also affect other parts of the brain not directly involved in the mediation of reward. For instance, running increases neurogenesis in hippocampus and is beneficial as an antidepressant in a genetic animal model of depression and in depressed humans. Here we discuss and compare neurochemical and functional changes in the brain after addictive drugs and exercise with a focus on brain reward pathways and hippocampus.

Running is rewarding and antidepressive

PubMed Central

Brené, Stefan; Bjørnebekk, Astrid; Åberg, Elin; Mathé, Aleksander A; Olson, Lars; Werme, Martin

2007-01-01

Natural behaviors such as eating, drinking, reproduction and exercise activate brain reward pathways and consequently the individual engages in these behaviors to receive the reward. However, drugs of abuse are even more potent to activate the reward pathways. Rewarding behaviors and addictive drugs also affect other parts of the brain not directly involved in the mediation of reward. For instance, running increases neurogenesis in hippocampus and is beneficial as an antidepressant in a genetic animal model of depression and in depressed humans. Here we discuss and compare neurochemical and functional changes in the brain after addictive drugs and exercise with a focus on brain reward pathways and hippocampus. PMID:17561174

Measuring and modeling the interaction among reward size, delay to reward, and satiation level on motivation in monkeys.

PubMed

Minamimoto, Takafumi; La Camera, Giancarlo; Richmond, Barry J

2009-01-01

Motivation is usually inferred from the likelihood or the intensity with which behavior is carried out. It is sensitive to external factors (e.g., the identity, amount, and timing of a rewarding outcome) and internal factors (e.g., hunger or thirst). We trained macaque monkeys to perform a nonchoice instrumental task (a sequential red-green color discrimination) while manipulating two external factors: reward size and delay-to-reward. We also inferred the state of one internal factor, level of satiation, by monitoring the accumulated reward. A visual cue indicated the forthcoming reward size and delay-to-reward in each trial. The fraction of trials completed correctly by the monkeys increased linearly with reward size and was hyperbolically discounted by delay-to-reward duration, relations that are similar to those found in free operant and choice tasks. The fraction of correct trials also decreased progressively as a function of the satiation level. Similar (albeit noiser) relations were obtained for reaction times. The combined effect of reward size, delay-to-reward, and satiation level on the proportion of correct trials is well described as a multiplication of the effects of the single factors when each factor is examined alone. These results provide a quantitative account of the interaction of external and internal factors on instrumental behavior, and allow us to extend the concept of subjective value of a rewarding outcome, usually confined to external factors, to account also for slow changes in the internal drive of the subject.

Measuring and Modeling the Interaction Among Reward Size, Delay to Reward, and Satiation Level on Motivation in Monkeys

PubMed Central

Minamimoto, Takafumi; La Camera, Giancarlo; Richmond, Barry J.

2009-01-01

Motivation is usually inferred from the likelihood or the intensity with which behavior is carried out. It is sensitive to external factors (e.g., the identity, amount, and timing of a rewarding outcome) and internal factors (e.g., hunger or thirst). We trained macaque monkeys to perform a nonchoice instrumental task (a sequential red-green color discrimination) while manipulating two external factors: reward size and delay-to-reward. We also inferred the state of one internal factor, level of satiation, by monitoring the accumulated reward. A visual cue indicated the forthcoming reward size and delay-to-reward in each trial. The fraction of trials completed correctly by the monkeys increased linearly with reward size and was hyperbolically discounted by delay-to-reward duration, relations that are similar to those found in free operant and choice tasks. The fraction of correct trials also decreased progressively as a function of the satiation level. Similar (albeit noiser) relations were obtained for reaction times. The combined effect of reward size, delay-to-reward, and satiation level on the proportion of correct trials is well described as a multiplication of the effects of the single factors when each factor is examined alone. These results provide a quantitative account of the interaction of external and internal factors on instrumental behavior, and allow us to extend the concept of subjective value of a rewarding outcome, usually confined to external factors, to account also for slow changes in the internal drive of the subject. PMID:18987119

"Liking" and "wanting" linked to Reward Deficiency Syndrome (RDS): hypothesizing differential responsivity in brain reward circuitry.

PubMed

Blum, Kenneth; Gardner, Eliot; Oscar-Berman, Marlene; Gold, Mark

2012-01-01

In an attempt to resolve controversy regarding the causal contributions of mesolimbic dopamine (DA) systems to reward, we evaluate the three main competing explanatory categories: "liking,"learning," and "wanting" [1]. That is, DA may mediate (a) the hedonic impact of reward (liking), (b) learned predictions about rewarding effects (learning), or (c) the pursuit of rewards by attributing incentive salience to reward-related stimuli (wanting). We evaluate these hypotheses, especially as they relate to the Reward Deficiency Syndrome (RDS), and we find that the incentive salience or "wanting" hypothesis of DA function is supported by a majority of the evidence. Neuroimaging studies have shown that drugs of abuse, palatable foods, and anticipated behaviors such as sex and gaming affect brain regions involving reward circuitry, and may not be unidirectional. Drugs of abuse enhance DA signaling and sensitize mesolimbic mechanisms that evolved to attribute incentive salience to rewards. Addictive drugs have in common that they are voluntarily selfadministered, they enhance (directly or indirectly) dopaminergic synaptic function in the nucleus accumbens (NAC), and they stimulate the functioning of brain reward circuitry (producing the "high" that drug users seek). Although originally believed simply to encode the set point of hedonic tone, these circuits now are believed to be functionally more complex, also encoding attention, reward expectancy, disconfirmation of reward expectancy, and incentive motivation. Elevated stress levels, together with polymorphisms of dopaminergic genes and other neurotransmitter genetic variants, may have a cumulative effect on vulnerability to addiction. The RDS model of etiology holds very well for a variety of chemical and behavioral addictions.

Effects of Motivation: Rewarding Hackers for Undetected Attacks Cause Analysts to Perform Poorly.

PubMed

Maqbool, Zahid; Makhijani, Nidhi; Pammi, V S Chandrasekhar; Dutt, Varun

2017-05-01

The aim of this study was to determine how monetary motivations influence decision making of humans performing as security analysts and hackers in a cybersecurity game. Cyberattacks are increasing at an alarming rate. As cyberattacks often cause damage to existing cyber infrastructures, it is important to understand how monetary rewards may influence decision making of hackers and analysts in the cyber world. Currently, only limited attention has been given to this area. In an experiment, participants were randomly assigned to three between-subjects conditions ( n = 26 for each condition): equal payoff, where the magnitude of monetary rewards for hackers and defenders was the same; rewarding hacker, where the magnitude of monetary reward for hacker's successful attack was 10 times the reward for analyst's successful defense; and rewarding analyst, where the magnitude of monetary reward for analyst's successful defense was 10 times the reward for hacker's successful attack. In all conditions, half of the participants were human hackers playing against Nash analysts and half were human analysts playing against Nash hackers. Results revealed that monetary rewards for human hackers and analysts caused a decrease in attack and defend actions compared with the baseline. Furthermore, rewarding human hackers for undetected attacks made analysts deviate significantly from their optimal behavior. If hackers are rewarded for their undetected attack actions, then this causes analysts to deviate from optimal defend proportions. Thus, analysts need to be trained not become overenthusiastic in defending networks. Applications of our results are to networks where the influence of monetary rewards may cause information theft and system damage.

The brain correlates of the effects of monetary and verbal rewards on intrinsic motivation.

PubMed

Albrecht, Konstanze; Abeler, Johannes; Weber, Bernd; Falk, Armin

2014-01-01

Apart from everyday duties, such as doing the laundry or cleaning the house, there are tasks we do for pleasure and enjoyment. We do such tasks, like solving crossword puzzles or reading novels, without any external pressure or force; instead, we are intrinsically motivated: we do the tasks because we enjoy doing them. Previous studies suggest that external rewards, i.e., rewards from the outside, affect the intrinsic motivation to engage in a task: while performance-based monetary rewards are perceived as controlling and induce a business-contract framing, verbal rewards praising one's competence can enhance the perceived self-determination. Accordingly, the former have been shown to decrease intrinsic motivation, whereas the latter have been shown to increase intrinsic motivation. The present study investigated the neural processes underlying the effects of monetary and verbal rewards on intrinsic motivation in a group of 64 subjects applying functional magnetic resonance imaging (fMRI). We found that, when participants received positive performance feedback, activation in the anterior striatum and midbrain was affected by the nature of the reward; compared to a non-rewarded control group, activation was higher while monetary rewards were administered. However, we did not find a decrease in activation after reward withdrawal. In contrast, we found an increase in activation for verbal rewards: after verbal rewards had been withdrawn, participants showed a higher activation in the aforementioned brain areas when they received success compared to failure feedback. We further found that, while participants worked on the task, activation in the lateral prefrontal cortex was enhanced after the verbal rewards were administered and withdrawn.

The rewarding value of good motor performance in the context of monetary incentives.

PubMed

Lutz, Kai; Pedroni, Andreas; Nadig, Karin; Luechinger, Roger; Jäncke, Lutz

2012-07-01

Whether an agent receives positive task feedback or a monetary reward, neural activity in their striatum increases. In the latter case striatal activity reflects extrinsic reward processing, while in the former, striatal activity reflects the intrinsically rewarding effects of performing well. There can be a "hidden cost of reward", which is a detrimental effect of extrinsic on intrinsic reward value. This raises the question how these two types of reward interact. To address this, we applied a monetary incentive delay task: in all trials participants received feedback depending on their performance. In half of the trials they could additionally receive monetary reward if they performed well. This resulted in high performance trials, which were monetarily rewarded and high performance trials that were not. This made it possible to dissociate the neural correlates of performance feedback from the neural correlates of monetary reward that comes with high performance. Performance feedback alone elicits activation increases in the ventral striatum. This activation increases due to additional monetary reward. Neural response in the dorsal striatum on the other hand is only significantly increased by feedback when a monetary incentive is present. The quality of performance does not significantly influence dorsal striatum activity. In conclusion, our results indicate that the dorsal striatum is primarily sensitive to optional or actually received external rewards, whereas the ventral striatum may be coding intrinsic reward due to positive performance feedback. Thus the ventral striatum is suggested to be involved in the processing of intrinsically motivated behavior. Copyright © 2012 Elsevier Ltd. All rights reserved.

The brain correlates of the effects of monetary and verbal rewards on intrinsic motivation

PubMed Central

Albrecht, Konstanze; Abeler, Johannes; Weber, Bernd; Falk, Armin

2014-01-01

Apart from everyday duties, such as doing the laundry or cleaning the house, there are tasks we do for pleasure and enjoyment. We do such tasks, like solving crossword puzzles or reading novels, without any external pressure or force; instead, we are intrinsically motivated: we do the tasks because we enjoy doing them. Previous studies suggest that external rewards, i.e., rewards from the outside, affect the intrinsic motivation to engage in a task: while performance-based monetary rewards are perceived as controlling and induce a business-contract framing, verbal rewards praising one's competence can enhance the perceived self-determination. Accordingly, the former have been shown to decrease intrinsic motivation, whereas the latter have been shown to increase intrinsic motivation. The present study investigated the neural processes underlying the effects of monetary and verbal rewards on intrinsic motivation in a group of 64 subjects applying functional magnetic resonance imaging (fMRI). We found that, when participants received positive performance feedback, activation in the anterior striatum and midbrain was affected by the nature of the reward; compared to a non-rewarded control group, activation was higher while monetary rewards were administered. However, we did not find a decrease in activation after reward withdrawal. In contrast, we found an increase in activation for verbal rewards: after verbal rewards had been withdrawn, participants showed a higher activation in the aforementioned brain areas when they received success compared to failure feedback. We further found that, while participants worked on the task, activation in the lateral prefrontal cortex was enhanced after the verbal rewards were administered and withdrawn. PMID:25278834

Imbalance in the sensitivity to different types of rewards in pathological gambling.

PubMed

Sescousse, Guillaume; Barbalat, Guillaume; Domenech, Philippe; Dreher, Jean-Claude

2013-08-01

Pathological gambling is an addictive disorder characterized by a persistent and compulsive desire to engage in gambling activities. This maladaptive behaviour has been suggested to result from a decreased sensitivity to experienced rewards, regardless of reward type. Alternatively, pathological gambling might reflect an imbalance in the sensitivity to monetary versus non-monetary incentives. To directly test these two hypotheses, we examined how the brain reward circuit of pathological gamblers responds to different types of rewards. Using functional magnetic resonance imaging, we compared the brain responses of 18 pathological gamblers and 20 healthy control subjects while they engaged in a simple incentive task manipulating both monetary and visual erotic rewards. During reward anticipation, the ventral striatum of pathological gamblers showed a differential response to monetary versus erotic cues, essentially driven by a blunted reactivity to cues predicting erotic stimuli. This differential response correlated with the severity of gambling symptoms and was paralleled by a reduced behavioural motivation for erotic rewards. During reward outcome, a posterior orbitofrontal cortex region, responding to erotic rewards in both groups, was further recruited by monetary gains in pathological gamblers but not in control subjects. Moreover, while ventral striatal activity correlated with subjective ratings assigned to monetary and erotic rewards in control subjects, it only correlated with erotic ratings in gamblers. Our results point to a differential sensitivity to monetary versus non-monetary rewards in pathological gambling, both at the motivational and hedonic levels. Such an imbalance might create a bias towards monetary rewards, potentially promoting addictive gambling behaviour.

Noradrenergic modulation of risk/reward decision making.

PubMed

Montes, David R; Stopper, Colin M; Floresco, Stan B

2015-08-01

Catecholamine transmission modulates numerous cognitive and reward-related processes that can subserve more complex functions such as cost/benefit decision making. Dopamine has been shown to play an integral role in decisions involving reward uncertainty, yet there is a paucity of research investigating the contributions of noradrenaline (NA) transmission to these functions. The present study was designed to elucidate the contribution of NA to risk/reward decision making in rats, assessed with a probabilistic discounting task. We examined the effects of reducing noradrenergic transmission with the α2 agonist clonidine (10-100 μg/kg), and increasing activity at α2A receptor sites with the agonist guanfacine (0.1-1 mg/kg), the α2 antagonist yohimbine (1-3 mg/kg), and the noradrenaline transporter (NET) inhibitor atomoxetine (0.3-3 mg/kg) on probabilistic discounting. Rats chose between a small/certain reward and a larger/risky reward, wherein the probability of obtaining the larger reward either decreased (100-12.5 %) or increased (12.5-100 %) over a session. In well-trained rats, clonidine reduced risky choice by decreasing reward sensitivity, whereas guanfacine did not affect choice behavior. Yohimbine impaired adjustments in decision biases as reward probability changed within a session by altering negative feedback sensitivity. In a subset of rats that displayed prominent discounting of probabilistic rewards, the lowest dose of atomoxetine increased preference for the large/risky reward when this option had greater long-term utility. These data highlight an important and previously uncharacterized role for noradrenergic transmission in mediating different aspects of risk/reward decision making and mediating reward and negative feedback sensitivity.

Neural correlates of sample-coding and reward-coding in the delay activity of neurons in the entopallium and nidopallium caudolaterale of pigeons (Columba livia).

PubMed

Johnston, Melissa; Anderson, Catrona; Colombo, Michael

2017-01-15

We recorded neuronal activity from the nidopallium caudolaterale, the avian equivalent of mammalian prefrontal cortex, and the entopallium, the avian equivalent of the mammalian visual cortex, in four birds trained on a differential outcomes delayed matching-to-sample procedure in which one sample stimulus was followed by reward and the other was not. Despite similar incidence of reward-specific and reward-unspecific delay cell types across the two areas, overall entopallium delay activity occurred following both rewarded and non-rewarded stimuli, whereas nidopallium caudolaterale delay activity tended to occur following the rewarded stimulus but not the non-rewarded stimulus. These findings are consistent with the view that delay activity in entopallium represents a code of the sample stimulus whereas delay activity in nidopallium caudolaterale represents a code of the possibility of an upcoming reward. However, based on the types of delay cells encountered, cells in NCL also code the sample stimulus and cells in ENTO are influenced by reward. We conclude that both areas support the retention of information, but that the activity in each area is differentially modulated by factors such as reward and attentional mechanisms. Copyright © 2016 Elsevier B.V. All rights reserved.

Reward associations impact both iconic and visual working memory.

PubMed

Infanti, Elisa; Hickey, Clayton; Turatto, Massimo

2015-02-01

Reward plays a fundamental role in human behavior. A growing number of studies have shown that stimuli associated with reward become salient and attract attention. The aim of the present study was to extend these results into the investigation of iconic memory and visual working memory. In two experiments we asked participants to perform a visual-search task where different colors of the target stimuli were paired with high or low reward. We then tested whether the pre-established feature-reward association affected performance on a subsequent visual memory task, in which no reward was provided. In this test phase participants viewed arrays of 8 objects, one of which had unique color that could match the color associated with reward during the previous visual-search task. A probe appeared at varying intervals after stimulus offset to identify the to-be-reported item. Our results suggest that reward biases the encoding of visual information such that items characterized by a reward-associated feature interfere with mnemonic representations of other items in the test display. These results extend current knowledge regarding the influence of reward on early cognitive processes, suggesting that feature-reward associations automatically interact with the encoding and storage of visual information, both in iconic memory and visual working memory. Copyright © 2014 Elsevier Ltd. All rights reserved.

I Don’t Want to Come Back Down: Undoing versus Maintaining of Reward Recovery in Older Adolescents

PubMed Central

Gilbert, Kirsten E.; Nolen-Hoeksema, Susan; Gruber, June

2017-01-01

Adolescence is characterized by heightened and sometimes impairing reward sensitivity, yet less is known about how adolescents recover from highly arousing positive states. This is particularly important given high onset rates of psychopathology associated with reward sensitivity during late adolescence and early adulthood. The current study thus utilized a novel reward sensitivity task in order to examine potential ways in which older adolescent females (ages 18–21; N = 83) might recover from high arousal positive reward sensitive states. Participants underwent a fixed incentive reward sensitivity task and subsequently watched a neutral, sad, or a low approach-motivated positive emotional film clip during which subjective and physiological recovery was assessed. Results indicated that the positive and negative film conditions were associated with maintained physiological arousal while the neutral condition facilitated faster physiological recovery from the reward sensitivity task. Interestingly, individual differences in self-reported positive emotion during the reward task were associated with faster recovery in the neutral condition. Findings suggest elicited emotion (regardless of valence) may serve to maintain reward sensitivity while self-reported positive emotional experience may be a key ingredient facilitating physiological recovery or undoing. Understanding the nuances of reward recovery provides a critical step in understanding the etiology and persistence of reward dysregulation more generally. PMID:26595439

Reward skewness coding in the insula independent of probability and loss

PubMed Central

Tobler, Philippe N.

2011-01-01

Rewards in the natural environment are rarely predicted with complete certainty. Uncertainty relating to future rewards has typically been defined as the variance of the potential outcomes. However, the asymmetry of predicted reward distributions, known as skewness, constitutes a distinct but neuroscientifically underexplored risk term that may also have an impact on preference. By changing only reward magnitudes, we study skewness processing in equiprobable ternary lotteries involving only gains and constant probabilities, thus excluding probability distortion or loss aversion as mechanisms for skewness preference formation. We show that individual preferences are sensitive to not only the mean and variance but also to the skewness of predicted reward distributions. Using neuroimaging, we show that the insula, a structure previously implicated in the processing of reward-related uncertainty, responds to the skewness of predicted reward distributions. Some insula responses increased in a monotonic fashion with skewness (irrespective of individual skewness preferences), whereas others were similarly elevated to both negative and positive as opposed to no reward skew. These data support the notion that the asymmetry of reward distributions is processed in the brain and, taken together with replicated findings of mean coding in the striatum and variance coding in the cingulate, suggest that the brain codes distinct aspects of reward distributions in a distributed fashion. PMID:21849610

A common neural code for social and monetary rewards in the human striatum

PubMed Central

Wake, Stephanie J

2017-01-01

Abstract Although managing social information and decision making on the basis of reward is critical for survival, it remains uncertain whether differing reward type is processed in a uniform manner. Previously, we demonstrated that monetary reward and the social reward of good reputation activated the same striatal regions including the caudate nucleus and putamen. However, it remains unclear whether overlapping activations reflect activities of identical neuronal populations or two overlapping but functionally independent neuronal populations. Here, we re-analyzed the original data and addressed this question using multivariate-pattern-analysis and found evidence that in the left caudate nucleus and bilateral nucleus accumbens, social vs monetary reward were represented similarly. The findings suggest that social and monetary rewards are processed by the same population of neurons within these regions of the striatum. Additional findings demonstrated similar neural patterns when participants experience high social reward compared to viewing others receiving low social reward (potentially inducing schadenfreude). This is possibly an early indication that the same population of neurons may be responsible for processing two different types of social reward (good reputation and schadenfreude). These findings provide a supplementary perspective to previous research, helping to further elucidate the mechanisms behind social vs non-social reward processing. PMID:28985408

Frontal theta and beta synchronizations for monetary reward increase visual working memory capacity

PubMed Central

Yamaguchi, Yoko

2013-01-01

Visual working memory (VWM) capacity is affected by motivational influences; however, little is known about how reward-related brain activities facilitate the VWM systems. To investigate the dynamic relationship between VWM- and reward-related brain activities, we conducted time–frequency analyses using electroencephalograph (EEG) data obtained during a monetary-incentive delayed-response task that required participants to memorize the position of colored disks. In case of a correct answer, participants received a monetary reward (0, 10 or 50 Japanese yen) announced at the beginning of each trial. Behavioral results showed that VWM capacity under high-reward condition significantly increased compared with that under low- or no-reward condition. EEG results showed that frontal theta (6 Hz) amplitudes enhanced during delay periods and positively correlated with VWM capacity, indicating involvement of theta local synchronizations in VWM. Moreover, frontal beta activities (24 Hz) were identified as reward-related activities, because delay-period amplitudes correlated with increases in VWM capacity between high-reward and no-reward conditions. Interestingly, cross-frequency couplings between frontal theta and beta phases were observed only under high-reward conditions. These findings suggest that the functional dynamic linking between VWM-related theta and reward-related beta activities on the frontal regions plays an integral role in facilitating increases in VWM capacity. PMID:22349800

Individual differences in sensitivity to reward and punishment and neural activity during reward and avoidance learning

PubMed Central

Yoon, HeungSik; Kim, Hackjin; Hamann, Stephan

2015-01-01

In this functional neuroimaging study, we investigated neural activations during the process of learning to gain monetary rewards and to avoid monetary loss, and how these activations are modulated by individual differences in reward and punishment sensitivity. Healthy young volunteers performed a reinforcement learning task where they chose one of two fractal stimuli associated with monetary gain (reward trials) or avoidance of monetary loss (avoidance trials). Trait sensitivity to reward and punishment was assessed using the behavioral inhibition/activation scales (BIS/BAS). Functional neuroimaging results showed activation of the striatum during the anticipation and reception periods of reward trials. During avoidance trials, activation of the dorsal striatum and prefrontal regions was found. As expected, individual differences in reward sensitivity were positively associated with activation in the left and right ventral striatum during reward reception. Individual differences in sensitivity to punishment were negatively associated with activation in the left dorsal striatum during avoidance anticipation and also with activation in the right lateral orbitofrontal cortex during receiving monetary loss. These results suggest that learning to attain reward and learning to avoid loss are dependent on separable sets of neural regions whose activity is modulated by trait sensitivity to reward or punishment. PMID:25680989

BAS-drive trait modulates dorsomedial striatum activity during reward response-outcome associations.

PubMed

Costumero, Víctor; Barrós-Loscertales, Alfonso; Fuentes, Paola; Rosell-Negre, Patricia; Bustamante, Juan Carlos; Ávila, César

2016-09-01

According to the Reinforcement Sensitivity Theory, behavioral studies have found that individuals with stronger reward sensitivity easily detect cues of reward and establish faster associations between instrumental responses and reward. Neuroimaging studies have shown that processing anticipatory cues of reward is accompanied by stronger ventral striatum activity in individuals with stronger reward sensitivity. Even though establishing response-outcome contingencies has been consistently associated with dorsal striatum, individual differences in this process are poorly understood. Here, we aimed to study the relation between reward sensitivity and brain activity while processing response-reward contingencies. Forty-five participants completed the BIS/BAS questionnaire and performed a gambling task paradigm in which they received monetary rewards or punishments. Overall, our task replicated previous results that have related processing high reward outcomes with activation of striatum and medial frontal areas, whereas processing high punishment outcomes was associated with stronger activity in insula and middle cingulate. As expected, the individual differences in the activity of dorsomedial striatum correlated positively with BAS-Drive. Our results agree with previous studies that have related the dorsomedial striatum with instrumental performance, and suggest that the individual differences in this area may form part of the neural substrate responsible for modulating instrumental conditioning by reward sensitivity.

The effects of monetary and social rewards on task performance in children and adolescents: liking is not enough.

PubMed

Demurie, Ellen; Roeyers, Herbert; Baeyens, Dieter; Sonuga-Barke, Edmund

2012-12-01

The current study compared the effects of reward anticipation on task performance in children and adolescents (8-16 years old) using monetary and various social rewards. Eighty-five typically developing children undertook the Monetary Incentive Delay (MID) task. Of these 44 also undertook the Social Incentive Delay (SID-basic) task where social reward was operationalized as a smiling face and spoken compliments. Forty-one children participated in the SID-plus where points were added to a pictogram with written compliments. In a preparatory validation study participants were asked howmuch they liked the SID-basic rewards.Results showed that there was an effect of reward size on accuracy and RT in both the MID task and SID-plus, but not SID-basic. Subjective value of the SID-basic rewards was rated higher with hypothesized increasing reward intensity. In conclusion, although the social rewards in SID-basic were liked by children andadolescents in the validation study, they had no effect on the behaviour. Only when points were added (SID-plus), anticipated social reward affected task performance. Thus our results highlight (i) the difference between likeability andreinforcing quality and (ii) the need for a quantifiable element to rewards for themto be reinforcing for children. Copyright © 2012 John Wiley & Sons, Ltd.

Effects of alexithymia and empathy on the neural processing of social and monetary rewards.

PubMed

Goerlich, Katharina Sophia; Votinov, Mikhail; Lammertz, Sarah E; Winkler, Lina; Spreckelmeyer, Katja N; Habel, Ute; Gründer, Gerhard; Gossen, Anna

2017-07-01

Empathy has been found to affect the neural processing of social and monetary rewards. Alexithymia, a subclinical condition showing a close inverse relationship with empathy is linked to dysfunctions of socio-emotional processing in the brain. Whether alexithymia alters the neural processing of rewards, which is currently unknown. Here, we investigated the influence of both alexithymia and empathy on reward processing using a social incentive delay (SID) task and a monetary incentive delay (MID) task in 45 healthy men undergoing functional magnetic resonance imaging. Controlling for temperament-character dimensions and rejection sensitivity, the relationship of alexithymia and empathy with neural activity in several a priori regions of interest (ROIs) was examined by means of partial correlations, while participants anticipated and received social and monetary rewards. Results were considered significant if they survived Holm-Bonferroni correction for multiple comparisons. Alexithymia modulated neural activity in several ROIs of the emotion and reward network, both during the anticipation of social and monetary rewards and in response to the receipt of monetary rewards. In contrast, empathy did not affect reward anticipation and modulated ROI activity only in response to the receipt of social rewards. These results indicate a significant influence of alexithymia on the processing of social and monetary rewards in the healthy brain.

A common neural code for social and monetary rewards in the human striatum.

PubMed

Wake, Stephanie J; Izuma, Keise

2017-10-01

Although managing social information and decision making on the basis of reward is critical for survival, it remains uncertain whether differing reward type is processed in a uniform manner. Previously, we demonstrated that monetary reward and the social reward of good reputation activated the same striatal regions including the caudate nucleus and putamen. However, it remains unclear whether overlapping activations reflect activities of identical neuronal populations or two overlapping but functionally independent neuronal populations. Here, we re-analyzed the original data and addressed this question using multivariate-pattern-analysis and found evidence that in the left caudate nucleus and bilateral nucleus accumbens, social vs monetary reward were represented similarly. The findings suggest that social and monetary rewards are processed by the same population of neurons within these regions of the striatum. Additional findings demonstrated similar neural patterns when participants experience high social reward compared to viewing others receiving low social reward (potentially inducing schadenfreude). This is possibly an early indication that the same population of neurons may be responsible for processing two different types of social reward (good reputation and schadenfreude). These findings provide a supplementary perspective to previous research, helping to further elucidate the mechanisms behind social vs non-social reward processing. © The Author (2017). Published by Oxford University Press.

Dorsomedial striatum lesions affect adjustment to reward uncertainty, but not to reward devaluation or omission.

PubMed

Torres, Carmen; Glueck, Amanda C; Conrad, Shannon E; Morón, Ignacio; Papini, Mauricio R

2016-09-22

The dorsomedial striatum (DMS) has been implicated in the acquisition of reward representations, a proposal leading to the hypothesis that it should play a role in situations involving reward loss. We report the results of an experiment in which the effects of DMS excitotoxic lesions were tested in consummatory successive negative contrast (reward devaluation), autoshaping training with partial vs. continuous reinforcement (reward uncertainty), and appetitive extinction (reward omission). Animals with DMS lesions exhibited reduced lever pressing responding, but enhanced goal entries, during partial reinforcement training in autoshaping. However, they showed normal negative contrast, acquisition under continuous reinforcement (CR), appetitive extinction, and response facilitation in early extinction trials. Open-field testing also indicated normal motor behavior. Thus, DMS lesions selectively affected the behavioral adjustment to a situation involving reward uncertainty, producing a behavioral reorganization according to which goal tracking (goal entries) became predominant at the expense of sign tracking (lever pressing). This pattern of results shows that the function of the DMS in situations involving reward loss is not general, but restricted to reward uncertainty. We suggest that a nonassociative, drive-related process induced by reward uncertainty requires normal output from DMS neurons. Copyright © 2016 IBRO. Published by Elsevier Ltd. All rights reserved.

Anatomical correlates of reward-seeking behaviours in behavioural variant frontotemporal dementia

PubMed Central

Sturm, Virginia E.; Seeley, William W.; Miller, Bruce L.; Kramer, Joel H.; Rosen, Howard J.

2014-01-01

Behavioural variant frontotemporal dementia is characterized by abnormal responses to primary reward stimuli such as food, sex and intoxicants, suggesting abnormal functioning of brain circuitry mediating reward processing. The goal of this analysis was to determine whether abnormalities in reward-seeking behaviour in behavioural variant frontotemporal dementia are correlated with atrophy in regions known to mediate reward processing. Review of case histories in 103 patients with behavioural variant frontotemporal dementia identified overeating or increased sweet food preference in 80 (78%), new or increased alcohol or drug use in 27 (26%), and hypersexuality in 17 (17%). For each patient, a primary reward-seeking score of 0–3 was created with 1 point given for each target behaviour (increased seeking of food, drugs, or sex). Voxel-based morphometry performed in 91 patients with available imaging revealed that right ventral putamen and pallidum atrophy correlated with higher reward-seeking scores. Each of the reward-related behaviours involved partially overlapping right hemisphere reward circuit regions including putamen, globus pallidus, insula and thalamus. These findings indicate that in some patients with behavioural variant frontotemporal dementia, low volume of subcortical reward-related structures is associated with increased pursuit of primary rewards, which may be a product of increased thalamocortical feedback. PMID:24740987

Frontal theta and beta synchronizations for monetary reward increase visual working memory capacity.

PubMed

Kawasaki, Masahiro; Yamaguchi, Yoko

2013-06-01

Visual working memory (VWM) capacity is affected by motivational influences; however, little is known about how reward-related brain activities facilitate the VWM systems. To investigate the dynamic relationship between VWM- and reward-related brain activities, we conducted time-frequency analyses using electroencephalograph (EEG) data obtained during a monetary-incentive delayed-response task that required participants to memorize the position of colored disks. In case of a correct answer, participants received a monetary reward (0, 10 or 50 Japanese yen) announced at the beginning of each trial. Behavioral results showed that VWM capacity under high-reward condition significantly increased compared with that under low- or no-reward condition. EEG results showed that frontal theta (6 Hz) amplitudes enhanced during delay periods and positively correlated with VWM capacity, indicating involvement of theta local synchronizations in VWM. Moreover, frontal beta activities (24 Hz) were identified as reward-related activities, because delay-period amplitudes correlated with increases in VWM capacity between high-reward and no-reward conditions. Interestingly, cross-frequency couplings between frontal theta and beta phases were observed only under high-reward conditions. These findings suggest that the functional dynamic linking between VWM-related theta and reward-related beta activities on the frontal regions plays an integral role in facilitating increases in VWM capacity.

A test of the reward-value hypothesis.

PubMed

Smith, Alexandra E; Dalecki, Stefan J; Crystal, Jonathon D

2017-03-01

Rats retain source memory (memory for the origin of information) over a retention interval of at least 1 week, whereas their spatial working memory (radial maze locations) decays within approximately 1 day. We have argued that different forgetting functions dissociate memory systems. However, the two tasks, in our previous work, used different reward values. The source memory task used multiple pellets of a preferred food flavor (chocolate), whereas the spatial working memory task provided access to a single pellet of standard chow-flavored food at each location. Thus, according to the reward-value hypothesis, enhanced performance in the source memory task stems from enhanced encoding/memory of a preferred reward. We tested the reward-value hypothesis by using a standard 8-arm radial maze task to compare spatial working memory accuracy of rats rewarded with either multiple chocolate or chow pellets at each location using a between-subjects design. The reward-value hypothesis predicts superior accuracy for high-valued rewards. We documented equivalent spatial memory accuracy for high- and low-value rewards. Importantly, a 24-h retention interval produced equivalent spatial working memory accuracy for both flavors. These data are inconsistent with the reward-value hypothesis and suggest that reward value does not explain our earlier findings that source memory survives unusually long retention intervals.

Adaptive Reward Pursuit: How Effort Requirements Affect Unconscious Reward Responses and Conscious Reward Decisions

ERIC Educational Resources Information Center

Bijleveld, Erik; Custers, Ruud; Aarts, Henk

2012-01-01

When in pursuit of rewards, humans weigh the value of potential rewards against the amount of effort that is required to attain them. Although previous research has generally conceptualized this process as a deliberate calculation, recent work suggests that rudimentary mechanisms--operating without conscious intervention--play an important role as…

Trait Anticipatory Pleasure Predicts Effort Expenditure for Reward

PubMed Central

Geaney, Joachim T.; Treadway, Michael T.; Smillie, Luke D.

2015-01-01

Research in motivation and emotion has been increasingly influenced by the perspective that processes underpinning the motivated approach of rewarding goals are distinct from those underpinning enjoyment during reward consummation. This distinction recently inspired the construction of the Temporal Experience of Pleasure Scale (TEPS), a self-report measure that distinguishes trait anticipatory pleasure (pre-reward feelings of desire) from consummatory pleasure (feelings of enjoyment and gratification upon reward attainment). In a university community sample (N = 97), we examined the TEPS subscales as predictors of (1) the willingness to expend effort for monetary rewards, and (2) affective responses to a pleasant mood induction procedure. Results showed that both anticipatory pleasure and a well-known trait measure of reward motivation predicted effort-expenditure for rewards when the probability of being rewarded was relatively low. Against expectations, consummatory pleasure was unrelated to induced pleasant affect. Taken together, our findings provide support for the validity of the TEPS anticipatory pleasure scale, but not the consummatory pleasure scale. PMID:26115223

Emotional arousal and discount rate in intertemporal choice are reference dependent.

PubMed

Lempert, Karolina M; Glimcher, Paul W; Phelps, Elizabeth A

2015-04-01

Many decisions involve weighing immediate gratification against future consequences. In such intertemporal choices, people often choose smaller, immediate rewards over larger delayed rewards. It has been proposed that emotional responses to immediate rewards lead us to choose them at our long-term expense. Here we utilize an objective measure of emotional arousal-pupil dilation-to examine the role of emotion in these decisions. We show that emotional arousal responses, as well as choices, in intertemporal choice tasks are reference-dependent and reflect the decision-maker's recent history of offers. Arousal increases when less predictable rewards are better than expected, whether those rewards are immediate or delayed. Furthermore, when immediate rewards are less predictable than delayed rewards, participants tend to be patient. When delayed rewards are less predictable, immediate rewards are preferred. Our findings suggest that we can encourage people to be more patient by changing the context in which intertemporal choices are made. (c) 2015 APA, all rights reserved).

Elevated striatal reactivity across monetary and social rewards in bipolar I disorder.

PubMed

Dutra, Sunny J; Cunningham, William A; Kober, Hedy; Gruber, June

2015-11-01

Bipolar disorder (BD) is associated with increased reactivity to rewards and heightened positive affectivity. It is less clear to what extent this heightened reward sensitivity is evident across contexts and what the associated neural mechanisms might be. The present investigation used both a monetary and social incentive delay task among adults with remitted BD Type I (n = 24) and a healthy nonpsychiatric control group (HC; n = 25) using fMRI. Both whole-brain and region-of-interest analyses revealed elevated reactivity to reward receipt in the striatum, a region implicated in incentive sensitivity, in the BD group. Post hoc analyses revealed that greater striatal reactivity to reward receipt, across monetary and social reward tasks, predicted decreased self-reported positive affect when anticipating subsequent rewards in the HC but not in the BD group. Results point toward elevated striatal reactivity to reward receipt as a potential neural mechanism of persistent reward pursuit in BD. (c) 2015 APA, all rights reserved).

Distinct Motivational Effects of Contingent and Noncontingent Rewards.

PubMed

Manohar, Sanjay G; Finzi, Rebecca Dawn; Drew, Daniel; Husain, Masud

2017-07-01

When rewards are available, people expend more energy, increasing their motivational vigor. In theory, incentives might drive behavior for two distinct reasons: First, they increase expected reward; second, they increase the difference in subjective value between successful and unsuccessful performance, which increases contingency-the degree to which action determines outcome. Previous studies of motivational vigor have never compared these directly. Here, we indexed motivational vigor by measuring the speed of eye movements toward a target after participants heard a cue indicating how outcomes would be determined. Eye movements were faster when the cue indicated that monetary rewards would be contingent on performance than when the cue indicated that rewards would be random. But even when the cue indicated that a reward was guaranteed regardless of speed, movement was still faster than when no reward was available. Motivation by contingent and certain rewards was uncorrelated across individuals, which suggests that there are two separable, independent components of motivation. Contingent motivation generated autonomic arousal, and unlike noncontingent motivation, was effective with penalties as well as rewards.

Impact of Social Reward on the Evolution of the Cooperation Behavior in Complex Networks

NASA Astrophysics Data System (ADS)

Wu, Yu'E.; Chang, Shuhua; Zhang, Zhipeng; Deng, Zhenghong

2017-01-01

Social reward, as a significant mechanism explaining the evolution of cooperation, has attracted great attention both theoretically and experimentally. In this paper, we study the evolution of cooperation by proposing a reward model in network population, where a third strategy, reward, as an independent yet particular type of cooperation is introduced in 2-person evolutionary games. Specifically, a new kind of role corresponding to reward strategy, reward agents, is defined, which is aimed at increasing the income of cooperators by applying to them a social reward. Results from numerical simulations show that consideration of social reward greatly promotes the evolution of cooperation, which is confirmed for different network topologies and two evolutionary games. Moreover, we explore the microscopic mechanisms for the promotion of cooperation in the three-strategy model. As expected, the reward agents play a vital role in the formation of cooperative clusters, thus resisting the aggression of defectors. Our research might provide valuable insights into further exploring the nature of cooperation in the real world.

Impact of Social Reward on the Evolution of the Cooperation Behavior in Complex Networks

PubMed Central

Wu, Yu’e; Chang, Shuhua; Zhang, Zhipeng; Deng, Zhenghong

2017-01-01

Social reward, as a significant mechanism explaining the evolution of cooperation, has attracted great attention both theoretically and experimentally. In this paper, we study the evolution of cooperation by proposing a reward model in network population, where a third strategy, reward, as an independent yet particular type of cooperation is introduced in 2-person evolutionary games. Specifically, a new kind of role corresponding to reward strategy, reward agents, is defined, which is aimed at increasing the income of cooperators by applying to them a social reward. Results from numerical simulations show that consideration of social reward greatly promotes the evolution of cooperation, which is confirmed for different network topologies and two evolutionary games. Moreover, we explore the microscopic mechanisms for the promotion of cooperation in the three-strategy model. As expected, the reward agents play a vital role in the formation of cooperative clusters, thus resisting the aggression of defectors. Our research might provide valuable insights into further exploring the nature of cooperation in the real world. PMID:28112276

A comparison of plan-based and abstract MDP reward shaping

NASA Astrophysics Data System (ADS)

Efthymiadis, Kyriakos; Kudenko, Daniel

2014-01-01

Reward shaping has been shown to significantly improve an agent's performance in reinforcement learning. As attention is shifting away from tabula-rasa approaches many different reward shaping methods have been developed. In this paper, we compare two different methods for reward shaping; plan-based, in which an agent is provided with a plan and extra rewards are given according to the steps of the plan the agent satisfies, and reward shaping via abstract Markov decision process (MDPs), in which an abstract high-level MDP of the environment is solved and the resulting value function is used to shape the agent. The comparison is conducted in terms of total reward, convergence speed and scaling up to more complex environments. Empirical results demonstrate the need to correctly select and set up reward shaping methods according to the needs of the environment the agents are acting in. This leads to the more interesting question, is there a reward shaping method which is universally better than all other approaches regardless of the environment dynamics?

Encoding of Vicarious Reward Prediction in Anterior Cingulate Cortex and Relationship with Trait Empathy

PubMed Central

Apps, Matthew A.J.; Roiser, Jonathan P.; Viding, Essi

2015-01-01

Empathy—the capacity to understand and resonate with the experiences of others—can depend on the ability to predict when others are likely to receive rewards. However, although a plethora of research has examined the neural basis of predictions about the likelihood of receiving rewards ourselves, very little is known about the mechanisms that underpin variability in vicarious reward prediction. Human neuroimaging and nonhuman primate studies suggest that a subregion of the anterior cingulate cortex in the gyrus (ACCg) is engaged when others receive rewards. Does the ACCg show specialization for processing predictions about others' rewards and not one's own and does this specialization vary with empathic abilities? We examined hemodynamic responses in the human brain time-locked to cues that were predictive of a high or low probability of a reward either for the subject themselves or another person. We found that the ACCg robustly signaled the likelihood of a reward being delivered to another. In addition, ACCg response significantly covaried with trait emotion contagion, a necessary foundation for empathizing with other individuals. In individuals high in emotion contagion, the ACCg was specialized for processing others' rewards exclusively, but for those low in emotion contagion, this region also responded to information about the subject's own rewards. Our results are the first to show that the ACCg signals probabilistic predictions about rewards for other people and that the substantial individual variability in the degree to which the ACCg is specialized for processing others' rewards is related to trait empathy. SIGNIFICANCE STATEMENT Successfully cooperating, competing, or empathizing with others can depend on our ability to predict when others are going to get something rewarding. Although many studies have examined how the brain processes rewards we will get ourselves, very little is known about vicarious reward processing. Here, we show that a subregion of the anterior cingulate cortex in the gyrus (ACCg) shows a degree of specialization for processing others' versus one's own rewards. However, the degree to which the ACCg is specialized varies with people's ability to empathize with others. This new insight into how vicarious rewards are processed in the brain and vary with empathy may be key for understanding disorders of social behavior, including psychopathy and autism. PMID:26446224

The influence of trial order on learning from reward vs. punishment in a probabilistic categorization task: experimental and computational analyses.

PubMed

Moustafa, Ahmed A; Gluck, Mark A; Herzallah, Mohammad M; Myers, Catherine E

2015-01-01

Previous research has shown that trial ordering affects cognitive performance, but this has not been tested using category-learning tasks that differentiate learning from reward and punishment. Here, we tested two groups of healthy young adults using a probabilistic category learning task of reward and punishment in which there are two types of trials (reward, punishment) and three possible outcomes: (1) positive feedback for correct responses in reward trials; (2) negative feedback for incorrect responses in punishment trials; and (3) no feedback for incorrect answers in reward trials and correct answers in punishment trials. Hence, trials without feedback are ambiguous, and may represent either successful avoidance of punishment or failure to obtain reward. In Experiment 1, the first group of subjects received an intermixed task in which reward and punishment trials were presented in the same block, as a standard baseline task. In Experiment 2, a second group completed the separated task, in which reward and punishment trials were presented in separate blocks. Additionally, in order to understand the mechanisms underlying performance in the experimental conditions, we fit individual data using a Q-learning model. Results from Experiment 1 show that subjects who completed the intermixed task paradoxically valued the no-feedback outcome as a reinforcer when it occurred on reinforcement-based trials, and as a punisher when it occurred on punishment-based trials. This is supported by patterns of empirical responding, where subjects showed more win-stay behavior following an explicit reward than following an omission of punishment, and more lose-shift behavior following an explicit punisher than following an omission of reward. In Experiment 2, results showed similar performance whether subjects received reward-based or punishment-based trials first. However, when the Q-learning model was applied to these data, there were differences between subjects in the reward-first and punishment-first conditions on the relative weighting of neutral feedback. Specifically, early training on reward-based trials led to omission of reward being treated as similar to punishment, but prior training on punishment-based trials led to omission of reward being treated more neutrally. This suggests that early training on one type of trials, specifically reward-based trials, can create a bias in how neutral feedback is processed, relative to those receiving early punishment-based training or training that mixes positive and negative outcomes.

Ventral pallidum roles in reward and motivation.

PubMed

Smith, Kyle S; Tindell, Amy J; Aldridge, J Wayne; Berridge, Kent C

2009-01-23

In recent years the ventral pallidum has become a focus of great research interest as a mechanism of reward and incentive motivation. As a major output for limbic signals, the ventral pallidum was once associated primarily with motor functions rather than regarded as a reward structure in its own right. However, ample evidence now suggests that ventral pallidum function is a major mechanism of reward in the brain. We review data indicating that (1) an intact ventral pallidum is necessary for normal reward and motivation, (2) stimulated activation of ventral pallidum is sufficient to cause reward and motivation enhancements, and (3) activation patterns in ventral pallidum neurons specifically encode reward and motivation signals via phasic bursts of excitation to incentive and hedonic stimuli. We conclude that the ventral pallidum may serve as an important 'limbic final common pathway' for mesocorticolimbic processing of many rewards.

Monetary rewards influence retrieval orientations.

PubMed

Halsband, Teresa M; Ferdinand, Nicola K; Bridger, Emma K; Mecklinger, Axel

2012-09-01

Reward anticipation during learning is known to support memory formation, but its role in retrieval processes is so far unclear. Retrieval orientations, as a reflection of controlled retrieval processing, are one aspect of retrieval that might be modulated by reward. These processes can be measured using the event-related potentials (ERPs) elicited by retrieval cues from tasks with different retrieval requirements, such as via changes in the class of targeted memory information. To determine whether retrieval orientations of this kind are modulated by reward during learning, we investigated the effects of high and low reward expectancy on the ERP correlates of retrieval orientation in two separate experiments. The reward manipulation at study in Experiment 1 was associated with later memory performance, whereas in Experiment 2, reward was directly linked to accuracy in the study task. In both studies, the participants encoded mixed lists of pictures and words preceded by high- or low-reward cues. After 24 h, they performed a recognition memory exclusion task, with words as the test items. In addition to a previously reported material-specific effect of retrieval orientation, a frontally distributed, reward-associated retrieval orientation effect was found in both experiments. These findings suggest that reward motivation during learning leads to the adoption of a reward-associated retrieval orientation to support the retrieval of highly motivational information. Thus, ERP retrieval orientation effects not only reflect retrieval processes related to the sought-for materials, but also relate to the reward conditions with which items were combined during encoding.

Individual differences in the influence of task-irrelevant Pavlovian cues on human behavior.

PubMed

Garofalo, Sara; di Pellegrino, Giuseppe

2015-01-01

Pavlovian-to-instrumental transfer (PIT) refers to the process of a Pavlovian reward-paired cue acquiring incentive motivational proprieties that drive choices. It represents a crucial phenomenon for understanding cue-controlled behavior, and it has both adaptive and maladaptive implications (i.e., drug-taking). In animals, individual differences in the degree to which such cues bias performance have been identified in two types of individuals that exhibit distinct Conditioned Responses (CR) during Pavlovian conditioning: Sign-Trackers (ST) and Goal-Trackers (GT). Using an appetitive PIT procedure with a monetary reward, the present study investigated, for the first time, the extent to which such individual differences might affect the influence of reward-paired cues in humans. In a first task, participants learned an instrumental response leading to reward; then, in a second task, a visual Pavlovian cue was associated with the same reward; finally, in a third task, PIT was tested by measuring the preference for the reward-paired instrumental response when the task-irrelevant reward-paired cue was presented, in the absence of the reward itself. In ST individuals, but not in GT individuals, reward-related cues biased behavior, resulting in an increased likelihood to perform the instrumental response independently paired with the same reward when presented with the task-irrelevant reward-paired cue, even if the reward itself was no longer available (i.e., stronger PIT effect). This finding has important implications for developing individualized treatment for maladaptive behaviors, such as addiction.

The effects of expected reward on creative problem solving.

PubMed

Cristofori, Irene; Salvi, Carola; Beeman, Mark; Grafman, Jordan

2018-06-12

Creative problem solving involves search processes, and it is known to be hard to motivate. Reward cues have been found to enhance performance across a range of tasks, even when cues are presented subliminally, without being consciously detected. It is uncertain whether motivational processes, such as reward, can influence problem solving. We tested the effect of supraliminal and subliminal reward on participant performance on problem solving that can be solved by deliberate analysis or by insight. Forty-one participants attempted to solve 100 compound remote associate problems. At the beginning of each problem, a potential reward cue (1 or 25 cents) was displayed, either subliminally (17 ms) or supraliminally (100 ms). Participants earned the displayed reward if they solved the problem correctly. Results showed that the higher subliminal reward increased the percentage of problems solved correctly overall. Second, we explored if subliminal rewards preferentially influenced solutions that were achieved via a sudden insight (mostly processed below awareness) or via a deliberate analysis. Participants solved more problems via insight following high subliminal reward when compared with low subliminal reward, and compared with high supraliminal reward, with no corresponding effect on analytic solving. Striatal dopamine (DA) is thought to influence motivation, reinforce behavior, and facilitate cognition. We speculate that subliminal rewards activate the striatal DA system, enhancing the kinds of automatic integrative processes that lead to more creative strategies for problem solving, without increasing the selectivity of attention, which could impede insight.

Motivation and effort in individuals with social anhedonia

PubMed Central

McCarthy, Julie M.; Treadway, Michael T.; Blanchard, Jack J.

2015-01-01

It has been proposed that anhedonia may, in part, reflect difficulties in reward processing and effortful decision-making. The current study aimed to replicate previous findings of effortful decision-making deficits associated with elevated anhedonia and expand upon these findings by investigating whether these decision-making deficits are specific to elevated social anhedonia or are also associated with elevated positive schizotypy characteristics. The current study compared controls (n = 40) to individuals elevated on social anhedonia (n = 30), and individuals elevated on perceptual aberration/magical ideation (n = 30) on the Effort Expenditure for Rewards Task (EEfRT). Across groups, participants chose a higher proportion of hard tasks with increasing probability of reward and reward magnitude, demonstrating sensitivity to probability and reward values. Contrary to our expectations, when the probability of reward was most uncertain (50% probability), at low and medium reward values, the social anhedonia group demonstrated more effortful decision-making than either individuals high in positive schizotypy or controls. The positive schizotypy group only differed from controls (making less effortful choices than controls) when reward probability was lowest (12%) and the magnitude of reward was the smallest. Our results suggest that social anhedonia is related to intact motivation and effort for monetary rewards, but that individuals with this characteristic display a unique and perhaps inefficient pattern of effort allocation when the probability of reward is most uncertain. Future research is needed to better understand effortful decision-making and the processing of reward across a range of individual difference characteristics. PMID:25888337

Relief as a Reward: Hedonic and Neural Responses to Safety from Pain

PubMed Central

Leknes, Siri; Lee, Michael; Berna, Chantal; Andersson, Jesper; Tracey, Irene

2011-01-01

Relief fits the definition of a reward. Unlike other reward types the pleasantness of relief depends on the violation of a negative expectation, yet this has not been investigated using neuroimaging approaches. We hypothesized that the degree of negative expectation depends on state (dread) and trait (pessimism) sensitivity. Of the brain regions that are involved in mediating pleasure, the nucleus accumbens also signals unexpected reward and positive prediction error. We hypothesized that accumbens activity reflects the level of negative expectation and subsequent pleasant relief. Using fMRI and two purpose-made tasks, we compared hedonic and BOLD responses to relief with responses during an appetitive reward task in 18 healthy volunteers. We expected some similarities in task responses, reflecting common neural substrates implicated across reward types. However, we also hypothesized that relief responses would differ from appetitive rewards in the nucleus accumbens, since only relief pleasantness depends on negative expectations. The results confirmed these hypotheses. Relief and appetitive reward task activity converged in the ventromedial prefrontal cortex, which also correlated with appetitive reward pleasantness ratings. In contrast, dread and pessimism scores correlated with relief but not with appetitive reward hedonics. Moreover, only relief pleasantness covaried with accumbens activation. Importantly, the accumbens signal appeared to specifically reflect individual differences in anticipation of the adverse event (dread, pessimism) but was uncorrelated to appetitive reward hedonics. In conclusion, relief differs from appetitive rewards due to its reliance on negative expectations, the violation of which is reflected in relief-related accumbens activation. PMID:21490964

THC reduces the anticipatory nucleus accumbens response to reward in subjects with a nicotine addiction

PubMed Central

Jansma, J M; van Hell, H H; Vanderschuren, L J M J; Bossong, M G; Jager, G; Kahn, R S; Ramsey, N F

2013-01-01

Recent evidence has implicated the endocannabinoid (eCB) system in nicotine addiction. The eCB system also has an important role in reward mechanisms, and nicotine addiction has been associated with aberrant reward processing. Motivated by this evidence, we tested the hypothesis that eCB modulation of reward processing is altered in subjects with a nicotine addiction (NAD). For this purpose, we compared reward-related activity in NAD with healthy controls (HC) in a pharmacological magnetic resonance imaging (MRI) study using Δ9-tetrahydrocannabinol (THC) administration to challenge the eCB system. Eleven HC and 10 NAD participated in a 3-T functional MRI (fMRI) study with a double-blind, cross-over, placebo-controlled design, using a Monetary Incentive Delay (MID) paradigm with three reward levels. Reward activity in the nucleus accumbens (NAcc) and caudate putamen during anticipation and feedback of reward was compared after THC and placebo. fMRI results indicated a significant reduction of reward anticipation activity in the NAcc in NAD after THC administration, which was not present in HC. This is indicated by a significant group by drug by reward interaction. Our data show that THC significantly reduces the NAcc response to monetary reward anticipation in NAD. These results suggest that nicotine addiction is associated with altered eCB modulation of reward processing in the NAcc. This study adds important human data to existing evidence implicating the eCB system in nicotine addiction. PMID:23443360

Individual differences in the influence of task-irrelevant Pavlovian cues on human behavior

PubMed Central

Garofalo, Sara; di Pellegrino, Giuseppe

2015-01-01

Pavlovian-to-instrumental transfer (PIT) refers to the process of a Pavlovian reward-paired cue acquiring incentive motivational proprieties that drive choices. It represents a crucial phenomenon for understanding cue-controlled behavior, and it has both adaptive and maladaptive implications (i.e., drug-taking). In animals, individual differences in the degree to which such cues bias performance have been identified in two types of individuals that exhibit distinct Conditioned Responses (CR) during Pavlovian conditioning: Sign-Trackers (ST) and Goal-Trackers (GT). Using an appetitive PIT procedure with a monetary reward, the present study investigated, for the first time, the extent to which such individual differences might affect the influence of reward-paired cues in humans. In a first task, participants learned an instrumental response leading to reward; then, in a second task, a visual Pavlovian cue was associated with the same reward; finally, in a third task, PIT was tested by measuring the preference for the reward-paired instrumental response when the task-irrelevant reward-paired cue was presented, in the absence of the reward itself. In ST individuals, but not in GT individuals, reward-related cues biased behavior, resulting in an increased likelihood to perform the instrumental response independently paired with the same reward when presented with the task-irrelevant reward-paired cue, even if the reward itself was no longer available (i.e., stronger PIT effect). This finding has important implications for developing individualized treatment for maladaptive behaviors, such as addiction. PMID:26157371

The effect of pre- vs. post-reward attainment on EEG asymmetry in melancholic depression.

PubMed

Shankman, Stewart A; Sarapas, Casey; Klein, Daniel N

2011-02-01

Clinical investigators have long theorized about the role of reward processing and positive affect in depression. One theory posits that compared to nonmelancholic depressives, melancholic depressives experience less consummatory (i.e., post-reward), but comparably low anticipatory (prior to reward), positive affect. We tested whether frontal EEG asymmetry, a putative marker of the anticipatory reward system, is present only before an individual receives a reward or also after receiving a reward (i.e., during consummatory reward processing). We also examined whether melancholic depression, a condition characterized by a deficit in consummatory reward processing, is associated with abnormal EEG asymmetries in alpha band power. Effects in other frequency bands (delta, theta, or beta) were also explored. EEG was recorded in 34 controls, 48 nonmelancholic depressives, and 17 melancholic depressives during a slot machine task designed to elicit anticipatory and consummatory reward processing. Results indicated that, for alpha, the frontal EEG asymmetry of greater relative left activity was specific to anticipatory reward processing. During the consummatory phase, individuals with melancholic depression exhibited different posterior EEG asymmetries than individuals with nonmelancholic depression (and controls at a trend level). This second finding was largely due to melancholics exhibiting relatively lower right posterior activity and nonmelancholics exhibiting relatively lower left activity. These results suggest that a posterior asymmetry may be a marker for melancholic depression and aberrant consummatory reward processing. Copyright © 2010 Elsevier B.V. All rights reserved.

Condition interference in rats performing a choice task with switched variable- and fixed-reward conditions.

PubMed

Funamizu, Akihiro; Ito, Makoto; Doya, Kenji; Kanzaki, Ryohei; Takahashi, Hirokazu

2015-01-01

Because humans and animals encounter various situations, the ability to adaptively decide upon responses to any situation is essential. To date, however, decision processes and the underlying neural substrates have been investigated under specific conditions; thus, little is known about how various conditions influence one another in these processes. In this study, we designed a binary choice task with variable- and fixed-reward conditions and investigated neural activities of the prelimbic cortex and dorsomedial striatum in rats. Variable- and fixed-reward conditions induced flexible and inflexible behaviors, respectively; one of the two conditions was randomly assigned in each trial for testing the possibility of condition interference. Rats were successfully conditioned such that they could find the better reward holes of variable-reward-condition and fixed-reward-condition trials. A learning interference model, which updated expected rewards (i.e., values) used in variable-reward-condition trials on the basis of combined experiences of both conditions, better fit choice behaviors than conventional models which updated values in each condition independently. Thus, although rats distinguished the trial condition, they updated values in a condition-interference manner. Our electrophysiological study suggests that this interfering value-updating is mediated by the prelimbic cortex and dorsomedial striatum. First, some prelimbic cortical and striatal neurons represented the action-reward associations irrespective of trial conditions. Second, the striatal neurons kept tracking the values of variable-reward condition even in fixed-reward-condition trials, such that values were possibly interferingly updated even in the fixed-reward condition.

Involvement of the endocannabinoid system in reward processing in the human brain.

PubMed

van Hell, Hendrika H; Jager, Gerry; Bossong, Matthijs G; Brouwer, Annelies; Jansma, J Martijn; Zuurman, Lineke; van Gerven, Joop; Kahn, René S; Ramsey, Nick F

2012-02-01

Disturbed reward processing in humans has been associated with a number of disorders, such as depression, addiction, and attention-deficit hyperactivity disorder. The endocannabinoid (eCB) system has been implicated in reward processing in animals, but in humans, the relation between eCB functioning and reward is less clear. The current study uses functional magnetic resonance imaging (fMRI) to investigate the role of the eCB system in reward processing in humans by examining the effect of the eCB agonist Δ(9)-tetrahydrocannabinol (THC) on reward-related brain activity. Eleven healthy males participated in a randomized placebo-controlled pharmacological fMRI study with administration of THC to challenge the eCB system. We compared anticipatory and feedback-related brain activity after placebo and THC, using a monetary incentive delay task. In this task, subjects are notified before each trial whether a correct response is rewarded ("reward trial") or not ("neutral trial"). Subjects showed faster reaction times during reward trials compared to neutral trials, and this effect was not altered by THC. THC induced a widespread attenuation of the brain response to feedback in reward trials but not in neutral trials. Anticipatory brain activity was not affected. These results suggest a role for the eCB system in the appreciation of rewards. The involvement of the eCB system in feedback processing may be relevant for disorders in which appreciation of natural rewards may be affected such as addiction.

Intrinsic Motivation and Rewards: What Sustains Young Children's Engagement with Text?

ERIC Educational Resources Information Center

Marinak, Barbara A.; Gambrell, Linda B.

2008-01-01

This study investigated the effects of reward proximity and choice of reward on the reading motivation of third-grade students as measured by indicators of task persistence. The major finding from this study was that students who were given a book as a reward and students who received no reward were more motivated to engage in subsequent reading…

Previous Cocaine Exposure Makes Rats Hypersensitive to Both Delay and Reward Magnitude

PubMed Central

Roesch, Matthew R.; Takahashi, Yuji; Gugsa, Nishan; Bissonette, Gregory B.; Schoenbaum, Geoffrey

2008-01-01

Animals prefer an immediate over a delayed reward, just as they prefer a large over a small reward. Exposure to psychostimulants causes long-lasting changes in structures critical for this behavior and might disrupt normal time-discounting performance. To test this hypothesis, we exposed rats to cocaine daily for 2 weeks (30 mg/kg, i.p.). Approximately 6 weeks later, we tested them on a variant of a time-discounting task, in which the rats responded to one of two locations to obtain reward while we independently manipulated the delay to reward and reward magnitude. Performance did not differ between cocaine-treated and saline-treated (control) rats when delay lengths and reward magnitudes were equal at the two locations. However, cocaine-treated rats were significantly more likely to shift their responding when we increased the delay or reward size asymmetrically. Furthermore, they were slower to respond and made more errors when forced to the side associated with the lower value. We conclude that previous exposure to cocaine makes choice behavior hypersensitive to differences in the time to and size of available rewards, consistent with a general effect of cocaine exposure on reward valuation mechanisms. PMID:17202492

Previous cocaine exposure makes rats hypersensitive to both delay and reward magnitude.

PubMed

Roesch, Matthew R; Takahashi, Yuji; Gugsa, Nishan; Bissonette, Gregory B; Schoenbaum, Geoffrey

2007-01-03

Animals prefer an immediate over a delayed reward, just as they prefer a large over a small reward. Exposure to psychostimulants causes long-lasting changes in structures critical for this behavior and might disrupt normal time-discounting performance. To test this hypothesis, we exposed rats to cocaine daily for 2 weeks (30 mg/kg, i.p.). Approximately 6 weeks later, we tested them on a variant of a time-discounting task, in which the rats responded to one of two locations to obtain reward while we independently manipulated the delay to reward and reward magnitude. Performance did not differ between cocaine-treated and saline-treated (control) rats when delay lengths and reward magnitudes were equal at the two locations. However, cocaine-treated rats were significantly more likely to shift their responding when we increased the delay or reward size asymmetrically. Furthermore, they were slower to respond and made more errors when forced to the side associated with the lower value. We conclude that previous exposure to cocaine makes choice behavior hypersensitive to differences in the time to and size of available rewards, consistent with a general effect of cocaine exposure on reward valuation mechanisms.

Caudate responses to reward anticipation associated with delay discounting behavior in healthy youth

PubMed Central

Benningfield, Margaret M.; Blackford, Jennifer U.; Ellsworth, Melissa E.; Samanez-Larkin, Gregory R.; Martin, Peter R.; Cowan, Ronald L.; Zald, David H.

2014-01-01

Background Choices requiring delay of gratification made during adolescence can have significant impact on life trajectory. Willingness to delay gratification can be measured using delay discounting tasks that require a choice between a smaller immediate reward and a larger delayed reward. Individual differences in the subjective value of delayed rewards are associated with risk for development of psychopathology including substance abuse. The neurobiological underpinnings related to these individual differences early in life are not fully understood. Using functional magnetic resonance imaging (fMRI), we tested the hypothesis that individual differences in delay discounting behavior in healthy youth are related to differences in responsiveness to potential reward. Method Nineteen 10 to 14 year-olds performed a monetary incentive delay task to assess neural sensitivity to potential reward and a questionnaire to measure discounting of future monetary rewards. Results Left ventromedial caudate activation during anticipation of potential reward was negatively correlated with delay discounting behavior. There were no regions where brain responses during notification of reward outcome were associated with discounting behavior. Conclusions Brain activation during anticipation of potential reward may serve as a marker for individual differences in ability or willingness to delay gratification in healthy youth. PMID:24309299

Functional requirements for reward-modulated spike-timing-dependent plasticity.

PubMed

Frémaux, Nicolas; Sprekeler, Henning; Gerstner, Wulfram

2010-10-06

Recent experiments have shown that spike-timing-dependent plasticity is influenced by neuromodulation. We derive theoretical conditions for successful learning of reward-related behavior for a large class of learning rules where Hebbian synaptic plasticity is conditioned on a global modulatory factor signaling reward. We show that all learning rules in this class can be separated into a term that captures the covariance of neuronal firing and reward and a second term that presents the influence of unsupervised learning. The unsupervised term, which is, in general, detrimental for reward-based learning, can be suppressed if the neuromodulatory signal encodes the difference between the reward and the expected reward-but only if the expected reward is calculated for each task and stimulus separately. If several tasks are to be learned simultaneously, the nervous system needs an internal critic that is able to predict the expected reward for arbitrary stimuli. We show that, with a critic, reward-modulated spike-timing-dependent plasticity is capable of learning motor trajectories with a temporal resolution of tens of milliseconds. The relation to temporal difference learning, the relevance of block-based learning paradigms, and the limitations of learning with a critic are discussed.

The Differential Effects of Reward on Space- and Object-Based Attentional Allocation

PubMed Central

Shomstein, Sarah

2013-01-01

Estimating reward contingencies and allocating attentional resources to a subset of relevant information are the most important contributors to increasing adaptability of an organism. Although recent evidence suggests that reward- and attention-based guidance recruits overlapping cortical regions and has similar effects on sensory responses, the exact nature of the relationship between the two remains elusive. Here, using event-related fMRI on human participants, we contrasted the effects of reward on space- and object-based selection in the same experimental setting. Reward was either distributed randomly or biased a particular object. Behavioral and neuroimaging results show that space- and object-based attention is influenced by reward differentially. Space-based attentional allocation is mandatory, integrating reward information over time, whereas object-based attentional allocation is a default setting that is completely replaced by the reward signal. Nonadditivity of the effects of reward and object-based attention was observed consistently at multiple levels of analysis in early visual areas as well as in control regions. These results provide strong evidence that space- and object-based allocation are two independent attentional mechanisms, and suggest that reward serves to constrain attentional selection. PMID:23804086

Overlapping neural systems represent cognitive effort and reward anticipation.

PubMed

Vassena, Eliana; Silvetti, Massimo; Boehler, Carsten N; Achten, Eric; Fias, Wim; Verguts, Tom

2014-01-01

Anticipating a potential benefit and how difficult it will be to obtain it are valuable skills in a constantly changing environment. In the human brain, the anticipation of reward is encoded by the Anterior Cingulate Cortex (ACC) and Striatum. Naturally, potential rewards have an incentive quality, resulting in a motivational effect improving performance. Recently it has been proposed that an upcoming task requiring effort induces a similar anticipation mechanism as reward, relying on the same cortico-limbic network. However, this overlapping anticipatory activity for reward and effort has only been investigated in a perceptual task. Whether this generalizes to high-level cognitive tasks remains to be investigated. To this end, an fMRI experiment was designed to investigate anticipation of reward and effort in cognitive tasks. A mental arithmetic task was implemented, manipulating effort (difficulty), reward, and delay in reward delivery to control for temporal confounds. The goal was to test for the motivational effect induced by the expectation of bigger reward and higher effort. The results showed that the activation elicited by an upcoming difficult task overlapped with higher reward prospect in the ACC and in the striatum, thus highlighting a pivotal role of this circuit in sustaining motivated behavior.

Pervasive competition between threat and reward in the brain

PubMed Central

Choi, Jong Moon; Padmala, Srikanth; Spechler, Philip

2014-01-01

In the current functional MRI study, we investigated interactions between reward and threat processing. Visual cues at the start of each trial informed participants about the chance of winning monetary reward and/or receiving a mild aversive shock. We tested two competing hypothesis: according to the ‘salience hypothesis’, in the condition involving both reward and threat, enhanced activation would be observed because of increased salience; according to the ‘competition hypothesis’, the processing of reward and threat would trade-off against each other, leading to reduced activation. Analysis of skin conductance data during a delay phase revealed an interaction between reward and threat processing, such that the effect of reward was reduced during threat and the effect of threat was reduced during reward. Analysis of imaging data during the same task phase revealed interactions between reward and threat processing in several regions, including the midbrain/ventral tegmental area, caudate, putamen, bed nucleus of the stria terminalis, anterior insula, middle frontal gyrus and dorsal anterior cingulate cortex. Taken together, our findings reveal conditions during which reward and threat trade-off against each other across multiple sites. Such interactions are suggestive of competitive processes and may reflect the organization of opponent systems in the brain. PMID:23547242

Paradoxical Decrease in Striatal Activation on an fMRI Reward Task Following Treatment in Youth with Co-morbid Cannabis Dependence/Major Depression.

PubMed

Cornelius, Jack R; Aizenstein, Howard J; Chung, Tammy A; Douaihy, Antoine; Hayes, Jeanine; Daley, Dennis; Salloum, Ihsan M

Reward behavior, including reward behavior involving drugs, has been shown to be mediated by the ventral striatum and related structures of the reward system. The aim of this study was to assess reward-related activity as shown by fMRI before and after treatment among youth with comorbid cannabis dependence and major depression. We hypothesized that the reward task (Delgado et al., 2003) would elicit activation in the reward system, and that the level of activation in response to reward would increase from the beginning to the end of the 12-week treatment study as levels of depressive symptoms and cannabis use decreased. Six subjects were recruited from a larger treatment study in which all received Cognitive Behavioral Therapy/Motivational Enhancement Therapy (CBT/MET), and also were randomized to receive either fluoxetine or placebo. Each of the six subjects completed an fMRI card- guessing/reward task both before and after the 12-week treatment study. As hypothesized, the expected activation was noted for the reward task in the insula, prefrontal, and striatal areas, both before and after treatment. However, the participants showed lower reward-related activation after treatment relative to pre-treatment, which is opposite of what would be expected in depressed subjects who did not demonstrate a comorbid substance use disorder. These paradoxical findings suggest that the expected increase in activity for reward associated with treatment for depression was overshadowed by a decrease in reward-related activation associated with treatment of pathological cannabis use in these comorbid youth. These findings emphasize the importance of comorbid disorders in fMRI studies.

Dissociated effects of anticipating smoking versus monetary reward in the caudate as a function of smoking abstinence.

PubMed

Sweitzer, Maggie M; Geier, Charles F; Joel, Danielle L; McGurrin, Patrick; Denlinger, Rachel L; Forbes, Erika E; Donny, Eric C

2014-11-01

Theories of addiction suggest that chronic smoking may be associated with both hypersensitivity to smoking and related cues and hyposensitivity to alternative reinforcers. However, neural responses to smoking and nonsmoking rewards are rarely evaluated within the same paradigm, leaving the extent to which both processes operate simultaneously uncertain. Behavioral evidence and theoretical models suggest that dysregulated reward processing may be more pronounced during deprivation from nicotine, but neuroimaging evidence on the effects of deprivation on reward processing is limited. The current study examined the impact of deprivation from smoking on neural processing of both smoking and monetary rewards. Two separate functional magnetic resonance imaging scans were performed in 38 daily smokers, one after smoking without restriction and one following 24 hours of abstinence. A rewarded guessing task was conducted during each scan to evaluate striatal blood oxygen level-dependent response during anticipation of both smoking and monetary rewards. A significant reward type by abstinence interaction was observed in the bilateral caudate and medial prefrontal cortex during reward anticipation. The blood oxygen level-dependent response to anticipation of smoking reward was significantly higher and anticipation of monetary rewards was significantly lower during abstinence compared with nonabstinence. Attenuation of monetary reward-related activation during abstinence was significantly correlated with abstinence-induced increases in craving and withdrawal. These results provide the first direct evidence of dissociated effects of smoking versus monetary rewards as a function of abstinence. The findings suggest an important neural pathway that may underlie the choice to smoke in lieu of alternative reinforcement during a quit attempt. © 2013 Society of Biological Psychiatry Published by Society of Biological Psychiatry All rights reserved.

The effects of nicotine dependence and acute abstinence on the processing of drug and non-drug rewards.

PubMed

Lawn, W; Freeman, T P; Hindocha, C; Mokrysz, C; Das, R K; Morgan, C J A; Curran, H V

2015-07-01

Drug addiction may be characterised by a hypersensitivity to drug rewards and a hyposensitivity to non-drug rewards. This imbalance may become further polarised during acute abstinence. (i) Examine the differences between dependent and occasional smokers in choices for, motivation for and self-reported wanting and liking of cigarette and non-drug rewards. (ii) Examine the effects of 12-h nicotine abstinence on these metrics. Dependent (n = 20) and occasional, non-dependent smokers (n = 20) were tested after ad libitum smoking and ≥12-h of nicotine abstinence. A novel task was developed (Drug, Reward and Motivation-Choice (DReaM-Choice)) in which different rewards (cigarettes, music and chocolate) could be won. In each trial, participants chose between two rewards and then could earn the chosen reward via repeated button-pressing. Participants subsequently 'consumed' and rated subjective liking of the rewards they had won. Compared with occasional smokers, dependent smokers made more choices for (p < 0.001), pressed more for (p = 0.046) and reported more wanting (p = 0.007) and liking (p < 0.001) of cigarettes, and also made fewer choices for chocolate (p = 0.005). There were no differences between the groups on button-pressing for chocolate or music. However, the balance between drug and non-drug reward processing was different between the groups across all metrics. Twelve-hour nicotine abstinence led to more cigarette choices (p < 0.001) and fewer music choices (p = 0.042) in both groups. Nicotine dependence was associated with a hypersensitivity to cigarette rewards, but we found little evidence indicating a hyposensitivity to non-drug rewards. Our findings question the moderating influence of dependence on how acute nicotine abstinence affects reward processing.

A longitudinal high-risk study of adolescent anxiety, depression and parent-severity on the developmental course of risk-adjustment.

PubMed

Rawal, Adhip; Riglin, Lucy; Ng-Knight, Terry; Collishaw, Stephan; Thapar, Anita; Rice, Frances

2014-11-01

Adolescence is associated with developments in the reward system and increased rates of emotional disorders. Familial risk for depression may be associated with disruptions in the reward system. However, it is unclear how symptoms of depression and anxiety influence the development of reward-processing over adolescence and whether variation in the severity of parental depression is associated with hyposensitivity to reward in a high-risk sample. We focused on risk-adjustment (adjusting decisions about reward according to the probability of obtaining reward) as this was hypothesized to improve over adolescence. In a one-year longitudinal sample (N = 197) of adolescent offspring of depressed parents, we examined how symptoms of depression and anxiety (generalized anxiety and social anxiety) influenced the development of risk-adjustment. We also examined how parental depression severity influenced adolescent risk-adjustment. Risk-adjustment improved over the course of the study indicating improved adjustment of reward-seeking to shifting contingencies. Depressive symptoms were associated with decreases in risk-adjustment over time while social anxiety symptoms were associated with increases in risk-adjustment over time. Specifically, depression was associated with reductions in reward-seeking at favourable reward probabilities only, whereas social anxiety (but not generalized anxiety) led to reductions in reward-seeking at low reward probabilities only. Parent depression severity was associated with lowered risk-adjustment in offspring and also influenced the longitudinal relationship between risk-adjustment and offspring depression. Anxiety and depression distinctly alter the pattern of longitudinal change in reward-processing. Severity of parent depression was associated with alterations in adolescent offspring reward-processing in a high-risk sample. © 2014 The Authors. Journal of Child Psychology and Psychiatry published by John Wiley & Sons Ltd on behalf of Association for Child and Adolescent Mental Health.

Saccade selection when reward probability is dynamically manipulated using Markov chains

PubMed Central

Lovejoy, Lee P.; Krauzlis, Richard J.

2012-01-01

Markov chains (stochastic processes where probabilities are assigned based on the previous outcome) are commonly used to examine the transitions between behavioral states, such as those that occur during foraging or social interactions. However, relatively little is known about how well primates can incorporate knowledge about Markov chains into their behavior. Saccadic eye movements are an example of a simple behavior influenced by information about probability, and thus are good candidates for testing whether subjects can learn Markov chains. In addition, when investigating the influence of probability on saccade target selection, the use of Markov chains could provide an alternative method that avoids confounds present in other task designs. To investigate these possibilities, we evaluated human behavior on a task in which stimulus reward probabilities were assigned using a Markov chain. On each trial, the subject selected one of four identical stimuli by saccade; after selection, feedback indicated the rewarded stimulus. Each session consisted of 200–600 trials, and on some sessions, the reward magnitude varied. On sessions with a uniform reward, subjects (n = 6) learned to select stimuli at a frequency close to reward probability, which is similar to human behavior on matching or probability classification tasks. When informed that a Markov chain assigned reward probabilities, subjects (n = 3) learned to select the greatest reward probability more often, bringing them close to behavior that maximizes reward. On sessions where reward magnitude varied across stimuli, subjects (n = 6) demonstrated preferences for both greater reward probability and greater reward magnitude, resulting in a preference for greater expected value (the product of reward probability and magnitude). These results demonstrate that Markov chains can be used to dynamically assign probabilities that are rapidly exploited by human subjects during saccade target selection. PMID:18330552

Saccade selection when reward probability is dynamically manipulated using Markov chains.

PubMed

Nummela, Samuel U; Lovejoy, Lee P; Krauzlis, Richard J

2008-05-01

Markov chains (stochastic processes where probabilities are assigned based on the previous outcome) are commonly used to examine the transitions between behavioral states, such as those that occur during foraging or social interactions. However, relatively little is known about how well primates can incorporate knowledge about Markov chains into their behavior. Saccadic eye movements are an example of a simple behavior influenced by information about probability, and thus are good candidates for testing whether subjects can learn Markov chains. In addition, when investigating the influence of probability on saccade target selection, the use of Markov chains could provide an alternative method that avoids confounds present in other task designs. To investigate these possibilities, we evaluated human behavior on a task in which stimulus reward probabilities were assigned using a Markov chain. On each trial, the subject selected one of four identical stimuli by saccade; after selection, feedback indicated the rewarded stimulus. Each session consisted of 200-600 trials, and on some sessions, the reward magnitude varied. On sessions with a uniform reward, subjects (n = 6) learned to select stimuli at a frequency close to reward probability, which is similar to human behavior on matching or probability classification tasks. When informed that a Markov chain assigned reward probabilities, subjects (n = 3) learned to select the greatest reward probability more often, bringing them close to behavior that maximizes reward. On sessions where reward magnitude varied across stimuli, subjects (n = 6) demonstrated preferences for both greater reward probability and greater reward magnitude, resulting in a preference for greater expected value (the product of reward probability and magnitude). These results demonstrate that Markov chains can be used to dynamically assign probabilities that are rapidly exploited by human subjects during saccade target selection.

“Liking” and “Wanting” Linked to Reward Deficiency Syndrome (RDS): Hypothesizing Differential Responsivity in Brain Reward Circuitry

PubMed Central

Blum, Kenneth; Gardner, Eliot; Oscar-Berman, Marlene; Gold, Mark

2013-01-01

In an attempt to resolve controversy regarding the causal contributions of mesolimbic dopamine (DA) systems to reward, we evaluate the three main competing explanatory categories: “liking,” “learning,” and “wanting” [1]. That is, DA may mediate (a) the hedonic impact of reward (liking), (b) learned predictions about rewarding effects (learning), or (c) the pursuit of rewards by attributing incentive salience to reward-related stimuli (wanting). We evaluate these hypotheses, especially as they relate to the Reward Deficiency Syndrome (RDS), and we find that the incentive salience or “wanting” hypothesis of DA function is supported by a majority of the evidence. Neuroimaging studies have shown that drugs of abuse, palatable foods, and anticipated behaviors such as sex and gaming affect brain regions involving reward circuitry, and may not be unidirectional. Drugs of abuse enhance DA signaling and sensitize mesolimbic mechanisms that evolved to attribute incentive salience to rewards. Addictive drugs have in common that they are voluntarily self-administered, they enhance (directly or indirectly) dopaminergic synaptic function in the nucleus accumbens, and they stimulate the functioning of brain reward circuitry (producing the “high” that drug users seek). Although originally believed simply to encode the set point of hedonic tone, these circuits now are believed to be functionally more complex, also encoding attention, reward expectancy, disconfirmation of reward expectancy, and incentive motivation. Elevated stress levels, together with polymorphisms of dopaminergic genes and other neurotransmitter genetic variants, may have a cumulative effect on vulnerability to addiction. The RDS model of etiology holds very well for a variety of chemical and behavioral addictions. PMID:22236117

Mutual Influence of Reward Anticipation and Emotion on Brain Activity during Memory Retrieval.

PubMed

Yan, Chunping; Liu, Fang; Li, Yunyun; Zhang, Qin; Cui, Lixia

2017-01-01

Previous studies on the joint effect of reward motivation and emotion on memory retrieval have obtained inconsistent results. Furthermore, whether and how any such joint effect might vary over time remains unclear too. Accordingly, using the event-related potential (ERP) measurement of high temporal resolution, our study investigates the cognitive and brain mechanisms of monetary reward and emotion affecting the retrieval processes of episodic memory. Twenty undergraduate and graduate students participated in the research, and our study's behavioral results indicated that reward (relative to no reward) and negative emotion (relative to positive and neutral emotion) significantly improved recognition performance. The ERP results showed that there were significant interactions between monetary reward and emotion on memory retrieval, and the reward effects of positive, neutral, and negative memory occurred at varied intervals in mean amplitude. The reward effect of positive memory appeared relatively early, at 260-330 ms after the stimulus onset in the frontal-frontocentral area, at 260-500 ms in the centroparietal-parietal area and at 500-700 ms in the frontocentral area. However, the reward effects of neutral and negative memory occurred relatively later, and that of negative memory appeared at 500-700 ms in the frontocentral and centroparietal area and that of neutral memory was at 500-700 ms in the frontocentral and centroparietal-parietal area. Meanwhile, significant FN400 old/new effects were observed in the negative and rewarded positive items, and the old/new effects of negative items appeared earlier at FN400 than positive items. Also, significant late positive component (LPC) old/new effects were found in the positive, negative, and rewarded neutral items. These results suggest that, monetary reward and negative emotion significantly improved recognition performance, and there was a mutual influence between reward and emotion on brain activity during memory retrieval.

SA45. Amotivation in Schizophrenia, Bipolar Disorder, and Major Depressive Disorder: A Preliminary Comparison Study

PubMed Central

Zou, Ying-min; Ni, Ke; Wang, Yang-yu; Yu, En-qing; Lui, Simon S. Y.; Cheung, Eric F. C.; Chan, Raymond C. K.

2017-01-01

Abstract Background: Deficits in reward processing, such as approaching motivation, reward learning and effort-based decision-making, have been observed in patients with schizophrenia (SCZ), bipolar disorder (BD), and major depressive disorder (MDD). However, little is known about the nature of reward-processing deficits in these 3 diagnostic groups. The present study aimed to compare and contrast amotivation in these 3 diagnostic groups using an effort-based decision-making task. Methods: Sixty patients (19 SCZ patients, 18 BD patients and 23 MDD patients) and 27 healthy controls (HC) were recruited for the present study. The Effort Expenditure for Reward Task (EEfRT) was administered to evaluate their effort allocation pattern. This task required participants to choose easy or hard tasks in response to different levels of reward magnitude and reward probability. Results: Results showed that SCZ, BD, and MDD patients chose fewer hard tasks compared to HC. As reward magnitude increased, MDD patients made the least effort to gain reward compared to the other groups. When reward probability was intermediate, MDD patients chose fewer hard tasks than SCZ patients, whereas BD patients and HC chose more hard tasks than MDD and SCZ patients. When the reward probability was high, all 3 groups of patients tried fewer hard tasks than HC. Moreover, SCZ and MDD patients were less likely to choose hard tasks than BD patients and HC in the intermediate estimated value conditions. However, in the highest estimated value condition, there was no group difference in hard task choices between these 3 clinical groups, and they were all less motivated than HC. Conclusion: SCZ, BD, and MDD patients shared common deficits in gaining reward if the reward probability and estimated value were high. SCZ and MDD patients showed less motivation than BD patients in gaining reward when the reward probability and estimated value was intermediate.

One pair of hands is not like another: caudate BOLD response in dogs depends on signal source and canine temperament

PubMed Central

Cook, Peter F.; Spivak, Mark

2014-01-01

Having previously used functional MRI to map the response to a reward signal in the ventral caudate in awake unrestrained dogs, here we examined the importance of signal source to canine caudate activation. Hand signals representing either incipient reward or no reward were presented by a familiar human (each dog’s respective handler), an unfamiliar human, and via illustrated images of hands on a computer screen to 13 dogs undergoing voluntary fMRI. All dogs had received extensive training with the reward and no-reward signals from their handlers and with the computer images and had minimal exposure to the signals from strangers. All dogs showed differentially higher BOLD response in the ventral caudate to the reward versus no reward signals, and there was a robust effect at the group level. Further, differential response to the signal source had a highly significant interaction with a dog’s general aggressivity as measured by the C-BARQ canine personality assessment. Dogs with greater aggressivity showed a higher differential response to the reward signal versus no-reward signal presented by the unfamiliar human and computer, while dogs with lower aggressivity showed a higher differential response to the reward signal versus no-reward signal from their handler. This suggests that specific facets of canine temperament bear more strongly on the perceived reward value of relevant communication signals than does reinforcement history, as each of the dogs were reinforced similarly for each signal, regardless of the source (familiar human, unfamiliar human, or computer). A group-level psychophysiological interaction (PPI) connectivity analysis showed increased functional coupling between the caudate and a region of cortex associated with visual discrimination and learning on reward versus no-reward trials. Our findings emphasize the sensitivity of the domestic dog to human social interaction, and may have other implications and applications pertinent to the training and assessment of working and pet dogs. PMID:25289182

The influence of motherhood on neural systems for reward processing in low income, minority, young women.

PubMed

Moses-Kolko, Eydie L; Forbes, Erika E; Stepp, Stephanie; Fraser, David; Keenan, Kate E; Guyer, Amanda E; Chase, Henry W; Phillips, Mary L; Zevallos, Carlos R; Guo, Chaohui; Hipwell, Alison E

2016-04-01

Given the association between maternal caregiving behavior and heightened neural reward activity in experimental animal studies, the present study examined whether motherhood in humans positively modulates reward-processing neural circuits, even among mothers exposed to various life stressors and depression. Subjects were 77 first-time mothers and 126 nulliparous young women from the Pittsburgh Girls Study, a longitudinal study beginning in childhood. Subjects underwent a monetary reward task during functional magnetic resonance imaging in addition to assessment of current depressive symptoms. Life stress was measured by averaging data collected between ages 8-15 years. Using a region-of-interest approach, we conducted hierarchical regression to examine the relationship of psychosocial factors (life stress and current depression) and motherhood with extracted ventral striatal (VST) response to reward anticipation. Whole-brain regression analyses were performed post-hoc to explore non-striatal regions associated with reward anticipation in mothers vs nulliparous women. Anticipation of monetary reward was associated with increased neural activity in expected regions including caudate, orbitofrontal, occipital, superior and middle frontal cortices. There was no main effect of motherhood nor motherhood-by-psychosocial factor interaction effect on VST response during reward anticipation. Depressive symptoms were associated with increased VST activity across the entire sample. In exploratory whole brain analysis, motherhood was associated with increased somatosensory cortex activity to reward (FWE cluster forming threshold p<0.001). These findings indicate that motherhood is not associated with reward anticipation-related VST activity nor does motherhood modulate the impact of depression or life stress on VST activity. Future studies are needed to evaluate whether earlier postpartum assessment of reward function, inclusion of mothers with more severe depressive symptoms, and use of reward tasks specific for social reward might reveal an impact of motherhood on reward system activity. Copyright © 2016 Elsevier Ltd. All rights reserved.

Reward Sensitivity and Waiting Impulsivity: Shift towards Reward Valuation away from Action Control

PubMed Central

Mechelmans, Daisy J; Strelchuk, Daniela; Doñamayor, Nuria; Banca, Paula; Robbins, Trevor W; Baek, Kwangyeol

2017-01-01

Abstract Background Impulsivity and reward expectancy are commonly interrelated. Waiting impulsivity, measured using the rodent 5-Choice Serial Reaction Time task, predicts compulsive cocaine seeking and sign (or cue) tracking. Here, we assess human waiting impulsivity using a novel translational task, the 4-Choice Serial Reaction Time task, and the relationship with reward cues. Methods Healthy volunteers (n=29) performed the monetary incentive delay task as a functional MRI study where subjects observe a cue predicting reward (cue) and wait to respond for high (£5), low (£1), or no reward. Waiting impulsivity was tested with the 4-Choice Serial Reaction Time task. Results For high reward prospects (£5, no reward), greater waiting impulsivity on the 4-CSRT correlated with greater medial orbitofrontal cortex and lower supplementary motor area activity to cues. In response to high reward cues, greater waiting impulsivity was associated with greater subthalamic nucleus connectivity with orbitofrontal cortex and greater subgenual cingulate connectivity with anterior insula, but decreased connectivity with regions implicated in action selection and preparation. Conclusion These findings highlight a shift towards regions implicated in reward valuation and a shift towards compulsivity away from higher level motor preparation and action selection and response. We highlight the role of reward sensitivity and impulsivity, mechanisms potentially linking human waiting impulsivity with incentive approach and compulsivity, theories highly relevant to disorders of addiction. PMID:29020291

The role of intrinsic and extrinsic rewards in committing violence during combat: A cross-sectional study with former combatants in the DR Congo.

PubMed

Haer, Roos; Hermenau, Katharin; Elbert, Thomas; Moran, James K; Hecker, Tobias

2017-05-01

It has been postulated that the violent behavior that characterizes armed conflict is reinforced by the possibility of receiving rewards. The present study examined the potential influence of two types of rewards in an ongoing setting of conflict: extrinsic and intrinsic rewards. Former combatants active in the Democratic Republic of the Congo (N = 198) were interviewed and questioned about the way they were recruited, the offenses they committed during combat, their level of perceived intrinsic rewards (i.e., appetitive perception of violence), and the number of received extrinsic rewards during their time in the armed group (e.g., money, extra food, alcohol, or drugs). A moderated multiple regression analysis showed that the number of received extrinsic rewards and the level of intrinsic rewards were significantly positively related to the number of different types of offenses committed. In contrast to our expectations and previous findings, the recruitment type (forced conscription vs. voluntary enlistment) did not moderate this relation. Our findings suggest that both types of rewards play a role in committing violence during combat. We suggest, therefore, that reintegration programs should not only consider the influence of extrinsic rewards, but also need to address the influence of intrinsic rewards to counter violent behavior among former combatants. Aggr. Behav. 43:241-250, 2017. © 2016 Wiley Periodicals, Inc. © 2016 Wiley Periodicals, Inc.

Autistic Traits Moderate the Impact of Reward Learning on Social Behaviour.

PubMed

Panasiti, Maria Serena; Puzzo, Ignazio; Chakrabarti, Bhismadev

2016-04-01

A deficit in empathy has been suggested to underlie social behavioural atypicalities in autism. A parallel theoretical account proposes that reduced social motivation (i.e., low responsivity to social rewards) can account for the said atypicalities. Recent evidence suggests that autistic traits modulate the link between reward and proxy metrics related to empathy. Using an evaluative conditioning paradigm to associate high and low rewards with faces, a previous study has shown that individuals high in autistic traits show reduced spontaneous facial mimicry of faces associated with high vs. low reward. This observation raises the possibility that autistic traits modulate the magnitude of evaluative conditioning. To test this, we investigated (a) if autistic traits could modulate the ability to implicitly associate a reward value to a social stimulus (reward learning/conditioning, using the Implicit Association Task, IAT); (b) if the learned association could modulate participants' prosocial behaviour (i.e., social reciprocity, measured using the cyberball task); (c) if the strength of this modulation was influenced by autistic traits. In 43 neurotypical participants, we found that autistic traits moderated the relationship of social reward learning on prosocial behaviour but not reward learning itself. This evidence suggests that while autistic traits do not directly influence social reward learning, they modulate the relationship of social rewards with prosocial behaviour. © 2015 The Authors Autism Research published by Wiley Periodicals, Inc. on behalf of International Society for Autism Research.

Individual differences in sensitivity to reward and punishment and neural activity during reward and avoidance learning.

PubMed

Kim, Sang Hee; Yoon, HeungSik; Kim, Hackjin; Hamann, Stephan

2015-09-01

In this functional neuroimaging study, we investigated neural activations during the process of learning to gain monetary rewards and to avoid monetary loss, and how these activations are modulated by individual differences in reward and punishment sensitivity. Healthy young volunteers performed a reinforcement learning task where they chose one of two fractal stimuli associated with monetary gain (reward trials) or avoidance of monetary loss (avoidance trials). Trait sensitivity to reward and punishment was assessed using the behavioral inhibition/activation scales (BIS/BAS). Functional neuroimaging results showed activation of the striatum during the anticipation and reception periods of reward trials. During avoidance trials, activation of the dorsal striatum and prefrontal regions was found. As expected, individual differences in reward sensitivity were positively associated with activation in the left and right ventral striatum during reward reception. Individual differences in sensitivity to punishment were negatively associated with activation in the left dorsal striatum during avoidance anticipation and also with activation in the right lateral orbitofrontal cortex during receiving monetary loss. These results suggest that learning to attain reward and learning to avoid loss are dependent on separable sets of neural regions whose activity is modulated by trait sensitivity to reward or punishment. © The Author (2015). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Encoding of reward expectation by monkey anterior insular neurons

PubMed Central

Mizuhiki, Takashi; Richmond, Barry J.

2012-01-01

The insula, a cortical brain region that is known to encode information about autonomic, visceral, and olfactory functions, has recently been shown to encode information during reward-seeking tasks in both single neuronal recording and functional magnetic resonance imaging studies. To examine the reward-related activation, we recorded from 170 single neurons in anterior insula of 2 monkeys during a multitrial reward schedule task, where the monkeys had to complete a schedule of 1, 2, 3, or 4 trials to earn a reward. In one block of trials a visual cue indicated whether a reward would or would not be delivered in the current trial after the monkey successfully detected that a red spot turned green, and in other blocks the visual cue was random with respect to reward delivery. Over one-quarter of 131 responsive neurons were activated when the current trial would (certain or uncertain) be rewarded if performed correctly. These same neurons failed to respond in trials that were certain, as indicated by the cue, to be unrewarded. Another group of neurons responded when the reward was delivered, similar to results reported previously. The dynamics of population activity in anterior insula also showed strong signals related to knowing when a reward is coming. The most parsimonious explanation is that this activity codes for a type of expected outcome, where the expectation encompasses both certain and uncertain rewards. PMID:22402653

Pervasive negative effects of rewards on intrinsic motivation: The myth continues

PubMed Central

Cameron, Judy; Banko, Katherine M.; Pierce, W. David

2001-01-01

A major concern in psychology and education is that rewards decrease intrinsic motivation to perform activities. Over the past 30 years, more than 100 experimental studies have been conducted on this topic. In 1994, Cameron and Pierce conducted a meta-analysis of this literature and concluded that negative effects of reward were limited and could be easily prevented in applied settings. A more recent meta-analysis of the literature by Deci, Koestner, and Ryan (1999) shows pervasive negative effects of reward. The purpose of the present article is to resolve differences in previous meta-analytic findings and to provide a meta-analysis of rewards and intrinsic motivation that permits tests of competing theoretical explanations. Our results suggest that in general, rewards are not harmful to motivation to perform a task. Rewards given for low-interest tasks enhance free-choice intrinsic motivation. On high-interest tasks, verbal rewards produce positive effects on free-choice motivation and self-reported task interest. Negative effects are found on high-interest tasks when the rewards are tangible, expected (offered beforehand), and loosely tied to level of performance. When rewards are linked to level of performance, measures of intrinsic motivation increase or do not differ from a nonrewarded control group. Overall, the pattern of results indicates that reward contingencies do not have pervasive negative effects on intrinsic motivation. Theoretical and practical implications of the findings are addressed. PMID:22478353

The effect of a primary sexual reward manipulation on cortisol responses to psychosocial stress in men.

PubMed

Creswell, J David; Pacilio, Laura E; Denson, Thomas F; Satyshur, Maureen

2013-05-01

Although previous research provides evidence for the role of rewarding activities in reducing hypothalamic-pituitary-adrenal axis responses to stress, no studies have tested whether rewards can buffer cortisol responses in humans undergoing social stressors. This study experimentally investigated whether viewing appetitive rewarding pictures reduces cortisol responses to an acute stress challenge. Fifty-four heterosexual men were randomly assigned to view either mildly erotic (reward) or neutral images (control) of mixed-sex couples before completing the Trier Social Stress Test (TSST). Participants in the reward condition had significantly lower area-under-the-curve cortisol reactivity to the TSST (mean [M] = 363.46) in comparison with participants in the control group (M = 807.06; F(1,46) = 4.84, p = .033, η(2) = 0.095). Reward participants also had improved cognitive performance on the math portion of the TSST (M = 20.74) in comparison with control participants (M = 13.82; F(44) = 5.44, p = .024, η(2) = 0.11). The stress-buffering effects of reward were specific to hypothalamic-pituitary-adrenal axis reactivity: the reward and control groups did not differ on psychological perceptions of anticipatory or poststress perceptions, heart rate, or blood pressure responses. This research provides the first evidence linking the experience of reward with reduced stress reactivity in humans and suggests a potential novel reward pathway for coping under stress.

Pervasive negative effects of rewards on intrinsic motivation: The myth continues.

PubMed

Cameron, J; Banko, K M; Pierce, W D

2001-01-01

A major concern in psychology and education is that rewards decrease intrinsic motivation to perform activities. Over the past 30 years, more than 100 experimental studies have been conducted on this topic. In 1994, Cameron and Pierce conducted a meta-analysis of this literature and concluded that negative effects of reward were limited and could be easily prevented in applied settings. A more recent meta-analysis of the literature by Deci, Koestner, and Ryan (1999) shows pervasive negative effects of reward. The purpose of the present article is to resolve differences in previous meta-analytic findings and to provide a meta-analysis of rewards and intrinsic motivation that permits tests of competing theoretical explanations. Our results suggest that in general, rewards are not harmful to motivation to perform a task. Rewards given for low-interest tasks enhance free-choice intrinsic motivation. On high-interest tasks, verbal rewards produce positive effects on free-choice motivation and self-reported task interest. Negative effects are found on high-interest tasks when the rewards are tangible, expected (offered beforehand), and loosely tied to level of performance. When rewards are linked to level of performance, measures of intrinsic motivation increase or do not differ from a nonrewarded control group. Overall, the pattern of results indicates that reward contingencies do not have pervasive negative effects on intrinsic motivation. Theoretical and practical implications of the findings are addressed.

Successful inhibitory control over an immediate reward is associated with attentional disengagement in visual processing areas.

PubMed

O'Connor, David A; Rossiter, Sarah; Yücel, Murat; Lubman, Dan I; Hester, Robert

2012-09-01

We examined the neural basis of the capacity to resist an immediately rewarding stimulus in order to obtain a larger delayed reward. This was investigated with a Go/No-go task employing No-go targets that provided two types of reward outcomes. These were contingent on inhibitory control performance: failure to inhibit Reward No-go targets provided a small monetary reward with immediate feedback; while successful inhibitory control resulted in larger rewards with delayed feedback based on the highest number of consecutive inhibitions. We observed faster Go trial responses with maintained levels of inhibition accuracy during the Reward No-go condition compared to a neutral No-go condition. Comparisons between conditions of BOLD activity showed successful inhibitory control over rewarding No-Go targets was associated with hypoactivity in regions previously associated with regulating emotion and inhibitory control, including insula and right inferior frontal gyrus. In addition, regions previously associated with visual processing centers that are modulated as a function of visual attention, namely the left fusiform and right superior temporal gyri, were hypoactive. These findings suggest a role for attentional disengagement as an aid to withholding response over a rewarding stimulus and are consistent with the notion that gratification can be delayed by directing attention away from immediate rewards. Crown Copyright © 2012. Published by Elsevier Inc. All rights reserved.

Impaired associative learning with food rewards in obese women.

PubMed

Zhang, Zhihao; Manson, Kirk F; Schiller, Daniela; Levy, Ifat

2014-08-04

Obesity is a major epidemic in many parts of the world. One of the main factors contributing to obesity is overconsumption of high-fat and high-calorie food, which is driven by the rewarding properties of these types of food. Previous studies have suggested that dysfunction in reward circuits may be associated with overeating and obesity. The nature of this dysfunction, however, is still unknown. Here, we demonstrate impairment in reward-based associative learning specific to food in obese women. Normal-weight and obese participants performed an appetitive reversal learning task in which they had to learn and modify cue-reward associations. To test whether any learning deficits were specific to food reward or were more general, we used a between-subject design in which half of the participants received food reward and the other half received money reward. Our results reveal a marked difference in associative learning between normal-weight and obese women when food was used as reward. Importantly, no learning deficits were observed with money reward. Multiple regression analyses also established a robust negative association between body mass index and learning performance in the food domain in female participants. Interestingly, such impairment was not observed in obese men. These findings suggest that obesity may be linked to impaired reward-based associative learning and that this impairment may be specific to the food domain. Copyright © 2014 Elsevier Ltd. All rights reserved.

Optogenetic Excitation of Central Amygdala Amplifies and Narrows Incentive Motivation to Pursue One Reward Above Another

PubMed Central

Warlow, Shelley M.; Berridge, Kent C.

2014-01-01

Choosing one reward above another is important for achieving adaptive life goals. Yet hijacked into excessive intensity in disorders such as addiction, single-minded pursuit becomes maladaptive. Here, we report that optogenetic channelrhodopsin stimulation of neurons in central nucleus of amygdala (CeA), paired with earning a particular sucrose reward in rats, amplified and narrowed incentive motivation to that single reward target. Therefore, CeA rats chose and intensely pursued only the laser-paired sucrose reward while ignoring an equally good sucrose alternative. In contrast, reward-paired stimulation of basolateral amygdala did not hijack choice. In a separate measure of incentive motivation, CeA stimulation also increased the progressive ratio breakpoint or level of effort exerted to obtain sucrose reward. However, CeA stimulation by itself failed to support behavioral self-stimulation in the absence of any paired external food reward, suggesting that CeA photo-excitation specifically transformed the value of its external reward (rather than adding an internal reinforcement state). Nor did CeA stimulation by itself induce any aversive state that motivated escape. Finally, CeA stimulation also failed to enhance ‘liking’ reactions elicited by sucrose taste and did not simply increase the general motivation to eat. This pattern suggests that CeA photo-excitation specifically enhances and narrows incentive motivation to pursue an associated external reward at the expense of another comparable reward. PMID:25505310

I don't want to come back down: Undoing versus maintaining of reward recovery in older adolescents.

PubMed

Gilbert, Kirsten E; Nolen-Hoeksema, Susan; Gruber, June

2016-03-01

Adolescence is characterized by heightened and sometimes impairing reward sensitivity, yet less is known about how adolescents recover from highly arousing positive states. This is particularly important given high onset rates of psychopathology associated with reward sensitivity during late adolescence and early adulthood. The current study thus utilized a novel reward sensitivity task in order to examine potential ways in which older adolescent females (ages 18-21; N = 83) might recover from high arousal positive reward sensitive states. Participants underwent a fixed incentive reward sensitivity task and subsequently watched a neutral, sad, or a low approach-motivated positive emotional film clip during which subjective and physiological recovery was assessed. Results indicated that the positive and negative film conditions were associated with maintained physiological arousal while the neutral condition facilitated faster physiological recovery from the reward sensitivity task. It is interesting to note that individual differences in self-reported positive emotion during the reward task were associated with faster recovery in the neutral condition. Findings suggest elicited emotion (regardless of valence) may serve to maintain reward sensitivity whereas self-reported positive emotional experience may be a key ingredient facilitating physiological recovery or undoing. Understanding the nuances of reward recovery provides a critical step in understanding the etiology and persistence of reward dysregulation more generally. (c) 2016 APA, all rights reserved).

Ventral Pallidum Roles in Reward and Motivation

PubMed Central

Smith, Kyle S.; Tindell, Amy J.; Aldridge, J. Wayne; Berridge, Kent C.

2008-01-01

In recent years the ventral pallidum has become a focus of great research interest as a mechanism of reward and incentive motivation. As a major output for limbic signals, the ventral pallidum was once associated primarily with motor functions rather than regarded as a reward structure in its own right. However, ample evidence now suggests that ventral pallidum function is a major mechanism of reward in the brain. We review data indicating that 1) an intact ventral pallidum is necessary for normal reward and motivation, 2) stimulated activation of ventral pallidum is sufficient to cause reward and motivation enhancements, and 3) activation patterns in ventral pallidum neurons specifically encode reward and motivation signals via phasic bursts of excitation to incentive and hedonic stimuli. We conclude that the ventral pallidum may serve as an important ‘limbic final common pathway’ for mesocorticolimbic processing of many rewards. PMID:18955088

Spread of status value: Rewards and the creation of status characteristics.

PubMed

Harkness, Sarah K

2017-01-01

Rewards have social significance and are highly esteemed objects, but what does their ownership signify to others? Prior work has demonstrated it may be possible for these rewards to spread their status to those who possess them, such that individuals gain or lose status and influence by virtue of the rewards they display. Yet, is this spread enough to produce entirely new status characteristics by virtue of their association with rewards? I propose a theoretical extension of the spread of status value theory and offer an experimental test considering whether the status value conveyed by rewards spreads to a new, nominal characteristic of those who come to possess these objects. The results indicate that states of a nominal characteristic do gain or lose status value and behavioral influence through their association with differentially valued rewards. Thus, rewards can create new status characteristics with resulting behavioral expectations. Copyright © 2016 Elsevier Inc. All rights reserved.

Reward alters the perception of time.

PubMed

Failing, Michel; Theeuwes, Jan

2016-03-01

Recent findings indicate that monetary rewards have a powerful effect on cognitive performance. In order to maximize overall gain, the prospect of earning reward biases visual attention to specific locations or stimulus features improving perceptual sensitivity and processing. The question we addressed in this study is whether the prospect of reward also affects the subjective perception of time. Here, participants performed a prospective timing task using temporal oddballs. The results show that temporal oddballs, displayed for varying durations, presented in a sequence of standard stimuli were perceived to last longer when they signaled a relatively high reward compared to when they signaled no or low reward. When instead of the oddball the standards signaled reward, the perception of the temporal oddball remained unaffected. We argue that by signaling reward, a stimulus becomes subjectively more salient thereby modulating its attentional deployment and distorting how it is perceived in time. Copyright © 2015 Elsevier B.V. All rights reserved.

Consolidation power of extrinsic rewards: reward cues enhance long-term memory for irrelevant past events.

PubMed

Murayama, Kou; Kitagami, Shinji

2014-02-01

Recent research suggests that extrinsic rewards promote memory consolidation through dopaminergic modulation processes. However, no conclusive behavioral evidence exists given that the influence of extrinsic reward on attention and motivation during encoding and consolidation processes are inherently confounded. The present study provides behavioral evidence that extrinsic rewards (i.e., monetary incentives) enhance human memory consolidation independently of attention and motivation. Participants saw neutral pictures, followed by a reward or control cue in an unrelated context. Our results (and a direct replication study) demonstrated that the reward cue predicted a retrograde enhancement of memory for the preceding neutral pictures. This retrograde effect was observed only after a delay, not immediately upon testing. An additional experiment showed that emotional arousal or unconscious resource mobilization cannot explain the retrograde enhancement effect. These results provide support for the notion that the dopaminergic memory consolidation effect can result from extrinsic reward.

The effects of oxytocin on social reward learning in humans.

PubMed

Clark-Elford, Rebecca; Nathan, Pradeep J; Auyeung, Bonnie; Voon, Valerie; Sule, Akeem; Müller, Ulrich; Dudas, Robert; Sahakian, Barbara J; Phan, K Luan; Baron-Cohen, Simon

2014-02-01

It has been hypothesised that the mechanisms modulating social affiliation are regulated by reward circuitry. Oxytocin, previously shown to support affiliative behaviour and the processing of socio-emotional stimuli, is expressed in areas of the brain involved in reward and motivation. However, limited data are available that test if oxytocin is directly involved in reward learning, or whether oxytocin can modulate the effect of emotion on reward learning. In a double-blind, randomised, placebo-controlled, within-group study design, 24 typical male volunteers were administered 24 IU of oxytocin or placebo and subsequently completed an affective reward learning task. Oxytocin selectively reduced performance of learning rewards, but not losses, from happy faces. The mechanism by which oxytocin may be exerting this effect is discussed in terms of whether oxytocin is affecting identity recognition via affecting the salience of happy faces. We conclude that oxytocin detrimentally affects learning rewards from happy faces in certain contexts.

Strategic attention deployment for delay of gratification in working and waiting situations.

PubMed

Peake, Philip K; Mischel, Walter; Hebl, Michelle

2002-03-01

Two studies examined whether the detrimental effects of attention to rewards on delay of gratification in waiting situations holds-or reverses-in working situations. In Study 1, preschoolers waited or worked for desired delayed rewards. Delay times increased when children worked in the presence of rewards but, as predicted, this increase was due to the distraction provided by the work itself. not because attention to rewards motivated children to sustain work. Analysis of spontaneous attention deployment showed that attending to rewards reduces delay time regardless of the working or waiting nature of the task. Fixing attention on rewards was a particularly detrimental strategy regardless of the type of task. Study 2 showed that when the work is not engaging, however, attention to rewards can motivate instrumental work and facilitate delay of gratification as long as attention deployment does not become fixed on the rewards.

Neural correlates of reward processing in healthy siblings of patients with schizophrenia

PubMed Central

Hanssen, Esther; van der Velde, Jorien; Gromann, Paula M.; Shergill, Sukhi S.; de Haan, Lieuwe; Bruggeman, Richard; Krabbendam, Lydia; Aleman, André; van Atteveldt, Nienke

2015-01-01

Deficits in motivational behavior and psychotic symptoms often observed in schizophrenia (SZ) may be driven by dysfunctional reward processing (RP). RP can be divided in two different stages; reward anticipation and reward consumption. Aberrant processing during reward anticipation seems to be related to SZ. Studies in patients with SZ have found less activation in the ventral striatum (VS) during anticipation of reward, but these findings do not provide information on effect of the genetic load on reward processing. Therefore, this study investigated RP in healthy first-degree relatives of SZ patients. The sample consisted of 94 healthy siblings of SZ patients and 57 healthy controls. Participants completed a classic RP task, the Monetary Incentive Delay task, during functional magnetic resonance imaging (fMRI). As expected, there were no behavioral differences between groups. In contrast to our expectations, we found no differences in any of the anticipatory reward related brain areas (region of interest analyses). Whole-brain analyses did reveal group differences during both reward anticipation and reward consumption; during reward anticipation siblings showed less deactivation in the insula, posterior cingulate cortex (PCC) and medial frontal gyrus (MFG) than controls. During reward consumption siblings showed less deactivation in the PCC and the right MFG compared to controls and activation in contrast to deactivation in controls in the precuneus and the left MFG. Exclusively in siblings, MFG activity correlated positively with subclinical negative symptoms. These regions are typically associated with the default mode network (DMN), which normally shows decreases in activation during task-related cognitive processes. Thus, in contrast to prior literature in patients with SZ, the results do not point to altered brain activity in classical RP brain areas, such as the VS. However, the weaker deactivation found outside the reward-related network in siblings could indicate reduced task-related suppression (i.e., hyperactivation) of the DMN. The presence of DMN hyperactivation during reward anticipation and reward consumption might indicate that siblings of patients with SZ have a higher baseline level of DMN activation and possible abnormal network functioning. PMID:26441601

Amygdala Contributions to Stimulus-Reward Encoding in the Macaque Medial and Orbital Frontal Cortex during Learning.

PubMed

Rudebeck, Peter H; Ripple, Joshua A; Mitz, Andrew R; Averbeck, Bruno B; Murray, Elisabeth A

2017-02-22

Orbitofrontal cortex (OFC), medial frontal cortex (MFC), and amygdala mediate stimulus-reward learning, but the mechanisms through which they interact are unclear. Here, we investigated how neurons in macaque OFC and MFC signaled rewards and the stimuli that predicted them during learning with and without amygdala input. Macaques performed a task that required them to evaluate two stimuli and then choose one to receive the reward associated with that option. Four main findings emerged. First, amygdala lesions slowed the acquisition and use of stimulus-reward associations. Further analyses indicated that this impairment was due, at least in part, to ineffective use of negative feedback to guide subsequent decisions. Second, the activity of neurons in OFC and MFC rapidly evolved to encode the amount of reward associated with each stimulus. Third, amygdalectomy reduced encoding of stimulus-reward associations during the evaluation of different stimuli. Reward encoding of anticipated and received reward after choices were made was not altered. Fourth, amygdala lesions led to an increase in the proportion of neurons in MFC, but not OFC, that encoded the instrumental response that monkeys made on each trial. These correlated changes in behavior and neural activity after amygdala lesions strongly suggest that the amygdala contributes to the ability to learn stimulus-reward associations rapidly by shaping encoding within OFC and MFC. SIGNIFICANCE STATEMENT Altered functional interactions among orbital frontal cortex (OFC), medial frontal cortex (MFC), and amygdala are thought to underlie several psychiatric conditions, many related to reward learning. Here, we investigated the causal contribution of the amygdala to the development of neuronal activity in macaque OFC and MFC related to rewards and the stimuli that predict them during learning. Without amygdala inputs, neurons in both OFC and MFC showed decreased encoding of stimulus-reward associations. MFC also showed increased encoding of the instrumental responses that monkeys made on each trial. Behaviorally, changes in neural activity were accompanied by slower stimulus-reward learning. The findings suggest that interactions among amygdala, OFC, and MFC contribute to learning about stimuli that predict rewards. Copyright © 2017 the authors 0270-6474/17/372186-17$15.00/0.

Orbitofrontal Cortex Signals Expected Outcomes with Predictive Codes When Stable Contingencies Promote the Integration of Reward History

PubMed Central

Shapiro, Matthew L.

2017-01-01

Memory can inform goal-directed behavior by linking current opportunities to past outcomes. The orbitofrontal cortex (OFC) may guide value-based responses by integrating the history of stimulus–reward associations into expected outcomes, representations of predicted hedonic value and quality. Alternatively, the OFC may rapidly compute flexible “online” reward predictions by associating stimuli with the latest outcome. OFC neurons develop predictive codes when rats learn to associate arbitrary stimuli with outcomes, but the extent to which predictive coding depends on most recent events and the integrated history of rewards is unclear. To investigate how reward history modulates OFC activity, we recorded OFC ensembles as rats performed spatial discriminations that differed only in the number of rewarded trials between goal reversals. The firing rate of single OFC neurons distinguished identical behaviors guided by different goals. When >20 rewarded trials separated goal switches, OFC ensembles developed stable and anticorrelated population vectors that predicted overall choice accuracy and the goal selected in single trials. When <10 rewarded trials separated goal switches, OFC population vectors decorrelated rapidly after each switch, but did not develop anticorrelated firing patterns or predict choice accuracy. The results show that, whereas OFC signals respond rapidly to contingency changes, they predict choices only when reward history is relatively stable, suggesting that consecutive rewarded episodes are needed for OFC computations that integrate reward history into expected outcomes. SIGNIFICANCE STATEMENT Adapting to changing contingencies and making decisions engages the orbitofrontal cortex (OFC). Previous work shows that OFC function can either improve or impair learning depending on reward stability, suggesting that OFC guides behavior optimally when contingencies apply consistently. The mechanisms that link reward history to OFC computations remain obscure. Here, we examined OFC unit activity as rodents performed tasks controlled by contingencies that varied reward history. When contingencies were stable, OFC neurons signaled past, present, and pending events; when contingencies were unstable, past and present coding persisted, but predictive coding diminished. The results suggest that OFC mechanisms require stable contingencies across consecutive episodes to integrate reward history, represent predicted outcomes, and inform goal-directed choices. PMID:28115481

Amygdala Contributions to Stimulus–Reward Encoding in the Macaque Medial and Orbital Frontal Cortex during Learning

PubMed Central

Averbeck, Bruno B.

2017-01-01

Orbitofrontal cortex (OFC), medial frontal cortex (MFC), and amygdala mediate stimulus–reward learning, but the mechanisms through which they interact are unclear. Here, we investigated how neurons in macaque OFC and MFC signaled rewards and the stimuli that predicted them during learning with and without amygdala input. Macaques performed a task that required them to evaluate two stimuli and then choose one to receive the reward associated with that option. Four main findings emerged. First, amygdala lesions slowed the acquisition and use of stimulus–reward associations. Further analyses indicated that this impairment was due, at least in part, to ineffective use of negative feedback to guide subsequent decisions. Second, the activity of neurons in OFC and MFC rapidly evolved to encode the amount of reward associated with each stimulus. Third, amygdalectomy reduced encoding of stimulus–reward associations during the evaluation of different stimuli. Reward encoding of anticipated and received reward after choices were made was not altered. Fourth, amygdala lesions led to an increase in the proportion of neurons in MFC, but not OFC, that encoded the instrumental response that monkeys made on each trial. These correlated changes in behavior and neural activity after amygdala lesions strongly suggest that the amygdala contributes to the ability to learn stimulus–reward associations rapidly by shaping encoding within OFC and MFC. SIGNIFICANCE STATEMENT Altered functional interactions among orbital frontal cortex (OFC), medial frontal cortex (MFC), and amygdala are thought to underlie several psychiatric conditions, many related to reward learning. Here, we investigated the causal contribution of the amygdala to the development of neuronal activity in macaque OFC and MFC related to rewards and the stimuli that predict them during learning. Without amygdala inputs, neurons in both OFC and MFC showed decreased encoding of stimulus–reward associations. MFC also showed increased encoding of the instrumental responses that monkeys made on each trial. Behaviorally, changes in neural activity were accompanied by slower stimulus–reward learning. The findings suggest that interactions among amygdala, OFC, and MFC contribute to learning about stimuli that predict rewards. PMID:28123082

Hedonic and incentive signals for body weight control.

PubMed

Egecioglu, Emil; Skibicka, Karolina P; Hansson, Caroline; Alvarez-Crespo, Mayte; Friberg, P Anders; Jerlhag, Elisabet; Engel, Jörgen A; Dickson, Suzanne L

2011-09-01

Here we review the emerging neurobiological understanding of the role of the brain's reward system in the regulation of body weight in health and in disease. Common obesity is characterized by the over-consumption of palatable/rewarding foods, reflecting an imbalance in the relative importance of hedonic versus homeostatic signals. The popular 'incentive salience theory' of food reward recognises not only a hedonic/pleasure component ('liking') but also an incentive motivation component ('wanting' or 'reward-seeking'). Central to the neurobiology of the reward mechanism is the mesoaccumbal dopamine system that confers incentive motivation not only for natural rewards such as food but also by artificial rewards (eg. addictive drugs). Indeed, this mesoaccumbal dopamine system receives and integrates information about the incentive (rewarding) value of foods with information about metabolic status. Problematic over-eating likely reflects a changing balance in the control exerted by hypothalamic versus reward circuits and/or it could reflect an allostatic shift in the hedonic set point for food reward. Certainly, for obesity to prevail, metabolic satiety signals such as leptin and insulin fail to regain control of appetitive brain networks, including those involved in food reward. On the other hand, metabolic control could reflect increased signalling by the stomach-derived orexigenic hormone, ghrelin. We have shown that ghrelin activates the mesoaccumbal dopamine system and that central ghrelin signalling is required for reward from both chemical drugs (eg alcohol) and also from palatable food. Future therapies for problematic over-eating and obesity may include drugs that interfere with incentive motivation, such as ghrelin antagonists.

Hunger does not motivate reward in women remitted from anorexia nervosa

PubMed Central

Wierenga, Christina E.; Bischoff-Grethe, Amanda; Melrose, A. James; Irvine, Zoe; Torres, Laura; Bailer, Ursula F.; Simmons, Alan; Fudge, Julie L.; McClure, Samuel M.; Ely, Alice; Kaye, Walter H.

2014-01-01

Background Hunger enhances sensitivity to reward, yet individuals with anorexia nervosa (AN) are not motivated to eat when starved. This study examined whether diminished response to reward could underlie food restriction in AN by investigating brain response to rewards during hunger and satiated states. Methods Using a delay discounting monetary decision task known to discriminate brain regions contributing to processing of immediate rewards and cognitive control important for decision making regarding future rewards, we compared 23 adults remitted from AN (to reduce the confounding effects of starvation [RAN]) to 17 healthy women (CW). Monetary rewards were used because the rewarding value of food may be confounded by anxiety in AN. Results Interactions of group (RAN, CW) × visit (hunger, satiety) revealed that, for CW, hunger significantly increased activation in reward salience circuitry (ventral striatum, dorsal caudate, anterior cingulate cortex) during processing of immediate reward, whereas satiety increased activation in cognitive control circuitry (ventrolateral prefrontal cortex, insula) during decision-making. In contrast, brain response in reward and cognitive neurocircuitry did not differ during hunger and satiety in RAN. A main effect of group revealed elevated response in the middle frontal gyrus for RAN. Conclusions RAN failed to increase activation of reward valuation circuitry when hungry and showed elevated response in cognitive control circuitry independent of metabolic state. Decreased sensitivity to hunger’s motivational drive may explain AN individuals’ ability to restrict food when emaciated. Moreover, difficulties in valuating emotional salience may contribute to inabilities to appreciate the risks inherent in this deadly disorder. PMID:25481622

Integration of homeostatic signaling and food reward processing in the human brain.

PubMed

Simon, Joe J; Wetzel, Anne; Sinno, Maria Hamze; Skunde, Mandy; Bendszus, Martin; Preissl, Hubert; Enck, Paul; Herzog, Wolfgang; Friederich, Hans-Christoph

2017-08-03

Food intake is guided by homeostatic needs and by the reward value of food, yet the exact relation between the two remains unclear. The aim of this study was to investigate the influence of different metabolic states and hormonal satiety signaling on responses in neural reward networks. Twenty-three healthy participants underwent functional magnetic resonance imaging while performing a task distinguishing between the anticipation and the receipt of either food- or monetary-related reward. Every participant was scanned twice in a counterbalanced fashion, both during a fasted state (after 24 hours fasting) and satiety. A functional connectivity analysis was performed to investigate the influence of satiety signaling on activation in neural reward networks. Blood samples were collected to assess hormonal satiety signaling. Fasting was associated with sensitization of the striatal reward system to the anticipation of food reward irrespective of reward magnitude. Furthermore, during satiety, individual ghrelin levels were associated with increased neural processing during the expectation of food-related reward. Our findings show that physiological hunger stimulates food consumption by specifically increasing neural processing during the expectation (i.e., incentive salience) but not the receipt of food-related reward. In addition, these findings suggest that ghrelin signaling influences hedonic-driven food intake by increasing neural reactivity during the expectation of food-related reward. These results provide insights into the neurobiological underpinnings of motivational processing and hedonic evaluation of food reward. ClinicalTrials.gov NCT03081585. This work was supported by the German Competence Network on Obesity, which is funded by the German Federal Ministry of Education and Research (FKZ 01GI1122E).

Motivation and effort in individuals with social anhedonia.

PubMed

McCarthy, Julie M; Treadway, Michael T; Blanchard, Jack J

2015-06-01

It has been proposed that anhedonia may, in part, reflect difficulties in reward processing and effortful decision making. The current study aimed to replicate previous findings of effortful decision making deficits associated with elevated anhedonia and expand upon these findings by investigating whether these decision making deficits are specific to elevated social anhedonia or are also associated with elevated positive schizotypy characteristics. The current study compared controls (n=40) to individuals elevated on social anhedonia (n=30), and individuals elevated on perceptual aberration/magical ideation (n=30) on the Effort Expenditure for Rewards Task (EEfRT). Across groups, participants chose a higher proportion of hard tasks with increasing probability of reward and reward magnitude, demonstrating sensitivity to probability and reward values. Contrary to our expectations, when the probability of reward was most uncertain (50% probability), at low and medium reward values, the social anhedonia group demonstrated more effortful decision making than either individuals high in positive schizotypy or controls. The positive schizotypy group only differed from controls (making less effortful choices than controls) when reward probability was lowest (12%) and the magnitude of reward was the smallest. Our results suggest that social anhedonia is related to intact motivation and effort for monetary rewards, but that individuals with this characteristic display a unique and perhaps inefficient pattern of effort allocation when the probability of reward is most uncertain. Future research is needed to better understand effortful decision making and the processing of reward across a range of individual difference characteristics. Copyright © 2015 Elsevier B.V. All rights reserved.

A universal role of the ventral striatum in reward-based learning: Evidence from human studies

PubMed Central

Daniel, Reka; Pollmann, Stefan

2014-01-01

Reinforcement learning enables organisms to adjust their behavior in order to maximize rewards. Electrophysiological recordings of dopaminergic midbrain neurons have shown that they code the difference between actual and predicted rewards, i.e., the reward prediction error, in many species. This error signal is conveyed to both the striatum and cortical areas and is thought to play a central role in learning to optimize behavior. However, in human daily life rewards are diverse and often only indirect feedback is available. Here we explore the range of rewards that are processed by the dopaminergic system in human participants, and examine whether it is also involved in learning in the absence of explicit rewards. While results from electrophysiological recordings in humans are sparse, evidence linking dopaminergic activity to the metabolic signal recorded from the midbrain and striatum with functional magnetic resonance imaging (fMRI) is available. Results from fMRI studies suggest that the human ventral striatum (VS) receives valuation information for a diverse set of rewarding stimuli. These range from simple primary reinforcers such as juice rewards over abstract social rewards to internally generated signals on perceived correctness, suggesting that the VS is involved in learning from trial-and-error irrespective of the specific nature of provided rewards. In addition, we summarize evidence that the VS can also be implicated when learning from observing others, and in tasks that go beyond simple stimulus-action-outcome learning, indicating that the reward system is also recruited in more complex learning tasks. PMID:24825620

International survey of nephrologists' perceptions and attitudes about rewards and compensations for kidney donation.

PubMed

Ghahramani, Nasrollah; Karparvar, Zahra; Ghahramani, Mehrdad; Shadrou, Shahrouz

2013-06-01

Payment for organ donation, whether in the form of incentives, rewards or compensation is highly debated and has been denounced by many professional and legislative bodies. Despite the passionate discussion in the literature, there is very limited data on attitudes and perceptions of physicians about providing rewards or compensation to organ donors. We investigated the relationship between demographic and practice characteristics of nephrologists and their perceptions and attitudes about rewards and compensations for organ donation. Using a web-based survey, we explored the views of nephrologists around the world about rewards and compensations for kidney donation. The relationship between attitudes and demographic characteristics of 1280 nephrologists from 74 countries was examined by univariate and multivariable analyses. Seventy-five percent agreed with donor health insurance, 26% favored direct financial compensation and 31% agreed with financial rewards for unrelated donors. Sixty-six percent believed that rewards will lead to increased donation. Seventy-three percent indicated that rewards will lead to exploitation of the poor and 78% agreed with legislation prohibiting organ sales. Thirty-seven percent believed that rewards will negatively impact deceased-donor transplantation. Nephrologists from India/Pakistan and the Middle East had more favorable views about rewards, while respondents from Latin America and Europe, older than 50, female nephrologists and those practicing in rural areas had less favorable views. We conclude that a minority of nephrologists favor rewards for donation, many agree with some compensation and a considerable majority favor donor health insurance. Perceptions of nephrologists about rewards and compensation are influenced by age, sex, urban versus rural location and geographic region of practice.

Sample path analysis of contribution and reward in cooperative groups.

PubMed

Toyoizumi, Hiroshi

2009-02-07

Explaining cooperative behavior is one of the major challenges in both biology and human society. The individual reward in cooperative group depends on how we share the rewards in the group. Thus, the group size dynamics in a cooperative group and reward-allocation rule seem essential to evaluate the emergence of cooperative groups. We apply a sample path-based analysis called an extension of Little's formula to general cooperative group. We show that the expected reward is insensitive to the specific reward-allocation rule and probabilistic structure of group dynamics, and the simple productivity condition guarantees the expected reward to be larger than the average contribution. As an example, we take social queues to see the insensitivity result in detail.

Ventral striatal activity links adversity and reward processing in children.

PubMed

Kamkar, Niki H; Lewis, Daniel J; van den Bos, Wouter; Morton, J Bruce

2017-08-01

Adversity impacts many aspects of psychological and physical development including reward-based learning and decision-making. Mechanisms relating adversity and reward processing in children, however, remain unclear. Here, we show that adversity is associated with potentiated learning from positive outcomes and impulsive decision-making, but unrelated to learning from negative outcomes. We then show via functional magnetic resonance imaging that the link between adversity and reward processing is partially mediated by differences in ventral striatal response to rewards. The findings suggest that early-life adversity is associated with alterations in the brain's sensitivity to rewards accounting, in part, for the link between adversity and altered reward processing in children. Copyright © 2017 The Authors. Published by Elsevier Ltd.. All rights reserved.

Reward from bugs to bipeds: a comparative approach to understanding how reward circuits function

PubMed Central

Scaplen, Kristin M.; Kaun, Karla R.

2016-01-01

Abstract In a complex environment, animals learn from their responses to stimuli and events. Appropriate response to reward and punishment can promote survival, reproduction and increase evolutionary fitness. Interestingly, the neural processes underlying these responses are remarkably similar across phyla. In all species, dopamine is central to encoding reward and directing motivated behaviors, however, a comprehensive understanding of how circuits encode reward and direct motivated behaviors is still lacking. In part, this is a result of the sheer diversity of neurons, the heterogeneity of their responses and the complexity of neural circuits within which they are found. We argue that general features of reward circuitry are common across model organisms, and thus principles learned from invertebrate model organisms can inform research across species. In particular, we discuss circuit motifs that appear to be functionally equivalent from flies to primates. We argue that a comparative approach to studying and understanding reward circuit function provides a more comprehensive understanding of reward circuitry, and informs disorders that affect the brain’s reward circuitry. PMID:27328845

An experimental examination of the effort-reward imbalance model of occupational stress: Increased financial reward is related to reduced stress physiology.

PubMed

Landolt, Kathleen; O'Donnell, Emma; Hazi, Agnes; Dragano, Nico; Wright, Bradley J

2017-04-01

Effort-reward imbalance in the workplace is linked to a variety of negative health and organisational outcomes, but it has rarely been assessed experimentally. We manipulated reward (while keeping effort constant) in a within-subjects design with female participants (N=60) who were randomly assigned to high and standard reward conditions within a simulated office environment. Self-report, behavioural (task performance), and physiological (heart rate variability, salivary alpha amylase) measures assessed the impact of increased financial reward. Participants reported increased perceptions of reward, performed moderately better on the task, and were less physiologically reactive in the high reward versus the standard condition. These findings highlight the importance of assessing both subjective self-reports of stress together with objective physiological measures of stress, and suggest that increasing monetary rewards has the potential to decrease stress physiological reactivity, and in turn, reduce the risk of ill-health in employees, and may also positively influence task efficacy. Copyright © 2017 Elsevier B.V. All rights reserved.

Social and monetary reward learning engage overlapping neural substrates.

PubMed

Lin, Alice; Adolphs, Ralph; Rangel, Antonio

2012-03-01

Learning to make choices that yield rewarding outcomes requires the computation of three distinct signals: stimulus values that are used to guide choices at the time of decision making, experienced utility signals that are used to evaluate the outcomes of those decisions and prediction errors that are used to update the values assigned to stimuli during reward learning. Here we investigated whether monetary and social rewards involve overlapping neural substrates during these computations. Subjects engaged in two probabilistic reward learning tasks that were identical except that rewards were either social (pictures of smiling or angry people) or monetary (gaining or losing money). We found substantial overlap between the two types of rewards for all components of the learning process: a common area of ventromedial prefrontal cortex (vmPFC) correlated with stimulus value at the time of choice and another common area of vmPFC correlated with reward magnitude and common areas in the striatum correlated with prediction errors. Taken together, the findings support the hypothesis that shared anatomical substrates are involved in the computation of both monetary and social rewards. © The Author (2011). Published by Oxford University Press.

Distinct Motivational Effects of Contingent and Noncontingent Rewards

PubMed Central

Manohar, Sanjay G.; Finzi, Rebecca Dawn; Drew, Daniel; Husain, Masud

2017-01-01

When rewards are available, people expend more energy, increasing their motivational vigor. In theory, incentives might drive behavior for two distinct reasons: First, they increase expected reward; second, they increase the difference in subjective value between successful and unsuccessful performance, which increases contingency—the degree to which action determines outcome. Previous studies of motivational vigor have never compared these directly. Here, we indexed motivational vigor by measuring the speed of eye movements toward a target after participants heard a cue indicating how outcomes would be determined. Eye movements were faster when the cue indicated that monetary rewards would be contingent on performance than when the cue indicated that rewards would be random. But even when the cue indicated that a reward was guaranteed regardless of speed, movement was still faster than when no reward was available. Motivation by contingent and certain rewards was uncorrelated across individuals, which suggests that there are two separable, independent components of motivation. Contingent motivation generated autonomic arousal, and unlike noncontingent motivation, was effective with penalties as well as rewards. PMID:28488927

The rat's not for turning: Dissociating the psychological components of cognitive inflexibility☆

PubMed Central

Nilsson, Simon R.O.; Alsiö, Johan; Somerville, Elizabeth M.; Clifton, Peter G.

2015-01-01

Executive function is commonly assessed by assays of cognitive flexibility such as reversal learning and attentional set-shifting. Disrupted performance in these assays, apparent in many neuropsychiatric disorders, is frequently interpreted as inability to overcome prior associations with reward. However, non-rewarded or irrelevant associations may be of considerable importance in both discrimination learning and cognitive flexibility. Non-rewarded associations can have greater influence on choice behaviour than rewarded associations in discrimination learning. Pathology-related deficits in cognitive flexibility can produce selective disruptions to both the processing of irrelevant associations and associations with reward. Genetic and pharmacological animal models demonstrate that modulation of reversal learning may result from alterations in either rewarded or non-rewarded associations. Successful performance in assays of cognitive flexibility can therefore depend on a combination of rewarded, non-rewarded, and irrelevant associations derived from previous learning, accounting for some inconsistencies observed in the literature. Taking this combination into account may increase the validity of animal models and may also reveal pathology-specific differences in problem solving and executive function. PMID:26112128

The effects of non-contingent extrinsic and intrinsic rewards on memory consolidation.

PubMed

Nielson, Kristy A; Bryant, Ted

2005-07-01

Emotional and arousing treatments given shortly after learning enhance delayed memory retrieval in animal and human studies. Positive affect and reward induced prior to a variety of cognitive tasks enhance performance, but their ability to affect memory consolidation has not been investigated before. Therefore, we investigated the effects of a small, non-contingent, intrinsic or extrinsic reward on delayed memory retrieval. Participants (n=108) studied and recalled a list of 30 affectively neutral, imageable nouns. Experimental groups were then given either an intrinsic reward (e.g., praise) or an extrinsic reward (e.g., US 1 dollar). After a one-week delay, participants' retrieval performance for the word list was significantly better in the extrinsic reward groups, whether the reward was expected or not, than in controls. Those who received the intrinsic reward performed somewhat better than controls, but the difference was not significant. Thus, at least some forms of arousal and reward, even when semantically unrelated to the learned material, can effectively modulate memory consolidation. These types of treatments might be useful for the development of new memory intervention strategies.

Post-learning hippocampal dynamics promote preferential retention of rewarding events

PubMed Central

Gruber, Matthias J.; Ritchey, Maureen; Wang, Shao-Fang; Doss, Manoj K.; Ranganath, Charan

2016-01-01

Reward motivation is known to modulate memory encoding, and this effect depends on interactions between the substantia nigra/ ventral tegmental area complex (SN/VTA) and the hippocampus. It is unknown, however, whether these interactions influence offline neural activity in the human brain that is thought to promote memory consolidation. Here, we used functional magnetic resonance imaging (fMRI) to test the effect of reward motivation on post-learning neural dynamics and subsequent memory for objects that were learned in high- or low-reward motivation contexts. We found that post-learning increases in resting-state functional connectivity between the SN/VTA and hippocampus predicted preferential retention of objects that were learned in high-reward contexts. In addition, multivariate pattern classification revealed that hippocampal representations of high-reward contexts were preferentially reactivated during post-learning rest, and the number of hippocampal reactivations was predictive of preferential retention of items learned in high-reward contexts. These findings indicate that reward motivation alters offline post-learning dynamics between the SN/VTA and hippocampus, providing novel evidence for a potential mechanism by which reward could influence memory consolidation. PMID:26875624

Neural Reward and Punishment Sensitivity in Cigarette Smokers

PubMed Central

Potts, Geoffrey F.; Bloom, Erika; Evans, David E.; Drobes, David J.

2014-01-01

Background Nicotine addiction remains a major public health problem but the neural substrates of addictive behavior remain unknown. One characteristic of smoking behavior is impulsive choice, selecting the immediate reward of smoking despite the potential long-term negative consequences. This suggests that drug users, including cigarette smokers, may be more sensitive to rewards and less sensitive to punishment. Methods We used event-related potentials (ERPs) to test the hypothesis that smokers are more responsive to reward signals and less responsive to punishment, potentially predisposing them to risky behavior. We conducted two experiments, one using a reward prediction design to elicit a Medial Frontal Negativity (MFN) and one using a reward- and punishment-motivated flanker task to elicit an Error Related Negativity (ERN), ERP components thought to index activity in the cortical projection of the dopaminergic reward system. Results and Conclusions The smokers had a greater MFN response to unpredicted rewards, and non-smokers, but not smokers, had a larger ERN on punishment motivated trials indicating that smokers are more reward sensitive and less punishment sensitive than nonsmokers, overestimating the appetitive value and underestimating aversive outcomes of stimuli and actions. PMID:25292454

The influence of trial order on learning from reward vs. punishment in a probabilistic categorization task: experimental and computational analyses

PubMed Central

Moustafa, Ahmed A.; Gluck, Mark A.; Herzallah, Mohammad M.; Myers, Catherine E.

2015-01-01

Previous research has shown that trial ordering affects cognitive performance, but this has not been tested using category-learning tasks that differentiate learning from reward and punishment. Here, we tested two groups of healthy young adults using a probabilistic category learning task of reward and punishment in which there are two types of trials (reward, punishment) and three possible outcomes: (1) positive feedback for correct responses in reward trials; (2) negative feedback for incorrect responses in punishment trials; and (3) no feedback for incorrect answers in reward trials and correct answers in punishment trials. Hence, trials without feedback are ambiguous, and may represent either successful avoidance of punishment or failure to obtain reward. In Experiment 1, the first group of subjects received an intermixed task in which reward and punishment trials were presented in the same block, as a standard baseline task. In Experiment 2, a second group completed the separated task, in which reward and punishment trials were presented in separate blocks. Additionally, in order to understand the mechanisms underlying performance in the experimental conditions, we fit individual data using a Q-learning model. Results from Experiment 1 show that subjects who completed the intermixed task paradoxically valued the no-feedback outcome as a reinforcer when it occurred on reinforcement-based trials, and as a punisher when it occurred on punishment-based trials. This is supported by patterns of empirical responding, where subjects showed more win-stay behavior following an explicit reward than following an omission of punishment, and more lose-shift behavior following an explicit punisher than following an omission of reward. In Experiment 2, results showed similar performance whether subjects received reward-based or punishment-based trials first. However, when the Q-learning model was applied to these data, there were differences between subjects in the reward-first and punishment-first conditions on the relative weighting of neutral feedback. Specifically, early training on reward-based trials led to omission of reward being treated as similar to punishment, but prior training on punishment-based trials led to omission of reward being treated more neutrally. This suggests that early training on one type of trials, specifically reward-based trials, can create a bias in how neutral feedback is processed, relative to those receiving early punishment-based training or training that mixes positive and negative outcomes. PMID:26257616

Cues Produced by Reward and Nonreward and Temporal Cues Influence Responding in the Intertrial Interval and to the Conditioned Stimulus

ERIC Educational Resources Information Center

Capaldi, E. J.; Martins, Ana; Miller, Ronald M.

2007-01-01

Rats in a Pavlovian situation were trained under three different reward schedules, at either a 30 s or a 90 s intertrial interval (ITI): Consistent reward (C), 50% irregular reward (I), and single alternation of reward and nonrewarded trials (SA). Activity was recorded to the conditioned stimulus (CS) and in all 10 s bins in each ITI except the…

Reward circuitry in resilience to severe trauma: An fMRI investigation of resilient special forces soldiers

PubMed Central

Vythilingam, Meena; Nelson, Eric E.; Scaramozza, Matthew; Waldeck, Tracy; Hazlett, Gary; Southwick, Steven M.; Pine, Daniel S.; Drevets, Wayne; Charney, Dennis S.; Ernst, Monique

2008-01-01

Enhanced brain reward function could contribute to resilience to trauma. Reward circuitry in active duty, resilient special forces (SF) soldiers was evaluated using fMRI during a monetary incentive delay task. Findings in this group of resilient individuals revealed unique patterns of activation during expectation of reward in the subgenual prefrontal cortex and nucleus accumbens area; regions pivotal to reward processes. PMID:19243926

Weak reward source memory in depression reflects blunted activation of VTA/SN and parahippocampus

PubMed Central

Dobbins, Ian G.; Pizzagalli, Diego A.

2014-01-01

Reward responses in the medial temporal lobes and dopaminergic midbrain boost episodic memory formation in healthy adults, and weak memory for emotionally positive material in depression suggests this mechanism may be dysfunctional in major depressive disorder (MDD). To test this hypothesis, we performed a study in which unmedicated adults with MDD and healthy controls encoded drawings paired with reward or zero tokens during functional magnetic resonance imaging. In a recognition test, participants judged whether drawings were previously associated with the reward token (‘reward source’) or the zero token (‘zero source’). Unlike controls, depressed participants failed to show better memory for drawings from the reward source vs the zero source. Consistent with predictions, controls also showed a stronger encoding response to reward tokens vs zero tokens in the right parahippocampus and dopaminergic midbrain, whereas the MDD group showed the opposite pattern—stronger responses to zero vs reward tokens—in these regions. Differential activation of the dopaminergic midbrain by reward vs zero tokens was positively correlated with the reward source memory advantage in controls, but not depressed participants. These data suggest that weaker memory for positive material in depression reflects blunted encoding responses in the dopaminergic midbrain and medial temporal lobes. PMID:24078019

Neural processing of reward in adolescent rodents.

PubMed

Simon, Nicholas W; Moghaddam, Bita

2015-02-01

Immaturities in adolescent reward processing are thought to contribute to poor decision making and increased susceptibility to develop addictive and psychiatric disorders. Very little is known; however, about how the adolescent brain processes reward. The current mechanistic theories of reward processing are derived from adult models. Here we review recent research focused on understanding of how the adolescent brain responds to rewards and reward-associated events. A critical aspect of this work is that age-related differences are evident in neuronal processing of reward-related events across multiple brain regions even when adolescent rats demonstrate behavior similar to adults. These include differences in reward processing between adolescent and adult rats in orbitofrontal cortex and dorsal striatum. Surprisingly, minimal age related differences are observed in ventral striatum, which has been a focal point of developmental studies. We go on to discuss the implications of these differences for behavioral traits affected in adolescence, such as impulsivity, risk-taking, and behavioral flexibility. Collectively, this work suggests that reward-evoked neural activity differs as a function of age and that regions such as the dorsal striatum that are not traditionally associated with affective processing in adults may be critical for reward processing and psychiatric vulnerability in adolescents. Copyright © 2014 The Authors. Published by Elsevier Ltd.. All rights reserved.

Fidelity of the representation of value in decision-making

PubMed Central

Dowding, Ben A.

2017-01-01

The ability to make optimal decisions depends on evaluating the expected rewards associated with different potential actions. This process is critically dependent on the fidelity with which reward value information can be maintained in the nervous system. Here we directly probe the fidelity of value representation following a standard reinforcement learning task. The results demonstrate a previously-unrecognized bias in the representation of value: extreme reward values, both low and high, are stored significantly more accurately and precisely than intermediate rewards. The symmetry between low and high rewards pertained despite substantially higher frequency of exposure to high rewards, resulting from preferential exploitation of more rewarding options. The observed variation in fidelity of value representation retrospectively predicted performance on the reinforcement learning task, demonstrating that the bias in representation has an impact on decision-making. A second experiment in which one or other extreme-valued option was omitted from the learning sequence showed that representational fidelity is primarily determined by the relative position of an encoded value on the scale of rewards experienced during learning. Both variability and guessing decreased with the reduction in the number of options, consistent with allocation of a limited representational resource. These findings have implications for existing models of reward-based learning, which typically assume defectless representation of reward value. PMID:28248958

Gender-specific modulation of neural mechanisms underlying social reward processing by Autism Quotient

PubMed Central

Barman, Adriana; Richter, Sylvia; Soch, Joram; Deibele, Anna; Richter, Anni; Assmann, Anne; Wüstenberg, Torsten; Walter, Henrik; Seidenbecher, Constanze I.

2015-01-01

Autism spectrum disorder refers to a neurodevelopmental condition primarily characterized by deficits in social cognition and behavior. Subclinically, autistic features are supposed to be present in healthy humans and can be quantified using the Autism Quotient (AQ). Here, we investigated a potential relationship between AQ and neural correlates of social and monetary reward processing, using functional magnetic resonance imaging in young, healthy participants. In an incentive delay task with either monetary or social reward, reward anticipation elicited increased ventral striatal activation, which was more pronounced during monetary reward anticipation. Anticipation of social reward elicited activation in the default mode network (DMN), a network previously implicated in social processing. Social reward feedback was associated with bilateral amygdala and fusiform face area activation. The relationship between AQ and neural correlates of social reward processing varied in a gender-dependent manner. In women and, to a lesser extent in men, higher AQ was associated with increased posterior DMN activation during social reward anticipation. During feedback, we observed a negative correlation of AQ and right amygdala activation in men only. Our results suggest that social reward processing might constitute an endophenotype for autism-related traits in healthy humans that manifests in a gender-specific way. PMID:25944965

Informationally administered reward enhances intrinsic motivation in schizophrenia.

PubMed

Lee, Hyeon-Seung; Jang, Seon-Kyeong; Lee, Ga-Young; Park, Seon-Cheol; Medalia, Alice; Choi, Kee-Hong

2017-10-01

Even when individuals with schizophrenia have an intact ability to enjoy rewarding moments, the means to assist them to translate rewarding experiences into goal-directed behaviors is unclear. The present study sought to determine whether informationally administered rewards enhance intrinsic motivation to foster goal-directed behaviors in individuals with schizophrenia (SZ) and healthy controls (HCs). Eighty-four participants (SZ=43, HCs=41) were randomly assigned to conditions involving either a performance-contingent reward with an informationally administered reward or a task-contingent reward with no feedback. Participants were asked to play two cognitive games of equalized difficulty. Accuracy, self-reported intrinsic motivation, free-choice intrinsic motivation (i.e., game play during a free-choice observation period), and perceived competency were measured. Intrinsic motivation and perceived competency in the cognitive games were similar between the two participant groups. The informationally administered reward significantly enhanced self-reported intrinsic motivation and perceived competency in both the groups. The likelihood that individuals with schizophrenia would play the game during the free-choice observation period was four times greater in the informationally administered reward condition than that in the no-feedback condition. Our findings suggest that, in the context of cognitive remediation, individuals with schizophrenia would benefit from informationally administered rewards. Copyright © 2017 Elsevier B.V. All rights reserved.

Striatal dopaminergic modulation of reinforcement learning predicts reward-oriented behavior in daily life.

PubMed

Kasanova, Zuzana; Ceccarini, Jenny; Frank, Michael J; Amelsvoort, Thérèse van; Booij, Jan; Heinzel, Alexander; Mottaghy, Felix; Myin-Germeys, Inez

2017-07-01

Much human behavior is driven by rewards. Preclinical neurophysiological and clinical positron emission tomography (PET) studies have implicated striatal phasic dopamine (DA) release as a primary modulator of reward processing. However, the relationship between experimental reward-induced striatal DA release and responsiveness to naturalistic rewards, and therefore functional relevance of these findings, has been elusive. We therefore combined, for the first time, a DA D 2/3 receptor [ 18 F]fallypride PET during a probabilistic reinforcement learning (RL) task with a six day ecological momentary assessments (EMA) of reward-related behavior in the everyday life of 16 healthy volunteers. We detected significant reward-induced DA release in the bilateral putamen, caudate nucleus and ventral striatum, the extent of which was associated with better behavioral performance on the RL task across all regions. Furthermore, individual variability in the extent of reward-induced DA release in the right caudate nucleus and ventral striatum modulated the tendency to be actively engaged in a behavior if the active engagement was previously deemed enjoyable. This study suggests a link between striatal reward-related DA release and ecologically relevant reward-oriented behavior, suggesting an avenue for the inquiry into the DAergic basis of optimal and impaired motivational drive. Copyright © 2017 Elsevier B.V. All rights reserved.

Eveningness among late adolescent males predicts neural reactivity to reward and alcohol dependence two years later

PubMed Central

Hasler, Brant P.; Casement, Melynda D.; Sitnick, Stephanie L.; Shaw, Daniel S.; Forbes, Erika E.

2017-01-01

Eveningness, a preference for later sleep-wake timing, is linked to altered reward function, which may explain a consistent association with substance abuse. Notably, the extant literature rests largely on cross-sectional data, yet both eveningness and reward function show developmental changes. We examined whether circadian preference during late adolescence predicted the neural response to reward two years later. A sample of 93 males reported circadian preference and completed a monetary reward fMRI paradigm at ages 20 and 22. Primary analyses examined longitudinal paths from circadian preference to medial prefrontal cortex (mPFC) and ventral striatal (VS) reward responses. We also explored whether reward responses mediated longitudinal associations between circadian preference and alcohol dependence, frequency of alcohol use, and/or frequency of cannabis use. Age 20 eveningness was positively associated with age 22 mPFC and VS responses to win, but not associated with age 22 reactivity to reward anticipation. Age 20 eveningness was indirectly related to age 22 alcohol dependence via age 22 mPFC response to win. Our findings provide novel evidence that altered reward-related brain function could underlie associations between eveningness and alcohol use problems. Eveningness may be an under-recognized but modifiable risk factor for reward-related problems such as mood and substance use disorders. PMID:28254633

Rewards and creative performance: a meta-analytic test of theoretically derived hypotheses.

PubMed

Byron, Kris; Khazanchi, Shalini

2012-07-01

Although many scholars and practitioners are interested in understanding how to motivate individuals to be more creative, whether and how rewards affect creativity remain unclear. We argue that the conflicting evidence may be due to differences between studies in terms of reward conditions and the context in which rewards are offered. Specifically, we examine 5 potential moderators of the rewards-creative performance relationship: (a) the reward contingency, (b) the extent to which participants are provided information about their past or current creative performance, (c) the extent to which the reward and context offer choice or impose control, (d) the extent to which the context serves to enhance task engagement, and (e) the extent to which the performance tasks are complex. Using random-effects models, we meta-analyzed 60 experimental and nonexperimental studies (including 69 independent samples) that examined the rewards-creativity relationship with children or adults. Our results suggest that creativity-contingent rewards tend to increase creative performance-and are more positively related to creative performance when individuals are given more positive, contingent, and task-focused performance feedback and are provided more choice (and are less controlled). In contrast, performance-contingent or completion-contingent rewards tend to have a slight negative effect on creative performance.

Reward improves long-term retention of a motor memory through induction of offline memory gains.

PubMed

Abe, Mitsunari; Schambra, Heidi; Wassermann, Eric M; Luckenbaugh, Dave; Schweighofer, Nicolas; Cohen, Leonardo G

2011-04-12

In humans, training in which good performance is rewarded or bad performance punished results in transient behavioral improvements. The relative effects of reward and punishment on consolidation and long-term retention, critical behavioral stages for successful learning, are not known. Here, we investigated the effects of reward and punishment on these different stages of human motor skill learning. We studied healthy subjects who trained on a motor task under rewarded, punished, or neutral control conditions. Performance was tested before and immediately, 6 hr, 24 hr, and 30 days after training in the absence of reward or punishment. Performance improvements immediately after training were comparable in the three groups. At 6 hr, the rewarded group maintained performance gains, whereas the other two groups experienced significant forgetting. At 24 hr, the reward group showed significant offline (posttraining) improvements, whereas the other two groups did not. At 30 days, the rewarded group retained the gains identified at 24 hr, whereas the other two groups experienced significant forgetting. We conclude that training under rewarded conditions is more effective than training under punished or neutral conditions in eliciting lasting motor learning, an advantage driven by offline memory gains that persist over time. Copyright © 2011 Elsevier Ltd. All rights reserved.

Task preparation processes related to reward prediction precede those related to task-difficulty expectation

PubMed Central

Schevernels, Hanne; Krebs, Ruth M.; Santens, Patrick; Woldorff, Marty G.; Boehler, C. Nico

2013-01-01

Recently, attempts have been made to disentangle the neural underpinnings of preparatory processes related to reward and attention. Functional magnetic resonance imaging (fMRI) research showed that neural activity related to the anticipation of reward and to attentional demands invokes neural activity patterns featuring large-scale overlap, along with some differences and interactions. Due to the limited temporal resolution of fMRI, however, the temporal dynamics of these processes remain unclear. Here, we report an event-related potentials (ERP) study in which cued attentional demands and reward prospect were combined in a factorial design. Results showed that reward prediction dominated early cue processing, as well as the early and later parts of the contingent negative variation (CNV) slow-wave ERP component that has been associated with task-preparation processes. Moreover these reward-related electrophysiological effects correlated across participants with response-time speeding on reward-prospect trials. In contrast, cued attentional demands affected only the later part of the CNV, with the highest amplitudes following cues predicting high-difficulty potential-reward targets, thus suggesting maximal task preparation when the task requires it and entails reward prospect. Consequently, we suggest that task-preparation processes triggered by reward can arise earlier, and potentially more directly, than strategic top-down aspects of preparation based on attentional demands. PMID:24064071

Neural connectivity during reward expectation dissociates psychopathic criminals from non-criminal individuals with high impulsive/antisocial psychopathic traits

PubMed Central

von Borries, Katinka; Volman, Inge; Bulten, Berend Hendrik; Cools, Roshan; Verkes, Robbert-Jan

2016-01-01

Criminal behaviour poses a big challenge for society. A thorough understanding of the neurobiological mechanisms underlying criminality could optimize its prevention and management. Specifically,elucidating the neural mechanisms underpinning reward expectation might be pivotal to understanding criminal behaviour. So far no study has assessed reward expectation and its mechanisms in a criminal sample. To fill this gap, we assessed reward expectation in incarcerated, psychopathic criminals. We compared this group to two groups of non-criminal individuals: one with high levels and another with low levels of impulsive/antisocial traits. Functional magnetic resonance imaging was used to quantify neural responses to reward expectancy. Psychophysiological interaction analyses were performed to examine differences in functional connectivity patterns of reward-related regions. The data suggest that overt criminality is characterized, not by abnormal reward expectation per se, but rather by enhanced communication between reward-related striatal regions and frontal brain regions. We establish that incarcerated psychopathic criminals can be dissociated from non-criminal individuals with comparable impulsive/antisocial personality tendencies based on the degree to which reward-related brain regions interact with brain regions that control behaviour. The present results help us understand why some people act according to their impulsive/antisocial personality while others are able to behave adaptively despite reward-related urges. PMID:27217111

Intrinsic rewards, fruit and vegetable consumption, and habit strength: a three-wave study testing the associative-cybernetic model.

PubMed

Wiedemann, Amelie U; Gardner, Benjamin; Knoll, Nina; Burkert, Silke

2014-03-01

Habit formation is thought to lead to long-term maintenance of fruit and vegetable consumption. Habits develop through context-dependent repetition, but additional variables such as intrinsic reward of behaviour may influence habit strength. Drawing upon the Associative-Cybernetic Model, this exploratory study tested different pathways by which intrinsic reward may influence fruit and vegetable consumption habit strength. In a three-wave study of fruit and vegetable intake in adults (N = 127) from the general population, intrinsic reward, intention, and self-efficacy were assessed at baseline, fruit and vegetable consumption and intrinsic reward two weeks later, and habit strength another two weeks later. Direct, indirect, and moderation effects of intrinsic reward on habit strength were tested simultaneously in a moderated mediation model. Intrinsic reward had a positive indirect effect on habit strength through its influence on the frequency of fruit and vegetable consumption. Further, the relationship between fruit and vegetable consumption and habit was stronger where consumption was considered more intrinsically rewarding. Findings highlight the potential relevance of intrinsic reward to habit. We suggest that intrinsic rewards from behaviour may not only facilitate habit via behaviour frequency, but also reinforce the relationship between behavioural repetition and habit strength. © 2013 The International Association of Applied Psychology.

Enriched Encoding: Reward Motivation Organizes Cortical Networks for Hippocampal Detection of Unexpected Events

PubMed Central

Murty, Vishnu P.; Adcock, R. Alison

2014-01-01

Learning how to obtain rewards requires learning about their contexts and likely causes. How do long-term memory mechanisms balance the need to represent potential determinants of reward outcomes with the computational burden of an over-inclusive memory? One solution would be to enhance memory for salient events that occur during reward anticipation, because all such events are potential determinants of reward. We tested whether reward motivation enhances encoding of salient events like expectancy violations. During functional magnetic resonance imaging, participants performed a reaction-time task in which goal-irrelevant expectancy violations were encountered during states of high- or low-reward motivation. Motivation amplified hippocampal activation to and declarative memory for expectancy violations. Connectivity of the ventral tegmental area (VTA) with medial prefrontal, ventrolateral prefrontal, and visual cortices preceded and predicted this increase in hippocampal sensitivity. These findings elucidate a novel mechanism whereby reward motivation can enhance hippocampus-dependent memory: anticipatory VTA-cortical–hippocampal interactions. Further, the findings integrate literatures on dopaminergic neuromodulation of prefrontal function and hippocampus-dependent memory. We conclude that during reward motivation, VTA modulation induces distributed neural changes that amplify hippocampal signals and records of expectancy violations to improve predictions—a potentially unique contribution of the hippocampus to reward learning. PMID:23529005

Altered neural reward and loss processing and prediction error signalling in depression

PubMed Central

Ubl, Bettina; Kuehner, Christine; Kirsch, Peter; Ruttorf, Michaela

2015-01-01

Dysfunctional processing of reward and punishment may play an important role in depression. However, functional magnetic resonance imaging (fMRI) studies have shown heterogeneous results for reward processing in fronto-striatal regions. We examined neural responsivity associated with the processing of reward and loss during anticipation and receipt of incentives and related prediction error (PE) signalling in depressed individuals. Thirty medication-free depressed persons and 28 healthy controls performed an fMRI reward paradigm. Regions of interest analyses focused on neural responses during anticipation and receipt of gains and losses and related PE-signals. Additionally, we assessed the relationship between neural responsivity during gain/loss processing and hedonic capacity. When compared with healthy controls, depressed individuals showed reduced fronto-striatal activity during anticipation of gains and losses. The groups did not significantly differ in response to reward and loss outcomes. In depressed individuals, activity increases in the orbitofrontal cortex and nucleus accumbens during reward anticipation were associated with hedonic capacity. Depressed individuals showed an absence of reward-related PEs but encoded loss-related PEs in the ventral striatum. Depression seems to be linked to blunted responsivity in fronto-striatal regions associated with limited motivational responses for rewards and losses. Alterations in PE encoding might mirror blunted reward- and enhanced loss-related associative learning in depression. PMID:25567763

Reward loss and addiction: Opportunities for cross-pollination.

PubMed

Ortega, Leonardo A; Solano, José L; Torres, Carmen; Papini, Mauricio R

2017-03-01

Paradigms used to study the response to and consequences of exposure to reward loss have been underutilized in approaches to the psychobiology of substance use disorders. We propose here that bringing these two areas into contact will help expanding our understanding of both reward loss and addictive behavior, hence opening up opportunities for cross-pollination. This review focuses on two lines of research that point to parallels. First, several neurochemical systems involved in addiction are also involved in the modulation of the behavioral effects of reward loss, including opioid, GABA, and dopamine receptors. Second, there are extensive overlaps in the brain circuitry underlying both reward loss and addiction. Common components of this system include, at least, the amygdala, ventral and dorsal striatum, and various prefrontal cortex regions. Four emerging avenues of research that benefit from emphasis on the common ground between reward loss and addiction are reviewed, namely, the neural circuitry involved in reward devaluation, the influence of genetic and reward history on the behavioral vulnerability and resilience, the role of competing natural rewards, and emotional self-medication. An understanding of the role of reward loss in addiction will point to a deeper understanding of the initiation and maintenance of substance use disorders. Copyright © 2017 Elsevier Inc. All rights reserved.

Common and distinct neural correlates of personal and vicarious reward: A quantitative meta-analysis

PubMed Central

Morelli, Sylvia A.; Sacchet, Matthew D.; Zaki, Jamil

2015-01-01

Individuals experience reward not only when directly receiving positive outcomes (e.g., food or money), but also when observing others receive such outcomes. This latter phenomenon, known as vicarious reward, is a perennial topic of interest among psychologists and economists. More recently, neuroscientists have begun exploring the neuroanatomy underlying vicarious reward. Here we present a quantitative whole-brain meta-analysis of this emerging literature. We identified 25 functional neuroimaging studies that included contrasts between vicarious reward and a neutral control, and subjected these contrasts to an activation likelihood estimate (ALE) meta-analysis. This analysis revealed a consistent pattern of activation across studies, spanning structures typically associated with the computation of value (especially ventromedial prefrontal cortex) and mentalizing (including dorsomedial prefrontal cortex and superior temporal sulcus). We further quantitatively compared this activation pattern to activation foci from a previous meta-analysis of personal reward. Conjunction analyses yielded overlapping VMPFC activity in response to personal and vicarious reward. Contrast analyses identified preferential engagement of the nucleus accumbens in response to personal as compared to vicarious reward, and in mentalizing-related structures in response to vicarious as compared to personal reward. These data shed light on the common and unique components of the reward that individuals experience directly and through their social connections. PMID:25554428

Pervasive competition between threat and reward in the brain.

PubMed

Choi, Jong Moon; Padmala, Srikanth; Spechler, Philip; Pessoa, Luiz

2014-06-01

In the current functional MRI study, we investigated interactions between reward and threat processing. Visual cues at the start of each trial informed participants about the chance of winning monetary reward and/or receiving a mild aversive shock. We tested two competing hypothesis: according to the 'salience hypothesis', in the condition involving both reward and threat, enhanced activation would be observed because of increased salience; according to the 'competition hypothesis', the processing of reward and threat would trade-off against each other, leading to reduced activation. Analysis of skin conductance data during a delay phase revealed an interaction between reward and threat processing, such that the effect of reward was reduced during threat and the effect of threat was reduced during reward. Analysis of imaging data during the same task phase revealed interactions between reward and threat processing in several regions, including the midbrain/ventral tegmental area, caudate, putamen, bed nucleus of the stria terminalis, anterior insula, middle frontal gyrus and dorsal anterior cingulate cortex. Taken together, our findings reveal conditions during which reward and threat trade-off against each other across multiple sites. Such interactions are suggestive of competitive processes and may reflect the organization of opponent systems in the brain. © The Author (2013). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Neural and personality correlates of individual differences related to the effects of acute tryptophan depletion on future reward evaluation.

PubMed

Demoto, Yoshihiko; Okada, Go; Okamoto, Yasumasa; Kunisato, Yoshihiko; Aoyama, Shiori; Onoda, Keiichi; Munakata, Ayumi; Nomura, Michio; Tanaka, Saori C; Schweighofer, Nicolas; Doya, Kenji; Yamawaki, Shigeto

2012-01-01

In general, humans tend to discount the value of delayed reward. An increase in the rate of discounting leads to an inability to select a delayed reward over a smaller immediate reward (reward-delay impulsivity). Although deficits in the serotonergic system are implicated in this reward-delay impulsivity, there is individual variation in response to serotonin depletion. The aim of the present study was to investigate whether the effects of serotonin depletion on the ability to evaluate future reward are affected by individual personality traits or brain activation. Personality traits were assessed using the NEO-Five Factor Inventory and Temperament and Character Inventory. The central serotonergic levels of 16 healthy volunteers were manipulated by dietary tryptophan depletion. Subjects performed a delayed reward choice task that required the continuous estimation of reward value during functional magnetic resonance imaging scanning. Discounting rates were increased in 9 participants, but were unchanged or decreased in 7 participants in response to tryptophan depletion. Participants whose discounting rate was increased by tryptophan depletion had significantly higher neuroticism and lower self-directedness. Furthermore, tryptophan depletion differentially affected the groups in terms of hemodynamic responses to the value of predicted future reward in the right insula. These results suggest that individuals who have high neuroticism and low self-directedness as personality traits are particularly vulnerable to the effect of low serotonin on future reward evaluation accompanied by altered brain activation patterns. Copyright © 2012 S. Karger AG, Basel.

The impact of reward on attention in schizophrenia.

PubMed

Bansal, Sonia; Robinson, Benjamin M; Geng, Joy J; Leonard, Carly J; Hahn, Britta; Luck, Steven J; Gold, James M

2018-06-01

Traditionally, attention was thought to be directed by either top-down goals or bottom-up salience. Recent studies have shown that the reward history of a stimulus feature also acts as a powerful attentional cue. This is particularly relevant in schizophrenia, which is characterized by motivational and attentional deficits. Here, we examine the impact of reward on selective attention. Forty-eight people with schizophrenia (PSZ) and 34 non-psychiatric control subject (NCS) discriminated the location of a target dot appearing inside a left circle or right circle. The circles were different colors, one of which was associated with reward via pre-training. In the first 2 blocks, targets were equally likely to appear in the left or right circle. In the last 4 blocks, the target was 75% likely on one side, thus allowing us to separately examine how attention was impacted by reward (color) and probability (location). PSZ had slower overall reaction times (RTs) than NCS. Both groups showed robust effects of spatial probability and reward history, with faster RTs for the rewarded color and for the more probable location. These effects were similar in PSZ and NCS. Negative symptom severity correlated with overall RT slowing, but there were no correlations between symptoms and reward-associated biasing of attention. PSZ demonstrated RT slowing but normal reward history and spatial probability-driven RT facilitation. These results are conceptually similar to prior findings showing intact implicit reward effects on response bias, and suggest that implicit processing of reward and probability is intact in PSZ.

Neural Response to Reward as a Predictor of Rise in Depressive Symptoms in Adolescence

PubMed Central

Morgan, Judith K.; Olino, Thomas M.; McMakin, Dana L.; Ryan, Neal D.; Forbes, Erika E.

2012-01-01

Adolescence is a developmental period characterized by significant increases in the onset of depression, but also by increases in depressive symptoms, even among psychiatrically healthy youth. Disrupted reward function has been postulated as a critical factor in the development of depression, but it is still unclear which adolescents are particularly at risk for rising depressive symptoms. We provide a conceptual stance on gender, pubertal development, and reward type as potential moderators of the association between neural response to reward and rises in depressive symptoms. In addition, we describe preliminary findings that support claims of this conceptual stance. We propose that (1) status-related rewards may be particularly salient for eliciting neural response relevant to depressive symptoms in boys, whereas social rewards may be more salient for eliciting neural response relevant to depressive symptoms in girls and (2) the pattern of reduced striatal response and enhanced medial prefrontal response to reward may be particularly predictive of depressive symptoms in pubertal adolescents. We found that greater vmPFC activation when winning rewards predicted greater increases in depressive symptoms over two years, for boys only, and less striatal activation when anticipating rewards predicted greater increases in depressive symptoms over two years, for adolescents in mid to late pubertal stages but not those in pre to early puberty. We also propose directions for future studies, including the investigation of social vs. monetary reward directly and the longitudinal assessment of parallel changes in pubertal development, neural response to reward, and depressive symptoms. PMID:22521464

Emotional arousal predicts intertemporal choice

PubMed Central

Lempert, Karolina M.; Johnson, Eli; Phelps, Elizabeth A.

2016-01-01

People generally prefer immediate rewards to rewards received after a delay, often even when the delayed reward is larger. This phenomenon is known as temporal discounting. It has been suggested that preferences for immediate rewards may be due to their being more concrete than delayed rewards. This concreteness may evoke an enhanced emotional response. Indeed, manipulating the representation of a future reward to make it more concrete has been shown to heighten the reward’s subjective emotional intensity, making people more likely to choose it. Here we use an objective measure of arousal – pupil dilation – to investigate if emotional arousal mediates the influence of delayed reward concreteness on choice. We recorded pupil dilation responses while participants made choices between immediate and delayed rewards. We manipulated concreteness through time interval framing: delayed rewards were presented either with the date on which they would be received (e.g., “$30, May 3”; DATE condition, more concrete) or in terms of delay to receipt (e.g., “$30, 7 days; DAYS condition, less concrete). Contrary to prior work, participants were not overall more patient in the DATE condition. However, there was individual variability in response to time framing, and this variability was predicted by differences in pupil dilation between conditions. Emotional arousal increased as the subjective value of delayed rewards increased, and predicted choice of the delayed reward on each trial. This study advances our understanding of the role of emotion in temporal discounting. PMID:26882337

Decision-making patterns and sensitivity to reward and punishment in children with attention-deficit hyperactivity disorder.

PubMed

Masunami, Taiji; Okazaki, Shinji; Maekawa, Hisao

2009-06-01

Earlier studies have demonstrated that attention-deficit hyperactivity disorder (ADHD) is associated with aberrant sensitivity to rewards and punishments. Although some studies have focused on real-life decision making in children with ADHD using the Iowa gambling task, the number of good deck choices, a frequently used index of decision-making ability in the gambling task, is insufficient for investigating the complex decision-making strategies in subjects. In the present study, we investigated decision-making strategies in ADHD children, analyzing T-patterns with rewards, with punishments, and without rewards and punishments during the gambling task, and examined the relationship between decision-making strategies and skin conductance responses (SCRs) to rewards and punishments. We hypothesized that ADHD children and normal children would employ different decision-making strategies depending on their sensitivity to rewards and punishments in the gambling task. Our results revealed that ADHD children had fewer T-patterns with punishments and exhibited a significant tendency to have many T-patterns with rewards, thus supporting our hypothesis. Moreover, in contrast to normal children, ADHD children failed to demonstrate differences between reward and punishment SCRs, supporting the idea that they had an aberrant sensitivity to rewards and punishments. Therefore, we concluded that ADHD children would be impaired in decision-making strategies depending on their aberrant sensitivity to rewards and punishments. However, we were unable to specify whether large reward SCRs or small punishment SCRs is generated in ADHD children.

Abnormal reward functioning across substance use disorders and major depressive disorder: Considering reward as a transdiagnostic mechanism.

PubMed

Baskin-Sommers, Arielle R; Foti, Dan

2015-11-01

A common criticism of the Diagnostic and Statistical Manual of Mental Disorders (American Psychiatric Association, 2013) is that its criteria are based more on behavioral descriptions than on underlying biological mechanisms. Increasingly, calls have intensified for a more biologically-based approach to conceptualizing, studying, and treating psychological disorders, as exemplified by the Research Domain Criteria Project (RDoC). Among the most well-studied neurobiological mechanisms is reward processing. Moreover, individual differences in reward sensitivity are related to risk for substance abuse and depression. The current review synthesizes the available preclinical, electrophysiological, and neuroimaging literature on reward processing from a transdiagnostic, multidimensional perspective. Findings are organized with respect to key reward constructs within the Positive Valence Systems domain of the RDoC matrix, including initial responsiveness to reward (physiological 'liking'), approach motivation (physiological 'wanting'), and reward learning/habit formation. In the current review, we (a) describe the neural basis of reward, (b) elucidate differences in reward activity in substance abuse and depression, and (c) suggest a framework for integrating these disparate literatures and discuss the utility of shifting focus from diagnosis to process for understanding liability and co-morbidity. Ultimately, we believe that an integrative focus on abnormal reward functioning across the full continuum of clinically heterogeneous samples, rather than within circumscribed diagnostic categories, might actually help to refine the phenotypes and improve the prediction of onset and recovery of these disorders. Copyright © 2015 Elsevier B.V. All rights reserved.

Dissociable effects of surprising rewards on learning and memory.

PubMed

Rouhani, Nina; Norman, Kenneth A; Niv, Yael

2018-03-19

Reward-prediction errors track the extent to which rewards deviate from expectations, and aid in learning. How do such errors in prediction interact with memory for the rewarding episode? Existing findings point to both cooperative and competitive interactions between learning and memory mechanisms. Here, we investigated whether learning about rewards in a high-risk context, with frequent, large prediction errors, would give rise to higher fidelity memory traces for rewarding events than learning in a low-risk context. Experiment 1 showed that recognition was better for items associated with larger absolute prediction errors during reward learning. Larger prediction errors also led to higher rates of learning about rewards. Interestingly we did not find a relationship between learning rate for reward and recognition-memory accuracy for items, suggesting that these two effects of prediction errors were caused by separate underlying mechanisms. In Experiment 2, we replicated these results with a longer task that posed stronger memory demands and allowed for more learning. We also showed improved source and sequence memory for items within the high-risk context. In Experiment 3, we controlled for the difficulty of reward learning in the risk environments, again replicating the previous results. Moreover, this control revealed that the high-risk context enhanced item-recognition memory beyond the effect of prediction errors. In summary, our results show that prediction errors boost both episodic item memory and incremental reward learning, but the two effects are likely mediated by distinct underlying systems. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Expected reward modulates encoding-related theta activity before an event.

PubMed

Gruber, Matthias J; Watrous, Andrew J; Ekstrom, Arne D; Ranganath, Charan; Otten, Leun J

2013-01-01

Oscillatory brain activity in the theta frequency range (4-8 Hz) before the onset of an event has been shown to affect the likelihood of successfully encoding the event into memory. Recent work has also indicated that frontal theta activity might be modulated by reward, but it is not clear how reward expectancy, anticipatory theta activity, and memory formation might be related. Here, we used scalp electroencephalography (EEG) to assess the relationship between these factors. EEG was recorded from healthy adults while they memorized a series of words. Each word was preceded by a cue that indicated whether a high or low monetary reward would be earned if the word was successfully remembered in a later recognition test. Frontal theta power between the presentation of the reward cue and the onset of a word was predictive of later memory for the word, but only in the high reward condition. No theta differences were observed before word onset following low reward cues. The magnitude of prestimulus encoding-related theta activity in the high reward condition was correlated with the number of high reward words that were later confidently recognized. These findings provide strong evidence for a link between reward expectancy, theta activity, and memory encoding. Theta activity before event onset seems to be especially important for the encoding of motivationally significant stimuli. One possibility is that dopaminergic activity during reward anticipation mediates frontal theta activity related to memory. Copyright © 2012 Elsevier Inc. All rights reserved.

Optogenetic excitation of central amygdala amplifies and narrows incentive motivation to pursue one reward above another.

PubMed

Robinson, Mike J F; Warlow, Shelley M; Berridge, Kent C

2014-12-10

Choosing one reward above another is important for achieving adaptive life goals. Yet hijacked into excessive intensity in disorders such as addiction, single-minded pursuit becomes maladaptive. Here, we report that optogenetic channelrhodopsin stimulation of neurons in central nucleus of amygdala (CeA), paired with earning a particular sucrose reward in rats, amplified and narrowed incentive motivation to that single reward target. Therefore, CeA rats chose and intensely pursued only the laser-paired sucrose reward while ignoring an equally good sucrose alternative. In contrast, reward-paired stimulation of basolateral amygdala did not hijack choice. In a separate measure of incentive motivation, CeA stimulation also increased the progressive ratio breakpoint or level of effort exerted to obtain sucrose reward. However, CeA stimulation by itself failed to support behavioral self-stimulation in the absence of any paired external food reward, suggesting that CeA photo-excitation specifically transformed the value of its external reward (rather than adding an internal reinforcement state). Nor did CeA stimulation by itself induce any aversive state that motivated escape. Finally, CeA stimulation also failed to enhance 'liking' reactions elicited by sucrose taste and did not simply increase the general motivation to eat. This pattern suggests that CeA photo-excitation specifically enhances and narrows incentive motivation to pursue an associated external reward at the expense of another comparable reward. Copyright © 2014 the authors 0270-6474/14/3416567-14$15.00/0.

28 CFR 13.6 - Criteria for reward.

Code of Federal Regulations, 2011 CFR

2011-07-01

... Judicial Administration DEPARTMENT OF JUSTICE ATOMIC WEAPONS AND SPECIAL NUCLEAR MATERIALS REWARDS... reward under the Atomic Weapons and Special Nuclear Materials Rewards Act must be original, and must..., acquire or export special nuclear material or atomic weapons, or (5) Loss, diversion or disposal or...

28 CFR 13.6 - Criteria for reward.

Code of Federal Regulations, 2012 CFR

2012-07-01

... Judicial Administration DEPARTMENT OF JUSTICE ATOMIC WEAPONS AND SPECIAL NUCLEAR MATERIALS REWARDS... reward under the Atomic Weapons and Special Nuclear Materials Rewards Act must be original, and must..., acquire or export special nuclear material or atomic weapons, or (5) Loss, diversion or disposal or...

28 CFR 13.6 - Criteria for reward.

Code of Federal Regulations, 2010 CFR

2010-07-01

... Judicial Administration DEPARTMENT OF JUSTICE ATOMIC WEAPONS AND SPECIAL NUCLEAR MATERIALS REWARDS... reward under the Atomic Weapons and Special Nuclear Materials Rewards Act must be original, and must..., acquire or export special nuclear material or atomic weapons, or (5) Loss, diversion or disposal or...

28 CFR 13.6 - Criteria for reward.

Code of Federal Regulations, 2014 CFR

2014-07-01

... Judicial Administration DEPARTMENT OF JUSTICE ATOMIC WEAPONS AND SPECIAL NUCLEAR MATERIALS REWARDS... reward under the Atomic Weapons and Special Nuclear Materials Rewards Act must be original, and must..., acquire or export special nuclear material or atomic weapons, or (5) Loss, diversion or disposal or...

28 CFR 13.6 - Criteria for reward.

Code of Federal Regulations, 2013 CFR

2013-07-01

... Judicial Administration DEPARTMENT OF JUSTICE ATOMIC WEAPONS AND SPECIAL NUCLEAR MATERIALS REWARDS... reward under the Atomic Weapons and Special Nuclear Materials Rewards Act must be original, and must..., acquire or export special nuclear material or atomic weapons, or (5) Loss, diversion or disposal or...

Blunted neural responses to reward in remitted major depression: A high-density event-related potential study

PubMed Central

Whitton, Alexis E.; Kakani, Pragya; Foti, Dan; Van’t Veer, Ashlee; Haile, Anja; Crowley, David J.; Pizzagalli, Diego A.

2015-01-01

Background Major depressive disorder (MDD) is a highly recurrent condition, and improving our understanding of the abnormalities that persist in remitted MDD (rMDD) may provide insight into mechanisms that contribute to relapse. MDD has been characterized by reward learning deficits linked to dysfunction in frontostriatal regions. Although initial behavioral evidence of reward learning deficits in rMDD has recently emerged, it is unclear whether these reflect impairments in neural reward processing that persist into remission. Methods We examined behavioral reward learning and 128-channel event-related potentials (ERP) during a well-validated probabilistic reward task in 26 rMDD individuals and 34 never-depressed controls. Temporo-spatial principal components analysis (PCA) was used to separate overlapping ERP components, and group differences in neural activity in a priori regions were examined using low-resolution electromagnetic tomography (LORETA). Results Individuals with rMDD displayed reduced behavioral reward learning, as well as blunted ERP amplitude to reward feedback. Importantly, the reduction in ERP amplitude occurred at a PCA factor that peaked during the time at which phasic reward feedback-related signaling – hypothesized to originate in the striatum and project to the anterior cingulate cortex (ACC) – are thought to modulate scalp-recorded activity. Consistent with this, LORETA analyses revealed reduced activity in the ACC in the rMDD group, and this blunting correlated with poorer reward learning. Conclusion These findings suggest that the reward learning impairment observed in acute MDD persists into full remission and that these impairments may be attributable to abnormalities in the neural processes that support reward feedback monitoring, particularly within the ACC. PMID:26858994

Waiting to win: elevated striatal and orbitofrontal cortical activity during reward anticipation in euthymic bipolar disorder adults

PubMed Central

Nusslock, Robin; Almeida, Jorge RC; Forbes, Erika E; Versace, Amelia; Frank, Ellen; LaBarbara, Edmund J; Klein, Crystal R; Phillips, Mary L

2012-01-01

Objective Bipolar disorder may be characterized by a hypersensitivity to reward-relevant stimuli, potentially underlying the emotional lability and dysregulation that characterizes the illness. In parallel, research highlights the predominant role of striatal and orbitofrontal cortical (OFC) regions in reward-processing and approach-related affect. We aimed to examine whether bipolar disorder, relative to healthy, participants displayed elevated activity in these regions during reward processing. Methods Twenty-one euthymic bipolar I disorder and 20 healthy control participants with no lifetime history of psychiatric disorder underwent functional magnetic resonance imaging (fMRI) scanning during a card-guessing paradigm designed to examine reward-related brain function to anticipation and receipt of monetary reward and loss. Data were collected using a 3T Siemens Trio scanner. Results Region-of-interest analyses revealed that bipolar disorder participants displayed greater ventral striatal and right-sided orbitofrontal [Brodmann area (BA) 11] activity during anticipation, but not outcome, of monetary reward, relative to healthy controls (p < 0.05, corrected). Wholebrain analyses indicated that bipolar disorder, relative to healthy, participants also displayed elevated left-lateral OFC activity (BA 47) activity during reward anticipation (p < 0.05, corrected). Conclusions Elevated ventral striatal and OFC activity during reward anticipation may represent a neural mechanism for predisposition to expansive mood and hypo/mania in response to reward-relevant cues that characterizes bipolar disorder. Our findings contrast with research reporting blunted activity in the ventral striatum during reward processing in unipolar depressed individuals, relative to healthy controls. Examination of reward-related neural activity in bipolar disorder is a promising research focus to facilitate identification of biological markers of the illness. PMID:22548898

Withholding a Reward-driven Action: Studies of the Rise and Fall of Motor Activation and the Effect of Cognitive Depletion.

PubMed

Freeman, Scott M; Aron, Adam R

2016-02-01

Controlling an inappropriate response tendency in the face of a reward-predicting stimulus likely depends on the strength of the reward-driven activation, the strength of a putative top-down control process, and their relative timing. We developed a rewarded go/no-go paradigm to investigate such dynamics. Participants made rapid responses (on go trials) to high versus low reward-predicting stimuli and sometimes had to withhold responding (on no-go trials) in the face of the same stimuli. Behaviorally, for high versus low reward stimuli, responses were faster on go trials, and there were more errors of commission on no-go trials. We used single-pulse TMS to map out the corticospinal excitability dynamics, especially on no-go trials where control is needed. For successful no-go trials, there was an early rise in motor activation that was then sharply reduced beneath baseline. This activation-reduction pattern was more pronounced for high- versus low-reward trials and in individuals with greater motivational drive for reward. A follow-on experiment showed that, when participants were fatigued by an effortful task, they made more errors on no-go trials for high versus low reward stimuli. Together, these studies show that, when a response is inappropriate, reward-predicting stimuli induce early motor activation, followed by a top-down effortful control process (which we interpret as response suppression) that depends on the strength of the preceding activation. Our findings provide novel information about the activation-suppression dynamics during control over reward-driven actions, and they illustrate how fatigue or depletion leads to control failures in the face of reward.

Hunger does not motivate reward in women remitted from anorexia nervosa.

PubMed

Wierenga, Christina E; Bischoff-Grethe, Amanda; Melrose, A James; Irvine, Zoe; Torres, Laura; Bailer, Ursula F; Simmons, Alan; Fudge, Julie L; McClure, Samuel M; Ely, Alice; Kaye, Walter H

2015-04-01

Hunger enhances sensitivity to reward, yet individuals with anorexia nervosa (AN) are not motivated to eat when starved. This study investigated brain response to rewards during hunger and satiated states to examine whether diminished response to reward could underlie food restriction in AN. Using a delay discounting monetary decision task known to discriminate brain regions contributing to processing of immediate rewards and cognitive control important for decision making regarding future rewards, we compared 23 women remitted from AN (RAN group; to reduce the confounding effects of starvation) with 17 healthy comparison women (CW group). Monetary rewards were used because the rewarding value of food may be confounded by anxiety in AN. Interactions of Group (RAN, CW) × Visit (hunger, satiety) revealed that, for the CW group, hunger significantly increased activation in reward salience circuitry (ventral striatum, dorsal caudate, anterior cingulate cortex) during processing of immediate reward, whereas satiety increased activation in cognitive control circuitry (ventrolateral prefrontal cortex, insula) during decision making. In contrast, brain response in reward and cognitive neurocircuitry did not differ during hunger and satiety in the RAN group. A main effect of group revealed elevated response in the middle frontal gyrus for the RAN group compared with the CW group. Women remitted from AN failed to increase activation of reward valuation circuitry when hungry and showed elevated response in cognitive control circuitry independent of metabolic state. Decreased sensitivity to the motivational drive of hunger may explain the ability of individuals with AN to restrict food when emaciated. Difficulties in valuating emotional salience may contribute to inabilities to appreciate the risks inherent in this disorder. Copyright © 2015 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

International survey of nephrologists' perceptions and attitudes about rewards and compensations for kidney donation

PubMed Central

Ghahramani, Nasrollah; Karparvar, Zahra; Ghahramani, Mehrdad; Shadrou, Shahrouz

2013-01-01

Background Payment for organ donation, whether in the form of incentives, rewards or compensation is highly debated and has been denounced by many professional and legislative bodies. Despite the passionate discussion in the literature, there is very limited data on attitudes and perceptions of physicians about providing rewards or compensation to organ donors. We investigated the relationship between demographic and practice characteristics of nephrologists and their perceptions and attitudes about rewards and compensations for organ donation. Methods Using a web-based survey, we explored the views of nephrologists around the world about rewards and compensations for kidney donation. The relationship between attitudes and demographic characteristics of 1280 nephrologists from 74 countries was examined by univariate and multivariable analyses. Results Seventy-five percent agreed with donor health insurance, 26% favored direct financial compensation and 31% agreed with financial rewards for unrelated donors. Sixty-six percent believed that rewards will lead to increased donation. Seventy-three percent indicated that rewards will lead to exploitation of the poor and 78% agreed with legislation prohibiting organ sales. Thirty-seven percent believed that rewards will negatively impact deceased-donor transplantation. Nephrologists from India/Pakistan and the Middle East had more favorable views about rewards, while respondents from Latin America and Europe, older than 50, female nephrologists and those practicing in rural areas had less favorable views. Conclusions We conclude that a minority of nephrologists favor rewards for donation, many agree with some compensation and a considerable majority favor donor health insurance. Perceptions of nephrologists about rewards and compensation are influenced by age, sex, urban versus rural location and geographic region of practice. PMID:23780679

Integration of homeostatic signaling and food reward processing in the human brain

PubMed Central

Simon, Joe J.; Wetzel, Anne; Sinno, Maria Hamze; Skunde, Mandy; Bendszus, Martin; Enck, Paul; Herzog, Wolfgang; Friederich, Hans-Christoph

2017-01-01

BACKGROUND. Food intake is guided by homeostatic needs and by the reward value of food, yet the exact relation between the two remains unclear. The aim of this study was to investigate the influence of different metabolic states and hormonal satiety signaling on responses in neural reward networks. METHODS. Twenty-three healthy participants underwent functional magnetic resonance imaging while performing a task distinguishing between the anticipation and the receipt of either food- or monetary-related reward. Every participant was scanned twice in a counterbalanced fashion, both during a fasted state (after 24 hours fasting) and satiety. A functional connectivity analysis was performed to investigate the influence of satiety signaling on activation in neural reward networks. Blood samples were collected to assess hormonal satiety signaling. RESULTS. Fasting was associated with sensitization of the striatal reward system to the anticipation of food reward irrespective of reward magnitude. Furthermore, during satiety, individual ghrelin levels were associated with increased neural processing during the expectation of food-related reward. CONCLUSIONS. Our findings show that physiological hunger stimulates food consumption by specifically increasing neural processing during the expectation (i.e., incentive salience) but not the receipt of food-related reward. In addition, these findings suggest that ghrelin signaling influences hedonic-driven food intake by increasing neural reactivity during the expectation of food-related reward. These results provide insights into the neurobiological underpinnings of motivational processing and hedonic evaluation of food reward. TRIAL REGISTRATION. ClinicalTrials.gov NCT03081585. FUNDING. This work was supported by the German Competence Network on Obesity, which is funded by the German Federal Ministry of Education and Research (FKZ 01GI1122E). PMID:28768906

Impact of Early Life Adversity on Reward Processing in Young Adults: EEG-fMRI Results from a Prospective Study over 25 Years

PubMed Central

Boecker, Regina; Holz, Nathalie E.; Buchmann, Arlette F.; Blomeyer, Dorothea; Plichta, Michael M.; Wolf, Isabella; Baumeister, Sarah; Meyer-Lindenberg, Andreas; Banaschewski, Tobias

2014-01-01

Several lines of evidence have implicated the mesolimbic dopamine reward pathway in altered brain function resulting from exposure to early adversity. The present study examined the impact of early life adversity on different stages of neuronal reward processing later in life and their association with a related behavioral phenotype, i.e. attention deficit/hyperactivity disorder (ADHD). 162 healthy young adults (mean age = 24.4 years; 58% female) from an epidemiological cohort study followed since birth participated in a simultaneous EEG-fMRI study using a monetary incentive delay task. Early life adversity according to an early family adversity index (EFA) and lifetime ADHD symptoms were assessed using standardized parent interviews conducted at the offspring's age of 3 months and between 2 and 15 years, respectively. fMRI region-of-interest analysis revealed a significant effect of EFA during reward anticipation in reward-related areas (i.e. ventral striatum, putamen, thalamus), indicating decreased activation when EFA increased. EEG analysis demonstrated a similar effect for the contingent negative variation (CNV), with the CNV decreasing with the level of EFA. In contrast, during reward delivery, activation of the bilateral insula, right pallidum and bilateral putamen increased with EFA. There was a significant association of lifetime ADHD symptoms with lower activation in the left ventral striatum during reward anticipation and higher activation in the right insula during reward delivery. The present findings indicate a differential long-term impact of early life adversity on reward processing, implicating hyporesponsiveness during reward anticipation and hyperresponsiveness when receiving a reward. Moreover, a similar activation pattern related to lifetime ADHD suggests that the impact of early life stress on ADHD may possibly be mediated by a dysfunctional reward pathway. PMID:25118701

Neural mechanisms of risky decision-making and reward response in adolescent onset cannabis use disorder.

PubMed

De Bellis, Michael D; Wang, Lihong; Bergman, Sara R; Yaxley, Richard H; Hooper, Stephen R; Huettel, Scott A

2013-11-01

Neural mechanisms of decision-making and reward response in adolescent cannabis use disorder (CUD) are underexplored. Three groups of male adolescents were studied: CUD in full remission (n=15); controls with psychopathology without substance use disorder history (n=23); and healthy controls (n=18). We investigated neural processing of decision-making and reward under conditions of varying risk and uncertainty with the Decision-Reward Uncertainty Task while participants were scanned using functional magnetic resonance imaging. Abstinent adolescents with CUD compared to controls with psychopathology showed hyperactivation in one cluster that spanned left superior parietal lobule/left lateral occipital cortex/precuneus while making risky decisions that involved uncertainty, and hypoactivation in left orbitofrontal cortex to rewarded outcomes compared to no-reward after making risky decisions. Post hoc region of interest analyses revealed that both control groups significantly differed from the CUD group (but not from each other) during both the decision-making and reward outcome phase of the Decision-Reward Uncertainty Task. In the CUD group, orbitofrontal activations to reward significantly and negatively correlated with total number of individual drug classes the CUD patients experimented with prior to treatment. CUD duration significantly and negatively correlated with orbitofrontal activations to no-reward. The adolescent CUD group demonstrated distinctly different activation patterns during risky decision-making and reward processing (after risky decision-making) compared to both the controls with psychopathology and healthy control groups. These findings suggest that neural differences in risky decision-making and reward processes are present in adolescent addiction, persist after remission from first CUD treatment, and may contribute to vulnerability for adolescent addiction. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.

Self-administration of the synthetic cathinone MPDV enhances reward function via a nicotinic receptor dependent mechanism.

PubMed

Geste, Jean R; Pompilus, Marjory; Febo, Marcelo; Bruijnzeel, Adriaan W

2018-05-09

Methylenedioxypyrovalerone (MDPV) is an addictive synthetic drug with severe side effects. Previous studies have shown that MDPV has positive reinforcing properties. However, little is known about the effect of MDPV self-administration on the state of the brain reward system and the neuronal mechanisms by which MDPV mediates its effects. The goal of the present studies was to determine the effect of MDPV self-administration on reward function and the role of cholinergic neurotransmission in the reinforcing effects of MDPV. To study the effect of MDPV self-administration on the brain reward system, rats were prepared with intravenous catheters and intracranial self-stimulation electrodes (ICSS). For 10 days, the reward thresholds were assessed immediately before (23 h post prior session) and after 1 h of MDPV self-administration. The reward thresholds were decreased immediately after MDPV self-administration, which is indicative of a potentiation of brain reward function. The reward thresholds 23 h after MDPV intake gradually increased over time, which is indicative of anhedonia. Pretreatment with the nicotinic acetylcholine receptor (nAChR) antagonist mecamylamine decreased the self-administration of MDPV and completely prevented the decrease in reward thresholds. A control study with palatable chocolate pellets showed that responding for a natural reinforcer does not affect the state of the brain reward system. Furthermore, mecamylamine did not affect responding for food pellets. In conclusion, the self-administration of MDPV potentiates reward function and nAChR blockade prevents the reward enhancing effects of MDPV self-administration. Preventing the MDPV-induced increase in cholinergic neurotransmission might be a safe approach to diminish MDPV abuse. Copyright © 2018. Published by Elsevier Ltd.

Reward-Based Spatial Learning in Teens With Bulimia Nervosa

PubMed Central

Cyr, Marilyn; Wang, Zhishun; Tau, Gregory Z.; Zhao, Guihu; Friedl, Eve; Stefan, Mihaela; Terranova, Kate; Marsh, Rachel

2016-01-01

Objective To assess the functioning of mesolimbic and fronto-striatal areas involved in reward-based spatial learning in teenaged girls with bulimia nervosa (BN) that might be involved in the development and maintenance of maladaptive behaviors characteristic of the disorder. Method We compared functional magnetic resonance imaging blood oxygen level dependent response in 27 adolescent girls with BN to that of 27 healthy, age-matched control participants during a reward-based learning task that required learning to use extra-maze cues to navigate a virtual 8-arm radial maze to find hidden rewards. We compared groups in their patterns of brain activation associated with reward-based spatial learning versus a control condition in which rewards were unexpected because they were allotted pseudo-randomly to experimentally prevent learning. Results Both groups learned to navigate the maze to find hidden rewards, but group differences in brain activity associated with maze navigation and reward processing were detected in fronto-striatal regions and right anterior hippocampus. Unlike healthy adolescents, those with BN did not engage right inferior frontal gyrus during maze navigation, activated right anterior hippocampus during the receipt of unexpected rewards (control condition), and deactivated left superior frontal gyrus and right anterior hippocampus during expected reward receipt (learning condition). These patterns of hippocampal activation in the control condition were significantly associated with the frequency of binge-eating episodes. Conclusion Adolescents with BN displayed abnormal functioning of anterior hippocampus and fronto-striatal regions during reward-based spatial learning. These findings suggest that an imbalance in control and reward circuits may arise early in the course of BN. Clinical trial registration information An fMRI Study of Self-regulation in Adolescents With Bulimia Nervosa; https://clinicaltrials.gov/ct2/show/NCT00345943; NCT00345943. PMID:27806864

Altered neural processing of reward and punishment in adolescents with Major Depressive Disorder.

PubMed

Landes, I; Bakos, S; Kohls, G; Bartling, J; Schulte-Körne, G; Greimel, E

2018-05-01

Altered reward and punishment function has been suggested as an important vulnerability factor for the development of Major Depressive Disorder (MDD). Prior ERP studies found evidence for neurophysiological dysfunctions in reinforcement processes in adults with MDD. To date, only few ERP studies have examined the neural underpinnings of reinforcement processing in adolescents diagnosed with MDD. The present event-related potential (ERP) study aimed to investigate neurophysiological mechanisms of anticipation and consumption of reward and punishment in adolescents with MDD in one comprehensive paradigm. During ERP recording, 25 adolescents with MDD and 29 healthy controls (12-17 years) completed a Monetary Incentive Delay Task comprising both a monetary reward and a monetary punishment condition. During anticipation, the cue-P3 signaling attentional allocation was recorded. During consumption, the feedback-P3 and Reward Positivity (RewP) were recorded to capture attentional allocation and outcome evaluation, respectively. Compared to controls, adolescents with MDD showed prolonged cue-P3 latencies to reward cues. Furthermore, unlike controls, adolescents with MDD displayed shorter feedback-P3 latencies in the reward versus punishment condition. RewPs did not differ between groups. It remains unanswered whether the observed alterations in adolescent MDD represent a state or trait. Delayed neural processing of reward cues corresponds to the clinical presentation of adolescent MDD with reduced motivational tendencies to obtain rewards. Relatively shorter feedback-P3 latencies in the reward versus punishment condition could indicate a high salience of performance-contingent reward. Frequent exposure of negatively biased adolescents with MDD to performance-contingent rewards might constitute a promising intervention approach. Copyright © 2018 Elsevier B.V. All rights reserved.

Decodability of Reward Learning Signals Predicts Mood Fluctuations.

PubMed

Eldar, Eran; Roth, Charlotte; Dayan, Peter; Dolan, Raymond J

2018-05-07

Our mood often fluctuates without warning. Recent accounts propose that these fluctuations might be preceded by changes in how we process reward. According to this view, the degree to which reward improves our mood reflects not only characteristics of the reward itself (e.g., its magnitude) but also how receptive to reward we happen to be. Differences in receptivity to reward have been suggested to play an important role in the emergence of mood episodes in psychiatric disorders [1-16]. However, despite substantial theory, the relationship between reward processing and daily fluctuations of mood has yet to be tested directly. In particular, it is unclear whether the extent to which people respond to reward changes from day to day and whether such changes are followed by corresponding shifts in mood. Here, we use a novel mobile-phone platform with dense data sampling and wearable heart-rate and electroencephalographic sensors to examine mood and reward processing over an extended period of one week. Subjects regularly performed a trial-and-error choice task in which different choices were probabilistically rewarded. Subjects' choices revealed two complementary learning processes, one fast and one slow. Reward prediction errors [17, 18] indicative of these two processes were decodable from subjects' physiological responses. Strikingly, more accurate decodability of prediction-error signals reflective of the fast process predicted improvement in subjects' mood several hours later, whereas more accurate decodability of the slow process' signals predicted better mood a whole day later. We conclude that real-life mood fluctuations follow changes in responsivity to reward at multiple timescales. Copyright © 2018 The Author(s). Published by Elsevier Ltd.. All rights reserved.

The Effects of Verbal Reward on the Behavior of Children in the Primary Grades at a Cognitive Task Typical of the New Elementary Science Curricula

ERIC Educational Resources Information Center

Lawlor, Francis X.

1970-01-01

Indicates that the use of verbal rewards which are not congruent with behavior will result in less efficient problem-solving than either a neutral, no-reward situation, or the use of rewards which are congruent with the problem-solving behavior. The giving of congruent rewards improved the problem-solving efficiency of girls but not of boys. (LS)

Mutual Influence of Reward Anticipation and Emotion on Brain Activity during Memory Retrieval

PubMed Central

Yan, Chunping; Liu, Fang; Li, Yunyun; Zhang, Qin; Cui, Lixia

2017-01-01

Previous studies on the joint effect of reward motivation and emotion on memory retrieval have obtained inconsistent results. Furthermore, whether and how any such joint effect might vary over time remains unclear too. Accordingly, using the event-related potential (ERP) measurement of high temporal resolution, our study investigates the cognitive and brain mechanisms of monetary reward and emotion affecting the retrieval processes of episodic memory. Twenty undergraduate and graduate students participated in the research, and our study’s behavioral results indicated that reward (relative to no reward) and negative emotion (relative to positive and neutral emotion) significantly improved recognition performance. The ERP results showed that there were significant interactions between monetary reward and emotion on memory retrieval, and the reward effects of positive, neutral, and negative memory occurred at varied intervals in mean amplitude. The reward effect of positive memory appeared relatively early, at 260–330 ms after the stimulus onset in the frontal-frontocentral area, at 260–500 ms in the centroparietal-parietal area and at 500–700 ms in the frontocentral area. However, the reward effects of neutral and negative memory occurred relatively later, and that of negative memory appeared at 500–700 ms in the frontocentral and centroparietal area and that of neutral memory was at 500–700 ms in the frontocentral and centroparietal-parietal area. Meanwhile, significant FN400 old/new effects were observed in the negative and rewarded positive items, and the old/new effects of negative items appeared earlier at FN400 than positive items. Also, significant late positive component (LPC) old/new effects were found in the positive, negative, and rewarded neutral items. These results suggest that, monetary reward and negative emotion significantly improved recognition performance, and there was a mutual influence between reward and emotion on brain activity during memory retrieval. PMID:29118728

The role of the central ghrelin system in reward from food and chemical drugs.

PubMed

Dickson, Suzanne L; Egecioglu, Emil; Landgren, Sara; Skibicka, Karolina P; Engel, Jörgen A; Jerlhag, Elisabet

2011-06-20

Here we review recent advances that identify a role for the central ghrelin signalling system in reward from both natural rewards (such as food) and artificial rewards (that include alcohol and drugs of abuse). Whereas ghrelin emerged as a stomach-derived hormone involved in energy balance, hunger and meal initiation via hypothalamic circuits, it now seems clear that it also has a role in motivated reward-driven behaviours via activation of the so-called "cholinergic-dopaminergic reward link". This reward link comprises a dopamine projection from the ventral tegmental area (VTA) to the nucleus accumbens together with a cholinergic input, arising primarily from the laterodorsal tegmental area. Ghrelin administration into the VTA or LDTg activates the "cholinergic-dopaminergic" reward link, suggesting that ghrelin may increase the incentive value of motivated behaviours such as reward-seeking behaviour ("wanting" or "incentive motivation"). Further, direct injection of ghrelin into the brain ventricles or into the VTA increases the consumption of rewarding foods as well as alcohol in mice and rats. Studies in rodents show beneficial effects of ghrelin receptor (GHS-R1A) antagonists to suppress the intake of palatable food, to reduce preference for caloric foods, to suppress food reward and motivated behaviour for food. They have also been shown to reduce alcohol consumption, suppress reward induced by alcohol, cocaine and amphetamine. Furthermore, variations in the GHS-R1A and pro-ghrelin genes have been associated with high alcohol consumption, smoking and increased weight gain in alcohol dependent individuals as well as with bulimia nervosa and obesity. Thus, the central ghrelin signalling system interfaces neurobiological circuits involved in reward from food as well as chemical drugs; agents that directly or indirectly suppress this system emerge as potential candidate drugs for suppressing problematic over-eating that leads to obesity as well as for the treatment of substance use disorder. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Selectivity in Postencoding Connectivity with High-Level Visual Cortex Is Associated with Reward-Motivated Memory

PubMed Central

Murty, Vishnu P.; Tompary, Alexa; Adcock, R. Alison

2017-01-01

Reward motivation has been demonstrated to enhance declarative memory by facilitating systems-level consolidation. Although high-reward information is often intermixed with lower reward information during an experience, memory for high value information is prioritized. How is this selectivity achieved? One possibility is that postencoding consolidation processes bias memory strengthening to those representations associated with higher reward. To test this hypothesis, we investigated the influence of differential reward motivation on the selectivity of postencoding markers of systems-level memory consolidation. Human participants encoded intermixed, trial-unique memoranda that were associated with either high or low-value during fMRI acquisition. Encoding was interleaved with periods of rest, allowing us to investigate experience-dependent changes in connectivity as they related to later memory. Behaviorally, we found that reward motivation enhanced 24 h associative memory. Analysis of patterns of postencoding connectivity showed that, even though learning trials were intermixed, there was significantly greater connectivity with regions of high-level, category-selective visual cortex associated with high-reward trials. Specifically, increased connectivity of category-selective visual cortex with both the VTA and the anterior hippocampus predicted associative memory for high- but not low-reward memories. Critically, these results were independent of encoding-related connectivity and univariate activity measures. Thus, these findings support a model by which the selective stabilization of memories for salient events is supported by postencoding interactions with sensory cortex associated with reward. SIGNIFICANCE STATEMENT Reward motivation is thought to promote memory by supporting memory consolidation. Yet, little is known as to how brain selects relevant information for subsequent consolidation based on reward. We show that experience-dependent changes in connectivity of both the anterior hippocampus and the VTA with high-level visual cortex selectively predicts memory for high-reward memoranda at a 24 h delay. These findings provide evidence for a novel mechanism guiding the consolidation of memories for valuable events, namely, postencoding interactions between neural systems supporting mesolimbic dopamine activation, episodic memory, and perception. PMID:28100737

Beyond Rewards

ERIC Educational Resources Information Center

Hall, Philip S.

2009-01-01

Using rewards to impact students' behavior has long been common practice. However, using reward systems to enhance student learning conveniently masks the larger and admittedly more difficult task of finding and implementing the structure and techniques that children with special needs require to learn. More important, rewarding the child for good…

Influence of reward motivation on human declarative memory.

PubMed

Miendlarzewska, Ewa A; Bavelier, Daphne; Schwartz, Sophie

2016-02-01

Motivational relevance can prioritize information for memory encoding and consolidation based on reward value. In this review, we pinpoint the possible psychological and neural mechanisms by which reward promotes learning, from guiding attention to enhancing memory consolidation. We then discuss how reward value can spill-over from one conditioned stimulus to a non-conditioned stimulus. Such generalization can occur across perceptually similar items or through more complex relations, such as associative or logical inferences. Existing evidence suggests that the neurotransmitter dopamine boosts the formation of declarative memory for rewarded information and may also control the generalization of reward values. In particular, temporally-correlated activity in the hippocampus and in regions of the dopaminergic circuit may mediate value-based decisions and facilitate cross-item integration. Given the importance of generalization in learning, our review points to the need to study not only how reward affects later memory but how learned reward values may generalize to related representations and ultimately alter memory structure. Copyright © 2015 Elsevier Ltd. All rights reserved.

From Effort to Value: Preschool Children's Alternative to Effort Justification.

PubMed

Benozio, Avi; Diesendruck, Gil

2015-09-01

In the current studies, we addressed the development of effort-based object valuation. Four- and 6-year-olds invested either great or little effort in order to obtain attractive or unattractive rewards. Children were allowed to allocate these rewards to an unfamiliar recipient (dictator game). Investing great effort to obtain attractive rewards (a consonant situation) led 6-year-olds, but not 4-year-olds, to enhance the value of the rewards and thus distribute fewer of them to others. After investing effort to attain unattractive rewards (a dissonant situation), 6-year-olds cognitively reduced the dissonance between effort and reward quality by reappraising the value of the rewards and thus distributing fewer of them. In contrast, 4-year-olds reduced the dissonance behaviorally by discarding the rewards. These findings provide evidence for the emergence of an effort-value link and underline possible mechanisms underlying the primacy of cognitive versus behavioral solutions to dissonance reduction. © The Author(s) 2015.

Rare Neural Correlations Implement Robotic Conditioning with Delayed Rewards and Disturbances

PubMed Central

Soltoggio, Andrea; Lemme, Andre; Reinhart, Felix; Steil, Jochen J.

2013-01-01

Neural conditioning associates cues and actions with following rewards. The environments in which robots operate, however, are pervaded by a variety of disturbing stimuli and uncertain timing. In particular, variable reward delays make it difficult to reconstruct which previous actions are responsible for following rewards. Such an uncertainty is handled by biological neural networks, but represents a challenge for computational models, suggesting the lack of a satisfactory theory for robotic neural conditioning. The present study demonstrates the use of rare neural correlations in making correct associations between rewards and previous cues or actions. Rare correlations are functional in selecting sparse synapses to be eligible for later weight updates if a reward occurs. The repetition of this process singles out the associating and reward-triggering pathways, and thereby copes with distal rewards. The neural network displays macro-level classical and operant conditioning, which is demonstrated in an interactive real-life human-robot interaction. The proposed mechanism models realistic conditioning in humans and animals and implements similar behaviors in neuro-robotic platforms. PMID:23565092

Event-related EEG responses to anticipation and delivery of monetary and social reward.

PubMed

Flores, Amanda; Münte, Thomas F; Doñamayor, Nuria

2015-07-01

Monetary and a social incentive delay tasks were used to characterize reward anticipation and delivery with electroencephalography. During reward anticipation, N1, P2 and P3 components were modulated by both prospective reward value and incentive type (monetary or social), suggesting distinctive allocation of attentional and motivational resources depending not only on whether rewards or non-rewards were cued, but also on the monetary and social nature of the prospective outcomes. In the delivery phase, P2, FRN and P3 components were also modulated by levels of reward value and incentive type, illustrating how distinctive affective and cognitive processes were attached to the different outcomes. Our findings imply that neural processing of both reward anticipation and delivery can be specific to incentive type, which might have implications for basic as well as translational research. These results are discussed in the light of previous electrophysiological and neuroimaging work using similar tasks. Copyright © 2015 Elsevier B.V. All rights reserved.

Reward sensitivity is associated with brain activity during erotic stimulus processing.

PubMed

Costumero, Victor; Barrós-Loscertales, Alfonso; Bustamante, Juan Carlos; Ventura-Campos, Noelia; Fuentes, Paola; Rosell-Negre, Patricia; Ávila, César

2013-01-01

The behavioral approach system (BAS) from Gray's reinforcement sensitivity theory is a neurobehavioral system involved in the processing of rewarding stimuli that has been related to dopaminergic brain areas. Gray's theory hypothesizes that the functioning of reward brain areas is modulated by BAS-related traits. To test this hypothesis, we performed an fMRI study where participants viewed erotic and neutral pictures, and cues that predicted their appearance. Forty-five heterosexual men completed the Sensitivity to Reward scale (from the Sensitivity to Punishment and Sensitivity to Reward Questionnaire) to measure BAS-related traits. Results showed that Sensitivity to Reward scores correlated positively with brain activity during reactivity to erotic pictures in the left orbitofrontal cortex, left insula, and right ventral striatum. These results demonstrated a relationship between the BAS and reward sensitivity during the processing of erotic stimuli, filling the gap of previous reports that identified the dopaminergic system as a neural substrate for the BAS during the processing of other rewarding stimuli such as money and food.

Frontostriatal white matter integrity mediates adult age differences in probabilistic reward learning.

PubMed

Samanez-Larkin, Gregory R; Levens, Sara M; Perry, Lee M; Dougherty, Robert F; Knutson, Brian

2012-04-11

Frontostriatal circuits have been implicated in reward learning, and emerging findings suggest that frontal white matter structural integrity and probabilistic reward learning are reduced in older age. This cross-sectional study examined whether age differences in frontostriatal white matter integrity could account for age differences in reward learning in a community life span sample of human adults. By combining diffusion tensor imaging with a probabilistic reward learning task, we found that older age was associated with decreased reward learning and decreased white matter integrity in specific pathways running from the thalamus to the medial prefrontal cortex and from the medial prefrontal cortex to the ventral striatum. Further, white matter integrity in these thalamocorticostriatal paths could statistically account for age differences in learning. These findings suggest that the integrity of frontostriatal white matter pathways critically supports reward learning. The findings also raise the possibility that interventions that bolster frontostriatal integrity might improve reward learning and decision making.

Reward Sensitivity Is Associated with Brain Activity during Erotic Stimulus Processing

PubMed Central

Costumero, Victor; Barrós-Loscertales, Alfonso; Bustamante, Juan Carlos; Ventura-Campos, Noelia; Fuentes, Paola; Rosell-Negre, Patricia; Ávila, César

2013-01-01

The behavioral approach system (BAS) from Gray’s reinforcement sensitivity theory is a neurobehavioral system involved in the processing of rewarding stimuli that has been related to dopaminergic brain areas. Gray’s theory hypothesizes that the functioning of reward brain areas is modulated by BAS-related traits. To test this hypothesis, we performed an fMRI study where participants viewed erotic and neutral pictures, and cues that predicted their appearance. Forty-five heterosexual men completed the Sensitivity to Reward scale (from the Sensitivity to Punishment and Sensitivity to Reward Questionnaire) to measure BAS-related traits. Results showed that Sensitivity to Reward scores correlated positively with brain activity during reactivity to erotic pictures in the left orbitofrontal cortex, left insula, and right ventral striatum. These results demonstrated a relationship between the BAS and reward sensitivity during the processing of erotic stimuli, filling the gap of previous reports that identified the dopaminergic system as a neural substrate for the BAS during the processing of other rewarding stimuli such as money and food. PMID:23840558

Reward Systems in the Brain and Nutrition.

PubMed

Rolls, Edmund T

2016-07-17

The taste cortex in the anterior insula provides separate and combined representations of the taste, temperature, and texture of food in the mouth independently of hunger and thus of reward value and pleasantness. One synapse on, in the orbitofrontal cortex, these sensory inputs are combined by associative learning with olfactory and visual inputs for some neurons, and these neurons encode food reward value in that they respond to food only when hunger is present and in that activations correlate linearly with subjective pleasantness. Cognitive factors, including word-level descriptions and selective attention to affective value, modulate the representation of the reward value of taste, olfactory, and flavor stimuli in the orbitofrontal cortex and a region to which it projects, the anterior cingulate cortex. These food reward representations are important in the control of appetite and food intake. Individual differences in reward representations may contribute to obesity, and there are age-related differences in these reward representations. Implications of how reward systems in the brain operate for understanding, preventing, and treating obesity are described.

Association Between Reward Reactivity and Drug Use Severity is Substance Dependent: Preliminary Evidence From the Human Connectome Project.

PubMed

Peechatka, Alyssa L; Janes, Amy C

2017-06-01

Blunted nucleus accumbens (NAc) reactivity to reward is common across drug users. One theory is that individuals abuse substances due to this reward deficit. However, whether there is a relationship between the amount an individual uses and the severity of NAc dysfunction is unclear. It also is possible that such a relationship is substance specific, as nicotine transiently increases reward system sensitivity while alcohol, another commonly used substance, does not. As smokers may use nicotine to bolster NAc reward function, we hypothesize that NAc reactivity to reward will be related to volume of cigarette use, but not volume of alcohol use. A functional magnetic resonance imaging incentive-processing task collected by the Human Connectome Project was assessed in a cohort of tobacco smokers who reported smoking between 5-20 cigarettes/day and a cohort of alcohol users who reported drinking 7-25 drinks/wk. Number of cigarettes/day and drinks/wk were correlated with right and left NAc reactivity to the receipt of a monetary reward relative to baseline. Individuals who smoke greater numbers of cigarettes/day showed lower right NAc reactivity to reward (r = 0.853, p ≤ .001). Left NAc reactivity was not correlated with cigarettes/day. No association was found with drinks/wk. A negative association was found between NAc reactivity to reward and cigarettes/day, but not alcohol drinks/wk. Given nicotine's unique ability to increase sensitivity to rewards, these findings suggest that individuals who smoke more cigarettes/day may be compensating for more dysfunctional NAc reward reactivity. The present study demonstrates that a relationship between NAc reactivity to nondrug reward and volume of substance use is present in nicotine but not alcohol use. While prior work has implicated dysfunctional reward processing in addictions, these findings clarify a substance-specific role that blunted reward function has in determining patterns of use among chronic users. © The Author 2017. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Dissociating motivation from reward in human striatal activity.

PubMed

Miller, Eric M; Shankar, Maya U; Knutson, Brian; McClure, Samuel M

2014-05-01

Neural activity in the striatum has consistently been shown to scale with the value of anticipated rewards. As a result, it is common across a number of neuroscientific subdiscliplines to associate activation in the striatum with anticipation of a rewarding outcome or a positive emotional state. However, most studies have failed to dissociate expected value from the motivation associated with seeking a reward. Although motivation generally scales positively with increases in potential reward, there are circumstances in which this linkage does not apply. The current study dissociates value-related activation from that induced by motivation alone by employing a task in which motivation increased as anticipated reward decreased. This design reverses the typical relationship between motivation and reward, allowing us to differentially investigate fMRI BOLD responses that scale with each. We report that activity scaled differently with value and motivation across the striatum. Specifically, responses in the caudate and putamen increased with motivation, whereas nucleus accumbens activity increased with expected reward. Consistent with this, self-report ratings indicated a positive association between caudate and putamen activity and arousal, whereas activity in the nucleus accumbens was more associated with liking. We conclude that there exist regional limits on inferring reward expectation from striatal activation.

Neurophysiology of Reward-Guided Behavior: Correlates Related to Predictions, Value, Motivation, Errors, Attention, and Action.

PubMed

Bissonette, Gregory B; Roesch, Matthew R

2016-01-01

Many brain areas are activated by the possibility and receipt of reward. Are all of these brain areas reporting the same information about reward? Or are these signals related to other functions that accompany reward-guided learning and decision-making? Through carefully controlled behavioral studies, it has been shown that reward-related activity can represent reward expectations related to future outcomes, errors in those expectations, motivation, and signals related to goal- and habit-driven behaviors. These dissociations have been accomplished by manipulating the predictability of positively and negatively valued events. Here, we review single neuron recordings in behaving animals that have addressed this issue. We describe data showing that several brain areas, including orbitofrontal cortex, anterior cingulate, and basolateral amygdala signal reward prediction. In addition, anterior cingulate, basolateral amygdala, and dopamine neurons also signal errors in reward prediction, but in different ways. For these areas, we will describe how unexpected manipulations of positive and negative value can dissociate signed from unsigned reward prediction errors. All of these signals feed into striatum to modify signals that motivate behavior in ventral striatum and guide responding via associative encoding in dorsolateral striatum.

Positive mood enhances reward-related neural activity

PubMed Central

Nusslock, Robin

2016-01-01

Although behavioral research has shown that positive mood leads to desired outcomes in nearly every major life domain, no studies have directly examined the effects of positive mood on the neural processes underlying reward-related affect and goal-directed behavior. To address this gap, participants in the present fMRI study experienced either a positive (n = 20) or neutral (n = 20) mood induction and subsequently completed a monetary incentive delay task that assessed reward and loss processing. Consistent with prediction, positive mood elevated activity specifically during reward anticipation in corticostriatal neural regions that have been implicated in reward processing and goal-directed behavior, including the nucleus accumbens, caudate, lateral orbitofrontal cortex and putamen, as well as related paralimbic regions, including the anterior insula and ventromedial prefrontal cortex. These effects were not observed during reward outcome, loss anticipation or loss outcome. Critically, this is the first study to report that positive mood enhances reward-related neural activity. Our findings have implications for uncovering the neural mechanisms by which positive mood enhances goal-directed behavior, understanding the malleability of reward-related neural activity, and developing targeted treatments for psychiatric disorders characterized by deficits in reward processing. PMID:26833919

Self-choice enhances value in reward-seeking in primates.

PubMed

Setogawa, Tsuyoshi; Mizuhiki, Takashi; Matsumoto, Narihisa; Akizawa, Fumika; Shidara, Munetaka

2014-03-01

When an individual chooses one item from two or more alternatives, they compare the values of the expected outcomes. The outcome value can be determined by the associated reward amount, the probability of reward, and the workload required to earn the reward. Rational choice theory states that choices are made to maximize rewards over time, and that the same outcome values lead to an equal likelihood of choices. However, the theory does not distinguish between conditions with the same reward value, even when acquired under different circumstances, and does not always accurately describe real behavior. We have found that allowing a monkey to choose a reward schedule endows the schedule with extra value when compared to performance in an identical schedule that is chosen by another agent (a computer here). This behavior is not consistent with pure rational choice theory. Theoretical analysis using a modified temporal-difference learning model showed an enhanced schedule state value by self-choice. These results suggest that an increased reward value underlies the improved performances by self-choice during reward-seeking behavior. Copyright © 2014 Elsevier Ireland Ltd and the Japan Neuroscience Society. All rights reserved.

A unified selection signal for attention and reward in primary visual cortex.

PubMed

Stănişor, Liviu; van der Togt, Chris; Pennartz, Cyriel M A; Roelfsema, Pieter R

2013-05-28

Stimuli associated with high rewards evoke stronger neuronal activity than stimuli associated with lower rewards in many brain regions. It is not well understood how these reward effects influence activity in sensory cortices that represent low-level stimulus features. Here, we investigated the effects of reward information in the primary visual cortex (area V1) of monkeys. We found that the reward value of a stimulus relative to the value of other stimuli is a good predictor of V1 activity. Relative value biases the competition between stimuli, just as has been shown for selective attention. The neuronal latency of this reward value effect in V1 was similar to the latency of attentional influences. Moreover, V1 neurons with a strong value effect also exhibited a strong attention effect, which implies that relative value and top-down attention engage overlapping, if not identical, neuronal selection mechanisms. Our findings demonstrate that the effects of reward value reach down to the earliest sensory processing levels of the cerebral cortex and imply that theories about the effects of reward coding and top-down attention on visual representations should be unified.

Divergent Relationship of Depression Severity to Social Reward Responses Among Patients with Bipolar Versus Unipolar Depression

PubMed Central

Sharma, Anup; Satterthwaite, Theodore D.; Vandekar, Lillie; Katchmar, Natalie; Daldal, Aylin; Ruparel, Kosha; A.Elliott, Mark; Baldassano, Claudia; Thase, Michael E.; Gur, Raquel E.; Kable, Joseph W.; Wolf, Daniel H.

2016-01-01

Neuroimaging studies of mood disorders demonstrate abnormalities in brain regions implicated in reward processing. However, there is a paucity of research investigating how social rewards affect reward circuit activity in these disorders. Here, we evaluated the relationship of both diagnostic category and dimensional depression severity to reward system function in bipolar and unipolar depression. In total, 86 adults were included, including 24 patients with bipolar depression, 24 patients with unipolar depression, and 38 healthy comparison subjects. Participants completed a social reward task during 3T BOLD fMRI. On average, diagnostic groups did not differ in activation to social reward. However, greater depression severity significantly correlated with reduced bilateral ventral striatum activation to social reward in the bipolar depressed group, but not the unipolar depressed group. In addition, decreased left orbitofrontal cortical activation correlated with more severe symptoms in bipolar depression, but not unipolar depression. These differential dimensional effects resulted in a significant voxelwise group by depression severity interaction. Taken together, these results provide initial evidence that deficits in social reward processing are differentially related to depression severity in the two disorders. PMID:27295401

Cerebral interactions of pain and reward and their relevance for chronic pain.

PubMed

Becker, Susanne; Gandhi, Wiebke; Schweinhardt, Petra

2012-06-29

Pain and reward are opponent, interacting processes. Such interactions are enabled by neuroanatomical and neurochemical overlaps of brain systems that process pain and reward. Cerebral processing of hedonic ('liking') and motivational ('wanting') aspects of reward can be separated: the orbitofrontal cortex and opioids play an important role for the hedonic experience, and the ventral striatum and dopamine predominantly process motivation for reward. Supported by neuroimaging studies, we present here the hypothesis that the orbitofrontal cortex and opioids are responsible for pain modulation by hedonic experience, while the ventral striatum and dopamine mediate motivational effects on pain. A rewarding stimulus that appears to be particularly important in the context of pain is pain relief. Further, reward, including pain relief, leads to operant learning, which can affect pain sensitivity. Indirect evidence points at brain mechanisms that might underlie pain relief as a reward and related operant learning but studies are scarce. Investigating the cerebral systems underlying pain-reward interactions as well as related operant learning holds the potential of better understanding mechanisms that contribute to the development and maintenance of chronic pain, as detailed in the last section of this review. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

Neurophysiology of Reward-Guided Behavior: Correlates Related to Predictions, Value, Motivation, Errors, Attention, and Action

PubMed Central

Roesch, Matthew R.

2017-01-01

Many brain areas are activated by the possibility and receipt of reward. Are all of these brain areas reporting the same information about reward? Or are these signals related to other functions that accompany reward-guided learning and decision-making? Through carefully controlled behavioral studies, it has been shown that reward-related activity can represent reward expectations related to future outcomes, errors in those expectations, motivation, and signals related to goal- and habit-driven behaviors. These dissociations have been accomplished by manipulating the predictability of positively and negatively valued events. Here, we review single neuron recordings in behaving animals that have addressed this issue. We describe data showing that several brain areas, including orbitofrontal cortex, anterior cingulate, and basolateral amygdala signal reward prediction. In addition, anterior cingulate, basolateral amygdala, and dopamine neurons also signal errors in reward prediction, but in different ways. For these areas, we will describe how unexpected manipulations of positive and negative value can dissociate signed from unsigned reward prediction errors. All of these signals feed into striatum to modify signals that motivate behavior in ventral striatum and guide responding via associative encoding in dorsolateral striatum. PMID:26276036

Dissociating Motivation from Reward in Human Striatal Activity

PubMed Central

Miller, Eric M.; Shankar, Maya U.; Knutson, Brian; McClure, Samuel M.

2018-01-01

Neural activity in the striatum has consistently been shown to scale with the value of anticipated rewards. As a result, it is common across a number of neuroscientific subdiscliplines to associate activation in the striatum with anticipation of a rewarding outcome or a positive emotional state. However, most studies have failed to dissociate expected value from the motivation associated with seeking a reward. Although motivation generally scales positively with increases in potential reward, there are circumstances in which this linkage does not apply. The current study dissociates value-related activation from that induced by motivation alone by employing a task in which motivation increased as anticipated reward decreased. This design reverses the typical relationship between motivation and reward, allowing us to differentially investigate fMRI BOLD responses that scale with each. We report that activity scaled differently with value and motivation across the striatum. Specifically, responses in the caudate and putamen increased with motivation, whereas nucleus accumbens activity increased with expected reward. Consistent with this, self-report ratings indicated a positive association between caudate and putamen activity and arousal, whereas activity in the nucleus accumbens was more associated with liking. We conclude that there exist regional limits on inferring reward expectation from striatal activation. PMID:24345173

Reward deficiency and anti-reward in pain chronification.

PubMed

Borsook, D; Linnman, C; Faria, V; Strassman, A M; Becerra, L; Elman, I

2016-09-01

Converging lines of evidence suggest that the pathophysiology of pain is mediated to a substantial degree via allostatic neuroadaptations in reward- and stress-related brain circuits. Thus, reward deficiency (RD) represents a within-system neuroadaptation to pain-induced protracted activation of the reward circuits that leads to depletion-like hypodopaminergia, clinically manifested anhedonia, and diminished motivation for natural reinforcers. Anti-reward (AR) conversely pertains to a between-systems neuroadaptation involving over-recruitment of key limbic structures (e.g., the central and basolateral amygdala nuclei, the bed nucleus of the stria terminalis, the lateral tegmental noradrenergic nuclei of the brain stem, the hippocampus and the habenula) responsible for massive outpouring of stressogenic neurochemicals (e.g., norepinephrine, corticotropin releasing factor, vasopressin, hypocretin, and substance P) giving rise to such negative affective states as anxiety, fear and depression. We propose here the Combined Reward deficiency and Anti-reward Model (CReAM), in which biopsychosocial variables modulating brain reward, motivation and stress functions can interact in a 'downward spiral' fashion to exacerbate the intensity, chronicity and comorbidities of chronic pain syndromes (i.e., pain chronification). Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

Multi Agent Reward Analysis for Learning in Noisy Domains

NASA Technical Reports Server (NTRS)

Tumer, Kagan; Agogino, Adrian K.

2005-01-01

In many multi agent learning problems, it is difficult to determine, a priori, the agent reward structure that will lead to good performance. This problem is particularly pronounced in continuous, noisy domains ill-suited to simple table backup schemes commonly used in TD(lambda)/Q-learning. In this paper, we present a new reward evaluation method that allows the tradeoff between coordination among the agents and the difficulty of the learning problem each agent faces to be visualized. This method is independent of the learning algorithm and is only a function of the problem domain and the agents reward structure. We then use this reward efficiency visualization method to determine an effective reward without performing extensive simulations. We test this method in both a static and a dynamic multi-rover learning domain where the agents have continuous state spaces and where their actions are noisy (e.g., the agents movement decisions are not always carried out properly). Our results show that in the more difficult dynamic domain, the reward efficiency visualization method provides a two order of magnitude speedup in selecting a good reward. Most importantly it allows one to quickly create and verify rewards tailored to the observational limitations of the domain.

The Nucleus Accumbens and Pavlovian Reward Learning

PubMed Central

Day, Jeremy J.

2011-01-01

The ability to form associations between predictive environmental events and rewarding outcomes is a fundamental aspect of learned behavior. This apparently simple ability likely requires complex neural processing evolved to identify, seek, and utilize natural rewards and redirect these activities based on updated sensory information. Emerging evidence from both animal and human research suggests that this type of processing is mediated in part by the nucleus accumbens and a closely associated network of brain structures. The nucleus accumbens is required for a number of reward-related behaviors, and processes specific information about reward availability, value, and context. Additionally, this structure is critical for the acquisition and expression of most Pavlovian stimulus-reward relationships, and cues that predict rewards produce robust changes in neural activity in the nucleus accumbens. While processing within the nucleus accumbens may enable or promote Pavlovian reward learning in natural situations, it has also been implicated in aspects of human drug addiction, including the ability of drug-paired cues to control behavior. This article will provide a critical review of the existing animal and human literature concerning the role of the NAc in Pavlovian learning with non-drug rewards and consider some clinical implications of these findings. PMID:17404375

Neural reward and punishment sensitivity in cigarette smokers.

PubMed

Potts, Geoffrey F; Bloom, Erika L; Evans, David E; Drobes, David J

2014-11-01

Nicotine addiction remains a major public health problem but the neural substrates of addictive behavior remain unknown. One characteristic of smoking behavior is impulsive choice, selecting the immediate reward of smoking despite the potential long-term negative consequences. This suggests that drug users, including cigarette smokers, may be more sensitive to rewards and less sensitive to punishment. We used event-related potentials (ERPs) to test the hypothesis that smokers are more responsive to reward signals and less responsive to punishment, potentially predisposing them to risky behavior. We conducted two experiments, one using a reward prediction design to elicit a Medial Frontal Negativity (MFN) and one using a reward- and punishment-motivated flanker task to elicit an Error Related Negativity (ERN), ERP components thought to index activity in the cortical projection of the dopaminergic reward system. The smokers had a greater MFN response to unpredicted rewards, and non-smokers, but not smokers, had a larger ERN on punishment motivated trials indicating that smokers are more reward sensitive and less punishment sensitive than nonsmokers, overestimating the appetitive value and underestimating aversive outcomes of stimuli and actions. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

U.S. Geological Survey Rewarding Environment Culture Study, 2002

USGS Publications Warehouse

Nash, Janis C.; Paradise-Tornow, Carol A.; Gray, Vicki K.; Griffin-Bemis, Sarah P.; Agnew, Pamela R.; Bouchet, Nicole M.

2010-01-01

In its 2001 review of the U.S. Geological Survey (USGS), the National Research Council (NRC, p. 126) cautioned that ?high-quality personnel are essential for developing high-quality science information? and urged the USGS to ?devote substantial efforts to recruiting and retaining excellent staff.? Recognizing the importance of the NRC recommendation, the USGS has committed time and resources to create a rewarding work environment with the goal of achieving the following valued outcomes: ? USGS science vitality ? Customer satisfaction with USGS products and services ? Employee perceptions of the USGS as a rewarding place to work ? Heightened employee morale and commitment ? The ability to recruit and retain employees with critical skills To determine whether this investment of time and resources was proving to be successful, the USGS Human Resources Office conducted a Rewarding Environment Culture Study to answer the following four questions. ? Question 1: Does a rewarding work environment lead to the valued outcomes (identified above) that the USGS is seeking? ? Question 2: Which management, supervisory, and leadership behaviors contribute most to creating a rewarding work environment and to achieving the valued outcomes that the USGS is seeking? ? Question 3: Do USGS employees perceive that the USGS is a rewarding place to work? ? Question 4: What actions can and should be taken to enhance the USGS work environment? To begin the study, a conceptual model of a rewarding USGS environment was developed to test assumptions about a rewarding work environment. The Rewarding Environment model identifies the key components that are thought to contribute to a rewarding work environment and the valued outcomes that are thought to result from having a rewarding work environment. The 2002 Organizational Assessment Survey (OAS) was used as the primary data source for the study because it provided the most readily available data. Additional survey data were included as they became available The dividends of creating a rewarding work environment can be great. As the results of the USGS Rewarding Environment Culture Study of 2002 indicate, creating a rewarding work environment is an investment that can have an important impact on the outcomes that the USGS values?the vitality of our science, the satisfaction of our customers, and the morale, commitment, and performance of our employees.

Group Rewards Make Groupwork Work.

ERIC Educational Resources Information Center

Slavin, Robert E.

1991-01-01

Critiques Kohn's article (in the same "Educational Leadership" issue) arguing against the use of cooperative rewards. Without group rewards based on the learning of all group members, cooperative learning can degenerate into answer-sharing. The idea that such rewards (usually paper certificates) can be dispensed with is wishful thinking. Includes…

Reward, Distraction, and the Overjustification Effect

ERIC Educational Resources Information Center

Smith, Timothy W.; Pittman, Thane S.

1978-01-01

This study tests two differing hypotheses: the competing response hypothesis, which states that both reward and non-reward distractions produce decreases in interest which weaken over repeated trials, and the attribution/overjustification hypothesis, which maintains that rewards produce a decrease in interest that does not weaken over trials.…

Reinforcement, Behavior Constraint, and the Overjustification Effect.

ERIC Educational Resources Information Center

Williams, Bruce W.

1980-01-01

Four levels of the behavior constraint-reinforcement variable were manipulated: attractive reward, unattractive reward, request to perform, and a no-reward control. Only the unattractive reward and request groups showed the performance decrements that suggest the overjustification effect. It is concluded that reinforcement does not cause the…

Enriched encoding: reward motivation organizes cortical networks for hippocampal detection of unexpected events.

PubMed

Murty, Vishnu P; Adcock, R Alison

2014-08-01

Learning how to obtain rewards requires learning about their contexts and likely causes. How do long-term memory mechanisms balance the need to represent potential determinants of reward outcomes with the computational burden of an over-inclusive memory? One solution would be to enhance memory for salient events that occur during reward anticipation, because all such events are potential determinants of reward. We tested whether reward motivation enhances encoding of salient events like expectancy violations. During functional magnetic resonance imaging, participants performed a reaction-time task in which goal-irrelevant expectancy violations were encountered during states of high- or low-reward motivation. Motivation amplified hippocampal activation to and declarative memory for expectancy violations. Connectivity of the ventral tegmental area (VTA) with medial prefrontal, ventrolateral prefrontal, and visual cortices preceded and predicted this increase in hippocampal sensitivity. These findings elucidate a novel mechanism whereby reward motivation can enhance hippocampus-dependent memory: anticipatory VTA-cortical-hippocampal interactions. Further, the findings integrate literatures on dopaminergic neuromodulation of prefrontal function and hippocampus-dependent memory. We conclude that during reward motivation, VTA modulation induces distributed neural changes that amplify hippocampal signals and records of expectancy violations to improve predictions-a potentially unique contribution of the hippocampus to reward learning. © The Author 2013. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

Measuring Social Motivation Using Signal Detection and Reward Responsiveness.

PubMed

Chevallier, Coralie; Tonge, Natasha; Safra, Lou; Kahn, David; Kohls, Gregor; Miller, Judith; Schultz, Robert T

2016-01-01

Recent trends in psychiatry have emphasized the need for a shift from categorical to dimensional approaches. Of critical importance to this transformation is the availability of tools to objectively quantify behaviors dimensionally. The present study focuses on social motivation, a dimension of behavior that is central to a range of psychiatric conditions but for which a particularly small number of assays currently exist. In Study 1 (N = 48), healthy adults completed a monetary reward task and a social reward task, followed by completion of the Chapman Physical and Social Anhedonia Scales. In Study 2 (N = 26), an independent sample was recruited to assess the robustness of Study 1's findings. The reward tasks were analyzed using signal detection theory to quantify how much reward cues bias participants' responses. In both Study 1 and Study 2, social anhedonia scores were negatively correlated with change in response bias in the social reward task but not in the monetary reward task. A median split on social anhedonia scores confirmed that participants with high social anhedonia showed less change in response bias in the social reward task compared to participants with low social anhedonia. This study confirms that social anhedonia selectively affects how much an individual changes their behavior based on the presence of socially rewarding cues and establishes a tool to quantify social reward responsiveness dimensionally.

The evolution of anti-social rewarding and its countermeasures in public goods games.

PubMed

dos Santos, Miguel

2015-01-07

Cooperation in joint enterprises can easily break down when self-interests are in conflict with collective benefits, causing a tragedy of the commons. In such social dilemmas, the possibility for contributors to invest in a common pool-rewards fund, which will be shared exclusively among contributors, can be powerful for averting the tragedy, as long as the second-order dilemma (i.e. withdrawing contribution to reward funds) can be overcome (e.g. with second-order sanctions). However, the present paper reveals the vulnerability of such pool-rewarding mechanisms to the presence of reward funds raised by defectors and shared among them (i.e. anti-social rewarding), as it causes a cooperation breakdown, even when second-order sanctions are possible. I demonstrate that escaping this social trap requires the additional condition that coalitions of defectors fare poorly compared with pro-socials, with either (i) better rewarding abilities for the latter or (ii) reward funds that are contingent upon the public good produced beforehand, allowing groups of contributors to invest more in reward funds than groups of defectors. These results suggest that the establishment of cooperation through a collective positive incentive mechanism is highly vulnerable to anti-social rewarding and requires additional countermeasures to act in combination with second-order sanctions. © 2014 The Author(s) Published by the Royal Society. All rights reserved.

Effort-Reward Imbalance and Post-Traumatic Stress After a Workplace Terror Attack.

PubMed

Hem, Camilla; Nielsen, Morten Birkeland; Hansen, Marianne Bang; Heir, Trond

2016-04-01

Following adverse work conditions, health consequences can be explained by an imbalance between the effort made and the reward received. We investigated the association between extra effort, perceived reward, and post-traumatic stress disorder (PTSD). The Effort-Reward Imbalance Model was used to examine whether extra effort at work in the aftermath of a workplace-related terrorist attack affected the risk of PTSD and the effects of reward for extra effort from a leader or colleagues. Cross-sectional data were collected 10 months after a terrorist attack in Norway in 2011. Out of 3520 Ministry employees invited, 1927 agreed to participate. Employees reported any extra effort performed as a result of the bomb explosion and any reward received from a leader or colleagues. PTSD was assessed with the PTSD Checklist. Employees who reported extra effort displayed increased risk for PTSD (odds ratio [OR]=1.71, 95% confidence interval [CI]: 1.15-2.55, P=0.008). Perceived reward for extra effort from a leader was associated with lower risk for PTSD (OR=0.39, 95% CI: 0.23-0.64, P<0.001) but not perceived reward from colleagues. Extra effort may increase the risk of PTSD, but reward from a leader may mitigate this effect. The Effort-Reward Imbalance Model appears to be an appropriate approach that may contribute to understanding of the etiology of work-related PTSD.

The impact of instrumental feeding on children's responses to taste exposure.

PubMed

Añez, E; Remington, A; Wardle, J; Cooke, L

2013-10-01

In a recent study, we showed that nonfood incentives combined with taste exposure increase children's acceptance of vegetables. However, the impact of children's previous experience of receiving food rewards is unknown. The present study investigated whether the experience of food rewards affects responses to an exposure-plus-reward intervention. One hundred and thirty-seven parents of 4-6-year-old children taking part in an exposure-based intervention study completed an instrumental feeding (IF) questionnaire aiming to assess their use of food rewards. Based on these scores, children were categorised as frequently or rarely instrumentally-fed. Intervention groups were given 12 daily tastes of a target vegetable combined with no reward, a tangible reward, (sticker) or a verbal reward (praise). A no-treatment control group received no tastings. Liking and intake of a target vegetable were measured at baseline and post-intervention. Irrespective of experience of IF, children in all intervention groups increased liking compared to controls (all P < 0.001) and both reward groups increased intake compared to controls (both P < 0.05). However, in the nonrewarded exposure group, only children with a limited experience with food rewards increased consumption (P < 0.05). Experience of IF may limit the benefits of 'mere exposure'. However, exposure with nonfood rewards can increase the acceptance of vegetables, regardless of previous experience. © 2012 The Authors Journal of Human Nutrition and Dietetics © 2012 The British Dietetic Association Ltd.

Separating the effect of reward from corrective feedback during learning in patients with Parkinson's disease.

PubMed

Freedberg, Michael; Schacherer, Jonathan; Chen, Kuan-Hua; Uc, Ergun Y; Narayanan, Nandakumar S; Hazeltine, Eliot

2017-06-01

Parkinson's disease (PD) is associated with procedural learning deficits. Nonetheless, studies have demonstrated that reward-related learning is comparable between patients with PD and controls (Bódi et al., Brain, 132(9), 2385-2395, 2009; Frank, Seeberger, & O'Reilly, Science, 306(5703), 1940-1943, 2004; Palminteri et al., Proceedings of the National Academy of Sciences of the United States of America, 106(45), 19179-19184, 2009). However, because these studies do not separate the effect of reward from the effect of practice, it is difficult to determine whether the effect of reward on learning is distinct from the effect of corrective feedback on learning. Thus, it is unknown whether these group differences in learning are due to reward processing or learning in general. Here, we compared the performance of medicated PD patients to demographically matched healthy controls (HCs) on a task where the effect of reward can be examined separately from the effect of practice. We found that patients with PD showed significantly less reward-related learning improvements compared to HCs. In addition, stronger learning of rewarded associations over unrewarded associations was significantly correlated with smaller skin-conductance responses for HCs but not PD patients. These results demonstrate that when separating the effect of reward from the effect of corrective feedback, PD patients do not benefit from reward.

A temporal basis for Weber's law in value perception.

PubMed

Namboodiri, Vijay Mohan K; Mihalas, Stefan; Hussain Shuler, Marshall G

2014-01-01

Weber's law-the observation that the ability to perceive changes in magnitudes of stimuli is proportional to the magnitude-is a widely observed psychophysical phenomenon. It is also believed to underlie the perception of reward magnitudes and the passage of time. Since many ecological theories state that animals attempt to maximize reward rates, errors in the perception of reward magnitudes and delays must affect decision-making. Using an ecological theory of decision-making (TIMERR), we analyze the effect of multiple sources of noise (sensory noise, time estimation noise, and integration noise) on reward magnitude and subjective value perception. We show that the precision of reward magnitude perception is correlated with the precision of time perception and that Weber's law in time estimation can lead to Weber's law in value perception. The strength of this correlation is predicted to depend on the reward history of the animal. Subsequently, we show that sensory integration noise (either alone or in combination with time estimation noise) also leads to Weber's law in reward magnitude perception in an accumulator model, if it has balanced Poisson feedback. We then demonstrate that the noise in subjective value of a delayed reward, due to the combined effect of noise in both the perception of reward magnitude and delay, also abides by Weber's law. Thus, in our theory we prove analytically that the perception of reward magnitude, time, and subjective value change all approximately obey Weber's law.

Reward processing in the value-driven attention network: reward signals tracking cue identity and location.

PubMed

Anderson, Brian A

2017-03-01

Through associative reward learning, arbitrary cues acquire the ability to automatically capture visual attention. Previous studies have examined the neural correlates of value-driven attentional orienting, revealing elevated activity within a network of brain regions encompassing the visual corticostriatal loop [caudate tail, lateral occipital complex (LOC) and early visual cortex] and intraparietal sulcus (IPS). Such attentional priority signals raise a broader question concerning how visual signals are combined with reward signals during learning to create a representation that is sensitive to the confluence of the two. This study examines reward signals during the cued reward training phase commonly used to generate value-driven attentional biases. High, compared with low, reward feedback preferentially activated the value-driven attention network, in addition to regions typically implicated in reward processing. Further examination of these reward signals within the visual system revealed information about the identity of the preceding cue in the caudate tail and LOC, and information about the location of the preceding cue in IPS, while early visual cortex represented both location and identity. The results reveal teaching signals within the value-driven attention network during associative reward learning, and further suggest functional specialization within different regions of this network during the acquisition of an integrated representation of stimulus value. © The Author (2016). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Learning Reward Uncertainty in the Basal Ganglia

PubMed Central

Bogacz, Rafal

2016-01-01

Learning the reliability of different sources of rewards is critical for making optimal choices. However, despite the existence of detailed theory describing how the expected reward is learned in the basal ganglia, it is not known how reward uncertainty is estimated in these circuits. This paper presents a class of models that encode both the mean reward and the spread of the rewards, the former in the difference between the synaptic weights of D1 and D2 neurons, and the latter in their sum. In the models, the tendency to seek (or avoid) options with variable reward can be controlled by increasing (or decreasing) the tonic level of dopamine. The models are consistent with the physiology of and synaptic plasticity in the basal ganglia, they explain the effects of dopaminergic manipulations on choices involving risks, and they make multiple experimental predictions. PMID:27589489

Synchronization in monkey visual cortex analyzed with an information-theoretic measure

NASA Astrophysics Data System (ADS)

Manyakov, Nikolay V.; Van Hulle, Marc M.

2008-09-01

We apply an information-theoretic measure for phase synchrony to local field potentials recorded with a multi-electrode array implanted in area V4 of the monkey visual cortex during a reinforcement pairing experiment. We show for the first time that (1) the phase synchrony is significantly higher for the rewarded stimulus than the unrewarded one, after training the monkey; (2) just after the stimuli reversal, the difference in phase synchronization is due to the stimuli, not the reward; (3) the difference between reward and no reward is most clear in two disconnected time intervals between stimuli onset and the expected delivery of the reward; and (4) synchronous activity appears in waves running over the array, and their timing correlates well with the time intervals where the difference between reward and no reward is most prominent.

Probing reward function in posttraumatic stress disorder: expectancy and satisfaction with monetary gains and losses.

PubMed

Hopper, James W; Pitman, Roger K; Su, Zhaohui; Heyman, Gene M; Lasko, Natasha B; Macklin, Michael L; Orr, Scott P; Lukas, Scott E; Elman, Igor

2008-08-01

Posttraumatic stress disorder (PTSD) may be associated with dysfunctional reward processing. The present study assessed for such dysfunction in both the expectancy and outcome phases of reward processing. Male Vietnam veterans with (n=15) and without (n=11) combat-related PTSD were administered a wheel of fortune-type gambling task. Self-reported ratings of expectancy and satisfaction were collected respectively before and after each experience of monetary gain or loss. PTSD participants reported both lower expectancy of reward and lower satisfaction with reward when it was received. The latter result was manifest in a failure of PTSD participants to show the greater satisfaction that normally accompanies rewards received under conditions of low expectancy. These results suggest reward function impairment in PTSD related to expectancy, satisfaction, and the expectancy-satisfaction relationship.

Microstimulation of the Human Substantia Nigra Alters Reinforcement Learning

PubMed Central

Ramayya, Ashwin G.; Misra, Amrit

2014-01-01

Animal studies have shown that substantia nigra (SN) dopaminergic (DA) neurons strengthen action–reward associations during reinforcement learning, but their role in human learning is not known. Here, we applied microstimulation in the SN of 11 patients undergoing deep brain stimulation surgery for the treatment of Parkinson's disease as they performed a two-alternative probability learning task in which rewards were contingent on stimuli, rather than actions. Subjects demonstrated decreased learning from reward trials that were accompanied by phasic SN microstimulation compared with reward trials without stimulation. Subjects who showed large decreases in learning also showed an increased bias toward repeating actions after stimulation trials; therefore, stimulation may have decreased learning by strengthening action–reward associations rather than stimulus–reward associations. Our findings build on previous studies implicating SN DA neurons in preferentially strengthening action–reward associations during reinforcement learning. PMID:24828643

Missing motoric manipulations: rethinking the imaging of the ventral striatum and dopamine in human reward.

PubMed

Kareken, David A

2018-01-26

Human neuroimaging studies of natural rewards and drugs of abuse frequently assay the brain's response to stimuli that, through Pavlovian learning, have come to be associated with a drug's rewarding properties. This might be characterized as a 'sensorial' view of the brain's reward system, insofar as the paradigms are designed to elicit responses to a reward's (drug's) sight, aroma, or flavor. A different field of research nevertheless suggests that the mesolimbic dopamine system may also be critically involved in the motor behaviors provoked by such stimuli. This brief review and commentary surveys some of the preclinical data supporting this more "efferent" (motoric) view of the brain's reward system, and discusses what such findings might mean for how human brain imaging studies of natural rewards and drugs of abuse are designed.

Extrinsic Rewards Diminish Costly Sharing in 3-Year-Olds.

PubMed

Ulber, Julia; Hamann, Katharina; Tomasello, Michael

2016-07-01

Two studies investigated the influence of external rewards and social praise in young children's fairness-related behavior. The motivation of ninety-six 3-year-olds' to equalize unfair resource allocations was measured in three scenarios (collaboration, windfall, and dictator game) following three different treatments (material reward, verbal praise, and neutral response). In all scenarios, children's willingness to engage in costly sharing was negatively influenced when they had received a reward for equal sharing during treatment than when they had received praise or no reward. The negative effect of material rewards was not due to subjects responding in kind to their partner's termination of rewards. These results provide new evidence for the intrinsic motivation of prosociality-in this case, costly sharing behavior-in preschool children. © 2016 The Authors. Child Development © 2016 Society for Research in Child Development, Inc.

Effect of current on the maximum possible reward.

PubMed

Gallistel, C R; Leon, M; Waraczynski, M; Hanau, M S

1991-12-01

Using a 2-lever choice paradigm with concurrent variable interval schedules of reward, it was found that when pulse frequency is increased, the preference-determining rewarding effect of 0.5-s trains of brief cathodal pulses delivered to the medial forebrain bundle of the rat saturates (stops increasing) at values ranging from 200 to 631 pulses/s (pps). Raising the current lowered the saturation frequency, which confirms earlier, more extensive findings showing that the rewarding effect of short trains saturates at pulse frequencies that vary from less than 100 pps to more than 800 pps, depending on the current. It was also found that the maximum possible reward--the magnitude of the reward at or beyond the saturation pulse frequency--increases with increasing current. Thus, increasing the current reduces the saturation frequency but increases the subjective magnitude of the maximum possible reward.

Distinct representations for shifts of spatial attention and changes of reward contingencies in the human brain

PubMed Central

Tosoni, Annalisa; Shulman, Gordon L.; Pope, Anna L. W.; McAvoy, Mark P.; Corbetta, Maurizio

2012-01-01

Success in a dynamically changing world requires both rapid shifts of attention to the location of important objects and the detection of changes in motivational contingencies that may alter future behavior. Here we addressed the relationship between these two processes by measuring the blood-oxygenation-level-dependent (BOLD) signal during a visual search task in which the location and the color of a salient cue respectively indicated where a rewarded target would appear and the monetary gain (large or small) associated with its detection. While cues that either shifted or maintained attention were presented every 4 to 8 seconds, the reward magnitude indicated by the cue changed roughly every 30 seconds, allowing us to distinguish a change in expected reward magnitude from a maintained state of expected reward magnitude. Posterior cingulate cortex was modulated by cues signaling an increase in expected reward magnitude, but not by cues for shifting versus maintaining spatial attention. Dorsal fronto-parietal regions in precuneus and FEF also showed increased BOLD activity for changes in expected reward magnitude from low to high, but in addition showed large independent modulations for shifting versus maintaining attention. In particular, the differential activation for shifting versus maintaining attention was not affected by expected reward magnitude. These results indicate that BOLD activations for shifts of attention and increases in expected reward magnitude are largely separate. Finally, visual cortex showed sustained spatially selective signals that were significantly enhanced when greater reward magnitude was expected, but this reward-related modulation was not observed in spatially selective regions of dorsal fronto-parietal cortex. PMID:22578709

Neural alterations of fronto-striatal circuitry during reward anticipation in euthymic bipolar disorder.

PubMed

Schreiter, S; Spengler, S; Willert, A; Mohnke, S; Herold, D; Erk, S; Romanczuk-Seiferth, N; Quinlivan, E; Hindi-Attar, C; Banzhaf, C; Wackerhagen, C; Romund, L; Garbusow, M; Stamm, T; Heinz, A; Walter, H; Bermpohl, F

2016-11-01

Bipolar disorder (BD), with the hallmark symptoms of elevated and depressed mood, is thought to be characterized by underlying alterations in reward-processing networks. However, to date the neural circuitry underlying abnormal responses during reward processing in BD remains largely unexplored. The aim of this study was to investigate whether euthymic BD is characterized by aberrant ventral striatal (VS) activation patterns and altered connectivity with the prefrontal cortex in response to monetary gains and losses. During functional magnetic resonance imaging 20 euthymic BD patients and 20 age-, gender- and intelligence quotient-matched healthy controls completed a monetary incentive delay paradigm, to examine neural processing of reward and loss anticipation. A priori defined regions of interest (ROIs) included the VS and the anterior prefrontal cortex (aPFC). Psychophysiological interactions (PPIs) between these ROIs were estimated and tested for group differences for reward and loss anticipation separately. BD participants, relative to healthy controls, displayed decreased activation selectively in the left and right VS during anticipation of reward, but not during loss anticipation. PPI analyses showed decreased functional connectivity between the left VS and aPFC in BD patients compared with healthy controls during reward anticipation. This is the first study showing decreased VS activity and aberrant connectivity in the reward-processing circuitry in euthymic, medicated BD patients during reward anticipation. Our findings contrast with research supporting a reward hypersensitivity model of BD, and add to the body of literature suggesting that blunted activation of reward processing circuits may be a vulnerability factor for mood disorders.

Motivational orientation modulates the neural response to reward.

PubMed

Linke, Julia; Kirsch, Peter; King, Andrea V; Gass, Achim; Hennerici, Michael G; Bongers, André; Wessa, Michèle

2010-02-01

Motivational orientation defines the source of motivation for an individual to perform a particular action and can either originate from internal desires (e.g., interest) or external compensation (e.g., money). To this end, motivational orientation should influence the way positive or negative feedback is processed during learning situations and this might in turn have an impact on the learning process. In the present study, we thus investigated whether motivational orientation, i.e., extrinsic and intrinsic motivation modulates the neural response to reward and punishment as well as learning from reward and punishment in 33 healthy individuals. To assess neural responses to reward, punishment and learning of reward contingencies we employed a probabilistic reversal learning task during functional magnetic resonance imaging. Extrinsic and intrinsic motivation were assessed with a self-report questionnaire. Rewarding trials fostered activation in the medial orbitofrontal cortex and anterior cingulate gyrus (ACC) as well as the amygdala and nucleus accumbens, whereas for punishment an increased neural response was observed in the medial and inferior prefrontal cortex, the superior parietal cortex and the insula. High extrinsic motivation was positively correlated to increased neural responses to reward in the ACC, amygdala and putamen, whereas a negative relationship between intrinsic motivation and brain activation in these brain regions was observed. These findings show that motivational orientation indeed modulates the responsiveness to reward delivery in major components of the human reward system and therefore extends previous results showing a significant influence of individual differences in reward-related personality traits on the neural processing of reward. Copyright (c) 2009 Elsevier Inc. All rights reserved.

Value and probability coding in a feedback-based learning task utilizing food rewards.

PubMed

Tricomi, Elizabeth; Lempert, Karolina M

2015-01-01

For the consequences of our actions to guide behavior, the brain must represent different types of outcome-related information. For example, an outcome can be construed as negative because an expected reward was not delivered or because an outcome of low value was delivered. Thus behavioral consequences can differ in terms of the information they provide about outcome probability and value. We investigated the role of the striatum in processing probability-based and value-based negative feedback by training participants to associate cues with food rewards and then employing a selective satiety procedure to devalue one food outcome. Using functional magnetic resonance imaging, we examined brain activity related to receipt of expected rewards, receipt of devalued outcomes, omission of expected rewards, omission of devalued outcomes, and expected omissions of an outcome. Nucleus accumbens activation was greater for rewarding outcomes than devalued outcomes, but activity in this region did not correlate with the probability of reward receipt. Activation of the right caudate and putamen, however, was largest in response to rewarding outcomes relative to expected omissions of reward. The dorsal striatum (caudate and putamen) at the time of feedback also showed a parametric increase correlating with the trialwise probability of reward receipt. Our results suggest that the ventral striatum is sensitive to the motivational relevance, or subjective value, of the outcome, while the dorsal striatum codes for a more complex signal that incorporates reward probability. Value and probability information may be integrated in the dorsal striatum, to facilitate action planning and allocation of effort. Copyright © 2015 the American Physiological Society.

Enhanced neural responsiveness to reward associated with obesity in the absence of food-related stimuli.

PubMed

Opel, Nils; Redlich, Ronny; Grotegerd, Dominik; Dohm, Katharina; Haupenthal, Cordula; Heindel, Walter; Kugel, Harald; Arolt, Volker; Dannlowski, Udo

2015-06-01

Obesity has been characterized by alterations in brain structure and function associated with emotion processing and regulation. Particularly, aberrations in food-related reward processing have been frequently demonstrated in obese subjects. However, it remains unclear whether reward-associated functional aberrations in obesity are specific for food-related stimuli or represent a general deficit in reward processing, extending to other stimulus domains. Given the crucial role of rewarding effects in the development of obesity and the ongoing discussion on overlapping neurobiological traits of obesity and psychiatric disorders such as depression and substance-related disorders, this study aimed to investigate the possibility of altered reward processing in obese subjects to occur in the absence of food-related stimuli during a monetary reward condition. Twenty-nine healthy obese subjects (body mass index >30) and 29 healthy, age-, and sex-matched control subjects of normal weight underwent functional MRI during a frequently used card guessing paradigm. A Group × Condition (win vs. loss) ANOVA was conducted to investigate differences between obese and normal-weight subjects. We found significant Group × Condition interaction effects in brain areas involved in emotion regulation and reward processing including the insula, the striatum, and the orbitofrontal cortex (OFC). This interaction was predominantly driven by a significant increase in blood oxygenation level dependent (BOLD) response in obese individuals while experiencing reward. Enhanced neural activation in obesity during reward processing seems to be apparent even in the absence of food-related stimuli and, thus, might point to generalized dysfunctions in reward-related brain circuits in obese individuals. © 2015 Wiley Periodicals, Inc.

A longitudinal examination of event-related potentials sensitive to monetary reward and loss feedback from late childhood to middle adolescence.

PubMed

Kujawa, Autumn; Carroll, Ashley; Mumper, Emma; Mukherjee, Dahlia; Kessel, Ellen M; Olino, Thomas; Hajcak, Greg; Klein, Daniel N

2017-11-04

Brain regions involved in reward processing undergo developmental changes from childhood to adolescence, and alterations in reward-related brain function are thought to contribute to the development of psychopathology. Event-related potentials (ERPs), such as the reward positivity (RewP) component, are valid measures of reward responsiveness that are easily assessed across development and provide insight into temporal dynamics of reward processing. Little work has systematically examined developmental changes in ERPs sensitive to reward. In this longitudinal study of 75 youth assessed 3 times across 6years, we used principal components analyses (PCA) to differentiate ERPs sensitive to monetary reward and loss feedback in late childhood, early adolescence, and middle adolescence. We then tested reliability of, and developmental changes in, ERPs. A greater number of ERP components differentiated reward and loss feedback in late childhood compared to adolescence, but components in childhood accounted for only a small proportion of variance. A component consistent with RewP was the only one to consistently emerge at each of the 3 assessments. RewP demonstrated acceptable reliability, particularly from early to middle adolescence, though reliability estimates varied depending on scoring approach and developmental period. The magnitude of the RewP component did not significantly change across time. Results provide insight into developmental changes in the structure of ERPs sensitive to reward, and indicate that RewP is a consistently observed and relatively stable measure of reward responsiveness, particularly across adolescence. Copyright © 2017. Published by Elsevier B.V.

Long term voluntary wheel running is rewarding and produces plasticity in the mesolimbic reward pathway

PubMed Central

Greenwood, Benjamin N.; Foley, Teresa E.; Le, Tony V.; Strong, Paul V.; Loughridge, Alice B.; Day, Heidi E.W.; Fleshner, Monika

2011-01-01

The mesolimbic reward pathway is implicated in stress-related psychiatric disorders and is a potential target of plasticity underlying the stress resistance produced by repeated voluntary exercise. It is unknown, however, whether rats find long-term access to running wheels rewarding, or if repeated voluntary exercise reward produces plastic changes in mesolimbic reward neurocircuitry. In the current studies, young adult, male Fischer 344 rats allowed voluntary access to running wheels for 6 weeks, but not 2 weeks, found wheel running rewarding, as measured by conditioned place preference (CPP). Consistent with prior reports and the behavioral data, 6 weeks of wheel running increased ΔFosB/FosB immunoreactivity in the nucleus accumbens (Acb). In addition, semi quantitative in situ hybridization revealed that 6 weeks of wheel running, compared to sedentary housing, increased tyrosine hydroxylase (TH) mRNA levels in the ventral tegmental area (VTA), increased delta opioid receptor (DOR) mRNA levels in the Acb shell, and reduced levels of dopamine receptor (DR)-D2 mRNA in the Acb core. Results indicate that repeated voluntary exercise is rewarding and alters gene transcription in mesolimbic reward neurocircuitry. The duration-dependent effects of wheel running on CPP suggest that as the weeks of wheel running progress, the rewarding effects of a night of voluntary wheel running might linger longer into the inactive cycle thus providing stronger support for CPP. The observed plasticity could contribute to the mechanisms by which exercise reduces the incidence and severity of substance abuse disorders, changes the rewarding properties of drugs of abuse, and facilitates successful coping with stress. PMID:21070820

Comparing Apples and Oranges: Using Reward-Specific and Reward-General Subjective Value Representation in the Brain

PubMed Central

Glimcher, Paul W.

2011-01-01

The ability of human subjects to choose between disparate kinds of rewards suggests that the neural circuits for valuing different reward types must converge. Economic theory suggests that these convergence points represent the subjective values (SVs) of different reward types on a common scale for comparison. To examine these hypotheses and to map the neural circuits for reward valuation we had food and water-deprived subjects make risky choices for money, food, and water both in and out of a brain scanner. We found that risk preferences across reward types were highly correlated; the level of risk aversion an individual showed when choosing among monetary lotteries predicted their risk aversion toward food and water. We also found that partially distinct neural networks represent the SVs of monetary and food rewards and that these distinct networks showed specific convergence points. The hypothalamic region mainly represented the SV for food, and the posterior cingulate cortex mainly represented the SV for money. In both the ventromedial prefrontal cortex (vmPFC) and striatum there was a common area representing the SV of both reward types, but only the vmPFC significantly represented the SVs of money and food on a common scale appropriate for choice in our data set. A correlation analysis demonstrated interactions across money and food valuation areas and the common areas in the vmPFC and striatum. This may suggest that partially distinct valuation networks for different reward types converge on a unified valuation network, which enables a direct comparison between different reward types and hence guides valuation and choice. PMID:21994386

Mental Imagery Training Increases Wanting of Rewards and Reward Sensitivity and Reduces Depressive Symptoms.

PubMed

Linke, Julia; Wessa, Michèle

2017-09-01

High reward sensitivity and wanting of rewarding stimuli help to identify and motivate repetition of pleasant activities. This behavioral activation is thought to increase positive emotions. Therefore, both mechanisms are highly relevant for resilience against depressive symptoms. Yet, these mechanisms have not been targeted by psychotherapeutic interventions. In the present study, we tested a mental imagery training comprising eight 10-minute sessions every second day and delivered via the Internet to healthy volunteers (N = 30, 21 female, mean age of 23.8 years, Caucasian) who were preselected for low reward sensitivity. Participants were paired according to age, sex, reward sensitivity, and mental imagery ability. Then, members of each pair were randomly assigned to either the intervention or wait condition. Ratings of wanting and response bias toward probabilistic reward cues (Probabilistic Reward Task) served as primary outcomes. We further tested whether training effects extended to approach behavior (Approach Avoidance Task) and depressive symptoms (Beck Depression Inventory). The intervention led to an increase in wanting (p < .001, η 2 p = .45) and reward sensitivity (p = .004, η 2 p = .27). Further, the training group displayed faster approach toward positive edibles and activities (p = .025, η 2 p = .18) and reductions in depressive symptoms (p = .028, η 2 p = .16). Results extend existing literature by showing that mental imagery training can increase wanting of rewarding stimuli and reward sensitivity. Further, the training appears to reduce depressive symptoms and thus may foster the successful implementation of exsiting treatments for depression such as behavioral activation and could also increase resilience against depressive symptoms. Copyright © 2017. Published by Elsevier Ltd.

Reduced posterior mesofrontal cortex activation by risky rewards in substance-dependent patients.

PubMed

Bjork, James M; Momenan, Reza; Smith, Ashley R; Hommer, Daniel W

2008-05-01

Substance-dependent individuals show disadvantageous decision-making, as well as alterated frontocortical recruitment when performing experimental tasks. We investigated whether substance-dependent patients (SDP) would show blunted recruitment of posterior mesofrontal cortex (PMC) by a conflict between concurrently increasing reward and risk of penalty in a monetary game of "chicken." SDP and controls performed: motor control (no reward) trials, guaranteed reward trials in which reward was not at risk, and risky trials where subjects were required to terminate their reward accrual before a secret varying time limit or else "bust" and forfeit that trial's winnings (low penalty) or the current trial's winnings plus an equal amount of previous winnings (high penalty). Reward accrual duration at risk of "busting" correlated negatively with trait neuroticism. The contrast between winning guaranteed reward versus non-reward activated the caudate head bilaterally in SDP but not controls. Accumulation of money at risk of low- or high-penalty (contrasted with accumulating guaranteed money) activated the PMC in both groups, but with a greater magnitude and more anterior extent in controls. Pre-decision signal increase in a PMC volume of interest negatively correlated with risk-taking in low-penalty trials, and was blunted in SDP relative to controls under both penalty conditions after controlling for individual differences in actual risk-taking and the higher neuroticism of SDP. These data suggest that SDP are characterized by a combination of: (a) striatal hypersensitivity to reward, and (b) under-recruitment of the specialized conflict-monitoring circuitry of the PMC when reward entails potential penalties.

Estradiol is a critical regulator of food-reward behavior.

PubMed

Richard, Jennifer E; López-Ferreras, Lorena; Anderberg, Rozita H; Olandersson, Kajsa; Skibicka, Karolina P

2017-04-01

Food intake is reduced by estrogenic hormones, levels of which vary throughout life and fluctuate throughout the ovarian cycle in females. However, estrogens have also been shown to increase reward derived from drugs of abuse, where motivational properties of drugs and progression to addiction are potentiated by estrogens. Whether reward derived from food, and specifically motivational properties of food, are altered by estrogens remains unknown. Here we investigated the effect of the estrous cycle on food reward behavior and show estrous cycle dictated variability in food motivation, measured by progressive ratio operant conditioning, in female rats. Reward behavior was lowest on days associated with high estrogen signaling. We therefore also examined the actions of subcutaneously administered β-estradiol on food reward and found that β-estradiol reduced food reward behavior. The ventral tegmental area (VTA) is a crucial node of the neurocircuitry underlying motivated behavior and estrogen receptors are expressed in this nucleus. Thus, we examined whether the effects of estrogens on reward were exerted directly at the level of the VTA. Intra-VTA microinjection of β-estradiol led to a significant reduction in food-motivated behavior. Interestingly, this effect was not accompanied by a reduction in chow intake or body weight, nor did it alter locomotor activity. Importantly, removal of the ovaries produced a potent and lasting elevation in food reward and food-seeking behavior, suggesting that ovarian sex steroids are critical for maintenance of normal food reward behavior. These data reveal a novel role for estrogens in the control of food reward behavior.​. Copyright © 2017 Elsevier Ltd. All rights reserved.

Individual differences in anticipatory activity to food rewards predict cue-induced appetitive 50-kHz calls in rats.

PubMed

Brenes, Juan C; Schwarting, Rainer K W

2015-10-01

Reward-related stimuli come to acquire incentive salience through Pavlovian learning and become capable of controlling reward-oriented behaviors. Here, we examined individual differences in anticipatory activity elicited by reward-related cues as indicative of how animals attribute incentive salience to otherwise neutral stimuli. Since adult rats can signal incentive motivation states through ultrasonic vocalizations (USVs) at around 50-kHz, such calls were recorded in food-deprived rats trained to associate cues with food rewards, which were subsequently devalued by satiation.We found that the extent to which animals developed conditioned anticipatory activity to food cues while food deprived determined the level of cue-induced appetitive USVs while sated. Re-exposure to reward cues after a free-testing period reinstated USVs, invigorated reward seeking and consumption, and again, increases in calling occurred only in animals with high levels of cue-induced anticipatory activity. Reward-experienced rats systemically challenged with the catecholamine agonist amphetamine or with the dopamine receptor antagonist flupenthixol showed attenuated responses to these drugs, especially for USVs and in subjects with high levels of cue-induced anticipatory activity. Our results suggest that individuals prone to attribute incentive salience to reward cues showed heightened reward-induced USVs which were reliably expressed over time and persisted despite physiological needs being fulfilled. Also, prone subjects seemed to undergo particular adaptations in their dopaminergic system related with incentive learning. Our findings may have translational relevance in preclinical research modeling compulsive disorders, which may be due to excessive attribution of incentive salience to reward cues, such as overeating, pathological gambling, and drug addiction.

Inverted Social Reward: Associations between Psychopathic Traits and Self-Report and Experimental Measures of Social Reward

PubMed Central

Foulkes, Lucy; McCrory, Eamon J.; Neumann, Craig S.; Viding, Essi

2014-01-01

Individuals with high levels of psychopathic traits tend to undervalue long-term, affiliative relationships, but it remains unclear what motivates them to engage in social interactions at all. Their experience of social reward may provide an important clue. In Study 1 of this paper, a large sample of participants (N = 505) completed a measure of psychopathic traits (Self-Report Psychopathy Scale Short-Form) and a measure of social reward value (Social Reward Questionnaire) to explore what aspects of social reward are associated with psychopathic traits. In Study 2 (N = 110), the same measures were administered to a new group of participants along with two experimental tasks investigating monetary and social reward value. Psychopathic traits were found to be positively correlated with the enjoyment of callous treatment of others and negatively associated with the enjoyment of positive social interactions. This indicates a pattern of ‘inverted’ social reward in which being cruel is enjoyable and being kind is not. Interpersonal psychopathic traits were also positively associated with the difference between mean reaction times (RTs) in the monetary and social experimental reward tasks; individuals with high levels of these traits responded comparatively faster to social than monetary reward. We speculate that this may be because social approval/admiration has particular value for these individuals, who have a tendency to use and manipulate others. Together, these studies provide evidence that the self-serving and cruel social behaviour seen in psychopathy may in part be explained by what these individuals find rewarding. PMID:25162519

Habit formation coincides with shifts in reinforcement representations in the sensorimotor striatum.

PubMed

Smith, Kyle S; Graybiel, Ann M

2016-03-01

Evaluating outcomes of behavior is a central function of the striatum. In circuits engaging the dorsomedial striatum, sensitivity to goal value is accentuated during learning, whereas outcome sensitivity is thought to be minimal in the dorsolateral striatum and its habit-related corticostriatal circuits. However, a distinct population of projection neurons in the dorsolateral striatum exhibits selective sensitivity to rewards. Here, we evaluated the outcome-related signaling in such neurons as rats performed an instructional T-maze task for two rewards. As the rats formed maze-running habits and then changed behavior after reward devaluation, we detected outcome-related spike activity in 116 units out of 1,479 recorded units. During initial training, nearly equal numbers of these units fired preferentially either after rewarded runs or after unrewarded runs, and the majority were responsive at only one of two reward locations. With overtraining, as habits formed, firing in nonrewarded trials almost disappeared, and reward-specific firing declined. Thus error-related signaling was lost, and reward signaling became generalized. Following reward devaluation, in an extinction test, postgoal activity was nearly undetectable, despite accurate running. Strikingly, when rewards were then returned, postgoal activity reappeared and recapitulated the original early response pattern, with nearly equal numbers responding to rewarded and unrewarded runs and to single rewards. These findings demonstrate that outcome evaluation in the dorsolateral striatum is highly plastic and tracks stages of behavioral exploration and exploitation. These signals could be a new target for understanding compulsive behaviors that involve changes to dorsal striatum function. Copyright © 2016 the American Physiological Society.

Reward Pays the Cost of Noise Reduction in Motor and Cognitive Control.

PubMed

Manohar, Sanjay G; Chong, Trevor T-J; Apps, Matthew A J; Batla, Amit; Stamelou, Maria; Jarman, Paul R; Bhatia, Kailash P; Husain, Masud

2015-06-29

Speed-accuracy trade-off is an intensively studied law governing almost all behavioral tasks across species. Here we show that motivation by reward breaks this law, by simultaneously invigorating movement and improving response precision. We devised a model to explain this paradoxical effect of reward by considering a new factor: the cost of control. Exerting control to improve response precision might itself come at a cost--a cost to attenuate a proportion of intrinsic neural noise. Applying a noise-reduction cost to optimal motor control predicted that reward can increase both velocity and accuracy. Similarly, application to decision-making predicted that reward reduces reaction times and errors in cognitive control. We used a novel saccadic distraction task to quantify the speed and accuracy of both movements and decisions under varying reward. Both faster speeds and smaller errors were observed with higher incentives, with the results best fitted by a model including a precision cost. Recent theories consider dopamine to be a key neuromodulator in mediating motivational effects of reward. We therefore examined how Parkinson's disease (PD), a condition associated with dopamine depletion, alters the effects of reward. Individuals with PD showed reduced reward sensitivity in their speed and accuracy, consistent in our model with higher noise-control costs. Including a cost of control over noise explains how reward may allow apparent performance limits to be surpassed. On this view, the pattern of reduced reward sensitivity in PD patients can specifically be accounted for by a higher cost for controlling noise. Copyright © 2015 The Authors. Published by Elsevier Ltd.. All rights reserved.

Reward-Related Decision-Making in Pediatric Major Depressive Disorder: An fMRI Study

ERIC Educational Resources Information Center

Forbes, Erika E.; Christopher May, J.; Siegle, Greg J.; Ladouceur, Cecile D.; Ryan, Neal D.; Carter, Cameron S.; Birmaher, Boris; Axelson, David A.; Dahl, Ronald E.

2006-01-01

Background: Although reward processing is considered an important part of affective functioning, few studies have investigated reward-related decisions or responses in young people with affective disorders. Depression is postulated to involve decreased activity in reward-related affective systems. Methods: Using functional magnetic resonance…

Reward Allocation and Academic versus Social Orientation toward School.

ERIC Educational Resources Information Center

Peterson, Candida C.; Peterson, James L.

1978-01-01

Correlates 138 elementary school children's views about the purposes of school to their styles of reward allocation: academically motivated students allocated rewards equally to two hypothetical performers who had unequally helped a teacher perform a manual chore, while socially motivated children allocated rewards in an equity (performance-based)…

"Good Citizen" Program.

ERIC Educational Resources Information Center

Placer Hills Union Elementary School District, Meadow Vista, CA.

THE FOLLOWING IS THE FULL TEXT OF THIS DOCUMENT: The "Good Citizen" Program was developed for many reasons: to keep the campus clean, to reward students for improvement, to reward students for good deeds, to improve the total school climate, to reward students for excellence, and to offer staff members a method of reward for positive…

Modeling the Effect of Reward Amount on Probability Discounting

ERIC Educational Resources Information Center

Myerson, Joel; Green, Leonard; Morris, Joshua

2011-01-01

The present study with college students examined the effect of amount on the discounting of probabilistic monetary rewards. A hyperboloid function accurately described the discounting of hypothetical rewards ranging in amount from $20 to $10,000,000. The degree of discounting increased continuously with amount of probabilistic reward. This effect…

Delay Discounting of Reward in ADHD: Application in Young Children

ERIC Educational Resources Information Center

Wilson, Vanessa B.; Mitchell, Suzanne H.; Musser, Erica D.; Schmitt, Colleen F.; Nigg, Joel T.

2011-01-01

Background: A key underlying process that may contribute to attention-deficit/hyperactivity disorder (ADHD) involves alterations in reward evaluation, including assessing the relative value of immediate over delayed rewards. This study examines whether children with ADHD discount the value of delayed rewards to a greater degree than typically…

Reward Circuitry Function in Autism during Face Anticipation and Outcomes

ERIC Educational Resources Information Center

Dichter, Gabriel S.; Richey, J. Anthony; Rittenberg, Alison M.; Sabatino, Antoinette; Bodfish, James W.

2012-01-01

The aim of this study was to investigate reward circuitry responses in autism during reward anticipation and outcomes for monetary and social rewards. During monetary anticipation, participants with autism spectrum disorders (ASDs) showed hypoactivation in right nucleus accumbens and hyperactivation in right hippocampus, whereas during monetary…

Sex Differences, Sex-Role Orientation, and Reward Allocations.

ERIC Educational Resources Information Center

Olejnik, Anthony B.

1982-01-01

In separate studies, examined (1) ways that college students allocated rewards to children performing in team and competitive situations, and (2) the relationship between sex role orientation and reward allocations. Found that sex and situational differences in reward allocations are affected by sex role orientation and differential socialization…

Extrinsic rewards undermine altruistic tendencies in 20-month-olds.

PubMed

Warneken, Felix; Tomasello, Michael

2008-11-01

The current study investigated the influence of rewards on very young children's helping behavior. After 20-month-old infants received a material reward during a treatment phase, they subsequently were less likely to engage in further helping during a test phase as compared with infants who had previously received social praise or no reward at all. This so-called overjustification effect suggests that even the earliest helping behaviors of young children are intrinsically motivated and that socialization practices involving extrinsic rewards can undermine this tendency.

An Analysis of the Civilian Employee Reward System in use at Naval Air Warfare Center, Patuxent River, Maryland

DTIC Science & Technology

1999-12-01

relative deprivation. If A and B have different rewards, distributive justice may still exist as long as person A feels that their level of investment to...example could be rewarding an assembly line for number of units produced (outcome) versus the degree of quality control (process). Even if quotas are...between reward preferences of one job type versus another. Perhaps most relevant to this thesis are the studies which have examined reward system

Dopamine reward prediction-error signalling: a two-component response

PubMed Central

Schultz, Wolfram

2017-01-01

Environmental stimuli and objects, including rewards, are often processed sequentially in the brain. Recent work suggests that the phasic dopamine reward prediction-error response follows a similar sequential pattern. An initial brief, unselective and highly sensitive increase in activity unspecifically detects a wide range of environmental stimuli, then quickly evolves into the main response component, which reflects subjective reward value and utility. This temporal evolution allows the dopamine reward prediction-error signal to optimally combine speed and accuracy. PMID:26865020

Food reward system: current perspectives and future research needs

PubMed Central

Woods, Stephen C.; Pelchat, Marcia; Grigson, Patricia Sue; Stice, Eric; Farooqi, Sadaf; Khoo, Chor San; Mattes, Richard D.; Beauchamp, Gary K.

2015-01-01

This article reviews current research and cross-disciplinary perspectives on the neuroscience of food reward in animals and humans, examines the scientific hypothesis of food addiction, discusses methodological and terminology challenges, and identifies knowledge gaps and future research needs. Topics addressed herein include the role of reward and hedonic aspects in the regulation of food intake, neuroanatomy and neurobiology of the reward system in animals and humans, responsivity of the brain reward system to palatable foods and drugs, translation of craving versus addiction, and cognitive control of food reward. The content is based on a workshop held in 2013 by the North American Branch of the International Life Sciences Institute. PMID:26011903

Response effort discounts the subjective value of rewards.

PubMed

Nishiyama, Ryoji

2014-09-01

Factors associated with obtaining a reward, such as a temporal delay in receiving the reward, can influence the subjective value of the reward. Cognitive as well as physical response effort is also known to influence choice behaviors. The present study used hypothetical situations to assess whether response effort affects the subjective value of rewards. The results demonstrated that increasing response effort increases the amount of money that participants are willing to forgo to avoid engaging in work. An exponential as well as hyperbolic function provided a good fit for such discounting. The findings suggest that response effort discounts the subjective value of a reward as a function of its amount. Copyright © 2014 Elsevier B.V. All rights reserved.

Finding intrinsic rewards by embodied evolution and constrained reinforcement learning.

PubMed

Uchibe, Eiji; Doya, Kenji

2008-12-01

Understanding the design principle of reward functions is a substantial challenge both in artificial intelligence and neuroscience. Successful acquisition of a task usually requires not only rewards for goals, but also for intermediate states to promote effective exploration. This paper proposes a method for designing 'intrinsic' rewards of autonomous agents by combining constrained policy gradient reinforcement learning and embodied evolution. To validate the method, we use Cyber Rodent robots, in which collision avoidance, recharging from battery packs, and 'mating' by software reproduction are three major 'extrinsic' rewards. We show in hardware experiments that the robots can find appropriate 'intrinsic' rewards for the vision of battery packs and other robots to promote approach behaviors.

The effects of reward and punishment on reaction times and autonomic activity in hyperactive and normal children.

PubMed

Firestone, P; Douglas, V

1975-01-01

The performance of hyperactive and control children was compared on a delayed reaction time task under three reinforcement conditions: reward, punishment, and reward plus punishment. Hyperactives had slower and more variable reaction times, suggesting an attentional deficit. Although each of the three reinforcement conditons was successful in improving reaction times for both subject groups, reward led to a significant increase in impulsive responses in the hyperactive children. Autonomic data revealed that reward also increased arousal to a greater extent than punishment or reward plus punishment. Although resting skin conductance was not different in the two groups of subjects, hyperactives produced fewer specific autonomic responses to signal stimuli.

Neural evidence reveals the rapid effects of reward history on selective attention.

PubMed

MacLean, Mary H; Giesbrecht, Barry

2015-05-05

Selective attention is often framed as being primarily driven by two factors: task-relevance and physical salience. However, factors like selection and reward history, which are neither currently task-relevant nor physically salient, can reliably and persistently influence visual selective attention. The current study investigated the nature of the persistent effects of irrelevant, physically non-salient, reward-associated features. These features affected one of the earliest reliable neural indicators of visual selective attention in humans, the P1 event-related potential, measured one week after the reward associations were learned. However, the effects of reward history were moderated by current task demands. The modulation of visually evoked activity supports the hypothesis that reward history influences the innate salience of reward associated features, such that even when no longer relevant, nor physically salient, these features have a rapid, persistent, and robust effect on early visual selective attention. Copyright © 2015 Elsevier B.V. All rights reserved.

Sensitivity to value-driven attention is predicted by how we learn from value.

PubMed

Jahfari, Sara; Theeuwes, Jan

2017-04-01

Reward learning is known to influence the automatic capture of attention. This study examined how the rate of learning, after high- or low-value reward outcomes, can influence future transfers into value-driven attentional capture. Participants performed an instrumental learning task that was directly followed by an attentional capture task. A hierarchical Bayesian reinforcement model was used to infer individual differences in learning from high or low reward. Results showed a strong relationship between high-reward learning rates (or the weight that is put on learning after a high reward) and the magnitude of attentional capture with high-reward colors. Individual differences in learning from high or low rewards were further related to performance differences when high- or low-value distractors were present. These findings provide novel insight into the development of value-driven attentional capture by showing how information updating after desired or undesired outcomes can influence future deployments of automatic attention.

Lateral habenula neurons signal errors in the prediction of reward information

PubMed Central

Bromberg-Martin, Ethan S.; Hikosaka, Okihide

2011-01-01

Humans and animals have a remarkable ability to predict future events, which they achieve by persistently searching their environment for sources of predictive information. Yet little is known about the neural systems that motivate this behavior. We hypothesized that information-seeking is assigned value by the same circuits that support reward-seeking, so that neural signals encoding conventional “reward prediction errors” include analogous “information prediction errors”. To test this we recorded from neurons in the lateral habenula, a nucleus which encodes reward prediction errors, while monkeys chose between cues that provided different amounts of information about upcoming rewards. We found that a subpopulation of lateral habenula neurons transmitted signals resembling information prediction errors, responding when reward information was unexpectedly cued, delivered, or denied. Their signals evaluated information sources reliably even when the animal’s decisions did not. These neurons could provide a common instructive signal for reward-seeking and information-seeking behavior. PMID:21857659

Quantifying familial influences on brain activation during the monetary incentive delay task: an adolescent monozygotic twin study.

PubMed

Silverman, Merav H; Krueger, Robert F; Iacono, William G; Malone, Stephen M; Hunt, Ruskin H; Thomas, Kathleen M

2014-12-01

Although altered brain activation during reward tasks has been found in a number of heritable psychiatric disorders and health outcomes, the familial nature of reward-related brain activation remains unexplored. In this study, we investigated the degree to which the magnitude of mesocorticolimbic reward system signal intensities in anticipation of reward during the monetary incentive delay (MID) task was similar within 46 pairs of adolescent, monozygotic twins. Significant within-pair correlations in brain activation during anticipation of gain were found in one third of the 18 reward-related regions investigated. These regions were the right nucleus accumbens, left and right posterior caudate, right anterior caudate, left insula, and anterior cingulate cortex. This serves as evidence for a shared familial contribution to individual differences in reward related brain activity in certain key reward processing regions. Copyright © 2014 Elsevier B.V. All rights reserved.

Social reward shapes attentional biases.

PubMed

Anderson, Brian A

2016-01-01

Paying attention to stimuli that predict a reward outcome is important for an organism to survive and thrive. When visual stimuli are associated with tangible, extrinsic rewards such as money or food, these stimuli acquire high attentional priority and come to automatically capture attention. In humans and other primates, however, many behaviors are not motivated directly by such extrinsic rewards, but rather by the social feedback that results from performing those behaviors. In the present study, I examine whether positive social feedback can similarly influence attentional bias. The results show that stimuli previously associated with a high probability of positive social feedback elicit value-driven attentional capture, much like stimuli associated with extrinsic rewards. Unlike with extrinsic rewards, however, such stimuli also influence task-specific motivation. My findings offer a potential mechanism by which social reward shapes the information that we prioritize when perceiving the world around us.

Modulation of value representation by social context in the primate orbitofrontal cortex.

PubMed

Azzi, João C B; Sirigu, Angela; Duhamel, Jean-René

2012-02-07

Primates depend for their survival on their ability to understand their social environment, and their behavior is often shaped by social circumstances. We report that the orbitofrontal cortex, a brain region involved in motivation and reward, is tuned to social information. Macaque monkeys worked to collect rewards for themselves and two monkey partners. Behaviorally, monkeys discriminated between cues signaling large and small [corrected] rewards, and between cues signaling rewards to self only and reward to both self and another monkey, with a preference for the former over the latter in both instances. Single neurons recorded during this task encoded the meaning of visual cues that predicted the magnitude of future rewards, as well as the motivational value of rewards obtained in a social context. Furthermore, neuronal activity was found to track momentary social preferences and partner's identity and social rank. The orbitofrontal cortex thus contains key neuronal mechanisms for the evaluation of social information.

Translational Assessment of Reward and Motivational Deficits in Psychiatric Disorders.

PubMed

Der-Avakian, Andre; Barnes, Samuel A; Markou, Athina; Pizzagalli, Diego A

Deficits in reward and motivation are common symptoms characterizing several psychiatric and neurological disorders. Such deficits may include anhedonia, defined as loss of pleasure, as well as impairments in anticipatory pleasure, reward valuation, motivation/effort, and reward learning. This chapter describes recent advances in the development of behavioral tasks used to assess different aspects of reward processing in both humans and non-human animals. While earlier tasks were generally developed independently with limited cross-species correspondence, a newer generation of translational tasks has emerged that are theoretically and procedurally analogous across species and allow parallel testing, data analyses, and interpretation between human and rodent behaviors. Such enhanced conformity between cross-species tasks will facilitate investigation of the neurobiological mechanisms underlying discrete reward and motivated behaviors and is expected to improve our understanding and treatment of neuropsychiatric disorders characterized by reward and motivation deficits.

Processing of social and monetary rewards in the human striatum.

PubMed

Izuma, Keise; Saito, Daisuke N; Sadato, Norihiro

2008-04-24

Despite an increasing focus on the neural basis of human decision making in neuroscience, relatively little attention has been paid to decision making in social settings. Moreover, although human social decision making has been explored in a social psychology context, few neural explanations for the observed findings have been considered. To bridge this gap and improve models of human social decision making, we investigated whether acquiring a good reputation, which is an important incentive in human social behaviors, activates the same reward circuitry as monetary rewards. In total, 19 subjects participated in functional magnetic resonance imaging (fMRI) experiments involving monetary and social rewards. The acquisition of one's good reputation robustly activated reward-related brain areas, notably the striatum, and these overlapped with the areas activated by monetary rewards. Our findings support the idea of a "common neural currency" for rewards and represent an important first step toward a neural explanation for complex human social behaviors.

Rewards modulate saccade latency but not exogenous spatial attention.

PubMed

Dunne, Stephen; Ellison, Amanda; Smith, Daniel T

2015-01-01

The eye movement system is sensitive to reward. However, whilst the eye movement system is extremely flexible, the extent to which changes to oculomotor behavior induced by reward paradigms persist beyond the training period or transfer to other oculomotor tasks is unclear. To address these issues we examined the effects of presenting feedback that represented small monetary rewards to spatial locations on the latency of saccadic eye movements, the time-course of learning and extinction of the effects of rewarding saccades on exogenous spatial attention and oculomotor inhibition of return. Reward feedback produced a relative facilitation of saccadic latency in a stimulus driven saccade task which persisted for three blocks of extinction trials. However, this hemifield-specific effect failed to transfer to peripheral cueing tasks. We conclude that rewarding specific spatial locations is unlikely to induce long-term, systemic changes to the human oculomotor or attention systems.

Activation of VTA GABA neurons disrupts reward consumption

PubMed Central

van Zessen, Ruud; Phillips, Jana L.; Budygin, Evgeny A.; Stuber, Garret D.

2012-01-01

The activity of Ventral Tegmental Area (VTA) dopamine (DA) neurons promotes behavioral responses to rewards and environmental stimuli that predict them. VTA GABA inputs synapse directly onto DA neurons and may regulate DA neuronal activity to alter reward-related behaviors, however, the functional consequences of selective activation of VTA GABA neurons remains unknown. Here, we show that in vivo optogenetic activation of VTA GABA neurons disrupts reward consummatory behavior, but not conditioned anticipatory behavior in response to reward-predictive cues. In addition, direct activation of VTA GABA projections to the nucleus accumbens (NAc) resulted in detectable GABA release, but did not alter reward consumption. Furthermore, optogenetic stimulation of VTA GABA neurons directly suppressed the activity and excitability of neighboring DA neurons, as well as the release of DA in the NAc, suggesting that the dynamic interplay between VTA DA and GABA neurons can control the initiation and termination of reward-related behaviors. PMID:22445345

Microstimulation of the human substantia nigra alters reinforcement learning.

PubMed

Ramayya, Ashwin G; Misra, Amrit; Baltuch, Gordon H; Kahana, Michael J

2014-05-14

Animal studies have shown that substantia nigra (SN) dopaminergic (DA) neurons strengthen action-reward associations during reinforcement learning, but their role in human learning is not known. Here, we applied microstimulation in the SN of 11 patients undergoing deep brain stimulation surgery for the treatment of Parkinson's disease as they performed a two-alternative probability learning task in which rewards were contingent on stimuli, rather than actions. Subjects demonstrated decreased learning from reward trials that were accompanied by phasic SN microstimulation compared with reward trials without stimulation. Subjects who showed large decreases in learning also showed an increased bias toward repeating actions after stimulation trials; therefore, stimulation may have decreased learning by strengthening action-reward associations rather than stimulus-reward associations. Our findings build on previous studies implicating SN DA neurons in preferentially strengthening action-reward associations during reinforcement learning. Copyright © 2014 the authors 0270-6474/14/346887-09$15.00/0.

A Positive Affective Neuroendocrinology Approach to Reward and Behavioral Dysregulation

PubMed Central

Welker, Keith M.; Gruber, June; Mehta, Pranjal H.

2015-01-01

Emerging lines of research suggest that both testosterone and maladaptive reward processing can modulate behavioral dysregulation. Yet, to date, no integrative account has been provided that systematically explains neuroendocrine function, dysregulation of reward, and behavioral dysregulation in a unified perspective. This is particularly important given specific neuroendocrine systems are potential mechanisms underlying and giving rise to reward-relevant behaviors. In this review, we propose a forward-thinking approach to study the mechanisms of reward and behavioral dysregulation from a positive affective neuroendocrinology (PANE) perspective. This approach holds that testosterone increases reward processing and motivation, which increase the likelihood of behavioral dysregulation. Additionally, the PANE framework holds that reward processing mediates the effects of testosterone on behavioral dysregulation. We also explore sources of potential sex differences and the roles of age, cortisol, and individual differences within the PANE framework. Finally, we discuss future prospects for research questions and methodology in the emerging field of affective neuroendocrinology. PMID:26191007

Nutritional controls of food reward.

PubMed

Fernandes, Maria F; Sharma, Sandeep; Hryhorczuk, Cecile; Auguste, Stephanie; Fulton, Stephanie

2013-08-01

The propensity to select and consume palatable nutrients is strongly influenced by the rewarding effects of food. Neural processes integrating reward, emotional states and decision-making can supersede satiety signals to promote excessive caloric intake and weight gain. While nutritional habits are influenced by reward-based neural mechanisms, nutrition and its impact on energy metabolism, in turn, plays an important role in the control of food reward. Feeding modulates the release of metabolic hormones that have an important influence on central controls of appetite. Nutrients themselves are also an essential source of energy fuel, while serving as key metabolites and acting as signalling molecules in the neural pathways that control feeding and food reward. Along these lines, this review discusses the impact of nutritionally regulated hormones and select macronutrients on the behavioural and neural processes underlying the rewarding effects of food. Copyright © 2013 Canadian Diabetes Association. Published by Elsevier Inc. All rights reserved.

Food Approach and Food Avoidance in Young Children: Relation with Reward Sensitivity and Punishment Sensitivity

PubMed Central

Vandeweghe, Laura; Vervoort, Leentje; Verbeken, Sandra; Moens, Ellen; Braet, Caroline

2016-01-01

It has recently been suggested that individual differences in Reward Sensitivity and Punishment Sensitivity may determine how children respond to food. These temperamental traits reflect activity in two basic brain systems that respond to rewarding and punishing stimuli, respectively, with approach and avoidance. Via parent-report questionnaires, we investigate the associations of the general motivational temperamental traits Reward Sensitivity and Punishment Sensitivity with Food Approach and Food Avoidance in 98 preschool children. Consistent with the conceptualization of Reward Sensitivity in terms of approach behavior and Punishment Sensitivity in terms of avoidance behavior, Reward Sensitivity was positively related to Food Approach, while Punishment Sensitivity was positively related to Food Avoidance. Future research should integrate these perspectives (i.e., general temperamental traits Reward Sensitivity and Punishment Sensitivity, and Food Approach and Avoidance) to get a better understanding of eating behavior and related body weight. PMID:27445898

Selective and graded coding of reward-uncertainty by neurons in the primate anterodorsal septal region

PubMed Central

Monosov, Ilya E.; Hikosaka, Okihide

2014-01-01

Natural environments are uncertain. Uncertainty of emotional outcomes can induce anxiety and raise vigilance, promote and signal the opportunity for learning, modulate economic choice, and regulate risk seeking. Here we demonstrate that a subset of neurons in the anterodorsal region of the primate septum (ADS) are primarily devoted to processing uncertainty in a highly specific manner. Those neurons were selectively activated by visual cues indicating probabilistic delivery of reward (e.g. 25%, 50%, 75% reward) and did not respond to cues indicating certain outcomes (0% and 100% reward). The average ADS uncertainty response was graded with the magnitude of reward uncertainty, and selectively signaled uncertainty about rewards rather than punishments. The selective and graded information about reward uncertainty encoded by many neurons in the ADS may underlie uncertainty-modulation of value- and sensorimotor- related areas to regulate goal-directed behavior. PMID:23666181

Neural basis of reward anticipation and its genetic determinants.

PubMed

Jia, Tianye; Macare, Christine; Desrivières, Sylvane; Gonzalez, Dante A; Tao, Chenyang; Ji, Xiaoxi; Ruggeri, Barbara; Nees, Frauke; Banaschewski, Tobias; Barker, Gareth J; Bokde, Arun L W; Bromberg, Uli; Büchel, Christian; Conrod, Patricia J; Dove, Rachel; Frouin, Vincent; Gallinat, Jürgen; Garavan, Hugh; Gowland, Penny A; Heinz, Andreas; Ittermann, Bernd; Lathrop, Mark; Lemaitre, Hervé; Martinot, Jean-Luc; Paus, Tomáš; Pausova, Zdenka; Poline, Jean-Baptiste; Rietschel, Marcella; Robbins, Trevor; Smolka, Michael N; Müller, Christian P; Feng, Jianfeng; Rothenfluh, Adrian; Flor, Herta; Schumann, Gunter

2016-04-05

Dysfunctional reward processing is implicated in various mental disorders, including attention deficit hyperactivity disorder (ADHD) and addictions. Such impairments might involve different components of the reward process, including brain activity during reward anticipation. We examined brain nodes engaged by reward anticipation in 1,544 adolescents and identified a network containing a core striatal node and cortical nodes facilitating outcome prediction and response preparation. Distinct nodes and functional connections were preferentially associated with either adolescent hyperactivity or alcohol consumption, thus conveying specificity of reward processing to clinically relevant behavior. We observed associations between the striatal node, hyperactivity, and the vacuolar protein sorting-associated protein 4A (VPS4A) gene in humans, and the causal role of Vps4 for hyperactivity was validated in Drosophila Our data provide a neurobehavioral model explaining the heterogeneity of reward-related behaviors and generate a hypothesis accounting for their enduring nature.

Translational Assessment of Reward and Motivational Deficits in Psychiatric Disorders

PubMed Central

Der-Avakian, Andre; Barnes, Samuel A.

2016-01-01

Deficits in reward and motivation are common symptoms characterizing several psychiatric and neurological disorders. Such deficits may include anhedonia, defined as loss of pleasure, as well as impairments in anticipatory pleasure, reward valuation, motivation/effort, and reward learning. This chapter describes recent advances in the development of behavioral tasks used to assess different aspects of reward processing in both humans and non-human animals. While earlier tasks were generally developed independently with limited cross-species correspondence, a newer generation of translational tasks has emerged that are theoretically and procedurally analogous across species and allow parallel testing, data analyses, and interpretation between human and rodent behaviors. Such enhanced conformity between cross-species tasks will facilitate investigation of the neurobiological mechanisms underlying discrete reward and motivated behaviors and is expected to improve our understanding and treatment of neuropsychiatric disorders characterized by reward and motivation deficits. PMID:26873017

Kinetics of matching.

PubMed

Mark, T A; Gallistel, C R

1994-01-01

Rats responded on concurrent variable interval schedules of brain stimulation reward in 2-trial sessions. Between trials, there was a 16-fold reversal in the relative rate of reward. In successive, narrow time windows, the authors compared the ratio of the times spent on the 2 levers to the ratio of the rewards received. Time-allocation ratios tracked wide, random fluctuations in the reward ratio. The adjustment to the midsession reversal in relative rate of reward was largely completed within 1 interreward interval on the leaner schedule. Both results were unaffected by a 16-fold change in the combined rates of reward. The large, rapid, scale-invariant shifts in time-allocation ratios that underlie matching behavior imply that the subjective relative rate of reward can be determined by a very few of the most recent interreward intervals and that this estimate can directly determine the ratio of the expected stay durations.

The effect of graded monetary reward on cognitive event-related potentials and behavior in young healthy adults

PubMed Central

Goldstein, Rita Z.; Cottone, Lisa A.; Jia, Zhiru; Maloney, Thomas; Volkow, Nora D.; Squires, Nancy K.

2008-01-01

Temporal correlates of the brain circuit underlying reward processing in healthy adults remain unclear. The current study investigated the P3 and contingent negative variation (CNV) as putative reward-related temporal markers. The effect of sustained monetary reward on these event-related potentials and on behavior was assessed using a warned reaction-time paradigm in 16 young healthy subjects. Monetary reward (0, 1 and 45 cents) varied across blocks of trials. While the CNV was unaffected by money, P3 amplitude was significantly larger for 45 than the 1 and 0 cent conditions. This effect corresponded to the monotonically positive subjective ratings of interest and excitement on the task (45>1>0). These findings suggest a difference between the P3 and CNV; the P3 is sensitive to the sustained effect of relative reward value while the CNV does not vary with reward magnitude. PMID:16876894

Value-Driven Attentional Capture is Modulated by Spatial Context

PubMed Central

Anderson, Brian A.

2014-01-01

When stimuli are associated with reward outcome, their visual features acquire high attentional priority such that stimuli possessing those features involuntarily capture attention. Whether a particular feature is predictive of reward, however, will vary with a number of contextual factors. One such factor is spatial location: for example, red berries are likely to be found in low-lying bushes, whereas yellow bananas are likely to be found on treetops. In the present study, I explore whether the attentional priority afforded to reward-associated features is modulated by such location-based contingencies. The results demonstrate that when a stimulus feature is associated with a reward outcome in one spatial location but not another, attentional capture by that feature is selective to when it appears in the rewarded location. This finding provides insight into how reward learning effectively modulates attention in an environment with complex stimulus–reward contingencies, thereby supporting efficient foraging. PMID:26069450

Neural basis of reward anticipation and its genetic determinants

PubMed Central

Jia, Tianye; Macare, Christine; Desrivières, Sylvane; Gonzalez, Dante A.; Tao, Chenyang; Ji, Xiaoxi; Ruggeri, Barbara; Nees, Frauke; Banaschewski, Tobias; Barker, Gareth J.; Bokde, Arun L. W.; Bromberg, Uli; Büchel, Christian; Conrod, Patricia J.; Dove, Rachel; Gallinat, Jürgen; Garavan, Hugh; Gowland, Penny A.; Heinz, Andreas; Ittermann, Bernd; Lathrop, Mark; Lemaitre, Hervé; Martinot, Jean-Luc; Paus, Tomáš; Pausova, Zdenka; Poline, Jean-Baptiste; Rietschel, Marcella; Robbins, Trevor; Müller, Christian P.; Feng, Jianfeng; Rothenfluh, Adrian; Flor, Herta; Schumann, Gunter

2016-01-01

Dysfunctional reward processing is implicated in various mental disorders, including attention deficit hyperactivity disorder (ADHD) and addictions. Such impairments might involve different components of the reward process, including brain activity during reward anticipation. We examined brain nodes engaged by reward anticipation in 1,544 adolescents and identified a network containing a core striatal node and cortical nodes facilitating outcome prediction and response preparation. Distinct nodes and functional connections were preferentially associated with either adolescent hyperactivity or alcohol consumption, thus conveying specificity of reward processing to clinically relevant behavior. We observed associations between the striatal node, hyperactivity, and the vacuolar protein sorting-associated protein 4A (VPS4A) gene in humans, and the causal role of Vps4 for hyperactivity was validated in Drosophila. Our data provide a neurobehavioral model explaining the heterogeneity of reward-related behaviors and generate a hypothesis accounting for their enduring nature. PMID:27001827

Unconscious Reward Cues Increase Invested Effort, but Do Not Change Speed-Accuracy Tradeoffs

ERIC Educational Resources Information Center

Bijleveld, Erik; Custers, Ruud; Aarts, Henk

2010-01-01

While both conscious and unconscious reward cues enhance effort to work on a task, previous research also suggests that conscious rewards may additionally affect speed-accuracy tradeoffs. Based on this idea, two experiments explored whether reward cues that are presented above (supraliminal) or below (subliminal) the threshold of conscious…

The Effectiveness of Rewards and Incentives for Teachers.

ERIC Educational Resources Information Center

Kimball, Roland B.

This study examined (1) the rewards and incentive systems currently used in schools, (2) the relationship between the existing reward system and both the excellence of the school and the behavior of teachers and administrators in searching for alternatives, and (3) the possibility of defining a rewards system for teachers which would elicit…

The Tenure of Private College and University Presidents

ERIC Educational Resources Information Center

Langbert, Mitchell

2012-01-01

This study fills several gaps. Most turnaround studies ignore post-turnaround executive rewards, and most studies of executive rewards ignore both the effects on rewards of achieving a turnaround and length of service, or tenure, as an element of the reward structure. Previous research about the length of college presidents' tenure in office has…

Detrimental Effects of a Self-reward Contracting Program on Subjects' Involvement in Self-administered Desensitization

ERIC Educational Resources Information Center

Barrera, Manuel Jr.; Rosen, Gerald M.

1977-01-01

Assesses a self-reward contracting procedure intended to facilitate completion of self-administered desensitization. Self-referred snake phobics received either (a) self-administered desensitization; (b) self-administered desensitization with self-reward contracting; or (c) a self-administered placebo with self-reward contracting. Results show the…

Revisiting the Role of Rewards in Motivation and Learning: Implications of Neuroscientific Research

ERIC Educational Resources Information Center

Hidi, Suzanne

2016-01-01

Rewards have been examined extensively by both psychologists and neuorscientists and have become one of the most contentious issues in social and educational psychology. In psychological research, reward processing has typically been studied in relation to behavioral outcomes. In contrast, neuroscientists have been examining how rewards are…

Effects of reward on the accuracy and dynamics of smooth pursuit eye movements.

PubMed

Brielmann, Aenne A; Spering, Miriam

2015-08-01

Reward modulates behavioral choices and biases goal-oriented behavior, such as eye or hand movements, toward locations or stimuli associated with higher rewards. We investigated reward effects on the accuracy and timing of smooth pursuit eye movements in 4 experiments. Eye movements were recorded in participants tracking a moving visual target on a computer monitor. Before target motion onset, a monetary reward cue indicated whether participants could earn money by tracking accurately, or whether the trial was unrewarded (Experiments 1 and 2, n = 11 each). Reward significantly improved eye-movement accuracy across different levels of task difficulty. Improvements were seen even in the earliest phase of the eye movement, within 70 ms of tracking onset, indicating that reward impacts visual-motor processing at an early level. We obtained similar findings when reward was not precued but explicitly associated with the pursuit target (Experiment 3, n = 16); critically, these results were not driven by stimulus prevalence or other factors such as preparation or motivation. Numerical cues (Experiment 4, n = 9) were not effective. (c) 2015 APA, all rights reserved).

The influence of contextual reward statistics on risk preference

PubMed Central

Rigoli, Francesco; Rutledge, Robb B.; Dayan, Peter; Dolan, Raymond J.

2016-01-01

Decision theories mandate that organisms should adjust their behaviour in the light of the contextual reward statistics. We tested this notion using a gambling choice task involving distinct contexts with different reward distributions. The best fitting model of subjects' behaviour indicated that the subjective values of options depended on several factors, including a baseline gambling propensity, a gambling preference dependent on reward amount, and a contextual reward adaptation factor. Combining this behavioural model with simultaneous functional magnetic resonance imaging we probed neural responses in three key regions linked to reward and value, namely ventral tegmental area/substantia nigra (VTA/SN), ventromedial prefrontal cortex (vmPFC) and ventral striatum (VST). We show that activity in the VTA/SN reflected contextual reward statistics to the extent that context affected behaviour, activity in the vmPFC represented a value difference between chosen and unchosen options while VST responses reflected a non-linear mapping between the actual objective rewards and their subjective value. The findings highlight a multifaceted basis for choice behaviour with distinct mappings between components of this behaviour and value sensitive brain regions. PMID:26707890

Monetary incentives at retrieval promote recognition of involuntarily learned emotional information.

PubMed

Yan, Chunping; Li, Yunyun; Zhang, Qin; Cui, Lixia

2018-03-07

Previous studies have suggested that the effects of reward on memory processes are affected by certain factors, but it remains unclear whether the effects of reward at retrieval on recognition processes are influenced by emotion. The event-related potential was used to investigate the combined effect of reward and emotion on memory retrieval and its neural mechanism. The behavioral results indicated that the reward at retrieval improved recognition performance under positive and negative emotional conditions. The event-related potential results indicated that there were significant interactions between the reward and emotion in the average amplitude during recognition, and the significant reward effects from the frontal to parietal brain areas appeared at 130-800 ms for positive pictures and at 190-800 ms for negative pictures, but there were no significant reward effects of neutral pictures; the reward effect of positive items appeared relatively earlier, starting at 130 ms, and that of negative pictures began at 190 ms. These results indicate that monetary incentives at retrieval promote recognition of involuntarily learned emotional information.

Reward prediction error signal enhanced by striatum-amygdala interaction explains the acceleration of probabilistic reward learning by emotion.

PubMed

Watanabe, Noriya; Sakagami, Masamichi; Haruno, Masahiko

2013-03-06

Learning does not only depend on rationality, because real-life learning cannot be isolated from emotion or social factors. Therefore, it is intriguing to determine how emotion changes learning, and to identify which neural substrates underlie this interaction. Here, we show that the task-independent presentation of an emotional face before a reward-predicting cue increases the speed of cue-reward association learning in human subjects compared with trials in which a neutral face is presented. This phenomenon was attributable to an increase in the learning rate, which regulates reward prediction errors. Parallel to these behavioral findings, functional magnetic resonance imaging demonstrated that presentation of an emotional face enhanced reward prediction error (RPE) signal in the ventral striatum. In addition, we also found a functional link between this enhanced RPE signal and increased activity in the amygdala following presentation of an emotional face. Thus, this study revealed an acceleration of cue-reward association learning by emotion, and underscored a role of striatum-amygdala interactions in the modulation of the reward prediction errors by emotion.

Reward-seeking behavior and addiction: cause or cog?

PubMed

Arias-Carrión, Oscar; Salama, Mohamed

2012-09-01

Although dopaminergic system represents the cornerstone in rewarding, other neurotransmitters can modulate both the reward system and the psychomotor effects of addictive drugs. Many hypotheses have been proposed for a better understanding of the reward system and its role in drug addiction. However, after many years of investigation, no single theory can completely explain the neural basis of drug addiction. Recent reports introduce novel neurotransmitters into the game e.g. dynorphins, orexins, histamine, gheralin and galanin. The interacting functions of these neurotransmitters have shown that the reward system and its role in drug dependence, is far more complicated than was thought before. Individual variations exist regarding response to drug exposure, vulnerability for addiction and the effects of different cues on reward systems. Consequently, genetic variations of neurotransmission are thought to influence reward processing that in turn may affect distinctive social behavior and susceptibility to addiction. However, the individual variations can not be based mainly on genetics; environmental factors seem to play a role too. Here we discuss the current knowledge about the orquestic regulation of different neurotransmitters on reward-seeking behavior and their potential effect on drug addiction.

Gender Dimorphism of Brain Reward System Volumes in Alcoholism

PubMed Central

Sawyer, Kayle S.; Oscar-Berman, Marlene; Barthelemy, Olivier J.; Papadimitriou, George M.; Harris, Gordon J.; Makris, Nikos

2017-01-01

The brain's reward network has been reported to be smaller in alcoholic men compared to nonalcoholic men, but little is known about the volumes of reward regions in alcoholic women. Morphometric analyses were performed on magnetic resonance brain scans of 60 long-term chronic alcoholics (ALC; 30 men) and 60 nonalcoholic controls (NC; 29 men). We derived volumes of total brain, and cortical and subcortical reward-related structures including the dorsolateral prefrontal (DLPFC), orbitofrontal, and cingulate cortices, and the temporal pole, insula, amygdala, hippocampus, nucleus accumbens septi (NAc), and ventral diencephalon (VDC). We examined the relationships of the volumetric findings to drinking history. Analyses revealed a significant gender interaction for the association between alcoholism and total reward network volumes, with ALC men having smaller reward volumes than NC men and ALC women having larger reward volumes than NC women. Analyses of a priori subregions revealed a similar pattern of reward volume differences with significant gender interactions for DLPFC and VDC. Overall, the volume of the cerebral ventricles in ALC participants was negatively associated with duration of abstinence, suggesting decline in atrophy over time. PMID:28285206

Rhesus monkeys lack a consistent peak-end effect.

PubMed

Xu, Eric R; Knight, Emily J; Kralik, Jerald D

2011-12-01

In humans, the order of receiving sequential rewards can significantly influence the overall subjective utility of an outcome. For example, people subjectively rate receiving a large reward by itself significantly higher than receiving the same large reward followed by a smaller one (Do, Rupert, & Wolford, 2008). This result is called the peak-end effect. A comparative analysis of order effects can help determine the generality of such effects across primates, and we therefore examined the influence of reward-quality order on decision making in three rhesus macaque monkeys (Macaca mulatta). When given the choice between a high-low reward sequence and a low-high sequence, all three monkeys preferred receiving the high-value reward first. Follow-up experiments showed that for two of the three monkeys their choices depended specifically on reward-quality order and could not be accounted for by delay discounting. These results provide evidence for the influence of outcome order on decision making in rhesus monkeys. Unlike humans, who usually discount choices when a low-value reward comes last, rhesus monkeys show no such peak-end effect.

Impairment of probabilistic reward-based learning in schizophrenia.

PubMed

Weiler, Julia A; Bellebaum, Christian; Brüne, Martin; Juckel, Georg; Daum, Irene

2009-09-01

Recent models assume that some symptoms of schizophrenia originate from defective reward processing mechanisms. Understanding the precise nature of reward-based learning impairments might thus make an important contribution to the understanding of schizophrenia and the development of treatment strategies. The present study investigated several features of probabilistic reward-based stimulus association learning, namely the acquisition of initial contingencies, reversal learning, generalization abilities, and the effects of reward magnitude. Compared to healthy controls, individuals with schizophrenia exhibited attenuated overall performance during acquisition, whereas learning rates across blocks were similar to the rates of controls. On the group level, persons with schizophrenia were, however, unable to learn the reversal of the initial reward contingencies. Exploratory analysis of only the subgroup of individuals with schizophrenia who showed significant learning during acquisition yielded deficits in reversal learning with low reward magnitudes only. There was further evidence of a mild generalization impairment of the persons with schizophrenia in an acquired equivalence task. In summary, although there was evidence of intact basic processing of reward magnitudes, individuals with schizophrenia were impaired at using this feedback for the adaptive guidance of behavior.

Effect of failure/success feedback and the moderating influence of personality on reward motivation.

PubMed

Anand, Deepika; Oehlberg, Katherine A; Treadway, Michael T; Nusslock, Robin

2016-01-01

While motivation to pursue goals is often assumed to be a trait-like characteristic, it is influenced by a variety of situational factors. In particular, recent experiences of success or failure, as well as cognitive responses to these outcomes, may shape subsequent willingness to expend effort for future rewards. To date, however, these effects have not been explicitly tested. In the present study, 131 healthy individuals received either failure or success feedback on a cognitive task. They were then instructed to either ruminate or distract themselves from their emotions. Finally, they completed the Effort Expenditure for Rewards Task, a laboratory measure of reward motivation. Results indicate that participants who received failure feedback relied more strongly on the reward magnitude when choosing whether to exert greater effort to obtain larger rewards, though this effect only held under conditions of significant uncertainty about whether the effort would be rewarded. Further, participants with high levels of trait inhibition were less responsive to reward value and probability when choosing whether to expend greater effort, results that echo past studies of effort-based decision-making in psychological disorders.

The Mediating Effect of Prefrontal Asymmetry on the Relationship between the COMT Val158Met SNP and Trait Consummatory Positive Affect

PubMed Central

Katz, Andrea C.; Sarapas, Casey; Bishop, Jeffrey R.; Patel, Shitalben R.; Shankman, Stewart A.

2014-01-01

The Val158Met rs4680 polymorphism in the COMT gene regulates dopamine catabolism in the prefrontal cortex (PFC). Dopamine’s involvement in reward experience suggests those with the Met variant may exhibit trait-level sensitivity to reward due to more post-synaptic dopamine in the PFC. A physiological mediator of this association may be greater relative left asymmetry in the PFC, a putative biomarker for trait positive emotionality. Electroencephalograms of 120 participants were measured during a task that assesses two aspects of reward processing: pre-reward anticipation and post-reward consummatory affect. Participants provided genetics samples and completed the Temporal Experience of Pleasure Scale, which assesses trait-level anticipatory and consummatory positive affect. Met carriers had higher TEPS-Consummatory scores. This effect was mediated by greater relative left activation in the post-reward phase of the task. No effects were observed for the pre-reward phase. Results suggest that frontal asymmetry is an endophenotype between COMT genotype and trait reward responsivity. PMID:25195915

Evidence for a shared representation of sequential cues that engage sign-tracking.

PubMed

Smedley, Elizabeth B; Smith, Kyle S

2018-06-19

Sign-tracking is a phenomenon whereby cues that predict rewards come to acquire their own motivational value (incentive salience) and attract appetitive behavior. Typically, sign-tracking paradigms have used single auditory, visual, or lever cues presented prior to a reward delivery. Yet, real world examples of events often can be predicted by a sequence of cues. We have shown that animals will sign-track to multiple cues presented in temporal sequence, and with time develop a bias in responding toward a reward distal cue over a reward proximal cue. Further, extinction of responding to the reward proximal cue directly decreases responding to the reward distal cue. One possible explanation of this result is that serial cues become representationally linked with one another. Here we provide further support of this by showing that extinction of responding to a reward distal cue directly reduces responding to a reward proximal cue. We suggest that the incentive salience of one cue can influence the incentive salience of the other cue. Copyright © 2018. Published by Elsevier B.V.

The differential effects of tangible rewards and praise on intrinsic motivation: A comparison of cognitive evaluation theory and operant theory.

PubMed

Carton, J S

1996-01-01

Substantial research indicates that tangible rewards, such as money, prizes, and tokens, decrease response rates by undermining intrinsic motivation. In contrast, praise appears to increase response rates by enhancing intrinsic motivation. Based on their interpretation of available evidence, many social-cognitive researchers warn not to use tangible rewards in applied settings and to use praise instead. Furthermore, they suggest that the differential effects of the two types of rewards on intrinsic motivation cannot be explained using principles of operant psychology. Cognitive evaluation theory provides one of the most recent and widely cited social-cognitive explanations for the different effects of the two types of rewards on intrinsic motivation (Deci & Ryan, 1985). However, a review of existing research found little support for the explanations based on this theory and revealed three potential confounding effects: (a) temporal contiguity, (b) the number of reward administrations, and (c) discriminative stimuli associated with reward availability. These three confounding factors provide explanations for the effects of tangible rewards and praise on intrinsic motivation that are consistent with principles of operant psychology.

The differential effects of tangible rewards and praise on intrinsic motivation: A comparison of cognitive evaluation theory and operant theory

PubMed Central

Carton, John S.

1996-01-01

Substantial research indicates that tangible rewards, such as money, prizes, and tokens, decrease response rates by undermining intrinsic motivation. In contrast, praise appears to increase response rates by enhancing intrinsic motivation. Based on their interpretation of available evidence, many social-cognitive researchers warn not to use tangible rewards in applied settings and to use praise instead. Furthermore, they suggest that the differential effects of the two types of rewards on intrinsic motivation cannot be explained using principles of operant psychology. Cognitive evaluation theory provides one of the most recent and widely cited social-cognitive explanations for the different effects of the two types of rewards on intrinsic motivation (Deci & Ryan, 1985). However, a review of existing research found little support for the explanations based on this theory and revealed three potential confounding effects: (a) temporal contiguity, (b) the number of reward administrations, and (c) discriminative stimuli associated with reward availability. These three confounding factors provide explanations for the effects of tangible rewards and praise on intrinsic motivation that are consistent with principles of operant psychology. PMID:22478261

Pubertal status associations with reward and threat sensitivities and subcortical brain volumes during adolescence.

PubMed

Urošević, Snežana; Collins, Paul; Muetzel, Ryan; Lim, Kelvin O; Luciana, Monica

2014-08-01

Adolescence is characterized by complex developmental processes that impact behavior, biology, and social functioning. Two such adolescence-specific processes are puberty and increases in reward sensitivity. Relations between these processes are poorly understood. The present study focused on examining unique effects of puberty, age, and sex on reward and threat sensitivities and volumes of subcortical brain structures relevant for reward/threat processing in a healthy sample of 9-18year-olds. Unlike age, pubertal status had a significant unique positive relationship with reward sensitivity. In addition, there was a trend for adolescent females to exhibit higher threat sensitivity with more advanced pubertal development and higher reward and threat sensitivity with older age. Similarly, there were significant puberty by sex interaction effects on striatal volumes, i.e., left nucleus accumbens and right pallidum. The present pattern of results suggests that pubertal development, independent of chronological age, is uniquely associated with reward hypersensitivity and with structural differences in striatal regions implicated in reward processing. Copyright © 2014 Elsevier Inc. All rights reserved.

Effects of emotional preferences on value-based decision making are mediated by mentalizing not reward networks

PubMed Central

Evans, Simon; Fleming, Stephen M.; Dolan, Raymond J.; Averbeck, Bruno B.

2012-01-01

Real-world decision-making often involves social considerations. Consequently, the social value of stimuli can induce preferences in choice behavior. However, it is unknown how financial and social values are integrated in the brain. Here, we investigated how smiling and angry face stimuli interacted with financial reward feedback in a stochastically-rewarded decision-making task. Subjects reliably preferred the smiling faces despite equivalent reward feedback, demonstrating a socially driven bias. We fit a Bayesian reinforcement learning model to factor the effects of financial rewards and emotion preferences in individual subjects, and regressed model predictions on the trial-by-trial fMRI signal. Activity in the sub-callosal cingulate and the ventral striatum, both involved in reward learning, correlated with financial reward feedback, whereas the differential contribution of social value activated dorsal temporo-parietal junction and dorsal anterior cingulate cortex, previously proposed as components of a mentalizing network. We conclude that the impact of social stimuli on value-based decision processes is mediated by effects in brain regions partially separable from classical reward circuitry. PMID:20946058

A Systematic Review of fMRI Reward Paradigms in Adolescents versus Adults: The Impact of Task Design and Implications for Understanding Neurodevelopment

PubMed Central

Richards, Jessica M.; Plate, Rista C.; Ernst, Monique

2013-01-01

The neural systems underlying reward-related behaviors across development have recently generated a great amount of interest. Yet, the neurodevelopmental literature on reward processing is marked by inconsistencies due to the heterogeneity of the reward paradigms used, the complexity of the behaviors being studied, and the developing brain itself as a moving target. The present review will examine task design as one source of variability across findings by compiling this literature along three dimensions: (1) task structures, (2) cognitive processes, and (3) neural systems. We start with the presentation of a heuristic neural systems model, the Triadic Model, as a way to provide a theoretical framework for the neuroscience research on motivated behaviors. We then discuss the principles guiding reward task development. Finally, we review the extant developmental neuroimaging literature on reward-related processing, organized by reward task type. We hope that this approach will help to clarify the literature on the functional neurodevelopment of reward-related neural systems, and to identify the role of the experimental parameters that significantly influence these findings. PMID:23518270

Statistical Mechanics of the Delayed Reward-Based Learning with Node Perturbation

NASA Astrophysics Data System (ADS)

Hiroshi Saito,; Kentaro Katahira,; Kazuo Okanoya,; Masato Okada,

2010-06-01

In reward-based learning, reward is typically given with some delay after a behavior that causes the reward. In machine learning literature, the framework of the eligibility trace has been used as one of the solutions to handle the delayed reward in reinforcement learning. In recent studies, the eligibility trace is implied to be important for difficult neuroscience problem known as the “distal reward problem”. Node perturbation is one of the stochastic gradient methods from among many kinds of reinforcement learning implementations, and it searches the approximate gradient by introducing perturbation to a network. Since the stochastic gradient method does not require a objective function differential, it is expected to be able to account for the learning mechanism of a complex system, like a brain. We study the node perturbation with the eligibility trace as a specific example of delayed reward-based learning, and analyzed it using a statistical mechanics approach. As a result, we show the optimal time constant of the eligibility trace respect to the reward delay and the existence of unlearnable parameter configurations.

Reward and Aversion.

PubMed

Hu, Hailan

2016-07-08

To benefit from opportunities and cope with challenges in the environment, animals must adapt their behavior to acquire rewards and to avoid punishments. Maladaptive changes in the neuromodulatory systems and neural circuits for reward and aversion can lead to manifestation of several prominent psychiatric disorders including addiction and depression. Recent progress is pushing the boundaries of knowledge on two major fronts in research on reward and aversion: First, new layers of complexity have been reported on the functions of dopamine (DA) and serotonin (5-HT) neuromodulatory systems in reward and aversion. Second, specific circuit components in the neural pathways that encode reward and aversion have begun to be identified. This review aims to outline historic perspectives and new insights into the functions of DA and 5-HT systems in coding the distinct components of rewards. It also highlights recent advances in neural circuit studies enabled by new technologies, such as cell-type-specific electrophysiology and tracing, and optogenetics-based behavioral manipulation. This knowledge may provide guidance for developing novel treatment strategies for neuropsychiatric diseases related to the malfunction of the reward system.

Tentative Evidence for Striatal Hyperactivity in Adolescent Cannabis Using Boys: A Cross-Sectional Multicenter fMRI Study

PubMed Central

Jager, Gerry; Block, Robert I.; Luijten, Maartje; Ramsey, Nick F.

2013-01-01

Adolescents' risk-taking behavior has been linked to a maturational imbalance between reward (“go”) and inhibitory-control (“stop”) related brain circuitry. This may drive adolescent drug-taking, such as cannabis use. In this study we assessed the non-acute effects of adolescent cannabis use on reward-related brain function. We performed a two-site (United States and Netherlands; pooled data) functional magnetic resonance imaging (fMRI) study with a cross-sectional design. Twenty-one abstinent but frequent cannabis-using boys were compared with 24 non-using peers on reward-related brain function, using a monetary incentive delay task with fMRI. Focus was on anticipatory and response stages of reward and brain areas critically involved in reward processing like the striatum. Performance in users was normal. Region-of-interest analysis indicated striatal hyperactivity during anticipatory stages of reward in users. Intriguingly, this effect was most pronounced during non-rewarding events. Striatal hyperactivity in adolescent cannabis users may signify an overly sensitive motivational brain circuitry. Frequent cannabis use during adolescence may induce diminished ability to disengage the motivational circuit when no reward can be obtained. This could strengthen the search for reinforcements like drugs of abuse, even when facing the negative (non-rewarding) consequences. PMID:23909003

Disrupted reward circuits is associated with cognitive deficits and depression severity in major depressive disorder.

PubMed

Gong, Liang; Yin, Yingying; He, Cancan; Ye, Qing; Bai, Feng; Yuan, Yonggui; Zhang, Haisan; Lv, Luxian; Zhang, Hongxing; Xie, Chunming; Zhang, Zhijun

2017-01-01

Neuroimaging studies have demonstrated that major depressive disorder (MDD) patients show blunted activity responses to reward-related tasks. However, whether abnormal reward circuits affect cognition and depression in MDD patients remains unclear. Seventy-five drug-naive MDD patients and 42 cognitively normal (CN) subjects underwent a resting-state functional magnetic resonance imaging scan. The bilateral nucleus accumbens (NAc) were selected as seeds to construct reward circuits across all subjects. A multivariate linear regression analysis was employed to investigate the neural substrates of cognitive function and depression severity on the reward circuits in MDD patients. The common pathway underlying cognitive deficits and depression was identified with conjunction analysis. Compared with CN subjects, MDD patients showed decreased reward network connectivity that was primarily located in the prefrontal-striatal regions. Importantly, distinct and common neural pathways underlying cognition and depression were identified, implying the independent and synergistic effects of cognitive deficits and depression severity on reward circuits. This study demonstrated that disrupted topological organization within reward circuits was significantly associated with cognitive deficits and depression severity in MDD patients. These findings suggest that in addition to antidepressant treatment, normalized reward circuits should be a focus and a target for improving depression and cognitive deficits in MDD patients. Copyright © 2016 Elsevier Ltd. All rights reserved.

Life stress in adolescence predicts early adult reward-related brain function and alcohol dependence

PubMed Central

Shaw, Daniel S.; Sitnick, Stephanie L.; Musselman, Samuel C.; Forbes, Erika E.

2015-01-01

Stressful life events increase vulnerability to problematic alcohol use, and they may do this by disrupting reward-related neural circuitry. This is particularly relevant for adolescents because alcohol use rises sharply after mid-adolescence and alcohol abuse peaks at age 20. Adolescents also report more stressors compared with children, and neural reward circuitry may be especially vulnerable to stressors during adolescence because of prefrontal cortex remodeling. Using a large sample of male participants in a longitudinal functional magnetic resonance imaging study (N = 157), we evaluated whether cumulative stressful life events between the ages of 15 and 18 were associated with reward-related brain function and problematic alcohol use at age 20 years. Higher cumulative stressful life events during adolescence were associated with decreased response in the medial prefrontal cortex (mPFC) during monetary reward anticipation and following the receipt of monetary rewards. Stress-related decreases in mPFC response during reward anticipation and following rewarding outcomes were associated with the severity of alcohol dependence. Furthermore, mPFC response mediated the association between stressful life events and later symptoms of alcohol dependence. These data are consistent with neurobiological models of addiction that propose that stressors during adolescence increase risk for problematic alcohol use by disrupting reward circuit function. PMID:24795442

The effort-reward imbalance work-stress model and daytime salivary cortisol and dehydroepiandrosterone (DHEA) among Japanese women.

PubMed

Ota, Atsuhiko; Mase, Junji; Howteerakul, Nopporn; Rajatanun, Thitipat; Suwannapong, Nawarat; Yatsuya, Hiroshi; Ono, Yuichiro

2014-09-17

We examined the influence of work-related effort-reward imbalance and overcommitment to work (OC), as derived from Siegrist's Effort-Reward Imbalance (ERI) model, on the hypothalamic-pituitary-adrenocortical (HPA) axis. We hypothesized that, among healthy workers, both cortisol and dehydroepiandrosterone (DHEA) secretion would be increased by effort-reward imbalance and OC and, as a result, cortisol-to-DHEA ratio (C/D ratio) would not differ by effort-reward imbalance or OC. The subjects were 115 healthy female nursery school teachers. Salivary cortisol, DHEA, and C/D ratio were used as indexes of HPA activity. Mixed-model analyses of variance revealed that neither the interaction between the ERI model indicators (i.e., effort, reward, effort-to-reward ratio, and OC) and the series of measurement times (9:00, 12:00, and 15:00) nor the main effect of the ERI model indicators was significant for daytime salivary cortisol, DHEA, or C/D ratio. Multiple linear regression analyses indicated that none of the ERI model indicators was significantly associated with area under the curve of daytime salivary cortisol, DHEA, or C/D ratio. We found that effort, reward, effort-reward imbalance, and OC had little influence on daytime variation patterns, levels, or amounts of salivary HPA-axis-related hormones. Thus, our hypotheses were not supported.

Video game training and the reward system.

PubMed

Lorenz, Robert C; Gleich, Tobias; Gallinat, Jürgen; Kühn, Simone

2015-01-01

Video games contain elaborate reinforcement and reward schedules that have the potential to maximize motivation. Neuroimaging studies suggest that video games might have an influence on the reward system. However, it is not clear whether reward-related properties represent a precondition, which biases an individual toward playing video games, or if these changes are the result of playing video games. Therefore, we conducted a longitudinal study to explore reward-related functional predictors in relation to video gaming experience as well as functional changes in the brain in response to video game training. Fifty healthy participants were randomly assigned to a video game training (TG) or control group (CG). Before and after training/control period, functional magnetic resonance imaging (fMRI) was conducted using a non-video game related reward task. At pretest, both groups showed strongest activation in ventral striatum (VS) during reward anticipation. At posttest, the TG showed very similar VS activity compared to pretest. In the CG, the VS activity was significantly attenuated. This longitudinal study revealed that video game training may preserve reward responsiveness in the VS in a retest situation over time. We suggest that video games are able to keep striatal responses to reward flexible, a mechanism which might be of critical value for applications such as therapeutic cognitive training.

Adolescent Depression: Stress and Reward Dysfunction

PubMed Central

Auerbach, Randy P.; Admon, Roee; Pizzagalli, Diego A.

2014-01-01

Adolescence is a peak period for the onset of depression, and it is also a time marked by substantial stress as well as neural development within the brain reward circuitry. In the current review, we provide a selective overview of current animal and human research investigating the relationship among reward processes, stress, and depression. Three separate, but related, etiological models examine the differential roles that stress may play with regard to reward dysfunction and adolescent depression. First, the reward mediation model suggests that acute and chronic stress contribute to reward deficits, which in turn, potentiate depressive symptoms and/or increase the risk for depression. Second, in line with the stress generation perspective, it is plausible that premorbid reward-related dysfunction generates stress, in particular interpersonal stress, which then leads to the manifestation of depressive symptoms. Last, consistent with a diathesis-stress model, the interaction between stress and premorbid reward dysfunction may contribute to the onset of depression. Given the equifinal nature of depression, these models could shed important light on different etiological pathways during adolescence, particularly as they may relate to understanding the heterogeneity of depression. To highlight the translational potential of these insights, a hypothetical case study is provided as means of demonstrating the importance of targeting reward dysfunction in both assessment and treatment of adolescent depression. PMID:24704785

Tightening up the performance-pay linkage: roles of contingent reward leadership and profit-sharing in the cross-level influence of individual pay-for-performance.

PubMed

Han, Joo Hun; Bartol, Kathryn M; Kim, Seongsu

2015-03-01

Drawing upon line-of-sight (Lawler, 1990, 2000; Murphy, 1999) as a unifying concept, we examine the cross-level influence of organizational use of individual pay-for-performance (PFP), theorizing that its impact on individual employees' performance-reward expectancy is boosted by the moderating effects of immediate group managers' contingent reward leadership and organizational use of profit-sharing. Performance-reward expectancy is then expected to mediate the interactive effects of individual PFP with contingent reward leadership and profit-sharing on employee job performance. Analyses of cross-organizational and cross-level data from 912 employees in 194 workgroups from 45 companies reveal that organizations' individual PFP was positively related to employees' performance-reward expectancy, which was strengthened when it was accompanied by higher levels of contingent reward leadership and profit-sharing. Also, performance-reward expectancy significantly transmitted the effects of individual PFP onto job performance under higher levels of contingent reward leadership and profit-sharing, thus delineating cross-level mediating and moderating processes by which organizations' individual PFP is linked to important individual-level employee outcomes. Several theoretical and practical implications are discussed. PsycINFO Database Record (c) 2015 APA, all rights reserved.

Diurnal rhythms in psychological reward functioning in healthy young men: 'Wanting', liking, and learning.

PubMed

Byrne, Jamie E M; Murray, Greg

2017-01-01

A range of evidence suggests that human reward functioning is partly driven by the endogenous circadian system, generating 24-hour rhythms in behavioural measures of reward activation. Reward functioning is multifaceted but literature to date is largely limited to measures of self-reported positive mood states. The aim of this study was to advance the field by testing for hypothesised diurnal variation in previously unexplored components of psychological reward: 'wanting', liking, and learning using subjective and behavioural measures. Risky decision making (automatic Balloon Analogue Risk Task), affective responsivity to positive images (International Affective Pictures System), uncued self-reported discrete emotions, and learning-contingent reward (Iowa Gambling Task) were measured at 10.00 hours, 14.00 hours, and 19.00 hours in a counterbalanced repeated measures design with 50 healthy male participants (aged 18-30). As hypothesised, risky decision making (unconscious 'wanting') and ratings of arousal towards positive images (conscious wanting) exhibited a diurnal waveform with indices highest at 14.00 hours. No diurnal rhythm was observed for liking (pleasure ratings to positive images, discrete uncued positive emotions) or in a learning-contingent reward task. Findings reaffirm that diurnal variation in human reward functioning is most pronounced in the motivational 'wanting' components of reward.

Prediction-error in the context of real social relationships modulates reward system activity.

PubMed

Poore, Joshua C; Pfeifer, Jennifer H; Berkman, Elliot T; Inagaki, Tristen K; Welborn, Benjamin L; Lieberman, Matthew D

2012-01-01

The human reward system is sensitive to both social (e.g., validation) and non-social rewards (e.g., money) and is likely integral for relationship development and reputation building. However, data is sparse on the question of whether implicit social reward processing meaningfully contributes to explicit social representations such as trust and attachment security in pre-existing relationships. This event-related fMRI experiment examined reward system prediction-error activity in response to a potent social reward-social validation-and this activity's relation to both attachment security and trust in the context of real romantic relationships. During the experiment, participants' expectations for their romantic partners' positive regard of them were confirmed (validated) or violated, in either positive or negative directions. Primary analyses were conducted using predefined regions of interest, the locations of which were taken from previously published research. Results indicate that activity for mid-brain and striatal reward system regions of interest was modulated by social reward expectation violation in ways consistent with prior research on reward prediction-error. Additionally, activity in the striatum during viewing of disconfirmatory information was associated with both increases in post-scan reports of attachment anxiety and decreases in post-scan trust, a finding that follows directly from representational models of attachment and trust.

Altered striatal activation predicting real-world positive affect in adolescent major depressive disorder.

PubMed

Forbes, Erika E; Hariri, Ahmad R; Martin, Samantha L; Silk, Jennifer S; Moyles, Donna L; Fisher, Patrick M; Brown, Sarah M; Ryan, Neal D; Birmaher, Boris; Axelson, David A; Dahl, Ronald E

2009-01-01

Alterations in reward-related brain function and phenomenological aspects of positive affect are increasingly examined in the development of major depressive disorder. The authors tested differences in reward-related brain function in healthy and depressed adolescents, and the authors examined direct links between reward-related brain function and positive mood that occurred in real-world contexts. Fifteen adolescents with major depressive disorder and 28 adolescents with no history of psychiatric disorder, ages 8-17 years, completed a functional magnetic resonance imaging guessing task involving monetary reward. Participants also reported their subjective positive affect in natural environments during a 4-day cell-phone-based ecological momentary assessment. Adolescents with major depressive disorder exhibited less striatal response than healthy comparison adolescents during reward anticipation and reward outcome, but more response in dorsolateral and medial prefrontal cortex. Diminished activation in a caudate region associated with this depression group difference was correlated with lower subjective positive affect in natural environments, particularly within the depressed group. Results support models of altered reward processing and related positive affect in young people with major depressive disorder and indicate that depressed adolescents' brain response to monetary reward is related to their affective experience in natural environments. Additionally, these results suggest that reward-processing paradigms capture brain function relevant to real-world positive affect.

Examining the interaction between cognitive control and reward sensitivity in substance use dependence.

PubMed

Charles-Walsh, Kathleen; Upton, Daniel J; Hester, Robert

2016-09-01

Drug dependence is characterized by altered reward processing and poor cognitive control, expressed as a preference for immediate rewards and impaired inhibitory control, respectively. To examine the interaction between reward processing (via the presence or absence of reward) and mechanisms of inhibitory control in drug dependence, the current study used the Monetary Incentive Control Task (MICT) to examine whether a group of opiate dependent persons demonstrated greater difficulty exerting control over immediate rewards compared to neutral stimuli. The MICT is a Go/Stop paradigm that examines inhibitory control over immediate rewards. Performance of 32 opiate dependent individuals was compared to 29 healthy controls. Opiate users demonstrated poorer inhibitory performance than controls, irrespective of cues signaling immediate reward. Whereas control participants' responses were modulated by probability cues, the opiate group did not show a capacity to up-regulate their cognitive control performance. The present results suggest a general decrease in cognitive control in opiate dependence, accompanied by a reduced ability to optimally modulate behavior in accordance with external cues. Opiate users and controls did not differ in the interaction between cognitive control and reward. The study highlights important issues for future research to consider when further examining this interaction in drug dependence. Crown Copyright © 2016. Published by Elsevier Ireland Ltd. All rights reserved.

Balancing Risk and Reward: A Rat Model of Risky Decision-Making

PubMed Central

Simon, Nicholas W.; Gilbert, Ryan J.; Mayse, Jeffrey D.; Bizon, Jennifer L.; Setlow, Barry

2009-01-01

We developed a behavioral task in rats to assess the influence of risk of punishment on decision-making. Male Long-Evans rats were given choices between pressing a lever to obtain a small, “safe” food reward and a large food reward associated with risk of punishment (footshock). Each test session consisted of 5 blocks of 10 choice trials, with punishment risk increasing with each consecutive block (0, 25, 50, 75, 100%). Preference for the large, “risky” reward declined with both increased probability and increased magnitude of punishment, and reward choice was not affected by the level of satiation or the order of risk presentation. Performance in this risky decision-making task was correlated with the degree to which the rats discounted the value of probabilistic rewards, but not delayed rewards. Finally, the acute effects of different doses of amphetamine and cocaine on risky decision-making were assessed. Systemic amphetamine administration caused a dose-dependent decrease in choice of the large risky reward (i.e. – it made rats more risk-averse). Cocaine did not cause a shift in reward choice, but instead impaired rats’ sensitivity to changes in punishment risk. These results should prove useful for investigating neuropsychiatric disorders in which risk taking is a prominent feature, such as attention deficit/hyperactivity disorder and addiction. PMID:19440192

Video game training and the reward system

PubMed Central

Lorenz, Robert C.; Gleich, Tobias; Gallinat, Jürgen; Kühn, Simone

2015-01-01

Video games contain elaborate reinforcement and reward schedules that have the potential to maximize motivation. Neuroimaging studies suggest that video games might have an influence on the reward system. However, it is not clear whether reward-related properties represent a precondition, which biases an individual toward playing video games, or if these changes are the result of playing video games. Therefore, we conducted a longitudinal study to explore reward-related functional predictors in relation to video gaming experience as well as functional changes in the brain in response to video game training. Fifty healthy participants were randomly assigned to a video game training (TG) or control group (CG). Before and after training/control period, functional magnetic resonance imaging (fMRI) was conducted using a non-video game related reward task. At pretest, both groups showed strongest activation in ventral striatum (VS) during reward anticipation. At posttest, the TG showed very similar VS activity compared to pretest. In the CG, the VS activity was significantly attenuated. This longitudinal study revealed that video game training may preserve reward responsiveness in the VS in a retest situation over time. We suggest that video games are able to keep striatal responses to reward flexible, a mechanism which might be of critical value for applications such as therapeutic cognitive training. PMID:25698962

Dopaminergic modulation of the human reward system: a placebo-controlled dopamine depletion fMRI study.

PubMed

da Silva Alves, Fabiana; Schmitz, Nicole; Figee, Martijn; Abeling, Nico; Hasler, Gregor; van der Meer, Johan; Nederveen, Aart; de Haan, Lieuwe; Linszen, Don; van Amelsvoort, Therese

2011-04-01

Reward related behaviour is linked to dopaminergic neurotransmission. Our aim was to gain insight into dopaminergic involvement in the human reward system. Combining functional magnetic resonance imaging with dopaminergic depletion by α-methylparatyrosine we measured dopamine-related brain activity in 10 healthy volunteers. In addition to blood-oxygen-level-dependent (BOLD) contrast we assessed the effect of dopaminergic depletion on prolactin response, peripheral markers for dopamine and norepinephrine. In the placebo condition we found increased activation in the left caudate and left cingulate gyrus during anticipation of reward. In the α-methylparatyrosine condition there was no significant brain activation during anticipation of reward or loss. In α-methylparatyrosine, anticipation of reward vs. loss increased activation in the right insula, left frontal, right parietal cortices and right cingulate gyrus. Comparing placebo versus α-methylparatyrosine showed increased activation in the left cingulate gyrus during anticipation of reward and the left medial frontal gyrus during anticipation of loss. α-methylparatyrosine reduced levels of dopamine in urine and homovanillic acid in plasma and increased prolactin. No significant effect of α-methylparatyrosine was found on norepinephrine markers. Our findings implicate distinct patterns of BOLD underlying reward processing following dopamine depletion, suggesting a role of dopaminergic neurotransmission for anticipation of monetary reward.

Suboptimal choice in rats: incentive salience attribution promotes maladaptive decision-making

PubMed Central

Chow, Jonathan J; Smith, Aaron P; Wilson, A George; Zentall, Thomas R; Beckmann, Joshua S

2016-01-01

Stimuli that are more predictive of subsequent reward also function as better conditioned reinforcers. Moreover, stimuli attributed with incentive salience function as more robust conditioned reinforcers. Some theories have suggested that conditioned reinforcement plays an important role in promoting suboptimal choice behavior, like gambling. The present experiments examined how different stimuli, those attributed with incentive salience versus those without, can function in tandem with stimulus-reward predictive utility to promote maladaptive decision-making in rats. One group of rats had lights associated with goal-tracking as the reward-predictive stimuli and another had levers associated with sign-tracking as the reward-predictive stimuli. All rats were first trained on a choice procedure in which the expected value across both alternatives was equivalent but differed in their stimulus-reward predictive utility. Next, the expected value across both alternatives was systematically changed so that the alternative with greater stimulus-reward predictive utility was suboptimal in regard to primary reinforcement. The results demonstrate that in order to obtain suboptimal choice behavior, incentive salience alongside strong stimulus-reward predictive utility may be necessary; thus, maladaptive decision-making can be driven more by the value attributed to stimuli imbued with incentive salience that reliably predict a reward rather than the reward itself. PMID:27993692

Music models aberrant rule decoding and reward valuation in dementia

PubMed Central

Clark, Camilla N; Golden, Hannah L; McCallion, Oliver; Nicholas, Jennifer M; Cohen, Miriam H; Slattery, Catherine F; Paterson, Ross W; Fletcher, Phillip D; Mummery, Catherine J; Rohrer, Jonathan D; Crutch, Sebastian J; Warren, Jason D

2018-01-01

Abstract Aberrant rule- and reward-based processes underpin abnormalities of socio-emotional behaviour in major dementias. However, these processes remain poorly characterized. Here we used music to probe rule decoding and reward valuation in patients with frontotemporal dementia (FTD) syndromes and Alzheimer’s disease (AD) relative to healthy age-matched individuals. We created short melodies that were either harmonically resolved (‘finished’) or unresolved (‘unfinished’); the task was to classify each melody as finished or unfinished (rule processing) and rate its subjective pleasantness (reward valuation). Results were adjusted for elementary pitch and executive processing; neuroanatomical correlates were assessed using voxel-based morphometry. Relative to healthy older controls, patients with behavioural variant FTD showed impairments of both musical rule decoding and reward valuation, while patients with semantic dementia showed impaired reward valuation but intact rule decoding, patients with AD showed impaired rule decoding but intact reward valuation and patients with progressive non-fluent aphasia performed comparably to healthy controls. Grey matter associations with task performance were identified in anterior temporal, medial and lateral orbitofrontal cortices, previously implicated in computing diverse biological and non-biological rules and rewards. The processing of musical rules and reward distils cognitive and neuroanatomical mechanisms relevant to complex socio-emotional dysfunction in major dementias. PMID:29186630

Suboptimal choice in rats: Incentive salience attribution promotes maladaptive decision-making.

PubMed

Chow, Jonathan J; Smith, Aaron P; Wilson, A George; Zentall, Thomas R; Beckmann, Joshua S

2017-03-01

Stimuli that are more predictive of subsequent reward also function as better conditioned reinforcers. Moreover, stimuli attributed with incentive salience function as more robust conditioned reinforcers. Some theories have suggested that conditioned reinforcement plays an important role in promoting suboptimal choice behavior, like gambling. The present experiments examined how different stimuli, those attributed with incentive salience versus those without, can function in tandem with stimulus-reward predictive utility to promote maladaptive decision-making in rats. One group of rats had lights associated with goal-tracking as the reward-predictive stimuli and another had levers associated with sign-tracking as the reward-predictive stimuli. All rats were first trained on a choice procedure in which the expected value across both alternatives was equivalent but differed in their stimulus-reward predictive utility. Next, the expected value across both alternatives was systematically changed so that the alternative with greater stimulus-reward predictive utility was suboptimal in regard to primary reinforcement. The results demonstrate that in order to obtain suboptimal choice behavior, incentive salience alongside strong stimulus-reward predictive utility may be necessary; thus, maladaptive decision-making can be driven more by the value attributed to stimuli imbued with incentive salience that reliably predict a reward rather than the reward itself. Copyright © 2016 Elsevier B.V. All rights reserved.

Developmental continuity in reward-related enhancement of cognitive control.

PubMed

Strang, Nicole M; Pollak, Seth D

2014-10-01

Adolescents engage in more risky behavior than children or adults. The most prominent hypothesis for this phenomenon is that brain systems governing reward sensitivity and brain systems governing self-regulation mature at different rates. Those systems governing reward sensitivity mature in advance of those governing self-control. This hypothesis has substantial empirical support, however, the evidence supporting this theory has been exclusively derived from contexts where self-control systems are required to regulate reward sensitivity in order to promote adaptive behavior. In adults, reward promotes a shift to a proactive control strategy and better cognitive control performance. It is unclear whether children and adolescents will respond to reward in the same way. Using fMRI methodology, we explored whether children and adolescents would demonstrate a shift to proactive control in the context of reward. We tested 22 children, 20 adolescents, and 23 adults. In contrast to our hypothesis, children, adolescents, and adults all demonstrated a shift to proactive cognitive control in the context of reward. In light of the results, current neurobiological theories of adolescent behavior need to be refined to reflect that in certain contexts there is continuity in the manner reward and cognitive control systems interact across development. Copyright © 2014 The Authors. Published by Elsevier Ltd.. All rights reserved.

Balancing risk and reward: a rat model of risky decision making.

PubMed

Simon, Nicholas W; Gilbert, Ryan J; Mayse, Jeffrey D; Bizon, Jennifer L; Setlow, Barry

2009-09-01

We developed a behavioral task in rats to assess the influence of risk of punishment on decision making. Male Long-Evans rats were given choices between pressing a lever to obtain a small, 'safe' food reward and a large food reward associated with risk of punishment (footshock). Each test session consisted of 5 blocks of 10 choice trials, with punishment risk increasing with each consecutive block (0, 25, 50, 75, 100%). Preference for the large, 'risky' reward declined with both increased probability and increased magnitude of punishment, and reward choice was not affected by the level of satiation or the order of risk presentation. Performance in this risky decision-making task was correlated with the degree to which the rats discounted the value of probabilistic rewards, but not delayed rewards. Finally, the acute effects of different doses of amphetamine and cocaine on risky decision making were assessed. Systemic amphetamine administration caused a dose-dependent decrease in choice of the large risky reward (ie, it made rats more risk averse). Cocaine did not cause a shift in reward choice, but instead impaired the rats' sensitivity to changes in punishment risk. These results should prove useful for investigating neuropsychiatric disorders in which risk taking is a prominent feature, such as attention deficit/hyperactivity disorder and addiction.

Tentative evidence for striatal hyperactivity in adolescent cannabis-using boys: a cross-sectional multicenter fMRI study.

PubMed

Jager, Gerry; Block, Robert I; Luijten, Maartje; Ramsey, Nick F

2013-01-01

Adolescents' risk-taking behavior has been linked to a maturational imbalance between reward ("go") and inhibitory-control ("stop")-related brain circuitry. This may drive adolescent drug-taking, such as cannabis use. In this study, we assessed the non-acute effects of adolescent cannabis use on reward-related brain function. We performed a two-site (United States and Netherlands; pooled data) functional magnetic resonance imaging (fMRI) study with a cross-sectional design. Twenty-one abstinent but frequent cannabis-using boys were compared with 24 non-using peers on reward-related brain function, using a monetary incentive delay task with fMRI. Focus was on anticipatory and response stages of reward and brain areas critically involved in reward processing like the striatum. Performance in users was normal. Region-of-interest analysis indicated striatal hyperactivity during anticipatory stages of reward in users. Intriguingly, this effect was most pronounced during non-rewarding events. Striatal hyperactivity in adolescent cannabis users may signify an overly sensitive motivational brain circuitry. Frequent cannabis use during adolescence may induce diminished ability to disengage the motivational circuit when no reward can be obtained. This could strengthen the search for reinforcements like drugs of abuse, even when facing the negative (non-rewarding) consequences.

Temporal discounting in major depressive disorder.

PubMed

Pulcu, E; Trotter, P D; Thomas, E J; McFarquhar, M; Juhasz, G; Sahakian, B J; Deakin, J F W; Zahn, R; Anderson, I M; Elliott, R

2014-07-01

Major depressive disorder (MDD) is associated with abnormalities in financial reward processing. Previous research suggests that patients with MDD show reduced sensitivity to frequency of financial rewards. However, there is a lack of conclusive evidence from studies investigating the evaluation of financial rewards over time, an important aspect of reward processing that influences the way people plan long-term investments. Beck's cognitive model posits that patients with MDD hold a negative view of the future that may influence the amount of resources patients are willing to invest into their future selves. We administered a delay discounting task to 82 participants: 29 healthy controls, 29 unmedicated participants with fully remitted MDD (rMDD) and 24 participants with current MDD (11 on medication). Patients with current MDD, relative to remitted patients and healthy subjects, discounted large-sized future rewards at a significantly higher rate and were insensitive to changes in reward size from medium to large. There was a main effect of clinical group on discounting rates for large-sized rewards, and discounting rates for large-sized rewards correlated with severity of depressive symptoms, particularly hopelessness. Higher discounting of delayed rewards in MDD seems to be state dependent and may be a reflection of depressive symptoms, specifically hopelessness. Discounting distant rewards at a higher rate means that patients are more likely to choose immediate financial options. Such impairments related to long-term investment planning may be important for understanding value-based decision making in MDD, and contribute to ongoing functional impairment.

A target sample of adolescents and reward processing: same neural and behavioral correlates engaged in common paradigms?

PubMed

Nees, Frauke; Vollstädt-Klein, Sabine; Fauth-Bühler, Mira; Steiner, Sabina; Mann, Karl; Poustka, Luise; Banaschewski, Tobias; Büchel, Christian; Conrod, Patricia J; Garavan, Hugh; Heinz, Andreas; Ittermann, Bernd; Artiges, Eric; Paus, Tomas; Pausova, Zdenka; Rietschel, Marcella; Smolka, Michael N; Struve, Maren; Loth, Eva; Schumann, Gunter; Flor, Herta

2012-11-01

Adolescence is a transition period that is assumed to be characterized by increased sensitivity to reward. While there is growing research on reward processing in adolescents, investigations into the engagement of brain regions under different reward-related conditions in one sample of healthy adolescents, especially in a target age group, are missing. We aimed to identify brain regions preferentially activated in a reaction time task (monetary incentive delay (MID) task) and a simple guessing task (SGT) in a sample of 14-year-old adolescents (N = 54) using two commonly used reward paradigms. Functional magnetic resonance imaging was employed during the MID with big versus small versus no win conditions and the SGT with big versus small win and big versus small loss conditions. Analyses focused on changes in blood oxygen level-dependent contrasts during reward and punishment processing in anticipation and feedback phases. We found clear magnitude-sensitive response in reward-related brain regions such as the ventral striatum during anticipation in the MID task, but not in the SGT. This was also true for reaction times. The feedback phase showed clear reward-related, but magnitude-independent, response patterns, for example in the anterior cingulate cortex, in both tasks. Our findings highlight neural and behavioral response patterns engaged in two different reward paradigms in one sample of 14-year-old healthy adolescents and might be important for reference in future studies investigating reward and punishment processing in a target age group.

Intranasal oxytocin enhances neural processing of monetary reward and loss in post-traumatic stress disorder and traumatized controls.

PubMed

Nawijn, Laura; van Zuiden, Mirjam; Koch, Saskia B J; Frijling, Jessie L; Veltman, Dick J; Olff, Miranda

2016-04-01

Anhedonia is a significant clinical problem in post-traumatic stress disorder (PTSD). PTSD patients show reduced motivational approach behavior, which may underlie anhedonic symptoms. Oxytocin administration is known to increase reward sensitivity and approach behavior. We therefore investigated whether oxytocin administration affected neural responses during motivational processing in PTSD patients and trauma-exposed controls. 35 police officers with PTSD (21 males) and 37 trauma-exposed police officers without PTSD (19 males) were included in a within-subjects, randomized, placebo-controlled fMRI study. Neural responses during anticipation of monetary reward and loss were investigated with a monetary incentive delay task (MID) after placebo and oxytocin (40 IU) administration. Oxytocin increased neural responses during reward and loss anticipation in PTSD patients and controls in the striatum, dorsal anterior cingulate cortex and insula, key regions in the reward pathway. Although PTSD patients did not differ from controls in motivational processing under placebo, anhedonia severity in PTSD patients was negatively related to reward responsiveness in the ventral striatum. Furthermore, oxytocin effects on reward processing in the ventral striatum were positively associated with anhedonia. Oxytocin administration increased reward pathway sensitivity during reward and loss anticipation in PTSD patients and trauma-exposed controls. Thus, oxytocin administration may increase motivation for goal-directed approach behavior in PTSD patients and controls, providing evidence for a neurobiological pathway through which oxytocin could potentially increase motivation and reward sensitivity in PTSD patients. Copyright © 2016 Elsevier Ltd. All rights reserved.

Human ventromedial prefrontal lesions alter incentivisation by reward.

PubMed

Manohar, Sanjay G; Husain, Masud

2016-03-01

Although medial frontal brain regions are implicated in valuation of rewards, evidence from focal lesions to these areas is scant, with many conflicting results regarding motivation and affect, and no human studies specifically examining incentivisation by reward. Here, 19 patients with isolated, focal damage in ventral and medial prefrontal cortex were selected from a database of 453 individuals with subarachnoid haemorrhage. Using a speeded saccadic task based on the oculomotor capture paradigm, we manipulated the maximum reward available on each trial using an auditory incentive cue. Modulation of behaviour by motivation permitted quantification of reward sensitivity. At the group level, medial frontal damage was overall associated with significantly reduced effects of reward on invigorating saccadic velocity and autonomic (pupil) responses compared to age-matched, healthy controls. Crucially, however, some individuals instead showed abnormally strong incentivisation effects for vigour. Increased sensitivity to rewards within the lesion group correlated with damage in subgenual ventromedial prefrontal cortex (vmPFC) areas, which have recently become the target for deep brain stimulation (DBS) in depression. Lesion correlations with clinical apathy suggested that the apathy associated with prefrontal damage is in fact reduced by damage at those coordinates. Reduced reward sensitivity showed a trend to correlate with damage near nucleus accumbens. Lesions did not, on the other hand, influence reward sensitivity of cognitive control, as measured by distractibility. Thus, although medial frontal lesions may generally reduce reward sensitivity, damage to key subregions paradoxically protect from this effect. Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

Acute ethanol effects on neural encoding of reward size and delay in the nucleus accumbens

PubMed Central

Gutman, Andrea L.

2016-01-01

Acute ethanol administration can cause impulsivity, resulting in increased preference for immediately available rewards over delayed but more valuable alternatives. The manner in which reward size and delay are represented in neural firing is not fully understood, and very little is known about ethanol effects on this encoding. To address this issue, we used in vivo electrophysiology to characterize neural firing in the core of the nucleus accumbens (NAcc) in rats responding for rewards that varied in size or delay after vehicle or ethanol administration. The NAcc is a central element in the circuit that governs decision-making and importantly, promotes choice of delayed rewards. We found that NAcc firing in response to reward-predictive cues encoded anticipated reward value after vehicle administration, but ethanol administration disrupted this encoding, resulting in a loss of discrimination between immediate and delayed rewards in cue-evoked neural responses. In addition, NAcc firing occurring at the time of the operant response (lever pressing) was inversely correlated with behavioral response latency, such that increased firing rates were associated with decreased latencies to lever press. Ethanol administration selectively attenuated this lever press-evoked firing when delayed but not immediate rewards were expected. These effects on neural firing were accompanied by increased behavioral latencies to respond for delayed rewards. Our results suggest that ethanol effects on NAcc cue- and lever press-evoked encoding may contribute to ethanol-induced impulsivity. PMID:27169507

Human ventromedial prefrontal lesions alter incentivisation by reward

PubMed Central

Manohar, Sanjay G.; Husain, Masud

2016-01-01

Although medial frontal brain regions are implicated in valuation of rewards, evidence from focal lesions to these areas is scant, with many conflicting results regarding motivation and affect, and no human studies specifically examining incentivisation by reward. Here, 19 patients with isolated, focal damage in ventral and medial prefrontal cortex were selected from a database of 453 individuals with subarachnoid haemorrhage. Using a speeded saccadic task based on the oculomotor capture paradigm, we manipulated the maximum reward available on each trial using an auditory incentive cue. Modulation of behaviour by motivation permitted quantification of reward sensitivity. At the group level, medial frontal damage was overall associated with significantly reduced effects of reward on invigorating saccadic velocity and autonomic (pupil) responses compared to age-matched, healthy controls. Crucially, however, some individuals instead showed abnormally strong incentivisation effects for vigour. Increased sensitivity to rewards within the lesion group correlated with damage in subgenual ventromedial prefrontal cortex (vmPFC) areas, which have recently become the target for deep brain stimulation (DBS) in depression. Lesion correlations with clinical apathy suggested that the apathy associated with prefrontal damage is in fact reduced by damage at those coordinates. Reduced reward sensitivity showed a trend to correlate with damage near nucleus accumbens. Lesions did not, on the other hand, influence reward sensitivity of cognitive control, as measured by distractibility. Thus, although medial frontal lesions may generally reduce reward sensitivity, damage to key subregions paradoxically protect from this effect. PMID:26874940

Reward-Dependent Modulation of Movement Variability

PubMed Central

Izawa, Jun; Shadmehr, Reza

2015-01-01

Movement variability is often considered an unwanted byproduct of a noisy nervous system. However, variability can signal a form of implicit exploration, indicating that the nervous system is intentionally varying the motor commands in search of actions that yield the greatest success. Here, we investigated the role of the human basal ganglia in controlling reward-dependent motor variability as measured by trial-to-trial changes in performance during a reaching task. We designed an experiment in which the only performance feedback was success or failure and quantified how reach variability was modulated as a function of the probability of reward. In healthy controls, reach variability increased as the probability of reward decreased. Control of variability depended on the history of past rewards, with the largest trial-to-trial changes occurring immediately after an unrewarded trial. In contrast, in participants with Parkinson's disease, a known example of basal ganglia dysfunction, reward was a poor modulator of variability; that is, the patients showed an impaired ability to increase variability in response to decreases in the probability of reward. This was despite the fact that, after rewarded trials, reach variability in the patients was comparable to healthy controls. In summary, we found that movement variability is partially a form of exploration driven by the recent history of rewards. When the function of the human basal ganglia is compromised, the reward-dependent control of movement variability is impaired, particularly affecting the ability to increase variability after unsuccessful outcomes. PMID:25740529

A Leptin-Mediated Central Mechanism in Analgesia-Enhanced Opioid Reward in Rats

PubMed Central

Lim, Grewo; Kim, Hyangin; McCabe, Michael F.; Chou, Chiu-Wen; Wang, Shuxing; Chen, Lucy L.; Marota, John J.A.; Blood, Anne; Breiter, Hans C.

2014-01-01

Opioid analgesics are commonly used in chronic pain management despite a potential risk of rewarding. However, it remains unclear whether opioid analgesia would enhance the opioid rewarding effect thereby contributing to opioid rewarding. Utilizing a rat paradigm of conditioned place preference (CPP) combined with ankle monoarthritis as a condition of persistent nociception, we showed that analgesia induced by either morphine or the nonsteroid anti-inflammatory drug ibuprofen increased CPP scores in arthritic rats, suggesting that analgesia itself had a rewarding effect. However, arthritic rats exhibited a significantly higher CPP score in response to morphine than ibuprofen. Thus, the rewarding effect of morphine was enhanced in the presence of persistent nociception, producing a phenomenon of analgesia-enhanced opioid reward. At the cellular level, administration of morphine activated a cascade of leptin expression, glial activation, and dopamine receptor upregulation in the nucleus accumbens (NAc), while administration of ibuprofen decreased glial activation with no effect on leptin expression in the NAc. Furthermore, the morphine rewarding effect was blocked in leptin deficient ob/ob mice or by neutralizing leptin or interleukin-1β in the NAc without diminishing morphine analgesia. The data indicate that systemic opioid can activate a leptin-mediated central mechanism in the NAc that led to the enhanced opioid rewarding effect. These findings provide evidence for an interaction between opioid analgesia and opioid rewarding, which may have implications in clinical opioid dose escalation in chronic pain management. PMID:25031415

From prediction error to incentive salience: mesolimbic computation of reward motivation

PubMed Central

Berridge, Kent C.

2011-01-01

Reward contains separable psychological components of learning, incentive motivation and pleasure. Most computational models have focused only on the learning component of reward, but the motivational component is equally important in reward circuitry, and even more directly controls behavior. Modeling the motivational component requires recognition of additional control factors besides learning. Here I will discuss how mesocorticolimbic mechanisms generate the motivation component of incentive salience. Incentive salience takes Pavlovian learning and memory as one input and as an equally important input takes neurobiological state factors (e.g., drug states, appetite states, satiety states) that can vary independently of learning. Neurobiological state changes can produce unlearned fluctuations or even reversals in the ability of a previously-learned reward cue to trigger motivation. Such fluctuations in cue-triggered motivation can dramatically depart from all previously learned values about the associated reward outcome. Thus a consequence of the difference between incentive salience and learning can be to decouple cue-triggered motivation of the moment from previously learned values of how good the associated reward has been in the past. Another consequence can be to produce irrationally strong motivation urges that are not justified by any memories of previous reward values (and without distorting associative predictions of future reward value). Such irrationally strong motivation may be especially problematic in addiction. To comprehend these phenomena, future models of mesocorticolimbic reward function should address the neurobiological state factors that participate to control generation of incentive salience. PMID:22487042

Hyperresponsivity and impaired prefrontal control of the mesolimbic reward system in schizophrenia.

PubMed

Richter, Anja; Petrovic, Aleksandra; Diekhof, Esther K; Trost, Sarah; Wolter, Sarah; Gruber, Oliver

2015-12-01

Schizophrenia is characterized by substantial dysfunctions of reward processing, leading to detrimental consequences for decision-making. The neurotransmitter dopamine is responsible for the transmission of reward signals and also known to be involved in the mechanism of psychosis. Using functional magnetic resonance imaging (fMRI), sixteen medicated patients with schizophrenia and sixteen healthy controls performed the 'desire-reason dilemma' (DRD) paradigm. This paradigm allowed us to directly investigate reward-related brain activations depending on the interaction of bottom-up and top-down mechanisms, when a previously conditioned reward stimulus had to be rejected to achieve a superordinate long-term goal. Both patients and controls showed significant activations in the mesolimbic reward system. In patients with schizophrenia, however, we found a significant hyperactivation of the left ventral striatum (vStr) when they were allowed to accept the conditioned reward stimuli, and a reduced top-down regulation of activation in the ventral striatum (vStr) and ventral tegmental area (VTA) while having to reject the immediate reward to pursue the superordinate task-goal. Moreover, while healthy subjects exhibited a negative functional coupling of the vStr with both the anteroventral prefrontal cortex (avPFC) and the ventromedial prefrontal cortex (VMPFC) in the dilemma situation, this functional coupling was significantly impaired in the patient group. These findings provide evidence for an increased ventral striatal activation to reward stimuli and an impaired top-down control of reward signals by prefrontal brain regions in schizophrenia. Copyright © 2015 Elsevier Ltd. All rights reserved.

Distinct representations for shifts of spatial attention and changes of reward contingencies in the human brain.

PubMed

Tosoni, Annalisa; Shulman, Gordon L; Pope, Anna L W; McAvoy, Mark P; Corbetta, Maurizio

2013-06-01

Success in a dynamically changing world requires both rapid shifts of attention to the location of important objects and the detection of changes in motivational contingencies that may alter future behavior. Here we addressed the relationship between these two processes by measuring the blood-oxygenation-level-dependent (BOLD) signal during a visual search task in which the location and the color of a salient cue respectively indicated where a rewarded target would appear and the monetary gain (large or small) associated with its detection. While cues that either shifted or maintained attention were presented every 4 to 8 sec, the reward magnitude indicated by the cue changed roughly every 30 sec, allowing us to distinguish a change in expected reward magnitude from a maintained state of expected reward magnitude. Posterior cingulate cortex was modulated by cues signaling an increase in expected reward magnitude, but not by cues for shifting versus maintaining spatial attention. Dorsal fronto-parietal regions in precuneus and frontal eye field (FEF) also showed increased BOLD activity for changes in expected reward magnitude from low to high, but in addition showed large independent modulations for shifting versus maintaining attention. In particular, the differential activation for shifting versus maintaining attention was not affected by expected reward magnitude. These results indicate that BOLD activations for shifts of attention and increases in expected reward magnitude are largely separate. Finally, visual cortex showed sustained spatially selective signals that were significantly enhanced when greater reward magnitude was expected, but this reward-related modulation was not observed in spatially selective regions of dorsal fronto-parietal cortex. Copyright © 2012 Elsevier Ltd. All rights reserved.

Reward and relief dimensions of temptation to drink: construct validity and role in predicting differential benefit from acamprosate and naltrexone.

PubMed

Roos, Corey R; Mann, Karl; Witkiewitz, Katie

2017-11-01

Researchers have sought to distinguish between individuals whose alcohol use disorder (AUD) is maintained by drinking to relieve negative affect ('relief drinkers') and those whose AUD is maintained by the rewarding effects of alcohol ('reward drinkers'). As an opioid receptor antagonist, naltrexone may be particularly effective for reward drinkers. Acamprosate, which has been shown to down-regulate the glutamatergic system, may be particularly effective for relief drinkers. This study sought to replicate and extend prior work (PREDICT study; Glöckner-Rist et al. ) by examining dimensions of reward and relief temptation to drink and subtypes of individuals with distinct patterns of reward/relief temptation. We utilized data from two randomized clinical trials for AUD (Project MATCH, n = 1726 and COMBINE study, n = 1383). We also tested whether classes of reward/relief temptation would predict differential response to naltrexone and acamprosate in COMBINE. Results replicated prior work by identifying reward and relief temptation factors, which had excellent reliability and construct validity. Using factor mixture modeling, we identified five distinct classes of reward/relief temptation that replicated across studies. In COMBINE, we found a significant class-by-acamprosate interaction effect. Among those most likely classified in the high relief/moderate reward temptation class, individuals had better drinking outcomes if assigned to acamprosate versus placebo. We did not find a significant class-by-naltrexone interaction effect. Our study questions the orthogonal classification of drinkers into only two types (reward or relief drinkers) and adds to the body of research on moderators of acamprosate, which may inform clinical decision making in the treatment of AUD. © 2016 Society for the Study of Addiction.

Moderation of the Relationship Between Reward Expectancy and Prediction Error-Related Ventral Striatal Reactivity by Anhedonia in Unmedicated Major Depressive Disorder: Findings From the EMBARC Study

PubMed Central

Greenberg, Tsafrir; Chase, Henry W.; Almeida, Jorge R.; Stiffler, Richelle; Zevallos, Carlos R.; Aslam, Haris A.; Deckersbach, Thilo; Weyandt, Sarah; Cooper, Crystal; Toups, Marisa; Carmody, Thomas; Kurian, Benji; Peltier, Scott; Adams, Phillip; McInnis, Melvin G.; Oquendo, Maria A.; McGrath, Patrick J.; Fava, Maurizio; Weissman, Myrna; Parsey, Ramin; Trivedi, Madhukar H.; Phillips, Mary L.

2016-01-01

Objective Anhedonia, disrupted reward processing, is a core symptom of major depressive disorder. Recent findings demonstrate altered reward-related ventral striatal reactivity in depressed individuals, but the extent to which this is specific to anhedonia remains poorly understood. The authors examined the effect of anhedonia on reward expectancy (expected outcome value) and prediction error-(discrepancy between expected and actual outcome) related ventral striatal reactivity, as well as the relationship between these measures. Method A total of 148 unmedicated individuals with major depressive disorder and 31 healthy comparison individuals recruited for the multisite EMBARC (Establishing Moderators and Biosignatures of Antidepressant Response in Clinical Care) study underwent functional MRI during a well-validated reward task. Region of interest and whole-brain data were examined in the first- (N=78) and second- (N=70) recruited cohorts, as well as the total sample, of depressed individuals, and in healthy individuals. Results Healthy, but not depressed, individuals showed a significant inverse relationship between reward expectancy and prediction error-related right ventral striatal reactivity. Across all participants, and in depressed individuals only, greater anhedonia severity was associated with a reduced reward expectancy-prediction error inverse relationship, even after controlling for other symptoms. Conclusions The normal reward expectancy and prediction error-related ventral striatal reactivity inverse relationship concords with conditioning models, predicting a shift in ventral striatal responding from reward outcomes to reward cues. This study shows, for the first time, an absence of this relationship in two cohorts of unmedicated depressed individuals and a moderation of this relationship by anhedonia, suggesting reduced reward-contingency learning with greater anhedonia. These findings help elucidate neural mechanisms of anhedonia, as a step toward identifying potential biosignatures of treatment response. PMID:26183698

Moderation of the Relationship Between Reward Expectancy and Prediction Error-Related Ventral Striatal Reactivity by Anhedonia in Unmedicated Major Depressive Disorder: Findings From the EMBARC Study.

PubMed

Greenberg, Tsafrir; Chase, Henry W; Almeida, Jorge R; Stiffler, Richelle; Zevallos, Carlos R; Aslam, Haris A; Deckersbach, Thilo; Weyandt, Sarah; Cooper, Crystal; Toups, Marisa; Carmody, Thomas; Kurian, Benji; Peltier, Scott; Adams, Phillip; McInnis, Melvin G; Oquendo, Maria A; McGrath, Patrick J; Fava, Maurizio; Weissman, Myrna; Parsey, Ramin; Trivedi, Madhukar H; Phillips, Mary L

2015-09-01

Anhedonia, disrupted reward processing, is a core symptom of major depressive disorder. Recent findings demonstrate altered reward-related ventral striatal reactivity in depressed individuals, but the extent to which this is specific to anhedonia remains poorly understood. The authors examined the effect of anhedonia on reward expectancy (expected outcome value) and prediction error- (discrepancy between expected and actual outcome) related ventral striatal reactivity, as well as the relationship between these measures. A total of 148 unmedicated individuals with major depressive disorder and 31 healthy comparison individuals recruited for the multisite EMBARC (Establishing Moderators and Biosignatures of Antidepressant Response in Clinical Care) study underwent functional MRI during a well-validated reward task. Region of interest and whole-brain data were examined in the first- (N=78) and second- (N=70) recruited cohorts, as well as the total sample, of depressed individuals, and in healthy individuals. Healthy, but not depressed, individuals showed a significant inverse relationship between reward expectancy and prediction error-related right ventral striatal reactivity. Across all participants, and in depressed individuals only, greater anhedonia severity was associated with a reduced reward expectancy-prediction error inverse relationship, even after controlling for other symptoms. The normal reward expectancy and prediction error-related ventral striatal reactivity inverse relationship concords with conditioning models, predicting a shift in ventral striatal responding from reward outcomes to reward cues. This study shows, for the first time, an absence of this relationship in two cohorts of unmedicated depressed individuals and a moderation of this relationship by anhedonia, suggesting reduced reward-contingency learning with greater anhedonia. These findings help elucidate neural mechanisms of anhedonia, as a step toward identifying potential biosignatures of treatment response.