Discrete coding of stimulus value, reward expectation, and reward prediction error in the dorsal striatum.

PubMed

Oyama, Kei; Tateyama, Yukina; Hernádi, István; Tobler, Philippe N; Iijima, Toshio; Tsutsui, Ken-Ichiro

2015-11-01

To investigate how the striatum integrates sensory information with reward information for behavioral guidance, we recorded single-unit activity in the dorsal striatum of head-fixed rats participating in a probabilistic Pavlovian conditioning task with auditory conditioned stimuli (CSs) in which reward probability was fixed for each CS but parametrically varied across CSs. We found that the activity of many neurons was linearly correlated with the reward probability indicated by the CSs. The recorded neurons could be classified according to their firing patterns into functional subtypes coding reward probability in different forms such as stimulus value, reward expectation, and reward prediction error. These results suggest that several functional subgroups of dorsal striatal neurons represent different kinds of information formed through extensive prior exposure to CS-reward contingencies. Copyright © 2015 the American Physiological Society.

Discrete coding of stimulus value, reward expectation, and reward prediction error in the dorsal striatum

PubMed Central

Oyama, Kei; Tateyama, Yukina; Hernádi, István; Tobler, Philippe N.; Iijima, Toshio

2015-01-01

To investigate how the striatum integrates sensory information with reward information for behavioral guidance, we recorded single-unit activity in the dorsal striatum of head-fixed rats participating in a probabilistic Pavlovian conditioning task with auditory conditioned stimuli (CSs) in which reward probability was fixed for each CS but parametrically varied across CSs. We found that the activity of many neurons was linearly correlated with the reward probability indicated by the CSs. The recorded neurons could be classified according to their firing patterns into functional subtypes coding reward probability in different forms such as stimulus value, reward expectation, and reward prediction error. These results suggest that several functional subgroups of dorsal striatal neurons represent different kinds of information formed through extensive prior exposure to CS-reward contingencies. PMID:26378201

Trait Anticipatory Pleasure Predicts Effort Expenditure for Reward

PubMed Central

Geaney, Joachim T.; Treadway, Michael T.; Smillie, Luke D.

2015-01-01

Research in motivation and emotion has been increasingly influenced by the perspective that processes underpinning the motivated approach of rewarding goals are distinct from those underpinning enjoyment during reward consummation. This distinction recently inspired the construction of the Temporal Experience of Pleasure Scale (TEPS), a self-report measure that distinguishes trait anticipatory pleasure (pre-reward feelings of desire) from consummatory pleasure (feelings of enjoyment and gratification upon reward attainment). In a university community sample (N = 97), we examined the TEPS subscales as predictors of (1) the willingness to expend effort for monetary rewards, and (2) affective responses to a pleasant mood induction procedure. Results showed that both anticipatory pleasure and a well-known trait measure of reward motivation predicted effort-expenditure for rewards when the probability of being rewarded was relatively low. Against expectations, consummatory pleasure was unrelated to induced pleasant affect. Taken together, our findings provide support for the validity of the TEPS anticipatory pleasure scale, but not the consummatory pleasure scale. PMID:26115223

Music-related reward responses predict episodic memory performance.

PubMed

Ferreri, Laura; Rodriguez-Fornells, Antoni

2017-12-01

Music represents a special type of reward involving the recruitment of the mesolimbic dopaminergic system. According to recent theories on episodic memory formation, as dopamine strengthens the synaptic potentiation produced by learning, stimuli triggering dopamine release could result in long-term memory improvements. Here, we behaviourally test whether music-related reward responses could modulate episodic memory performance. Thirty participants rated (in terms of arousal, familiarity, emotional valence, and reward) and encoded unfamiliar classical music excerpts. Twenty-four hours later, their episodic memory was tested (old/new recognition and remember/know paradigm). Results revealed an influence of music-related reward responses on memory: excerpts rated as more rewarding were significantly better recognized and remembered. Furthermore, inter-individual differences in the ability to experience musical reward, measured through the Barcelona Music Reward Questionnaire, positively predicted memory performance. Taken together, these findings shed new light on the relationship between music, reward and memory, showing for the first time that music-driven reward responses are directly implicated in higher cognitive functions and can account for individual differences in memory performance.

Dopamine, reward learning, and active inference.

PubMed

FitzGerald, Thomas H B; Dolan, Raymond J; Friston, Karl

2015-01-01

Temporal difference learning models propose phasic dopamine signaling encodes reward prediction errors that drive learning. This is supported by studies where optogenetic stimulation of dopamine neurons can stand in lieu of actual reward. Nevertheless, a large body of data also shows that dopamine is not necessary for learning, and that dopamine depletion primarily affects task performance. We offer a resolution to this paradox based on an hypothesis that dopamine encodes the precision of beliefs about alternative actions, and thus controls the outcome-sensitivity of behavior. We extend an active inference scheme for solving Markov decision processes to include learning, and show that simulated dopamine dynamics strongly resemble those actually observed during instrumental conditioning. Furthermore, simulated dopamine depletion impairs performance but spares learning, while simulated excitation of dopamine neurons drives reward learning, through aberrant inference about outcome states. Our formal approach provides a novel and parsimonious reconciliation of apparently divergent experimental findings.

Anticipatory Pleasure Predicts Motivation for Reward in Major Depression

PubMed Central

Sherdell, Lindsey; Waugh, Christian E.; Gotlib, Ian H.

2012-01-01

Anhedonia, the lack of interest or pleasure in response to hedonic stimuli or experiences, is a cardinal symptom of depression. This deficit in hedonic processing has been posited to influence depressed individuals’ motivation to engage in potentially rewarding experiences. Accumulating evidence indicates that hedonic processing is not a unitary construct but rather consists of an anticipatory and a consummatory phase. We examined how these components of hedonic processing influence motivation to obtain reward in participants diagnosed with major depression and in never-disordered controls. Thirty-eight currently depressed and 30 never-disordered control participants rated their liking of humorous and nonhumorous cartoons and then made a series of choices between viewing a cartoon from either group. Each choice was associated with a specified amount of effort participants would have to exert before viewing the chosen cartoon. Although depressed and control participants did not differ in their consummatory liking of the rewards, levels of reward liking predicted motivation to expend effort for the rewards only in the control participants; in the depressed participants, liking and motivation were dissociated. In the depressed group, levels of anticipatory anhedonia predicted motivation to exert effort for the rewards. These findings support the formulation that anhedonia is not a unitary construct and suggest that, for depressed individuals, deficits in motivation for reward are driven primarily by low anticipatory pleasure and not by decreased consummatory liking. PMID:21842963

Differential encoding of factors influencing predicted reward value in monkey rostral anterior cingulate cortex.

PubMed

Toda, Koji; Sugase-Miyamoto, Yasuko; Mizuhiki, Takashi; Inaba, Kiyonori; Richmond, Barry J; Shidara, Munetaka

2012-01-01

The value of a predicted reward can be estimated based on the conjunction of both the intrinsic reward value and the length of time to obtain it. The question we addressed is how the two aspects, reward size and proximity to reward, influence the responses of neurons in rostral anterior cingulate cortex (rACC), a brain region thought to play an important role in reward processing. We recorded from single neurons while two monkeys performed a multi-trial reward schedule task. The monkeys performed 1-4 sequential color discrimination trials to obtain a reward of 1-3 liquid drops. There were two task conditions, a valid cue condition, where the number of trials and reward amount were associated with visual cues, and a random cue condition, where the cue was picked from the cue set at random. In the valid cue condition, the neuronal firing is strongly modulated by the predicted reward proximity during the trials. Information about the predicted reward amount is almost absent at those times. In substantial subpopulations, the neuronal responses decreased or increased gradually through schedule progress to the predicted outcome. These two gradually modulating signals could be used to calculate the effect of time on the perception of reward value. In the random cue condition, little information about the reward proximity or reward amount is encoded during the course of the trial before reward delivery, but when the reward is actually delivered the responses reflect both the reward proximity and reward amount. Our results suggest that the rACC neurons encode information about reward proximity and amount in a manner that is dependent on utility of reward information. The manner in which the information is represented could be used in the moment-to-moment calculation of the effect of time and amount on predicted outcome value.

Model-free and model-based reward prediction errors in EEG.

PubMed

Sambrook, Thomas D; Hardwick, Ben; Wills, Andy J; Goslin, Jeremy

2018-05-24

Learning theorists posit two reinforcement learning systems: model-free and model-based. Model-based learning incorporates knowledge about structure and contingencies in the world to assign candidate actions with an expected value. Model-free learning is ignorant of the world's structure; instead, actions hold a value based on prior reinforcement, with this value updated by expectancy violation in the form of a reward prediction error. Because they use such different learning mechanisms, it has been previously assumed that model-based and model-free learning are computationally dissociated in the brain. However, recent fMRI evidence suggests that the brain may compute reward prediction errors to both model-free and model-based estimates of value, signalling the possibility that these systems interact. Because of its poor temporal resolution, fMRI risks confounding reward prediction errors with other feedback-related neural activity. In the present study, EEG was used to show the presence of both model-based and model-free reward prediction errors and their place in a temporal sequence of events including state prediction errors and action value updates. This demonstration of model-based prediction errors questions a long-held assumption that model-free and model-based learning are dissociated in the brain. Copyright © 2018 Elsevier Inc. All rights reserved.

EEG to Primary Rewards: Predictive Utility and Malleability by Brain Stimulation.

PubMed

Prause, Nicole; Siegle, Greg J; Deblieck, Choi; Wu, Allan; Iacoboni, Marco

2016-01-01

Theta burst stimulation (TBS) is thought to affect reward processing mechanisms, which may increase and decrease reward sensitivity. To test the ability of TBS to modulate response to strong primary rewards, participants hypersensitive to primary rewards were recruited. Twenty men and women with at least two opposite-sex, sexual partners in the last year received two forms of TBS. Stimulations were randomized to avoid order effects and separated by 2 hours to reduce carryover. The two TBS forms have been demonstrated to inhibit (continuous) or excite (intermittent) the left dorsolateral prefrontal cortex using different pulse patterns, which links to brain areas associated with reward conditioning. After each TBS, participants completed tasks assessing their reward responsiveness to monetary and sexual rewards. Electroencephalography (EEG) was recorded. They also reported their number of orgasms in the weekend following stimulation. This signal was malleable by TBS, where excitatory TBS resulted in lower EEG alpha relative to inhibitory TBS to primary rewards. EEG responses to sexual rewards in the lab (following both forms of TBS) predicted the number of orgasms experienced over the forthcoming weekend. TBS may be useful in modifying hypersensitivity or hyposensitivity to primary rewards that predict sexual behaviors. Since TBS altered the anticipation of a sexual reward, TBS may offer a novel treatment for sexual desire problems.

Dopamine neurons share common response function for reward prediction error

PubMed Central

Eshel, Neir; Tian, Ju; Bukwich, Michael; Uchida, Naoshige

2016-01-01

Dopamine neurons are thought to signal reward prediction error, or the difference between actual and predicted reward. How dopamine neurons jointly encode this information, however, remains unclear. One possibility is that different neurons specialize in different aspects of prediction error; another is that each neuron calculates prediction error in the same way. We recorded from optogenetically-identified dopamine neurons in the lateral ventral tegmental area (VTA) while mice performed classical conditioning tasks. Our tasks allowed us to determine the full prediction error functions of dopamine neurons and compare them to each other. We found striking homogeneity among individual dopamine neurons: their responses to both unexpected and expected rewards followed the same function, just scaled up or down. As a result, we could describe both individual and population responses using just two parameters. Such uniformity ensures robust information coding, allowing each dopamine neuron to contribute fully to the prediction error signal. PMID:26854803

Trial-by-Trial Modulation of Associative Memory Formation by Reward Prediction Error and Reward Anticipation as Revealed by a Biologically Plausible Computational Model.

PubMed

Aberg, Kristoffer C; Müller, Julia; Schwartz, Sophie

2017-01-01

Anticipation and delivery of rewards improves memory formation, but little effort has been made to disentangle their respective contributions to memory enhancement. Moreover, it has been suggested that the effects of reward on memory are mediated by dopaminergic influences on hippocampal plasticity. Yet, evidence linking memory improvements to actual reward computations reflected in the activity of the dopaminergic system, i.e., prediction errors and expected values, is scarce and inconclusive. For example, different previous studies reported that the magnitude of prediction errors during a reinforcement learning task was a positive, negative, or non-significant predictor of successfully encoding simultaneously presented images. Individual sensitivities to reward and punishment have been found to influence the activation of the dopaminergic reward system and could therefore help explain these seemingly discrepant results. Here, we used a novel associative memory task combined with computational modeling and showed independent effects of reward-delivery and reward-anticipation on memory. Strikingly, the computational approach revealed positive influences from both reward delivery, as mediated by prediction error magnitude, and reward anticipation, as mediated by magnitude of expected value, even in the absence of behavioral effects when analyzed using standard methods, i.e., by collapsing memory performance across trials within conditions. We additionally measured trait estimates of reward and punishment sensitivity and found that individuals with increased reward (vs. punishment) sensitivity had better memory for associations encoded during positive (vs. negative) prediction errors when tested after 20 min, but a negative trend when tested after 24 h. In conclusion, modeling trial-by-trial fluctuations in the magnitude of reward, as we did here for prediction errors and expected value computations, provides a comprehensive and biologically plausible description of

Dopamine, reward learning, and active inference

PubMed Central

FitzGerald, Thomas H. B.; Dolan, Raymond J.; Friston, Karl

2015-01-01

Temporal difference learning models propose phasic dopamine signaling encodes reward prediction errors that drive learning. This is supported by studies where optogenetic stimulation of dopamine neurons can stand in lieu of actual reward. Nevertheless, a large body of data also shows that dopamine is not necessary for learning, and that dopamine depletion primarily affects task performance. We offer a resolution to this paradox based on an hypothesis that dopamine encodes the precision of beliefs about alternative actions, and thus controls the outcome-sensitivity of behavior. We extend an active inference scheme for solving Markov decision processes to include learning, and show that simulated dopamine dynamics strongly resemble those actually observed during instrumental conditioning. Furthermore, simulated dopamine depletion impairs performance but spares learning, while simulated excitation of dopamine neurons drives reward learning, through aberrant inference about outcome states. Our formal approach provides a novel and parsimonious reconciliation of apparently divergent experimental findings. PMID:26581305

Anticipatory pleasure predicts motivation for reward in major depression.

PubMed

Sherdell, Lindsey; Waugh, Christian E; Gotlib, Ian H

2012-02-01

Anhedonia, the lack of interest or pleasure in response to hedonic stimuli or experiences, is a cardinal symptom of depression. This deficit in hedonic processing has been posited to influence depressed individuals' motivation to engage in potentially rewarding experiences. Accumulating evidence indicates that hedonic processing is not a unitary construct but rather consists of an anticipatory and a consummatory phase. We examined how these components of hedonic processing influence motivation to obtain reward in participants diagnosed with major depression and in never-disordered controls. Thirty-eight currently depressed and 30 never-disordered control participants rated their liking of humorous and nonhumorous cartoons and then made a series of choices between viewing a cartoon from either group. Each choice was associated with a specified amount of effort participants would have to exert before viewing the chosen cartoon. Although depressed and control participants did not differ in their consummatory liking of the rewards, levels of reward liking predicted motivation to expend effort for the rewards only in the control participants; in the depressed participants, liking and motivation were dissociated. In the depressed group, levels of anticipatory anhedonia predicted motivation to exert effort for the rewards. These findings support the formulation that anhedonia is not a unitary construct and suggest that, for depressed individuals, deficits in motivation for reward are driven primarily by low anticipatory pleasure and not by decreased consummatory liking. PsycINFO Database Record (c) 2012 APA, all rights reserved.

Encoding of Vicarious Reward Prediction in Anterior Cingulate Cortex and Relationship with Trait Empathy

PubMed Central

Apps, Matthew A.J.; Roiser, Jonathan P.; Viding, Essi

2015-01-01

Empathy—the capacity to understand and resonate with the experiences of others—can depend on the ability to predict when others are likely to receive rewards. However, although a plethora of research has examined the neural basis of predictions about the likelihood of receiving rewards ourselves, very little is known about the mechanisms that underpin variability in vicarious reward prediction. Human neuroimaging and nonhuman primate studies suggest that a subregion of the anterior cingulate cortex in the gyrus (ACCg) is engaged when others receive rewards. Does the ACCg show specialization for processing predictions about others' rewards and not one's own and does this specialization vary with empathic abilities? We examined hemodynamic responses in the human brain time-locked to cues that were predictive of a high or low probability of a reward either for the subject themselves or another person. We found that the ACCg robustly signaled the likelihood of a reward being delivered to another. In addition, ACCg response significantly covaried with trait emotion contagion, a necessary foundation for empathizing with other individuals. In individuals high in emotion contagion, the ACCg was specialized for processing others' rewards exclusively, but for those low in emotion contagion, this region also responded to information about the subject's own rewards. Our results are the first to show that the ACCg signals probabilistic predictions about rewards for other people and that the substantial individual variability in the degree to which the ACCg is specialized for processing others' rewards is related to trait empathy. SIGNIFICANCE STATEMENT Successfully cooperating, competing, or empathizing with others can depend on our ability to predict when others are going to get something rewarding. Although many studies have examined how the brain processes rewards we will get ourselves, very little is known about vicarious reward processing. Here, we show that a

EEG to Primary Rewards: Predictive Utility and Malleability by Brain Stimulation

PubMed Central

Prause, Nicole; Siegle, Greg J.; Deblieck, Choi; Wu, Allan; Iacoboni, Marco

2016-01-01

Theta burst stimulation (TBS) is thought to affect reward processing mechanisms, which may increase and decrease reward sensitivity. To test the ability of TBS to modulate response to strong primary rewards, participants hypersensitive to primary rewards were recruited. Twenty men and women with at least two opposite-sex, sexual partners in the last year received two forms of TBS. Stimulations were randomized to avoid order effects and separated by 2 hours to reduce carryover. The two TBS forms have been demonstrated to inhibit (continuous) or excite (intermittent) the left dorsolateral prefrontal cortex using different pulse patterns, which links to brain areas associated with reward conditioning. After each TBS, participants completed tasks assessing their reward responsiveness to monetary and sexual rewards. Electroencephalography (EEG) was recorded. They also reported their number of orgasms in the weekend following stimulation. This signal was malleable by TBS, where excitatory TBS resulted in lower EEG alpha relative to inhibitory TBS to primary rewards. EEG responses to sexual rewards in the lab (following both forms of TBS) predicted the number of orgasms experienced over the forthcoming weekend. TBS may be useful in modifying hypersensitivity or hyposensitivity to primary rewards that predict sexual behaviors. Since TBS altered the anticipation of a sexual reward, TBS may offer a novel treatment for sexual desire problems. PMID:27902711

Association of Elevated Reward Prediction Error Response With Weight Gain in Adolescent Anorexia Nervosa.

PubMed

DeGuzman, Marisa; Shott, Megan E; Yang, Tony T; Riederer, Justin; Frank, Guido K W

2017-06-01

Anorexia nervosa is a psychiatric disorder of unknown etiology. Understanding associations between behavior and neurobiology is important in treatment development. Using a novel monetary reward task during functional magnetic resonance brain imaging, the authors tested how brain reward learning in adolescent anorexia nervosa changes with weight restoration. Female adolescents with anorexia nervosa (N=21; mean age, 16.4 years [SD=1.9]) underwent functional MRI (fMRI) before and after treatment; similarly, healthy female control adolescents (N=21; mean age, 15.2 years [SD=2.4]) underwent fMRI on two occasions. Brain function was tested using the reward prediction error construct, a computational model for reward receipt and omission related to motivation and neural dopamine responsiveness. Compared with the control group, the anorexia nervosa group exhibited greater brain response 1) for prediction error regression within the caudate, ventral caudate/nucleus accumbens, and anterior and posterior insula, 2) to unexpected reward receipt in the anterior and posterior insula, and 3) to unexpected reward omission in the caudate body. Prediction error and unexpected reward omission response tended to normalize with treatment, while unexpected reward receipt response remained significantly elevated. Greater caudate prediction error response when underweight was associated with lower weight gain during treatment. Punishment sensitivity correlated positively with ventral caudate prediction error response. Reward system responsiveness is elevated in adolescent anorexia nervosa when underweight and after weight restoration. Heightened prediction error activity in brain reward regions may represent a phenotype of adolescent anorexia nervosa that does not respond well to treatment. Prediction error response could be a neurobiological marker of illness severity that can indicate individual treatment needs.

Association of Elevated Reward Prediction Error Response With Weight Gain in Adolescent Anorexia Nervosa

PubMed Central

DeGuzman, Marisa; Shott, Megan E.; Yang, Tony T.; Riederer, Justin; Frank, Guido K.W.

2017-01-01

Objective Anorexia nervosa is a psychiatric disorder of unknown etiology. Understanding associations between behavior and neurobiology is important in treatment development. Using a novel monetary reward task during functional magnetic resonance brain imaging, the authors tested how brain reward learning in adolescent anorexia nervosa changes with weight restoration. Method Female adolescents with anorexia nervosa (N=21; mean age, 15.2 years [SD=2.4]) underwent functional MRI (fMRI) before and after treatment; similarly, healthy female control adolescents (N=21; mean age, 16.4 years [SD=1.9]) underwent fMRI on two occasions. Brain function was tested using the reward prediction error construct, a computational model for reward receipt and omission related to motivation and neural dopamine responsiveness. Results Compared with the control group, the anorexia nervosa group exhibited greater brain response 1) for prediction error regression within the caudate, ventral caudate/nucleus accumbens, and anterior and posterior insula, 2) to unexpected reward receipt in the anterior and posterior insula, and 3) to unexpected reward omission in the caudate body. Prediction error and unexpected reward omission response tended to normalize with treatment, while unexpected reward receipt response remained significantly elevated. Greater caudate prediction error response when underweight was associated with lower weight gain during treatment. Punishment sensitivity correlated positively with ventral caudate prediction error response. Conclusions Reward system responsiveness is elevated in adolescent anorexia nervosa when underweight and after weight restoration. Heightened prediction error activity in brain reward regions may represent a phenotype of adolescent anorexia nervosa that does not respond well to treatment. Prediction error response could be a neurobiological marker of illness severity that can indicate individual treatment needs. PMID:28231717

Interactions between the nucleus accumbens and auditory cortices predict music reward value.

PubMed

Salimpoor, Valorie N; van den Bosch, Iris; Kovacevic, Natasa; McIntosh, Anthony Randal; Dagher, Alain; Zatorre, Robert J

2013-04-12

We used functional magnetic resonance imaging to investigate neural processes when music gains reward value the first time it is heard. The degree of activity in the mesolimbic striatal regions, especially the nucleus accumbens, during music listening was the best predictor of the amount listeners were willing to spend on previously unheard music in an auction paradigm. Importantly, the auditory cortices, amygdala, and ventromedial prefrontal regions showed increased activity during listening conditions requiring valuation, but did not predict reward value, which was instead predicted by increasing functional connectivity of these regions with the nucleus accumbens as the reward value increased. Thus, aesthetic rewards arise from the interaction between mesolimbic reward circuitry and cortical networks involved in perceptual analysis and valuation.

Individualized relapse prediction: Personality measures and striatal and insular activity during reward-processing robustly predict relapse.

PubMed

Gowin, Joshua L; Ball, Tali M; Wittmann, Marc; Tapert, Susan F; Paulus, Martin P

2015-07-01

Nearly half of individuals with substance use disorders relapse in the year after treatment. A diagnostic tool to help clinicians make decisions regarding treatment does not exist for psychiatric conditions. Identifying individuals with high risk for relapse to substance use following abstinence has profound clinical consequences. This study aimed to develop neuroimaging as a robust tool to predict relapse. 68 methamphetamine-dependent adults (15 female) were recruited from 28-day inpatient treatment. During treatment, participants completed a functional MRI scan that examined brain activation during reward processing. Patients were followed 1 year later to assess abstinence. We examined brain activation during reward processing between relapsing and abstaining individuals and employed three random forest prediction models (clinical and personality measures, neuroimaging measures, a combined model) to generate predictions for each participant regarding their relapse likelihood. 18 individuals relapsed. There were significant group by reward-size interactions for neural activation in the left insula and right striatum for rewards. Abstaining individuals showed increased activation for large, risky relative to small, safe rewards, whereas relapsing individuals failed to show differential activation between reward types. All three random forest models yielded good test characteristics such that a positive test for relapse yielded a likelihood ratio 2.63, whereas a negative test had a likelihood ratio of 0.48. These findings suggest that neuroimaging can be developed in combination with other measures as an instrument to predict relapse, advancing tools providers can use to make decisions about individualized treatment of substance use disorders. Published by Elsevier Ireland Ltd.

A simple solution for model comparison in bold imaging: the special case of reward prediction error and reward outcomes.

PubMed

Erdeniz, Burak; Rohe, Tim; Done, John; Seidler, Rachael D

2013-01-01

Conventional neuroimaging techniques provide information about condition-related changes of the BOLD (blood-oxygen-level dependent) signal, indicating only where and when the underlying cognitive processes occur. Recently, with the help of a new approach called "model-based" functional neuroimaging (fMRI), researchers are able to visualize changes in the internal variables of a time varying learning process, such as the reward prediction error or the predicted reward value of a conditional stimulus. However, despite being extremely beneficial to the imaging community in understanding the neural correlates of decision variables, a model-based approach to brain imaging data is also methodologically challenging due to the multicollinearity problem in statistical analysis. There are multiple sources of multicollinearity in functional neuroimaging including investigations of closely related variables and/or experimental designs that do not account for this. The source of multicollinearity discussed in this paper occurs due to correlation between different subjective variables that are calculated very close in time. Here, we review methodological approaches to analyzing such data by discussing the special case of separating the reward prediction error signal from reward outcomes.

Enhanced Neural Responses to Imagined Primary Rewards Predict Reduced Monetary Temporal Discounting.

PubMed

Hakimi, Shabnam; Hare, Todd A

2015-09-23

The pervasive tendency to discount the value of future rewards varies considerably across individuals and has important implications for health and well-being. Here, we used fMRI with human participants to examine whether an individual's neural representation of an imagined primary reward predicts the degree to which the value of delayed monetary payments is discounted. Because future rewards can never be experienced at the time of choice, imagining or simulating the benefits of a future reward may play a critical role in decisions between alternatives with either immediate or delayed benefits. We found that enhanced ventromedial prefrontal cortex response during imagined primary reward receipt was correlated with reduced discounting in a separate monetary intertemporal choice task. Furthermore, activity in enhanced ventromedial prefrontal cortex during reward imagination predicted temporal discounting behavior both between- and within-individual decision makers with 62% and 73% mean balanced accuracy, respectively. These results suggest that the quality of reward imagination may impact the degree to which future outcomes are discounted. Significance statement: We report a novel test of the hypothesis that an important factor influencing the discount rate for future rewards is the quality with which they are imagined or estimated in the present. Previous work has shown that temporal discounting is linked to individual characteristics ranging from general intelligence to the propensity for addiction. We demonstrate that individual differences in a neurobiological measure of primary reward imagination are significantly correlated with discounting rates for future monetary payments. Moreover, our neurobiological measure of imagination can be used to accurately predict choice behavior both between and within individuals. These results suggest that improving reward imagination may be a useful therapeutic target for individuals whose high discount rates promote

Neurophysiology of Reward-Guided Behavior: Correlates Related to Predictions, Value, Motivation, Errors, Attention, and Action.

PubMed

Bissonette, Gregory B; Roesch, Matthew R

2016-01-01

Many brain areas are activated by the possibility and receipt of reward. Are all of these brain areas reporting the same information about reward? Or are these signals related to other functions that accompany reward-guided learning and decision-making? Through carefully controlled behavioral studies, it has been shown that reward-related activity can represent reward expectations related to future outcomes, errors in those expectations, motivation, and signals related to goal- and habit-driven behaviors. These dissociations have been accomplished by manipulating the predictability of positively and negatively valued events. Here, we review single neuron recordings in behaving animals that have addressed this issue. We describe data showing that several brain areas, including orbitofrontal cortex, anterior cingulate, and basolateral amygdala signal reward prediction. In addition, anterior cingulate, basolateral amygdala, and dopamine neurons also signal errors in reward prediction, but in different ways. For these areas, we will describe how unexpected manipulations of positive and negative value can dissociate signed from unsigned reward prediction errors. All of these signals feed into striatum to modify signals that motivate behavior in ventral striatum and guide responding via associative encoding in dorsolateral striatum.

Neurophysiology of Reward-Guided Behavior: Correlates Related to Predictions, Value, Motivation, Errors, Attention, and Action

PubMed Central

Roesch, Matthew R.

2017-01-01

Many brain areas are activated by the possibility and receipt of reward. Are all of these brain areas reporting the same information about reward? Or are these signals related to other functions that accompany reward-guided learning and decision-making? Through carefully controlled behavioral studies, it has been shown that reward-related activity can represent reward expectations related to future outcomes, errors in those expectations, motivation, and signals related to goal- and habit-driven behaviors. These dissociations have been accomplished by manipulating the predictability of positively and negatively valued events. Here, we review single neuron recordings in behaving animals that have addressed this issue. We describe data showing that several brain areas, including orbitofrontal cortex, anterior cingulate, and basolateral amygdala signal reward prediction. In addition, anterior cingulate, basolateral amygdala, and dopamine neurons also signal errors in reward prediction, but in different ways. For these areas, we will describe how unexpected manipulations of positive and negative value can dissociate signed from unsigned reward prediction errors. All of these signals feed into striatum to modify signals that motivate behavior in ventral striatum and guide responding via associative encoding in dorsolateral striatum. PMID:26276036

When theory and biology differ: The relationship between reward prediction errors and expectancy.

PubMed

Williams, Chad C; Hassall, Cameron D; Trska, Robert; Holroyd, Clay B; Krigolson, Olave E

2017-10-01

Comparisons between expectations and outcomes are critical for learning. Termed prediction errors, the violations of expectancy that occur when outcomes differ from expectations are used to modify value and shape behaviour. In the present study, we examined how a wide range of expectancy violations impacted neural signals associated with feedback processing. Participants performed a time estimation task in which they had to guess the duration of one second while their electroencephalogram was recorded. In a key manipulation, we varied task difficulty across the experiment to create a range of different feedback expectancies - reward feedback was either very expected, expected, 50/50, unexpected, or very unexpected. As predicted, the amplitude of the reward positivity, a component of the human event-related brain potential associated with feedback processing, scaled inversely with expectancy (e.g., unexpected feedback yielded a larger reward positivity than expected feedback). Interestingly, the scaling of the reward positivity to outcome expectancy was not linear as would be predicted by some theoretical models. Specifically, we found that the amplitude of the reward positivity was about equivalent for very expected and expected feedback, and for very unexpected and unexpected feedback. As such, our results demonstrate a sigmoidal relationship between reward expectancy and the amplitude of the reward positivity, with interesting implications for theories of reinforcement learning. Copyright © 2017 Elsevier B.V. All rights reserved.

Orbitofrontal Cortex Signals Expected Outcomes with Predictive Codes When Stable Contingencies Promote the Integration of Reward History

PubMed Central

Shapiro, Matthew L.

2017-01-01

Memory can inform goal-directed behavior by linking current opportunities to past outcomes. The orbitofrontal cortex (OFC) may guide value-based responses by integrating the history of stimulus–reward associations into expected outcomes, representations of predicted hedonic value and quality. Alternatively, the OFC may rapidly compute flexible “online” reward predictions by associating stimuli with the latest outcome. OFC neurons develop predictive codes when rats learn to associate arbitrary stimuli with outcomes, but the extent to which predictive coding depends on most recent events and the integrated history of rewards is unclear. To investigate how reward history modulates OFC activity, we recorded OFC ensembles as rats performed spatial discriminations that differed only in the number of rewarded trials between goal reversals. The firing rate of single OFC neurons distinguished identical behaviors guided by different goals. When >20 rewarded trials separated goal switches, OFC ensembles developed stable and anticorrelated population vectors that predicted overall choice accuracy and the goal selected in single trials. When <10 rewarded trials separated goal switches, OFC population vectors decorrelated rapidly after each switch, but did not develop anticorrelated firing patterns or predict choice accuracy. The results show that, whereas OFC signals respond rapidly to contingency changes, they predict choices only when reward history is relatively stable, suggesting that consecutive rewarded episodes are needed for OFC computations that integrate reward history into expected outcomes. SIGNIFICANCE STATEMENT Adapting to changing contingencies and making decisions engages the orbitofrontal cortex (OFC). Previous work shows that OFC function can either improve or impair learning depending on reward stability, suggesting that OFC guides behavior optimally when contingencies apply consistently. The mechanisms that link reward history to OFC computations

Competition between learned reward and error outcome predictions in anterior cingulate cortex.

PubMed

Alexander, William H; Brown, Joshua W

2010-02-15

The anterior cingulate cortex (ACC) is implicated in performance monitoring and cognitive control. Non-human primate studies of ACC show prominent reward signals, but these are elusive in human studies, which instead show mainly conflict and error effects. Here we demonstrate distinct appetitive and aversive activity in human ACC. The error likelihood hypothesis suggests that ACC activity increases in proportion to the likelihood of an error, and ACC is also sensitive to the consequence magnitude of the predicted error. Previous work further showed that error likelihood effects reach a ceiling as the potential consequences of an error increase, possibly due to reductions in the average reward. We explored this issue by independently manipulating reward magnitude of task responses and error likelihood while controlling for potential error consequences in an Incentive Change Signal Task. The fMRI results ruled out a modulatory effect of expected reward on error likelihood effects in favor of a competition effect between expected reward and error likelihood. Dynamic causal modeling showed that error likelihood and expected reward signals are intrinsic to the ACC rather than received from elsewhere. These findings agree with interpretations of ACC activity as signaling both perceptions of risk and predicted reward. Copyright 2009 Elsevier Inc. All rights reserved.

Association of Neural and Emotional Impacts of Reward Prediction Errors With Major Depression

PubMed Central

Moutoussis, Michael; Smittenaar, Peter; Zeidman, Peter; Taylor, Tanja; Hrynkiewicz, Louise; Lam, Jordan; Skandali, Nikolina; Siegel, Jenifer Z.; Ousdal, Olga T.; Prabhu, Gita; Dayan, Peter; Fonagy, Peter; Dolan, Raymond J.

2017-01-01

Importance Major depressive disorder (MDD) is associated with deficits in representing reward prediction errors (RPEs), which are the difference between experienced and predicted reward. Reward prediction errors underlie learning of values in reinforcement learning models, are represented by phasic dopamine release, and are known to affect momentary mood. Objective To combine functional neuroimaging, computational modeling, and smartphone-based large-scale data collection to test, in the absence of learning-related concerns, the hypothesis that depression attenuates the impact of RPEs. Design, Setting, and Participants Functional magnetic resonance imaging (fMRI) data were collected on 32 individuals with moderate MDD and 20 control participants who performed a probabilistic reward task. A risky decision task with repeated happiness ratings as a measure of momentary mood was also tested in the laboratory in 74 participants and with a smartphone-based platform in 1833 participants. The study was conducted from November 20, 2012, to February 17, 2015. Main Outcomes and Measures Blood oxygen level–dependent activity was measured in ventral striatum, a dopamine target area known to represent RPEs. Momentary mood was measured during risky decision making. Results Of the 52 fMRI participants (mean [SD] age, 34.0 [9.1] years), 30 (58%) were women and 32 had MDD. Of the 74 participants in the laboratory risky decision task (mean age, 34.2 [10.3] years), 44 (59%) were women and 54 had MDD. Of the smartphone group, 543 (30%) had a depression history and 1290 (70%) had no depression history; 918 (50%) were women, and 593 (32%) were younger than 30 years. Contrary to previous results in reinforcement learning tasks, individuals with moderate depression showed intact RPE signals in ventral striatum (z = 3.16; P = .002) that did not differ significantly from controls (z = 0.91; P = .36). Symptom severity correlated with baseline mood parameters in laboratory (�

Cognitive strategies regulate fictive, but not reward prediction error signals in a sequential investment task.

PubMed

Gu, Xiaosi; Kirk, Ulrich; Lohrenz, Terry M; Montague, P Read

2014-08-01

Computational models of reward processing suggest that foregone or fictive outcomes serve as important information sources for learning and augment those generated by experienced rewards (e.g. reward prediction errors). An outstanding question is how these learning signals interact with top-down cognitive influences, such as cognitive reappraisal strategies. Using a sequential investment task and functional magnetic resonance imaging, we show that the reappraisal strategy selectively attenuates the influence of fictive, but not reward prediction error signals on investment behavior; such behavioral effect is accompanied by changes in neural activity and connectivity in the anterior insular cortex, a brain region thought to integrate subjective feelings with high-order cognition. Furthermore, individuals differ in the extent to which their behaviors are driven by fictive errors versus reward prediction errors, and the reappraisal strategy interacts with such individual differences; a finding also accompanied by distinct underlying neural mechanisms. These findings suggest that the variable interaction of cognitive strategies with two important classes of computational learning signals (fictive, reward prediction error) represent one contributing substrate for the variable capacity of individuals to control their behavior based on foregone rewards. These findings also expose important possibilities for understanding the lack of control in addiction based on possibly foregone rewarding outcomes. Copyright © 2013 The Authors. Human Brain Mapping Published by Wiley Periodicals, Inc.

Prediction-error in the context of real social relationships modulates reward system activity.

PubMed

Poore, Joshua C; Pfeifer, Jennifer H; Berkman, Elliot T; Inagaki, Tristen K; Welborn, Benjamin L; Lieberman, Matthew D

2012-01-01

The human reward system is sensitive to both social (e.g., validation) and non-social rewards (e.g., money) and is likely integral for relationship development and reputation building. However, data is sparse on the question of whether implicit social reward processing meaningfully contributes to explicit social representations such as trust and attachment security in pre-existing relationships. This event-related fMRI experiment examined reward system prediction-error activity in response to a potent social reward-social validation-and this activity's relation to both attachment security and trust in the context of real romantic relationships. During the experiment, participants' expectations for their romantic partners' positive regard of them were confirmed (validated) or violated, in either positive or negative directions. Primary analyses were conducted using predefined regions of interest, the locations of which were taken from previously published research. Results indicate that activity for mid-brain and striatal reward system regions of interest was modulated by social reward expectation violation in ways consistent with prior research on reward prediction-error. Additionally, activity in the striatum during viewing of disconfirmatory information was associated with both increases in post-scan reports of attachment anxiety and decreases in post-scan trust, a finding that follows directly from representational models of attachment and trust.

Medial Orbitofrontal Neurons Preferentially Signal Cues Predicting Changes in Reward during Unblocking

PubMed Central

Lopatina, Nina; McDannald, Michael A.; Styer, Clay V.; Peterson, Jacob F.; Sadacca, Brian F.; Cheer, Joseph F.

2016-01-01

The orbitofrontal cortex (OFC) has been broadly implicated in the ability to use the current value of expected outcomes to guide behavior. Although value correlates have been prominently reported in lateral OFC, they are more often associated with more medial areas. Further, recent studies in primates have suggested a dissociation in which the lateral OFC is involved in credit assignment and representation of reward identity and more medial areas are critical to representing value. Previously, we used unblocking to test more specifically what information about outcomes is represented by OFC neurons in rats; consistent with the proposed dichotomy between the lateral and medial OFC, we found relatively little linear value coding in the lateral OFC (Lopatina et al., 2015). Here we have repeated this experiment, recording in the medial OFC, to test whether such value signals might be found there. Neurons were recorded in an unblocking task as rats learned about cues that signaled either more, less, or the same amount of reward. We found that medial OFC neurons acquired responses to these cues; however, these responses did not signal different reward values across cues. Surprisingly, we found that cells developed responses to cues predicting a change, particularly a decrease, in reward value. This is consistent with a special role for medial OFC in representing current value to support devaluation/revaluation sensitive changes in behavior. SIGNIFICANCE STATEMENT This study uniquely examines encoding in rodent mOFC at the single-unit level in response to cues that predict more, less, or no change in reward in rats during training in a Pavlovian unblocking task, finding more cells responding to change-predictive cues and stronger activity in response to cues predictive of less reward. PMID:27511013

Ethanol Exposure History and Alcoholic Reward Differentially Alter Dopamine Release in the Nucleus Accumbens to a Reward-Predictive Cue.

PubMed

Fiorenza, Amanda M; Shnitko, Tatiana A; Sullivan, Kaitlin M; Vemuru, Sudheer R; Gomez-A, Alexander; Esaki, Julie Y; Boettiger, Charlotte A; Da Cunha, Claudio; Robinson, Donita L

2018-06-01

Conditioned stimuli (CS) that predict reward delivery acquire the ability to induce phasic dopamine release in the nucleus accumbens (NAc). This dopamine release may facilitate conditioned approach behavior, which often manifests as approach to the site of reward delivery (called "goal-tracking") or to the CS itself (called "sign-tracking"). Previous research has linked sign-tracking in particular to impulsivity and drug self-administration, and addictive drugs may promote the expression of sign-tracking. Ethanol (EtOH) acutely promotes phasic release of dopamine in the accumbens, but it is unknown whether an alcoholic reward alters dopamine release to a CS. We hypothesized that Pavlovian conditioning with an alcoholic reward would increase dopamine release triggered by the CS and subsequent sign-tracking behavior. Moreover, we predicted that chronic intermittent EtOH (CIE) exposure would promote sign-tracking while acute administration of naltrexone (NTX) would reduce it. Rats received 14 doses of EtOH (3 to 5 g/kg, intragastric) or water followed by 6 days of Pavlovian conditioning training. Rewards were a chocolate solution with or without 10% (w/v) alcohol. We used fast-scan cyclic voltammetry to measure phasic dopamine release in the NAc core in response to the CS and the rewards. We also determined the effect of NTX (1 mg/kg, subcutaneous) on conditioned approach. Both CIE and alcoholic reward, individually but not together, associated with greater dopamine to the CS than control conditions. However, this increase in dopamine release was not linked to greater sign-tracking, as both CIE and alcoholic reward shifted conditioned approach from sign-tracking behavior to goal-tracking behavior. However, they both also increased sensitivity to NTX, which reduced goal-tracking behavior. While a history of EtOH exposure or alcoholic reward enhanced dopamine release to a CS, they did not promote sign-tracking under the current conditions. These findings are

Role of Reward Sensitivity and Processing in Major Depressive and Bipolar Spectrum Disorders

PubMed Central

Alloy, Lauren B.; Olino, Thomas; Freed, Rachel D.; Nusslock, Robin

2016-01-01

Since Costello’s (1972) seminal Behavior Therapy article on loss of reinforcers or reinforcer effectiveness in depression, the role of reward sensitivity and processing in both depression and bipolar disorder has become a central area of investigation. In this article, we review the evidence for a model of reward sensitivity in mood disorders, with unipolar depression characterized by reward hyposensitivity and bipolar disorders by reward hypersensitivity. We address whether aberrant reward sensitivity and processing are correlates of, mood-independent traits of, vulnerabilities for, and/or predictors of the course of depression and bipolar spectrum disorders, covering evidence from self-report, behavioral, neurophysiological, and neural levels of analysis. We conclude that substantial evidence documents that blunted reward sensitivity and processing are involved in unipolar depression and heightened reward sensitivity and processing are characteristic of hypomania/mania. We further conclude that aberrant reward sensitivity has a trait component, but more research is needed to clearly demonstrate that reward hyposensitivity and hypersensitivity are vulnerabilities for depression and bipolar disorder, respectively. Moreover, additional research is needed to determine whether bipolar depression is similar to unipolar depression and characterized by reward hyposensitivity, or whether like bipolar hypomania/mania, it involves reward hypersensitivity. PMID:27816074

Predicting through-focus visual acuity with the eye's natural aberrations.

PubMed

Kingston, Amanda C; Cox, Ian G

2013-10-01

To develop a predictive optical modeling process that utilizes individual computer eye models along with a novel through-focus image quality metric. Individual eye models were implemented in optical design software (Zemax, Bellevue, WA) based on evaluation of ocular aberrations, pupil diameter, visual acuity, and accommodative response of 90 subjects (180 eyes; 24-63 years of age). Monocular high-contrast minimum angle of resolution (logMAR) acuity was assessed at 6 m, 2 m, 1 m, 67 cm, 50 cm, 40 cm, 33 cm, 28 cm, and 25 cm. While the subject fixated on the lowest readable line of acuity, total ocular aberrations and pupil diameter were measured three times each using the Complete Ophthalmic Analysis System (COAS HD VR) at each distance. A subset of 64 mature presbyopic eyes was used to predict the clinical logMAR acuity performance of five novel multifocal contact lens designs. To validate predictability of the design process, designs were manufactured and tested clinically on a population of 24 mature presbyopes (having at least +1.50 D spectacle add at 40 cm). Seven object distances were used in the validation study (6 m, 2 m, 1 m, 67 cm, 50 cm, 40 cm, and 25 cm) to measure monocular high-contrast logMAR acuity. Baseline clinical through-focus logMAR was shown to correlate highly (R² = 0.85) with predicted logMAR from individual eye models. At all object distances, each of the five multifocal lenses showed less than one line difference, on average, between predicted and clinical normalized logMAR acuity. Correlation showed R² between 0.90 and 0.97 for all multifocal designs. Computer-based models that account for patient's aberrations, pupil diameter changes, and accommodative amplitude can be used to predict the performance of contact lens designs. With this high correlation (R² ≥ 0.90) and high level of predictability, more design options can be explored in the computer to optimize performance before a lens is manufactured and tested clinically.

Predicting aberrant CpG island methylation

PubMed Central

Feltus, F. A.; Lee, E. K.; Costello, J. F.; Plass, C.; Vertino, P. M.

2003-01-01

Epigenetic silencing associated with aberrant methylation of promoter region CpG islands is one mechanism leading to loss of tumor suppressor function in human cancer. Profiling of CpG island methylation indicates that some genes are more frequently methylated than others, and that each tumor type is associated with a unique set of methylated genes. However, little is known about why certain genes succumb to this aberrant event. To address this question, we used Restriction Landmark Genome Scanning to analyze the susceptibility of 1,749 unselected CpG islands to de novo methylation driven by overexpression of DNA cytosine-5-methyltransferase 1 (DNMT1). We found that although the overall incidence of CpG island methylation was increased in cells overexpressing DNMT1, not all loci were equally affected. The majority of CpG islands (69.9%) were resistant to de novo methylation, regardless of DNMT1 overexpression. In contrast, we identified a subset of methylation-prone CpG islands (3.8%) that were consistently hypermethylated in multiple DNMT1 overexpressing clones. Methylation-prone and methylation-resistant CpG islands were not significantly different with respect to size, C+G content, CpG frequency, chromosomal location, or promoter association. We used DNA pattern recognition and supervised learning techniques to derive a classification function based on the frequency of seven novel sequence patterns that was capable of discriminating methylation-prone from methylation-resistant CpG islands with 82% accuracy. The data indicate that CpG islands differ in their intrinsic susceptibility to de novo methylation, and suggest that the propensity for a CpG island to become aberrantly methylated can be predicted based on its sequence context. PMID:14519846

Predicting aberrant CpG island methylation.

PubMed

Feltus, F A; Lee, E K; Costello, J F; Plass, C; Vertino, P M

2003-10-14

Epigenetic silencing associated with aberrant methylation of promoter region CpG islands is one mechanism leading to loss of tumor suppressor function in human cancer. Profiling of CpG island methylation indicates that some genes are more frequently methylated than others, and that each tumor type is associated with a unique set of methylated genes. However, little is known about why certain genes succumb to this aberrant event. To address this question, we used Restriction Landmark Genome Scanning to analyze the susceptibility of 1,749 unselected CpG islands to de novo methylation driven by overexpression of DNA cytosine-5-methyltransferase 1 (DNMT1). We found that although the overall incidence of CpG island methylation was increased in cells overexpressing DNMT1, not all loci were equally affected. The majority of CpG islands (69.9%) were resistant to de novo methylation, regardless of DNMT1 overexpression. In contrast, we identified a subset of methylation-prone CpG islands (3.8%) that were consistently hypermethylated in multiple DNMT1 overexpressing clones. Methylation-prone and methylation-resistant CpG islands were not significantly different with respect to size, C+G content, CpG frequency, chromosomal location, or promoter association. We used DNA pattern recognition and supervised learning techniques to derive a classification function based on the frequency of seven novel sequence patterns that was capable of discriminating methylation-prone from methylation-resistant CpG islands with 82% accuracy. The data indicate that CpG islands differ in their intrinsic susceptibility to de novo methylation, and suggest that the propensity for a CpG island to become aberrantly methylated can be predicted based on its sequence context.

Task preparation processes related to reward prediction precede those related to task-difficulty expectation

PubMed Central

Schevernels, Hanne; Krebs, Ruth M.; Santens, Patrick; Woldorff, Marty G.; Boehler, C. Nico

2013-01-01

Recently, attempts have been made to disentangle the neural underpinnings of preparatory processes related to reward and attention. Functional magnetic resonance imaging (fMRI) research showed that neural activity related to the anticipation of reward and to attentional demands invokes neural activity patterns featuring large-scale overlap, along with some differences and interactions. Due to the limited temporal resolution of fMRI, however, the temporal dynamics of these processes remain unclear. Here, we report an event-related potentials (ERP) study in which cued attentional demands and reward prospect were combined in a factorial design. Results showed that reward prediction dominated early cue processing, as well as the early and later parts of the contingent negative variation (CNV) slow-wave ERP component that has been associated with task-preparation processes. Moreover these reward-related electrophysiological effects correlated across participants with response-time speeding on reward-prospect trials. In contrast, cued attentional demands affected only the later part of the CNV, with the highest amplitudes following cues predicting high-difficulty potential-reward targets, thus suggesting maximal task preparation when the task requires it and entails reward prospect. Consequently, we suggest that task-preparation processes triggered by reward can arise earlier, and potentially more directly, than strategic top-down aspects of preparation based on attentional demands. PMID:24064071

Episodic Memory Encoding Interferes with Reward Learning and Decreases Striatal Prediction Errors

PubMed Central

Braun, Erin Kendall; Daw, Nathaniel D.

2014-01-01

Learning is essential for adaptive decision making. The striatum and its dopaminergic inputs are known to support incremental reward-based learning, while the hippocampus is known to support encoding of single events (episodic memory). Although traditionally studied separately, in even simple experiences, these two types of learning are likely to co-occur and may interact. Here we sought to understand the nature of this interaction by examining how incremental reward learning is related to concurrent episodic memory encoding. During the experiment, human participants made choices between two options (colored squares), each associated with a drifting probability of reward, with the goal of earning as much money as possible. Incidental, trial-unique object pictures, unrelated to the choice, were overlaid on each option. The next day, participants were given a surprise memory test for these pictures. We found that better episodic memory was related to a decreased influence of recent reward experience on choice, both within and across participants. fMRI analyses further revealed that during learning the canonical striatal reward prediction error signal was significantly weaker when episodic memory was stronger. This decrease in reward prediction error signals in the striatum was associated with enhanced functional connectivity between the hippocampus and striatum at the time of choice. Our results suggest a mechanism by which memory encoding may compete for striatal processing and provide insight into how interactions between different forms of learning guide reward-based decision making. PMID:25378157

Temporal specificity of reward prediction errors signaled by putative dopamine neurons in rat VTA depends on ventral striatum

PubMed Central

Takahashi, Yuji K.; Langdon, Angela J.; Niv, Yael; Schoenbaum, Geoffrey

2016-01-01

Summary Dopamine neurons signal reward prediction errors. This requires accurate reward predictions. It has been suggested that the ventral striatum provides these predictions. Here we tested this hypothesis by recording from putative dopamine neurons in the VTA of rats performing a task in which prediction errors were induced by shifting reward timing or number. In controls, the neurons exhibited error signals in response to both manipulations. However, dopamine neurons in rats with ipsilateral ventral striatal lesions exhibited errors only to changes in number and failed to respond to changes in timing of reward. These results, supported by computational modeling, indicate that predictions about the temporal specificity and the number of expected rewards are dissociable, and that dopaminergic prediction-error signals rely on the ventral striatum for the former but not the latter. PMID:27292535

Reward Prediction Errors in Drug Addiction and Parkinson's Disease: from Neurophysiology to Neuroimaging.

PubMed

García-García, Isabel; Zeighami, Yashar; Dagher, Alain

2017-06-01

Surprises are important sources of learning. Cognitive scientists often refer to surprises as "reward prediction errors," a parameter that captures discrepancies between expectations and actual outcomes. Here, we integrate neurophysiological and functional magnetic resonance imaging (fMRI) results addressing the processing of reward prediction errors and how they might be altered in drug addiction and Parkinson's disease. By increasing phasic dopamine responses, drugs might accentuate prediction error signals, causing increases in fMRI activity in mesolimbic areas in response to drugs. Chronic substance dependence, by contrast, has been linked with compromised dopaminergic function, which might be associated with blunted fMRI responses to pleasant non-drug stimuli in mesocorticolimbic areas. In Parkinson's disease, dopamine replacement therapies seem to induce impairments in learning from negative outcomes. The present review provides a holistic overview of reward prediction errors across different pathologies and might inform future clinical strategies targeting impulsive/compulsive disorders.

BOLD responses in reward regions to hypothetical and imaginary monetary rewards

PubMed Central

Miyapuram, Krishna P.; Tobler, Philippe N.; Gregorios-Pippas, Lucy; Schultz, Wolfram

2015-01-01

Monetary rewards are uniquely human. Because money is easy to quantify and present visually, it is the reward of choice for most fMRI studies, even though it cannot be handed over to participants inside the scanner. A typical fMRI study requires hundreds of trials and thus small amounts of monetary rewards per trial (e.g. 5p) if all trials are to be treated equally. However, small payoffs can have detrimental effects on performance due to their limited buying power. Hypothetical monetary rewards can overcome the limitations of smaller monetary rewards but it is less well known whether predictors of hypothetical rewards activate reward regions. In two experiments, visual stimuli were associated with hypothetical monetary rewards. In Experiment 1, we used stimuli predicting either visually presented or imagined hypothetical monetary rewards, together with non-rewarding control pictures. Activations to reward predictive stimuli occurred in reward regions, namely the medial orbitofrontal cortex and midbrain. In Experiment 2, we parametrically varied the amount of visually presented hypothetical monetary reward keeping constant the amount of actually received reward. Graded activation in midbrain was observed to stimuli predicting increasing hypothetical rewards. The results demonstrate the efficacy of using hypothetical monetary rewards in fMRI studies. PMID:21985912

BOLD responses in reward regions to hypothetical and imaginary monetary rewards.

PubMed

Miyapuram, Krishna P; Tobler, Philippe N; Gregorios-Pippas, Lucy; Schultz, Wolfram

2012-01-16

Monetary rewards are uniquely human. Because money is easy to quantify and present visually, it is the reward of choice for most fMRI studies, even though it cannot be handed over to participants inside the scanner. A typical fMRI study requires hundreds of trials and thus small amounts of monetary rewards per trial (e.g. 5p) if all trials are to be treated equally. However, small payoffs can have detrimental effects on performance due to their limited buying power. Hypothetical monetary rewards can overcome the limitations of smaller monetary rewards but it is less well known whether predictors of hypothetical rewards activate reward regions. In two experiments, visual stimuli were associated with hypothetical monetary rewards. In Experiment 1, we used stimuli predicting either visually presented or imagined hypothetical monetary rewards, together with non-rewarding control pictures. Activations to reward predictive stimuli occurred in reward regions, namely the medial orbitofrontal cortex and midbrain. In Experiment 2, we parametrically varied the amount of visually presented hypothetical monetary reward keeping constant the amount of actually received reward. Graded activation in midbrain was observed to stimuli predicting increasing hypothetical rewards. The results demonstrate the efficacy of using hypothetical monetary rewards in fMRI studies. Copyright © 2011 Elsevier Inc. All rights reserved.

Ventromedial Frontal Cortex Is Critical for Guiding Attention to Reward-Predictive Visual Features in Humans.

PubMed

Vaidya, Avinash R; Fellows, Lesley K

2015-09-16

Adaptively interacting with our environment requires extracting information that will allow us to successfully predict reward. This can be a challenge, particularly when there are many candidate cues, and when rewards are probabilistic. Recent work has demonstrated that visual attention is allocated to stimulus features that have been associated with reward on previous trials. The ventromedial frontal lobe (VMF) has been implicated in learning in dynamic environments of this kind, but the mechanism by which this region influences this process is not clear. Here, we hypothesized that the VMF plays a critical role in guiding attention to reward-predictive stimulus features based on feedback. We tested the effects of VMF damage in human subjects on a visual search task in which subjects were primed to attend to task-irrelevant colors associated with different levels of reward, incidental to the search task. Consistent with previous work, we found that distractors had a greater influence on reaction time when they appeared in colors associated with high reward in the previous trial compared with colors associated with low reward in healthy control subjects and patients with prefrontal damage sparing the VMF. However, this reward modulation of attentional priming was absent in patients with VMF damage. Thus, an intact VMF is necessary for directing attention based on experience with cue-reward associations. We suggest that this region plays a role in selecting reward-predictive cues to facilitate future learning. There has been a swell of interest recently in the ventromedial frontal cortex (VMF), a brain region critical to associative learning. However, the underlying mechanism by which this region guides learning is not well understood. Here, we tested the effects of damage to this region in humans on a task in which rewards were linked incidentally to visual features, resulting in trial-by-trial attentional priming. Controls and subjects with prefrontal damage

The Distribution of Chromosomal Aberrations in Human Cells Predicted by a Generalized Time-Dependent Model of Radiation-Induced Formation of Aberrations

NASA Technical Reports Server (NTRS)

Ponomarev, Artem L.; George, K.; Cucinotta, F. A.

2011-01-01

New experimental data show how chromosomal aberrations for low- and high-LET radiation are dependent on DSB repair deficiencies in wild-type, AT and NBS cells. We simulated the development of chromosomal aberrations in these cells lines in a stochastic track-structure-dependent model, in which different cells have different kinetics of DSB repair. We updated a previously formulated model of chromosomal aberrations, which was based on a stochastic Monte Carlo approach, to consider the time-dependence of DSB rejoining. The previous version of the model had an assumption that all DSBs would rejoin, and therefore we called it a time-independent model. The chromosomal-aberrations model takes into account the DNA and track structure for low- and high-LET radiations, and provides an explanation and prediction of the statistics of rare and more complex aberrations. We compared the program-simulated kinetics of DSB rejoining to the experimentally-derived bimodal exponential curves of the DSB kinetics. We scored the formation of translocations, dicentrics, acentric and centric rings, deletions, and inversions. The fraction of DSBs participating in aberrations was studied in relation to the rejoining time. Comparisons of simulated dose dependence for simple aberrations to the experimental dose-dependence for HF19, AT and NBS cells will be made.

Dysfunctional insular connectivity during reward prediction in patients with first-episode psychosis

PubMed Central

Schmidt, André; Palaniyappan, Lena; Smieskova, Renata; Simon, Andor; Riecher-Rössler, Anita; Lang, Undine E.; Fusar-Poli, Paolo; McGuire, Philip; Borgwardt, Stefan J.

2016-01-01

Background Increasing evidence indicates that psychosis is associated with abnormal reward processing. Imaging studies in patients with first-episode psychosis (FEP) have revealed reduced activity in diverse brain regions, including the ventral striatum, insula and anterior cingulate cortex (ACC), during reward prediction. However, whether these reductions in local brain activity are due to altered connectivity has rarely been explored. Methods We applied dynamic causal modelling and Bayesian model selection to fMRI data during the Salience Attribution Task to investigate whether patients with FEP showed abnormal modulation of connectivity between the ventral striatum, insula and ACC induced by rewarding cues and whether these changes were related to positive psychotic symptoms and atypical antipsychotic medication. Results The model including reward-induced modulation of insula–ACC connectivity was the best fitting model in each group. Compared with healthy controls (n = 19), patients with FEP (n = 29) revealed reduced right insula–ACC connectivity. After subdividing patients according to current antipsychotic medication, we found that the reduced insula–ACC connectivity relative to healthy controls was observed only in untreated patients (n = 17), not in patients treated with antipsychotics (n = 12), and that it correlated negatively with unusual thought content in untreated patients with FEP. Limitations The modest sample size of untreated patients with FEP was a limitation of our study. Conclusion This study indicates that insula–ACC connectivity during reward prediction is reduced in untreated patients with FEP and related to the formation of positive psychotic symptoms. Our study further suggests that atypical antipsychotics may reverse connectivity between the insula and the ACC during reward prediction. PMID:26854756

Exploring food reward and calorie intake in self-perceived food addicts.

PubMed

Ruddock, Helen K; Field, Matt; Hardman, Charlotte A

2017-08-01

Previous research indicates that many people perceive themselves to be addicted to food. These 'self-perceived food addicts' may demonstrate aberrant eating patterns which put them at greater risk of overeating. However this is yet to be empirically investigated. The current study investigated whether self-perceived food addicts would exhibit higher food reward and calorie intake in a laboratory context relative to self-perceived non-addicts. A secondary aim was to investigate whether self-perceived food addicts would demonstrate increased food liking and/or increased hunger ratings. Finally, we explored whether self-perceived food addicts demonstrate patterns of aberrant eating, beyond that predicted by measures of trait dietary disinhibition and restraint. Female participants (self-perceived food addicts n = 31, non-addicts n = 29) completed measures of hunger, food reward (desire-to-eat, willingness-to-pay ratings, and an operant response task) and liking for high- and low-fat foods. Participants completed all measures when they were hungry, and again when they were satiated after consuming a fixed-lunch meal. Finally, participants were provided with ad-libitum access to high-and low-fat foods. Results indicated that self-perceived food addicts consumed more calories from high-fat food compared to non-addicts, despite the absence of any between-group differences in hunger or overall liking ratings. Self-perceived food addicts also displayed higher desire-to-eat ratings across foods compared to non-addicts, but groups did not differ on other measures of food reward. However, the differences in calorie intake and desire-to-eat between self-perceived food addicts and non-addicts were no longer significant after controlling for dietary disinhibition and restraint. These findings suggest that self-perceived food addicts experience food as more rewarding and have a tendency to overeat. However, this may be attributable to increased dietary disinhibition and

Aberrant membranous expression of β-catenin predicts poor prognosis in patients with craniopharyngioma.

PubMed

Li, Zongping; Xu, Jianguo; Huang, Siqing; You, Chao

2015-12-01

The objective of this study is to investigate β-catenin expression in craniopharyngioma patients and determine its significance in predicting the prognosis of this disease. Fifty craniopharyngioma patients were enrolled in this study. Expression of β-catenin in tumor specimens collected from these patients was examined through immunostaining. In addition, mutation of exon 3 in the β-catenin gene, CTNNB1, was analyzed using polymerase chain reaction, denaturing high-pressure liquid chromatography, and DNA sequencing. Based on these results, we explored the association between membranous β-catenin expression, clinical and pathologic characteristics, and prognoses in these patients. Of all craniopharyngioma specimens, 31 (62.0%) had preserved membranous β-catenin expression, whereas the remaining 19 specimens (38.0%) displayed aberrant expression. Statistical analysis showed a significant correlation between aberrant membranous β-catenin expression and CTNNB1 exon 3 mutation, as well as between aberrant membranous β-catenin expression and the histopathologic type of craniopharyngioma and type of resection in our patient population. Furthermore, aberrant membranous β-catenin expression was found to be associated with poor patient survival. Results of Kaplan-Meier survival analysis and Cox regression analysis further confirmed this finding. In conclusion, our study demonstrated that aberrant membranous β-catenin expression was significantly correlated with poor survival in patients with craniopharyngioma. This raises the possibility for use of aberrant membranous β-catenin expression as an independent risk factor in predicting the prognosis of this disease. Copyright © 2015 Elsevier Inc. All rights reserved.

Decision-making patterns and sensitivity to reward and punishment in children with attention-deficit hyperactivity disorder.

PubMed

Masunami, Taiji; Okazaki, Shinji; Maekawa, Hisao

2009-06-01

Earlier studies have demonstrated that attention-deficit hyperactivity disorder (ADHD) is associated with aberrant sensitivity to rewards and punishments. Although some studies have focused on real-life decision making in children with ADHD using the Iowa gambling task, the number of good deck choices, a frequently used index of decision-making ability in the gambling task, is insufficient for investigating the complex decision-making strategies in subjects. In the present study, we investigated decision-making strategies in ADHD children, analyzing T-patterns with rewards, with punishments, and without rewards and punishments during the gambling task, and examined the relationship between decision-making strategies and skin conductance responses (SCRs) to rewards and punishments. We hypothesized that ADHD children and normal children would employ different decision-making strategies depending on their sensitivity to rewards and punishments in the gambling task. Our results revealed that ADHD children had fewer T-patterns with punishments and exhibited a significant tendency to have many T-patterns with rewards, thus supporting our hypothesis. Moreover, in contrast to normal children, ADHD children failed to demonstrate differences between reward and punishment SCRs, supporting the idea that they had an aberrant sensitivity to rewards and punishments. Therefore, we concluded that ADHD children would be impaired in decision-making strategies depending on their aberrant sensitivity to rewards and punishments. However, we were unable to specify whether large reward SCRs or small punishment SCRs is generated in ADHD children.

From prediction error to incentive salience: mesolimbic computation of reward motivation

PubMed Central

Berridge, Kent C.

2011-01-01

Reward contains separable psychological components of learning, incentive motivation and pleasure. Most computational models have focused only on the learning component of reward, but the motivational component is equally important in reward circuitry, and even more directly controls behavior. Modeling the motivational component requires recognition of additional control factors besides learning. Here I will discuss how mesocorticolimbic mechanisms generate the motivation component of incentive salience. Incentive salience takes Pavlovian learning and memory as one input and as an equally important input takes neurobiological state factors (e.g., drug states, appetite states, satiety states) that can vary independently of learning. Neurobiological state changes can produce unlearned fluctuations or even reversals in the ability of a previously-learned reward cue to trigger motivation. Such fluctuations in cue-triggered motivation can dramatically depart from all previously learned values about the associated reward outcome. Thus a consequence of the difference between incentive salience and learning can be to decouple cue-triggered motivation of the moment from previously learned values of how good the associated reward has been in the past. Another consequence can be to produce irrationally strong motivation urges that are not justified by any memories of previous reward values (and without distorting associative predictions of future reward value). Such irrationally strong motivation may be especially problematic in addiction. To comprehend these phenomena, future models of mesocorticolimbic reward function should address the neurobiological state factors that participate to control generation of incentive salience. PMID:22487042

The Brain Reward Circuitry in Mood Disorders

PubMed Central

Russo, Scott J.; Nestler, Eric J.

2013-01-01

Mood disorders are common and debilitating conditions characterized in part by profound deficits in reward-related behavioral domains. A recent literature has identified important structural and functional alterations within the brain’s reward circuitry —particularly in the ventral tegmental area to nucleus accumbens pathway — that are associated with symptoms such as anhedonia and aberrant reward-associated perception and memory. This review synthesizes recent data from human and rodent studies from which emerges a circuit-level framework for understanding reward deficits in depression. We also discuss some of the molecular and cellular underpinnings of this framework, ranging from adaptations in glutamatergic synapses and neurotrophic factors to transcriptional and epigenetic mechanisms. PMID:23942470

From prediction error to incentive salience: mesolimbic computation of reward motivation.

PubMed

Berridge, Kent C

2012-04-01

Reward contains separable psychological components of learning, incentive motivation and pleasure. Most computational models have focused only on the learning component of reward, but the motivational component is equally important in reward circuitry, and even more directly controls behavior. Modeling the motivational component requires recognition of additional control factors besides learning. Here I discuss how mesocorticolimbic mechanisms generate the motivation component of incentive salience. Incentive salience takes Pavlovian learning and memory as one input and as an equally important input takes neurobiological state factors (e.g. drug states, appetite states, satiety states) that can vary independently of learning. Neurobiological state changes can produce unlearned fluctuations or even reversals in the ability of a previously learned reward cue to trigger motivation. Such fluctuations in cue-triggered motivation can dramatically depart from all previously learned values about the associated reward outcome. Thus, one consequence of the difference between incentive salience and learning can be to decouple cue-triggered motivation of the moment from previously learned values of how good the associated reward has been in the past. Another consequence can be to produce irrationally strong motivation urges that are not justified by any memories of previous reward values (and without distorting associative predictions of future reward value). Such irrationally strong motivation may be especially problematic in addiction. To understand these phenomena, future models of mesocorticolimbic reward function should address the neurobiological state factors that participate to control generation of incentive salience. © 2012 The Author. European Journal of Neuroscience © 2012 Federation of European Neuroscience Societies and Blackwell Publishing Ltd.

Morphological elucidation of basal ganglia circuits contributing reward prediction

PubMed Central

Fujiyama, Fumino; Takahashi, Susumu; Karube, Fuyuki

2015-01-01

Electrophysiological studies in monkeys have shown that dopaminergic neurons respond to the reward prediction error. In addition, striatal neurons alter their responsiveness to cortical or thalamic inputs in response to the dopamine signal, via the mechanism of dopamine-regulated synaptic plasticity. These findings have led to the hypothesis that the striatum exhibits synaptic plasticity under the influence of the reward prediction error and conduct reinforcement learning throughout the basal ganglia circuits. The reinforcement learning model is useful; however, the mechanism by which such a process emerges in the basal ganglia needs to be anatomically explained. The actor–critic model has been previously proposed and extended by the existence of role sharing within the striatum, focusing on the striosome/matrix compartments. However, this hypothesis has been difficult to confirm morphologically, partly because of the complex structure of the striosome/matrix compartments. Here, we review recent morphological studies that elucidate the input/output organization of the striatal compartments. PMID:25698913

Physiological Response to Reward and Extinction Predicts Alcohol, Marijuana, and Cigarette Use Two Years Later

PubMed Central

Derefinko, Karen J.; Eisenlohr-Moul, Tory A.; Peters, Jessica R.; Roberts, Walter; Walsh, Erin C.; Milich, Richard; Lynam, Donald R.

2017-01-01

Background Physiological responses to reward and extinction are believed to represent the Behavioral Activation System (BAS) and Behavioral Inhibition System (BIS) constructs of Reinforcement Sensitivity Theory and underlie externalizing behaviors, including substance use. However, little research has examined these relations directly. Methods We assessed individuals’ cardiac pre-ejection periods (PEP) and electrodermal responses (EDR) during reward and extinction trials through the “Number Elimination Game” paradigm. Responses represented BAS and BIS, respectively. We then examined whether these responses provided incremental utility in the prediction of future alcohol, marijuana, and cigarette use. Results Zero-inflated Poisson (ZIP) regression models were used to examine the predictive utility of physiological BAS and BIS responses above and beyond previous substance use. Physiological responses accounted for incremental variance over previous use. Low BAS responses during reward predicted frequency of alcohol use at year 3. Low BAS responses during reward and extinction and high BIS responses during extinction predicted frequency of marijuana use at year 3. For cigarette use, low BAS response during extinction predicted use at year 3. Conclusions These findings suggest that the constructs of Reinforcement Sensitivity Theory, as assessed through physiology, contribute to the longitudinal maintenance of substance use. PMID:27306728

Altered neural reward and loss processing and prediction error signalling in depression

PubMed Central

Ubl, Bettina; Kuehner, Christine; Kirsch, Peter; Ruttorf, Michaela

2015-01-01

Dysfunctional processing of reward and punishment may play an important role in depression. However, functional magnetic resonance imaging (fMRI) studies have shown heterogeneous results for reward processing in fronto-striatal regions. We examined neural responsivity associated with the processing of reward and loss during anticipation and receipt of incentives and related prediction error (PE) signalling in depressed individuals. Thirty medication-free depressed persons and 28 healthy controls performed an fMRI reward paradigm. Regions of interest analyses focused on neural responses during anticipation and receipt of gains and losses and related PE-signals. Additionally, we assessed the relationship between neural responsivity during gain/loss processing and hedonic capacity. When compared with healthy controls, depressed individuals showed reduced fronto-striatal activity during anticipation of gains and losses. The groups did not significantly differ in response to reward and loss outcomes. In depressed individuals, activity increases in the orbitofrontal cortex and nucleus accumbens during reward anticipation were associated with hedonic capacity. Depressed individuals showed an absence of reward-related PEs but encoded loss-related PEs in the ventral striatum. Depression seems to be linked to blunted responsivity in fronto-striatal regions associated with limited motivational responses for rewards and losses. Alterations in PE encoding might mirror blunted reward- and enhanced loss-related associative learning in depression. PMID:25567763

Reward Dependent Invigoration Relates to Theta Oscillations and Is Predicted by Dopaminergic Midbrain Integrity in Healthy Elderly.

PubMed

Steiger, Tineke K; Bunzeck, Nico

2017-01-01

Motivation can have invigorating effects on behavior via dopaminergic neuromodulation. While this relationship has mainly been established in theoretical models and studies in younger subjects, the impact of structural declines of the dopaminergic system during healthy aging remains unclear. To investigate this issue, we used electroencephalography (EEG) in healthy young and elderly humans in a reward-learning paradigm. Specifically, scene images were initially encoded by combining them with cues predicting monetary reward (high vs. low reward). Subsequently, recognition memory for the scenes was tested. As a main finding, we can show that response times (RTs) during encoding were faster for high reward predicting images in the young but not elderly participants. This pattern was resembled in power changes in the theta-band (4-7 Hz). Importantly, analyses of structural MRI data revealed that individual reward-related differences in the elderlies' response time could be predicted by the structural integrity of the dopaminergic substantia nigra (SN; as measured by magnetization transfer (MT)). These findings suggest a close relationship between reward-based invigoration, theta oscillations and age-dependent changes of the dopaminergic system.

Reward rate optimization in two-alternative decision making: empirical tests of theoretical predictions.

PubMed

Simen, Patrick; Contreras, David; Buck, Cara; Hu, Peter; Holmes, Philip; Cohen, Jonathan D

2009-12-01

The drift-diffusion model (DDM) implements an optimal decision procedure for stationary, 2-alternative forced-choice tasks. The height of a decision threshold applied to accumulating information on each trial determines a speed-accuracy tradeoff (SAT) for the DDM, thereby accounting for a ubiquitous feature of human performance in speeded response tasks. However, little is known about how participants settle on particular tradeoffs. One possibility is that they select SATs that maximize a subjective rate of reward earned for performance. For the DDM, there exist unique, reward-rate-maximizing values for its threshold and starting point parameters in free-response tasks that reward correct responses (R. Bogacz, E. Brown, J. Moehlis, P. Holmes, & J. D. Cohen, 2006). These optimal values vary as a function of response-stimulus interval, prior stimulus probability, and relative reward magnitude for correct responses. We tested the resulting quantitative predictions regarding response time, accuracy, and response bias under these task manipulations and found that grouped data conformed well to the predictions of an optimally parameterized DDM.

Pain in context: Cues predicting a reward decrease fear of movement related pain and avoidance behavior.

PubMed

Claes, Nathalie; Vlaeyen, Johan W S; Crombez, Geert

2016-09-01

Previous research shows that goal-directed behavior might be modulated by cues that predict (dis)similar outcomes. However, the literature investigating this modulation with pain outcomes is scarce. Therefore, this experiment investigated whether environmental cues predicting pain or reward modulate defensive pain responding. Forty-eight healthy participants completed a joystick movement task with two different movement orientations. Performing one movement was associated with a painful stimulus, whereas performance of another movement was associated with reward, i.e. lottery tickets. In a subsequent task, participants learned to associate three different cues withpain, reward, or neither of the two. Next, these cues were integrated in the movement task. This study demonstrates that in general, aversive cues enhance and appetitive cues reduce pain-related fear. Furthermore, we found that incongruence between the outcomes predicted by the movement and the cue results in more oscillatory behavior, i.e., participants were more willing to perform a painful movement when a cue predicting reward was simultaneously presented, and vice versa. Similarly, when given a choice, participants preferred to perform the reward movement, unless there was an incongruence between the outcomes predicted by the movements and cues. Taken together, these results provide experimental evidence that environmental cues are capable of modulating pain-related fear and avoidance behavior. Copyright © 2016 Elsevier Ltd. All rights reserved.

Cognitive capacity limitations and Need for Cognition differentially predict reward-induced cognitive effort expenditure.

PubMed

Sandra, Dasha A; Otto, A Ross

2018-03-01

While psychological, economic, and neuroscientific accounts of behavior broadly maintain that people minimize expenditure of cognitive effort, empirical work reveals how reward incentives can mobilize increased cognitive effort expenditure. Recent theories posit that the decision to expend effort is governed, in part, by a cost-benefit tradeoff whereby the potential benefits of mental effort can offset the perceived costs of effort exertion. Taking an individual differences approach, the present study examined whether one's executive function capacity, as measured by Stroop interference, predicts the extent to which reward incentives reduce switch costs in a task-switching paradigm, which indexes additional expenditure of cognitive effort. In accordance with the predictions of a cost-benefit account of effort, we found that a low executive function capacity-and, relatedly, a low intrinsic motivation to expend effort (measured by Need for Cognition)-predicted larger increase in cognitive effort expenditure in response to monetary reward incentives, while individuals with greater executive function capacity-and greater intrinsic motivation to expend effort-were less responsive to reward incentives. These findings suggest that an individual's cost-benefit tradeoff is constrained by the perceived costs of exerting cognitive effort. Copyright © 2017 Elsevier B.V. All rights reserved.

Reward sensitivity predicts ice cream-related attentional bias assessed by inattentional blindness.

PubMed

Li, Xiaoming; Tao, Qian; Fang, Ya; Cheng, Chen; Hao, Yangyang; Qi, Jianjun; Li, Yu; Zhang, Wei; Wang, Ying; Zhang, Xiaochu

2015-06-01

The cognitive mechanism underlying the association between individual differences in reward sensitivity and food craving is unknown. The present study explored the mechanism by examining the role of reward sensitivity in attentional bias toward ice cream cues. Forty-nine college students who displayed high level of ice cream craving (HICs) and 46 who displayed low level of ice cream craving (LICs) performed an inattentional blindness (IB) task which was used to assess attentional bias for ice cream. In addition, reward sensitivity and coping style were assessed by the Behavior Inhibition System/Behavior Activation System Scales and Simplified Coping Style Questionnaire. Results showed significant higher identification rate of the critical stimulus in the HICs than LICs, suggesting greater attentional bias for ice cream in the HICs. It was indicated that attentional bias for food cues persisted even under inattentional condition. Furthermore, a significant correlation was found between the attentional bias and reward sensitivity after controlling for coping style, and reward sensitivity predicted attentional bias for food cues. The mediation analyses showed that attentional bias mediated the relationship between reward sensitivity and food craving. Those findings suggest that the association between individual differences in reward sensitivity and food craving may be attributed to attentional bias for food-related cues. Copyright © 2015 Elsevier Ltd. All rights reserved.

Dopamine reward prediction errors reflect hidden state inference across time

PubMed Central

Starkweather, Clara Kwon; Babayan, Benedicte M.; Uchida, Naoshige; Gershman, Samuel J.

2017-01-01

Midbrain dopamine neurons signal reward prediction error (RPE), or actual minus expected reward. The temporal difference (TD) learning model has been a cornerstone in understanding how dopamine RPEs could drive associative learning. Classically, TD learning imparts value to features that serially track elapsed time relative to observable stimuli. In the real world, however, sensory stimuli provide ambiguous information about the hidden state of the environment, leading to the proposal that TD learning might instead compute a value signal based on an inferred distribution of hidden states (a ‘belief state’). In this work, we asked whether dopaminergic signaling supports a TD learning framework that operates over hidden states. We found that dopamine signaling exhibited a striking difference between two tasks that differed only with respect to whether reward was delivered deterministically. Our results favor an associative learning rule that combines cached values with hidden state inference. PMID:28263301

Dopamine reward prediction errors reflect hidden-state inference across time.

PubMed

Starkweather, Clara Kwon; Babayan, Benedicte M; Uchida, Naoshige; Gershman, Samuel J

2017-04-01

Midbrain dopamine neurons signal reward prediction error (RPE), or actual minus expected reward. The temporal difference (TD) learning model has been a cornerstone in understanding how dopamine RPEs could drive associative learning. Classically, TD learning imparts value to features that serially track elapsed time relative to observable stimuli. In the real world, however, sensory stimuli provide ambiguous information about the hidden state of the environment, leading to the proposal that TD learning might instead compute a value signal based on an inferred distribution of hidden states (a 'belief state'). Here we asked whether dopaminergic signaling supports a TD learning framework that operates over hidden states. We found that dopamine signaling showed a notable difference between two tasks that differed only with respect to whether reward was delivered in a deterministic manner. Our results favor an associative learning rule that combines cached values with hidden-state inference.

Significance of a Behavioral Economic Index of Reward Value in Predicting Drinking Problem Resolution

ERIC Educational Resources Information Center

Tucker, Jalie A.; Vuchinich, Rudy E.; Black, Bethany C.; Rippens, Paula D.

2006-01-01

This study investigated whether a behavioral economic index of the value of rewards available over different time horizons improved prediction of drinking outcomes beyond established biopsychosocial predictors. Preferences for immediate drinking versus more delayed rewards made possible by saving money were determined from expenditures prior to…

A balance of activity in brain control and reward systems predicts self-regulatory outcomes

PubMed Central

Chen, Pin-Hao A.; Huckins, Jeremy F.; Hofmann, Wilhelm; Kelley, William M.; Heatherton, Todd F.

2017-01-01

Abstract Previous neuroimaging work has shown that increased reward-related activity following exposure to food cues is predictive of self-control failure. The balance model suggests that self-regulation failures result from an imbalance in reward and executive control mechanisms. However, an open question is whether the relative balance of activity in brain systems associated with executive control (vs reward) supports self-regulatory outcomes when people encounter tempting cues in daily life. Sixty-nine chronic dieters, a population known for frequent lapses in self-control, completed a food cue-reactivity task during an fMRI scanning session, followed by a weeklong sampling of daily eating behaviors via ecological momentary assessment. We related participants’ food cue activity in brain systems associated with executive control and reward to real-world eating patterns. Specifically, a balance score representing the amount of activity in brain regions associated with self-regulatory control, relative to automatic reward-related activity, predicted dieters’ control over their eating behavior during the following week. This balance measure may reflect individual self-control capacity and be useful for examining self-regulation success in other domains and populations. PMID:28158874

A balance of activity in brain control and reward systems predicts self-regulatory outcomes.

PubMed

Lopez, Richard B; Chen, Pin-Hao A; Huckins, Jeremy F; Hofmann, Wilhelm; Kelley, William M; Heatherton, Todd F

2017-05-01

Previous neuroimaging work has shown that increased reward-related activity following exposure to food cues is predictive of self-control failure. The balance model suggests that self-regulation failures result from an imbalance in reward and executive control mechanisms. However, an open question is whether the relative balance of activity in brain systems associated with executive control (vs reward) supports self-regulatory outcomes when people encounter tempting cues in daily life. Sixty-nine chronic dieters, a population known for frequent lapses in self-control, completed a food cue-reactivity task during an fMRI scanning session, followed by a weeklong sampling of daily eating behaviors via ecological momentary assessment. We related participants' food cue activity in brain systems associated with executive control and reward to real-world eating patterns. Specifically, a balance score representing the amount of activity in brain regions associated with self-regulatory control, relative to automatic reward-related activity, predicted dieters' control over their eating behavior during the following week. This balance measure may reflect individual self-control capacity and be useful for examining self-regulation success in other domains and populations. © The Author (2017). Published by Oxford University Press.

Abnormal Striatal BOLD Responses to Reward Anticipation and Reward Delivery in ADHD

PubMed Central

Furukawa, Emi; Bado, Patricia; Tripp, Gail; Mattos, Paulo; Wickens, Jeff R.; Bramati, Ivanei E.; Alsop, Brent; Ferreira, Fernanda Meireles; Lima, Debora; Tovar-Moll, Fernanda; Sergeant, Joseph A.; Moll, Jorge

2014-01-01

Altered reward processing has been proposed to contribute to the symptoms of attention deficit hyperactivity disorder (ADHD). The neurobiological mechanism underlying this alteration remains unclear. We hypothesize that the transfer of dopamine release from reward to reward-predicting cues, as normally observed in animal studies, may be deficient in ADHD. Functional magnetic resonance imaging (fMRI) was used to investigate striatal responses to reward-predicting cues and reward delivery in a classical conditioning paradigm. Data from 14 high-functioning and stimulant-naïve young adults with elevated lifetime symptoms of ADHD (8 males, 6 females) and 15 well-matched controls (8 males, 7 females) were included in the analyses. During reward anticipation, increased blood-oxygen-level-dependent (BOLD) responses in the right ventral and left dorsal striatum were observed in controls, but not in the ADHD group. The opposite pattern was observed in response to reward delivery; the ADHD group demonstrated significantly greater BOLD responses in the ventral striatum bilaterally and the left dorsal striatum relative to controls. In the ADHD group, the number of current hyperactivity/impulsivity symptoms was inversely related to ventral striatal responses during reward anticipation and positively associated with responses to reward. The BOLD response patterns observed in the striatum are consistent with impaired predictive dopamine signaling in ADHD, which may explain altered reward-contingent behaviors and symptoms of ADHD. PMID:24586543

Cocaine cues drive opposing context-dependent shifts in reward processing and emotional state.

PubMed

Wheeler, Robert A; Aragona, Brandon J; Fuhrmann, Katherine A; Jones, Joshua L; Day, Jeremy J; Cacciapaglia, Fabio; Wightman, R Mark; Carelli, Regina M

2011-06-01

Prominent neurobiological theories of addiction posit a central role for aberrant mesolimbic dopamine release but disagree as to whether repeated drug experience blunts or enhances this system. Although drug withdrawal diminishes dopamine release, drug sensitization augments mesolimbic function, and both processes have been linked to drug seeking. One possibility is that the dopamine system can rapidly switch from dampened to enhanced release depending on the specific drug-predictive environment. To test this, we examined dopamine release when cues signaled delayed cocaine delivery versus imminent cocaine self-administration. Fast-scan cyclic voltammetry was used to examine real-time dopamine release while simultaneously monitoring behavioral indexes of aversion as rats experienced a sweet taste cue that predicted delayed cocaine availability and during self-administration. Furthermore, the impact of cues signaling delayed drug availability on intracranial self-stimulation, a broad measure of reward function, was assessed. We observed decreased mesolimbic dopamine concentrations, decreased reward sensitivity, and negative affect in response to the cocaine-predictive taste cue that signaled delayed cocaine availability. Importantly, dopamine concentration rapidly switched to elevated levels to cues signaling imminent cocaine delivery in the subsequent self-administration session. These findings show rapid, bivalent contextual control over brain reward processing, affect, and motivated behavior and have implications for mechanisms mediating substance abuse. Copyright © 2011 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

Ventral striatum activation to prosocial rewards predicts longitudinal declines in adolescent risk taking.

PubMed

Telzer, Eva H; Fuligni, Andrew J; Lieberman, Matthew D; Galván, Adriana

2013-01-01

Adolescence is a period of intensified emotions and an increase in motivated behaviors and passions. Evidence from developmental neuroscience suggests that this heightened emotionality occurs, in part, due to a peak in functional reactivity to rewarding stimuli, which renders adolescents more oriented toward reward-seeking behaviors. Most prior work has focused on how reward sensitivity may create vulnerabilities, leading to increases in risk taking. Here, we test whether heightened reward sensitivity may potentially be an asset for adolescents when engaged in prosocial activities. Thirty-two adolescents were followed over a one-year period to examine whether ventral striatum activation to prosocial rewards predicts decreases in risk taking over a year. Results show that heightened ventral striatum activation to prosocial stimuli relates to longitudinal declines in risk taking. Therefore, the very same neural region that has conferred vulnerability for adolescent risk taking may also be protective against risk taking. Copyright © 2012 Elsevier Ltd. All rights reserved.

Dopamine cells respond to predicted events during classical conditioning: evidence for eligibility traces in the reward-learning network.

PubMed

Pan, Wei-Xing; Schmidt, Robert; Wickens, Jeffery R; Hyland, Brian I

2005-06-29

Behavioral conditioning of cue-reward pairing results in a shift of midbrain dopamine (DA) cell activity from responding to the reward to responding to the predictive cue. However, the precise time course and mechanism underlying this shift remain unclear. Here, we report a combined single-unit recording and temporal difference (TD) modeling approach to this question. The data from recordings in conscious rats showed that DA cells retain responses to predicted reward after responses to conditioned cues have developed, at least early in training. This contrasts with previous TD models that predict a gradual stepwise shift in latency with responses to rewards lost before responses develop to the conditioned cue. By exploring the TD parameter space, we demonstrate that the persistent reward responses of DA cells during conditioning are only accurately replicated by a TD model with long-lasting eligibility traces (nonzero values for the parameter lambda) and low learning rate (alpha). These physiological constraints for TD parameters suggest that eligibility traces and low per-trial rates of plastic modification may be essential features of neural circuits for reward learning in the brain. Such properties enable rapid but stable initiation of learning when the number of stimulus-reward pairings is limited, conferring significant adaptive advantages in real-world environments.

Neural alterations of fronto-striatal circuitry during reward anticipation in euthymic bipolar disorder.

PubMed

Schreiter, S; Spengler, S; Willert, A; Mohnke, S; Herold, D; Erk, S; Romanczuk-Seiferth, N; Quinlivan, E; Hindi-Attar, C; Banzhaf, C; Wackerhagen, C; Romund, L; Garbusow, M; Stamm, T; Heinz, A; Walter, H; Bermpohl, F

2016-11-01

Bipolar disorder (BD), with the hallmark symptoms of elevated and depressed mood, is thought to be characterized by underlying alterations in reward-processing networks. However, to date the neural circuitry underlying abnormal responses during reward processing in BD remains largely unexplored. The aim of this study was to investigate whether euthymic BD is characterized by aberrant ventral striatal (VS) activation patterns and altered connectivity with the prefrontal cortex in response to monetary gains and losses. During functional magnetic resonance imaging 20 euthymic BD patients and 20 age-, gender- and intelligence quotient-matched healthy controls completed a monetary incentive delay paradigm, to examine neural processing of reward and loss anticipation. A priori defined regions of interest (ROIs) included the VS and the anterior prefrontal cortex (aPFC). Psychophysiological interactions (PPIs) between these ROIs were estimated and tested for group differences for reward and loss anticipation separately. BD participants, relative to healthy controls, displayed decreased activation selectively in the left and right VS during anticipation of reward, but not during loss anticipation. PPI analyses showed decreased functional connectivity between the left VS and aPFC in BD patients compared with healthy controls during reward anticipation. This is the first study showing decreased VS activity and aberrant connectivity in the reward-processing circuitry in euthymic, medicated BD patients during reward anticipation. Our findings contrast with research supporting a reward hypersensitivity model of BD, and add to the body of literature suggesting that blunted activation of reward processing circuits may be a vulnerability factor for mood disorders.

Amphetamine sensitization alters reward processing in the human striatum and amygdala.

PubMed

O'Daly, Owen G; Joyce, Daniel; Tracy, Derek K; Azim, Adnan; Stephan, Klaas E; Murray, Robin M; Shergill, Sukhwinder S

2014-01-01

Dysregulation of mesolimbic dopamine transmission is implicated in a number of psychiatric illnesses characterised by disruption of reward processing and goal-directed behaviour, including schizophrenia, drug addiction and impulse control disorders associated with chronic use of dopamine agonists. Amphetamine sensitization (AS) has been proposed to model the development of this aberrant dopamine signalling and the subsequent dysregulation of incentive motivational processes. However, in humans the effects of AS on the dopamine-sensitive neural circuitry associated with reward processing remains unclear. Here we describe the effects of acute amphetamine administration, following a sensitising dosage regime, on blood oxygen level dependent (BOLD) signal in dopaminoceptive brain regions during a rewarded gambling task performed by healthy volunteers. Using a randomised, double-blind, parallel-groups design, we found clear evidence for sensitization to the subjective effects of the drug, while rewarded reaction times were unchanged. Repeated amphetamine exposure was associated with reduced dorsal striatal BOLD signal during decision making, but enhanced ventromedial caudate activity during reward anticipation. The amygdala BOLD response to reward outcomes was blunted following repeated amphetamine exposure. Positive correlations between subjective sensitization and changes in anticipation- and outcome-related BOLD signal were seen for the caudate nucleus and amygdala, respectively. These data show for the first time in humans that AS changes the functional impact of acute stimulant exposure on the processing of reward-related information within dopaminoceptive regions. Our findings accord with pathophysiological models which implicate aberrant dopaminergic modulation of striatal and amygdala activity in psychosis and drug-related compulsive disorders.

Parabolic discounting of monetary rewards by physical effort.

PubMed

Hartmann, Matthias N; Hager, Oliver M; Tobler, Philippe N; Kaiser, Stefan

2013-11-01

When humans and other animals make decisions in their natural environments prospective rewards have to be weighed against costs. It is well established that increasing costs lead to devaluation or discounting of reward. While our knowledge about discount functions for time and probability costs is quite advanced, little is known about how physical effort discounts reward. In the present study we compared three different models in a binary choice task in which human participants had to squeeze a handgrip to earn monetary rewards: a linear, a hyperbolic, and a parabolic model. On the group as well as the individual level, the concave parabolic model explained most variance of the choice data, thus contrasting with the typical hyperbolic discounting of reward value by delay. Research on effort discounting is not only important to basic science but also holds the potential to quantify aberrant motivational states in neuropsychiatric disorders. Copyright © 2013 Elsevier B.V. All rights reserved.

Effort-reward imbalance at work is predicted by temporal and energetic characteristics of behavior: a population-based study.

PubMed

Hintsa, Taina; Hintsanen, Mirka; Jokela, Markus; Pulkki-Råback, Laura; Keltikangas-Järvinen, Liisa

2013-06-01

Personality dispositions may influence perceptions of work stress. The paper examines the relationship between temperament in terms of Strelau’s Regulative Theory of Temperament and the effort-reward imbalance and its components. There were 890 participants (360 men) aged 37.9 years on average. Temperament traits of briskness and perseveration (temporal characteristics of behavior), sensory sensitivity, emotional reactivity, endurance and activity (energetic characteristics of behavior) were measured by Strelau & Zawadzki’s Formal Characteristics of Behavior- Temperament Inventory (FCB-TI) in 1997 and 2001. Effort and reward at work were assessed with the original effort- reward imbalance (ERI) questionnaire of 2007. Higher ERI at work was predicted by higher emotional reactivity, higher perseveration, lower briskness, and lower endurance. Higher effort and lower rewards at work were predicted by higher perseveration and lower endurance. The FCB-TI temperament characteristics accounted for 5.2%, 4.8% and 6.5% of the variance in the ERI, effort and reward, respectively. Lower emotional reactivity, lower perseveration, higher brisk- ness and higher endurance predicted higher esteem at work, job promotion and job security. Individual differences in arousability, reflected in temporal and energetic characteristics of behavior, may predispose to or to protect from an effort-reward imbalance at work. Individual differences should be acknowledged in work stress prevention and developing interventions.

Working Memory Load Strengthens Reward Prediction Errors.

PubMed

Collins, Anne G E; Ciullo, Brittany; Frank, Michael J; Badre, David

2017-04-19

Reinforcement learning (RL) in simple instrumental tasks is usually modeled as a monolithic process in which reward prediction errors (RPEs) are used to update expected values of choice options. This modeling ignores the different contributions of different memory and decision-making systems thought to contribute even to simple learning. In an fMRI experiment, we investigated how working memory (WM) and incremental RL processes interact to guide human learning. WM load was manipulated by varying the number of stimuli to be learned across blocks. Behavioral results and computational modeling confirmed that learning was best explained as a mixture of two mechanisms: a fast, capacity-limited, and delay-sensitive WM process together with slower RL. Model-based analysis of fMRI data showed that striatum and lateral prefrontal cortex were sensitive to RPE, as shown previously, but, critically, these signals were reduced when the learning problem was within capacity of WM. The degree of this neural interaction related to individual differences in the use of WM to guide behavioral learning. These results indicate that the two systems do not process information independently, but rather interact during learning. SIGNIFICANCE STATEMENT Reinforcement learning (RL) theory has been remarkably productive at improving our understanding of instrumental learning as well as dopaminergic and striatal network function across many mammalian species. However, this neural network is only one contributor to human learning and other mechanisms such as prefrontal cortex working memory also play a key role. Our results also show that these other players interact with the dopaminergic RL system, interfering with its key computation of reward prediction errors. Copyright © 2017 the authors 0270-6474/17/374332-11$15.00/0.

Reported maternal tendencies predict the reward value of infant facial cuteness, but not cuteness detection

PubMed Central

Hahn, Amanda C.; DeBruine, Lisa M.; Jones, Benedict C.

2015-01-01

The factors that contribute to individual differences in the reward value of cute infant facial characteristics are poorly understood. Here we show that the effect of cuteness on a behavioural measure of the reward value of infant faces is greater among women reporting strong maternal tendencies. By contrast, maternal tendencies did not predict women's subjective ratings of the cuteness of these infant faces. These results show, for the first time, that the reward value of infant facial cuteness is greater among women who report being more interested in interacting with infants, implicating maternal tendencies in individual differences in the reward value of infant cuteness. Moreover, our results indicate that the relationship between maternal tendencies and the reward value of infant facial cuteness is not due to individual differences in women's ability to detect infant cuteness. This latter result suggests that individual differences in the reward value of infant cuteness are not simply a by-product of low-cost, functionless biases in the visual system. PMID:25740842

Application of the aberration ring test (ARTEMIS) to determine lens quality and predict its lithographic performance

NASA Astrophysics Data System (ADS)

Moers, Marco H. P.; van der Laan, Hans; Zellenrath, Mark; de Boeij, Wim; Beaudry, Neil A.; Cummings, Kevin D.; van Zwol, Adriaan; Brecht, Arthur; Willekers, Rob

2001-09-01

ARTEMISTM (Aberration Ring Test Exposed at Multiple Illumination Settings) is a technique to determine in-situ, full-field, low and high order lens aberrations. In this paper we are analyzing the ARTEMISTM data of PAS5500/750TM DUV Step & Scan systems and its use as a lithographic prediction tool. ARTEMISTM is capable of determining Zernike coefficients up to Z25 with a 3(sigma) reproducibility range from 1.5 to 4.5 nm depending on the aberration type. 3D electric field simulations, that take the extended geometry of the phase shift feature into account, have been used for an improved treatment of the extraction of the spherical Zernike coefficients. Knowledge of the extracted Zernike coefficients allows an accurate prediction of the lithographic performance of the scanner system. This ability is demonstrated for a two bar pattern and an isolation pattern. The RMS difference between the ARTEMISTM-based lithographic prediction and the lithographic measurement is 2.5 nm for the two bar pattern and 3 nm for the isolation pattern. The 3(sigma) reproducibility of the prediction for the two bar pattern is 2.5 nm and 1 nm for the isolation pattern. This is better than the reproducibility of the lithographic measurements themselves.

Enhanced neural responsiveness to reward associated with obesity in the absence of food-related stimuli.

PubMed

Opel, Nils; Redlich, Ronny; Grotegerd, Dominik; Dohm, Katharina; Haupenthal, Cordula; Heindel, Walter; Kugel, Harald; Arolt, Volker; Dannlowski, Udo

2015-06-01

Obesity has been characterized by alterations in brain structure and function associated with emotion processing and regulation. Particularly, aberrations in food-related reward processing have been frequently demonstrated in obese subjects. However, it remains unclear whether reward-associated functional aberrations in obesity are specific for food-related stimuli or represent a general deficit in reward processing, extending to other stimulus domains. Given the crucial role of rewarding effects in the development of obesity and the ongoing discussion on overlapping neurobiological traits of obesity and psychiatric disorders such as depression and substance-related disorders, this study aimed to investigate the possibility of altered reward processing in obese subjects to occur in the absence of food-related stimuli during a monetary reward condition. Twenty-nine healthy obese subjects (body mass index >30) and 29 healthy, age-, and sex-matched control subjects of normal weight underwent functional MRI during a frequently used card guessing paradigm. A Group × Condition (win vs. loss) ANOVA was conducted to investigate differences between obese and normal-weight subjects. We found significant Group × Condition interaction effects in brain areas involved in emotion regulation and reward processing including the insula, the striatum, and the orbitofrontal cortex (OFC). This interaction was predominantly driven by a significant increase in blood oxygenation level dependent (BOLD) response in obese individuals while experiencing reward. Enhanced neural activation in obesity during reward processing seems to be apparent even in the absence of food-related stimuli and, thus, might point to generalized dysfunctions in reward-related brain circuits in obese individuals. © 2015 Wiley Periodicals, Inc.

Reward inference by primate prefrontal and striatal neurons.

PubMed

Pan, Xiaochuan; Fan, Hongwei; Sawa, Kosuke; Tsuda, Ichiro; Tsukada, Minoru; Sakagami, Masamichi

2014-01-22

The brain contains multiple yet distinct systems involved in reward prediction. To understand the nature of these processes, we recorded single-unit activity from the lateral prefrontal cortex (LPFC) and the striatum in monkeys performing a reward inference task using an asymmetric reward schedule. We found that neurons both in the LPFC and in the striatum predicted reward values for stimuli that had been previously well experienced with set reward quantities in the asymmetric reward task. Importantly, these LPFC neurons could predict the reward value of a stimulus using transitive inference even when the monkeys had not yet learned the stimulus-reward association directly; whereas these striatal neurons did not show such an ability. Nevertheless, because there were two set amounts of reward (large and small), the selected striatal neurons were able to exclusively infer the reward value (e.g., large) of one novel stimulus from a pair after directly experiencing the alternative stimulus with the other reward value (e.g., small). Our results suggest that although neurons that predict reward value for old stimuli in the LPFC could also do so for new stimuli via transitive inference, those in the striatum could only predict reward for new stimuli via exclusive inference. Moreover, the striatum showed more complex functions than was surmised previously for model-free learning.

Reward Inference by Primate Prefrontal and Striatal Neurons

PubMed Central

Pan, Xiaochuan; Fan, Hongwei; Sawa, Kosuke; Tsuda, Ichiro; Tsukada, Minoru

2014-01-01

The brain contains multiple yet distinct systems involved in reward prediction. To understand the nature of these processes, we recorded single-unit activity from the lateral prefrontal cortex (LPFC) and the striatum in monkeys performing a reward inference task using an asymmetric reward schedule. We found that neurons both in the LPFC and in the striatum predicted reward values for stimuli that had been previously well experienced with set reward quantities in the asymmetric reward task. Importantly, these LPFC neurons could predict the reward value of a stimulus using transitive inference even when the monkeys had not yet learned the stimulus–reward association directly; whereas these striatal neurons did not show such an ability. Nevertheless, because there were two set amounts of reward (large and small), the selected striatal neurons were able to exclusively infer the reward value (e.g., large) of one novel stimulus from a pair after directly experiencing the alternative stimulus with the other reward value (e.g., small). Our results suggest that although neurons that predict reward value for old stimuli in the LPFC could also do so for new stimuli via transitive inference, those in the striatum could only predict reward for new stimuli via exclusive inference. Moreover, the striatum showed more complex functions than was surmised previously for model-free learning. PMID:24453328

Signed reward prediction errors drive declarative learning

PubMed Central

Naert, Lien; Janssens, Clio; Talsma, Durk; Van Opstal, Filip; Verguts, Tom

2018-01-01

Reward prediction errors (RPEs) are thought to drive learning. This has been established in procedural learning (e.g., classical and operant conditioning). However, empirical evidence on whether RPEs drive declarative learning–a quintessentially human form of learning–remains surprisingly absent. We therefore coupled RPEs to the acquisition of Dutch-Swahili word pairs in a declarative learning paradigm. Signed RPEs (SRPEs; “better-than-expected” signals) during declarative learning improved recognition in a follow-up test, with increasingly positive RPEs leading to better recognition. In addition, classic declarative memory mechanisms such as time-on-task failed to explain recognition performance. The beneficial effect of SRPEs on recognition was subsequently affirmed in a replication study with visual stimuli. PMID:29293493

Signed reward prediction errors drive declarative learning.

PubMed

De Loof, Esther; Ergo, Kate; Naert, Lien; Janssens, Clio; Talsma, Durk; Van Opstal, Filip; Verguts, Tom

2018-01-01

Reward prediction errors (RPEs) are thought to drive learning. This has been established in procedural learning (e.g., classical and operant conditioning). However, empirical evidence on whether RPEs drive declarative learning-a quintessentially human form of learning-remains surprisingly absent. We therefore coupled RPEs to the acquisition of Dutch-Swahili word pairs in a declarative learning paradigm. Signed RPEs (SRPEs; "better-than-expected" signals) during declarative learning improved recognition in a follow-up test, with increasingly positive RPEs leading to better recognition. In addition, classic declarative memory mechanisms such as time-on-task failed to explain recognition performance. The beneficial effect of SRPEs on recognition was subsequently affirmed in a replication study with visual stimuli.

Sustained anterior cingulate cortex activation during reward processing predicts response to psychotherapy in major depressive disorder.

PubMed

Carl, Hannah; Walsh, Erin; Eisenlohr-Moul, Tory; Minkel, Jared; Crowther, Andrew; Moore, Tyler; Gibbs, Devin; Petty, Chris; Bizzell, Josh; Dichter, Gabriel S; Smoski, Moria J

2016-10-01

The purpose of the present investigation was to evaluate whether pre-treatment neural activation in response to rewards is a predictor of clinical response to Behavioral Activation Therapy for Depression (BATD), an empirically validated psychotherapy that decreases depressive symptoms by increasing engagement with rewarding stimuli and reducing avoidance behaviors. Participants were 33 outpatients with major depressive disorder (MDD) and 20 matched controls. We examined group differences in activation, and the capacity to sustain activation, across task runs using functional magnetic resonance imaging (fMRI) and the monetary incentive delay (MID) task. Hierarchical linear modeling was used to investigate whether pre-treatment neural responses predicted change in depressive symptoms over the course of BATD treatment. MDD and Control groups differed in sustained activation during reward outcomes in the right nucleus accumbens, such that the MDD group experienced a significant decrease in activation in this region from the first to second task run relative to controls. Pretreatment anhedonia severity and pretreatment task-related reaction times were predictive of response to treatment. Furthermore, sustained activation in the anterior cingulate cortex during reward outcomes predicted response to psychotherapy; patients with greater sustained activation in this region were more responsive to BATD treatment. The current study only included a single treatment condition, thus it unknown whether these predictors of treatment response are specific to BATD or psychotherapy in general. Findings add to the growing body of literature suggesting that the capacity to sustain neural responses to rewards may be a critical endophenotype of MDD. Copyright © 2016 Elsevier B.V. All rights reserved.

Eveningness among late adolescent males predicts neural reactivity to reward and alcohol dependence two years later

PubMed Central

Hasler, Brant P.; Casement, Melynda D.; Sitnick, Stephanie L.; Shaw, Daniel S.; Forbes, Erika E.

2017-01-01

Eveningness, a preference for later sleep-wake timing, is linked to altered reward function, which may explain a consistent association with substance abuse. Notably, the extant literature rests largely on cross-sectional data, yet both eveningness and reward function show developmental changes. We examined whether circadian preference during late adolescence predicted the neural response to reward two years later. A sample of 93 males reported circadian preference and completed a monetary reward fMRI paradigm at ages 20 and 22. Primary analyses examined longitudinal paths from circadian preference to medial prefrontal cortex (mPFC) and ventral striatal (VS) reward responses. We also explored whether reward responses mediated longitudinal associations between circadian preference and alcohol dependence, frequency of alcohol use, and/or frequency of cannabis use. Age 20 eveningness was positively associated with age 22 mPFC and VS responses to win, but not associated with age 22 reactivity to reward anticipation. Age 20 eveningness was indirectly related to age 22 alcohol dependence via age 22 mPFC response to win. Our findings provide novel evidence that altered reward-related brain function could underlie associations between eveningness and alcohol use problems. Eveningness may be an under-recognized but modifiable risk factor for reward-related problems such as mood and substance use disorders. PMID:28254633

Effect of monochromatic aberrations on photorefractive patterns

NASA Astrophysics Data System (ADS)

Campbell, Melanie C. W.; Bobier, W. R.; Roorda, A.

1995-08-01

Photorefractive methods have become popular in the measurement of refractive and accommodative states of infants and children owing to their photographic nature and rapid speed of measurement. As in the case of any method that measures the refractive state of the human eye, monochromatic aberrations will reduce the accuracy of the measurement. Monochromatic aberrations cannot be as easily predicted or controlled as chromatic aberrations during the measurement, and accordingly they will introduce measurement errors. This study defines this error or uncertainty by extending the existing paraxial optical analyses of coaxial and eccentric photorefraction. This new optical analysis predicts that, for the amounts of spherical aberration (SA) reported for the human eye, there will be a significant degree of measurement uncertainty introduced for all photorefractive methods. The dioptric amount of this uncertainty may exceed the maximum amount of SA present in the eye. The calculated effects on photorefractive measurement of a real eye with a mixture of spherical aberration and coma are shown to be significant. The ability, developed here, to predict photorefractive patterns corresponding to different amounts and types of monochromatic aberration may in the future lead to an extension of photorefractive methods to the dual measurement of refractive states and aberrations of individual eyes. aberration, retinal image quality,

Attenuation of Frontostriatal Connectivity During Reward Processing Predicts Response to Psychotherapy in Major Depressive Disorder.

PubMed

Walsh, Erin; Carl, Hannah; Eisenlohr-Moul, Tory; Minkel, Jared; Crowther, Andrew; Moore, Tyler; Gibbs, Devin; Petty, Chris; Bizzell, Josh; Smoski, Moria J; Dichter, Gabriel S

2017-03-01

There are few reliable predictors of response to antidepressant treatments. In the present investigation, we examined pretreatment functional brain connectivity during reward processing as a potential predictor of response to Behavioral Activation Treatment for Depression (BATD), a validated psychotherapy that promotes engagement with rewarding stimuli and reduces avoidance behaviors. Thirty-three outpatients with major depressive disorder (MDD) and 20 matched controls completed two runs of the monetary incentive delay task during functional magnetic resonance imaging after which participants with MDD received up to 15 sessions of BATD. Seed-based generalized psychophysiological interaction analyses focused on task-based connectivity across task runs, as well as the attenuation of connectivity from the first to the second run of the task. The average change in Beck Depression Inventory-II scores due to treatment was 10.54 points, a clinically meaningful response. Groups differed in seed-based functional connectivity among multiple frontostriatal regions. Hierarchical linear modeling revealed that improved treatment response to BATD was predicted by greater connectivity between the left putamen and paracingulate gyrus during reward anticipation. In addition, MDD participants with greater attenuation of connectivity between several frontostriatal seeds, and midline subcallosal cortex and left paracingulate gyrus demonstrated improved response to BATD. These findings indicate that pretreatment frontostriatal functional connectivity during reward processing is predictive of response to a psychotherapy modality that promotes improving approach-related behaviors in MDD. Furthermore, connectivity attenuation among reward-processing regions may be a particularly powerful endophenotypic predictor of response to BATD in MDD.

'Wanting' and 'liking' skin picking: A validation of the Skin Picking Reward Scale.

PubMed

Snorrason, Ivar; Olafsson, Ragnar P; Houghton, David C; Woods, Douglas W; Lee, Han-Joo

2015-12-01

Excoriation (skin-picking) disorder (SPD) is often conceptualized as a behavioral addiction in which aberrant reward processing may play an important role. The current study sought to develop a self-report instrument--the Skin Picking Reward Scale (SPRS)--that measures how strongly skin picking is 'liked' (i.e., the degree of pleasurable feelings while receiving the reward) and 'wanted' (i.e., the degree of the motivation to seek the reward). We administered the SPRS to individuals who endorsed excessive skin picking in online surveys and examined the scale's factor structure (Studies 1 and 2). We then asked individuals with documented pathological skin picking to complete the SPRS and other relevant questionnaires on two occasions one week apart (Study 3). Exploratory (Study 1; n = 330) and confirmatory (Study 2; n = 144) factor analyses consistently supported a two-factor structure reflecting the 'liking' and 'wanting' constructs. Results from Study 3 (N = 36) indicated that the Wanting and the Liking scales had adequate internal consistency and test-retest reliability. Additionally, consistent with predictions, the Wanting scale, but not the Liking scale, was associated with picking urges the following week, greater cue-reactivity, and more picking-related routines/habits. These initial findings suggest that SPRS is a psychometrically sound measure of 'wanting' and 'liking' in pathological skin picking. The SPRS may facilitate research on reward processing anomalies in SPD and serve as a useful clinical instrument (e.g., to identify those at risk for cue-induced relapse).

Cortical Brain Activity Reflecting Attentional Biasing Toward Reward-Predicting Cues Covaries with Economic Decision-Making Performance

PubMed Central

San Martín, René; Appelbaum, Lawrence G.; Huettel, Scott A.; Woldorff, Marty G.

2016-01-01

Adaptive choice behavior depends critically on identifying and learning from outcome-predicting cues. We hypothesized that attention may be preferentially directed toward certain outcome-predicting cues. We studied this possibility by analyzing event-related potential (ERP) responses in humans during a probabilistic decision-making task. Participants viewed pairs of outcome-predicting visual cues and then chose to wager either a small (i.e., loss-minimizing) or large (i.e., gain-maximizing) amount of money. The cues were bilaterally presented, which allowed us to extract the relative neural responses to each cue by using a contralateral-versus-ipsilateral ERP contrast. We found an early lateralized ERP response, whose features matched the attention-shift-related N2pc component and whose amplitude scaled with the learned reward-predicting value of the cues as predicted by an attention-for-reward model. Consistently, we found a double dissociation involving the N2pc. Across participants, gain-maximization positively correlated with the N2pc amplitude to the most reliable gain-predicting cue, suggesting an attentional bias toward such cues. Conversely, loss-minimization was negatively correlated with the N2pc amplitude to the most reliable loss-predicting cue, suggesting an attentional avoidance toward such stimuli. These results indicate that learned stimulus–reward associations can influence rapid attention allocation, and that differences in this process are associated with individual differences in economic decision-making performance. PMID:25139941

Reward Sensitivity and Waiting Impulsivity: Shift towards Reward Valuation away from Action Control

PubMed Central

Mechelmans, Daisy J; Strelchuk, Daniela; Doñamayor, Nuria; Banca, Paula; Robbins, Trevor W; Baek, Kwangyeol

2017-01-01

Abstract Background Impulsivity and reward expectancy are commonly interrelated. Waiting impulsivity, measured using the rodent 5-Choice Serial Reaction Time task, predicts compulsive cocaine seeking and sign (or cue) tracking. Here, we assess human waiting impulsivity using a novel translational task, the 4-Choice Serial Reaction Time task, and the relationship with reward cues. Methods Healthy volunteers (n=29) performed the monetary incentive delay task as a functional MRI study where subjects observe a cue predicting reward (cue) and wait to respond for high (£5), low (£1), or no reward. Waiting impulsivity was tested with the 4-Choice Serial Reaction Time task. Results For high reward prospects (£5, no reward), greater waiting impulsivity on the 4-CSRT correlated with greater medial orbitofrontal cortex and lower supplementary motor area activity to cues. In response to high reward cues, greater waiting impulsivity was associated with greater subthalamic nucleus connectivity with orbitofrontal cortex and greater subgenual cingulate connectivity with anterior insula, but decreased connectivity with regions implicated in action selection and preparation. Conclusion These findings highlight a shift towards regions implicated in reward valuation and a shift towards compulsivity away from higher level motor preparation and action selection and response. We highlight the role of reward sensitivity and impulsivity, mechanisms potentially linking human waiting impulsivity with incentive approach and compulsivity, theories highly relevant to disorders of addiction. PMID:29020291

Dopamine prediction errors in reward learning and addiction: from theory to neural circuitry

PubMed Central

Keiflin, Ronald; Janak, Patricia H.

2015-01-01

Summary Midbrain dopamine (DA) neurons are proposed to signal reward prediction error (RPE), a fundamental parameter in associative learning models. This RPE hypothesis provides a compelling theoretical framework for understanding DA function in reward learning and addiction. New studies support a causal role for DA-mediated RPE activity in promoting learning about natural reward; however, this question has not been explicitly tested in the context of drug addiction. In this review, we integrate theoretical models with experimental findings on the activity of DA systems, and on the causal role of specific neuronal projections and cell types, to provide a circuit-based framework for probing DA-RPE function in addiction. By examining error-encoding DA neurons in the neural network in which they are embedded, hypotheses regarding circuit-level adaptations that possibly contribute to pathological error-signaling and addiction can be formulated and tested. PMID:26494275

Aberrant reward center response to partner reputation during a social exchange game in generalized social phobia.

PubMed

Sripada, Chandra; Angstadt, Michael; Liberzon, Israel; McCabe, Kevin; Phan, K Luan

2013-04-01

Generalized social anxiety disorder (GSAD) is characterized by excessive fear of public scrutiny and reticence in social engagement. Previous studies have probed the neural basis of GSAD often using static, noninteractive stimuli (e.g., face photographs) and have identified dysfunction in fear circuitry. We sought to investigate brain-based dysfunction in GSAD during more real-world, dynamic social interactions, focusing on the role of reward-related regions that are implicated in social decision-making. Thirty-six healthy individuals (healthy control [HC]) and 36 individuals with GSAD underwent functional magnetic resonance imaging (fMRI) scanning while participating in a behavioral economic game ("Trust Game") involving iterative exchanges with fictive partners who acquire differential reputations for reciprocity. We investigated brain responses to reciprocation of trust in one's social partner, and how these brain responses are modulated by partner reputation for repayment. In both HC and GSAD, receipt of reciprocity robustly engaged ventral striatum, a region implicated in reward. In HC, striatal responses to reciprocity were specific to partners who have consistently returned the investment ("cooperative partners"), and were absent for partners who lack a cooperative reputation. In GSAD, modulation of striatal responses by partner reputation was absent. Social anxiety severity predicted diminished responses to cooperative partners. These results suggest abnormalities in GSAD in reward-related striatal mechanisms that may be important for the initiation, valuation, and maintenance of cooperative social relationships. Moreover, this study demonstrates that dynamic, interactive task paradigms derived from economics can help illuminate novel mechanisms of pathology in psychiatric illnesses in which social dysfunction is a cardinal feature. © 2013 Wiley Periodicals, Inc.

A reward-centred model of anorexia nervosa: a focussed narrative review of the neurological and psychophysiological literature.

PubMed

O'Hara, Caitlin B; Campbell, Iain C; Schmidt, Ulrike

2015-05-01

This focussed narrative review examines neurobiological and psychophysiological evidence supporting a role for altered reward processes in the development and maintenance of anorexia nervosa (AN). In AN, there does not appear to be a generalised inability to experience reward. Rather, data suggest that a reluctance to gain weight leads to an aversive appraisal of food- and taste-related stimuli. As a result, cues compatible with this aberrant mode of thinking become rewarding for the individual. Evidence also suggests that attribution of motivational salience to such cues promotes anorectic behaviours. These findings are consistent with models in which interactions between cognition and reward are important in eliciting the anorectic "habit". A model is proposed which is consistent with elements of other theoretical frameworks, but differs in that its emphasis is towards neural overlaps between AN and addiction. It is consistent with AN being a reward-based learned behaviour in which aberrant cognitions related to eating and shape alter functioning of central reward systems. It proposes that the primary neural problem responsible for the development, maintenance, and treatment resistance is centred in the striatal reward system. This helps shift the emphasis of aetiological models towards reward processing, particularly in the context of illness-compatible cues. Furthermore, it suggests that continuing to explore the utility and valued nature of AN in the patient's life would be a useful inclusion in treatment and prevention models. Copyright © 2015. Published by Elsevier Ltd.

Shaping Attention with Reward: Effects of Reward on Space- and Object-Based Selection

PubMed Central

Shomstein, Sarah; Johnson, Jacoba

2014-01-01

The contribution of rewarded actions to automatic attentional selection remains obscure. We hypothesized that some forms of automatic orienting, such as object-based selection, can be completely abandoned in lieu of reward maximizing strategy. While presenting identical visual stimuli to the observer, in a set of two experiments, we manipulate what is being rewarded (different object targets or random object locations) and the type of reward received (money or points). It was observed that reward alone guides attentional selection, entirely predicting behavior. These results suggest that guidance of selective attention, while automatic, is flexible and can be adjusted in accordance with external non-sensory reward-based factors. PMID:24121412

Reward processing in neurodegenerative disease

PubMed Central

Perry, David C.; Kramer, Joel H.

2015-01-01

Representation of reward value involves a distributed network including cortical and subcortical structures. Because neurodegenerative illnesses target specific anatomic networks that partially overlap with the reward circuit they would be predicted to have distinct impairments in reward processing. This review presents the existing evidence of reward processing changes in neurodegenerative diseases including mild cognitive impairment, Alzheimer's disease, frontotemporal dementia, amyotrophic lateral sclerosis, Parkinson's disease, and Huntington's disease, as well as in healthy aging. Carefully distinguishing the different aspects of reward processing (primary rewards, secondary rewards, reward-based learning, and reward-based decision-making) and using tasks that differentiate the stages of processing reward will lead to improved understanding of this fundamental process and clarify a contributing cause of behavioral change in these illnesses. PMID:24417286

Cortical Brain Activity Reflecting Attentional Biasing Toward Reward-Predicting Cues Covaries with Economic Decision-Making Performance.

PubMed

San Martín, René; Appelbaum, Lawrence G; Huettel, Scott A; Woldorff, Marty G

2016-01-01

Adaptive choice behavior depends critically on identifying and learning from outcome-predicting cues. We hypothesized that attention may be preferentially directed toward certain outcome-predicting cues. We studied this possibility by analyzing event-related potential (ERP) responses in humans during a probabilistic decision-making task. Participants viewed pairs of outcome-predicting visual cues and then chose to wager either a small (i.e., loss-minimizing) or large (i.e., gain-maximizing) amount of money. The cues were bilaterally presented, which allowed us to extract the relative neural responses to each cue by using a contralateral-versus-ipsilateral ERP contrast. We found an early lateralized ERP response, whose features matched the attention-shift-related N2pc component and whose amplitude scaled with the learned reward-predicting value of the cues as predicted by an attention-for-reward model. Consistently, we found a double dissociation involving the N2pc. Across participants, gain-maximization positively correlated with the N2pc amplitude to the most reliable gain-predicting cue, suggesting an attentional bias toward such cues. Conversely, loss-minimization was negatively correlated with the N2pc amplitude to the most reliable loss-predicting cue, suggesting an attentional avoidance toward such stimuli. These results indicate that learned stimulus-reward associations can influence rapid attention allocation, and that differences in this process are associated with individual differences in economic decision-making performance. © The Author 2014. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

Self-stimulating rats combine subjective reward magnitude and subjective reward rate multiplicatively.

PubMed

Leon, M I; Gallistel, C R

1998-07-01

For rats that bar pressed for intracranial electrical stimulation in a 2-lever matching paradigm with concurrent variable interval schedules of reward, the authors found that the time allocation ratio is based on a multiplicative combination of the ratio of subjective reward magnitudes and the ratio of the rates of reward. Multiplicative combining was observed in a range covering approximately 2 orders of magnitude in the ratio of the rates of reward from about 1:10 to 10:1) and an order of magnitude change in the size of rewards. After determining the relation between the pulse frequency of stimulation and subjective reward magnitude, the authors were able to predict from knowledge of the subjective magnitudes of the rewards and the obtained relative rates of reward the subject's time allocation ratio over a range in which it varied by more than 3 orders of magnitude.

Dissociable effects of surprising rewards on learning and memory.

PubMed

Rouhani, Nina; Norman, Kenneth A; Niv, Yael

2018-03-19

Reward-prediction errors track the extent to which rewards deviate from expectations, and aid in learning. How do such errors in prediction interact with memory for the rewarding episode? Existing findings point to both cooperative and competitive interactions between learning and memory mechanisms. Here, we investigated whether learning about rewards in a high-risk context, with frequent, large prediction errors, would give rise to higher fidelity memory traces for rewarding events than learning in a low-risk context. Experiment 1 showed that recognition was better for items associated with larger absolute prediction errors during reward learning. Larger prediction errors also led to higher rates of learning about rewards. Interestingly we did not find a relationship between learning rate for reward and recognition-memory accuracy for items, suggesting that these two effects of prediction errors were caused by separate underlying mechanisms. In Experiment 2, we replicated these results with a longer task that posed stronger memory demands and allowed for more learning. We also showed improved source and sequence memory for items within the high-risk context. In Experiment 3, we controlled for the difficulty of reward learning in the risk environments, again replicating the previous results. Moreover, this control revealed that the high-risk context enhanced item-recognition memory beyond the effect of prediction errors. In summary, our results show that prediction errors boost both episodic item memory and incremental reward learning, but the two effects are likely mediated by distinct underlying systems. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Nicotine Withdrawal Induces Neural Deficits in Reward Processing.

PubMed

Oliver, Jason A; Evans, David E; Addicott, Merideth A; Potts, Geoffrey F; Brandon, Thomas H; Drobes, David J

2017-06-01

Nicotine withdrawal reduces neurobiological responses to nonsmoking rewards. Insight into these reward deficits could inform the development of targeted interventions. This study examined the effect of withdrawal on neural and behavioral responses during a reward prediction task. Smokers (N = 48) attended two laboratory sessions following overnight abstinence. Withdrawal was manipulated by having participants smoke three regular nicotine (0.6 mg yield; satiation) or very low nicotine (0.05 mg yield; withdrawal) cigarettes. Electrophysiological recordings of neural activity were obtained while participants completed a reward prediction task that involved viewing four combinations of predictive and reward-determining stimuli: (1) Unexpected Reward; (2) Predicted Reward; (3) Predicted Punishment; (4) Unexpected Punishment. The task evokes a medial frontal negativity that mimics the phasic pattern of dopaminergic firing in ventral tegmental regions associated with reward prediction errors. Nicotine withdrawal decreased the amplitude of the medial frontal negativity equally across all trial types (p < .001). Exploratory analyses indicated withdrawal increased time to initiate the next trial following unexpected punishment trials (p < .001) and response time on reward trials during withdrawal was positively related to nicotine dependence (p < .001). Nicotine withdrawal had equivocal impact across trial types, suggesting reward processing deficits are unlikely to stem from changes in phasic dopaminergic activity during prediction errors. Effects on tonic activity may be more pronounced. Pharmacological interventions directly targeting the dopamine system and behavioral interventions designed to increase reward motivation and responsiveness (eg, behavioral activation) may aid in mitigating withdrawal symptoms and potentially improving smoking cessation outcomes. Findings from this study indicate nicotine withdrawal impacts reward processing signals that are observable in

High monetary reward rates and caloric rewards decrease temporal persistence

PubMed Central

Bode, Stefan; Murawski, Carsten

2017-01-01

Temporal persistence refers to an individual's capacity to wait for future rewards, while forgoing possible alternatives. This requires a trade-off between the potential value of delayed rewards and opportunity costs, and is relevant to many real-world decisions, such as dieting. Theoretical models have previously suggested that high monetary reward rates, or positive energy balance, may result in decreased temporal persistence. In our study, 50 fasted participants engaged in a temporal persistence task, incentivised with monetary rewards. In alternating blocks of this task, rewards were delivered at delays drawn randomly from distributions with either a lower or higher maximum reward rate. During some blocks participants received either a caloric drink or water. We used survival analysis to estimate participants' probability of quitting conditional on the delay distribution and the consumed liquid. Participants had a higher probability of quitting in blocks with the higher reward rate. Furthermore, participants who consumed the caloric drink had a higher probability of quitting than those who consumed water. Our results support the predictions from the theoretical models, and importantly, suggest that both higher monetary reward rates and physiologically relevant rewards can decrease temporal persistence, which is a crucial determinant for survival in many species. PMID:28228517

High monetary reward rates and caloric rewards decrease temporal persistence.

PubMed

Fung, Bowen J; Bode, Stefan; Murawski, Carsten

2017-02-22

Temporal persistence refers to an individual's capacity to wait for future rewards, while forgoing possible alternatives. This requires a trade-off between the potential value of delayed rewards and opportunity costs, and is relevant to many real-world decisions, such as dieting. Theoretical models have previously suggested that high monetary reward rates, or positive energy balance, may result in decreased temporal persistence. In our study, 50 fasted participants engaged in a temporal persistence task, incentivised with monetary rewards. In alternating blocks of this task, rewards were delivered at delays drawn randomly from distributions with either a lower or higher maximum reward rate. During some blocks participants received either a caloric drink or water. We used survival analysis to estimate participants' probability of quitting conditional on the delay distribution and the consumed liquid. Participants had a higher probability of quitting in blocks with the higher reward rate. Furthermore, participants who consumed the caloric drink had a higher probability of quitting than those who consumed water. Our results support the predictions from the theoretical models, and importantly, suggest that both higher monetary reward rates and physiologically relevant rewards can decrease temporal persistence, which is a crucial determinant for survival in many species. © 2017 The Authors.

Spontaneous Eye-Blink Rate as an Index of Reward Responsivity: Validation and Links to Bipolar Disorder

PubMed Central

Peckham, Andrew D.; Johnson, Sheri L.

2015-01-01

Extensive research supports the role of striatal dopamine in pursuing and responding to reward, and that eye-blink rate is a valid indicator of striatal dopamine. This study tested whether phasic changes in blink rate could provide an index of reward pursuit. This hypothesis was tested in people with bipolar I disorder (BD; a population with aberrations in reward responsivity), and in those without BD. Thirty-one adults with BD and 28 control participants completed a laboratory task involving effort towards monetary reward. Blink rate was recorded using eye-tracking at baseline, reward anticipation, and post-reward. Those in the BD group completed self-report measures relating to reward and ambition. Results showed that across all participants, blink rates increased from reward anticipation to post-reward. In the BD group, reward-relevant measures were strongly correlated with variation in blink rate. These findings provide validation for phasic changes in blink rate as an index of reward response. PMID:27274949

Neural dynamics of reward probability coding: a Magnetoencephalographic study in humans

PubMed Central

Thomas, Julie; Vanni-Mercier, Giovanna; Dreher, Jean-Claude

2013-01-01

Prediction of future rewards and discrepancy between actual and expected outcomes (prediction error) are crucial signals for adaptive behavior. In humans, a number of fMRI studies demonstrated that reward probability modulates these two signals in a large brain network. Yet, the spatio-temporal dynamics underlying the neural coding of reward probability remains unknown. Here, using magnetoencephalography, we investigated the neural dynamics of prediction and reward prediction error computations while subjects learned to associate cues of slot machines with monetary rewards with different probabilities. We showed that event-related magnetic fields (ERFs) arising from the visual cortex coded the expected reward value 155 ms after the cue, demonstrating that reward value signals emerge early in the visual stream. Moreover, a prediction error was reflected in ERF peaking 300 ms after the rewarded outcome and showing decreasing amplitude with higher reward probability. This prediction error signal was generated in a network including the anterior and posterior cingulate cortex. These findings pinpoint the spatio-temporal characteristics underlying reward probability coding. Together, our results provide insights into the neural dynamics underlying the ability to learn probabilistic stimuli-reward contingencies. PMID:24302894

Reward contingencies and the recalibration of task monitoring and reward systems: a high-density electrical mapping study.

PubMed

Morie, K P; De Sanctis, P; Foxe, J J

2014-07-25

Task execution almost always occurs in the context of reward-seeking or punishment-avoiding behavior. As such, ongoing task-monitoring systems are influenced by reward anticipation systems. In turn, when a task has been executed either successfully or unsuccessfully, future iterations of that task will be re-titrated on the basis of the task outcome. Here, we examined the neural underpinnings of the task-monitoring and reward-evaluation systems to better understand how they govern reward-seeking behavior. Twenty-three healthy adult participants performed a task where they accrued points that equated to real world value (gift cards) by responding as rapidly as possible within an allotted timeframe, while success rate was titrated online by changing the duration of the timeframe dependent on participant performance. Informative cues initiated each trial, indicating the probability of potential reward or loss (four levels from very low to very high). We manipulated feedback by first informing participants of task success/failure, after which a second feedback signal indicated actual magnitude of reward/loss. High-density electroencephalography (EEG) recordings allowed for examination of event-related potentials (ERPs) to the informative cues and in turn, to both feedback signals. Distinct ERP components associated with reward cues, task-preparatory and task-monitoring processes, and reward feedback processes were identified. Unsurprisingly, participants displayed increased ERP amplitudes associated with task-preparatory processes following cues that predicted higher chances of reward. They also rapidly updated reward and loss prediction information dependent on task performance after the first feedback signal. Finally, upon reward receipt, initial reward probability was no longer taken into account. Rather, ERP measures suggested that only the magnitude of actual reward or loss was now processed. Reward and task-monitoring processes are clearly dissociable, but

Reward Contingencies and the Recalibration of Task Monitoring and Reward Systems: A high-density electrical mapping study

PubMed Central

Morie, Kristen P.; De Sanctis, Pierfilippo; Foxe, John J.

2014-01-01

Task execution almost always occurs in the context of reward-seeking or punishment-avoiding behavior. As such, ongoing task monitoring systems are influenced by reward anticipation systems. In turn, when a task has been executed either successfully or unsuccessfully, future iterations of that task will be re-titrated on the basis of the task outcome. Here, we examined the neural underpinnings of the task-monitoring and reward-evaluation systems to better understand how they govern reward seeking behavior. Twenty-three healthy adult participants performed a task where they accrued points that equated to real world value (gift cards) by responding as rapidly as possible within an allotted timeframe, while success rate was titrated online by changing the duration of the timeframe dependent on participant performance. Informative cues initiated each trial, indicating the probability of potential reward or loss (four levels from very low to very high). We manipulated feedback by first informing participants of task success/failure, after which a second feedback signal indicated actual magnitude of reward/loss. High-density EEG recordings allowed for examination of event-related potentials (ERPs) to the informative cues and in turn, to both feedback signals. Distinct ERP components associated with reward cues, task preparatory and task monitoring processes, and reward feedback processes were identified. Unsurprisingly, participants displayed increased ERP amplitudes associated with task preparatory processes following cues that predicted higher chances of reward. They also rapidly updated reward and loss prediction information dependent on task performance after the first feedback signal. Finally, upon reward receipt, initial reward probability was no longer taken into account. Rather, ERP measures suggested that only the magnitude of actual reward or loss was now processed. Reward and task monitoring processes are clearly dissociable, but interact across very fast

Reward and relief dimensions of temptation to drink: construct validity and role in predicting differential benefit from acamprosate and naltrexone.

PubMed

Roos, Corey R; Mann, Karl; Witkiewitz, Katie

2017-11-01

Researchers have sought to distinguish between individuals whose alcohol use disorder (AUD) is maintained by drinking to relieve negative affect ('relief drinkers') and those whose AUD is maintained by the rewarding effects of alcohol ('reward drinkers'). As an opioid receptor antagonist, naltrexone may be particularly effective for reward drinkers. Acamprosate, which has been shown to down-regulate the glutamatergic system, may be particularly effective for relief drinkers. This study sought to replicate and extend prior work (PREDICT study; Glöckner-Rist et al. ) by examining dimensions of reward and relief temptation to drink and subtypes of individuals with distinct patterns of reward/relief temptation. We utilized data from two randomized clinical trials for AUD (Project MATCH, n = 1726 and COMBINE study, n = 1383). We also tested whether classes of reward/relief temptation would predict differential response to naltrexone and acamprosate in COMBINE. Results replicated prior work by identifying reward and relief temptation factors, which had excellent reliability and construct validity. Using factor mixture modeling, we identified five distinct classes of reward/relief temptation that replicated across studies. In COMBINE, we found a significant class-by-acamprosate interaction effect. Among those most likely classified in the high relief/moderate reward temptation class, individuals had better drinking outcomes if assigned to acamprosate versus placebo. We did not find a significant class-by-naltrexone interaction effect. Our study questions the orthogonal classification of drinkers into only two types (reward or relief drinkers) and adds to the body of research on moderators of acamprosate, which may inform clinical decision making in the treatment of AUD. © 2016 Society for the Study of Addiction.

Blunted striatal response to monetary reward anticipation during smoking abstinence predicts lapse during a contingency-managed quit attempt.

PubMed

Sweitzer, Maggie M; Geier, Charles F; Denlinger, Rachel; Forbes, Erika E; Raiff, Bethany R; Dallery, Jesse; McClernon, F J; Donny, Eric C

2016-03-01

Tobacco smoking is associated with dysregulated reward processing within the striatum, characterized by hypersensitivity to smoking rewards and hyposensitivity to non-smoking rewards. This bias toward smoking reward at the expense of alternative rewards is further exacerbated by deprivation from smoking, which may contribute to difficulty maintaining abstinence during a quit attempt. We examined whether abstinence-induced changes in striatal processing of rewards predicted lapse likelihood during a quit attempt supported by contingency management (CM), in which abstinence from smoking was reinforced with money. Thirty-six non-treatment-seeking smokers participated in two functional MRI (fMRI) sessions, one following 24-h abstinence and one following smoking as usual. During each scan, participants completed a rewarded guessing task designed to elicit striatal activation in which they could earn smoking and monetary rewards delivered after the scan. Participants then engaged in a 3-week CM-supported quit attempt. As previously reported, 24-h abstinence was associated with increased striatal activation in anticipation of smoking reward and decreased activation in anticipation of monetary reward. Individuals exhibiting greater decrements in right striatal activation to monetary reward during abstinence (controlling for activation during non-abstinence) were more likely to lapse during CM (p < 0.025), even when controlling for other predictors of lapse outcome (e.g., craving); no association was seen for smoking reward. These results are consistent with a growing number of studies indicating the specific importance of disrupted striatal processing of non-drug reward in nicotine dependence and highlight the importance of individual differences in abstinence-induced deficits in striatal function for smoking cessation.

Moderation of the Relationship Between Reward Expectancy and Prediction Error-Related Ventral Striatal Reactivity by Anhedonia in Unmedicated Major Depressive Disorder: Findings From the EMBARC Study.

PubMed

Greenberg, Tsafrir; Chase, Henry W; Almeida, Jorge R; Stiffler, Richelle; Zevallos, Carlos R; Aslam, Haris A; Deckersbach, Thilo; Weyandt, Sarah; Cooper, Crystal; Toups, Marisa; Carmody, Thomas; Kurian, Benji; Peltier, Scott; Adams, Phillip; McInnis, Melvin G; Oquendo, Maria A; McGrath, Patrick J; Fava, Maurizio; Weissman, Myrna; Parsey, Ramin; Trivedi, Madhukar H; Phillips, Mary L

2015-09-01

Anhedonia, disrupted reward processing, is a core symptom of major depressive disorder. Recent findings demonstrate altered reward-related ventral striatal reactivity in depressed individuals, but the extent to which this is specific to anhedonia remains poorly understood. The authors examined the effect of anhedonia on reward expectancy (expected outcome value) and prediction error- (discrepancy between expected and actual outcome) related ventral striatal reactivity, as well as the relationship between these measures. A total of 148 unmedicated individuals with major depressive disorder and 31 healthy comparison individuals recruited for the multisite EMBARC (Establishing Moderators and Biosignatures of Antidepressant Response in Clinical Care) study underwent functional MRI during a well-validated reward task. Region of interest and whole-brain data were examined in the first- (N=78) and second- (N=70) recruited cohorts, as well as the total sample, of depressed individuals, and in healthy individuals. Healthy, but not depressed, individuals showed a significant inverse relationship between reward expectancy and prediction error-related right ventral striatal reactivity. Across all participants, and in depressed individuals only, greater anhedonia severity was associated with a reduced reward expectancy-prediction error inverse relationship, even after controlling for other symptoms. The normal reward expectancy and prediction error-related ventral striatal reactivity inverse relationship concords with conditioning models, predicting a shift in ventral striatal responding from reward outcomes to reward cues. This study shows, for the first time, an absence of this relationship in two cohorts of unmedicated depressed individuals and a moderation of this relationship by anhedonia, suggesting reduced reward-contingency learning with greater anhedonia. These findings help elucidate neural mechanisms of anhedonia, as a step toward identifying potential biosignatures

Pain and suicidality: Insights from reward and addiction neuroscience

PubMed Central

Elman, Igor; Borsook, David; Volkow, Nora D.

2016-01-01

Suicidality is exceedingly prevalent in pain patients. Although the pathophysiology of this link remains unclear, it may be potentially related to the partial congruence of physical and emotional pain systems. The latter system’s role in suicide is also conspicuous during setbacks and losses sustained in the context of social attachments. Here we propose a model based on the neural pathways mediating reward and anti-reward (i.e., allostatic adjustment to recurrent activation of the reward circuitry); both are relevant etiologic factors in pain, suicide and social attachments. A comprehensive literature search on neurobiology of pain and suicidality was performed. The collected articles were critically reviewed and relevant data were extracted and summarized within four key areas: (1) physical and emotional pain, (2) emotional pain and social attachments, (3) pain-and suicide-related alterations of the reward and anti-reward circuits as compared to addiction, which is the premier probe for dysfunction of these circuits and (4) mechanistically informed treatments of co-occurring pain and suicidality. Pain-, stress- and analgesic drugs-induced opponent and proponent states of the mesolimbic dopaminergic pathways may render reward and anti-reward systems vulnerable to sensitization, cross-sensitization and aberrant learning of contents and contexts associated with suicidal acts and behaviors. These findings suggest that pain patients exhibit alterations in the brain circuits mediating reward (depressed function) and anti-reward (sensitized function) that may affect their proclivity for suicide and support pain and suicidality classification among other “reward deficiency syndromes” and a new proposal for “enhanced anti-reward syndromes”. We suggest that interventions aimed at restoring the balance between the reward and anti-reward networks in patients with chronic pain may help decreasing their suicide risk. PMID:23827972

Pain and suicidality: insights from reward and addiction neuroscience.

PubMed

Elman, Igor; Borsook, David; Volkow, Nora D

2013-10-01

Suicidality is exceedingly prevalent in pain patients. Although the pathophysiology of this link remains unclear, it may be potentially related to the partial congruence of physical and emotional pain systems. The latter system's role in suicide is also conspicuous during setbacks and losses sustained in the context of social attachments. Here we propose a model based on the neural pathways mediating reward and anti-reward (i.e., allostatic adjustment to recurrent activation of the reward circuitry); both are relevant etiologic factors in pain, suicide and social attachments. A comprehensive literature search on neurobiology of pain and suicidality was performed. The collected articles were critically reviewed and relevant data were extracted and summarized within four key areas: (1) physical and emotional pain, (2) emotional pain and social attachments, (3) pain- and suicide-related alterations of the reward and anti-reward circuits as compared to addiction, which is the premier probe for dysfunction of these circuits and (4) mechanistically informed treatments of co-occurring pain and suicidality. Pain-, stress- and analgesic drugs-induced opponent and proponent states of the mesolimbic dopaminergic pathways may render reward and anti-reward systems vulnerable to sensitization, cross-sensitization and aberrant learning of contents and contexts associated with suicidal acts and behaviors. These findings suggest that pain patients exhibit alterations in the brain circuits mediating reward (depressed function) and anti-reward (sensitized function) that may affect their proclivity for suicide and support pain and suicidality classification among other "reward deficiency syndromes" and a new proposal for "enhanced anti-reward syndromes". We suggest that interventions aimed at restoring the balance between the reward and anti-reward networks in patients with chronic pain may help decreasing their suicide risk. Published by Elsevier Ltd.

Reward Processing, Neuroeconomics, and Psychopathology.

PubMed

Zald, David H; Treadway, Michael T

2017-05-08

Abnormal reward processing is a prominent transdiagnostic feature of psychopathology. The present review provides a framework for considering the different aspects of reward processing and their assessment, and highlights recent insights from the field of neuroeconomics that may aid in understanding these processes. Although altered reward processing in psychopathology has often been treated as a general hypo- or hyperresponsivity to reward, increasing data indicate that a comprehensive understanding of reward dysfunction requires characterization within more specific reward-processing domains, including subjective valuation, discounting, hedonics, reward anticipation and facilitation, and reinforcement learning. As such, more nuanced models of the nature of these abnormalities are needed. We describe several processing abnormalities capable of producing the types of selective alterations in reward-related behavior observed in different forms of psychopathology, including (mal)adaptive scaling and anchoring, dysfunctional weighting of reward and cost variables, competition between valuation systems, and reward prediction error signaling.

Optogenetic stimulation in a computational model of the basal ganglia biases action selection and reward prediction error.

PubMed

Berthet, Pierre; Lansner, Anders

2014-01-01

Optogenetic stimulation of specific types of medium spiny neurons (MSNs) in the striatum has been shown to bias the selection of mice in a two choices task. This shift is dependent on the localisation and on the intensity of the stimulation but also on the recent reward history. We have implemented a way to simulate this increased activity produced by the optical flash in our computational model of the basal ganglia (BG). This abstract model features the direct and indirect pathways commonly described in biology, and a reward prediction pathway (RP). The framework is similar to Actor-Critic methods and to the ventral/dorsal distinction in the striatum. We thus investigated the impact on the selection caused by an added stimulation in each of the three pathways. We were able to reproduce in our model the bias in action selection observed in mice. Our results also showed that biasing the reward prediction is sufficient to create a modification in the action selection. However, we had to increase the percentage of trials with stimulation relative to that in experiments in order to impact the selection. We found that increasing only the reward prediction had a different effect if the stimulation in RP was action dependent (only for a specific action) or not. We further looked at the evolution of the change in the weights depending on the stage of learning within a block. A bias in RP impacts the plasticity differently depending on that stage but also on the outcome. It remains to experimentally test how the dopaminergic neurons are affected by specific stimulations of neurons in the striatum and to relate data to predictions of our model.

Tryptophan depletion disinhibits punishment but not reward prediction: implications for resilience.

PubMed

Robinson, Oliver J; Cools, Roshan; Sahakian, Barbara J

2012-01-01

We have previously shown that tryptophan depletion enhances punishment but not reward prediction (Cools et al. in Neuropsychopharmacology 33:2291-2299, 2008b). This provided evidence for a valence-specific role of serotonin (which declines under depleted tryptophan) in aversive processing. Recent theoretical (Dayan and Huys in PLoS Comput Biol 4:e4, 2008) and experimental (Crockett et al. in J Neurosci 29:11993-11999, 2009) approaches have, however, further specified this role by showing that serotonin is critical for punishment-induced inhibition. We sought to examine the role of serotonin in punishment-induced inhibition. We also examined the impact of induced mood on this effect to assess whether effects of tryptophan depletion on affective inhibition are moderated by mood. Healthy females consumed a balanced amino acid mixture with (N = 20) or without (N = 21) the serotonin precursor tryptophan. Each subject completed either negative or neutral mood induction. All subjects completed the reward and punishment reversal learning task adopted in the previous study. We demonstrate a punishment prediction impairment in individuals who consumed tryptophan which was absent in individuals who were depleted of tryptophan. This effect was impervious to mood state. Our results suggest that serotonin promotes the inhibition of responses to punishing outcomes. This may lead to reduced punishment prediction accuracy in the presence of tryptophan and may contribute to resilience to affective disorders. Reduction of serotonin via tryptophan depletion then removes this inhibition. As such, we highlight a mechanism by which reduced serotonin can contribute to disorders of impulsivity and compulsivity as well as disorders of emotion.

Efficacy, safety, predictability, aberrations and corneal biomechnical parameters after SMILE and FLEx: Meta-analysis.

PubMed

Ma, Jing; Cao, Nan-Jue; Xia, Li-Kun

2016-01-01

To identify possible differences of efficacy, safety, predictability, higher-order aberrations and corneal biomechnical parameters after small-incision lenticule extraction (SMILE) and femtosecond lenticule extraction (FLEx). A systematic literature retrieval was conducted in Medline, Embase and the Cochrane Library, up to October, 2015. The included studies were subject to a Meta-analysis. Comparison between SMILE and FLEx was measured as pooled odds ratio (OR) or weighted mean differences (WMD). Of 95% confidence intervals (CI) were used to analyze data. A total of seven studies were included. Firstly, there were no differences in uncorrected distance visual acuity (UDVA) 20/20 or better (OR, 1.37; 95% CI, 0.69 to 2.69; P=0.37) and logMAR UDVA (WMD, -0.02; 95% CI, -0.05 to 0.01; P=0.17) after SMILE versus FLEx. We found no differences in corrected distance visual acuity (CDVA) unchanged (OR, 0.98; 95% CI, 0.46 to 2.11; P=0.97) and logMAR CDVA (WMD, -0.00; 95% CI, -0.01 to 0.01; P=0.90) either. Secondly, we found no differences in refraction within ±1.00 D (OR, 0.98; 95% CI, 0.13 to 7.28; P=0.99) and ±0.50 D (OR, 1.62; 95% CI, 0.62 to 4.28; P=0.33) of target postoperatively. Thirdly, for higher-order aberrations, we found no differences in the total higher-order aberrations (WMD, -0.04; 95% CI, -0.09 to 0.01; P=0.14), coma (WMD, -0.04; 95% CI, -0.09 to 0.01; P=0.11), spherical (WMD, 0.01; 95% CI, -0.02 to 0.03; P=0.60) and trefoil (WMD, -0.00; 95% CI, -0.04 to 0.03; P=0.76). Furthermore, for corneal biomechanical parameters, we also found no differences (WMD, 0.08; 95% CI, -0.17 to 0.33; P=0.54) after SMILE versus FLEx. There are no statistically differences in efficacy, safety, predictability, higher-order aberrations and corneal biomechnical parameters postoperative between SMILE and FLEx.

Altered Reward Function in Adolescent Depression: What, When, and How?

PubMed Central

Forbes, Erika E.; Dahl, Ronald E.

2011-01-01

Background Conceptual models and recent evidence indicate that neural response to reward is altered in depression. Taking a developmental approach to investigating reward function in adolescent depression can elucidate the etiology, pathophysiology, and course of depression, a disorder that typically begins during adolescence and has high rates of recurrence. Methods This conceptual review describes the what, when, and how of altered reward function in adolescent depression. With the goal of generating new, testable hypotheses within a developmental affective neuroscience framework, we critically review findings and suggest future directions. Peer-reviewed empirical papers for inclusion in this critical review were obtained by searching PubMed, PsycInfo, and ScienceDirect for the years 1990–2010. Results A pattern of low striatal response and high medial prefrontal response to reward is evident in adolescents and adults with depression. Given the salience of social stimuli for positive affect and depression, reward function might be especially disrupted in response to social rewards. Because of changes in the dopamine system and reward function with aging, altered reward function in depression might be more evident during adolescence than later in life; however, low reward function may also be a stable characteristic of people who experience depression. Mechanisms of altered reward function in depression could include disrupted balance of corticostriatal circuit function, with disruption occurring as aberrant adolescent brain development. Conclusions Future studies should examine responses to social rewards; employ longitudinal and prospective designs; and investigate patterns of functional connectivity in reward circuits. Understanding altered reward function in depression has potential implications for treatment development. A more rigorous approach to investigating anhedonia, threat-reward interactions, and comorbid anxiety will be valuable to future progress

Blunted striatal response to monetary reward anticipation during smoking abstinence predicts lapse during a contingency-managed quit attempt

PubMed Central

Sweitzer, Maggie M.; Geier, Charles F.; Denlinger, Rachel; Forbes, Erika E.; Raiff, Bethany R.; Dallery, Jesse; McClernon, F.J.; Donny, Eric C.

2017-01-01

Rationale Tobacco smoking is associated with dysregulated reward processing within the striatum, characterized by hypersensitivity to smoking rewards and hyposensitivity to non-smoking rewards. This bias toward smoking reward at the expense of alternative rewards is further exacerbated by deprivation from smoking, which may contribute to difficulty maintaining abstinence during a quit attempt. Objective We examined whether abstinence-induced changes in striatal processing of rewards predicted lapse likelihood during a quit attempt supported by contingency management (CM), in which abstinence from smoking was reinforced with money. Methods Thirty-six non-treatment seeking smokers participated in two fMRI sessions, one following 24-hr abstinence and one following smoking as usual. During each scan, participants completed a rewarded guessing task designed to elicit striatal activation in which they could earn smoking and monetary rewards delivered after the scan. Participants then engaged in a 3-week CM-supported quit attempt. Results As previously reported, 24-hr abstinence was associated with increased striatal activation in anticipation of smoking reward and decreased activation in anticipation of monetary reward. Individuals exhibiting greater decrements in right striatal activation to monetary reward during abstinence (controlling for activation during non-abstinence) were more likely to lapse during CM (p<.05), even when controlling for other predictors of lapse outcome (e.g., craving); no association was seen for smoking reward. Conclusions These results are consistent with a growing number of studies indicating the specific importance of disrupted striatal processing of non-drug reward in nicotine dependence, and highlight the importance of individual differences in abstinence-induced deficits in striatal function for smoking cessation. PMID:26660448

Initial uncertainty in Pavlovian reward prediction persistently elevates incentive salience and extends sign-tracking to normally unattractive cues.

PubMed

Robinson, Mike J F; Anselme, Patrick; Fischer, Adam M; Berridge, Kent C

2014-06-01

Uncertainty is a component of many gambling games and may play a role in incentive motivation and cue attraction. Uncertainty can increase the attractiveness for predictors of reward in the Pavlovian procedure of autoshaping, visible as enhanced sign-tracking (or approach and nibbles) by rats of a metal lever whose sudden appearance acts as a conditioned stimulus (CS+) to predict sucrose pellets as an unconditioned stimulus (UCS). Here we examined how reward uncertainty might enhance incentive salience as sign-tracking both in intensity and by broadening the range of attractive CS+s. We also examined whether initially induced uncertainty enhancements of CS+ attraction can endure beyond uncertainty itself, and persist even when Pavlovian prediction becomes 100% certain. Our results show that uncertainty can broaden incentive salience attribution to make CS cues attractive that would otherwise not be (either because they are too distal from reward or too risky to normally attract sign-tracking). In addition, uncertainty enhancement of CS+ incentive salience, once induced by initial exposure, persisted even when Pavlovian CS-UCS correlations later rose toward 100% certainty in prediction. Persistence suggests an enduring incentive motivation enhancement potentially relevant to gambling, which in some ways resembles incentive-sensitization. Higher motivation to uncertain CS+s leads to more potent attraction to these cues when they predict the delivery of uncertain rewards. In humans, those cues might possibly include the sights and sounds associated with gambling, which contribute a major component of the play immersion experienced by problematic gamblers. Copyright © 2014 Elsevier B.V. All rights reserved.

Initial uncertainty in Pavlovian reward prediction persistently elevates incentive salience and extends sign-tracking to normally unattractive cues

PubMed Central

Robinson, Mike J. F.; Anselme, Patrick; Fischer, Adam M.; Berridge, Kent C.

2014-01-01

Uncertainty is a component of many gambling games and may play a role in incentive motivation and cue attraction. Uncertainty can increase the attractiveness for predictors of reward in the Pavlovian procedure of autoshaping, visible as enhanced sign-tracking (or approach and nibbles) by rats of a metal lever whose sudden appearance acts as a conditioned stimulus (CS+) to predict sucrose pellets as an unconditioned stimulus (UCS). Here we examined how reward uncertainty might enhance incentive salience as sign-tracking both in intensity and by broadening the range of attractive CS+s. We also examined whether initially-induced uncertainty enhancements of CS+ attraction can endure beyond uncertainty itself, and persist even when Pavlovian prediction becomes 100% certain. Our results show that uncertainty can broaden incentive salience attribution to make CS cues attractive that would otherwise not be (either because they are too distal from reward or too risky to normally attract sign-tracking). In addition, uncertainty enhancement of CS+ incentive salience, once induced by initial exposure, persisted even when Pavlovian CS-UCS correlations later rose toward 100% certainty in prediction. Persistence suggests an enduring incentive motivation enhancement potentially relevant to gambling, which in some ways resembles incentive-sensitization. Higher motivation to uncertain CS+s leads to more potent attraction to these cues when they predict the delivery of uncertain rewards. In humans, those cues might possibly include the sights and sounds associated with gambling, which contribute a major component of the play immersion experienced by problematic gamblers. PMID:24631397

Moderation of the Relationship Between Reward Expectancy and Prediction Error-Related Ventral Striatal Reactivity by Anhedonia in Unmedicated Major Depressive Disorder: Findings From the EMBARC Study

PubMed Central

Greenberg, Tsafrir; Chase, Henry W.; Almeida, Jorge R.; Stiffler, Richelle; Zevallos, Carlos R.; Aslam, Haris A.; Deckersbach, Thilo; Weyandt, Sarah; Cooper, Crystal; Toups, Marisa; Carmody, Thomas; Kurian, Benji; Peltier, Scott; Adams, Phillip; McInnis, Melvin G.; Oquendo, Maria A.; McGrath, Patrick J.; Fava, Maurizio; Weissman, Myrna; Parsey, Ramin; Trivedi, Madhukar H.; Phillips, Mary L.

2016-01-01

Objective Anhedonia, disrupted reward processing, is a core symptom of major depressive disorder. Recent findings demonstrate altered reward-related ventral striatal reactivity in depressed individuals, but the extent to which this is specific to anhedonia remains poorly understood. The authors examined the effect of anhedonia on reward expectancy (expected outcome value) and prediction error-(discrepancy between expected and actual outcome) related ventral striatal reactivity, as well as the relationship between these measures. Method A total of 148 unmedicated individuals with major depressive disorder and 31 healthy comparison individuals recruited for the multisite EMBARC (Establishing Moderators and Biosignatures of Antidepressant Response in Clinical Care) study underwent functional MRI during a well-validated reward task. Region of interest and whole-brain data were examined in the first- (N=78) and second- (N=70) recruited cohorts, as well as the total sample, of depressed individuals, and in healthy individuals. Results Healthy, but not depressed, individuals showed a significant inverse relationship between reward expectancy and prediction error-related right ventral striatal reactivity. Across all participants, and in depressed individuals only, greater anhedonia severity was associated with a reduced reward expectancy-prediction error inverse relationship, even after controlling for other symptoms. Conclusions The normal reward expectancy and prediction error-related ventral striatal reactivity inverse relationship concords with conditioning models, predicting a shift in ventral striatal responding from reward outcomes to reward cues. This study shows, for the first time, an absence of this relationship in two cohorts of unmedicated depressed individuals and a moderation of this relationship by anhedonia, suggesting reduced reward-contingency learning with greater anhedonia. These findings help elucidate neural mechanisms of anhedonia, as a step toward

Autocorrelation structure at rest predicts value correlates of single neurons during reward-guided choice

PubMed Central

Cavanagh, Sean E; Wallis, Joni D; Kennerley, Steven W; Hunt, Laurence T

2016-01-01

Correlates of value are routinely observed in the prefrontal cortex (PFC) during reward-guided decision making. In previous work (Hunt et al., 2015), we argued that PFC correlates of chosen value are a consequence of varying rates of a dynamical evidence accumulation process. Yet within PFC, there is substantial variability in chosen value correlates across individual neurons. Here we show that this variability is explained by neurons having different temporal receptive fields of integration, indexed by examining neuronal spike rate autocorrelation structure whilst at rest. We find that neurons with protracted resting temporal receptive fields exhibit stronger chosen value correlates during choice. Within orbitofrontal cortex, these neurons also sustain coding of chosen value from choice through the delivery of reward, providing a potential neural mechanism for maintaining predictions and updating stored values during learning. These findings reveal that within PFC, variability in temporal specialisation across neurons predicts involvement in specific decision-making computations. DOI: http://dx.doi.org/10.7554/eLife.18937.001 PMID:27705742

Lower- and higher-order aberrations predicted by an optomechanical model of arcuate keratotomy for astigmatism.

PubMed

Navarro, Rafael; Palos, Fernando; Lanchares, Elena; Calvo, Begoña; Cristóbal, José A

2009-01-01

To develop a realistic model of the optomechanical behavior of the cornea after curved relaxing incisions to simulate the induced astigmatic change and predict the optical aberrations produced by the incisions. ICMA Consejo Superior de Investigaciones Científicas and Universidad de Zaragoza, Zaragoza, Spain. A 3-dimensional finite element model of the anterior hemisphere of the ocular surface was used. The corneal tissue was modeled as a quasi-incompressible, anisotropic hyperelastic constitutive behavior strongly dependent on the physiological collagen fibril distribution. Similar behaviors were assigned to the limbus and sclera. With this model, some corneal incisions were computer simulated after the Lindstrom nomogram. The resulting geometry of the biomechanical simulation was analyzed in the optical zone, and finite ray tracing was performed to compute refractive power and higher-order aberrations (HOAs). The finite-element simulation provided new geometry of the corneal surfaces, from which elevation topographies were obtained. The surgically induced astigmatism (SIA) of the simulated incisions according to the Lindstrom nomogram was computed by finite ray tracing. However, paraxial computations would yield slightly different results (undercorrection of astigmatism). In addition, arcuate incisions would induce significant amounts of HOAs. Finite-element models, together with finite ray-tracing computations, yielded realistic simulations of the biomechanical and optical changes induced by relaxing incisions. The model reproduced the SIA indicated by the Lindstrom nomogram for the simulated incisions and predicted a significant increase in optical aberrations induced by arcuate keratotomy.

Reward Processing, Neuroeconomics, and Psychopathology

PubMed Central

Zald, David H.; Treadway, Michael

2018-01-01

Abnormal reward processing is a prominent transdiagnostic feature of psychopathology. The present review provides a framework for considering the different aspects of reward processing and their assessment and highlight recent insights from the field of neuroeconomics that may aid in understanding these processes. Although altered reward processing in psychopathology has often been treated as a general hypo- or hyper-responsivity to reward, increasing data indicate that a comprehensive understanding of reward dysfunction requires characterization within more specific reward processing domains, including subjective valuation, discounting, hedonics, reward anticipation and facilitation, and reinforcement learning. As such, more nuanced models of the nature of these abnormalities are needed. We describe several processing abnormalities capable of producing the types of selective alterations in reward related behavior observed in different forms of psychopathology, including (mal)adaptive scaling and anchoring, dysfunctional weighting of reward and cost variables, completion between valuation systems, and positive prediction error signaling. PMID:28301764

The Attraction Effect Modulates Reward Prediction Errors and Intertemporal Choices.

PubMed

Gluth, Sebastian; Hotaling, Jared M; Rieskamp, Jörg

2017-01-11

Classical economic theory contends that the utility of a choice option should be independent of other options. This view is challenged by the attraction effect, in which the relative preference between two options is altered by the addition of a third, asymmetrically dominated option. Here, we leveraged the attraction effect in the context of intertemporal choices to test whether both decisions and reward prediction errors (RPE) in the absence of choice violate the independence of irrelevant alternatives principle. We first demonstrate that intertemporal decision making is prone to the attraction effect in humans. In an independent group of participants, we then investigated how this affects the neural and behavioral valuation of outcomes using a novel intertemporal lottery task and fMRI. Participants' behavioral responses (i.e., satisfaction ratings) were modulated systematically by the attraction effect and this modulation was correlated across participants with the respective change of the RPE signal in the nucleus accumbens. Furthermore, we show that, because exponential and hyperbolic discounting models are unable to account for the attraction effect, recently proposed sequential sampling models might be more appropriate to describe intertemporal choices. Our findings demonstrate for the first time that the attraction effect modulates subjective valuation even in the absence of choice. The findings also challenge the prospect of using neuroscientific methods to measure utility in a context-free manner and have important implications for theories of reinforcement learning and delay discounting. Many theories of value-based decision making assume that people first assess the attractiveness of each option independently of each other and then pick the option with the highest subjective value. The attraction effect, however, shows that adding a new option to a choice set can change the relative value of the existing options, which is a violation of the independence

A reward prediction error for charitable donations reveals outcome orientation of donators

PubMed Central

Kuss, Katarina; Falk, Armin; Trautner, Peter; Elger, Christian E.; Weber, Bernd

2013-01-01

The motives underlying prosocial behavior, like charitable donations, can be related either to actions or to outcomes. To address the neural basis of outcome orientation in charitable giving, we asked 33 subjects to make choices affecting their own payoffs and payoffs to a charity organization, while being scanned by functional magnetic resonance imaging (fMRI). We experimentally induced a reward prediction error (RPE) by subsequently discarding some of the chosen outcomes. Co-localized to a nucleus accumbens BOLD signal corresponding to the RPE for the subject's own payoff, we observed an equivalent RPE signal for the charity's payoff in those subjects who were willing to donate. This unique demonstration of a neuronal RPE signal for outcomes exclusively affecting unrelated others indicates common brain processes during outcome evaluation for selfish, individual and nonselfish, social rewards and strongly suggests the effectiveness of outcome-oriented motives in charitable giving. PMID:22198972

Is the encoding of Reward Prediction Error reliable during development?

PubMed

Keren, Hanna; Chen, Gang; Benson, Brenda; Ernst, Monique; Leibenluft, Ellen; Fox, Nathan A; Pine, Daniel S; Stringaris, Argyris

2018-05-16

Reward Prediction Errors (RPEs), defined as the difference between the expected and received outcomes, are integral to reinforcement learning models and play an important role in development and psychopathology. In humans, RPE encoding can be estimated using fMRI recordings, however, a basic measurement property of RPE signals, their test-retest reliability across different time scales, remains an open question. In this paper, we examine the 3-month and 3-year reliability of RPE encoding in youth (mean age at baseline = 10.6 ± 0.3 years), a period of developmental transitions in reward processing. We show that RPE encoding is differentially distributed between the positive values being encoded predominantly in the striatum and negative RPEs primarily encoded in the insula. The encoding of negative RPE values is highly reliable in the right insula, across both the long and the short time intervals. Insula reliability for RPE encoding is the most robust finding, while other regions, such as the striatum, are less consistent. Striatal reliability appeared significant as well once covarying for factors, which were possibly confounding the signal to noise ratio. By contrast, task activation during feedback in the striatum is highly reliable across both time intervals. These results demonstrate the valence-dependent differential encoding of RPE signals between the insula and striatum, and the consistency of RPE signals or lack thereof, during childhood and into adolescence. Characterizing the regions where the RPE signal in BOLD fMRI is a reliable marker is key for estimating reward-processing alterations in longitudinal designs, such as developmental or treatment studies. Copyright © 2018 Elsevier Inc. All rights reserved.

Molecular role of dopamine in anhedonia linked to reward deficiency syndrome (RDS) and anti- reward systems.

PubMed

Gold, Mark S; Blum, Kenneth; Febo, Marcelo; Baron, David; Modestino, Edward Justin; Elman, Igor; Badgaiyan, Rajendra D

2018-03-01

Anhedonia is a condition that leads to the loss of feelings pleasure in response to natural reinforcers like food, sex, exercise, and social activities. This disorder occurs in addiction, and an array of related neuropsychiatric syndromes, including schizophrenia, depression, and Post Traumatic Stress Disorder (PTSD). Anhedonia may by due to derangements in mesolimbic dopaminergic pathways and their terminal fields (e.g., striatum, amygdala, and prefrontal cortex) that persist long after the traces of the causative drugs are eliminated (pharmacokinetically). Here we postulate that anhedonia is not a distinct entity but is rather an epiphenomenon of hypodopaminergic states and traits arising from the interaction of genetic traits and epigenetic neurobiological alterations in response to environmental influences. Moreover, dopaminergic activity is rather complex, and so it may give rise to differential pathophysiological processes such as incentive sensitization, aberrant learning and stress-like "anti-reward" phenomena. These processes may have additive, synergistic or antagonistic interactions with the concurrent reward deficiency states leading in some instances to more severe and long-lasting symptoms. Operant understanding of the neurogenetic antecedents to reward deficiency syndrome (RDS) and the elucidation of reward gene polymorphisms may provide a map for accessing an individual's genetic risk for developing Anhedonia. Prevention techniques that can restore homeostatic balance via physiological activation of dopaminergic receptors (D2/D3) may be instrumental for targeting not only anhedonia per se but also drug craving and relapse.

Spared internal but impaired external reward prediction error signals in major depressive disorder during reinforcement learning.

PubMed

Bakic, Jasmina; Pourtois, Gilles; Jepma, Marieke; Duprat, Romain; De Raedt, Rudi; Baeken, Chris

2017-01-01

Major depressive disorder (MDD) creates debilitating effects on a wide range of cognitive functions, including reinforcement learning (RL). In this study, we sought to assess whether reward processing as such, or alternatively the complex interplay between motivation and reward might potentially account for the abnormal reward-based learning in MDD. A total of 35 treatment resistant MDD patients and 44 age matched healthy controls (HCs) performed a standard probabilistic learning task. RL was titrated using behavioral, computational modeling and event-related brain potentials (ERPs) data. MDD patients showed comparable learning rate compared to HCs. However, they showed decreased lose-shift responses as well as blunted subjective evaluations of the reinforcers used during the task, relative to HCs. Moreover, MDD patients showed normal internal (at the level of error-related negativity, ERN) but abnormal external (at the level of feedback-related negativity, FRN) reward prediction error (RPE) signals during RL, selectively when additional efforts had to be made to establish learning. Collectively, these results lend support to the assumption that MDD does not impair reward processing per se during RL. Instead, it seems to alter the processing of the emotional value of (external) reinforcers during RL, when additional intrinsic motivational processes have to be engaged. © 2016 Wiley Periodicals, Inc.

A Focus on Reward Prediction and the Lateral Habenula: Functional Alterations and the Behavioral Outcomes Induced by Drugs of Abuse.

PubMed

Graziane, Nicholas M; Neumann, Peter A; Dong, Yan

2018-01-01

The lateral habenula (LHb) regulates reward learning and controls the updating of reward-related information. Drugs of abuse have the capacity to hijack the cellular and neurocircuit mechanisms mediating reward learning, forming non-adaptable, compulsive behaviors geared toward obtaining illicit substances. Here, we discuss current findings demonstrating how drugs of abuse alter intrinsic and synaptic LHb neuronal function. Additionally, we discuss evidence for how drug-induced LHb alterations may affect the ability to predict reward, potentially facilitating an addiction-like state. Altogether, we combine ex vivo and in vivo results for an overview of how drugs of abuse alter LHb function and how these functional alterations affect the ability to learn and update behavioral responses to hedonic external stimuli.

Structural connectivity of neural reward networks in youth at risk for substance use disorders.

PubMed

Squeglia, Lindsay M; Sorg, Scott F; Jacobus, Joanna; Brumback, Ty; Taylor, Charles T; Tapert, Susan F

2015-07-01

Having a positive family history of alcohol use disorders (FHP), as well as aberrant reward circuitry, has been implicated in the initiation of substance use during adolescence. This study explored the relationship between FHP status and reward circuitry in substance naïve youth to better understand future risky behaviors. Participants were 49 FHP and 45 demographically matched family history negative (FHN) substance-naïve 12-14 year-olds (54 % female). Subjects underwent structural magnetic resonance imaging, including diffusion tensor imaging. Nucleus accumbens and orbitofrontal cortex volumes were derived using FreeSurfer, and FSL probabilistic tractography probed structural connectivity and differences in white matter diffusivity estimates (e.g. fractional anisotropy, and mean, radial, and axial diffusivity) between fiber tracts connecting these regions. FHP and FHN youth did not differ on nucleus accumbens or orbitofrontal cortex volumes, white matter tract volumes, or percentages of streamlines (a proxy for fiber tract count) connecting these regions. However, within white matter tracts connecting the nucleus accumbens to the orbitofrontal cortex, FHP youth had significantly lower mean and radial diffusivity (ps < 0.03) than FHN youth. While white matter macrostructure between salience and reward regions did not differ between FHP and FHN youth, FHP youth showed greater white matter coherence within these tracts than FHN youth. Aberrant connectivity between reward regions in FHP youth could be linked to an increased risk for substance use initiation.

Inhibiting food reward: delay discounting, food reward sensitivity, and palatable food intake in overweight and obese women

PubMed Central

Appelhans, Bradley M.; Woolf, Kathleen; Pagoto, Sherry L.; Schneider, Kristin L.; Whited, Matthew C.; Liebman, Rebecca

2012-01-01

Overeating is believed to result when the appetitive motivation to consume palatable food exceeds an individual’s capacity for inhibitory control of eating. This hypothesis was supported in recent studies involving predominantly normal weight women, but has not been tested in obese populations. The current study tested the interaction between food reward sensitivity and inhibitory control in predicting palatable food intake among energy-replete overweight and obese women (N=62). Sensitivity to palatable food reward was measured with the Power of Food Scale. Inhibitory control was assessed with a computerized choice task that captures the tendency to discount large delayed rewards relative to smaller immediate rewards. Participants completed an eating in the absence of hunger protocol in which homeostatic energy needs were eliminated with a bland preload of plain oatmeal, followed by a bogus laboratory taste test of palatable and bland snacks. The interaction between food reward sensitivity and inhibitory control was a significant predictor of palatable food intake in regression analyses controlling for body mass index and the amount of preload consumed. Probing this interaction indicated that higher food reward sensitivity predicted greater palatable food intake at low levels of inhibitory control, but was not associated with intake at high levels of inhibitory control. As expected, no associations were found in a similar regression analysis predicting intake of bland foods. Findings support a neurobehavioral model of eating behavior in which sensitivity to palatable food reward drives overeating only when accompanied by insufficient inhibitory control. Strengthening inhibitory control could enhance weight management programs. PMID:21475139

Dopamine neurons learn relative chosen value from probabilistic rewards

PubMed Central

Lak, Armin; Stauffer, William R; Schultz, Wolfram

2016-01-01

Economic theories posit reward probability as one of the factors defining reward value. Individuals learn the value of cues that predict probabilistic rewards from experienced reward frequencies. Building on the notion that responses of dopamine neurons increase with reward probability and expected value, we asked how dopamine neurons in monkeys acquire this value signal that may represent an economic decision variable. We found in a Pavlovian learning task that reward probability-dependent value signals arose from experienced reward frequencies. We then assessed neuronal response acquisition during choices among probabilistic rewards. Here, dopamine responses became sensitive to the value of both chosen and unchosen options. Both experiments showed also the novelty responses of dopamine neurones that decreased as learning advanced. These results show that dopamine neurons acquire predictive value signals from the frequency of experienced rewards. This flexible and fast signal reflects a specific decision variable and could update neuronal decision mechanisms. DOI: http://dx.doi.org/10.7554/eLife.18044.001 PMID:27787196

Reward Modulates Adaptations to Conflict

ERIC Educational Resources Information Center

Braem, Senne; Verguts, Tom; Roggeman, Chantal; Notebaert, Wim

2012-01-01

Both cognitive conflict (e.g. Verguts & Notebaert, 2009) and reward signals (e.g. Waszak & Pholulamdeth, 2009) have been proposed to enhance task-relevant associations. Bringing these two notions together, we predicted that reward modulates conflict-based sequential adaptations in cognitive control. This was tested combining either a single…

Reward skewness coding in the insula independent of probability and loss

PubMed Central

Tobler, Philippe N.

2011-01-01

Rewards in the natural environment are rarely predicted with complete certainty. Uncertainty relating to future rewards has typically been defined as the variance of the potential outcomes. However, the asymmetry of predicted reward distributions, known as skewness, constitutes a distinct but neuroscientifically underexplored risk term that may also have an impact on preference. By changing only reward magnitudes, we study skewness processing in equiprobable ternary lotteries involving only gains and constant probabilities, thus excluding probability distortion or loss aversion as mechanisms for skewness preference formation. We show that individual preferences are sensitive to not only the mean and variance but also to the skewness of predicted reward distributions. Using neuroimaging, we show that the insula, a structure previously implicated in the processing of reward-related uncertainty, responds to the skewness of predicted reward distributions. Some insula responses increased in a monotonic fashion with skewness (irrespective of individual skewness preferences), whereas others were similarly elevated to both negative and positive as opposed to no reward skew. These data support the notion that the asymmetry of reward distributions is processed in the brain and, taken together with replicated findings of mean coding in the striatum and variance coding in the cingulate, suggest that the brain codes distinct aspects of reward distributions in a distributed fashion. PMID:21849610

Hemispheric Asymmetries in Striatal Reward Responses Relate to Approach-Avoidance Learning and Encoding of Positive-Negative Prediction Errors in Dopaminergic Midbrain Regions.

PubMed

Aberg, Kristoffer Carl; Doell, Kimberly C; Schwartz, Sophie

2015-10-28

Some individuals are better at learning about rewarding situations, whereas others are inclined to avoid punishments (i.e., enhanced approach or avoidance learning, respectively). In reinforcement learning, action values are increased when outcomes are better than predicted (positive prediction errors [PEs]) and decreased for worse than predicted outcomes (negative PEs). Because actions with high and low values are approached and avoided, respectively, individual differences in the neural encoding of PEs may influence the balance between approach-avoidance learning. Recent correlational approaches also indicate that biases in approach-avoidance learning involve hemispheric asymmetries in dopamine function. However, the computational and neural mechanisms underpinning such learning biases remain unknown. Here we assessed hemispheric reward asymmetry in striatal activity in 34 human participants who performed a task involving rewards and punishments. We show that the relative difference in reward response between hemispheres relates to individual biases in approach-avoidance learning. Moreover, using a computational modeling approach, we demonstrate that better encoding of positive (vs negative) PEs in dopaminergic midbrain regions is associated with better approach (vs avoidance) learning, specifically in participants with larger reward responses in the left (vs right) ventral striatum. Thus, individual dispositions or traits may be determined by neural processes acting to constrain learning about specific aspects of the world. Copyright © 2015 the authors 0270-6474/15/3514491-10$15.00/0.

Phasic dopamine as a prediction error of intrinsic and extrinsic reinforcements driving both action acquisition and reward maximization: a simulated robotic study.

PubMed

Mirolli, Marco; Santucci, Vieri G; Baldassarre, Gianluca

2013-03-01

An important issue of recent neuroscientific research is to understand the functional role of the phasic release of dopamine in the striatum, and in particular its relation to reinforcement learning. The literature is split between two alternative hypotheses: one considers phasic dopamine as a reward prediction error similar to the computational TD-error, whose function is to guide an animal to maximize future rewards; the other holds that phasic dopamine is a sensory prediction error signal that lets the animal discover and acquire novel actions. In this paper we propose an original hypothesis that integrates these two contrasting positions: according to our view phasic dopamine represents a TD-like reinforcement prediction error learning signal determined by both unexpected changes in the environment (temporary, intrinsic reinforcements) and biological rewards (permanent, extrinsic reinforcements). Accordingly, dopamine plays the functional role of driving both the discovery and acquisition of novel actions and the maximization of future rewards. To validate our hypothesis we perform a series of experiments with a simulated robotic system that has to learn different skills in order to get rewards. We compare different versions of the system in which we vary the composition of the learning signal. The results show that only the system reinforced by both extrinsic and intrinsic reinforcements is able to reach high performance in sufficiently complex conditions. Copyright © 2013 Elsevier Ltd. All rights reserved.

Increased neural processing of rewarding and aversive food stimuli in recovered anorexia nervosa.

PubMed

Cowdrey, Felicity A; Park, Rebecca J; Harmer, Catherine J; McCabe, Ciara

2011-10-15

Recent evidence has shown that individuals with acute anorexia nervosa and those recovered have aberrant physiological responses to rewarding stimuli. We hypothesized that women recovered from anorexia nervosa would show aberrant neural responses to both rewarding and aversive disorder-relevant stimuli. Using functional magnetic resonance imaging (fMRI), the neural response to the sight and flavor of chocolate, and their combination, in 15 women recovered from restricting-type anorexia nervosa and 16 healthy control subjects matched for age and body mass index was investigated. The neural response to a control aversive condition, consisting of the sight of moldy strawberries and a corresponding unpleasant taste, was also measured. Participants simultaneously recorded subjective ratings of "pleasantness," "intensity," and "wanting." Despite no differences between the groups in subjective ratings, individuals recovered from anorexia nervosa showed increased neural response to the pleasant chocolate taste in the ventral striatum and pleasant chocolate sight in the occipital cortex. The recovered participants also showed increased neural response to the aversive strawberry taste in the insula and putamen and to the aversive strawberry sight in the anterior cingulate cortex and caudate. Individuals recovered from anorexia nervosa have increased neural responses to both rewarding and aversive food stimuli. These findings suggest that even after recovery, women with anorexia nervosa have increased salience attribution to food stimuli. These results aid our neurobiological understanding and support the view that the neural response to reward may constitute a neural biomarker for anorexia nervosa. Crown Copyright © 2011. Published by Elsevier Inc. All rights reserved.

Research Review: altered reward function in adolescent depression: what, when and how?

PubMed

Forbes, Erika E; Dahl, Ronald E

2012-01-01

Conceptual models and recent evidence indicate that neural response to reward is altered in depression. Taking a developmental approach to investigating reward function in adolescent depression can elucidate the etiology, pathophysiology and course of depression, a disorder that typically begins during adolescence and has high rates of recurrence. This conceptual review describes the what, when and how of altered reward function in adolescent depression. With the goal of generating new, testable hypotheses within a developmental affective neuroscience framework, we critically review findings and suggest future directions. Peer-reviewed empirical papers for inclusion in this critical review were obtained by searching PubMed, PsycInfo and ScienceDirect for the years 1990-2010. A pattern of low striatal response and high medial prefrontal response to reward is evident in adolescents and adults with depression. Given the salience of social stimuli for positive affect and depression, reward function might be especially disrupted in response to social rewards. Because of changes in the dopamine system and reward function with aging, altered reward function in depression might be more evident during adolescence than later in life; however, low reward function may also be a stable characteristic of people who experience depression. Mechanisms of altered reward function in depression could include disrupted balance of corticostriatal circuit function, with disruption occurring as aberrant adolescent brain development. Future studies should examine responses to social rewards; employ longitudinal and prospective designs; and investigate patterns of functional connectivity in reward circuits. Understanding altered reward function in depression has potential implications for treatment development. A more rigorous approach to investigating anhedonia, threat-reward interactions and comorbid anxiety will be valuable to future progress in describing the role of reward function in

The Nucleus Accumbens and Pavlovian Reward Learning

PubMed Central

Day, Jeremy J.

2011-01-01

The ability to form associations between predictive environmental events and rewarding outcomes is a fundamental aspect of learned behavior. This apparently simple ability likely requires complex neural processing evolved to identify, seek, and utilize natural rewards and redirect these activities based on updated sensory information. Emerging evidence from both animal and human research suggests that this type of processing is mediated in part by the nucleus accumbens and a closely associated network of brain structures. The nucleus accumbens is required for a number of reward-related behaviors, and processes specific information about reward availability, value, and context. Additionally, this structure is critical for the acquisition and expression of most Pavlovian stimulus-reward relationships, and cues that predict rewards produce robust changes in neural activity in the nucleus accumbens. While processing within the nucleus accumbens may enable or promote Pavlovian reward learning in natural situations, it has also been implicated in aspects of human drug addiction, including the ability of drug-paired cues to control behavior. This article will provide a critical review of the existing animal and human literature concerning the role of the NAc in Pavlovian learning with non-drug rewards and consider some clinical implications of these findings. PMID:17404375

Social reward shapes attentional biases.

PubMed

Anderson, Brian A

2016-01-01

Paying attention to stimuli that predict a reward outcome is important for an organism to survive and thrive. When visual stimuli are associated with tangible, extrinsic rewards such as money or food, these stimuli acquire high attentional priority and come to automatically capture attention. In humans and other primates, however, many behaviors are not motivated directly by such extrinsic rewards, but rather by the social feedback that results from performing those behaviors. In the present study, I examine whether positive social feedback can similarly influence attentional bias. The results show that stimuli previously associated with a high probability of positive social feedback elicit value-driven attentional capture, much like stimuli associated with extrinsic rewards. Unlike with extrinsic rewards, however, such stimuli also influence task-specific motivation. My findings offer a potential mechanism by which social reward shapes the information that we prioritize when perceiving the world around us.

Consolidation power of extrinsic rewards: reward cues enhance long-term memory for irrelevant past events.

PubMed

Murayama, Kou; Kitagami, Shinji

2014-02-01

Recent research suggests that extrinsic rewards promote memory consolidation through dopaminergic modulation processes. However, no conclusive behavioral evidence exists given that the influence of extrinsic reward on attention and motivation during encoding and consolidation processes are inherently confounded. The present study provides behavioral evidence that extrinsic rewards (i.e., monetary incentives) enhance human memory consolidation independently of attention and motivation. Participants saw neutral pictures, followed by a reward or control cue in an unrelated context. Our results (and a direct replication study) demonstrated that the reward cue predicted a retrograde enhancement of memory for the preceding neutral pictures. This retrograde effect was observed only after a delay, not immediately upon testing. An additional experiment showed that emotional arousal or unconscious resource mobilization cannot explain the retrograde enhancement effect. These results provide support for the notion that the dopaminergic memory consolidation effect can result from extrinsic reward.

Cerebellar granule cells encode the expectation of reward

PubMed Central

Wagner, Mark J; Kim, Tony Hyun; Savall, Joan; Schnitzer, Mark J; Luo, Liqun

2017-01-01

The human brain contains ~60 billion cerebellar granule cells1, which outnumber all other neurons combined. Classical theories posit that a large, diverse population of granule cells allows for highly detailed representations of sensorimotor context, enabling downstream Purkinje cells to sense fine contextual changes2–6. Although evidence suggests a role for cerebellum in cognition7–10, granule cells are known to encode only sensory11–13 and motor14 context. Using two-photon calcium imaging in behaving mice, here we show that granule cells convey information about the expectation of reward. Mice initiated voluntary forelimb movements for delayed water reward. Some granule cells responded preferentially to reward or reward omission, whereas others selectively encoded reward anticipation. Reward responses were not restricted to forelimb movement, as a Pavlovian task evoked similar responses. Compared to predictable rewards, unexpected rewards elicited markedly different granule cell activity despite identical stimuli and licking responses. In both tasks, reward signals were widespread throughout multiple cerebellar lobules. Tracking the same granule cells over several days of learning revealed that cells with reward-anticipating responses emerged from those that responded at the start of learning to reward delivery, whereas reward omission responses grew stronger as learning progressed. The discovery of predictive, non-sensorimotor encoding in granule cells is a major departure from current understanding of these neurons and dramatically enriches contextual information available to postsynaptic Purkinje cells, with important implications for cognitive processing in the cerebellum. PMID:28321129

Motivated To Win: Relationship between Anticipatory and Outcome Reward-Related Neural Activity

PubMed Central

Nusslock, Robin

2015-01-01

Reward-processing involves two temporal stages characterized by two distinct neural processes: reward-anticipation and reward-outcome. Intriguingly, very little research has examined the relationship between neural processes involved in reward-anticipation and reward-outcome. To investigate this, one needs to consider the heterogeneity of reward-processing within each stage. To identify different stages of reward processing, we adapted a reward time-estimation task. While EEG data were recorded, participants were instructed to button-press 3.5 s after the onset of an Anticipation-Cue and received monetary reward for good time-estimation on the Reward trials, but not on No-Reward trials. We first separated reward-anticipation into event related potentials (ERPs) occurring at three sub-stages: reward/no-reward cue-evaluation, motor-preparation and feedback-anticipation. During reward/no-reward cue-evaluation, the Reward-Anticipation Cue led to a smaller N2 and larger P3. During motor-preparation, we report, for the first time, that the Reward-Anticipation Cue enhanced the Readiness Potential (RP), starting approximately 1 s before movement. At the subsequent feedback-anticipation stage, the Reward-Anticipation Cue elevated the Stimulus-Preceding Negativity (SPN). We also separated reward-outcome ERPs into different components occurring at different time-windows: the Feedback-Related Negativity (FRN), Feedback-P3 (FB-P3) and Late-Positive Potentials (LPP). Lastly, we examined the relationship between reward-anticipation and reward-outcome ERPs. We report that individual-differences in specific reward-anticipation ERPs uniquely predicted specific reward-outcome ERPs. In particular, the reward-anticipation Early-RP (1 to .8 s before movement) predicted early reward-outcome ERPs (FRN and FB-P3), whereas, the reward-anticipation SPN most strongly predicted a later reward-outcome ERP (LPP). Results have important implications for understanding the nature of the

Beyond reward prediction errors: the role of dopamine in movement kinematics

PubMed Central

Barter, Joseph W.; Li, Suellen; Lu, Dongye; Bartholomew, Ryan A.; Rossi, Mark A.; Shoemaker, Charles T.; Salas-Meza, Daniel; Gaidis, Erin; Yin, Henry H.

2015-01-01

We recorded activity of dopamine (DA) neurons in the substantia nigra pars compacta in unrestrained mice while monitoring their movements with video tracking. Our approach allows an unbiased examination of the continuous relationship between single unit activity and behavior. Although DA neurons show characteristic burst firing following cue or reward presentation, as previously reported, their activity can be explained by the representation of actual movement kinematics. Unlike neighboring pars reticulata GABAergic output neurons, which can represent vector components of position, DA neurons represent vector components of velocity or acceleration. We found neurons related to movements in four directions—up, down, left, right. For horizontal movements, there is significant lateralization of neurons: the left nigra contains more rightward neurons, whereas the right nigra contains more leftward neurons. The relationship between DA activity and movement kinematics was found on both appetitive trials using sucrose and aversive trials using air puff, showing that these neurons belong to a velocity control circuit that can be used for any number of purposes, whether to seek reward or to avoid harm. In support of this conclusion, mimicry of the phasic activation of DA neurons with selective optogenetic stimulation could also generate movements. Contrary to the popular hypothesis that DA neurons encode reward prediction errors, our results suggest that nigrostriatal DA plays an essential role in controlling the kinematics of voluntary movements. We hypothesize that DA signaling implements gain adjustment for adaptive transition control, and describe a new model of the basal ganglia (BG) in which DA functions to adjust the gain of the transition controller. This model has significant implications for our understanding of movement disorders implicating DA and the BG. PMID:26074791

Activation of VTA GABA neurons disrupts reward consumption

PubMed Central

van Zessen, Ruud; Phillips, Jana L.; Budygin, Evgeny A.; Stuber, Garret D.

2012-01-01

The activity of Ventral Tegmental Area (VTA) dopamine (DA) neurons promotes behavioral responses to rewards and environmental stimuli that predict them. VTA GABA inputs synapse directly onto DA neurons and may regulate DA neuronal activity to alter reward-related behaviors, however, the functional consequences of selective activation of VTA GABA neurons remains unknown. Here, we show that in vivo optogenetic activation of VTA GABA neurons disrupts reward consummatory behavior, but not conditioned anticipatory behavior in response to reward-predictive cues. In addition, direct activation of VTA GABA projections to the nucleus accumbens (NAc) resulted in detectable GABA release, but did not alter reward consumption. Furthermore, optogenetic stimulation of VTA GABA neurons directly suppressed the activity and excitability of neighboring DA neurons, as well as the release of DA in the NAc, suggesting that the dynamic interplay between VTA DA and GABA neurons can control the initiation and termination of reward-related behaviors. PMID:22445345

The effect of pre- vs. post-reward attainment on EEG asymmetry in melancholic depression.

PubMed

Shankman, Stewart A; Sarapas, Casey; Klein, Daniel N

2011-02-01

Clinical investigators have long theorized about the role of reward processing and positive affect in depression. One theory posits that compared to nonmelancholic depressives, melancholic depressives experience less consummatory (i.e., post-reward), but comparably low anticipatory (prior to reward), positive affect. We tested whether frontal EEG asymmetry, a putative marker of the anticipatory reward system, is present only before an individual receives a reward or also after receiving a reward (i.e., during consummatory reward processing). We also examined whether melancholic depression, a condition characterized by a deficit in consummatory reward processing, is associated with abnormal EEG asymmetries in alpha band power. Effects in other frequency bands (delta, theta, or beta) were also explored. EEG was recorded in 34 controls, 48 nonmelancholic depressives, and 17 melancholic depressives during a slot machine task designed to elicit anticipatory and consummatory reward processing. Results indicated that, for alpha, the frontal EEG asymmetry of greater relative left activity was specific to anticipatory reward processing. During the consummatory phase, individuals with melancholic depression exhibited different posterior EEG asymmetries than individuals with nonmelancholic depression (and controls at a trend level). This second finding was largely due to melancholics exhibiting relatively lower right posterior activity and nonmelancholics exhibiting relatively lower left activity. These results suggest that a posterior asymmetry may be a marker for melancholic depression and aberrant consummatory reward processing. Copyright © 2010 Elsevier B.V. All rights reserved.

General functioning predicts reward and punishment learning in schizophrenia.

PubMed

Somlai, Zsuzsanna; Moustafa, Ahmed A; Kéri, Szabolcs; Myers, Catherine E; Gluck, Mark A

2011-04-01

Previous studies investigating feedback-driven reinforcement learning in patients with schizophrenia have provided mixed results. In this study, we explored the clinical predictors of reward and punishment learning using a probabilistic classification learning task. Patients with schizophrenia (n=40) performed similarly to healthy controls (n=30) on the classification learning task. However, more severe negative and general symptoms were associated with lower reward-learning performance, whereas poorer general psychosocial functioning was correlated with both lower reward- and punishment-learning performances. Multiple linear regression analyses indicated that general psychosocial functioning was the only significant predictor of reinforcement learning performance when education, antipsychotic dose, and positive, negative and general symptoms were included in the analysis. These results suggest a close relationship between reinforcement learning and general psychosocial functioning in schizophrenia. Published by Elsevier B.V.

A neurocomputational account of reward and novelty processing and effects of psychostimulants in attention deficit hyperactivity disorder.

PubMed

Sethi, Arjun; Voon, Valerie; Critchley, Hugo D; Cercignani, Mara; Harrison, Neil A

2018-05-01

Computational models of reinforcement learning have helped dissect discrete components of reward-related function and characterize neurocognitive deficits in psychiatric illnesses. Stimulus novelty biases decision-making, even when unrelated to choice outcome, acting as if possessing intrinsic reward value to guide decisions toward uncertain options. Heightened novelty seeking is characteristic of attention deficit hyperactivity disorder, yet how this influences reward-related decision-making is computationally encoded, or is altered by stimulant medication, is currently uncertain. Here we used an established reinforcement-learning task to model effects of novelty on reward-related behaviour during functional MRI in 30 adults with attention deficit hyperactivity disorder and 30 age-, sex- and IQ-matched control subjects. Each participant was tested on two separate occasions, once ON and once OFF stimulant medication. OFF medication, patients with attention deficit hyperactivity disorder showed significantly impaired task performance (P = 0.027), and greater selection of novel options (P = 0.004). Moreover, persistence in selecting novel options predicted impaired task performance (P = 0.025). These behavioural deficits were accompanied by a significantly lower learning rate (P = 0.011) and heightened novelty signalling within the substantia nigra/ventral tegmental area (family-wise error corrected P < 0.05). Compared to effects in controls, stimulant medication improved attention deficit hyperactivity disorder participants' overall task performance (P = 0.011), increased reward-learning rates (P = 0.046) and enhanced their ability to differentiate optimal from non-optimal novel choices (P = 0.032). It also reduced substantia nigra/ventral tegmental area responses to novelty. Preliminary cross-sectional evidence additionally suggested an association between long-term stimulant treatment and a reduction in the rewarding value of novelty. These data suggest that

Individual differences in regulatory focus predict neural response to reward.

PubMed

Scult, Matthew A; Knodt, Annchen R; Hanson, Jamie L; Ryoo, Minyoung; Adcock, R Alison; Hariri, Ahmad R; Strauman, Timothy J

2017-08-01

Although goal pursuit is related to both functioning of the brain's reward circuits and psychological factors, the literatures surrounding these concepts have often been separate. Here, we use the psychological construct of regulatory focus to investigate individual differences in neural response to reward. Regulatory focus theory proposes two motivational orientations for personal goal pursuit: (1) promotion, associated with sensitivity to potential gain, and (2) prevention, associated with sensitivity to potential loss. The monetary incentive delay task was used to manipulate reward circuit function, along with instructional framing corresponding to promotion and prevention in a within-subject design. We observed that the more promotion oriented an individual was, the lower their ventral striatum response to gain cues. Follow-up analyses revealed that greater promotion orientation was associated with decreased ventral striatum response even to no-value cues, suggesting that promotion orientation may be associated with relatively hypoactive reward system function. The findings are also likely to represent an interaction between the cognitive and motivational characteristics of the promotion system with the task demands. Prevention orientation did not correlate with ventral striatum response to gain cues, supporting the discriminant validity of regulatory focus theory. The results highlight a dynamic association between individual differences in self-regulation and reward system function.

Response of neural reward regions to food cues in autism spectrum disorders

PubMed Central

2012-01-01

Background One hypothesis for the social deficits that characterize autism spectrum disorders (ASD) is diminished neural reward response to social interaction and attachment. Prior research using established monetary reward paradigms as a test of non-social reward to compare with social reward may involve confounds in the ability of individuals with ASD to utilize symbolic representation of money and the abstraction required to interpret monetary gains. Thus, a useful addition to our understanding of neural reward circuitry in ASD includes a characterization of the neural response to primary rewards. Method We asked 17 children with ASD and 18 children without ASD to abstain from eating for at least four hours before an MRI scan in which they viewed images of high-calorie foods. We assessed the neural reward network for increases in the blood oxygenation level dependent (BOLD) signal in response to the food images Results We found very similar patterns of increased BOLD signal to these images in the two groups; both groups showed increased BOLD signal in the bilateral amygdala, as well as in the nucleus accumbens, orbitofrontal cortex, and insula. Direct group comparisons revealed that the ASD group showed a stronger response to food cues in bilateral insula along the anterior-posterior gradient and in the anterior cingulate cortex than the control group, whereas there were no neural reward regions that showed higher activation for controls than for ASD. Conclusion These results suggest that neural response to primary rewards is not diminished but in fact shows an aberrant enhancement in children with ASD. PMID:22958533

Reward modulation of cognitive function in adult attention-deficit/hyperactivity disorder: a pilot study on the role of striatal dopamine.

PubMed

Aarts, Esther; van Holstein, Mieke; Hoogman, Martine; Onnink, Marten; Kan, Cornelis; Franke, Barbara; Buitelaar, Jan; Cools, Roshan

2015-02-01

Attention-deficit/hyperactivity disorder (ADHD) is accompanied by impairments in cognitive control, such as task-switching deficits. We investigated whether such problems, and their remediation by medication, reflect abnormal reward motivation and associated striatal dopamine transmission in ADHD. We used functional genetic neuroimaging to assess the effects of dopaminergic medication and reward motivation on task-switching and striatal BOLD signal in 23 adults with ADHD, ON and OFF methylphenidate, and 26 healthy controls. Critically, we took into account interindividual variability in striatal dopamine by exploiting a common genetic polymorphism (3'-UTR VNTR) in the DAT1 gene coding for the dopamine transporter. The results showed a highly significant group by genotype interaction in the striatum. This was because a subgroup of patients with ADHD showed markedly exaggerated effects of reward on the striatal BOLD signal during task-switching when they were OFF their dopaminergic medication. Specifically, patients carrying the 9R allele showed a greater striatal signal than healthy controls carrying this allele, whereas no effect of diagnosis was observed in 10R homozygotes. Aberrant striatal responses were normalized when 9R-carrying patients with ADHD were ON medication. These pilot data indicate an important role for aberrant reward motivation, striatal dopamine and interindividual genetic differences in cognitive processes in adult ADHD.

Reward modulation of cognitive function in adult attention-deficit/hyperactivity disorder: a pilot study on the role of striatal dopamine

PubMed Central

Aarts, Esther; Hoogman, Martine; Onnink, Marten; Kan, Cornelis; Franke, Barbara; Buitelaar, Jan; Cools, Roshan

2015-01-01

Attention-deficit/hyperactivity disorder (ADHD) is accompanied by impairments in cognitive control, such as task-switching deficits. We investigated whether such problems, and their remediation by medication, reflect abnormal reward motivation and associated striatal dopamine transmission in ADHD. We used functional genetic neuroimaging to assess the effects of dopaminergic medication and reward motivation on task-switching and striatal BOLD signal in 23 adults with ADHD, ON and OFF methylphenidate, and 26 healthy controls. Critically, we took into account interindividual variability in striatal dopamine by exploiting a common genetic polymorphism (3′-UTR VNTR) in the DAT1 gene coding for the dopamine transporter. The results showed a highly significant group by genotype interaction in the striatum. This was because a subgroup of patients with ADHD showed markedly exaggerated effects of reward on the striatal BOLD signal during task-switching when they were OFF their dopaminergic medication. Specifically, patients carrying the 9R allele showed a greater striatal signal than healthy controls carrying this allele, whereas no effect of diagnosis was observed in 10R homozygotes. Aberrant striatal responses were normalized when 9R-carrying patients with ADHD were ON medication. These pilot data indicate an important role for aberrant reward motivation, striatal dopamine and interindividual genetic differences in cognitive processes in adult ADHD. PMID:25485641

Putting reward in art: A tentative prediction error account of visual art

PubMed Central

Van de Cruys, Sander; Wagemans, Johan

2011-01-01

The predictive coding model is increasingly and fruitfully used to explain a wide range of findings in perception. Here we discuss the potential of this model in explaining the mechanisms underlying aesthetic experiences. Traditionally art appreciation has been associated with concepts such as harmony, perceptual fluency, and the so-called good Gestalt. We observe that more often than not great artworks blatantly violate these characteristics. Using the concept of prediction error from the predictive coding approach, we attempt to resolve this contradiction. We argue that artists often destroy predictions that they have first carefully built up in their viewers, and thus highlight the importance of negative affect in aesthetic experience. However, the viewer often succeeds in recovering the predictable pattern, sometimes on a different level. The ensuing rewarding effect is derived from this transition from a state of uncertainty to a state of increased predictability. We illustrate our account with several example paintings and with a discussion of art movements and individual differences in preference. On a more fundamental level, our theorizing leads us to consider the affective implications of prediction confirmation and violation. We compare our proposal to other influential theories on aesthetics and explore its advantages and limitations. PMID:23145260

THC reduces the anticipatory nucleus accumbens response to reward in subjects with a nicotine addiction

PubMed Central

Jansma, J M; van Hell, H H; Vanderschuren, L J M J; Bossong, M G; Jager, G; Kahn, R S; Ramsey, N F

2013-01-01

Recent evidence has implicated the endocannabinoid (eCB) system in nicotine addiction. The eCB system also has an important role in reward mechanisms, and nicotine addiction has been associated with aberrant reward processing. Motivated by this evidence, we tested the hypothesis that eCB modulation of reward processing is altered in subjects with a nicotine addiction (NAD). For this purpose, we compared reward-related activity in NAD with healthy controls (HC) in a pharmacological magnetic resonance imaging (MRI) study using Δ9-tetrahydrocannabinol (THC) administration to challenge the eCB system. Eleven HC and 10 NAD participated in a 3-T functional MRI (fMRI) study with a double-blind, cross-over, placebo-controlled design, using a Monetary Incentive Delay (MID) paradigm with three reward levels. Reward activity in the nucleus accumbens (NAcc) and caudate putamen during anticipation and feedback of reward was compared after THC and placebo. fMRI results indicated a significant reduction of reward anticipation activity in the NAcc in NAD after THC administration, which was not present in HC. This is indicated by a significant group by drug by reward interaction. Our data show that THC significantly reduces the NAcc response to monetary reward anticipation in NAD. These results suggest that nicotine addiction is associated with altered eCB modulation of reward processing in the NAcc. This study adds important human data to existing evidence implicating the eCB system in nicotine addiction. PMID:23443360

Aberrant approach-avoidance conflict resolution following repeated cocaine pre-exposure.

PubMed

Nguyen, David; Schumacher, Anett; Erb, Suzanne; Ito, Rutsuko

2015-10-01

Addiction is characterized by persistence to seek drug reinforcement despite negative consequences. Drug-induced aberrations in approach and avoidance processing likely facilitate the sustenance of addiction pathology. Currently, the effects of repeated drug exposure on the resolution of conflicting approach and avoidance motivational signals have yet to be thoroughly investigated. The present study sought to investigate the effects of cocaine pre-exposure on conflict resolution using novel approach-avoidance paradigms. We used a novel mixed-valence conditioning paradigm to condition cocaine-pre-exposed rats to associate visuo-tactile cues with either the delivery of sucrose reward or shock punishment in the arms in which the cues were presented. Following training, exploration of an arm containing a superimposition of the cues was assessed as a measure of conflict resolution behavior. We also used a mixed-valence runway paradigm wherein cocaine-pre-exposed rats traversed an alleyway toward a goal compartment to receive a pairing of sucrose reward and shock punishment. Latency to enter the goal compartment across trials was taken as a measure of motivational conflict. Our results reveal that cocaine pre-exposure attenuated learning for the aversive cue association in our conditioning paradigm and enhanced preference for mixed-valence stimuli in both paradigms. Repeated cocaine pre-exposure allows appetitive approach motivations to gain greater influence over behavioral output in the context of motivational conflict, due to aberrant positive and negative incentive motivational processing.

Striatal dopaminergic modulation of reinforcement learning predicts reward-oriented behavior in daily life.

PubMed

Kasanova, Zuzana; Ceccarini, Jenny; Frank, Michael J; Amelsvoort, Thérèse van; Booij, Jan; Heinzel, Alexander; Mottaghy, Felix; Myin-Germeys, Inez

2017-07-01

Much human behavior is driven by rewards. Preclinical neurophysiological and clinical positron emission tomography (PET) studies have implicated striatal phasic dopamine (DA) release as a primary modulator of reward processing. However, the relationship between experimental reward-induced striatal DA release and responsiveness to naturalistic rewards, and therefore functional relevance of these findings, has been elusive. We therefore combined, for the first time, a DA D 2/3 receptor [ 18 F]fallypride PET during a probabilistic reinforcement learning (RL) task with a six day ecological momentary assessments (EMA) of reward-related behavior in the everyday life of 16 healthy volunteers. We detected significant reward-induced DA release in the bilateral putamen, caudate nucleus and ventral striatum, the extent of which was associated with better behavioral performance on the RL task across all regions. Furthermore, individual variability in the extent of reward-induced DA release in the right caudate nucleus and ventral striatum modulated the tendency to be actively engaged in a behavior if the active engagement was previously deemed enjoyable. This study suggests a link between striatal reward-related DA release and ecologically relevant reward-oriented behavior, suggesting an avenue for the inquiry into the DAergic basis of optimal and impaired motivational drive. Copyright © 2017 Elsevier B.V. All rights reserved.

Social and monetary reward learning engage overlapping neural substrates.

PubMed

Lin, Alice; Adolphs, Ralph; Rangel, Antonio

2012-03-01

Learning to make choices that yield rewarding outcomes requires the computation of three distinct signals: stimulus values that are used to guide choices at the time of decision making, experienced utility signals that are used to evaluate the outcomes of those decisions and prediction errors that are used to update the values assigned to stimuli during reward learning. Here we investigated whether monetary and social rewards involve overlapping neural substrates during these computations. Subjects engaged in two probabilistic reward learning tasks that were identical except that rewards were either social (pictures of smiling or angry people) or monetary (gaining or losing money). We found substantial overlap between the two types of rewards for all components of the learning process: a common area of ventromedial prefrontal cortex (vmPFC) correlated with stimulus value at the time of choice and another common area of vmPFC correlated with reward magnitude and common areas in the striatum correlated with prediction errors. Taken together, the findings support the hypothesis that shared anatomical substrates are involved in the computation of both monetary and social rewards. © The Author (2011). Published by Oxford University Press.

Effects of reward and punishment on learning from errors in smokers.

PubMed

Duehlmeyer, Leonie; Levis, Bianca; Hester, Robert

2018-04-30

Punishing errors facilitates adaptation in healthy individuals, while aberrant reward and punishment sensitivity in drug-dependent individuals may change this impact. Many societies have institutions that use the concept of punishing drug use behavior, making it important to understand how drug dependency mediates the effects of negative feedback for influencing adaptive behavior. Using an associative learning task, we investigated differences in error correction rates of dependent smokers, compared with controls. Two versions of the task were administered to different participant samples: One assessed the effect of varying monetary contingencies to task performance, the other, the presence of reward as compared to avoidance of punishment for correct performance. While smokers recalled associations that were rewarded with a higher value 11% more often than lower rewarded locations, they did not correct higher punished locations more often. Controls exhibited the opposite pattern. The three-way interaction between magnitude, feedback type and group was significant, F(1,48) = 5.288, p =0.026, ɳ 2 p =0.099. Neither participant group corrected locations offering reward more often than those offering avoidances of punishment. The interaction between group and feedback condition was not significant, F(1,58) = 0.0, p =0.99, ɳ 2 p =0.001. The present results suggest that smokers have poorer learning from errors when receiving negative feedback. Moreover, larger rewards reinforce smokers' behavior stronger than smaller rewards, whereas controls made no distinction. These findings support the hypothesis that dependent smokers may respond to positively framed and rewarded anti-smoking programs when compared to those relying on negative feedback or punishment. Copyright © 2018 Elsevier B.V. All rights reserved.

Neural correlates of reward processing in healthy siblings of patients with schizophrenia

PubMed Central

Hanssen, Esther; van der Velde, Jorien; Gromann, Paula M.; Shergill, Sukhi S.; de Haan, Lieuwe; Bruggeman, Richard; Krabbendam, Lydia; Aleman, André; van Atteveldt, Nienke

2015-01-01

Deficits in motivational behavior and psychotic symptoms often observed in schizophrenia (SZ) may be driven by dysfunctional reward processing (RP). RP can be divided in two different stages; reward anticipation and reward consumption. Aberrant processing during reward anticipation seems to be related to SZ. Studies in patients with SZ have found less activation in the ventral striatum (VS) during anticipation of reward, but these findings do not provide information on effect of the genetic load on reward processing. Therefore, this study investigated RP in healthy first-degree relatives of SZ patients. The sample consisted of 94 healthy siblings of SZ patients and 57 healthy controls. Participants completed a classic RP task, the Monetary Incentive Delay task, during functional magnetic resonance imaging (fMRI). As expected, there were no behavioral differences between groups. In contrast to our expectations, we found no differences in any of the anticipatory reward related brain areas (region of interest analyses). Whole-brain analyses did reveal group differences during both reward anticipation and reward consumption; during reward anticipation siblings showed less deactivation in the insula, posterior cingulate cortex (PCC) and medial frontal gyrus (MFG) than controls. During reward consumption siblings showed less deactivation in the PCC and the right MFG compared to controls and activation in contrast to deactivation in controls in the precuneus and the left MFG. Exclusively in siblings, MFG activity correlated positively with subclinical negative symptoms. These regions are typically associated with the default mode network (DMN), which normally shows decreases in activation during task-related cognitive processes. Thus, in contrast to prior literature in patients with SZ, the results do not point to altered brain activity in classical RP brain areas, such as the VS. However, the weaker deactivation found outside the reward-related network in siblings could

The role of aberrant salience and self-concept clarity in psychotic-like experiences.

PubMed

Cicero, David C; Becker, Theresa M; Martin, Elizabeth A; Docherty, Anna R; Kerns, John G

2013-01-01

Most theories of psychotic-like experiences posit the involvement of cognitive mechanisms. The current research examined the relations between psychotic-like experiences and two cognitive mechanisms, high aberrant salience and low self-concept clarity. In particular, we examined whether aberrant salience, or the incorrect assignment of importance to neutral stimuli, and low self-concept clarity interacted to predict psychotic-like experiences. The current research included three large samples (n = 667, 724, 744) of participants and oversampled for increased schizotypal personality traits. In all three studies, an interaction between aberrant salience and self-concept clarity was found such that participants with high aberrant salience and low self-concept clarity had the highest levels of psychotic-like experiences. In addition, aberrant salience and self-concept clarity interacted to predict a supplemental measure of delusions in Study 2. In Study 3, in contrast to low self-concept clarity, neuroticism did not interact with aberrant salience to predict psychotic-like experiences, suggesting that the relation between low self-concept clarity and psychosis may not be a result of neuroticism. Additionally, aberrant salience and self-concept clarity did not interact to predict two other SPD criteria, social anhedonia or trait paranoia, which suggests the interaction is specific to psychotic-like experiences. Overall, our results are consistent with several cognitive models of psychosis suggesting that aberrant salience and self-concept clarity might be important mechanisms in the occurrence of psychotic-like symptoms.

The Role of Aberrant Salience and Self-Concept Clarity in Psychotic-Like Experiences

PubMed Central

Cicero, David C.; Becker, Theresa M.; Martin, Elizabeth A.; Docherty, Anna R.; Kerns, John G.

2013-01-01

Most theories of psychotic-like experiences posit the involvement of social-cognitive mechanisms. The current research examined the relations between psychotic-like experiences and two social-cognitive mechanisms, high aberrant salience and low self-concept clarity. In particular, we examined whether aberrant salience, or the incorrect assignment of importance to neutral stimuli, and low self-concept clarity interacted to predict psychotic-like experiences. The current research included three large samples (n = 667, 724, 744) of participants and over-sampled for increased schizotypal personality traits. In all three studies, an interaction between aberrant salience and self-concept clarity was found such that participants with high aberrant salience and low self-concept clarity had the highest levels of psychotic-like experiences. In addition, aberrant salience and self-concept clarity interacted to predict a supplemental measure of delusions in Study 2. In Study 3, in contrast to low self-concept clarity, neuroticism did not interact with aberrant salience to predict psychotic-like experiences, suggesting that the relation between low self-concept clarity and psychosis may not be due to neuroticism. Additionally, aberrant salience and self-concept clarity did not interact to predict to other schizotypal personality disorder criteria, social anhedonia or trait paranoia, which suggests the interaction is specific to psychotic-like experiences. Overall, our results are consistent with several social-cognitive models of psychosis suggesting that aberrant salience and self-concept clarity might be important mechanisms in the occurrence of psychotic-like symptoms. PMID:22452775

Decision-making, sensitivity to reward, and attrition in weight-management

PubMed Central

Koritzky, Gilly; Dieterle, Camille; Rice, Chantelle; Jordan, Katie; Bechara, Antoine

2014-01-01

Objective Attrition is a common problem in weight-management. Understanding the risk factors for attrition should enhance professionals’ ability to increase completion rates and improve health outcomes for more individuals. We propose a model that draws upon neuropsychological knowledge on reward-sensitivity in obesity and overeating to predict attrition. Design & Methods 52 participants in a weight-management program completed a complex decision-making task.Decision-making characteristics – including sensitivity to reward – were further estimated using a quantitative model. Impulsivity and risk-taking measures were also administered. Results Consistent with the hypothesis that sensitivity to reward predicted attrition, program dropouts had higher sensitivity to reward than completers (p < 0.03). No differences were observed between completers and dropouts in initial BMI, age, employment status, or the number of prior weight-loss attempts (p ≥ 0.07). Completers had a slightly higher education level than dropouts, but its inclusion in the model did not increase predictive power. Impulsivity, delay of gratification, and risk-taking did not predict attrition, either. Conclusions Findings link attrition in weight-management to the neural mechanisms associated with reward-seeking and related influences on decision-making. Individual differences in the magnitude of response elicited by rewards may account for the relative difficulty experienced by dieters in adhering to treatment. PMID:24771588

Cognitive Inflexibility in Gamblers is Primarily Present in Reward-Related Decision Making

PubMed Central

Boog, Michiel; Höppener, Paul; v. d. Wetering, Ben J. M.; Goudriaan, Anna E.; Boog, Matthijs C.; Franken, Ingmar H. A.

2014-01-01

One hallmark of gambling disorder (GD) is the observation that gamblers have problems stopping their gambling behavior once it is initiated. On a neuropsychological level, it has been hypothesized that this is the result of a cognitive inflexibility. The present study investigated cognitive inflexibility in patients with GD using a task involving cognitive inflexibility with a reward element (i.e., reversal learning) and a task measuring general cognitive inflexibility without such a component (i.e., response perseveration). For this purpose, scores of a reward-based reversal learning task (probabilistic reversal learning task) and the Wisconsin card sorting task were compared between a group of treatment seeking patients with GD and a gender and age matched control group. The results show that pathological gamblers have impaired performance on the neurocognitive task measuring reward-based cognitive inflexibility. However, no difference between the groups is observed regarding non-reward-based cognitive inflexibility. This suggests that cognitive inflexibility in GD is the result of an aberrant reward-based learning, and not based on a more general problem with cognitive flexibility. The pattern of observed problems is suggestive of a dysfunction of the orbitofrontal cortex, the ventrolateral prefrontal cortex, and the ventral regions of the striatum in gamblers. Relevance for the neurocognition of problematic gambling is discussed. PMID:25165438

Distinct Reward Properties are Encoded via Corticostriatal Interactions

PubMed Central

Smith, David V.; Rigney, Anastasia E.; Delgado, Mauricio R.

2016-01-01

The striatum serves as a critical brain region for reward processing. Yet, understanding the link between striatum and reward presents a challenge because rewards are composed of multiple properties. Notably, affective properties modulate emotion while informative properties help obtain future rewards. We approached this problem by emphasizing affective and informative reward properties within two independent guessing games. We found that both reward properties evoked activation within the nucleus accumbens, a subregion of the striatum. Striatal responses to informative, but not affective, reward properties predicted subsequent utilization of information for obtaining monetary reward. We hypothesized that activation of the striatum may be necessary but not sufficient to encode distinct reward properties. To investigate this possibility, we examined whether affective and informative reward properties were differentially encoded in corticostriatal interactions. Strikingly, we found that the striatum exhibited dissociable connectivity patterns with the ventrolateral prefrontal cortex, with increasing connectivity for affective reward properties and decreasing connectivity for informative reward properties. Our results demonstrate that affective and informative reward properties are encoded via corticostriatal interactions. These findings highlight how corticostriatal systems contribute to reward processing, potentially advancing models linking striatal activation to behavior. PMID:26831208

Distinct Reward Properties are Encoded via Corticostriatal Interactions.

PubMed

Smith, David V; Rigney, Anastasia E; Delgado, Mauricio R

2016-02-02

The striatum serves as a critical brain region for reward processing. Yet, understanding the link between striatum and reward presents a challenge because rewards are composed of multiple properties. Notably, affective properties modulate emotion while informative properties help obtain future rewards. We approached this problem by emphasizing affective and informative reward properties within two independent guessing games. We found that both reward properties evoked activation within the nucleus accumbens, a subregion of the striatum. Striatal responses to informative, but not affective, reward properties predicted subsequent utilization of information for obtaining monetary reward. We hypothesized that activation of the striatum may be necessary but not sufficient to encode distinct reward properties. To investigate this possibility, we examined whether affective and informative reward properties were differentially encoded in corticostriatal interactions. Strikingly, we found that the striatum exhibited dissociable connectivity patterns with the ventrolateral prefrontal cortex, with increasing connectivity for affective reward properties and decreasing connectivity for informative reward properties. Our results demonstrate that affective and informative reward properties are encoded via corticostriatal interactions. These findings highlight how corticostriatal systems contribute to reward processing, potentially advancing models linking striatal activation to behavior.

Does general motivation energize financial reward-seeking behavior? Evidence from an effort task.

PubMed

Chumbley, Justin; Fehr, Ernst

2014-01-01

We aimed to predict how hard subjects work for financial rewards from their general trait and state reward-motivation. We specifically asked 1) whether individuals high in general trait "reward responsiveness" work harder 2) whether task-irrelevant cues can make people work harder, by increasing general motivation. Each trial of our task contained a 1 second earning interval in which male subjects earned money for each button press. This was preceded by one of three predictive cues: an erotic picture of a woman, a man, or a geometric figure. We found that individuals high in trait "reward responsiveness" worked harder and earned more, irrespective of the predictive cue. Because female predictive cues are more rewarding, we expected them to increase general motivation in our male subjects and invigorate work, but found a more complex pattern.

"Liking" and "wanting" linked to Reward Deficiency Syndrome (RDS): hypothesizing differential responsivity in brain reward circuitry.

PubMed

Blum, Kenneth; Gardner, Eliot; Oscar-Berman, Marlene; Gold, Mark

2012-01-01

In an attempt to resolve controversy regarding the causal contributions of mesolimbic dopamine (DA) systems to reward, we evaluate the three main competing explanatory categories: "liking,"learning," and "wanting" [1]. That is, DA may mediate (a) the hedonic impact of reward (liking), (b) learned predictions about rewarding effects (learning), or (c) the pursuit of rewards by attributing incentive salience to reward-related stimuli (wanting). We evaluate these hypotheses, especially as they relate to the Reward Deficiency Syndrome (RDS), and we find that the incentive salience or "wanting" hypothesis of DA function is supported by a majority of the evidence. Neuroimaging studies have shown that drugs of abuse, palatable foods, and anticipated behaviors such as sex and gaming affect brain regions involving reward circuitry, and may not be unidirectional. Drugs of abuse enhance DA signaling and sensitize mesolimbic mechanisms that evolved to attribute incentive salience to rewards. Addictive drugs have in common that they are voluntarily selfadministered, they enhance (directly or indirectly) dopaminergic synaptic function in the nucleus accumbens (NAC), and they stimulate the functioning of brain reward circuitry (producing the "high" that drug users seek). Although originally believed simply to encode the set point of hedonic tone, these circuits now are believed to be functionally more complex, also encoding attention, reward expectancy, disconfirmation of reward expectancy, and incentive motivation. Elevated stress levels, together with polymorphisms of dopaminergic genes and other neurotransmitter genetic variants, may have a cumulative effect on vulnerability to addiction. The RDS model of etiology holds very well for a variety of chemical and behavioral addictions.

Neuronal Reward and Decision Signals: From Theories to Data

PubMed Central

Schultz, Wolfram

2015-01-01

Rewards are crucial objects that induce learning, approach behavior, choices, and emotions. Whereas emotions are difficult to investigate in animals, the learning function is mediated by neuronal reward prediction error signals which implement basic constructs of reinforcement learning theory. These signals are found in dopamine neurons, which emit a global reward signal to striatum and frontal cortex, and in specific neurons in striatum, amygdala, and frontal cortex projecting to select neuronal populations. The approach and choice functions involve subjective value, which is objectively assessed by behavioral choices eliciting internal, subjective reward preferences. Utility is the formal mathematical characterization of subjective value and a prime decision variable in economic choice theory. It is coded as utility prediction error by phasic dopamine responses. Utility can incorporate various influences, including risk, delay, effort, and social interaction. Appropriate for formal decision mechanisms, rewards are coded as object value, action value, difference value, and chosen value by specific neurons. Although all reward, reinforcement, and decision variables are theoretical constructs, their neuronal signals constitute measurable physical implementations and as such confirm the validity of these concepts. The neuronal reward signals provide guidance for behavior while constraining the free will to act. PMID:26109341

Reward System Activation in Response to Alcohol Advertisements Predicts College Drinking.

PubMed

Courtney, Andrea L; Rapuano, Kristina M; Sargent, James D; Heatherton, Todd F; Kelley, William M

2018-01-01

In this study, we assess whether activation of the brain's reward system in response to alcohol advertisements is associated with college drinking. Previous research has established a relationship between exposure to alcohol marketing and underage drinking. Within other appetitive domains, the relationship between cue exposure and behavioral enactment is known to rely on activation of the brain's reward system. However, the relationship between neural activation to alcohol advertisements and alcohol consumption has not been studied in a nondisordered population. In this cross-sectional study, 53 college students (32 women) completed a functional magnetic resonance imaging scan while viewing alcohol, food, and control (car and technology) advertisements. Afterward, they completed a survey about their alcohol consumption (including frequency of drinking, typical number of drinks consumed, and frequency of binge drinking) over the previous month. In 43 participants (24 women) meeting inclusion criteria, viewing alcohol advertisements elicited activation in the left orbitofrontal cortex and bilateral ventral striatum-regions of the reward system that typically activate to other appetitive rewards and relate to consumption behaviors. Moreover, the level of self-reported drinking correlated with the magnitude of activation in the left orbitofrontal cortex. Results suggest that alcohol cues are processed within the reward system in a way that may motivate drinking behavior.

Ocular Chromatic Aberrations and Their Effects on Polychromatic Retinal Image Quality

NASA Astrophysics Data System (ADS)

Zhang, Xiaoxiao

Previous studies of ocular chromatic aberrations have concentrated on chromatic difference of focus (CDF). Less is known about the chromatic difference of image position (CDP) in the peripheral retina and no experimental attempt has been made to measure the ocular chromatic difference of magnification (CDM). Consequently, theoretical modelling of human eyes is incomplete. The insufficient knowledge of ocular chromatic aberrations is partially responsible for two unsolved applied vision problems: (1) how to improve vision by correcting ocular chromatic aberration? (2) what is the impact of ocular chromatic aberration on the use of isoluminance gratings as a tool in spatial-color vision?. Using optical ray tracing methods, MTF analysis methods of image quality, and psychophysical methods, I have developed a more complete model of ocular chromatic aberrations and their effects on vision. The ocular CDM was determined psychophysically by measuring the tilt in the apparent frontal parallel plane (AFPP) induced by interocular difference in image wavelength. This experimental result was then used to verify a theoretical relationship between the ocular CDM, the ocular CDF and the entrance pupil of the eye. In the retinal image after correcting the ocular CDF with existing achromatizing methods, two forms of chromatic aberration (CDM and chromatic parallax) were examined. The CDM was predicted by theoretical ray tracing and measured with the same method used to determine ocular CDM. The chromatic parallax was predicted with a nodal ray model and measured with the two-color vernier alignment method. The influence of these two aberrations on polychromatic MTF were calculated. Using this improved model of ocular chromatic aberration, luminance artifacts in the images of isoluminance gratings were calculated. The predicted luminance artifacts were then compared with experimental data from previous investigators. The results show that: (1) A simple relationship exists between

It's about time: Earlier rewards increase intrinsic motivation.

PubMed

Woolley, Kaitlin; Fishbach, Ayelet

2018-06-01

Can immediate (vs. delayed) rewards increase intrinsic motivation? Prior research compared the presence versus absence of rewards. By contrast, this research compared immediate versus delayed rewards, predicting that more immediate rewards increase intrinsic motivation by creating a perceptual fusion between the activity and its goal (i.e., the reward). In support of the hypothesis, framing a reward from watching a news program as more immediate (vs. delayed) increased intrinsic motivation to watch the program (Study 1), and receiving more immediate bonus (vs. delayed, Study 2; and vs. delayed and no bonus, Study 3) increased intrinsic motivation in an experimental task. The effect of reward timing was mediated by the strength of the association between an activity and a reward, and was specific to intrinsic (vs. extrinsic) motivation-immediacy influenced the positive experience of an activity, but not perceived outcome importance (Study 4). In addition, the effect of the timing of rewards was independent of the effect of the magnitude of the rewards (Study 5). (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Antisocial Behavior, Psychopathic Features and Abnormalities in Reward and Punishment Processing in Youth

PubMed Central

Byrd, Amy L.; Loeber, Rolf; Pardini, Dustin A.

2017-01-01

A better understanding of what leads youth to initially engage in antisocial behavior (ASB) and more importantly persist with such behaviors into adulthood has significant implications for prevention and intervention efforts. A considerable number of studies using behavioral and neuroimaging techniques have investigated abnormalities in reward and punishment processing as potential causal mechanisms underlying ASB. However, this literature has yet to be critically evaluated, and there are no comprehensive reviews that systematically examine and synthesize these findings. The goal of the present review is twofold. The first aim is to examine the extent to which youth with ASB are characterized by abnormalities in (1) reward processing; (2) punishment processing; or (3) both reward and punishment processing. The second aim is to evaluate whether aberrant reward and/or punishment processing is specific to or most pronounced in a subgroup of antisocial youth with psychopathic features. Studies utilizing behavioral methods are first reviewed, followed by studies using functional magnetic resonance imaging. An integration of theory and research across multiple levels of analysis is presented in order to provide a more comprehensive understanding of reward and punishment processing in antisocial youth. Findings are discussed in terms of developmental and contextual considerations, proposed future directions and implications for intervention. PMID:24357109

Post-learning hippocampal dynamics promote preferential retention of rewarding events

PubMed Central

Gruber, Matthias J.; Ritchey, Maureen; Wang, Shao-Fang; Doss, Manoj K.; Ranganath, Charan

2016-01-01

Reward motivation is known to modulate memory encoding, and this effect depends on interactions between the substantia nigra/ ventral tegmental area complex (SN/VTA) and the hippocampus. It is unknown, however, whether these interactions influence offline neural activity in the human brain that is thought to promote memory consolidation. Here, we used functional magnetic resonance imaging (fMRI) to test the effect of reward motivation on post-learning neural dynamics and subsequent memory for objects that were learned in high- or low-reward motivation contexts. We found that post-learning increases in resting-state functional connectivity between the SN/VTA and hippocampus predicted preferential retention of objects that were learned in high-reward contexts. In addition, multivariate pattern classification revealed that hippocampal representations of high-reward contexts were preferentially reactivated during post-learning rest, and the number of hippocampal reactivations was predictive of preferential retention of items learned in high-reward contexts. These findings indicate that reward motivation alters offline post-learning dynamics between the SN/VTA and hippocampus, providing novel evidence for a potential mechanism by which reward could influence memory consolidation. PMID:26875624

Frontal-striatum dysfunction during reward processing: Relationships to amotivation in schizophrenia.

PubMed

Chung, Yu Sun; Barch, Deanna M

2016-04-01

Schizophrenia is characterized by deficits of context processing, thought to be related to dorsolateral prefrontal cortex (DLPFC) impairment. Despite emerging evidence suggesting a crucial role of the DLPFC in integrating reward and goal information, we do not know whether individuals with schizophrenia can represent and integrate reward-related context information to modulate cognitive control. To address this question, 36 individuals with schizophrenia (n = 29) or schizoaffective disorder (n = 7) and 27 healthy controls performed a variant of a response conflict task (Padmala & Pessoa, 2011) during fMRI scanning, in both baseline and reward conditions, with monetary incentives on some reward trials. We used a mixed state-item design that allowed us to examine both sustained and transient reward effects on cognitive control. Different from predictions about impaired DLPFC function in schizophrenia, we found an intact pattern of increased sustained DLPFC activity during reward versus baseline blocks in individuals with schizophrenia at a group level but blunted sustained activations in the putamen. Contrary to our predictions, individuals with schizophrenia showed blunted cue-related activations in several regions of the basal ganglia responding to reward-predicting cues. Importantly, as predicted, individual differences in anhedonia/amotivation symptoms severity were significantly associated with reduced sustained DLPFC activation in the same region that showed overall increased activity as a function of reward. These results suggest that individual differences in motivational impairments in schizophrenia may be related to dysfunction of the DLPFC and striatum in motivationally salient situations. (c) 2016 APA, all rights reserved).

The link between callous-unemotional traits and neural mechanisms of reward processing: An fMRI study.

PubMed

Veroude, Kim; von Rhein, Daniel; Chauvin, Roselyne J M; van Dongen, Eelco V; Mennes, Maarten J J; Franke, Barbara; Heslenfeld, Dirk J; Oosterlaan, Jaap; Hartman, Catharina A; Hoekstra, Pieter J; Glennon, Jeffrey C; Buitelaar, Jan K

2016-09-30

Callous-unemotional (CU) traits, i.e., unconcernedness and lack of prosocial feelings, may manifest in Conduct Disorder (CD), but also in Oppositional Defiant Disorder (ODD) and Attention Deficit Hyperactivity Disorder (ADHD). These disorders have been associated with aberrant reward processing, while the influence of CU traits is unclear. Using functional Magnetic Resonance Imaging (fMRI), we examined whether CU traits affect the neural circuit for reward. A Monetary Incentive Delay (MID) task was administered to 328 adolescents and young adults with varying levels of CU traits: 40 participants with ODD/CD plus ADHD, 101 participants with ADHD only, 84 siblings of probands with ADHD and 103 typically developing (TD) individuals. During reward anticipation, CU traits related negatively to medial prefrontal cortex (mPFC) activity, independent of ADHD symptoms and ODD/CD diagnosis. Our results indicate that CU traits are a valuable dimension for assessing the neural basis of reward processing. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Ventral Striatum Functional Connectivity as a Predictor of Adolescent Depressive Disorder in a Longitudinal Community-Based Sample.

PubMed

Pan, Pedro Mario; Sato, João R; Salum, Giovanni A; Rohde, Luis A; Gadelha, Ary; Zugman, Andre; Mari, Jair; Jackowski, Andrea; Picon, Felipe; Miguel, Eurípedes C; Pine, Daniel S; Leibenluft, Ellen; Bressan, Rodrigo A; Stringaris, Argyris

2017-11-01

Previous studies have implicated aberrant reward processing in the pathogenesis of adolescent depression. However, no study has used functional connectivity within a distributed reward network, assessed using resting-state functional MRI (fMRI), to predict the onset of depression in adolescents. This study used reward network-based functional connectivity at baseline to predict depressive disorder at follow-up in a community sample of adolescents. A total of 637 children 6-12 years old underwent resting-state fMRI. Discovery and replication analyses tested intrinsic functional connectivity (iFC) among nodes of a putative reward network. Logistic regression tested whether striatal node strength, a measure of reward-related iFC, predicted onset of a depressive disorder at 3-year follow-up. Further analyses investigated the specificity of this prediction. Increased left ventral striatum node strength predicted increased risk for future depressive disorder (odds ratio=1.54, 95% CI=1.09-2.18), even after excluding participants who had depressive disorders at baseline (odds ratio=1.52, 95% CI=1.05-2.20). Among 11 reward-network nodes, only the left ventral striatum significantly predicted depression. Striatal node strength did not predict other common adolescent psychopathology, such as anxiety, attention deficit hyperactivity disorder, and substance use. Aberrant ventral striatum functional connectivity specifically predicts future risk for depressive disorder. This finding further emphasizes the need to understand how brain reward networks contribute to youth depression.

Learning Reward Uncertainty in the Basal Ganglia

PubMed Central

Bogacz, Rafal

2016-01-01

Learning the reliability of different sources of rewards is critical for making optimal choices. However, despite the existence of detailed theory describing how the expected reward is learned in the basal ganglia, it is not known how reward uncertainty is estimated in these circuits. This paper presents a class of models that encode both the mean reward and the spread of the rewards, the former in the difference between the synaptic weights of D1 and D2 neurons, and the latter in their sum. In the models, the tendency to seek (or avoid) options with variable reward can be controlled by increasing (or decreasing) the tonic level of dopamine. The models are consistent with the physiology of and synaptic plasticity in the basal ganglia, they explain the effects of dopaminergic manipulations on choices involving risks, and they make multiple experimental predictions. PMID:27589489

Smile! Social reward drives attention.

PubMed

Hayward, Dana A; Pereira, Effie J; Otto, A Ross; Ristic, Jelena

2018-02-01

Human social behavior is fine-tuned by interactions between individuals and their environments. Here we show that social motivation plays an important role in this process. Using a novel manipulation of social reward that included elements of real-life social exchanges, we demonstrate the emergence of attentional orienting for coincidental spatial associations that received positive social reward. After an interaction with the experimenter, participants completed a computerized task in which they received positive, negative, or no social reward for their performance to spatially congruent, spatially incongruent, and neutral cue-target pairings, respectively. Even though cue-target spatial correspondences remained at chance, attentional benefits emerged and persisted a day later for targets that received positive social reward. Our data further revealed that participants' level of social competence, as measured by the Autism-Spectrum Quotient scale, was predictably related to the magnitude of their reward-driven attentional benefits. No attentional effects emerged when the social interaction and social reward manipulations were removed. These results show that motivational incentives available during social exchanges affect later individual cognitive functioning, providing one of the first insights into why seemingly ambiguous social signals produce reliable and persistent attentional effects. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Authoritarian parenting predicts reduced electrocortical response to observed adolescent offspring rewards

PubMed Central

Speed, Brittany C.; Nelson, Brady; Bress, Jennifer N.; Hajcak, Greg

2017-01-01

Abstract Parenting styles are robust predictors of offspring outcomes, yet little is known about their neural underpinnings. In this study, 44 parent-adolescent dyads (Mage of adolescent = 12.9) completed a laboratory guessing task while EEG was continuously recorded. In the task, each pair member received feedback about their own monetary wins and losses and also observed the monetary wins and losses of the other member of the pair. We examined the association between self-reported parenting style and parents’ electrophysiological responses to watching their adolescent winning and losing money, dubbed the observational Reward Positivity (RewP) and observational feedback negativity (FN), respectively. Self-reported authoritarian parenting predicted reductions in parents’ observational RewP but not FN. This predictive relationship remained after adjusting for sex of both participants, parents’ responsiveness to their own wins, and parental psychopathology. ‘Exploratory analyses found that permissive parenting was associated with a blunting of the adolescents’ response to their parents’ losses’. These findings suggest that parents’ rapid neural responses to their child’s successes may relate to the harsh parenting behaviors associated with authoritarian parenting. PMID:27613780

Struggling toward reward: Recent experience of anhedonia interacts with motivation to predict reward pursuit in the face of a stressful manipulation.

PubMed

Bryant, Jessica; Winer, E Samuel; Salem, Taban; Nadorff, Michael R

2017-01-01

Anhedonia, or the loss of interest and/or pleasure, is a core symptom of depression. Individuals experiencing anhedonia have difficulty motivating themselves to pursue rewarding stimuli, which can result in dysfunction. Action orientation is a motivational factor that might interact with anhedonia to potentially buffer against this dysfunction, as action-oriented individuals upregulate positive affect to quickly motivate themselves to complete goals in the face of stress. The Effort-Expenditure for Rewards Task (EEfRT) is a promising new method for examining differences in motivation in individuals experiencing anhedonia. In the EEfRT, participants choose either easier tasks associated with smaller monetary rewards or harder tasks associated with larger monetary rewards. We examined the relationship between action orientation and EEfRT performance following a negative mood induction in a sample with varying levels of anhedonia. There were two competing hypotheses: (1) action orientation would act as a buffer against anhedonia such that action-oriented individuals, regardless of anhedonic symptoms, would be motivated to pursue greater rewards despite stress, or (2) anhedonia would act as a debilitating factor such that individuals with elevated anhedonic symptoms, regardless of action orientation, would not pursue greater rewards. We examined these hypotheses via Generalized Estimating Equations and found an interaction between anhedonia and action orientation. At low levels of anhedonia, action orientation was associated with effort for reward, but this relationship was not present at high levels of anhedonia. Thus, at low levels of anhedonia, action orientation acted as a buffer against stress, but at high levels, anhedonia debilitated action orientation so that it was no longer a promotive factor.

Positive mood enhances reward-related neural activity

PubMed Central

Nusslock, Robin

2016-01-01

Although behavioral research has shown that positive mood leads to desired outcomes in nearly every major life domain, no studies have directly examined the effects of positive mood on the neural processes underlying reward-related affect and goal-directed behavior. To address this gap, participants in the present fMRI study experienced either a positive (n = 20) or neutral (n = 20) mood induction and subsequently completed a monetary incentive delay task that assessed reward and loss processing. Consistent with prediction, positive mood elevated activity specifically during reward anticipation in corticostriatal neural regions that have been implicated in reward processing and goal-directed behavior, including the nucleus accumbens, caudate, lateral orbitofrontal cortex and putamen, as well as related paralimbic regions, including the anterior insula and ventromedial prefrontal cortex. These effects were not observed during reward outcome, loss anticipation or loss outcome. Critically, this is the first study to report that positive mood enhances reward-related neural activity. Our findings have implications for uncovering the neural mechanisms by which positive mood enhances goal-directed behavior, understanding the malleability of reward-related neural activity, and developing targeted treatments for psychiatric disorders characterized by deficits in reward processing. PMID:26833919

Suboptimal Decision Criteria Are Predicted by Subjectively Weighted Probabilities and Rewards

PubMed Central

Ackermann, John F.; Landy, Michael S.

2014-01-01

Subjects performed a visual detection task in which the probability of target occurrence at each of the two possible locations, and the rewards for correct responses for each, were varied across conditions. To maximize monetary gain, observers should bias their responses, choosing one location more often than the other in line with the varied probabilities and rewards. Typically, and in our task, observers do not bias their responses to the extent they should, and instead distribute their responses more evenly across locations, a phenomenon referred to as ‘conservatism.’ We investigated several hypotheses regarding the source of the conservatism. We measured utility and probability weighting functions under Prospect Theory for each subject in an independent economic choice task and used the weighting-function parameters to calculate each subject’s subjective utility (SU(c)) as a function of the criterion c, and the corresponding weighted optimal criteria (wcopt). Subjects’ criteria were not close to optimal relative to wcopt. The slope of SU (c) and of expected gain EG(c) at the neutral criterion corresponding to β = 1 were both predictive of subjects’ criteria. The slope of SU(c) was a better predictor of observers’ decision criteria overall. Thus, rather than behaving optimally, subjects move their criterion away from the neutral criterion by estimating how much they stand to gain by such a change based on the slope of subjective gain as a function of criterion, using inherently distorted probabilities and values. PMID:25366822

Suboptimal decision criteria are predicted by subjectively weighted probabilities and rewards.

PubMed

Ackermann, John F; Landy, Michael S

2015-02-01

Subjects performed a visual detection task in which the probability of target occurrence at each of the two possible locations, and the rewards for correct responses for each, were varied across conditions. To maximize monetary gain, observers should bias their responses, choosing one location more often than the other in line with the varied probabilities and rewards. Typically, and in our task, observers do not bias their responses to the extent they should, and instead distribute their responses more evenly across locations, a phenomenon referred to as 'conservatism.' We investigated several hypotheses regarding the source of the conservatism. We measured utility and probability weighting functions under Prospect Theory for each subject in an independent economic choice task and used the weighting-function parameters to calculate each subject's subjective utility (SU(c)) as a function of the criterion c, and the corresponding weighted optimal criteria (wc opt ). Subjects' criteria were not close to optimal relative to wc opt . The slope of SU(c) and of expected gain EG(c) at the neutral criterion corresponding to β = 1 were both predictive of the subjects' criteria. The slope of SU(c) was a better predictor of observers' decision criteria overall. Thus, rather than behaving optimally, subjects move their criterion away from the neutral criterion by estimating how much they stand to gain by such a change based on the slope of subjective gain as a function of criterion, using inherently distorted probabilities and values.

Phasic dopamine signals: from subjective reward value to formal economic utility

PubMed Central

Schultz, Wolfram; Carelli, Regina M; Wightman, R Mark

2015-01-01

Although rewards are physical stimuli and objects, their value for survival and reproduction is subjective. The phasic, neurophysiological and voltammetric dopamine reward prediction error response signals subjective reward value. The signal incorporates crucial reward aspects such as amount, probability, type, risk, delay and effort. Differences of dopamine release dynamics with temporal delay and effort in rodents may derive from methodological issues and require further study. Recent designs using concepts and behavioral tools from experimental economics allow to formally characterize the subjective value signal as economic utility and thus to establish a neuronal value function. With these properties, the dopamine response constitutes a utility prediction error signal. PMID:26719853

Abnormal Reward System Activation in Mania

PubMed Central

Abler, Birgit; Greenhouse, Ian; Ongur, Dost; Walter, Henrik; Heckers, Stephan

2008-01-01

Transmission of reward signals is a function of dopamine, a neurotransmitter known to be involved in the mechanism of psychosis. Using functional magnetic resonance imaging (fMRI), we investigated how expectation and receipt of monetary rewards modulate brain activation in patients with bipolar mania and schizophrenia. We studied 12 acutely manic patients with a history of bipolar disorder, 12 patients with a current episode of schizoaffective disorder or schizophrenia and 12 healthy subjects. All patients were treated with dopamine antagonists at the time of the study. Subjects performed a delayed incentive paradigm with monetary reward in the scanner that allowed for investigating effects of expectation, receipt, and omission of rewards. Patients with schizophrenia and healthy control subjects showed the expected activation of dopaminergic brain areas, that is, ventral tegmentum activation upon expectation of monetary rewards and nucleus accumbens activation during receipt vs omission of rewards. In manic patients, however, we did not find a similar pattern of brain activation and the differential signal in the nucleus accumbens upon receipt vs omission of rewards was significantly lower compared to the healthy control subjects. Our findings provide evidence for abnormal function of the dopamine system during receipt or omission of expected rewards in bipolar disorder. These deficits in prediction error processing in acute mania may help to explain symptoms of disinhibition and abnormal goal pursuit regulation. PMID:17987058

A model of chromosome aberration induction: applications to space research.

PubMed

Ballarini, Francesca; Ottolenghi, Andrea

2005-10-01

A mechanistic model and Monte Carlo code simulating chromosome aberration induction in human lymphocytes is presented. The model is based on the assumption that aberrations arise from clustered DNA lesions and that only the free ends of clustered lesions created in neighboring chromosome territories or in the same territory can join and produce exchanges. The lesions are distributed in the cell nucleus according to the radiation track structure. Interphase chromosome territories are modeled as compact intranuclear regions with volumes proportional to the chromosome DNA contents. Both Giemsa staining and FISH painting can be simulated, and background aberrations can be taken into account. The good agreement with in vitro data provides validation of the model in terms of both the assumptions adopted and the simulation techniques. As an application in the field of space research, the model predictions were compared with aberration yields measured among crew members of long-term missions on board Mir and ISS, assuming an average radiation quality factor of 2.4. The agreement obtained also validated the model for in vivo exposure scenarios and suggested possible applications to the prediction of other relevant aberrations, typically translocations.

Comparing Apples and Oranges: Using Reward-Specific and Reward-General Subjective Value Representation in the Brain

PubMed Central

Glimcher, Paul W.

2011-01-01

The ability of human subjects to choose between disparate kinds of rewards suggests that the neural circuits for valuing different reward types must converge. Economic theory suggests that these convergence points represent the subjective values (SVs) of different reward types on a common scale for comparison. To examine these hypotheses and to map the neural circuits for reward valuation we had food and water-deprived subjects make risky choices for money, food, and water both in and out of a brain scanner. We found that risk preferences across reward types were highly correlated; the level of risk aversion an individual showed when choosing among monetary lotteries predicted their risk aversion toward food and water. We also found that partially distinct neural networks represent the SVs of monetary and food rewards and that these distinct networks showed specific convergence points. The hypothalamic region mainly represented the SV for food, and the posterior cingulate cortex mainly represented the SV for money. In both the ventromedial prefrontal cortex (vmPFC) and striatum there was a common area representing the SV of both reward types, but only the vmPFC significantly represented the SVs of money and food on a common scale appropriate for choice in our data set. A correlation analysis demonstrated interactions across money and food valuation areas and the common areas in the vmPFC and striatum. This may suggest that partially distinct valuation networks for different reward types converge on a unified valuation network, which enables a direct comparison between different reward types and hence guides valuation and choice. PMID:21994386

A test of the reward-value hypothesis.

PubMed

Smith, Alexandra E; Dalecki, Stefan J; Crystal, Jonathon D

2017-03-01

Rats retain source memory (memory for the origin of information) over a retention interval of at least 1 week, whereas their spatial working memory (radial maze locations) decays within approximately 1 day. We have argued that different forgetting functions dissociate memory systems. However, the two tasks, in our previous work, used different reward values. The source memory task used multiple pellets of a preferred food flavor (chocolate), whereas the spatial working memory task provided access to a single pellet of standard chow-flavored food at each location. Thus, according to the reward-value hypothesis, enhanced performance in the source memory task stems from enhanced encoding/memory of a preferred reward. We tested the reward-value hypothesis by using a standard 8-arm radial maze task to compare spatial working memory accuracy of rats rewarded with either multiple chocolate or chow pellets at each location using a between-subjects design. The reward-value hypothesis predicts superior accuracy for high-valued rewards. We documented equivalent spatial memory accuracy for high- and low-value rewards. Importantly, a 24-h retention interval produced equivalent spatial working memory accuracy for both flavors. These data are inconsistent with the reward-value hypothesis and suggest that reward value does not explain our earlier findings that source memory survives unusually long retention intervals.

Surface geometry and optical aberrations of ex-vivo crystalline lenses

NASA Astrophysics Data System (ADS)

Bueno, Juan M.; Schwarz, Christina; Acosta, Eva; Artal, Pablo

2010-02-01

The shape of the surfaces of ex-vivo human crystalline lenses was measured using a shadow photography technique. From these data, the back-focal distance and the contribution of each surface to the main optical aberrations of the lenses were estimated. The aberrations of the lenses were measured separately with two complementary techniques: a Hartmann-Shack wavefront sensor and a point-diffraction interferometer. A laser scanning set-up was also used to measure the actual back-focal length as well as the phase aberration in one meridian section of the lenses. Measured and predicted back-focal length agreed well within the experimental errors. The lens aberrations computed with a ray-tracing approach from the measured surfaces and geometrical data only reproduce quantitatively the measured aberrations.

Abnormal reward functioning across substance use disorders and major depressive disorder: Considering reward as a transdiagnostic mechanism.

PubMed

Baskin-Sommers, Arielle R; Foti, Dan

2015-11-01

A common criticism of the Diagnostic and Statistical Manual of Mental Disorders (American Psychiatric Association, 2013) is that its criteria are based more on behavioral descriptions than on underlying biological mechanisms. Increasingly, calls have intensified for a more biologically-based approach to conceptualizing, studying, and treating psychological disorders, as exemplified by the Research Domain Criteria Project (RDoC). Among the most well-studied neurobiological mechanisms is reward processing. Moreover, individual differences in reward sensitivity are related to risk for substance abuse and depression. The current review synthesizes the available preclinical, electrophysiological, and neuroimaging literature on reward processing from a transdiagnostic, multidimensional perspective. Findings are organized with respect to key reward constructs within the Positive Valence Systems domain of the RDoC matrix, including initial responsiveness to reward (physiological 'liking'), approach motivation (physiological 'wanting'), and reward learning/habit formation. In the current review, we (a) describe the neural basis of reward, (b) elucidate differences in reward activity in substance abuse and depression, and (c) suggest a framework for integrating these disparate literatures and discuss the utility of shifting focus from diagnosis to process for understanding liability and co-morbidity. Ultimately, we believe that an integrative focus on abnormal reward functioning across the full continuum of clinically heterogeneous samples, rather than within circumscribed diagnostic categories, might actually help to refine the phenotypes and improve the prediction of onset and recovery of these disorders. Copyright © 2015 Elsevier B.V. All rights reserved.

Life stress in adolescence predicts early adult reward-related brain function and alcohol dependence

PubMed Central

Shaw, Daniel S.; Sitnick, Stephanie L.; Musselman, Samuel C.; Forbes, Erika E.

2015-01-01

Stressful life events increase vulnerability to problematic alcohol use, and they may do this by disrupting reward-related neural circuitry. This is particularly relevant for adolescents because alcohol use rises sharply after mid-adolescence and alcohol abuse peaks at age 20. Adolescents also report more stressors compared with children, and neural reward circuitry may be especially vulnerable to stressors during adolescence because of prefrontal cortex remodeling. Using a large sample of male participants in a longitudinal functional magnetic resonance imaging study (N = 157), we evaluated whether cumulative stressful life events between the ages of 15 and 18 were associated with reward-related brain function and problematic alcohol use at age 20 years. Higher cumulative stressful life events during adolescence were associated with decreased response in the medial prefrontal cortex (mPFC) during monetary reward anticipation and following the receipt of monetary rewards. Stress-related decreases in mPFC response during reward anticipation and following rewarding outcomes were associated with the severity of alcohol dependence. Furthermore, mPFC response mediated the association between stressful life events and later symptoms of alcohol dependence. These data are consistent with neurobiological models of addiction that propose that stressors during adolescence increase risk for problematic alcohol use by disrupting reward circuit function. PMID:24795442

No unified reward prediction error in local field potentials from the human nucleus accumbens: evidence from epilepsy patients

PubMed Central

Rutledge, Robb B.; Zaehle, Tino; Schmitt, Friedhelm C.; Kopitzki, Klaus; Kowski, Alexander B.; Voges, Jürgen; Heinze, Hans-Jochen; Dolan, Raymond J.

2015-01-01

Functional magnetic resonance imaging (fMRI), cyclic voltammetry, and single-unit electrophysiology studies suggest that signals measured in the nucleus accumbens (Nacc) during value-based decision making represent reward prediction errors (RPEs), the difference between actual and predicted rewards. Here, we studied the precise temporal and spectral pattern of reward-related signals in the human Nacc. We recorded local field potentials (LFPs) from the Nacc of six epilepsy patients during an economic decision-making task. On each trial, patients decided whether to accept or reject a gamble with equal probabilities of a monetary gain or loss. The behavior of four patients was consistent with choices being guided by value expectations. Expected value signals before outcome onset were observed in three of those patients, at varying latencies and with nonoverlapping spectral patterns. Signals after outcome onset were correlated with RPE regressors in all subjects. However, further analysis revealed that these signals were better explained as outcome valence rather than RPE signals, with gamble gains and losses differing in the power of beta oscillations and in evoked response amplitudes. Taken together, our results do not support the idea that postsynaptic potentials in the Nacc represent a RPE that unifies outcome magnitude and prior value expectation. We discuss the generalizability of our findings to healthy individuals and the relation of our results to measurements of RPE signals obtained from the Nacc with other methods. PMID:26019312

No unified reward prediction error in local field potentials from the human nucleus accumbens: evidence from epilepsy patients.

PubMed

Stenner, Max-Philipp; Rutledge, Robb B; Zaehle, Tino; Schmitt, Friedhelm C; Kopitzki, Klaus; Kowski, Alexander B; Voges, Jürgen; Heinze, Hans-Jochen; Dolan, Raymond J

2015-08-01

Functional magnetic resonance imaging (fMRI), cyclic voltammetry, and single-unit electrophysiology studies suggest that signals measured in the nucleus accumbens (Nacc) during value-based decision making represent reward prediction errors (RPEs), the difference between actual and predicted rewards. Here, we studied the precise temporal and spectral pattern of reward-related signals in the human Nacc. We recorded local field potentials (LFPs) from the Nacc of six epilepsy patients during an economic decision-making task. On each trial, patients decided whether to accept or reject a gamble with equal probabilities of a monetary gain or loss. The behavior of four patients was consistent with choices being guided by value expectations. Expected value signals before outcome onset were observed in three of those patients, at varying latencies and with nonoverlapping spectral patterns. Signals after outcome onset were correlated with RPE regressors in all subjects. However, further analysis revealed that these signals were better explained as outcome valence rather than RPE signals, with gamble gains and losses differing in the power of beta oscillations and in evoked response amplitudes. Taken together, our results do not support the idea that postsynaptic potentials in the Nacc represent a RPE that unifies outcome magnitude and prior value expectation. We discuss the generalizability of our findings to healthy individuals and the relation of our results to measurements of RPE signals obtained from the Nacc with other methods. Copyright © 2015 the American Physiological Society.

Regulating task-monitoring systems in response to variable reward contingencies and outcomes in cocaine addicts.

PubMed

Morie, Kristen P; De Sanctis, Pierfilippo; Garavan, Hugh; Foxe, John J

2016-03-01

We investigated anticipatory and consummatory reward processing in cocaine addiction. In addition, we set out to assess whether task-monitoring systems were appropriately recalibrated in light of variable reward schedules. We also examined neural measures of task-monitoring and reward processing as a function of hedonic tone, since anhedonia is a vulnerability marker for addiction that is obviously germane in the context of reward processing. High-density event-related potentials were recorded while participants performed a speeded response task that systematically varied anticipated probabilities of reward receipt. The paradigm dissociated feedback regarding task success (or failure) from feedback regarding the value of reward (or loss), so that task-monitoring and reward processing could be examined in partial isolation. Twenty-three active cocaine abusers and 23 age-matched healthy controls participated. Cocaine abusers showed amplified anticipatory responses to reward predictive cues, but crucially, these responses were not as strongly modulated by reward probability as in controls. Cocaine users also showed blunted responses to feedback about task success or failure and did not use this information to update predictions about reward. In turn, they showed clearly blunted responses to reward feedback. In controls and users, measures of anhedonia were associated with reward motivation. In cocaine users, anhedonia was also associated with diminished monitoring and reward feedback responses. Findings imply that reward anticipation and monitoring deficiencies in addiction are associated with increased responsiveness to reward cues but impaired ability to predict reward in light of task contingencies, compounded by deficits in responding to actual reward outcomes.

DISRUPTION OF CONDITIONED REWARD ASSOCIATION BY TYPICAL AND ATYPICAL ANTIPSYCHOTICS

PubMed Central

Danna, C.L.; Elmer, G.I.

2013-01-01

Antipsychotic drugs are broadly classified into typical and atypical compounds; they vary in their pharmacological profile however a common component is their antagonist effects at the D2 dopamine receptors (DRD2). Unfortunately, diminished DRD2 activation is generally thought to be associated with the severity of neuroleptic-induced anhedonia. The purpose of this study was to determine the effect of the atypical antipsychotic olanzapine and typical antipsychotic haloperidol in a paradigm that reflects the learned transfer of incentive motivational properties to previously neutral stimuli, namely autoshaping. In order to provide a dosing comparison to a therapeutically relevant endpoint, both drugs were tested against amphetamine-induced disruption of prepulse inhibition as well. In the autoshaping task, rats were exposed to repeated pairings of stimuli that were differentially predictive of reward delivery. Conditioned approach to the reward predictive cue (sign-tracking) and to the reward (goal-tracking) increased during repeated pairings in the vehicle treated rats. Haloperidol and olanzapine completely abolished this behavior at relatively low doses (100 μg/kg). This same dose was the threshold dose for each drug to antagonize the sensorimotor gating deficits produced by amphetamine. At lower doses (3–30 μg/kg) both drugs produced a dose-dependent decrease in conditioned approach to the reward predictive cue. There was no difference between drugs at this dose range which indicates that olanzapine disrupts autoshaping at a significantly lower proposed DRD2 receptor occupancy. Interestingly, neither drug disrupted conditioned approach to the reward at the same dose range that disrupted conditioned approach to the reward predictive cue. Thus, haloperidol and olanzapine, at doses well below what is considered therapeutically relevant, disrupts the attribution of incentive motivational value to previously neutral cues. Drug effects on this dimension of reward

Reward Selectively Modulates the Lingering Neural Representation of Recently Attended Objects in Natural Scenes.

PubMed

Hickey, Clayton; Peelen, Marius V

2017-08-02

Theories of reinforcement learning and approach behavior suggest that reward can increase the perceptual salience of environmental stimuli, ensuring that potential predictors of outcome are noticed in the future. However, outcome commonly follows visual processing of the environment, occurring even when potential reward cues have long disappeared. How can reward feedback retroactively cause now-absent stimuli to become attention-drawing in the future? One possibility is that reward and attention interact to prime lingering visual representations of attended stimuli that sustain through the interval separating stimulus and outcome. Here, we test this idea using multivariate pattern analysis of fMRI data collected from male and female humans. While in the scanner, participants searched for examples of target categories in briefly presented pictures of cityscapes and landscapes. Correct task performance was followed by reward feedback that could randomly have either high or low magnitude. Analysis showed that high-magnitude reward feedback boosted the lingering representation of target categories while reducing the representation of nontarget categories. The magnitude of this effect in each participant predicted the behavioral impact of reward on search performance in subsequent trials. Other analyses show that sensitivity to reward-as expressed in a personality questionnaire and in reactivity to reward feedback in the dopaminergic midbrain-predicted reward-elicited variance in lingering target and nontarget representations. Credit for rewarding outcome thus appears to be assigned to the target representation, causing the visual system to become sensitized for similar objects in the future. SIGNIFICANCE STATEMENT How do reward-predictive visual stimuli become salient and attention-drawing? In the real world, reward cues precede outcome and reward is commonly received long after potential predictors have disappeared. How can the representation of environmental stimuli

Personality domains and traits that predict self-reported aberrant driving behaviours in a southeastern US university sample.

PubMed

Beanland, Vanessa; Sellbom, Martin; Johnson, Alexandria K

2014-11-01

Personality traits are meaningful predictors of many significant life outcomes, including mortality. Several studies have investigated the relationship between specific personality traits and driving behaviours, e.g., aggression and speeding, in an attempt to identify traits associated with elevated crash risk. These studies, while valuable, are limited in that they examine only a narrow range of personality constructs and thus do not necessarily reveal which traits in constellation best predict aberrant driving behaviours. The primary aim of this study was to use a comprehensive measure of personality to investigate which personality traits are most predictive of four types of aberrant driving behaviour (Aggressive Violations, Ordinary Violations, Errors, Lapses) as indicated by the Manchester Driver Behaviour Questionnaire (DBQ). We recruited 285 young adults (67% female) from a university in the southeastern US. They completed self-report questionnaires including the DBQ and the Personality Inventory for DSM-5, which indexes 5 broad personality domains (Antagonism, Detachment, Disinhibition, Negative Affectivity, Psychoticism) and 25 specific trait facets. Confirmatory factor analysis showed adequate evidence for the DBQ internal structure. Structural regression analyses revealed that the personality domains of Antagonism and Negative Affectivity best predicted both Aggressive Violations and Ordinary Violations, whereas the best predictors of both Errors and Lapses were Negative Affectivity, Disinhibition and to a lesser extent Antagonism. A more nuanced analysis of trait facets revealed that Hostility was the best predictor of Aggressive Violations; Risk-taking and Hostility of Ordinary Violations; Irresponsibility, Separation Insecurity and Attention Seeking of Errors; and Perseveration and Irresponsibility of Lapses. Copyright © 2014 Elsevier Ltd. All rights reserved.

Amygdala mu-opioid receptors mediate the motivating influence of cue-triggered reward expectations.

PubMed

Lichtenberg, Nina T; Wassum, Kate M

2017-02-01

Environmental reward-predictive stimuli can retrieve from memory a specific reward expectation that allows them to motivate action and guide choice. This process requires the basolateral amygdala (BLA), but little is known about the signaling systems necessary within this structure. Here we examined the role of the neuromodulatory opioid receptor system in the BLA in such cue-directed action using the outcome-specific Pavlovian-to-instrumental transfer (PIT) test in rats. Inactivation of BLA mu-, but not delta-opioid receptors was found to dose-dependently attenuate the ability of a reward-predictive cue to selectively invigorate the performance of actions directed at the same unique predicted reward (i.e. to express outcome-specific PIT). BLA mu-opioid receptor inactivation did not affect the ability of a reward itself to similarly motivate action (outcome-specific reinstatement), suggesting a more selective role for the BLA mu-opioid receptor in the motivating influence of currently unobservable rewarding events. These data reveal a new role for BLA mu-opioid receptor activation in the cued recall of precise reward memories and the use of this information to motivate specific action plans. © 2016 Federation of European Neuroscience Societies and John Wiley & Sons Ltd.

“Liking” and “Wanting” Linked to Reward Deficiency Syndrome (RDS): Hypothesizing Differential Responsivity in Brain Reward Circuitry

PubMed Central

Blum, Kenneth; Gardner, Eliot; Oscar-Berman, Marlene; Gold, Mark

2013-01-01

In an attempt to resolve controversy regarding the causal contributions of mesolimbic dopamine (DA) systems to reward, we evaluate the three main competing explanatory categories: “liking,” “learning,” and “wanting” [1]. That is, DA may mediate (a) the hedonic impact of reward (liking), (b) learned predictions about rewarding effects (learning), or (c) the pursuit of rewards by attributing incentive salience to reward-related stimuli (wanting). We evaluate these hypotheses, especially as they relate to the Reward Deficiency Syndrome (RDS), and we find that the incentive salience or “wanting” hypothesis of DA function is supported by a majority of the evidence. Neuroimaging studies have shown that drugs of abuse, palatable foods, and anticipated behaviors such as sex and gaming affect brain regions involving reward circuitry, and may not be unidirectional. Drugs of abuse enhance DA signaling and sensitize mesolimbic mechanisms that evolved to attribute incentive salience to rewards. Addictive drugs have in common that they are voluntarily self-administered, they enhance (directly or indirectly) dopaminergic synaptic function in the nucleus accumbens, and they stimulate the functioning of brain reward circuitry (producing the “high” that drug users seek). Although originally believed simply to encode the set point of hedonic tone, these circuits now are believed to be functionally more complex, also encoding attention, reward expectancy, disconfirmation of reward expectancy, and incentive motivation. Elevated stress levels, together with polymorphisms of dopaminergic genes and other neurotransmitter genetic variants, may have a cumulative effect on vulnerability to addiction. The RDS model of etiology holds very well for a variety of chemical and behavioral addictions. PMID:22236117

Dampening Positive Affect and Neural Reward Responding in Healthy Children: Implications for Affective Inflexibility

PubMed Central

Gilbert, Kirsten; Luking, Katherine; Pagliaccio, David; Luby, Joan L.; Barch, Deanna M.

2017-01-01

OBJECTIVE Blunted reward processing is evident in and may contribute to the onset of major depressive disorder. However, it is unclear what mechanisms contribute to the development of blunted reward-response prior to depression onset. METHOD The current study examined how individual differences in the tendency to dampen positive affect, an affect regulation strategy that decreases positive affect, are associated with reward responding and related brain activation in 39 healthy children (age 7–10; 51% female; 79% white). To do this, we examined neural responses to winning a reward (candy) within the context of a previous loss, win, or neutral outcome. RESULTS Whole brain regression analyses revealed that self-reported tendencies to engage in dampening were associated with blunted striatum and thalamic activation during a winning outcome when following a previous loss outcome, as compared to when following a neutral outcome. This finding was above and beyond the influence of current depressive symptoms. However, tendencies to dampen positive affect were not associated with neural activity during the second of two consecutive win outcomes, and thus did not support the notion that dampening is associated with an inability to maintain reward responding. CONCLUSIONS In youth, tendencies to dampen positive affect may be associated with less ability to flexibly upregulate neural reward responding following a loss, possibly leading to the development of affective inflexibility and increased vulnerability to depression. Dampening positive affect may be one mechanism that contributes to aberrant neural reward responding via affective inflexibility and may be a target for prevention in youth. PMID:27819484

Predicting aberrant drug behavior in patients treated for chronic pain: importance of abuse history.

PubMed

Michna, Edward; Ross, Edgar L; Hynes, Wilfred L; Nedeljkovic, Srdjan S; Soumekh, Sharonah; Janfaza, David; Palombi, Diane; Jamison, Robert N

2004-09-01

Physicians can encounter problems in prescribing opioids for some patients with chronic pain such as multiple unsanctioned dose escalations, episodes of lost or stolen prescriptions, and positive urine drug screenings for illicit substances. This study explored the usefulness of questions on abuse history in predicting problems with prescribing opioids for patients at a hospital-based pain management program. One hundred forty-five (145) patients who were taking long- and short-acting opioids for their pain were classified as high or low risk on the basis of their responses to interview questions about 1) substance abuse history in their family, 2) past problems with drug or alcohol abuse, and 3) history of legal problems. The treating physicians completed a questionnaire about problems that they had encountered with their patients. Problem behaviors were verified through chart review. No differences in demographic characteristics were found between those classified as high and low risk. Patients who admitted to a family history of substance abuse, a history of legal problems, and drug or alcohol abuse were prone to more aberrant drug-related behaviors, including a higher incidence of lost or stolen prescriptions and the presence of illicit substances in their urine (P < 0.05). Patients classified as high risk also had a significantly higher frequency of reported mental health problems and motor vehicle accidents. More of these patients smoked cigarettes, tended to need a cigarette within the first hour of the day, took higher doses of opioids, and reported fewer adverse effects from the medications than did those without such a history (P < 0.05). This study demonstrates that questions about abuse history and legal problems can be useful in predicting aberrant drug-related behavior with opioid use in persons with chronic noncancer pain.

Authoritarian parenting predicts reduced electrocortical response to observed adolescent offspring rewards.

PubMed

Levinson, Amanda R; Speed, Brittany C; Nelson, Brady; Bress, Jennifer N; Hajcak, Greg

2017-03-01

Parenting styles are robust predictors of offspring outcomes, yet little is known about their neural underpinnings. In this study, 44 parent-adolescent dyads (Mage of adolescent = 12.9) completed a laboratory guessing task while EEG was continuously recorded. In the task, each pair member received feedback about their own monetary wins and losses and also observed the monetary wins and losses of the other member of the pair. We examined the association between self-reported parenting style and parents' electrophysiological responses to watching their adolescent winning and losing money, dubbed the observational Reward Positivity (RewP) and observational feedback negativity (FN), respectively. Self-reported authoritarian parenting predicted reductions in parents' observational RewP but not FN. This predictive relationship remained after adjusting for sex of both participants, parents' responsiveness to their own wins, and parental psychopathology. 'Exploratory analyses found that permissive parenting was associated with a blunting of the adolescents' response to their parents' losses'. These findings suggest that parents' rapid neural responses to their child's successes may relate to the harsh parenting behaviors associated with authoritarian parenting. © The Author (2016). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Aberrations associated with rigid contact lenses.

PubMed

Atchison, D A

1995-10-01

A rigid contact lens on an eye can produce levels of spherical aberration very different from those produced by a spectacle lens in front of the eye. These levels are considerably affected by contact lens surface asphericity. Change in longitudinal spherical aberration associated with aspherizing a contact lens surface is well predicted by a simple equation for change in sagittal power of the surface. Displacing an aspheric contact lens on the eye can produce considerable defocus, which is well predicted by simple equations for change in sagittal and tangential surface powers. The best refractive correction with contact lenses can be determined only by overrefraction with a patient wearing a contact lens of power and characteristics similar to that which will be prescribed. An aspheric contact lens that moves to a considerable extent on the eye will cause more unstable vision than will a spherical lens that moves to the same extent.

Time of Day Differences in Neural Reward Functioning in Healthy Young Men.

PubMed

Byrne, Jamie E M; Hughes, Matthew E; Rossell, Susan L; Johnson, Sheri L; Murray, Greg

2017-09-13

Reward function appears to be modulated by the circadian system, but little is known about the neural basis of this interaction. Previous research suggests that the neural reward response may be different in the afternoon; however, the direction of this effect is contentious. Reward response may follow the diurnal rhythm in self-reported positive affect, peaking in the early afternoon. An alternative is that daily reward response represents a type of prediction error, with neural reward activation relatively high at times of day when rewards are unexpected (i.e., early and late in the day). The present study measured neural reward activation in the context of a validated reward task at 10.00 h, 14.00 h, and 19.00 h in healthy human males. A region of interest BOLD fMRI protocol was used to investigate the diurnal waveform of activation in reward-related brain regions. Multilevel modeling found, as expected, a highly significant quadratic time-of-day effect focusing on the left putamen ( p < 0.001). Consistent with the "prediction error" hypothesis, activation was significantly higher at 10.00 h and 19.00 h compared with 14.00 h. It is provisionally concluded that the putamen may be particularly important in endogenous priming of reward motivation at different times of day, with the pattern of activation consistent with circadian-modulated reward expectancies in neural pathways (i.e., greater activation to reward stimuli at unexpected times of day). This study encourages further research into circadian modulation of reward and underscores the methodological importance of accounting for time of day in fMRI protocols. SIGNIFICANCE STATEMENT This is one of the first studies to use a repeated-measures imaging procedure to explore the diurnal rhythm of reward activation. Although self-reported reward (most often operationalized as positive affect) peaks in the afternoon, the present findings indicate that neural activation is lowest at this time. We conclude that the

Adaptive scaling of reward in episodic memory: a replication study.

PubMed

Mason, Alice; Ludwig, Casimir; Farrell, Simon

2017-11-01

Reward is thought to enhance episodic memory formation via dopaminergic consolidation. Bunzeck, Dayan, Dolan, and Duzel [(2010). A common mechanism for adaptive scaling of reward and novelty. Human Brain Mapping, 31, 1380-1394] provided functional magnetic resonance imaging (fMRI) and behavioural evidence that reward and episodic memory systems are sensitive to the contextual value of a reward-whether it is relatively higher or lower-as opposed to absolute value or prediction error. We carried out a direct replication of their behavioural study and did not replicate their finding that memory performance associated with reward follows this pattern of adaptive scaling. An effect of reward outcome was in the opposite direction to that in the original study, with lower reward outcomes leading to better memory than higher outcomes. There was a marginal effect of reward context, suggesting that expected value affected memory performance. We discuss the robustness of the reward memory relationship to variations in reward context, and whether other reward-related factors have a more reliable influence on episodic memory.

An extended reinforcement learning model of basal ganglia to understand the contributions of serotonin and dopamine in risk-based decision making, reward prediction, and punishment learning

PubMed Central

Balasubramani, Pragathi P.; Chakravarthy, V. Srinivasa; Ravindran, Balaraman; Moustafa, Ahmed A.

2014-01-01

Although empirical and neural studies show that serotonin (5HT) plays many functional roles in the brain, prior computational models mostly focus on its role in behavioral inhibition. In this study, we present a model of risk based decision making in a modified Reinforcement Learning (RL)-framework. The model depicts the roles of dopamine (DA) and serotonin (5HT) in Basal Ganglia (BG). In this model, the DA signal is represented by the temporal difference error (δ), while the 5HT signal is represented by a parameter (α) that controls risk prediction error. This formulation that accommodates both 5HT and DA reconciles some of the diverse roles of 5HT particularly in connection with the BG system. We apply the model to different experimental paradigms used to study the role of 5HT: (1) Risk-sensitive decision making, where 5HT controls risk assessment, (2) Temporal reward prediction, where 5HT controls time-scale of reward prediction, and (3) Reward/Punishment sensitivity, in which the punishment prediction error depends on 5HT levels. Thus the proposed integrated RL model reconciles several existing theories of 5HT and DA in the BG. PMID:24795614

Neural reward and punishment sensitivity in cigarette smokers.

PubMed

Potts, Geoffrey F; Bloom, Erika L; Evans, David E; Drobes, David J

2014-11-01

Nicotine addiction remains a major public health problem but the neural substrates of addictive behavior remain unknown. One characteristic of smoking behavior is impulsive choice, selecting the immediate reward of smoking despite the potential long-term negative consequences. This suggests that drug users, including cigarette smokers, may be more sensitive to rewards and less sensitive to punishment. We used event-related potentials (ERPs) to test the hypothesis that smokers are more responsive to reward signals and less responsive to punishment, potentially predisposing them to risky behavior. We conducted two experiments, one using a reward prediction design to elicit a Medial Frontal Negativity (MFN) and one using a reward- and punishment-motivated flanker task to elicit an Error Related Negativity (ERN), ERP components thought to index activity in the cortical projection of the dopaminergic reward system. The smokers had a greater MFN response to unpredicted rewards, and non-smokers, but not smokers, had a larger ERN on punishment motivated trials indicating that smokers are more reward sensitive and less punishment sensitive than nonsmokers, overestimating the appetitive value and underestimating aversive outcomes of stimuli and actions. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Neural Reward and Punishment Sensitivity in Cigarette Smokers

PubMed Central

Potts, Geoffrey F.; Bloom, Erika; Evans, David E.; Drobes, David J.

2014-01-01

Background Nicotine addiction remains a major public health problem but the neural substrates of addictive behavior remain unknown. One characteristic of smoking behavior is impulsive choice, selecting the immediate reward of smoking despite the potential long-term negative consequences. This suggests that drug users, including cigarette smokers, may be more sensitive to rewards and less sensitive to punishment. Methods We used event-related potentials (ERPs) to test the hypothesis that smokers are more responsive to reward signals and less responsive to punishment, potentially predisposing them to risky behavior. We conducted two experiments, one using a reward prediction design to elicit a Medial Frontal Negativity (MFN) and one using a reward- and punishment-motivated flanker task to elicit an Error Related Negativity (ERN), ERP components thought to index activity in the cortical projection of the dopaminergic reward system. Results and Conclusions The smokers had a greater MFN response to unpredicted rewards, and non-smokers, but not smokers, had a larger ERN on punishment motivated trials indicating that smokers are more reward sensitive and less punishment sensitive than nonsmokers, overestimating the appetitive value and underestimating aversive outcomes of stimuli and actions. PMID:25292454

Maternal Depression and Warmth During Childhood Predict Age 20 Neural Response to Reward

PubMed Central

Morgan, Judith K.; Shaw, Daniel S.; Forbes, Erika E.

2014-01-01

Objective Early parenting experiences likely shape children’s brain development, with consequences potentially extending into adulthood. Parents’ affective disorders and expressions of positive affect could exert an influence on affect-related circuitry. The current study evaluated how maternal depression and maternal warmth assessed in early childhood and early adolescence were related to boys’ reward function during early adulthood. Method Participants were 120 boys at socioeconomic risk for emotional problems. Mothers’ history of depression during the child’s lifetime was measured when boys were 42 months old and 10/11 years old. Maternal warmth was observed during mother–child interactions at 18 and 24 months and at 10 and 11 years. Results Maternal warmth during early childhood was associated with less activation in the medial prefrontal cortex (mPFC) when anticipating and experiencing reward loss. Maternal warmth during early adolescence was associated with less activation in the mPFC when winning rewards and greater activation in the caudate when experiencing loss. The association between maternal warmth during early childhood and early adolescence and reward function in the striatum and mPFC was stronger for boys exposed to maternal depression relative to boys who were not. Conclusions The experience of warmth and affection from mothers may be a protective factor for reward function in boys exposed to maternal depression, possibly by engaging vulnerable neural reward systems through affiliation. PMID:24342390

Medial prefrontal brain activation to anticipated reward and loss in obsessive–compulsive disorder☆

PubMed Central

Kaufmann, C.; Beucke, J.C.; Preuße, F.; Endrass, T.; Schlagenhauf, F.; Heinz, A.; Juckel, G.; Kathmann, N.

2013-01-01

Obsessive–compulsive disorder (OCD) is associated with dysfunctional brain activity in several regions which are also involved in the processing of motivational stimuli. Processing of reward and punishment appears to be of special importance to understand clinical symptoms. There is evidence for higher sensitivity to punishment in patients with OCD which raises the question how avoidance of punishment relates to activity within the brain's reward circuitry. We employed the monetary incentive delay task paradigm optimized for modeling the anticipation phase of immediate reward and punishment, in the context of a cross-sectional event-related FMRI study comparing OCD patients and healthy control participants (n = 19 in each group). While overall behavioral performance was similar in both groups, patients showed increased activation upon anticipated losses in a medial and superior frontal cortex region extending into the cingulate cortex, and decreased activation upon anticipated rewards. No evidence was found for altered activation of dorsal or ventral striatal regions. Patients also showed more delayed responses for anticipated rewards than for anticipated losses whereas the reverse was true in healthy participants. The medial prefrontal cortex has been shown to implement a domain-general process comprising negative affect, pain and cognitive control. This process uses information about punishment to control aversively motivated actions by integrating signals arriving from subcortical regions. Our results support the notion that OCD is associated with altered sensitivity to anticipated rewards and losses in a medial prefrontal region whereas there is no significant aberrant activation in ventral or dorsal striatal brain regions during processing of reinforcement anticipation. PMID:24179774

Medial prefrontal brain activation to anticipated reward and loss in obsessive-compulsive disorder.

PubMed

Kaufmann, C; Beucke, J C; Preuße, F; Endrass, T; Schlagenhauf, F; Heinz, A; Juckel, G; Kathmann, N

2013-01-01

Obsessive-compulsive disorder (OCD) is associated with dysfunctional brain activity in several regions which are also involved in the processing of motivational stimuli. Processing of reward and punishment appears to be of special importance to understand clinical symptoms. There is evidence for higher sensitivity to punishment in patients with OCD which raises the question how avoidance of punishment relates to activity within the brain's reward circuitry. We employed the monetary incentive delay task paradigm optimized for modeling the anticipation phase of immediate reward and punishment, in the context of a cross-sectional event-related FMRI study comparing OCD patients and healthy control participants (n = 19 in each group). While overall behavioral performance was similar in both groups, patients showed increased activation upon anticipated losses in a medial and superior frontal cortex region extending into the cingulate cortex, and decreased activation upon anticipated rewards. No evidence was found for altered activation of dorsal or ventral striatal regions. Patients also showed more delayed responses for anticipated rewards than for anticipated losses whereas the reverse was true in healthy participants. The medial prefrontal cortex has been shown to implement a domain-general process comprising negative affect, pain and cognitive control. This process uses information about punishment to control aversively motivated actions by integrating signals arriving from subcortical regions. Our results support the notion that OCD is associated with altered sensitivity to anticipated rewards and losses in a medial prefrontal region whereas there is no significant aberrant activation in ventral or dorsal striatal brain regions during processing of reinforcement anticipation.

Midbrain dopamine neurons signal aversion in a reward-context-dependent manner

PubMed Central

Matsumoto, Hideyuki; Tian, Ju; Uchida, Naoshige; Watabe-Uchida, Mitsuko

2016-01-01

Dopamine is thought to regulate learning from appetitive and aversive events. Here we examined how optogenetically-identified dopamine neurons in the lateral ventral tegmental area of mice respond to aversive events in different conditions. In low reward contexts, most dopamine neurons were exclusively inhibited by aversive events, and expectation reduced dopamine neurons’ responses to reward and punishment. When a single odor predicted both reward and punishment, dopamine neurons’ responses to that odor reflected the integrated value of both outcomes. Thus, in low reward contexts, dopamine neurons signal value prediction errors (VPEs) integrating information about both reward and aversion in a common currency. In contrast, in high reward contexts, dopamine neurons acquired a short-latency excitation to aversive events that masked their VPE signaling. Our results demonstrate the importance of considering the contexts to examine the representation in dopamine neurons and uncover different modes of dopamine signaling, each of which may be adaptive for different environments. DOI: http://dx.doi.org/10.7554/eLife.17328.001 PMID:27760002

Differences in reward processing between putative cell types in primate prefrontal cortex.

PubMed

Fan, Hongwei; Pan, Xiaochuan; Wang, Rubin; Sakagami, Masamichi

2017-01-01

Single-unit studies in monkeys have demonstrated that neurons in the prefrontal cortex predict the reward type, reward amount or reward availability associated with a stimulus. To examine contributions of pyramidal cells and interneurons in reward processing, single-unit activity was extracellularly recorded in prefrontal cortices of four monkeys performing a reward prediction task. Based on their shapes of spike waveforms, prefrontal neurons were classified into broad-spike and narrow-spike units that represented putative pyramidal cells and interneurons, respectively. We mainly observed that narrow-spike neurons showed higher firing rates but less bursty discharges than did broad-spike neurons. Both narrow-spike and broad-spike cells selectively responded to the stimulus, reward and their interaction, and the proportions of each type of selective neurons were similar between the two cell classes. Moreover, the two types of cells displayed equal reliability of reward or stimulus discrimination. Furthermore, we found that broad-spike and narrow-spike cells showed distinct mechanisms for encoding reward or stimulus information. Broad-spike neurons raised their firing rate relative to the baseline rate to represent the preferred reward or stimulus information, whereas narrow-spike neurons inhibited their firing rate lower than the baseline rate to encode the non-preferred reward or stimulus information. Our results suggest that narrow-spike and broad-spike cells were equally involved in reward and stimulus processing in the prefrontal cortex. They utilized a binary strategy to complementarily represent reward or stimulus information, which was consistent with the task structure in which the monkeys were required to remember two reward conditions and two visual stimuli.

RM-SORN: a reward-modulated self-organizing recurrent neural network.

PubMed

Aswolinskiy, Witali; Pipa, Gordon

2015-01-01

Neural plasticity plays an important role in learning and memory. Reward-modulation of plasticity offers an explanation for the ability of the brain to adapt its neural activity to achieve a rewarded goal. Here, we define a neural network model that learns through the interaction of Intrinsic Plasticity (IP) and reward-modulated Spike-Timing-Dependent Plasticity (STDP). IP enables the network to explore possible output sequences and STDP, modulated by reward, reinforces the creation of the rewarded output sequences. The model is tested on tasks for prediction, recall, non-linear computation, pattern recognition, and sequence generation. It achieves performance comparable to networks trained with supervised learning, while using simple, biologically motivated plasticity rules, and rewarding strategies. The results confirm the importance of investigating the interaction of several plasticity rules in the context of reward-modulated learning and whether reward-modulated self-organization can explain the amazing capabilities of the brain.

Prediction of alcohol drinking in adolescents: Personality-traits, behavior, brain responses, and genetic variations in the context of reward sensitivity.

PubMed

Heinrich, Angela; Müller, Kathrin U; Banaschewski, Tobias; Barker, Gareth J; Bokde, Arun L W; Bromberg, Uli; Büchel, Christian; Conrod, Patricia; Fauth-Bühler, Mira; Papadopoulos, Dimitri; Gallinat, Jürgen; Garavan, Hugh; Gowland, Penny; Heinz, Andreas; Ittermann, Bernd; Mann, Karl; Martinot, Jean-Luc; Paus, Tomáš; Pausova, Zdenka; Smolka, Michael; Ströhle, Andreas; Rietschel, Marcella; Flor, Herta; Schumann, Gunter; Nees, Frauke

2016-07-01

Adolescence is a time that can set the course of alcohol abuse later in life. Sensitivity to reward on multiple levels is a major factor in this development. We examined 736 adolescents from the IMAGEN longitudinal study for alcohol drinking during early (mean age=14.37) and again later (mean age=16.45) adolescence. Conducting structural equation modeling we evaluated the contribution of reward-related personality traits, behavior, brain responses and candidate genes. Personality seems to be most important in explaining alcohol drinking in early adolescence. However, genetic variations in ANKK1 (rs1800497) and HOMER1 (rs7713917) play an equal role in predicting alcohol drinking two years later and are most important in predicting the increase in alcohol consumption. We hypothesize that the initiation of alcohol use may be driven more strongly by personality while the transition to increased alcohol use is more genetically influenced. Copyright © 2016 Elsevier B.V. All rights reserved.

The neuroscience of investing: fMRI of the reward system.

PubMed

Peterson, Richard L

2005-11-15

Functional magnetic resonance imaging (fMRI) has proven a useful tool for observing neural BOLD signal changes during complex cognitive and emotional tasks. Yet the meaning and applicability of the fMRI data being gathered is still largely unknown. The brain's reward system underlies the fundamental neural processes of goal evaluation, preference formation, positive motivation, and choice behavior. fMRI technology allows researchers to dynamically visualize reward system processes. Experimenters can then correlate reward system BOLD activations with experimental behavior from carefully controlled experiments. In the SPAN lab at Stanford University, directed by Brian Knutson Ph.D., researchers have been using financial tasks during fMRI scanning to correlate emotion, behavior, and cognition with the reward system's fundamental neural activations. One goal of the SPAN lab is the development of predictive models of behavior. In this paper we extrapolate our fMRI results toward understanding and predicting individual behavior in the uncertain and high-risk environment of the financial markets. The financial market price anomalies of "value versus glamour" and "momentum" may be real-world examples of reward system activation biasing collective behavior. On the individual level, the investor's bias of overconfidence may similarly be related to reward system activation. We attempt to understand selected "irrational" investor behaviors and anomalous financial market price patterns through correlations with findings from fMRI research of the reward system.

Chronic Stress Alters Striosome-Circuit Dynamics, Leading to Aberrant Decision-Making.

PubMed

Friedman, Alexander; Homma, Daigo; Bloem, Bernard; Gibb, Leif G; Amemori, Ken-Ichi; Hu, Dan; Delcasso, Sebastien; Truong, Timothy F; Yang, Joyce; Hood, Adam S; Mikofalvy, Katrina A; Beck, Dirk W; Nguyen, Norah; Nelson, Erik D; Toro Arana, Sebastian E; Vorder Bruegge, Ruth H; Goosens, Ki A; Graybiel, Ann M

2017-11-16

Effective evaluation of costs and benefits is a core survival capacity that in humans is considered as optimal, "rational" decision-making. This capacity is vulnerable in neuropsychiatric disorders and in the aftermath of chronic stress, in which aberrant choices and high-risk behaviors occur. We report that chronic stress exposure in rodents produces abnormal evaluation of costs and benefits resembling non-optimal decision-making in which choices of high-cost/high-reward options are sharply increased. Concomitantly, alterations in the task-related spike activity of medial prefrontal neurons correspond with increased activity of their striosome-predominant striatal projection neuron targets and with decreased and delayed striatal fast-firing interneuron activity. These effects of chronic stress on prefronto-striatal circuit dynamics could be blocked or be mimicked by selective optogenetic manipulation of these circuits. We suggest that altered excitation-inhibition dynamics of striosome-based circuit function could be an underlying mechanism by which chronic stress contributes to disorders characterized by aberrant decision-making under conflict. VIDEO ABSTRACT. Copyright © 2017 Elsevier Inc. All rights reserved.

Neural coding of basic reward terms of animal learning theory, game theory, microeconomics and behavioural ecology.

PubMed

Schultz, Wolfram

2004-04-01

Neurons in a small number of brain structures detect rewards and reward-predicting stimuli and are active during the expectation of predictable food and liquid rewards. These neurons code the reward information according to basic terms of various behavioural theories that seek to explain reward-directed learning, approach behaviour and decision-making. The involved brain structures include groups of dopamine neurons, the striatum including the nucleus accumbens, the orbitofrontal cortex and the amygdala. The reward information is fed to brain structures involved in decision-making and organisation of behaviour, such as the dorsolateral prefrontal cortex and possibly the parietal cortex. The neural coding of basic reward terms derived from formal theories puts the neurophysiological investigation of reward mechanisms on firm conceptual grounds and provides neural correlates for the function of rewards in learning, approach behaviour and decision-making.

Functional requirements for reward-modulated spike-timing-dependent plasticity.

PubMed

Frémaux, Nicolas; Sprekeler, Henning; Gerstner, Wulfram

2010-10-06

Recent experiments have shown that spike-timing-dependent plasticity is influenced by neuromodulation. We derive theoretical conditions for successful learning of reward-related behavior for a large class of learning rules where Hebbian synaptic plasticity is conditioned on a global modulatory factor signaling reward. We show that all learning rules in this class can be separated into a term that captures the covariance of neuronal firing and reward and a second term that presents the influence of unsupervised learning. The unsupervised term, which is, in general, detrimental for reward-based learning, can be suppressed if the neuromodulatory signal encodes the difference between the reward and the expected reward-but only if the expected reward is calculated for each task and stimulus separately. If several tasks are to be learned simultaneously, the nervous system needs an internal critic that is able to predict the expected reward for arbitrary stimuli. We show that, with a critic, reward-modulated spike-timing-dependent plasticity is capable of learning motor trajectories with a temporal resolution of tens of milliseconds. The relation to temporal difference learning, the relevance of block-based learning paradigms, and the limitations of learning with a critic are discussed.

A test of the reward-contrast hypothesis.

PubMed

Dalecki, Stefan J; Panoz-Brown, Danielle E; Crystal, Jonathon D

2017-12-01

Source memory, a facet of episodic memory, is the memory of the origin of information. Whereas source memory in rats is sustained for at least a week, spatial memory degraded after approximately a day. Different forgetting functions may suggest that two memory systems (source memory and spatial memory) are dissociated. However, in previous work, the two tasks used baiting conditions consisting of chocolate and chow flavors; notably, the source memory task used the relatively better flavor. Thus, according to the reward-contrast hypothesis, when chocolate and chow were presented within the same context (i.e., within a single radial maze trial), the chocolate location was more memorable than the chow location because of contrast. We tested the reward-contrast hypothesis using baiting configurations designed to produce reward-contrast. The reward-contrast hypothesis predicts that under these conditions, spatial memory will survive a 24-h retention interval. We documented elimination of spatial memory performance after a 24-h retention interval using a reward-contrast baiting pattern. These data suggest that reward contrast does not explain our earlier findings that source memory survives unusually long retention intervals. Copyright © 2017 Elsevier B.V. All rights reserved.

Striatal dopamine D2 receptor availability predicts the thalamic and medial prefrontal responses to reward in cocaine abusers three years later

DOE Office of Scientific and Technical Information (OSTI.GOV)

Asensio, S.; Goldstein, R.; Asensio, S.

Low levels of dopamine (DA) D2 receptor availability at a resting baseline have been previously reported in drug addicted individuals and have been associated with reduced ventral and dorsal prefrontal metabolism. The reduction in DA D2 receptor availability along with the reduced ventral frontal metabolism is thought to underlie compromised sensitivity to nondrug reward, a core characteristic of drug addiction. We therefore hypothesized that variability in DA D2 receptor availability at baseline will covary with dynamic responses to monetary reward in addicted individuals. Striatal DA D2 receptor availability was measured with [{sup 11}C]raclopride and positron emission tomography and response tomore » monetary reward was measured (an average of three years later) with functional magnetic resonance imaging in seven cocaine-addicted individuals. Results show that low DA D2 receptor availability in the dorsal striatum was associated with decreased thalamic response to monetary reward; while low availability in ventral striatum was associated with increased medial prefrontal (Brodmann Area 6/8/32) response to monetary reward. These preliminary results, that need to be replicated in larger sample sizes and validated with healthy controls, suggest that resting striatal DA D2 receptor availability predicts variability in functional responses to a nondrug reinforcer (money) in prefrontal cortex, implicated in behavioral monitoring, and in thalamus, implicated in conditioned responses and expectation, in cocaine-addicted individuals.« less

Striatal dopamine D2 receptor availability predicts the thalamic and medial prefrontal responses to reward in cocaine abusers three years later

PubMed Central

Asensio, Samuel; Romero, Maria J.; Romero, Francisco J.; Wong, Christopher; Alia-Klein, Nelly; Tomasi, Dardo; Wang, Gene-Jack; Telang, Frank; Volkow, Nora D.; Goldstein, Rita Z.

2009-01-01

Low levels of dopamine (DA) D2 receptor availability at a resting baseline have been previously reported in drug addicted individuals and have been associated with reduced ventral and dorsal prefrontal metabolism. The reduction in DA D2 receptor availability along with the reduced ventral frontal metabolism is thought to underlie compromised sensitivity to non-drug reward, a core characteristic of drug addiction. We therefore hypothesized that variability in DA D2 receptor availability at baseline will covary with dynamic responses to monetary reward in addicted individuals. Striatal DA D2 receptor availability was measured with [11C]raclopride and positron emission tomography and response to monetary reward was measured (an average of 3 years later) with functional magnetic resonance imaging in seven cocaine addicted individuals. Results show that low DA D2 receptor availability in the dorsal striatum was associated with decreased thalamic response to monetary reward; while low availability in ventral striatum was associated with increased medial prefrontal (Brodmann Area 6/8/32) response to monetary reward. These preliminary results, that need to be replicated in larger sample sizes and validated with healthy controls, suggest that resting striatal DA D2 receptor availability predicts variability in functional responses to a non-drug reinforcer (money) in prefrontal cortex, implicated in behavioral monitoring, and in thalamus, implicated in conditioned responses and expectation, in cocaine addicted individuals. PMID:20034014

Blunted ventral striatal responses to anticipated rewards foreshadow problematic drug use in novelty-seeking adolescents

PubMed Central

Büchel, Christian; Peters, Jan; Banaschewski, Tobias; Bokde, Arun L. W.; Bromberg, Uli; Conrod, Patricia J.; Flor, Herta; Papadopoulos, Dimitri; Garavan, Hugh; Gowland, Penny; Heinz, Andreas; Walter, Henrik; Ittermann, Bernd; Mann, Karl; Martinot, Jean-Luc; Paillère-Martinot, Marie-Laure; Nees, Frauke; Paus, Tomas; Pausova, Zdenka; Poustka, Luise; Rietschel, Marcella; Robbins, Trevor W.; Smolka, Michael N.; Gallinat, Juergen; Schumann, Gunter; Knutson, Brian; Arroyo, Mercedes; Artiges, Eric; Aydin, Semiha; Bach, Christine; Barbot, Alexis; Barker, Gareth; Bruehl, Ruediger; Cattrell, Anna; Constant, Patrick; Crombag, Hans; Czech, Katharina; Dalley, Jeffrey; Decideur, Benjamin; Desrivieres, Sylvane; Fadai, Tahmine; Fauth-Buhler, Mira; Feng, Jianfeng; Filippi, Irinia; Frouin, Vincent; Fuchs, Birgit; Gemmeke, Isabel; Genauck, Alexander; Hanratty, Eanna; Heinrichs, Bert; Heym, Nadja; Hubner, Thomas; Ihlenfeld, Albrecht; Ing, Alex; Ireland, James; Jia, Tianye; Jones, Jennifer; Jurk, Sarah; Kaviani, Mehri; Klaassen, Arno; Kruschwitz, Johann; Lalanne, Christophe; Lanzerath, Dirk; Lathrop, Mark; Lawrence, Claire; Lemaitre, Hervé; Macare, Christine; Mallik, Catherine; Mar, Adam; Martinez-Medina, Lourdes; Mennigen, Eva; de Carvahlo, Fabiana Mesquita; Mignon, Xavier; Millenet, Sabina; Miranda, Ruben; Müller, Kathrin; Nymberg, Charlotte; Parchetka, Caroline; Pena-Oliver, Yolanda; Pentilla, Jani; Poline, Jean-Baptiste; Quinlan, Erin Burke; Rapp, Michael; Ripke, Stephan; Ripley, Tamzin; Robert, Gabriel; Rogers, John; Romanowski, Alexander; Ruggeri, Barbara; Schmäl, Christine; Schmidt, Dirk; Schneider, Sophia; Schubert, Florian; Schwartz, Yannick; Sommer, Wolfgang; Spanagel, Rainer; Speiser, Claudia; Spranger, Tade; Stedman, Alicia; Stephens, Dai; Strache, Nicole; Ströhle, Andreas; Struve, Maren; Subramaniam, Naresh; Theobald, David; Vetter, Nora; Vulser, Helene; Weiss, Katharina; Whelan, Robert; Williams, Steve; Xu, Bing; Yacubian, Juliana; Yu, Tao; Ziesch, Veronika

2017-01-01

Novelty-seeking tendencies in adolescents may promote innovation as well as problematic impulsive behaviour, including drug abuse. Previous research has not clarified whether neural hyper- or hypo-responsiveness to anticipated rewards promotes vulnerability in these individuals. Here we use a longitudinal design to track 144 novelty-seeking adolescents at age 14 and 16 to determine whether neural activity in response to anticipated rewards predicts problematic drug use. We find that diminished BOLD activity in mesolimbic (ventral striatal and midbrain) and prefrontal cortical (dorsolateral prefrontal cortex) regions during reward anticipation at age 14 predicts problematic drug use at age 16. Lower psychometric conscientiousness and steeper discounting of future rewards at age 14 also predicts problematic drug use at age 16, but the neural responses independently predict more variance than psychometric measures. Together, these findings suggest that diminished neural responses to anticipated rewards in novelty-seeking adolescents may increase vulnerability to future problematic drug use. PMID:28221370

Differences in reward processing between putative cell types in primate prefrontal cortex

PubMed Central

Fan, Hongwei; Wang, Rubin; Sakagami, Masamichi

2017-01-01

Single-unit studies in monkeys have demonstrated that neurons in the prefrontal cortex predict the reward type, reward amount or reward availability associated with a stimulus. To examine contributions of pyramidal cells and interneurons in reward processing, single-unit activity was extracellularly recorded in prefrontal cortices of four monkeys performing a reward prediction task. Based on their shapes of spike waveforms, prefrontal neurons were classified into broad-spike and narrow-spike units that represented putative pyramidal cells and interneurons, respectively. We mainly observed that narrow-spike neurons showed higher firing rates but less bursty discharges than did broad-spike neurons. Both narrow-spike and broad-spike cells selectively responded to the stimulus, reward and their interaction, and the proportions of each type of selective neurons were similar between the two cell classes. Moreover, the two types of cells displayed equal reliability of reward or stimulus discrimination. Furthermore, we found that broad-spike and narrow-spike cells showed distinct mechanisms for encoding reward or stimulus information. Broad-spike neurons raised their firing rate relative to the baseline rate to represent the preferred reward or stimulus information, whereas narrow-spike neurons inhibited their firing rate lower than the baseline rate to encode the non-preferred reward or stimulus information. Our results suggest that narrow-spike and broad-spike cells were equally involved in reward and stimulus processing in the prefrontal cortex. They utilized a binary strategy to complementarily represent reward or stimulus information, which was consistent with the task structure in which the monkeys were required to remember two reward conditions and two visual stimuli. PMID:29261734

Neural basis of reward anticipation and its genetic determinants.

PubMed

Jia, Tianye; Macare, Christine; Desrivières, Sylvane; Gonzalez, Dante A; Tao, Chenyang; Ji, Xiaoxi; Ruggeri, Barbara; Nees, Frauke; Banaschewski, Tobias; Barker, Gareth J; Bokde, Arun L W; Bromberg, Uli; Büchel, Christian; Conrod, Patricia J; Dove, Rachel; Frouin, Vincent; Gallinat, Jürgen; Garavan, Hugh; Gowland, Penny A; Heinz, Andreas; Ittermann, Bernd; Lathrop, Mark; Lemaitre, Hervé; Martinot, Jean-Luc; Paus, Tomáš; Pausova, Zdenka; Poline, Jean-Baptiste; Rietschel, Marcella; Robbins, Trevor; Smolka, Michael N; Müller, Christian P; Feng, Jianfeng; Rothenfluh, Adrian; Flor, Herta; Schumann, Gunter

2016-04-05

Dysfunctional reward processing is implicated in various mental disorders, including attention deficit hyperactivity disorder (ADHD) and addictions. Such impairments might involve different components of the reward process, including brain activity during reward anticipation. We examined brain nodes engaged by reward anticipation in 1,544 adolescents and identified a network containing a core striatal node and cortical nodes facilitating outcome prediction and response preparation. Distinct nodes and functional connections were preferentially associated with either adolescent hyperactivity or alcohol consumption, thus conveying specificity of reward processing to clinically relevant behavior. We observed associations between the striatal node, hyperactivity, and the vacuolar protein sorting-associated protein 4A (VPS4A) gene in humans, and the causal role of Vps4 for hyperactivity was validated in Drosophila Our data provide a neurobehavioral model explaining the heterogeneity of reward-related behaviors and generate a hypothesis accounting for their enduring nature.

Neural basis of reward anticipation and its genetic determinants

PubMed Central

Jia, Tianye; Macare, Christine; Desrivières, Sylvane; Gonzalez, Dante A.; Tao, Chenyang; Ji, Xiaoxi; Ruggeri, Barbara; Nees, Frauke; Banaschewski, Tobias; Barker, Gareth J.; Bokde, Arun L. W.; Bromberg, Uli; Büchel, Christian; Conrod, Patricia J.; Dove, Rachel; Gallinat, Jürgen; Garavan, Hugh; Gowland, Penny A.; Heinz, Andreas; Ittermann, Bernd; Lathrop, Mark; Lemaitre, Hervé; Martinot, Jean-Luc; Paus, Tomáš; Pausova, Zdenka; Poline, Jean-Baptiste; Rietschel, Marcella; Robbins, Trevor; Müller, Christian P.; Feng, Jianfeng; Rothenfluh, Adrian; Flor, Herta; Schumann, Gunter

2016-01-01

Dysfunctional reward processing is implicated in various mental disorders, including attention deficit hyperactivity disorder (ADHD) and addictions. Such impairments might involve different components of the reward process, including brain activity during reward anticipation. We examined brain nodes engaged by reward anticipation in 1,544 adolescents and identified a network containing a core striatal node and cortical nodes facilitating outcome prediction and response preparation. Distinct nodes and functional connections were preferentially associated with either adolescent hyperactivity or alcohol consumption, thus conveying specificity of reward processing to clinically relevant behavior. We observed associations between the striatal node, hyperactivity, and the vacuolar protein sorting-associated protein 4A (VPS4A) gene in humans, and the causal role of Vps4 for hyperactivity was validated in Drosophila. Our data provide a neurobehavioral model explaining the heterogeneity of reward-related behaviors and generate a hypothesis accounting for their enduring nature. PMID:27001827

Reward-related attentional bias and adolescent substance use: a prognostic relationship?

PubMed

van Hemel-Ruiter, Madelon E; de Jong, Peter J; Ostafin, Brian D; Oldehinkel, Albertine J

2015-01-01

Current cognitive-motivational addiction theories propose that prioritizing appetitive, reward-related information (attentional bias) plays a vital role in substance abuse behavior. Previous cross-sectional research has shown that adolescent substance use is related to reward-related attentional biases. The present study was designed to extend these findings by testing whether these reward biases have predictive value for adolescent substance use at three-year follow-up. Participants (N = 657, mean age = 16.2 yrs at baseline) were a sub-sample of Tracking Adolescents' Individual Lives Survey (TRAILS), a large longitudinal community cohort study. We used a spatial orienting task as a behavioral index of appetitive-related attentional processes at baseline and a substance use questionnaire at both baseline and three years follow-up. Bivariate correlational analyses showed that enhanced attentional engagement with cues that predicted potential reward and nonpunishment was positively associated with substance use (alcohol, tobacco, and cannabis) three years later. However, reward bias was not predictive of changes in substance use. A post-hoc analysis in a selection of adolescents who started using illicit drugs (other than cannabis) in the follow-up period demonstrated that stronger baseline attentional engagement toward cues of nonpunishment was related to a higher level of illicit drug use three years later. The finding that reward bias was not predictive for the increase in substance use in adolescents who already started using substances at baseline, but did show prognostic value in adolescents who initiated drug use in between baseline and follow-up suggests that appetitive bias might be especially important in the initiation stages of adolescent substance use.

Reward-Related Attentional Bias and Adolescent Substance Use: A Prognostic Relationship?

PubMed Central

van Hemel-Ruiter, Madelon E.; de Jong, Peter J.; Ostafin, Brian D.; Oldehinkel, Albertine J.

2015-01-01

Current cognitive-motivational addiction theories propose that prioritizing appetitive, reward-related information (attentional bias) plays a vital role in substance abuse behavior. Previous cross-sectional research has shown that adolescent substance use is related to reward-related attentional biases. The present study was designed to extend these findings by testing whether these reward biases have predictive value for adolescent substance use at three-year follow-up. Participants (N = 657, mean age = 16.2 yrs at baseline) were a sub-sample of Tracking Adolescents’ Individual Lives Survey (TRAILS), a large longitudinal community cohort study. We used a spatial orienting task as a behavioral index of appetitive-related attentional processes at baseline and a substance use questionnaire at both baseline and three years follow-up. Bivariate correlational analyses showed that enhanced attentional engagement with cues that predicted potential reward and nonpunishment was positively associated with substance use (alcohol, tobacco, and cannabis) three years later. However, reward bias was not predictive of changes in substance use. A post-hoc analysis in a selection of adolescents who started using illicit drugs (other than cannabis) in the follow-up period demonstrated that stronger baseline attentional engagement toward cues of nonpunishment was related to a higher level of illicit drug use three years later. The finding that reward bias was not predictive for the increase in substance use in adolescents who already started using substances at baseline, but did show prognostic value in adolescents who initiated drug use in between baseline and follow-up suggests that appetitive bias might be especially important in the initiation stages of adolescent substance use. PMID:25816295

A behavioral economic reward index predicts drinking resolutions: moderation revisited and compared with other outcomes.

PubMed

Tucker, Jalie A; Roth, David L; Vignolo, Mary J; Westfall, Andrew O

2009-04-01

Data were pooled from 3 studies of recently resolved community-dwelling problem drinkers to determine whether a behavioral economic index of the value of rewards available over different time horizons distinguished among moderation (n = 30), abstinent (n = 95), and unresolved (n = 77) outcomes. Moderation over 1- to 2-year prospective follow-up intervals was hypothesized to involve longer term behavior regulation processes than abstinence or relapse and to be predicted by more balanced preresolution monetary allocations between short-term and longer term objectives (i.e., drinking and saving for the future). Standardized odds ratios (ORs) based on changes in standard deviation units from a multinomial logistic regression indicated that increases on this "Alcohol-Savings Discretionary Expenditure" index predicted higher rates of abstinence (OR = 1.93, p = .004) and relapse (OR = 2.89, p < .0001) compared with moderation outcomes. The index had incremental utility in predicting moderation in complex models that included other established predictors. The study adds to evidence supporting a behavioral economic analysis of drinking resolutions and shows that a systematic analysis of preresolution spending patterns aids in predicting moderation.

Intrinsic Work Value-Reward Dissonance and Work Satisfaction during Young Adulthood

PubMed Central

Porfeli, Erik J.; Mortimer, Jeylan T.

2010-01-01

Previous research suggests that discrepancies between work values and rewards are indicators of dissonance that induce change in both to reduce such dissonance over time. The present study elaborates this model to suggest parallels with the first phase of the extension- and-strain curve. Small discrepancies or small increases in extension are presumed to be almost unnoticeable, while increasingly large discrepancies are thought to yield exponentially increasing strain. Work satisfaction is a principal outcome of dissonance; hence, work value-reward discrepancies are predicted to diminish work satisfaction in an exponential fashion. Findings from the work and family literature, however, lead to the prediction that this curvilinear association will be moderated by gender and family roles. Using longitudinal data spanning the third decade of life, the results suggest that intrinsic work value-reward discrepancies, as predicted, are increasingly associated, in a negative curvilinear fashion, with work satisfaction. This pattern, however, differs as a function of gender and family roles. Females who established family roles exhibited the expected pattern while other gender by family status groups did not. The results suggest that gender and family roles moderate the association between intrinsic work value-reward dissonance and satisfaction. In addition, women who remained unmarried and childless exhibited the strongest associations between occupational rewards and satisfaction. PMID:20526434

Intrinsic Work Value-Reward Dissonance and Work Satisfaction during Young Adulthood.

PubMed

Porfeli, Erik J; Mortimer, Jeylan T

2010-06-01

Previous research suggests that discrepancies between work values and rewards are indicators of dissonance that induce change in both to reduce such dissonance over time. The present study elaborates this model to suggest parallels with the first phase of the extension- and-strain curve. Small discrepancies or small increases in extension are presumed to be almost unnoticeable, while increasingly large discrepancies are thought to yield exponentially increasing strain. Work satisfaction is a principal outcome of dissonance; hence, work value-reward discrepancies are predicted to diminish work satisfaction in an exponential fashion. Findings from the work and family literature, however, lead to the prediction that this curvilinear association will be moderated by gender and family roles. Using longitudinal data spanning the third decade of life, the results suggest that intrinsic work value-reward discrepancies, as predicted, are increasingly associated, in a negative curvilinear fashion, with work satisfaction. This pattern, however, differs as a function of gender and family roles. Females who established family roles exhibited the expected pattern while other gender by family status groups did not. The results suggest that gender and family roles moderate the association between intrinsic work value-reward dissonance and satisfaction. In addition, women who remained unmarried and childless exhibited the strongest associations between occupational rewards and satisfaction.

Neural Response to Reward as a Predictor of Rise in Depressive Symptoms in Adolescence

PubMed Central

Morgan, Judith K.; Olino, Thomas M.; McMakin, Dana L.; Ryan, Neal D.; Forbes, Erika E.

2012-01-01

Adolescence is a developmental period characterized by significant increases in the onset of depression, but also by increases in depressive symptoms, even among psychiatrically healthy youth. Disrupted reward function has been postulated as a critical factor in the development of depression, but it is still unclear which adolescents are particularly at risk for rising depressive symptoms. We provide a conceptual stance on gender, pubertal development, and reward type as potential moderators of the association between neural response to reward and rises in depressive symptoms. In addition, we describe preliminary findings that support claims of this conceptual stance. We propose that (1) status-related rewards may be particularly salient for eliciting neural response relevant to depressive symptoms in boys, whereas social rewards may be more salient for eliciting neural response relevant to depressive symptoms in girls and (2) the pattern of reduced striatal response and enhanced medial prefrontal response to reward may be particularly predictive of depressive symptoms in pubertal adolescents. We found that greater vmPFC activation when winning rewards predicted greater increases in depressive symptoms over two years, for boys only, and less striatal activation when anticipating rewards predicted greater increases in depressive symptoms over two years, for adolescents in mid to late pubertal stages but not those in pre to early puberty. We also propose directions for future studies, including the investigation of social vs. monetary reward directly and the longitudinal assessment of parallel changes in pubertal development, neural response to reward, and depressive symptoms. PMID:22521464

The computational neurobiology of learning and reward.

PubMed

Daw, Nathaniel D; Doya, Kenji

2006-04-01

Following the suggestion that midbrain dopaminergic neurons encode a signal, known as a 'reward prediction error', used by artificial intelligence algorithms for learning to choose advantageous actions, the study of the neural substrates for reward-based learning has been strongly influenced by computational theories. In recent work, such theories have been increasingly integrated into experimental design and analysis. Such hybrid approaches have offered detailed new insights into the function of a number of brain areas, especially the cortex and basal ganglia. In part this is because these approaches enable the study of neural correlates of subjective factors (such as a participant's beliefs about the reward to be received for performing some action) that the computational theories purport to quantify.

Rewards.

PubMed

Gunderman, Richard B; Kamer, Aaron P

2011-05-01

For much of the 20th century, psychologists and economists operated on the assumption that work is devoid of intrinsic rewards, and the only way to get people to work harder is through the use of rewards and punishments. This so-called carrot-and-stick model of workplace motivation, when applied to medical practice, emphasizes the use of financial incentives and disincentives to manipulate behavior. More recently, however, it has become apparent that, particularly when applied to certain kinds of work, such approaches can be ineffective or even frankly counterproductive. Instead of focusing on extrinsic rewards such as compensation, organizations and their leaders need to devote more attention to the intrinsic rewards of work itself. This article reviews this new understanding of rewards and traces out its practical implications for radiology today. Copyright © 2011. Published by Elsevier Inc.

State-based versus reward-based motivation in younger and older adults.

PubMed

Worthy, Darrell A; Cooper, Jessica A; Byrne, Kaileigh A; Gorlick, Marissa A; Maddox, W Todd

2014-12-01

Recent decision-making work has focused on a distinction between a habitual, model-free neural system that is motivated toward actions that lead directly to reward and a more computationally demanding goal-directed, model-based system that is motivated toward actions that improve one's future state. In this article, we examine how aging affects motivation toward reward-based versus state-based decision making. Participants performed tasks in which one type of option provided larger immediate rewards but the alternative type of option led to larger rewards on future trials, or improvements in state. We predicted that older adults would show a reduced preference for choices that led to improvements in state and a greater preference for choices that maximized immediate reward. We also predicted that fits from a hybrid reinforcement-learning model would indicate greater model-based strategy use in younger than in older adults. In line with these predictions, older adults selected the options that maximized reward more often than did younger adults in three of the four tasks, and modeling results suggested reduced model-based strategy use. In the task where older adults showed similar behavior to younger adults, our model-fitting results suggested that this was due to the utilization of a win-stay-lose-shift heuristic rather than a more complex model-based strategy. Additionally, within older adults, we found that model-based strategy use was positively correlated with memory measures from our neuropsychological test battery. We suggest that this shift from state-based to reward-based motivation may be due to age related declines in the neural structures needed for more computationally demanding model-based decision making.

Increased neural responses to reward in adolescents and young adults with attention-deficit/hyperactivity disorder and their unaffected siblings.

PubMed

von Rhein, Daniel; Cools, Roshan; Zwiers, Marcel P; van der Schaaf, Marieke; Franke, Barbara; Luman, Marjolein; Oosterlaan, Jaap; Heslenfeld, Dirk J; Hoekstra, Pieter J; Hartman, Catharina A; Faraone, Stephen V; van Rooij, Daan; van Dongen, Eelco V; Lojowska, Maria; Mennes, Maarten; Buitelaar, Jan

2015-05-01

Attention-deficit/hyperactivity disorder (ADHD) is a heritable neuropsychiatric disorder associated with abnormal reward processing. Limited and inconsistent data exist about the neural mechanisms underlying this abnormality. Furthermore, it is not known whether reward processing is abnormal in unaffected siblings of participants with ADHD. We used event-related functional magnetic resonance imaging (fMRI) to investigate brain responses during reward anticipation and receipt with an adapted monetary incentive delay task in a large sample of adolescents and young adults with ADHD (n = 150), their unaffected siblings (n = 92), and control participants (n = 108), all of the same age. Participants with ADHD showed, relative to control participants, increased responses in the anterior cingulate, anterior frontal cortex, and cerebellum during reward anticipation, and in the orbitofrontal, occipital cortex and ventral striatum. Responses of unaffected siblings were increased in these regions as well, except for the cerebellum during anticipation and ventral striatum during receipt. ADHD in adolescents and young adults is associated with enhanced neural responses in frontostriatal circuitry to anticipation and receipt of reward. The findings support models emphasizing aberrant reward processing in ADHD, and suggest that processing of reward is subject to familial influences. Future studies using standard monetary incentive delay task parameters are needed to replicate our findings. Copyright © 2015 American Academy of Child and Adolescent Psychiatry. Published by Elsevier Inc. All rights reserved.

Learning shapes the aversion and reward responses of lateral habenula neurons

PubMed Central

Wang, Daqing; Li, Yi; Feng, Qiru; Guo, Qingchun; Zhou, Jingfeng; Luo, Minmin

2017-01-01

The lateral habenula (LHb) is believed to encode negative motivational values. It remains unknown how LHb neurons respond to various stressors and how learning shapes their responses. Here, we used fiber-photometry and electrophysiology to track LHb neuronal activity in freely-behaving mice. Bitterness, pain, and social attack by aggressors intensively excite LHb neurons. Aversive Pavlovian conditioning induced activation by the aversion-predicting cue in a few trials. The experience of social defeat also conditioned excitatory responses to previously neutral social stimuli. In contrast, fiber photometry and single-unit recordings revealed that sucrose reward inhibited LHb neurons and often produced excitatory rebound. It required prolonged conditioning and high reward probability to induce inhibition by reward-predicting cues. Therefore, LHb neurons can bidirectionally process a diverse array of aversive and reward signals. Importantly, their responses are dynamically shaped by learning, suggesting that the LHb participates in experience-dependent selection of behavioral responses to stressors and rewards. DOI: http://dx.doi.org/10.7554/eLife.23045.001 PMID:28561735

Reward sensitivity, decisional bias, and metacognitive deficits in cocaine drug addiction.

PubMed

Balconi, Michela; Finocchiaro, Roberta; Campanella, Salvatore

2014-01-01

The present research explored the effect of reward sensitivity bias and metacognitive deficits on substance use disorder (SUD) in the decision-making process. The behavioral activation system (BAS) was used as a predictive marker of dysfunctional behavior during the Iowa gambling task (IGT). We also tried to relate this motivational system bias to self-reported metacognitive measures (self-knowledge, strategic planning, flexibility, and efficacy) in the decision processes. Thirty-four SUD participants (cocaine dependent) and 39 participants in the control group underwent the IGT. The SUD group was associated with a poorer performance on the IGT and a dysfunctional metacognition ability (unrealistic representation). An increase in the reward sensitivity (higher BAS, BAS reward responsiveness, and BAS reward) was observed in the SUD group compared with the control group and explained (through a regression analysis) the main behavioral deficits. More generally, an increase in the BAS reward responsiveness may be considered a predictive measure of risk-taking and dysfunctional behavior, not only in pathological (SUD) individuals, but also in subclinical individuals (controls). We discuss the likely cognitive, brain, and neurotransmitter contributions to this phenomenon.

Listening to music in a risk-reward context: The roles of the temporoparietal junction and the orbitofrontal/insular cortices in reward-anticipation, reward-gain, and reward-loss.

PubMed

Li, Chia-Wei; Chen, Jyh-Horng; Tsai, Chen-Gia

2015-12-10

Artificial rewards, such as visual arts and music, produce pleasurable feelings. Popular songs in the verse-chorus form provide a useful model for understanding the neural mechanisms underlying the processing of artificial rewards, because the chorus is usually the most rewarding element of a song. In this functional magnetic resonance imaging (fMRI) study, the stimuli were excerpts of 10 popular songs with a tensioned verse-to-chorus transition. We examined the neural correlates of three phases of reward processing: (1) reward-anticipation during the verse-to-chorus transition, (2) reward-gain during the first phrase of the chorus, and (3) reward-loss during the unexpected noise followed by the verse-to-chorus transition. Participants listened to these excerpts in a risk-reward context because the verse was followed by either the chorus or noise with equal probability. The results showed that reward-gain and reward-loss were associated with left- and right-biased temporoparietal junction activation, respectively. The bilateral temporoparietal junctions were active during reward-anticipation. Moreover, we observed left-biased lateral orbitofrontal activation during reward-anticipation, whereas the medial orbitofrontal cortex was activated during reward-gain. The findings are discussed in relation to the cognitive and emotional aspects of reward processing. Copyright © 2015 Elsevier B.V. All rights reserved.

Reward Pays the Cost of Noise Reduction in Motor and Cognitive Control.

PubMed

Manohar, Sanjay G; Chong, Trevor T-J; Apps, Matthew A J; Batla, Amit; Stamelou, Maria; Jarman, Paul R; Bhatia, Kailash P; Husain, Masud

2015-06-29

Speed-accuracy trade-off is an intensively studied law governing almost all behavioral tasks across species. Here we show that motivation by reward breaks this law, by simultaneously invigorating movement and improving response precision. We devised a model to explain this paradoxical effect of reward by considering a new factor: the cost of control. Exerting control to improve response precision might itself come at a cost--a cost to attenuate a proportion of intrinsic neural noise. Applying a noise-reduction cost to optimal motor control predicted that reward can increase both velocity and accuracy. Similarly, application to decision-making predicted that reward reduces reaction times and errors in cognitive control. We used a novel saccadic distraction task to quantify the speed and accuracy of both movements and decisions under varying reward. Both faster speeds and smaller errors were observed with higher incentives, with the results best fitted by a model including a precision cost. Recent theories consider dopamine to be a key neuromodulator in mediating motivational effects of reward. We therefore examined how Parkinson's disease (PD), a condition associated with dopamine depletion, alters the effects of reward. Individuals with PD showed reduced reward sensitivity in their speed and accuracy, consistent in our model with higher noise-control costs. Including a cost of control over noise explains how reward may allow apparent performance limits to be surpassed. On this view, the pattern of reduced reward sensitivity in PD patients can specifically be accounted for by a higher cost for controlling noise. Copyright © 2015 The Authors. Published by Elsevier Ltd.. All rights reserved.

Irrelevant learned reward associations disrupt voluntary spatial attention.

PubMed

MacLean, Mary H; Diaz, Gisella K; Giesbrecht, Barry

2016-10-01

Attention can be guided involuntarily by physical salience and by non-salient, previously learned reward associations that are currently task-irrelevant. Attention can be guided voluntarily by current goals and expectations. The current study examined, in two experiments, whether irrelevant reward associations could disrupt current, goal-driven, voluntary attention. In a letter-search task, attention was directed voluntarily (i.e., cued) on half the trials by a cue stimulus indicating the hemifield in which the target letter would appear with 100 % accuracy. On the other half of the trials, a cue stimulus was presented, but it did not provide information about the target hemifield (i.e., uncued). On both cued and uncued trials, attention could be involuntarily captured by the presence of a task-irrelevant, and physically non-salient, color, either within the cued or the uncued hemifield. Importantly, one week prior to the letter search task, the irrelevant color had served as a target feature that was predictive of reward in a separate training task. Target identification accuracy was better on cued compared to uncued trials. However, this effect was reduced when the irrelevant, and physically non-salient, reward-associated feature was present in the uncued hemifield. This effect was not observed in a second, control experiment in which the irrelevant color was not predictive of reward during training. Our results indicate that involuntary, value-driven capture can disrupt the voluntary control of spatial attention.

Disentangling reward anticipation with simultaneous pupillometry / fMRI.

PubMed

Schneider, Max; Leuchs, Laura; Czisch, Michael; Sämann, Philipp G; Spoormaker, Victor I

2018-05-05

The reward system may provide an interesting intermediate phenotype for anhedonia in affective disorders. Reward anticipation is characterized by an increase in arousal, and previous studies have linked the anterior cingulate cortex (ACC) to arousal responses such as dilation of the pupil. Here, we examined pupil dynamics during a reward anticipation task in forty-six healthy human subjects and evaluated its neural correlates using functional magnetic resonance imaging (fMRI). Pupil size showed a strong increase during monetary reward anticipation, a moderate increase during verbal reward anticipation and a decrease during control trials. For fMRI analyses, average pupil size and pupil change were computed in 1-s time bins during the anticipation phase. Activity in the ventral striatum was inversely related to the pupil size time course, indicating an early onset of activation and a role in reward prediction processing. Pupil dilations were linked to increased activity in the salience network (dorsal ACC and bilateral insula), which likely triggers an increase in arousal to enhance task performance. Finally, increased pupil size preceding the required motor response was associated with activity in the ventral attention network. In sum, pupillometry provides an effective tool for disentangling different phases of reward anticipation, with relevance for affective symptomatology. Copyright © 2018 Elsevier Inc. All rights reserved.

Determination of aberration center of Ronchigram for automated aberration correctors in scanning transmission electron microscopy.

PubMed

Sannomiya, Takumi; Sawada, Hidetaka; Nakamichi, Tomohiro; Hosokawa, Fumio; Nakamura, Yoshio; Tanishiro, Yasumasa; Takayanagi, Kunio

2013-12-01

A generic method to determine the aberration center is established, which can be utilized for aberration calculation and axis alignment for aberration corrected electron microscopes. In this method, decentering induced secondary aberrations from inherent primary aberrations are minimized to find the appropriate axis center. The fitness function to find the optimal decentering vector for the axis was defined as a sum of decentering induced secondary aberrations with properly distributed weight values according to the aberration order. Since the appropriate decentering vector is determined from the aberration values calculated at an arbitrary center axis, only one aberration measurement is in principle required to find the center, resulting in /very fast center search. This approach was tested for the Ronchigram based aberration calculation method for aberration corrected scanning transmission electron microscopy. Both in simulation and in experiments, the center search was confirmed to work well although the convergence to find the best axis becomes slower with larger primary aberrations. Such aberration center determination is expected to fully automatize the aberration correction procedures, which used to require pre-alignment of experienced users. This approach is also applicable to automated aperture positioning. Copyright © 2013 Elsevier B.V. All rights reserved.

Girls' challenging social experiences in early adolescence predict neural response to rewards and depressive symptoms.

PubMed

Casement, Melynda D; Guyer, Amanda E; Hipwell, Alison E; McAloon, Rose L; Hoffmann, Amy M; Keenan, Kathryn E; Forbes, Erika E

2014-04-01

Developmental models of psychopathology posit that exposure to social stressors may confer risk for depression in adolescent girls by disrupting neural reward circuitry. The current study tested this hypothesis by examining the relationship between early adolescent social stressors and later neural reward processing and depressive symptoms. Participants were 120 girls from an ongoing longitudinal study of precursors to depression across adolescent development. Low parental warmth, peer victimization, and depressive symptoms were assessed when the girls were 11 and 12 years old, and participants completed a monetary reward guessing fMRI task and assessment of depressive symptoms at age 16. Results indicate that low parental warmth was associated with increased response to potential rewards in the medial prefrontal cortex (mPFC), striatum, and amygdala, whereas peer victimization was associated with decreased response to potential rewards in the mPFC. Furthermore, concurrent depressive symptoms were associated with increased reward anticipation response in mPFC and striatal regions that were also associated with early adolescent psychosocial stressors, with mPFC and striatal response mediating the association between social stressors and depressive symptoms. These findings are consistent with developmental models that emphasize the adverse impact of early psychosocial stressors on neural reward processing and risk for depression in adolescence. Copyright © 2013 The Authors. Published by Elsevier Ltd.. All rights reserved.

Depression-Related Increases and Decreases in Appetite: Dissociable Patterns of Aberrant Activity in Reward and Interoceptive Neurocircuitry.

PubMed

Simmons, W Kyle; Burrows, Kaiping; Avery, Jason A; Kerr, Kara L; Bodurka, Jerzy; Savage, Cary R; Drevets, Wayne C

2016-04-01

Appetite and weight changes are common but variable diagnostic markers in major depressive disorder: some depressed individuals manifest increased appetite, while others lose their appetite. Many of the brain regions implicated in appetitive responses to food have also been implicated in depression. It is thus remarkable that there exists no published research comparing the neural responses to food stimuli of depressed patients with increased versus decreased appetites. Using functional MRI, brain activity was compared in unmedicated depressed patients with increased or decreased appetite and healthy control subjects while viewing photographs of food and nonfood objects. The authors also measured how resting-state functional connectivity related to subjects' food pleasantness ratings. Within putative reward regions, depressed participants with increased appetites exhibited greater hemodynamic activity to food stimuli than both those reporting appetite decreases and healthy control subjects. In contrast, depressed subjects experiencing appetite loss exhibited hypoactivation within a region of the mid-insula implicated in interoception, with no difference observed in this region between healthy subjects and those with depression-related appetite increases. Mid-insula activity was negatively correlated with food pleasantness ratings of depressed participants with increased appetites, and its functional connectivity to reward circuitry was positively correlated with food pleasantness ratings. Depression-related increases in appetite are associated with hyperactivation of putative mesocorticolimbic reward circuitry, while depression-related appetite loss is associated with hypoactivation of insular regions that support monitoring the body's physiological state. Importantly, the interactions among these regions also contribute to individual differences in the depression-related appetite changes.

Nanofocusing with aberration-corrected rotationally parabolic refractive X-ray lenses

DOE PAGES

Seiboth, Frank; Wittwer, Felix; Scholz, Maria; ...

2018-01-01

Wavefront errors of rotationally parabolic refractive X-ray lenses made of beryllium (Be CRLs) have been recovered for various lens sets and X-ray beam configurations. Due to manufacturing via an embossing process, aberrations of individual lenses within the investigated ensemble are very similar. By deriving a mean single-lens deformation for the ensemble, aberrations of any arbitrary lens stack can be predicted from the ensemble with σ¯ = 0.034λ. Using these findings the expected focusing performance of current Be CRLs are modeled for relevant X-ray energies and bandwidths and it is shown that a correction of aberrations can be realised without priormore » lens characterization but simply based on the derived lens deformation. As a result, the performance of aberration-corrected Be CRLs is discussed and the applicability of aberration-correction demonstrated over wide X-ray energy ranges.« less

Reward deficiency and anti-reward in pain chronification.

PubMed

Borsook, D; Linnman, C; Faria, V; Strassman, A M; Becerra, L; Elman, I

2016-09-01

Converging lines of evidence suggest that the pathophysiology of pain is mediated to a substantial degree via allostatic neuroadaptations in reward- and stress-related brain circuits. Thus, reward deficiency (RD) represents a within-system neuroadaptation to pain-induced protracted activation of the reward circuits that leads to depletion-like hypodopaminergia, clinically manifested anhedonia, and diminished motivation for natural reinforcers. Anti-reward (AR) conversely pertains to a between-systems neuroadaptation involving over-recruitment of key limbic structures (e.g., the central and basolateral amygdala nuclei, the bed nucleus of the stria terminalis, the lateral tegmental noradrenergic nuclei of the brain stem, the hippocampus and the habenula) responsible for massive outpouring of stressogenic neurochemicals (e.g., norepinephrine, corticotropin releasing factor, vasopressin, hypocretin, and substance P) giving rise to such negative affective states as anxiety, fear and depression. We propose here the Combined Reward deficiency and Anti-reward Model (CReAM), in which biopsychosocial variables modulating brain reward, motivation and stress functions can interact in a 'downward spiral' fashion to exacerbate the intensity, chronicity and comorbidities of chronic pain syndromes (i.e., pain chronification). Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

Enriched encoding: reward motivation organizes cortical networks for hippocampal detection of unexpected events.

PubMed

Murty, Vishnu P; Adcock, R Alison

2014-08-01

Learning how to obtain rewards requires learning about their contexts and likely causes. How do long-term memory mechanisms balance the need to represent potential determinants of reward outcomes with the computational burden of an over-inclusive memory? One solution would be to enhance memory for salient events that occur during reward anticipation, because all such events are potential determinants of reward. We tested whether reward motivation enhances encoding of salient events like expectancy violations. During functional magnetic resonance imaging, participants performed a reaction-time task in which goal-irrelevant expectancy violations were encountered during states of high- or low-reward motivation. Motivation amplified hippocampal activation to and declarative memory for expectancy violations. Connectivity of the ventral tegmental area (VTA) with medial prefrontal, ventrolateral prefrontal, and visual cortices preceded and predicted this increase in hippocampal sensitivity. These findings elucidate a novel mechanism whereby reward motivation can enhance hippocampus-dependent memory: anticipatory VTA-cortical-hippocampal interactions. Further, the findings integrate literatures on dopaminergic neuromodulation of prefrontal function and hippocampus-dependent memory. We conclude that during reward motivation, VTA modulation induces distributed neural changes that amplify hippocampal signals and records of expectancy violations to improve predictions-a potentially unique contribution of the hippocampus to reward learning. © The Author 2013. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

Crash risk and aberrant driving behaviors among bus drivers: the role of personality and attitudes towards traffic safety.

PubMed

Mallia, Luca; Lazuras, Lambros; Violani, Cristiano; Lucidi, Fabio

2015-06-01

Several studies have shown that personality traits and attitudes toward traffic safety predict aberrant driving behaviors and crash involvement. However, this process has not been adequately investigated in professional drivers, such as bus drivers. The present study used a personality-attitudes model to assess whether personality traits predicted aberrant self-reported driving behaviors (driving violations, lapses, and errors) both directly and indirectly, through the effects of attitudes towards traffic safety in a large sample of bus drivers. Additionally, the relationship between aberrant self-reported driving behaviors and crash risk was also assessed. Three hundred and one bus drivers (mean age=39.1, SD=10.7 years) completed a structured and anonymous questionnaire measuring personality traits, attitudes toward traffic safety, self-reported aberrant driving behaviors (i.e., errors, lapses, and traffic violations), and accident risk in the last 12 months. Structural equation modeling analysis revealed that personality traits were associated to aberrant driving behaviors both directly and indirectly. In particular altruism, excitement seeking, and normlessness directly predicted bus drivers' attitudes toward traffic safety which, in turn, were negatively associated with the three types of self-reported aberrant driving behaviors. Personality traits relevant to emotionality directly predicted bus drivers' aberrant driving behaviors, without any mediation of attitudes. Finally, only self-reported violations were related to bus drivers' accident risk. The present findings suggest that the hypothesized personality-attitudes model accounts for aberrant driving behaviors in bus drivers, and provide the empirical basis for evidence-based road safety interventions in the context of public transport. Copyright © 2015 Elsevier Ltd. All rights reserved.

Aberrant learning in Parkinson's disease: A neurocomputational study on bradykinesia.

PubMed

Ursino, Mauro; Baston, Chiara

2018-05-22

Parkinson's disease (PD) is a neurodegenerative disorder characterized by a progressive decline in motor functions, such as bradykinesia, caused by the pathological denervation of nigrostriatal dopaminergic neurons within the basal ganglia (BG). It is acknowledged that dopamine (DA) directly affects the modulatory role of BG towards the cortex. However, a growing body of literature is suggesting that DA-induced aberrant synaptic plasticity could play a role in the core symptoms of PD, thus recalling for a "reconceptualization" of the pathophysiology. The aim of this work was to investigate DA-driven aberrant learning as a concurrent cause of bradykinesia, using a comprehensive, biologically inspired neurocomputational model of action selection in the BG. The model includes the three main pathways operating in the BG circuitry, that is the direct, indirect and hyperdirect pathways, and use a two-term Hebb rule to train synapses in the striatum, based on previous history of rewards and punishments. Levodopa pharmacodynamics is also incorporated. Through model simulations of the Alternate Finger Tapping motor task, we assessed the role of aberrant learning on bradykinesia. The results show that training under drug medication (levodopa) provides not only immediate but also delayed benefit lasting in time. Conversely, if performed in conditions of vanishing levodopa efficacy, training may result in dysfunctional corticostriatal synaptic plasticity, further worsening motor performances in PD subjects. This suggests that bradykinesia may result from the concurrent effects of low DA levels and dysfunctional plasticity and that training can be exploited in medicated subjects to improve levodopa treatment. © 2018 Federation of European Neuroscience Societies and John Wiley & Sons Ltd.

Recombinant Temporal Aberration Detection Algorithms for Enhanced Biosurveillance

PubMed Central

Murphy, Sean Patrick; Burkom, Howard

2008-01-01

Objective Broadly, this research aims to improve the outbreak detection performance and, therefore, the cost effectiveness of automated syndromic surveillance systems by building novel, recombinant temporal aberration detection algorithms from components of previously developed detectors. Methods This study decomposes existing temporal aberration detection algorithms into two sequential stages and investigates the individual impact of each stage on outbreak detection performance. The data forecasting stage (Stage 1) generates predictions of time series values a certain number of time steps in the future based on historical data. The anomaly measure stage (Stage 2) compares features of this prediction to corresponding features of the actual time series to compute a statistical anomaly measure. A Monte Carlo simulation procedure is then used to examine the recombinant algorithms’ ability to detect synthetic aberrations injected into authentic syndromic time series. Results New methods obtained with procedural components of published, sometimes widely used, algorithms were compared to the known methods using authentic datasets with plausible stochastic injected signals. Performance improvements were found for some of the recombinant methods, and these improvements were consistent over a range of data types, outbreak types, and outbreak sizes. For gradual outbreaks, the WEWD MovAvg7+WEWD Z-Score recombinant algorithm performed best; for sudden outbreaks, the HW+WEWD Z-Score performed best. Conclusion This decomposition was found not only to yield valuable insight into the effects of the aberration detection algorithms but also to produce novel combinations of data forecasters and anomaly measures with enhanced detection performance. PMID:17947614

Individual differences in the attribution of incentive salience to reward-related cues: Implications for addiction.

PubMed

Flagel, Shelly B; Akil, Huda; Robinson, Terry E

2009-01-01

Drugs of abuse acquire different degrees of control over thoughts and actions based not only on the effects of drugs themselves, but also on predispositions of the individual. Those individuals who become addicted are unable to shift their thoughts and actions away from drugs and drug-associated stimuli. Thus in addicts, exposure to places or things (cues) that has been previously associated with drug-taking often instigates renewed drug-taking. We and others have postulated that drug-associated cues acquire the ability to maintain and instigate drug-taking behavior in part because they acquire incentive motivational properties through Pavlovian (stimulus-stimulus) learning. In the case of compulsive behavioral disorders, including addiction, such cues may be attributed with pathological incentive value ("incentive salience"). For this reason, we have recently begun to explore individual differences in the tendency to attribute incentive salience to cues that predict rewards. When discrete cues are associated with the non-contingent delivery of food or drug rewards some animals come to quickly approach and engage the cue even if it is located at a distance from where the reward will be delivered. In these animals the reward-predictive cue itself becomes attractive, eliciting approach towards it, presumably because it is attributed with incentive salience. Animals that develop this type of conditional response are called "sign-trackers". Other animals, "goal-trackers", do not approach the reward-predictive cue, but upon cue presentation they immediately go to the location where food will be delivered (the "goal"). For goal-trackers the reward-predictive cue is not attractive, presumably because it is not attributed with incentive salience. We review here preliminary data suggesting that these individual differences in the tendency to attribute incentive salience to cues predictive of reward may confer vulnerability or resistance to compulsive behavioral disorders

A Tribute to Charlie Chaplin: Induced Positive Affect Improves Reward-Based Decision-Learning in Parkinson’s Disease

PubMed Central

Ridderinkhof, K. Richard; van Wouwe, Nelleke C.; Band, Guido P. H.; Wylie, Scott A.; Van der Stigchel, Stefan; van Hees, Pieter; Buitenweg, Jessika; van de Vijver, Irene; van den Wildenberg, Wery P. M.

2012-01-01

Reward-based decision-learning refers to the process of learning to select those actions that lead to rewards while avoiding actions that lead to punishments. This process, known to rely on dopaminergic activity in striatal brain regions, is compromised in Parkinson’s disease (PD). We hypothesized that such decision-learning deficits are alleviated by induced positive affect, which is thought to incur transient boosts in midbrain and striatal dopaminergic activity. Computational measures of probabilistic reward-based decision-learning were determined for 51 patients diagnosed with PD. Previous work has shown these measures to rely on the nucleus caudatus (outcome evaluation during the early phases of learning) and the putamen (reward prediction during later phases of learning). We observed that induced positive affect facilitated learning, through its effects on reward prediction rather than outcome evaluation. Viewing a few minutes of comedy clips served to remedy dopamine-related problems associated with frontostriatal circuitry and, consequently, learning to predict which actions will yield reward. PMID:22707944

Sensitivity of Locus Ceruleus Neurons to Reward Value for Goal-Directed Actions

PubMed Central

Richmond, Barry J.

2015-01-01

The noradrenergic nucleus locus ceruleus (LC) is associated classically with arousal and attention. Recent data suggest that it might also play a role in motivation. To study how LC neuronal responses are related to motivational intensity, we recorded 121 single neurons from two monkeys while reward size (one, two, or four drops) and the manner of obtaining reward (passive vs active) were both manipulated. The monkeys received reward under three conditions: (1) releasing a bar when a visual target changed color; (2) passively holding a bar; or (3) touching and releasing a bar. In the first two conditions, a visual cue indicated the size of the upcoming reward, and, in the third, the reward was constant through each block of 25 trials. Performance levels and lipping intensity (an appetitive behavior) both showed that the monkeys' motivation in the task was related to the predicted reward size. In conditions 1 and 2, LC neurons were activated phasically in relation to cue onset, and this activation strengthened with increasing expected reward size. In conditions 1 and 3, LC neurons were activated before the bar-release action, and the activation weakened with increasing expected reward size but only in task 1. These effects evolved as monkeys progressed through behavioral sessions, because increasing fatigue and satiety presumably progressively decreased the value of the upcoming reward. These data indicate that LC neurons integrate motivationally relevant information: both external cues and internal drives. The LC might provide the impetus to act when the predicted outcome value is low. PMID:25740528

Reward uncertainty enhances incentive salience attribution as sign-tracking

PubMed Central

Anselme, Patrick; Robinson, Mike J. F.; Berridge, Kent C.

2014-01-01

Conditioned stimuli (CSs) come to act as motivational magnets following repeated association with unconditioned stimuli (UCSs) such as sucrose rewards. By traditional views, the more reliably predictive a Pavlovian CS-UCS association, the more the CS becomes attractive. However, in some cases, less predictability might equal more motivation. Here we examined the effect of introducing uncertainty in CS-UCS association on CS strength as an attractive motivation magnet. In the present study, Experiment 1 assessed the effects of Pavlovian predictability versus uncertainty about reward probability and/or reward magnitude on the acquisition and expression of sign-tracking (ST) and goal-tracking (GT) responses in an autoshaping procedure. Results suggested that uncertainty produced strongest incentive salience expressed as sign-tracking. Experiment 2 examined whether a within-individual temporal shift from certainty to uncertainty conditions could produce a stronger CS motivational magnet when uncertainty began, and found that sign-tracking still increased after the shift. Overall, our results support earlier reports that ST responses become more pronounced in the presence of uncertainty regarding CS-UCS associations, especially when uncertainty combines both probability and magnitude. These results suggest that Pavlovian uncertainty, although diluting predictability, is still able to enhance the incentive motivational power of particular CSs. PMID:23078951

Markov reward processes

NASA Technical Reports Server (NTRS)

Smith, R. M.

1991-01-01

Numerous applications in the area of computer system analysis can be effectively studied with Markov reward models. These models describe the behavior of the system with a continuous-time Markov chain, where a reward rate is associated with each state. In a reliability/availability model, upstates may have reward rate 1 and down states may have reward rate zero associated with them. In a queueing model, the number of jobs of certain type in a given state may be the reward rate attached to that state. In a combined model of performance and reliability, the reward rate of a state may be the computational capacity, or a related performance measure. Expected steady-state reward rate and expected instantaneous reward rate are clearly useful measures of the Markov reward model. More generally, the distribution of accumulated reward or time-averaged reward over a finite time interval may be determined from the solution of the Markov reward model. This information is of great practical significance in situations where the workload can be well characterized (deterministically, or by continuous functions e.g., distributions). The design process in the development of a computer system is an expensive and long term endeavor. For aerospace applications the reliability of the computer system is essential, as is the ability to complete critical workloads in a well defined real time interval. Consequently, effective modeling of such systems must take into account both performance and reliability. This fact motivates our use of Markov reward models to aid in the development and evaluation of fault tolerant computer systems.

Aerobic exercise modulates anticipatory reward processing via the μ-opioid receptor system.

PubMed

Saanijoki, Tiina; Nummenmaa, Lauri; Tuulari, Jetro J; Tuominen, Lauri; Arponen, Eveliina; Kalliokoski, Kari K; Hirvonen, Jussi

2018-06-08

Physical exercise modulates food reward and helps control body weight. The endogenous µ-opioid receptor (MOR) system is involved in rewarding aspects of both food and physical exercise, yet interaction between endogenous opioid release following exercise and anticipatory food reward remains unresolved. Here we tested whether exercise-induced opioid release correlates with increased anticipatory reward processing in humans. We scanned 24 healthy lean men after rest and after a 1 h session of aerobic exercise with positron emission tomography (PET) using MOR-selective radioligand [ 11 C]carfentanil. After both PET scans, the subjects underwent a functional magnetic resonance imaging (fMRI) experiment where they viewed pictures of palatable versus nonpalatable foods to trigger anticipatory food reward responses. Exercise-induced changes in MOR binding in key regions of reward circuit (amygdala, thalamus, ventral and dorsal striatum, and orbitofrontal and cingulate cortices) were used to predict the changes in anticipatory reward responses in fMRI. Exercise-induced changes in MOR binding correlated negatively with the exercise-induced changes in neural anticipatory food reward responses in orbitofrontal and cingulate cortices, insula, ventral striatum, amygdala, and thalamus: higher exercise-induced opioid release predicted higher brain responses to palatable versus nonpalatable foods. We conclude that MOR activation following exercise may contribute to the considerable interindividual variation in food craving and consumption after exercise, which might promote compensatory eating and compromise weight control. © 2018 Wiley Periodicals, Inc.

Distinct medial temporal networks encode surprise during motivation by reward versus punishment

PubMed Central

Murty, Vishnu P.; LaBar, Kevin S.; Adcock, R. Alison

2016-01-01

Adaptive motivated behavior requires predictive internal representations of the environment, and surprising events are indications for encoding new representations of the environment. The medial temporal lobe memory system, including the hippocampus and surrounding cortex, encodes surprising events and is influenced by motivational state. Because behavior reflects the goals of an individual, we investigated whether motivational valence (i.e., pursuing rewards versus avoiding punishments) also impacts neural and mnemonic encoding of surprising events. During functional magnetic resonance imaging (fMRI), participants encountered perceptually unexpected events either during the pursuit of rewards or avoidance of punishments. Despite similar levels of motivation across groups, reward and punishment facilitated the processing of surprising events in different medial temporal lobe regions. Whereas during reward motivation, perceptual surprises enhanced activation in the hippocampus, during punishment motivation surprises instead enhanced activation in parahippocampal cortex. Further, we found that reward motivation facilitated hippocampal coupling with ventromedial PFC, whereas punishment motivation facilitated parahippocampal cortical coupling with orbitofrontal cortex. Behaviorally, post-scan testing revealed that reward, but not punishment, motivation resulted in greater memory selectivity for surprising events encountered during goal pursuit. Together these findings demonstrate that neuromodulatory systems engaged by anticipation of reward and punishment target separate components of the medial temporal lobe, modulating medial temporal lobe sensitivity and connectivity. Thus, reward and punishment motivation yield distinct neural contexts for learning, with distinct consequences for how surprises are incorporated into predictive mnemonic models of the environment. PMID:26854903

Distinct medial temporal networks encode surprise during motivation by reward versus punishment.

PubMed

Murty, Vishnu P; LaBar, Kevin S; Adcock, R Alison

2016-10-01

Adaptive motivated behavior requires predictive internal representations of the environment, and surprising events are indications for encoding new representations of the environment. The medial temporal lobe memory system, including the hippocampus and surrounding cortex, encodes surprising events and is influenced by motivational state. Because behavior reflects the goals of an individual, we investigated whether motivational valence (i.e., pursuing rewards versus avoiding punishments) also impacts neural and mnemonic encoding of surprising events. During functional magnetic resonance imaging (fMRI), participants encountered perceptually unexpected events either during the pursuit of rewards or avoidance of punishments. Despite similar levels of motivation across groups, reward and punishment facilitated the processing of surprising events in different medial temporal lobe regions. Whereas during reward motivation, perceptual surprises enhanced activation in the hippocampus, during punishment motivation surprises instead enhanced activation in parahippocampal cortex. Further, we found that reward motivation facilitated hippocampal coupling with ventromedial PFC, whereas punishment motivation facilitated parahippocampal cortical coupling with orbitofrontal cortex. Behaviorally, post-scan testing revealed that reward, but not punishment, motivation resulted in greater memory selectivity for surprising events encountered during goal pursuit. Together these findings demonstrate that neuromodulatory systems engaged by anticipation of reward and punishment target separate components of the medial temporal lobe, modulating medial temporal lobe sensitivity and connectivity. Thus, reward and punishment motivation yield distinct neural contexts for learning, with distinct consequences for how surprises are incorporated into predictive mnemonic models of the environment. Copyright © 2016 Elsevier Inc. All rights reserved.

Sensitivity for Cues Predicting Reward and Punishment in Young Women with Eating Disorders.

PubMed

Matton, Annelies; de Jong, Peter; Goossens, Lien; Jonker, Nienke; Van Malderen, Eva; Vervaet, Myriam; De Schryver, Nele; Braet, Caroline

2017-11-01

Increasing evidence shows that sensitivity to reward (SR) and punishment (SP) may be involved in eating disorders (EDs). Most studies used self-reported positive/negative effect in rewarding/punishing situations, whereas the implied proneness to detect signals of reward/punishment is largely ignored. This pilot study used a spatial orientation task to examine transdiagnostic and interdiagnostic differences in SR/SP. Participants (14-29 years) were patients with anorexia nervosa of restricting type (AN-R, n = 20), binge/purge ED group [AN of binge/purge type and bulimia nervosa (n = 16)] and non-symptomatic individuals (n = 23). Results revealed stronger difficulties to redirect attention away from signals of rewards in AN-R compared with binge/purge EDs, and binge/purge EDs showed stronger difficulties to direct attention away from signals of punishment compared with AN-R. Findings demonstrate interdiagnostic differences and show that the spatial orientation task is sensitive for individual differences in SP/SR within the context of EDs, thereby sustaining its usefulness as behavioural measure of reinforcement sensitivity. Copyright © 2017 John Wiley & Sons, Ltd and Eating Disorders Association. Copyright © 2017 John Wiley & Sons, Ltd and Eating Disorders Association.

Invigoration of reward-seeking by cue and proximity encoding in the nucleus accumbens

PubMed Central

McGinty, Vincent B.; Lardeux, Sylvie; Taha, Sharif A.; Kim, James J.; Nicola, Saleem M.

2014-01-01

Summary A key function of the nucleus accumbens is to promote vigorous reward-seeking, but the corresponding neural mechanism has not been identified despite many years of research. Here we study cued flexible approach behavior, a form of reward-seeking that strongly depends on the accumbens, and we describe a robust, single-cell neural correlate of behavioral vigor in the excitatory response of accumbens neurons to reward-predictive cues. Well before locomotion begins, this cue-evoked excitation predicts both the movement initiation latency and speed of subsequent flexible approach responses, but not of stereotyped, inflexible responses. Moreover, the excitation simultaneously signals the subject’s proximity to the approach target, a signal that appears to mediate greater response vigor on trials that begin with the subject closer to the target. These results demonstrate a neural mechanism for response invigoration whereby accumbens neuronal encoding of reward availability and target proximity together drive the onset and speed of reward-seeking locomotion. PMID:23764290

Rewarding leadership and fair procedures as determinants of self-esteem.

PubMed

De Cremer, David; van Knippenberg, Barbara; van Knippenberg, Daan; Mullenders, Danny; Stinglhamber, Florence

2005-01-01

In the present research, the authors examined the effect of procedural fairness and rewarding leadership style on an important variable for employees: self-esteem. The authors predicted that procedural fairness would positively influence people's reported self-esteem if the leader adopted a style of rewarding behavior for a job well done. Results from a scenario experiment, a laboratory experiment, and an organizational survey indeed show that procedural fairness and rewarding leadership style interacted to influence followers' self-esteem, such that the positive relationship between procedural fairness and self-esteem was more pronounced when the leadership style was high in rewarding behavior. Implications in terms of integrating the leadership and procedural fairness literature are discussed.

Real and hypothetical monetary rewards modulate risk taking in the brain.

PubMed

Xu, Sihua; Pan, Yu; Wang, You; Spaeth, Andrea M; Qu, Zhe; Rao, Hengyi

2016-07-07

Both real and hypothetical monetary rewards are widely used as reinforcers in risk taking and decision making studies. However, whether real and hypothetical monetary rewards modulate risk taking and decision making in the same manner remains controversial. In this study, we used event-related potentials (ERP) with a balloon analogue risk task (BART) paradigm to examine the effects of real and hypothetical monetary rewards on risk taking in the brain. Behavioral data showed reduced risk taking after negative feedback (money loss) during the BART with real rewards compared to those with hypothetical rewards, suggesting increased loss aversion with real monetary rewards. The ERP data demonstrated a larger feedback-related negativity (FRN) in response to money loss during risk taking with real rewards compared to those with hypothetical rewards, which may reflect greater prediction error or regret emotion after real monetary losses. These findings demonstrate differential effects of real versus hypothetical monetary rewards on risk taking behavior and brain activity, suggesting a caution when drawing conclusions about real choices from hypothetical studies of intended behavior, especially when large rewards are used. The results have implications for future utility of real and hypothetical monetary rewards in studies of risk taking and decision making.

Neurogenetics and Nutrigenomics of Neuro-Nutrient Therapy for Reward Deficiency Syndrome (RDS): Clinical Ramifications as a Function of Molecular Neurobiological Mechanisms

PubMed Central

Blum, Kenneth; Oscar-Berman, Marlene; Stuller, Elizabeth; Miller, David; Giordano, John; Morse, Siobhan; McCormick, Lee; Downs, William B; Waite, Roger L; Barh, Debmalya; Neal, Dennis; Braverman, Eric R; Lohmann, Raquel; Borsten, Joan; Hauser, Mary; Han, David; Liu, Yijun; Helman, Manya; Simpatico, Thomas

2013-01-01

In accord with the new definition of addiction published by American Society of Addiction Medicine (ASAM) it is well-known that individuals who present to a treatment center involved in chemical dependency or other documented reward dependence behaviors have impaired brain reward circuitry. They have hypodopaminergic function due to genetic and/or environmental negative pressures upon the reward neuro-circuitry. This impairment leads to aberrant craving behavior and other behaviors such as Substance Use Disorder (SUD). Neurogenetic research in both animal and humans revealed that there is a well-defined cascade in the reward site of the brain that leads to normal dopamine release. This cascade has been termed the “Brain Reward Cascade” (BRC). Any impairment due to either genetics or environmental influences on this cascade will result in a reduced amount of dopamine release in the brain reward site. Manipulation of the BRC has been successfully achieved with neuro-nutrient therapy utilizing nutrigenomic principles. After over four decades of development, neuro-nutrient therapy has provided important clinical benefits when appropriately utilized. This is a review, with some illustrative case histories from a number of addiction professionals, of certain molecular neurobiological mechanisms which if ignored may lead to clinical complications. PMID:23926462

Rewards and Performance Incentives.

ERIC Educational Resources Information Center

Zigon, Jack

1994-01-01

Discusses rewards and performance incentives for employees, including types of rewards; how rewards help in managing; dysfunctional awards; selecting the right reward; how to find rewards that fit; and delivering rewards effectively. Examples are included. (three references) (LRW)

A local circuit model of learned striatal and dopamine cell responses under probabilistic schedules of reward.

PubMed

Tan, Can Ozan; Bullock, Daniel

2008-10-01

Recently, dopamine (DA) neurons of the substantia nigra pars compacta (SNc) were found to exhibit sustained responses related to reward uncertainty, in addition to the phasic responses related to reward-prediction errors (RPEs). Thus, cue-dependent anticipations of the timing, magnitude, and uncertainty of rewards are learned and reflected in components of DA signals. Here we simulate a local circuit model to show how learned uncertainty responses are generated, along with phasic RPE responses, on single trials. Both types of simulated DA responses exhibit the empirically observed dependencies on conditional probability, expected value of reward, and time since onset of the reward-predicting cue. The model's three major pathways compute expected values of cues, timed predictions of reward magnitudes, and uncertainties associated with these predictions. The first two pathways' computations refine those modeled by Brown et al. (1999). The third, newly modeled, pathway involves medium spiny projection neurons (MSPNs) of the striatal matrix, whose axons corelease GABA and substance P, both at synapses with GABAergic neurons in the substantia nigra pars reticulata (SNr) and with distal dendrites (in SNr) of DA neurons whose somas are located in ventral SNc. Corelease enables efficient computation of uncertainty responses that are a nonmonotonic function of the conditional probability of reward, and variability in striatal cholinergic transmission can explain observed individual differences in the amplitudes of uncertainty responses. The involvement of matricial MSPNs and cholinergic transmission within the striatum implies a relation between uncertainty in cue-reward contingencies and action-selection functions of the basal ganglia.

Reward loss and the basolateral amygdala: A function in reward comparisons.

PubMed

Kawasaki, Katsuyoshi; Annicchiarico, Iván; Glueck, Amanda C; Morón, Ignacio; Papini, Mauricio R

2017-07-28

The neural circuitry underlying behavior in reward loss situations is poorly understood. We considered two such situations: reward devaluation (from large to small rewards) and reward omission (from large rewards to no rewards). There is evidence that the central nucleus of the amygdala (CeA) plays a role in the negative emotion accompanying reward loss. However, little is known about the function of the basolateral nucleus (BLA) in reward loss. Two hypotheses of BLA function in reward loss, negative emotion and reward comparisons, were tested in an experiment involving pretraining excitotoxic BLA lesions followed by training in four tasks: consummatory successive negative contrast (cSNC), autoshaping (AS) acquisition and extinction, anticipatory negative contrast (ANC), and open field testing (OF). Cell counts in the BLA (but not in the CeA) were significantly lower in animals with lesions vs. shams. BLA lesions eliminated cSNC and ANC, and accelerated extinction of lever pressing in AS. BLA lesions had no effect on OF testing: higher activity in the periphery than in the central area. This pattern of results provides support for the hypothesis that BLA neurons are important for reward comparison. The three affected tasks (cSNC, ANC, and AS extinction) involve reward comparisons. However, ANC does not seem to involve negative emotions and it was affected, whereas OF activity is known to involve negative emotion, but it was not affected. It is hypothesized that a circuit involving the thalamus, insular cortex, and BLA is critically involved in the mechanism comparing current and expected rewards. Copyright © 2017 Elsevier B.V. All rights reserved.

A Fly's Eye View of Natural and Drug Reward.

PubMed

Lowenstein, Eve G; Velazquez-Ulloa, Norma A

2018-01-01

Animals encounter multiple stimuli each day. Some of these stimuli are innately appetitive or aversive, while others are assigned valence based on experience. Drugs like ethanol can elicit aversion in the short term and attraction in the long term. The reward system encodes the predictive value for different stimuli, mediating anticipation for attractive or punishing stimuli and driving animal behavior to approach or avoid conditioned stimuli. The neurochemistry and neurocircuitry of the reward system is partly evolutionarily conserved. In both vertebrates and invertebrates, including Drosophila melanogaster , dopamine is at the center of a network of neurotransmitters and neuromodulators acting in concert to encode rewards. Behavioral assays in D. melanogaster have become increasingly sophisticated, allowing more direct comparison with mammalian research. Moreover, recent evidence has established the functional modularity of the reward neural circuits in Drosophila . This functional modularity resembles the organization of reward circuits in mammals. The powerful genetic and molecular tools for D. melanogaster allow characterization and manipulation at the single-cell level. These tools are being used to construct a detailed map of the neural circuits mediating specific rewarding stimuli and have allowed for the identification of multiple genes and molecular pathways that mediate the effects of reinforcing stimuli, including their rewarding effects. This report provides an overview of the research on natural and drug reward in D. melanogaster , including natural rewards such as sugar and other food nutrients, and drug rewards including ethanol, cocaine, amphetamine, methamphetamine, and nicotine. We focused mainly on the known genetic and neural mechanisms underlying appetitive reward for sugar and reward for ethanol. We also include genes, molecular pathways, and neural circuits that have been identified using assays that test the palatability of the rewarding

Computational model of chromosome aberration yield induced by high- and low-LET radiation exposures.

PubMed

Ponomarev, Artem L; George, Kerry; Cucinotta, Francis A

2012-06-01

We present a computational model for calculating the yield of radiation-induced chromosomal aberrations in human cells based on a stochastic Monte Carlo approach and calibrated using the relative frequencies and distributions of chromosomal aberrations reported in the literature. A previously developed DNA-fragmentation model for high- and low-LET radiation called the NASARadiationTrackImage model was enhanced to simulate a stochastic process of the formation of chromosomal aberrations from DNA fragments. The current version of the model gives predictions of the yields and sizes of translocations, dicentrics, rings, and more complex-type aberrations formed in the G(0)/G(1) cell cycle phase during the first cell division after irradiation. As the model can predict smaller-sized deletions and rings (<3 Mbp) that are below the resolution limits of current cytogenetic analysis techniques, we present predictions of hypothesized small deletions that may be produced as a byproduct of properly repaired DNA double-strand breaks (DSB) by nonhomologous end-joining. Additionally, the model was used to scale chromosomal exchanges in two or three chromosomes that were obtained from whole-chromosome FISH painting analysis techniques to whole-genome equivalent values.

Orbitofrontal Cortical Neurons Encode Expectation-Driven Initiation of Reward-Seeking

PubMed Central

Aston-Jones, Gary

2014-01-01

Adaptive execution and inhibition of behavior are guided by the activity of neuronal populations across multiple frontal cortical areas. The rodent medial prefrontal cortex has been well studied with respect to these behaviors, influencing behavioral execution/inhibition based on context. Other frontal regions, in particular the orbitofrontal cortex (OFC), are critical in directing behavior to obtain rewards, but the relationship between OFC neuronal activity and response execution or inhibition has been poorly characterized. In particular, little is known about OFC with respect to extinction learning, an important example of context-guided response inhibition. Here, we recorded the activity of OFC neurons while rats performed a discriminative-stimulus (DS)-driven sucrose-seeking task followed by multiple days of extinction of the DS. OFC neuronal activity was maximally responsive (1) to reward-predicting stimuli (RS) that triggered a lever press (i.e., lever-response initiation) and (2) during reward-well approach in pursuit of sucrose (i.e., well-response initiation). RS presentation that was not followed by a lever press or RS presentation during extinction produced weak activation, as did nonrewarded stimulus (NS) presentation regardless of response (press or withhold) or session (DS-sucrose or extinction). Activity related to nonrewarded well entry was minor, and activity was significantly inhibited during reward consumption. Finally, OFC neuronal activity switched selectivity to track rewarded behaviors when the RS/NS contingencies were reversed. Thus, rather than signaling variables related to extinction or response inhibition, activity in OFC was strongest at the initiation of multiple components of reward-seeking behavior, most prominently when valid reward-predicting cues drove these behaviors. PMID:25080585

Do reward-processing deficits in schizophrenia-spectrum disorders promote cannabis use? An investigation of physiological response to natural rewards and drug cues.

PubMed

Cassidy, Clifford M; Brodeur, Mathieu B; Lepage, Martin; Malla, Ashok

2014-09-01

Dysfunctional reward processing is present in individuals with schizophrenia-spectrum disorders (SSD) and may confer vulnerability to addiction. Our objective was to identify a deficit in patients with SSD on response to rewarding stimuli and determine whether this deficit predicts cannabis use. We divided a group of patients with SSD and nonpsychotic controls into cannabis users and nonusers. Response to emotional and cannabis-associated visual stimuli was assessed using self-report, event-related potentials (using the late positive potential [LPP]), facial electromyography and skin-conductance response. Our sample comprised 35 patients with SSD and 35 nonpsychotic controls. Compared with controls, the patients with SSD showed blunted LPP response to pleasant stimuli (p = 0.003). Across measures, cannabis-using controls showed greater response to pleasant stimuli than to cannabis stimuli whereas cannabis-using patients showed little bias toward pleasant stimuli. Reduced LPP response to pleasant stimuli was predictive of more frequent subsequent cannabis use (β = -0.24, p = 0.034). It is not clear if the deficit associated with cannabis use is specific to rewarding stimuli or nonspecific to any kind of emotionally salient stimuli. The LPP captures a reward-processing deficit in patients with SSD and shows potential as a biomarker for identifying patients at risk of heavy cannabis use.

Neural activation to monetary reward is associated with amphetamine reward sensitivity.

PubMed

Crane, Natania A; Gorka, Stephanie M; Weafer, Jessica; Langenecker, Scott A; de Wit, Harriet; Phan, K Luan

2018-03-14

One known risk factor for drug use and abuse is sensitivity to rewarding effects of drugs. It is not known whether this risk factor extends to sensitivity to non-drug rewards. In this study with healthy young adults, we examined the association between sensitivity to the subjective rewarding effects of amphetamine and a neural indicator of anticipation of monetary reward. We hypothesized that greater euphorigenic response to amphetamine would be associated with greater neural activation to anticipation of monetary reward (Win > Loss). Healthy participants (N = 61) completed four laboratory sessions in which they received d-amphetamine (20 mg) and placebo in alternating order, providing self-report measures of euphoria and stimulation at regular intervals. At a separate visit 1-3 weeks later, participants completed the guessing reward task (GRT) during fMRI in a drug-free state. Participants reporting greater euphoria after amphetamine also exhibited greater neural activation during monetary reward anticipation in mesolimbic reward regions, including the bilateral caudate and putamen. This is the first study to show a relationship between neural correlates of monetary reward and sensitivity to the subjective rewarding effects of amphetamine in humans. These findings support growing evidence that sensitivity to reward in general is a risk factor for drug use and abuse, and suggest that sensitivity of drug-induced euphoria may reflect a general sensitivity to rewards. This may be an index of vulnerability for drug use or abuse.

Elevated Striatal Reactivity Across Monetary and Social Rewards in Bipolar I Disorder

PubMed Central

Dutra, Sunny J.; Cunningham, William A.; Kober, Hedy; Gruber, June

2016-01-01

Bipolar disorder (BD) is associated with increased reactivity to rewards and heightened positive affectivity. It is less clear to what extent this heightened reward sensitivity is evident across contexts and what the associated neural mechanisms might be. The present investigation employed both a monetary and social incentive delay task among adults with remitted BD type I (N=24) and a healthy non-psychiatric control group (HC; N=25) using fMRI. Both whole-brain and region-of-interest analyses revealed elevated ventral and dorsal striatal reactivity across monetary and social reward receipt, but not anticipation, in the BD group. Post-hoc analyses further suggested that greater striatal reactivity to reward receipt across monetary and social reward tasks predicted decreased self-reported positive affect when anticipating subsequent rewards in the HC, but not BD, group. Results point toward elevated striatal reactivity to reward receipt as a potential neural mechanism of reward reactivity. PMID:26390194

Elevated striatal reactivity across monetary and social rewards in bipolar I disorder.

PubMed

Dutra, Sunny J; Cunningham, William A; Kober, Hedy; Gruber, June

2015-11-01

Bipolar disorder (BD) is associated with increased reactivity to rewards and heightened positive affectivity. It is less clear to what extent this heightened reward sensitivity is evident across contexts and what the associated neural mechanisms might be. The present investigation used both a monetary and social incentive delay task among adults with remitted BD Type I (n = 24) and a healthy nonpsychiatric control group (HC; n = 25) using fMRI. Both whole-brain and region-of-interest analyses revealed elevated reactivity to reward receipt in the striatum, a region implicated in incentive sensitivity, in the BD group. Post hoc analyses revealed that greater striatal reactivity to reward receipt, across monetary and social reward tasks, predicted decreased self-reported positive affect when anticipating subsequent rewards in the HC but not in the BD group. Results point toward elevated striatal reactivity to reward receipt as a potential neural mechanism of persistent reward pursuit in BD. (c) 2015 APA, all rights reserved).

Sensitivity to reward: implications for overeating and overweight.

PubMed

Davis, Caroline; Strachan, Shaelyn; Berkson, Marni

2004-04-01

Sensitivity to reward (STR)-a personality trait firmly rooted in the neurobiology of the mesolimbic dopamine system-has been strongly implicated in the risk for addiction. This construct describes the ability to derive pleasure or reward from natural reinforcers like food, and from pharmacologic rewards like addictive drugs. Recently experts in the field of addiction research have acknowledged that psychomotor stimulant drugs are no longer at the heart of all addictions, and that brain circuits can also be deranged with natural rewards like food. The present study tested a model in which STR was expected to relate positively to overeating, which in turn would be associated with higher body weight in woman aged 25-45 years. As predicted, STR was correlated positively with measures of emotional overeating. Also, overweight woman were significantly more sensitive to reward than those of normal weight. Interestingly, however, the obese woman (Body Mass Index>30) were more anhedonic than the overweight woman (Body Mass Index>25<30). These findings are discussed in the context of neuroadaptations to overactivity of brain reward circuits. Results also indicate that STR may serve as a risk factor for overeating and overweight, especially in cultures such as ours where palatable, calorically-dense food is plentiful.

Neural correlates of RDoC reward constructs in adolescents with diverse psychiatric symptoms: A Reward Flanker Task pilot study.

PubMed

Bradley, Kailyn A L; Case, Julia A C; Freed, Rachel D; Stern, Emily R; Gabbay, Vilma

2017-07-01

There has been growing interest under the Research Domain Criteria initiative to investigate behavioral constructs and their underlying neural circuitry. Abnormalities in reward processes are salient across psychiatric conditions and may precede future psychopathology in youth. However, the neural circuitry underlying such deficits has not been well defined. Therefore, in this pilot, we studied youth with diverse psychiatric symptoms and examined the neural underpinnings of reward anticipation, attainment, and positive prediction error (PPE, unexpected reward gain). Clinically, we focused on anhedonia, known to reflect deficits in reward function. Twenty-two psychotropic medication-free youth, 16 with psychiatric symptoms, exhibiting a full range of anhedonia, were scanned during the Reward Flanker Task. Anhedonia severity was quantified using the Snaith-Hamilton Pleasure Scale. Functional magnetic resonance imaging analyses were false discovery rate corrected for multiple comparisons. Anticipation activated a broad network, including the medial frontal cortex and ventral striatum, while attainment activated memory and emotion-related regions such as the hippocampus and parahippocampal gyrus, but not the ventral striatum. PPE activated a right-dominant fronto-temporo-parietal network. Anhedonia was only correlated with activation of the right angular gyrus during anticipation and the left precuneus during PPE at an uncorrected threshold. Findings are preliminary due to the small sample size. This pilot characterized the neural circuitry underlying different aspects of reward processing in youth with diverse psychiatric symptoms. These results highlight the complexity of the neural circuitry underlying reward anticipation, attainment, and PPE. Furthermore, this study underscores the importance of RDoC research in youth. Copyright © 2016 Elsevier B.V. All rights reserved.

Interpreting Chromosome Aberration Spectra

NASA Technical Reports Server (NTRS)

Levy, Dan; Reeder, Christopher; Loucas, Bradford; Hlatky, Lynn; Chen, Allen; Cornforth, Michael; Sachs, Rainer

2007-01-01

Ionizing radiation can damage cells by breaking both strands of DNA in multiple locations, essentially cutting chromosomes into pieces. The cell has enzymatic mechanisms to repair such breaks; however, these mechanisms are imperfect and, in an exchange process, may produce a large-scale rearrangement of the genome, called a chromosome aberration. Chromosome aberrations are important in killing cells, during carcinogenesis, in characterizing repair/misrepair pathways, in retrospective radiation biodosimetry, and in a number of other ways. DNA staining techniques such as mFISH ( multicolor fluorescent in situ hybridization) provide a means for analyzing aberration spectra by examining observed final patterns. Unfortunately, an mFISH observed final pattern often does not uniquely determine the underlying exchange process. Further, resolution limitations in the painting protocol sometimes lead to apparently incomplete final patterns. We here describe an algorithm for systematically finding exchange processes consistent with any observed final pattern. This algorithm uses aberration multigraphs, a mathematical formalism that links the various aspects of aberration formation. By applying a measure to the space of consistent multigraphs, we will show how to generate model-specific distributions of aberration processes from mFISH experimental data. The approach is implemented by software freely available over the internet. As a sample application, we apply these algorithms to an aberration data set, obtaining a distribution of exchange cycle sizes, which serves to measure aberration complexity. Estimating complexity, in turn, helps indicate how damaging the aberrations are and may facilitate identification of radiation type in retrospective biodosimetry.

Attentional bias for nondrug reward is magnified in addiction.

PubMed

Anderson, Brian A; Faulkner, Monica L; Rilee, Jessica J; Yantis, Steven; Marvel, Cherie L

2013-12-01

Attentional biases for drug-related stimuli play a prominent role in addiction, predicting treatment outcomes. Attentional biases also develop for stimuli that have been paired with nondrug rewards in adults without a history of addiction, the magnitude of which is predicted by visual working-memory capacity and impulsiveness. We tested the hypothesis that addiction is associated with an increased attentional bias for nondrug (monetary) reward relative to that of healthy controls, and that this bias is related to working-memory impairments and increased impulsiveness. Seventeen patients receiving methadone-maintenance treatment for opioid dependence and 17 healthy controls participated. Impulsiveness was measured using the Barratt Impulsiveness Scale (BIS-11; Patton, Stanford, & Barratt, 1995), visual working-memory capacity was measured as the ability to recognize briefly presented color stimuli, and attentional bias was measured as the magnitude of response time slowing caused by irrelevant but previously reward-associated distractors in a visual-search task. The results showed that attention was biased toward the distractors across all participants, replicating previous findings. It is important to note, this bias was significantly greater in the patients than in the controls and was negatively correlated with visual working-memory capacity. Patients were also significantly more impulsive than controls as a group. Our findings demonstrate that patients in treatment for addiction experience greater difficulty ignoring stimuli associated with nondrug reward. This nonspecific reward-related bias could mediate the distracting quality of drug-related stimuli previously observed in addiction.

Real and hypothetical rewards

PubMed Central

Locey, Matthew L.; Jones, Bryan A.; Rachlin, Howard

2012-01-01

Laboratory studies of choice and decision making among real monetary rewards typically use smaller real rewards than those common in real life. When laboratory rewards are large, they are almost always hypothetical. In applying laboratory results meaningfully to real-life situations, it is important to know the extent to which choices among hypothetical rewards correspond to choices among real rewards and whether variation of the magnitude of hypothetical rewards affects behavior in meaningful ways. The present study compared real and hypothetical monetary rewards in two experiments. In Experiment 1, participants played a temporal discounting game that incorporates the logic of a repeated prisoner’s-dilemma (PD) type game versus tit-for-tat; choice of one alternative (“defection” in PD terminology) resulted in a small-immediate reward; choice of the other alternative (“cooperation” in PD terminology) resulted in a larger reward delayed until the following trial. The larger-delayed reward was greater for half of the groups than for the other half. Rewards also differed in type across groups: multiples of real nickels, hypothetical nickels or hypothetical hundred-dollar bills. All groups significantly increased choice of the larger delayed reward over the 40 trials of the experiment. Over the last 10 trials, cooperation was significantly higher when the difference between larger and smaller hypothetical rewards was greater. Reward type (real or hypothetical) made no significant difference in cooperation. In Experiment 2, real and hypothetical rewards were compared in social discounting – the decrease in value to the giver of a reward as social distance increases to the receiver of the reward. Social discount rates were well described by a hyperbolic function. Discounting rates for real and hypothetical rewards did not significantly differ. These results add to the evidence that results of experiments with hypothetical rewards validly apply in everyday

Beyond Rewards

ERIC Educational Resources Information Center

Hall, Philip S.

2009-01-01

Using rewards to impact students' behavior has long been common practice. However, using reward systems to enhance student learning conveniently masks the larger and admittedly more difficult task of finding and implementing the structure and techniques that children with special needs require to learn. More important, rewarding the child for good…

Amygdala Contributions to Stimulus–Reward Encoding in the Macaque Medial and Orbital Frontal Cortex during Learning

PubMed Central

Averbeck, Bruno B.

2017-01-01

Orbitofrontal cortex (OFC), medial frontal cortex (MFC), and amygdala mediate stimulus–reward learning, but the mechanisms through which they interact are unclear. Here, we investigated how neurons in macaque OFC and MFC signaled rewards and the stimuli that predicted them during learning with and without amygdala input. Macaques performed a task that required them to evaluate two stimuli and then choose one to receive the reward associated with that option. Four main findings emerged. First, amygdala lesions slowed the acquisition and use of stimulus–reward associations. Further analyses indicated that this impairment was due, at least in part, to ineffective use of negative feedback to guide subsequent decisions. Second, the activity of neurons in OFC and MFC rapidly evolved to encode the amount of reward associated with each stimulus. Third, amygdalectomy reduced encoding of stimulus–reward associations during the evaluation of different stimuli. Reward encoding of anticipated and received reward after choices were made was not altered. Fourth, amygdala lesions led to an increase in the proportion of neurons in MFC, but not OFC, that encoded the instrumental response that monkeys made on each trial. These correlated changes in behavior and neural activity after amygdala lesions strongly suggest that the amygdala contributes to the ability to learn stimulus–reward associations rapidly by shaping encoding within OFC and MFC. SIGNIFICANCE STATEMENT Altered functional interactions among orbital frontal cortex (OFC), medial frontal cortex (MFC), and amygdala are thought to underlie several psychiatric conditions, many related to reward learning. Here, we investigated the causal contribution of the amygdala to the development of neuronal activity in macaque OFC and MFC related to rewards and the stimuli that predict them during learning. Without amygdala inputs, neurons in both OFC and MFC showed decreased encoding of stimulus–reward associations. MFC also

On- and off-eye spherical aberration of soft contact lenses and consequent changes of effective lens power.

PubMed

Dietze, Holger H; Cox, Michael J

2003-02-01

Soft contact lenses produce a significant level of spherical aberration affecting their power on-eye. A simple model assuming that a thin soft contact lens aligns to the cornea predicts that these effects are similar on-eye and off-eye. The wavefront aberration for 17 eyes and 33 soft contact lenses on-eye was measured with a Shack-Hartmann wavefront sensor. The Zernike coefficients describing the on-eye spherical aberration of the soft contact lens were compared with off-eye ray-tracing results. Paraxial and effective lens power changes were determined. The model predicts the on-eye spherical aberration of soft contact lenses closely. The resulting power change for a +/- 7.00 D spherical soft contact lens is +/- 0.5 D for a 6-mm pupil diameter and +/- 0.1 D for a 3-mm pupil diameter. Power change is negligible for soft contact lenses corrected for off-eye spherical aberration. For thin soft contact lenses, the level of spherical aberration and the consequent power change is similar on-eye and off-eye. Soft contact lenses corrected for spherical aberration in air will be expected to be aberration-free on-eye and produce only negligibly small power changes. For soft contact lenses without aberration correction, for higher levels of ametropia and large pupils, the soft contact lens power should be determined with trial lenses with their power and p value similar to the prescribed lens. The benefit of soft contact lenses corrected for spherical aberration depends on the level of ocular spherical aberration.

fMRI of alterations in reward selection, anticipation, and feedback in major depressive disorder.

PubMed

Smoski, Moria J; Felder, Jennifer; Bizzell, Joshua; Green, Steven R; Ernst, Monique; Lynch, Thomas R; Dichter, Gabriel S

2009-11-01

The purpose of the present investigation was to evaluate reward processing in unipolar major depressive disorder (MDD). Specifically, we investigated whether adults with MDD demonstrated hyporesponsivity in striatal brain regions and/or hyperresponsivity in cortical brain regions involved in conflict monitoring using a Wheel of Fortune task designed to probe responses during reward selection, reward anticipation, and reward feedback. Functional magnetic resonance imaging (fMRI) data indicated that the MDD group was characterized by reduced activation of striatal reward regions during reward selection, reward anticipation, and reward feedback, supporting previous data indicating hyporesponsivity of reward systems in MDD. Support was not found for hyperresponsivity of cognitive control regions during reward selection or reward anticipation. Instead, MDD participants showed hyperresponsivity in orbitofrontal cortex, a region associated with assessment of risk and reward, during reward selection, as well as decreased activation of the middle frontal gyrus and the rostral cingulate gyrus during reward selection and anticipation. Finally, depression severity was predicted by activation in bilateral midfrontal gyrus during reward selection. Results indicate that MDD is characterized by striatal hyporesponsivity, and that future studies of MDD treatments that seek to improve responses to rewarding stimuli should assess striatal functioning.

Depression-related increases and decreases in appetite reveal dissociable patterns of aberrant activity in reward and interoceptive neurocircuitry

PubMed Central

Simmons, W. Kyle; Burrows, Kaiping; Avery, Jason A.; Kerr, Kara L.; Bodurka, Jerzy; Savage, Cary R.; Drevets, Wayne C.

2016-01-01

Objective Appetite and weight changes are common but variable diagnostic markers in major depressive disorder: some depressed individuals manifest increased appetite, while others lose their appetite. Many of the brain regions implicated in appetitive responses to food have also been implicated in depression. It is thus remarkable that there exists no published research comparing the neural responses to food stimuli of depressed patients with increased versus decreased appetites. Method Using functional magnetic resonance imaging we compared brain activity in unmedicated depressed patients with increased or decreased appetite, and healthy control subjects, while viewing photographs of food and non-food objects. We also measured how resting-state functional connectivity related to subjects’ food pleasantness ratings. Results Within putative reward regions, depressed participants with increased appetites exhibited greater hemodynamic activity to food stimuli than both those reporting appetite decreases and healthy control subjects. In contrast, depressed subjects experiencing appetite loss exhibited hypoactivation within a region of the mid-insula implicated in interoception, with no difference observed in this region between healthy subjects and those with depression-related appetite increases. Mid-insula activity was negatively correlated with food pleasantness ratings of depressed participants with increased appetites, and its functional connectivity to reward circuitry was positively correlated with food pleasantness ratings. Conclusions Depression-related increases in appetite are associated with hyperactivation of putative mesocorticolimbic reward circuitry, while depression-related appetite loss is associated with hypoactivation of insular regions that support monitoring the body’s physiological state. Importantly, the interactions among these regions also contribute to individual differences in the depression-related appetite changes. PMID:26806872

Ethanol induces impulsive-like responding in a delay-of-reward operant choice procedure: impulsivity predicts autoshaping.

PubMed

Tomie, A; Aguado, A S; Pohorecky, L A; Benjamin, D

1998-10-01

Autoshaping conditioned responses (CRs) are reflexive and targeted motor responses expressed as a result of experience with reward. To evaluate the hypothesis that autoshaping may be a form of impulsive responding, within-subjects correlations between performance on autoshaping and impulsivity tasks were assessed in 15 Long-Evans hooded rats. Autoshaping procedures [insertion of retractable lever conditioned stimulus (CS) followed by the response-independent delivery of food (US)] were followed by testing for impulsive-like responding in a two-choice lever-press operant delay-of-reward procedure (immediate small food reward versus delayed large food reward). Delay-of-reward functions revealed two distinct subject populations. Subjects in the Sensitive group (n=7) were more impulsive-like, increasing immediate reward choices at longer delays for large reward, while those in the Insensitive group (n=8) responded predominantly on only one lever. During the prior autoshaping phase, the Sensitive group had performed more autoshaping CRs, and correlations revealed that impulsive subjects acquired the autoshaping CR in fewer trials. In the Sensitive group, acute injections of ethanol (0, 0.25, 0.50, 1.00, 1.50 g/kg) given immediately before delay-of-reward sessions yielded an inverted U-shaped dose-response curve with increased impulsivity induced by the 0.25, 0.50, and 1.00 g/kg doses of ethanol, while choice strategy of the Insensitive group was not influenced by ethanol dose. Ethanol induced impulsive-like responding only in rats that were flexible in their response strategy (Sensitive group), and this group also performed more autoshaping CRs. Data support the hypothesis that autoshaping and impulsivity are linked.

Expected reward modulates encoding-related theta activity before an event.

PubMed

Gruber, Matthias J; Watrous, Andrew J; Ekstrom, Arne D; Ranganath, Charan; Otten, Leun J

2013-01-01

Oscillatory brain activity in the theta frequency range (4-8 Hz) before the onset of an event has been shown to affect the likelihood of successfully encoding the event into memory. Recent work has also indicated that frontal theta activity might be modulated by reward, but it is not clear how reward expectancy, anticipatory theta activity, and memory formation might be related. Here, we used scalp electroencephalography (EEG) to assess the relationship between these factors. EEG was recorded from healthy adults while they memorized a series of words. Each word was preceded by a cue that indicated whether a high or low monetary reward would be earned if the word was successfully remembered in a later recognition test. Frontal theta power between the presentation of the reward cue and the onset of a word was predictive of later memory for the word, but only in the high reward condition. No theta differences were observed before word onset following low reward cues. The magnitude of prestimulus encoding-related theta activity in the high reward condition was correlated with the number of high reward words that were later confidently recognized. These findings provide strong evidence for a link between reward expectancy, theta activity, and memory encoding. Theta activity before event onset seems to be especially important for the encoding of motivationally significant stimuli. One possibility is that dopaminergic activity during reward anticipation mediates frontal theta activity related to memory. Copyright © 2012 Elsevier Inc. All rights reserved.

Subjective depth of field in presence of 4th-order and 6th-order Zernike spherical aberration using adaptive optics technology.

PubMed

Benard, Yohann; Lopez-Gil, Norberto; Legras, Richard

2010-12-01

To study the impact on the subjective depth of field of 4th-order spherical aberration and its combination with 6th-order spherical aberration and analyze the accuracy of image-quality metrics in predicting the impact. Laboratoire Aimé Cotton, Centre National de la Recherche Scientifique, Université Paris-Sud, Orsay, France. Case series. Subjective depth of field was defined as the range of defocus at which the target (3 high-contrast letters at 20/50) was perceived acceptable. Depth of field was measured using 0.18 diopter (D) steps in young subjects with the addition of the following spherical aberration values: ±0.3 μm and ±0.6 μm 4th-order spherical aberration with 3.0 mm and 6.0 mm pupils and ±0.3 μm 4th-order spherical aberration with ±0.1 μm 6th-order spherical aberration for 6.0 mm pupils. The addition of ±0.3 and ±0.6 μm 4th-order spherical aberration increased depth of field by 30% and 45%, respectively. The combination of 4th-order spherical aberration and 6th-order spherical aberration of opposite signs increased depth of field more than 4th-order spherical aberration alone (ie, 63%), while the combination of 4th-order spherical aberration and 6th-order spherical aberration of the same signs did not (ie, 24%). Whereas the midpoint of the depth of field could be predicted by image-quality metrics, none was found a good predictor of objectionable depth of field. Subjective depth of field increased when 4th-order spherical aberration and 6th-order spherical aberration of opposite signs were added but could not be predicted with image-quality metrics. Copyright © 2010 ASCRS and ESCRS. Published by Elsevier Inc. All rights reserved.

Negative symptoms in schizophrenia are associated with aberrant striato-cortical connectivity in a rewarded perceptual decision-making task.

PubMed

Reckless, Greg E; Andreassen, Ole A; Server, Andres; Østefjells, Tiril; Jensen, Jimmy

2015-01-01

Negative symptoms in schizophrenia have been associated with structural and functional changes in the prefrontal cortex. They often persist after treatment with antipsychotic medication which targets, in particular, the ventral striatum (VS). As schizophrenia has been suggested to arise from dysfunctional connectivity between neural networks, it is possible that residual aberrant striato-cortical connectivity in medicated patients plays a role in enduring negative symptomology. The present study examined the relationship between striato-cortical connectivity and negative symptoms in medicated schizophrenia patients. We manipulated motivation in a perceptual decision-making task during functional magnetic resonance imaging. Comparing healthy controls (n = 21) and medicated patients with schizophrenia (n = 18) we investigated how motivation-mediated changes in VS activation affected functional connectivity with the frontal cortex, and how changes in connectivity strength from the neutral to motivated condition related to negative symptom severity. A pattern of aberrant striato-cortical connectivity was observed in the presence of intact VS, but altered left inferior frontal gyrus (IFG) motivation-mediated activation in patients. The more severe the patient's negative symptoms, the less the connectivity strength between the right VS and left IFG changed from the neutral to the motivated condition. Despite aberrant striato-cortical connectivity and altered recruitment of the left IFG among patients, both patients and healthy controls adopted a more liberal response strategy in the motivated compared to the neutral condition. The present findings suggest that there is a link between dysfunctional striato-cortical connectivity and negative symptom severity, and offer a possible explanation as to why negative symptoms persist after treatment with antipsychotics.

The role of rewards in motivating participation in simple warfare.

PubMed

Glowacki, Luke; Wrangham, Richard W

2013-12-01

In the absence of explicit punitive sanctions, why do individuals voluntarily participate in intergroup warfare when doing so incurs a mortality risk? Here we consider the motivation of individuals for participating in warfare. We hypothesize that in addition to other considerations, individuals are incentivized by the possibility of rewards. We test a prediction of this "cultural rewards war-risk hypothesis" with ethnographic literature on warfare in small-scale societies. We find that a greater number of benefits from warfare is associated with a higher rate of death from conflict. This provides preliminary support for the relationship between rewards and participation in warfare.

Using food as a reward: An examination of parental reward practices.

PubMed

Roberts, Lindsey; Marx, Jenna M; Musher-Eizenman, Dara R

2018-01-01

Eating patterns and taste preferences are often established early in life. Many studies have examined how parental feeding practices may affect children's outcomes, including food intake and preference. The current study focused on a common food parenting practice, using food as a reward, and used Latent Profile Analysis (LPA) to examine whether mothers (n = 376) and fathers (n = 117) of children ages 2.8 to 7.5 (M = 4.7; SD = 1.1) grouped into profiles (i.e., subgroups) based on how they use of food as a reward. The 4-class model was the best-fitting LPA model, with resulting classes based on both the frequency and type of reward used. Classes were: infrequent reward (33%), tangible reward (21%), food reward (27%), and frequent reward (19%). The current study also explored whether children's eating styles (emotional overeating, rood fussiness, food responsiveness, and satiety responsiveness) and parenting style (Authoritative, Authoritarian, and Permissive) varied by reward profile. Analyses of Variance (ANOVA) revealed that the four profiles differed significantly for all outcome variables except satiety responsiveness. It appears that the use of tangible and food-based rewards have important implications in food parenting. More research is needed to better understand how the different rewarding practices affect additional child outcomes. Copyright © 2017 Elsevier Ltd. All rights reserved.

Reward sensitivity is associated with brain activity during erotic stimulus processing.

PubMed

Costumero, Victor; Barrós-Loscertales, Alfonso; Bustamante, Juan Carlos; Ventura-Campos, Noelia; Fuentes, Paola; Rosell-Negre, Patricia; Ávila, César

2013-01-01

The behavioral approach system (BAS) from Gray's reinforcement sensitivity theory is a neurobehavioral system involved in the processing of rewarding stimuli that has been related to dopaminergic brain areas. Gray's theory hypothesizes that the functioning of reward brain areas is modulated by BAS-related traits. To test this hypothesis, we performed an fMRI study where participants viewed erotic and neutral pictures, and cues that predicted their appearance. Forty-five heterosexual men completed the Sensitivity to Reward scale (from the Sensitivity to Punishment and Sensitivity to Reward Questionnaire) to measure BAS-related traits. Results showed that Sensitivity to Reward scores correlated positively with brain activity during reactivity to erotic pictures in the left orbitofrontal cortex, left insula, and right ventral striatum. These results demonstrated a relationship between the BAS and reward sensitivity during the processing of erotic stimuli, filling the gap of previous reports that identified the dopaminergic system as a neural substrate for the BAS during the processing of other rewarding stimuli such as money and food.

Reward Sensitivity Is Associated with Brain Activity during Erotic Stimulus Processing

PubMed Central

Costumero, Victor; Barrós-Loscertales, Alfonso; Bustamante, Juan Carlos; Ventura-Campos, Noelia; Fuentes, Paola; Rosell-Negre, Patricia; Ávila, César

2013-01-01

The behavioral approach system (BAS) from Gray’s reinforcement sensitivity theory is a neurobehavioral system involved in the processing of rewarding stimuli that has been related to dopaminergic brain areas. Gray’s theory hypothesizes that the functioning of reward brain areas is modulated by BAS-related traits. To test this hypothesis, we performed an fMRI study where participants viewed erotic and neutral pictures, and cues that predicted their appearance. Forty-five heterosexual men completed the Sensitivity to Reward scale (from the Sensitivity to Punishment and Sensitivity to Reward Questionnaire) to measure BAS-related traits. Results showed that Sensitivity to Reward scores correlated positively with brain activity during reactivity to erotic pictures in the left orbitofrontal cortex, left insula, and right ventral striatum. These results demonstrated a relationship between the BAS and reward sensitivity during the processing of erotic stimuli, filling the gap of previous reports that identified the dopaminergic system as a neural substrate for the BAS during the processing of other rewarding stimuli such as money and food. PMID:23840558

A Behavioral Economic Reward Index Predicts Drinking Resolutions: Moderation Re-visited and Compared with Other Outcomes

PubMed Central

Tucker, Jalie A.; Roth, David L.; Vignolo, Mary J.; Westfall, Andrew O.

2014-01-01

Data were pooled from three studies of recently resolved community-dwelling problem drinkers to determine whether a behavioral economic index of the value of rewards available over different time horizons distinguished among moderation (n = 30), abstinent (n = 95), and unresolved (n = 77) outcomes. Moderation over 1-2 year prospective follow-up intervals was hypothesized to involve longer term behavior regulation processes compared to abstinence or relapse and to be predicted by more balanced pre-resolution monetary allocations between short- and longer-term objectives (i.e., drinking and saving for the future). Standardized odds ratios (OR) based on changes in standard deviation units from a multinomial logistic regression indicated that increases on this “Alcohol-Savings Discretionary Expenditure” index predicted higher rates of both abstinence (OR = 1.93, p = .004) and relapse (OR = 2.89, p < .0001) compared to moderation outcomes. The index had incremental utility in predicting moderation in complex models that included other established predictors. The study adds to evidence supporting a behavioral economic analysis of drinking resolutions and shows that a systematic analysis of pre-resolution spending patterns aids in predicting moderation. PMID:19309182

The Reward-Based Eating Drive Scale: A Self-Report Index of Reward-Based Eating

PubMed Central

Mason, Ashley E.; Laraia, Barbara A.; Hartman, William; Ready, Karen; Acree, Michael; Adam, Tanja C.; St. Jeor, Sachiko; Kessler, David

2014-01-01

Why are some individuals more vulnerable to persistent weight gain and obesity than are others? Some obese individuals report factors that drive overeating, including lack of control, lack of satiation, and preoccupation with food, which may stem from reward-related neural circuitry. These are normative and common symptoms and not the sole focus of any existing measures. Many eating scales capture these common behaviors, but are confounded with aspects of dysregulated eating such as binge eating or emotional overeating. Across five studies, we developed items that capture this reward-based eating drive (RED). Study 1 developed the items in lean to obese individuals (n = 327) and examined changes in weight over eight years. In Study 2, the scale was further developed and expert raters evaluated the set of items. Study 3 tested psychometric properties of the final 9 items in 400 participants. Study 4 examined psychometric properties and race invariance (n = 80 women). Study 5 examined psychometric properties and age/gender invariance (n = 381). Results showed that RED scores correlated with BMI and predicted earlier onset of obesity, greater weight fluctuations, and greater overall weight gain over eight years. Expert ratings of RED scale items indicated that the items reflected characteristics of reward-based eating. The RED scale evidenced high internal consistency and invariance across demographic factors. The RED scale, designed to tap vulnerability to reward-based eating behavior, appears to be a useful brief tool for identifying those at higher risk of weight gain over time. Given the heterogeneity of obesity, unique brief profiling of the reward-based aspect of obesity using a self-report instrument such as the RED scale may be critical for customizing effective treatments in the general population. PMID:24979216

Temporal dynamics of reward anticipation in the human brain.

PubMed

Zhang, Yuanyuan; Li, Qi; Wang, Zhao; Liu, Xun; Zheng, Ya

2017-09-01

Reward anticipation is a complex process including cue evaluation, motor preparation, and feedback anticipation. The present study investigated whether these psychological processes were dissociable on neural dynamics in terms of incentive valence and approach motivation. We recorded EEG when participants were performing a monetary incentive delay task, and found a cue-P3 during the cue-evaluation stage, a contingent negative variation (CNV) during the motor-preparation stage, and a stimulus-preceding negativity (SPN) during the feedback-anticipation stage. Critically, both the cue-P3 and SPN exhibited an enhanced sensitivity to gain versus loss anticipation, which was not observed for the CNV. Moreover, both the cue-P3 and SPN, instead of the CNV, for gain anticipation selectively predicted the participants' approach motivation as measured in a following effort expenditure for rewards task, particularly when reward uncertainty was maximal. Together, these results indicate that reward anticipation consists of several sub-stages, each with distinct functional significance, thus providing implications for neuropsychiatric diseases characterized by dysfunction in anticipatory reward processing. Copyright © 2017 Elsevier B.V. All rights reserved.

Sleep-Dependent Consolidation of Rewarded Behavior Is Diminished in Children with Attention Deficit Hyperactivity Disorder and a Comorbid Disorder of Social Behavior

PubMed Central

Wiesner, Christian D.; Molzow, Ina; Prehn-Kristensen, Alexander; Baving, Lioba

2017-01-01

Children suffering from attention-deficit hyperactivity disorder (ADHD) often also display impaired learning and memory. Previous research has documented aberrant reward processing in ADHD as well as impaired sleep-dependent consolidation of declarative memory. We investigated whether sleep also fosters the consolidation of behavior learned by probabilistic reward and whether ADHD patients with a comorbid disorder of social behavior show deficits in this memory domain, too. A group of 17 ADHD patients with comorbid disorders of social behavior aged 8–12 years and healthy controls matched for age, IQ, and handedness took part in the experiment. During the encoding task, children worked on a probabilistic learning task acquiring behavioral preferences for stimuli rewarded most often. After a 12-hr retention interval of either sleep at night or wakefulness during the day, a reversal task was presented where the contingencies were reversed. Consolidation of rewarded behavior is indicated by greater resistance to reversal learning. We found that healthy children consolidate rewarded behavior better during a night of sleep than during a day awake and that the sleep-dependent consolidation of rewarded behavior by trend correlates with non-REM sleep but not with REM sleep. In contrast, children with ADHD and comorbid disorders of social behavior do not show sleep-dependent consolidation of rewarded behavior. Moreover, their consolidation of rewarded behavior does not correlate with sleep. The results indicate that dysfunctional sleep in children suffering from ADHD and disorders of social behavior might be a crucial factor in the consolidation of behavior learned by reward. PMID:28228742

Reward signals, attempted suicide, and impulsivity in late-life depression.

PubMed

Dombrovski, Alexandre Y; Szanto, Katalin; Clark, Luke; Reynolds, Charles F; Siegle, Greg J

2013-10-01

IMPORTANCE—Suicide can be viewed as an escape from unendurable punishment at the cost of any future rewards. Could faulty estimation of these outcomes predispose to suicidal behavior? In behavioral studies, many of those who have attempted suicide misestimate expected rewards on gambling and probabilistic learning tasks.OBJECTIVES—To describe the neural circuit abnormalities that underlie disadvantageous choices in people at risk for suicide and to relate these abnormalities to impulsivity, which is one of the components of vulnerability to suicide.DESIGN—Case-control functional magnetic resonance imaging study of reward learning using are inforcement learning model.SETTING—University hospital and outpatient clinic.PATIENTS—Fifty-three participants 60 years or older, including 15 depressed patients who had attempted suicide, 18 depressed patients who had never attempted suicide (depressed control subjects), and 20 psychiatrically healthy controls.MAIN OUTCOMES AND MEASURES—Components of the cortical blood oxygenation level–dependent response tracking expected and unpredicted rewards.RESULTS—Depressed elderly participants displayed 2 distinct disruptions of control over reward-guided behavior. First, impulsivity and a history of suicide attempts (particularly poorly planned ones) were associated with a weakened expected reward signal in the paralimbic cortex,which in turn predicted the behavioral insensitivity to contingency change. Second, depression was associated with disrupted corticostriatothalamic encoding of unpredicted rewards, which in turn predicted the behavioral over sensitivity to punishment. These results were robust to the effects of possible brain damage from suicide attempts, depressive severity, co-occurring substance use and anxiety disorders, antidepressant and anticholinergic exposure, lifetime exposure to electroconvulsive therapy, vascular illness, and incipient dementia.CONCLUSIONS AND RELEVANCE—Altered paralimbic reward

Reward Signals, Attempted Suicide, and Impulsivity in Late-Life Depression

PubMed Central

Dombrovski, Alexandre Y.; Szanto, Katalin; Clark, Luke; Reynolds, Charles F.; Siegle, Greg J.

2013-01-01

IMPORTANCE Suicide can be viewed as an escape from unendurable punishment at the cost of any future rewards. Could faulty estimation of these outcomes predispose to suicidal behavior? In behavioral studies, many of those who have attempted suicide misestimate expected rewards on gambling and probabilistic learning tasks. OBJECTIVES To describe the neural circuit abnormalities that underlie disadvantageous choices in people at risk for suicide and to relate these abnormalities to impulsivity, which is one of the components of vulnerability to suicide. DESIGN Case-control functional magnetic resonance imaging study of reward learning using a reinforcement learning model. SETTING University hospital and outpatient clinic. PATIENTS Fifty-three participants 60 years or older, including 15 depressed patients who had attempted suicide, 18 depressed patients who had never attempted suicide (depressed control subjects), and 20 psychiatrically healthy controls. MAIN OUTCOMES AND MEASURES Components of the cortical blood oxygenation level–dependent response tracking expected and unpredicted rewards. RESULTS Depressed elderly participants displayed 2 distinct disruptions of control over reward-guided behavior. First, impulsivity and a history of suicide attempts (particularly poorly planned ones) were associated with a weakened expected reward signal in the paralimbic cortex, which in turn predicted the behavioral insensitivity to contingency change. Second, depression was associated with disrupted corticostriatothalamic encoding of unpredicted rewards, which in turn predicted the behavioral oversensitivity to punishment. These results were robust to the effects of possible brain damage from suicide attempts, depressive severity, co-occurring substance use and anxiety disorders, antidepressant and anticholinergic exposure, lifetime exposure to electroconvulsive therapy, vascular illness, and incipient dementia. CONCLUSIONS AND RELEVANCE Altered paralimbic reward signals and

Do reward-processing deficits in schizophrenia-spectrum disorders promote cannabis use? An investigation of physiological response to natural rewards and drug cues

PubMed Central

Cassidy, Clifford M.; Brodeur, Mathieu B.; Lepage, Martin; Malla, Ashok

2014-01-01

Background Dysfunctional reward processing is present in individuals with schizophrenia-spectrum disorders (SSD) and may confer vulnerability to addiction. Our objective was to identify a deficit in patients with SSD on response to rewarding stimuli and determine whether this deficit predicts cannabis use. Methods We divided a group of patients with SSD and nonpsychotic controls into cannabis users and nonusers. Response to emotional and cannabis-associated visual stimuli was assessed using self-report, event-related potentials (using the late positive potential [LPP]), facial electromyography and skin-conductance response. Results Our sample comprised 35 patients with SSD and 35 nonpsychotic controls. Compared with controls, the patients with SSD showed blunted LPP response to pleasant stimuli (p = 0.003). Across measures, cannabis-using controls showed greater response to pleasant stimuli than to cannabis stimuli whereas cannabis-using patients showed little bias toward pleasant stimuli. Reduced LPP response to pleasant stimuli was predictive of more frequent subsequent cannabis use (β = −0.24, p = 0.034). Limitations It is not clear if the deficit associated with cannabis use is specific to rewarding stimuli or nonspecific to any kind of emotionally salient stimuli. Conclusion The LPP captures a reward-processing deficit in patients with SSD and shows potential as a biomarker for identifying patients at risk of heavy cannabis use. PMID:24913137

A universal role of the ventral striatum in reward-based learning: Evidence from human studies

PubMed Central

Daniel, Reka; Pollmann, Stefan

2014-01-01

Reinforcement learning enables organisms to adjust their behavior in order to maximize rewards. Electrophysiological recordings of dopaminergic midbrain neurons have shown that they code the difference between actual and predicted rewards, i.e., the reward prediction error, in many species. This error signal is conveyed to both the striatum and cortical areas and is thought to play a central role in learning to optimize behavior. However, in human daily life rewards are diverse and often only indirect feedback is available. Here we explore the range of rewards that are processed by the dopaminergic system in human participants, and examine whether it is also involved in learning in the absence of explicit rewards. While results from electrophysiological recordings in humans are sparse, evidence linking dopaminergic activity to the metabolic signal recorded from the midbrain and striatum with functional magnetic resonance imaging (fMRI) is available. Results from fMRI studies suggest that the human ventral striatum (VS) receives valuation information for a diverse set of rewarding stimuli. These range from simple primary reinforcers such as juice rewards over abstract social rewards to internally generated signals on perceived correctness, suggesting that the VS is involved in learning from trial-and-error irrespective of the specific nature of provided rewards. In addition, we summarize evidence that the VS can also be implicated when learning from observing others, and in tasks that go beyond simple stimulus-action-outcome learning, indicating that the reward system is also recruited in more complex learning tasks. PMID:24825620

Individual differences in anticipatory activity to food rewards predict cue-induced appetitive 50-kHz calls in rats.

PubMed

Brenes, Juan C; Schwarting, Rainer K W

2015-10-01

Reward-related stimuli come to acquire incentive salience through Pavlovian learning and become capable of controlling reward-oriented behaviors. Here, we examined individual differences in anticipatory activity elicited by reward-related cues as indicative of how animals attribute incentive salience to otherwise neutral stimuli. Since adult rats can signal incentive motivation states through ultrasonic vocalizations (USVs) at around 50-kHz, such calls were recorded in food-deprived rats trained to associate cues with food rewards, which were subsequently devalued by satiation.We found that the extent to which animals developed conditioned anticipatory activity to food cues while food deprived determined the level of cue-induced appetitive USVs while sated. Re-exposure to reward cues after a free-testing period reinstated USVs, invigorated reward seeking and consumption, and again, increases in calling occurred only in animals with high levels of cue-induced anticipatory activity. Reward-experienced rats systemically challenged with the catecholamine agonist amphetamine or with the dopamine receptor antagonist flupenthixol showed attenuated responses to these drugs, especially for USVs and in subjects with high levels of cue-induced anticipatory activity. Our results suggest that individuals prone to attribute incentive salience to reward cues showed heightened reward-induced USVs which were reliably expressed over time and persisted despite physiological needs being fulfilled. Also, prone subjects seemed to undergo particular adaptations in their dopaminergic system related with incentive learning. Our findings may have translational relevance in preclinical research modeling compulsive disorders, which may be due to excessive attribution of incentive salience to reward cues, such as overeating, pathological gambling, and drug addiction.

A Fly’s Eye View of Natural and Drug Reward

PubMed Central

Lowenstein, Eve G.; Velazquez-Ulloa, Norma A.

2018-01-01

Animals encounter multiple stimuli each day. Some of these stimuli are innately appetitive or aversive, while others are assigned valence based on experience. Drugs like ethanol can elicit aversion in the short term and attraction in the long term. The reward system encodes the predictive value for different stimuli, mediating anticipation for attractive or punishing stimuli and driving animal behavior to approach or avoid conditioned stimuli. The neurochemistry and neurocircuitry of the reward system is partly evolutionarily conserved. In both vertebrates and invertebrates, including Drosophila melanogaster, dopamine is at the center of a network of neurotransmitters and neuromodulators acting in concert to encode rewards. Behavioral assays in D. melanogaster have become increasingly sophisticated, allowing more direct comparison with mammalian research. Moreover, recent evidence has established the functional modularity of the reward neural circuits in Drosophila. This functional modularity resembles the organization of reward circuits in mammals. The powerful genetic and molecular tools for D. melanogaster allow characterization and manipulation at the single-cell level. These tools are being used to construct a detailed map of the neural circuits mediating specific rewarding stimuli and have allowed for the identification of multiple genes and molecular pathways that mediate the effects of reinforcing stimuli, including their rewarding effects. This report provides an overview of the research on natural and drug reward in D. melanogaster, including natural rewards such as sugar and other food nutrients, and drug rewards including ethanol, cocaine, amphetamine, methamphetamine, and nicotine. We focused mainly on the known genetic and neural mechanisms underlying appetitive reward for sugar and reward for ethanol. We also include genes, molecular pathways, and neural circuits that have been identified using assays that test the palatability of the rewarding

Amygdala Contributions to Stimulus-Reward Encoding in the Macaque Medial and Orbital Frontal Cortex during Learning.

PubMed

Rudebeck, Peter H; Ripple, Joshua A; Mitz, Andrew R; Averbeck, Bruno B; Murray, Elisabeth A

2017-02-22

Orbitofrontal cortex (OFC), medial frontal cortex (MFC), and amygdala mediate stimulus-reward learning, but the mechanisms through which they interact are unclear. Here, we investigated how neurons in macaque OFC and MFC signaled rewards and the stimuli that predicted them during learning with and without amygdala input. Macaques performed a task that required them to evaluate two stimuli and then choose one to receive the reward associated with that option. Four main findings emerged. First, amygdala lesions slowed the acquisition and use of stimulus-reward associations. Further analyses indicated that this impairment was due, at least in part, to ineffective use of negative feedback to guide subsequent decisions. Second, the activity of neurons in OFC and MFC rapidly evolved to encode the amount of reward associated with each stimulus. Third, amygdalectomy reduced encoding of stimulus-reward associations during the evaluation of different stimuli. Reward encoding of anticipated and received reward after choices were made was not altered. Fourth, amygdala lesions led to an increase in the proportion of neurons in MFC, but not OFC, that encoded the instrumental response that monkeys made on each trial. These correlated changes in behavior and neural activity after amygdala lesions strongly suggest that the amygdala contributes to the ability to learn stimulus-reward associations rapidly by shaping encoding within OFC and MFC. SIGNIFICANCE STATEMENT Altered functional interactions among orbital frontal cortex (OFC), medial frontal cortex (MFC), and amygdala are thought to underlie several psychiatric conditions, many related to reward learning. Here, we investigated the causal contribution of the amygdala to the development of neuronal activity in macaque OFC and MFC related to rewards and the stimuli that predict them during learning. Without amygdala inputs, neurons in both OFC and MFC showed decreased encoding of stimulus-reward associations. MFC also showed

A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation.

PubMed

Deci, E L; Koestner, R; Ryan, R M

1999-11-01

A meta-analysis of 128 studies examined the effects of extrinsic rewards on intrinsic motivation. As predicted, engagement-contingent, completion-contingent, and performance-contingent rewards significantly undermined free-choice intrinsic motivation (d = -0.40, -0.36, and -0.28, respectively), as did all rewards, all tangible rewards, and all expected rewards. Engagement-contingent and completion-contingent rewards also significantly undermined self-reported interest (d = -0.15, and -0.17), as did all tangible rewards and all expected rewards. Positive feedback enhanced both free-choice behavior (d = 0.33) and self-reported interest (d = 0.31). Tangible rewards tended to be more detrimental for children than college students, and verbal rewards tended to be less enhancing for children than college students. The authors review 4 previous meta-analyses of this literature and detail how this study's methods, analyses, and results differed from the previous ones.

Chromosomal aberrations in peripheral lymphocytes of train engine drivers.

PubMed

Nordenson, I; Mild, K H; Järventaus, H; Hirvonen, A; Sandström, M; Wilén, J; Blix, N; Norppa, H

2001-07-01

Studies of Swedish railway employees have indicated that railroad engine drivers have an increased cancer morbidity and incidence of chronic lymphatic leukemia. The drivers are exposed to relatively high magnetic fields (MF), ranging from a few to over a hundred microT. Although the possible genotoxic potential of MF is unclear, some earlier studies have indicated that occupational exposure to MF may increase chromosome aberrations in blood lymphocytes. Since an increased level of chromosomal aberrations has been suggested to predict elevated cancer risk, we performed a cytogenetic analysis on cultured (48 h) peripheral lymphocytes of Swedish train engine drivers. A pilot study of 18 engine drivers indicated a significant difference in the frequency of cells with chromosomal aberrations (gaps included or excluded) in comparison with seven concurrent referents (train dispatchers) and a control group of 16 office workers. The engine drivers had about four times higher frequency of cells with chromosome-type aberrations (excluding gaps) than the office workers (P < 0.01) and the dispatchers (P < 0.05). Seventy-eight percent of the engine drivers showed at least one cell per 100 with chromosome-type aberrations compared with 29% among the dispatchers and 31% among the office workers. In a follow-up study, another 30 engine drivers showed an increase (P < 0.05) in the frequency of cells with chromosome-type aberrations (gaps excluded) as compared with 30 referent policemen. Sixty percent of the engine drivers had one or more cells (per 100 cells) with chromosome-type aberrations compared with 30% among the policemen. In conclusion, the results of the two studies support the hypothesis that exposure to MF at mean intensities of 2-15 microT can induce chromosomal damage. Copyright 2001 Wiley-Liss, Inc.

Attentional Bias for Non-drug Reward is Magnified in Addiction

PubMed Central

Anderson, Brian A.; Faulkner, Monica L.; Rilee, Jessica J.; Yantis, Steven; Marvel, Cherie L.

2014-01-01

Attentional biases for drug-related stimuli play a prominent role in addiction, predicting treatment outcome. Attentional biases also develop for stimuli that have been paired with non-drug reward in adults without a history of addiction, the magnitude of which is predicted by visual working memory capacity and impulsiveness. We tested the hypothesis that addiction is associated with an increased attentional bias for non-drug (monetary) reward relative to that of healthy controls, and that this bias is related to working memory impairments and increased impulsiveness. Seventeen patients receiving methadone maintenance treatment for opioid dependence and seventeen healthy controls participated. Impulsiveness was measured using the Barratt Impulsiveness Scale (BIS-11), visual working memory capacity was measured as the ability to recognize briefly presented color stimuli, and attentional bias was measured as the magnitude of response time slowing caused by irrelevant but previously reward-associated distractors in a visual search task. The results showed that attention was biased toward the distractors across all participants, replicating previous findings. Importantly, this bias was significantly greater in the patients than in the controls and was negatively correlated with visual working memory capacity. Patients were also significantly more impulsive than controls as a group. Our findings demonstrate that patients in treatment for addiction experience greater difficulty ignoring stimuli associated with non-drug reward. This non-specific reward-related bias could mediate the distracting quality of drug-related stimuli previously observed in addiction. PMID:24128148

Reward can modulate attentional capture, independent of top-down set.

PubMed

Munneke, Jaap; Hoppenbrouwers, Sylco S; Theeuwes, Jan

2015-11-01

The traditional distinction between exogenous and endogenous attentional control has recently been enriched with an additional mode of control, termed "selection history." Recent findings have indicated, for instance, that previously rewarded or punished stimuli capture more attention than their physical attributes would predict. As such, the value that is associated with certain stimuli modulates attentional capture. This particular influence has also been shown for endogenous attention. Although recent leads have emerged, elucidating the influences of reward on exogenous and endogenous attention, it remains unclear to what extent exogenous attention is modulated by reward when endogenous attention is already deployed. We used a Posner cueing task in which exogenous and endogenous cues were presented to guide attention. Crucially, the exogenous cue also indicated the reward value. That is, the color of the exogenous cue indicated how much reward could be obtained on a given trial. The results showed main effects of endogenous and exogenous attention (i.e., speeded reaction times when either cue was valid, as compared to when it was invalid). Crucially, an interaction between exogenous cue validity and reward level was observed, indicating that reward-based associative-learning processes rapidly influence attentional capture, even when endogenous attention has been actively deployed.

Reward and Aversion.

PubMed

Hu, Hailan

2016-07-08

To benefit from opportunities and cope with challenges in the environment, animals must adapt their behavior to acquire rewards and to avoid punishments. Maladaptive changes in the neuromodulatory systems and neural circuits for reward and aversion can lead to manifestation of several prominent psychiatric disorders including addiction and depression. Recent progress is pushing the boundaries of knowledge on two major fronts in research on reward and aversion: First, new layers of complexity have been reported on the functions of dopamine (DA) and serotonin (5-HT) neuromodulatory systems in reward and aversion. Second, specific circuit components in the neural pathways that encode reward and aversion have begun to be identified. This review aims to outline historic perspectives and new insights into the functions of DA and 5-HT systems in coding the distinct components of rewards. It also highlights recent advances in neural circuit studies enabled by new technologies, such as cell-type-specific electrophysiology and tracing, and optogenetics-based behavioral manipulation. This knowledge may provide guidance for developing novel treatment strategies for neuropsychiatric diseases related to the malfunction of the reward system.

Optical aberrations, retinal image quality and eye growth: Experimentation and modeling

NASA Astrophysics Data System (ADS)

Tian, Yibin

2007-12-01

Retinal image quality is important for normal eye growth. Optical aberrations are of interest for two reasons: first, they degrade retinal images; second, they might provide some cues to defocus. Higher than normal ocular aberrations have been previously associated with human myopia. However, these studies were cross-sectional in design, and only reported aberrations in terms of root mean square (RMS) errors of Zernike coefficients, a poor metric of optical quality. This dissertation presents results from investigations of ocular optical aberrations, retinal image quality and eye growth in chicks and humans. A number of techniques were utilized, including Shack-Hartmann aberrometry, high-frequency A-scan ultrasonography, ciliary nerve section (CNX), photorefractive keratectomy (PRK) as well as computer simulations and modeling. A technique to extract light scatter information from Shack-Hartmann images was also developed. The main findings of the dissertation are summarized below. In young chicks, most ocular aberrations decreased with growth in both normal and CNX eyes, and there were diurnal fluctuations in some aberrations. Modeling suggested active reduction in higher order aberrations (HOAs) during early development. Although CNX eyes manifested greater than normal HOAs, they showed near normal growth. Retinal image degradation varied greatly among individual eyes post-PRK in young chicks. Including light scatter information into analyses of retinal image quality better estimated the latter. Albino eyes showed more severe retinal image degradation than normal eyes, due to increased optical aberrations and light scatter, but their growth was similar to those of normal eyes, implying that they are relatively insensitive to retina image quality. Although the above results questioned the influence of optical aberrations on early ocular growth, some optical quality metrics, derived from optical aberrations data, could predict how much the eyes of young chicks

Blunted Neural Response to Rewards as a Prospective Predictor of the Development of Depression in Adolescent Girls.

PubMed

Nelson, Brady D; Perlman, Greg; Klein, Daniel N; Kotov, Roman; Hajcak, Greg

2016-12-01

A blunted neural response to rewards has recently emerged as a potential mechanistic biomarker of adolescent depression. The reward positivity, an event-related potential elicited by feedback indicating monetary gain relative to loss, has been associated with risk for depression. The authors examined whether the reward positivity prospectively predicted the development of depression 18 months later in a large community sample of adolescent girls. The sample included 444 girls 13.5-15.5 years old with no lifetime history of a depressive disorder, along with a biological parent for each girl. At baseline, the adolescents' reward positivity was measured using a monetary guessing task, their current depressive symptoms were assessed using a self-report questionnaire, and the adolescents' and parents' lifetime psychiatric histories were evaluated with diagnostic interviews. The same interview and questionnaire were administered to the adolescents again approximately 18 months later. A blunted reward positivity at baseline predicted first-onset depressive disorder and greater depressive symptom scores 18 months later. The reward positivity was also a significant predictor independent of other prominent risk factors, including baseline depressive symptoms and adolescent and parental lifetime psychiatric history. The combination of a blunted reward positivity and greater depressive symptom scores at baseline provided the greatest positive predictive value for first-onset depressive disorder. This study provides strong converging evidence that a blunted neural response to rewards precedes adolescent-onset depression and symptom emergence. Blunted neural response may therefore constitute an important target for screening and prevention.

Medial orbitofrontal cortex codes relative rather than absolute value of financial rewards in humans.

PubMed

Elliott, R; Agnew, Z; Deakin, J F W

2008-05-01

Functional imaging studies in recent years have confirmed the involvement of orbitofrontal cortex (OFC) in human reward processing and have suggested that OFC responses are context-dependent. A seminal electrophysiological experiment in primates taught animals to associate abstract visual stimuli with differently valuable food rewards. Subsequently, pairs of these learned abstract stimuli were presented and firing of OFC neurons to the medium-value stimulus was measured. OFC firing was shown to depend on the relative value context. In this study, we developed a human analogue of this paradigm and scanned subjects using functional magnetic resonance imaging. The analysis compared neuronal responses to two superficially identical events, which differed only in terms of the preceding context. Medial OFC response to the same perceptual stimulus was greater when the stimulus predicted the more valuable of two rewards than when it predicted the less valuable. Additional responses were observed in other components of reward circuitry, the amygdala and ventral striatum. The central finding is consistent with the primate results and suggests that OFC neurons code relative rather than absolute reward value. Amygdala and striatal involvement in coding reward value is also consistent with recent functional imaging data. By using a simpler and less confounded paradigm than many functional imaging studies, we are able to demonstrate that relative financial reward value per se is coded in distinct subregions of an extended reward and decision-making network.

Reward-related neural activity and structure predict future substance use in dysregulated youth.

PubMed

Bertocci, M A; Bebko, G; Versace, A; Iyengar, S; Bonar, L; Forbes, E E; Almeida, J R C; Perlman, S B; Schirda, C; Travis, M J; Gill, M K; Diwadkar, V A; Sunshine, J L; Holland, S K; Kowatch, R A; Birmaher, B; Axelson, D A; Frazier, T W; Arnold, L E; Fristad, M A; Youngstrom, E A; Horwitz, S M; Findling, R L; Phillips, M L

2017-06-01

Identifying youth who may engage in future substance use could facilitate early identification of substance use disorder vulnerability. We aimed to identify biomarkers that predicted future substance use in psychiatrically un-well youth. LASSO regression for variable selection was used to predict substance use 24.3 months after neuroimaging assessment in 73 behaviorally and emotionally dysregulated youth aged 13.9 (s.d. = 2.0) years, 30 female, from three clinical sites in the Longitudinal Assessment of Manic Symptoms (LAMS) study. Predictor variables included neural activity during a reward task, cortical thickness, and clinical and demographic variables. Future substance use was associated with higher left middle prefrontal cortex activity, lower left ventral anterior insula activity, thicker caudal anterior cingulate cortex, higher depression and lower mania scores, not using antipsychotic medication, more parental stress, older age. This combination of variables explained 60.4% of the variance in future substance use, and accurately classified 83.6%. These variables explained a large proportion of the variance, were useful classifiers of future substance use, and showed the value of combining multiple domains to provide a comprehensive understanding of substance use development. This may be a step toward identifying neural measures that can identify future substance use disorder risk, and act as targets for therapeutic interventions.

Reward-based training of recurrent neural networks for cognitive and value-based tasks

PubMed Central

Song, H Francis; Yang, Guangyu R; Wang, Xiao-Jing

2017-01-01

Trained neural network models, which exhibit features of neural activity recorded from behaving animals, may provide insights into the circuit mechanisms of cognitive functions through systematic analysis of network activity and connectivity. However, in contrast to the graded error signals commonly used to train networks through supervised learning, animals learn from reward feedback on definite actions through reinforcement learning. Reward maximization is particularly relevant when optimal behavior depends on an animal’s internal judgment of confidence or subjective preferences. Here, we implement reward-based training of recurrent neural networks in which a value network guides learning by using the activity of the decision network to predict future reward. We show that such models capture behavioral and electrophysiological findings from well-known experimental paradigms. Our work provides a unified framework for investigating diverse cognitive and value-based computations, and predicts a role for value representation that is essential for learning, but not executing, a task. DOI: http://dx.doi.org/10.7554/eLife.21492.001 PMID:28084991

Comparing the neural basis of monetary reward and cognitive feedback during information-integration category learning.

PubMed

Daniel, Reka; Pollmann, Stefan

2010-01-06

The dopaminergic system is known to play a central role in reward-based learning (Schultz, 2006), yet it was also observed to be involved when only cognitive feedback is given (Aron et al., 2004). Within the domain of information-integration category learning, in which information from several stimulus dimensions has to be integrated predecisionally (Ashby and Maddox, 2005), the importance of contingent feedback is well established (Maddox et al., 2003). We examined the common neural correlates of reward anticipation and prediction error in this task. Sixteen subjects performed two parallel information-integration tasks within a single event-related functional magnetic resonance imaging session but received a monetary reward only for one of them. Similar functional areas including basal ganglia structures were activated in both task versions. In contrast, a single structure, the nucleus accumbens, showed higher activation during monetary reward anticipation compared with the anticipation of cognitive feedback in information-integration learning. Additionally, this activation was predicted by measures of intrinsic motivation in the cognitive feedback task and by measures of extrinsic motivation in the rewarded task. Our results indicate that, although all other structures implicated in category learning are not significantly affected by altering the type of reward, the nucleus accumbens responds to the positive incentive properties of an expected reward depending on the specific type of the reward.

Serotonergic neurons signal reward and punishment on multiple timescales

PubMed Central

Cohen, Jeremiah Y; Amoroso, Mackenzie W; Uchida, Naoshige

2015-01-01

Serotonin's function in the brain is unclear. One challenge in testing the numerous hypotheses about serotonin's function has been observing the activity of identified serotonergic neurons in animals engaged in behavioral tasks. We recorded the activity of dorsal raphe neurons while mice experienced a task in which rewards and punishments varied across blocks of trials. We ‘tagged’ serotonergic neurons with the light-sensitive protein channelrhodopsin-2 and identified them based on their responses to light. We found three main features of serotonergic neuron activity: (1) a large fraction of serotonergic neurons modulated their tonic firing rates over the course of minutes during reward vs punishment blocks; (2) most were phasically excited by punishments; and (3) a subset was phasically excited by reward-predicting cues. By contrast, dopaminergic neurons did not show firing rate changes across blocks of trials. These results suggest that serotonergic neurons signal information about reward and punishment on multiple timescales. DOI: http://dx.doi.org/10.7554/eLife.06346.001 PMID:25714923

Hedging Your Bets by Learning Reward Correlations in the Human Brain

PubMed Central

Wunderlich, Klaus; Symmonds, Mkael; Bossaerts, Peter; Dolan, Raymond J.

2011-01-01

Summary Human subjects are proficient at tracking the mean and variance of rewards and updating these via prediction errors. Here, we addressed whether humans can also learn about higher-order relationships between distinct environmental outcomes, a defining ecological feature of contexts where multiple sources of rewards are available. By manipulating the degree to which distinct outcomes are correlated, we show that subjects implemented an explicit model-based strategy to learn the associated outcome correlations and were adept in using that information to dynamically adjust their choices in a task that required a minimization of outcome variance. Importantly, the experimentally generated outcome correlations were explicitly represented neuronally in right midinsula with a learning prediction error signal expressed in rostral anterior cingulate cortex. Thus, our data show that the human brain represents higher-order correlation structures between rewards, a core adaptive ability whose immediate benefit is optimized sampling. PMID:21943609

Development of a Self-Report Measure of Reward Sensitivity:A Test in Current and Former Smokers.

PubMed

Hughes, John R; Callas, Peter W; Priest, Jeff S; Etter, Jean-Francois; Budney, Alan J; Sigmon, Stacey C

2017-06-01

Tobacco use or abstinence may increase or decrease reward sensitivity. Most existing measures of reward sensitivity were developed decades ago, and few have undergone extensive psychometric testing. We developed a 58-item survey of the anticipated enjoyment from, wanting for, and frequency of common rewards (the Rewarding Events Inventory-REI). The current analysis focuses on ratings of anticipated enjoyment. The first validation study recruited current and former smokers from Internet sites. The second study recruited smokers who wished to quit and monetarily reinforced them to stay abstinent in a laboratory study and a comparison group of former smokers. In both studies, participants completed the inventory on two occasions, 3-7 days apart. They also completed four anhedonia scales and a behavioral test of reduced reward sensitivity. Half of the enjoyment ratings loaded on four factors: socializing, active hobbies, passive hobbies, and sex/drug use. Cronbach's alpha coefficients were all ≥0.73 for overall mean and factor scores. Test-retest correlations were all ≥0.83. Correlations of the overall and factor scores with frequency of rewards and anhedonia scales were 0.19-0.53, except for the sex/drugs factor. The scores did not correlate with behavioral tests of reward and did not differ between current and former smokers. Lower overall mean enjoyment score predicted a shorter time to relapse. Internal reliability and test-retest reliability of the enjoyment outcomes of the REI are excellent, and construct and predictive validity are modest but promising. The REI is comprehensive and up-to-date, yet is short enough to use on repeated occasions. Replication tests, especially predictive validity tests, are needed. Both use of and abstinence from nicotine appear to increase or decrease how rewarding nondrug rewards are; however, self-report scales to test this have limitations. Our inventory of enjoyment from 58 rewards appears to be reliable and valid as well as

Paying for performance: Performance incentives increase desire for the reward object.

PubMed

Hur, Julia D; Nordgren, Loran F

2016-09-01

The current research examines how exposure to performance incentives affects one's desire for the reward object. We hypothesized that the flexible nature of performance incentives creates an attentional fixation on the reward object (e.g., money), which leads people to become more desirous of the rewards. Results from 5 laboratory experiments and 1 large-scale field study provide support for this prediction. When performance was incentivized with monetary rewards, participants reported being more desirous of money (Study 1), put in more effort to earn additional money in an ensuing task (Study 2), and were less willing to donate money to charity (Study 4). We replicated the result with nonmonetary rewards (Study 5). We also found that performance incentives increased attention to the reward object during the task, which in part explains the observed effects (Study 6). A large-scale field study replicated these findings in a real-world setting (Study 7). One laboratory experiment failed to replicate (Study 3). (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Impact of satisfactions with psychological reward and pay on Chinese nurses' work attitudes.

PubMed

Chen, Feifei; Yang, Min; Gao, Wei; Liu, Ye; De Gieter, Sara

2015-11-01

To examine the impact of satisfaction with psychological rewards (received from the head nurse and from physicians) and with pay on Chinese nurses' work attitudes. We conducted a cross-sectional survey in China. A total of 413 nurses completed our survey. We examined the effect of satisfactions with psychological rewards and pay on work attitudes by performing a series of hierarchical regression analyses. We found that both satisfaction with pay and satisfaction with psychological rewards from the head nurse significantly predicted work attitudes, whereas satisfaction with psychological rewards from physicians did not. Our results illustrate that when nurses feel satisfied with their pay and the psychological rewards received from the head nurse they exhibit more positive work attitudes. Copyright © 2015 Elsevier Inc. All rights reserved.

Pressure to cooperate: is positive reward interdependence really needed in cooperative learning?

PubMed

Buchs, Céline; Gilles, Ingrid; Dutrévis, Marion; Butera, Fabrizio

2011-03-01

BACKGROUND. Despite extensive research on cooperative learning, the debate regarding whether or not its effectiveness depends on positive reward interdependence has not yet found clear evidence. AIMS. We tested the hypothesis that positive reward interdependence, as compared to reward independence, enhances cooperative learning only if learners work on a 'routine task'; if the learners work on a 'true group task', positive reward interdependence induces the same level of learning as reward independence. SAMPLE. The study involved 62 psychology students during regular workshops. METHOD. Students worked on two psychology texts in cooperative dyads for three sessions. The type of task was manipulated through resource interdependence: students worked on either identical (routine task) or complementary (true group task) information. Students expected to be assessed with a Multiple Choice Test (MCT) on the two texts. The MCT assessment type was introduced according to two reward interdependence conditions, either individual (reward independence) or common (positive reward interdependence). A follow-up individual test took place 4 weeks after the third session of dyadic work to examine individual learning. RESULTS. The predicted interaction between the two types of interdependence was significant, indicating that students learned more with positive reward interdependence than with reward independence when they worked on identical information (routine task), whereas students who worked on complementary information (group task) learned the same with or without reward interdependence. CONCLUSIONS. This experiment sheds light on the conditions under which positive reward interdependence enhances cooperative learning, and suggests that creating a real group task allows to avoid the need for positive reward interdependence. © 2010 The British Psychological Society.

Basolateral Amygdala to Orbitofrontal Cortex Projections Enable Cue-Triggered Reward Expectations

PubMed Central

Lichtenberg, Nina T.; Pennington, Zachary T.; Holley, Sandra M.; Greenfield, Venuz Y.; Levine, Michael S.

2017-01-01

required for expectations of specific available rewards to influence reward seeking and decision making. The necessity of these projections was limited to situations in which expectations were elicited by reward-predictive cues. These projections therefore facilitate adaptive behavior by enabling the orbitofrontal cortex to use environmental stimuli to generate expectations of potential future rewarding events. PMID:28743727

Reward positivity is elicited by monetary reward in the absence of response choice.

PubMed

Varona-Moya, Sergio; Morís, Joaquín; Luque, David

2015-02-11

The neural response to positive and negative feedback differs in their event-related potentials. Most often this difference is interpreted as the result of a negative voltage deflection after negative feedback. This deflection has been referred to as the feedback-related negativity component. The reinforcement learning model of the feedback-related negativity establishes that this component reflects an error monitoring process aimed to increase behavior adjustment progressively. However, a recent proposal suggests that the difference observed is actually due to a positivity reflecting the rewarding value of positive feedbacks - that is, the reward positivity component (RewP). From this it follows that RewP could be found even in the absence of any action-monitoring processes. We tested this prediction by means of an experiment in which visual target stimuli were intermixed with nontarget stimuli. Three types of targets signaled money gains, money losses, or the absence of either money gain or money loss, respectively. No motor response was required. Event-related potential analyses showed a central positivity in a 270-370 ms time window that was elicited by target stimuli signaling money gains, as compared with both stimuli signaling losses and no-gain/no-loss neutral stimuli. This is the first evidence to show that RewP is obtained when stimuli with rewarding values are passively perceived.

Negative urgency and reward/punishment sensitivity in intermittent explosive disorder.

PubMed

Puhalla, Alexander A; Ammerman, Brooke A; Uyeji, Lauren L; Berman, Mitchell E; McCloskey, Michael S

2016-09-01

Intermittent explosive disorder (IED) is the sole psychiatric diagnosis in which affective aggression is the cardinal symptom. Previous research has been equivocal with regard to the relationship between IED and impulsivity. This inconsistency may reflect the varied facets of impulsivity, with some aspects of impulsivity (e.g. negative urgency) as well as some overlapping, albeit distinct constructs (e.g. reward and punishment sensitivity) yet to be studied. The present study compared individuals diagnosed with IED (n=81) with psychiatric controls (PCs; n=52) and healthy volunteers (HVs; n=58) on the impulsivity domains of negative and positive urgency, perseverance, sensation seeking, and premeditation, as well as on reward and punishment sensitivity. We hypothesized that individuals with IED would show greater negative and positive urgency, reward sensitivity, punishment sensitivity, with negative urgency independently predicting IED status. We also hypothesized that negative urgency would predict levels of anger, aggression, and aggression control among those with IED. The IED participants reported greater negative urgency than both comparison groups, and greater levels of positive urgency, reward sensitivity, and punishment sensitivity compared to HVs. Further, heightened negative urgency was the sole predictor an IED diagnosis. Within the IED group negative urgency uniquely predicted decreased aggression control and increased trait anger. Limitations included reliance on self-report measures to assess RS/PS, impulsivity, and aggression. These findings suggest that negative urgency is a key factor associated with IED and is associated with dampened control of aggression within those with IED. Copyright © 2016 Elsevier B.V. All rights reserved.

An ecologically based model of alcohol-consumption decision making: evidence for the discriminative and predictive role of contextual reward and punishment information.

PubMed

Bogg, Tim; Finn, Peter R

2009-05-01

Using insights from Ecological Systems Theory and Reinforcement Sensitivity Theory, the current study assessed the utility of a series of hypothetical role-based alcohol-consumption scenarios that varied in their presentation of rewarding and punishing information. The scenarios, along with measures of impulsive sensation seeking and a self-report of weekly alcohol consumption, were administered to a sample of alcohol-dependent and non-alcohol-dependent college-age individuals (N = 170). The results showed scenario attendance decisions were largely unaffected by alcohol-dependence status and variations in contextual reward and punishment information. In contrast to the attendance findings, the results for the alcohol-consumption decisions showed alcohol-dependent individuals reported a greater frequency of deciding to drink, as well as indicating greater alcohol consumption in the contexts of complementary rewarding or nonpunishing information. Regression results provided evidence for the criterion-related validity of scenario outcomes in an account of diagnostic alcohol problems. The results are discussed in terms of the conceptual and predictive gains associated with an assessment approach to alcohol-consumption decision making that combines situational information organized and balanced through the frameworks of Ecological Systems Theory and Reinforcement Sensitivity Theory.

An Ecologically Based Model of Alcohol-Consumption Decision Making: Evidence for the Discriminative and Predictive Role of Contextual Reward and Punishment Information*

PubMed Central

Bogg, Tim; Finn, Peter R.

2009-01-01

Objective: Using insights from Ecological Systems Theory and Reinforcement Sensitivity Theory, the current study assessed the utility of a series of hypothetical role-based alcohol-consumption scenarios that varied in their presentation of rewarding and punishing information. Method: The scenarios, along with measures of impulsive sensation seeking and a self-report of weekly alcohol consumption, were administered to a sample of alcohol-dependent and non-alcohol-dependent college-age individuals (N = 170). Results: The results showed scenario attendance decisions were largely unaffected by alcohol-dependence status and variations in contextual reward and punishment information. In contrast to the attendance findings, the results for the alcohol-consumption decisions showed alcohol-dependent individuals reported a greater frequency of deciding to drink, as well as indicating greater alcohol consumption in the contexts of complementary rewarding or nonpunishing information. Regression results provided evidence for the criterion-related validity of scenario outcomes in an account of diagnostic alcohol problems. Conclusions: The results are discussed in terms of the conceptual and predictive gains associated with an assessment approach to alcohol-consumption decision making that combines situational information organized and balanced through the frameworks of Ecological Systems Theory and Reinforcement Sensitivity Theory. PMID:19371496

Heterogeneity of reward mechanisms.

PubMed

Lajtha, A; Sershen, H

2010-06-01

The finding that many drugs that have abuse potential and other natural stimuli such as food or sexual activity cause similar chemical changes in the brain, an increase in extracellular dopamine (DA) in the shell of the nucleus accumbens (NAccS), indicated some time ago that the reward mechanism is at least very similar for all stimuli and that the mechanism is relatively simple. The presently available information shows that the mechanisms involved are more complex and have multiple elements. Multiple brain regions, multiple receptors, multiple distinct neurons, multiple transmitters, multiple transporters, circuits, peptides, proteins, metabolism of transmitters, and phosphorylation, all participate in reward mechanisms. The system is variable, is changed during development, is sex-dependent, and is influenced by genetic differences. Not all of the elements participate in the reward of all stimuli. Different set of mechanisms are involved in the reward of different drugs of abuse, yet different mechanisms in the reward of natural stimuli such as food or sexual activity; thus there are different systems that distinguish different stimuli. Separate functions of the reward system such as anticipation, evaluation, consummation and identification; all contain function-specific elements. The level of the stimulus also influences the participation of the elements of the reward system, there are possible reactions to even below threshold stimuli, and excessive stimuli can change reward to aversion involving parts of the system. Learning and memory of past reward is an important integral element of reward and addictive behavior. Many of the reward elements are altered by repeated or chronic stimuli, and chronic exposure to one drug is likely to alter the response to another stimulus. To evaluate and identify the reward stimulus thus requires heterogeneity of the reward components in the brain.

Quantifying individual variation in the propensity to attribute incentive salience to reward cues.

PubMed

Meyer, Paul J; Lovic, Vedran; Saunders, Benjamin T; Yager, Lindsay M; Flagel, Shelly B; Morrow, Jonathan D; Robinson, Terry E

2012-01-01

If reward-associated cues acquire the properties of incentive stimuli they can come to powerfully control behavior, and potentially promote maladaptive behavior. Pavlovian incentive stimuli are defined as stimuli that have three fundamental properties: they are attractive, they are themselves desired, and they can spur instrumental actions. We have found, however, that there is considerable individual variation in the extent to which animals attribute Pavlovian incentive motivational properties ("incentive salience") to reward cues. The purpose of this paper was to develop criteria for identifying and classifying individuals based on their propensity to attribute incentive salience to reward cues. To do this, we conducted a meta-analysis of a large sample of rats (N = 1,878) subjected to a classic Pavlovian conditioning procedure. We then used the propensity of animals to approach a cue predictive of reward (one index of the extent to which the cue was attributed with incentive salience), to characterize two behavioral phenotypes in this population: animals that approached the cue ("sign-trackers") vs. others that approached the location of reward delivery ("goal-trackers"). This variation in Pavlovian approach behavior predicted other behavioral indices of the propensity to attribute incentive salience to reward cues. Thus, the procedures reported here should be useful for making comparisons across studies and for assessing individual variation in incentive salience attribution in small samples of the population, or even for classifying single animals.

Mood congruent tuning of reward expectation in positive mood: evidence from FRN and theta modulations

PubMed Central

Pourtois, Gilles

2017-01-01

Abstract Positive mood broadens attention and builds additional mental resources. However, its effect on performance monitoring and reward prediction errors remain unclear. To examine this issue, we used a standard mood induction procedure (based on guided imagery) and asked 45 participants to complete a gambling task suited to study reward prediction errors by means of the feedback-related negativity (FRN) and mid-frontal theta band power. Results showed a larger FRN for negative feedback as well as a lack of reward expectation modulation for positive feedback at the theta level with positive mood, relative to a neutral mood condition. A control analysis showed that this latter result could not be explained by the mere superposition of the event-related brain potential component on the theta oscillations. Moreover, these neurophysiological effects were evidenced in the absence of impairments at the behavioral level or increase in autonomic arousal with positive mood, suggesting that this mood state reliably altered brain mechanisms of reward prediction errors during performance monitoring. We interpret these new results as reflecting a genuine mood congruency effect, whereby reward is anticipated as the default outcome with positive mood and therefore processed as unsurprising (even when it is unlikely), while negative feedback is perceived as unexpected. PMID:28199707

Aberrations in square pore micro-channel optics used for x-ray lobster eye telescopes

NASA Astrophysics Data System (ADS)

Willingale, R.; Pearson, J. F.; Martindale, A.; Feldman, C. H.; Fairbend, R.; Schyns, E.; Petit, S.; Osborne, J. P.; O'Brien, P. T.

2016-07-01

We identify all the significant aberrations that limit the performance of square pore micro-channel plate optics (MPOs) used as an X-ray lobster eye. These include aberrations intrinsic to the geometry, intrinsic errors associated with the slumping process used to introduce a spherical form to the plates and imperfections associated with the plate manufacturing process. The aberrations are incorporated into a comprehensive software model of the X-ray response of the optics and the predicted imaging response is compared with the measured X-ray performance obtained from a breadboard lobster eye. The results reveal the manufacturing tolerances which limit the current performance of MPOs and enable us to identify particular intrinsic aberrations which will limit the ultimate performance we can expect from MPO-lobster eye telescopes.

Temporal and probabilistic discounting of rewards in children and adolescents: effects of age and ADHD symptoms.

PubMed

Scheres, Anouk; Dijkstra, Marianne; Ainslie, Eleanor; Balkan, Jaclyn; Reynolds, Brady; Sonuga-Barke, Edmund; Castellanos, F Xavier

2006-01-01

This study investigated whether age and ADHD symptoms affected choice preferences in children and adolescents when they chose between (1) small immediate rewards and larger delayed rewards and (2) small certain rewards and larger probabilistic uncertain rewards. A temporal discounting (TD) task and a probabilistic discounting (PD) task were used to measure the degree to which the subjective value of a large reward decreased as one had to wait longer for it (TD), and as the probability of obtaining it decreased (PD). Rewards used were small amounts of money. In the TD task, the large reward (10 cents) was delayed by between 0 and 30s, and the immediate reward varied in magnitude (0-10 cents). In the PD task, receipt of the large reward (10 cents) varied in likelihood, with probabilities of 0, 0.25, 0.5, 0.75, and 1.0 used, and the certain reward varied in magnitude (0-10 cents). Age and diagnostic group did not affect the degree of PD of rewards: All participants made choices so that total gains were maximized. As predicted, young children, aged 6-11 years (n = 25) demonstrated steeper TD of rewards than adolescents, aged 12-17 years (n = 21). This effect remained significant even when choosing the immediate reward did not shorten overall task duration. This, together with the lack of interaction between TD task version and age, suggests that steeper discounting in young children is driven by reward immediacy and not by delay aversion. Contrary to our predictions, participants with ADHD (n = 22) did not demonstrate steeper TD of rewards than controls (n = 24). These results raise the possibility that strong preferences for small immediate rewards in ADHD, as found in previous research, depend on factors such as total maximum gain and the use of fixed versus varied delay durations. The decrease in TD as observed in adolescents compared to children may be related to developmental changes in the (dorsolateral) prefrontal cortex. Future research needs to investigate

Probability differently modulating the effects of reward and punishment on visuomotor adaptation.

PubMed

Song, Yanlong; Smiley-Oyen, Ann L

2017-12-01

Recent human motor learning studies revealed that punishment seemingly accelerated motor learning but reward enhanced consolidation of motor memory. It is not evident how intrinsic properties of reward and punishment modulate the potentially dissociable effects of reward and punishment on motor learning and motor memory. It is also not clear what causes the dissociation of the effects of reward and punishment. By manipulating probability of distribution, a critical property of reward and punishment, the present study demonstrated that probability had distinct modulation on the effects of reward and punishment in adapting to a sudden visual rotation and consolidation of the adaptation memory. Specifically, two probabilities of monetary reward and punishment distribution, 50 and 100%, were applied during young adult participants adapting to a sudden visual rotation. Punishment and reward showed distinct effects on motor adaptation and motor memory. The group that received punishments in 100% of the adaptation trials adapted significantly faster than the other three groups, but the group that received rewards in 100% of the adaptation trials showed marked savings in re-adapting to the same rotation. In addition, the group that received punishments in 50% of the adaptation trials that were randomly selected also had savings in re-adapting to the same rotation. Sensitivity to sensory prediction error or difference in explicit process induced by reward and punishment may likely contribute to the distinct effects of reward and punishment.

The Environmental Reward Observation Scale (EROS): development, validity, and reliability.

PubMed

Armento, Maria E A; Hopko, Derek R

2007-06-01

Researchers acknowledge a strong association between the frequency and duration of environmental reward and affective mood states, particularly in relation to the etiology, assessment, and treatment of depression. Given behavioral theories that outline environmental reward as a strong mediator of affect and the unavailability of an efficient, reliable, and valid self-report measure of environmental reward, we developed the Environmental Reward Observation Scale (EROS) and examined its psychometric properties. In Experiment 1, exploratory factor analysis supported a unidimensional 10-item measure with strong internal consistency and test-retest reliability. When administered to a replication sample, confirmatory factor analysis suggested an excellent fit to the 1-factor model and convergent/discriminant validity data supported the construct validity of the EROS. In Experiment 2, further support for the convergent validity of the EROS was obtained via moderate correlations with the Pleasant Events Schedule (PES; MacPhillamy & Lewinsohn, 1976). In Experiment 3, hierarchical regression supported the ecological validity of the EROS toward predicting daily diary reports of time spent in highly rewarding behaviors and activities. Above and beyond variance accounted for by depressive symptoms (BDI), the EROS was associated with significant incremental variance in accounting for time spent in both low and high reward behaviors. The EROS may represent a brief, reliable and valid measure of environmental reward that may improve the psychological assessment of negative mood states such as clinical depression.

Goal or gold: overlapping reward processes in soccer players upon scoring and winning money.

PubMed

Häusler, Alexander Niklas; Becker, Benjamin; Bartling, Marcel; Weber, Bernd

2015-01-01

Social rewards are important incentives for human behavior. This is especially true in team sports such as the most popular one worldwide: soccer. We investigated reward processing upon scoring a soccer goal in a standard two-versus-one situation and in comparison to winning in a monetary incentive task. The results show a strong overlap in brain activity between the two conditions in established reward regions of the mesolimbic dopaminergic system, including the ventral striatum and ventromedial pre-frontal cortex. The three main components of reward-associated learning, i.e., reward probability (RP), reward reception (RR) and reward prediction errors (RPE) showed highly similar activation in both con-texts, with only the RR and RPE components displaying overlapping reward activity. Passing and shooting behavior did not correlate with individual egoism scores, but we observe a positive correlation be-tween egoism and activity in the left middle frontal gyrus upon scoring after a pass versus a direct shot. Our findings suggest that rewards in the context of soccer and monetary incentives are based on similar neural processes.

Goal or Gold: Overlapping Reward Processes in Soccer Players upon Scoring and Winning Money

PubMed Central

Häusler, Alexander Niklas; Becker, Benjamin; Bartling, Marcel; Weber, Bernd

2015-01-01

Social rewards are important incentives for human behavior. This is especially true in team sports such as the most popular one worldwide: soccer. We investigated reward processing upon scoring a soccer goal in a standard two-versus-one situation and in comparison to winning in a monetary incentive task. The results show a strong overlap in brain activity between the two conditions in established reward regions of the mesolimbic dopaminergic system, including the ventral striatum and ventromedial pre-frontal cortex. The three main components of reward-associated learning i.e. reward probability (RP), reward reception (RR) and reward prediction errors (RPE) showed highly similar activation in both con-texts, with only the RR and RPE components displaying overlapping reward activity. Passing and shooting behavior did not correlate with individual egoism scores, but we observe a positive correlation be-tween egoism and activity in the left middle frontal gyrus upon scoring after a pass versus a direct shot. Our findings suggest that rewards in the context of soccer and monetary incentives are based on similar neural processes. PMID:25875594

Mask-induced aberration in EUV lithography

NASA Astrophysics Data System (ADS)

Nakajima, Yumi; Sato, Takashi; Inanami, Ryoichi; Nakasugi, Tetsuro; Higashiki, Tatsuhiko

2009-04-01

We estimated aberrations using Zernike sensitivity analysis. We found the difference of the tolerated aberration with line direction for illumination. The tolerated aberration of perpendicular line for illumination is much smaller than that of parallel line. We consider this difference to be attributable to the mask 3D effect. We call it mask-induced aberration. In the case of the perpendicular line for illumination, there was a difference in CD between right line and left line without aberration. In this report, we discuss the possibility of pattern formation in NA 0.25 generation EUV lithography tool. In perpendicular pattern for EUV light, the dominant part of aberration is mask-induced aberration. In EUV lithography, pattern correction based on the mask topography effect will be more important.

Severe Violence During Adolescence and Early Adulthood and Its Relation to Anticipated Rewards and Costs.

PubMed

Shulman, Elizabeth P; Monahan, Kathryn C; Steinberg, Laurence

2017-01-01

This report compares the effects (concurrent and lagged) of the anticipated rewards and costs of violent crime on engagement in severe violence in a sample of male juvenile offenders (N = 1,170; 42.1% black, 34.0% Hispanic, 19.2% white, and 4.6% other; ages 14-18 at baseline). Anticipated rewards (social approval, thrill) are more predictive of concurrent severe violence than are anticipated costs (social disapproval, risk of punishment). The analysis finds no evidence that perceptions of the rewards and costs of violent crime influence engagement in severe violence 6 months later. The results support the view that adolescence is a time of heightened reward salience but raise doubt about the longitudinal predictive validity of perceptions about crime during this time of life. © 2017 The Authors. Child Development © 2017 Society for Research in Child Development, Inc.

Neuroendocrinology and brain imaging of reward in eating disorders: A possible key to the treatment of anorexia nervosa and bulimia nervosa.

PubMed

Monteleone, Alessio Maria; Castellini, Giovanni; Volpe, Umberto; Ricca, Valdo; Lelli, Lorenzo; Monteleone, Palmiero; Maj, Mario

2018-01-03

Anorexia nervosa and bulimia nervosa are severe eating disorders whose etiopathogenesis is still unknown. Clinical features suggest that eating disorders may develop as reward-dependent syndromes, since eating less food is perceived as rewarding in anorexia nervosa while consumption of large amounts of food during binge episodes in bulimia nervosa aims at reducing the patient's negative emotional states. Therefore, brain reward mechanisms have been a major focus of research in the attempt to contribute to the comprehension of the pathophysiology of these disorders. Structural brain imaging data provided the evidence that brain reward circuits may be altered in patients with anorexia or bulimia nervosa. Similarly, functional brain imaging studies exploring the activation of brain reward circuits by food stimuli as well as by stimuli recognized to be potentially rewarding for eating disordered patients, such as body image cues or stimuli related to food deprivation and physical hyperactivity, showed several dysfunctions in ED patients. Moreover, very recently, it has been demonstrated that some of the biochemical homeostatic modulators of eating behavior are also implicated in the regulation of food-related and non-food-related reward, representing a possible link between the aberrant behaviors of ED subjects and their hypothesized deranged reward processes. In particular, changes in leptin and ghrelin occur in patients with anorexia or bulimia nervosa and have been suggested to represent not only homeostatic adaptations to an altered energy balance but to contribute also to the acquisition and/or maintenance of persistent starvation, binge eating and physical hyperactivity, which are potentially rewarding for ED patients. On the basis of such findings new pathogenetic models of EDs have been proposed, and these models may provide new theoretical basis for the development of innovative treatment strategies, either psychological and pharmacological, with the aim to

Homeostatic reinforcement learning for integrating reward collection and physiological stability.

PubMed

Keramati, Mehdi; Gutkin, Boris

2014-12-02

Efficient regulation of internal homeostasis and defending it against perturbations requires adaptive behavioral strategies. However, the computational principles mediating the interaction between homeostatic and associative learning processes remain undefined. Here we use a definition of primary rewards, as outcomes fulfilling physiological needs, to build a normative theory showing how learning motivated behaviors may be modulated by internal states. Within this framework, we mathematically prove that seeking rewards is equivalent to the fundamental objective of physiological stability, defining the notion of physiological rationality of behavior. We further suggest a formal basis for temporal discounting of rewards by showing that discounting motivates animals to follow the shortest path in the space of physiological variables toward the desired setpoint. We also explain how animals learn to act predictively to preclude prospective homeostatic challenges, and several other behavioral patterns. Finally, we suggest a computational role for interaction between hypothalamus and the brain reward system.

Reward and relief craving tendencies in patients with alcohol use disorders: results from the PREDICT study.

PubMed

Glöckner-Rist, Angelika; Lémenager, Tagrid; Mann, Karl

2013-02-01

Previous research suggests that patients' tendencies toward either reward or relief craving are distinct continuous factorial dimensions of craving for alcohol. According to these tendencies patients with alcohol use disorders (AUD) might also be allocated into distinct subgroups. In personalized treatment, patients of such different subgroups might respond differently to various psychotherapeutic and pharmacological interventions aimed at relapse prevention. To establish that the items of the subscale Temptation to Drink of the Alcohol Abstinence Self-Efficacy Scale (AASE) capture two continuous dimensions of reward and relief craving, and that they allow the identification of respective discrete class factors and subgroups of patients with AUD. Nonlinear confirmatory factor analysis (CFA) and latent class factor analysis (LCFA) were performed with data from 426 detoxified patients with AUD. The validity of continuous relief and reward dimensions, discrete class factors, and subtypes with different craving tendencies was established by including past drinking in positive and negative settings, gender, trait anxiety and perceived stress as covariates in the finally accepted CFA and LCFA measurement models. The AASE temptation items formed two continuous relief and reward craving factors. They also associated themselves to two binary class factors, which defined four craving subgroups. Two of them (21% and 29% of patients) were characterized by high levels of either reward or relief craving tendencies. A third subgroup (31%) rated both tendencies in an equal high measure, while a fourth (18%) reported almost no craving tendencies at all. Past drinking in negative and positive settings was significantly associated with relief or reward craving tendencies. Male patients reported reward drinking more frequently than female patients. Trait anxiety was positively related only to the relief craving tendency. Unexpectedly, patients' level of perceived stress was associated

Imbalance in the sensitivity to different types of rewards in pathological gambling.

PubMed

Sescousse, Guillaume; Barbalat, Guillaume; Domenech, Philippe; Dreher, Jean-Claude

2013-08-01

Pathological gambling is an addictive disorder characterized by a persistent and compulsive desire to engage in gambling activities. This maladaptive behaviour has been suggested to result from a decreased sensitivity to experienced rewards, regardless of reward type. Alternatively, pathological gambling might reflect an imbalance in the sensitivity to monetary versus non-monetary incentives. To directly test these two hypotheses, we examined how the brain reward circuit of pathological gamblers responds to different types of rewards. Using functional magnetic resonance imaging, we compared the brain responses of 18 pathological gamblers and 20 healthy control subjects while they engaged in a simple incentive task manipulating both monetary and visual erotic rewards. During reward anticipation, the ventral striatum of pathological gamblers showed a differential response to monetary versus erotic cues, essentially driven by a blunted reactivity to cues predicting erotic stimuli. This differential response correlated with the severity of gambling symptoms and was paralleled by a reduced behavioural motivation for erotic rewards. During reward outcome, a posterior orbitofrontal cortex region, responding to erotic rewards in both groups, was further recruited by monetary gains in pathological gamblers but not in control subjects. Moreover, while ventral striatal activity correlated with subjective ratings assigned to monetary and erotic rewards in control subjects, it only correlated with erotic ratings in gamblers. Our results point to a differential sensitivity to monetary versus non-monetary rewards in pathological gambling, both at the motivational and hedonic levels. Such an imbalance might create a bias towards monetary rewards, potentially promoting addictive gambling behaviour.

The human orbitofrontal cortex monitors outcomes even when no reward is at stake.

PubMed

Schnider, Armin; Treyer, Valerie; Buck, Alfred

2005-01-01

The orbitofrontal cortex (OFC) processes the occurrence or omission of anticipated rewards, but clinical evidence suggests that it might serve as a generic outcome monitoring system, independent of tangible reward. In this positron emission tomography (PET) study, normal human subjects performed a series of tasks in which they simply had to predict behind which one of two colored rectangles a drawing of an object was hidden. While all tasks involved anticipation in that they had an expectation phase between the subject's prediction and the presentation of the outcome, they varied with regards to the uncertainty of outcome. No comment on the correctness of the prediction, no record of ongoing performance, and no reward, not even a score, was provided. Nonetheless, we found strong activation of the OFC: in comparison with a baseline task, the left anterior medial OFC showed activation in all conditions, indicating a basic role in anticipation; the left posterior OFC was activated in all tasks with some uncertainty of outcome, suggesting a role in the monitoring of outcomes; the right medial OFC showed activation exclusively during guessing. The data indicate a generic role of the human OFC, with some topical specificity, in the generation of hypotheses and processing of outcomes, independent of the presence of explicit reward.

Adaptive neural reward processing during anticipation and receipt of monetary rewards in mindfulness meditators.

PubMed

Kirk, Ulrich; Brown, Kirk Warren; Downar, Jonathan

2015-05-01

Reward seeking is ubiquitous and adaptive in humans. But excessive reward seeking behavior, such as chasing monetary rewards, may lead to diminished subjective well-being. This study examined whether individuals trained in mindfulness meditation show neural evidence of lower susceptibility to monetary rewards. Seventy-eight participants (34 meditators, 44 matched controls) completed the monetary incentive delay task while undergoing functional magnetic resonance imaging. The groups performed equally on the task, but meditators showed lower neural activations in the caudate nucleus during reward anticipation, and elevated bilateral posterior insula activation during reward anticipation. Meditators also evidenced reduced activations in the ventromedial prefrontal cortex during reward receipt compared with controls. Connectivity parameters between the right caudate and bilateral anterior insula were attenuated in meditators during incentive anticipation. In summary, brain regions involved in reward processing-both during reward anticipation and receipt of reward-responded differently in mindfulness meditators than in nonmeditators, indicating that the former are less susceptible to monetary incentives. © The Author (2014). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

A Prediction Error-driven Retrieval Procedure for Destabilizing and Rewriting Maladaptive Reward Memories in Hazardous Drinkers

PubMed Central

Das, Ravi K.; Gale, Grace; Hennessy, Vanessa; Kamboj, Sunjeev K.

2018-01-01

Maladaptive reward memories (MRMs) can become unstable following retrieval under certain conditions, allowing their modification by subsequent new learning. However, robust (well-rehearsed) and chronologically old MRMs, such as those underlying substance use disorders, do not destabilize easily when retrieved. A key determinate of memory destabilization during retrieval is prediction error (PE). We describe a retrieval procedure for alcohol MRMs in hazardous drinkers that specifically aims to maximize the generation of PE and therefore the likelihood of MRM destabilization. The procedure requires explicitly generating the expectancy of alcohol consumption and then violating this expectancy (withholding alcohol) following the presentation of a brief set of prototypical alcohol cue images (retrieval + PE). Control procedures involve presenting the same cue images, but allow alcohol to be consumed, generating minimal PE (retrieval-no PE) or generate PE without retrieval of alcohol MRMs, by presenting orange juice cues (no retrieval + PE). Subsequently, we describe a multisensory disgust-based counterconditioning procedure to probe MRM destabilization by re-writing alcohol cue-reward associations prior to reconsolidation. This procedure pairs alcohol cues with images invoking pathogen disgust and an extremely bitter-tasting solution (denatonium benzoate), generating gustatory disgust. Following retrieval + PE, but not no retrieval + PE or retrieval-no PE, counterconditioning produces evidence of MRM rewriting as indexed by lasting reductions in alcohol cue valuation, attentional capture, and alcohol craving. PMID:29364255

Transitionality in addiction: A "temporal continuum" hypotheses involving the aberrant motivation, the hedonic dysregulation, and the aberrant learning.

PubMed

Patrono, Enrico; Gasbarri, Antonella; Tomaz, Carlos; Nishijo, Hisao

2016-08-01

Addiction is a chronic compulsion and relapsing disorder. It involves several brain areas and circuits, which encode vary functions such as reward, motivation, and memory. Drug addiction is defined as a "pathological pattern of use of a substance", characterized by the loss of control on drug-taking-related behaviors, the pursuance of those behaviors even in the presence of negative consequences, and a strong motivated activity to assume substances. Three different theories guide experimental research on drug addiction. Each of these theories consider singles features, such as an aberrant motivation, a hedonic dysregulation, and an aberrant habit learning as the main actor to explain the entire process of the addictive behaviors. The major goal of this study is to present a new hypotheses of transitionality from a controlled use to abuse of addictive substances trough the overview of the three different theories, considering all the single features of each single theory together on the same "temporal continuum" from use to abuse of addictive substances. Recently, it has been suggested that common neural systems may be activated by natural and pharmacological stimuli, raising the hypotheses that binge-eating disorders could be considered as addictive behaviors. The second goal of this study is to present evidences in order to highlight a possible psycho-bio-physiological superimposition between drug and "food addiction". Finally, interesting questions are brought up starting from last findings about a theoretical/psycho-bio-physiological superimposition between drug and "food addiction" and their possibly same transitionality along the same "temporal continuum" from use to abuse of addictive substances in order to investigate new therapeutic strategies based on new therapeutic strategies based on the individual moments characterizing the transition from the voluntary intake of substances to the maladaptive addictive behavior. Copyright © 2016. Published by Elsevier

Adaptive Reward Pursuit: How Effort Requirements Affect Unconscious Reward Responses and Conscious Reward Decisions

ERIC Educational Resources Information Center

Bijleveld, Erik; Custers, Ruud; Aarts, Henk

2012-01-01

When in pursuit of rewards, humans weigh the value of potential rewards against the amount of effort that is required to attain them. Although previous research has generally conceptualized this process as a deliberate calculation, recent work suggests that rudimentary mechanisms--operating without conscious intervention--play an important role as…

Medial Frontal Event-Related Potentials and Reward Prediction: Do Responses Matter?

ERIC Educational Resources Information Center

Martin, Laura E.; Potts, Geoffrey F.

2011-01-01

Medial frontal event-related potentials (ERPs) following rewarding feedback index outcome evaluation. The majority of studies examining the feedback related medial frontal negativity (MFN) employ active tasks during which participants' responses impact their feedback, however, the MFN has been elicited during passive tasks. Many of the studies…

Distinct Roles for the Amygdala and Orbitofrontal Cortex in Representing the Relative Amount of Expected Reward.

PubMed

Saez, Rebecca A; Saez, Alexandre; Paton, Joseph J; Lau, Brian; Salzman, C Daniel

2017-07-05

The same reward can possess different motivational meaning depending upon its magnitude relative to other rewards. To study the neurophysiological mechanisms mediating assignment of motivational meaning, we recorded the activity of neurons in the amygdala and orbitofrontal cortex (OFC) of monkeys during a Pavlovian task in which the relative amount of liquid reward associated with one conditioned stimulus (CS) was manipulated by changing the reward amount associated with a second CS. Anticipatory licking tracked relative reward magnitude, implying that monkeys integrated information about recent rewards to adjust the motivational meaning of a CS. Upon changes in relative reward magnitude, neural responses to reward-predictive cues updated more rapidly in OFC than amygdala, and activity in OFC but not the amygdala was modulated by recent reward history. These results highlight a distinction between the amygdala and OFC in assessing reward history to support the flexible assignment of motivational meaning to sensory cues. Copyright © 2017 Elsevier Inc. All rights reserved.

Brain substrates of reward processing and the μ-opioid receptor: a pathway into pain?

PubMed

Nees, Frauke; Becker, Susanne; Millenet, Sabina; Banaschewski, Tobias; Poustka, Luise; Bokde, Arun; Bromberg, Uli; Büchel, Christian; Conrod, Patricia J; Desrivières, Sylvane; Frouin, Vincent; Gallinat, Jürgen; Garavan, Hugh; Heinz, Andreas; Ittermann, Bernd; Martinot, Jean-Luc; Papadopoulos Orfanos, Dimitri; Paus, Tomáš; Smolka, Michael N; Walter, Henrik; Whelan, Rob; Schumann, Gunter; Flor, Herta

2017-02-01

The processing of reward and reinforcement learning seems to be important determinants of pain chronicity. However, reward processing is already altered early in life and if this is related to the development of pain symptoms later on is not known. The aim of this study was first to examine whether behavioural and brain-related indicators of reward processing at the age of 14 to 15 years are significant predictors of pain complaints 2 years later, at 16 to 17 years. Second, we investigated the contribution of genetic variations in the opioidergic system, which is linked to the processing of both, reward and pain, to this prediction. We used the monetary incentive delay task to assess reward processing, the Children's Somatization Inventory as measure of pain complaints and tested the effects of 2 single nucleotide polymorphisms (rs1799971/rs563649) of the human μ-opioid receptor gene. We found a significant prediction of pain complaints by responses in the dorsal striatum during reward feedback, independent of genetic predisposition. The relationship of pain complaints and activation in the periaqueductal gray and ventral striatum depended on the T-allele of rs563649. Carriers of this allele also showed more pain complaints than CC-allele carriers. Therefore, brain responses to reward outcomes and higher sensitivity to pain might be related already early in life and may thus set the course for pain complaints later in life, partly depending on a specific opioidergic genetic predisposition.

Social Anxiety, Acute Social Stress, and Reward Parameters Interact to Predict Risky Decision-Making among Adolescents

PubMed Central

Richards, Jessica M.; Patel, Nilam; Daniele, Teresa; MacPherson, Laura; Lejuez, C.W.; Ernst, Monique

2014-01-01

Risk-taking behavior increases during adolescence, leading to potentially disastrous consequences. Social anxiety emerges in adolescence and may compound risk-taking propensity, particularly during stress and when reward potential is high. However, the manner in which social anxiety, stress, and reward parameters interact to impact adolescent risk-taking is unclear. To clarify this question, a community sample of 35 adolescents (15 to 18 yo), characterized as having high or low social anxiety, participated in a 2-day study, during each of which they were exposed to either a social stress or a control condition, while performing a risky decision-making task. The task manipulated, orthogonally, reward magnitude and probability across trials. Three findings emerged. First, reward magnitude had a greater impact on the rate of risky decisions in high social anxiety (HSA) than low social anxiety (LSA) adolescents. Second, reaction times (RTs) were similar during the social stress and the control conditions for the HSA group, whereas the LSA group’s RTs differed between conditions. Third, HSA adolescents showed the longest RTs on the most negative trials. These findings suggest that risk-taking in adolescents is modulated by context and reward parameters differentially as a function of social anxiety. PMID:25465884

Reward Sensitivity for a Palatable Food Reward Peaks During Pubertal Developmental in Rats

PubMed Central

Friemel, Chris M.; Spanagel, Rainer; Schneider, Miriam

2010-01-01

Puberty is a critical period for the initiation of drug use and abuse. Because early drug use onset often accounts for a more severe progression of addiction, it is of importance to understand the underlying mechanisms and neurodevelopmental changes during puberty that are contributing to enhanced reward processing in teenagers. The present study investigated the progression of reward sensitivity toward a natural food reward over the whole course of adolescence in male rats (postnatal days 30–90) by monitoring consummatory, motivational behavior and neurobiological correlates of reward. Using a limited-free intake paradigm, consumption of sweetened condensed milk (SCM) was measured repeatedly in adolescent and adult rats. Additionally, early- and mid-pubertal animals were tested in Progressive Ratio responding for SCM and c-fos protein expression in reward-associated brain structures was examined after odor conditioning for SCM. We found a transient increase in SCM consumption and motivational incentive for SCM during puberty. This increased reward sensitivity was most pronounced around mid-puberty. The behavioral findings are paralleled by enhanced c-fos staining in reward-related structures revealing an intensified neuronal response after reward-cue presentation, distinctive for pubertal animals. Taken together, these data indicate an increase in reward sensitivity during adolescence accompanied by enhanced responsiveness of reward-associated brain structures to incentive stimuli, and it seems that both is strongly pronounced around mid-puberty. Therefore, higher reward sensitivity during pubertal maturation might contribute to the enhanced vulnerability of teenagers for the initiation of experimental drug use. PMID:20700386

Corneal higher-order aberrations and higher-order Strehl ratio after aberration-free ablation profile to treat compound myopic astigmatism.

PubMed

Brenner, Luis F

2015-12-01

To evaluate the changes in corneal higher-order aberrations (HOAs) and their impact on corneal higher-order Strehl ratio after aberration-free ablation profile. Verter Institute, H. Olhos, São Paulo, Brazil. Prospective interventional study. Eyes that had aberration-free myopic ablation were divided into 3 groups, based on the spherical equivalent (SE). The corneal HOAs and higher-order Strehl ratios were calculated before surgery and 3 months after surgery. The postoperative uncorrected-distance visual acuity, corrected-distance visual acuity, and SE did not present statistical differences among groups (88 eyes, P > .05). For a 6 mm pupil, the corneal HOA showed a mean increase of 0.17 μm (range 0.39 to 0.56 μm) (P < .001) and the corneal higher-order Strehl ratio presented a reduction of 0.03 (from 0.25 to 0.22) (P = .001). The following consistent linear predictive model was obtained: corneal HOA induction = 1.474 - 0.032 × SE - 0.225 × OZ, where OZ is the optical zone (R(2) = 0.49, adjusted R(2) = 0.48, P < .001). The corneal HOAs and the higher-order Strehl ratios deteriorated after moderate and high myopic ablations. The worsening in corneal aberrations and optical quality were related to the magnitude of the intended correction and did not affect high-contrast visual performance. The OZ was the only modifiable parameter capable to restrain the optical quality loss. The author has no financial or proprietary interest in any material or method mentioned. Copyright © 2015 ASCRS and ESCRS. Published by Elsevier Inc. All rights reserved.

Camera processing with chromatic aberration.

PubMed

Korneliussen, Jan Tore; Hirakawa, Keigo

2014-10-01

Since the refractive index of materials commonly used for lens depends on the wavelengths of light, practical camera optics fail to converge light to a single point on an image plane. Known as chromatic aberration, this phenomenon distorts image details by introducing magnification error, defocus blur, and color fringes. Though achromatic and apochromatic lens designs reduce chromatic aberration to a degree, they are complex and expensive and they do not offer a perfect correction. In this paper, we propose a new postcapture processing scheme designed to overcome these problems computationally. Specifically, the proposed solution is comprised of chromatic aberration-tolerant demosaicking algorithm and post-demosaicking chromatic aberration correction. Experiments with simulated and real sensor data verify that the chromatic aberration is effectively corrected.

[Psychosocial factors at work and cardiovascular diseases: contribution of the Effort-Reward Imbalance model].

PubMed

Niedhammer, I; Siegrist, J

1998-11-01

The effect of psychosocial factors at work on health, especially cardiovascular health, has given rise to growing concern in occupational epidemiology over the last few years. Two theoretical models, Karasek's model and the Effort-Reward Imbalance model, have been developed to evaluate psychosocial factors at work within specific conceptual frameworks in an attempt to take into account the serious methodological difficulties inherent in the evaluation of such factors. Karasek's model, the most widely used model, measures three factors: psychological demands, decision latitude and social support at work. Many studies have shown the predictive effects of these factors on cardiovascular diseases independently of well-known cardiovascular risk factors. More recently, the Effort-Reward Imbalance model takes into account the role of individual coping characteristics which was neglected in the Karasek model. The effort-reward imbalance model focuses on the reciprocity of exchange in occupational life where high-cost/low-gain conditions are considered particularly stressful. Three dimensions of rewards are distinguished: money, esteem and gratifications in terms of promotion prospects and job security. Some studies already support that high-effort/low reward-conditions are predictive of cardiovascular diseases.

Abnormal Frontostriatal Activity During Unexpected Reward Receipt in Depression and Schizophrenia: Relationship to Anhedonia.

PubMed

Segarra, Nuria; Metastasio, Antonio; Ziauddeen, Hisham; Spencer, Jennifer; Reinders, Niels R; Dudas, Robert B; Arrondo, Gonzalo; Robbins, Trevor W; Clark, Luke; Fletcher, Paul C; Murray, Graham K

2016-07-01

Alterations in reward processes may underlie motivational and anhedonic symptoms in depression and schizophrenia. However it remains unclear whether these alterations are disorder-specific or shared, and whether they clearly relate to symptom generation or not. We studied brain responses to unexpected rewards during a simulated slot-machine game in 24 patients with depression, 21 patients with schizophrenia, and 21 healthy controls using functional magnetic resonance imaging. We investigated relationships between brain activation, task-related motivation, and questionnaire rated anhedonia. There was reduced activation in the orbitofrontal cortex, ventral striatum, inferior temporal gyrus, and occipital cortex in both depression and schizophrenia in comparison with healthy participants during receipt of unexpected reward. In the medial prefrontal cortex both patient groups showed reduced activation, with activation significantly more abnormal in schizophrenia than depression. Anterior cingulate and medial frontal cortical activation predicted task-related motivation, which in turn predicted anhedonia severity in schizophrenia. Our findings provide evidence for overlapping hypofunction in ventral striatal and orbitofrontal regions in depression and schizophrenia during unexpected reward receipt, and for a relationship between unexpected reward processing in the medial prefrontal cortex and the generation of motivational states.

Abnormal Frontostriatal Activity During Unexpected Reward Receipt in Depression and Schizophrenia: Relationship to Anhedonia

PubMed Central

Segarra, Nuria; Metastasio, Antonio; Ziauddeen, Hisham; Spencer, Jennifer; Reinders, Niels R; Dudas, Robert B; Arrondo, Gonzalo; Robbins, Trevor W; Clark, Luke; Fletcher, Paul C; Murray, Graham K

2016-01-01

Alterations in reward processes may underlie motivational and anhedonic symptoms in depression and schizophrenia. However it remains unclear whether these alterations are disorder-specific or shared, and whether they clearly relate to symptom generation or not. We studied brain responses to unexpected rewards during a simulated slot-machine game in 24 patients with depression, 21 patients with schizophrenia, and 21 healthy controls using functional magnetic resonance imaging. We investigated relationships between brain activation, task-related motivation, and questionnaire rated anhedonia. There was reduced activation in the orbitofrontal cortex, ventral striatum, inferior temporal gyrus, and occipital cortex in both depression and schizophrenia in comparison with healthy participants during receipt of unexpected reward. In the medial prefrontal cortex both patient groups showed reduced activation, with activation significantly more abnormal in schizophrenia than depression. Anterior cingulate and medial frontal cortical activation predicted task-related motivation, which in turn predicted anhedonia severity in schizophrenia. Our findings provide evidence for overlapping hypofunction in ventral striatal and orbitofrontal regions in depression and schizophrenia during unexpected reward receipt, and for a relationship between unexpected reward processing in the medial prefrontal cortex and the generation of motivational states. PMID:26708106