The CB1 Receptor as an Important Mediator of Hedonic Reward Processing

PubMed Central

Friemel, Chris M; Zimmer, Andreas; Schneider, Miriam

2014-01-01

The endocannabinoid (ECB) system has emerged recently as a key mediator for reward processing. It is well known that cannabinoids affect appetitive learning processes and can induce reinforcing and rewarding effects. However, the involvement of the ECB system in hedonic aspects of reward-related behavior is not completely understood. With the present study, we investigated the modulatory role of the ECB system on hedonic perception, measured by the pleasure attenuated startle (PAS) paradigm for a palatable food reward. Here, a conditioned odor is thought to induce a pleasant affective state that attenuates an aversive reflex—the acoustic startle response. Modulatory effects of the CB1 receptor antagonist/inverse agonist SR1411716 and the cannabinoid agonist WIN 55 212-2 on PAS were examined in rats. PAS was also measured in CB1 receptor knockout (KO) and wild-type (WT) mice. Pharmacological inhibition as well as the absence of CB1 receptors was found to reduce PAS, whereas WIN 55 212-2 administration increased PAS. Finally, presentation of a conditioned reward cue was found to induce striatal FosB/ΔFosB expression in WT mice, but not in KO mice, indicating a reduced stimulation of reward-related brain regions in conditioned KO mice by odor presentation. We here show that in addition to our previous studies in rats, PAS may also serve as a valuable and suitable measure to assess hedonic processing in mice. Our data further indicate that the ECB system, and in particular CB1 receptor signaling, appears to be highly important for the mediation of hedonic aspects of reward processing. PMID:24718372

Cannabinoid Regulation of Brain Reward Processing with an Emphasis on the Role of CB1 Receptors: A Step Back into the Future.

PubMed

Panagis, George; Mackey, Brian; Vlachou, Styliani

2014-01-01

Over the last decades, the endocannabinoid system has been implicated in a large variety of functions, including a crucial modulation of brain-reward circuits and the regulation of motivational processes. Importantly, behavioral studies have shown that cannabinoid compounds activate brain reward mechanisms and circuits in a similar manner to other drugs of abuse, such as nicotine, alcohol, cocaine, and heroin, although the conditions under which cannabinoids exert their rewarding effects may be more limited. Furthermore, there is evidence on the involvement of the endocannabinoid system in the regulation of cue- and drug-induced relapsing phenomena in animal models. The aim of this review is to briefly present the available data obtained using diverse behavioral experimental approaches in experimental animals, namely, the intracranial self-stimulation paradigm, the self-administration procedure, the conditioned place preference procedure, and the reinstatement of drug-seeking behavior procedure, to provide a comprehensive picture of the current status of what is known about the endocannabinoid system mechanisms that underlie modification of brain-reward processes. Emphasis is placed on the effects of cannabinoid 1 (CB1) receptor agonists, antagonists, and endocannabinoid modulators. Further, the role of CB1 receptors in reward processes is investigated through presentation of respective genetic ablation studies in mice. The vast majority of studies in the existing literature suggest that the endocannabinoid system plays a major role in modulating motivation and reward processes. However, much remains to be done before we fully understand these interactions. Further research in the future will shed more light on these processes and, thus, could lead to the development of potential pharmacotherapies designed to treat reward-dysfunction-related disorders.

Incentive-Elicited Mesolimbic Activation and Externalizing Symptomatology in Adolescents

ERIC Educational Resources Information Center

Bjork, James M.; Chen, Gang; Smith, Ashley R.; Hommer, Daniel W.

2010-01-01

Background: Opponent-process theories of externalizing disorders (ExD) attribute them to some combination of overactive reward processing systems and/or underactive behavior inhibition systems. Reward processing has been indexed by recruitment of incentive-motivational neurocircuitry of the ventral striatum (VS), including nucleus accumbens…

The neuroscience of investing: fMRI of the reward system.

PubMed

Peterson, Richard L

2005-11-15

Functional magnetic resonance imaging (fMRI) has proven a useful tool for observing neural BOLD signal changes during complex cognitive and emotional tasks. Yet the meaning and applicability of the fMRI data being gathered is still largely unknown. The brain's reward system underlies the fundamental neural processes of goal evaluation, preference formation, positive motivation, and choice behavior. fMRI technology allows researchers to dynamically visualize reward system processes. Experimenters can then correlate reward system BOLD activations with experimental behavior from carefully controlled experiments. In the SPAN lab at Stanford University, directed by Brian Knutson Ph.D., researchers have been using financial tasks during fMRI scanning to correlate emotion, behavior, and cognition with the reward system's fundamental neural activations. One goal of the SPAN lab is the development of predictive models of behavior. In this paper we extrapolate our fMRI results toward understanding and predicting individual behavior in the uncertain and high-risk environment of the financial markets. The financial market price anomalies of "value versus glamour" and "momentum" may be real-world examples of reward system activation biasing collective behavior. On the individual level, the investor's bias of overconfidence may similarly be related to reward system activation. We attempt to understand selected "irrational" investor behaviors and anomalous financial market price patterns through correlations with findings from fMRI research of the reward system.

The genetic basis of individual differences in reward processing and the link to addictive behavior and social cognition.

PubMed

Yacubian, J; Büchel, C

2009-11-24

Dopaminergic neurotransmission is widely recognized to be critical to the neurobiology of reward, motivation and addiction. Interestingly, social interactions and related behavior also activate the same neuronal system. Consequently, genetic variations of dopamine neurotransmission are thought influence reward processing that in turn may affect distinctive social behavior and susceptibility to addiction. This review focuses on advances made to date in an effort to link genetic individual variations and reward processing as a possible basis for addictive behaviors.

Pervasive competition between threat and reward in the brain

PubMed Central

Choi, Jong Moon; Padmala, Srikanth; Spechler, Philip

2014-01-01

In the current functional MRI study, we investigated interactions between reward and threat processing. Visual cues at the start of each trial informed participants about the chance of winning monetary reward and/or receiving a mild aversive shock. We tested two competing hypothesis: according to the ‘salience hypothesis’, in the condition involving both reward and threat, enhanced activation would be observed because of increased salience; according to the ‘competition hypothesis’, the processing of reward and threat would trade-off against each other, leading to reduced activation. Analysis of skin conductance data during a delay phase revealed an interaction between reward and threat processing, such that the effect of reward was reduced during threat and the effect of threat was reduced during reward. Analysis of imaging data during the same task phase revealed interactions between reward and threat processing in several regions, including the midbrain/ventral tegmental area, caudate, putamen, bed nucleus of the stria terminalis, anterior insula, middle frontal gyrus and dorsal anterior cingulate cortex. Taken together, our findings reveal conditions during which reward and threat trade-off against each other across multiple sites. Such interactions are suggestive of competitive processes and may reflect the organization of opponent systems in the brain. PMID:23547242

The anticipation and outcome phases of reward and loss processing: A neuroimaging meta-analysis of the monetary incentive delay task.

PubMed

Oldham, Stuart; Murawski, Carsten; Fornito, Alex; Youssef, George; Yücel, Murat; Lorenzetti, Valentina

2018-04-25

The processing of rewards and losses are crucial to everyday functioning. Considerable interest has been attached to investigating the anticipation and outcome phases of reward and loss processing, but results to date have been inconsistent. It is unclear if anticipation and outcome of a reward or loss recruit similar or distinct brain regions. In particular, while the striatum has widely been found to be active when anticipating a reward, whether it activates in response to the anticipation of losses as well remains ambiguous. Furthermore, concerning the orbitofrontal/ventromedial prefrontal regions, activation is often observed during reward receipt. However, it is unclear if this area is active during reward anticipation as well. We ran an Activation Likelihood Estimation meta-analysis of 50 fMRI studies, which used the Monetary Incentive Delay Task (MIDT), to identify which brain regions are implicated in the anticipation of rewards, anticipation of losses, and the receipt of reward. Anticipating rewards and losses recruits overlapping areas including the striatum, insula, amygdala and thalamus, suggesting that a generalised neural system initiates motivational processes independent of valence. The orbitofrontal/ventromedial prefrontal regions were recruited only during the reward outcome, likely representing the value of the reward received. Our findings help to clarify the neural substrates of the different phases of reward and loss processing, and advance neurobiological models of these processes. © 2018 The Authors Human Brain Mapping Published by Wiley Periodicals, Inc.

Immaturities in Reward Processing and Its Influence on Inhibitory Control in Adolescence

PubMed Central

Terwilliger, R.; Teslovich, T.; Velanova, K.; Luna, B.

2010-01-01

The nature of immature reward processing and the influence of rewards on basic elements of cognitive control during adolescence are currently not well understood. Here, during functional magnetic resonance imaging, healthy adolescents and adults performed a modified antisaccade task in which trial-by-trial reward contingencies were manipulated. The use of a novel fast, event-related design enabled developmental differences in brain function underlying temporally distinct stages of reward processing and response inhibition to be assessed. Reward trials compared with neutral trials resulted in faster correct inhibitory responses across ages and in fewer inhibitory errors in adolescents. During reward trials, the blood oxygen level–dependent signal was attenuated in the ventral striatum in adolescents during cue assessment, then overactive during response preparation, suggesting limitations during adolescence in reward assessment and heightened reactivity in anticipation of reward compared with adults. Importantly, heightened activity in the frontal cortex along the precentral sulcus was also observed in adolescents during reward-trial response preparation, suggesting reward modulation of oculomotor control regions supporting correct inhibitory responding. Collectively, this work characterizes specific immaturities in adolescent brain systems that support reward processing and describes the influence of reward on inhibitory control. In sum, our findings suggest mechanisms that may underlie adolescents’ vulnerability to poor decision-making and risk-taking behavior. PMID:19875675

An Analysis of the Civilian Employee Reward System in use at Naval Air Warfare Center, Patuxent River, Maryland

DTIC Science & Technology

1999-12-01

relative deprivation. If A and B have different rewards, distributive justice may still exist as long as person A feels that their level of investment to...example could be rewarding an assembly line for number of units produced (outcome) versus the degree of quality control (process). Even if quotas are...between reward preferences of one job type versus another. Perhaps most relevant to this thesis are the studies which have examined reward system

A performability solution method for degradable nonrepairable systems

NASA Technical Reports Server (NTRS)

Furchtgott, D. G.; Meyer, J. F.

1984-01-01

The present performability model-solving algorithm identifies performance with 'reward', representing the state behavior of a system S by a finite-state stochastic process and determining reward by means of reward rates that are associated with the states of the base model. A general method is obtained for determining the probability distribution function of the performance (reward) variable, and therefore the performability, of the corresponding system. This is done for bounded utilization periods, and the result is an integral expression which is either analytically or numerically solvable.

The effect of pre- vs. post-reward attainment on EEG asymmetry in melancholic depression.

PubMed

Shankman, Stewart A; Sarapas, Casey; Klein, Daniel N

2011-02-01

Clinical investigators have long theorized about the role of reward processing and positive affect in depression. One theory posits that compared to nonmelancholic depressives, melancholic depressives experience less consummatory (i.e., post-reward), but comparably low anticipatory (prior to reward), positive affect. We tested whether frontal EEG asymmetry, a putative marker of the anticipatory reward system, is present only before an individual receives a reward or also after receiving a reward (i.e., during consummatory reward processing). We also examined whether melancholic depression, a condition characterized by a deficit in consummatory reward processing, is associated with abnormal EEG asymmetries in alpha band power. Effects in other frequency bands (delta, theta, or beta) were also explored. EEG was recorded in 34 controls, 48 nonmelancholic depressives, and 17 melancholic depressives during a slot machine task designed to elicit anticipatory and consummatory reward processing. Results indicated that, for alpha, the frontal EEG asymmetry of greater relative left activity was specific to anticipatory reward processing. During the consummatory phase, individuals with melancholic depression exhibited different posterior EEG asymmetries than individuals with nonmelancholic depression (and controls at a trend level). This second finding was largely due to melancholics exhibiting relatively lower right posterior activity and nonmelancholics exhibiting relatively lower left activity. These results suggest that a posterior asymmetry may be a marker for melancholic depression and aberrant consummatory reward processing. Copyright © 2010 Elsevier B.V. All rights reserved.

Reward-Related Decision-Making in Pediatric Major Depressive Disorder: An fMRI Study

ERIC Educational Resources Information Center

Forbes, Erika E.; Christopher May, J.; Siegle, Greg J.; Ladouceur, Cecile D.; Ryan, Neal D.; Carter, Cameron S.; Birmaher, Boris; Axelson, David A.; Dahl, Ronald E.

2006-01-01

Background: Although reward processing is considered an important part of affective functioning, few studies have investigated reward-related decisions or responses in young people with affective disorders. Depression is postulated to involve decreased activity in reward-related affective systems. Methods: Using functional magnetic resonance…

Pervasive competition between threat and reward in the brain.

PubMed

Choi, Jong Moon; Padmala, Srikanth; Spechler, Philip; Pessoa, Luiz

2014-06-01

In the current functional MRI study, we investigated interactions between reward and threat processing. Visual cues at the start of each trial informed participants about the chance of winning monetary reward and/or receiving a mild aversive shock. We tested two competing hypothesis: according to the 'salience hypothesis', in the condition involving both reward and threat, enhanced activation would be observed because of increased salience; according to the 'competition hypothesis', the processing of reward and threat would trade-off against each other, leading to reduced activation. Analysis of skin conductance data during a delay phase revealed an interaction between reward and threat processing, such that the effect of reward was reduced during threat and the effect of threat was reduced during reward. Analysis of imaging data during the same task phase revealed interactions between reward and threat processing in several regions, including the midbrain/ventral tegmental area, caudate, putamen, bed nucleus of the stria terminalis, anterior insula, middle frontal gyrus and dorsal anterior cingulate cortex. Taken together, our findings reveal conditions during which reward and threat trade-off against each other across multiple sites. Such interactions are suggestive of competitive processes and may reflect the organization of opponent systems in the brain. © The Author (2013). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Modeling effects of intrinsic and extrinsic rewards on the competition between striatal learning systems.

PubMed

Boedecker, Joschka; Lampe, Thomas; Riedmiller, Martin

2013-01-01

A common assumption in psychology, economics, and other fields holds that higher performance will result if extrinsic rewards (such as money) are offered as an incentive. While this principle seems to work well for tasks that require the execution of the same sequence of steps over and over, with little uncertainty about the process, in other cases, especially where creative problem solving is required due to the difficulty in finding the optimal sequence of actions, external rewards can actually be detrimental to task performance. Furthermore, they have the potential to undermine intrinsic motivation to do an otherwise interesting activity. In this work, we extend a computational model of the dorsomedial and dorsolateral striatal reinforcement learning systems to account for the effects of extrinsic and intrinsic rewards. The model assumes that the brain employs both a goal-directed and a habitual learning system, and competition between both is based on the trade-off between the cost of the reasoning process and value of information. The goal-directed system elicits internal rewards when its models of the environment improve, while the habitual system, being model-free, does not. Our results account for the phenomena that initial extrinsic reward leads to reduced activity after extinction compared to the case without any initial extrinsic rewards, and that performance in complex task settings drops when higher external rewards are promised. We also test the hypothesis that external rewards bias the competition in favor of the computationally efficient, but cruder and less flexible habitual system, which can negatively influence intrinsic motivation and task performance in the class of tasks we consider.

The effects of intranasal oxytocin on reward circuitry responses in children with autism spectrum disorder.

PubMed

Greene, R K; Spanos, M; Alderman, C; Walsh, E; Bizzell, J; Mosner, M G; Kinard, J L; Stuber, G D; Chandrasekhar, T; Politte, L C; Sikich, L; Dichter, G S

2018-03-27

Intranasal oxytocin (OT) has been shown to improve social communication functioning of individuals with autism spectrum disorder (ASD) and, thus, has received considerable interest as a potential ASD therapeutic agent. Although preclinical research indicates that OT modulates the functional output of the mesocorticolimbic dopamine system that processes rewards, no clinical brain imaging study to date has examined the effects of OT on this system using a reward processing paradigm. To address this, we used an incentive delay task to examine the effects of a single dose of intranasal OT, versus placebo (PLC), on neural responses to social and nonsocial rewards in children with ASD. In this placebo-controlled double-blind study, 28 children and adolescents with ASD (age: M = 13.43 years, SD = 2.36) completed two fMRI scans, one after intranasal OT administration and one after PLC administration. During both scanning sessions, participants completed social and nonsocial incentive delay tasks. Task-based neural activation and connectivity were examined to assess the impact of OT relative to PLC on mesocorticolimbic brain responses to social and nonsocial reward anticipation and outcomes. Central analyses compared the OT and PLC conditions. During nonsocial reward anticipation, there was greater activation in the right nucleus accumbens (NAcc), left anterior cingulate cortex (ACC), bilateral orbital frontal cortex (OFC), left superior frontal cortex, and right frontal pole (FP) during the OT condition relative to PLC. Alternatively, during social reward anticipation and outcomes, there were no significant increases in brain activation during the OT condition relative to PLC. A Treatment Group × Reward Condition interaction revealed relatively greater activation in the right NAcc, right caudate nucleus, left ACC, and right OFC during nonsocial relative to social reward anticipation during the OT condition relative to PLC. Additionally, these analyses revealed greater activation during nonsocial reward outcomes during the OT condition relative to PLC in the right OFC and left FP. Finally, functional connectivity analyses generally revealed changes in frontostriatal connections during the OT condition relative to PLC in response to nonsocial, but not social, rewards. The effects of intranasal OT administration on mesocorticolimbic brain systems that process rewards in ASD were observable primarily during the processing of nonsocial incentive salience stimuli. These findings have implications for understanding the effects of OT on neural systems that process rewards, as well as for experimental trials of novel ASD treatments developed to ameliorate social communication impairments in ASD.

Interaction between COMT Val(158)Met polymorphism and childhood adversity affects reward processing in adulthood.

PubMed

Boecker-Schlier, Regina; Holz, Nathalie E; Buchmann, Arlette F; Blomeyer, Dorothea; Plichta, Michael M; Jennen-Steinmetz, Christine; Wolf, Isabella; Baumeister, Sarah; Treutlein, Jens; Rietschel, Marcella; Meyer-Lindenberg, Andreas; Banaschewski, Tobias; Brandeis, Daniel; Laucht, Manfred

2016-05-15

Accumulating evidence suggests that altered dopamine transmission may increase the risk of mental disorders such as ADHD, schizophrenia or depression, possibly mediated by reward system dysfunction. This study aimed to clarify the impact of the COMT Val(158)Met polymorphism in interaction with environmental variation (G×E) on neuronal activity during reward processing. 168 healthy young adults from a prospective study conducted over 25years participated in a monetary incentive delay task measured with simultaneous EEG-fMRI. DNA was genotyped for COMT, and childhood family adversity (CFA) up to age 11 was assessed by a standardized parent interview. At reward delivery, a G×E revealed that fMRI activation for win vs. no-win trials in reward-related regions increased with the level of CFA in Met homozygotes as compared to Val/Met heterozygotes and Val homozygotes, who showed no significant effect. During the anticipation of monetary vs. verbal rewards, activation decreased with the level of CFA, which was also observed for EEG, in which the CNV declined with the level of CFA. These results identify convergent genetic and environmental effects on reward processing in a prospective study. Moreover, G×E effects during reward delivery suggest that stress during childhood is associated with higher reward sensitivity and reduced efficiency in processing rewarding stimuli in genetically at-risk individuals. Together with previous evidence, these results begin to define a specific system mediating interacting effects of early environmental and genetic risk factors, which may be targeted by early intervention and prevention. Copyright © 2016 Elsevier Inc. All rights reserved.

Distinct Reward Properties are Encoded via Corticostriatal Interactions

PubMed Central

Smith, David V.; Rigney, Anastasia E.; Delgado, Mauricio R.

2016-01-01

The striatum serves as a critical brain region for reward processing. Yet, understanding the link between striatum and reward presents a challenge because rewards are composed of multiple properties. Notably, affective properties modulate emotion while informative properties help obtain future rewards. We approached this problem by emphasizing affective and informative reward properties within two independent guessing games. We found that both reward properties evoked activation within the nucleus accumbens, a subregion of the striatum. Striatal responses to informative, but not affective, reward properties predicted subsequent utilization of information for obtaining monetary reward. We hypothesized that activation of the striatum may be necessary but not sufficient to encode distinct reward properties. To investigate this possibility, we examined whether affective and informative reward properties were differentially encoded in corticostriatal interactions. Strikingly, we found that the striatum exhibited dissociable connectivity patterns with the ventrolateral prefrontal cortex, with increasing connectivity for affective reward properties and decreasing connectivity for informative reward properties. Our results demonstrate that affective and informative reward properties are encoded via corticostriatal interactions. These findings highlight how corticostriatal systems contribute to reward processing, potentially advancing models linking striatal activation to behavior. PMID:26831208

Distinct Reward Properties are Encoded via Corticostriatal Interactions.

PubMed

Smith, David V; Rigney, Anastasia E; Delgado, Mauricio R

2016-02-02

The striatum serves as a critical brain region for reward processing. Yet, understanding the link between striatum and reward presents a challenge because rewards are composed of multiple properties. Notably, affective properties modulate emotion while informative properties help obtain future rewards. We approached this problem by emphasizing affective and informative reward properties within two independent guessing games. We found that both reward properties evoked activation within the nucleus accumbens, a subregion of the striatum. Striatal responses to informative, but not affective, reward properties predicted subsequent utilization of information for obtaining monetary reward. We hypothesized that activation of the striatum may be necessary but not sufficient to encode distinct reward properties. To investigate this possibility, we examined whether affective and informative reward properties were differentially encoded in corticostriatal interactions. Strikingly, we found that the striatum exhibited dissociable connectivity patterns with the ventrolateral prefrontal cortex, with increasing connectivity for affective reward properties and decreasing connectivity for informative reward properties. Our results demonstrate that affective and informative reward properties are encoded via corticostriatal interactions. These findings highlight how corticostriatal systems contribute to reward processing, potentially advancing models linking striatal activation to behavior.

Goal or gold: overlapping reward processes in soccer players upon scoring and winning money.

PubMed

Häusler, Alexander Niklas; Becker, Benjamin; Bartling, Marcel; Weber, Bernd

2015-01-01

Social rewards are important incentives for human behavior. This is especially true in team sports such as the most popular one worldwide: soccer. We investigated reward processing upon scoring a soccer goal in a standard two-versus-one situation and in comparison to winning in a monetary incentive task. The results show a strong overlap in brain activity between the two conditions in established reward regions of the mesolimbic dopaminergic system, including the ventral striatum and ventromedial pre-frontal cortex. The three main components of reward-associated learning, i.e., reward probability (RP), reward reception (RR) and reward prediction errors (RPE) showed highly similar activation in both con-texts, with only the RR and RPE components displaying overlapping reward activity. Passing and shooting behavior did not correlate with individual egoism scores, but we observe a positive correlation be-tween egoism and activity in the left middle frontal gyrus upon scoring after a pass versus a direct shot. Our findings suggest that rewards in the context of soccer and monetary incentives are based on similar neural processes.

Goal or Gold: Overlapping Reward Processes in Soccer Players upon Scoring and Winning Money

PubMed Central

Häusler, Alexander Niklas; Becker, Benjamin; Bartling, Marcel; Weber, Bernd

2015-01-01

Social rewards are important incentives for human behavior. This is especially true in team sports such as the most popular one worldwide: soccer. We investigated reward processing upon scoring a soccer goal in a standard two-versus-one situation and in comparison to winning in a monetary incentive task. The results show a strong overlap in brain activity between the two conditions in established reward regions of the mesolimbic dopaminergic system, including the ventral striatum and ventromedial pre-frontal cortex. The three main components of reward-associated learning i.e. reward probability (RP), reward reception (RR) and reward prediction errors (RPE) showed highly similar activation in both con-texts, with only the RR and RPE components displaying overlapping reward activity. Passing and shooting behavior did not correlate with individual egoism scores, but we observe a positive correlation be-tween egoism and activity in the left middle frontal gyrus upon scoring after a pass versus a direct shot. Our findings suggest that rewards in the context of soccer and monetary incentives are based on similar neural processes. PMID:25875594

A Positive Affective Neuroendocrinology Approach to Reward and Behavioral Dysregulation

PubMed Central

Welker, Keith M.; Gruber, June; Mehta, Pranjal H.

2015-01-01

Emerging lines of research suggest that both testosterone and maladaptive reward processing can modulate behavioral dysregulation. Yet, to date, no integrative account has been provided that systematically explains neuroendocrine function, dysregulation of reward, and behavioral dysregulation in a unified perspective. This is particularly important given specific neuroendocrine systems are potential mechanisms underlying and giving rise to reward-relevant behaviors. In this review, we propose a forward-thinking approach to study the mechanisms of reward and behavioral dysregulation from a positive affective neuroendocrinology (PANE) perspective. This approach holds that testosterone increases reward processing and motivation, which increase the likelihood of behavioral dysregulation. Additionally, the PANE framework holds that reward processing mediates the effects of testosterone on behavioral dysregulation. We also explore sources of potential sex differences and the roles of age, cortisol, and individual differences within the PANE framework. Finally, we discuss future prospects for research questions and methodology in the emerging field of affective neuroendocrinology. PMID:26191007

A longitudinal high-risk study of adolescent anxiety, depression and parent-severity on the developmental course of risk-adjustment.

PubMed

Rawal, Adhip; Riglin, Lucy; Ng-Knight, Terry; Collishaw, Stephan; Thapar, Anita; Rice, Frances

2014-11-01

Adolescence is associated with developments in the reward system and increased rates of emotional disorders. Familial risk for depression may be associated with disruptions in the reward system. However, it is unclear how symptoms of depression and anxiety influence the development of reward-processing over adolescence and whether variation in the severity of parental depression is associated with hyposensitivity to reward in a high-risk sample. We focused on risk-adjustment (adjusting decisions about reward according to the probability of obtaining reward) as this was hypothesized to improve over adolescence. In a one-year longitudinal sample (N = 197) of adolescent offspring of depressed parents, we examined how symptoms of depression and anxiety (generalized anxiety and social anxiety) influenced the development of risk-adjustment. We also examined how parental depression severity influenced adolescent risk-adjustment. Risk-adjustment improved over the course of the study indicating improved adjustment of reward-seeking to shifting contingencies. Depressive symptoms were associated with decreases in risk-adjustment over time while social anxiety symptoms were associated with increases in risk-adjustment over time. Specifically, depression was associated with reductions in reward-seeking at favourable reward probabilities only, whereas social anxiety (but not generalized anxiety) led to reductions in reward-seeking at low reward probabilities only. Parent depression severity was associated with lowered risk-adjustment in offspring and also influenced the longitudinal relationship between risk-adjustment and offspring depression. Anxiety and depression distinctly alter the pattern of longitudinal change in reward-processing. Severity of parent depression was associated with alterations in adolescent offspring reward-processing in a high-risk sample. © 2014 The Authors. Journal of Child Psychology and Psychiatry published by John Wiley & Sons Ltd on behalf of Association for Child and Adolescent Mental Health.

Independent functional connectivity networks underpin food and monetary reward sensitivity in excess weight.

PubMed

Verdejo-Román, Juan; Fornito, Alex; Soriano-Mas, Carles; Vilar-López, Raquel; Verdejo-García, Antonio

2017-02-01

Overvaluation of palatable food is a primary driver of obesity, and is associated with brain regions of the reward system. However, it remains unclear if this network is specialized in food reward, or generally involved in reward processing. We used functional magnetic resonance imaging (fMRI) to characterize functional connectivity during processing of food and monetary rewards. Thirty-nine adults with excess weight and 37 adults with normal weight performed the Willingness to Pay for Food task and the Monetary Incentive Delay task in the fMRI scanner. A data-driven graph approach was applied to compare whole-brain, task-related functional connectivity between groups. Excess weight was associated with decreased functional connectivity during the processing of food rewards in a network involving primarily frontal and striatal areas, and increased functional connectivity during the processing of monetary rewards in a network involving principally frontal and parietal areas. These two networks were topologically and anatomically distinct, and were independently associated with BMI. The processing of food and monetary rewards involve segregated neural networks, and both are altered in individuals with excess weight. Copyright © 2016 Elsevier Inc. All rights reserved.

Reward-seeking behavior and addiction: cause or cog?

PubMed

Arias-Carrión, Oscar; Salama, Mohamed

2012-09-01

Although dopaminergic system represents the cornerstone in rewarding, other neurotransmitters can modulate both the reward system and the psychomotor effects of addictive drugs. Many hypotheses have been proposed for a better understanding of the reward system and its role in drug addiction. However, after many years of investigation, no single theory can completely explain the neural basis of drug addiction. Recent reports introduce novel neurotransmitters into the game e.g. dynorphins, orexins, histamine, gheralin and galanin. The interacting functions of these neurotransmitters have shown that the reward system and its role in drug dependence, is far more complicated than was thought before. Individual variations exist regarding response to drug exposure, vulnerability for addiction and the effects of different cues on reward systems. Consequently, genetic variations of neurotransmission are thought to influence reward processing that in turn may affect distinctive social behavior and susceptibility to addiction. However, the individual variations can not be based mainly on genetics; environmental factors seem to play a role too. Here we discuss the current knowledge about the orquestic regulation of different neurotransmitters on reward-seeking behavior and their potential effect on drug addiction.

Reward processing and mood-related symptoms: An RDoC and translational neuroscience perspective.

PubMed

Nusslock, Robin; Alloy, Lauren B

2017-07-01

Two objectives of the NIMH Research Domain Criteria (RDoC) initiative are to identify (a) mechanisms that are common to multiple psychiatric disorders, and (b) mechanisms that are unique to specific psychiatric symptoms, and that reflect markers of differential risk for these symptoms. With respect to these objectives, a brain-behavior dimension that has received considerable attention and that is directly relevant to the Positive Valence Systems domain of the RDoC initiative involves reward processing. The present review paper first examines the relationship between reward processing and mood-related symptoms from an RDoC perspective. We then place this work in a larger context by examining the relationship between reward processing abnormalities and psychiatric symptoms defined broadly, including mood-related symptoms, schizophrenia, and addiction. Our review suggests that reward hyposensitivity relates to a subtype of anhedonia characterized by motivational deficits in unipolar depression, and reward hypersensitivity relates to a cluster of hypo/manic symptoms characterized by excessive approach motivation in the context of bipolar disorder. Integrating this perspective with research on reward processing abnormalities in schizophrenia and addiction, we further argue that the principles of equifinality and multifinality may be preferable to a transdiagnostic perspective for conceptualizing the relationship between reward processing and psychiatric symptoms defined broadly. We propose that vulnerability to either motivational anhedonia or approach-related hypo/manic symptoms involve extreme and opposite profiles of reward processing. We further propose that an equifinality and multifinality perspective may serve as a useful framework for future research on reward processing abnormalities and psychiatric symptoms. Copyright © 2017. Published by Elsevier B.V.

Modeling effects of intrinsic and extrinsic rewards on the competition between striatal learning systems

PubMed Central

Boedecker, Joschka; Lampe, Thomas; Riedmiller, Martin

2013-01-01

A common assumption in psychology, economics, and other fields holds that higher performance will result if extrinsic rewards (such as money) are offered as an incentive. While this principle seems to work well for tasks that require the execution of the same sequence of steps over and over, with little uncertainty about the process, in other cases, especially where creative problem solving is required due to the difficulty in finding the optimal sequence of actions, external rewards can actually be detrimental to task performance. Furthermore, they have the potential to undermine intrinsic motivation to do an otherwise interesting activity. In this work, we extend a computational model of the dorsomedial and dorsolateral striatal reinforcement learning systems to account for the effects of extrinsic and intrinsic rewards. The model assumes that the brain employs both a goal-directed and a habitual learning system, and competition between both is based on the trade-off between the cost of the reasoning process and value of information. The goal-directed system elicits internal rewards when its models of the environment improve, while the habitual system, being model-free, does not. Our results account for the phenomena that initial extrinsic reward leads to reduced activity after extinction compared to the case without any initial extrinsic rewards, and that performance in complex task settings drops when higher external rewards are promised. We also test the hypothesis that external rewards bias the competition in favor of the computationally efficient, but cruder and less flexible habitual system, which can negatively influence intrinsic motivation and task performance in the class of tasks we consider. PMID:24137146

Elevated cognitive control over reward processing in recovered female patients with anorexia nervosa.

PubMed

Ehrlich, Stefan; Geisler, Daniel; Ritschel, Franziska; King, Joseph A; Seidel, Maria; Boehm, Ilka; Breier, Marion; Clas, Sabine; Weiss, Jessika; Marxen, Michael; Smolka, Michael N; Roessner, Veit; Kroemer, Nils B

2015-09-01

Individuals with anorexia nervosa are thought to exert excessive self-control to inhibit primary drives. This study used functional MRI (fMRI) to interrogate interactions between the neural correlates of cognitive control and motivational processes in the brain reward system during the anticipation of monetary reward and reward-related feedback. In order to avoid confounding effects of undernutrition, we studied female participants recovered from anorexia nervosa and closely matched healthy female controls. The fMRI analysis (including node-to-node functional connectivity) followed a region of interest approach based on models of the brain reward system and cognitive control regions implicated in anorexia nervosa: the ventral striatum, medial orbitofrontal cortex (mOFC) and dorsolateral prefrontal cortex (DLPFC). We included 30 recovered patients and 30 controls in our study. There were no behavioural differences and no differences in hemodynamic responses of the ventral striatum and the mOFC in the 2 phases of the task. However, relative to controls, recovered patients showed elevated DLPFC activity during the anticipation phase, failed to deactivate this region during the feedback phase and displayed greater functional coupling between the DLPFC and mOFC. Recovered patients also had stronger associations than controls between anticipation-related DLPFC responses and instrumental responding. The results we obtained using monetary stimuli might not generalize to other forms of reward. Unaltered neural responses in ventral limbic reward networks but increased recruitment of and connectivity with lateral-frontal brain circuitry in recovered patients suggests an elevated degree of selfregulatory processes in response to rewarding stimuli. An imbalance between brain systems subserving bottom-up and top-down processes may be a trait marker of the disorder.

Further support for association between GWAS variant for positive emotion and reward systems.

PubMed

Lancaster, T M; Ihssen, N; Brindley, L M; Linden, D E J

2017-01-31

A recent genome-wide association study (GWAS) identified a significant single-nucleotide polymorphism (SNP) for trait-positive emotion at rs322931 on chromosome 1, which was also associated with brain activation in the reward system of healthy individuals when observing positive stimuli in a functional magnetic resonance imaging (fMRI) study. In the current study, we aimed to further validate the role of variation at rs322931 in reward processing. Using a similar fMRI approach, we use two paradigms that elicit a strong ventral striatum (VS) blood oxygen-level dependency (BOLD) response in a sample of young, healthy individuals (N=82). In the first study we use a similar picture-viewing task to the discovery sample (positive>neutral stimuli) to replicate an effect of the variant on emotion processing. In the second study we use a probabilistic reversal learning procedure to identify reward processing during decision-making under uncertainly (reward>punishment). In a region of interest (ROI) analysis of the bilateral VS, we show that the rs322931 genotype was associated with BOLD in the left VS during the positive>neutral contrast (P ROI-CORRECTED =0.045) and during the reward>punishment contrast (P ROI-CORRECTED =0.018), although the effect of passive picture viewing was in the opposite direction from that reported in the discovery sample. These findings suggest that the recently identified GWAS hit may influence positive emotion via individual differences in activity in the key hubs of the brain's reward system. Furthermore, these effects may not be limited to the passive viewing of positive emotional scenes, but may also be observed during dynamic decision-making. This study suggests that future studies of this GWAS locus may yield further insight into the biological mechanisms of psychopathologies characterised by deficits in reward processing and positive emotion.

When performance and risk taking are related: Working for rewards is related to risk taking when the value of rewards is presented briefly.

PubMed

Veling, Harm; Bijleveld, Erik

2015-12-01

Valuable monetary rewards can boost human performance on various effortful tasks even when the value of the rewards is presented too briefly to allow for strategic decision making. However, the mechanism by which briefly-presented reward information influences performance has remained unclear. One possibility is that performance after briefly-presented reward information is primarily boosted via activation of the dopamine reward system, whereas performance after very visible reward information is driven more by strategic processes. To examine this hypothesis, we first presented participants with a task in which they could earn rewards of relatively low (1 cent) or high (10 cents) value, and the value information was presented either briefly (17 ms) or for an extended duration (300 ms). Furthermore, responsiveness of the dopamine system was indirectly estimated with a measure of risk taking, the Balloon Analogue Risk Task (BART). Results showed that performance after high- compared to low-value rewards was indeed related to the BART scores only when reward information was presented briefly. These results are suggestive of the possibility that brief presentation of reward information boosts performance directly via activating the dopamine system, whereas extended presentation of reward information leads to more strategic reward-driven behavior. Copyright © 2015 Elsevier Inc. All rights reserved.

Longitudinal Changes in Behavioral Approach System Sensitivity and Brain Structures Involved in Reward Processing during Adolescence

ERIC Educational Resources Information Center

Urosevic, Snezana; Collins, Paul; Muetzel, Ryan; Lim, Kelvin; Luciana, Monica

2012-01-01

Adolescence is a period of radical normative changes and increased risk for substance use, mood disorders, and physical injury. Researchers have proposed that increases in reward sensitivity (i.e., sensitivity of the behavioral approach system [BAS]) and/or increases in reactivity to all emotional stimuli (i.e., reward and threat sensitivities)…

Addiction is a Reward Deficit and Stress Surfeit Disorder

PubMed Central

Koob, George F.

2013-01-01

Drug addiction can be defined by a three-stage cycle – binge/intoxication, withdrawal/negative affect, and preoccupation/anticipation – that involves allostatic changes in the brain reward and stress systems. Two primary sources of reinforcement, positive and negative reinforcement, have been hypothesized to play a role in this allostatic process. The negative emotional state that drives negative reinforcement is hypothesized to derive from dysregulation of key neurochemical elements involved in the brain reward and stress systems. Specific neurochemical elements in these structures include not only decreases in reward system function (within-system opponent processes) but also recruitment of the brain stress systems mediated by corticotropin-releasing factor (CRF) and dynorphin-κ opioid systems in the ventral striatum, extended amygdala, and frontal cortex (both between-system opponent processes). CRF antagonists block anxiety-like responses associated with withdrawal, block increases in reward thresholds produced by withdrawal from drugs of abuse, and block compulsive-like drug taking during extended access. Excessive drug taking also engages the activation of CRF in the medial prefrontal cortex, paralleled by deficits in executive function that may facilitate the transition to compulsive-like responding. Neuropeptide Y, a powerful anti-stress neurotransmitter, has a profile of action on compulsive-like responding for ethanol similar to a CRF1 antagonist. Blockade of the κ opioid system can also block dysphoric-like effects associated with withdrawal from drugs of abuse and block the development of compulsive-like responding during extended access to drugs of abuse, suggesting another powerful brain stress system that contributes to compulsive drug seeking. The loss of reward function and recruitment of brain systems provide a powerful neurochemical basis that drives the compulsivity of addiction. PMID:23914176

The neurobiology of reward and cognitive control systems and their role in incentivizing health behavior.

PubMed

Garavan, Hugh; Weierstall, Karen

2012-11-01

This article reviews the neurobiology of cognitive control and reward processes and addresses their role in the treatment of addiction. We propose that the neurobiological mechanisms involved in treatment may differ from those involved in the etiology of addiction and consequently are worthy of increased investigation. We review the literature on reward and control processes and evidence of differences in these systems in drug addicted individuals. We also review the relatively small literature on neurobiological predictors of abstinence. We conclude that prefrontal control systems may be central to a successful recovery from addiction. The frontal lobes have been shown to regulate striatal reward-related processes, to be among the regions that predict treatment outcome, and to show elevated functioning in those who have succeeded in maintaining abstinence. The evidence of the involvement of the frontal lobes in recovery is consistent with the hypothesis that recovery is a distinct process that is more than the undoing of those processes involved in becoming addicted and a return to the pre-addiction state of the individual. The extent to which these frontal systems are engaged by treatment interventions may contribute to their efficacy. Copyright © 2012 Elsevier Inc. All rights reserved.

The effects of expected reward on creative problem solving.

PubMed

Cristofori, Irene; Salvi, Carola; Beeman, Mark; Grafman, Jordan

2018-06-12

Creative problem solving involves search processes, and it is known to be hard to motivate. Reward cues have been found to enhance performance across a range of tasks, even when cues are presented subliminally, without being consciously detected. It is uncertain whether motivational processes, such as reward, can influence problem solving. We tested the effect of supraliminal and subliminal reward on participant performance on problem solving that can be solved by deliberate analysis or by insight. Forty-one participants attempted to solve 100 compound remote associate problems. At the beginning of each problem, a potential reward cue (1 or 25 cents) was displayed, either subliminally (17 ms) or supraliminally (100 ms). Participants earned the displayed reward if they solved the problem correctly. Results showed that the higher subliminal reward increased the percentage of problems solved correctly overall. Second, we explored if subliminal rewards preferentially influenced solutions that were achieved via a sudden insight (mostly processed below awareness) or via a deliberate analysis. Participants solved more problems via insight following high subliminal reward when compared with low subliminal reward, and compared with high supraliminal reward, with no corresponding effect on analytic solving. Striatal dopamine (DA) is thought to influence motivation, reinforce behavior, and facilitate cognition. We speculate that subliminal rewards activate the striatal DA system, enhancing the kinds of automatic integrative processes that lead to more creative strategies for problem solving, without increasing the selectivity of attention, which could impede insight.

Influence of ventral tegmental area input on cortico-subcortical networks underlying action control and decision making.

PubMed

Richter, Anja; Gruber, Oliver

2018-02-01

It is argued that the mesolimbic system has a more general function in processing all salient events, including and extending beyond rewards. Saliency was defined as an event that is unexpected due to its frequency of occurrence and elicits an attentional-behavioral switch. Using functional magnetic resonance imaging (fMRI), signals were measured in response to the modulation of salience of rewarding and nonrewarding events during a reward-based decision making task, the so called desire-reason dilemma paradigm (DRD). Replicating previous findings, both frequent and infrequent, and therefore salient, reward stimuli elicited reliable activation of the ventral tegmental area (VTA) and ventral striatum (vStr). When immediate reward desiring contradicted the superordinate task-goal, we found an increased activation of the VTA and vStr when the salient reward stimuli were presented compared to the nonsalient reward stimuli, indicating a boosting of activation in these brain regions. Furthermore, we found a significantly increased functional connectivity between the VTA and vStr, confirming the boosting of vStr activation via VTA input. Moreover, saliency per se without a reward association led to an increased activation of brain regions in the mesolimbic reward system as well as the orbitofrontal cortex (OFC), inferior frontal gyrus (IFG), and anterior cingulate cortex (ACC). Finally, findings uncovered multiple increased functional interactions between cortical saliency-processing brain areas and the VTA and vStr underlying detection and processing of salient events and adaptive decision making. © 2017 Wiley Periodicals, Inc.

Mechanisms of Habitual Approach

PubMed Central

Anderson, Brian A.; Folk, Charles L.; Garrison, Rebecca; Rogers, Leeland

2016-01-01

Reward learning has a powerful influence on the attention system, causing previously reward-associated stimuli to automatically capture attention. Difficulty ignoring stimuli associated with drug reward has been linked to addiction relapse, and the attention system of drug-dependent patients seems especially influenced by reward history. This and other evidence suggests that value-driven attention has consequences for behavior and decision-making, facilitating a bias to approach and consume the previously reward-associated stimulus even when doing so runs counter to current goals and priorities. Yet, a mechanism linking value-driven attention to behavioral responding and a general approach bias is lacking. Here we show that previously reward-associated stimuli escape inhibitory processing in a go/no-go task. Control experiments confirmed that this value-dependent failure of goal-directed inhibition could not be explained by search history or residual motivation, but depended specifically on the learned association between particular stimuli and reward outcome. When a previously high-value stimulus is encountered, the response codes generated by that stimulus are automatically afforded high priority, bypassing goal-directed cognitive processes involved in suppressing task-irrelevant behavior. PMID:27054684

Motivation and timing: Clues for modeling the reward system

PubMed Central

Galtress, Tiffany; Marshall, Andrew T.; Kirkpatrick, Kimberly

2012-01-01

There is growing evidence that a change in reward magnitude or value alters interval timing, indicating that motivation and timing are not independent processes as was previously believed. The present paper reviews several recent studies, as well as presenting some new evidence with further manipulations of reward value during training vs. testing on a peak procedure. The combined results cannot be accounted for by any of the current psychological timing theories. However, in examining the neural circuitry of the reward system, it is not surprising that motivation has an impact on timing because the motivation/valuation system directly interfaces with the timing system. A new approach is proposed for the development of the next generation of timing models, which utilizes knowledge of the neuroanatomy and neurophysiology of the reward system to guide the development of a neurocomputational model of the reward system. The initial foundation along with heuristics for proceeding with developing such a model is unveiled in an attempt to stimulate new theoretical approaches in the field. PMID:22421220

Serotonergic modulation of reward and punishment: evidence from pharmacological fMRI studies.

PubMed

Macoveanu, Julian

2014-03-27

Until recently, the bulk of research on the human reward system was focused on studying the dopaminergic and opioid neurotransmitter systems. However, extending the initial data from animal studies on reward, recent pharmacological brain imaging studies on human participants bring a new line of evidence on the key role serotonin plays in reward processing. The reviewed research has revealed how central serotonin availability and receptor specific transmission modulates the neural response to both appetitive (rewarding) and aversive (punishing) stimuli in putative reward-related brain regions. Thus, serotonin is suggested to be involved in behavioral control when there is a prospect of reward or punishment. The new findings may have implications in understanding psychiatric disorders such as major depression which is characterized by abnormal serotonergic function and reward-related processing and may also provide a neural correlated for the emotional blunting observed in the clinical treatment of psychiatric disorders with selective serotonin reuptake inhibitors. Given the unique profile of action of each serotonergic receptor subtype, future pharmacological studies may favor receptor specific investigations to complement present research mainly focused on global serotonergic manipulations. Copyright © 2014 Elsevier B.V. All rights reserved.

A review of reward processing and motivational impairment in schizophrenia.

PubMed

Strauss, Gregory P; Waltz, James A; Gold, James M

2014-03-01

This article reviews and synthesizes research on reward processing in schizophrenia, which has begun to provide important insights into the cognitive and neural mechanisms associated with motivational impairments. Aberrant cortical-striatal interactions may be involved with multiple reward processing abnormalities, including: (1) dopamine-mediated basal ganglia systems that support reinforcement learning and the ability to predict cues that lead to rewarding outcomes; (2) orbitofrontal cortex-driven deficits in generating, updating, and maintaining value representations; (3) aberrant effort-value computations, which may be mediated by disrupted anterior cingulate cortex and midbrain dopamine functioning; and (4) altered activation of the prefrontal cortex, which is important for generating exploratory behaviors in environments where reward outcomes are uncertain. It will be important for psychosocial interventions targeting negative symptoms to account for abnormalities in each of these reward processes, which may also have important interactions; suggestions for novel behavioral intervention strategies that make use of external cues, reinforcers, and mobile technology are discussed.

Methylphenidate and brain activity in a reward/conflict paradigm: role of the insula in task performance.

PubMed

Ivanov, Iliyan; Liu, Xun; Clerkin, Suzanne; Schulz, Kurt; Fan, Jin; Friston, Karl; London, Edythe D; Schwartz, Jeffrey; Newcorn, Jeffrey H

2014-06-01

Psychostimulants, such as methylphenidate, are thought to improve information processing in motivation-reward and attention-activation networks by enhancing the effects of more relevant signals and suppressing those of less relevant ones; however the nature of such reciprocal influences remains poorly understood. To explore this question, we tested the effect of methylphenidate on performance and associated brain activity in the Anticipation, Conflict, Reward (ACR) task. Sixteen healthy adult volunteers, ages 21-45, were scanned twice using functional magnetic resonance imaging (fMRI) as they performed the ACR task under placebo and methylphenidate conditions. A three-way repeated measures analysis of variance, with cue (reward vs. non-reward), target (congruent vs. incongruent) and medication condition (methylphenidate vs. placebo) as the factors, was used to analyze behaviors on the task. Blood oxygen level dependent (BOLD) signals, reflecting task-related neural activity, were evaluated using linear contrasts. Participants exhibited significantly greater accuracy in the methylphenidate condition than the placebo condition. Compared with placebo, the methylphenidate condition also was associated with lesser task-related activity in components of attention-activation systems irrespective of the reward cue, and less task-related activity in components of the reward-motivation system, particularly the insula, during reward trials irrespective of target difficulty. These results suggest that methylphenidate enhances task performance by improving efficiency of information processing in both reward-motivation and in attention-activation systems. Published by Elsevier B.V.

Imbalanced functional link between reward circuits and the cognitive control system in patients with obsessive-compulsive disorder.

PubMed

Xie, Chunming; Ma, Lisha; Jiang, Nan; Huang, Ruyan; Li, Li; Gong, Liang; He, Cancan; Xiao, Chaoyong; Liu, Wen; Xu, Shu; Zhang, Zhijun

2017-08-01

Altered reward processing and cognitive deficits are often observed in patients with obsessive-compulsive disorder (OCD); however, whether the imbalance in activity between reward circuits and the cognitive control (CC) system is associated with compulsive behavior remains unknown. Sixty-eight OCD patients and 33 cognitively normal (CN) healthy subjects participated in this resting-state functional magnetic resonance imaging study. Alterations in the functional connectivity between reward circuits and the CC system were quantitatively assessed and compared between the groups. A Granger causality analysis was used to determine the causal informational influence between and within reward circuits and the CC system across all subjects. OCD patients showed a dichotomous pattern of enhanced functional coupling in their reward circuits and a weakened functional coupling in their CC system when compared to CN subjects. Neural correlates of compulsive behavior were primarily located in the reward circuits and CC system in OCD patients. Importantly, the CC system exerted a reduced interregional causal influence over the reward system in OCD patients relative to its effect in CN subjects. The limitations of this study are that it was a cross-sectional study and the potential effects of environmental and genetic factors were not explored. OCD patients showed an imbalance in the functional link between reward circuits and the CC system at rest. This bias toward a loss of control may define a pathological state in which subjects are more vulnerable to engaging in compulsive behaviors.

Integration of homeostatic signaling and food reward processing in the human brain.

PubMed

Simon, Joe J; Wetzel, Anne; Sinno, Maria Hamze; Skunde, Mandy; Bendszus, Martin; Preissl, Hubert; Enck, Paul; Herzog, Wolfgang; Friederich, Hans-Christoph

2017-08-03

Food intake is guided by homeostatic needs and by the reward value of food, yet the exact relation between the two remains unclear. The aim of this study was to investigate the influence of different metabolic states and hormonal satiety signaling on responses in neural reward networks. Twenty-three healthy participants underwent functional magnetic resonance imaging while performing a task distinguishing between the anticipation and the receipt of either food- or monetary-related reward. Every participant was scanned twice in a counterbalanced fashion, both during a fasted state (after 24 hours fasting) and satiety. A functional connectivity analysis was performed to investigate the influence of satiety signaling on activation in neural reward networks. Blood samples were collected to assess hormonal satiety signaling. Fasting was associated with sensitization of the striatal reward system to the anticipation of food reward irrespective of reward magnitude. Furthermore, during satiety, individual ghrelin levels were associated with increased neural processing during the expectation of food-related reward. Our findings show that physiological hunger stimulates food consumption by specifically increasing neural processing during the expectation (i.e., incentive salience) but not the receipt of food-related reward. In addition, these findings suggest that ghrelin signaling influences hedonic-driven food intake by increasing neural reactivity during the expectation of food-related reward. These results provide insights into the neurobiological underpinnings of motivational processing and hedonic evaluation of food reward. ClinicalTrials.gov NCT03081585. This work was supported by the German Competence Network on Obesity, which is funded by the German Federal Ministry of Education and Research (FKZ 01GI1122E).

"I won, but I’m not getting my hopes up": Depression Moderates the Relationship Outcomes and Reward Anticipation

PubMed Central

Olino, Thomas M.; McMakin, Dana L.; Dahl, Ronald E.; Ryan, Neal D.; Silk, Jennifer S.; Birmaher, Boris; Axelson, David A.; Forbes, Erika E.

2011-01-01

Major Depressive Disorder (MDD) in adolescents is characterized by alterations in positive emotions and reward processing. Recent investigations using functional magnetic resonance imaging (fMRI) find depression-related differences in reward anticipation. However, it is unknown whether feedback influences subsequent reward anticipation, which may highlight the context of reward processing. Ten youth with MDD and sixteen youth with no history of MDD completed an fMRI assessment using a reward task. Reward anticipation was indexed by blood oxygen level dependent signal change in the striatum following winning; losing; non-winning; and non-losing outcomes. A significant interaction between diagnostic status and outcome condition predicted reward anticipation in the caudate. Decomposition of the interaction indicated that following winning outcomes, depressed youth demonstrated reduced reward anticipation relative to healthy youth. However, no significant differences between depressed and healthy youth were found after other outcomes. Reward anticipation is altered following winning outcomes. This finding has implications for understanding the developmental pathophysiology of MDD and suggests specific contexts where altered motivational system functioning may play a role in maintaining depression. PMID:22079656

[Cognitive Functions in the Prefrontal Association Cortex; Transitive Inference and the Lateral Prefrontal Cortex].

PubMed

Tanaka, Shingo; Oguchi, Mineki; Sakagami, Masamichi

2016-11-01

To behave appropriately in a complex and uncertain world, the brain makes use of several distinct learning systems. One such system is called the "model-free process", via which conditioning allows the association between a stimulus or response and a given reward to be learned. Another system is called the "model-based process". Via this process, the state transition between a stimulus and a response is learned so that the brain is able to plan actions prior to their execution. Several studies have tried to relate the difference between model-based and model-free processes to the difference in functions of the lateral prefrontal cortex (LPFC) and the striatum. Here, we describe a series of studies that demonstrate the ability of LPFC neurons to categorize visual stimuli by their associated behavioral responses and to generate abstract information. If LPFC neurons utilize abstract code to associate a stimulus with a reward, they should be able to infer similar relationships between other stimuli of the same category and their rewards without direct experience of these stimulus-reward contingencies. We propose that this ability of LPFC neurons to utilize abstract information can contribute to the model-based learning process.

Addiction and the brain antireward system.

PubMed

Koob, George F; Le Moal, Michel

2008-01-01

A neurobiological model of the brain emotional systems has been proposed to explain the persistent changes in motivation that are associated with vulnerability to relapse in addiction, and this model may generalize to other psychopathology associated with dysregulated motivational systems. In this framework, addiction is conceptualized as a cycle of decreased function of brain reward systems and recruitment of antireward systems that progressively worsen, resulting in the compulsive use of drugs. Counteradaptive processes, such as opponent process, that are part of the normal homeostatic limitation of reward function fail to return within the normal homeostatic range and are hypothesized to repeatedly drive the allostatic state. Excessive drug taking thus results in not only the short-term amelioration of the reward deficit but also suppression of the antireward system. However, in the long term, there is worsening of the underlying neurochemical dysregulations that ultimately form an allostatic state (decreased dopamine and opioid peptide function, increased corticotropin-releasing factor activity). This allostatic state is hypothesized to be reflected in a chronic deviation of reward set point that is fueled not only by dysregulation of reward circuits per se but also by recruitment of brain and hormonal stress responses. Vulnerability to addiction may involve genetic comorbidity and developmental factors at the molecular, cellular, or neurocircuitry levels that sensitize the brain antireward systems.

Investigating the Impact of a Genome-Wide Supported Bipolar Risk Variant of MAD1L1 on the Human Reward System.

PubMed

Trost, Sarah; Diekhof, Esther K; Mohr, Holger; Vieker, Henning; Krämer, Bernd; Wolf, Claudia; Keil, Maria; Dechent, Peter; Binder, Elisabeth B; Gruber, Oliver

2016-10-01

Recent genome-wide association studies have identified MAD1L1 (mitotic arrest deficient-like 1) as a susceptibility gene for bipolar disorder and schizophrenia. The minor allele of the single-nucleotide polymorphism (SNP) rs11764590 in MAD1L1 was associated with bipolar disorder. Both diseases, bipolar disorder and schizophrenia, are linked to functional alterations in the reward system. We aimed at investigating possible effects of the MAD1L1 rs11764590 risk allele on reward systems functioning in healthy adults. A large homogenous sample of 224 young (aged 18-31 years) participants was genotyped and underwent functional magnetic resonance imaging (fMRI). All participants performed the 'Desire-Reason Dilemma' paradigm investigating the neural correlates that underlie reward processing and active reward dismissal in favor of a long-term goal. We found significant hypoactivations of the ventral tegmental area (VTA), the bilateral striatum and bilateral frontal and parietal cortices in response to conditioned reward stimuli in the risk allele carriers compared with major allele carriers. In the dilemma situation, functional connectivity between prefrontal brain regions and the ventral striatum was significantly diminished in the risk allele carriers. Healthy risk allele carriers showed a significant deficit of their bottom-up response to conditioned reward stimuli in the bilateral VTA and striatum. Furthermore, functional connectivity between the ventral striatum and prefrontal areas exerting top-down control on the mesolimbic reward system was reduced in this group. Similar alterations in reward processing and disturbances of prefrontal control mechanisms on mesolimbic brain circuits have also been reported in bipolar disorder and schizophrenia. Together, these findings suggest the existence of an intermediate phenotype associated with MAD1L1.

NMDA receptor blockade in the prelimbic cortex activates the mesolimbic system and dopamine-dependent opiate reward signaling.

PubMed

Tan, Huibing; Rosen, Laura G; Ng, Garye A; Rushlow, Walter J; Laviolette, Steven R

2014-12-01

N-Methyl-D-aspartate (NMDA) receptors in the medial prefrontal cortex (mPFC) are involved in opiate reward processing and modulate sub-cortical dopamine (DA) activity. NMDA receptor blockade in the prelimbic (PLC) division of the mPFC strongly potentiates the rewarding behavioural properties of normally sub-reward threshold doses of opiates. However, the possible functional interactions between cortical NMDA and sub-cortical DAergic motivational neural pathways underlying these effects are not understood. This study examines how NMDA receptor modulation in the PLC influences opiate reward processing via interactions with sub-cortical DAergic transmission. We further examined whether direct intra-PLC NMDA receptor modulation may activate DA-dependent opiate reward signaling via interactions with the ventral tegmental area (VTA). Using an unbiased place conditioning procedure (CPP) in rats, we performed bilateral intra-PLC microinfusions of the competitive NMDA receptor antagonist, (2R)-amino-5-phosphonovaleric acid (AP-5), prior to behavioural morphine place conditioning and challenged the rewarding effects of morphine with DA receptor blockade. We next examined the effects of intra-PLC NMDA receptor blockade on the spontaneous activity patterns of presumptive VTA DA or GABAergic neurons, using single-unit, extracellular in vivo neuronal recordings. We show that intra-PLC NMDA receptor blockade strongly activates sub-cortical DA neurons within the VTA while inhibiting presumptive non-DA GABAergic neurons. Behaviourally, NMDA receptor blockade activates a DA-dependent opiate reward system, as pharmacological blockade of DA transmission blocked morphine reward only in the presence of intra-PLC NMDA receptor antagonism. These findings demonstrate a cortical NMDA-mediated mechanism controlling mesolimbic DAergic modulation of opiate reward processing.

Reward and aversion in a heterogeneous midbrain dopamine system.

PubMed

Lammel, Stephan; Lim, Byung Kook; Malenka, Robert C

2014-01-01

The ventral tegmental area (VTA) is a heterogeneous brain structure that serves a central role in motivation and reward processing. Abnormalities in the function of VTA dopamine (DA) neurons and the targets they influence are implicated in several prominent neuropsychiatric disorders including addiction and depression. Recent studies suggest that the midbrain DA system is composed of anatomically and functionally heterogeneous DA subpopulations with different axonal projections. These findings may explain a number of previously confusing observations that suggested a role for DA in processing both rewarding as well as aversive events. Here we will focus on recent advances in understanding the neural circuits mediating reward and aversion in the VTA and how stress as well as drugs of abuse, in particular cocaine, alter circuit function within a heterogeneous midbrain DA system. This article is part of a Special Issue entitled 'NIDA 40th Anniversary Issue'. Copyright © 2013 Elsevier Ltd. All rights reserved.

Autistic traits modulate frontostriatal connectivity during processing of rewarding faces

PubMed Central

Neufeld, Janina; Johnstone, Tom; Chakrabarti, Bhismadev

2014-01-01

Deficits in facial mimicry have been widely reported in autism. Some studies have suggested that these deficits are restricted to spontaneous mimicry and do not extend to volitional mimicry. We bridge these apparently inconsistent observations by testing the impact of reward value on neural indices of mimicry and how autistic traits modulate this impact. Neutral faces were conditioned with high and low reward. Subsequently, functional connectivity between the ventral striatum (VS) and inferior frontal gyrus (IFG) was measured while neurotypical adults (n = 30) watched happy expressions made by these conditioned faces. We found greater VS–IFG connectivity in response to high reward vs low reward happy faces. This difference was negatively proportional to autistic traits, suggesting that reduced spontaneous mimicry of social stimuli seen in autism, may be related to a failure in the modulation of the mirror system by the reward system rather than a circumscribed deficit in the mirror system. PMID:24493838

Modulation of Food Reward by Endocrine and Environmental Factors: Update and Perspective.

PubMed

Figlewicz, Dianne P

2015-01-01

Palatable foods are frequently high in energy density. Chronic consumption of high-energy density foods can contribute to the development of cardiometabolic pathology including obesity, diabetes, and cardiovascular disease. This article reviews the contributions of extrinsic and intrinsic factors that influence the reward components of food intake. A narrative review was conducted to determine the behavioral and central nervous system (CNS) related processes involved in the reward components of high-energy density food intake. The rewarding aspects of food, particularly palatable and preferred foods, are regulated by CNS circuitry. Overlaying this regulation is modulation by intrinsic endocrine systems and metabolic hormones relating to energy homeostasis, developmental stage, or gender. It is now recognized that extrinsic or environmental factors, including ambient diet composition and the provocation of stress or anxiety, also contribute substantially to the expression of food reward behaviors such as motivation for, and seeking of, preferred foods. High-energy density food intake is influenced by both physiological and pathophysiological processes. Contextual, behavioral, and psychological factors and CNS-related processes represent potential targets for multiple types of therapeutic intervention.

Music and the nucleus accumbens.

PubMed

Mavridis, Ioannis N

2015-03-01

Music is a universal feature of human societies over time, mainly because it allows expression and regulation of strong emotions, thus influencing moods and evoking pleasure. The nucleus accumbens (NA), the most important pleasure center of the human brain (dominates the reward system), is the 'king of neurosciences' and dopamine (DA) can be rightfully considered as its 'crown' due to the fundamental role that this neurotransmitter plays in the brain's reward system. Purpose of this article was to review the existing literature regarding the relation between music and the NA. Studies have shown that reward value for music can be coded by activity levels in the NA, whose functional connectivity with auditory and frontal areas increases as a function of increasing musical reward. Listening to music strongly modulates activity in a network of mesolimbic structures involved in reward processing including the NA. The functional connectivity between brain regions mediating reward, autonomic and cognitive processing provides insight into understanding why listening to music is one of the most rewarding and pleasurable human experiences. Musical stimuli can significantly increase extracellular DA levels in the NA. NA DA and serotonin were found significantly higher in animals exposed to music. Finally, passive listening to unfamiliar although liked music showed activations in the NA.

Oscillatory rhythm of reward: anticipation and processing of rewards in children with and without autism.

PubMed

Stavropoulos, Katherine Kuhl-Meltzoff; Carver, Leslie J

2018-01-01

Autism spectrum disorder (ASD) is a complex neurodevelopmental condition, and multiple theories have emerged concerning core social deficits. While the social motivation hypothesis proposes that deficits in the social reward system cause individuals with ASD to engage less in social interaction, the overly intense world hypothesis (sensory over-responsivity) proposes that individuals with ASD find stimuli to be too intense and may have hypersensitivity to social interaction, leading them to avoid these interactions. EEG was recorded during reward anticipation and reward processing. Reward anticipation was measured using alpha asymmetry, and post-feedback theta was utilized to measure reward processing. Additionally, we calculated post-feedback alpha suppression to measure attention and salience. Participants were 6- to 8-year-olds with ( N  = 20) and without ( N  = 23) ASD. Children with ASD showed more left-dominant alpha suppression when anticipating rewards accompanied by nonsocial stimuli compared to social stimuli. During reward processing, children with ASD had less theta activity than typically developing (TD) children. Alpha activity after feedback showed the opposite pattern: children with ASD had greater alpha suppression than TD children. Significant correlations were observed between behavioral measures of autism severity and EEG activity in both the reward anticipation and reward processing time periods. The findings provide evidence that children with ASD have greater approach motivation prior to nonsocial (compared to social) stimuli. Results after feedback suggest that children with ASD evidence less robust activity thought to reflect evaluation and processing of rewards (e.g., theta) compared to TD children. However, children with ASD evidence greater alpha suppression after feedback compared to TD children. We hypothesize that post-feedback alpha suppression reflects general cognitive engagement-which suggests that children with ASD may experience feedback as overly intense. Taken together, these results suggest that aspects of both the social motivation hypothesis and the overly intense world hypothesis may be occurring simultaneously.

Motivation and timing: clues for modeling the reward system.

PubMed

Galtress, Tiffany; Marshall, Andrew T; Kirkpatrick, Kimberly

2012-05-01

There is growing evidence that a change in reward magnitude or value alters interval timing, indicating that motivation and timing are not independent processes as was previously believed. The present paper reviews several recent studies, as well as presenting some new evidence with further manipulations of reward value during training vs. testing on a peak procedure. The combined results cannot be accounted for by any of the current psychological timing theories. However, in examining the neural circuitry of the reward system, it is not surprising that motivation has an impact on timing because the motivation/valuation system directly interfaces with the timing system. A new approach is proposed for the development of the next generation of timing models, which utilizes knowledge of the neuroanatomy and neurophysiology of the reward system to guide the development of a neurocomputational model of the reward system. The initial foundation along with heuristics for proceeding with developing such a model is unveiled in an attempt to stimulate new theoretical approaches in the field. Copyright © 2012 Elsevier B.V. All rights reserved.

Aerobic exercise modulates anticipatory reward processing via the μ-opioid receptor system.

PubMed

Saanijoki, Tiina; Nummenmaa, Lauri; Tuulari, Jetro J; Tuominen, Lauri; Arponen, Eveliina; Kalliokoski, Kari K; Hirvonen, Jussi

2018-06-08

Physical exercise modulates food reward and helps control body weight. The endogenous µ-opioid receptor (MOR) system is involved in rewarding aspects of both food and physical exercise, yet interaction between endogenous opioid release following exercise and anticipatory food reward remains unresolved. Here we tested whether exercise-induced opioid release correlates with increased anticipatory reward processing in humans. We scanned 24 healthy lean men after rest and after a 1 h session of aerobic exercise with positron emission tomography (PET) using MOR-selective radioligand [ 11 C]carfentanil. After both PET scans, the subjects underwent a functional magnetic resonance imaging (fMRI) experiment where they viewed pictures of palatable versus nonpalatable foods to trigger anticipatory food reward responses. Exercise-induced changes in MOR binding in key regions of reward circuit (amygdala, thalamus, ventral and dorsal striatum, and orbitofrontal and cingulate cortices) were used to predict the changes in anticipatory reward responses in fMRI. Exercise-induced changes in MOR binding correlated negatively with the exercise-induced changes in neural anticipatory food reward responses in orbitofrontal and cingulate cortices, insula, ventral striatum, amygdala, and thalamus: higher exercise-induced opioid release predicted higher brain responses to palatable versus nonpalatable foods. We conclude that MOR activation following exercise may contribute to the considerable interindividual variation in food craving and consumption after exercise, which might promote compensatory eating and compromise weight control. © 2018 Wiley Periodicals, Inc.

Impairments in learning by monetary rewards and alcohol-associated rewards in detoxified alcoholic patients.

PubMed

Jokisch, Daniel; Roser, Patrik; Juckel, Georg; Daum, Irene; Bellebaum, Christian

2014-07-01

Excessive alcohol consumption has been linked to structural and functional brain changes associated with cognitive, emotional, and behavioral impairments. It has been suggested that neural processing in the reward system is also affected by alcoholism. The present study aimed at further investigating reward-based associative learning and reversal learning in detoxified alcohol-dependent patients. Twenty-one detoxified alcohol-dependent patients and 26 healthy control subjects participated in a probabilistic learning task using monetary and alcohol-associated rewards as feedback stimuli indicating correct responses. Performance during acquisition and reversal learning in the different feedback conditions was analyzed. Alcohol-dependent patients and healthy control subjects showed an increase in learning performance over learning blocks during acquisition, with learning performance being significantly lower in alcohol-dependent patients. After changing the contingencies, alcohol-dependent patients exhibited impaired reversal learning and showed, in contrast to healthy controls, different learning curves for different types of rewards with no increase in performance for high monetary and alcohol-associated feedback. The present findings provide evidence that dysfunctional processing in the reward system in alcohol-dependent patients leads to alterations in reward-based learning resulting in a generally reduced performance. In addition, the results suggest that alcohol-dependent patients are, in particular, more impaired in changing an established behavior originally reinforced by high rewards. Copyright © 2014 by the Research Society on Alcoholism.

Prediction-error in the context of real social relationships modulates reward system activity.

PubMed

Poore, Joshua C; Pfeifer, Jennifer H; Berkman, Elliot T; Inagaki, Tristen K; Welborn, Benjamin L; Lieberman, Matthew D

2012-01-01

The human reward system is sensitive to both social (e.g., validation) and non-social rewards (e.g., money) and is likely integral for relationship development and reputation building. However, data is sparse on the question of whether implicit social reward processing meaningfully contributes to explicit social representations such as trust and attachment security in pre-existing relationships. This event-related fMRI experiment examined reward system prediction-error activity in response to a potent social reward-social validation-and this activity's relation to both attachment security and trust in the context of real romantic relationships. During the experiment, participants' expectations for their romantic partners' positive regard of them were confirmed (validated) or violated, in either positive or negative directions. Primary analyses were conducted using predefined regions of interest, the locations of which were taken from previously published research. Results indicate that activity for mid-brain and striatal reward system regions of interest was modulated by social reward expectation violation in ways consistent with prior research on reward prediction-error. Additionally, activity in the striatum during viewing of disconfirmatory information was associated with both increases in post-scan reports of attachment anxiety and decreases in post-scan trust, a finding that follows directly from representational models of attachment and trust.

Improved memory for reward cues following acute buprenorphine administration in humans.

PubMed

Syal, Supriya; Ipser, Jonathan; Terburg, David; Solms, Mark; Panksepp, Jaak; Malcolm-Smith, Susan; Bos, Peter A; Montoya, Estrella R; Stein, Dan J; van Honk, Jack

2015-03-01

In rodents, there is abundant evidence for the involvement of the opioid system in the processing of reward cues, but this system has remained understudied in humans. In humans, the happy facial expression is a pivotal reward cue. Happy facial expressions activate the brain's reward system and are disregarded by subjects scoring high on depressive mood who are low in reward drive. We investigated whether a single 0.2mg administration of the mixed mu-opioid agonist/kappa-antagonist, buprenorphine, would influence short-term memory for happy, angry or fearful expressions relative to neutral faces. Healthy human subjects (n38) participated in a randomized placebo-controlled within-subject design, and performed an emotional face relocation task after administration of buprenorphine and placebo. We show that, compared to placebo, buprenorphine administration results in a significant improvement of memory for happy faces. Our data demonstrate that acute manipulation of the opioid system by buprenorphine increases short-term memory for social reward cues. Copyright © 2015. Published by Elsevier Ltd.

Within-subject neural reactivity to reward and threat is inverted in young adolescents.

PubMed

Thomason, M E; Marusak, H A

2017-07-01

As children mature, they become increasingly independent and less reliant on caregiver support. Changes in brain systems are likely to stimulate and guide this process. One mechanistic hypothesis suggests that changes in neural systems that process reward and threat support the increase in exploratory behavior observed in the transition to adolescence. This study examines the basic tenets of this hypothesis by performing functional magnetic resonance imaging (fMRI) during well-established reward and threat processing tasks in 40 children and adolescents, aged 9-15 years. fMRI responses in the striatum and amygdala are fit to a model predicting that striatal reward and amygdala threat-responses will be unrelated in younger participants (aged 9-12 years), while older participants (aged 13-15 years) will differentially engage these structures. Our data are consistent with this model. Activity in the striatum and amygdala are comparable in younger children, but in older children, they are inversely related; those more responsive to reward show a reduced threat-response. Analyses testing age as a continuous variable yield consistent results. In addition, the proportion of threat to reward-response relates to self-reported approach behavior in older but not younger youth, exposing behavioral relevance in the relative level of activity in these structures. Results are consistent with the notion that both individual and developmental differences drive reward-seeking behavior in adolescence. While these response patterns may serve adaptive functions in the shift to independence, skew in these systems may relate to increased rates of emotional psychopathology and risk-taking observed in adolescence.

Mechanisms Underlying the Risk to Develop Drug Addiction, Insights From Studies in Drosophila melanogaster.

PubMed

Ryvkin, Julia; Bentzur, Assa; Zer-Krispil, Shir; Shohat-Ophir, Galit

2018-01-01

The ability to adapt to environmental changes is an essential feature of biological systems, achieved in animals by a coordinated crosstalk between neuronal and hormonal programs that allow rapid and integrated organismal responses. Reward systems play a key role in mediating this adaptation by reinforcing behaviors that enhance immediate survival, such as eating or drinking, or those that ensure long-term survival, such as sexual behavior or caring for offspring. Drugs of abuse co-opt neuronal and molecular pathways that mediate natural rewards, which under certain circumstances can lead to addiction. Many factors can contribute to the transition from drug use to drug addiction, highlighting the need to discover mechanisms underlying the progression from initial drug use to drug addiction. Since similar responses to natural and drug rewards are present in very different animals, it is likely that the central systems that process reward stimuli originated early in evolution, and that common ancient biological principles and genes are involved in these processes. Thus, the neurobiology of natural and drug rewards can be studied using simpler model organisms that have their systems stripped of some of the immense complexity that exists in mammalian brains. In this paper we review studies in Drosophila melanogaster that model different aspects of natural and drug rewards, with an emphasis on how motivational states shape the value of the rewarding experience, as an entry point to understanding the mechanisms that contribute to the vulnerability of drug addiction.

The role of reward in word learning and its implications for language acquisition.

PubMed

Ripollés, Pablo; Marco-Pallarés, Josep; Hielscher, Ulrike; Mestres-Missé, Anna; Tempelmann, Claus; Heinze, Hans-Jochen; Rodríguez-Fornells, Antoni; Noesselt, Toemme

2014-11-03

The exact neural processes behind humans' drive to acquire a new language--first as infants and later as second-language learners--are yet to be established. Recent theoretical models have proposed that during human evolution, emerging language-learning mechanisms might have been glued to phylogenetically older subcortical reward systems, reinforcing human motivation to learn a new language. Supporting this hypothesis, our results showed that adult participants exhibited robust fMRI activation in the ventral striatum (VS)--a core region of reward processing--when successfully learning the meaning of new words. This activation was similar to the VS recruitment elicited using an independent reward task. Moreover, the VS showed enhanced functional and structural connectivity with neocortical language areas during successful word learning. Together, our results provide evidence for the neural substrate of reward and motivation during word learning. We suggest that this strong functional and anatomical coupling between neocortical language regions and the subcortical reward system provided a crucial advantage in humans that eventually enabled our lineage to successfully acquire linguistic skills. Copyright © 2014 Elsevier Ltd. All rights reserved.

Reward sensitivity, decisional bias, and metacognitive deficits in cocaine drug addiction.

PubMed

Balconi, Michela; Finocchiaro, Roberta; Campanella, Salvatore

2014-01-01

The present research explored the effect of reward sensitivity bias and metacognitive deficits on substance use disorder (SUD) in the decision-making process. The behavioral activation system (BAS) was used as a predictive marker of dysfunctional behavior during the Iowa gambling task (IGT). We also tried to relate this motivational system bias to self-reported metacognitive measures (self-knowledge, strategic planning, flexibility, and efficacy) in the decision processes. Thirty-four SUD participants (cocaine dependent) and 39 participants in the control group underwent the IGT. The SUD group was associated with a poorer performance on the IGT and a dysfunctional metacognition ability (unrealistic representation). An increase in the reward sensitivity (higher BAS, BAS reward responsiveness, and BAS reward) was observed in the SUD group compared with the control group and explained (through a regression analysis) the main behavioral deficits. More generally, an increase in the BAS reward responsiveness may be considered a predictive measure of risk-taking and dysfunctional behavior, not only in pathological (SUD) individuals, but also in subclinical individuals (controls). We discuss the likely cognitive, brain, and neurotransmitter contributions to this phenomenon.

Brain substrates of reward processing and the μ-opioid receptor: a pathway into pain?

PubMed

Nees, Frauke; Becker, Susanne; Millenet, Sabina; Banaschewski, Tobias; Poustka, Luise; Bokde, Arun; Bromberg, Uli; Büchel, Christian; Conrod, Patricia J; Desrivières, Sylvane; Frouin, Vincent; Gallinat, Jürgen; Garavan, Hugh; Heinz, Andreas; Ittermann, Bernd; Martinot, Jean-Luc; Papadopoulos Orfanos, Dimitri; Paus, Tomáš; Smolka, Michael N; Walter, Henrik; Whelan, Rob; Schumann, Gunter; Flor, Herta

2017-02-01

The processing of reward and reinforcement learning seems to be important determinants of pain chronicity. However, reward processing is already altered early in life and if this is related to the development of pain symptoms later on is not known. The aim of this study was first to examine whether behavioural and brain-related indicators of reward processing at the age of 14 to 15 years are significant predictors of pain complaints 2 years later, at 16 to 17 years. Second, we investigated the contribution of genetic variations in the opioidergic system, which is linked to the processing of both, reward and pain, to this prediction. We used the monetary incentive delay task to assess reward processing, the Children's Somatization Inventory as measure of pain complaints and tested the effects of 2 single nucleotide polymorphisms (rs1799971/rs563649) of the human μ-opioid receptor gene. We found a significant prediction of pain complaints by responses in the dorsal striatum during reward feedback, independent of genetic predisposition. The relationship of pain complaints and activation in the periaqueductal gray and ventral striatum depended on the T-allele of rs563649. Carriers of this allele also showed more pain complaints than CC-allele carriers. Therefore, brain responses to reward outcomes and higher sensitivity to pain might be related already early in life and may thus set the course for pain complaints later in life, partly depending on a specific opioidergic genetic predisposition.

Viewing pictures of a romantic partner reduces experimental pain: involvement of neural reward systems.

PubMed

Younger, Jarred; Aron, Arthur; Parke, Sara; Chatterjee, Neil; Mackey, Sean

2010-10-13

The early stages of a new romantic relationship are characterized by intense feelings of euphoria, well-being, and preoccupation with the romantic partner. Neuroimaging research has linked those feelings to activation of reward systems in the human brain. The results of those studies may be relevant to pain management in humans, as basic animal research has shown that pharmacologic activation of reward systems can substantially reduce pain. Indeed, viewing pictures of a romantic partner was recently demonstrated to reduce experimental thermal pain. We hypothesized that pain relief evoked by viewing pictures of a romantic partner would be associated with neural activations in reward-processing centers. In this functional magnetic resonance imaging (fMRI) study, we examined fifteen individuals in the first nine months of a new, romantic relationship. Participants completed three tasks under periods of moderate and high thermal pain: 1) viewing pictures of their romantic partner, 2) viewing pictures of an equally attractive and familiar acquaintance, and 3) a word-association distraction task previously demonstrated to reduce pain. The partner and distraction tasks both significantly reduced self-reported pain, although only the partner task was associated with activation of reward systems. Greater analgesia while viewing pictures of a romantic partner was associated with increased activity in several reward-processing regions, including the caudate head, nucleus accumbens, lateral orbitofrontal cortex, amygdala, and dorsolateral prefrontal cortex--regions not associated with distraction-induced analgesia. The results suggest that the activation of neural reward systems via non-pharmacologic means can reduce the experience of pain.

Reward processing by the lateral habenula in normal and depressive behaviors

PubMed Central

Proulx, Christophe D.; Hikosaka, Okihide; Malinow, Roberto

2015-01-01

The brain reward circuit has a central role in reinforcing behaviors that are rewarding and preventing behaviors that lead to punishment. Recent work has shown that the lateral habenula is an important part of the reward circuit by providing ‘negative value’ signals to the dopaminergic and serotonergic systems. Studies also suggest that dysfunction of the lateral habenula is associated with psychiatric disorders including major depression. In this review, we first discuss insights gained from neuronal recordings in monkeys regarding how the lateral habenula processes reward-related information. We next highlight recent optogenetic experiments in rodents addressing normal and abnormal functions of the habenula. Finally, we discuss how deregulation of the lateral habenula may play a role in depressive behaviors. PMID:25157511

Integration of homeostatic signaling and food reward processing in the human brain

PubMed Central

Simon, Joe J.; Wetzel, Anne; Sinno, Maria Hamze; Skunde, Mandy; Bendszus, Martin; Enck, Paul; Herzog, Wolfgang; Friederich, Hans-Christoph

2017-01-01

BACKGROUND. Food intake is guided by homeostatic needs and by the reward value of food, yet the exact relation between the two remains unclear. The aim of this study was to investigate the influence of different metabolic states and hormonal satiety signaling on responses in neural reward networks. METHODS. Twenty-three healthy participants underwent functional magnetic resonance imaging while performing a task distinguishing between the anticipation and the receipt of either food- or monetary-related reward. Every participant was scanned twice in a counterbalanced fashion, both during a fasted state (after 24 hours fasting) and satiety. A functional connectivity analysis was performed to investigate the influence of satiety signaling on activation in neural reward networks. Blood samples were collected to assess hormonal satiety signaling. RESULTS. Fasting was associated with sensitization of the striatal reward system to the anticipation of food reward irrespective of reward magnitude. Furthermore, during satiety, individual ghrelin levels were associated with increased neural processing during the expectation of food-related reward. CONCLUSIONS. Our findings show that physiological hunger stimulates food consumption by specifically increasing neural processing during the expectation (i.e., incentive salience) but not the receipt of food-related reward. In addition, these findings suggest that ghrelin signaling influences hedonic-driven food intake by increasing neural reactivity during the expectation of food-related reward. These results provide insights into the neurobiological underpinnings of motivational processing and hedonic evaluation of food reward. TRIAL REGISTRATION. ClinicalTrials.gov NCT03081585. FUNDING. This work was supported by the German Competence Network on Obesity, which is funded by the German Federal Ministry of Education and Research (FKZ 01GI1122E). PMID:28768906

Aberrant mesolimbic dopamine-opiate interaction in obesity.

PubMed

Tuominen, Lauri; Tuulari, Jetro; Karlsson, Henry; Hirvonen, Jussi; Helin, Semi; Salminen, Paulina; Parkkola, Riitta; Hietala, Jarmo; Nuutila, Pirjo; Nummenmaa, Lauri

2015-11-15

Dopamine and opioid neurotransmitter systems share many functions such as regulation of reward and pleasure. μ-Opioid receptors (MOR) modulate the mesolimbic dopamine system in ventral tegmental area and striatum, key areas implicated in reward. We hypothesized that dopamine and opioid receptor availabilities correlate in vivo and that this correlation is altered in obesity, a disease with altered reward processing. Twenty lean females (mean BMI 22) and 25 non-binge eating morbidly obese females (mean BMI 41) underwent two positron emission tomography scans with [(11)C]carfentanil and [(11)C]raclopride to measure the MOR and dopamine D2 receptor (DRD2) availability, respectively. In lean subjects, the MOR and DRD2 availabilities were positively associated in the ventral striatum (r=0.62, p=0.003) and dorsal caudate nucleus (r=0.62, p=0.004). Moreover, DRD2 availability in the ventral striatum was associated with MOR availability in other regions of the reward circuitry, particularly in the ventral tegmental area. In morbidly obese subjects, this receptor interaction was significantly weaker in ventral striatum but unaltered in the caudate nucleus. Finally, the association between DRD2 availability in the ventral striatum and MOR availability in the ventral tegmental area was abolished in the morbidly obese. The study demonstrates a link between DRD2 and MOR availabilities in living human brain. This interaction is selectively disrupted in mesolimbic dopamine system in morbid obesity. We propose that interaction between the dopamine and opioid systems is a prerequisite for normal reward processing and that disrupted cross-talk may underlie altered reward processing in obesity. Copyright © 2015 Elsevier Inc. All rights reserved.

Workload-Based Automated Interface Mode Selection

DTIC Science & Technology

2012-03-22

Process . . . . . . . . . . . . . . . . . . . . . 31 3.5.10 Agent Reward Function . . . . . . . . . . . . . . . . 31 3.5.11 Accelerated Learning... Strategies . . . . . . . . . . . . 31 4. Experimental Methodology . . . . . . . . . . . . . . . . . . . . . . . . 33 4.1 System Engineering Methodology...26 5. Agent state function. . . . . . . . . . . . . . . . . . . . . . . . . . . 28 6. Agent reward function

Chronic Motivational State Interacts with Task Reward Structure in Dynamic Decision-Making

PubMed Central

Cooper, Jessica A.; Worthy, Darrell A.; Maddox, W. Todd

2015-01-01

Research distinguishes between a habitual, model-free system motivated toward immediately rewarding actions, and a goal-directed, model-based system motivated toward actions that improve future state. We examined the balance of processing in these two systems during state-based decision-making. We tested a regulatory fit hypothesis (Maddox & Markman, 2010) that predicts that global trait motivation affects the balance of habitual- vs. goal-directed processing but only through its interaction with the task framing as gain-maximization or loss-minimization. We found support for the hypothesis that a match between an individual’s chronic motivational state and the task framing enhances goal-directed processing, and thus state-based decision-making. Specifically, chronic promotion-focused individuals under gain-maximization and chronic prevention-focused individuals under loss-minimization both showed enhanced state-based decision-making. Computational modeling indicates that individuals in a match between global chronic motivational state and local task reward structure engaged more goal-directed processing, whereas those in a mismatch engaged more habitual processing. PMID:26520256

Quality management of human resources. Providers should begin by focusing on education, performance management, and reward systems.

PubMed

Blair, C S; Fordyce, M; Barney, S M

1993-10-01

For a quality management transformation to occur, a healthcare organization must focus on education and development, performance management, and recognition and reward systems during the first years of implementation. Education and development are perhaps the most important human resource management functions when implementing quality management principles and processes because behavioral changes will be required at all organizational levels. Specific programs that support an organization's quality management effort will vary but should include the conceptual, cultural, and technical aspects of quality management. The essence of quality management is to always satisfy the customer and to continuously improve the services and products the organization offers. The approach to performance management should therefore rely on customer feedback and satisfaction. An organization committed to quality management should base its performance management approach on customer orientation, process improvement, employee involvement, decision making with data, and continuous improvement. Managers and trustees are being challenged to provide innovative recognition and reward systems that reinforce the values and behaviors consistent with quality management. Such systems must also be aligned with the behaviors and outcomes that support the philosophy, mission, and values of the Catholic healthcare ministry. The following components should be considered for a recognition and reward system: base pay, incentives, benefits, and nonmonetary rewards.

The role of the opioid system in binge eating disorder.

PubMed

Giuliano, Chiara; Cottone, Pietro

2015-12-01

Binge eating disorder is characterized by excessive, uncontrollable consumption of palatable food within brief periods of time. Excessive intake of palatable food is thought to be driven by hedonic, rather than energy homeostatic, mechanisms. However, reward processing does not only comprise consummatory actions; a key component is represented by the anticipatory phase directed at procuring the reward. This phase is highly influenced by environmental food-associated stimuli, which can robustly enhance the desire to eat even in the absence of physiological needs. The opioid system (endogenous peptides and their receptors) has been strongly linked to the rewarding aspects of palatable food intake, and perhaps represents the key system involved in hedonic overeating. Here we review evidence suggesting that the opioid system can also be regarded as one of the systems that regulates the anticipatory incentive processes preceding binge eating hedonic episodes.

Abnormal reward functioning across substance use disorders and major depressive disorder: Considering reward as a transdiagnostic mechanism.

PubMed

Baskin-Sommers, Arielle R; Foti, Dan

2015-11-01

A common criticism of the Diagnostic and Statistical Manual of Mental Disorders (American Psychiatric Association, 2013) is that its criteria are based more on behavioral descriptions than on underlying biological mechanisms. Increasingly, calls have intensified for a more biologically-based approach to conceptualizing, studying, and treating psychological disorders, as exemplified by the Research Domain Criteria Project (RDoC). Among the most well-studied neurobiological mechanisms is reward processing. Moreover, individual differences in reward sensitivity are related to risk for substance abuse and depression. The current review synthesizes the available preclinical, electrophysiological, and neuroimaging literature on reward processing from a transdiagnostic, multidimensional perspective. Findings are organized with respect to key reward constructs within the Positive Valence Systems domain of the RDoC matrix, including initial responsiveness to reward (physiological 'liking'), approach motivation (physiological 'wanting'), and reward learning/habit formation. In the current review, we (a) describe the neural basis of reward, (b) elucidate differences in reward activity in substance abuse and depression, and (c) suggest a framework for integrating these disparate literatures and discuss the utility of shifting focus from diagnosis to process for understanding liability and co-morbidity. Ultimately, we believe that an integrative focus on abnormal reward functioning across the full continuum of clinically heterogeneous samples, rather than within circumscribed diagnostic categories, might actually help to refine the phenotypes and improve the prediction of onset and recovery of these disorders. Copyright © 2015 Elsevier B.V. All rights reserved.

Reward Retroactively Enhances Memory Consolidation for Related Items

ERIC Educational Resources Information Center

Patil, Anuya; Murty, Vishnu P.; Dunsmoor, Joseph E.; Phelps, Elizabeth A.; Davachi, Lila

2017-01-01

Reward motivation has been shown to modulate episodic memory processes in order to support future adaptive behavior. However, for a memory system to be truly adaptive, it should enhance memory for rewarded events as well as for neutral events that may seem inconsequential at the time of encoding but can gain importance later. Here, we investigated…

Effects of motivation on reward and attentional networks: an fMRI study.

PubMed

Ivanov, Iliyan; Liu, Xun; Clerkin, Suzanne; Schulz, Kurt; Friston, Karl; Newcorn, Jeffrey H; Fan, Jin

2012-11-01

Existing evidence suggests that reward and attentional networks function in concert and that activation in one system influences the other in a reciprocal fashion; however, the nature of these influences remains poorly understood. We therefore developed a three-component task to assess the interaction effects of reward anticipation and conflict resolution on the behavioral performance and the activation of brain reward and attentional systems. Sixteen healthy adult volunteers aged 21-45 years were scanned with functional magnetic resonance imaging (fMRI) while performing the task. A two-way repeated measures analysis of variance (ANOVA) with cue (reward vs. non-reward) and target (congruent vs. incongruent) as within-subjects factors was used to test for main and interaction effects. Neural responses to anticipation, conflict, and reward outcomes were tested. Behaviorally there were main effects of both reward cue and target congruency on reaction time. Neuroimaging results showed that reward anticipation and expected reward outcomes activated components of the attentional networks, including the inferior parietal and occipital cortices, whereas surprising non-rewards activated the frontoinsular cortex bilaterally and deactivated the ventral striatum. In turn, conflict activated a broad network associated with cognitive control and motor functions. Interaction effects showed decreased activity in the thalamus, anterior cingulated gyrus, and middle frontal gyrus bilaterally when difficult conflict trials (e.g., incongruent targets) were preceded by reward cues; in contrast, the ventral striatum and orbitofrontal cortex showed greater activation during congruent targets preceded by reward cues. These results suggest that reward anticipation is associated with lower activation in attentional networks, possibly due to increased processing efficiency, whereas more difficult, conflict trials are associated with lower activity in regions of the reward system, possibly because such trials are experienced as less rewarding.

A reward-centred model of anorexia nervosa: a focussed narrative review of the neurological and psychophysiological literature.

PubMed

O'Hara, Caitlin B; Campbell, Iain C; Schmidt, Ulrike

2015-05-01

This focussed narrative review examines neurobiological and psychophysiological evidence supporting a role for altered reward processes in the development and maintenance of anorexia nervosa (AN). In AN, there does not appear to be a generalised inability to experience reward. Rather, data suggest that a reluctance to gain weight leads to an aversive appraisal of food- and taste-related stimuli. As a result, cues compatible with this aberrant mode of thinking become rewarding for the individual. Evidence also suggests that attribution of motivational salience to such cues promotes anorectic behaviours. These findings are consistent with models in which interactions between cognition and reward are important in eliciting the anorectic "habit". A model is proposed which is consistent with elements of other theoretical frameworks, but differs in that its emphasis is towards neural overlaps between AN and addiction. It is consistent with AN being a reward-based learned behaviour in which aberrant cognitions related to eating and shape alter functioning of central reward systems. It proposes that the primary neural problem responsible for the development, maintenance, and treatment resistance is centred in the striatal reward system. This helps shift the emphasis of aetiological models towards reward processing, particularly in the context of illness-compatible cues. Furthermore, it suggests that continuing to explore the utility and valued nature of AN in the patient's life would be a useful inclusion in treatment and prevention models. Copyright © 2015. Published by Elsevier Ltd.

Willing to Wait: Elevated Reward-Processing EEG Activity Associated with a Greater Preference for Larger-But-Delayed Rewards

PubMed Central

Pornpattananangkul, Narun; Nusslock, Robin

2016-01-01

While almost everyone discounts the value of future rewards over immediate rewards, people differ in their so-called delay-discounting. One of the several factors that may explain individual differences in delay-discounting is reward-processing. To study individual-differences in reward-processing, however, one needs to consider the heterogeneity of neural-activity at each reward-processing stage. Here using EEG, we separated reward-related neural activity into distinct reward-anticipation and reward-outcome stages using time-frequency characteristics. Thirty-seven individuals completed a behavioral delay-discounting task. Reward-processing EEG activity was assessed using a separate reward-learning task, called a reward time-estimation task. During this task, participants were instructed to estimate time duration and were provided performance feedback on a trial-by-trial basis. Participants received monetary-reward for accurate-performance on Reward trials, but not on No-Reward trials. Reward trials, relative to No-Reward trials, enhanced EEG activity during both reward-anticipation stage (including, cued-locked delta power during cue-evaluation and pre-feedback alpha suppression during feedback-anticipation) and at the reward-outcome stage (including, feedback-locked delta, theta and beta power). Moreover, all of these EEG indices correlated with behavioral performance in the time-estimation task, suggesting their essential roles in learning and adjusting performance to maximize winnings in a reward-learning situation. Importantly, enhanced EEG power during Reward trials for 1) pre-feedback alpha suppression, 2) feedback-locked theta and 3) feedback-locked beta was associated with a greater preference for larger-but-delayed rewards. Results highlight the association between a stronger preference toward larger-but-delayed rewards and enhanced reward-processing. Moreover, our reward-processing EEG indices detail the specific stages of reward-processing where these associations occur. PMID:27477630

Neural Correlates of Impaired Reward-Effort Integration in Remitted Bulimia Nervosa.

PubMed

Mueller, Stefanie Verena; Morishima, Yosuke; Schwab, Simon; Wiest, Roland; Federspiel, Andrea; Hasler, Gregor

2018-03-01

The integration of reward magnitudes and effort costs is required for an effective behavioral guidance. This reward-effort integration was reported to be dependent on dopaminergic neurotransmission. As bulimia nervosa has been associated with a dysregulated dopamine system and catecholamine depletion led to reward-processing deficits in remitted bulimia nervosa, the purpose of this study was to identify the role of catecholamine dysfunction and its relation to behavioral and neural reward-effort integration in bulimia nervosa. To investigate the interaction between catecholamine functioning and behavioral, and neural responses directly, 17 remitted bulimic (rBN) and 21 healthy individuals (HC) received alpha-methyl-paratyrosine (AMPT) over 24 h to achieve catecholamine depletion in a randomized, crossover study design. We used functional magnetic resonance imaging (fMRI) and the monetary incentive delay (MID) task to assess reward-effort integration in relation to catecholaminergic neurotransmission at the behavioral and neural level. AMPT reduced the ability to integrate rewards and efforts effectively in HC participants. In contrast, in rBN participants, the reduced reward-effort integration was associated with illness duration in the sham condition and unrelated to catecholamine depletion. Regarding neural activation, AMPT decreased the reward anticipation-related neural activation in the anteroventral striatum. This decrease was associated with the AMPT-induced reduction of monetary earning in HC in contrast to rBN participants. Our findings contributed to the theory of a desensitized dopaminergic system in bulimia nervosa. A disrupted processing of reward magnitudes and effort costs might increase the probability of maintenance of bulimic symptoms.

Neural correlates of reward processing in adults with 22q11 deletion syndrome.

PubMed

van Duin, Esther D A; Goossens, Liesbet; Hernaus, Dennis; da Silva Alves, Fabiana; Schmitz, Nicole; Schruers, Koen; van Amelsvoort, Therese

2016-01-01

22q11.2 deletion syndrome (22q11DS) is caused by a microdeletion on chromosome 22q11.2 and associated with an increased risk to develop psychosis. The gene coding for catechol-O-methyl-transferase (COMT) is located at the deleted region, resulting in disrupted dopaminergic neurotransmission in 22q11DS, which may contribute to the increased vulnerability for psychosis. A dysfunctional motivational reward system is considered one of the salient features in psychosis and thought to be related to abnormal dopaminergic neurotransmission. The functional anatomy of the brain reward circuitry has not yet been investigated in 22q11DS. This study aims to investigate neural activity during anticipation of reward and loss in adult patients with 22q11DS. We measured blood-oxygen-level dependent (BOLD) activity in 16 patients with 22q11DS and 12 healthy controls during a monetary incentive delay task using a 3T Philips Intera MRI system. Data were analysed using SPM8. During anticipation of reward, the 22q11DS group alone displayed significant activation in bilateral middle frontal and temporal brain regions. Compared to healthy controls, significantly less activation in bilateral cingulate gyrus extending to premotor, primary motor and somatosensory areas was found. During anticipation of loss, the 22q11DS group displayed activity in the left middle frontal gyrus and anterior cingulate cortex, and relative to controls, they showed reduced brain activation in bilateral (pre)cuneus and left posterior cingulate. Within the 22q11DS group, COMT Val hemizygotes displayed more activation compared to Met hemizygotes in right posterior cingulate and bilateral parietal regions during anticipation of reward. During anticipation of loss, COMT Met hemizygotes compared to Val hemizygotes showed more activation in bilateral insula, striatum and left anterior cingulate. This is the first study to investigate reward processing in 22q11DS. Our preliminary results suggest that people with 22q11DS engage a fronto-temporal neural network. Compared to healthy controls, people with 22q11DS primarily displayed reduced activity in medial frontal regions during reward anticipation. COMT hemizygosity affects responsivity of the reward system in this condition. Alterations in reward processing partly underlain by the dopamine system may play a role in susceptibility for psychosis in 22q11DS.

The influence of motherhood on neural systems for reward processing in low income, minority, young women.

PubMed

Moses-Kolko, Eydie L; Forbes, Erika E; Stepp, Stephanie; Fraser, David; Keenan, Kate E; Guyer, Amanda E; Chase, Henry W; Phillips, Mary L; Zevallos, Carlos R; Guo, Chaohui; Hipwell, Alison E

2016-04-01

Given the association between maternal caregiving behavior and heightened neural reward activity in experimental animal studies, the present study examined whether motherhood in humans positively modulates reward-processing neural circuits, even among mothers exposed to various life stressors and depression. Subjects were 77 first-time mothers and 126 nulliparous young women from the Pittsburgh Girls Study, a longitudinal study beginning in childhood. Subjects underwent a monetary reward task during functional magnetic resonance imaging in addition to assessment of current depressive symptoms. Life stress was measured by averaging data collected between ages 8-15 years. Using a region-of-interest approach, we conducted hierarchical regression to examine the relationship of psychosocial factors (life stress and current depression) and motherhood with extracted ventral striatal (VST) response to reward anticipation. Whole-brain regression analyses were performed post-hoc to explore non-striatal regions associated with reward anticipation in mothers vs nulliparous women. Anticipation of monetary reward was associated with increased neural activity in expected regions including caudate, orbitofrontal, occipital, superior and middle frontal cortices. There was no main effect of motherhood nor motherhood-by-psychosocial factor interaction effect on VST response during reward anticipation. Depressive symptoms were associated with increased VST activity across the entire sample. In exploratory whole brain analysis, motherhood was associated with increased somatosensory cortex activity to reward (FWE cluster forming threshold p<0.001). These findings indicate that motherhood is not associated with reward anticipation-related VST activity nor does motherhood modulate the impact of depression or life stress on VST activity. Future studies are needed to evaluate whether earlier postpartum assessment of reward function, inclusion of mothers with more severe depressive symptoms, and use of reward tasks specific for social reward might reveal an impact of motherhood on reward system activity. Copyright © 2016 Elsevier Ltd. All rights reserved.

Cortisol alters reward processing in the human brain.

PubMed

Kinner, Valerie L; Wolf, Oliver T; Merz, Christian J

2016-08-01

Dysfunctional reward processing is known to play a central role for the development of psychiatric disorders. Glucocorticoids that are secreted in response to stress have been shown to attenuate reward sensitivity and thereby might promote the onset of psychopathology. However, the underlying neurobiological mechanisms mediating stress hormone effects on reward processing as well as potential sex differences remain elusive. In this neuroimaging study, we administered 30mg cortisol or a placebo to 30 men and 30 women and subsequently tested them in the Monetary Incentive Delay Task. Cortisol attenuated anticipatory neural responses to a verbal and a monetary reward in the left pallidum and the right anterior parahippocampal gyrus. Furthermore, in men, activation in the amygdala, the precuneus, the anterior cingulate, and in hippocampal regions was reduced under cortisol, whereas in cortisol-treated women a signal increase was observed in these regions. Behavioral performance also indicated that reward learning in men is impaired under high cortisol concentrations, while it is augmented in women. These findings illustrate that the stress hormone cortisol substantially diminishes reward anticipation and provide first evidence that cortisol effects on the neural reward system are sensitive to sex differences, which might translate into different vulnerabilities for psychiatric disorders. Copyright © 2016 Elsevier Inc. All rights reserved.

Brain reward system's alterations in response to food and monetary stimuli in overweight and obese individuals.

PubMed

Verdejo-Román, Juan; Vilar-López, Raquel; Navas, Juan F; Soriano-Mas, Carles; Verdejo-García, Antonio

2017-02-01

The brain's reward system is crucial to understand obesity in modern society, as increased neural responsivity to reward can fuel the unhealthy food choices that are driving the growing obesity epidemic. Brain's reward system responsivity to food and monetary rewards in individuals with excessive weight (overweight and obese) versus normal weight controls, along with the relationship between this responsivity and body mass index (BMI) were tested. The sample comprised 21 adults with obesity (BMI > 30), 21 with overweight (BMI between 25 and 30), and 39 with normal weight (BMI < 25). Participants underwent a functional magnetic resonance imaging (fMRI) session while performing two tasks that involve the processing of food (Willing to Pay) and monetary rewards (Monetary Incentive Delay). Neural activations within the brain reward system were compared across the three groups. Curve fit analyses were conducted to establish the association between BMI and brain reward system's response. Individuals with obesity had greater food-evoked responsivity in the dorsal and ventral striatum compared with overweight and normal weight groups. There was an inverted U-shape association between BMI and monetary-evoked responsivity in the ventral striatum, medial frontal cortex, and amygdala; that is, individuals with BMIs between 27 and 32 had greater responsivity to monetary stimuli. Obesity is associated with greater food-evoked responsivity in the ventral and dorsal striatum, and overweight is associated with greater monetary-evoked responsivity in the ventral striatum, the amygdala, and the medial frontal cortex. Findings suggest differential reactivity of the brain's reward system to food versus monetary rewards in obesity and overweight. Hum Brain Mapp 38:666-677, 2017. © 2016 Wiley Periodicals, Inc. © 2016 Wiley Periodicals, Inc.

Active and observational reward learning in adults with autism spectrum disorder: relationship with empathy in an atypical sample.

PubMed

Bellebaum, Christian; Brodmann, Katja; Thoma, Patrizia

2014-01-01

Autism spectrum disorders (ASDs) are characterised by disturbances in social behaviour. A prevailing hypothesis suggests that these problems are related to deficits in assigning rewarding value to social stimuli. The present study aimed to examine monetary reward processing in adults with ASDs by means of event-related potentials (ERPs). Ten individuals with mild ASDs (Asperger's syndrome and high-functioning autism) and 12 healthy control subjects performed an active and an observational probabilistic reward-learning task. Both groups showed similar overall learning performance. With respect to reward processing, subjects with ASDs exhibited a general reduction in feedback-related negativity (FRN) amplitude, irrespective of feedback valence and type of learning (active or observational). Individuals with ASDs showed lower scores for cognitive empathy, while affective empathy did not differ between groups. Correlation analyses revealed that higher empathy (both cognitive and affective) negatively affected performance in observational learning in controls and in active learning in ASDs (only cognitive empathy). No relationships were seen between empathy and ERPs. Reduced FRN amplitudes are discussed in terms of a deficit in fast reward processing in ASDs, which may indicate altered reward system functioning.

Advances in studying phasic dopamine signaling in brain reward mechanisms

PubMed Central

Wickham, Robert J.; Solecki, Wojciech; Rathbun, Liza R.; Neugebauer, Nichole M.; Wightman, R. Mark; Addy, Nii A.

2013-01-01

The last sixty years of research have provided extraordinary advances of our knowledge of the reward system. Since its initial discovery as a neurotransmitter by Carlsson and colleagues (Carlsson et al., 1957), dopamine (DA) has emerged as an important mediator of reward processing. As a result, a number of electrochemical techniques have been developed to directly measure DA levels in the brain using various preparations. Many of these techniques and preparations differ in the types of questions that they can address. Together, these techniques have begun to elucidate the complex roles of tonic and phasic DA signaling in reward processing and in addiction. In this review, we will first provide a guide for the most commonly used electrochemical methods for DA detection and describe their utility in furthering our knowledge about DA's role in reward and addiction. Second, we will review the value of common in vitro and in vivo preparations and describe their ability to address different types of questions. Last, we will review recent data that has provided new insight of the mechanisms of in vivo phasic DA signaling and its role in reward processing and reward-mediated behavior. PMID:23747914

Modulation of frontostriatal interaction aligns with reduced primary reward processing under serotonergic drugs.

PubMed

Abler, Birgit; Grön, Georg; Hartmann, Antonie; Metzger, Coraline; Walter, Martin

2012-01-25

Recently, functional interactions between anteroventral prefrontal cortex and nucleus accumbens (NAcc) have been shown to relate to behavior counteracting reward-desiring (Diekhof and Gruber, 2010). Downregulation of the reward system by serotonin has also been suggested as the mode of action accounting for unsatisfactory effects of serotonin reuptake inhibitors (SSRIs) such as insufficient alleviation or even increase of anhedonia, and loss of interest. However, understanding of the in vivo mechanisms of SSRI-related alteration of the human reward system is still incomplete. Using functional magnetic resonance imaging (fMRI) within a double-blind cross-over within-subjects study design and administering the SSRI paroxetine, the dopamine/norepinephrine reuptake inhibitor bupropione, and placebo for 7 d each, we investigated a group of 18 healthy male subjects. Under paroxetine, subjects showed significantly decreased activation of the bilateral NAcc during processing of primary rewards (erotic videos), but not under bupropion. Similar to the previous study, analysis of psychophysiological interactions revealed that this downregulation relied on negative interactions between left and right NAcc fMRI signals and the bilateral anteroventral prefrontal cortex that now were significantly enhanced under paroxetine and reduced under bupropion. Individual drug-dependent modulations of interacting brain regions were significantly associated with individual expressions of impulsivity as a personality trait. Our results corroborate and extend previous insights on interregional crosstalk from secondary to primary rewards and demonstrate parallels between active inhibitory control of and serotonergic effects on the dopaminergic reward system's activity.

Divergent Relationship of Depression Severity to Social Reward Responses Among Patients with Bipolar Versus Unipolar Depression

PubMed Central

Sharma, Anup; Satterthwaite, Theodore D.; Vandekar, Lillie; Katchmar, Natalie; Daldal, Aylin; Ruparel, Kosha; A.Elliott, Mark; Baldassano, Claudia; Thase, Michael E.; Gur, Raquel E.; Kable, Joseph W.; Wolf, Daniel H.

2016-01-01

Neuroimaging studies of mood disorders demonstrate abnormalities in brain regions implicated in reward processing. However, there is a paucity of research investigating how social rewards affect reward circuit activity in these disorders. Here, we evaluated the relationship of both diagnostic category and dimensional depression severity to reward system function in bipolar and unipolar depression. In total, 86 adults were included, including 24 patients with bipolar depression, 24 patients with unipolar depression, and 38 healthy comparison subjects. Participants completed a social reward task during 3T BOLD fMRI. On average, diagnostic groups did not differ in activation to social reward. However, greater depression severity significantly correlated with reduced bilateral ventral striatum activation to social reward in the bipolar depressed group, but not the unipolar depressed group. In addition, decreased left orbitofrontal cortical activation correlated with more severe symptoms in bipolar depression, but not unipolar depression. These differential dimensional effects resulted in a significant voxelwise group by depression severity interaction. Taken together, these results provide initial evidence that deficits in social reward processing are differentially related to depression severity in the two disorders. PMID:27295401

Reward processing in neurodegenerative disease

PubMed Central

Perry, David C.; Kramer, Joel H.

2015-01-01

Representation of reward value involves a distributed network including cortical and subcortical structures. Because neurodegenerative illnesses target specific anatomic networks that partially overlap with the reward circuit they would be predicted to have distinct impairments in reward processing. This review presents the existing evidence of reward processing changes in neurodegenerative diseases including mild cognitive impairment, Alzheimer's disease, frontotemporal dementia, amyotrophic lateral sclerosis, Parkinson's disease, and Huntington's disease, as well as in healthy aging. Carefully distinguishing the different aspects of reward processing (primary rewards, secondary rewards, reward-based learning, and reward-based decision-making) and using tasks that differentiate the stages of processing reward will lead to improved understanding of this fundamental process and clarify a contributing cause of behavioral change in these illnesses. PMID:24417286

Shared neural coding for social hierarchy and reward value in primate amygdala.

PubMed

Munuera, Jérôme; Rigotti, Mattia; Salzman, C Daniel

2018-03-01

The social brain hypothesis posits that dedicated neural systems process social information. In support of this, neurophysiological data have shown that some brain regions are specialized for representing faces. It remains unknown, however, whether distinct anatomical substrates also represent more complex social variables, such as the hierarchical rank of individuals within a social group. Here we show that the primate amygdala encodes the hierarchical rank of individuals in the same neuronal ensembles that encode the rewards associated with nonsocial stimuli. By contrast, orbitofrontal and anterior cingulate cortices lack strong representations of hierarchical rank while still representing reward values. These results challenge the conventional view that dedicated neural systems process social information. Instead, information about hierarchical rank-which contributes to the assessment of the social value of individuals within a group-is linked in the amygdala to representations of rewards associated with nonsocial stimuli.

The "highs and lows" of the human brain on dopaminergics: Evidence from neuropharmacology.

PubMed

Martins, Daniel; Mehta, Mitul A; Prata, Diana

2017-09-01

Rewards are appetitive events that elicit approach. Ground-breaking findings from neurophysiological experiments in animals, alongside neuropharmacology and neuroimaging research in human samples have identified dopamine as the main neurochemical messenger of global reward processing in the brain. However, dopamine's contribution to the different components of reward processing remains to be precisely defined. To facilitate the informed design and interpretation of reward studies in humans, we have systematically reviewed all existing human pharmacological studies investigating how drug manipulation of the dopamine system affects reward-related behaviour and its neural correlates. Pharmacological experiments in humans face methodological challenges in terms of the: 1) specificity and safety of the available drugs for administration in humans, 2) uncertainties about pre- or post-synaptic modes of action, and 3) possible interactions with inter-individual neuropsychological or genotypic variables. In order to circumvent some of these limitations, future research should rely on the combination of different levels of observation, in integrative pharmaco-genetics-neurobehavioral approaches, to more completely characterize dopamine's role in both general and modality-specific processing of reward. Copyright © 2017 Elsevier Ltd. All rights reserved.

Neural Reward Processing Mediates the Relationship between Insomnia Symptoms and Depression in Adolescence

PubMed Central

Casement, Melynda D.; Keenan, Kate E.; Hipwell, Alison E.; Guyer, Amanda E.; Forbes, Erika E.

2016-01-01

Study Objectives: Emerging evidence suggests that insomnia may disrupt reward-related brain function—a potentially important factor in the development of depressive disorder. Adolescence may be a period during which such disruption is especially problematic given the rise in the incidence of insomnia and ongoing development of neural systems that support reward processing. The present study uses longitudinal data to test the hypothesis that disruption of neural reward processing is a mechanism by which insomnia symptoms—including nocturnal insomnia symptoms (NIS) and nonrestorative sleep (NRS)—contribute to depressive symptoms in adolescent girls. Method: Participants were 123 adolescent girls and their caregivers from an ongoing longitudinal study of precursors to depression across adolescent development. NIS and NRS were assessed annually from ages 9 to 13 years. Girls completed a monetary reward task during a functional MRI scan at age 16 years. Depressive symptoms were assessed at ages 16 and 17 years. Multivariable regression tested the prospective associations between NIS and NRS, neural response during reward anticipation, and the mean number of depressive symptoms (omitting sleep problems). Results: NRS, but not NIS, during early adolescence was positively associated with late adolescent dorsal medial prefrontal cortex (dmPFC) response to reward anticipation and depressive symptoms. DMPFC response mediated the relationship between early adolescent NRS and late adolescent depressive symptoms. Conclusions: These results suggest that NRS may contribute to depression by disrupting reward processing via altered activity in a region of prefrontal cortex involved in affective control. The results also support the mechanistic differentiation of NIS and NRS. Citation: Casement MD, Keenan KE, Hipwell AE, Guyer AE, Forbes EE. Neural reward processing mediates the relationship between insomnia symptoms and depression in adolescence. SLEEP 2016;39(2):439–447. PMID:26350468

Goal-Directed and Habit-Like Modulations of Stimulus Processing during Reinforcement Learning.

PubMed

Luque, David; Beesley, Tom; Morris, Richard W; Jack, Bradley N; Griffiths, Oren; Whitford, Thomas J; Le Pelley, Mike E

2017-03-15

Recent research has shown that perceptual processing of stimuli previously associated with high-value rewards is automatically prioritized even when rewards are no longer available. It has been hypothesized that such reward-related modulation of stimulus salience is conceptually similar to an "attentional habit." Recording event-related potentials in humans during a reinforcement learning task, we show strong evidence in favor of this hypothesis. Resistance to outcome devaluation (the defining feature of a habit) was shown by the stimulus-locked P1 component, reflecting activity in the extrastriate visual cortex. Analysis at longer latencies revealed a positive component (corresponding to the P3b, from 550-700 ms) sensitive to outcome devaluation. Therefore, distinct spatiotemporal patterns of brain activity were observed corresponding to habitual and goal-directed processes. These results demonstrate that reinforcement learning engages both attentional habits and goal-directed processes in parallel. Consequences for brain and computational models of reinforcement learning are discussed. SIGNIFICANCE STATEMENT The human attentional network adapts to detect stimuli that predict important rewards. A recent hypothesis suggests that the visual cortex automatically prioritizes reward-related stimuli, driven by cached representations of reward value; that is, stimulus-response habits. Alternatively, the neural system may track the current value of the predicted outcome. Our results demonstrate for the first time that visual cortex activity is increased for reward-related stimuli even when the rewarding event is temporarily devalued. In contrast, longer-latency brain activity was specifically sensitive to transient changes in reward value. Therefore, we show that both habit-like attention and goal-directed processes occur in the same learning episode at different latencies. This result has important consequences for computational models of reinforcement learning. Copyright © 2017 the authors 0270-6474/17/373009-09$15.00/0.

Motivational orientation modulates the neural response to reward.

PubMed

Linke, Julia; Kirsch, Peter; King, Andrea V; Gass, Achim; Hennerici, Michael G; Bongers, André; Wessa, Michèle

2010-02-01

Motivational orientation defines the source of motivation for an individual to perform a particular action and can either originate from internal desires (e.g., interest) or external compensation (e.g., money). To this end, motivational orientation should influence the way positive or negative feedback is processed during learning situations and this might in turn have an impact on the learning process. In the present study, we thus investigated whether motivational orientation, i.e., extrinsic and intrinsic motivation modulates the neural response to reward and punishment as well as learning from reward and punishment in 33 healthy individuals. To assess neural responses to reward, punishment and learning of reward contingencies we employed a probabilistic reversal learning task during functional magnetic resonance imaging. Extrinsic and intrinsic motivation were assessed with a self-report questionnaire. Rewarding trials fostered activation in the medial orbitofrontal cortex and anterior cingulate gyrus (ACC) as well as the amygdala and nucleus accumbens, whereas for punishment an increased neural response was observed in the medial and inferior prefrontal cortex, the superior parietal cortex and the insula. High extrinsic motivation was positively correlated to increased neural responses to reward in the ACC, amygdala and putamen, whereas a negative relationship between intrinsic motivation and brain activation in these brain regions was observed. These findings show that motivational orientation indeed modulates the responsiveness to reward delivery in major components of the human reward system and therefore extends previous results showing a significant influence of individual differences in reward-related personality traits on the neural processing of reward. Copyright (c) 2009 Elsevier Inc. All rights reserved.

CLEANing the Reward: Counterfactual Actions to Remove Exploratory Action Noise in Multiagent Learning

NASA Technical Reports Server (NTRS)

HolmesParker, Chris; Taylor, Mathew E.; Tumer, Kagan; Agogino, Adrian

2014-01-01

Learning in multiagent systems can be slow because agents must learn both how to behave in a complex environment and how to account for the actions of other agents. The inability of an agent to distinguish between the true environmental dynamics and those caused by the stochastic exploratory actions of other agents creates noise in each agent's reward signal. This learning noise can have unforeseen and often undesirable effects on the resultant system performance. We define such noise as exploratory action noise, demonstrate the critical impact it can have on the learning process in multiagent settings, and introduce a reward structure to effectively remove such noise from each agent's reward signal. In particular, we introduce Coordinated Learning without Exploratory Action Noise (CLEAN) rewards and empirically demonstrate their benefits

Willing to wait: Elevated reward-processing EEG activity associated with a greater preference for larger-but-delayed rewards.

PubMed

Pornpattananangkul, Narun; Nusslock, Robin

2016-10-01

While almost everyone discounts the value of future rewards over immediate rewards, people differ in their so-called delay-discounting. One of the several factors that may explain individual differences in delay-discounting is reward-processing. To study individual-differences in reward-processing, however, one needs to consider the heterogeneity of neural-activity at each reward-processing stage. Here using EEG, we separated reward-related neural activity into distinct reward-anticipation and reward-outcome stages using time-frequency characteristics. Thirty-seven individuals first completed a behavioral delay-discounting task. Then reward-processing EEG activity was assessed using a separate reward-learning task, called a reward time-estimation task. During this EEG task, participants were instructed to estimate time duration and were provided performance feedback on a trial-by-trial basis. Participants received monetary-reward for accurate-performance on Reward trials, but not on No-Reward trials. Reward trials, relative to No-Reward trials, enhanced EEG activity during both reward-anticipation (including, cued-locked delta power during cue-evaluation and pre-feedback alpha suppression during feedback-anticipation) and reward-outcome (including, feedback-locked delta, theta and beta power) stages. Moreover, all of these EEG indices correlated with behavioral performance in the time-estimation task, suggesting their essential roles in learning and adjusting performance to maximize winnings in a reward-learning situation. Importantly, enhanced EEG power during Reward trials, as reflected by stronger 1) pre-feedback alpha suppression, 2) feedback-locked theta and 3) feedback-locked beta, was associated with a greater preference for larger-but-delayed rewards in a separate, behavioral delay-discounting task. Results highlight the association between a stronger preference toward larger-but-delayed rewards and enhanced reward-processing. Moreover, our reward-processing EEG indices detail the specific stages of reward-processing where these associations occur. Copyright © 2016 Elsevier Ltd. All rights reserved.

Anticipatory Reward Processing in Addicted Populations: A Focus on the Monetary Incentive Delay Task

PubMed Central

Balodis, Iris M.; Potenza, Marc N.

2014-01-01

Advances in brain imaging techniques have allowed neurobiological research to temporally analyze signals coding for the anticipation of rewards. In addicted populations, both hypo- and hyper-responsiveness of brain regions (e.g., ventral striatum) implicated in drug effects and reward system processing have been reported during anticipation of generalized reward. Here, we discuss the current state of knowledge of reward processing in addictive disorders from a widely used and validated task: the Monetary Incentive Delay Task (MIDT). The current paper constrains review to those studies applying the MIDT in addicted and at-risk adult populations, with a focus on anticipatory processing and striatal regions activated during task performance, as well as the relationship of these regions with individual difference (e.g., impulsivity) and treatment outcome variables. We further review drug influences in challenge studies as a means to examine acute influences on reward processing in abstinent, recreationally using and addicted populations. Here, we discuss that generalized reward processing in addicted and at-risk populations is often characterized by divergent anticipatory signaling in the ventral striatum. Although methodological/task variations may underlie some discrepant findings, anticipatory signaling in the ventral striatum may also be influenced by smoking status, drug metabolites and treatment status in addicted populations. Divergent results across abstinent, recreationally using and addicted populations demonstrate complexities in interpreting findings. Future studies will benefit from focusing on characterizing how impulsivity and other addiction-related features relate to anticipatory striatal signaling over time. Additionally, identifying how anticipatory signals recover/adjust following protracted abstinence will be important in understanding recovery processes. PMID:25481621

Review. Neurobiological mechanisms for opponent motivational processes in addiction.

PubMed

Koob, George F; Le Moal, Michel

2008-10-12

The conceptualization of drug addiction as a compulsive disorder with excessive drug intake and loss of control over intake requires motivational mechanisms. Opponent process as a motivational theory for the negative reinforcement of drug dependence has long required a neurobiological explanation. Key neurochemical elements involved in reward and stress within basal forebrain structures involving the ventral striatum and extended amygdala are hypothesized to be dysregulated in addiction to convey the opponent motivational processes that drive dependence. Specific neurochemical elements in these structures include not only decreases in reward neurotransmission such as dopamine and opioid peptides in the ventral striatum, but also recruitment of brain stress systems such as corticotropin-releasing factor (CRF), noradrenaline and dynorphin in the extended amygdala. Acute withdrawal from all major drugs of abuse produces increases in reward thresholds, anxiety-like responses and extracellular levels of CRF in the central nucleus of the amygdala. CRF receptor antagonists block excessive drug intake produced by dependence. A brain stress response system is hypothesized to be activated by acute excessive drug intake, to be sensitized during repeated withdrawal, to persist into protracted abstinence and to contribute to stress-induced relapse. The combination of loss of reward function and recruitment of brain stress systems provides a powerful neurochemical basis for the long hypothesized opponent motivational processes responsible for the negative reinforcement driving addiction.

Adolescent transformations of behavioral and neural processes as potential targets for prevention.

PubMed

Eldreth, Dana; Hardin, Michael G; Pavletic, Nevia; Ernst, Monique

2013-06-01

Adolescence is a transitional period in development that is marked by a distinct, typical behavioral profile of high rates of exploration, novelty-seeking, and emotional lability. While these behaviors generally assist the adolescent transition to independence, they can also confer vulnerability for excessive risk-taking and psychopathology, particularly in the context of specific environmental or genetic influences. As prevention research depends on the identification of targets of vulnerability, the following review will discuss the interplay among motivational systems including reward-related, avoidance-related, and regulatory processes in typical and atypical adolescent development. Each set of processes will be discussed in relation to their underlying neural correlates and distinct developmental trajectories. Evidence suggests that typical adolescent behavior and the risk for atypical development are mediated by heightened adolescent responsiveness of reward-related and avoidance-related systems under specific conditions, concurrent with poor modulation by immature regulatory processes. Finally, we will propose strategies to exploit heightened reward processing to reinforce inhibitory control, which is an essential component of regulatory processes in prevention interventions.

fMRI of alterations in reward selection, anticipation, and feedback in major depressive disorder.

PubMed

Smoski, Moria J; Felder, Jennifer; Bizzell, Joshua; Green, Steven R; Ernst, Monique; Lynch, Thomas R; Dichter, Gabriel S

2009-11-01

The purpose of the present investigation was to evaluate reward processing in unipolar major depressive disorder (MDD). Specifically, we investigated whether adults with MDD demonstrated hyporesponsivity in striatal brain regions and/or hyperresponsivity in cortical brain regions involved in conflict monitoring using a Wheel of Fortune task designed to probe responses during reward selection, reward anticipation, and reward feedback. Functional magnetic resonance imaging (fMRI) data indicated that the MDD group was characterized by reduced activation of striatal reward regions during reward selection, reward anticipation, and reward feedback, supporting previous data indicating hyporesponsivity of reward systems in MDD. Support was not found for hyperresponsivity of cognitive control regions during reward selection or reward anticipation. Instead, MDD participants showed hyperresponsivity in orbitofrontal cortex, a region associated with assessment of risk and reward, during reward selection, as well as decreased activation of the middle frontal gyrus and the rostral cingulate gyrus during reward selection and anticipation. Finally, depression severity was predicted by activation in bilateral midfrontal gyrus during reward selection. Results indicate that MDD is characterized by striatal hyporesponsivity, and that future studies of MDD treatments that seek to improve responses to rewarding stimuli should assess striatal functioning.

Topography, power, and current source density of θ oscillations during reward processing as markers for alcohol dependence.

PubMed

Kamarajan, Chella; Rangaswamy, Madhavi; Manz, Niklas; Chorlian, David B; Pandey, Ashwini K; Roopesh, Bangalore N; Porjesz, Bernice

2012-05-01

Recent studies have linked alcoholism with a dysfunctional neural reward system. Although several electrophysiological studies have explored reward processing in healthy individuals, such studies in alcohol-dependent individuals are quite rare. The present study examines theta oscillations during reward processing in abstinent alcoholics. The electroencephalogram (EEG) was recorded in 38 abstinent alcoholics and 38 healthy controls as they performed a single outcome gambling task, which involved outcomes of either loss or gain of an amount (10 or 50¢) that was bet. Event-related theta band (3.0-7.0 Hz) power following each outcome stimulus was computed using the S-transform method. Theta power at the time window of the outcome-related negativity (ORN) and positivity (ORP) (200-500 ms) was compared across groups and outcome conditions. Additionally, behavioral data of impulsivity and task performance were analyzed. The alcoholic group showed significantly decreased theta power during reward processing compared to controls. Current source density (CSD) maps of alcoholics revealed weaker and diffuse source activity for all conditions and weaker bilateral prefrontal sources during the Loss 50 condition when compared with controls who manifested stronger and focused midline sources. Furthermore, alcoholics exhibited increased impulsivity and risk-taking on the behavioral measures. A strong association between reduced anterior theta power and impulsive task-performance was observed. It is suggested that decreased power and weaker and diffuse CSD in alcoholics may be due to dysfunctional neural reward circuitry. The relationship among alcoholism, theta oscillations, reward processing, and impulsivity could offer clues to understand brain circuitries that mediate reward processing and inhibitory control. Copyright © 2011 Wiley-Liss, Inc.

Topography, Power and Current Source Density of Theta Oscillations during Reward Processing as Markers for Alcohol Dependence

PubMed Central

Kamarajan, Chella; Rangaswamy, Madhavi; Manz, Niklas; Chorlian, David B.; Pandey, Ashwini K.; Roopesh, Bangalore N.; Porjesz, Bernice

2013-01-01

Recent studies have linked alcoholism with a dysfunctional neural reward system. Although several electrophysiological studies have explored reward processing in healthy individuals, such studies in alcohol dependent individuals are quite rare. The present study examines theta oscillations during reward processing in abstinent alcoholics. The electroencephalogram (EEG) was recorded in 38 abstinent alcoholics and 38 healthy controls as they performed a single outcome gambling task which involved outcomes of either loss or gain of an amount (10¢ or 50¢) that was bet. Event-related theta band (3.0–7.0 Hz) power following each outcome stimulus was computed using the S-transform method. Theta power at the time window of the outcome-related negativity (ORN) and positivity (ORP) (200–500 ms) was compared across groups and outcome conditions. Additionally, behavioral data of impulsivity and task performance were analyzed. The alcoholic group showed significantly decreased theta power during reward processing compared to controls. Current Source Density (CSD) maps of alcoholics revealed weaker and diffuse source activity for all conditions and weaker bilateral prefrontal sources during the Loss 50 condition as compared to controls who manifested stronger and focused midline sources. Further, alcoholics exhibited increased impulsivity and risk-taking on the behavioral measures. A strong association between reduced anterior theta power and impulsive task-performance was observed. It is suggested that decreased power and weaker and diffuse CSD in alcoholics may be due to dysfunctional neural reward circuitry. The relationship among alcoholism, theta oscillations, reward processing and impulsivity could offer clues to understand brain circuitries that mediate reward processing and inhibitory control. PMID:21520344

Early Parenting Moderates the Association between Parental Depression and Neural Reactivity to Rewards and Losses in Offspring.

PubMed

Kujawa, Autumn; Proudfit, Greg H; Laptook, Rebecca; Klein, Daniel N

2015-07-01

Children of parents with depression exhibit neural abnormalities in reward processing. Examining contributions of parenting could provide insight into the development of these abnormalities and to the etiology of depression. We evaluated whether early parenting moderates the effects of parental depression on a neural measure of reward and loss processing in mid-late childhood. Parenting was assessed when children were preschoolers. At age nine, children completed an event-related potential assessment and the feedback negativity (FN) was measured following rewards and losses ( N =344). Maternal authoritative parenting moderated the effect of maternal depression; among offspring of mothers with histories of depression, low authoritative parenting predicted a blunted FN. Observed maternal positive parenting interacted with paternal depression in a comparable manner, indicating that maternal parenting may buffer the effects of paternal depression. Early parenting may be important in shaping the neural systems involved in reward processing among children at high risk for depression.

Early Parenting Moderates the Association between Parental Depression and Neural Reactivity to Rewards and Losses in Offspring

PubMed Central

Kujawa, Autumn; Proudfit, Greg H.; Laptook, Rebecca; Klein, Daniel N.

2014-01-01

Children of parents with depression exhibit neural abnormalities in reward processing. Examining contributions of parenting could provide insight into the development of these abnormalities and to the etiology of depression. We evaluated whether early parenting moderates the effects of parental depression on a neural measure of reward and loss processing in mid-late childhood. Parenting was assessed when children were preschoolers. At age nine, children completed an event-related potential assessment and the feedback negativity (FN) was measured following rewards and losses (N=344). Maternal authoritative parenting moderated the effect of maternal depression; among offspring of mothers with histories of depression, low authoritative parenting predicted a blunted FN. Observed maternal positive parenting interacted with paternal depression in a comparable manner, indicating that maternal parenting may buffer the effects of paternal depression. Early parenting may be important in shaping the neural systems involved in reward processing among children at high risk for depression. PMID:26167423

Chronic motivational state interacts with task reward structure in dynamic decision-making.

PubMed

Cooper, Jessica A; Worthy, Darrell A; Maddox, W Todd

2015-12-01

Research distinguishes between a habitual, model-free system motivated toward immediately rewarding actions, and a goal-directed, model-based system motivated toward actions that improve future state. We examined the balance of processing in these two systems during state-based decision-making. We tested a regulatory fit hypothesis (Maddox & Markman, 2010) that predicts that global trait motivation affects the balance of habitual- vs. goal-directed processing but only through its interaction with the task framing as gain-maximization or loss-minimization. We found support for the hypothesis that a match between an individual's chronic motivational state and the task framing enhances goal-directed processing, and thus state-based decision-making. Specifically, chronic promotion-focused individuals under gain-maximization and chronic prevention-focused individuals under loss-minimization both showed enhanced state-based decision-making. Computational modeling indicates that individuals in a match between global chronic motivational state and local task reward structure engaged more goal-directed processing, whereas those in a mismatch engaged more habitual processing. Copyright © 2015 Elsevier Inc. All rights reserved.

Evidences from Rewarding System, FRN and P300 Effect in Internet-Addiction in Young People SHORT TITLE: Rewarding System and EEG in Internet-Addiction

PubMed Central

Venturella, Irene; Finocchiaro, Roberta

2017-01-01

The present research explored rewarding bias and attentional deficits in Internet addiction (IA) based on the IAT (Internet Addiction Test) construct, during an attentional inhibitory task (Go/NoGo task). Event-related Potentials (ERPs) effects (Feedback Related Negativity (FRN) and P300) were monitored in concomitance with Behavioral Activation System (BAS) modulation. High-IAT young participants showed specific responses to IA-related cues (videos representing online gambling and videogames) in terms of cognitive performance (decreased Response Times, RTs; and Error Rates, ERs) and ERPs modulation (decreased FRN and increased P300). Consistent reward and attentional biases was adduced to explain the cognitive “gain” effect and the anomalous response in terms of both feedback behavior (FRN) and attentional (P300) mechanisms in high-IAT. In addition, BAS and BAS-Reward subscales measures were correlated with both IAT and ERPs variations. Therefore, high sensitivity to IAT may be considered as a marker of dysfunctional reward processing (reduction of monitoring) and cognitive control (higher attentional values) for specific IA-related cues. More generally, a direct relationship among reward-related behavior, Internet addiction and BAS attitude was suggested. PMID:28704978

Motivated To Win: Relationship between Anticipatory and Outcome Reward-Related Neural Activity

PubMed Central

Nusslock, Robin

2015-01-01

Reward-processing involves two temporal stages characterized by two distinct neural processes: reward-anticipation and reward-outcome. Intriguingly, very little research has examined the relationship between neural processes involved in reward-anticipation and reward-outcome. To investigate this, one needs to consider the heterogeneity of reward-processing within each stage. To identify different stages of reward processing, we adapted a reward time-estimation task. While EEG data were recorded, participants were instructed to button-press 3.5 s after the onset of an Anticipation-Cue and received monetary reward for good time-estimation on the Reward trials, but not on No-Reward trials. We first separated reward-anticipation into event related potentials (ERPs) occurring at three sub-stages: reward/no-reward cue-evaluation, motor-preparation and feedback-anticipation. During reward/no-reward cue-evaluation, the Reward-Anticipation Cue led to a smaller N2 and larger P3. During motor-preparation, we report, for the first time, that the Reward-Anticipation Cue enhanced the Readiness Potential (RP), starting approximately 1 s before movement. At the subsequent feedback-anticipation stage, the Reward-Anticipation Cue elevated the Stimulus-Preceding Negativity (SPN). We also separated reward-outcome ERPs into different components occurring at different time-windows: the Feedback-Related Negativity (FRN), Feedback-P3 (FB-P3) and Late-Positive Potentials (LPP). Lastly, we examined the relationship between reward-anticipation and reward-outcome ERPs. We report that individual-differences in specific reward-anticipation ERPs uniquely predicted specific reward-outcome ERPs. In particular, the reward-anticipation Early-RP (1 to .8 s before movement) predicted early reward-outcome ERPs (FRN and FB-P3), whereas, the reward-anticipation SPN most strongly predicted a later reward-outcome ERP (LPP). Results have important implications for understanding the nature of the relationship between reward-anticipation and reward-outcome neural-processes. PMID:26433773

Dissociated roles of the anterior cingulate cortex in reward and conflict processing as revealed by the feedback error-related negativity and N200.

PubMed

Baker, Travis E; Holroyd, Clay B

2011-04-01

The reinforcement learning theory of the error-related negativity (ERN) holds that the impact of reward signals carried by the midbrain dopamine system modulates activity of the anterior cingulate cortex (ACC), alternatively disinhibiting and inhibiting the ACC following unpredicted error and reward events, respectively. According to a recent formulation of the theory, activity that is intrinsic to the ACC produces a component of the event-related brain potential (ERP) called the N200, and following unpredicted rewards, the N200 is suppressed by extrinsically applied positive dopamine reward signals, resulting in an ERP component called the feedback-ERN (fERN). Here we demonstrate that, despite extensive spatial and temporal overlap between the two ERP components, the functional processes indexed by the N200 (conflict) and the fERN (reward) are dissociable. These results point toward avenues for future investigation. Copyright © 2011 Elsevier B.V. All rights reserved.

Stress and reward processing in bipolar disorder: an fMRI study

PubMed Central

Berghorst, Lisa H; Kumar, Poornima; Greve, Doug N; Deckersbach, Thilo; Ongur, Dost; Dutra, Sunny; Pizzagalli, Diego A

2016-01-01

Objectives A link between negative life stress and the onset of mood episodes in bipolar disorder (BD) has been established, but processes underlying such a link remain unclear. Growing evidence suggests that stress can negatively affect reward processing and related neurobiological substrates, indicating that a dysregulated reward system may provide a partial explanation. The aim of this study was to test the impact of stress on reward-related neural functioning in BD. Methods Thirteen euthymic or mildly depressed individuals with BD and 15 controls performed a Monetary Incentive Delay task while undergoing functional magnetic resonance imaging during no-stress and stress (negative psychosocial stressor involving poor performance feedback and threat of monetary deductions) conditions. Results In hypothesis-driven region-of- interest-based analyses, a significant group by condition interaction emerged in the amygdala during reward anticipation. Relative to controls, while anticipating a potential reward, subjects with BD were characterized by amygdalar hyperactivation in the no-stress condition but hypoactivation during stress. Moreover, relative to controls, subjects with BD had significantly larger amygdala volumes. After controlling for structural differences, the effects of stress on amygdalar function remained, whereas groups no longer differed during the no-stress condition. During reward consumption, a group by condition interaction emerged in the putamen due to increased putamen activation to rewards in participants with BD during stress, but an opposite pattern in controls. Conclusions Overall, findings highlight possible impairments in using reward-predicting cues to adaptively engage in goal-directed actions in BD, combined with stress-induced hypersensitivity to reward consumption. Potential clinical implications are discussed. PMID:27870507

Perceived ownership impacts reward evaluation within medial-frontal cortex.

PubMed

Krigolson, Olave E; Hassall, Cameron D; Balcom, Lynsey; Turk, David

2013-06-01

Ownership is a powerful construct. Indeed, in a series of recent studies, perceived ownership has been shown to increase attentional capacity, facilitate a memorial advantage, and elicit positive attitudes. Here, we sought to determine whether self-relevance would bias reward evaluation systems within the brain. To accomplish this, we had participants complete a simple gambling task during which they could "win" or "lose" prizes for themselves or for someone else, while electroencephalographic data were recorded. Our results indicated that the amplitude of the feedback error-related negativity, a component of the event-related brain potential sensitive to reward evaluation, was diminished when participants were not gambling for themselves. Furthermore, our data suggest that the ownership cues that indicated who would win or lose a given gamble either were processed as a potential for an increase in utility (i.e., gain: self-gambles) or were processed in a nonutilitarian manner (other-gambles). Importantly, our results suggest that the medial-frontal reward system is sensitive to perceived ownership, to the extent that it may not process changes in utility when they are not directly relevant to self.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Volkow N. D.; Wang G.; Volkow, N.D.

The ability to resist the urge to eat requires the proper functioning of neuronal circuits involved in top-down control to oppose the conditioned responses that predict reward from eating the food and the desire to eat the food. Imaging studies show that obese subjects might have impairments in dopaminergic pathways that regulate neuronal systems associated with reward sensitivity, conditioning and control. It is known that the neuropeptides that regulate energy balance (homeostatic processes) through the hypothalamus also modulate the activity of dopamine cells and their projections into regions involved in the rewarding processes underlying food intake. It is postulated thatmore » this could also be a mechanism by which overeating and the resultant resistance to homoeostatic signals impairs the function of circuits involved in reward sensitivity, conditioning and cognitive control.« less

Cannabinoid transmission in the prelimbic cortex bidirectionally controls opiate reward and aversion signaling through dissociable kappa versus μ-opiate receptor dependent mechanisms.

PubMed

Ahmad, Tasha; Lauzon, Nicole M; de Jaeger, Xavier; Laviolette, Steven R

2013-09-25

Cannabinoid, dopamine (DA), and opiate receptor pathways play integrative roles in emotional learning, associative memory, and sensory perception. Modulation of cannabinoid CB1 receptor transmission within the medial prefrontal cortex (mPFC) regulates the emotional valence of both rewarding and aversive experiences. Furthermore, CB1 receptor substrates functionally interact with opiate-related motivational processing circuits, particularly in the context of reward-related learning and memory. Considerable evidence demonstrates functional interactions between CB1 and DA signaling pathways during the processing of motivationally salient information. However, the role of mPFC CB1 receptor transmission in the modulation of behavioral opiate-reward processing is not currently known. Using an unbiased conditioned place preference paradigm with rats, we examined the role of intra-mPFC CB1 transmission during opiate reward learning. We report that activation or inhibition of CB1 transmission within the prelimbic cortical (PLC) division of the mPFC bidirectionally regulates the motivational valence of opiates; whereas CB1 activation switched morphine reward signaling into an aversive stimulus, blockade of CB1 transmission potentiated the rewarding properties of normally sub-reward threshold conditioning doses of morphine. Both of these effects were dependent upon DA transmission as systemic blockade of DAergic transmission prevented CB1-dependent modulation of morphine reward and aversion behaviors. We further report that CB1-mediated intra-PLC opiate motivational signaling is mediated through a μ-opiate receptor-dependent reward pathway, or a κ-opiate receptor-dependent aversion pathway, directly within the ventral tegmental area. Our results provide evidence for a novel CB1-mediated motivational valence switching mechanism within the PLC, controlling dissociable subcortical reward and aversion pathways.

Brain connectivity reflects human aesthetic responses to music

PubMed Central

Sachs, Matthew E.; Ellis, Robert J.; Schlaug, Gottfried

2016-01-01

Abstract Humans uniquely appreciate aesthetics, experiencing pleasurable responses to complex stimuli that confer no clear intrinsic value for survival. However, substantial variability exists in the frequency and specificity of aesthetic responses. While pleasure from aesthetics is attributed to the neural circuitry for reward, what accounts for individual differences in aesthetic reward sensitivity remains unclear. Using a combination of survey data, behavioral and psychophysiological measures and diffusion tensor imaging, we found that white matter connectivity between sensory processing areas in the superior temporal gyrus and emotional and social processing areas in the insula and medial prefrontal cortex explains individual differences in reward sensitivity to music. Our findings provide the first evidence for a neural basis of individual differences in sensory access to the reward system, and suggest that social–emotional communication through the auditory channel may offer an evolutionary basis for music making as an aesthetically rewarding function in humans. PMID:26966157

Anticipatory reward processing in addicted populations: a focus on the monetary incentive delay task.

PubMed

Balodis, Iris M; Potenza, Marc N

2015-03-01

Advances in brain imaging techniques have allowed neurobiological research to temporally analyze signals coding for the anticipation of reward. In addicted populations, both hyporesponsiveness and hyperresponsiveness of brain regions (e.g., ventral striatum) implicated in drug effects and reward system processing have been reported during anticipation of generalized reward. We discuss the current state of knowledge of reward processing in addictive disorders from a widely used and validated task: the monetary incentive delay task. Only studies applying the monetary incentive delay task in addicted and at-risk adult populations are reviewed, with a focus on anticipatory processing and striatal regions activated during task performance as well as the relationship of these regions with individual difference (e.g., impulsivity) and treatment outcome variables. We further review drug influences in challenge studies as a means to examine acute influences on reward processing in abstinent, recreationally using, and addicted populations. Generalized reward processing in addicted and at-risk populations is often characterized by divergent anticipatory signaling in the ventral striatum. Although methodologic and task variations may underlie some discrepant findings, anticipatory signaling in the ventral striatum may also be influenced by smoking status, drug metabolites, and treatment status in addicted populations. Divergent results across abstinent, recreationally using, and addicted populations demonstrate complexities in interpreting findings. Future studies would benefit from focusing on characterizing how impulsivity and other addiction-related features relate to anticipatory striatal signaling over time. Additionally, identifying how anticipatory signals recover or adjust after protracted abstinence will be important in understanding recovery processes. Copyright © 2015 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

The impact of cognitive load on reward evaluation.

PubMed

Krigolson, Olave E; Hassall, Cameron D; Satel, Jason; Klein, Raymond M

2015-11-19

The neural systems that afford our ability to evaluate rewards and punishments are impacted by a variety of external factors. Here, we demonstrate that increased cognitive load reduces the functional efficacy of a reward processing system within the human medial-frontal cortex. In our paradigm, two groups of participants used performance feedback to estimate the exact duration of one second while electroencephalographic (EEG) data was recorded. Prior to performing the time estimation task, both groups were instructed to keep their eyes still and avoid blinking in line with well established EEG protocol. However, during performance of the time-estimation task, one of the two groups was provided with trial-to-trial-feedback about their performance on the time-estimation task and their eye movements to induce a higher level of cognitive load relative to participants in the other group who were solely provided with feedback about the accuracy of their temporal estimates. In line with previous work, we found that the higher level of cognitive load reduced the amplitude of the feedback-related negativity, a component of the human event-related brain potential associated with reward evaluation within the medial-frontal cortex. Importantly, our results provide further support that increased cognitive load reduces the functional efficacy of a neural system associated with reward processing. Copyright © 2015 Elsevier B.V. All rights reserved.

Reward processing in the value-driven attention network: reward signals tracking cue identity and location.

PubMed

Anderson, Brian A

2017-03-01

Through associative reward learning, arbitrary cues acquire the ability to automatically capture visual attention. Previous studies have examined the neural correlates of value-driven attentional orienting, revealing elevated activity within a network of brain regions encompassing the visual corticostriatal loop [caudate tail, lateral occipital complex (LOC) and early visual cortex] and intraparietal sulcus (IPS). Such attentional priority signals raise a broader question concerning how visual signals are combined with reward signals during learning to create a representation that is sensitive to the confluence of the two. This study examines reward signals during the cued reward training phase commonly used to generate value-driven attentional biases. High, compared with low, reward feedback preferentially activated the value-driven attention network, in addition to regions typically implicated in reward processing. Further examination of these reward signals within the visual system revealed information about the identity of the preceding cue in the caudate tail and LOC, and information about the location of the preceding cue in IPS, while early visual cortex represented both location and identity. The results reveal teaching signals within the value-driven attention network during associative reward learning, and further suggest functional specialization within different regions of this network during the acquisition of an integrated representation of stimulus value. © The Author (2016). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Peril and Pleasure: An RDoC-inspired examination of threat responses and reward processing in anxiety and depression

PubMed Central

Dillon, Daniel G.; Rosso, Isabelle M.; Pechtel, Pia; Killgore, William D. S.; Rauch, Scott L.; Pizzagalli, Diego A.

2014-01-01

As a step toward addressing limitations in the current psychiatric diagnostic system, the NIMH recently developed the Research Domain Criteria (RDoC) to stimulate integrative research—spanning self-report, behavior, neural circuitry, and molecular/genetic mechanisms—on core psychological processes implicated in mental illness. Here, we use the RDoC conceptualization to review research on threat responses, reward processing, and their interaction. The first section of the manuscript highlights the pivotal role of exaggerated threat responses—mediated by circuits connecting the frontal cortex, amygdala, and midbrain—in anxiety, and reviews data indicating that genotypic variation in the serotonin system is associated with hyperactivity in this circuitry, which elevates the risk for anxiety and mood disorders. In the second section, we describe mounting evidence linking anhedonic behavior to deficits in psychological functions that rely heavily on dopamine signaling, especially cost/benefit decision-making and reward learning. The third section covers recent studies that document negative effects of acute threats and chronic stress on reward responses in humans. The mechanisms underlying such effects are unclear, but new optogenetic data in rodents indicate that GABAergic inhibition of midbrain dopamine neurons, driven by activation of the habenula, may play a fundamental role in stress-induced anhedonia. In addition to its basic scientific value, a better understanding of interactions between the neural systems that mediate threat and reward responses may offer relief from the burdensome condition of anxious depression. PMID:24151118

Neural Reward Processing Mediates the Relationship between Insomnia Symptoms and Depression in Adolescence.

PubMed

Casement, Melynda D; Keenan, Kate E; Hipwell, Alison E; Guyer, Amanda E; Forbes, Erika E

2016-02-01

Emerging evidence suggests that insomnia may disrupt reward-related brain function-a potentially important factor in the development of depressive disorder. Adolescence may be a period during which such disruption is especially problematic given the rise in the incidence of insomnia and ongoing development of neural systems that support reward processing. The present study uses longitudinal data to test the hypothesis that disruption of neural reward processing is a mechanism by which insomnia symptoms-including nocturnal insomnia symptoms (NIS) and nonrestorative sleep (NRS)-contribute to depressive symptoms in adolescent girls. Participants were 123 adolescent girls and their caregivers from an ongoing longitudinal study of precursors to depression across adolescent development. NIS and NRS were assessed annually from ages 9 to 13 years. Girls completed a monetary reward task during a functional MRI scan at age 16 years. Depressive symptoms were assessed at ages 16 and 17 years. Multivariable regression tested the prospective associations between NIS and NRS, neural response during reward anticipation, and the mean number of depressive symptoms (omitting sleep problems). NRS, but not NIS, during early adolescence was positively associated with late adolescent dorsal medial prefrontal cortex (dmPFC) response to reward anticipation and depressive symptoms. DMPFC response mediated the relationship between early adolescent NRS and late adolescent depressive symptoms. These results suggest that NRS may contribute to depression by disrupting reward processing via altered activity in a region of prefrontal cortex involved in affective control. The results also support the mechanistic differentiation of NIS and NRS. © 2016 Associated Professional Sleep Societies, LLC.

Reward System Activation in Response to Alcohol Advertisements Predicts College Drinking.

PubMed

Courtney, Andrea L; Rapuano, Kristina M; Sargent, James D; Heatherton, Todd F; Kelley, William M

2018-01-01

In this study, we assess whether activation of the brain's reward system in response to alcohol advertisements is associated with college drinking. Previous research has established a relationship between exposure to alcohol marketing and underage drinking. Within other appetitive domains, the relationship between cue exposure and behavioral enactment is known to rely on activation of the brain's reward system. However, the relationship between neural activation to alcohol advertisements and alcohol consumption has not been studied in a nondisordered population. In this cross-sectional study, 53 college students (32 women) completed a functional magnetic resonance imaging scan while viewing alcohol, food, and control (car and technology) advertisements. Afterward, they completed a survey about their alcohol consumption (including frequency of drinking, typical number of drinks consumed, and frequency of binge drinking) over the previous month. In 43 participants (24 women) meeting inclusion criteria, viewing alcohol advertisements elicited activation in the left orbitofrontal cortex and bilateral ventral striatum-regions of the reward system that typically activate to other appetitive rewards and relate to consumption behaviors. Moreover, the level of self-reported drinking correlated with the magnitude of activation in the left orbitofrontal cortex. Results suggest that alcohol cues are processed within the reward system in a way that may motivate drinking behavior.

A biased activation theory of the cognitive and attentional modulation of emotion.

PubMed

Rolls, Edmund T

2013-01-01

Cognition can influence emotion by biasing neural activity in the first cortical region in which the reward value and subjective pleasantness of stimuli is made explicit in the representation, the orbitofrontal cortex (OFC). The same effect occurs in a second cortical tier for emotion, the anterior cingulate cortex (ACC). Similar effects are found for selective attention, to for example the pleasantness vs. the intensity of stimuli, which modulates representations of reward value and affect in the orbitofrontal and anterior cingulate cortices. The mechanisms for the effects of cognition and attention on emotion are top-down biased competition and top-down biased activation. Affective and mood states can in turn influence memory and perception, by backprojected biasing influences. Emotion-related decision systems operate to choose between gene-specified rewards such as taste, touch, and beauty. Reasoning processes capable of planning ahead with multiple steps held in working memory in the explicit system can allow the gene-specified rewards not to be selected, or to be deferred. The stochastic, noisy, dynamics of decision-making systems in the brain may influence whether decisions are made by the selfish-gene-specified reward emotion system, or by the cognitive reasoning system that explicitly calculates reward values that are in the interests of the individual, the phenotype.

Changes in reward-induced brain activation in opiate addicts.

PubMed

Martin-Soelch, C; Chevalley, A F; Künig, G; Missimer, J; Magyar, S; Mino, A; Schultz, W; Leenders, K L

2001-10-01

Many studies indicate a role of the cerebral dopaminergic reward system in addiction. Motivated by these findings, we examined in opiate addicts whether brain regions involved in the reward circuitry also react to human prototypical rewards. We measured regional cerebral blood flow (rCBF) with H(2)(15)O positron emission tomography (PET) during a visuo-spatial recognition task with delayed response in control subjects and in opiate addicts participating in a methadone program. Three conditions were defined by the types of feedback: nonsense feedback; nonmonetary reinforcement; or monetary reward, received by the subjects for a correct response. We found in the control subjects rCBF increases in regions associated with the meso-striatal and meso-corticolimbic circuits in response to both monetary reward and nonmonetary reinforcement. In opiate addicts, these regions were activated only in response to monetary reward. Furthermore, nonmonetary reinforcement elicited rCBF increases in limbic regions of the opiate addicts that were not activated in the control subjects. Because psychoactive drugs serve as rewards and directly affect regions of the dopaminergic system like the striatum, we conclude that the differences in rCBF increases between controls and addicts can be attributed to an adaptive consequence of the addiction process.

Amygdala mu-opioid receptors mediate the motivating influence of cue-triggered reward expectations.

PubMed

Lichtenberg, Nina T; Wassum, Kate M

2017-02-01

Environmental reward-predictive stimuli can retrieve from memory a specific reward expectation that allows them to motivate action and guide choice. This process requires the basolateral amygdala (BLA), but little is known about the signaling systems necessary within this structure. Here we examined the role of the neuromodulatory opioid receptor system in the BLA in such cue-directed action using the outcome-specific Pavlovian-to-instrumental transfer (PIT) test in rats. Inactivation of BLA mu-, but not delta-opioid receptors was found to dose-dependently attenuate the ability of a reward-predictive cue to selectively invigorate the performance of actions directed at the same unique predicted reward (i.e. to express outcome-specific PIT). BLA mu-opioid receptor inactivation did not affect the ability of a reward itself to similarly motivate action (outcome-specific reinstatement), suggesting a more selective role for the BLA mu-opioid receptor in the motivating influence of currently unobservable rewarding events. These data reveal a new role for BLA mu-opioid receptor activation in the cued recall of precise reward memories and the use of this information to motivate specific action plans. © 2016 Federation of European Neuroscience Societies and John Wiley & Sons Ltd.

Effects of selective serotonin reuptake inhibition on neural activity related to risky decisions and monetary rewards in healthy males.

PubMed

Macoveanu, Julian; Fisher, Patrick M; Haahr, Mette E; Frokjaer, Vibe G; Knudsen, Gitte M; Siebner, Hartwig R

2014-10-01

Selective serotonin reuptake inhibitors (SSRIs) such as fluoxetine are commonly prescribed antidepressant drugs targeting the dysfunctional serotonin (5-HT) system, yet little is known about the functional effects of prolonged serotonin reuptake inhibition in healthy individuals. Here we used functional MRI (fMRI) to investigate how a three-week fluoxetine intervention influences neural activity related to risk taking and reward processing. Employing a double-blinded parallel-group design, 29 healthy young males were randomly assigned to receive 3 weeks of a daily dose of 40 mg fluoxetine or placebo. Participants underwent task-related fMRI prior to and after the three-week intervention while performing a card gambling task. The task required participants to choose between two decks of cards. Choices were associated with different risk levels and potential reward magnitudes. Relative to placebo, the SSRI intervention did not alter individual risk-choice preferences, but modified neural activity during decision-making and reward processing: During the choice phase, SSRI reduced the neural response to increasing risk in lateral orbitofrontal cortex, a key structure for value-based decision-making. During the outcome phase, a midbrain region showed an independent decrease in the responsiveness to rewarding outcomes. This midbrain cluster included the raphe nuclei from which serotonergic modulatory projections originate to both cortical and subcortical regions. The findings corroborate the involvement of the normally functioning 5HT-system in decision-making under risk and processing of monetary rewards. The data suggest that prolonged SSRI treatment might reduce emotional engagement by reducing the impact of risk during decision-making or the impact of reward during outcome evaluation. Copyright © 2014 Elsevier Inc. All rights reserved.

Dopamine receptor blockade attenuates the general incentive motivational effects of noncontingently delivered rewards and reward-paired cues without affecting their ability to bias action selection.

PubMed

Ostlund, Sean B; Maidment, Nigel T

2012-01-01

Environmental cues affect our behavior in a variety of ways. Despite playing an invaluable role in guiding our daily activities, such cues also appear to trigger the harmful, compulsive behaviors that characterize addiction and other disorders of behavioral control. In instrumental conditioning, rewards and reward-paired cues bias action selection and invigorate reward-seeking behaviors, and appear to do so through distinct neurobehavioral processes. Although reward-paired cues are known to invigorate performance through a dopamine-dependent incentive motivational process, it is not known if dopamine also mediates the influence of rewards and reward-paired cues over action selection. The current study contrasted the effects of systemic administration of the nonspecific dopamine receptor antagonist flupentixol on response invigoration and action bias in Pavlovian-instrumental transfer, a test of cue-elicited responding, and in instrumental reinstatement, a test of noncontingent reward-elicited responding. Hungry rats were trained on two different stimulus-outcome relationships (eg, tone-grain pellets and noise-sucrose solution) and two different action-outcome relationships (eg, left press-grain and right press-sucrose). At test, we found that flupentixol pretreatment blocked the response invigoration generated by the cues but spared their ability to bias action selection to favor the action whose outcome was signaled by the cue being presented. The response-biasing influence of noncontingent reward deliveries was also unaffected by flupentixol. Interestingly, although flupentixol had a modest effect on the immediate response invigoration produced by those rewards, it was particularly potent in countering the lingering enhancement of responding produced by multiple reward deliveries. These findings indicate that dopamine mediates the general incentive motivational effects of noncontingent rewards and reward-paired cues but does not support their ability to bias action selection.

Dopaminergic modulation of the human reward system: a placebo-controlled dopamine depletion fMRI study.

PubMed

da Silva Alves, Fabiana; Schmitz, Nicole; Figee, Martijn; Abeling, Nico; Hasler, Gregor; van der Meer, Johan; Nederveen, Aart; de Haan, Lieuwe; Linszen, Don; van Amelsvoort, Therese

2011-04-01

Reward related behaviour is linked to dopaminergic neurotransmission. Our aim was to gain insight into dopaminergic involvement in the human reward system. Combining functional magnetic resonance imaging with dopaminergic depletion by α-methylparatyrosine we measured dopamine-related brain activity in 10 healthy volunteers. In addition to blood-oxygen-level-dependent (BOLD) contrast we assessed the effect of dopaminergic depletion on prolactin response, peripheral markers for dopamine and norepinephrine. In the placebo condition we found increased activation in the left caudate and left cingulate gyrus during anticipation of reward. In the α-methylparatyrosine condition there was no significant brain activation during anticipation of reward or loss. In α-methylparatyrosine, anticipation of reward vs. loss increased activation in the right insula, left frontal, right parietal cortices and right cingulate gyrus. Comparing placebo versus α-methylparatyrosine showed increased activation in the left cingulate gyrus during anticipation of reward and the left medial frontal gyrus during anticipation of loss. α-methylparatyrosine reduced levels of dopamine in urine and homovanillic acid in plasma and increased prolactin. No significant effect of α-methylparatyrosine was found on norepinephrine markers. Our findings implicate distinct patterns of BOLD underlying reward processing following dopamine depletion, suggesting a role of dopaminergic neurotransmission for anticipation of monetary reward.

Endocannabinoid Signaling in Motivation, Reward, and Addiction: Influences on Mesocorticolimbic Dopamine Function.

PubMed

Sagheddu, Claudia; Muntoni, Anna Lisa; Pistis, Marco; Melis, Miriam

2015-01-01

Evidence suggests that the endocannabinoid system has been conserved in the animal kingdom for 500 million years, and this system influences many critical behavioral processes including associative learning, reward signaling, goal-directed behavior, motor skill learning, and action-habit transformation. Additionally, the neurotransmitter dopamine has long been recognized to play a critical role in the processing of natural rewards, as well as of motivation that regulates approach and avoidance behavior. This motivational role of dopamine neurons is also based upon the evidence provided by several studies investigating disorders of dopamine pathways such as drug addiction and Parkinson's disease. From an evolutionary point of view, individuals engage in behaviors aimed at maximizing and minimizing positive and aversive consequences, respectively. Accordingly, those with the greatest fitness have a better potential to survival. Hence, deviations from fitness can be viewed as a part of the evolutionary process by means of natural selection. Given the long evolutionary history of both the endocannabinoid and dopaminergic systems, it is plausible that they must serve as fundamental and basic modulators of physiological functions and needs. Notably, endocannabinoids regulate dopamine neuronal activity and its influence on behavioral output. The goal of this chapter is to examine the endocannabinoid influence on dopamine signaling specifically related to (i) those behavioral processes that allow us to successfully adapt to ever-changing environments (i.e., reward signaling and motivational processes) and (ii) derangements from behavioral flexibility that underpin drug addiction. © 2015 Elsevier Inc. All rights reserved.

Stress and reward processing in bipolar disorder: a functional magnetic resonance imaging study.

PubMed

Berghorst, Lisa H; Kumar, Poornima; Greve, Doug N; Deckersbach, Thilo; Ongur, Dost; Dutra, Sunny J; Pizzagalli, Diego A

2016-11-01

A link between negative life stress and the onset of mood episodes in bipolar disorder (BD) has been established, but processes underlying such a link remain unclear. Growing evidence suggests that stress can negatively affect reward processing and related neurobiological substrates, indicating that a dysregulated reward system may provide a partial explanation. The aim of this study was to test the impact of stress on reward-related neural functioning in BD. Thirteen euthymic or mildly depressed individuals with BD and 15 controls performed a Monetary Incentive Delay (MID) task while undergoing functional magnetic resonance imaging during no-stress and stress (negative psychosocial stressor involving poor performance feedback and threat of monetary deductions) conditions. In hypothesis-driven region-of-interest analyses, a significant group-by-condition interaction emerged in the amygdala during reward anticipation. Relative to controls, while anticipating a potential reward, subjects with BD were characterized by amygdalar hyperactivation in the no-stress condition but hypoactivation during stress. Moreover, relative to controls, subjects with BD had significantly larger amygdala volumes. After controlling for structural differences, the effects of stress on amygdalar function remained, whereas groups no longer differed during the no-stress condition. During reward consumption, a group-by-condition interaction emerged in the putamen due to increased putamen activation in response to rewards in participants with BD during stress, but an opposite pattern in controls. Overall, findings highlight possible impairments in using reward-predicting cues to adaptively engage in goal-directed actions in BD, combined with stress-induced hypersensitivity to reward consumption. Potential clinical implications are discussed. © 2016 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Neurocircuitry of drug reward

PubMed Central

Ikemoto, Satoshi; Bonci, Antonello

2013-01-01

In recent years, neuroscientists have produced profound conceptual and mechanistic advances on the neurocircuitry of reward and substance use disorders. Here, we will provide a brief review of intracranial drug self-administration and optogenetic self-stimulation studies that identified brain regions and neurotransmitter systems involved in drug- and reward-related behaviors. Also discussed is a theoretical framework that helps to understand the functional properties of the circuitry involved in these behaviors. The circuitry appears to be homeostatically regulated and mediate anticipatory processes that regulate behavioral interaction with the environment in response to salient stimuli. That is, abused drugs or, at least, some may act on basic motivation and mood processes, regulating behavior-environment interaction. Optogenetics and related technologies have begun to uncover detailed circuit mechanisms linking key brain regions in which abused drugs act for rewarding effects. PMID:23664810

Acute stress-induced cortisol elevations mediate reward system activity during subconscious processing of sexual stimuli.

PubMed

Oei, Nicole Y L; Both, Stephanie; van Heemst, Diana; van der Grond, Jeroen

2014-01-01

Stress is thought to alter motivational processes by increasing dopamine (DA) secretion in the brain's "reward system", and its key region, the nucleus accumbens (NAcc). However, stress studies using functional magnetic resonance imaging (fMRI), mainly found evidence for stress-induced decreases in NAcc responsiveness toward reward cues. Results from both animal and human PET studies indicate that the stress hormone cortisol may be crucial in the interaction between stress and dopaminergic actions. In the present study we therefore investigated whether cortisol mediated the effect of stress on DA-related responses to -subliminal-presentation of reward cues using the Trier Social Stress Test (TSST), which is known to reliably enhance cortisol levels. Young healthy males (n = 37) were randomly assigned to the TSST or control condition. After stress induction, brain activation was assessed using fMRI during a backward-masking paradigm in which potentially rewarding (sexual), emotionally negative and neutral stimuli were presented subliminally, masked by pictures of inanimate objects. A region of interest analysis showed that stress decreased activation in the NAcc in response to masked sexual cues (voxel-corrected, p<05). Furthermore, with mediation analysis it was found that high cortisol levels were related to stronger NAcc activation, showing that cortisol acted as a suppressor variable in the negative relation between stress and NAcc activation. The present findings indicate that cortisol is crucially involved in the relation between stress and the responsiveness of the reward system. Although generally stress decreases activation in the NAcc in response to rewarding stimuli, high stress-induced cortisol levels suppress this relation, and are associated with stronger NAcc activation. Individuals with a high cortisol response to stress might on one hand be protected against reductions in reward sensitivity, which has been linked to anhedonia and depression, but they may ultimately be more vulnerable to increased reward sensitivity, and addictions. Future studies investigating effects of stress on reward sensitivity should take into account the severity of the stressor and the individual cortisol response to stress. Copyright © 2013 Elsevier Ltd. All rights reserved.

Maximizing Total QoS-Provisioning of Image Streams with Limited Energy Budget

NASA Astrophysics Data System (ADS)

Lee, Wan Yeon; Kim, Kyong Hoon; Ko, Young Woong

To fully utilize the limited battery energy of mobile electronic devices, we propose an adaptive adjustment method of processing quality for multiple image stream tasks running with widely varying execution times. This adjustment method completes the worst-case executions of the tasks with a given budget of energy, and maximizes the total reward value of processing quality obtained during their executions by exploiting the probability distribution of task execution times. The proposed method derives the maximum reward value for the tasks being executable with arbitrary processing quality, and near maximum value for the tasks being executable with a finite number of processing qualities. Our evaluation on a prototype system shows that the proposed method achieves larger reward values, by up to 57%, than the previous method.

Social and monetary reward processing in autism spectrum disorders

PubMed Central

2012-01-01

Background Social motivation theory suggests that deficits in social reward processing underlie social impairments in autism spectrum disorders (ASD). However, the extent to which abnormalities in reward processing generalize to other classes of stimuli remains unresolved. The aim of the current study was to examine if reward processing abnormalities in ASD are specific to social stimuli or can be generalized to other classes of reward. Additionally, we sought to examine the results in the light of behavioral impairments in ASD. Methods Participants performed adapted versions of the social and monetary incentive delay tasks. Data from 21 unmedicated right-handed male participants with ASD and 21 age- and IQ-matched controls were analyzed using a factorial design to examine the blood-oxygen-level-dependent (BOLD) response during the anticipation and receipt of both reward types. Results Behaviorally, the ASD group showed less of a reduction in reaction time (RT) for rewarded compared to unrewarded trials than the control group. In terms of the fMRI results, there were no significant group differences in reward circuitry during reward anticipation. During the receipt of rewards, there was a significant interaction between group and reward type in the left dorsal striatum (DS). The ASD group showed reduced activity in the DS compared to controls for social rewards but not monetary rewards and decreased activation for social rewards compared to monetary rewards. Controls showed no significant difference between the two reward types. Increased activation in the DS during social reward processing was associated with faster response times for rewarded trials, compared to unrewarded trials, in both groups. This is in line with behavioral results indicating that the ASD group showed less of a reduction in RT for rewarded compared to unrewarded trials. Additionally, de-activation to social rewards was associated with increased repetitive behavior in ASD. Conclusions In line with social motivation theory, the ASD group showed reduced activation, compared to controls, during the receipt of social rewards in the DS. Groups did not differ significantly during the processing of monetary rewards. BOLD activation in the DS, during social reward processing, was associated with behavioral impairments in ASD. PMID:23014171

Social and monetary reward processing in autism spectrum disorders.

PubMed

Delmonte, Sonja; Balsters, Joshua H; McGrath, Jane; Fitzgerald, Jacqueline; Brennan, Sean; Fagan, Andrew J; Gallagher, Louise

2012-09-26

Social motivation theory suggests that deficits in social reward processing underlie social impairments in autism spectrum disorders (ASD). However, the extent to which abnormalities in reward processing generalize to other classes of stimuli remains unresolved. The aim of the current study was to examine if reward processing abnormalities in ASD are specific to social stimuli or can be generalized to other classes of reward. Additionally, we sought to examine the results in the light of behavioral impairments in ASD. Participants performed adapted versions of the social and monetary incentive delay tasks. Data from 21 unmedicated right-handed male participants with ASD and 21 age- and IQ-matched controls were analyzed using a factorial design to examine the blood-oxygen-level-dependent (BOLD) response during the anticipation and receipt of both reward types. Behaviorally, the ASD group showed less of a reduction in reaction time (RT) for rewarded compared to unrewarded trials than the control group. In terms of the fMRI results, there were no significant group differences in reward circuitry during reward anticipation. During the receipt of rewards, there was a significant interaction between group and reward type in the left dorsal striatum (DS). The ASD group showed reduced activity in the DS compared to controls for social rewards but not monetary rewards and decreased activation for social rewards compared to monetary rewards. Controls showed no significant difference between the two reward types. Increased activation in the DS during social reward processing was associated with faster response times for rewarded trials, compared to unrewarded trials, in both groups. This is in line with behavioral results indicating that the ASD group showed less of a reduction in RT for rewarded compared to unrewarded trials. Additionally, de-activation to social rewards was associated with increased repetitive behavior in ASD. In line with social motivation theory, the ASD group showed reduced activation, compared to controls, during the receipt of social rewards in the DS. Groups did not differ significantly during the processing of monetary rewards. BOLD activation in the DS, during social reward processing, was associated with behavioral impairments in ASD.

Quantifying familial influences on brain activation during the monetary incentive delay task: an adolescent monozygotic twin study.

PubMed

Silverman, Merav H; Krueger, Robert F; Iacono, William G; Malone, Stephen M; Hunt, Ruskin H; Thomas, Kathleen M

2014-12-01

Although altered brain activation during reward tasks has been found in a number of heritable psychiatric disorders and health outcomes, the familial nature of reward-related brain activation remains unexplored. In this study, we investigated the degree to which the magnitude of mesocorticolimbic reward system signal intensities in anticipation of reward during the monetary incentive delay (MID) task was similar within 46 pairs of adolescent, monozygotic twins. Significant within-pair correlations in brain activation during anticipation of gain were found in one third of the 18 reward-related regions investigated. These regions were the right nucleus accumbens, left and right posterior caudate, right anterior caudate, left insula, and anterior cingulate cortex. This serves as evidence for a shared familial contribution to individual differences in reward related brain activity in certain key reward processing regions. Copyright © 2014 Elsevier B.V. All rights reserved.

Selectivity in Postencoding Connectivity with High-Level Visual Cortex Is Associated with Reward-Motivated Memory

PubMed Central

Murty, Vishnu P.; Tompary, Alexa; Adcock, R. Alison

2017-01-01

Reward motivation has been demonstrated to enhance declarative memory by facilitating systems-level consolidation. Although high-reward information is often intermixed with lower reward information during an experience, memory for high value information is prioritized. How is this selectivity achieved? One possibility is that postencoding consolidation processes bias memory strengthening to those representations associated with higher reward. To test this hypothesis, we investigated the influence of differential reward motivation on the selectivity of postencoding markers of systems-level memory consolidation. Human participants encoded intermixed, trial-unique memoranda that were associated with either high or low-value during fMRI acquisition. Encoding was interleaved with periods of rest, allowing us to investigate experience-dependent changes in connectivity as they related to later memory. Behaviorally, we found that reward motivation enhanced 24 h associative memory. Analysis of patterns of postencoding connectivity showed that, even though learning trials were intermixed, there was significantly greater connectivity with regions of high-level, category-selective visual cortex associated with high-reward trials. Specifically, increased connectivity of category-selective visual cortex with both the VTA and the anterior hippocampus predicted associative memory for high- but not low-reward memories. Critically, these results were independent of encoding-related connectivity and univariate activity measures. Thus, these findings support a model by which the selective stabilization of memories for salient events is supported by postencoding interactions with sensory cortex associated with reward. SIGNIFICANCE STATEMENT Reward motivation is thought to promote memory by supporting memory consolidation. Yet, little is known as to how brain selects relevant information for subsequent consolidation based on reward. We show that experience-dependent changes in connectivity of both the anterior hippocampus and the VTA with high-level visual cortex selectively predicts memory for high-reward memoranda at a 24 h delay. These findings provide evidence for a novel mechanism guiding the consolidation of memories for valuable events, namely, postencoding interactions between neural systems supporting mesolimbic dopamine activation, episodic memory, and perception. PMID:28100737

Brain Systems for Assessing Facial Attractiveness

ERIC Educational Resources Information Center

Winston, Joel S.; O'Doherty, John; Kilner, James M.; Perrett, David I.; Dolan, Raymond J.

2007-01-01

Attractiveness is a facial attribute that shapes human affiliative behaviours. In a previous study we reported a linear response to facial attractiveness in orbitofrontal cortex (OFC), a region involved in reward processing. There are strong theoretical grounds for the hypothesis that coding stimulus reward value also involves the amygdala. The…

Reward inference by primate prefrontal and striatal neurons.

PubMed

Pan, Xiaochuan; Fan, Hongwei; Sawa, Kosuke; Tsuda, Ichiro; Tsukada, Minoru; Sakagami, Masamichi

2014-01-22

The brain contains multiple yet distinct systems involved in reward prediction. To understand the nature of these processes, we recorded single-unit activity from the lateral prefrontal cortex (LPFC) and the striatum in monkeys performing a reward inference task using an asymmetric reward schedule. We found that neurons both in the LPFC and in the striatum predicted reward values for stimuli that had been previously well experienced with set reward quantities in the asymmetric reward task. Importantly, these LPFC neurons could predict the reward value of a stimulus using transitive inference even when the monkeys had not yet learned the stimulus-reward association directly; whereas these striatal neurons did not show such an ability. Nevertheless, because there were two set amounts of reward (large and small), the selected striatal neurons were able to exclusively infer the reward value (e.g., large) of one novel stimulus from a pair after directly experiencing the alternative stimulus with the other reward value (e.g., small). Our results suggest that although neurons that predict reward value for old stimuli in the LPFC could also do so for new stimuli via transitive inference, those in the striatum could only predict reward for new stimuli via exclusive inference. Moreover, the striatum showed more complex functions than was surmised previously for model-free learning.

Reward Inference by Primate Prefrontal and Striatal Neurons

PubMed Central

Pan, Xiaochuan; Fan, Hongwei; Sawa, Kosuke; Tsuda, Ichiro; Tsukada, Minoru

2014-01-01

The brain contains multiple yet distinct systems involved in reward prediction. To understand the nature of these processes, we recorded single-unit activity from the lateral prefrontal cortex (LPFC) and the striatum in monkeys performing a reward inference task using an asymmetric reward schedule. We found that neurons both in the LPFC and in the striatum predicted reward values for stimuli that had been previously well experienced with set reward quantities in the asymmetric reward task. Importantly, these LPFC neurons could predict the reward value of a stimulus using transitive inference even when the monkeys had not yet learned the stimulus–reward association directly; whereas these striatal neurons did not show such an ability. Nevertheless, because there were two set amounts of reward (large and small), the selected striatal neurons were able to exclusively infer the reward value (e.g., large) of one novel stimulus from a pair after directly experiencing the alternative stimulus with the other reward value (e.g., small). Our results suggest that although neurons that predict reward value for old stimuli in the LPFC could also do so for new stimuli via transitive inference, those in the striatum could only predict reward for new stimuli via exclusive inference. Moreover, the striatum showed more complex functions than was surmised previously for model-free learning. PMID:24453328

Listening to Rhythmic Music Reduces Connectivity within the Basal Ganglia and the Reward System.

PubMed

Brodal, Hans P; Osnes, Berge; Specht, Karsten

2017-01-01

Music can trigger emotional responses in a more direct way than any other stimulus. In particular, music-evoked pleasure involves brain networks that are part of the reward system. Furthermore, rhythmic music stimulates the basal ganglia and may trigger involuntary movements to the beat. In the present study, we created a continuously playing rhythmic, dance floor-like composition where the ambient noise from the MR scanner was incorporated as an additional instrument of rhythm. By treating this continuous stimulation paradigm as a variant of resting-state, the data was analyzed with stochastic dynamic causal modeling (sDCM), which was used for exploring functional dependencies and interactions between core areas of auditory perception, rhythm processing, and reward processing. The sDCM model was a fully connected model with the following areas: auditory cortex, putamen/pallidum, and ventral striatum/nucleus accumbens of both hemispheres. The resulting estimated parameters were compared to ordinary resting-state data, without an additional continuous stimulation. Besides reduced connectivity within the basal ganglia, the results indicated a reduced functional connectivity of the reward system, namely the right ventral striatum/nucleus accumbens from and to the basal ganglia and auditory network while listening to rhythmic music. In addition, the right ventral striatum/nucleus accumbens demonstrated also a change in its hemodynamic parameter, reflecting an increased level of activation. These converging results may indicate that the dopaminergic reward system reduces its functional connectivity and relinquishing its constraints on other areas when we listen to rhythmic music.

Listening to Rhythmic Music Reduces Connectivity within the Basal Ganglia and the Reward System

PubMed Central

Brodal, Hans P.; Osnes, Berge; Specht, Karsten

2017-01-01

Music can trigger emotional responses in a more direct way than any other stimulus. In particular, music-evoked pleasure involves brain networks that are part of the reward system. Furthermore, rhythmic music stimulates the basal ganglia and may trigger involuntary movements to the beat. In the present study, we created a continuously playing rhythmic, dance floor-like composition where the ambient noise from the MR scanner was incorporated as an additional instrument of rhythm. By treating this continuous stimulation paradigm as a variant of resting-state, the data was analyzed with stochastic dynamic causal modeling (sDCM), which was used for exploring functional dependencies and interactions between core areas of auditory perception, rhythm processing, and reward processing. The sDCM model was a fully connected model with the following areas: auditory cortex, putamen/pallidum, and ventral striatum/nucleus accumbens of both hemispheres. The resulting estimated parameters were compared to ordinary resting-state data, without an additional continuous stimulation. Besides reduced connectivity within the basal ganglia, the results indicated a reduced functional connectivity of the reward system, namely the right ventral striatum/nucleus accumbens from and to the basal ganglia and auditory network while listening to rhythmic music. In addition, the right ventral striatum/nucleus accumbens demonstrated also a change in its hemodynamic parameter, reflecting an increased level of activation. These converging results may indicate that the dopaminergic reward system reduces its functional connectivity and relinquishing its constraints on other areas when we listen to rhythmic music. PMID:28400717

A universal role of the ventral striatum in reward-based learning: Evidence from human studies

PubMed Central

Daniel, Reka; Pollmann, Stefan

2014-01-01

Reinforcement learning enables organisms to adjust their behavior in order to maximize rewards. Electrophysiological recordings of dopaminergic midbrain neurons have shown that they code the difference between actual and predicted rewards, i.e., the reward prediction error, in many species. This error signal is conveyed to both the striatum and cortical areas and is thought to play a central role in learning to optimize behavior. However, in human daily life rewards are diverse and often only indirect feedback is available. Here we explore the range of rewards that are processed by the dopaminergic system in human participants, and examine whether it is also involved in learning in the absence of explicit rewards. While results from electrophysiological recordings in humans are sparse, evidence linking dopaminergic activity to the metabolic signal recorded from the midbrain and striatum with functional magnetic resonance imaging (fMRI) is available. Results from fMRI studies suggest that the human ventral striatum (VS) receives valuation information for a diverse set of rewarding stimuli. These range from simple primary reinforcers such as juice rewards over abstract social rewards to internally generated signals on perceived correctness, suggesting that the VS is involved in learning from trial-and-error irrespective of the specific nature of provided rewards. In addition, we summarize evidence that the VS can also be implicated when learning from observing others, and in tasks that go beyond simple stimulus-action-outcome learning, indicating that the reward system is also recruited in more complex learning tasks. PMID:24825620

Preserved reward outcome processing in ASD as revealed by event-related potentials.

PubMed

McPartland, James C; Crowley, Michael J; Perszyk, Danielle R; Mukerji, Cora E; Naples, Adam J; Wu, Jia; Mayes, Linda C

2012-05-31

Problems with reward system function have been posited as a primary difficulty in autism spectrum disorders. The current study examined an electrophysiological marker of feedback monitoring, the feedback-related negativity (FRN), during a monetary reward task. The study advanced prior understanding by focusing exclusively on a developmental sample, applying rigorous diagnostic characterization and introducing an experimental paradigm providing more subtly different feedback valence (reward versus non-reward instead of reward versus loss). Twenty-six children with autism spectrum disorder and 28 typically developing peers matched on age and full-scale IQ played a guessing game resulting in monetary gain ("win") or neutral outcome ("draw"). ERP components marking early visual processing (N1, P2) and feedback appraisal (FRN) were contrasted between groups in each condition, and their relationships to behavioral measures of social function and dysfunction, social anxiety, and autism symptomatology were explored. FRN was observed on draw trials relative to win trials. Consistent with prior research, children with ASD exhibited a FRN to suboptimal outcomes that was comparable to typical peers. ERP parameters were unrelated to behavioral measures. Results of the current study indicate typical patterns of feedback monitoring in the context of monetary reward in ASD. The study extends prior findings of normative feedback monitoring to a sample composed exclusively of children and demonstrates that, as in typical development, individuals with autism exhibit a FRN to suboptimal outcomes, irrespective of neutral or negative valence. Results do not support a pervasive problem with reward system function in ASD, instead suggesting any dysfunction lies in more specific domains, such as social perception, or in response to particular feedback-monitoring contexts, such as self-evaluation of one's errors.

Dopaminergic stimulation increases selfish behavior in the absence of punishment threat.

PubMed

Pedroni, Andreas; Eisenegger, Christoph; Hartmann, Matthias N; Fischbacher, Urs; Knoch, Daria

2014-01-01

People often face decisions that pit self-interested behavior aimed at maximizing personal reward against normative behavior such as acting cooperatively, which benefits others. The threat of social sanctions for defying the fairness norm prevents people from behaving overly selfish. Thus, normative behavior is influenced by both seeking rewards and avoiding punishment. However, the neurochemical processes mediating the impact of these influences remain unknown. Several lines of evidence link the dopaminergic system to reward and punishment processing, respectively, but this evidence stems from studies in non-social contexts. The present study investigates dopaminergic drug effects on individuals' reward seeking and punishment avoidance in social interaction. Two-hundred one healthy male participants were randomly assigned to receive 300 mg of L-3,4-dihydroxyphenylalanine (L-DOPA) or a placebo before playing an economic bargaining game. This game involved two conditions, one in which unfair behavior could be punished and one in which unfair behavior could not be punished. In the absence of punishment threats, L-DOPA administration led to more selfish behavior, likely mediated through an increase in reward seeking. In contrast, L-DOPA administration had no significant effect on behavior when faced with punishment threats. The results of this study broaden the role of the dopaminergic system in reward seeking to human social interactions. We could show that even a single dose of a dopaminergic drug may bring selfish behavior to the fore, which in turn may shed new light on potential causal relationships between the dopaminergic system and norm abiding behaviors in certain clinical subpopulations.

The role of dopamine in reward and pleasure behaviour--review of data from preclinical research.

PubMed

Bressan, R A; Crippa, J A

2005-01-01

The purpose of this article is to review some of the basic aspects of the dopaminergic system and its role in reward and pleasure behaviour. We also discuss the association between dopamine and unpleasant symptoms that are commonly found in neuropsychiatric disorders and may also be side-effects of neuroleptic drugs. A computer-based search of the literature, augmented by extensive bibliography-guided article reviews, were used to find basic information on the dopamine and the reward systems, and symptoms such as dysphoria, anhedonia and depression. Central dopaminergic neurotransmission is complex, having multiple actions at each level of the mesocorticolimbic reward pathway. The role of dopamine in the reward process was classically associated with the ability to experience pleasure; recent data suggest a more motivational role. Dysfunction of the dopamine transmission in the reward circuit is associated with symptoms such as anhedonia, apathy and dysphoria found in several neuropsychiatric disorders, including Parkinson's disease, depression, drug addiction, and neuroleptic-induced dysphoria. Viewing the dysfunctions of the reward pathways within a broader spectrum and exploring its complex relations with the dopaminergic transmission may help understand the pathophysiology of these neuropsychiatric disorders and lead to a rational development of novel treatments.

Brain connectivity reflects human aesthetic responses to music.

PubMed

Sachs, Matthew E; Ellis, Robert J; Schlaug, Gottfried; Loui, Psyche

2016-06-01

Humans uniquely appreciate aesthetics, experiencing pleasurable responses to complex stimuli that confer no clear intrinsic value for survival. However, substantial variability exists in the frequency and specificity of aesthetic responses. While pleasure from aesthetics is attributed to the neural circuitry for reward, what accounts for individual differences in aesthetic reward sensitivity remains unclear. Using a combination of survey data, behavioral and psychophysiological measures and diffusion tensor imaging, we found that white matter connectivity between sensory processing areas in the superior temporal gyrus and emotional and social processing areas in the insula and medial prefrontal cortex explains individual differences in reward sensitivity to music. Our findings provide the first evidence for a neural basis of individual differences in sensory access to the reward system, and suggest that social-emotional communication through the auditory channel may offer an evolutionary basis for music making as an aesthetically rewarding function in humans. © The Author (2016). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Utilization of reward-prospect enhances preparatory attention and reduces stimulus conflict.

PubMed

van den Berg, Berry; Krebs, Ruth M; Lorist, Monicque M; Woldorff, Marty G

2014-06-01

The prospect of gaining money is an incentive widely at play in the real world. Such monetary motivation might have particularly strong influence when the cognitive system is challenged, such as when needing to process conflicting stimulus inputs. Here, we employed manipulations of reward-prospect and attentional-preparation levels in a cued-Stroop stimulus conflict task, along with the high temporal resolution of electrical brain recordings, to provide insight into the mechanisms by which reward-prospect and attention interact and modulate cognitive task performance. In this task, the cue indicated whether or not the participant needed to prepare for an upcoming Stroop stimulus and, if so, whether there was the potential for monetary reward (dependent on performance on that trial). Both cued attention and cued reward-prospect enhanced preparatory neural activity, as reflected by increases in the hallmark attention-related negative-polarity ERP slow wave (contingent negative variation [CNV]) and reductions in oscillatory Alpha activity, which was followed by enhanced processing of the subsequent Stroop stimulus. In addition, similar modulations of preparatory neural activity (larger CNVs and reduced Alpha) predicted shorter versus longer response times (RTs) to the subsequent target stimulus, consistent with such modulations reflecting trial-to-trial variations in attention. Particularly striking were the individual differences in the utilization of reward-prospect information. In particular, the size of the reward effects on the preparatory neural activity correlated across participants with the degree to which reward-prospect both facilitated overall task performance (shorter RTs) and reduced conflict-related behavioral interference. Thus, the prospect of reward appears to recruit attentional preparation circuits to enhance processing of task-relevant target information.

Utilization of reward-prospect enhances preparatory attention and reduces stimulus conflict

PubMed Central

van den Berg, Berry; Krebs, Ruth M.; Lorist, Monicque M.; Woldorff, Marty G.

2015-01-01

The prospect of gaining money is an incentive widely at play in the real world. Such monetary motivation might have particularly strong influence when the cognitive system is challenged, such as when needing to process conflicting stimulus inputs. Here, we employed manipulations of reward-prospect and attentional-preparation levels in a cued-Stroop stimulus-conflict task, along with the high temporal resolution of electrical brain recordings, to provide insight into the mechanisms by which reward-prospect and attention interact and modulate cognitive-task performance. In this task the cue indicated whether or not the subject needed to prepare for an upcoming Stroop stimulus, and if so, whether there was the potential for monetary reward (dependent on performance on that trial). Both cued-attention and cued-reward-prospect enhanced preparatory neural activity, as reflected by increases in the hallmark attention-related negative-polarity ERP slow wave (CNV) and reductions in oscillatory Alpha activity, which was followed by enhanced processing of the subsequent Stroop stimulus. In addition, similar modulations of preparatory neural activity (larger CNVs and reduced Alpha) predicted faster versus slower response times (RTs) to the subsequent target stimulus, consistent with such modulations reflecting trial-to-trial variations in attention. Particularly striking were the individual differences in the utilization of reward-prospect information. In particular, the size of the reward effects on the preparatory neural activity correlated across-subjects with the degree to which reward-prospect both facilitated overall task performance (faster RTs) and reduced conflict-related behavioral interference. Thus, the prospect of reward appears to recruit attentional preparation circuits to enhance processing of task-relevant target information. PMID:24820263

Levodopa administration modulates striatal processing of punishment-associated items in healthy participants.

PubMed

Wittmann, Bianca C; D'Esposito, Mark

2015-01-01

Appetitive and aversive processes share a number of features such as their relevance for action and learning. On a neural level, reward and its predictors are associated with increased firing of dopaminergic neurons, whereas punishment processing has been linked to the serotonergic system and to decreases in dopamine transmission. Recent data indicate, however, that the dopaminergic system also responds to aversive stimuli and associated actions. In this pharmacological functional magnetic resonance imaging study, we investigated the contribution of the dopaminergic system to reward and punishment processing in humans. Two groups of participants received either placebo or the dopamine precursor levodopa and were scanned during alternating reward and punishment anticipation blocks. Levodopa administration increased striatal activations for cues presented in punishment blocks. In an interaction with individual personality scores, levodopa also enhanced striatal activation for punishment-predictive compared with neutral cues in participants scoring higher on the novelty-seeking dimension. These data support recent indications that dopamine contributes to punishment processing and suggest that the novelty-seeking trait is a measure of susceptibility to drug effects on motivation. These findings are also consistent with the possibility of an inverted U-shaped response function of dopamine in the striatum, suggesting an optimal level of dopamine release for motivational processing.

Levodopa administration modulates striatal processing of punishment-associated items in healthy participants

PubMed Central

Wittmann, Bianca C.; D’Esposito, Mark

2014-01-01

Rationale Appetitive and aversive processes share a number of features such as their relevance for action and learning. On a neural level, reward and its predictors are associated with increased firing of dopaminergic neurons, whereas punishment processing has been linked to the serotonergic system and to decreases in dopamine transmission. Recent data indicate, however, that the dopaminergic system also responds to aversive stimuli and associated actions. Objectives In this pharmacological functional magnetic resonance imaging (fMRI) study, we investigated the contribution of the dopaminergic system to reward and punishment processing in humans. Methods Two groups of participants received either placebo or the dopamine precursor levodopa and were scanned during alternating reward and punishment anticipation blocks. Results Levodopa administration increased striatal activations for cues presented in punishment blocks. In an interaction with individual personality scores, levodopa also enhanced striatal activation for punishment-predictive compared to neutral cues in participants scoring higher on the novelty-seeking dimension. Conclusions These data support recent indications that dopamine contributes to punishment processing and suggest that the novelty-seeking trait is a measure of susceptibility to drug effects on motivation. These findings are also consistent with the possibility of an inverted U-shaped response function of dopamine in the striatum, suggesting an optimal level of dopamine release for motivational processing. PMID:24923987

Abnormal Reward System Activation in Mania

PubMed Central

Abler, Birgit; Greenhouse, Ian; Ongur, Dost; Walter, Henrik; Heckers, Stephan

2008-01-01

Transmission of reward signals is a function of dopamine, a neurotransmitter known to be involved in the mechanism of psychosis. Using functional magnetic resonance imaging (fMRI), we investigated how expectation and receipt of monetary rewards modulate brain activation in patients with bipolar mania and schizophrenia. We studied 12 acutely manic patients with a history of bipolar disorder, 12 patients with a current episode of schizoaffective disorder or schizophrenia and 12 healthy subjects. All patients were treated with dopamine antagonists at the time of the study. Subjects performed a delayed incentive paradigm with monetary reward in the scanner that allowed for investigating effects of expectation, receipt, and omission of rewards. Patients with schizophrenia and healthy control subjects showed the expected activation of dopaminergic brain areas, that is, ventral tegmentum activation upon expectation of monetary rewards and nucleus accumbens activation during receipt vs omission of rewards. In manic patients, however, we did not find a similar pattern of brain activation and the differential signal in the nucleus accumbens upon receipt vs omission of rewards was significantly lower compared to the healthy control subjects. Our findings provide evidence for abnormal function of the dopamine system during receipt or omission of expected rewards in bipolar disorder. These deficits in prediction error processing in acute mania may help to explain symptoms of disinhibition and abnormal goal pursuit regulation. PMID:17987058

The role of the dopaminergic projections in MFB self-stimulation.

PubMed

Gallistel, C R

1986-11-01

Psychophysical experiments indicate that the first stage of the reward pathway in medial forebrain bundle self-stimulation consists of small myelinated descending axons. Pharmacological experiments show that neuroleptics attenuate or abolish the rewarding effect. This had led to the hypothesis that the descending myelinated axons synapse on an ascending dopaminergic second stage projection. 2-Deoxy-[14C]glucose autoradiography in self-stimulating animals or animals receiving automatically administered rewarding stimulation after treatment with reward-blocking doses of pimozide reveals activation of a descending myelinated system but no stimulation-produced activation of an ascending dopaminergic projection system, even though the autoradiographic method reveals the mild elevations and depressions of activity in dopaminergic terminal fields consequent upon injections of neuroleptics and amphetamine, respectively, and the strong activation of the nigrostriatal projection produced by stimulating directly in the substantia nigra. When the effects of neuroleptics and clonidine are measured by the psychophysical method (that is, by lateral shifts in the rate-frequency function), it is found that both drugs produce only gradual and rather small attenuations of rewarding efficacy up to doses at which it is no longer possible to measure their effects. It is suggested that, for neuroleptics at least, the rewarding effect abruptly fails at these doses. It is further suggested that these drugs do not act on the rewarding pathway itself, but on the process by which the rewarding signal is converted to an enduring rewarding effect.

The role of the dopaminergic projections in MFB self-stimulation.

PubMed

Gallistel, C R

1986-06-01

Psychophysical experiments indicate that the first stage of the reward pathway in medial forebrain bundle self-stimulation consists of small myelinated descending axons. Pharmacological experiments show that neuroleptics attenuate or abolish the rewarding effect. This had led to the hypothesis that the descending myelinated axons synapse on an ascending dopaminergic second stage projection. 2-Deoxy-[14C]glucose autoradiography in self-stimulating animals or animals receiving automatically administered rewarding stimulation after treatment with reward-blocking doses of pimozide reveals activation of a descending myelinated system but no stimulation-produced activation of an ascending dopaminergic projection system, even though the autoradiographic method reveals the mild elevations and depressions of activity in dopaminergic terminal fields consequent upon injections of neuroleptics and amphetamine, respectively, and the strong activation of the nigrostriatal projection produced by stimulating directly in the substantia nigra. When the effects of neuroleptics and clonidine are measured by the psychophysical method (that is, by lateral shifts in the rate-frequency function), it is found that both drugs produce only gradual and rather small attenuations of rewarding efficacy up to doses at which it is no longer possible to measure their effects. It is suggested that, for neuroleptics at least, the rewarding effect abruptly fails at these doses. It is further suggested that these drugs do not act on the rewarding pathway itself, but on the process by which the rewarding signal is converted to an enduring rewarding effect.

ILLICIT DOPAMINE TRANSIENTS: RECONCILING ACTIONS OF ABUSED DRUGS

PubMed Central

Covey, Dan P.; Roitman, Mitchell F.; Garris, Paul A.

2014-01-01

Phasic increases in brain dopamine are required for cue-directed reward seeking. While compelling within the framework of appetitive behavior, the view that illicit drugs hijack reward circuits by hyper-activating these dopamine transients is inconsistent with established psychostimulant pharmacology. However, recent work reclassifying amphetamine (AMPH), cocaine, and other addictive dopamine-transporter inhibitors (DAT-Is) supports transient hyper-activation as a unifying hypothesis of abused drugs. We argue here that reclassification also identifies generating burst firing by dopamine neurons as a keystone action. Unlike natural rewards, which are processed by sensory systems, drugs act directly on the brain. Consequently, to mimic natural reward and exploit reward circuits, dopamine transients must be elicited de novo. Of available drug targets, only burst firing achieves this essential outcome. PMID:24656971

Comparing the effects of food restriction and overeating on brain reward systems

PubMed Central

Avena, Nicole M.; Murray, Susan; Gold, Mark S.

2014-01-01

Both caloric restriction and overeating have been shown to affect neural processes associated with reinforcement. Both preclinical and some clinical studies have provided evidence that food restriction may increase reward sensitivity, and while there are mixed findings regarding the effects of overeating on reward sensitivity, there is strong evidence linking this behavior with changes in reward-related brain regions. Evidence of these changes comes in part from findings that show that such eating patterns are associated with increased drug use. The data discussed here regarding the differential effects of various eating patterns on reward systems may be particularly relevant to the aging population, as this population has been shown to exhibit altered reward sensitivity and decreased caloric consumption. Moreover, members of this population appear to be increasingly affected by the current obesity epidemic. Food, like alcohol or drugs, can stimulate its own consumption and produce similar neurochemical changes in the brain. Age-related loss of appetite, decreased eating, and caloric restriction are hypothesized to be associated with changes in the prevalence of substance misuse, abuse, and dependence seen in this cohort. PMID:23535488

Nicotine Withdrawal Induces Neural Deficits in Reward Processing.

PubMed

Oliver, Jason A; Evans, David E; Addicott, Merideth A; Potts, Geoffrey F; Brandon, Thomas H; Drobes, David J

2017-06-01

Nicotine withdrawal reduces neurobiological responses to nonsmoking rewards. Insight into these reward deficits could inform the development of targeted interventions. This study examined the effect of withdrawal on neural and behavioral responses during a reward prediction task. Smokers (N = 48) attended two laboratory sessions following overnight abstinence. Withdrawal was manipulated by having participants smoke three regular nicotine (0.6 mg yield; satiation) or very low nicotine (0.05 mg yield; withdrawal) cigarettes. Electrophysiological recordings of neural activity were obtained while participants completed a reward prediction task that involved viewing four combinations of predictive and reward-determining stimuli: (1) Unexpected Reward; (2) Predicted Reward; (3) Predicted Punishment; (4) Unexpected Punishment. The task evokes a medial frontal negativity that mimics the phasic pattern of dopaminergic firing in ventral tegmental regions associated with reward prediction errors. Nicotine withdrawal decreased the amplitude of the medial frontal negativity equally across all trial types (p < .001). Exploratory analyses indicated withdrawal increased time to initiate the next trial following unexpected punishment trials (p < .001) and response time on reward trials during withdrawal was positively related to nicotine dependence (p < .001). Nicotine withdrawal had equivocal impact across trial types, suggesting reward processing deficits are unlikely to stem from changes in phasic dopaminergic activity during prediction errors. Effects on tonic activity may be more pronounced. Pharmacological interventions directly targeting the dopamine system and behavioral interventions designed to increase reward motivation and responsiveness (eg, behavioral activation) may aid in mitigating withdrawal symptoms and potentially improving smoking cessation outcomes. Findings from this study indicate nicotine withdrawal impacts reward processing signals that are observable in smokers' neural activity. This may play a role in the subjective aversive experience of nicotine withdrawal and potentially contribute to smoking relapse. Interventions that address abnormal responding to both pleasant and unpleasant stimuli may be particularly effective for alleviating nicotine withdrawal. © The Author 2017. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Value-driven attentional capture in the auditory domain.

PubMed

Anderson, Brian A

2016-01-01

It is now well established that the visual attention system is shaped by reward learning. When visual features are associated with a reward outcome, they acquire high priority and can automatically capture visual attention. To date, evidence for value-driven attentional capture has been limited entirely to the visual system. In the present study, I demonstrate that previously reward-associated sounds also capture attention, interfering more strongly with the performance of a visual task. This finding suggests that value-driven attention reflects a broad principle of information processing that can be extended to other sensory modalities and that value-driven attention can bias cross-modal stimulus competition.

Hyperresponsivity and impaired prefrontal control of the mesolimbic reward system in schizophrenia.

PubMed

Richter, Anja; Petrovic, Aleksandra; Diekhof, Esther K; Trost, Sarah; Wolter, Sarah; Gruber, Oliver

2015-12-01

Schizophrenia is characterized by substantial dysfunctions of reward processing, leading to detrimental consequences for decision-making. The neurotransmitter dopamine is responsible for the transmission of reward signals and also known to be involved in the mechanism of psychosis. Using functional magnetic resonance imaging (fMRI), sixteen medicated patients with schizophrenia and sixteen healthy controls performed the 'desire-reason dilemma' (DRD) paradigm. This paradigm allowed us to directly investigate reward-related brain activations depending on the interaction of bottom-up and top-down mechanisms, when a previously conditioned reward stimulus had to be rejected to achieve a superordinate long-term goal. Both patients and controls showed significant activations in the mesolimbic reward system. In patients with schizophrenia, however, we found a significant hyperactivation of the left ventral striatum (vStr) when they were allowed to accept the conditioned reward stimuli, and a reduced top-down regulation of activation in the ventral striatum (vStr) and ventral tegmental area (VTA) while having to reject the immediate reward to pursue the superordinate task-goal. Moreover, while healthy subjects exhibited a negative functional coupling of the vStr with both the anteroventral prefrontal cortex (avPFC) and the ventromedial prefrontal cortex (VMPFC) in the dilemma situation, this functional coupling was significantly impaired in the patient group. These findings provide evidence for an increased ventral striatal activation to reward stimuli and an impaired top-down control of reward signals by prefrontal brain regions in schizophrenia. Copyright © 2015 Elsevier Ltd. All rights reserved.

When unconscious rewards boost cognitive task performance inefficiently: the role of consciousness in integrating value and attainability information

PubMed Central

Zedelius, Claire M.; Veling, Harm; Aarts, Henk

2012-01-01

Research has shown that high vs. low value rewards improve cognitive task performance independent of whether they are perceived consciously or unconsciously. However, efficient performance in response to high value rewards also depends on whether or not rewards are attainable. This raises the question of whether unconscious reward processing enables people to take into account such attainability information. Building on a theoretical framework according to which conscious reward processing is required to enable higher level cognitive processing, the present research tested the hypothesis that conscious but not unconscious reward processing enables integration of reward value with attainability information. In two behavioral experiments, participants were exposed to mask high and low value coins serving as rewards on a working memory (WM) task. The likelihood for conscious processing was manipulated by presenting the coins relatively briefly (17 ms) or long and clearly visible (300 ms). Crucially, rewards were expected to be attainable or unattainable. Requirements to integrate reward value with attainability information varied across experiments. Results showed that when integration of value and attainability was required (Experiment 1), long reward presentation led to efficient performance, i.e., selectively improved performance for high value attainable rewards. In contrast, in the short presentation condition, performance was increased for high value rewards even when these were unattainable. This difference between the effects of long and short presentation time disappeared when integration of value and attainability information was not required (Experiment 2). Together these findings suggest that unconsciously processed reward information is not integrated with attainability expectancies, causing inefficient effort investment. These findings are discussed in terms of a unique role of consciousness in efficient allocation of effort to cognitive control processes. PMID:22848198

Role of Reward Sensitivity and Processing in Major Depressive and Bipolar Spectrum Disorders

PubMed Central

Alloy, Lauren B.; Olino, Thomas; Freed, Rachel D.; Nusslock, Robin

2016-01-01

Since Costello’s (1972) seminal Behavior Therapy article on loss of reinforcers or reinforcer effectiveness in depression, the role of reward sensitivity and processing in both depression and bipolar disorder has become a central area of investigation. In this article, we review the evidence for a model of reward sensitivity in mood disorders, with unipolar depression characterized by reward hyposensitivity and bipolar disorders by reward hypersensitivity. We address whether aberrant reward sensitivity and processing are correlates of, mood-independent traits of, vulnerabilities for, and/or predictors of the course of depression and bipolar spectrum disorders, covering evidence from self-report, behavioral, neurophysiological, and neural levels of analysis. We conclude that substantial evidence documents that blunted reward sensitivity and processing are involved in unipolar depression and heightened reward sensitivity and processing are characteristic of hypomania/mania. We further conclude that aberrant reward sensitivity has a trait component, but more research is needed to clearly demonstrate that reward hyposensitivity and hypersensitivity are vulnerabilities for depression and bipolar disorder, respectively. Moreover, additional research is needed to determine whether bipolar depression is similar to unipolar depression and characterized by reward hyposensitivity, or whether like bipolar hypomania/mania, it involves reward hypersensitivity. PMID:27816074

Electrophysiological Evidence of Atypical Motivation and Reward Processing in Children with Attention-Deficit Hyperactivity Disorder

ERIC Educational Resources Information Center

Holroyd, Clay B.; Baker, Travis E.; Kerns, Kimberly A.; Muller, Ulrich

2008-01-01

Behavioral and neurophysiological evidence suggest that attention-deficit hyperactivity disorder (ADHD) is characterized by the impact of abnormal reward prediction error signals carried by the midbrain dopamine system on frontal brain areas that implement cognitive control. To investigate this issue, we recorded the event-related brain potential…

Executive functions, information sampling, and decision making in narcolepsy with cataplexy.

PubMed

Delazer, Margarete; Högl, Birgit; Zamarian, Laura; Wenter, Johanna; Gschliesser, Viola; Ehrmann, Laura; Brandauer, Elisabeth; Cevikkol, Zehra; Frauscher, Birgit

2011-07-01

Narcolepsy with cataplexy (NC) affects neurotransmitter systems regulating emotions and cognitive functions. This study aimed to assess executive functions, information sampling, reward processing, and decision making in NC. Twenty-one NC patients and 58 healthy participants performed an extensive neuropsychological test battery. NC patients scored as controls in executive function tasks assessing set shifting, reversal learning, working memory, and planning. Group differences appeared in a task measuring information sampling and reward sensitivity. NC patients gathered less information, tolerated a higher level of uncertainty, and were less influenced by reward contingencies than controls. NC patients also showed reduced learning in decision making and had significantly lower scores than controls in the fifth block of the IOWA gambling task. No correlations were found with measures of sleepiness. NC patients may achieve high performance in several neuropsychological domains, including executive functions. Specific differences between NC patients and controls highlight the importance of the hypocretin system in reward processing and decision making and are in line with previous neuroimaging and neurophysiological studies. PsycINFO Database Record (c) 2011 APA, all rights reserved.

From conflict management to reward-based decision making: actors and critics in primate medial frontal cortex.

PubMed

Silvetti, Massimo; Alexander, William; Verguts, Tom; Brown, Joshua W

2014-10-01

The role of the medial prefrontal cortex (mPFC) and especially the anterior cingulate cortex has been the subject of intense debate for the last decade. A number of theories have been proposed to account for its function. Broadly speaking, some emphasize cognitive control, whereas others emphasize value processing; specific theories concern reward processing, conflict detection, error monitoring, and volatility detection, among others. Here we survey and evaluate them relative to experimental results from neurophysiological, anatomical, and cognitive studies. We argue for a new conceptualization of mPFC, arising from recent computational modeling work. Based on reinforcement learning theory, these new models propose that mPFC is an Actor-Critic system. This system is aimed to predict future events including rewards, to evaluate errors in those predictions, and finally, to implement optimal skeletal-motor and visceromotor commands to obtain reward. This framework provides a comprehensive account of mPFC function, accounting for and predicting empirical results across different levels of analysis, including monkey neurophysiology, human ERP, human neuroimaging, and human behavior. Copyright © 2013 Elsevier Ltd. All rights reserved.

Neural processing of reward in adolescent rodents.

PubMed

Simon, Nicholas W; Moghaddam, Bita

2015-02-01

Immaturities in adolescent reward processing are thought to contribute to poor decision making and increased susceptibility to develop addictive and psychiatric disorders. Very little is known; however, about how the adolescent brain processes reward. The current mechanistic theories of reward processing are derived from adult models. Here we review recent research focused on understanding of how the adolescent brain responds to rewards and reward-associated events. A critical aspect of this work is that age-related differences are evident in neuronal processing of reward-related events across multiple brain regions even when adolescent rats demonstrate behavior similar to adults. These include differences in reward processing between adolescent and adult rats in orbitofrontal cortex and dorsal striatum. Surprisingly, minimal age related differences are observed in ventral striatum, which has been a focal point of developmental studies. We go on to discuss the implications of these differences for behavioral traits affected in adolescence, such as impulsivity, risk-taking, and behavioral flexibility. Collectively, this work suggests that reward-evoked neural activity differs as a function of age and that regions such as the dorsal striatum that are not traditionally associated with affective processing in adults may be critical for reward processing and psychiatric vulnerability in adolescents. Copyright © 2014 The Authors. Published by Elsevier Ltd.. All rights reserved.

Dopamine Depletion Reduces Food-Related Reward Activity Independent of BMI

PubMed Central

Frank, Sabine; Veit, Ralf; Sauer, Helene; Enck, Paul; Friederich, Hans-Christoph; Unholzer, Theresa; Bauer, Ute-Maria; Linder, Katarzyna; Heni, Martin; Fritsche, Andreas; Preissl, Hubert

2016-01-01

Reward sensitivity and possible alterations in the dopaminergic-reward system are associated with obesity. We therefore aimed to investigate the influence of dopamine depletion on food-reward processing. We investigated 34 female subjects in a randomized placebo-controlled, within-subject design (body mass index (BMI)=27.0 kg/m2 ±4.79 SD; age=28 years ±4.97 SD) using an acute phenylalanine/tyrosine depletion drink representing dopamine depletion and a balanced amino acid drink as the control condition. Brain activity was measured with functional magnetic resonance imaging during a ‘wanting' and ‘liking' rating of food items. Eating behavior-related traits and states were assessed on the basis of questionnaires. Dopamine depletion resulted in reduced activation in the striatum and higher activation in the superior frontal gyrus independent of BMI. Brain activity during the wanting task activated a more distributed network than during the liking task. This network included gustatory, memory, visual, reward, and frontal regions. An interaction effect of dopamine depletion and the wanting/liking task was observed in the hippocampus. The interaction with the covariate BMI was significant in motor and control regions but not in the striatum. Our results support the notion of altered brain activity in the reward and prefrontal network with blunted dopaminergic action during food-reward processing. This effect is, however, independent of BMI, which contradicts the reward-deficiency hypothesis. This hints to the hypothesis suggesting a different or more complex mechanism underlying the dopaminergic reward function in obesity. PMID:26450814

Abnormal Social Reward Responses in Anorexia Nervosa: An fMRI Study.

PubMed

Via, Esther; Soriano-Mas, Carles; Sánchez, Isabel; Forcano, Laura; Harrison, Ben J; Davey, Christopher G; Pujol, Jesús; Martínez-Zalacaín, Ignacio; Menchón, José M; Fernández-Aranda, Fernando; Cardoner, Narcís

2015-01-01

Patients with anorexia nervosa (AN) display impaired social interactions, implicated in the development and prognosis of the disorder. Importantly, social behavior is modulated by reward-based processes, and dysfunctional at-brain-level reward responses have been involved in AN neurobiological models. However, no prior evidence exists of whether these neural alterations would be equally present in social contexts. In this study, we conducted a cross-sectional social-judgment functional magnetic resonance imaging (fMRI) study of 20 restrictive-subtype AN patients and 20 matched healthy controls. Brain activity during acceptance and rejection was investigated and correlated with severity measures (Eating Disorder Inventory -EDI-2) and with personality traits of interest known to modulate social behavior (The Sensitivity to Punishment and Sensitivity to Reward Questionnaire). Patients showed hypoactivation of the dorsomedial prefrontal cortex (DMPFC) during social acceptance and hyperactivation of visual areas during social rejection. Ventral striatum activation during rejection was positively correlated in patients with clinical severity scores. During acceptance, activation of the frontal opercula-anterior insula and dorsomedial/dorsolateral prefrontal cortices was differentially associated with reward sensitivity between groups. These results suggest an abnormal motivational drive for social stimuli, and involve overlapping social cognition and reward systems leading to a disruption of adaptive responses in the processing of social reward. The specific association of reward-related regions with clinical and psychometric measures suggests the putative involvement of reward structures in the maintenance of pathological behaviors in AN.

The Dopamine Prediction Error: Contributions to Associative Models of Reward Learning

PubMed Central

Nasser, Helen M.; Calu, Donna J.; Schoenbaum, Geoffrey; Sharpe, Melissa J.

2017-01-01

Phasic activity of midbrain dopamine neurons is currently thought to encapsulate the prediction-error signal described in Sutton and Barto’s (1981) model-free reinforcement learning algorithm. This phasic signal is thought to contain information about the quantitative value of reward, which transfers to the reward-predictive cue after learning. This is argued to endow the reward-predictive cue with the value inherent in the reward, motivating behavior toward cues signaling the presence of reward. Yet theoretical and empirical research has implicated prediction-error signaling in learning that extends far beyond a transfer of quantitative value to a reward-predictive cue. Here, we review the research which demonstrates the complexity of how dopaminergic prediction errors facilitate learning. After briefly discussing the literature demonstrating that phasic dopaminergic signals can act in the manner described by Sutton and Barto (1981), we consider how these signals may also influence attentional processing across multiple attentional systems in distinct brain circuits. Then, we discuss how prediction errors encode and promote the development of context-specific associations between cues and rewards. Finally, we consider recent evidence that shows dopaminergic activity contains information about causal relationships between cues and rewards that reflect information garnered from rich associative models of the world that can be adapted in the absence of direct experience. In discussing this research we hope to support the expansion of how dopaminergic prediction errors are thought to contribute to the learning process beyond the traditional concept of transferring quantitative value. PMID:28275359

Discrete neurochemical coding of distinguishable motivational processes: insights from nucleus accumbens control of feeding.

PubMed

Baldo, Brian A; Kelley, Ann E

2007-04-01

The idea that nucleus accumbens (Acb) dopamine transmission contributes to the neural mediation of reward, at least in a general sense, has achieved wide acceptance. Nevertheless, debate remains over the precise nature of dopamine's role in reward and even over the nature of reward itself. In the present article, evidence is reviewed from studies of food intake, feeding microstructure, instrumental responding for food reinforcement, and dopamine efflux associated with feeding, which suggests that reward processing in the Acb is best understood as an interaction among distinct processes coded by discrete neurotransmitter systems. In agreement with several theories of Acb dopamine function, it is proposed here that allocation of motor effort in seeking food or food-associated conditioned stimuli can be dissociated from computations relevant to the hedonic evaluation of food during the consummatory act. The former appears to depend upon Acb dopamine transmission and the latter upon striatal opioid peptide release. Moreover, dopamine transmission may play a role in 'stamping in' associations between motor acts and goal attainment and perhaps also neural representations corresponding to rewarding outcomes. Finally, evidence is reviewed that amino acid transmission specifically in the Acb shell acts as a central 'circuit breaker' to flexibly enable or terminate the consummatory act, via descending connections to hypothalamic feeding control systems. The heuristic framework outlined above may help explain why dopamine-compromising manipulations that strongly diminish instrumental goal-seeking behaviors leave consummatory activity relatively unaffected.

Effects of alexithymia and empathy on the neural processing of social and monetary rewards.

PubMed

Goerlich, Katharina Sophia; Votinov, Mikhail; Lammertz, Sarah E; Winkler, Lina; Spreckelmeyer, Katja N; Habel, Ute; Gründer, Gerhard; Gossen, Anna

2017-07-01

Empathy has been found to affect the neural processing of social and monetary rewards. Alexithymia, a subclinical condition showing a close inverse relationship with empathy is linked to dysfunctions of socio-emotional processing in the brain. Whether alexithymia alters the neural processing of rewards, which is currently unknown. Here, we investigated the influence of both alexithymia and empathy on reward processing using a social incentive delay (SID) task and a monetary incentive delay (MID) task in 45 healthy men undergoing functional magnetic resonance imaging. Controlling for temperament-character dimensions and rejection sensitivity, the relationship of alexithymia and empathy with neural activity in several a priori regions of interest (ROIs) was examined by means of partial correlations, while participants anticipated and received social and monetary rewards. Results were considered significant if they survived Holm-Bonferroni correction for multiple comparisons. Alexithymia modulated neural activity in several ROIs of the emotion and reward network, both during the anticipation of social and monetary rewards and in response to the receipt of monetary rewards. In contrast, empathy did not affect reward anticipation and modulated ROI activity only in response to the receipt of social rewards. These results indicate a significant influence of alexithymia on the processing of social and monetary rewards in the healthy brain.

Reward Promotes Self-Face Processing: An Event-Related Potential Study

PubMed Central

Zhan, Youlong; Chen, Jie; Xiao, Xiao; Li, Jin; Yang, Zilu; Fan, Wei; Zhong, Yiping

2016-01-01

The present study adopted a reward-priming paradigm to investigate whether and how monetary reward cues affected self-face processing. Event-related potentials were recorded during judgments of head orientation of target faces (self, friend, and stranger), with performance associated with a monetary reward. The results showed self-faces elicited larger N2 mean amplitudes than other-faces, and mean N2 amplitudes increased after monetary reward as compared with no reward cue. Moreover, an interaction effect between cue type and face type was observed for the P3 component, suggesting that both self-faces and friend-faces elicited larger P3 mean amplitudes than stranger-faces after no reward cue, with no significant difference between self-faces and friend-faces under this condition. However, self-faces elicited larger P3 mean amplitudes than friend-faces when monetary reward cues were provided. Interestingly, the enhancement of reward on friend-faces processing was observed at late positive potentials (LPP; 450–600 ms), suggesting that the LPP difference between friend-faces and stranger-faces was enhanced with monetary reward cues. Thus, we found that the enhancement effect of reward on self-relevant processing occurred at the later stages, but not at the early stage. These findings suggest that the activation of the reward expectations can enhance self-face processing, yielding a robust and sustained modulation over their overlapped brain areas where reward and self-relevant processing mechanisms may operate together. PMID:27242637

Dopamine neuronal loss contributes to memory and reward dysfunction in a model of Alzheimer's disease

PubMed Central

Nobili, Annalisa; Latagliata, Emanuele Claudio; Viscomi, Maria Teresa; Cavallucci, Virve; Cutuli, Debora; Giacovazzo, Giacomo; Krashia, Paraskevi; Rizzo, Francesca Romana; Marino, Ramona; Federici, Mauro; De Bartolo, Paola; Aversa, Daniela; Dell'Acqua, Maria Concetta; Cordella, Alberto; Sancandi, Marco; Keller, Flavio; Petrosini, Laura; Puglisi-Allegra, Stefano; Mercuri, Nicola Biagio; Coccurello, Roberto; Berretta, Nicola; D'Amelio, Marcello

2017-01-01

Alterations of the dopaminergic (DAergic) system are frequently reported in Alzheimer's disease (AD) patients and are commonly linked to cognitive and non-cognitive symptoms. However, the cause of DAergic system dysfunction in AD remains to be elucidated. We investigated alterations of the midbrain DAergic system in the Tg2576 mouse model of AD, overexpressing a mutated human amyloid precursor protein (APPswe). Here, we found an age-dependent DAergic neuron loss in the ventral tegmental area (VTA) at pre-plaque stages, although substantia nigra pars compacta (SNpc) DAergic neurons were intact. The selective VTA DAergic neuron degeneration results in lower DA outflow in the hippocampus and nucleus accumbens (NAc) shell. The progression of DAergic cell death correlates with impairments in CA1 synaptic plasticity, memory performance and food reward processing. We conclude that in this mouse model of AD, degeneration of VTA DAergic neurons at pre-plaque stages contributes to memory deficits and dysfunction of reward processing. PMID:28367951

Evidence for deficits in reward responsivity in antisocial youth with callous-unemotional traits.

PubMed

Marini, Victoria A; Stickle, Timothy R

2010-10-01

This study investigated reward responsivity in youth with high levels of callous-unemotional (CU) traits using a cross-sectional design. Whereas deficits in responding to punishment cues are well established in youth with CU traits, it is unclear whether responsivity to rewarding stimuli is impaired as well. Participants were 148 predominantly Caucasian, adjudicated adolescents between the ages of 11 and 17 (M = 15.1, SD = 1.4) who completed the Balloon Analogue Risk Task as part of a larger battery investigating aggression and social information processing. A Reward Responsivity variable was created to capture changes in participants' responding after receiving a reward. A hierarchical regression analysis indicated that higher levels of CU traits significantly predicted less reward responsivity, above and beyond gender, sensation seeking, and impulsivity. Results support Blair's (2004) Integrated Emotion Systems model that proposes individuals with CU traits are impaired in their responsivity to both appetitive and aversive stimuli.

Illicit dopamine transients: reconciling actions of abused drugs.

PubMed

Covey, Dan P; Roitman, Mitchell F; Garris, Paul A

2014-04-01

Phasic increases in brain dopamine are required for cue-directed reward seeking. Although compelling within the framework of appetitive behavior, the view that illicit drugs hijack reward circuits by hyperactivating these dopamine transients is inconsistent with established psychostimulant pharmacology. However, recent work reclassifying amphetamine (AMPH), cocaine, and other addictive dopamine-transporter inhibitors (DAT-Is) supports transient hyperactivation as a unifying hypothesis of abused drugs. We argue here that reclassification also identifies generating burst firing by dopamine neurons as a keystone action. Unlike natural rewards, which are processed by sensory systems, drugs act directly on the brain. Consequently, to mimic natural rewards and exploit reward circuits, dopamine transients must be elicited de novo. Of available drug targets, only burst firing achieves this essential outcome. Copyright © 2014 Elsevier Ltd. All rights reserved.

Distinct medial temporal networks encode surprise during motivation by reward versus punishment

PubMed Central

Murty, Vishnu P.; LaBar, Kevin S.; Adcock, R. Alison

2016-01-01

Adaptive motivated behavior requires predictive internal representations of the environment, and surprising events are indications for encoding new representations of the environment. The medial temporal lobe memory system, including the hippocampus and surrounding cortex, encodes surprising events and is influenced by motivational state. Because behavior reflects the goals of an individual, we investigated whether motivational valence (i.e., pursuing rewards versus avoiding punishments) also impacts neural and mnemonic encoding of surprising events. During functional magnetic resonance imaging (fMRI), participants encountered perceptually unexpected events either during the pursuit of rewards or avoidance of punishments. Despite similar levels of motivation across groups, reward and punishment facilitated the processing of surprising events in different medial temporal lobe regions. Whereas during reward motivation, perceptual surprises enhanced activation in the hippocampus, during punishment motivation surprises instead enhanced activation in parahippocampal cortex. Further, we found that reward motivation facilitated hippocampal coupling with ventromedial PFC, whereas punishment motivation facilitated parahippocampal cortical coupling with orbitofrontal cortex. Behaviorally, post-scan testing revealed that reward, but not punishment, motivation resulted in greater memory selectivity for surprising events encountered during goal pursuit. Together these findings demonstrate that neuromodulatory systems engaged by anticipation of reward and punishment target separate components of the medial temporal lobe, modulating medial temporal lobe sensitivity and connectivity. Thus, reward and punishment motivation yield distinct neural contexts for learning, with distinct consequences for how surprises are incorporated into predictive mnemonic models of the environment. PMID:26854903

Distinct medial temporal networks encode surprise during motivation by reward versus punishment.

PubMed

Murty, Vishnu P; LaBar, Kevin S; Adcock, R Alison

2016-10-01

Adaptive motivated behavior requires predictive internal representations of the environment, and surprising events are indications for encoding new representations of the environment. The medial temporal lobe memory system, including the hippocampus and surrounding cortex, encodes surprising events and is influenced by motivational state. Because behavior reflects the goals of an individual, we investigated whether motivational valence (i.e., pursuing rewards versus avoiding punishments) also impacts neural and mnemonic encoding of surprising events. During functional magnetic resonance imaging (fMRI), participants encountered perceptually unexpected events either during the pursuit of rewards or avoidance of punishments. Despite similar levels of motivation across groups, reward and punishment facilitated the processing of surprising events in different medial temporal lobe regions. Whereas during reward motivation, perceptual surprises enhanced activation in the hippocampus, during punishment motivation surprises instead enhanced activation in parahippocampal cortex. Further, we found that reward motivation facilitated hippocampal coupling with ventromedial PFC, whereas punishment motivation facilitated parahippocampal cortical coupling with orbitofrontal cortex. Behaviorally, post-scan testing revealed that reward, but not punishment, motivation resulted in greater memory selectivity for surprising events encountered during goal pursuit. Together these findings demonstrate that neuromodulatory systems engaged by anticipation of reward and punishment target separate components of the medial temporal lobe, modulating medial temporal lobe sensitivity and connectivity. Thus, reward and punishment motivation yield distinct neural contexts for learning, with distinct consequences for how surprises are incorporated into predictive mnemonic models of the environment. Copyright © 2016 Elsevier Inc. All rights reserved.

Selectivity in Postencoding Connectivity with High-Level Visual Cortex Is Associated with Reward-Motivated Memory.

PubMed

Murty, Vishnu P; Tompary, Alexa; Adcock, R Alison; Davachi, Lila

2017-01-18

Reward motivation has been demonstrated to enhance declarative memory by facilitating systems-level consolidation. Although high-reward information is often intermixed with lower reward information during an experience, memory for high value information is prioritized. How is this selectivity achieved? One possibility is that postencoding consolidation processes bias memory strengthening to those representations associated with higher reward. To test this hypothesis, we investigated the influence of differential reward motivation on the selectivity of postencoding markers of systems-level memory consolidation. Human participants encoded intermixed, trial-unique memoranda that were associated with either high or low-value during fMRI acquisition. Encoding was interleaved with periods of rest, allowing us to investigate experience-dependent changes in connectivity as they related to later memory. Behaviorally, we found that reward motivation enhanced 24 h associative memory. Analysis of patterns of postencoding connectivity showed that, even though learning trials were intermixed, there was significantly greater connectivity with regions of high-level, category-selective visual cortex associated with high-reward trials. Specifically, increased connectivity of category-selective visual cortex with both the VTA and the anterior hippocampus predicted associative memory for high- but not low-reward memories. Critically, these results were independent of encoding-related connectivity and univariate activity measures. Thus, these findings support a model by which the selective stabilization of memories for salient events is supported by postencoding interactions with sensory cortex associated with reward. Reward motivation is thought to promote memory by supporting memory consolidation. Yet, little is known as to how brain selects relevant information for subsequent consolidation based on reward. We show that experience-dependent changes in connectivity of both the anterior hippocampus and the VTA with high-level visual cortex selectively predicts memory for high-reward memoranda at a 24 h delay. These findings provide evidence for a novel mechanism guiding the consolidation of memories for valuable events, namely, postencoding interactions between neural systems supporting mesolimbic dopamine activation, episodic memory, and perception. Copyright © 2017 the authors 0270-6474/17/370537-09$15.00/0.

Implication of Dopaminergic Modulation in Operant Reward Learning and the Induction of Compulsive-Like Feeding Behavior in "Aplysia"

ERIC Educational Resources Information Center

Bedecarrats, Alexis; Cornet, Charles; Simmers, John; Nargeot, Romuald

2013-01-01

Feeding in "Aplysia" provides an amenable model system for analyzing the neuronal substrates of motivated behavior and its adaptability by associative reward learning and neuromodulation. Among such learning processes, appetitive operant conditioning that leads to a compulsive-like expression of feeding actions is known to be associated…

Reward bias and lateralization in gambling behavior: behavioral activation system and alpha band analysis.

PubMed

Balconi, Michela; Finocchiaro, Roberta; Canavesio, Ylenia; Messina, Rossella

2014-11-30

The present research explored the main factors that can influence subjects' choices in the case of decisions. In order to elucidate the individual differences that influence the decisional processes, making their strategies more or less advantageous, we tested the effect of a reward sensitivity in the behavioral activation system (BAS-Reward) constructed on the ability to distinguish between high- and low-risk decisions. Secondly, the lateralization effect, related to increased activation of the left (BAS-related) hemisphere, was explored. Thirty-one subjects were tested using the Iowa Gambling Task, and the BAS-Reward measure was applied to distinguish between high-BAS and low-BAS groups. Behavioral responses (gain/loss options) and alpha-band modulation were considered. It was found that high-BAS group increased their tendency to opt in favor of the immediate reward (loss strategy) rather than the long-term option (win strategy). Secondly, high-BAS subjects showed an increased left-hemisphere activation in response to losing (with immediate reward) choices in comparison with low-BAS subjects. A "reward bias" effect was supposed to explain both the bad strategy and the unbalanced hemispheric activation for high-BAS and more risk-taking subjects. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Neurobiological constraints on behavioral models of motivation.

PubMed

Nader, K; Bechara, A; van der Kooy, D

1997-01-01

The application of neurobiological tools to behavioral questions has produced a number of working models of the mechanisms mediating the rewarding and aversive properties of stimuli. The authors review and compare three models that differ in the nature and number of the processes identified. The dopamine hypothesis, a single system model, posits that the neurotransmitter dopamine plays a fundamental role in mediating the rewarding properties of all classes of stimuli. In contrast, both nondeprived/deprived and saliency attribution models claim that separate systems make independent contributions to reward. The former identifies the psychological boundary defined by the two systems as being between states of nondeprivation (e.g. food sated) and deprivation (e.g. hunger). The latter identifies a boundary between liking and wanting systems. Neurobiological dissociations provide tests of and explanatory power for behavioral theories of goal-directed behavior.

Serotonergic antidepressants decrease hedonic signals but leave learning signals in the nucleus accumbens unaffected.

PubMed

Graf, Heiko; Metzger, Coraline D; Walter, Martin; Abler, Birgit

2016-01-06

Investigating the effects of serotonergic antidepressants on neural correlates of visual erotic stimulation revealed decreased reactivity within the dopaminergic reward network along with decreased subjective sexual functioning compared with placebo. However, a global dampening of the reward system under serotonergic drugs is not intuitive considering clinical observations of their beneficial effects in the treatment of depression. Particularly, learning signals as coded in prediction error processing within the dopaminergic reward system can be assumed to be rather enhanced as antidepressant drugs have been demonstrated to facilitate the efficacy of psychotherapeutic interventions relying on learning processes. Within the same study sample, we now explored the effects of serotonergic and dopaminergic/noradrenergic antidepressants on prediction error signals compared with placebo by functional MRI. A total of 17 healthy male participants (mean age: 25.4 years) were investigated under the administration of paroxetine, bupropion and placebo for 7 days each within a randomized, double-blind, within-subject cross-over design. During functional MRI, we used an established monetary incentive task to explore neural prediction error signals within the bilateral nucleus accumbens as region of interest within the dopaminergic reward system. In contrast to diminished neural activations and subjective sexual functioning under the serotonergic agent paroxetine under visual erotic stimulation, we revealed unaffected or even enhanced neural prediction error processing within the nucleus accumbens under this antidepressant along with unaffected behavioural processing. Our study provides evidence that serotonergic antidepressants facilitate prediction error signalling and may support suggestions of beneficial effects of these agents on reinforced learning as an essential element in behavioural psychotherapy.

Neural substrates of reward magnitude, probability, and risk during a wheel of fortune decision-making task.

PubMed

Smith, Bruce W; Mitchell, Derek G V; Hardin, Michael G; Jazbec, Sandra; Fridberg, Daniel; Blair, R James R; Ernst, Monique

2009-01-15

Economic decision-making involves the weighting of magnitude and probability of potential gains/losses. While previous work has examined the neural systems involved in decision-making, there is a need to understand how the parameters associated with decision-making (e.g., magnitude of expected reward, probability of expected reward and risk) modulate activation within these neural systems. In the current fMRI study, we modified the monetary wheel of fortune (WOF) task [Ernst, M., Nelson, E.E., McClure, E.B., Monk, C.S., Munson, S., Eshel, N., et al. (2004). Choice selection and reward anticipation: an fMRI study. Neuropsychologia 42(12), 1585-1597.] to examine in 25 healthy young adults the neural responses to selections of different reward magnitudes, probabilities, or risks. Selection of high, relative to low, reward magnitude increased activity in insula, amygdala, middle and posterior cingulate cortex, and basal ganglia. Selection of low-probability, as opposed to high-probability reward, increased activity in anterior cingulate cortex, as did selection of risky, relative to safe reward. In summary, decision-making that did not involve conflict, as in the magnitude contrast, recruited structures known to support the coding of reward values, and those that integrate motivational and perceptual information for behavioral responses. In contrast, decision-making under conflict, as in the probability and risk contrasts, engaged the dorsal anterior cingulate cortex whose role in conflict monitoring is well established. However, decision-making under conflict failed to activate the structures that track reward values per se. Thus, the presence of conflict in decision-making seemed to significantly alter the pattern of neural responses to simple rewards. In addition, this paradigm further clarifies the functional specialization of the cingulate cortex in processes of decision-making.

Ventral striatal activity links adversity and reward processing in children.

PubMed

Kamkar, Niki H; Lewis, Daniel J; van den Bos, Wouter; Morton, J Bruce

2017-08-01

Adversity impacts many aspects of psychological and physical development including reward-based learning and decision-making. Mechanisms relating adversity and reward processing in children, however, remain unclear. Here, we show that adversity is associated with potentiated learning from positive outcomes and impulsive decision-making, but unrelated to learning from negative outcomes. We then show via functional magnetic resonance imaging that the link between adversity and reward processing is partially mediated by differences in ventral striatal response to rewards. The findings suggest that early-life adversity is associated with alterations in the brain's sensitivity to rewards accounting, in part, for the link between adversity and altered reward processing in children. Copyright © 2017 The Authors. Published by Elsevier Ltd.. All rights reserved.

Task preparation processes related to reward prediction precede those related to task-difficulty expectation

PubMed Central

Schevernels, Hanne; Krebs, Ruth M.; Santens, Patrick; Woldorff, Marty G.; Boehler, C. Nico

2013-01-01

Recently, attempts have been made to disentangle the neural underpinnings of preparatory processes related to reward and attention. Functional magnetic resonance imaging (fMRI) research showed that neural activity related to the anticipation of reward and to attentional demands invokes neural activity patterns featuring large-scale overlap, along with some differences and interactions. Due to the limited temporal resolution of fMRI, however, the temporal dynamics of these processes remain unclear. Here, we report an event-related potentials (ERP) study in which cued attentional demands and reward prospect were combined in a factorial design. Results showed that reward prediction dominated early cue processing, as well as the early and later parts of the contingent negative variation (CNV) slow-wave ERP component that has been associated with task-preparation processes. Moreover these reward-related electrophysiological effects correlated across participants with response-time speeding on reward-prospect trials. In contrast, cued attentional demands affected only the later part of the CNV, with the highest amplitudes following cues predicting high-difficulty potential-reward targets, thus suggesting maximal task preparation when the task requires it and entails reward prospect. Consequently, we suggest that task-preparation processes triggered by reward can arise earlier, and potentially more directly, than strategic top-down aspects of preparation based on attentional demands. PMID:24064071

BAS-drive trait modulates dorsomedial striatum activity during reward response-outcome associations.

PubMed

Costumero, Víctor; Barrós-Loscertales, Alfonso; Fuentes, Paola; Rosell-Negre, Patricia; Bustamante, Juan Carlos; Ávila, César

2016-09-01

According to the Reinforcement Sensitivity Theory, behavioral studies have found that individuals with stronger reward sensitivity easily detect cues of reward and establish faster associations between instrumental responses and reward. Neuroimaging studies have shown that processing anticipatory cues of reward is accompanied by stronger ventral striatum activity in individuals with stronger reward sensitivity. Even though establishing response-outcome contingencies has been consistently associated with dorsal striatum, individual differences in this process are poorly understood. Here, we aimed to study the relation between reward sensitivity and brain activity while processing response-reward contingencies. Forty-five participants completed the BIS/BAS questionnaire and performed a gambling task paradigm in which they received monetary rewards or punishments. Overall, our task replicated previous results that have related processing high reward outcomes with activation of striatum and medial frontal areas, whereas processing high punishment outcomes was associated with stronger activity in insula and middle cingulate. As expected, the individual differences in the activity of dorsomedial striatum correlated positively with BAS-Drive. Our results agree with previous studies that have related the dorsomedial striatum with instrumental performance, and suggest that the individual differences in this area may form part of the neural substrate responsible for modulating instrumental conditioning by reward sensitivity.

Comparing the effects of food restriction and overeating on brain reward systems.

PubMed

Avena, Nicole M; Murray, Susan; Gold, Mark S

2013-10-01

Both caloric restriction and overeating have been shown to affect neural processes associated with reinforcement. Both preclinical and some clinical studies have provided evidence that food restriction may increase reward sensitivity, and while there are mixed findings regarding the effects of overeating on reward sensitivity, there is strong evidence linking this behavior with changes in reward-related brain regions. Evidence of these changes comes in part from findings that show that such eating patterns are associated with increased drug use. The data discussed here regarding the differential effects of various eating patterns on reward systems may be particularly relevant to the aging population, as this population has been shown to exhibit altered reward sensitivity and decreased caloric consumption. Moreover, members of this population appear to be increasingly affected by the current obesity epidemic. Food, like alcohol or drugs, can stimulate its own consumption and produce similar neurochemical changes in the brain. Age-related loss of appetite, decreased eating, and caloric restriction are hypothesized to be associated with changes in the prevalence of substance misuse, abuse, and dependence seen in this cohort. Copyright © 2013 Elsevier Inc. All rights reserved.

Occupational safety and health as an element of a complex compensation system evaluation within an organization.

PubMed

Beck-Krala, Ewa; Klimkiewicz, Katarzyna

2016-12-01

Occupational safety and health (OSH) plays a significant role in today's organizations, because it helps in attracting and retaining employees as well as molding their attitudes and behaviors at work. This is why the issue of OSH is stressed in a comprehensive approach to employee rewards: the total reward concept. This article explains how OSH may be included in a complex evaluation process of the compensation system. Although the literature on the effectiveness of employee compensation refers mainly to financial and non-financial components, there is a need for inclusion of working conditions in such analyses. An evaluation of the compensation system that incorporates OSH can drive many benefits for both the organization and employees. Obtaining such benefits, however, requires systematic evaluation of the reward system, including OSH. Incorporation of OSH issue within the comprehensive analysis of compensation systems promotes responsible behavior of all stakeholders.

Detecting Cyber Attacks On Nuclear Power Plants

NASA Astrophysics Data System (ADS)

Rrushi, Julian; Campbell, Roy

This paper proposes an unconventional anomaly detection approach that provides digital instrumentation and control (I&C) systems in a nuclear power plant (NPP) with the capability to probabilistically discern between legitimate protocol frames and attack frames. The stochastic activity network (SAN) formalism is used to model the fusion of protocol activity in each digital I&C system and the operation of physical components of an NPP. SAN models are employed to analyze links between protocol frames as streams of bytes, their semantics in terms of NPP operations, control data as stored in the memory of I&C systems, the operations of I&C systems on NPP components, and NPP processes. Reward rates and impulse rewards are defined in the SAN models based on the activity-marking reward structure to estimate NPP operation profiles. These profiles are then used to probabilistically estimate the legitimacy of the semantics and payloads of protocol frames received by I&C systems.

Altered prefrontal correlates of monetary anticipation and outcome in chronic pain.

PubMed

Martucci, Katherine T; Borg, Nicholas; MacNiven, Kelly H; Knutson, Brian; Mackey, Sean C

2018-04-04

Chronic pain may alter both affect- and value-related behaviors, which represents a potentially treatable aspect of chronic pain experience. Current understanding of how chronic pain influences the function of brain reward systems, however, is limited. Using a monetary incentive delay task and functional magnetic resonance imaging (fMRI), we measured neural correlates of reward anticipation and outcomes in female participants with the chronic pain condition of fibromyalgia (N = 17) and age-matched, pain-free, female controls (N = 15). We hypothesized that patients would demonstrate lower positive arousal, as well as altered reward anticipation and outcome activity within corticostriatal circuits implicated in reward processing. Patients demonstrated lower arousal ratings as compared with controls, but no group differences were observed for valence, positive arousal, or negative arousal ratings. Group fMRI analyses were conducted to determine predetermined region of interest, nucleus accumbens (NAcc) and medial prefrontal cortex (mPFC), responses to potential gains, potential losses, reward outcomes, and punishment outcomes. Compared with controls, patients demonstrated similar, although slightly reduced, NAcc activity during gain anticipation. Conversely, patients demonstrated dramatically reduced mPFC activity during gain anticipation-possibly related to lower estimated reward probabilities. Further, patients demonstrated normal mPFC activity to reward outcomes, but dramatically heightened mPFC activity to no-loss (nonpunishment) outcomes. In parallel to NAcc and mPFC responses, patients demonstrated slightly reduced activity during reward anticipation in other brain regions, which included the ventral tegmental area, anterior cingulate cortex, and anterior insular cortex. Together, these results implicate altered corticostriatal processing of monetary rewards in chronic pain.

Integration of reward with cost anticipation during performance monitoring revealed by ERPs and EEG spectral perturbations.

PubMed

Gheza, Davide; De Raedt, Rudi; Baeken, Chris; Pourtois, Gilles

2018-06-01

Effort expenditure has an aversive connotation and it can lower hedonic feelings. In this study, we explored the electrophysiological correlates of the complex interplay of reward processing with cost anticipation. To this aim, healthy adult participants performed a gambling task where the outcome (monetary reward vs. no-reward) and its expectancy were manipulated on a trial by trial basis while 64-channel EEG was recorded. Crucially, on some trials, the no-reward outcome could be transformed to a rewarding one, pending effort expenditure by means of an orthogonal dot clicking task, enabling us to compare at the electrophysiological level reward processing when cost was anticipated or not. We extracted and compared different markers of reward processing at the feedback level using both classical ERPs and EEG spectral perturbations in specific bands (theta, delta and beta-gamma). At the behavioral level, participants reported enhanced pleasure and relief when the outcome was rewarding but effort expenditure could be avoided, relative to a control condition where the outcome was rewarding but no extra effort was anticipated. In this condition, EEG results showed a larger Reward Positivity ERP component and increased power in the Delta and Beta-gamma bands. By comparison, cost anticipation did not influence the processing of the no-reward outcome at the FRN and frontal midline theta levels. All together, these neurophysiological results suggest that effort avoidance is associated with increased reward processing. Copyright © 2018 Elsevier Inc. All rights reserved.

Repeated cocaine exposure facilitates the expression of incentive motivation and induces habitual control in rats.

PubMed

LeBlanc, Kimberly H; Maidment, Nigel T; Ostlund, Sean B

2013-01-01

There is growing evidence that mere exposure to drugs can induce long-term alterations in the neural systems that mediate reward processing, motivation, and behavioral control, potentially causing the pathological pursuit of drugs that characterizes the addicted state. The incentive sensitization theory proposes that drug exposure potentiates the influence of reward-paired cues on behavior. It has also been suggested that drug exposure biases action selection towards the automatic execution of habits and away from more deliberate goal-directed control. The current study investigated whether rats given repeated exposure to peripherally administered cocaine would show alterations in incentive motivation (assayed using the Pavlovian-to-instrumental transfer (PIT) paradigm) or habit formation (assayed using sensitivity to reward devaluation). After instrumental and Pavlovian training for food pellet rewards, rats were given 6 daily injections of cocaine (15 mg/kg, IP) or saline, followed by a 10-d period of rest. Consistent with the incentive sensitization theory, cocaine-treated rats showed stronger cue-evoked lever pressing than saline-treated rats during the PIT test. The same rats were then trained on a new instrumental action with a new food pellet reward before undergoing a reward devaluation testing. Although saline-treated rats exhibited sensitivity to reward devaluation, indicative of goal-directed performance, cocaine-treated rats were insensitive to this treatment, suggesting a reliance on habitual processes. These findings, when taken together, indicate that repeated exposure to cocaine can cause broad alterations in behavioral control, spanning both motivational and action selection processes, and could therefore help explain aberrations of decision-making that underlie drug addiction.

Repeated Cocaine Exposure Facilitates the Expression of Incentive Motivation and Induces Habitual Control in Rats

PubMed Central

LeBlanc, Kimberly H.; Maidment, Nigel T.; Ostlund, Sean B.

2013-01-01

There is growing evidence that mere exposure to drugs can induce long-term alterations in the neural systems that mediate reward processing, motivation, and behavioral control, potentially causing the pathological pursuit of drugs that characterizes the addicted state. The incentive sensitization theory proposes that drug exposure potentiates the influence of reward-paired cues on behavior. It has also been suggested that drug exposure biases action selection towards the automatic execution of habits and away from more deliberate goal-directed control. The current study investigated whether rats given repeated exposure to peripherally administered cocaine would show alterations in incentive motivation (assayed using the Pavlovian-to-instrumental transfer (PIT) paradigm) or habit formation (assayed using sensitivity to reward devaluation). After instrumental and Pavlovian training for food pellet rewards, rats were given 6 daily injections of cocaine (15 mg/kg, IP) or saline, followed by a 10-d period of rest. Consistent with the incentive sensitization theory, cocaine-treated rats showed stronger cue-evoked lever pressing than saline-treated rats during the PIT test. The same rats were then trained on a new instrumental action with a new food pellet reward before undergoing a reward devaluation testing. Although saline-treated rats exhibited sensitivity to reward devaluation, indicative of goal-directed performance, cocaine-treated rats were insensitive to this treatment, suggesting a reliance on habitual processes. These findings, when taken together, indicate that repeated exposure to cocaine can cause broad alterations in behavioral control, spanning both motivational and action selection processes, and could therefore help explain aberrations of decision-making that underlie drug addiction. PMID:23646106

Précis of The brain and emotion.

PubMed

Rolls, E T

2000-04-01

The topics treated in The brain and emotion include the definition, nature, and functions of emotion (Ch. 3); the neural bases of emotion (Ch. 4); reward, punishment, and emotion in brain design (Ch. 10); a theory of consciousness and its application to understanding emotion and pleasure (Ch. 9); and neural networks and emotion-related learning (Appendix). The approach is that emotions can be considered as states elicited by reinforcers (rewards and punishers). This approach helps with understanding the functions of emotion, with classifying different emotions, and in understanding what information-processing systems in the brain are involved in emotion, and how they are involved. The hypothesis is developed that brains are designed around reward- and punishment-evaluation systems, because this is the way that genes can build a complex system that will produce appropriate but flexible behavior to increase fitness (Ch. 10). By specifying goals rather than particular behavioral patterns of responses, genes leave much more open the possible behavioral strategies that might be required to increase fitness. The importance of reward and punishment systems in brain design also provides a basis for understanding the brain mechanisms of motivation, as described in Chapters 2 for appetite and feeding, 5 for brain-stimulation reward, 6 for addiction, 7 for thirst, and 8 for sexual behavior.

Listening to music in a risk-reward context: The roles of the temporoparietal junction and the orbitofrontal/insular cortices in reward-anticipation, reward-gain, and reward-loss.

PubMed

Li, Chia-Wei; Chen, Jyh-Horng; Tsai, Chen-Gia

2015-12-10

Artificial rewards, such as visual arts and music, produce pleasurable feelings. Popular songs in the verse-chorus form provide a useful model for understanding the neural mechanisms underlying the processing of artificial rewards, because the chorus is usually the most rewarding element of a song. In this functional magnetic resonance imaging (fMRI) study, the stimuli were excerpts of 10 popular songs with a tensioned verse-to-chorus transition. We examined the neural correlates of three phases of reward processing: (1) reward-anticipation during the verse-to-chorus transition, (2) reward-gain during the first phrase of the chorus, and (3) reward-loss during the unexpected noise followed by the verse-to-chorus transition. Participants listened to these excerpts in a risk-reward context because the verse was followed by either the chorus or noise with equal probability. The results showed that reward-gain and reward-loss were associated with left- and right-biased temporoparietal junction activation, respectively. The bilateral temporoparietal junctions were active during reward-anticipation. Moreover, we observed left-biased lateral orbitofrontal activation during reward-anticipation, whereas the medial orbitofrontal cortex was activated during reward-gain. The findings are discussed in relation to the cognitive and emotional aspects of reward processing. Copyright © 2015 Elsevier B.V. All rights reserved.

Reward Selectively Modulates the Lingering Neural Representation of Recently Attended Objects in Natural Scenes.

PubMed

Hickey, Clayton; Peelen, Marius V

2017-08-02

Theories of reinforcement learning and approach behavior suggest that reward can increase the perceptual salience of environmental stimuli, ensuring that potential predictors of outcome are noticed in the future. However, outcome commonly follows visual processing of the environment, occurring even when potential reward cues have long disappeared. How can reward feedback retroactively cause now-absent stimuli to become attention-drawing in the future? One possibility is that reward and attention interact to prime lingering visual representations of attended stimuli that sustain through the interval separating stimulus and outcome. Here, we test this idea using multivariate pattern analysis of fMRI data collected from male and female humans. While in the scanner, participants searched for examples of target categories in briefly presented pictures of cityscapes and landscapes. Correct task performance was followed by reward feedback that could randomly have either high or low magnitude. Analysis showed that high-magnitude reward feedback boosted the lingering representation of target categories while reducing the representation of nontarget categories. The magnitude of this effect in each participant predicted the behavioral impact of reward on search performance in subsequent trials. Other analyses show that sensitivity to reward-as expressed in a personality questionnaire and in reactivity to reward feedback in the dopaminergic midbrain-predicted reward-elicited variance in lingering target and nontarget representations. Credit for rewarding outcome thus appears to be assigned to the target representation, causing the visual system to become sensitized for similar objects in the future. SIGNIFICANCE STATEMENT How do reward-predictive visual stimuli become salient and attention-drawing? In the real world, reward cues precede outcome and reward is commonly received long after potential predictors have disappeared. How can the representation of environmental stimuli be affected by outcome that occurs later in time? Here, we show that reward acts on lingering representations of environmental stimuli that sustain through the interval between stimulus and outcome. Using naturalistic scene stimuli and multivariate pattern analysis of fMRI data, we show that reward boosts the representation of attended objects and reduces the representation of unattended objects. This interaction of attention and reward processing acts to prime vision for stimuli that may serve to predict outcome. Copyright © 2017 the authors 0270-6474/17/377297-08$15.00/0.

Punishment sensitivity modulates the processing of negative feedback but not error-induced learning.

PubMed

Unger, Kerstin; Heintz, Sonja; Kray, Jutta

2012-01-01

Accumulating evidence suggests that individual differences in punishment and reward sensitivity are associated with functional alterations in neural systems underlying error and feedback processing. In particular, individuals highly sensitive to punishment have been found to be characterized by larger mediofrontal error signals as reflected in the error negativity/error-related negativity (Ne/ERN) and the feedback-related negativity (FRN). By contrast, reward sensitivity has been shown to relate to the error positivity (Pe). Given that Ne/ERN, FRN, and Pe have been functionally linked to flexible behavioral adaptation, the aim of the present research was to examine how these electrophysiological reflections of error and feedback processing vary as a function of punishment and reward sensitivity during reinforcement learning. We applied a probabilistic learning task that involved three different conditions of feedback validity (100%, 80%, and 50%). In contrast to prior studies using response competition tasks, we did not find reliable correlations between punishment sensitivity and the Ne/ERN. Instead, higher punishment sensitivity predicted larger FRN amplitudes, irrespective of feedback validity. Moreover, higher reward sensitivity was associated with a larger Pe. However, only reward sensitivity was related to better overall learning performance and higher post-error accuracy, whereas highly punishment sensitive participants showed impaired learning performance, suggesting that larger negative feedback-related error signals were not beneficial for learning or even reflected maladaptive information processing in these individuals. Thus, although our findings indicate that individual differences in reward and punishment sensitivity are related to electrophysiological correlates of error and feedback processing, we found less evidence for influences of these personality characteristics on the relation between performance monitoring and feedback-based learning.

The habenula governs the attribution of incentive salience to reward predictive cues

PubMed Central

Danna, Carey L.; Shepard, Paul D.; Elmer, Greg I.

2013-01-01

The attribution of incentive salience to reward associated cues is critical for motivation and the pursuit of rewards. Disruptions in the integrity of the neural systems controlling these processes can lead to avolition and anhedonia, symptoms that cross the diagnostic boundaries of many neuropsychiatric illnesses. Here, we consider whether the habenula (Hb), a region recently demonstrated to encode negatively valenced events, also modulates the attribution of incentive salience to a neutral cue predicting a food reward. The Pavlovian autoshaping paradigm was used in the rat as an investigative tool to dissociate Pavlovian learning processes imparting strictly predictive value from learning that attributes incentive motivational value. Electrolytic lesions of the fasciculus retroflexus (fr), the sole pathway through which descending Hb efferents are conveyed, significantly increased incentive salience as measured by conditioned approaches to a cue light predictive of reward. Conversely, generation of a fictive Hb signal via fr stimulation during CS+ presentation significantly decreased the incentive salience of the predictive cue. Neither manipulation altered the reward predictive value of the cue as measured by conditioned approach to the food. Our results provide new evidence supporting a significant role for the Hb in governing the attribution of incentive motivational salience to reward predictive cues and further imply that pathological changes in Hb activity could contribute to the aberrant pursuit of debilitating goals or avolition and depression-like symptoms. PMID:24368898

Decodability of Reward Learning Signals Predicts Mood Fluctuations.

PubMed

Eldar, Eran; Roth, Charlotte; Dayan, Peter; Dolan, Raymond J

2018-05-07

Our mood often fluctuates without warning. Recent accounts propose that these fluctuations might be preceded by changes in how we process reward. According to this view, the degree to which reward improves our mood reflects not only characteristics of the reward itself (e.g., its magnitude) but also how receptive to reward we happen to be. Differences in receptivity to reward have been suggested to play an important role in the emergence of mood episodes in psychiatric disorders [1-16]. However, despite substantial theory, the relationship between reward processing and daily fluctuations of mood has yet to be tested directly. In particular, it is unclear whether the extent to which people respond to reward changes from day to day and whether such changes are followed by corresponding shifts in mood. Here, we use a novel mobile-phone platform with dense data sampling and wearable heart-rate and electroencephalographic sensors to examine mood and reward processing over an extended period of one week. Subjects regularly performed a trial-and-error choice task in which different choices were probabilistically rewarded. Subjects' choices revealed two complementary learning processes, one fast and one slow. Reward prediction errors [17, 18] indicative of these two processes were decodable from subjects' physiological responses. Strikingly, more accurate decodability of prediction-error signals reflective of the fast process predicted improvement in subjects' mood several hours later, whereas more accurate decodability of the slow process' signals predicted better mood a whole day later. We conclude that real-life mood fluctuations follow changes in responsivity to reward at multiple timescales. Copyright © 2018 The Author(s). Published by Elsevier Ltd.. All rights reserved.

Activation of the cannabinoid system in the nucleus accumbens affects effort-based decision making.

PubMed

Fatahi, Zahra; Haghparast, Abbas

2018-02-01

Effort-based decision making addresses how we make an action choice based on an integration of action and goal values. The nucleus accumbens (NAc) is implicated in allowing an animal to overcome effort constraints to obtain greater benefits, and it has been previously shown that cannabis derivatives may affect such processes. Therefore, in this study, we intend to evaluate the involvement of the cannabinoid system in the entire NAc on effort-based decision making. Rats were trained in a T-maze cost-benefit decision making the task in which they could choose either to climb a barrier to obtain a large reward in one arm or run into the other arm without a barrier to obtaining a small reward. Following training, the animals were bilaterally implanted with guide cannulae in the NAc. On test day, rats received cannabinoid agonist (Win 55,212-2; 2, 10 and 50μM) and/or antagonist (AM251; 45μM), afterward percentage of large reward choice and latency of reward attainment were investigated. Results revealed that the administration of cannabinoid agonist led to decrease of large reward choice percentage such that the animals preferred to receive a small reward with low effort instead of receiving a large reward with high effort. The administration of antagonist solely did not affect effort-based decision making, but did attenuate the Win 55,212-2-induced impairments in effort allocation. In agonist-treated animals, the latency of reward collection increased. Moreover, when the effort was equated on both arms, the animals returned to choosing large reward showing that obtained results were not caused by spatial memory impairment. Our finding suggested that activation of the cannabinoid system in the NAc impaired effort-based decision making and led to rats were less willing to invest the physical effort to gain large reward. Copyright © 2017 Elsevier Inc. All rights reserved.

Functional magnetic resonance imaging in awake transgenic fragile X rats: evidence of dysregulation in reward processing in the mesolimbic/habenular neural circuit.

PubMed

Kenkel, W M; Yee, J R; Moore, K; Madularu, D; Kulkarni, P; Gamber, K; Nedelman, M; Ferris, C F

2016-03-22

Anxiety and social deficits, often involving communication impairment, are fundamental clinical features of fragile X syndrome. There is growing evidence that dysregulation in reward processing is a contributing factor to the social deficits observed in many psychiatric disorders. Hence, we hypothesized that transgenic fragile X mental retardation 1 gene (fmr1) KO (FX) rats would display alterations in reward processing. To this end, awake control and FX rats were imaged for changes in blood oxygen level dependent (BOLD) signal intensity in response to the odor of almond, a stimulus to elicit the innate reward response. Subjects were 'odor naive' to this evolutionarily conserved stimulus. The resulting changes in brain activity were registered to a three-dimensional segmented, annotated rat atlas delineating 171 brain regions. Both wild-type (WT) and FX rats showed robust brain activation to a rewarding almond odor, though FX rats showed an altered temporal pattern and tended to have a higher number of voxels with negative BOLD signal change from baseline. This pattern of greater negative BOLD was especially apparent in the Papez circuit, critical to emotional processing and the mesolimbic/habenular reward circuit. WT rats showed greater positive BOLD response in the supramammillary area, whereas FX rats showed greater positive BOLD response in the dorsal lateral striatum, and greater negative BOLD response in the retrosplenial cortices, the core of the accumbens and the lateral preoptic area. When tested in a freely behaving odor-investigation paradigm, FX rats failed to show the preference for almond odor which typifies WT rats. However, FX rats showed investigation profiles similar to WT when presented with social odors. These data speak to an altered processing of this highly salient novel odor in the FX phenotype and lend further support to the notion that altered reward systems in the brain may contribute to fragile X syndrome symptomology.

Fidelity of the representation of value in decision-making

PubMed Central

Dowding, Ben A.

2017-01-01

The ability to make optimal decisions depends on evaluating the expected rewards associated with different potential actions. This process is critically dependent on the fidelity with which reward value information can be maintained in the nervous system. Here we directly probe the fidelity of value representation following a standard reinforcement learning task. The results demonstrate a previously-unrecognized bias in the representation of value: extreme reward values, both low and high, are stored significantly more accurately and precisely than intermediate rewards. The symmetry between low and high rewards pertained despite substantially higher frequency of exposure to high rewards, resulting from preferential exploitation of more rewarding options. The observed variation in fidelity of value representation retrospectively predicted performance on the reinforcement learning task, demonstrating that the bias in representation has an impact on decision-making. A second experiment in which one or other extreme-valued option was omitted from the learning sequence showed that representational fidelity is primarily determined by the relative position of an encoded value on the scale of rewards experienced during learning. Both variability and guessing decreased with the reduction in the number of options, consistent with allocation of a limited representational resource. These findings have implications for existing models of reward-based learning, which typically assume defectless representation of reward value. PMID:28248958

A Quantitative Relationship between Signal Detection in Attention and Approach/Avoidance Behavior

PubMed Central

Viswanathan, Vijay; Sheppard, John P.; Kim, Byoung W.; Plantz, Christopher L.; Ying, Hao; Lee, Myung J.; Raman, Kalyan; Mulhern, Frank J.; Block, Martin P.; Calder, Bobby; Lee, Sang; Mortensen, Dale T.; Blood, Anne J.; Breiter, Hans C.

2017-01-01

This study examines how the domains of reward and attention, which are often studied as independent processes, in fact interact at a systems level. We operationalize divided attention with a continuous performance task and variables from signal detection theory (SDT), and reward/aversion with a keypress task measuring approach/avoidance in the framework of relative preference theory (RPT). Independent experiments with the same subjects showed a significant association between one SDT and two RPT variables, visualized as a three-dimensional structure. Holding one of these three variables constant, further showed a significant relationship between a loss aversion-like metric from the approach/avoidance task, and the response bias observed during the divided attention task. These results indicate that a more liberal response bias under signal detection (i.e., a higher tolerance for noise, resulting in a greater proportion of false alarms) is associated with higher “loss aversion.” Furthermore, our functional model suggests a mechanism for processing constraints with divided attention and reward/aversion. Together, our results argue for a systematic relationship between divided attention and reward/aversion processing in humans. PMID:28270776

A Quantitative Relationship between Signal Detection in Attention and Approach/Avoidance Behavior.

PubMed

Viswanathan, Vijay; Sheppard, John P; Kim, Byoung W; Plantz, Christopher L; Ying, Hao; Lee, Myung J; Raman, Kalyan; Mulhern, Frank J; Block, Martin P; Calder, Bobby; Lee, Sang; Mortensen, Dale T; Blood, Anne J; Breiter, Hans C

2017-01-01

This study examines how the domains of reward and attention, which are often studied as independent processes, in fact interact at a systems level. We operationalize divided attention with a continuous performance task and variables from signal detection theory (SDT), and reward/aversion with a keypress task measuring approach/avoidance in the framework of relative preference theory (RPT). Independent experiments with the same subjects showed a significant association between one SDT and two RPT variables, visualized as a three-dimensional structure. Holding one of these three variables constant, further showed a significant relationship between a loss aversion-like metric from the approach/avoidance task, and the response bias observed during the divided attention task. These results indicate that a more liberal response bias under signal detection (i.e., a higher tolerance for noise, resulting in a greater proportion of false alarms) is associated with higher "loss aversion." Furthermore, our functional model suggests a mechanism for processing constraints with divided attention and reward/aversion. Together, our results argue for a systematic relationship between divided attention and reward/aversion processing in humans.

Developmental changes in autonomic responses are associated with future reward/punishment expectations: A study of sympathetic skin responses in the Markov decision task.

PubMed

Hosaka, Hiromi; Aoyagi, Kakuro; Kaga, Yoshimi; Kanemura, Hideaki; Sugita, Kanji; Aihara, Masao

2017-08-01

Autonomic nervous system activity is recognized as a major component of emotional responses. Future reward/punishment expectations depend upon the process of decision making in the frontal lobe, which is considered to play an important role in executive function. The aim of this study was to investigate the relationship between autonomic responses and decision making during reinforcement tasks using sympathetic skin responses (SSR). Nine adult and 9 juvenile (mean age, 10.2years) volunteers were enrolled in this study. SSRs were measured during the Markov decision task (MDT), which is a reinforcement task. In this task, subjects must endure a small immediate loss to ultimately get a large reward. The subjects had to undergo three sets of tests and their scores in these tests were assessed and evaluated. All adults showed gradually increasing scores for the MDT from the first to third set. As the trial progressed from the first to second set in adults, SSR appearance ratios remarkably increased for both punishment and reward expectations. In comparison with adults, children showed decreasing scores from the first to second set. There were no significant inter-target differences in the SSR appearance ratio in the first and second set in children. In the third set, the SSR appearance ratio for reward expectations was higher than that in the neutral condition. In reinforcement tasks, such as MDT, autonomic responses play an important role in decision making. We assume that SSRs are elicited during efficient decision making tasks associated with future reward/punishment expectations, which demonstrates the importance of autonomic function. In contrast, in children around the age of 10years, the autonomic system does not react as an organized response specific to reward/punishment expectations. This suggests the immaturity of the future reward/punishment expectations process in children. Copyright © 2017 The Japanese Society of Child Neurology. Published by Elsevier B.V. All rights reserved.

Reward sensitivity modulates brain activity in the prefrontal cortex, ACC and striatum during task switching.

PubMed

Fuentes-Claramonte, Paola; Ávila, César; Rodríguez-Pujadas, Aina; Ventura-Campos, Noelia; Bustamante, Juan C; Costumero, Víctor; Rosell-Negre, Patricia; Barrós-Loscertales, Alfonso

2015-01-01

Current perspectives on cognitive control acknowledge that individual differences in motivational dispositions may modulate cognitive processes in the absence of reward contingencies. This work aimed to study the relationship between individual differences in Behavioral Activation System (BAS) sensitivity and the neural underpinnings involved in processing a switching cue in a task-switching paradigm. BAS sensitivity was hypothesized to modulate brain activity in frontal regions, ACC and the striatum. Twenty-eight healthy participants underwent fMRI while performing a switching task, which elicited activity in fronto-striatal regions during the processing of the switch cue. BAS sensitivity was negatively associated with activity in the lateral prefrontal cortex, anterior cingulate cortex and the ventral striatum. Combined with previous results, our data indicate that BAS sensitivity modulates the neurocognitive processes involved in task switching in a complex manner depending on task demands. Therefore, individual differences in motivational dispositions may influence cognitive processing in the absence of reward contingencies.

Reward Sensitivity Modulates Brain Activity in the Prefrontal Cortex, ACC and Striatum during Task Switching

PubMed Central

Fuentes-Claramonte, Paola; Ávila, César; Rodríguez-Pujadas, Aina; Ventura-Campos, Noelia; Bustamante, Juan C.; Costumero, Víctor; Rosell-Negre, Patricia; Barrós-Loscertales, Alfonso

2015-01-01

Current perspectives on cognitive control acknowledge that individual differences in motivational dispositions may modulate cognitive processes in the absence of reward contingencies. This work aimed to study the relationship between individual differences in Behavioral Activation System (BAS) sensitivity and the neural underpinnings involved in processing a switching cue in a task-switching paradigm. BAS sensitivity was hypothesized to modulate brain activity in frontal regions, ACC and the striatum. Twenty-eight healthy participants underwent fMRI while performing a switching task, which elicited activity in fronto-striatal regions during the processing of the switch cue. BAS sensitivity was negatively associated with activity in the lateral prefrontal cortex, anterior cingulate cortex and the ventral striatum. Combined with previous results, our data indicate that BAS sensitivity modulates the neurocognitive processes involved in task switching in a complex manner depending on task demands. Therefore, individual differences in motivational dispositions may influence cognitive processing in the absence of reward contingencies. PMID:25875640

Comorbidity of Alcohol Use Disorder and Chronic Pain: Genetic Influences on Brain Reward and Stress Systems.

PubMed

Yeung, Ellen W; Craggs, Jason G; Gizer, Ian R

2017-11-01

Alcohol use disorder (AUD) is highly comorbid with chronic pain (CP). Evidence has suggested that neuroadaptive processes characterized by reward deficit and stress surfeit are involved in the development of AUD and pain chronification. Neurological data suggest that shared genetic architecture associated with the reward and stress systems may contribute to the comorbidity of AUD and CP. This monograph first delineates the prevailing theories of the development of AUD and pain chronification focusing on the reward and stress systems. It then provides a brief summary of relevant neurological findings followed by an evaluation of evidence documented by molecular genetic studies. Candidate gene association studies have provided some initial support for the genetic overlap between AUD and CP; however, these results must be interpreted with caution until studies with sufficient statistical power are conducted and replications obtained. Genomewide association studies have suggested a number of genes (e.g., TBX19, HTR7, and ADRA1A) that are either directly or indirectly related to the reward and stress systems in the AUD and CP literature. Evidence reviewed in this monograph suggests that shared genetic liability underlying the comorbidity between AUD and CP, if present, is likely to be complex. As the advancement in molecular genetic methods continues, future studies may show broader central nervous system involvement in AUD-CP comorbidity. Copyright © 2017 by the Research Society on Alcoholism.

Appetitive Motivation and Negative Emotion Reactivity among Remitted Depressed Youth

PubMed Central

Hankin, Benjamin L.; Wetter, Emily K.; Flory, Kate

2012-01-01

Depression has been characterized as involving altered appetitive motivation and emotional reactivity. Yet no study has examined objective indices of emotional reactivity when the appetitive/approach system is suppressed in response to failure to attain a self-relevant goal and desired reward. Three groups of youth (N = 98, ages 9–15; remitted depressed, n = 34; externalizing disordered without depression, n = 30, and healthy controls, n = 34) participated in a novel reward striving task designed to activate the appetitive/approach motivation system. Objective facial expressions of emotion were videotaped and coded throughout both failure (i.e., nonreward) and control (success and reward) conditions. Observational coding of facial expressions as well as youths’ subjective emotion reports showed that the remitted depressed youth specifically exhibited more negative emotional reactivity to failure in the reward striving task, but not the control condition. Neither externalizing disordered (i.e., ADHD, CD, and/ or ODD) nor control youth displayed greater negative emotional reactivity in either the failure or control condition. Findings suggest that depression among youth is related to dysregulated appetitive motivation and associated negative emotional reactivity after failing to achieve an important, self-relevant goal and not attaining reward. These deficits in reward processing appear to be specific to depression as externalizing disordered youth did not display negative emotional reactivity to failure after their appetitive motivation system was activated. PMID:22901275

Appetitive motivation and negative emotion reactivity among remitted depressed youth.

PubMed

Hankin, Benjamin L; Wetter, Emily K; Flory, Kate

2012-01-01

Depression has been characterized as involving altered appetitive motivation and emotional reactivity. Yet no study has examined objective indices of emotional reactivity when the appetitive/approach system is suppressed in response to failure to attain a self-relevant goal and desired reward. Three groups of youth (N = 98, ages 9-15; remitted depressed, n = 34; externalizing disordered without depression, n = 30; and healthy controls, n = 34) participated in a novel reward striving task designed to activate the appetitive/approach motivation system. Objective facial expressions of emotion were videotaped and coded throughout both failure (i.e., nonreward) and control (success and reward) conditions. Observational coding of facial expressions as well as youths' subjective emotion reports showed that the remitted depressed youth specifically exhibited more negative emotional reactivity to failure in the reward striving task, but not the control condition. Neither externalizing disordered (i.e., attention deficit hyperactivity disorder, conduct disorder, and/or oppositional defiant disorder) nor control youth displayed greater negative emotional reactivity in either the failure or control condition. Findings suggest that depression among youth is related to dysregulated appetitive motivation and associated negative emotional reactivity after failing to achieve an important, self-relevant goal and not attaining reward. These deficits in reward processing appear to be specific to depression as externalizing disordered youth did not display negative emotional reactivity to failure after their appetitive motivation system was activated.

Hyporesponsive reward anticipation in the basal ganglia following severe institutional deprivation early in life.

PubMed

Mehta, Mitul A; Gore-Langton, Emma; Golembo, Nicole; Colvert, Emma; Williams, Steven C R; Sonuga-Barke, Edmund

2010-10-01

Severe deprivation in the first few years of life is associated with multiple difficulties in cognition and behavior. However, the brain basis for these difficulties is poorly understood. Structural and functional neuroimaging studies have implicated limbic system structures as dysfunctional, and one functional imaging study in a heterogeneous group of maltreated individuals has confirmed the presence of abnormalities in the basal ganglia. Based on these studies and known dopaminergic abnormalities from studies in experimental animals using social isolation, we used a task of monetary reward anticipation to examine the functional integrity of brain regions previously shown to be implicated in reward processing. Our sample included a group of adolescents (n = 12) who had experienced global deprivation early in their lives in Romania prior to adoption into UK families. In contrast to a nonadopted comparison group (n = 11), the adoptees did not recruit the striatum during reward anticipation despite comparable performance accuracy and latency. These results show, for the first time, an association between early institutional deprivation and brain reward systems in humans and highlight potential neural vulnerabilities resulting from such exposures.

Encoding of Vicarious Reward Prediction in Anterior Cingulate Cortex and Relationship with Trait Empathy

PubMed Central

Apps, Matthew A.J.; Roiser, Jonathan P.; Viding, Essi

2015-01-01

Empathy—the capacity to understand and resonate with the experiences of others—can depend on the ability to predict when others are likely to receive rewards. However, although a plethora of research has examined the neural basis of predictions about the likelihood of receiving rewards ourselves, very little is known about the mechanisms that underpin variability in vicarious reward prediction. Human neuroimaging and nonhuman primate studies suggest that a subregion of the anterior cingulate cortex in the gyrus (ACCg) is engaged when others receive rewards. Does the ACCg show specialization for processing predictions about others' rewards and not one's own and does this specialization vary with empathic abilities? We examined hemodynamic responses in the human brain time-locked to cues that were predictive of a high or low probability of a reward either for the subject themselves or another person. We found that the ACCg robustly signaled the likelihood of a reward being delivered to another. In addition, ACCg response significantly covaried with trait emotion contagion, a necessary foundation for empathizing with other individuals. In individuals high in emotion contagion, the ACCg was specialized for processing others' rewards exclusively, but for those low in emotion contagion, this region also responded to information about the subject's own rewards. Our results are the first to show that the ACCg signals probabilistic predictions about rewards for other people and that the substantial individual variability in the degree to which the ACCg is specialized for processing others' rewards is related to trait empathy. SIGNIFICANCE STATEMENT Successfully cooperating, competing, or empathizing with others can depend on our ability to predict when others are going to get something rewarding. Although many studies have examined how the brain processes rewards we will get ourselves, very little is known about vicarious reward processing. Here, we show that a subregion of the anterior cingulate cortex in the gyrus (ACCg) shows a degree of specialization for processing others' versus one's own rewards. However, the degree to which the ACCg is specialized varies with people's ability to empathize with others. This new insight into how vicarious rewards are processed in the brain and vary with empathy may be key for understanding disorders of social behavior, including psychopathy and autism. PMID:26446224

Association Between Reward Reactivity and Drug Use Severity is Substance Dependent: Preliminary Evidence From the Human Connectome Project.

PubMed

Peechatka, Alyssa L; Janes, Amy C

2017-06-01

Blunted nucleus accumbens (NAc) reactivity to reward is common across drug users. One theory is that individuals abuse substances due to this reward deficit. However, whether there is a relationship between the amount an individual uses and the severity of NAc dysfunction is unclear. It also is possible that such a relationship is substance specific, as nicotine transiently increases reward system sensitivity while alcohol, another commonly used substance, does not. As smokers may use nicotine to bolster NAc reward function, we hypothesize that NAc reactivity to reward will be related to volume of cigarette use, but not volume of alcohol use. A functional magnetic resonance imaging incentive-processing task collected by the Human Connectome Project was assessed in a cohort of tobacco smokers who reported smoking between 5-20 cigarettes/day and a cohort of alcohol users who reported drinking 7-25 drinks/wk. Number of cigarettes/day and drinks/wk were correlated with right and left NAc reactivity to the receipt of a monetary reward relative to baseline. Individuals who smoke greater numbers of cigarettes/day showed lower right NAc reactivity to reward (r = 0.853, p ≤ .001). Left NAc reactivity was not correlated with cigarettes/day. No association was found with drinks/wk. A negative association was found between NAc reactivity to reward and cigarettes/day, but not alcohol drinks/wk. Given nicotine's unique ability to increase sensitivity to rewards, these findings suggest that individuals who smoke more cigarettes/day may be compensating for more dysfunctional NAc reward reactivity. The present study demonstrates that a relationship between NAc reactivity to nondrug reward and volume of substance use is present in nicotine but not alcohol use. While prior work has implicated dysfunctional reward processing in addictions, these findings clarify a substance-specific role that blunted reward function has in determining patterns of use among chronic users. © The Author 2017. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Electrophysiological evidence for the involvement of proactive and reactive control in a rewarded stop-signal task.

PubMed

Schevernels, Hanne; Bombeke, Klaas; Van der Borght, Liesbet; Hopf, Jens-Max; Krebs, Ruth M; Boehler, C Nicolas

2015-11-01

Reward availability is known to facilitate various cognitive operations, which is usually studied in cue-based paradigms that allow for enhanced preparation in reward-related trials. However, recent research using tasks that signal reward availability via task-relevant stimuli suggests that reward can also rapidly promote performance independent of global strategic preparation. Notably, this effect was also observed in a reward-related stop-signal task, in which behavioral measures of inhibition speed were found to be shorter in trials signaling reward. Corresponding fMRI results implied that this effect relies on boosted reactive control as indicated by increased activity in the 'inhibition-related network' in the reward-related condition. Here, we used EEG to better characterize transient modulations of attentional processes likely preceding this ultimate implementation of response inhibition. Importantly, such modulations would probably reflect enhanced proactive control in the form of more top-down attention to reward-related features. Counter to the notion that behavioral benefits would rely purely on reactive control, we found increased stop-evoked attentional processing (larger N1 component) on reward-related trials. This effect was accompanied by enhanced frontal P3 amplitudes reflecting successful stopping, and earlier and larger ERP differences between successful and failed stop trials in the reward-related condition. Finally, more global proactive control processes in the form of a reward context modulation of reward-unrelated trials did not have an effect on stopping performance but did influence attentional processing of go stimuli. Together, these results suggest that proactive and reactive processes can interact to bring about stimulus-specific reward benefits when the task precludes differential global preparation. Copyright © 2015 Elsevier Inc. All rights reserved.

Gender-specific modulation of neural mechanisms underlying social reward processing by Autism Quotient

PubMed Central

Barman, Adriana; Richter, Sylvia; Soch, Joram; Deibele, Anna; Richter, Anni; Assmann, Anne; Wüstenberg, Torsten; Walter, Henrik; Seidenbecher, Constanze I.

2015-01-01

Autism spectrum disorder refers to a neurodevelopmental condition primarily characterized by deficits in social cognition and behavior. Subclinically, autistic features are supposed to be present in healthy humans and can be quantified using the Autism Quotient (AQ). Here, we investigated a potential relationship between AQ and neural correlates of social and monetary reward processing, using functional magnetic resonance imaging in young, healthy participants. In an incentive delay task with either monetary or social reward, reward anticipation elicited increased ventral striatal activation, which was more pronounced during monetary reward anticipation. Anticipation of social reward elicited activation in the default mode network (DMN), a network previously implicated in social processing. Social reward feedback was associated with bilateral amygdala and fusiform face area activation. The relationship between AQ and neural correlates of social reward processing varied in a gender-dependent manner. In women and, to a lesser extent in men, higher AQ was associated with increased posterior DMN activation during social reward anticipation. During feedback, we observed a negative correlation of AQ and right amygdala activation in men only. Our results suggest that social reward processing might constitute an endophenotype for autism-related traits in healthy humans that manifests in a gender-specific way. PMID:25944965

Altered neural reward and loss processing and prediction error signalling in depression

PubMed Central

Ubl, Bettina; Kuehner, Christine; Kirsch, Peter; Ruttorf, Michaela

2015-01-01

Dysfunctional processing of reward and punishment may play an important role in depression. However, functional magnetic resonance imaging (fMRI) studies have shown heterogeneous results for reward processing in fronto-striatal regions. We examined neural responsivity associated with the processing of reward and loss during anticipation and receipt of incentives and related prediction error (PE) signalling in depressed individuals. Thirty medication-free depressed persons and 28 healthy controls performed an fMRI reward paradigm. Regions of interest analyses focused on neural responses during anticipation and receipt of gains and losses and related PE-signals. Additionally, we assessed the relationship between neural responsivity during gain/loss processing and hedonic capacity. When compared with healthy controls, depressed individuals showed reduced fronto-striatal activity during anticipation of gains and losses. The groups did not significantly differ in response to reward and loss outcomes. In depressed individuals, activity increases in the orbitofrontal cortex and nucleus accumbens during reward anticipation were associated with hedonic capacity. Depressed individuals showed an absence of reward-related PEs but encoded loss-related PEs in the ventral striatum. Depression seems to be linked to blunted responsivity in fronto-striatal regions associated with limited motivational responses for rewards and losses. Alterations in PE encoding might mirror blunted reward- and enhanced loss-related associative learning in depression. PMID:25567763

Intermittent Theta Burst Stimulation Increases Reward Responsiveness in Individuals with Higher Hedonic Capacity.

PubMed

Duprat, Romain; De Raedt, Rudi; Wu, Guo-Rong; Baeken, Chris

2016-01-01

Repetitive transcranial magnetic stimulation over the left dorsolateral prefrontal cortex (DLPFC) has been documented to influence striatal and orbitofrontal dopaminergic activity implicated in reward processing. However, the exact neuropsychological mechanisms of how DLPFC stimulation may affect the reward system and how trait hedonic capacity may interact with the effects remains to be elucidated. In this sham-controlled study in healthy individuals, we investigated the effects of a single session of neuronavigated intermittent theta burst stimulation (iTBS) on reward responsiveness, as well as the influence of trait hedonic capacity. We used a randomized crossover single session iTBS design with an interval of 1 week. We assessed reward responsiveness using a rewarded probabilistic learning task and measured individual trait hedonic capacity (the ability to experience pleasure) with the temporal experience of pleasure scale questionnaire. As expected, the participants developed a response bias toward the most rewarded stimulus (rich stimulus). Reaction time and accuracy for the rich stimulus were respectively shorter and higher as compared to the less rewarded stimulus (lean stimulus). Active or sham stimulation did not seem to influence the outcome. However, when taking into account individual trait hedonic capacity, we found an early significant increase in the response bias only after active iTBS. The higher the individual's trait hedonic capacity, the more the response bias toward the rich stimulus increased after the active stimulation. When taking into account trait hedonic capacity, one active iTBS session over the left DLPFC improved reward responsiveness in healthy male participants with higher hedonic capacity. This suggests that individual differences in hedonic capacity may influence the effects of iTBS on the reward system.

Blunted responses to reward in remitted post-traumatic stress disorder

PubMed Central

Kalebasi, Nilufer; Kuelen, Eveline; Schnyder, Ulrich; Schumacher, Sonja; Mueller-Pfeiffer, Christoph; Wilhelm, Frank H; Athilingam, Jegath; Moergeli, Hanspeter; Martin-Soelch, Chantal

2015-01-01

Background Recent evidence suggests blunted responses to rewarding stimuli in patients with post-traumatic stress disorder (PTSD). However, it is not clear whether these alterations in reward processing normalize in remitted PTSD patients. Methods We tested behavioral and physiological responses to monetary reward in a spatial memory task in 13 accident survivors with remitted PTSD, 14 accident survivors who never had PTSD, and 16 nontrauma-exposed subjects. All accident survivors were recruited from two samples of severely physically injured patients, who had participated in previous prospective studies on the incidence of PTSD after accidental injury approximately 10 years ago. Reaction time, accuracy, skin conductance responses, and self-reported mood were assessed during the task. Results Accident survivors who never had PTSD and nontrauma exposed controls reported significantly higher positive mood in the reinforced versus nonreinforced condition (P < 0.045 and P < 0.001, respectively), while there was no effect of reinforcement in remitted PTSD subjects. Conclusions Our findings suggest an alteration of the reward system in remitted PTSD. Further research is needed to investigate whether altered reward processing is a residual characteristic in PTSD after remission of symptoms or, alternatively, a preexisting risk factor for the development of PTSD after a traumatic event. PMID:26357590

When opportunity meets motivation: Neural engagement during social approach is linked to high approach motivation.

PubMed

Radke, Sina; Seidel, Eva-Maria; Eickhoff, Simon B; Gur, Ruben C; Schneider, Frank; Habel, Ute; Derntl, Birgit

2016-02-15

Social rewards are processed by the same dopaminergic-mediated brain networks as non-social rewards, suggesting a common representation of subjective value. Individual differences in personality and motivation influence the reinforcing value of social incentives, but it remains open whether the pursuit of social incentives is analogously supported by the neural reward system when positive social stimuli are connected to approach behavior. To test for a modulation of neural activation by approach motivation, individuals with high and low approach motivation (BAS) completed implicit and explicit social approach-avoidance paradigms during fMRI. High approach motivation was associated with faster implicit approach reactions as well as a trend for higher approach ratings, indicating increased approach tendencies. Implicit and explicit positive social approach was accompanied by stronger recruitment of the nucleus accumbens, middle cingulate cortex, and (pre-)cuneus for individuals with high compared to low approach motivation. These results support and extend prior research on social reward processing, self-other distinctions and affective judgments by linking approach motivation to the engagement of reward-related circuits during motivational reactions to social incentives. This interplay between motivational preferences and motivational contexts might underlie the rewarding experience during social interactions. Copyright © 2015 Elsevier Inc. All rights reserved.

The Sensitivity of the Crayfish Reward System to Mammalian Drugs of Abuse.

PubMed

Shipley, Adam T; Imeh-Nathaniel, Adebobola; Orfanakos, Vasiliki B; Wormack, Leah N; Huber, Robert; Nathaniel, Thomas I

2017-01-01

The idea that addiction occurs when the brain is not able to differentiate whether specific reward circuits were triggered by adaptive natural rewards or falsely activated by addictive drugs exist in several models of drug addiction. The suitability of crayfish ( Orconectes rusticus ) for drug addiction research arises from developmental variation of growth, life span, reproduction, behavior and some quantitative traits, especially among isogenic mates reared in the same environment. This broad spectrum of traits makes it easier to analyze the effect of mammalian drugs of abuse in shaping behavioral phenotype. Moreover, the broad behavioral repertoire allows the investigation of self-reinforcing circuitries involving appetitive and exploratory motor behavior, while the step-wise alteration of the phenotype by metamorphosis allows accurate longitudinal analysis of different behavioral states. This paper reviews a series of recent experimental findings that evidence the suitability of crayfish as an invertebrate model system for the study of drug addiction. Results from these studies reveal that unconditioned exposure to mammalian drugs of abuse produces a variety of stereotyped behaviors. Moreover, if presented in the context of novelty, drugs directly stimulate exploration and appetitive motor patterns along with molecular processes for drug conditioned reward. Findings from these studies indicate the existence of drug sensitive circuitry in crayfish that facilitates exploratory behavior and appetitive motor patterns via increased incentive salience of environmental stimuli or by increasing exploratory motor patterns. This work demonstrates the potential of crayfish as a model system for research into the neural mechanisms of addiction, by contributing an evolutionary, comparative context to our understanding of natural reward as an important life-sustaining process.

A Novel Perspective on Dopaminergic Processing of Human Addiction.

PubMed

Badgaiyan, Rajendra D

2013-01-01

Converging evidence from clinical, animal, and neuroimaging experiments suggests that the addictive behavior is associated with dysregulated dopamine neurotransmission. The precise role of dopamine in establishment and maintenance of addiction however is unclear. In this context animal studies on the brain reward system and the associative memory processing provide a novel insight. It was shown that both processing involve dopamine neurotransmission and both are disrupted in addiction. These findings indicate that dysregulated dopamine neurotransmission alters the brain processing of not only the reward system but also that of the memory of association between an addictive substance and reward. These alterations lead to maladaptive motivational behavior leading to chemical dependency. This concept however is based mostly on the data obtained in laboratory animals because of the paucity of human data. Due to lack of a reliable technique to study neurotransmission in the live human brain, it has been a problem to study the role of dopamine in human volunteers. A recently developed dynamic molecular imaging technique however, provides an opportunity to study these concepts in human volunteers because the technique allows detection, mapping and measurement of dopamine released in the live human brain during task performance.

Cocaine cues drive opposing context-dependent shifts in reward processing and emotional state.

PubMed

Wheeler, Robert A; Aragona, Brandon J; Fuhrmann, Katherine A; Jones, Joshua L; Day, Jeremy J; Cacciapaglia, Fabio; Wightman, R Mark; Carelli, Regina M

2011-06-01

Prominent neurobiological theories of addiction posit a central role for aberrant mesolimbic dopamine release but disagree as to whether repeated drug experience blunts or enhances this system. Although drug withdrawal diminishes dopamine release, drug sensitization augments mesolimbic function, and both processes have been linked to drug seeking. One possibility is that the dopamine system can rapidly switch from dampened to enhanced release depending on the specific drug-predictive environment. To test this, we examined dopamine release when cues signaled delayed cocaine delivery versus imminent cocaine self-administration. Fast-scan cyclic voltammetry was used to examine real-time dopamine release while simultaneously monitoring behavioral indexes of aversion as rats experienced a sweet taste cue that predicted delayed cocaine availability and during self-administration. Furthermore, the impact of cues signaling delayed drug availability on intracranial self-stimulation, a broad measure of reward function, was assessed. We observed decreased mesolimbic dopamine concentrations, decreased reward sensitivity, and negative affect in response to the cocaine-predictive taste cue that signaled delayed cocaine availability. Importantly, dopamine concentration rapidly switched to elevated levels to cues signaling imminent cocaine delivery in the subsequent self-administration session. These findings show rapid, bivalent contextual control over brain reward processing, affect, and motivated behavior and have implications for mechanisms mediating substance abuse. Copyright © 2011 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

Social defeat disrupts reward learning and potentiates striatal nociceptin/orphanin FQ mRNA in rats.

PubMed

Der-Avakian, Andre; D'Souza, Manoranjan S; Potter, David N; Chartoff, Elena H; Carlezon, William A; Pizzagalli, Diego A; Markou, Athina

2017-05-01

Mood disorders can be triggered by stress and are characterized by deficits in reward processing, including disrupted reward learning (the ability to modulate behavior according to past rewards). Reward learning is regulated by the anterior cingulate cortex (ACC) and striatal circuits, both of which are implicated in the pathophysiology of mood disorders. Here, we assessed in rats the effects of a potent stressor (social defeat) on reward learning and gene expression in the ACC, ventral tegmental area (VTA), and striatum. Adult male Wistar rats were trained on an operant probabilistic reward task (PRT) and then exposed to 3 days of social defeat before assessment of reward learning. After testing, the ACC, VTA, and striatum were dissected, and expression of genes previously implicated in stress was assessed. Social defeat blunted reward learning (manifested as reduced response bias toward a more frequently rewarded stimulus) and was associated with increased nociceptin/orphanin FQ (N/OFQ) peptide mRNA levels in the striatum and decreased Fos mRNA levels in the VTA. Moreover, N/OFQ peptide and nociceptin receptor mRNA levels in the ACC, VTA and striatum were inversely related to reward learning. The behavioral findings parallel previous data in humans, suggesting that stress similarly disrupts reward learning in both species. Increased striatal N/OFQ mRNA in stressed rats characterized by impaired reward learning is consistent with accumulating evidence that antagonism of nociceptin receptors, which bind N/OFQ, has antidepressant-like effects. These results raise the possibility that nociceptin systems represent a molecular substrate through which stress produces reward learning deficits in mood disorders.

Pubertal status associations with reward and threat sensitivities and subcortical brain volumes during adolescence.

PubMed

Urošević, Snežana; Collins, Paul; Muetzel, Ryan; Lim, Kelvin O; Luciana, Monica

2014-08-01

Adolescence is characterized by complex developmental processes that impact behavior, biology, and social functioning. Two such adolescence-specific processes are puberty and increases in reward sensitivity. Relations between these processes are poorly understood. The present study focused on examining unique effects of puberty, age, and sex on reward and threat sensitivities and volumes of subcortical brain structures relevant for reward/threat processing in a healthy sample of 9-18year-olds. Unlike age, pubertal status had a significant unique positive relationship with reward sensitivity. In addition, there was a trend for adolescent females to exhibit higher threat sensitivity with more advanced pubertal development and higher reward and threat sensitivity with older age. Similarly, there were significant puberty by sex interaction effects on striatal volumes, i.e., left nucleus accumbens and right pallidum. The present pattern of results suggests that pubertal development, independent of chronological age, is uniquely associated with reward hypersensitivity and with structural differences in striatal regions implicated in reward processing. Copyright © 2014 Elsevier Inc. All rights reserved.

A common neural code for social and monetary rewards in the human striatum

PubMed Central

Wake, Stephanie J

2017-01-01

Abstract Although managing social information and decision making on the basis of reward is critical for survival, it remains uncertain whether differing reward type is processed in a uniform manner. Previously, we demonstrated that monetary reward and the social reward of good reputation activated the same striatal regions including the caudate nucleus and putamen. However, it remains unclear whether overlapping activations reflect activities of identical neuronal populations or two overlapping but functionally independent neuronal populations. Here, we re-analyzed the original data and addressed this question using multivariate-pattern-analysis and found evidence that in the left caudate nucleus and bilateral nucleus accumbens, social vs monetary reward were represented similarly. The findings suggest that social and monetary rewards are processed by the same population of neurons within these regions of the striatum. Additional findings demonstrated similar neural patterns when participants experience high social reward compared to viewing others receiving low social reward (potentially inducing schadenfreude). This is possibly an early indication that the same population of neurons may be responsible for processing two different types of social reward (good reputation and schadenfreude). These findings provide a supplementary perspective to previous research, helping to further elucidate the mechanisms behind social vs non-social reward processing. PMID:28985408

A common neural code for social and monetary rewards in the human striatum.

PubMed

Wake, Stephanie J; Izuma, Keise

2017-10-01

Although managing social information and decision making on the basis of reward is critical for survival, it remains uncertain whether differing reward type is processed in a uniform manner. Previously, we demonstrated that monetary reward and the social reward of good reputation activated the same striatal regions including the caudate nucleus and putamen. However, it remains unclear whether overlapping activations reflect activities of identical neuronal populations or two overlapping but functionally independent neuronal populations. Here, we re-analyzed the original data and addressed this question using multivariate-pattern-analysis and found evidence that in the left caudate nucleus and bilateral nucleus accumbens, social vs monetary reward were represented similarly. The findings suggest that social and monetary rewards are processed by the same population of neurons within these regions of the striatum. Additional findings demonstrated similar neural patterns when participants experience high social reward compared to viewing others receiving low social reward (potentially inducing schadenfreude). This is possibly an early indication that the same population of neurons may be responsible for processing two different types of social reward (good reputation and schadenfreude). These findings provide a supplementary perspective to previous research, helping to further elucidate the mechanisms behind social vs non-social reward processing. © The Author (2017). Published by Oxford University Press.

Reward speeds up and increases consistency of visual selective attention: a lifespan comparison.

PubMed

Störmer, Viola; Eppinger, Ben; Li, Shu-Chen

2014-06-01

Children and older adults often show less favorable reward-based learning and decision making, relative to younger adults. It is unknown, however, whether reward-based processes that influence relatively early perceptual and attentional processes show similar lifespan differences. In this study, we investigated whether stimulus-reward associations affect selective visual attention differently across the human lifespan. Children, adolescents, younger adults, and older adults performed a visual search task in which the target colors were associated with either high or low monetary rewards. We discovered that high reward value speeded up response times across all four age groups, indicating that reward modulates attentional selection across the lifespan. This speed-up in response time was largest in younger adults, relative to the other three age groups. Furthermore, only younger adults benefited from high reward value in increasing response consistency (i.e., reduction of trial-by-trial reaction time variability). Our findings suggest that reward-based modulations of relatively early and implicit perceptual and attentional processes are operative across the lifespan, and the effects appear to be greater in adulthood. The age-specific effect of reward on reducing intraindividual response variability in younger adults likely reflects mechanisms underlying the development and aging of reward processing, such as lifespan age differences in the efficacy of dopaminergic modulation. Overall, the present results indicate that reward shapes visual perception across different age groups by biasing attention to motivationally salient events.

Enhanced neural responsiveness to reward associated with obesity in the absence of food-related stimuli.

PubMed

Opel, Nils; Redlich, Ronny; Grotegerd, Dominik; Dohm, Katharina; Haupenthal, Cordula; Heindel, Walter; Kugel, Harald; Arolt, Volker; Dannlowski, Udo

2015-06-01

Obesity has been characterized by alterations in brain structure and function associated with emotion processing and regulation. Particularly, aberrations in food-related reward processing have been frequently demonstrated in obese subjects. However, it remains unclear whether reward-associated functional aberrations in obesity are specific for food-related stimuli or represent a general deficit in reward processing, extending to other stimulus domains. Given the crucial role of rewarding effects in the development of obesity and the ongoing discussion on overlapping neurobiological traits of obesity and psychiatric disorders such as depression and substance-related disorders, this study aimed to investigate the possibility of altered reward processing in obese subjects to occur in the absence of food-related stimuli during a monetary reward condition. Twenty-nine healthy obese subjects (body mass index >30) and 29 healthy, age-, and sex-matched control subjects of normal weight underwent functional MRI during a frequently used card guessing paradigm. A Group × Condition (win vs. loss) ANOVA was conducted to investigate differences between obese and normal-weight subjects. We found significant Group × Condition interaction effects in brain areas involved in emotion regulation and reward processing including the insula, the striatum, and the orbitofrontal cortex (OFC). This interaction was predominantly driven by a significant increase in blood oxygenation level dependent (BOLD) response in obese individuals while experiencing reward. Enhanced neural activation in obesity during reward processing seems to be apparent even in the absence of food-related stimuli and, thus, might point to generalized dysfunctions in reward-related brain circuits in obese individuals. © 2015 Wiley Periodicals, Inc.

Association between pubertal stage at first drink and neural reward processing in early adulthood.

PubMed

Boecker-Schlier, Regina; Holz, Nathalie E; Hohm, Erika; Zohsel, Katrin; Blomeyer, Dorothea; Buchmann, Arlette F; Baumeister, Sarah; Wolf, Isabella; Esser, Günter; Schmidt, Martin H; Meyer-Lindenberg, Andreas; Banaschewski, Tobias; Brandeis, Daniel; Laucht, Manfred

2017-09-01

Puberty is a critical time period during human development. It is characterized by high levels of risk-taking behavior, such as increased alcohol consumption, and is accompanied by various neurobiological changes. Recent studies in animals and humans have revealed that the pubertal stage at first drink (PSFD) significantly impacts drinking behavior in adulthood. Moreover, neuronal alterations of the dopaminergic reward system have been associated with alcohol abuse or addiction. This study aimed to clarify the impact of PSFD on neuronal characteristics of reward processing linked to alcohol-related problems. One hundred sixty-eight healthy young adults from a prospective study covering 25 years participated in a monetary incentive delay task measured with simultaneous EEG-fMRI. PSFD was determined according to the age at menarche or Tanner stage of pubertal development, respectively. Alcohol-related problems in early adulthood were assessed with the Alcohol Use Disorder Identification Test (AUDIT). During reward anticipation, decreased fMRI activation of the frontal cortex and increased preparatory EEG activity (contingent negative variation) occurred with pubertal compared to postpubertal first alcohol intake. Moreover, alcohol-related problems during early adulthood were increased in pubertal compared to postpubertal beginners, which was mediated by neuronal activation of the right medial frontal gyrus. At reward delivery, increased fMRI activation of the left caudate and higher feedback-related EEG negativity were detected in pubertal compared to postpubertal beginners. Together with animal findings, these results implicate PSFD as a potential modulator of psychopathology, involving altered reward anticipation. Both PSFD timing and reward processing might thus be potential targets for early prevention and intervention. © 2016 Society for the Study of Addiction.

Neurocomputational mechanisms underlying subjective valuation of effort costs

PubMed Central

Giehl, Kathrin; Sillence, Annie

2017-01-01

In everyday life, we have to decide whether it is worth exerting effort to obtain rewards. Effort can be experienced in different domains, with some tasks requiring significant cognitive demand and others being more physically effortful. The motivation to exert effort for reward is highly subjective and varies considerably across the different domains of behaviour. However, very little is known about the computational or neural basis of how different effort costs are subjectively weighed against rewards. Is there a common, domain-general system of brain areas that evaluates all costs and benefits? Here, we used computational modelling and functional magnetic resonance imaging (fMRI) to examine the mechanisms underlying value processing in both the cognitive and physical domains. Participants were trained on two novel tasks that parametrically varied either cognitive or physical effort. During fMRI, participants indicated their preferences between a fixed low-effort/low-reward option and a variable higher-effort/higher-reward offer for each effort domain. Critically, reward devaluation by both cognitive and physical effort was subserved by a common network of areas, including the dorsomedial and dorsolateral prefrontal cortex, the intraparietal sulcus, and the anterior insula. Activity within these domain-general areas also covaried negatively with reward and positively with effort, suggesting an integration of these parameters within these areas. Additionally, the amygdala appeared to play a unique, domain-specific role in processing the value of rewards associated with cognitive effort. These results are the first to reveal the neurocomputational mechanisms underlying subjective cost–benefit valuation across different domains of effort and provide insight into the multidimensional nature of motivation. PMID:28234892

Homeostatic reinforcement learning for integrating reward collection and physiological stability.

PubMed

Keramati, Mehdi; Gutkin, Boris

2014-12-02

Efficient regulation of internal homeostasis and defending it against perturbations requires adaptive behavioral strategies. However, the computational principles mediating the interaction between homeostatic and associative learning processes remain undefined. Here we use a definition of primary rewards, as outcomes fulfilling physiological needs, to build a normative theory showing how learning motivated behaviors may be modulated by internal states. Within this framework, we mathematically prove that seeking rewards is equivalent to the fundamental objective of physiological stability, defining the notion of physiological rationality of behavior. We further suggest a formal basis for temporal discounting of rewards by showing that discounting motivates animals to follow the shortest path in the space of physiological variables toward the desired setpoint. We also explain how animals learn to act predictively to preclude prospective homeostatic challenges, and several other behavioral patterns. Finally, we suggest a computational role for interaction between hypothalamus and the brain reward system.

Neural Sensitivity to Absolute and Relative Anticipated Reward in Adolescents

PubMed Central

Vaidya, Jatin G.; Knutson, Brian; O'Leary, Daniel S.; Block, Robert I.; Magnotta, Vincent

2013-01-01

Adolescence is associated with a dramatic increase in risky and impulsive behaviors that have been attributed to developmental differences in neural processing of rewards. In the present study, we sought to identify age differences in anticipation of absolute and relative rewards. To do so, we modified a commonly used monetary incentive delay (MID) task in order to examine brain activity to relative anticipated reward value (neural sensitivity to the value of a reward as a function of other available rewards). This design also made it possible to examine developmental differences in brain activation to absolute anticipated reward magnitude (the degree to which neural activity increases with increasing reward magnitude). While undergoing fMRI, 18 adolescents and 18 adult participants were presented with cues associated with different reward magnitudes. After the cue, participants responded to a target to win money on that trial. Presentation of cues was blocked such that two reward cues associated with $.20, $1.00, or $5.00 were in play on a given block. Thus, the relative value of the $1.00 reward varied depending on whether it was paired with a smaller or larger reward. Reflecting age differences in neural responses to relative anticipated reward (i.e., reference dependent processing), adults, but not adolescents, demonstrated greater activity to a $1 reward when it was the larger of the two available rewards. Adults also demonstrated a more linear increase in ventral striatal activity as a function of increasing absolute reward magnitude compared to adolescents. Additionally, reduced ventral striatal sensitivity to absolute anticipated reward (i.e., the difference in activity to medium versus small rewards) correlated with higher levels of trait Impulsivity. Thus, ventral striatal activity in anticipation of absolute and relative rewards develops with age. Absolute reward processing is also linked to individual differences in Impulsivity. PMID:23544046

Willed action, free will, and the stochastic neurodynamics of decision-making

PubMed Central

Rolls, Edmund T.

2012-01-01

It is shown that the randomness of the firing times of neurons in decision-making attractor neuronal networks that is present before the decision cues are applied can cause statistical fluctuations that influence the decision that will be taken. In this rigorous sense, it is possible to partially predict decisions before they are made. This raises issues about free will and determinism. There are many decision-making networks in the brain. Some decision systems operate to choose between gene-specified rewards such as taste, touch, and beauty (in for example the peacock's tail). Other processes capable of planning ahead with multiple steps held in working memory may require correction by higher order thoughts that may involve explicit, conscious, processing. The explicit system can allow the gene-specified rewards not to be selected or deferred. The decisions between the selfish gene-specified rewards, and the explicitly calculated rewards that are in the interests of the individual, the phenotype, may themselves be influenced by noise in the brain. When the explicit planning system does take the decision, it can report on its decision-making, and can provide a causal account rather than a confabulation about the decision process. We might use the terms “willed action” and “free will” to refer to the operation of the planning system that can think ahead over several steps held in working memory with which it can take explicit decisions. Reduced connectivity in some of the default mode cortical regions including the precuneus that are active during self-initiated action appears to be related to the reduction in the sense of self and agency, of causing willed actions, that can be present in schizophrenia. PMID:22973205

Impaired Feedback Processing for Symbolic Reward in Individuals with Internet Game Overuse

PubMed Central

Kim, Jinhee; Kim, Hackjin; Kang, Eunjoo

2017-01-01

Reward processing, which plays a critical role in adaptive behavior, is impaired in addiction disorders, which are accompanied by functional abnormalities in brain reward circuits. Internet gaming disorder, like substance addiction, is thought to be associated with impaired reward processing, but little is known about how it affects learning, especially when feedback is conveyed by less-salient motivational events. Here, using both monetary (±500 KRW) and symbolic (Chinese characters “right” or “wrong”) rewards and penalties, we investigated whether behavioral performance and feedback-related neural responses are altered in Internet game overuse (IGO) group. Using functional MRI, brain responses for these two types of reward/penalty feedback were compared between young males with problems of IGO (IGOs, n = 18, mean age = 22.2 ± 2.0 years) and age-matched control subjects (Controls, n = 20, mean age = 21.2 ± 2.1) during a visuomotor association task where associations were learned between English letters and one of four responses. No group difference was found in adjustment of error responses following the penalty or in brain responses to penalty, for either monetary or symbolic penalties. The IGO individuals, however, were more likely to fail to choose the response previously reinforced by symbolic (but not monetary) reward. A whole brain two-way ANOVA analysis for reward revealed reduced activations in the IGO group in the rostral anterior cingulate cortex/ventromedial prefrontal cortex (vmPFC) in response to both reward types, suggesting impaired reward processing. However, the responses to reward in the inferior parietal region and medial orbitofrontal cortex/vmPFC were affected by the types of reward in the IGO group. Unlike the control group, in the IGO group the reward response was reduced only for symbolic reward, suggesting lower attentional and value processing specific to symbolic reward. Furthermore, the more severe the Internet gaming overuse symptoms in the IGO group, the greater the activations of the ventral striatum for monetary relative to symbolic reward. These findings suggest that IGO is associated with bias toward motivationally salient reward, which would lead to poor goal-directed behavior in everyday life. PMID:29051739

Psychological processes in chronic pain: Influences of reward and fear learning as key mechanisms - Behavioral evidence, neural circuits, and maladaptive changes.

PubMed

Nees, Frauke; Becker, Susanne

2017-09-07

In the understanding of chronic pain, hypotheses derived from psychological theories, together with insights from physiological assessments and brain imaging, highlight the importance of mechanistically driven approaches. Physical system changes, for example following injury, can result in alterations of psychological processes and are accompanied by changes in corticolimbic circuits, which have been shown to be essential in emotional learning and memory, as well as reward processing and related behavior. In the present review, we thus highlight the importance of motivational, reward/pain relief, and fear learning processes in the context of chronic pain and discuss the potential of a mechanistic understanding of chronic pain within a clinical perspective, for example for the development of therapeutic strategies. We argue that changes in these mechanisms are not only characteristic for chronic pain, reflecting consequences of the disorder, but are also critically involved in the transition from acute to chronic pain states. Copyright © 2017 IBRO. Published by Elsevier Ltd. All rights reserved.

Reward, motivation, and emotion systems associated with early-stage intense romantic love.

PubMed

Aron, Arthur; Fisher, Helen; Mashek, Debra J; Strong, Greg; Li, Haifang; Brown, Lucy L

2005-07-01

Early-stage romantic love can induce euphoria, is a cross-cultural phenomenon, and is possibly a developed form of a mammalian drive to pursue preferred mates. It has an important influence on social behaviors that have reproductive and genetic consequences. To determine which reward and motivation systems may be involved, we used functional magnetic resonance imaging and studied 10 women and 7 men who were intensely "in love" from 1 to 17 mo. Participants alternately viewed a photograph of their beloved and a photograph of a familiar individual, interspersed with a distraction-attention task. Group activation specific to the beloved under the two control conditions occurred in dopamine-rich areas associated with mammalian reward and motivation, namely the right ventral tegmental area and the right postero-dorsal body and medial caudate nucleus. Activation in the left ventral tegmental area was correlated with facial attractiveness scores. Activation in the right anteromedial caudate was correlated with questionnaire scores that quantified intensity of romantic passion. In the left insula-putamen-globus pallidus, activation correlated with trait affect intensity. The results suggest that romantic love uses subcortical reward and motivation systems to focus on a specific individual, that limbic cortical regions process individual emotion factors, and that there is localization heterogeneity for reward functions in the human brain.

Music models aberrant rule decoding and reward valuation in dementia

PubMed Central

Clark, Camilla N; Golden, Hannah L; McCallion, Oliver; Nicholas, Jennifer M; Cohen, Miriam H; Slattery, Catherine F; Paterson, Ross W; Fletcher, Phillip D; Mummery, Catherine J; Rohrer, Jonathan D; Crutch, Sebastian J; Warren, Jason D

2018-01-01

Abstract Aberrant rule- and reward-based processes underpin abnormalities of socio-emotional behaviour in major dementias. However, these processes remain poorly characterized. Here we used music to probe rule decoding and reward valuation in patients with frontotemporal dementia (FTD) syndromes and Alzheimer’s disease (AD) relative to healthy age-matched individuals. We created short melodies that were either harmonically resolved (‘finished’) or unresolved (‘unfinished’); the task was to classify each melody as finished or unfinished (rule processing) and rate its subjective pleasantness (reward valuation). Results were adjusted for elementary pitch and executive processing; neuroanatomical correlates were assessed using voxel-based morphometry. Relative to healthy older controls, patients with behavioural variant FTD showed impairments of both musical rule decoding and reward valuation, while patients with semantic dementia showed impaired reward valuation but intact rule decoding, patients with AD showed impaired rule decoding but intact reward valuation and patients with progressive non-fluent aphasia performed comparably to healthy controls. Grey matter associations with task performance were identified in anterior temporal, medial and lateral orbitofrontal cortices, previously implicated in computing diverse biological and non-biological rules and rewards. The processing of musical rules and reward distils cognitive and neuroanatomical mechanisms relevant to complex socio-emotional dysfunction in major dementias. PMID:29186630

Impact of socio-emotional context, brain development, and pubertal maturation on adolescent risk-taking.

PubMed

Smith, Ashley R; Chein, Jason; Steinberg, Laurence

2013-07-01

While there is little doubt that risk-taking is generally more prevalent during adolescence than before or after, the underlying causes of this pattern of age differences have long been investigated and debated. One longstanding popular notion is the belief that risky and reckless behavior in adolescence is tied to the hormonal changes of puberty. However, the interactions between pubertal maturation and adolescent decision making remain largely understudied. In the current review, we discuss changes in decision making during adolescence, focusing on the asynchronous development of the affective, reward-focused processing system and the deliberative, reasoned processing system. As discussed, differential maturation in the structure and function of brain systems associated with these systems leaves adolescents particularly vulnerable to socio-emotional influences and risk-taking behaviors. We argue that this asynchrony may be partially linked to pubertal influences on development and specifically on the maturation of the affective, reward-focused processing system. Copyright © 2013 Elsevier Inc. All rights reserved.

Neural Networks Involved in Adolescent Reward Processing: An Activation Likelihood Estimation Meta-Analysis of Functional Neuroimaging Studies

PubMed Central

Silverman, Merav H.; Jedd, Kelly; Luciana, Monica

2015-01-01

Behavioral responses to, and the neural processing of, rewards change dramatically during adolescence and may contribute to observed increases in risk-taking during this developmental period. Functional MRI (fMRI) studies suggest differences between adolescents and adults in neural activation during reward processing, but findings are contradictory, and effects have been found in non-predicted directions. The current study uses an activation likelihood estimation (ALE) approach for quantitative meta-analysis of functional neuroimaging studies to: 1) confirm the network of brain regions involved in adolescents’ reward processing, 2) identify regions involved in specific stages (anticipation, outcome) and valence (positive, negative) of reward processing, and 3) identify differences in activation likelihood between adolescent and adult reward-related brain activation. Results reveal a subcortical network of brain regions involved in adolescent reward processing similar to that found in adults with major hubs including the ventral and dorsal striatum, insula, and posterior cingulate cortex (PCC). Contrast analyses find that adolescents exhibit greater likelihood of activation in the insula while processing anticipation relative to outcome and greater likelihood of activation in the putamen and amygdala during outcome relative to anticipation. While processing positive compared to negative valence, adolescents show increased likelihood for activation in the posterior cingulate cortex (PCC) and ventral striatum. Contrasting adolescent reward processing with the existing ALE of adult reward processing (Liu et al., 2011) reveals increased likelihood for activation in limbic, frontolimbic, and striatal regions in adolescents compared with adults. Unlike adolescents, adults also activate executive control regions of the frontal and parietal lobes. These findings support hypothesized elevations in motivated activity during adolescence. PMID:26254587

Monetary rewards influence retrieval orientations.

PubMed

Halsband, Teresa M; Ferdinand, Nicola K; Bridger, Emma K; Mecklinger, Axel

2012-09-01

Reward anticipation during learning is known to support memory formation, but its role in retrieval processes is so far unclear. Retrieval orientations, as a reflection of controlled retrieval processing, are one aspect of retrieval that might be modulated by reward. These processes can be measured using the event-related potentials (ERPs) elicited by retrieval cues from tasks with different retrieval requirements, such as via changes in the class of targeted memory information. To determine whether retrieval orientations of this kind are modulated by reward during learning, we investigated the effects of high and low reward expectancy on the ERP correlates of retrieval orientation in two separate experiments. The reward manipulation at study in Experiment 1 was associated with later memory performance, whereas in Experiment 2, reward was directly linked to accuracy in the study task. In both studies, the participants encoded mixed lists of pictures and words preceded by high- or low-reward cues. After 24 h, they performed a recognition memory exclusion task, with words as the test items. In addition to a previously reported material-specific effect of retrieval orientation, a frontally distributed, reward-associated retrieval orientation effect was found in both experiments. These findings suggest that reward motivation during learning leads to the adoption of a reward-associated retrieval orientation to support the retrieval of highly motivational information. Thus, ERP retrieval orientation effects not only reflect retrieval processes related to the sought-for materials, but also relate to the reward conditions with which items were combined during encoding.

Motivation versus aversive processing during perception.

PubMed

Padmala, Srikanth; Pessoa, Luiz

2014-06-01

Reward facilitates performance and boosts cognitive performance across many tasks. At the same time, negative affective stimuli interfere with performance when they are not relevant to the task at hand. Yet, the investigation of how reward and negative stimuli impact perception and cognition has taken place in a manner that is largely independent of each other. How reward and negative emotion simultaneously contribute to behavioral performance is currently poorly understood. The aim of the present study was to investigate how the simultaneous manipulation of positive motivational processing (here manipulated via reward) and aversive processing (here manipulated via negative picture viewing) influence behavior during a perceptual task. We tested 2 competing hypotheses about the impact of reward on negative picture viewing. On the one hand, suggestions about the automaticity of emotional processing predict that negative picture interference would be relatively immune to reward. On the other, if affective visual processing is not obligatory, as we have argued in the past, reward may counteract the deleterious effect of more potent negative pictures. We found that reward counteracted the effect of potent, negative distracters during a visual discrimination task. Thus, when sufficiently motivated, participants were able to reduce the deleterious impact of bodily mutilation stimuli.

Positive mood enhances reward-related neural activity

PubMed Central

Nusslock, Robin

2016-01-01

Although behavioral research has shown that positive mood leads to desired outcomes in nearly every major life domain, no studies have directly examined the effects of positive mood on the neural processes underlying reward-related affect and goal-directed behavior. To address this gap, participants in the present fMRI study experienced either a positive (n = 20) or neutral (n = 20) mood induction and subsequently completed a monetary incentive delay task that assessed reward and loss processing. Consistent with prediction, positive mood elevated activity specifically during reward anticipation in corticostriatal neural regions that have been implicated in reward processing and goal-directed behavior, including the nucleus accumbens, caudate, lateral orbitofrontal cortex and putamen, as well as related paralimbic regions, including the anterior insula and ventromedial prefrontal cortex. These effects were not observed during reward outcome, loss anticipation or loss outcome. Critically, this is the first study to report that positive mood enhances reward-related neural activity. Our findings have implications for uncovering the neural mechanisms by which positive mood enhances goal-directed behavior, understanding the malleability of reward-related neural activity, and developing targeted treatments for psychiatric disorders characterized by deficits in reward processing. PMID:26833919

The Nucleus Accumbens and Pavlovian Reward Learning

PubMed Central

Day, Jeremy J.

2011-01-01

The ability to form associations between predictive environmental events and rewarding outcomes is a fundamental aspect of learned behavior. This apparently simple ability likely requires complex neural processing evolved to identify, seek, and utilize natural rewards and redirect these activities based on updated sensory information. Emerging evidence from both animal and human research suggests that this type of processing is mediated in part by the nucleus accumbens and a closely associated network of brain structures. The nucleus accumbens is required for a number of reward-related behaviors, and processes specific information about reward availability, value, and context. Additionally, this structure is critical for the acquisition and expression of most Pavlovian stimulus-reward relationships, and cues that predict rewards produce robust changes in neural activity in the nucleus accumbens. While processing within the nucleus accumbens may enable or promote Pavlovian reward learning in natural situations, it has also been implicated in aspects of human drug addiction, including the ability of drug-paired cues to control behavior. This article will provide a critical review of the existing animal and human literature concerning the role of the NAc in Pavlovian learning with non-drug rewards and consider some clinical implications of these findings. PMID:17404375

Who, what, where, when (and maybe even why)? How the experience of sexual reward connects sexual desire, preference, and performance.

PubMed

Pfaus, James G; Kippin, Tod E; Coria-Avila, Genaro A; Gelez, Hélène; Afonso, Veronica M; Ismail, Nafissa; Parada, Mayte

2012-02-01

Although sexual behavior is controlled by hormonal and neurochemical actions in the brain, sexual experience induces a degree of plasticity that allows animals to form instrumental and Pavlovian associations that predict sexual outcomes, thereby directing the strength of sexual responding. This review describes how experience with sexual reward strengthens the development of sexual behavior and induces sexually-conditioned place and partner preferences in rats. In both male and female rats, early sexual experience with partners scented with a neutral or even noxious odor induces a preference for scented partners in subsequent choice tests. Those preferences can also be induced by injections of morphine or oxytocin paired with a male rat's first exposure to scented females, indicating that pharmacological activation of opioid or oxytocin receptors can "stand in" for the sexual reward-related neurochemical processes normally activated by sexual stimulation. Conversely, conditioned place or partner preferences can be blocked by the opioid receptor antagonist naloxone. A somatosensory cue (a rodent jacket) paired with sexual reward comes to elicit sexual arousal in male rats, such that paired rats with the jacket off show dramatic copulatory deficits. We propose that endogenous opioid activation forms the basis of sexual reward, which also sensitizes hypothalamic and mesolimbic dopamine systems in the presence of cues that predict sexual reward. Those systems act to focus attention on, and activate goal-directed behavior toward, reward-related stimuli. Thus, a critical period exists during an individual's early sexual experience that creates a "love map" or Gestalt of features, movements, feelings, and interpersonal interactions associated with sexual reward.

15 years of genetic approaches in vivo for addiction research: Opioid receptor and peptide gene knockout in mouse models of drug abuse.

PubMed

Charbogne, Pauline; Kieffer, Brigitte L; Befort, Katia

2014-01-01

The endogenous opioid system is expressed throughout the brain reinforcement circuitry, and plays a major role in reward processing, mood control and the development of addiction. This neuromodulator system is composed of three receptors, mu, delta and kappa, interacting with a family of opioid peptides derived from POMC (β-endorphin), preproenkephalin (pEnk) and preprodynorphin (pDyn) precursors. Knockout mice targeting each gene of the opioid system have been created almost two decades ago. Extending classical pharmacology, these mutant mice represent unique tools to tease apart the specific role of each opioid receptor and peptide in vivo, and a powerful approach to understand how the opioid system modulates behavioral effects of drugs of abuse. The present review summarizes these studies, with a focus on major drugs of abuse including morphine/heroin, cannabinoids, psychostimulants, nicotine or alcohol. Genetic data, altogether, set the mu receptor as the primary target for morphine and heroin. In addition, this receptor is essential to mediate rewarding properties of non-opioid drugs of abuse, with a demonstrated implication of β-endorphin for cocaine and nicotine. Delta receptor activity reduces levels of anxiety and depressive-like behaviors, and facilitates morphine-context association. pEnk is involved in these processes and delta/pEnk signaling likely regulates alcohol intake. The kappa receptor mainly interacts with pDyn peptides to limit drug reward, and mediate dysphoric effects of cannabinoids and nicotine. Kappa/dynorphin activity also increases sensitivity to cocaine reward under stressful conditions. The opioid system remains a prime candidate to develop successful therapies in addicted individuals, and understanding opioid-mediated processes at systems level, through emerging genetic and imaging technologies, represents the next challenging goal and a promising avenue in addiction research. This article is part of a Special Issue entitled 'NIDA 40th Anniversary Issue'. Copyright © 2013 Elsevier Ltd. All rights reserved.

Neural alterations of fronto-striatal circuitry during reward anticipation in euthymic bipolar disorder.

PubMed

Schreiter, S; Spengler, S; Willert, A; Mohnke, S; Herold, D; Erk, S; Romanczuk-Seiferth, N; Quinlivan, E; Hindi-Attar, C; Banzhaf, C; Wackerhagen, C; Romund, L; Garbusow, M; Stamm, T; Heinz, A; Walter, H; Bermpohl, F

2016-11-01

Bipolar disorder (BD), with the hallmark symptoms of elevated and depressed mood, is thought to be characterized by underlying alterations in reward-processing networks. However, to date the neural circuitry underlying abnormal responses during reward processing in BD remains largely unexplored. The aim of this study was to investigate whether euthymic BD is characterized by aberrant ventral striatal (VS) activation patterns and altered connectivity with the prefrontal cortex in response to monetary gains and losses. During functional magnetic resonance imaging 20 euthymic BD patients and 20 age-, gender- and intelligence quotient-matched healthy controls completed a monetary incentive delay paradigm, to examine neural processing of reward and loss anticipation. A priori defined regions of interest (ROIs) included the VS and the anterior prefrontal cortex (aPFC). Psychophysiological interactions (PPIs) between these ROIs were estimated and tested for group differences for reward and loss anticipation separately. BD participants, relative to healthy controls, displayed decreased activation selectively in the left and right VS during anticipation of reward, but not during loss anticipation. PPI analyses showed decreased functional connectivity between the left VS and aPFC in BD patients compared with healthy controls during reward anticipation. This is the first study showing decreased VS activity and aberrant connectivity in the reward-processing circuitry in euthymic, medicated BD patients during reward anticipation. Our findings contrast with research supporting a reward hypersensitivity model of BD, and add to the body of literature suggesting that blunted activation of reward processing circuits may be a vulnerability factor for mood disorders.

A novel mobile system for radiation detection and monitoring

NASA Astrophysics Data System (ADS)

Biafore, Mauro

2014-05-01

A novel mobile system for real time, wide area radiation surveillance has been developed within the REWARD project, financed within the FP7 programme, theme SEC-2011.1.5-1 (Development of detection capabilities of difficult to detect radioactive sources and nuclear materials - Capability Project). The REWARD sensing units are small, mobile portable units with low energy consumption, which consist of new miniaturized solid-state radiation sensors: a CdZnTe detector for gamma radiation and a high efficiency neutron detector based on novel silicon technologies. The sensing unit is integrated by a wireless communication interface to send the data remotely to a monitoring base station as well as a GPS system to calculate the position of the tag. The system also incorporates middleware and high-level software to provide web-service interfaces for the exchange of information. A central monitoring and decision support system has been designed to process the data from the sensing units and to compare them with historical record in order to generate an alarm when an abnormal situation is detected. A security framework ensures protection against unauthorized access to the network and data, ensuring the privacy of the communications and contributing to the overall robustness and reliability of the REWARD system. The REWARD system has been designed for many different scenarios such as nuclear terrorism threats, lost radioactive sources, radioactive contamination or nuclear accidents. It can be deployed in emergency units and in general in any type of mobile or static equipment, but also inside public/private buildings or infrastructures. The complete system is scalable in terms of complexity and cost and offers very high precision on both the measurement and the location of the radiation. The modularity and flexibility of the system allows for a realistic introduction to the market. Authorities may start with a basic, low cost system and increase the complexity based on their evolving needs and budget constraints. On 24th September 2013, REWARD project received a prize as the best Innovative project related to the Not Conventional Threat (NCT) Chemical Biological Radiological Nuclear explosives (CBRNe) products. A highly distinguished jury stated that "the developed detection and surveillance system offers a perfect solution for end-users to enhance crucial capabilities in RN analysis, risk communication and surveillance in case of a radiation incident". A demonstration of the REWARD system is planned in Naples on September 2014. More information about the REWARD project can be found at www.reward-project.eu.

Dissociable effects of reward and expectancy during evaluative feedback processing revealed by topographic ERP mapping analysis.

PubMed

Gheza, Davide; Paul, Katharina; Pourtois, Gilles

2017-11-24

Evaluative feedback provided during performance monitoring (PM) elicits either a positive or negative deflection ~250-300ms after its onset in the event-related potential (ERP) depending on whether the outcome is reward-related or not, as well as expected or not. However, it remains currently unclear whether these two deflections reflect a unitary process, or rather dissociable effects arising from non-overlapping brain networks. To address this question, we recorded 64-channel EEG in healthy adult participants performing a standard gambling task where valence and expectancy were manipulated in a factorial design. We analyzed the feedback-locked ERP data using a conventional ERP analysis, as well as an advanced topographic ERP mapping analysis supplemented with distributed source localization. Results reveal two main topographies showing opposing valence effects, and being differently modulated by expectancy. The first one was short-lived and sensitive to no-reward irrespective of expectancy. Source-estimation associated with this topographic map comprised mainly regions of the dorsal anterior cingulate cortex. The second one was primarily driven by reward, had a prolonged time-course and was monotonically influenced by expectancy. Moreover, this reward-related topographical map was best accounted for by intracranial generators estimated in the posterior cingulate cortex. These new findings suggest the existence of dissociable brain systems depending on feedback valence and expectancy. More generally, they inform about the added value of using topographic ERP mapping methods, besides conventional ERP measurements, to characterize qualitative changes occurring in the spatio-temporal dynamic of reward processing during PM. Copyright © 2017 Elsevier B.V. All rights reserved.

Perceived Chronic Stress Exposure Modulates Reward-Related Medial Prefrontal Cortex Responses to Acute Stress in Depression

PubMed Central

Kumar, Poornima; Slavich, George M.; Berghorst, Lisa H.; Treadway, Michael T.; Brooks, Nancy H.; Dutra, Sunny J.; Greve, Douglas N.; O'Donovan, Aoife; Bleil, Maria E.; Maninger, Nicole; Pizzagalli, Diego A.

2015-01-01

Introduction Major depressive disorder (MDD) is often precipitated by life stress and growing evidence suggests that stress-induced alterations in reward processing may contribute to such risk. However, no human imaging studies have examined how recent life stress exposure modulates the neural systems that underlie reward processing in depressed and healthy individuals. Methods In this proof-of-concept study, 12 MDD and 10 psychiatrically healthy individuals were interviewed using the Life Events and Difficulties Schedule (LEDS) to assess their perceived levels of recent acute and chronic life stress exposure. Additionally, each participant performed a monetary incentive delay task under baseline (no-stress) and stress (social-evaluative) conditions during functional MRI. Results Across groups, medial prefrontal cortex (mPFC) activation to reward feedback was greater during acute stress versus no-stress conditions in individuals with greater perceived stressor severity. Under acute stress, depressed individuals showed a positive correlation between perceived stressor severity levels and reward-related mPFC activation (r = 0.79, p = 0.004), whereas no effect was found in healthy controls. Moreover, for depressed (but not healthy) individuals, the correlations between the stress (r = 0.79) and no-stress (r = −0.48) conditions were significantly different. Finally, relative to controls, depressed participants showed significantly reduced mPFC grey matter, but functional findings remained when accounting for structural differences. Limitation Small sample size, which warrants replication. Conclusion Depressed individuals experiencing greater recent life stress recruited the mPFC more under stress when processing rewards. Our results represent an initial step toward elucidating mechanisms underlying stress sensitization and recurrence in depression. PMID:25898329

Dopaminergic circuitry and risk/reward decision making: implications for schizophrenia.

PubMed

Stopper, Colin M; Floresco, Stan B

2015-01-01

Abnormal reinforcement learning and representations of reward value are present in schizophrenia, and these impairments can manifest as deficits in risk/reward decision making. These abnormalities may be due in part to dopaminergic dysfunction within cortico-limbic-striatal circuitry. Evidence from studies with laboratory animal have revealed that normal DA activity within different nodes of these circuits is critical for mediating dissociable processes that can refine decision biases. Moreover, both phasic and tonic dopamine transmission appear to play separate yet complementary roles in these processes. Tonic dopamine release within the prefrontal cortex and nucleus accumbens, serves as a "running rate-meter" of reward and reflects contextual information such as reward uncertainty and overt choice behavior. On the other hand, manipulations of outcome-related phasic dopamine bursts and dips suggest these signals provide rapid feedback to allow for quick adjustments in choice as reward contingencies change. The lateral habenula is a key input to the DA system that phasic signals is necessary for expressing subjective decision biases; as suppression of activity within this nucleus leads to catastrophic impairments in decision making and random patterns of choice behavior. As schizophrenia is characterized by impairments in using positive and negative feedback to appropriately guide decision making, these findings suggest that these deficits in these processes may be mediated, at least in part, by abnormalities in both tonic and phasic dopamine transmission. © The Author 2014. Published by Oxford University Press on behalf of the Maryland Psychiatric Research Center. All rights reserved. For permissions, please email: journals.permissions@oup.com.

Functional changes of the reward system underlie blunted response to social gaze in cocaine users

PubMed Central

Preller, Katrin H.; Herdener, Marcus; Schilbach, Leonhard; Stämpfli, Philipp; Hulka, Lea M.; Vonmoos, Matthias; Ingold, Nina; Vogeley, Kai; Tobler, Philippe N.; Seifritz, Erich; Quednow, Boris B.

2014-01-01

Social interaction deficits in drug users likely impede treatment, increase the burden of the affected families, and consequently contribute to the high costs for society associated with addiction. Despite its significance, the neural basis of altered social interaction in drug users is currently unknown. Therefore, we investigated basal social gaze behavior in cocaine users by applying behavioral, psychophysiological, and functional brain-imaging methods. In study I, 80 regular cocaine users and 63 healthy controls completed an interactive paradigm in which the participants’ gaze was recorded by an eye-tracking device that controlled the gaze of an anthropomorphic virtual character. Valence ratings of different eye-contact conditions revealed that cocaine users show diminished emotional engagement in social interaction, which was also supported by reduced pupil responses. Study II investigated the neural underpinnings of changes in social reward processing observed in study I. Sixteen cocaine users and 16 controls completed a similar interaction paradigm as used in study I while undergoing functional magnetic resonance imaging. In response to social interaction, cocaine users displayed decreased activation of the medial orbitofrontal cortex, a key region of reward processing. Moreover, blunted activation of the medial orbitofrontal cortex was significantly correlated with a decreased social network size, reflecting problems in real-life social behavior because of reduced social reward. In conclusion, basic social interaction deficits in cocaine users as observed here may arise from altered social reward processing. Consequently, these results point to the importance of reinstatement of social reward in the treatment of stimulant addiction. PMID:24449854

Why social attachment and oxytocin protect against addiction and stress: Insights from the dynamics between ventral and dorsal corticostriatal systems.

PubMed

Tops, Mattie; Koole, Sander L; IJzerman, Hans; Buisman-Pijlman, Femke T A

2014-04-01

The present article advances a neurobiological model of the reciprocal associations between social attachment and drug abuse, and social attachment and chronic stress, as overlapping systems are involved in stress coping and social attachment. In terms of coping, responding to a novel stressor or challenge involves initial novelty processing and activation of learning mechanisms that allow habituation to the stressor through familiarization. Similarly, social attachments are initially formed by being attracted by rewarding properties of an as-yet novel individual, and subsequently developing feelings of attachment towards the familiarized individual. Attachment and familiarization increase the availability of "internal working models" for the control of behavior and emotion, which may explain why secure attachments are associated with increased resilience in the face of stress, accompanied by less reactive reward responding (i.e., increased resilience against drug addiction). The present article seeks to illuminate the role of the neuropeptide oxytocin, which may be involved in the overlapping mechanisms of stable attachment formation and stress coping by shifting processing from novelty and reward seeking to appreciation of familiarity. Oxytocin may accomplish this by facilitating a ventral-to-dorsal shift in activation in corticostriatal loops, which produces a shift from a reactive reward drive (wanting) to stable appreciation of familiar social aspects ("liking" or "loving"). The authors suggest that through dopaminergic, serotonergic and endogenous opioid mechanisms, oxytocin is involved in shifting the balance between wanting and liking in corticostriatal loops by facilitating consolidation of social information from ventral reactive reward systems to dorsal internal working models that aid in prospectively selecting optimal actions in the future, increasing resilience in the face of stress and addiction. © 2013.

Orbitofrontal overactivation in reward processing in borderline personality disorder: the role of non-suicidal self-injury.

PubMed

Vega, Daniel; Ripollés, Pablo; Soto, Àngel; Torrubia, Rafael; Ribas, Joan; Monreal, Jose Antonio; Pascual, Juan Carlos; Salvador, Raymond; Pomarol-Clotet, Edith; Rodríguez-Fornells, Antoni; Marco-Pallarés, Josep

2018-02-01

Borderline Personality Disorder (BPD) is a disabling and difficult-to-treat mental disease. One of its core features is a significant difficulty in affect regulation, which is often accompanied by Non-Suicidal Self-Injury (NSSI). It is suggested that this type of behavior elicits positive emotions and mitigates emotional distress, and therefore can ultimately be reinforced and promoted. In spite of the high prevalence of NSSI behaviors (also in non-BPD samples), their role in modulating reward-related processes has not yet been investigated in BPD patients. In the present study, this lack of research was addressed. A large sample of BPD patients (N = 40), divided into two groups depending on the presence of NSSI, and a group of matched healthy controls underwent functional Magnetic Resonance Imaging (fMRI) while performing a gambling task. Patients who committed NSSI acts exhibited enhanced activation of the orbitofrontal cortex following an unexpected reward, when compared with controls and BPD patients with no NSSI behavior. In addition, the NSSI group showed diminished functional connectivity between the left orbitofrontal cortex and the right parahippocampal gyrus. These findings might suggest impaired ability to update reward associations of potential choices when both BPD and NSSI are present. We propose that the presence of NSSI involves alterations in the reward system independently of BPD, and thus can be considered as a possible phenotype for reward-related alterations.

Reward Expectancy Strengthens CA1 Theta and Beta Band Synchronization and Hippocampal-Ventral Striatal Coupling.

PubMed

Lansink, Carien S; Meijer, Guido T; Lankelma, Jan V; Vinck, Martin A; Jackson, Jadin C; Pennartz, Cyriel M A

2016-10-12

The use of information from the hippocampal memory system in motivated behavior depends on its communication with the ventral striatum. When an animal encounters cues that signal subsequent reward, its reward expectancy is raised. It is unknown, however, how this process affects hippocampal dynamics and their influence on target structures, such as ventral striatum. We show that, in rats, reward-predictive cues result in enhanced hippocampal theta and beta band rhythmic activity during subsequent action, compared with uncued goal-directed navigation. The beta band component, also labeled theta's harmonic, involves selective hippocampal CA1 cell groups showing frequency doubling of firing periodicity relative to theta rhythmicity and it partitions the theta cycle into segments showing clear versus poor spike timing organization. We found that theta phase precession occurred over a wider range than previously reported. This was apparent from spikes emitted near the peak of the theta cycle exhibiting large "phase precessing jumps" relative to spikes in foregoing cycles. Neither this phenomenon nor the regular manifestation of theta phase precession was affected by reward expectancy. Ventral striatal neuronal firing phase-locked not only to hippocampal theta, but also to beta band activity. Both hippocampus and ventral striatum showed increased synchronization between neuronal firing and local field potential activity during cued compared with uncued goal approaches. These results suggest that cue-triggered reward expectancy intensifies hippocampal output to target structures, such as the ventral striatum, by which the hippocampus may gain prioritized access to systems modulating motivated behaviors. Here we show that temporally discrete cues raising reward expectancy enhance both theta and beta band activity in the hippocampus once goal-directed navigation has been initiated. These rhythmic activities are associated with increased synchronization of neuronal firing patterns in the hippocampus and the connected ventral striatum. When transmitted to downstream target structures, this expectancy-related state of intensified processing in the hippocampus may modulate goal-directed action. Copyright © 2016 the authors 0270-6474/16/3610598-13$15.00/0.

Cocaine affects foraging behaviour and biogenic amine modulated behavioural reflexes in honey bees.

PubMed

Søvik, Eirik; Even, Naïla; Radford, Catherine W; Barron, Andrew B

2014-01-01

In humans and other mammals, drugs of abuse alter the function of biogenic amine pathways in the brain leading to the subjective experience of reward and euphoria. Biogenic amine pathways are involved in reward processing across diverse animal phyla, however whether cocaine acts on these neurochemical pathways to cause similar rewarding behavioural effects in animal phyla other than mammals is unclear. Previously, it has been shown that bees are more likely to dance (a signal of perceived reward) when returning from a sucrose feeder after cocaine treatment. Here we examined more broadly whether cocaine altered reward-related behaviour, and biogenic amine modulated behavioural responses in bees. Bees developed a preference for locations at which they received cocaine, and when foraging at low quality sucrose feeders increase their foraging rate in response to cocaine treatment. Cocaine also increased reflexive proboscis extension to sucrose, and sting extension to electric shock. Both of these simple reflexes are modulated by biogenic amines. This shows that systemic cocaine treatment alters behavioural responses that are modulated by biogenic amines in insects. Since insect reward responses involve both octopamine and dopamine signalling, we conclude that cocaine treatment altered diverse reward-related aspects of behaviour in bees. We discuss the implications of these results for understanding the ecology of cocaine as a plant defence compound. Our findings further validate the honey bee as a model system for understanding the behavioural impacts of cocaine, and potentially other drugs of abuse.

[The endogenous opioid system and drug addiction].

PubMed

Maldonado, R

2010-01-01

Drug addiction is a chronic brain disorder leading to complex adaptive changes within the brain reward circuits. Several neurotransmitters, including the endogenous opioid system are involved in these changes. The opioid system plays a pivotal role in different aspects of addiction. Thus, opioid receptors and endogenous opioid peptides are largely distributed in the mesolimbic system and modulate dopaminergic activity within the reward circuits. Opioid receptors and peptides are selectively involved in several components of the addictive processes induced by opioids, cannabinoids, psychostimulants, alcohol and nicotine. This review is focused on the contribution of each component of the endogenous opioid system in the addictive properties of the different drugs of abuse. Copyright 2010 Elsevier Masson SAS. All rights reserved.

A measurement-based performability model for a multiprocessor system

NASA Technical Reports Server (NTRS)

Ilsueh, M. C.; Iyer, Ravi K.; Trivedi, K. S.

1987-01-01

A measurement-based performability model based on real error-data collected on a multiprocessor system is described. Model development from the raw errror-data to the estimation of cumulative reward is described. Both normal and failure behavior of the system are characterized. The measured data show that the holding times in key operational and failure states are not simple exponential and that semi-Markov process is necessary to model the system behavior. A reward function, based on the service rate and the error rate in each state, is then defined in order to estimate the performability of the system and to depict the cost of different failure types and recovery procedures.

An Exploration of Dual Systems via Time Pressure Manipulation in Decision-making Problems

NASA Astrophysics Data System (ADS)

Guo, Lisa

Every day, decisions need to be made where time is a limiting factor. Regardless of situation, time constraints often place a premium on rapid decision-making. Researchers have been interested in studying this human behavior and understanding its underlying cognitive processes. In previous studies, scientists have believed that the cognitive processes underlying decision-making behavior were consistent with dual-process modes of thinking. Critics of dual-process theory question the vagueness of its definition, and claim that single-process accounts can explain the data just as well. My aim is to elucidate the cognitive processes that underlie decisions which involve some level of risk through the experimental manipulation of time pressure. Using this method, I hope to distinguish between competing hypotheses related to the origin of the effect. I will explore three types of decisions that illustrate these concepts: risky decision-making involving gambles, intertemporal choice, and one-shot public goods games involving social cooperation. In our experiments, participants made decisions about gambles framed as either gains or losses; decided upon intertemporal choices for smaller but sooner rewards or larger but later rewards; and played a one-shot public goods game involving social cooperation and contributing an amount of money to a group. In each case, we experimentally manipulated time pressure, either within subjects or among individuals. Results showed under time pressure, increased framing effects under in both hypothetical and incentivized choices; and greater contributions and cooperation among individuals, lending support to the dual process hypothesis that these effects arise from a fast, intuitive system. However, our intertemporal choice experiment showed that time constraints led to increased selection of the larger but later options, which suggests that the magnitude of the reward may play larger role in choice selection under cognitive load than previously studied. This diverges from the current dual-process interpretation that myopic choices under time pressure favor smaller but sooner rewards, and suggests that more studies are needed in this realm to disentangle the intuitive from the deliberative system through the manipulation of cognitive load.

Neural correlates of reward processing in healthy siblings of patients with schizophrenia

PubMed Central

Hanssen, Esther; van der Velde, Jorien; Gromann, Paula M.; Shergill, Sukhi S.; de Haan, Lieuwe; Bruggeman, Richard; Krabbendam, Lydia; Aleman, André; van Atteveldt, Nienke

2015-01-01

Deficits in motivational behavior and psychotic symptoms often observed in schizophrenia (SZ) may be driven by dysfunctional reward processing (RP). RP can be divided in two different stages; reward anticipation and reward consumption. Aberrant processing during reward anticipation seems to be related to SZ. Studies in patients with SZ have found less activation in the ventral striatum (VS) during anticipation of reward, but these findings do not provide information on effect of the genetic load on reward processing. Therefore, this study investigated RP in healthy first-degree relatives of SZ patients. The sample consisted of 94 healthy siblings of SZ patients and 57 healthy controls. Participants completed a classic RP task, the Monetary Incentive Delay task, during functional magnetic resonance imaging (fMRI). As expected, there were no behavioral differences between groups. In contrast to our expectations, we found no differences in any of the anticipatory reward related brain areas (region of interest analyses). Whole-brain analyses did reveal group differences during both reward anticipation and reward consumption; during reward anticipation siblings showed less deactivation in the insula, posterior cingulate cortex (PCC) and medial frontal gyrus (MFG) than controls. During reward consumption siblings showed less deactivation in the PCC and the right MFG compared to controls and activation in contrast to deactivation in controls in the precuneus and the left MFG. Exclusively in siblings, MFG activity correlated positively with subclinical negative symptoms. These regions are typically associated with the default mode network (DMN), which normally shows decreases in activation during task-related cognitive processes. Thus, in contrast to prior literature in patients with SZ, the results do not point to altered brain activity in classical RP brain areas, such as the VS. However, the weaker deactivation found outside the reward-related network in siblings could indicate reduced task-related suppression (i.e., hyperactivation) of the DMN. The presence of DMN hyperactivation during reward anticipation and reward consumption might indicate that siblings of patients with SZ have a higher baseline level of DMN activation and possible abnormal network functioning. PMID:26441601

Trading Later Rewards for Current Pleasure: Pornography Consumption and Delay Discounting.

PubMed

Negash, Sesen; Sheppard, Nicole Van Ness; Lambert, Nathaniel M; Fincham, Frank D

2016-01-01

Internet pornography is a multi-billion-dollar industry that has grown increasingly accessible. Delay discounting involves devaluing larger, later rewards in favor of smaller, more immediate rewards. The constant novelty and primacy of sexual stimuli as particularly strong natural rewards make Internet pornography a unique activator of the brain's reward system, thereby having implications for decision-making processes. Based on theoretical studies of evolutionary psychology and neuroeconomics, two studies tested the hypothesis that consuming Internet pornography would relate to higher rates of delay discounting. Study 1 used a longitudinal design. Participants completed a pornography use questionnaire and a delay discounting task at Time 1 and then again four weeks later. Participants reporting higher initial pornography use demonstrated a higher delay discounting rate at Time 2, controlling for initial delay discounting. Study 2 tested for causality with an experimental design. Participants were randomly assigned to abstain from either their favorite food or pornography for three weeks. Participants who abstained from pornography use demonstrated lower delay discounting than participants who abstained from their favorite food. The finding suggests that Internet pornography is a sexual reward that contributes to delay discounting differently than other natural rewards. Theoretical and clinical implications of these studies are highlighted.

Reward-prospect interacts with trial-by-trial preparation for potential distraction

PubMed Central

Marini, Francesco; van den Berg, Berry; Woldorff, Marty G.

2015-01-01

When attending for impending visual stimuli, cognitive systems prepare to identify relevant information while ignoring irrelevant, potentially distracting input. Recent work (Marini et al., 2013) showed that a supramodal distracter-filtering mechanism is invoked in blocked designs involving expectation of possible distracter stimuli, although this entails a cost (distraction-filtering cost) on speeded performance when distracters are expected but not presented. Here we used an arrow-flanker task to study whether an analogous cost, potentially reflecting the recruitment of a specific distraction-filtering mechanism, occurs dynamically when potential distraction is cued trial-to-trial (cued distracter-expectation cost). In order to promote the maximal utilization of cue information by participants, in some experimental conditions the cue also signaled the possibility of earning a monetary reward for fast and accurate performance. This design also allowed us to investigate the interplay between anticipation for distracters and anticipation of reward, which is known to engender attentional preparation. Only in reward contexts did participants show a cued distracter-expectation cost, which was larger with higher reward prospect and when anticipation for both distracters and reward were manipulated trial-to-trial. Thus, these results indicate that reward prospect interacts with the distracter expectation during trial-by-trial preparatory processes for potential distraction. These findings highlight how reward guides cue-driven attentional preparation. PMID:26180506

Reward-prospect interacts with trial-by-trial preparation for potential distraction.

PubMed

Marini, Francesco; van den Berg, Berry; Woldorff, Marty G

2015-02-01

When attending for impending visual stimuli, cognitive systems prepare to identify relevant information while ignoring irrelevant, potentially distracting input. Recent work (Marini et al., 2013) showed that a supramodal distracter-filtering mechanism is invoked in blocked designs involving expectation of possible distracter stimuli, although this entails a cost ( distraction-filtering cost ) on speeded performance when distracters are expected but not presented. Here we used an arrow-flanker task to study whether an analogous cost, potentially reflecting the recruitment of a specific distraction-filtering mechanism, occurs dynamically when potential distraction is cued trial-to-trial ( cued distracter-expectation cost ). In order to promote the maximal utilization of cue information by participants, in some experimental conditions the cue also signaled the possibility of earning a monetary reward for fast and accurate performance. This design also allowed us to investigate the interplay between anticipation for distracters and anticipation of reward, which is known to engender attentional preparation. Only in reward contexts did participants show a cued distracter-expectation cost, which was larger with higher reward prospect and when anticipation for both distracters and reward were manipulated trial-to-trial. Thus, these results indicate that reward prospect interacts with the distracter expectation during trial-by-trial preparatory processes for potential distraction. These findings highlight how reward guides cue-driven attentional preparation.

Disentangling reward anticipation with simultaneous pupillometry / fMRI.

PubMed

Schneider, Max; Leuchs, Laura; Czisch, Michael; Sämann, Philipp G; Spoormaker, Victor I

2018-05-05

The reward system may provide an interesting intermediate phenotype for anhedonia in affective disorders. Reward anticipation is characterized by an increase in arousal, and previous studies have linked the anterior cingulate cortex (ACC) to arousal responses such as dilation of the pupil. Here, we examined pupil dynamics during a reward anticipation task in forty-six healthy human subjects and evaluated its neural correlates using functional magnetic resonance imaging (fMRI). Pupil size showed a strong increase during monetary reward anticipation, a moderate increase during verbal reward anticipation and a decrease during control trials. For fMRI analyses, average pupil size and pupil change were computed in 1-s time bins during the anticipation phase. Activity in the ventral striatum was inversely related to the pupil size time course, indicating an early onset of activation and a role in reward prediction processing. Pupil dilations were linked to increased activity in the salience network (dorsal ACC and bilateral insula), which likely triggers an increase in arousal to enhance task performance. Finally, increased pupil size preceding the required motor response was associated with activity in the ventral attention network. In sum, pupillometry provides an effective tool for disentangling different phases of reward anticipation, with relevance for affective symptomatology. Copyright © 2018 Elsevier Inc. All rights reserved.

Differences in neural responses to reward and punishment processing between anorexia nervosa subtypes: An fMRI study.

PubMed

Murao, Ema; Sugihara, Genichi; Isobe, Masanori; Noda, Tomomi; Kawabata, Michiko; Matsukawa, Noriko; Takahashi, Hidehiko; Murai, Toshiya; Noma, Shun'ichi

2017-09-01

Anorexia nervosa (AN) includes the restricting (AN-r) and binge-eating/purging (AN-bp) subtypes, which have been reported to differ regarding their underlying pathophysiologies as well as their behavioral patterns. However, the differences in neural mechanisms of reward systems between AN subtypes remain unclear. The aim of the present study was to explore differences in the neural processing of reward and punishment between AN subtypes. Twenty-three female patients with AN (11 AN-r and 12 AN-bp) and 20 healthy women underwent functional magnetic resonance imaging while performing a monetary incentive delay task. Whole-brain one-way analysis of variance was conducted to test between-group differences. There were significant group differences in brain activation in the rostral anterior cingulate cortex and right posterior insula during loss anticipation, with increased brain activation in the AN-bp group relative to the AN-r and healthy women groups. No significant differences were found during gain anticipation. AN-bp patients showed altered neural responses to punishment in brain regions implicated in emotional arousal. Our findings suggest that individuals with AN-bp are more sensitive to potential punishment than individuals with AN-r and healthy individuals at the neural level. The present study provides preliminary evidence that there are neurobiological differences between AN subtypes with regard to the reward system, especially punishment processing. © 2017 The Authors. Psychiatry and Clinical Neurosciences © 2017 Japanese Society of Psychiatry and Neurology.

Reward Improves Cancellation and Restraint Inhibition Across Childhood and Adolescence

PubMed Central

Sinopoli, Katia J.; Schachar, Russell; Dennis, Maureen

2011-01-01

Inhibitory control allows for the regulation of thought and action, and interacts with motivational variables, such as reward, to modify behavior adaptively as environments change. We examined the effects of reward on two distinct forms of inhibitory control, cancellation and restraint. Typically developing children and adolescents completed two versions of the stop signal task (cancellation and restraint) under three reward conditions (neutral, low reward, and high reward), where rewards were earned for successful inhibitory control. Rewards improved both cancellation and restraint inhibition, with similar effects of reward on each form of inhibitory control. Rewards did not alter the speed of response execution in either task, suggesting that rewards specifically altered inhibition processes without influencing processes related to response execution. Adolescents were faster and less variable than children when executing and inhibiting their responses. There were similar developmental effects of reward on the speed of inhibitory control, but group differences were found in terms of accuracy of inhibition in the restraint task. These results clarify how reward modulates two different forms of regulatory behavior in children and adolescents. PMID:21744952

Dissociated effects of anticipating smoking versus monetary reward in the caudate as a function of smoking abstinence.

PubMed

Sweitzer, Maggie M; Geier, Charles F; Joel, Danielle L; McGurrin, Patrick; Denlinger, Rachel L; Forbes, Erika E; Donny, Eric C

2014-11-01

Theories of addiction suggest that chronic smoking may be associated with both hypersensitivity to smoking and related cues and hyposensitivity to alternative reinforcers. However, neural responses to smoking and nonsmoking rewards are rarely evaluated within the same paradigm, leaving the extent to which both processes operate simultaneously uncertain. Behavioral evidence and theoretical models suggest that dysregulated reward processing may be more pronounced during deprivation from nicotine, but neuroimaging evidence on the effects of deprivation on reward processing is limited. The current study examined the impact of deprivation from smoking on neural processing of both smoking and monetary rewards. Two separate functional magnetic resonance imaging scans were performed in 38 daily smokers, one after smoking without restriction and one following 24 hours of abstinence. A rewarded guessing task was conducted during each scan to evaluate striatal blood oxygen level-dependent response during anticipation of both smoking and monetary rewards. A significant reward type by abstinence interaction was observed in the bilateral caudate and medial prefrontal cortex during reward anticipation. The blood oxygen level-dependent response to anticipation of smoking reward was significantly higher and anticipation of monetary rewards was significantly lower during abstinence compared with nonabstinence. Attenuation of monetary reward-related activation during abstinence was significantly correlated with abstinence-induced increases in craving and withdrawal. These results provide the first direct evidence of dissociated effects of smoking versus monetary rewards as a function of abstinence. The findings suggest an important neural pathway that may underlie the choice to smoke in lieu of alternative reinforcement during a quit attempt. © 2013 Society of Biological Psychiatry Published by Society of Biological Psychiatry All rights reserved.

Abstinent adult daily smokers show reduced anticipatory but elevated saccade-related brain responses during a rewarded antisaccade task.

PubMed

Geier, Charles F; Sweitzer, Maggie M; Denlinger, Rachel; Sparacino, Gina; Donny, Eric C

2014-08-30

Chronic smoking may result in reduced sensitivity to non-drug rewards (e.g., money), a phenomenon particularly salient during abstinence. During a quit attempt, this effect may contribute to biased decision-making (smoking>alternative reinforcers) and relapse. Although relevant for quitting, characterization of reduced reward function in abstinent smokers remains limited. Moreover, how attenuated reward function affects other brain systems supporting decision-making has not been established. Here, we use a rewarded antisaccade (rAS) task to characterize non-drug reward processing and its influence on inhibitory control, key elements underlying decision-making, in abstinent smokers vs. non-smokers. Abstinent (12-hours) adult daily smokers (N=23) and non-smokers (N=11) underwent fMRI while performing the rAS. Behavioral performances improved on reward vs. neutral trials. Smokers showed attenuated activation in ventral striatum during the reward cue and in superior precentral sulcus and posterior parietal cortex during response preparation, but greater responses during the saccade response in posterior cingulate and parietal cortices. Smokers' attenuated anticipatory responses suggest reduced motivation from monetary reward, while heightened activation during the saccade response suggests that additional circuitry may be engaged later to enhance inhibitory task performance. Overall, this preliminary study highlights group differences in decision-making components and the utility of the rAS to characterize these effects. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

The detrimental effects of emotional process dysregulation on decision-making in substance dependence

PubMed Central

Murphy, Anna; Taylor, Eleanor; Elliott, Rebecca

2012-01-01

Substance dependence is complex and multifactorial, with many distinct pathways involved in both the development and subsequent maintenance of addictive behaviors. Various cognitive mechanisms have been implicated, including impulsivity, compulsivity, and impaired decision-making. These mechanisms are modulated by emotional processes, resulting in increased likelihood of initial drug use, sustained substance dependence, and increased relapse during periods of abstinence. Emotional traits, such as sensation-seeking, are risk factors for substance use, and chronic drug use can result in further emotional dysregulation via effects on reward, motivation, and stress systems. We will explore theories of hyper and hypo sensitivity of the brain reward systems that may underpin motivational abnormalities and anhedonia. Disturbances in these systems contribute to the biasing of emotional processing toward cues related to drug use at the expense of natural rewards, which serves to maintain addictive behavior, via enhanced drug craving. We will additionally focus on the sensitization of the brain stress systems that result in negative affect states that continue into protracted abstinence that is may lead to compulsive drug-taking. We will explore how these emotional dysregulations impact upon decision-making controlled by goal-directed and habitual action selections systems, and, in combination with a failure of prefrontal inhibitory control, mediate maladaptive decision-making observed in substance dependent individuals such that they continue drug use in spite of negative consequences. An understanding of the emotional impacts on cognition in substance dependent individuals may guide the development of more effective therapeutic interventions. PMID:23162443

Individual differences in drivers' cognitive processing of road safety messages.

PubMed

Kaye, Sherrie-Anne; White, Melanie J; Lewis, Ioni M

2013-01-01

Using Gray and McNaughton's (2000) revised reinforcement sensitivity theory (r-RST), we examined the influence of personality on processing of words presented in gain-framed and loss-framed anti-speeding messages and how the processing biases associated with personality influenced message acceptance. The r-RST predicts that the nervous system regulates personality and that behaviour is dependent upon the activation of the behavioural activation system (BAS), activated by reward cues and the fight-flight-freeze system (FFFS), activated by punishment cues. According to r-RST, individuals differ in the sensitivities of their BAS and FFFS (i.e., weak to strong), which in turn leads to stable patterns of behaviour in the presence of rewards and punishments, respectively. It was hypothesised that individual differences in personality (i.e., strength of the BAS and the FFFS) would influence the degree of both message processing (as measured by reaction time to previously viewed message words) and message acceptance (measured three ways by perceived message effectiveness, behavioural intentions, and attitudes). Specifically, it was anticipated that, individuals with a stronger BAS would process the words presented in the gain-frame messages faster than those with a weaker BAS and individuals with a stronger FFFS would process the words presented in the loss-frame messages faster than those with a weaker FFFS. Further, it was expected that greater processing (faster reaction times) would be associated with greater acceptance for that message. Driver licence holding students (N=108) were recruited to view one of four anti-speeding messages (i.e., social gain-frame, social loss-frame, physical gain-frame, and physical loss-frame). A computerised lexical decision task assessed participants' subsequent reaction times to message words, as an indicator of the extent of processing of the previously viewed message. Self-report measures assessed personality and the three message acceptance measures. As predicted, the degree of initial processing of the content of the social gain-framed message mediated the relationship between the reward sensitive trait and message effectiveness. Initial processing of the physical loss-framed message partially mediated the relationship between the punishment sensitive trait and both message effectiveness and behavioural intention ratings. These results show that reward sensitivity and punishment sensitivity traits influence cognitive processing of gain-framed and loss-framed message content, respectively, and subsequently, message effectiveness and behavioural intention ratings. Specifically, a range of road safety messages (i.e., gain-frame and loss-frame messages) could be designed which align with the processing biases associated with personality and which would target those individuals who are sensitive to rewards and those who are sensitive to punishments. Copyright © 2012 Elsevier Ltd. All rights reserved.

Reward Anticipation in Ventral Striatum and Individual Sensitivity to Reward: A Pilot Study of a Child-Friendly fMRI Task.

PubMed

van Hulst, Branko M; de Zeeuw, Patrick; Lupas, Kellina; Bos, Dienke J; Neggers, Sebastiaan F W; Durston, Sarah

2015-01-01

Reward processing has been implicated in developmental disorders. However, the classic task to probe reward anticipation, the monetary incentive delay task, has an abstract coding of reward and no storyline and may therefore be less appropriate for use with developmental populations. We modified the task to create a version appropriate for use with children. We investigated whether this child-friendly version could elicit ventral striatal activation during reward anticipation in typically developing children and young adolescents (aged 9.5-14.5). In addition, we tested whether our performance-based measure of reward sensitivity was associated with anticipatory activity in ventral striatum. Reward anticipation was related to activity in bilateral ventral striatum. Moreover, we found an association between individual reward sensitivity and activity in ventral striatum. We conclude that this task assesses ventral striatal activity in a child-friendly paradigm. The combination with a performance-based measure of reward sensitivity potentially makes the task a powerful tool for developmental imaging studies of reward processing.

What's the Point?: A Review of Reward Systems Implemented in Gamification Interventions.

PubMed

Lewis, Zakkoyya H; Swartz, Maria C; Lyons, Elizabeth J

2016-04-01

Rewards are commonly used in interventions to change behavior, but they can inhibit development of intrinsic motivation, which is associated with long-term behavior maintenance. Gamification is a novel intervention strategy that may target intrinsic motivation through fun and enjoyment. Before the effects of gamified interventions on motivation can be determined, there must be an understanding of how gamified interventions operationalize rewards, such as point systems. The purpose of this review is to determine the prevalence of different reward types, specifically point systems, within gamified interventions. Electronic databases were searched for relevant articles. Data sources included Medline OVID, Medline PubMed, Web of Science, CINAHL, Cochrane Central, and PsycINFO. Out of the 21 articles retrieved, 18 studies described a reward system and were included in this review. Gamified interventions were designed to target a myriad of clinical outcomes across diverse populations. Rewards included points (n = 14), achievements/badges/medals (n = 7), tangible rewards (n = 7), currency (n = 4), other unspecified rewards (n = 3), likes (n = 2), animated feedback (n = 1), and kudos (n = 1). Rewards, and points in particular, appear to be a foundational component of gamified interventions. Despite their prevalence, authors seldom described the use of noncontingent rewards or how the rewards interacted with other game features. The reward systems relying on tangible rewards and currency may have been limited by inhibited intrinsic motivation. As gamification proliferates, future research should explicitly describe how rewards were operationalized in the intervention and evaluate the effects of gamified rewards on motivation across populations and research outcomes.

Reward skewness coding in the insula independent of probability and loss

PubMed Central

Tobler, Philippe N.

2011-01-01

Rewards in the natural environment are rarely predicted with complete certainty. Uncertainty relating to future rewards has typically been defined as the variance of the potential outcomes. However, the asymmetry of predicted reward distributions, known as skewness, constitutes a distinct but neuroscientifically underexplored risk term that may also have an impact on preference. By changing only reward magnitudes, we study skewness processing in equiprobable ternary lotteries involving only gains and constant probabilities, thus excluding probability distortion or loss aversion as mechanisms for skewness preference formation. We show that individual preferences are sensitive to not only the mean and variance but also to the skewness of predicted reward distributions. Using neuroimaging, we show that the insula, a structure previously implicated in the processing of reward-related uncertainty, responds to the skewness of predicted reward distributions. Some insula responses increased in a monotonic fashion with skewness (irrespective of individual skewness preferences), whereas others were similarly elevated to both negative and positive as opposed to no reward skew. These data support the notion that the asymmetry of reward distributions is processed in the brain and, taken together with replicated findings of mean coding in the striatum and variance coding in the cingulate, suggest that the brain codes distinct aspects of reward distributions in a distributed fashion. PMID:21849610

Contemporary approaches to neural circuit manipulation and mapping: focus on reward and addiction

PubMed Central

Saunders, Benjamin T.; Richard, Jocelyn M.; Janak, Patricia H.

2015-01-01

Tying complex psychological processes to precisely defined neural circuits is a major goal of systems and behavioural neuroscience. This is critical for understanding adaptive behaviour, and also how neural systems are altered in states of psychopathology, such as addiction. Efforts to relate psychological processes relevant to addiction to activity within defined neural circuits have been complicated by neural heterogeneity. Recent advances in technology allow for manipulation and mapping of genetically and anatomically defined neurons, which when used in concert with sophisticated behavioural models, have the potential to provide great insight into neural circuit bases of behaviour. Here we discuss contemporary approaches for understanding reward and addiction, with a focus on midbrain dopamine and cortico-striato-pallidal circuits. PMID:26240425

Peer Influences on Adolescent Decision Making.

PubMed

Albert, Dustin; Chein, Jason; Steinberg, Laurence

2013-04-01

Research efforts to account for elevated risk behavior among adolescents have arrived at an exciting new stage. Moving beyond laboratory studies of age differences in "cool" cognitive processes related to risk perception and reasoning, new approaches have shifted focus to the influence of social and emotional factors on adolescent neurocognition. We review recent research suggesting that adolescent risk-taking propensity derives in part from a maturational gap between early adolescent remodeling of the brain's socio-emotional reward system and a gradual, prolonged strengthening of the cognitive control system. At a time when adolescents spend an increasing amount of time with their peers, research suggests that peer-related stimuli may sensitize the reward system to respond to the reward value of risky behavior. As the cognitive control system gradually matures over the course of the teenage years, adolescents grow in their capacity to coordinate affect and cognition, and to exercise self-regulation even in emotionally arousing situations. These capacities are reflected in gradual growth in the capacity to resist peer influence.

Mechanisms of impulsive choice: III. The role of reward processes

PubMed Central

Marshall, Andrew T.

2015-01-01

Two experiments examined the relationship between reward processing and impulsive choice. In Experiment 1, rats chose between a smaller-sooner (SS) reward (1 pellet, 10 s) and a larger-later (LL) reward (1, 2, and 4 pellets, 30 s). The rats then experienced concurrent variable-interval 30-s schedules with variations in reward magnitude to evaluate reward magnitude discrimination. LL choice behavior positively correlated with reward magnitude discrimination. In Experiment 2, rats chose between an SS reward (1 pellet, 10 s) and an LL reward (2 and 4 pellets, 30 s). The rats then received either a reward intervention which consisted of concurrent fixed-ratio schedules associated with different magnitudes to improve their reward magnitude discrimination, or a control task. All rats then experienced a post-intervention impulsive choice task followed by a reward magnitude discrimination task to assess intervention efficacy. The rats that received the intervention exhibited increases in post-intervention LL choice behavior, and made more responses for larger-reward magnitudes in the reward magnitude discrimination task, suggesting that the intervention heightened sensitivities to reward magnitude. The results suggest that reward magnitude discrimination plays a key role in individual differences in impulsive choice, and could be a potential target for further intervention developments. PMID:26506254

Neural dissociation of food- and money-related reward processing using an abstract incentive delay task.

PubMed

Simon, Joe J; Skunde, Mandy; Wu, Mudan; Schnell, Knut; Herpertz, Sabine C; Bendszus, Martin; Herzog, Wolfgang; Friederich, Hans-Christoph

2015-08-01

Food is an innate reward stimulus related to energy homeostasis and survival, whereas money is considered a more general reward stimulus that gains a rewarding value through learning experiences. Although the underlying neural processing for both modalities of reward has been investigated independently from one another, a more detailed investigation of neural similarities and/or differences between food and monetary reward is still missing. Here, we investigated the neural processing of food compared with monetary-related rewards in 27 healthy, normal-weight women using functional magnetic resonance imaging. We developed a task distinguishing between the anticipation and the receipt of either abstract food or monetary reward. Both tasks activated the ventral striatum during the expectation of a reward. Compared with money, greater food-related activations were observed in prefrontal, parietal and central midline structures during the anticipation and lateral orbitofrontal cortex (lOFC) during the receipt of food reward. Furthermore, during the receipt of food reward, brain activation in the secondary taste cortex was positively related to the body mass index. These results indicate that food-dependent activations encompass to a greater extent brain regions involved in self-control and self-reflection during the anticipation and phylogenetically older parts of the lOFC during the receipt of reward. © The Author (2014). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Policy improvement by a model-free Dyna architecture.

PubMed

Hwang, Kao-Shing; Lo, Chia-Yue

2013-05-01

The objective of this paper is to accelerate the process of policy improvement in reinforcement learning. The proposed Dyna-style system combines two learning schemes, one of which utilizes a temporal difference method for direct learning; the other uses relative values for indirect learning in planning between two successive direct learning cycles. Instead of establishing a complicated world model, the approach introduces a simple predictor of average rewards to actor-critic architecture in the simulation (planning) mode. The relative value of a state, defined as the accumulated differences between immediate reward and average reward, is used to steer the improvement process in the right direction. The proposed learning scheme is applied to control a pendulum system for tracking a desired trajectory to demonstrate its adaptability and robustness. Through reinforcement signals from the environment, the system takes the appropriate action to drive an unknown dynamic to track desired outputs in few learning cycles. Comparisons are made between the proposed model-free method, a connectionist adaptive heuristic critic, and an advanced method of Dyna-Q learning in the experiments of labyrinth exploration. The proposed method outperforms its counterparts in terms of elapsed time and convergence rate.

Neural basis of reward anticipation and its genetic determinants.

PubMed

Jia, Tianye; Macare, Christine; Desrivières, Sylvane; Gonzalez, Dante A; Tao, Chenyang; Ji, Xiaoxi; Ruggeri, Barbara; Nees, Frauke; Banaschewski, Tobias; Barker, Gareth J; Bokde, Arun L W; Bromberg, Uli; Büchel, Christian; Conrod, Patricia J; Dove, Rachel; Frouin, Vincent; Gallinat, Jürgen; Garavan, Hugh; Gowland, Penny A; Heinz, Andreas; Ittermann, Bernd; Lathrop, Mark; Lemaitre, Hervé; Martinot, Jean-Luc; Paus, Tomáš; Pausova, Zdenka; Poline, Jean-Baptiste; Rietschel, Marcella; Robbins, Trevor; Smolka, Michael N; Müller, Christian P; Feng, Jianfeng; Rothenfluh, Adrian; Flor, Herta; Schumann, Gunter

2016-04-05

Dysfunctional reward processing is implicated in various mental disorders, including attention deficit hyperactivity disorder (ADHD) and addictions. Such impairments might involve different components of the reward process, including brain activity during reward anticipation. We examined brain nodes engaged by reward anticipation in 1,544 adolescents and identified a network containing a core striatal node and cortical nodes facilitating outcome prediction and response preparation. Distinct nodes and functional connections were preferentially associated with either adolescent hyperactivity or alcohol consumption, thus conveying specificity of reward processing to clinically relevant behavior. We observed associations between the striatal node, hyperactivity, and the vacuolar protein sorting-associated protein 4A (VPS4A) gene in humans, and the causal role of Vps4 for hyperactivity was validated in Drosophila Our data provide a neurobehavioral model explaining the heterogeneity of reward-related behaviors and generate a hypothesis accounting for their enduring nature.

Neural basis of reward anticipation and its genetic determinants

PubMed Central

Jia, Tianye; Macare, Christine; Desrivières, Sylvane; Gonzalez, Dante A.; Tao, Chenyang; Ji, Xiaoxi; Ruggeri, Barbara; Nees, Frauke; Banaschewski, Tobias; Barker, Gareth J.; Bokde, Arun L. W.; Bromberg, Uli; Büchel, Christian; Conrod, Patricia J.; Dove, Rachel; Gallinat, Jürgen; Garavan, Hugh; Gowland, Penny A.; Heinz, Andreas; Ittermann, Bernd; Lathrop, Mark; Lemaitre, Hervé; Martinot, Jean-Luc; Paus, Tomáš; Pausova, Zdenka; Poline, Jean-Baptiste; Rietschel, Marcella; Robbins, Trevor; Müller, Christian P.; Feng, Jianfeng; Rothenfluh, Adrian; Flor, Herta; Schumann, Gunter

2016-01-01

Dysfunctional reward processing is implicated in various mental disorders, including attention deficit hyperactivity disorder (ADHD) and addictions. Such impairments might involve different components of the reward process, including brain activity during reward anticipation. We examined brain nodes engaged by reward anticipation in 1,544 adolescents and identified a network containing a core striatal node and cortical nodes facilitating outcome prediction and response preparation. Distinct nodes and functional connections were preferentially associated with either adolescent hyperactivity or alcohol consumption, thus conveying specificity of reward processing to clinically relevant behavior. We observed associations between the striatal node, hyperactivity, and the vacuolar protein sorting-associated protein 4A (VPS4A) gene in humans, and the causal role of Vps4 for hyperactivity was validated in Drosophila. Our data provide a neurobehavioral model explaining the heterogeneity of reward-related behaviors and generate a hypothesis accounting for their enduring nature. PMID:27001827

Subliminal and supraliminal processing of reward-related stimuli in anorexia nervosa.

PubMed

Boehm, I; King, J A; Bernardoni, F; Geisler, D; Seidel, M; Ritschel, F; Goschke, T; Haynes, J-D; Roessner, V; Ehrlich, S

2018-04-01

Previous studies have highlighted the role of the brain reward and cognitive control systems in the etiology of anorexia nervosa (AN). In an attempt to disentangle the relative contribution of these systems to the disorder, we used functional magnetic resonance imaging (fMRI) to investigate hemodynamic responses to reward-related stimuli presented both subliminally and supraliminally in acutely underweight AN patients and age-matched healthy controls (HC). fMRI data were collected from a total of 35 AN patients and 35 HC, while they passively viewed subliminally and supraliminally presented streams of food, positive social, and neutral stimuli. Activation patterns of the group × stimulation condition × stimulus type interaction were interrogated to investigate potential group differences in processing different stimulus types under the two stimulation conditions. Moreover, changes in functional connectivity were investigated using generalized psychophysiological interaction analysis. AN patients showed a generally increased response to supraliminally presented stimuli in the inferior frontal junction (IFJ), but no alterations within the reward system. Increased activation during supraliminal stimulation with food stimuli was observed in the AN group in visual regions including superior occipital gyrus and the fusiform gyrus/parahippocampal gyrus. No group difference was found with respect to the subliminal stimulation condition and functional connectivity. Increased IFJ activation in AN during supraliminal stimulation may indicate hyperactive cognitive control, which resonates with clinical presentation of excessive self-control in AN patients. Increased activation to food stimuli in visual regions may be interpreted in light of an attentional food bias in AN.

Diminished fronto-striatal activity during processing of monetary rewards and losses in pathological gambling

PubMed Central

Balodis, Iris M.; Kober, Hedy; Worhunsky, Patrick D.; Stevens, Michael C.; Pearlson, Godfrey D.; Potenza, Marc N.

2012-01-01

Background Mesocorticolimbic neurocircuitry and impulsivity have both been implicated in pathological gambling (PG) and in reward processing. However, the neural underpinnings of specific phases of reward and loss processing in PG and their relationships to impulsivity remain only partially understood. The present functional magnetic resonance imaging study examined brain activity associated with different phases of reward and loss processing in PG. Given an inverse relationship between ventral striatal recruitment during anticipation of monetary rewards and impulsivity in alcohol dependence, the current study explored whether a similar association might also be present in PG. Methods Fourteen adults with PG and 14 control comparison (CC) participants performed the Monetary Incentive Delay Task (MIDT) to identify brain activation changes associated with reward/loss prospect, reward/loss anticipation and reward/loss notification. Impulsivity was assessed separately using the Barratt Impulsiveness Scale. Results Relative to the CC group, the PG group exhibited significantly reduced activity in the ventromedial prefrontal cortex, insula and ventral striatum during several phases, including the prospect and anticipation phases of both gain and losses. Activity in the ventral striatum correlated inversely with levels of impulsivity in PG participants, consistent with prior findings in alcohol dependence. Conclusions Relatively decreased activity in cortico-striatal neurocircuitry during multiple phases of reward processing suggests consistent alterations in neurocircuitry underlying incentive valuation and loss prediction. Together with findings in alcohol dependence, these results suggest that impulsive tendencies in addictions may be reflected in diminished ventral striatal activations to reward anticipation and may represent targets for treatment development in addictions. PMID:22336565

Diminished frontostriatal activity during processing of monetary rewards and losses in pathological gambling.

PubMed

Balodis, Iris M; Kober, Hedy; Worhunsky, Patrick D; Stevens, Michael C; Pearlson, Godfrey D; Potenza, Marc N

2012-04-15

Mesocorticolimbic neurocircuitry and impulsivity have both been implicated in pathological gambling (PG) and in reward processing. However, the neural underpinnings of specific phases of reward and loss processing in PG and their relationships to impulsivity remain only partially understood. The present functional magnetic resonance imaging study examined brain activity associated with different phases of reward and loss processing in PG. Given an inverse relationship between ventral striatal recruitment during anticipation of monetary rewards and impulsivity in alcohol dependence, the current study explored whether a similar association might also be present in PG. Fourteen adults with PG and 14 control comparison participants performed the Monetary Incentive Delay Task to identify brain activation changes associated with reward/loss prospect, reward/loss anticipation, and reward/loss notification. Impulsivity was assessed separately using the Barratt Impulsiveness Scale. Relative to the control comparison group, the PG group exhibited significantly reduced activity in the ventromedial prefrontal cortex, insula, and ventral striatum during several phases, including the prospect and anticipation phases of both gains and losses. Activity in the ventral striatum correlated inversely with levels of impulsivity in PG participants, consistent with prior findings in alcohol dependence. Relatively decreased activity in corticostriatal neurocircuitry during multiple phases of reward processing suggests consistent alterations in neurocircuitry underlying incentive valuation and loss prediction. Together with findings in alcohol dependence, these results suggest that impulsive tendencies in addictions may be reflected in diminished ventral striatal activations to reward anticipation and may represent targets for treatment development in addictions. Copyright © 2012 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

Cortical and Hippocampal Correlates of Deliberation during Model-Based Decisions for Rewards in Humans

PubMed Central

Bornstein, Aaron M.; Daw, Nathaniel D.

2013-01-01

How do we use our memories of the past to guide decisions we've never had to make before? Although extensive work describes how the brain learns to repeat rewarded actions, decisions can also be influenced by associations between stimuli or events not directly involving reward — such as when planning routes using a cognitive map or chess moves using predicted countermoves — and these sorts of associations are critical when deciding among novel options. This process is known as model-based decision making. While the learning of environmental relations that might support model-based decisions is well studied, and separately this sort of information has been inferred to impact decisions, there is little evidence concerning the full cycle by which such associations are acquired and drive choices. Of particular interest is whether decisions are directly supported by the same mnemonic systems characterized for relational learning more generally, or instead rely on other, specialized representations. Here, building on our previous work, which isolated dual representations underlying sequential predictive learning, we directly demonstrate that one such representation, encoded by the hippocampal memory system and adjacent cortical structures, supports goal-directed decisions. Using interleaved learning and decision tasks, we monitor predictive learning directly and also trace its influence on decisions for reward. We quantitatively compare the learning processes underlying multiple behavioral and fMRI observables using computational model fits. Across both tasks, a quantitatively consistent learning process explains reaction times, choices, and both expectation- and surprise-related neural activity. The same hippocampal and ventral stream regions engaged in anticipating stimuli during learning are also engaged in proportion to the difficulty of decisions. These results support a role for predictive associations learned by the hippocampal memory system to be recalled during choice formation. PMID:24339770

The role of orgasm in the development and shaping of partner preferences.

PubMed

Coria-Avila, Genaro A; Herrera-Covarrubias, Deissy; Ismail, Nafissa; Pfaus, James G

2016-01-01

The effect of orgasm on the development and shaping of partner preferences may involve a catalysis of the neurochemical mechanisms of bonding. Therefore, understanding such process is relevant for neuroscience and psychology. A systematic review was carried out using the terms Orgasm, Sexual Reward, Partner Preference, Pair Bonding, Brain, Learning, Sex, Copulation. In humans, concentrations of arousing neurotransmitters and potential bonding neurotransmitters increase during orgasm in the cerebrospinal fluid and the bloodstream. Similarly, studies in animals indicate that those neurotransmitters (noradrenaline, oxytocin, prolactin) and others (e.g. dopamine, opioids, serotonin) modulate the appetitive and consummatory phases of sexual behavior and reward. This suggests a link between the experience of orgasm/sexual reward and the neurochemical mechanisms of pair bonding. Orgasm/reward functions as an unconditioned stimulus (UCS). Some areas in the nervous system function as UCS-detection centers, which become activated during orgasm. Partner-related cues function as conditioned stimuli (CS) and are processed in CS-detector centers. Throughout the article, we discuss how UCS- and CS-detection centers must interact to facilitate memory consolidation and produce recognition and motivation during future social encounters.

Sex versus sweet: opposite effects of opioid drugs on the reward of sucrose and sexual pheromones.

PubMed

Agustín-Pavón, Carmen; Martínez-Ricós, Joana; Martínez-García, Fernando; Lanuza, Enrique

2008-04-01

Endogenous opioids mediate some reward processes involving both natural (food, sweet taste) and artificial (morphine, heroin) rewards. In contrast, sexual behavior (which is also reinforcing) is generally inhibited by opioids. To establish the role of endogenous opioids for a newly described natural reinforcer, namely male sexual pheromones for female mice, we checked the effects of systemic injections of the general opioid antagonist naloxone (1-10 mg/kg) and the agonist fentanyl (0.1- 0.5 mg/kg) in a number of behavioral tests. Naloxone affected neither the innate preference for male-soiled bedding (vs. female-soiled bedding) in 2-choice tests nor the induction of place conditioning using male pheromones as rewarding stimuli, although it effectively blocked the preference for consuming a sucrose solution. In contrast, fentanyl inhibited the preference for male chemosignals without altering sucrose preference. These results suggest that, in macrosmatic animals such as rodents, opioidergic inhibition of sexual behavior might be due, at least partially, to an impaired processing of pheromonal cues and that the hedonic value of sweet-tasting solutions and sexual pheromones are under different opioid modulation.

The impact of junk foods on the adolescent brain.

PubMed

Reichelt, Amy C; Rank, Michelle M

2017-12-01

Adolescence is a significant period of physical, social, and emotional development, and is characterized by prominent neurobiological changes in the brain. The maturational processes that occur in brain regions responsible for cognitive control and reward seeking may underpin excessive consumption of palatable high fat and high sugar "junk" foods during adolescence. Recent studies have highlighted the negative impact of these foods on brain function, resulting in cognitive impairments and altered reward processing. The increased neuroplasticity during adolescence may render the brain vulnerable to the negative effects of these foods on cognition and behavior. In this review, we describe the mechanisms by which junk food diets influence neurodevelopment during adolescence. Diet can lead to alterations in dopamine-mediated reward signaling, and inhibitory neurotransmission controlled by γ-aminobutyric acid (GABA), two major neurotransmitter systems that are under construction across adolescence. We propose that poor dietary choices may derail the normal adolescent maturation process and influence neurodevelopmental trajectories, which can predispose individuals to dysregulated eating and impulsive behaviors. © 2017 Wiley Periodicals, Inc.

Adaptive neural reward processing during anticipation and receipt of monetary rewards in mindfulness meditators.

PubMed

Kirk, Ulrich; Brown, Kirk Warren; Downar, Jonathan

2015-05-01

Reward seeking is ubiquitous and adaptive in humans. But excessive reward seeking behavior, such as chasing monetary rewards, may lead to diminished subjective well-being. This study examined whether individuals trained in mindfulness meditation show neural evidence of lower susceptibility to monetary rewards. Seventy-eight participants (34 meditators, 44 matched controls) completed the monetary incentive delay task while undergoing functional magnetic resonance imaging. The groups performed equally on the task, but meditators showed lower neural activations in the caudate nucleus during reward anticipation, and elevated bilateral posterior insula activation during reward anticipation. Meditators also evidenced reduced activations in the ventromedial prefrontal cortex during reward receipt compared with controls. Connectivity parameters between the right caudate and bilateral anterior insula were attenuated in meditators during incentive anticipation. In summary, brain regions involved in reward processing-both during reward anticipation and receipt of reward-responded differently in mindfulness meditators than in nonmeditators, indicating that the former are less susceptible to monetary incentives. © The Author (2014). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

Common and distinct networks underlying reward valence and processing stages: A meta-analysis of functional neuroimaging studies

PubMed Central

Liu, Xun; Hairston, Jacqueline; Schrier, Madeleine; Fan, Jin

2011-01-01

To better understand the reward circuitry in human brain, we conducted activation likelihood estimation (ALE) and parametric voxel-based meta-analyses (PVM) on 142 neuroimaging studies that examined brain activation in reward-related tasks in healthy adults. We observed several core brain areas that participated in reward-related decision making, including the nucleus accumbens (NAcc), caudate, putamen, thalamus, orbitofrontal cortex (OFC), bilateral anterior insula, anterior (ACC) and posterior (PCC) cingulate cortex, as well as cognitive control regions in the inferior parietal lobule and prefrontal cortex (PFC). The NAcc was commonly activated by both positive and negative rewards across various stages of reward processing (e.g., anticipation, outcome, and evaluation). In addition, the medial OFC and PCC preferentially responded to positive rewards, whereas the ACC, bilateral anterior insula, and lateral PFC selectively responded to negative rewards. Reward anticipation activated the ACC, bilateral anterior insula, and brain stem, whereas reward outcome more significantly activated the NAcc, medial OFC, and amygdala. Neurobiological theories of reward-related decision making should therefore distributed and interrelated representations of reward valuation and valence assessment into account. PMID:21185861

Acute stress selectively reduces reward sensitivity

PubMed Central

Berghorst, Lisa H.; Bogdan, Ryan; Frank, Michael J.; Pizzagalli, Diego A.

2013-01-01

Stress may promote the onset of psychopathology by disrupting reward processing. However, the extent to which stress impairs reward processing, rather than incentive processing more generally, is unclear. To evaluate the specificity of stress-induced reward processing disruption, 100 psychiatrically healthy females were administered a probabilistic stimulus selection task (PSST) that enabled comparison of sensitivity to reward-driven (Go) and punishment-driven (NoGo) learning under either “no stress” or “stress” (threat-of-shock) conditions. Cortisol samples and self-report measures were collected. Contrary to hypotheses, the groups did not differ significantly in task performance or cortisol reactivity. However, further analyses focusing only on individuals under “stress” who were high responders with regard to both cortisol reactivity and self-reported negative affect revealed reduced reward sensitivity relative to individuals tested in the “no stress” condition; importantly, these deficits were reward-specific. Overall, findings provide preliminary evidence that stress-reactive individuals show diminished sensitivity to reward, but not punishment, under stress. While such results highlight the possibility that stress-induced anhedonia might be an important mechanism linking stress to affective disorders, future studies are necessary to confirm this conjecture. PMID:23596406

Differences in reward processing between putative cell types in primate prefrontal cortex

PubMed Central

Fan, Hongwei; Wang, Rubin; Sakagami, Masamichi

2017-01-01

Single-unit studies in monkeys have demonstrated that neurons in the prefrontal cortex predict the reward type, reward amount or reward availability associated with a stimulus. To examine contributions of pyramidal cells and interneurons in reward processing, single-unit activity was extracellularly recorded in prefrontal cortices of four monkeys performing a reward prediction task. Based on their shapes of spike waveforms, prefrontal neurons were classified into broad-spike and narrow-spike units that represented putative pyramidal cells and interneurons, respectively. We mainly observed that narrow-spike neurons showed higher firing rates but less bursty discharges than did broad-spike neurons. Both narrow-spike and broad-spike cells selectively responded to the stimulus, reward and their interaction, and the proportions of each type of selective neurons were similar between the two cell classes. Moreover, the two types of cells displayed equal reliability of reward or stimulus discrimination. Furthermore, we found that broad-spike and narrow-spike cells showed distinct mechanisms for encoding reward or stimulus information. Broad-spike neurons raised their firing rate relative to the baseline rate to represent the preferred reward or stimulus information, whereas narrow-spike neurons inhibited their firing rate lower than the baseline rate to encode the non-preferred reward or stimulus information. Our results suggest that narrow-spike and broad-spike cells were equally involved in reward and stimulus processing in the prefrontal cortex. They utilized a binary strategy to complementarily represent reward or stimulus information, which was consistent with the task structure in which the monkeys were required to remember two reward conditions and two visual stimuli. PMID:29261734

Differences in reward processing between putative cell types in primate prefrontal cortex.

PubMed

Fan, Hongwei; Pan, Xiaochuan; Wang, Rubin; Sakagami, Masamichi

2017-01-01

Single-unit studies in monkeys have demonstrated that neurons in the prefrontal cortex predict the reward type, reward amount or reward availability associated with a stimulus. To examine contributions of pyramidal cells and interneurons in reward processing, single-unit activity was extracellularly recorded in prefrontal cortices of four monkeys performing a reward prediction task. Based on their shapes of spike waveforms, prefrontal neurons were classified into broad-spike and narrow-spike units that represented putative pyramidal cells and interneurons, respectively. We mainly observed that narrow-spike neurons showed higher firing rates but less bursty discharges than did broad-spike neurons. Both narrow-spike and broad-spike cells selectively responded to the stimulus, reward and their interaction, and the proportions of each type of selective neurons were similar between the two cell classes. Moreover, the two types of cells displayed equal reliability of reward or stimulus discrimination. Furthermore, we found that broad-spike and narrow-spike cells showed distinct mechanisms for encoding reward or stimulus information. Broad-spike neurons raised their firing rate relative to the baseline rate to represent the preferred reward or stimulus information, whereas narrow-spike neurons inhibited their firing rate lower than the baseline rate to encode the non-preferred reward or stimulus information. Our results suggest that narrow-spike and broad-spike cells were equally involved in reward and stimulus processing in the prefrontal cortex. They utilized a binary strategy to complementarily represent reward or stimulus information, which was consistent with the task structure in which the monkeys were required to remember two reward conditions and two visual stimuli.

Neuroscientific Model of Motivational Process

PubMed Central

Kim, Sung-il

2013-01-01

Considering the neuroscientific findings on reward, learning, value, decision-making, and cognitive control, motivation can be parsed into three sub processes, a process of generating motivation, a process of maintaining motivation, and a process of regulating motivation. I propose a tentative neuroscientific model of motivational processes which consists of three distinct but continuous sub processes, namely reward-driven approach, value-based decision-making, and goal-directed control. Reward-driven approach is the process in which motivation is generated by reward anticipation and selective approach behaviors toward reward. This process recruits the ventral striatum (reward area) in which basic stimulus-action association is formed, and is classified as an automatic motivation to which relatively less attention is assigned. By contrast, value-based decision-making is the process of evaluating various outcomes of actions, learning through positive prediction error, and calculating the value continuously. The striatum and the orbitofrontal cortex (valuation area) play crucial roles in sustaining motivation. Lastly, the goal-directed control is the process of regulating motivation through cognitive control to achieve goals. This consciously controlled motivation is associated with higher-level cognitive functions such as planning, retaining the goal, monitoring the performance, and regulating action. The anterior cingulate cortex (attention area) and the dorsolateral prefrontal cortex (cognitive control area) are the main neural circuits related to regulation of motivation. These three sub processes interact with each other by sending reward prediction error signals through dopaminergic pathway from the striatum and to the prefrontal cortex. The neuroscientific model of motivational process suggests several educational implications with regard to the generation, maintenance, and regulation of motivation to learn in the learning environment. PMID:23459598

Neuroscientific model of motivational process.

PubMed

Kim, Sung-Il

2013-01-01

Considering the neuroscientific findings on reward, learning, value, decision-making, and cognitive control, motivation can be parsed into three sub processes, a process of generating motivation, a process of maintaining motivation, and a process of regulating motivation. I propose a tentative neuroscientific model of motivational processes which consists of three distinct but continuous sub processes, namely reward-driven approach, value-based decision-making, and goal-directed control. Reward-driven approach is the process in which motivation is generated by reward anticipation and selective approach behaviors toward reward. This process recruits the ventral striatum (reward area) in which basic stimulus-action association is formed, and is classified as an automatic motivation to which relatively less attention is assigned. By contrast, value-based decision-making is the process of evaluating various outcomes of actions, learning through positive prediction error, and calculating the value continuously. The striatum and the orbitofrontal cortex (valuation area) play crucial roles in sustaining motivation. Lastly, the goal-directed control is the process of regulating motivation through cognitive control to achieve goals. This consciously controlled motivation is associated with higher-level cognitive functions such as planning, retaining the goal, monitoring the performance, and regulating action. The anterior cingulate cortex (attention area) and the dorsolateral prefrontal cortex (cognitive control area) are the main neural circuits related to regulation of motivation. These three sub processes interact with each other by sending reward prediction error signals through dopaminergic pathway from the striatum and to the prefrontal cortex. The neuroscientific model of motivational process suggests several educational implications with regard to the generation, maintenance, and regulation of motivation to learn in the learning environment.

Reward for food odors: an fMRI study of liking and wanting as a function of metabolic state and BMI

PubMed Central

Jiang, Tao; Soussignan, Robert; Schaal, Benoist

2015-01-01

Brain reward systems mediate liking and wanting for food reward. Here, we explore the differential involvement of the following structures for these two components: the ventral and dorsal striatopallidal area, orbitofrontal cortex (OFC), anterior insula and anterior cingulate. Twelve healthy female participants were asked to rate pleasantness (liking of food and non-food odors) and the desire to eat (wanting of odor-evoked food) during event-related functional magnetic resonance imaging (fMRI). The subjective ratings and fMRI were performed in hunger and satiety states. Activations of regions of interest were compared as a function of task (liking vs wanting), odor category (food vs non-food) and metabolic state (hunger vs satiety). We found that the nucleus accumbens and ventral pallidum were differentially involved in liking or wanting during the hunger state, which suggests a reciprocal inhibitory influence between these structures. Neural activation of OFC subregions was correlated with either liking or wanting ratings, suggesting an OFC role in reward processing magnitude. Finally, during the hunger state, participants with a high body mass index exhibited less activation in neural structures underlying food reward processing. Our results suggest that food liking and wanting are two separable psychological constructs and may be functionally segregated within the cortico-striatopallidal circuit. PMID:24948157

Neural markers of social and monetary rewards in children with Attention-Deficit/Hyperactivity Disorder and Autism Spectrum Disorder.

PubMed

Gonzalez-Gadea, Maria Luz; Sigman, Mariano; Rattazzi, Alexia; Lavin, Claudio; Rivera-Rei, Alvaro; Marino, Julian; Manes, Facundo; Ibanez, Agustin

2016-07-28

Recent theories of decision making propose a shared value-related brain mechanism for encoding monetary and social rewards. We tested this model in children with Attention-Deficit/Hyperactivity Disorder (ADHD), children with Autism Spectrum Disorder (ASD) and control children. We monitored participants' brain dynamics using high density-electroencephalography while they played a monetary and social reward tasks. Control children exhibited a feedback Error-Related Negativity (fERN) modulation and Anterior Cingulate Cortex (ACC) source activation during both tasks. Remarkably, although cooperation resulted in greater losses for the participants, the betrayal options generated greater fERN responses. ADHD subjects exhibited an absence of fERN modulation and reduced ACC activation during both tasks. ASD subjects exhibited normal fERN modulation during monetary choices and inverted fERN/ACC responses in social options than did controls. These results suggest that in neurotypicals, monetary losses and observed disloyal social decisions induced similar activity in the brain value system. In ADHD children, difficulties in reward processing affected early brain signatures of monetary and social decisions. Conversely, ASD children showed intact neural markers of value-related monetary mechanisms, but no brain modulation by prosociality in the social task. These results offer insight into the typical and atypical developments of neural correlates of monetary and social reward processing.

The human orbitofrontal cortex monitors outcomes even when no reward is at stake.

PubMed

Schnider, Armin; Treyer, Valerie; Buck, Alfred

2005-01-01

The orbitofrontal cortex (OFC) processes the occurrence or omission of anticipated rewards, but clinical evidence suggests that it might serve as a generic outcome monitoring system, independent of tangible reward. In this positron emission tomography (PET) study, normal human subjects performed a series of tasks in which they simply had to predict behind which one of two colored rectangles a drawing of an object was hidden. While all tasks involved anticipation in that they had an expectation phase between the subject's prediction and the presentation of the outcome, they varied with regards to the uncertainty of outcome. No comment on the correctness of the prediction, no record of ongoing performance, and no reward, not even a score, was provided. Nonetheless, we found strong activation of the OFC: in comparison with a baseline task, the left anterior medial OFC showed activation in all conditions, indicating a basic role in anticipation; the left posterior OFC was activated in all tasks with some uncertainty of outcome, suggesting a role in the monitoring of outcomes; the right medial OFC showed activation exclusively during guessing. The data indicate a generic role of the human OFC, with some topical specificity, in the generation of hypotheses and processing of outcomes, independent of the presence of explicit reward.

Reward circuitry dysfunction in psychiatric and neurodevelopmental disorders and genetic syndromes: animal models and clinical findings.

PubMed

Dichter, Gabriel S; Damiano, Cara A; Allen, John A

2012-07-06

This review summarizes evidence of dysregulated reward circuitry function in a range of neurodevelopmental and psychiatric disorders and genetic syndromes. First, the contribution of identifying a core mechanistic process across disparate disorders to disease classification is discussed, followed by a review of the neurobiology of reward circuitry. We next consider preclinical animal models and clinical evidence of reward-pathway dysfunction in a range of disorders, including psychiatric disorders (i.e., substance-use disorders, affective disorders, eating disorders, and obsessive compulsive disorders), neurodevelopmental disorders (i.e., schizophrenia, attention-deficit/hyperactivity disorder, autism spectrum disorders, Tourette's syndrome, conduct disorder/oppositional defiant disorder), and genetic syndromes (i.e., Fragile X syndrome, Prader-Willi syndrome, Williams syndrome, Angelman syndrome, and Rett syndrome). We also provide brief overviews of effective psychopharmacologic agents that have an effect on the dopamine system in these disorders. This review concludes with methodological considerations for future research designed to more clearly probe reward-circuitry dysfunction, with the ultimate goal of improved intervention strategies.

Reward circuitry dysfunction in psychiatric and neurodevelopmental disorders and genetic syndromes: animal models and clinical findings

PubMed Central

2012-01-01

This review summarizes evidence of dysregulated reward circuitry function in a range of neurodevelopmental and psychiatric disorders and genetic syndromes. First, the contribution of identifying a core mechanistic process across disparate disorders to disease classification is discussed, followed by a review of the neurobiology of reward circuitry. We next consider preclinical animal models and clinical evidence of reward-pathway dysfunction in a range of disorders, including psychiatric disorders (i.e., substance-use disorders, affective disorders, eating disorders, and obsessive compulsive disorders), neurodevelopmental disorders (i.e., schizophrenia, attention-deficit/hyperactivity disorder, autism spectrum disorders, Tourette’s syndrome, conduct disorder/oppositional defiant disorder), and genetic syndromes (i.e., Fragile X syndrome, Prader–Willi syndrome, Williams syndrome, Angelman syndrome, and Rett syndrome). We also provide brief overviews of effective psychopharmacologic agents that have an effect on the dopamine system in these disorders. This review concludes with methodological considerations for future research designed to more clearly probe reward-circuitry dysfunction, with the ultimate goal of improved intervention strategies. PMID:22958744

Homeostatic reinforcement learning for integrating reward collection and physiological stability

PubMed Central

Keramati, Mehdi; Gutkin, Boris

2014-01-01

Efficient regulation of internal homeostasis and defending it against perturbations requires adaptive behavioral strategies. However, the computational principles mediating the interaction between homeostatic and associative learning processes remain undefined. Here we use a definition of primary rewards, as outcomes fulfilling physiological needs, to build a normative theory showing how learning motivated behaviors may be modulated by internal states. Within this framework, we mathematically prove that seeking rewards is equivalent to the fundamental objective of physiological stability, defining the notion of physiological rationality of behavior. We further suggest a formal basis for temporal discounting of rewards by showing that discounting motivates animals to follow the shortest path in the space of physiological variables toward the desired setpoint. We also explain how animals learn to act predictively to preclude prospective homeostatic challenges, and several other behavioral patterns. Finally, we suggest a computational role for interaction between hypothalamus and the brain reward system. DOI: http://dx.doi.org/10.7554/eLife.04811.001 PMID:25457346

Mapping brain functional alterations in betel-quid chewers using resting-state fMRI and network analysis.

PubMed

Weng, Jun-Cheng; Chou, Yu-Syuan; Huang, Guo-Joe; Tyan, Yeu-Sheng; Ho, Ming-Chou

2018-04-01

The World Health Organization regards betel quid (BQ) as a human carcinogen, and DSM-IV and ICD-10 dependence symptoms may develop with its heavy use. BQ's possible effects of an enhanced reward system and disrupted inhibitory control may increase the likelihood of habitual substance use. The current study aimed to employ resting-state fMRI to examine the hypothesized enhanced reward system (e.g., the basal forebrain system) and disrupted inhibitory control (e.g., the prefrontal system) in BQ chewers. The current study recruited three groups of 48 male participants: 16 BQ chewers, 15 tobacco- and alcohol-user controls, and 17 healthy controls. We used functional connectivity (FC), mean fractional amplitude of low-frequency fluctuations (mfALFF), and mean regional homogeneity (mReHo) to evaluate functional alternations in BQ chewers. Graph theoretical analysis (GTA) and network-based statistical (NBS) analysis were also performed to identify the functional network differences among the three groups. Our hypothesis was partially supported: the enhanced reward system for the BQ chewers (e.g., habitual drug-seeking behavior) was supported; however, their inhibitory control was relatively preserved. In addition, we reported that the BQ chewers may have enhanced visuospatial processing and decreased local segregation. The current results (showing an enhanced reward system in the chewers) provided the clinicians with important insight for the future development of an effective abstinence treatment.

Can Decision Making Research Provide a Better Understanding of Chemical and Behavioral Addictions?

PubMed

Engel, Anzhelika; Cáceda, Ricardo

2015-01-01

We reviewed the cognitive and neurobiological commonalities between chemical and behavioral addictions. Poor impulse control, limited executive function and abnormalities in reward processing are seen in both group of entities. Brain imaging shows consistent abnormalities in frontoparietal regions and the limbic system. In drug addiction, exaggerated risk taking behavior and temporal discounting may reflect an imbalance between a hyperactive mesolimbic and hypoactive executive systems. Several cognitive distortions are found in pathological gambling that seems to harness the brain reward system that has evolved to face situations related to skill, not random chance. Abnormalities in risk assessment and impulsivity are found in variety of eating disorders, in particularly related to eating behavior. Corresponding findings in eating disorder patients include abnormalities in the limbic system, i.e. orbitofrontal cortex (OFC), striatum and insula. Similarly, internet addiction disorder is associated with risky decision making and increased choice impulsivity with corresponding discrepant activation in the dorsolateral prefrontal cortex, OFC, anterior cingulate cortex, caudate and insula. Sexual addictions are in turn associated with exaggerated impulsive choice and suggestive evidence of abnormalities in reward processing. In sum, exploration of executive function and decision making abnormalities in chemical and behavioral addictions may increase understanding in their psychopathology and yield valuable targets for therapeutic interventions.

Altered neural processing of reward and punishment in adolescents with Major Depressive Disorder.

PubMed

Landes, I; Bakos, S; Kohls, G; Bartling, J; Schulte-Körne, G; Greimel, E

2018-05-01

Altered reward and punishment function has been suggested as an important vulnerability factor for the development of Major Depressive Disorder (MDD). Prior ERP studies found evidence for neurophysiological dysfunctions in reinforcement processes in adults with MDD. To date, only few ERP studies have examined the neural underpinnings of reinforcement processing in adolescents diagnosed with MDD. The present event-related potential (ERP) study aimed to investigate neurophysiological mechanisms of anticipation and consumption of reward and punishment in adolescents with MDD in one comprehensive paradigm. During ERP recording, 25 adolescents with MDD and 29 healthy controls (12-17 years) completed a Monetary Incentive Delay Task comprising both a monetary reward and a monetary punishment condition. During anticipation, the cue-P3 signaling attentional allocation was recorded. During consumption, the feedback-P3 and Reward Positivity (RewP) were recorded to capture attentional allocation and outcome evaluation, respectively. Compared to controls, adolescents with MDD showed prolonged cue-P3 latencies to reward cues. Furthermore, unlike controls, adolescents with MDD displayed shorter feedback-P3 latencies in the reward versus punishment condition. RewPs did not differ between groups. It remains unanswered whether the observed alterations in adolescent MDD represent a state or trait. Delayed neural processing of reward cues corresponds to the clinical presentation of adolescent MDD with reduced motivational tendencies to obtain rewards. Relatively shorter feedback-P3 latencies in the reward versus punishment condition could indicate a high salience of performance-contingent reward. Frequent exposure of negatively biased adolescents with MDD to performance-contingent rewards might constitute a promising intervention approach. Copyright © 2018 Elsevier B.V. All rights reserved.

Perceived life stress exposure modulates reward-related medial prefrontal cortex responses to acute stress in depression.

PubMed

Kumar, Poornima; Slavich, George M; Berghorst, Lisa H; Treadway, Michael T; Brooks, Nancy H; Dutra, Sunny J; Greve, Douglas N; O'Donovan, Aoife; Bleil, Maria E; Maninger, Nicole; Pizzagalli, Diego A

2015-07-15

Major depressive disorder (MDD) is often precipitated by life stress and growing evidence suggests that stress-induced alterations in reward processing may contribute to such risk. However, no human imaging studies have examined how recent life stress exposure modulates the neural systems that underlie reward processing in depressed and healthy individuals. In this proof-of-concept study, 12 MDD and 10 psychiatrically healthy individuals were interviewed using the Life Events and Difficulties Schedule (LEDS) to assess their perceived levels of recent acute and chronic life stress exposure. Additionally, each participant performed a monetary incentive delay task under baseline (no-stress) and stress (social-evaluative) conditions during functional MRI. Across groups, medial prefrontal cortex (mPFC) activation to reward feedback was greater during acute stress versus no-stress conditions in individuals with greater perceived stressor severity. Under acute stress, depressed individuals showed a positive correlation between perceived stressor severity levels and reward-related mPFC activation (r=0.79, p=0.004), whereas no effect was found in healthy controls. Moreover, for depressed (but not healthy) individuals, the correlations between the stress (r=0.79) and no-stress (r=-0.48) conditions were significantly different. Finally, relative to controls, depressed participants showed significantly reduced mPFC gray matter, but functional findings remained robust while accounting for structural differences. Small sample size, which warrants replication. Depressed individuals experiencing greater recent life stress recruited the mPFC more under stress when processing rewards. Our results represent an initial step toward elucidating mechanisms underlying stress sensitization and recurrence in depression. Copyright © 2015 Elsevier B.V. All rights reserved.

What does the amygdala contribute to social cognition?

PubMed Central

Adolphs, Ralph

2010-01-01

The amygdala has received intense recent attention from neuroscientists investigating its function at the molecular, cellular, systems, cognitive, and clinical level. It clearly contributes to processing emotionally and socially relevant information, yet a unifying description and computational account have been lacking. The difficulty of tying together the various studies stems in part from the sheer diversity of approaches and species studied, in part from the amygdala’s inherent heterogeneity in terms of its component nuclei, and in part because different investigators have simply been interested in different topics. Yet, a synthesis now seems close at hand in combining new results from social neuroscience with data from neuroeconomics and reward learning. The amygdala processes a psychological stimulus dimension related to saliency or relevance; mechanisms have been identified to link it to processing unpredictability; and insights from reward learning have situated it within a network of structures that include the prefrontal cortex and the ventral striatum in processing the current value of stimuli. These aspects help to clarify the amygdala’s contributions to recognizing emotion from faces, to social behavior toward conspecifics, and to reward learning and instrumental behavior. PMID:20392275

Evaluation of the Social Motivation Hypothesis of Autism: A Systematic Review and Meta-analysis.

PubMed

Clements, Caitlin C; Zoltowski, Alisa R; Yankowitz, Lisa D; Yerys, Benjamin E; Schultz, Robert T; Herrington, John D

2018-06-13

The social motivation hypothesis posits that individuals with autism spectrum disorder (ASD) find social stimuli less rewarding than do people with neurotypical activity. However, functional magnetic resonance imaging (fMRI) studies of reward processing have yielded mixed results. To examine whether individuals with ASD process rewarding stimuli differently than typically developing individuals (controls), whether differences are limited to social rewards, and whether contradictory findings in the literature might be due to sample characteristics. Articles were identified in PubMed, Embase, and PsycINFO from database inception until June 1, 2017. Functional MRI data from these articles were provided by most authors. Publications were included that provided brain activation contrasts between a sample with ASD and controls on a reward task, determined by multiple reviewer consensus. When fMRI data were not provided by authors, multiple reviewers extracted peak coordinates and effect sizes from articles to recreate statistical maps using seed-based d mapping software. Random-effects meta-analyses of responses to social, nonsocial, and restricted interest stimuli, as well as all of these domains together, were performed. Secondary analyses included meta-analyses of wanting and liking, meta-regression with age, and correlations with ASD severity. All procedures were conducted in accordance with Meta-analysis of Observational Studies in Epidemiology guidelines. Brain activation differences between groups with ASD and typically developing controls while processing rewards. All analyses except the domain-general meta-analysis were planned before data collection. The meta-analysis included 13 studies (30 total fMRI contrasts) from 259 individuals with ASD and 246 controls. Autism spectrum disorder was associated with aberrant processing of both social and nonsocial rewards in striatal regions and increased activation in response to restricted interests (social reward, caudate cluster: d = -0.25 [95% CI, -0.41 to -0.08]; nonsocial reward, caudate and anterior cingulate cluster: d = -0.22 [95% CI, -0.42 to -0.02]; restricted interests, caudate and nucleus accumbens cluster: d = 0.42 [95% CI, 0.07 to 0.78]). Individuals with ASD show atypical processing of social and nonsocial rewards. Findings support a broader interpretation of the social motivation hypothesis of ASD whereby general atypical reward processing encompasses social reward, nonsocial reward, and perhaps restricted interests. This meta-analysis also suggests that prior mixed results could be driven by sample age differences, warranting further study of the developmental trajectory for reward processing in ASD.

A test of the opponent-process theory of motivation using lesions that selectively block morphine reward.

PubMed

Vargas-Perez, Hector; Ting-A-Kee, Ryan A; Heinmiller, Andrew; Sturgess, Jessica E; van der Kooy, Derek

2007-06-01

The opponent-process theory of motivation postulates that motivational stimuli activate a rewarding process that is followed by an opposed aversive process in a homeostatic control mechanism. Thus, an acute injection of morphine in nondependent animals should evoke an acute rewarding response, followed by a later aversive response. Indeed, the tegmental pedunculopontine nucleus (TPP) mediates the rewarding effects of opiates in previously morphine-naive animals, but not other unconditioned effects of opiates, or learning ability. The aversive opponent process for acute morphine reward was revealed using a place-conditioning paradigm. The conditioned place aversion induced by 16-h spontaneous morphine withdrawal from an acute morphine injection in nondependent rats was abolished by TPP lesions performed prior to drug experience. However, TPP-lesioned rats did show conditioned aversions for an environment paired with the acute administration of the opioid antagonist naloxone, which blocks endogenous opioids. The results show that blocking the rewarding effects of morphine with TPP lesions also blocked the opponent aversive effects of acute morphine withdrawal in nondependent animals. Thus, this spontaneous withdrawal aversion (the opponent process) is induced by the acute rewarding effects of morphine and not by other unconditioned effects of morphine, the pharmacological effects of morphine or endogenous opioids being displaced from opiate receptors.

A comparison of the electrocortical response to monetary and social reward

PubMed Central

Distefano, Amanda; Jackson, Felicia; Levinson, Amanda R; Infantolino, Zachary P; Jarcho, Johanna M; Nelson, Brady D

2018-01-01

Abstract Affective science research on reward processing has primarily focused on monetary rewards. There has been a growing interest in evaluating the neural basis of social decision-making and reward processing. The present study employed a within-subject design and compared the reward positivity (RewP), an event-related potential component that is present following favorable feedback and absent or reduced following unfavorable feedback, during monetary and social reward tasks. Specifically, 114 participants (75 females) completed a monetary reward task and a novel social reward task that were matched on trial structure, timing, and feedback stimuli in a counterbalanced order. Results indicated that the monetary and social RewP were of similar magnitude, positively correlated and demonstrated comparable psychometric properties, including reliability and dependability. Across both the monetary and social tasks, women demonstrated a greater RewP compared with men. This study provides a novel methodological approach toward examining the electrocortical response to social reward that is comparable to monetary reward. PMID:29373743

A target sample of adolescents and reward processing: same neural and behavioral correlates engaged in common paradigms?

PubMed

Nees, Frauke; Vollstädt-Klein, Sabine; Fauth-Bühler, Mira; Steiner, Sabina; Mann, Karl; Poustka, Luise; Banaschewski, Tobias; Büchel, Christian; Conrod, Patricia J; Garavan, Hugh; Heinz, Andreas; Ittermann, Bernd; Artiges, Eric; Paus, Tomas; Pausova, Zdenka; Rietschel, Marcella; Smolka, Michael N; Struve, Maren; Loth, Eva; Schumann, Gunter; Flor, Herta

2012-11-01

Adolescence is a transition period that is assumed to be characterized by increased sensitivity to reward. While there is growing research on reward processing in adolescents, investigations into the engagement of brain regions under different reward-related conditions in one sample of healthy adolescents, especially in a target age group, are missing. We aimed to identify brain regions preferentially activated in a reaction time task (monetary incentive delay (MID) task) and a simple guessing task (SGT) in a sample of 14-year-old adolescents (N = 54) using two commonly used reward paradigms. Functional magnetic resonance imaging was employed during the MID with big versus small versus no win conditions and the SGT with big versus small win and big versus small loss conditions. Analyses focused on changes in blood oxygen level-dependent contrasts during reward and punishment processing in anticipation and feedback phases. We found clear magnitude-sensitive response in reward-related brain regions such as the ventral striatum during anticipation in the MID task, but not in the SGT. This was also true for reaction times. The feedback phase showed clear reward-related, but magnitude-independent, response patterns, for example in the anterior cingulate cortex, in both tasks. Our findings highlight neural and behavioral response patterns engaged in two different reward paradigms in one sample of 14-year-old healthy adolescents and might be important for reference in future studies investigating reward and punishment processing in a target age group.

Intranasal oxytocin enhances neural processing of monetary reward and loss in post-traumatic stress disorder and traumatized controls.

PubMed

Nawijn, Laura; van Zuiden, Mirjam; Koch, Saskia B J; Frijling, Jessie L; Veltman, Dick J; Olff, Miranda

2016-04-01

Anhedonia is a significant clinical problem in post-traumatic stress disorder (PTSD). PTSD patients show reduced motivational approach behavior, which may underlie anhedonic symptoms. Oxytocin administration is known to increase reward sensitivity and approach behavior. We therefore investigated whether oxytocin administration affected neural responses during motivational processing in PTSD patients and trauma-exposed controls. 35 police officers with PTSD (21 males) and 37 trauma-exposed police officers without PTSD (19 males) were included in a within-subjects, randomized, placebo-controlled fMRI study. Neural responses during anticipation of monetary reward and loss were investigated with a monetary incentive delay task (MID) after placebo and oxytocin (40 IU) administration. Oxytocin increased neural responses during reward and loss anticipation in PTSD patients and controls in the striatum, dorsal anterior cingulate cortex and insula, key regions in the reward pathway. Although PTSD patients did not differ from controls in motivational processing under placebo, anhedonia severity in PTSD patients was negatively related to reward responsiveness in the ventral striatum. Furthermore, oxytocin effects on reward processing in the ventral striatum were positively associated with anhedonia. Oxytocin administration increased reward pathway sensitivity during reward and loss anticipation in PTSD patients and trauma-exposed controls. Thus, oxytocin administration may increase motivation for goal-directed approach behavior in PTSD patients and controls, providing evidence for a neurobiological pathway through which oxytocin could potentially increase motivation and reward sensitivity in PTSD patients. Copyright © 2016 Elsevier Ltd. All rights reserved.

Molecular role of dopamine in anhedonia linked to reward deficiency syndrome (RDS) and anti- reward systems.

PubMed

Gold, Mark S; Blum, Kenneth; Febo, Marcelo; Baron, David; Modestino, Edward Justin; Elman, Igor; Badgaiyan, Rajendra D

2018-03-01

Anhedonia is a condition that leads to the loss of feelings pleasure in response to natural reinforcers like food, sex, exercise, and social activities. This disorder occurs in addiction, and an array of related neuropsychiatric syndromes, including schizophrenia, depression, and Post Traumatic Stress Disorder (PTSD). Anhedonia may by due to derangements in mesolimbic dopaminergic pathways and their terminal fields (e.g., striatum, amygdala, and prefrontal cortex) that persist long after the traces of the causative drugs are eliminated (pharmacokinetically). Here we postulate that anhedonia is not a distinct entity but is rather an epiphenomenon of hypodopaminergic states and traits arising from the interaction of genetic traits and epigenetic neurobiological alterations in response to environmental influences. Moreover, dopaminergic activity is rather complex, and so it may give rise to differential pathophysiological processes such as incentive sensitization, aberrant learning and stress-like "anti-reward" phenomena. These processes may have additive, synergistic or antagonistic interactions with the concurrent reward deficiency states leading in some instances to more severe and long-lasting symptoms. Operant understanding of the neurogenetic antecedents to reward deficiency syndrome (RDS) and the elucidation of reward gene polymorphisms may provide a map for accessing an individual's genetic risk for developing Anhedonia. Prevention techniques that can restore homeostatic balance via physiological activation of dopaminergic receptors (D2/D3) may be instrumental for targeting not only anhedonia per se but also drug craving and relapse.

Linking online gaming and addictive behavior: converging evidence for a general reward deficiency in frequent online gamers.

PubMed

Hahn, Tim; Notebaert, Karolien Hilde; Dresler, Thomas; Kowarsch, Linda; Reif, Andreas; Fallgatter, Andreas J

2014-01-01

Millions of people regularly play so-called massively multiplayer online role playing games (MMORPGs). Recently, it has been argued that MMORPG overuse is becoming a significant health problem worldwide. Symptoms such as tolerance, withdrawal, and craving have been described. Based on behavioral, resting state, and task-related neuroimaging data, we test whether frequent players of the MMORPG "World of Warcraft" (WoW) - similar to drug addicts and individuals with an increased risk for addictions - show a generally deficient reward system. In frequent players of the MMORPG "World of Warcraft" (WoW-players) and in a control group of non-gamers we assessed (1) trait sensitivity to reward (SR), (2) BOLD responses during monetary reward processing in the ventral striatum, and (3) ventral-striatal resting-state dynamics. We found a decreased neural activation in the ventral striatum during the anticipation of both small and large monetary rewards. Additionally, we show generally altered neurodynamics in this region independent of any specific task for WoW players (resting state). On the behavioral level, we found differences in trait SR, suggesting that the reward processing deficiencies found in this study are not a consequence of gaming, but predisposed to it. These findings empirically support a direct link between frequent online gaming and the broad field of behavioral and drug addiction research, thus opening new avenues for clinical interventions in addicted gamers and potentially improving the assessment of addiction-risk in the vast population of frequent gamers.

FNDC5/irisin, a molecular target for boosting reward-related learning and motivation.

PubMed

Zsuga, Judit; Tajti, Gabor; Papp, Csaba; Juhasz, Bela; Gesztelyi, Rudolf

2016-05-01

Interventions focusing on the prevention and treatment of chronic non-communicable diseases are on rise. In the current article, we propose that dysfunction of the mesocortico-limbic reward system contributes to the emergence of the WHO-identified risk behaviors (tobacco use, unhealthy diet, physical inactivity and harmful use of alcohol), behaviors that underlie the evolution of major non-communicable diseases (e.g. cardiovascular diseases, cancer, diabetes and chronic respiratory diseases). Given that dopaminergic neurons of the mesocortico-limbic system are tightly associated with reward-related processes and motivation, their dysfunction may fundamentally influence behavior. While nicotine and alcohol alter dopamine neuron function by influencing some receptors, mesocortico-limbic system dysfunction was associated with elevation of metabolic set-point leading to hedonic over-eating. Although there is some empirical evidence, precise molecular mechanism for linking physical inactivity and mesocortico-limbic dysfunction per se seems to be missing; identification of which may contribute to higher success rates for interventions targeting lifestyle changes pertaining to physical activity. In the current article, we compile evidence in support of a link between exercise and the mesocortico-limbic system by elucidating interactions on the axis of muscle - irisin - brain derived neurotrophic factor (BDNF) - and dopaminergic function of the midbrain. Irisin is a contraction-regulated myokine formed primarily in skeletal muscle but also in the brain. Irisin stirred considerable interest, when its ability to induce browning of white adipose tissue parallel to increasing thermogenesis was discovered. Furthermore, it may also play a role in the regulation of behavior given it readily enters the central nervous system, where it induces BDNF expression in several brain areas linked to reward processing, e.g. the ventral tegmental area and the hippocampus. BDNF is a neurotropic factor that increases neuronal dopamine content, modulates dopamine release relevant for neuronal plasticity and increased neuronal survival as well as learning and memory. Further linking BDNF to dopaminergic function is BDNF's ability to activate tropomyosin-related kinase B receptor that shares signalization with presynaptic dopamine-3 receptors in the ventral tegmental area. Summarizing, we propose that the skeletal muscle derived irisin may be the link between physical activity and reward-related processes and motivation. Moreover alteration of this axis may contribute to sedentary lifestyle and subsequent non-communicable diseases. Preclinical and clinical experimental models to test this hypothesis are also proposed. Copyright © 2016 Elsevier Ltd. All rights reserved.

Fear Memory Recall Potentiates Opiate Reward Sensitivity through Dissociable Dopamine D1 versus D4 Receptor-Dependent Memory Mechanisms in the Prefrontal Cortex.

PubMed

Jing Li, Jing; Szkudlarek, Hanna; Renard, Justine; Hudson, Roger; Rushlow, Walter; Laviolette, Steven R

2018-05-09

Disturbances in prefrontal cortical (PFC) dopamine (DA) transmission are well established features of psychiatric disorders involving pathological memory processing, such as post-traumatic stress disorder and opioid addiction. Transmission through PFC DA D4 receptors (D4Rs) has been shown to potentiate the emotional salience of normally nonsalient emotional memories, whereas transmission through PFC DA D1 receptors (D1Rs) has been demonstrated to selectively block recall of reward- or aversion-related associative memories. In the present study, using a combination of fear conditioning and opiate reward conditioning in male rats, we examined the role of PFC D4/D1R signaling during the processing of fear-related memory acquisition and recall and subsequent sensitivity to opiate reward memory formation. We report that PFC D4R activation potentiates the salience of normally subthreshold fear conditioning memory cues and simultaneously potentiates the rewarding effects of systemic or intra-ventral tegmental area (VTA) morphine conditioning cues. In contrast, blocking the recall of salient fear memories with intra-PFC D1R activation, blocks the ability of fear memory recall to potentiate systemic or intra-VTA morphine place preference. These effects were dependent upon dissociable PFC phosphorylation states involving calcium-calmodulin-kinase II or extracellular signal-related kinase 1-2, following intra-PFC D4 or D1R activation, respectively. Together, these findings reveal new insights into how aberrant PFC DAergic transmission and associated downstream molecular signaling pathways may modulate fear-related emotional memory processing and concomitantly increase opioid addiction vulnerability. SIGNIFICANCE STATEMENT Post-traumatic stress disorder is highly comorbid with addiction. In this study, we use a translational model of fear memory conditioning to examine how transmission through dopamine D1 or D4 receptors, in the prefrontal cortex (PFC), may differentially control acquisition or recall of fear memories and how these mechanisms might regulate sensitivity to the rewarding effects of opioids. We demonstrate that PFC D4 activation not only controls the salience of fear memory acquisition, but potentiates the rewarding effects of opioids. In contrast, PFC D1 receptor activation blocks recall of fear memories and prevents potentiation of opioid reward effects. Together, these findings demonstrate novel PFC mechanisms that may account for how emotional memory disturbances might increase the addictive liability of opioid-class drugs. Copyright © 2018 the authors 0270-6474/18/384543-13$15.00/0.

Influence of promised rewards on conflict resolution in healthy participants and patients with Parkinson's disease.

PubMed

Houvenaghel, Jean-François; Duprez, Joan; Naudet, Florian; Argaud, Soizic; Dondaine, Thibaut; Drapier, Sophie; Robert, Gabriel Hadrien; Drapier, Dominique; Vérin, Marc; Sauleau, Paul

2016-08-15

The influence of promised rewards on conflict resolution processes is not clearly defined in the literature, and the underlying mechanisms are poorly understood. Some studies have shown no effect of reward, while others have demonstrated a beneficial influence. In addition, although the basal ganglia are known to play a critical role in the association between motivation and cognition, the influence of promised rewards on conflict resolution processes in Parkinson's disease (PD) has received little attention. In this context, we assessed the influence of promised rewards on both impulse activation and suppression in 36 healthy participants and 36 patients with PD, using a rewarded Simon task. Analysis of performances revealed that promised rewards worsened the overall congruence effect, but only in healthy participants. Although the incentive context did not modulate the congruence effect in patients, by using the activation-suppression model, we were able to show that promised rewards did influence impulse suppression in patients-but not in healthy participants. Suppressing inappropriate response activation in an incentive context appears to be harder in medically treated Parkinson's disease. This indicates that incentive motivation can modulate at least one cognitive process involved in cognitive action control in patients with medically treated PD. The activation-suppression model provides essential additional information concerning the influence of promised rewards on conflict resolution processes in a pathological population. Copyright © 2016 Elsevier B.V. All rights reserved.

Fronto-striatal Dysfunction During Reward Processing in Unaffected Siblings of Schizophrenia Patients

PubMed Central

de Leeuw, Max; Kahn, René S.; Vink, Matthijs

2015-01-01

Schizophrenia is a psychiatric disorder that is associated with impaired functioning of the fronto-striatal network, in particular during reward processing. However, it is unclear whether this dysfunction is related to the illness itself or whether it reflects a genetic vulnerability to develop schizophrenia. Here, we examined reward processing in unaffected siblings of schizophrenia patients using functional magnetic resonance imaging. Brain activity was measured during reward anticipation and reward outcome in 27 unaffected siblings of schizophrenia patients and 29 healthy volunteers using a modified monetary incentive delay task. Task performance was manipulated online so that all subjects won the same amount of money. Despite equal performance, siblings showed reduced activation in the ventral striatum, insula, and supplementary motor area (SMA) during reward anticipation compared to controls. Decreased ventral striatal activation in siblings was correlated with sub-clinical negative symptoms. During the outcome of reward, siblings showed increased activation in the ventral striatum and orbitofrontal cortex compared to controls. Our finding of decreased activity in the ventral striatum during reward anticipation and increased activity in this region during receiving reward may indicate impaired cue processing in siblings. This is consistent with the notion of dopamine dysfunction typically associated with schizophrenia. Since unaffected siblings share on average 50% of their genes with their ill relatives, these deficits may be related to the genetic vulnerability for schizophrenia. PMID:25368371

Mood, food, and obesity.

PubMed

Singh, Minati

2014-01-01

Food is a potent natural reward and food intake is a complex process. Reward and gratification associated with food consumption leads to dopamine (DA) production, which in turn activates reward and pleasure centers in the brain. An individual will repeatedly eat a particular food to experience this positive feeling of gratification. This type of repetitive behavior of food intake leads to the activation of brain reward pathways that eventually overrides other signals of satiety and hunger. Thus, a gratification habit through a favorable food leads to overeating and morbid obesity. Overeating and obesity stems from many biological factors engaging both central and peripheral systems in a bi-directional manner involving mood and emotions. Emotional eating and altered mood can also lead to altered food choice and intake leading to overeating and obesity. Research findings from human and animal studies support a two-way link between three concepts, mood, food, and obesity. The focus of this article is to provide an overview of complex nature of food intake where various biological factors link mood, food intake, and brain signaling that engages both peripheral and central nervous system signaling pathways in a bi-directional manner in obesity.

Trait Rumination Influences Neural Correlates of the Anticipation but Not the Consumption Phase of Reward Processing

PubMed Central

Kocsel, Natália; Szabó, Edina; Galambos, Attila; Édes, Andrea; Pap, Dorottya; Elliott, Rebecca; Kozák, Lajos R.; Bagdy, György; Juhász, Gabriella; Kökönyei, Gyöngyi

2017-01-01

Cumulative evidence suggests that trait rumination can be defined as an abstract information processing mode, which leads people to constantly anticipate the likely impact of present events on future events and experiences. A previous study with remitted depressed patients suggested that enhanced rumination tendencies distort brain mechanisms of anticipatory processes associated with reward and loss cues. In the present study, we explored the impact of trait rumination on neural activity during reward and loss anticipation among never-depressed people. We analyzed the data of 37 healthy controls, who performed the monetary incentive delay (MID) task which was designed for the simultaneous measurement of the anticipation (motivational) and consumption (hedonic) phase of reward processing, during functional magnetic resonance imaging (fMRI). Our results show that rumination—after controlling for age, gender, and current mood—significantly influenced neural responses to reward (win) cues compared to loss cues. Blood-oxygenation-level-dependent (BOLD) activity in the left inferior frontal gyrus (IFG) triangularis, left anterior insula, and left rolandic operculum was positively related to Ruminative Response Scale (RRS) scores. We did not detect any significant rumination-related activations associated with win-neutral or loss-neutral cues and with reward or loss consumption. Our results highlight the influence of trait rumination on reward anticipation in a non-depressed sample. They also suggest that for never-depressed ruminators rewarding cues are more salient than loss cues. BOLD response during reward consumption did not relate to rumination, suggesting that rumination mainly relates to processing of the motivational (wanting) aspect of reward rather than the hedonic (liking) aspect, at least in the absence of pathological mood. PMID:28539875

Altered neural reward representations in pathological gamblers revealed by delay and probability discounting.

PubMed

Miedl, Stephan F; Peters, Jan; Büchel, Christian

2012-02-01

The neural basis of excessive delay discounting and reduced risk sensitivity of pathological gamblers with a particular focus on subjective neural reward representations has not been previously examined. To examine how pathological gamblers represent subjective reward value at a neural level and how this is affected by gambling severity. Model-based functional magnetic resonance imaging study with patients and control subjects. Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf. Participants were recruited from the local community by advertisement and through self-help groups. A sample of 16 pathological gamblers (according to the DSM-IV definition) was matched by age, sex, smoking status, income, educational level, and handedness to 16 healthy controls. Pathological gamblers showed increased discounting of delayed rewards and a trend toward decreased discounting of probabilistic rewards compared with matched controls. At the neural level, a significant group × condition interaction indicated that reward representations in the gamblers were modulated in a condition-specific manner, such that they exhibited increased (delay discounting) and decreased (probability discounting) neural value correlations in the reward system. In addition, throughout the reward system, neuronal value signals for delayed rewards were negatively correlated with gambling severity. The results extend previous reports of a generally hypoactive reward system in pathological gamblers by showing that, even when subjective reward valuation is accounted for, gamblers still show altered reward representations. Furthermore, results point toward a gradual degradation of mesolimbic reward representations for delayed rewards during the course of pathological gambling.

Frontal glutamate and reward processing in adolescence and adulthood.

PubMed

Gleich, Tobias; Lorenz, Robert C; Pöhland, Lydia; Raufelder, Diana; Deserno, Lorenz; Beck, Anne; Heinz, Andreas; Kühn, Simone; Gallinat, Jürgen

2015-11-01

The fronto-limbic network interaction, driven by glutamatergic and dopaminergic neurotransmission, represents a core mechanism of motivated behavior and personality traits. Reward seeking behavior undergoes tremendous changes in adolescence paralleled by neurobiological changes of this network including the prefrontal cortex, striatum and amygdala. Since fronto-limbic dysfunctions also underlie major psychiatric diseases beginning in adolescence, this investigation focuses on network characteristics separating adolescents from adults. To investigate differences in network interactions, the brain reward system activity (slot machine task) together with frontal glutamate concentration (anterior cingulate cortex, ACC) was measured in 28 adolescents and 26 adults employing functional magnetic resonance imaging and magnetic resonance spectroscopy, respectively. An inverse coupling of glutamate concentrations in the ACC and activation of the ventral striatum was observed in adolescents. Further, amygdala response in adolescents was negatively correlated with the personality trait impulsivity. For adults, no significant associations of network components or correlations with impulsivity were found. The inverse association between frontal glutamate concentration and striatal activation in adolescents is in line with the triadic model of motivated behavior stressing the important role of frontal top-down inhibition on limbic structures. Our data identified glutamate as the mediating neurotransmitter of this inhibitory process and demonstrates the relevance of glutamate on the reward system and related behavioral traits like impulsivity. This fronto-limbic coupling may represent a vulnerability factor for psychiatric disorders starting in adolescence but not in adulthood.

Age associations with neural processing of reward anticipation in adolescents with bipolar disorders

PubMed Central

Urošević, Snežana; Luciana, Monica; Jensen, Jonathan B.; Youngstrom, Eric A.; Thomas, Kathleen M.

2016-01-01

Reward/behavioral approach system hypersensitivity is implicated in bipolar disorders (BD) and in normative development during adolescence. Pediatric onset of BD is associated with a more severe illness course. However, little is known about neural processing of rewards in adolescents with BD or developmental (i.e., age) associations with activation of these neural systems. The present study aims to address this knowledge gap. The present sample included 21 adolescents with BD and 26 healthy adolescents, ages 13 to 19. Participants completed a functional magnetic resonance imaging (fMRI) protocol using the Monetary Incentive Delay (MID) task. Behavioral performance was similar between groups. Group differences in BOLD activation during target anticipation and feedback anticipation periods of the task were examined using whole-brain analyses, as were group differences in age effects. During both target anticipation and feedback anticipation, adolescents with BD, compared to adolescents without psychopathology, exhibited decreased engagement of frontal regions involved in cognitive control (i.e., dorsolateral prefrontal cortex). Healthy adolescents exhibited age-related decreases, while adolescents with BD exhibited age-related increases, in activity of other cognitive control frontal areas (i.e., right inferior frontal gyrus), suggesting altered development in the BD group. Longitudinal research is needed to examine potentially abnormal development of cognitive control during reward pursuit in adolescent BD and whether early therapeutic interventions can prevent these potential deviations from normative development. PMID:27114896

Age associations with neural processing of reward anticipation in adolescents with bipolar disorders.

PubMed

Urošević, Snežana; Luciana, Monica; Jensen, Jonathan B; Youngstrom, Eric A; Thomas, Kathleen M

2016-01-01

Reward/behavioral approach system hypersensitivity is implicated in bipolar disorders (BD) and in normative development during adolescence. Pediatric onset of BD is associated with a more severe illness course. However, little is known about neural processing of rewards in adolescents with BD or developmental (i.e., age) associations with activation of these neural systems. The present study aims to address this knowledge gap. The present sample included 21 adolescents with BD and 26 healthy adolescents, ages 13 to 19. Participants completed a functional magnetic resonance imaging (fMRI) protocol using the Monetary Incentive Delay (MID) task. Behavioral performance was similar between groups. Group differences in BOLD activation during target anticipation and feedback anticipation periods of the task were examined using whole-brain analyses, as were group differences in age effects. During both target anticipation and feedback anticipation, adolescents with BD, compared to adolescents without psychopathology, exhibited decreased engagement of frontal regions involved in cognitive control (i.e., dorsolateral prefrontal cortex). Healthy adolescents exhibited age-related decreases, while adolescents with BD exhibited age-related increases, in activity of other cognitive control frontal areas (i.e., right inferior frontal gyrus), suggesting altered development in the BD group. Longitudinal research is needed to examine potentially abnormal development of cognitive control during reward pursuit in adolescent BD and whether early therapeutic interventions can prevent these potential deviations from normative development.

Distinct effects of ASD and ADHD symptoms on reward anticipation in participants with ADHD, their unaffected siblings and healthy controls: a cross-sectional study.

PubMed

van Dongen, Eelco V; von Rhein, Daniel; O'Dwyer, Laurence; Franke, Barbara; Hartman, Catharina A; Heslenfeld, Dirk J; Hoekstra, Pieter J; Oosterlaan, Jaap; Rommelse, Nanda; Buitelaar, Jan

2015-01-01

Autism spectrum disorder (ASD) traits are continuously distributed throughout the population, and ASD symptoms are also frequently observed in patients with attention-deficit/hyperactivity disorder (ADHD). Both ASD and ADHD have been linked to alterations in reward-related neural processing. However, whether both symptom domains interact and/or have distinct effects on reward processing in healthy and ADHD populations is currently unknown. We examined how variance in ASD and ADHD symptoms in individuals with ADHD and healthy participants was related to the behavioural and neural response to reward during a monetary incentive delay (MID) task. Participants (mean age: 17.7 years, range: 10-28 years) from the NeuroIMAGE study with a confirmed diagnosis of ADHD (n = 136), their unaffected siblings (n = 83), as well as healthy controls (n = 105) performed an MID task in a magnetic resonance imaging (MRI) scanner. ASD and ADHD symptom scores were used as predictors of the neural response to reward anticipation and reward receipt. Behavioural responses were modeled using linear mixed models; neural responses were analysed using FMRIB's Software Library (FSL) proprietary mixed effects analysis (FLAMEO). ASD and ADHD symptoms were associated with alterations in BOLD activity during reward anticipation, but not reward receipt. Specifically, ASD scores were related to increased insular activity during reward anticipation across the sample. No interaction was found between this effect and the presence of ADHD, suggesting that ASD symptoms had no differential effect in ADHD and healthy populations. ADHD symptom scores were associated with reduced dorsolateral prefrontal activity during reward anticipation. No interactions were found between the effects of ASD and ADHD symptoms on reward processing. Variance in ASD and ADHD symptoms separately influence neural processing during reward anticipation in both individuals with (an increased risk of) ADHD and healthy participants. Our findings therefore suggest that both symptom domains affect reward processing through distinct mechanisms, underscoring the importance of multidimensional and multimodal assessment in psychiatry.

The Effectiveness of Rewards and Incentives for Teachers.

ERIC Educational Resources Information Center

Kimball, Roland B.

This study examined (1) the rewards and incentive systems currently used in schools, (2) the relationship between the existing reward system and both the excellence of the school and the behavior of teachers and administrators in searching for alternatives, and (3) the possibility of defining a rewards system for teachers which would elicit…

Orbitofrontal reward sensitivity and impulsivity in adult attention deficit hyperactivity disorder.

PubMed

Wilbertz, Gregor; van Elst, Ludger Tebartz; Delgado, Mauricio R; Maier, Simon; Feige, Bernd; Philipsen, Alexandra; Blechert, Jens

2012-03-01

Impulsivity symptoms of adult attention deficit hyperactivity disorder (ADHD) such as increased risk taking have been linked with impaired reward processing. Previous studies have focused on reward anticipation or on rewarded executive functioning tasks and have described a striatal hyporesponsiveness and orbitofrontal alterations in adult and adolescent ADHD. Passive reward delivery and its link to behavioral impulsivity are less well understood. To study this crucial aspect of reward processing we used functional magnetic resonance imaging (fMRI) combined with electrodermal assessment in male and female adult ADHD patients (N=28) and matched healthy control participants (N=28) during delivery of monetary and non-monetary rewards. Further, two behavioral tasks assessed risky decision making (game of dice task) and delay discounting. Results indicated that both groups activated ventral and dorsal striatum and the medial orbitofrontal cortex (mOFC) in response to high-incentive (i.e. monetary) rewards. A similar, albeit less strong activation pattern was found for low-incentive (i.e. non-monetary) rewards. Group differences emerged when comparing high and low incentive rewards directly: activation in the mOFC coded for the motivational change in reward delivery in healthy controls, but not ADHD patients. Additionally, this dysfunctional mOFC activity in patients correlated with risky decision making and delay discounting and was paralleled by physiological arousal. Together, these results suggest that the mOFC codes reward value and type in healthy individuals whereas this function is deficient in ADHD. The brain-behavior correlations suggest that this deficit might be related to behavioral impulsivity. Reward value processing difficulties in ADHD should be considered when assessing reward anticipation and emotional learning in research and applied settings. Copyright © 2011 Elsevier Inc. All rights reserved.

Blunted striatal response to monetary reward anticipation during smoking abstinence predicts lapse during a contingency-managed quit attempt

PubMed Central

Sweitzer, Maggie M.; Geier, Charles F.; Denlinger, Rachel; Forbes, Erika E.; Raiff, Bethany R.; Dallery, Jesse; McClernon, F.J.; Donny, Eric C.

2017-01-01

Rationale Tobacco smoking is associated with dysregulated reward processing within the striatum, characterized by hypersensitivity to smoking rewards and hyposensitivity to non-smoking rewards. This bias toward smoking reward at the expense of alternative rewards is further exacerbated by deprivation from smoking, which may contribute to difficulty maintaining abstinence during a quit attempt. Objective We examined whether abstinence-induced changes in striatal processing of rewards predicted lapse likelihood during a quit attempt supported by contingency management (CM), in which abstinence from smoking was reinforced with money. Methods Thirty-six non-treatment seeking smokers participated in two fMRI sessions, one following 24-hr abstinence and one following smoking as usual. During each scan, participants completed a rewarded guessing task designed to elicit striatal activation in which they could earn smoking and monetary rewards delivered after the scan. Participants then engaged in a 3-week CM-supported quit attempt. Results As previously reported, 24-hr abstinence was associated with increased striatal activation in anticipation of smoking reward and decreased activation in anticipation of monetary reward. Individuals exhibiting greater decrements in right striatal activation to monetary reward during abstinence (controlling for activation during non-abstinence) were more likely to lapse during CM (p<.05), even when controlling for other predictors of lapse outcome (e.g., craving); no association was seen for smoking reward. Conclusions These results are consistent with a growing number of studies indicating the specific importance of disrupted striatal processing of non-drug reward in nicotine dependence, and highlight the importance of individual differences in abstinence-induced deficits in striatal function for smoking cessation. PMID:26660448

Blunted striatal response to monetary reward anticipation during smoking abstinence predicts lapse during a contingency-managed quit attempt.

PubMed

Sweitzer, Maggie M; Geier, Charles F; Denlinger, Rachel; Forbes, Erika E; Raiff, Bethany R; Dallery, Jesse; McClernon, F J; Donny, Eric C

2016-03-01

Tobacco smoking is associated with dysregulated reward processing within the striatum, characterized by hypersensitivity to smoking rewards and hyposensitivity to non-smoking rewards. This bias toward smoking reward at the expense of alternative rewards is further exacerbated by deprivation from smoking, which may contribute to difficulty maintaining abstinence during a quit attempt. We examined whether abstinence-induced changes in striatal processing of rewards predicted lapse likelihood during a quit attempt supported by contingency management (CM), in which abstinence from smoking was reinforced with money. Thirty-six non-treatment-seeking smokers participated in two functional MRI (fMRI) sessions, one following 24-h abstinence and one following smoking as usual. During each scan, participants completed a rewarded guessing task designed to elicit striatal activation in which they could earn smoking and monetary rewards delivered after the scan. Participants then engaged in a 3-week CM-supported quit attempt. As previously reported, 24-h abstinence was associated with increased striatal activation in anticipation of smoking reward and decreased activation in anticipation of monetary reward. Individuals exhibiting greater decrements in right striatal activation to monetary reward during abstinence (controlling for activation during non-abstinence) were more likely to lapse during CM (p < 0.025), even when controlling for other predictors of lapse outcome (e.g., craving); no association was seen for smoking reward. These results are consistent with a growing number of studies indicating the specific importance of disrupted striatal processing of non-drug reward in nicotine dependence and highlight the importance of individual differences in abstinence-induced deficits in striatal function for smoking cessation.

A Genetic Polymorphism of the Endogenous Opioid Dynorphin Modulates Monetary Reward Anticipation in the Corticostriatal Loop

PubMed Central

Votinov, Mikhail; Pripfl, Juergen; Windischberger, Christian; Kalcher, Klaudius; Zimprich, Alexander; Zimprich, Fritz; Moser, Ewald

2014-01-01

The dynorphin/κ-opioid receptor (KOP-R) system has been shown to play a role in different types of behavior regulation, including reward-related behavior and drug craving. It has been shown that alleles with 3 or 4 repeats (HH genotype) of the variable nucleotide tandem repeat (68-bp VNTR) functional polymorphism of the prodynorphin (PDYN) gene are associated with higher levels of dynorphin peptides than alleles with 1 or 2 repeats (LL genotype). We used fMRI on N = 71 prescreened healthy participants to investigate the effect of this polymorphism on cerebral activation in the limbic-corticostriatal loop during reward anticipation. Individuals with the HH genotype showed higher activation than those with the LL genotype in the medial orbitofrontal cortex (mOFC) when anticipating a possible monetary reward. In addition, the HH genotype showed stronger functional coupling (as assessed by effective connectivity analyses) of mOFC with VMPFC, subgenual anterior cingulate cortex, and ventral striatum during reward anticipation. This hints at a larger sensitivity for upcoming rewards in individuals with the HH genotype, resulting in a higher motivation to attain these rewards. These findings provide first evidence in humans that the PDYN polymorphism modulates neural processes associated with the anticipation of rewards, which ultimately may help to explain differences between genotypes with respect to addiction and drug abuse. PMID:24587148

A genetic polymorphism of the endogenous opioid dynorphin modulates monetary reward anticipation in the corticostriatal loop.

PubMed

Votinov, Mikhail; Pripfl, Juergen; Windischberger, Christian; Kalcher, Klaudius; Zimprich, Alexander; Zimprich, Fritz; Moser, Ewald; Lamm, Claus; Sailer, Uta

2014-01-01

The dynorphin/κ-opioid receptor (KOP-R) system has been shown to play a role in different types of behavior regulation, including reward-related behavior and drug craving. It has been shown that alleles with 3 or 4 repeats (HH genotype) of the variable nucleotide tandem repeat (68-bp VNTR) functional polymorphism of the prodynorphin (PDYN) gene are associated with higher levels of dynorphin peptides than alleles with 1 or 2 repeats (LL genotype). We used fMRI on N = 71 prescreened healthy participants to investigate the effect of this polymorphism on cerebral activation in the limbic-corticostriatal loop during reward anticipation. Individuals with the HH genotype showed higher activation than those with the LL genotype in the medial orbitofrontal cortex (mOFC) when anticipating a possible monetary reward. In addition, the HH genotype showed stronger functional coupling (as assessed by effective connectivity analyses) of mOFC with VMPFC, subgenual anterior cingulate cortex, and ventral striatum during reward anticipation. This hints at a larger sensitivity for upcoming rewards in individuals with the HH genotype, resulting in a higher motivation to attain these rewards. These findings provide first evidence in humans that the PDYN polymorphism modulates neural processes associated with the anticipation of rewards, which ultimately may help to explain differences between genotypes with respect to addiction and drug abuse.

Heterogeneity of reward mechanisms.

PubMed

Lajtha, A; Sershen, H

2010-06-01

The finding that many drugs that have abuse potential and other natural stimuli such as food or sexual activity cause similar chemical changes in the brain, an increase in extracellular dopamine (DA) in the shell of the nucleus accumbens (NAccS), indicated some time ago that the reward mechanism is at least very similar for all stimuli and that the mechanism is relatively simple. The presently available information shows that the mechanisms involved are more complex and have multiple elements. Multiple brain regions, multiple receptors, multiple distinct neurons, multiple transmitters, multiple transporters, circuits, peptides, proteins, metabolism of transmitters, and phosphorylation, all participate in reward mechanisms. The system is variable, is changed during development, is sex-dependent, and is influenced by genetic differences. Not all of the elements participate in the reward of all stimuli. Different set of mechanisms are involved in the reward of different drugs of abuse, yet different mechanisms in the reward of natural stimuli such as food or sexual activity; thus there are different systems that distinguish different stimuli. Separate functions of the reward system such as anticipation, evaluation, consummation and identification; all contain function-specific elements. The level of the stimulus also influences the participation of the elements of the reward system, there are possible reactions to even below threshold stimuli, and excessive stimuli can change reward to aversion involving parts of the system. Learning and memory of past reward is an important integral element of reward and addictive behavior. Many of the reward elements are altered by repeated or chronic stimuli, and chronic exposure to one drug is likely to alter the response to another stimulus. To evaluate and identify the reward stimulus thus requires heterogeneity of the reward components in the brain.

Common Alterations in Sensitivity to Type but Not Amount of Reward in ADHD and Autism Spectrum Disorders

ERIC Educational Resources Information Center

Demurie, Ellen; Roeyers, Herbert; Baeyens, Dieter; Sonuga-Barke, Edmund

2011-01-01

Background: Children with attention deficit/hyperactivity disorder (ADHD) display abnormalities in reward processing. Most reward studies have focused on the effects of material or monetary rewards. Studies with autism spectrum disorder (ASD) have focused on social rewards. In this study we compared the effects of amount and type of reward in…

A transient dopamine signal encodes subjective value and causally influences demand in an economic context

PubMed Central

Schelp, Scott A.; Pultorak, Katherine J.; Rakowski, Dylan R.; Gomez, Devan M.; Krzystyniak, Gregory; Das, Raibatak; Oleson, Erik B.

2017-01-01

The mesolimbic dopamine system is strongly implicated in motivational processes. Currently accepted theories suggest that transient mesolimbic dopamine release events energize reward seeking and encode reward value. During the pursuit of reward, critical associations are formed between the reward and cues that predict its availability. Conditioned by these experiences, dopamine neurons begin to fire upon the earliest presentation of a cue, and again at the receipt of reward. The resulting dopamine concentration scales proportionally to the value of the reward. In this study, we used a behavioral economics approach to quantify how transient dopamine release events scale with price and causally alter price sensitivity. We presented sucrose to rats across a range of prices and modeled the resulting demand curves to estimate price sensitivity. Using fast-scan cyclic voltammetry, we determined that the concentration of accumbal dopamine time-locked to cue presentation decreased with price. These data confirm and extend the notion that dopamine release events originating in the ventral tegmental area encode subjective value. Using optogenetics to augment dopamine concentration, we found that enhancing dopamine release at cue made demand more sensitive to price and decreased dopamine concentration at reward delivery. From these observations, we infer that value is decreased because of a negative reward prediction error (i.e., the animal receives less than expected). Conversely, enhancing dopamine at reward made demand less sensitive to price. We attribute this finding to a positive reward prediction error, whereby the animal perceives they received a better value than anticipated. PMID:29109253

Age Differences in the Impact of Peers on Adolescents’ and Adults’ Neural Response to Reward

PubMed Central

Smith, Ashley R.; Steinberg, Laurence; Strang, Nicole; Chein, Jason

2014-01-01

Prior research suggests that increased adolescent risk-taking in the presence of peers may be linked to the influence of peers on the valuation and processing of rewards during decision-making. The current study explores this idea by examining how peer observation impacts the processing of rewards when such processing is isolated from other facets of risky decision-making (e.g. risk-perception and preference, inhibitory processing, etc.). In an fMRI paradigm, a sample of adolescents (ages 14–19) and adults (ages 25–35) completed a modified High/Low Card Guessing Task that included rewarded and un-rewarded trials. Social context was manipulated by having participants complete the task both alone and while being observed by two, same-age, same-sex peers. Results indicated an interaction of age and social context on the activation of reward circuitry during the receipt of reward; when observed by peers adolescents exhibited greater ventral striatal activation than adults, but no age-related differences were evinced when the task was completed alone. These findings suggest that, during adolescence, peers influence recruitment of reward-related regions even when they are engaged outside of the context of risk-taking. Implications for engagement in prosocial, as well as risky, behaviors during adolescence are discussed. PMID:25280778

Fairness influences early signatures of reward-related neural processing.

PubMed

Massi, Bart; Luhmann, Christian C

2015-12-01

Many humans exhibit a strong preference for fairness during decision-making. Although there is evidence that social factors influence reward-related and affective neural processing, it is unclear if this effect is mediated by compulsory outcome evaluation processes or results from slower deliberate cognition. Here we show that the feedback-related negativity (FRN) and late positive potential (LPP), two signatures of early hedonic processing, are modulated by the fairness of rewards during a passive rating task. We find that unfair payouts elicit larger FRNs than fair payouts, whereas fair payouts elicit larger LPPs than unfair payouts. This is true both in the time-domain, where the FRN and LPP are related, and in the time-frequency domain, where the two signals are largely independent. Ultimately, this work demonstrates that fairness affects the early stages of reward and affective processing, suggesting a common biological mechanism for social and personal reward evaluation.

Rewarded visual items capture attention only in heterogeneous contexts.

PubMed

Feldmann-Wüstefeld, Tobias; Brandhofer, Ruben; Schubö, Anna

2016-07-01

Reward is known to affect visual search performance. Rewarding targets can increase search performance, whereas rewarding distractors can decrease search performance. We used subcomponents of the N2pc in the event-related EEG, the NT (target negativity) and ND /PD (distractor negativity/positivity), in a visual search task to disentangle target and distractor processing related to reward. The visual search task comprised homogeneous and heterogeneous contexts in which a target and a colored distractor were embedded. After each correct trial, participants were given a monetary reward that depended on the color of the distractor. We found longer response times for displays with high-reward distractors compared to displays with low-reward distractors, indicating reward-induced interference, however, only for heterogeneous contexts. The NT component, indicative of attention deployment to the target, showed that target selection was impaired by high-reward distractors, regardless of the context homogeneity. Processing of distractors was not affected by reward in homogeneous contexts. In heterogeneous contexts, however, high-reward distractors were more likely to capture attention (ND ) and required more effort to be suppressed (PD ) than low-reward distractors. In sum the results showed that, despite the fact that target selection is impaired by high-reward distractors in both homogeneous and heterogeneous background contexts, high-reward distractors capture attention only in scenarios that foster attentional capture. © 2016 Society for Psychophysiological Research.

Cigarette smoking modulates medication-associated deficits in a monetary reward task in patients with schizophrenia.

PubMed

Lernbass, Birgit; Grön, Georg; Wolf, Nadine D; Abler, Birgit

2013-09-01

Imaging studies of reward processing have demonstrated a mesolimbic-mesocortical dopaminergic dysfunction in schizophrenia. Such studies on reward processing in patients and also in healthy controls showed that differential activations of dopaminergic brain areas are associated with adaptive changes in response speed related to different reward values. Given this relationship, we investigated reward processing on the behavioural level in a larger sample of 49 medicated patients with a diagnosis of schizophrenia (ICD-10 F20) and 49 healthy controls. Subjects were instructed to react by button press upon two different stimuli in order to retain a 60 % chance winning a previously announced high (1$) or low (20¢) amount of money paid to participants after the experiment. Concordant with previous reports on deficits in reward processing, acceleration of reaction times in patients upon low rewards differed significantly (p < 0.05) from healthy controls in our present behavioural study. This effect was pronounced in the non-smoking subgroup of patients (n = 24). In this subgroup, we also observed a significant (p < 0.05) positive correlation with medication type (relatively high vs. low D2 receptor affinity) and with the PANSS score, the latter with a trend to significance (p = 0.08). Our study demonstrates that reaction time measures in a monetary reward task might constitute a feasible behavioural proxy for dopaminergic dysfunction and its different dimensions regarding psychopathology but also medication in patients with schizophrenia. In line with clinical observations, our findings support the notion that smoking modulates medication-associated side effects on reward processing in patients with schizophrenia.

A functional neuroimaging study assessing gender differences in the neural mechanisms underlying the ability to resist impulsive desires.

PubMed

Diekhof, Esther K; Keil, Maria; Obst, Katrin U; Henseler, Ilona; Dechent, Peter; Falkai, Peter; Gruber, Oliver

2012-09-14

There is ample evidence of gender differences in neural processes and behavior. Differences in reward-related behaviors have been linked to either temporary or permanent organizational influences of gonadal hormones on the mesolimbic dopamine system and reward-related activation. Still, little is known about the association between biological gender and the neural underpinnings of the ability to resist reward-related impulses. Here we assessed with functional magnetic resonance imaging which neural processes enable men and women to successfully control their desire for immediate reward when this is required by a higher-order goal (i.e., during a 'desire-reason dilemma'; Diekhof and Gruber, 2010). Thirty-two participants (16 females) were closely matched for age, personality characteristics (e.g., novelty seeking) and behavioral performance in the 'desire-reason task'. On the neural level, men and women showed similarities in the general response of the nucleus accumbens and of the ventral tegmental area to predictors of immediate reward, but they differed in additional brain mechanisms that enabled self-controlled decisions against the preference for immediate reward. Firstly, men exhibited a stronger reduction of activation in the ventral pallidum, putamen, temporal pole and pregenual anterior cingulate cortex during the 'desire-reason dilemma'. Secondly, connectivity analyses revealed a significant change in the direction of the connectivity between anteroventral prefrontal cortex and nucleus accumbens during decisions counteracting the reward-related impulse when comparing men and women. Together, these findings support the view of a sexual dimorphism that manifested in the recruitment of gender-specific neural resources during the successful deployment of self-control. Copyright © 2012 Elsevier B.V. All rights reserved.

Liking, wanting, and the incentive-sensitization theory of addiction.

PubMed

Berridge, Kent C; Robinson, Terry E

2016-11-01

Rewards are both "liked" and "wanted," and those 2 words seem almost interchangeable. However, the brain circuitry that mediates the psychological process of "wanting" a particular reward is dissociable from circuitry that mediates the degree to which it is "liked." Incentive salience or "wanting," a form of motivation, is generated by large and robust neural systems that include mesolimbic dopamine. By comparison, "liking," or the actual pleasurable impact of reward consumption, is mediated by smaller and fragile neural systems, and is not dependent on dopamine. The incentive-sensitization theory posits the essence of drug addiction to be excessive amplification specifically of psychological "wanting," especially triggered by cues, without necessarily an amplification of "liking." This is because of long-lasting changes in dopamine-related motivation systems of susceptible individuals, called "neural sensitization." A quarter-century after its proposal, evidence has continued to grow in support the incentive-sensitization theory. Further, its scope is now expanding to include diverse behavioral addictions and other psychopathologies. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Liking, Wanting and the Incentive-Sensitization Theory of Addiction

PubMed Central

Berridge, Kent C.; Robinson, Terry E.

2016-01-01

Rewards are both ‘liked’ and ‘wanted’, and those two words seem almost interchangeable. However, the brain circuitry that mediates the psychological process of ‘wanting’ a particular reward is dissociable from circuitry that mediates the degree to which it is ‘liked’. Incentive salience or ‘wanting’, a form of motivation, is generated by large and robust neural systems that include mesolimbic dopamine. By comparison, ‘liking’, or the actual pleasurable impact of reward consumption, is mediated by smaller and fragile neural systems, and is not dependent on dopamine. The incentive-sensitization theory posits the essence of drug addiction to be excessive amplification specifically of psychological ‘wanting’, especially triggered by cues, without necessarily an amplification of ‘liking’. This is due to long-lasting changes in dopamine-related motivation systems of susceptible individuals, called neural sensitization. A quarter-century after its proposal, evidence has continued to grow in support the incentive-sensitization theory. Further, its scope is now expanding to include diverse behavioral addictions and other psychopathologies. PMID:27977239

Drug-sensitive reward in crayfish: an invertebrate model system for the study of SEEKING, reward, addiction, and withdrawal.

PubMed

Huber, Robert; Panksepp, Jules B; Nathaniel, Thomas; Alcaro, Antonio; Panksepp, Jaak

2011-10-01

In mammals, rewarding properties of drugs depend on their capacity to activate appetitive motivational states. With the underlying mechanisms strongly conserved in evolution, invertebrates have recently emerged as a powerful new model in addiction research. In crayfish natural reward has proven surprisingly sensitive to human drugs of abuse, opening an unlikely avenue of research into the basic biological mechanisms of drug addiction. In a series of studies we first examined the presence of natural reward systems in crayfish, then characterized its sensitivity to a wide range of human drugs of abuse. A conditioned place preference (CPP) paradigm was used to demonstrate that crayfish seek out those environments that had previously been paired with the psychostimulants cocaine and amphetamine, and the opioid morphine. The administration of amphetamine exerted its effects at a number of sites, including the stimulation of circuits for active exploratory behaviors (i.e., SEEKING). A further study examined morphine-induced reward, extinction and reinstatement in crayfish. Repeated intra-circulatory infusions of morphine served as a reward when paired with distinct visual or tactile cues. Morphine-induced CPP was extinguished after repeated saline injections. Following this extinction phase, morphine-experienced crayfish were once again challenged with the drug. The priming injections of morphine reinstated CPP at all tested doses, suggesting that morphine-induced CPP is unrelenting. In an exploration of drug-associated behavioral sensitization in crayfish we concurrently mapped measures of locomotion and rewarding properties of morphine. Single and repeated intra-circulatory infusions of morphine resulted in persistent locomotory sensitization, even 5 days following the infusion. Moreover, a single dose of morphine was sufficient to induce long-term behavioral sensitization. CPP for morphine and context-dependent cues could not be disrupted over a drug free period of 5 days. This work demonstrates that crayfish offer a comparative and complementary approach in addiction research. Serving as an invertebrate animal model for the exposure to mammalian drugs of abuse, modularly organized and experimentally accessible nervous systems render crayfish uniquely suited for studying (1) the basic biological mechanisms of drug effects, (2) to explore how the appetitive/seeking disposition is implemented in a simple neural system, and (3) how such a disposition is related to the rewarding action of drugs of abuse. This work aimed to contribute an evolutionary, comparative context to our understanding of a key component in learning, and of natural reward as an important life-sustaining process. Copyright © 2010 Elsevier Ltd. All rights reserved.

The role of high-frequency oscillatory activity in reward processing and learning.

PubMed

Marco-Pallarés, Josep; Münte, Thomas F; Rodríguez-Fornells, Antoni

2015-02-01

Oscillatory activity has been proposed as a key mechanism in the integration of brain activity of distant structures. Particularly, high frequency brain oscillatory activity in the beta and gamma range has received increasing interest in the domains of attention and memory. In addition, a number of recent studies have revealed an increase of beta-gamma activity (20-35 Hz) after unexpected or relevant positive reward outcomes. In the present manuscript we review the literature on this phenomenon and we propose that this activity is a brain signature elicited by unexpected positive outcomes in order to transmit a fast motivational value signal to the reward network. In addition, we hypothesize that beta-gamma oscillatory activity indexes the interaction between attentional and emotional systems, and that it directly reflects the appearance of unexpected positive rewards in learning-related contexts. Copyright © 2014 Elsevier Ltd. All rights reserved.

Magnetoencephalographic imaging of deep corticostriatal network activity during a rewards paradigm.

PubMed

Kanal, Eliezer Y; Sun, Mingui; Ozkurt, Tolga E; Jia, Wenyan; Sclabassi, Robert

2009-01-01

The human rewards network is a complex system spanning both cortical and subcortical regions. While much is known about the functions of the various components of the network, research on the behavior of the network as a whole has been stymied due to an inability to detect signals at a high enough temporal resolution from both superficial and deep network components simultaneously. In this paper, we describe the application of magnetoencephalographic imaging (MEG) combined with advanced signal processing techniques to this problem. Using data collected while subjects performed a rewards-related gambling paradigm demonstrated to activate the rewards network, we were able to identify neural signals which correspond to deep network activity. We also show that this signal was not observable prior to filtration. These results suggest that MEG imaging may be a viable tool for the detection of deep neural activity.

Consolidation power of extrinsic rewards: reward cues enhance long-term memory for irrelevant past events.

PubMed

Murayama, Kou; Kitagami, Shinji

2014-02-01

Recent research suggests that extrinsic rewards promote memory consolidation through dopaminergic modulation processes. However, no conclusive behavioral evidence exists given that the influence of extrinsic reward on attention and motivation during encoding and consolidation processes are inherently confounded. The present study provides behavioral evidence that extrinsic rewards (i.e., monetary incentives) enhance human memory consolidation independently of attention and motivation. Participants saw neutral pictures, followed by a reward or control cue in an unrelated context. Our results (and a direct replication study) demonstrated that the reward cue predicted a retrograde enhancement of memory for the preceding neutral pictures. This retrograde effect was observed only after a delay, not immediately upon testing. An additional experiment showed that emotional arousal or unconscious resource mobilization cannot explain the retrograde enhancement effect. These results provide support for the notion that the dopaminergic memory consolidation effect can result from extrinsic reward.

The attention habit: how reward learning shapes attentional selection.

PubMed

Anderson, Brian A

2016-04-01

There is growing consensus that reward plays an important role in the control of attention. Until recently, reward was thought to influence attention indirectly by modulating task-specific motivation and its effects on voluntary control over selection. Such an account was consistent with the goal-directed (endogenous) versus stimulus-driven (exogenous) framework that had long dominated the field of attention research. Now, a different perspective is emerging. Demonstrations that previously reward-associated stimuli can automatically capture attention even when physically inconspicuous and task-irrelevant challenge previously held assumptions about attentional control. The idea that attentional selection can be value driven, reflecting a distinct and previously unrecognized control mechanism, has gained traction. Since these early demonstrations, the influence of reward learning on attention has rapidly become an area of intense investigation, sparking many new insights. The result is an emerging picture of how the reward system of the brain automatically biases information processing. Here, I review the progress that has been made in this area, synthesizing a wealth of recent evidence to provide an integrated, up-to-date account of value-driven attention and some of its broader implications. © 2015 New York Academy of Sciences.

Motivation, working memory, and decision making: a cognitive-motivational theory of personality vulnerability to alcoholism.

PubMed

Finn, Peter R

2002-09-01

This article presents a cognitive-motivational theory (CMT) of the mechanisms associated with three basic dimensions of personality vulnerability to alcoholism, impulsivity/novelty seeking, harm avoidance, and excitement seeking. CMT describes the interrelationships between activity in basic motivational systems and attentional, decision-making and working memory processes as the mechanisms associated with variation in each personality trait. Impulsivity/novelty seeking reflects activity in both appetitive and inhibitory motivational systems, greater attention to reward cues, and increased emotional reactivity to reward and frustration. Harm avoidance reflects individual differences in fearfulness and activity in specific inhibitory systems. Excitement seeking reflects the need to engage in appetitive behaviors in less predictable environments to experience positive affect. CMT also describes the impact of working memory and the specific motivational processes underlying each trait dimension on the dynamics of decision making from the perspective of decision field theory.

Evidence for opioid involvement in the motivation to sing

PubMed Central

Riters, Lauren V.

2009-01-01

Songbirds produce high rates of song within multiple social contexts, suggesting that they are highly motivated to sing and that song production itself may be rewarding. Progress has been made in understanding the neural basis of song learning and sensorimotor processing, however little is known about neurobiological mechanisms regulating the motivation to sing. Neural systems involved in motivation and reward have been conserved across species and in songbirds are neuroanatomically well-positioned to influence the song control system. Opioid neuropeptides within these systems play a primary role in hedonic reward, at least in mammals. In songbirds, opioid neuropeptides and receptors are found throughout the song control system and within several brain regions implicated in both motivation and reward, including the medial preoptic nucleus (POM) and ventral tegmental area (VTA). Growing research shows these regions to play a role in birdsong that differs depending upon whether song is sexually-motivated in response to a female, used for territorial defense or sung as part of a flock but not directed towards an individual (undirected song). Opioid pharmacological manipulations and immunocytochemical data demonstrate a role for opioid activity possibly within VTA and POM in the regulation of song production. Although future research is needed, data suggest that opioids may be most critically involved in reinforcing song that does not result in any obvious form of immediate externally-mediated reinforcement, such as undirected song produced in large flocks or during song learning. Data are reviewed supporting the idea that dopamine activity underlies the motivation or drive to sing, but that opioid release is what makes song production rewarding. PMID:19995531

Cannabinoid modulation of drug reward and the implications of marijuana legalization.

PubMed

Covey, Dan P; Wenzel, Jennifer M; Cheer, Joseph F

2015-12-02

Marijuana is the most popular illegal drug worldwide. Recent trends indicate that this may soon change; not due to decreased marijuana use, but to an amendment in marijuana's illegal status. The cannabinoid type 1 (CB1) receptor mediates marijuana's psychoactive and reinforcing properties. CB1 receptors are also part of the brain endocannabinoid (eCB) system and support numerous forms of learning and memory, including the conditioned reinforcing properties of cues predicting reward or punishment. This is accomplished via eCB-dependent alterations in mesolimbic dopamine function, which plays an obligatory role in reward learning and motivation. Presynaptic CB1 receptors control midbrain dopamine neuron activity and thereby shape phasic dopamine release in target regions, particularly the nucleus accumbens (NAc). By also regulating synaptic input to the NAc, CB1 receptors modulate NAc output onto downstream neurons of the basal ganglia motor circuit, and thereby support goal-directed behaviors. Abused drugs promote short- and long-term adaptations in eCB-regulation of mesolimbic dopamine function, and thereby hijack neural systems related to the pursuit of rewards to promote drug abuse. By pharmacologically targeting the CB1 receptors, marijuana has preferential access to this neuronal system and can potently alter eCB-dependent processing of reward-related stimuli. As marijuana legalization progresses, greater access to this drug should increase the utility of marijuana as a research tool to better understand the eCB system, which has the potential to advance cannabinoid-based treatments for drug addiction. Copyright © 2014 Elsevier B.V. All rights reserved.

Reward reduces conflict by enhancing attentional control and biasing visual cortical processing.

PubMed

Padmala, Srikanth; Pessoa, Luiz

2011-11-01

How does motivation interact with cognitive control during challenging behavioral conditions? Here, we investigated the interactions between motivation and cognition during a response conflict task and tested a specific model of the effect of reward on cognitive processing. Behaviorally, participants exhibited reduced conflict during the reward versus no-reward condition. Brain imaging results revealed that a group of subcortical and fronto-parietal regions was robustly influenced by reward at cue processing and, importantly, that cue-related responses in fronto-parietal attentional regions were predictive of reduced conflict-related signals in the medial pFC (MPFC)/ACC during the upcoming target phase. Path analysis revealed that the relationship between cue responses in the right intraparietal sulcus (IPS) and interference-related responses in the MPFC during the subsequent target phase was mediated via signals in the left fusiform gyrus, which we linked to distractor-related processing. Finally, reward increased functional connectivity between the right IPS and both bilateral putamen and bilateral nucleus accumbens during the cue phase, a relationship that covaried with across-individual sensitivity to reward in the case of the right nucleus accumbens. Taken together, our findings are consistent with a model in which motivationally salient cues are employed to upregulate top-down control processes that bias the selection of visual information, thereby leading to more efficient stimulus processing during conflict conditions.

The effects of nicotine dependence and acute abstinence on the processing of drug and non-drug rewards.

PubMed

Lawn, W; Freeman, T P; Hindocha, C; Mokrysz, C; Das, R K; Morgan, C J A; Curran, H V

2015-07-01

Drug addiction may be characterised by a hypersensitivity to drug rewards and a hyposensitivity to non-drug rewards. This imbalance may become further polarised during acute abstinence. (i) Examine the differences between dependent and occasional smokers in choices for, motivation for and self-reported wanting and liking of cigarette and non-drug rewards. (ii) Examine the effects of 12-h nicotine abstinence on these metrics. Dependent (n = 20) and occasional, non-dependent smokers (n = 20) were tested after ad libitum smoking and ≥12-h of nicotine abstinence. A novel task was developed (Drug, Reward and Motivation-Choice (DReaM-Choice)) in which different rewards (cigarettes, music and chocolate) could be won. In each trial, participants chose between two rewards and then could earn the chosen reward via repeated button-pressing. Participants subsequently 'consumed' and rated subjective liking of the rewards they had won. Compared with occasional smokers, dependent smokers made more choices for (p < 0.001), pressed more for (p = 0.046) and reported more wanting (p = 0.007) and liking (p < 0.001) of cigarettes, and also made fewer choices for chocolate (p = 0.005). There were no differences between the groups on button-pressing for chocolate or music. However, the balance between drug and non-drug reward processing was different between the groups across all metrics. Twelve-hour nicotine abstinence led to more cigarette choices (p < 0.001) and fewer music choices (p = 0.042) in both groups. Nicotine dependence was associated with a hypersensitivity to cigarette rewards, but we found little evidence indicating a hyposensitivity to non-drug rewards. Our findings question the moderating influence of dependence on how acute nicotine abstinence affects reward processing.

Antireward, compulsivity, and addiction: seminal contributions of Dr. Athina Markou to motivational dysregulation in addiction.

PubMed

Koob, George F

2017-05-01

Addiction is defined as a chronically relapsing disorder characterized by compulsive drug seeking that is hypothesized to derive from multiple sources of motivational dysregulation. Dr. Athina Markou made seminal contributions to our understanding of the neurobiology of addiction with her studies on the dysregulation of reward function using animal models with construct validity. Repeated overstimulation of the reward systems with drugs of abuse decreases reward function, characterized by brain stimulation reward and presumbably reflecting dysphoria-like states. The construct of negative reinforcement, defined as drug taking that alleviates a negative emotional state that is created by drug abstinence, is particularly relevant as a driving force in both the withdrawal/negative affect and preoccupation/anticipation stages of the addiction cycle. The negative emotional state that drives such negative reinforcement is hypothesized to derive from the dysregulation of key neurochemical circuits that drive incentive-salience/reward systems (dopamine, opioid peptides) in the ventral striatum and from the recruitment of brain stress systems (corticotropin-releasing factor, dynorphin) within the extended amygdala. As drug taking becomes compulsive-like, the factors that motivate behavior are hypothesized to shift to drug-seeking behavior that is driven not only by positive reinforcement but also by negative reinforcement. This shift in motivation is hypothesized to reflect the allostatic misregulation of hedonic tone such that drug taking makes the hedonic negative emotional state worse during the process of seeking temporary relief with compulsive drug taking.

Impaired Learning of Social Compared to Monetary Rewards in Autism

PubMed Central

Lin, Alice; Rangel, Antonio; Adolphs, Ralph

2012-01-01

A leading hypothesis to explain the social dysfunction in people with autism spectrum disorders (ASD) is that they exhibit a deficit in reward processing and motivation specific to social stimuli. However, there have been few direct tests of this hypothesis to date. Here we used an instrumental reward learning task that contrasted learning with social rewards (pictures of positive and negative faces) against learning with monetary reward (winning and losing money). The two tasks were structurally identical except for the type of reward, permitting direct comparisons. We tested 10 high-functioning people with ASD (7M, 3F) and 10 healthy controls who were matched on gender, age, and education. We found no significant differences between the two groups in terms of overall ability behaviorally to discriminate positive from negative slot machines, reaction-times, and valence ratings, However, there was a specific impairment in the ASD group in learning to choose social rewards, compared to monetary rewards: they had a significantly lower cumulative number of choices of the most rewarding social slot machine, and had a significantly slower initial learning rate for the socially rewarding slot machine, compared to the controls. The findings show a deficit in reward learning in ASD that is greater for social rewards than for monetary rewards, and support the hypothesis of a disproportionate impairment in social reward processing in ASD. PMID:23060743

Differential dependence of Pavlovian incentive motivation and instrumental incentive learning processes on dopamine signaling

PubMed Central

Wassum, Kate M.; Ostlund, Sean B.; Balleine, Bernard W.; Maidment, Nigel T.

2011-01-01

Here we attempted to clarify the role of dopamine signaling in reward seeking. In Experiment 1, we assessed the effects of the dopamine D1/D2 receptor antagonist flupenthixol (0.5 mg/kg i.p.) on Pavlovian incentive motivation and found that flupenthixol blocked the ability of a conditioned stimulus to enhance both goal approach and instrumental performance (Pavlovian-to-instrumental transfer). In Experiment 2 we assessed the effects of flupenthixol on reward palatability during post-training noncontingent re-exposure to the sucrose reward in either a control 3-h or novel 23-h food-deprived state. Flupenthixol, although effective in blocking the Pavlovian goal approach, was without effect on palatability or the increase in reward palatability induced by the upshift in motivational state. This noncontingent re-exposure provided an opportunity for instrumental incentive learning, the process by which rats encode the value of a reward for use in updating reward-seeking actions. Flupenthixol administered prior to the instrumental incentive learning opportunity did not affect the increase in subsequent off-drug reward-seeking actions induced by that experience. These data suggest that although dopamine signaling is necessary for Pavlovian incentive motivation, it is not necessary for changes in reward experience, or for the instrumental incentive learning process that translates this experience into the incentive value used to drive reward-seeking actions, and provide further evidence that Pavlovian and instrumental incentive learning processes are dissociable. PMID:21693635

Altered reward system reactivity for personalized circumscribed interests in autism.

PubMed

Kohls, Gregor; Antezana, Ligia; Mosner, Maya G; Schultz, Robert T; Yerys, Benjamin E

2018-01-01

Neurobiological research in autism spectrum disorders (ASD) has paid little attention on brain mechanisms that cause and maintain restricted and repetitive behaviors and interests (RRBIs). Evidence indicates an imbalance in the brain's reward system responsiveness to social and non-social stimuli may contribute to both social deficits and RRBIs. Thus, this study's central aim was to compare brain responsiveness to individual RRBI (i.e., circumscribed interests), with social rewards (i.e., social approval), in youth with ASD relative to typically developing controls (TDCs). We conducted a 3T functional magnetic resonance imaging (fMRI) study to investigate the blood-oxygenation-level-dependent effect of personalized circumscribed interest rewards versus social rewards in 39 youth with ASD relative to 22 TDC. To probe the reward system, we employed short video clips as reinforcement in an instrumental incentive delay task. This optimization increased the task's ecological validity compared to still pictures that are often used in this line of research. Compared to TDCs, youth with ASD had stronger reward system responses for CIs mostly within the non-social realm (e.g., video games) than social rewards (e.g., approval). Additionally, this imbalance within the caudate nucleus' responsiveness was related to greater social impairment. The current data support the idea of reward system dysfunction that may contribute to enhanced motivation for RRBIs in ASD, accompanied by diminished motivation for social engagement. If a dysregulated reward system indeed supports the emergence and maintenance of social and non-social symptoms of ASD, then strategically targeting the reward system in future treatment endeavors may allow for more efficacious treatment practices that help improve outcomes for individuals with ASD and their families.

Modulation of neural activity by reward in medial intraparietal cortex is sensitive to temporal sequence of reward

PubMed Central

Rajalingham, Rishi; Stacey, Richard Greg; Tsoulfas, Georgios

2014-01-01

To restore movements to paralyzed patients, neural prosthetic systems must accurately decode patients' intentions from neural signals. Despite significant advancements, current systems are unable to restore complex movements. Decoding reward-related signals from the medial intraparietal area (MIP) could enhance prosthetic performance. However, the dynamics of reward sensitivity in MIP is not known. Furthermore, reward-related modulation in premotor areas has been attributed to behavioral confounds. Here we investigated the stability of reward encoding in MIP by assessing the effect of reward history on reward sensitivity. We recorded from neurons in MIP while monkeys performed a delayed-reach task under two reward schedules. In the variable schedule, an equal number of small- and large-rewards trials were randomly interleaved. In the constant schedule, one reward size was delivered for a block of trials. The memory period firing rate of most neurons in response to identical rewards varied according to schedule. Using systems identification tools, we attributed the schedule sensitivity to the dependence of neural activity on the history of reward. We did not find schedule-dependent behavioral changes, suggesting that reward modulates neural activity in MIP. Neural discrimination between rewards was less in the variable than in the constant schedule, degrading our ability to decode reach target and reward simultaneously. The effect of schedule was mitigated by adding Haar wavelet coefficients to the decoding model. This raises the possibility of multiple encoding schemes at different timescales and reinforces the potential utility of reward information for prosthetic performance. PMID:25008408

Modulation of neural activity by reward in medial intraparietal cortex is sensitive to temporal sequence of reward.

PubMed

Rajalingham, Rishi; Stacey, Richard Greg; Tsoulfas, Georgios; Musallam, Sam

2014-10-01

To restore movements to paralyzed patients, neural prosthetic systems must accurately decode patients' intentions from neural signals. Despite significant advancements, current systems are unable to restore complex movements. Decoding reward-related signals from the medial intraparietal area (MIP) could enhance prosthetic performance. However, the dynamics of reward sensitivity in MIP is not known. Furthermore, reward-related modulation in premotor areas has been attributed to behavioral confounds. Here we investigated the stability of reward encoding in MIP by assessing the effect of reward history on reward sensitivity. We recorded from neurons in MIP while monkeys performed a delayed-reach task under two reward schedules. In the variable schedule, an equal number of small- and large-rewards trials were randomly interleaved. In the constant schedule, one reward size was delivered for a block of trials. The memory period firing rate of most neurons in response to identical rewards varied according to schedule. Using systems identification tools, we attributed the schedule sensitivity to the dependence of neural activity on the history of reward. We did not find schedule-dependent behavioral changes, suggesting that reward modulates neural activity in MIP. Neural discrimination between rewards was less in the variable than in the constant schedule, degrading our ability to decode reach target and reward simultaneously. The effect of schedule was mitigated by adding Haar wavelet coefficients to the decoding model. This raises the possibility of multiple encoding schemes at different timescales and reinforces the potential utility of reward information for prosthetic performance. Copyright © 2014 the American Physiological Society.

Amphetamine sensitization alters reward processing in the human striatum and amygdala.

PubMed

O'Daly, Owen G; Joyce, Daniel; Tracy, Derek K; Azim, Adnan; Stephan, Klaas E; Murray, Robin M; Shergill, Sukhwinder S

2014-01-01

Dysregulation of mesolimbic dopamine transmission is implicated in a number of psychiatric illnesses characterised by disruption of reward processing and goal-directed behaviour, including schizophrenia, drug addiction and impulse control disorders associated with chronic use of dopamine agonists. Amphetamine sensitization (AS) has been proposed to model the development of this aberrant dopamine signalling and the subsequent dysregulation of incentive motivational processes. However, in humans the effects of AS on the dopamine-sensitive neural circuitry associated with reward processing remains unclear. Here we describe the effects of acute amphetamine administration, following a sensitising dosage regime, on blood oxygen level dependent (BOLD) signal in dopaminoceptive brain regions during a rewarded gambling task performed by healthy volunteers. Using a randomised, double-blind, parallel-groups design, we found clear evidence for sensitization to the subjective effects of the drug, while rewarded reaction times were unchanged. Repeated amphetamine exposure was associated with reduced dorsal striatal BOLD signal during decision making, but enhanced ventromedial caudate activity during reward anticipation. The amygdala BOLD response to reward outcomes was blunted following repeated amphetamine exposure. Positive correlations between subjective sensitization and changes in anticipation- and outcome-related BOLD signal were seen for the caudate nucleus and amygdala, respectively. These data show for the first time in humans that AS changes the functional impact of acute stimulant exposure on the processing of reward-related information within dopaminoceptive regions. Our findings accord with pathophysiological models which implicate aberrant dopaminergic modulation of striatal and amygdala activity in psychosis and drug-related compulsive disorders.

Striatal Sensitivity during Reward Processing in Attention-Deficit/Hyperactivity Disorder

ERIC Educational Resources Information Center

Paloyelis, Yannis; Mehta, Mitul A.; Faraone, Stephen V.; Asherson, Philip; Kuntsi, Jonna

2012-01-01

Objective: Attention-deficit/hyperactivity disorder (ADHD) has been linked to deficits in the dopaminergic reward-processing circuitry; yet, existing evidence is limited, and the influence of genetic variation affecting dopamine signaling remains unknown. We investigated striatal responsivity to rewards in ADHD combined type (ADHD-CT) using…

Antisocial Behavior, Psychopathic Features and Abnormalities in Reward and Punishment Processing in Youth

PubMed Central

Byrd, Amy L.; Loeber, Rolf; Pardini, Dustin A.

2017-01-01

A better understanding of what leads youth to initially engage in antisocial behavior (ASB) and more importantly persist with such behaviors into adulthood has significant implications for prevention and intervention efforts. A considerable number of studies using behavioral and neuroimaging techniques have investigated abnormalities in reward and punishment processing as potential causal mechanisms underlying ASB. However, this literature has yet to be critically evaluated, and there are no comprehensive reviews that systematically examine and synthesize these findings. The goal of the present review is twofold. The first aim is to examine the extent to which youth with ASB are characterized by abnormalities in (1) reward processing; (2) punishment processing; or (3) both reward and punishment processing. The second aim is to evaluate whether aberrant reward and/or punishment processing is specific to or most pronounced in a subgroup of antisocial youth with psychopathic features. Studies utilizing behavioral methods are first reviewed, followed by studies using functional magnetic resonance imaging. An integration of theory and research across multiple levels of analysis is presented in order to provide a more comprehensive understanding of reward and punishment processing in antisocial youth. Findings are discussed in terms of developmental and contextual considerations, proposed future directions and implications for intervention. PMID:24357109

Iowa Gambling Task (IGT): twenty years after – gambling disorder and IGT

PubMed Central

Brevers, Damien; Bechara, Antoine; Cleeremans, Axel; Noël, Xavier

2013-01-01

The Iowa Gambling Task (IGT) involves probabilistic learning via monetary rewards and punishments, where advantageous task performance requires subjects to forego potential large immediate rewards for small longer-term rewards to avoid larger losses. Pathological gamblers (PG) perform worse on the IGT compared to controls, relating to their persistent preference toward high, immediate, and uncertain rewards despite experiencing larger losses. In this contribution, we review studies that investigated processes associated with poor IGT performance in PG. Findings from these studies seem to fit with recent neurocognitive models of addiction, which argue that the diminished ability of addicted individuals to ponder short-term against long-term consequences of a choice may be the product of an hyperactive automatic attentional and memory system for signaling the presence of addiction-related cues (e.g., high uncertain rewards associated with disadvantageous decks selection during the IGT) and for attributing to such cues pleasure and excitement. This incentive-salience associated with gambling-related choice in PG may be so high that it could literally “hijack” resources [“hot” executive functions (EFs)] involved in emotional self-regulation and necessary to allow the enactment of further elaborate decontextualized problem-solving abilities (“cool” EFs). A framework for future research is also proposed, which highlights the need for studies examining how these processes contribute specifically to the aberrant choice profile displayed by PG on the IGT. PMID:24137138

Neural markers of social and monetary rewards in children with Attention-Deficit/Hyperactivity Disorder and Autism Spectrum Disorder

PubMed Central

Gonzalez-Gadea, Maria Luz; Sigman, Mariano; Rattazzi, Alexia; Lavin, Claudio; Rivera-Rei, Alvaro; Marino, Julian; Manes, Facundo; Ibanez, Agustin

2016-01-01

Recent theories of decision making propose a shared value-related brain mechanism for encoding monetary and social rewards. We tested this model in children with Attention-Deficit/Hyperactivity Disorder (ADHD), children with Autism Spectrum Disorder (ASD) and control children. We monitored participants’ brain dynamics using high density-electroencephalography while they played a monetary and social reward tasks. Control children exhibited a feedback Error-Related Negativity (fERN) modulation and Anterior Cingulate Cortex (ACC) source activation during both tasks. Remarkably, although cooperation resulted in greater losses for the participants, the betrayal options generated greater fERN responses. ADHD subjects exhibited an absence of fERN modulation and reduced ACC activation during both tasks. ASD subjects exhibited normal fERN modulation during monetary choices and inverted fERN/ACC responses in social options than did controls. These results suggest that in neurotypicals, monetary losses and observed disloyal social decisions induced similar activity in the brain value system. In ADHD children, difficulties in reward processing affected early brain signatures of monetary and social decisions. Conversely, ASD children showed intact neural markers of value-related monetary mechanisms, but no brain modulation by prosociality in the social task. These results offer insight into the typical and atypical developments of neural correlates of monetary and social reward processing. PMID:27464551

Reward for food odors: an fMRI study of liking and wanting as a function of metabolic state and BMI.

PubMed

Jiang, Tao; Soussignan, Robert; Schaal, Benoist; Royet, Jean-Pierre

2015-04-01

Brain reward systems mediate liking and wanting for food reward. Here, we explore the differential involvement of the following structures for these two components: the ventral and dorsal striatopallidal area, orbitofrontal cortex (OFC), anterior insula and anterior cingulate. Twelve healthy female participants were asked to rate pleasantness (liking of food and non-food odors) and the desire to eat (wanting of odor-evoked food) during event-related functional magnetic resonance imaging (fMRI). The subjective ratings and fMRI were performed in hunger and satiety states. Activations of regions of interest were compared as a function of task (liking vs wanting), odor category (food vs non-food) and metabolic state (hunger vs satiety). We found that the nucleus accumbens and ventral pallidum were differentially involved in liking or wanting during the hunger state, which suggests a reciprocal inhibitory influence between these structures. Neural activation of OFC subregions was correlated with either liking or wanting ratings, suggesting an OFC role in reward processing magnitude. Finally, during the hunger state, participants with a high body mass index exhibited less activation in neural structures underlying food reward processing. Our results suggest that food liking and wanting are two separable psychological constructs and may be functionally segregated within the cortico-striatopallidal circuit. © The Author (2014). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

The scarcity heuristic impacts reward processing within the medial-frontal cortex.

PubMed

Williams, Chad C; Saffer, Boaz Y; McCulloch, Robert B; Krigolson, Olave E

2016-05-04

Objects that are rare are often perceived to be inherently more valuable than objects that are abundant - a bias brought about in part by the scarcity heuristic. In the present study, we sought to test whether perception of rarity impacted reward evaluation within the human medial-frontal cortex. Here, participants played a gambling game in which they flipped rare and abundant 'cards' on a computer screen to win financial rewards while electroencephalographic data were recorded. Unbeknownst to participants, reward outcome and frequency was random and equivalent for both rare and abundant cards; thus, only a perception of scarcity was true. Analysis of the electroencephalographic data indicated that the P300 component of the event-related brain potential differed in amplitude for wins and losses following the selection of rare cards, but not following the selection of abundant cards. Importantly, then, we found that the perception of card rarity impacted reward processing even though reward feedback was independent of and subsequent to card selection. Our data indicate a top-down influence of the scarcity heuristic on reward evaluation, and specifically the processing of reward magnitude, within the human medial-frontal cortex.

Candy and the Brain: Neural Response to Candy Gains and Losses

PubMed Central

Luking, Katherine R; Barch, Deanna M

2013-01-01

Incentive processing is a critical component of a host of cognitive processes including attention, motivation, and learning. Neuroimaging studies have clarified the neural systems underlying processing of primary and secondary rewards in adults. However, current reward paradigms have hindered comparison across these reward types as well as between age groups. To address methodological issues regarding timing of incentive delivery (during versus post-scan) and the age-appropriateness of the incentive type we utilized fMRI and a modified version of a card guessing game (CGG), where candy pieces delivered post-scan served as the reinforcer, to investigate neural responses to incentives. Healthy young adults aged 22–26 years won and lost large and small amounts of candy based on their ability to guess the number on a mystery card. BOLD activity was compared following candy gain (large/small), loss (large/small) and neutral feedback. During candy gains, adults recruited regions typically involved in response to monetary and other rewards such as the caudate, putamen, and orbitofrontal cortex. During losses, adults displayed greater deactivation in the hippocampus compared to neutral and gain feedback. Additionally, individual difference analyses suggested a negative relationship between reward sensitivity (assessed by behavioral inhibition/behavioral activation scales) and the difference between high and low magnitude losses in the caudate and lateral orbitofrontal cortex. Also within the striatum greater punishment sensitivity was positively related to the difference in activity following high compared to low gains. Overall these results show strong overlap with those from previous monetary versions of the CGG and provide a baseline for future work with developmental populations. PMID:23519971

Three real-time architectures - A study using reward models

NASA Technical Reports Server (NTRS)

Sjogren, J. A.; Smith, R. M.

1990-01-01

Numerous applications in the area of computer system analysis can be effectively studied with Markov reward models. These models describe the evolutionary behavior of the computer system by a continuous-time Markov chain, and a reward rate is associated with each state. In reliability/availability models, upstates have reward rate 1, and down states have reward rate zero associated with them. In a combined model of performance and reliability, the reward rate of a state may be the computational capacity, or a related performance measure. Steady-state expected reward rate and expected instantaneous reward rate are clearly useful measures which can be extracted from the Markov reward model. The diversity of areas where Markov reward models may be used is illustrated with a comparative study of three examples of interest to the fault tolerant computing community.

Rewards modulate saccade latency but not exogenous spatial attention.

PubMed

Dunne, Stephen; Ellison, Amanda; Smith, Daniel T

2015-01-01

The eye movement system is sensitive to reward. However, whilst the eye movement system is extremely flexible, the extent to which changes to oculomotor behavior induced by reward paradigms persist beyond the training period or transfer to other oculomotor tasks is unclear. To address these issues we examined the effects of presenting feedback that represented small monetary rewards to spatial locations on the latency of saccadic eye movements, the time-course of learning and extinction of the effects of rewarding saccades on exogenous spatial attention and oculomotor inhibition of return. Reward feedback produced a relative facilitation of saccadic latency in a stimulus driven saccade task which persisted for three blocks of extinction trials. However, this hemifield-specific effect failed to transfer to peripheral cueing tasks. We conclude that rewarding specific spatial locations is unlikely to induce long-term, systemic changes to the human oculomotor or attention systems.

Reward and loss anticipation in panic disorder: An fMRI study.

PubMed

Held-Poschardt, Dada; Sterzer, Philipp; Schlagenhauf, Florian; Pehrs, Corinna; Wittmann, Andre; Stoy, Meline; Hägele, Claudia; Knutson, Brian; Heinz, Andreas; Ströhle, Andreas

2018-01-30

Anticipatory anxiety and harm avoidance are essential features of panic disorder (PD) and may involve deficits in the reward system of the brain, in particular in the ventral striatum. While neuroimaging studies on PD have focused on fearful and negative affective stimulus processing, no investigations have directly addressed deficits in reward and loss anticipation. To determine whether the ventral striatum shows abnormal neural activity in PD patients during anticipation of loss or gain, an event-related functional magnetic resonance imaging experiment using a monetary incentive delay task was employed in 10 patients with PD and 10 healthy controls. A repeated-measures ANOVA to identify effects of group (PD vs. Control) and condition (anticipation of loss vs. gain vs. neutral outcome) revealed that patients with PD showed significantly reduced bilateral ventral striatal activation during reward anticipation but increased activity during loss anticipation. Within the patient group, the degree of activation in the ventral striatum during loss-anticipation was positively correlated with harm avoidance and negatively correlated with novelty seeking. These findings suggest that behavioural impairments in panic disorder may be related to abnormal neural processing of motivational cues. Copyright © 2017 Elsevier B.V. All rights reserved.

The role of orgasm in the development and shaping of partner preferences

PubMed Central

Coria-Avila, Genaro A.; Herrera-Covarrubias, Deissy; Ismail, Nafissa; Pfaus, James G.

2016-01-01

Background The effect of orgasm on the development and shaping of partner preferences may involve a catalysis of the neurochemical mechanisms of bonding. Therefore, understanding such process is relevant for neuroscience and psychology. Methods A systematic review was carried out using the terms Orgasm, Sexual Reward, Partner Preference, Pair Bonding, Brain, Learning, Sex, Copulation. Results In humans, concentrations of arousing neurotransmitters and potential bonding neurotransmitters increase during orgasm in the cerebrospinal fluid and the bloodstream. Similarly, studies in animals indicate that those neurotransmitters (noradrenaline, oxytocin, prolactin) and others (e.g. dopamine, opioids, serotonin) modulate the appetitive and consummatory phases of sexual behavior and reward. This suggests a link between the experience of orgasm/sexual reward and the neurochemical mechanisms of pair bonding. Orgasm/reward functions as an unconditioned stimulus (UCS). Some areas in the nervous system function as UCS-detection centers, which become activated during orgasm. Partner-related cues function as conditioned stimuli (CS) and are processed in CS-detector centers. Conclusions Throughout the article, we discuss how UCS- and CS-detection centers must interact to facilitate memory consolidation and produce recognition and motivation during future social encounters. PMID:27799080

Probing reward function in posttraumatic stress disorder: expectancy and satisfaction with monetary gains and losses.

PubMed

Hopper, James W; Pitman, Roger K; Su, Zhaohui; Heyman, Gene M; Lasko, Natasha B; Macklin, Michael L; Orr, Scott P; Lukas, Scott E; Elman, Igor

2008-08-01

Posttraumatic stress disorder (PTSD) may be associated with dysfunctional reward processing. The present study assessed for such dysfunction in both the expectancy and outcome phases of reward processing. Male Vietnam veterans with (n=15) and without (n=11) combat-related PTSD were administered a wheel of fortune-type gambling task. Self-reported ratings of expectancy and satisfaction were collected respectively before and after each experience of monetary gain or loss. PTSD participants reported both lower expectancy of reward and lower satisfaction with reward when it was received. The latter result was manifest in a failure of PTSD participants to show the greater satisfaction that normally accompanies rewards received under conditions of low expectancy. These results suggest reward function impairment in PTSD related to expectancy, satisfaction, and the expectancy-satisfaction relationship.

Mechanisms Underlying Motivational Deficits in Psychopathology: Similarities and Differences in Depression and Schizophrenia.

PubMed

Barch, Deanna M; Pagliaccio, David; Luking, Katherine

2016-01-01

Motivational and hedonic impairments are core aspects of a variety of types of psychopathology. These impairments cut across diagnostic categories and may be critical to understanding major aspects of the functional impairments accompanying psychopathology. Given the centrality of motivational and hedonic systems to psychopathology, the Research Domain Criteria (RDoC) initiative includes a "positive valence" systems domain that outlines a number of constructs that may be key to understanding the nature and mechanisms of motivational and hedonic impairments in psychopathology. These component constructs include initial responsiveness to reward, reward anticipation or expectancy, incentive or reinforcement learning, effort valuation, and action selection. Here, we review behavioral and neuroimaging studies providing evidence for impairments in these constructs in individuals with psychosis versus in individuals with depressive pathology. There are important differences in the nature of reward-related and hedonic deficits associated with psychosis versus depression that have major implications for our understanding of etiology and treatment development. In particular, the literature strongly suggests the presence of impairments in in-the-moment hedonics or "liking" in individuals with depressive pathology, particularly among those who experience anhedonia. Such deficits may propagate forward and contribute to impairments in other constructs that are dependent on hedonic responses, such as anticipation, learning, effort, and action selection. Such hedonic impairments could reflect alterations in dopamine and/or opioid signaling in the striatum related to depression or specifically to anhedonia in depressed populations. In contrast, the literature points to relatively intact in-the-moment hedonic processing in psychosis, but provides much evidence for impairments in other components involved in translating reward to action selection. Particularly, individuals with schizophrenia exhibit altered reward prediction and associated striatal and prefrontal activation, impaired reward learning, and impaired reward-modulated action selection.

Effects of anabolic-androgens on brain reward function

PubMed Central

Mhillaj, Emanuela; Morgese, Maria G.; Tucci, Paolo; Bove, Maria; Schiavone, Stefania; Trabace, Luigia

2015-01-01

Androgens are mainly prescribed to treat several diseases caused by testosterone deficiency. However, athletes try to promote muscle growth by manipulating testosterone levels or assuming androgen anabolic steroids (AAS). These substances were originally synthesized to obtain anabolic effects greater than testosterone. Although AAS are rarely prescribed compared to testosterone, their off-label utilization is very wide. Furthermore, combinations of different steroids and doses generally higher than those used in therapy are common. Symptoms of the chronic use of supra-therapeutic doses of AAS include anxiety, depression, aggression, paranoia, distractibility, confusion, amnesia. Interestingly, some studies have shown that AAS elicited electroencephalographic changes similar to those observed with amphetamine abuse. The frequency of side effects is higher among AAS abusers, with psychiatric complications such as labile mood, lack of impulse control and high violence. On the other hand, AAS addiction studies are complex because data collection is very difficult due to the subjects' reticence and can be biased by many variables, including physical exercise, that alter the reward system. Moreover, it has been reported that AAS may imbalance neurotransmitter systems involved in the reward process, leading to increased sensitivity toward opioid narcotics and central stimulants. The goal of this article is to review the literature on steroid abuse and changes to the reward system in preclinical and clinical studies. PMID:26379484

Effects of anabolic-androgens on brain reward function.

PubMed

Mhillaj, Emanuela; Morgese, Maria G; Tucci, Paolo; Bove, Maria; Schiavone, Stefania; Trabace, Luigia

2015-01-01

Androgens are mainly prescribed to treat several diseases caused by testosterone deficiency. However, athletes try to promote muscle growth by manipulating testosterone levels or assuming androgen anabolic steroids (AAS). These substances were originally synthesized to obtain anabolic effects greater than testosterone. Although AAS are rarely prescribed compared to testosterone, their off-label utilization is very wide. Furthermore, combinations of different steroids and doses generally higher than those used in therapy are common. Symptoms of the chronic use of supra-therapeutic doses of AAS include anxiety, depression, aggression, paranoia, distractibility, confusion, amnesia. Interestingly, some studies have shown that AAS elicited electroencephalographic changes similar to those observed with amphetamine abuse. The frequency of side effects is higher among AAS abusers, with psychiatric complications such as labile mood, lack of impulse control and high violence. On the other hand, AAS addiction studies are complex because data collection is very difficult due to the subjects' reticence and can be biased by many variables, including physical exercise, that alter the reward system. Moreover, it has been reported that AAS may imbalance neurotransmitter systems involved in the reward process, leading to increased sensitivity toward opioid narcotics and central stimulants. The goal of this article is to review the literature on steroid abuse and changes to the reward system in preclinical and clinical studies.

Increased neural responses to reward in adolescents and young adults with attention-deficit/hyperactivity disorder and their unaffected siblings.

PubMed

von Rhein, Daniel; Cools, Roshan; Zwiers, Marcel P; van der Schaaf, Marieke; Franke, Barbara; Luman, Marjolein; Oosterlaan, Jaap; Heslenfeld, Dirk J; Hoekstra, Pieter J; Hartman, Catharina A; Faraone, Stephen V; van Rooij, Daan; van Dongen, Eelco V; Lojowska, Maria; Mennes, Maarten; Buitelaar, Jan

2015-05-01

Attention-deficit/hyperactivity disorder (ADHD) is a heritable neuropsychiatric disorder associated with abnormal reward processing. Limited and inconsistent data exist about the neural mechanisms underlying this abnormality. Furthermore, it is not known whether reward processing is abnormal in unaffected siblings of participants with ADHD. We used event-related functional magnetic resonance imaging (fMRI) to investigate brain responses during reward anticipation and receipt with an adapted monetary incentive delay task in a large sample of adolescents and young adults with ADHD (n = 150), their unaffected siblings (n = 92), and control participants (n = 108), all of the same age. Participants with ADHD showed, relative to control participants, increased responses in the anterior cingulate, anterior frontal cortex, and cerebellum during reward anticipation, and in the orbitofrontal, occipital cortex and ventral striatum. Responses of unaffected siblings were increased in these regions as well, except for the cerebellum during anticipation and ventral striatum during receipt. ADHD in adolescents and young adults is associated with enhanced neural responses in frontostriatal circuitry to anticipation and receipt of reward. The findings support models emphasizing aberrant reward processing in ADHD, and suggest that processing of reward is subject to familial influences. Future studies using standard monetary incentive delay task parameters are needed to replicate our findings. Copyright © 2015 American Academy of Child and Adolescent Psychiatry. Published by Elsevier Inc. All rights reserved.

Age differences in the impact of peers on adolescents' and adults' neural response to reward.

PubMed

Smith, Ashley R; Steinberg, Laurence; Strang, Nicole; Chein, Jason

2015-02-01

Prior research suggests that increased adolescent risk-taking in the presence of peers may be linked to the influence of peers on the valuation and processing of rewards during decision-making. The current study explores this idea by examining how peer observation impacts the processing of rewards when such processing is isolated from other facets of risky decision-making (e.g. risk-perception and preference, inhibitory processing, etc.). In an fMRI paradigm, a sample of adolescents (ages 14-19) and adults (ages 25-35) completed a modified High/Low Card Guessing Task that included rewarded and un-rewarded trials. Social context was manipulated by having participants complete the task both alone and while being observed by two, same-age, same-sex peers. Results indicated an interaction of age and social context on the activation of reward circuitry during the receipt of reward; when observed by peers adolescents exhibited greater ventral striatal activation than adults, but no age-related differences were evinced when the task was completed alone. These findings suggest that, during adolescence, peers influence recruitment of reward-related regions even when they are engaged outside of the context of risk-taking. Implications for engagement in prosocial, as well as risky, behaviors during adolescence are discussed. Copyright © 2014 The Authors. Published by Elsevier Ltd.. All rights reserved.

Temporal Dynamics of Motivation-Cognitive Control Interactions Revealed by High-Resolution Pupillometry

PubMed Central

Chiew, Kimberly S.; Braver, Todd S.

2013-01-01

Motivational manipulations, such as the presence of performance-contingent reward incentives, can have substantial influences on cognitive control. Previous evidence suggests that reward incentives may enhance cognitive performance specifically through increased preparatory, or proactive, control processes. The present study examined reward influences on cognitive control dynamics in the AX-Continuous Performance Task (AX-CPT), using high-resolution pupillometry. In the AX-CPT, contextual cues must be actively maintained over a delay in order to appropriately respond to ambiguous target probes. A key feature of the task is that it permits dissociable characterization of preparatory, proactive control processes (i.e., utilization of context) and reactive control processes (i.e., target-evoked interference resolution). Task performance profiles suggested that reward incentives enhanced proactive control (context utilization). Critically, pupil dilation was also increased on reward incentive trials during context maintenance periods, suggesting trial-specific shifts in proactive control, particularly when context cues indicated the need to overcome the dominant target response bias. Reward incentives had both transient (i.e., trial-by-trial) and sustained (i.e., block-based) effects on pupil dilation, which may reflect distinct underlying processes. The transient pupillary effects were present even when comparing against trials matched in task performance, suggesting a unique motivational influence of reward incentives. These results suggest that pupillometry may be a useful technique for investigating reward motivational signals and their dynamic influence on cognitive control. PMID:23372557

Adaptive Reward Pursuit: How Effort Requirements Affect Unconscious Reward Responses and Conscious Reward Decisions

ERIC Educational Resources Information Center

Bijleveld, Erik; Custers, Ruud; Aarts, Henk

2012-01-01

When in pursuit of rewards, humans weigh the value of potential rewards against the amount of effort that is required to attain them. Although previous research has generally conceptualized this process as a deliberate calculation, recent work suggests that rudimentary mechanisms--operating without conscious intervention--play an important role as…

Orbitofrontal and hippocampal contributions to memory for face-name associations: the rewarding power of a smile.

PubMed

Tsukiura, Takashi; Cabeza, Roberto

2008-01-01

Memory processes can be enhanced by reward, and social signals such a smiling face can be rewarding to humans. Using event-related functional MRI (fMRI), we investigated the rewarding effect of a simple smile during the encoding and retrieval of face-name associations. During encoding, participants viewed smiling or neutral faces, each paired with a name, and during retrieval, only names were presented, and participants retrieved the associated facial expressions. Successful memory activity of face-name associations was identified by comparing remembered vs. forgotten trials during both encoding and retrieval, and the effect of a smile was identified by comparing successful memory trials for smiling vs. neutral faces. The study yielded three main findings. First, behavioral results showed that the retrieval of face-name associations was more accurate and faster for smiling than neutral faces. Second, the orbitofrontal cortex and the hippocampus showed successful encoding and retrieval activations, which were greater for smiling than neutral faces. Third, functional connectivity between the orbitofrontal cortex and the hippocampus during successful encoding and retrieval was stronger for smiling than neutral faces. As a part of the reward system, the orbitofrontal cortex may modulate memory processes of face-name associations mediated by the hippocampus. Interestingly, the effect of a smile during retrieval was found even though only names were presented as retrieval cues, suggesting that the effect was mediated by face imagery. Taken together, the results demonstrate how rewarding social signals from a smiling face can enhance relational memory for face-name associations.

Linking Online Gaming and Addictive Behavior: Converging Evidence for a General Reward Deficiency in Frequent Online Gamers

PubMed Central

Hahn, Tim; Notebaert, Karolien Hilde; Dresler, Thomas; Kowarsch, Linda; Reif, Andreas; Fallgatter, Andreas J.

2014-01-01

Millions of people regularly play so-called massively multiplayer online role playing games (MMORPGs). Recently, it has been argued that MMORPG overuse is becoming a significant health problem worldwide. Symptoms such as tolerance, withdrawal, and craving have been described. Based on behavioral, resting state, and task-related neuroimaging data, we test whether frequent players of the MMORPG “World of Warcraft” (WoW) – similar to drug addicts and individuals with an increased risk for addictions – show a generally deficient reward system. In frequent players of the MMORPG “World of Warcraft” (WoW-players) and in a control group of non-gamers we assessed (1) trait sensitivity to reward (SR), (2) BOLD responses during monetary reward processing in the ventral striatum, and (3) ventral-striatal resting-state dynamics. We found a decreased neural activation in the ventral striatum during the anticipation of both small and large monetary rewards. Additionally, we show generally altered neurodynamics in this region independent of any specific task for WoW players (resting state). On the behavioral level, we found differences in trait SR, suggesting that the reward processing deficiencies found in this study are not a consequence of gaming, but predisposed to it. These findings empirically support a direct link between frequent online gaming and the broad field of behavioral and drug addiction research, thus opening new avenues for clinical interventions in addicted gamers and potentially improving the assessment of addiction-risk in the vast population of frequent gamers. PMID:25426039

Attention to nurses' rewarding - an interview study of registered nurses working in primary and private healthcare in Finland.

PubMed

Seitovirta, Jaana; Vehviläinen-Julkunen, Katri; Mitronen, Lasse; De Gieter, Sara; Kvist, Tarja

2017-04-01

To identify meaningful types of rewards and the consequences of rewards as expressed by Finnish registered nurses working in primary and private healthcare. Previous studies have found significant associations between nurses' rewards and both their commitment and job satisfaction. Furthermore, appropriate rewards can have beneficial effects on factors including workforce stability and occupational satisfaction that are highly important in times of nurse shortages. A cross-sectional, qualitative interview study. Data were collected via individual semi-structured interviews (n = 20) with registered nurses working in Finland's primary and private healthcare, and subjected to qualitative content analysis. Six meaningful types of rewards were identified by the registered nurses: Financial compensation and benefits, Work-Life balance, Work content, Professional development, Recognition, and Supportive leadership. Rewards encouraged respondents to perform their work correctly and reinforced occupational satisfaction, but also caused feelings of envy and stress. It is essential to pay attention to nurses' preferences for particular rewards and to reward management. When designing effective reward systems for registered nurses, it is not sufficient to provide financial rewards alone, as various kinds of non-financial rewards are both meaningful and necessary. When trying to improve registered nurses' commitment and job satisfaction through reward management, it is important to listen to nurses' opinions to create a reward system that integrates financial and non-financial rewards and is fair from their perspective. Healthcare organisations that offer registered nurses a holistic reward system are more likely to retain satisfied and committed nurses at a time of increasing nursing shortages. © 2016 John Wiley & Sons Ltd.

The Neurobiology of Anhedonia and Other Reward-Related Deficits

PubMed Central

Der-Avakian, Andre; Markou, Athina

2011-01-01

Anhedonia, or markedly diminished interest or pleasure, is a hallmark symptom of major depression, schizophrenia, and other neuropsychiatric disorders. Over the past three decades, the clinical definition of anhedonia has remained relatively unchanged, although cognitive psychology and behavioral neuroscience have expanded our understanding of other reward-related processes. Here, we review the neural bases of the construct of anhedonia that reflects deficits in hedonic capacity, and is also closely linked to the constructs of reward valuation, decision-making, anticipation, and motivation. The neural circuits subserving these reward-related processes include the ventral striatum, prefrontal cortical regions, and afferent and efferent projections. Understanding anhedonia and other reward-related constructs will facilitate diagnosis and treatment of disorders that include reward deficits as key symptoms. PMID:22177980

Developmental continuity in reward-related enhancement of cognitive control.

PubMed

Strang, Nicole M; Pollak, Seth D

2014-10-01

Adolescents engage in more risky behavior than children or adults. The most prominent hypothesis for this phenomenon is that brain systems governing reward sensitivity and brain systems governing self-regulation mature at different rates. Those systems governing reward sensitivity mature in advance of those governing self-control. This hypothesis has substantial empirical support, however, the evidence supporting this theory has been exclusively derived from contexts where self-control systems are required to regulate reward sensitivity in order to promote adaptive behavior. In adults, reward promotes a shift to a proactive control strategy and better cognitive control performance. It is unclear whether children and adolescents will respond to reward in the same way. Using fMRI methodology, we explored whether children and adolescents would demonstrate a shift to proactive control in the context of reward. We tested 22 children, 20 adolescents, and 23 adults. In contrast to our hypothesis, children, adolescents, and adults all demonstrated a shift to proactive cognitive control in the context of reward. In light of the results, current neurobiological theories of adolescent behavior need to be refined to reflect that in certain contexts there is continuity in the manner reward and cognitive control systems interact across development. Copyright © 2014 The Authors. Published by Elsevier Ltd.. All rights reserved.

Brain reward circuitry beyond the mesolimbic dopamine system: a neurobiological theory.

PubMed

Ikemoto, Satoshi

2010-11-01

Reductionist attempts to dissect complex mechanisms into simpler elements are necessary, but not sufficient for understanding how biological properties like reward emerge out of neuronal activity. Recent studies on intracranial self-administration of neurochemicals (drugs) found that rats learn to self-administer various drugs into the mesolimbic dopamine structures-the posterior ventral tegmental area, medial shell nucleus accumbens and medial olfactory tubercle. In addition, studies found roles of non-dopaminergic mechanisms of the supramammillary, rostromedial tegmental and midbrain raphe nuclei in reward. To explain intracranial self-administration and related effects of various drug manipulations, I outlined a neurobiological theory claiming that there is an intrinsic central process that coordinates various selective functions (including perceptual, visceral, and reinforcement processes) into a global function of approach. Further, this coordinating process for approach arises from interactions between brain structures including those structures mentioned above and their closely linked regions: the medial prefrontal cortex, septal area, ventral pallidum, bed nucleus of stria terminalis, preoptic area, lateral hypothalamic areas, lateral habenula, periaqueductal gray, laterodorsal tegmental nucleus and parabrachical area. Published by Elsevier Ltd.

Cigarette craving is associated with blunted reward processing in nicotine-dependent smokers.

PubMed

Peechatka, Alyssa L; Whitton, Alexis E; Farmer, Stacey L; Pizzagalli, Diego A; Janes, Amy C

2015-10-01

Dysfunctional reward processing leading to the undervaluation of non-drug rewards is hypothesized to play a crucial role in nicotine dependence. However, it is unclear if blunted reward responsivity and the desire to use nicotine are directly linked after a brief period of abstinence. Such an association would suggest that individuals with reduced reward responsivity may be at increased risk to experience nicotine craving. Reward function was evaluated with a probabilistic reward task (PRT), which measures reward responsivity to monetary incentives. To identify whether smoking status influenced reward function, PRT performance was compared between non-depressed, nicotine-dependent smokers and non-smokers. Within smokers, correlations were conducted to determine if blunted reward responsivity on the PRT was associated with increased nicotine craving. Time since last nicotine exposure was standardized to 4h for all smokers. Smokers and non-smokers did not differ in reward responsivity on the PRT. However, within smokers, a significant negative correlation was found between reward responsivity and intensity of nicotine craving. The current findings show that, among smokers, the intensity of nicotine craving is linked to lower sensitivity to non-drug rewards. This finding is in line with prior theories that suggest reward dysfunction in some clinical populations (e.g., depressive disorders, schizophrenia) may facilitate nicotine use. The current study expands on such theories by indicating that sub-clinical variations in reward function are related to motivation for nicotine use. Identifying smokers who show blunted sensitivity to non-drug rewards may help guide treatments aimed at mitigating the motivation to smoke. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Waiting to win: elevated striatal and orbitofrontal cortical activity during reward anticipation in euthymic bipolar disorder adults

PubMed Central

Nusslock, Robin; Almeida, Jorge RC; Forbes, Erika E; Versace, Amelia; Frank, Ellen; LaBarbara, Edmund J; Klein, Crystal R; Phillips, Mary L

2012-01-01

Objective Bipolar disorder may be characterized by a hypersensitivity to reward-relevant stimuli, potentially underlying the emotional lability and dysregulation that characterizes the illness. In parallel, research highlights the predominant role of striatal and orbitofrontal cortical (OFC) regions in reward-processing and approach-related affect. We aimed to examine whether bipolar disorder, relative to healthy, participants displayed elevated activity in these regions during reward processing. Methods Twenty-one euthymic bipolar I disorder and 20 healthy control participants with no lifetime history of psychiatric disorder underwent functional magnetic resonance imaging (fMRI) scanning during a card-guessing paradigm designed to examine reward-related brain function to anticipation and receipt of monetary reward and loss. Data were collected using a 3T Siemens Trio scanner. Results Region-of-interest analyses revealed that bipolar disorder participants displayed greater ventral striatal and right-sided orbitofrontal [Brodmann area (BA) 11] activity during anticipation, but not outcome, of monetary reward, relative to healthy controls (p < 0.05, corrected). Wholebrain analyses indicated that bipolar disorder, relative to healthy, participants also displayed elevated left-lateral OFC activity (BA 47) activity during reward anticipation (p < 0.05, corrected). Conclusions Elevated ventral striatal and OFC activity during reward anticipation may represent a neural mechanism for predisposition to expansive mood and hypo/mania in response to reward-relevant cues that characterizes bipolar disorder. Our findings contrast with research reporting blunted activity in the ventral striatum during reward processing in unipolar depressed individuals, relative to healthy controls. Examination of reward-related neural activity in bipolar disorder is a promising research focus to facilitate identification of biological markers of the illness. PMID:22548898

Impact of Early Life Adversity on Reward Processing in Young Adults: EEG-fMRI Results from a Prospective Study over 25 Years

PubMed Central

Boecker, Regina; Holz, Nathalie E.; Buchmann, Arlette F.; Blomeyer, Dorothea; Plichta, Michael M.; Wolf, Isabella; Baumeister, Sarah; Meyer-Lindenberg, Andreas; Banaschewski, Tobias

2014-01-01

Several lines of evidence have implicated the mesolimbic dopamine reward pathway in altered brain function resulting from exposure to early adversity. The present study examined the impact of early life adversity on different stages of neuronal reward processing later in life and their association with a related behavioral phenotype, i.e. attention deficit/hyperactivity disorder (ADHD). 162 healthy young adults (mean age = 24.4 years; 58% female) from an epidemiological cohort study followed since birth participated in a simultaneous EEG-fMRI study using a monetary incentive delay task. Early life adversity according to an early family adversity index (EFA) and lifetime ADHD symptoms were assessed using standardized parent interviews conducted at the offspring's age of 3 months and between 2 and 15 years, respectively. fMRI region-of-interest analysis revealed a significant effect of EFA during reward anticipation in reward-related areas (i.e. ventral striatum, putamen, thalamus), indicating decreased activation when EFA increased. EEG analysis demonstrated a similar effect for the contingent negative variation (CNV), with the CNV decreasing with the level of EFA. In contrast, during reward delivery, activation of the bilateral insula, right pallidum and bilateral putamen increased with EFA. There was a significant association of lifetime ADHD symptoms with lower activation in the left ventral striatum during reward anticipation and higher activation in the right insula during reward delivery. The present findings indicate a differential long-term impact of early life adversity on reward processing, implicating hyporesponsiveness during reward anticipation and hyperresponsiveness when receiving a reward. Moreover, a similar activation pattern related to lifetime ADHD suggests that the impact of early life stress on ADHD may possibly be mediated by a dysfunctional reward pathway. PMID:25118701

Neural mechanisms of risky decision-making and reward response in adolescent onset cannabis use disorder.

PubMed

De Bellis, Michael D; Wang, Lihong; Bergman, Sara R; Yaxley, Richard H; Hooper, Stephen R; Huettel, Scott A

2013-11-01

Neural mechanisms of decision-making and reward response in adolescent cannabis use disorder (CUD) are underexplored. Three groups of male adolescents were studied: CUD in full remission (n=15); controls with psychopathology without substance use disorder history (n=23); and healthy controls (n=18). We investigated neural processing of decision-making and reward under conditions of varying risk and uncertainty with the Decision-Reward Uncertainty Task while participants were scanned using functional magnetic resonance imaging. Abstinent adolescents with CUD compared to controls with psychopathology showed hyperactivation in one cluster that spanned left superior parietal lobule/left lateral occipital cortex/precuneus while making risky decisions that involved uncertainty, and hypoactivation in left orbitofrontal cortex to rewarded outcomes compared to no-reward after making risky decisions. Post hoc region of interest analyses revealed that both control groups significantly differed from the CUD group (but not from each other) during both the decision-making and reward outcome phase of the Decision-Reward Uncertainty Task. In the CUD group, orbitofrontal activations to reward significantly and negatively correlated with total number of individual drug classes the CUD patients experimented with prior to treatment. CUD duration significantly and negatively correlated with orbitofrontal activations to no-reward. The adolescent CUD group demonstrated distinctly different activation patterns during risky decision-making and reward processing (after risky decision-making) compared to both the controls with psychopathology and healthy control groups. These findings suggest that neural differences in risky decision-making and reward processes are present in adolescent addiction, persist after remission from first CUD treatment, and may contribute to vulnerability for adolescent addiction. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.

Dopamine D2/3- and μ-opioid receptor antagonists reduce cue-induced responding and reward impulsivity in humans.

PubMed

Weber, S C; Beck-Schimmer, B; Kajdi, M-E; Müller, D; Tobler, P N; Quednow, B B

2016-07-05

Increased responding to drug-associated stimuli (cue reactivity) and an inability to tolerate delayed gratification (reward impulsivity) have been implicated in the development and maintenance of drug addiction. Whereas data from animal studies suggest that both the dopamine and opioid system are involved in these two reward-related processes, their role in humans is less clear. Moreover, dopaminergic and opioidergic drugs have not been directly compared with regard to these functions, even though a deeper understanding of the underlying mechanisms might inform the development of specific treatments for elevated cue reactivity and reward impulsivity. In a randomized, double-blind, between-subject design we administered the selective dopamine D2/D3 receptor antagonist amisulpride (400 mg, n=41), the unspecific opioid receptor antagonist naltrexone (50 mg, n=40) or placebo (n=40) to healthy humans and measured cue-induced responding with a Pavlovian-instrumental transfer task and reward impulsivity with a delay discounting task. Mood was assessed using a visual analogue scale. Compared with placebo, amisulpride significantly suppressed cue-induced responding and reward impulsivity. The effects of naltrexone were similar, although less pronounced. Both amisulpride and naltrexone decreased average mood ratings compared with placebo. Our results demonstrate that a selective blockade of dopamine D2/D3 receptors reduces cue-induced responding and reward impulsivity in healthy humans. Antagonizing μ-opioid receptors has similar effects for cue-induced responding and to a lesser extent for reward impulsivity.

The Influence of Reward Associations on Conflict Processing in the Stroop Task

ERIC Educational Resources Information Center

Krebs, Ruth M.; Boehler, Carsten N.; Woldorff, Marty G.

2010-01-01

Performance in a behavioral task can be facilitated by associating stimulus properties with reward. In contrast, conflicting information is known to impede task performance. Here we investigated how reward associations influence the within-trial processing of conflicting information using a color-naming Stroop task in which a subset of ink colors…

State-dependent μ-opioid modulation of social motivation

PubMed Central

Loseth, Guro E.; Ellingsen, Dan-Mikael; Leknes, Siri

2014-01-01

Social mammals engage in affiliative interactions both when seeking relief from negative affect and when searching for pleasure and joy. These two motivational states are both modulated by μ-opioid transmission. The μ-opioid receptor (MOR) system in the brain mediates pain relief and reward behaviors, and is implicated in social reward processing and affiliative bonding across mammalian species. However, pharmacological manipulation of the μ-opioid system has yielded opposite effects on rodents and primates: in rodents, social motivation is generally increased by MOR agonists and reduced by antagonists, whereas the opposite pattern has been shown in primates. Here, we address this paradox by taking into account differences in motivational state. We first review evidence for μ-opioid mediation of reward processing, emotion regulation, and affiliation in humans, non-human primates, rodents and other species. Based on the consistent cross-species similarities in opioid functioning, we propose a unified, state-dependent model for μ-opioid modulation of affiliation across the mammalian species. Finally, we show that this state-dependent model is supported by evidence from both rodent and primate studies, when species and age differences in social separation response are taken into account. PMID:25565999

Perceiving active listening activates the reward system and improves the impression of relevant experiences.

PubMed

Kawamichi, Hiroaki; Yoshihara, Kazufumi; Sasaki, Akihiro T; Sugawara, Sho K; Tanabe, Hiroki C; Shinohara, Ryoji; Sugisawa, Yuka; Tokutake, Kentaro; Mochizuki, Yukiko; Anme, Tokie; Sadato, Norihiro

2015-01-01

Although active listening is an influential behavior, which can affect the social responses of others, the neural correlates underlying its perception have remained unclear. Sensing active listening in social interactions is accompanied by an improvement in the recollected impressions of relevant experiences and is thought to arouse positive feelings. We therefore hypothesized that the recognition of active listening activates the reward system, and that the emotional appraisal of experiences that had been subject to active listening would be improved. To test these hypotheses, we conducted functional magnetic resonance imaging (fMRI) on participants viewing assessments of their own personal experiences made by evaluators with or without active listening attitude. Subjects rated evaluators who showed active listening more positively. Furthermore, they rated episodes more positively when they were evaluated by individuals showing active listening. Neural activation in the ventral striatum was enhanced by perceiving active listening, suggesting that this was processed as rewarding. It also activated the right anterior insula, representing positive emotional reappraisal processes. Furthermore, the mentalizing network was activated when participants were being evaluated, irrespective of active listening behavior. Therefore, perceiving active listening appeared to result in positive emotional appraisal and to invoke mental state attribution to the active listener.

Alterations of monetary reward and punishment processing in chronic cannabis users: an FMRI study.

PubMed

Enzi, Björn; Lissek, Silke; Edel, Marc-Andreas; Tegenthoff, Martin; Nicolas, Volkmar; Scherbaum, Norbert; Juckel, Georg; Roser, Patrik

2015-01-01

Alterations in reward and punishment processing have been reported in adults suffering from long-term cannabis use. However, previous findings regarding the chronic effects of cannabis on reward and punishment processing have been inconsistent. In the present study, we used functional magnetic resonance imaging (fMRI) to reveal the neural correlates of reward and punishment processing in long-term cannabis users (n = 15) and in healthy control subjects (n = 15) with no history of drug abuse. For this purpose, we used the well-established Monetary Incentive Delay (MID) task, a reliable experimental paradigm that allows the differentiation between anticipatory and consummatory aspects of reward and punishment processing. Regarding the gain anticipation period, no significant group differences were observed. In the left caudate and the left inferior frontal gyrus, cannabis users were - in contrast to healthy controls - not able to differentiate between the conditions feedback of reward and control. In addition, cannabis users showed stronger activations in the left caudate and the bilateral inferior frontal gyrus following feedback of no punishment as compared to healthy controls. We interpreted these deficits in dorsal striatal functioning as altered stimulus-reward or action-contingent learning in cannabis users. In addition, the enhanced lateral prefrontal activation in cannabis users that is related to non-punishing feedback may reflect a deficit in emotion regulation or cognitive reappraisal in these subjects.

Motivational effects on the processing of delayed intentions in the anterior prefrontal cortex.

PubMed

Bruening, Jovita; Ludwig, Vera U; Paschke, Lena M; Walter, Henrik; Stelzel, Christine

2018-05-15

Delaying intentions bears the risk of interference from distracting activities during the delay interval. Motivation can increase intention retrieval success but little is known about the underlying brain mechanisms. Here, we investigated whether motivational incentives (monetary reward) modulate the processing of delayed intentions in the anterior prefrontal cortex (aPFC), known to be crucial for intention processing. Using a mixed blocked and event-related functional Magnetic Resonance Imaging design, we specifically tested whether reward affects intention processing in the aPFC in a transient or in a sustained manner and whether this is related to individual differences in retrieval success. We found a generalized effect of reward on both correct intention retrieval and ongoing task performance. Fronto-parietal regions including bilateral lateral aPFC showed sustained activity increases in rewarded compared to non-rewarded blocks as well as transient reward-related activity during the storage phase. Additionally, individual differences in reward-related performance benefits were related to the degree of transient signal increases in right lateral aPFC, specifically during intention encoding. This suggests that the ability to integrate motivational relevance into the encoding of future intentions is crucial for successful intention retrieval in addition to general increases in processing effort. Bilateral aPFC is central to these motivation-cognition interactions. Copyright © 2018 Elsevier Inc. All rights reserved.

Alterations of Monetary Reward and Punishment Processing in Chronic Cannabis Users: An fMRI Study

PubMed Central

Enzi, Björn; Lissek, Silke; Edel, Marc-Andreas; Tegenthoff, Martin; Nicolas, Volkmar; Scherbaum, Norbert; Juckel, Georg; Roser, Patrik

2015-01-01

Alterations in reward and punishment processing have been reported in adults suffering from long-term cannabis use. However, previous findings regarding the chronic effects of cannabis on reward and punishment processing have been inconsistent. In the present study, we used functional magnetic resonance imaging (fMRI) to reveal the neural correlates of reward and punishment processing in long-term cannabis users (n = 15) and in healthy control subjects (n = 15) with no history of drug abuse. For this purpose, we used the well-established Monetary Incentive Delay (MID) task, a reliable experimental paradigm that allows the differentiation between anticipatory and consummatory aspects of reward and punishment processing. Regarding the gain anticipation period, no significant group differences were observed. In the left caudate and the left inferior frontal gyrus, cannabis users were – in contrast to healthy controls – not able to differentiate between the conditions feedback of reward and control. In addition, cannabis users showed stronger activations in the left caudate and the bilateral inferior frontal gyrus following feedback of no punishment as compared to healthy controls. We interpreted these deficits in dorsal striatal functioning as altered stimulus-reward or action-contingent learning in cannabis users. In addition, the enhanced lateral prefrontal activation in cannabis users that is related to non-punishing feedback may reflect a deficit in emotion regulation or cognitive reappraisal in these subjects. PMID:25799565

Regulatory processes of hunger motivated behavior.

PubMed

Lénárd, L; Karádi, Z

2012-01-01

While food intake and body weight are under homeostatic regulation, eating is a highly motivated and reinforced behavior that induces feelings of gratification and pleasure. The chemical senses (taste and odor) and their evaluation are essential to these functions. Brainstem and limbic glucose-monitoring (GM) neurons receiving neurochemical information from the periphery and from the local brain milieu are important controlling hunger motivation, and brain gut peptides have a modulatory role on this function. The hypothalamic and limbic forebrain areas are responsible for evaluation of reward quality and related emotions. They are innervated by the mesolimbic dopaminergic system (MLDS) and majority of GM neurons are also influenced by dopamine. Via dopamine release, the MLDS plays an essential role in rewarding-reinforcing processes of feeding and addiction. The GM network and the MLDS in the limbic system represent essential elements in the neural substrate of motivation.

Food reward system: current perspectives and future research needs

PubMed Central

Woods, Stephen C.; Pelchat, Marcia; Grigson, Patricia Sue; Stice, Eric; Farooqi, Sadaf; Khoo, Chor San; Mattes, Richard D.; Beauchamp, Gary K.

2015-01-01

This article reviews current research and cross-disciplinary perspectives on the neuroscience of food reward in animals and humans, examines the scientific hypothesis of food addiction, discusses methodological and terminology challenges, and identifies knowledge gaps and future research needs. Topics addressed herein include the role of reward and hedonic aspects in the regulation of food intake, neuroanatomy and neurobiology of the reward system in animals and humans, responsivity of the brain reward system to palatable foods and drugs, translation of craving versus addiction, and cognitive control of food reward. The content is based on a workshop held in 2013 by the North American Branch of the International Life Sciences Institute. PMID:26011903

Event-related EEG responses to anticipation and delivery of monetary and social reward.

PubMed

Flores, Amanda; Münte, Thomas F; Doñamayor, Nuria

2015-07-01

Monetary and a social incentive delay tasks were used to characterize reward anticipation and delivery with electroencephalography. During reward anticipation, N1, P2 and P3 components were modulated by both prospective reward value and incentive type (monetary or social), suggesting distinctive allocation of attentional and motivational resources depending not only on whether rewards or non-rewards were cued, but also on the monetary and social nature of the prospective outcomes. In the delivery phase, P2, FRN and P3 components were also modulated by levels of reward value and incentive type, illustrating how distinctive affective and cognitive processes were attached to the different outcomes. Our findings imply that neural processing of both reward anticipation and delivery can be specific to incentive type, which might have implications for basic as well as translational research. These results are discussed in the light of previous electrophysiological and neuroimaging work using similar tasks. Copyright © 2015 Elsevier B.V. All rights reserved.

Identifying nurses' rewards: a qualitative categorization study in Belgium

PubMed Central

De Gieter, Sara; De Cooman, Rein; Pepermans, Roland; Caers, Ralf; Du Bois, Cindy; Jegers, Marc

2006-01-01

Background Rewards are important in attracting, motivating and retaining the most qualified employees, and nurses are no exception to this rule. This makes the establishment of an efficient reward system for nurses a true challenge for every hospital manager. A reward does not necessarily have a financial connotation: non-financial rewards may matter too, or may even be more important. Therefore, the present study examines nurses' reward perceptions, in order to identify potential reward options. Methods To answer the research question "What do nurses consider a reward and how can these rewards be categorized?", 20 in-depth semi-structured interviews with nurses were conducted and analysed using discourse and content analyses. In addition, the respondents received a list of 34 rewards (derived from the literature) and were asked to indicate the extent to which they perceived each of them to be rewarding. Results Discourse analysis revealed three major reward categories: financial, non-financial and psychological, each containing different subcategories. In general, nurses more often mentioned financial rewards spontaneously in the interview, compared to non-financial and psychological rewards. The questionnaire results did not, however, indicate a significant difference in the rewarding potential of these three categories. Both the qualitative and quantitative data revealed that a number of psychological and non-financial rewards were important for nurses in addition to their monthly pay and other remunerations. In particular, appreciation for their work by others, compliments from others, presents from others and contact with patients were highly valued. Moreover, some demographical variables influenced the reward perceptions. Younger and less experienced nurses considered promotion possibilities as more rewarding than the older and more senior ones. The latter valued job security and working for a hospital with a good reputation higher than their younger and more junior colleagues. Conclusion When trying to establish an efficient reward system for nurses, hospital managers should not concentrate on the financial reward possibilities alone. They also ought to consider non-financial and psychological rewards (in combination with financial rewards), since nurses value these as well and they may lead to a more personalized reward system. PMID:16824227

Nutritional controls of food reward.

PubMed

Fernandes, Maria F; Sharma, Sandeep; Hryhorczuk, Cecile; Auguste, Stephanie; Fulton, Stephanie

2013-08-01

The propensity to select and consume palatable nutrients is strongly influenced by the rewarding effects of food. Neural processes integrating reward, emotional states and decision-making can supersede satiety signals to promote excessive caloric intake and weight gain. While nutritional habits are influenced by reward-based neural mechanisms, nutrition and its impact on energy metabolism, in turn, plays an important role in the control of food reward. Feeding modulates the release of metabolic hormones that have an important influence on central controls of appetite. Nutrients themselves are also an essential source of energy fuel, while serving as key metabolites and acting as signalling molecules in the neural pathways that control feeding and food reward. Along these lines, this review discusses the impact of nutritionally regulated hormones and select macronutrients on the behavioural and neural processes underlying the rewarding effects of food. Copyright © 2013 Canadian Diabetes Association. Published by Elsevier Inc. All rights reserved.

Reward and Aversion.

PubMed

Hu, Hailan

2016-07-08

To benefit from opportunities and cope with challenges in the environment, animals must adapt their behavior to acquire rewards and to avoid punishments. Maladaptive changes in the neuromodulatory systems and neural circuits for reward and aversion can lead to manifestation of several prominent psychiatric disorders including addiction and depression. Recent progress is pushing the boundaries of knowledge on two major fronts in research on reward and aversion: First, new layers of complexity have been reported on the functions of dopamine (DA) and serotonin (5-HT) neuromodulatory systems in reward and aversion. Second, specific circuit components in the neural pathways that encode reward and aversion have begun to be identified. This review aims to outline historic perspectives and new insights into the functions of DA and 5-HT systems in coding the distinct components of rewards. It also highlights recent advances in neural circuit studies enabled by new technologies, such as cell-type-specific electrophysiology and tracing, and optogenetics-based behavioral manipulation. This knowledge may provide guidance for developing novel treatment strategies for neuropsychiatric diseases related to the malfunction of the reward system.

Neural reactivity to monetary rewards and losses differentiates social from generalized anxiety in children.

PubMed

Kessel, Ellen M; Kujawa, Autumn; Hajcak Proudfit, Greg; Klein, Daniel N

2015-07-01

The relationship between reward sensitivity and pediatric anxiety is poorly understood. Evidence suggests that alterations in reward processing are more characteristic of depressive than anxiety disorders. However, some studies have reported that anxiety disorders are also associated with perturbations in reward processing. Heterogeneity in the forms of anxiety studied may account for the differences between studies. We used the feedback-negativity, an event-related potential sensitive to monetary gains versus losses (ΔFN), to examine whether different forms of youth anxiety symptoms were uniquely associated with reward sensitivity as indexed by neural reactivity to the receipt of positive and negative monetary outcomes. Participants were 390, eight- to ten-year-old children (175 females) from a large community sample. The ΔFN was measured during a monetary reward task. Self-reports of child anxiety and depression symptoms and temperamental positive emotionality (PE) were obtained. Multiple regression analysis revealed that social anxiety and generalized anxiety symptoms were unique predictors of reward sensitivity after accounting for concurrent depressive symptoms and PE. While social anxiety was associated with a greater ΔFN, generalized anxiety was associated with a reduced ΔFN. Different symptom dimensions of child anxiety are differentially related to alterations in reward sensitivity. This may, in part, explain inconsistent findings in the literature regarding reward processing in anxiety. © 2014 Association for Child and Adolescent Mental Health.

Rewarding safe behavior: strategies for change.

PubMed

Fell-Carlson, Deborah

2004-12-01

Effective, sustainable safety incentives are integrated into a performance management system designed to encourage long term behavior change. Effective incentive program design integrates the fundamental considerations of compensation (i.e., valence, instrumentality, expectancy, equity) with behavior change theory in the context of a strong merit based performance management system. Clear expectations are established and communicated from the time applicants apply for the position. Feedback and social recognition are leveraged and used as rewards, in addition to financial incentives built into the compensation system and offered periodically as short term incentives. Rewards are tied to specific objectives intended to influence specific behaviors. Objectives are designed to challenge employees, providing opportunities to grow and enhance their sense of belonging. Safety contests and other awareness activities are most effective when used to focus safety improvement efforts on specific behaviors or processes, for a predetermined period of time, in the context of a comprehensive safety system. Safety incentive programs designed around injury outcomes can result in unintended, and undesirable, consequences. Safety performance can be leveraged by integrating safety into corporate cultural indicators. Symbols of safety remind employees of corporate safety goals and objectives (e.g., posted safety goals and integrating safety into corporate mission and vision). Rites and ceremonies provide opportunities for social recognition and feedback and demonstrate safety is a corporate value. Feedback opportunities, rewards, and social recognition all provide content for corporate legends, those stories embellished over time, that punctuate the overall system of organizational norms, and provide examples of the organizational safety culture in action.

Anatomical correlates of reward-seeking behaviours in behavioural variant frontotemporal dementia

PubMed Central

Sturm, Virginia E.; Seeley, William W.; Miller, Bruce L.; Kramer, Joel H.; Rosen, Howard J.

2014-01-01

Behavioural variant frontotemporal dementia is characterized by abnormal responses to primary reward stimuli such as food, sex and intoxicants, suggesting abnormal functioning of brain circuitry mediating reward processing. The goal of this analysis was to determine whether abnormalities in reward-seeking behaviour in behavioural variant frontotemporal dementia are correlated with atrophy in regions known to mediate reward processing. Review of case histories in 103 patients with behavioural variant frontotemporal dementia identified overeating or increased sweet food preference in 80 (78%), new or increased alcohol or drug use in 27 (26%), and hypersexuality in 17 (17%). For each patient, a primary reward-seeking score of 0–3 was created with 1 point given for each target behaviour (increased seeking of food, drugs, or sex). Voxel-based morphometry performed in 91 patients with available imaging revealed that right ventral putamen and pallidum atrophy correlated with higher reward-seeking scores. Each of the reward-related behaviours involved partially overlapping right hemisphere reward circuit regions including putamen, globus pallidus, insula and thalamus. These findings indicate that in some patients with behavioural variant frontotemporal dementia, low volume of subcortical reward-related structures is associated with increased pursuit of primary rewards, which may be a product of increased thalamocortical feedback. PMID:24740987

Mood, food, and obesity

PubMed Central

Singh, Minati

2014-01-01

Food is a potent natural reward and food intake is a complex process. Reward and gratification associated with food consumption leads to dopamine (DA) production, which in turn activates reward and pleasure centers in the brain. An individual will repeatedly eat a particular food to experience this positive feeling of gratification. This type of repetitive behavior of food intake leads to the activation of brain reward pathways that eventually overrides other signals of satiety and hunger. Thus, a gratification habit through a favorable food leads to overeating and morbid obesity. Overeating and obesity stems from many biological factors engaging both central and peripheral systems in a bi-directional manner involving mood and emotions. Emotional eating and altered mood can also lead to altered food choice and intake leading to overeating and obesity. Research findings from human and animal studies support a two-way link between three concepts, mood, food, and obesity. The focus of this article is to provide an overview of complex nature of food intake where various biological factors link mood, food intake, and brain signaling that engages both peripheral and central nervous system signaling pathways in a bi-directional manner in obesity. PMID:25225489

Missing motoric manipulations: rethinking the imaging of the ventral striatum and dopamine in human reward.

PubMed

Kareken, David A

2018-01-26

Human neuroimaging studies of natural rewards and drugs of abuse frequently assay the brain's response to stimuli that, through Pavlovian learning, have come to be associated with a drug's rewarding properties. This might be characterized as a 'sensorial' view of the brain's reward system, insofar as the paradigms are designed to elicit responses to a reward's (drug's) sight, aroma, or flavor. A different field of research nevertheless suggests that the mesolimbic dopamine system may also be critically involved in the motor behaviors provoked by such stimuli. This brief review and commentary surveys some of the preclinical data supporting this more "efferent" (motoric) view of the brain's reward system, and discusses what such findings might mean for how human brain imaging studies of natural rewards and drugs of abuse are designed.

Hedonic and incentive signals for body weight control.

PubMed

Egecioglu, Emil; Skibicka, Karolina P; Hansson, Caroline; Alvarez-Crespo, Mayte; Friberg, P Anders; Jerlhag, Elisabet; Engel, Jörgen A; Dickson, Suzanne L

2011-09-01

Here we review the emerging neurobiological understanding of the role of the brain's reward system in the regulation of body weight in health and in disease. Common obesity is characterized by the over-consumption of palatable/rewarding foods, reflecting an imbalance in the relative importance of hedonic versus homeostatic signals. The popular 'incentive salience theory' of food reward recognises not only a hedonic/pleasure component ('liking') but also an incentive motivation component ('wanting' or 'reward-seeking'). Central to the neurobiology of the reward mechanism is the mesoaccumbal dopamine system that confers incentive motivation not only for natural rewards such as food but also by artificial rewards (eg. addictive drugs). Indeed, this mesoaccumbal dopamine system receives and integrates information about the incentive (rewarding) value of foods with information about metabolic status. Problematic over-eating likely reflects a changing balance in the control exerted by hypothalamic versus reward circuits and/or it could reflect an allostatic shift in the hedonic set point for food reward. Certainly, for obesity to prevail, metabolic satiety signals such as leptin and insulin fail to regain control of appetitive brain networks, including those involved in food reward. On the other hand, metabolic control could reflect increased signalling by the stomach-derived orexigenic hormone, ghrelin. We have shown that ghrelin activates the mesoaccumbal dopamine system and that central ghrelin signalling is required for reward from both chemical drugs (eg alcohol) and also from palatable food. Future therapies for problematic over-eating and obesity may include drugs that interfere with incentive motivation, such as ghrelin antagonists.

Comprehensive Behavioral Analysis of Male Ox1r (-/-) Mice Showed Implication of Orexin Receptor-1 in Mood, Anxiety, and Social Behavior.

PubMed

Abbas, Md G; Shoji, Hirotaka; Soya, Shingo; Hondo, Mari; Miyakawa, Tsuyoshi; Sakurai, Takeshi

2015-01-01

Neuropeptides orexin A and orexin B, which are exclusively produced by neurons in the lateral hypothalamic area, play an important role in the regulation of a wide range of behaviors and homeostatic processes, including regulation of sleep/wakefulness states and energy homeostasis. The orexin system has close anatomical and functional relationships with systems that regulate the autonomic nervous system, emotion, mood, the reward system, and sleep/wakefulness states. Recent pharmacological studies using selective antagonists have suggested that orexin receptor-1 (OX1R) is involved in physiological processes that regulate emotion, the reward system, and autonomic nervous system. Here, we examined Ox1r (-/-) mice with a comprehensive behavioral test battery to screen additional OX1R functions. Ox1r (-/-) mice showed increased anxiety-like behavior, altered depression-like behavior, slightly decreased spontaneous locomotor activity, reduced social interaction, increased startle response, and decreased prepulse inhibition. These results suggest that OX1R plays roles in social behavior and sensory motor gating in addition to roles in mood and anxiety.

Comprehensive Behavioral Analysis of Male Ox1r−/− Mice Showed Implication of Orexin Receptor-1 in Mood, Anxiety, and Social Behavior

PubMed Central

Abbas, Md. G.; Shoji, Hirotaka; Soya, Shingo; Hondo, Mari; Miyakawa, Tsuyoshi; Sakurai, Takeshi

2015-01-01

Neuropeptides orexin A and orexin B, which are exclusively produced by neurons in the lateral hypothalamic area, play an important role in the regulation of a wide range of behaviors and homeostatic processes, including regulation of sleep/wakefulness states and energy homeostasis. The orexin system has close anatomical and functional relationships with systems that regulate the autonomic nervous system, emotion, mood, the reward system, and sleep/wakefulness states. Recent pharmacological studies using selective antagonists have suggested that orexin receptor-1 (OX1R) is involved in physiological processes that regulate emotion, the reward system, and autonomic nervous system. Here, we examined Ox1r−/− mice with a comprehensive behavioral test battery to screen additional OX1R functions. Ox1r−/− mice showed increased anxiety-like behavior, altered depression-like behavior, slightly decreased spontaneous locomotor activity, reduced social interaction, increased startle response, and decreased prepulse inhibition. These results suggest that OX1R plays roles in social behavior and sensory motor gating in addition to roles in mood and anxiety. PMID:26696848

Alcohol and Emotional Contagion: An Examination of the Spreading of Smiles in Male and Female Drinking Groups

PubMed Central

Fairbairn, Catharine E.; Sayette, Michael A.; Aalen, Odd O.; Frigessi, Arnoldo

2014-01-01

Researchers have hypothesized that men gain greater reward from alcohol than women. However, alcohol-administration studies testing participants drinking alone have offered weak support for this hypothesis. Research suggests that social processes may be implicated in gender differences in drinking patterns. We examined the impact of gender and alcohol on “emotional contagion”—a social mechanism central to bonding and cohesion. Social drinkers (360 male, 360 female) consumed alcohol, placebo, or control beverages in groups of three. Social interactions were video recorded, and both Duchenne and non-Duchenne smiling were continuously coded using the Facial Action Coding System. Results revealed that Duchenne smiling (but not non-Duchenne smiling) contagion correlated with self-reported reward and typical drinking patterns. Importantly, Duchenne smiles were significantly less “infectious” among sober male versus female groups, and alcohol eliminated these gender differences in smiling contagion. Findings identify new directions for research exploring social-reward processes in the etiology of alcohol problems. PMID:26504673

Alcohol and Emotional Contagion: An Examination of the Spreading of Smiles in Male and Female Drinking Groups.

PubMed

Fairbairn, Catharine E; Sayette, Michael A; Aalen, Odd O; Frigessi, Arnoldo

2015-09-01

Researchers have hypothesized that men gain greater reward from alcohol than women. However, alcohol-administration studies testing participants drinking alone have offered weak support for this hypothesis. Research suggests that social processes may be implicated in gender differences in drinking patterns. We examined the impact of gender and alcohol on "emotional contagion"-a social mechanism central to bonding and cohesion. Social drinkers (360 male, 360 female) consumed alcohol, placebo, or control beverages in groups of three. Social interactions were video recorded, and both Duchenne and non-Duchenne smiling were continuously coded using the Facial Action Coding System . Results revealed that Duchenne smiling (but not non-Duchenne smiling) contagion correlated with self-reported reward and typical drinking patterns. Importantly, Duchenne smiles were significantly less "infectious" among sober male versus female groups, and alcohol eliminated these gender differences in smiling contagion. Findings identify new directions for research exploring social-reward processes in the etiology of alcohol problems.

Performability modeling based on real data: A case study

NASA Technical Reports Server (NTRS)

Hsueh, M. C.; Iyer, R. K.; Trivedi, K. S.

1988-01-01

Described is a measurement-based performability model based on error and resource usage data collected on a multiprocessor system. A method for identifying the model structure is introduced and the resulting model is validated against real data. Model development from the collection of raw data to the estimation of the expected reward is described. Both normal and error behavior of the system are characterized. The measured data show that the holding times in key operational and error states are not simple exponentials and that a semi-Markov process is necessary to model system behavior. A reward function, based on the service rate and the error rate in each state, is then defined in order to estimate the performability of the system and to depict the cost of apparent types of errors.

Performability modeling based on real data: A casestudy

NASA Technical Reports Server (NTRS)

Hsueh, M. C.; Iyer, R. K.; Trivedi, K. S.

1987-01-01

Described is a measurement-based performability model based on error and resource usage data collected on a multiprocessor system. A method for identifying the model structure is introduced and the resulting model is validated against real data. Model development from the collection of raw data to the estimation of the expected reward is described. Both normal and error behavior of the system are characterized. The measured data show that the holding times in key operational and error states are not simple exponentials and that a semi-Markov process is necessary to model the system behavior. A reward function, based on the service rate and the error rate in each state, is then defined in order to estimate the performability of the system and to depict the cost of different types of errors.

Evidence for opioid involvement in the motivation to sing.

PubMed

Riters, Lauren V

2010-03-01

Songbirds produce high rates of song within multiple social contexts, suggesting that they are highly motivated to sing and that song production itself may be rewarding. Progress has been made in understanding the neural basis of song learning and sensorimotor processing, however little is known about neurobiological mechanisms regulating the motivation to sing. Neural systems involved in motivation and reward have been conserved across species and in songbirds are neuroanatomically well-positioned to influence the song control system. Opioid neuropeptides within these systems play a primary role in hedonic reward, at least in mammals. In songbirds, opioid neuropeptides and receptors are found throughout the song control system and within several brain regions implicated in both motivation and reward, including the medial preoptic nucleus (POM) and ventral tegmental area (VTA). Growing research shows these regions to play a role in birdsong that differs depending upon whether song is sexually motivated in response to a female, used for territorial defense or sung as part of a flock but not directed towards an individual (undirected song). Opioid pharmacological manipulations and immunocytochemical data demonstrate a role for opioid activity possibly within VTA and POM in the regulation of song production. Although future research is needed, data suggest that opioids may be most critically involved in reinforcing song that does not result in any obvious form of immediate externally mediated reinforcement, such as undirected song produced in large flocks or during song learning. Data are reviewed supporting the idea that dopamine activity underlies the motivation or drive to sing, but that opioid release is what makes song production rewarding. Copyright 2009 Elsevier B.V. All rights reserved.

Neuropharmacological mechanisms of drug reward: beyond dopamine in the nucleus accumbens.

PubMed

Bardo, M T

1998-01-01

Multiple lines of research have implicated the mesolimbic dopamine system in drug reward measured by either the drug self-administration or conditioned place preference paradigm. The present review summarizes recent work that examines the neuropharmacological mechanisms by which drugs impinge on this dopaminergic neural circuitry, as well as other systems that provide input and output circuits to the mesolimbic dopamine system. Studies examining the effect of selective agonist and antagonist drugs administered systemically have indicated that multiple neurotransmitters are involved, including dopamine, serotonin, acetylcholine, glutamate, GABA, and various peptides. Direct microinjection studies have also provided crucial evidence indicating that, in addition to the mesolimbic dopamine system, other structures play a role in drug reward, including the ventral pallidum, amygdala, hippocampus, hypothalamus, and pedunculopontine tegmental nucleus. GABAergic circuitry descending from the nucleus accumbens to the pedunculopontine tegmental nucleus via the ventral pallidum appears to be especially important in directing the behavioral sequelae associated with reward produced by various drugs of abuse. However, activation of the reward circuitry is achieved differently for various drugs of abuse. With amphetamine and cocaine, initiation of reward is controlled within the nucleus accumbens and prefrontal cortex, respectively. With opiates, initiation of reward involves the ventral tegmental area, nucleus accumbens, hippocampus, and hypothalamus. It is not clear presently if these multiple anatomical structures mediate opiate reward by converging on a single output system or multiple output systems.

Imbalanced functional link between executive control network and reward network explain the online-game seeking behaviors in Internet gaming disorder.

PubMed

Dong, Guangheng; Lin, Xiao; Hu, Yanbo; Xie, Chunming; Du, Xiaoxia

2015-03-17

Literatures have shown that Internet gaming disorder (IGD) subjects show impaired executive control and enhanced reward sensitivities than healthy controls. However, how these two networks jointly affect the valuation process and drive IGD subjects' online-game-seeking behaviors remains unknown. Thirty-five IGD and 36 healthy controls underwent a resting-states scan in the MRI scanner. Functional connectivity (FC) was examined within control and reward network seeds regions, respectively. Nucleus accumbens (NAcc) was selected as the node to find the interactions between these two networks. IGD subjects show decreased FC in the executive control network and increased FC in the reward network when comparing with the healthy controls. When examining the correlations between the NAcc and the executive control/reward networks, the link between the NAcc - executive control network is negatively related with the link between NAcc - reward network. The changes (decrease/increase) in IGD subjects' brain synchrony in control/reward networks suggest the inefficient/overly processing within neural circuitry underlying these processes. The inverse proportion between control network and reward network in IGD suggest that impairments in executive control lead to inefficient inhibition of enhanced cravings to excessive online game playing. This might shed light on the mechanistic understanding of IGD.

A critical appraisal of neuroimaging studies of bipolar disorder: toward a new conceptualization of underlying neural circuitry and roadmap for future research

PubMed Central

Phillips, Mary L; Swartz, Holly A.

2014-01-01

Objective This critical review appraises neuroimaging findings in bipolar disorder in emotion processing, emotion regulation, and reward processing neural circuitry, to synthesize current knowledge of the neural underpinnings of bipolar disorder, and provide a neuroimaging research “roadmap” for future studies. Method We examined findings from all major studies in bipolar disorder that used fMRI, volumetric analyses, diffusion imaging, and resting state techniques, to inform current conceptual models of larger-scale neural circuitry abnormalities in bipolar disorder Results Bipolar disorder can be conceptualized in neural circuitry terms as parallel dysfunction in bilateral prefrontal cortical (especially ventrolateral prefrontal cortical)-hippocampal-amygdala emotion processing and emotion regulation neural circuitries, together with an “overactive” left-sided ventral striatal-ventrolateral and orbitofrontal cortical reward processing circuitry, that result in characteristic behavioral abnormalities associated with bipolar disorder: emotional lability, emotional dysregulation and heightened reward sensitivity. A potential structural basis for these functional abnormalities are gray matter decreases in prefrontal and temporal cortices, amygdala and hippocampus, and fractional anisotropy decreases in white matter tracts connecting prefrontal and subcortical regions. Conclusion Neuroimaging studies of bipolar disorder clearly demonstrate abnormalities in neural circuitries supporting emotion processing, emotion regulation and reward processing, although there are several limitations to these studies. Future neuroimaging research in bipolar disorder should include studies adopting dimensional approaches; larger studies examining neurodevelopmental trajectories in bipolar disorder and at-risk youth; multimodal neuroimaging studies using integrated systems approaches; and studies using pattern recognition approaches to provide clinically useful, individual-level data. Such studies will help identify clinically-relevant biomarkers to guide diagnosis and treatment decision-making for individuals with bipolar disorder. PMID:24626773

Activity of striatal neurons reflects social action and own reward.

PubMed

Báez-Mendoza, Raymundo; Harris, Christopher J; Schultz, Wolfram

2013-10-08

Social interactions provide agents with the opportunity to earn higher benefits than when acting alone and contribute to evolutionary stable strategies. A basic requirement for engaging in beneficial social interactions is to recognize the actor whose movement results in reward. Despite the recent interest in the neural basis of social interactions, the neurophysiological mechanisms identifying the actor in social reward situations are unknown. A brain structure well suited for exploring this issue is the striatum, which plays a role in movement, reward, and goal-directed behavior. In humans, the striatum is involved in social processes related to reward inequity, donations to charity, and observational learning. We studied the neurophysiology of social action for reward in rhesus monkeys performing a reward-giving task. The behavioral data showed that the animals distinguished between their own and the conspecific's reward and knew which individual acted. Striatal neurons coded primarily own reward but rarely other's reward. Importantly, the activations occurred preferentially, and in approximately similar fractions, when either the own or the conspecific's action was followed by own reward. Other striatal neurons showed social action coding without reward. Some of the social action coding disappeared when the conspecific's role was simulated by a computer, confirming a social rather than observational relationship. These findings demonstrate a role of striatal neurons in identifying the social actor and own reward in a social setting. These processes may provide basic building blocks underlying the brain's function in social interactions.

Impulsive responding in threat and reward contexts as a function of PTSD symptoms and trait disinhibition.

PubMed

Sadeh, Naomi; Spielberg, Jeffrey M; Hayes, Jasmeet P

2018-01-01

We examined current posttraumatic stress disorder (PTSD) symptoms, trait disinhibition, and affective context as contributors to impulsive and self-destructive behavior in 94 trauma-exposed Veterans. Participants completed an affective Go/No-Go task (GNG) with different emotional contexts (threat, reward, and a multidimensional threat/reward condition) and current PTSD, trait disinhibition, and risky/self-destructive behavior measures. PTSD interacted with trait disinhibition to explain recent engagement in risky/self-destructive behavior, with Veterans scoring high on trait disinhibition and current PTSD symptoms reporting the highest levels of these behaviors. On the GNG task, commission errors were also associated with the interaction of PTSD symptoms and trait disinhibition. Specifically, PTSD symptoms were associated with greater commission errors in threat vs. reward contexts for individuals who were low on trait disinhibition. In contrast, veterans high on PTSD and trait disinhibition exhibited the greatest number of commission errors in the multidimensional affective context that involved both threat and reward processing. Results highlight the interactive effects of PTSD and disinhibited personality traits, as well as threat and reward systems, as risk factors for impulsive and self-destructive behavior in trauma-exposed groups. Findings have clinical implications for understanding heterogeneity in the expression of PTSD and its association with disinhibited behavior. Copyright © 2017 Elsevier Ltd. All rights reserved.

Striatal response to favorite brands as a function of neuroticism and extraversion.

PubMed

Schaefer, Michael; Knuth, Michael; Rumpel, Franziska

2011-11-24

Recent research has demonstrated that the perception of favorite brands involves similar brain networks than artificially associated reward stimuli. This has been explained by the association of brands with appetitive stimuli due to marketing efforts. Thereby, strong emotional bonds between the brand and the customer may be established. Furthermore, previous studies have shown that the personality dimension extraversion can be linked with the dopaminergic system and reward-sensitive brain areas. The current study aimed to examine if personality traits are associated with the perception of brands as rewarding stimuli. In order to test this hypothesis we conducted an fMRI study in which we presented pictures of chocolate brands, which participants had to rate according to their personal attraction. The personality traits were assessed according to the Five-Factor-Model. Results revealed that favorite brands engaged reward-related brain areas (ventral striatum). This activation was significantly correlated with the degree of extraversion and neuroticism of the participants. Thus, the results demonstrate that personality traits are closely associated with the perception of brands as rewarding stimuli. We discuss the results with recent studies on the neuronal substrates of reward related processing of cultural objects and the role of personality in brand loyalty. Copyright © 2011 Elsevier B.V. All rights reserved.

Working memory accuracy for multiple targets is driven by reward expectation and stimulus contrast with different time-courses.

PubMed

Klink, P Christiaan; Jeurissen, Danique; Theeuwes, Jan; Denys, Damiaan; Roelfsema, Pieter R

2017-08-22

The richness of sensory input dictates that the brain must prioritize and select information for further processing and storage in working memory. Stimulus salience and reward expectations influence this prioritization but their relative contributions and underlying mechanisms are poorly understood. Here we investigate how the quality of working memory for multiple stimuli is determined by priority during encoding and later memory phases. Selective attention could, for instance, act as the primary gating mechanism when stimuli are still visible. Alternatively, observers might still be able to shift priorities across memories during maintenance or retrieval. To distinguish between these possibilities, we investigated how and when reward cues determine working memory accuracy and found that they were only effective during memory encoding. Previously learned, but currently non-predictive, color-reward associations had a similar influence, which gradually weakened without reinforcement. Finally, we show that bottom-up salience, manipulated through varying stimulus contrast, influences memory accuracy during encoding with a fundamentally different time-course than top-down reward cues. While reward-based effects required long stimulus presentation, the influence of contrast was strongest with brief presentations. Our results demonstrate how memory resources are distributed over memory targets and implicates selective attention as a main gating mechanism between sensory and memory systems.

Delay Discounting of Reward in ADHD: Application in Young Children

ERIC Educational Resources Information Center

Wilson, Vanessa B.; Mitchell, Suzanne H.; Musser, Erica D.; Schmitt, Colleen F.; Nigg, Joel T.

2011-01-01

Background: A key underlying process that may contribute to attention-deficit/hyperactivity disorder (ADHD) involves alterations in reward evaluation, including assessing the relative value of immediate over delayed rewards. This study examines whether children with ADHD discount the value of delayed rewards to a greater degree than typically…

Fetal Programming Effects of Testosterone on the Reward System and Behavioral Approach Tendencies in Humans

PubMed Central

Lombardo, Michael V.; Ashwin, Emma; Auyeung, Bonnie; Chakrabarti, Bhismadev; Lai, Meng-Chuan; Taylor, Kevin; Hackett, Gerald; Bullmore, Edward T.; Baron-Cohen, Simon

2012-01-01

Background Sex differences are present in many neuropsychiatric conditions that affect emotion and approach-avoidance behavior. One potential mechanism underlying such observations is testosterone in early development. Although much is known about the effects of testosterone in adolescence and adulthood, little is known in humans about how testosterone in fetal development influences later neural sensitivity to valenced facial cues and approach-avoidance behavioral tendencies. Methods With functional magnetic resonance imaging we scanned 25 8–11-year-old children while viewing happy, fear, neutral, or scrambled faces. Fetal testosterone (FT) was measured via amniotic fluid sampled between 13 and 20 weeks gestation. Behavioral approach-avoidance tendencies were measured via parental report on the Sensitivity to Punishment and Sensitivity to Rewards questionnaire. Results Increasing FT predicted enhanced selectivity for positive compared with negatively valenced facial cues in reward-related regions such as caudate, putamen, and nucleus accumbens but not the amygdala. Statistical mediation analyses showed that increasing FT predicts increased behavioral approach tendencies by biasing caudate, putamen, and nucleus accumbens but not amygdala to be more responsive to positive compared with negatively valenced cues. In contrast, FT was not predictive of behavioral avoidance tendencies, either through direct or neurally mediated paths. Conclusions This work suggests that testosterone in humans acts as a fetal programming mechanism on the reward system and influences behavioral approach tendencies later in life. As a mechanism influencing atypical development, FT might be important across a range of neuropsychiatric conditions that asymmetrically affect the sexes, the reward system, emotion processing, and approach behavior. PMID:22763187

Crayfish Self-Administer Amphetamine in a Spatially Contingent Task.

PubMed

Datta, Udita; van Staaden, Moira; Huber, Robert

2018-01-01

Natural reward is an essential element of any organism's ability to adapt to environmental variation. Its underlying circuits and mechanisms guide the learning process as they help associate an event, or cue, with the perception of an outcome's value. More generally, natural reward serves as the fundamental generator of all motivated behavior. Addictive plant alkaloids are able to activate this circuitry in taxa ranging from planaria to humans. With modularly organized nervous systems and confirmed vulnerabilities to human drugs of abuse, crayfish have recently emerged as a compelling model for the study of the addiction cycle, including psychostimulant effects, sensitization, withdrawal, reinstatement, and drug reward in conditioned place preference paradigms. Here we extend this work with the demonstration of a spatially contingent, operant drug self-administration paradigm for amphetamine. When the animal enters a quadrant of the arena with a particular textured substrate, a computer-based control system delivers amphetamine through an indwelling fine-bore cannula. Resulting reward strength, dose-response, and the time course of operant conditioning were assessed. Individuals experiencing the drug contingent on their behavior, displayed enhanced rates of operant responses compared to that of their yoked (non-contingent) counterparts. Application of amphetamine near the supra-esophageal ganglion elicited stronger and more robust increases in operant responding than did systemic infusions. This work demonstrates automated implementation of a spatially contingent self-administration paradigm in crayfish, which provides a powerful tool to explore comparative perspectives in drug-sensitive reward, the mechanisms of learning underlying the addictive cycle, and phylogenetically conserved vulnerabilities to psychostimulant compounds.

Crayfish Self-Administer Amphetamine in a Spatially Contingent Task

PubMed Central

Datta, Udita; van Staaden, Moira; Huber, Robert

2018-01-01

Natural reward is an essential element of any organism’s ability to adapt to environmental variation. Its underlying circuits and mechanisms guide the learning process as they help associate an event, or cue, with the perception of an outcome’s value. More generally, natural reward serves as the fundamental generator of all motivated behavior. Addictive plant alkaloids are able to activate this circuitry in taxa ranging from planaria to humans. With modularly organized nervous systems and confirmed vulnerabilities to human drugs of abuse, crayfish have recently emerged as a compelling model for the study of the addiction cycle, including psychostimulant effects, sensitization, withdrawal, reinstatement, and drug reward in conditioned place preference paradigms. Here we extend this work with the demonstration of a spatially contingent, operant drug self-administration paradigm for amphetamine. When the animal enters a quadrant of the arena with a particular textured substrate, a computer-based control system delivers amphetamine through an indwelling fine-bore cannula. Resulting reward strength, dose-response, and the time course of operant conditioning were assessed. Individuals experiencing the drug contingent on their behavior, displayed enhanced rates of operant responses compared to that of their yoked (non-contingent) counterparts. Application of amphetamine near the supra-esophageal ganglion elicited stronger and more robust increases in operant responding than did systemic infusions. This work demonstrates automated implementation of a spatially contingent self-administration paradigm in crayfish, which provides a powerful tool to explore comparative perspectives in drug-sensitive reward, the mechanisms of learning underlying the addictive cycle, and phylogenetically conserved vulnerabilities to psychostimulant compounds.

Fetal programming effects of testosterone on the reward system and behavioral approach tendencies in humans.

PubMed

Lombardo, Michael V; Ashwin, Emma; Auyeung, Bonnie; Chakrabarti, Bhismadev; Lai, Meng-Chuan; Taylor, Kevin; Hackett, Gerald; Bullmore, Edward T; Baron-Cohen, Simon

2012-11-15

Sex differences are present in many neuropsychiatric conditions that affect emotion and approach-avoidance behavior. One potential mechanism underlying such observations is testosterone in early development. Although much is known about the effects of testosterone in adolescence and adulthood, little is known in humans about how testosterone in fetal development influences later neural sensitivity to valenced facial cues and approach-avoidance behavioral tendencies. With functional magnetic resonance imaging we scanned 25 8-11-year-old children while viewing happy, fear, neutral, or scrambled faces. Fetal testosterone (FT) was measured via amniotic fluid sampled between 13 and 20 weeks gestation. Behavioral approach-avoidance tendencies were measured via parental report on the Sensitivity to Punishment and Sensitivity to Rewards questionnaire. Increasing FT predicted enhanced selectivity for positive compared with negatively valenced facial cues in reward-related regions such as caudate, putamen, and nucleus accumbens but not the amygdala. Statistical mediation analyses showed that increasing FT predicts increased behavioral approach tendencies by biasing caudate, putamen, and nucleus accumbens but not amygdala to be more responsive to positive compared with negatively valenced cues. In contrast, FT was not predictive of behavioral avoidance tendencies, either through direct or neurally mediated paths. This work suggests that testosterone in humans acts as a fetal programming mechanism on the reward system and influences behavioral approach tendencies later in life. As a mechanism influencing atypical development, FT might be important across a range of neuropsychiatric conditions that asymmetrically affect the sexes, the reward system, emotion processing, and approach behavior. Copyright © 2012 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

The endogenous opioid system: a common substrate in drug addiction.

PubMed

Trigo, José Manuel; Martin-García, Elena; Berrendero, Fernando; Robledo, Patricia; Maldonado, Rafael

2010-05-01

Drug addiction is a chronic brain disorder leading to complex adaptive changes within the brain reward circuits that involve several neurotransmitters. One of the neurochemical systems that plays a pivotal role in different aspects of addiction is the endogenous opioid system (EOS). Opioid receptors and endogenous opioid peptides are largely distributed in the mesolimbic system and modulate dopaminergic activity within these reward circuits. Chronic exposure to the different prototypical drugs of abuse, including opioids, alcohol, nicotine, psychostimulants and cannabinoids has been reported to produce significant alterations within the EOS, which seem to play an important role in the development of the addictive process. In this review, we will describe the adaptive changes produced by different drugs of abuse on the EOS, and the current knowledge about the contribution of each component of this neurobiological system to their addictive properties.

Differential reward coding in the subdivisions of the primate caudate during an oculomotor task.

PubMed

Nakamura, Kae; Santos, Gustavo S; Matsuzaki, Ryuichi; Nakahara, Hiroyuki

2012-11-07

The basal ganglia play a pivotal role in reward-oriented behavior. The striatum, an input channel of the basal ganglia, is composed of subdivisions that are topographically connected with different cortical and subcortical areas. To test whether reward information is differentially processed in the different parts of the striatum, we compared reward-related neuronal activity along the dorsolateral-ventromedial axis in the caudate nucleus of monkeys performing an asymmetrically rewarded oculomotor task. In a given block, a target in one position was associated with a large reward, whereas the other target was associated with a small reward. The target position-reward value contingency was switched between blocks. We found the following: (1) activity that reflected the block-wise reward contingency emerged before the appearance of a visual target, and it was more prevalent in the dorsal, rather than central and ventral, caudate; (2) activity that was positively related to the reward size of the current trial was evident, especially after reward delivery, and it was more prevalent in the ventral and central, rather than dorsal, caudate; and (3) activity that was modulated by the memory of the outcomes of the previous trials was evident in the dorsal and central caudate. This multiple reward information, together with the target-direction information, was represented primarily by individual caudate neurons, and the different reward information was represented in caudate subpopulations with distinct electrophysiological properties, e.g., baseline firing and spike width. These results suggest parallel processing of different reward information by the basal ganglia subdivisions defined by extrinsic connections and intrinsic properties.

A systems neurophysiology approach to voluntary event coding.

PubMed

Petruo, Vanessa A; Stock, Ann-Kathrin; Münchau, Alexander; Beste, Christian

2016-07-15

Mechanisms responsible for the integration of perceptual events and appropriate actions (sensorimotor processes) have been subject to intense research. Different theoretical frameworks have been put forward with the "Theory of Event Coding (TEC)" being one of the most influential. In the current study, we focus on the concept of 'event files' within TEC and examine what sub-processes being dissociable by means of cognitive-neurophysiological methods are involved in voluntary event coding. This was combined with EEG source localization. We also introduce reward manipulations to delineate the neurophysiological sub-processes most relevant for performance variations during event coding. The results show that processes involved in voluntary event coding included predominantly stimulus categorization, feature unbinding and response selection, which were reflected by distinct neurophysiological processes (the P1, N2 and P3 ERPs). On a system's neurophysiological level, voluntary event-file coding is thus related to widely distributed parietal-medial frontal networks. Attentional selection processes (N1 ERP) turned out to be less important. Reward modulated stimulus categorization in parietal regions likely reflecting aspects of perceptual decision making but not in other processes. The perceptual categorization stage appears central for voluntary event-file coding. Copyright © 2016 Elsevier Inc. All rights reserved.

The risk variant in ODZ4 for bipolar disorder impacts on amygdala activation during reward processing.

PubMed

Heinrich, Angela; Lourdusamy, Anbarasu; Tzschoppe, Jelka; Vollstädt-Klein, Sabine; Bühler, Mira; Steiner, Sabina; Bach, Christiane; Poustka, Luise; Banaschewski, Tobias; Barker, Gareth; Büchel, Christian; Conrod, Patricia; Garavan, Hugh; Gallinat, Jürgen; Heinz, Andreas; Ittermann, Bernd; Loth, Eva; Mann, Karl; Martinot, Jean-Luc; Paus, Tomáš; Pausova, Zdenka; Smolka, Michael; Ströhle, Andreas; Struve, Maren; Witt, Stephanie; Flor, Herta; Schumann, Gunter; Rietschel, Marcella; Nees, Frauke

2013-06-01

Bipolar disorder is a severe mood disorder, which normally begins during adolescence or early adulthood and has a heritability of up to 80%. The largest genome-wide association analysis of bipolar disorder recently identified a new genome-wide associated variant in OZD4 (rs12576775). The aim of the present study was to further elucidate the role of this risk variant in the disease process using an imaging genetics approach. As increased amygdala and striatal responses during the processing of reward and emotion are characteristic for bipolar disorder patients, it was tested whether the risk variant has an influence on this endophenotype in healthy adolescents. We examined the impact of the risk variant rs12576775 on functional magnetic resonance imaging data in an adolescent sample (N = 485). Differential activation between carriers of the risk allele (G-allele) and homozygous A-allele carriers in the amygdala and the striatum during a modification of the monetary incentive delay task (examining reward) and a face task (examining emotion) was analyzed. Carriers of the risk allele showed an increased blood oxygen level-dependent response in the amygdala during reward sensitivity (p = 0.05) and reward expectation (p < 0.05) but not during the face task. No significant group differences were found in the striatum during both reward and emotion processing. Our results indicate that the ODZ4 risk variant influences reward processing in the amygdala. Alterations in the processing of emotion may have different underlying mechanisms and need to be further examined. © 2013 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

I want to media multitask and I want to do it now: Individual differences in media multitasking predict delay of gratification and system-1 thinking.

PubMed

Schutten, Dan; Stokes, Kirk A; Arnell, Karen M

2017-01-01

Media multitasking, the concurrent use of multiple media forms, has been shown to be related to greater self-reported impulsivity and less self-control. These measures are both hallmarks of the need for immediate gratification which has been associated with fast, intuitive 'system-1' decision making, as opposed to more deliberate and effortful 'system-2' decision making. In Study 1, we used the Cognitive Reflection Task (CRT) to examine whether individuals who engage heavily in media multitasking differ from those who are light media multitaskers in their degree of system-1 versus system-2 thinking. In Study 2 we examined whether heavy and light media multitaskers differ in delay of gratification, using the delay discounting measure which estimates the preference for smaller immediate rewards, relative to larger delayed rewards in a hypothetical monetary choice task. We found that heavy media multitaskers were more likely than light media multitaskers to endorse intuitive, but wrong, decisions on the CRT indicating a greater reliance on 'system-1' thinking. Heavy media multitaskers were also willing to settle for less money immediately relative to light media multitaskers who were more willing to wait for the larger delayed reward. These results suggest that heavy media multitaskers have a reactive decision-making style that promotes current desires (money, ease of processing) at the expense of accuracy and future rewards. These findings highlight the potential for heavy media multitaskers to be at risk for problematic behaviors associated with delay discounting - behaviors such as substance abuse, overeating, problematic gambling, and poor financial management.

Motivational salience and genetic variability of dopamine D2 receptor expression interact in the modulation of interference processing

PubMed Central

Richter, Anni; Richter, Sylvia; Barman, Adriana; Soch, Joram; Klein, Marieke; Assmann, Anne; Libeau, Catherine; Behnisch, Gusalija; Wüstenberg, Torsten; Seidenbecher, Constanze I.; Schott, Björn H.

2013-01-01

Dopamine has been implicated in the fine-tuning of complex cognitive and motor function and also in the anticipation of future rewards. This dual function of dopamine suggests that dopamine might be involved in the generation of active motivated behavior. The DRD2 TaqIA polymorphism of the dopamine D2 receptor gene (rs1800497) has previously been suggested to affect striatal function with carriers of the less common A1 allele exhibiting reduced striatal D2 receptor density and increased risk for addiction. Here we aimed to investigate the influences of DRD2 TaqIA genotype on the modulation of interference processing by reward and punishment. Forty-six young, healthy volunteers participated in a behavioral experiment, and 32 underwent functional magnetic resonance imaging (fMRI). Participants performed a flanker task with a motivation manipulation (monetary reward, monetary loss, neither, or both). Reaction times (RTs) were shorter in motivated flanker trials, irrespective of congruency. In the fMRI experiment motivation was associated with reduced prefrontal activation during incongruent vs. congruent flanker trials, possibly reflecting increased processing efficiency. DRD2 TaqIA genotype did not affect overall RTs, but interacted with motivation on the congruency-related RT differences, with A1 carriers showing smaller interference effects to reward alone and A2 homozygotes exhibiting a specific interference reduction during combined reward (REW) and punishment trials (PUN). In fMRI, anterior cingulate activity showed a similar pattern of genotype-related modulation. Additionally, A1 carriers showed increased anterior insula activation relative to A2 homozygotes. Our results point to a role for genetic variations of the dopaminergic system in individual differences of cognition-motivation interaction. PMID:23760450

Candy and the brain: neural response to candy gains and losses.

PubMed

Luking, Katherine R; Barch, Deanna M

2013-09-01

Incentive processing is a critical component of a host of cognitive processes, including attention, motivation, and learning. Neuroimaging studies have clarified the neural systems underlying processing of primary and secondary rewards in adults. However, current reward paradigms have hindered comparisons across these reward types as well as between age groups. To address methodological issues regarding the timing of incentive delivery (during scan vs. postscan) and the age-appropriateness of the incentive type, we utilized fMRI and a modified version of a card-guessing game (CGG), in which candy pieces delivered postscan served as the reinforcer, to investigate neural responses to incentives. Healthy young adults 22-26 years of age won and lost large and small amounts of candy on the basis of their ability to guess the number on a mystery card. BOLD activity was compared following candy gain (large/small), loss (large/small), and neutral feedback. During candy gains, adults recruited regions typically involved in response to monetary and other rewards, such as the caudate, putamen, and orbitofrontal cortex. During losses, they displayed greater deactivation in the hippocampus than in response to neutral and gain feedback. Additionally, individual-difference analyses suggested a negative relationship between reward sensitivity (assessed by the Behavioral Inhibition/Behavioral Activation Scales) and the difference between high- and low-magnitude losses in the caudate and lateral orbitofrontal cortex. Also within the striatum, greater punishment sensitivity was positively related to the difference in activity following high as compared to low gains. Overall, these results show strong overlap with those from previous monetary versions of the CGG and provide a baseline for future work with developmental populations.

Differential Effects of Acute Stress on Anticipatory and Consummatory Phases of Reward Processing

PubMed Central

Kumar, Poornima; Berghorst, Lisa H.; Nickerson, Lisa D.; Dutra, Sunny J.; Goer, Franziska; Greve, Douglas; Pizzagalli, Diego A.

2014-01-01

Anhedonia is one of the core symptoms of depression and has been linked to blunted responses to rewarding stimuli in striatal regions. Stress, a key vulnerability factor for depression, has been shown to induce anhedonic behavior, including reduced reward responsiveness in both animals and humans, but the brain processes associated with these effects remain largely unknown in humans. Emerging evidence suggests that stress has dissociable effects on distinct components of reward processing, as it has been found to potentiate motivation/‘wanting’ during the anticipatory phase but reduce reward responsiveness/‘liking’ during the consummatory phase. To examine the impact of stress on reward processing, we used a monetary incentive delay (MID) task and an acute stress manipulation (negative performance feedback) in conjunction with functional magnetic resonance imaging (fMRI). Fifteen healthy participants performed the MID task under no-stress and stress conditions. We hypothesized that stress would have dissociable effects on the anticipatory and consummatory phases in reward-related brain regions. Specifically, we expected reduced striatal responsiveness during reward consumption (mirroring patterns previously observed in clinical depression) and increased striatal activation during reward anticipation consistent with non-human findings. Supporting our hypotheses, significant Phase (Anticipation/Consumption) x Stress (Stress/No-stress) interactions emerged in the putamen, nucleus accumbens, caudate and amygdala. Post-hoc tests revealed that stress increased striatal and amygdalar activation during anticipation but decreased striatal activation during consumption. Importantly, stress-induced striatal blunting was similar to the profile observed in clinical depression under baseline (no-stress) conditions in prior studies. Given that stress is a pivotal vulnerability factor for depression, these results offer insight to better understand the etiology of this prevalent disorder. PMID:24508744

Motivational systems in adolescence: Possible implications for age differences in substance abuse and other risk-taking behaviors

PubMed Central

Doremus-Fitzwater, Tamara L.; Varlinskaya, Elena I.; Spear, Linda P.

2009-01-01

Adolescence is an evolutionarily conserved developmental phase characterized by hormonal, physiological, neural and behavioral alterations evident widely across mammalian species. For instance, adolescent rats, like their human counterparts, exhibit elevations in peer-directed social interactions, risk-taking/novelty seeking and drug and alcohol use relative to adults, along with notable changes in motivational and reward-related brain regions. After reviewing these topics, the present paper discusses conditioned preference and aversion data showing adolescents to be more sensitive than adults to positive rewarding properties of various drugs and natural stimuli, while less sensitive to the aversive properties of these stimuli. Additional experiments designed to parse specific components of reward-related processing using natural rewards have yielded more mixed findings, with reports of accentuated positive hedonic sensitivity during adolescence contrasting with studies showing less positive hedonic affect and reduced incentive salience at this age. Implications of these findings for adolescent substance abuse will be discussed. PMID:19762139

The rostromedial tegmental nucleus (RMTg), a major GABAergic afferent to midbrain dopamine neurons, selectively encodes aversive stimuli and promotes behavioral inhibition

PubMed Central

Jhou, Thomas C.; Fields, Howard L.; Baxter, Mark G.; Saper, Clifford B.; Holland, Peter C.

2009-01-01

Summary Separate studies have implicated the lateral habenula (LHb) or amygdala-related regions in processing aversive stimuli, but their relationships to each other and to appetitive motivational systems are poorly understood. We show that neurons in the recently identified GABAergic rostromedial tegmental nucleus (RMTg), which receive a major LHb input, project heavily to midbrain dopamine neurons, and show phasic activations and/or Fos induction after aversive stimuli (footshocks, shock-predictive cues, food deprivation, or reward omission) and inhibitions after rewards or reward-predictive stimuli. RMTg lesions markedly reduce passive fear behaviors (freezing, open-arm avoidance) dependent on the extended amygdala, periaqueductal gray, or septum, all regions that project directly to the RMTg. In contrast, RMTg lesions spare or enhance active fear responses (treading, escape) in these same paradigms. These findings suggest that aversive inputs from widespread brain regions and stimulus modalities converge onto the RMTg, which opposes reward and motor-activating functions of midbrain dopamine neurons PMID:19285474

Don't Worry, Be Happy: Endocannabinoids and Cannabis at the Intersection of Stress and Reward.

PubMed

Volkow, Nora D; Hampson, Aidan J; Baler, Ruben D

2017-01-06

Cannabis enables and enhances the subjective sense of well-being by stimulating the endocannabinoid system (ECS), which plays a key role in modulating the response to stress, reward, and their interactions. However, over time, repeated activation of the ECS by cannabis can trigger neuroadaptations that may impair the sensitivity to stress and reward. This effect, in vulnerable individuals, can lead to addiction and other adverse consequences. The recent shift toward legalization of medical or recreational cannabis has renewed interest in investigating the physiological role of the ECS as well as the potential health effects, both adverse and beneficial, of cannabis. Here we review our current understanding of the ECS and its complex physiological roles. We discuss the implications of this understanding vis-á-vis the ECS's modulation of stress and reward and its relevance to mental disorders in which these processes are disrupted (i.e., addiction, depression, posttraumatic stress disorder, schizophrenia), along with the therapeutic potential of strategies to manipulate the ECS for these conditions.

Modulation of cue-induced firing of ventral tegmental area dopamine neurons by leptin and ghrelin

PubMed Central

van der Plasse, G; van Zessen, R; Luijendijk, M C M; Erkan, H; Stuber, G D; Ramakers, G M J; Adan, R A H

2015-01-01

Background/objectives: The rewarding value of palatable foods contributes to overconsumption, even in satiated subjects. Midbrain dopaminergic activity in response to reward-predicting environmental stimuli drives reward-seeking and motivated behavior for food rewards. This mesolimbic dopamine (DA) system is sensitive to changes in energy balance, yet it has thus far not been established whether reward signaling of DA neurons in vivo is under control of hormones that signal appetite and energy balance such as ghrelin and leptin. Subjects/methods: We trained rats (n=11) on an operant task in which they could earn two different food rewards. We then implanted recording electrodes in the ventral tegmental area (VTA), and recorded from DA neurons during behavior. Subsequently, we assessed the effects of mild food restriction and pretreatment with the adipose tissue-derived anorexigenic hormone leptin or the orexigenic hormone ghrelin on VTA DA reward signaling. Results: Animals showed an increase in performance following mild food restriction (P=0.002). Importantly, food-cue induced DA firing increased when animals were food restricted (P=0.02), but was significantly attenuated after leptin pretreatment (P=0.00). While ghrelin did affect baseline DA activity (P=0.025), it did not affect cue-induced firing (P⩾0.353). Conclusions: Metabolic signals, such as leptin, affect food seeking, a process that is dependent on the formation of cue-reward outcomes and involves midbrain DA signaling. These data show that food restriction engages the encoding of food cues by VTA DA neurons at a millisecond level and leptin suppresses this activity. This suggests that leptin is a key in linking metabolic information to reward signaling. PMID:26183405

The left hemisphere learns what is right: Hemispatial reward learning depends on reinforcement learning processes in the contralateral hemisphere.

PubMed

Aberg, Kristoffer Carl; Doell, Kimberly Crystal; Schwartz, Sophie

2016-08-01

Orienting biases refer to consistent, trait-like direction of attention or locomotion toward one side of space. Recent studies suggest that such hemispatial biases may determine how well people memorize information presented in the left or right hemifield. Moreover, lesion studies indicate that learning rewarded stimuli in one hemispace depends on the integrity of the contralateral striatum. However, the exact neural and computational mechanisms underlying the influence of individual orienting biases on reward learning remain unclear. Because reward-based behavioural adaptation depends on the dopaminergic system and prediction error (PE) encoding in the ventral striatum, we hypothesized that hemispheric asymmetries in dopamine (DA) function may determine individual spatial biases in reward learning. To test this prediction, we acquired fMRI in 33 healthy human participants while they performed a lateralized reward task. Learning differences between hemispaces were assessed by presenting stimuli, assigned to different reward probabilities, to the left or right of central fixation, i.e. presented in the left or right visual hemifield. Hemispheric differences in DA function were estimated through differential fMRI responses to positive vs. negative feedback in the left vs. right ventral striatum, and a computational approach was used to identify the neural correlates of PEs. Our results show that spatial biases favoring reward learning in the right (vs. left) hemifield were associated with increased reward responses in the left hemisphere and relatively better neural encoding of PEs for stimuli presented in the right (vs. left) hemifield. These findings demonstrate that trait-like spatial biases implicate hemisphere-specific learning mechanisms, with individual differences between hemispheres contributing to reinforcing spatial biases. Copyright © 2016 Elsevier Ltd. All rights reserved.

Nicotine, alcohol and cocaine coupling to reward processes via endogenous morphine signaling: the dopamine-morphine hypothesis.

PubMed

Stefano, George B; Bianchi, Enrica; Guarna, Massimo; Fricchione, Gregory L; Zhu, Wei; Cadet, Patrick; Mantione, Kirk J; Casares, Federico M; Kream, Richard M; Esch, Tobias

2007-06-01

Pleasure is described as a state or feeling of happiness and satisfaction resulting from an experience that one enjoys. We examine the neurobiological factors underlying reward processes and pleasure phenomena. With regard to possible negative effects of pleasure, we focus on addiction and motivational toxicity. Pleasure can serve cognition, productivity and health, but simultaneously promotes addiction and other negative behaviors. It is a complex neurobiological phenomenon, relying on reward circuitry or limbic activity. These processes involve dopaminergic signaling. Moreover, nicotine, cocaine and alcohol appear to exert their pleasure providing action via endogenous morphinergic mechanisms. Natural rewarding activities are necessary for survival and appetitive motivation, usually governing beneficial biological behaviors like eating, sex and reproduction. Social contacts can further facilitate the positive effects exerted by pleasurable experiences. However, artificial stimulants can be detrimental, since flexibility and normal control of behavior are deteriorated. Additionally, addictive drugs are capable of directly acting on reward pathways, now, in part, via endogenous morphine processes.

Children with ADHD Symptoms Show Decreased Activity in Ventral Striatum during the Anticipation of Reward, Irrespective of ADHD Diagnosis

ERIC Educational Resources Information Center

van Hulst, Branko M.; de Zeeuw, Patrick; Bos, Dienke J.; Rijks, Yvonne; Neggers, Sebastiaan F. W.; Durston, Sarah

2017-01-01

Background: Changes in reward processing are thought to be involved in the etiology of attention-deficit/hyperactivity disorder (ADHD), as well as other developmental disorders. In addition, different forms of therapy for ADHD rely on reinforcement principles. As such, improved understanding of reward processing in ADHD could eventually lead to…

High temporal discounters overvalue immediate rewards rather than undervalue future rewards: an event-related brain potential study.

PubMed

Cherniawsky, Avital S; Holroyd, Clay B

2013-03-01

Impulsivity is characterized in part by heightened sensitivity to immediate relative to future rewards. Although previous research has suggested that "high discounters" in intertemporal choice tasks tend to prefer immediate over future rewards because they devalue the latter, it remains possible that they instead overvalue immediate rewards. To investigate this question, we recorded the reward positivity, a component of the event-related brain potential (ERP) associated with reward processing, with participants engaged in a task in which they received both immediate and future rewards and nonrewards. The participants also completed a temporal discounting task without ERP recording. We found that immediate but not future rewards elicited the reward positivity. High discounters also produced larger reward positivities to immediate rewards than did low discounters, indicating that high discounters relatively overvalued immediate rewards. These findings suggest that high discounters may be more motivated than low discounters to work for monetary rewards, irrespective of the time of arrival of the incentives.

Monetary reward processing in obese individuals with and without binge eating disorder.

PubMed

Balodis, Iris M; Kober, Hedy; Worhunsky, Patrick D; White, Marney A; Stevens, Michael C; Pearlson, Godfrey D; Sinha, Rajita; Grilo, Carlos M; Potenza, Marc N

2013-05-01

An important step in obesity research involves identifying neurobiological underpinnings of nonfood reward processing unique to specific subgroups of obese individuals. Nineteen obese individuals seeking treatment for binge eating disorder (BED) were compared with 19 non-BED obese individuals (OB) and 19 lean control subjects (LC) while performing a monetary reward/loss task that parses anticipatory and outcome components during functional magnetic resonance imaging. Differences in regional activation were investigated in BED, OB, and LC groups during reward/loss prospect, anticipation, and notification. Relative to the LC group, the OB group demonstrated increased ventral striatal and ventromedial prefrontal cortex activity during anticipatory phases. In contrast, the BED group relative to the OB group demonstrated diminished bilateral ventral striatal activity during anticipatory reward/loss processing. No differences were observed between the BED and LC groups in the ventral striatum. Heterogeneity exists among obese individuals with respect to the neural correlates of reward/loss processing. Neural differences in separable groups with obesity suggest that multiple, varying interventions might be important in optimizing prevention and treatment strategies for obesity. Copyright © 2013 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

Assessing and Rewarding Excellent Academic Teachers for the Benefit of an Organization

ERIC Educational Resources Information Center

Olsson, Thomas; Roxå, Torgny

2013-01-01

In this article we describe and analyse a system for rewarding excellence in university teaching developed at the Faculty of Engineering at Lund University in Sweden. Individual teachers are rewarded for the effort they invest in the support of student learning. However, it is the organization that establishes a reward system and it does so for…

Reward circuitry in resilience to severe trauma: An fMRI investigation of resilient special forces soldiers

PubMed Central

Vythilingam, Meena; Nelson, Eric E.; Scaramozza, Matthew; Waldeck, Tracy; Hazlett, Gary; Southwick, Steven M.; Pine, Daniel S.; Drevets, Wayne; Charney, Dennis S.; Ernst, Monique

2008-01-01

Enhanced brain reward function could contribute to resilience to trauma. Reward circuitry in active duty, resilient special forces (SF) soldiers was evaluated using fMRI during a monetary incentive delay task. Findings in this group of resilient individuals revealed unique patterns of activation during expectation of reward in the subgenual prefrontal cortex and nucleus accumbens area; regions pivotal to reward processes. PMID:19243926

A potential role of reward and punishment in the facilitation of the emotion-cognition dichotomy in the Iowa Gambling Task.

PubMed

Singh, Varsha

2013-01-01

The Iowa Gambling Task (IGT) is based on the assumption that a decision maker is equally motivated to seek reward and avoid punishment, and that decision making is governed solely by the intertemporal attribute (i.e., preference for an option that produces an immediate outcome instead of one that yields a delayed outcome is believed to reflect risky decision making and is considered a deficit). It was assumed in the present study that the emotion- and cognition-based processing dichotomy manifests in the IGT as reward and punishment frequency and the intertemporal attribute. It was further proposed that the delineation of emotion- and cognition-based processing is contingent upon reward and punishment as manifested in the frame of the task (variant type) and task motivation (instruction type). The effects of IGT variant type (reward vs. punishment) and instruction type (task motivation induced by instruction types: reward, punishment, reward and punishment, or no hint) on the intertemporal and frequency attributes of IGT decision-making were analyzed. Decision making in the reward variant was equally governed by both attributes, and significantly affected by instruction type, while decision making in the punishment variant was differentially affected by the two attributes and not significantly impacted by instruction type. These results suggest that reward and punishment manifested via task frame as well as the task motivation may facilitate the differentiation of emotion- and cognition-based processing in the IGT.

A potential role of reward and punishment in the facilitation of the emotion-cognition dichotomy in the Iowa Gambling Task

PubMed Central

Singh, Varsha

2013-01-01

The Iowa Gambling Task (IGT) is based on the assumption that a decision maker is equally motivated to seek reward and avoid punishment, and that decision making is governed solely by the intertemporal attribute (i.e., preference for an option that produces an immediate outcome instead of one that yields a delayed outcome is believed to reflect risky decision making and is considered a deficit). It was assumed in the present study that the emotion- and cognition-based processing dichotomy manifests in the IGT as reward and punishment frequency and the intertemporal attribute. It was further proposed that the delineation of emotion- and cognition-based processing is contingent upon reward and punishment as manifested in the frame of the task (variant type) and task motivation (instruction type). The effects of IGT variant type (reward vs. punishment) and instruction type (task motivation induced by instruction types: reward, punishment, reward and punishment, or no hint) on the intertemporal and frequency attributes of IGT decision-making were analyzed. Decision making in the reward variant was equally governed by both attributes, and significantly affected by instruction type, while decision making in the punishment variant was differentially affected by the two attributes and not significantly impacted by instruction type. These results suggest that reward and punishment manifested via task frame as well as the task motivation may facilitate the differentiation of emotion- and cognition-based processing in the IGT. PMID:24381567

Cholinergic modulation of mesolimbic dopamine function and reward.

PubMed

Mark, Gregory P; Shabani, Shkelzen; Dobbs, Lauren K; Hansen, Stephen T

2011-07-25

The substantial health risk posed by obesity and compulsive drug use has compelled a serious research effort to identify the neurobiological substrates that underlie the development these pathological conditions. Despite substantial progress, an understanding of the neurochemical systems that mediate the motivational aspects of drug-seeking and craving remains incomplete. Important work from the laboratory of Bart Hoebel has provided key information on neurochemical systems that interact with dopamine (DA) as potentially important components in both the development of addiction and the expression of compulsive behaviors such as binge eating. One such modulatory system appears to be cholinergic pathways that interact with DA systems at all levels of the reward circuit. Cholinergic cells in the pons project to DA-rich cell body regions in the ventral tegmental area (VTA) and substantial nigra (SN) where they modulate the activity of dopaminergic neurons and reward processing. The DA terminal region of the nucleus accumbens (NAc) contains a small but particularly important group of cholinergic interneurons, which have extensive dendritic arbors that make synapses with a vast majority of NAc neurons and afferents. Together with acetylcholine (ACh) input onto DA cell bodies, cholinergic systems could serve a vital role in gating information flow concerning the motivational value of stimuli through the mesolimbic system. In this report we highlight evidence that CNS cholinergic systems play a pivotal role in behaviors that are motivated by both natural and drug rewards. We argue that the search for underlying neurochemical substrates of compulsive behaviors, as well as attempts to identify potential pharmacotherapeutic targets to combat them, must include a consideration of central cholinergic systems. Copyright © 2011 Elsevier Inc. All rights reserved.

Distinguishing between learning and motivation in behavioral tests of the reinforcement sensitivity theory of personality.

PubMed

Smillie, Luke D; Dalgleish, Len I; Jackson, Chris J

2007-04-01

According to Gray's (1973) Reinforcement Sensitivity Theory (RST), a Behavioral Inhibition System (BIS) and a Behavioral Activation System (BAS) mediate effects of goal conflict and reward on behavior. BIS functioning has been linked with individual differences in trait anxiety and BAS functioning with individual differences in trait impulsivity. In this article, it is argued that behavioral outputs of the BIS and BAS can be distinguished in terms of learning and motivation processes and that these can be operationalized using the Signal Detection Theory measures of response-sensitivity and response-bias. In Experiment 1, two measures of BIS-reactivity predicted increased response-sensitivity under goal conflict, whereas one measure of BAS-reactivity predicted increased response-sensitivity under reward. In Experiment 2, two measures of BIS-reactivity predicted response-bias under goal conflict, whereas a measure of BAS-reactivity predicted motivation response-bias under reward. In both experiments, impulsivity measures did not predict criteria for BAS-reactivity as traditionally predicted by RST.

Successful inhibitory control over an immediate reward is associated with attentional disengagement in visual processing areas.

PubMed

O'Connor, David A; Rossiter, Sarah; Yücel, Murat; Lubman, Dan I; Hester, Robert

2012-09-01

We examined the neural basis of the capacity to resist an immediately rewarding stimulus in order to obtain a larger delayed reward. This was investigated with a Go/No-go task employing No-go targets that provided two types of reward outcomes. These were contingent on inhibitory control performance: failure to inhibit Reward No-go targets provided a small monetary reward with immediate feedback; while successful inhibitory control resulted in larger rewards with delayed feedback based on the highest number of consecutive inhibitions. We observed faster Go trial responses with maintained levels of inhibition accuracy during the Reward No-go condition compared to a neutral No-go condition. Comparisons between conditions of BOLD activity showed successful inhibitory control over rewarding No-Go targets was associated with hypoactivity in regions previously associated with regulating emotion and inhibitory control, including insula and right inferior frontal gyrus. In addition, regions previously associated with visual processing centers that are modulated as a function of visual attention, namely the left fusiform and right superior temporal gyri, were hypoactive. These findings suggest a role for attentional disengagement as an aid to withholding response over a rewarding stimulus and are consistent with the notion that gratification can be delayed by directing attention away from immediate rewards. Crown Copyright © 2012. Published by Elsevier Inc. All rights reserved.

Nucleus Accumbens Shell Dopamine Preferentially Tracks Information Related to Outcome Value of Reward.

PubMed

Sackett, Deirdre A; Saddoris, Michael P; Carelli, Regina M

2017-01-01

Effective decision-making requires organisms to predict reward values and bias behavior toward the best available option. The mesolimbic dopamine system, including the nucleus accumbens (NAc) shell and core, is involved in this process. Although studies support a role of the shell and core in specific aspects of decision-making (e.g., risk, effort, delay), no studies have directly compared dopamine release dynamics in these subregions to cues exclusively signaling the availability of different reward magnitudes. Here, fast-scan cyclic voltammetry was used to compare rapid dopamine release dynamics in the NAc subregions during a magnitude-based decision-making task. Rats learned that distinct cues signaled the availability of either a small or large reward (one or two sugar pellets), and then were given an opportunity to choose their preferred option. We found that peak dopamine release tracked the more preferred (higher-magnitude) option in both core and shell subregions. Critically, however, overall (i.e., global) dopamine release was significantly higher and longer lasting in the shell and tracked the preferred magnitude during the entire cue period. Further, in the shell (not core), dopamine signaling significantly declined immediately at the lever press for reward but increased during the period of reward consumption. Collectively, the results indicate that although dopamine release in both the core and shell are activated by cues signaling the opportunity to respond for rewards of different magnitudes, dopamine release in the shell plays a differential and unique role in tracking information related to the outcome value of reward.

Acute D3 Antagonist GSK598809 Selectively Enhances Neural Response During Monetary Reward Anticipation in Drug and Alcohol Dependence

PubMed Central

Murphy, Anna; Nestor, Liam J; McGonigle, John; Paterson, Louise; Boyapati, Venkataramana; Ersche, Karen D; Flechais, Remy; Kuchibatla, Shankar; Metastasio, Antonio; Orban, Csaba; Passetti, Filippo; Reed, Laurence; Smith, Dana; Suckling, John; Taylor, Eleanor; Robbins, Trevor W; Lingford-Hughes, Anne; Nutt, David J; Deakin, John FW; Elliott, Rebecca

2017-01-01

Evidence suggests that disturbances in neurobiological mechanisms of reward and inhibitory control maintain addiction and provoke relapse during abstinence. Abnormalities within the dopamine system may contribute to these disturbances and pharmacologically targeting the D3 dopamine receptor (DRD3) is therefore of significant clinical interest. We used functional magnetic resonance imaging to investigate the acute effects of the DRD3 antagonist GSK598809 on anticipatory reward processing, using the monetary incentive delay task (MIDT), and response inhibition using the Go/No-Go task (GNGT). A double-blind, placebo-controlled, crossover design approach was used in abstinent alcohol dependent, abstinent poly-drug dependent and healthy control volunteers. For the MIDT, there was evidence of blunted ventral striatal response to reward in the poly-drug-dependent group under placebo. GSK598809 normalized ventral striatal reward response and enhanced response in the DRD3-rich regions of the ventral pallidum and substantia nigra. Exploratory investigations suggested that the effects of GSK598809 were mainly driven by those with primary dependence on alcohol but not on opiates. Taken together, these findings suggest that GSK598809 may remediate reward deficits in substance dependence. For the GNGT, enhanced response in the inferior frontal cortex of the poly-drug group was found. However, there were no effects of GSK598809 on the neural network underlying response inhibition nor were there any behavioral drug effects on response inhibition. GSK598809 modulated the neural network underlying reward anticipation but not response inhibition, suggesting that DRD3 antagonists may restore reward deficits in addiction. PMID:28042871

Revisiting the Role of Rewards in Motivation and Learning: Implications of Neuroscientific Research

ERIC Educational Resources Information Center

Hidi, Suzanne

2016-01-01

Rewards have been examined extensively by both psychologists and neuorscientists and have become one of the most contentious issues in social and educational psychology. In psychological research, reward processing has typically been studied in relation to behavioral outcomes. In contrast, neuroscientists have been examining how rewards are…

Monetary incentives at retrieval promote recognition of involuntarily learned emotional information.

PubMed

Yan, Chunping; Li, Yunyun; Zhang, Qin; Cui, Lixia

2018-03-07

Previous studies have suggested that the effects of reward on memory processes are affected by certain factors, but it remains unclear whether the effects of reward at retrieval on recognition processes are influenced by emotion. The event-related potential was used to investigate the combined effect of reward and emotion on memory retrieval and its neural mechanism. The behavioral results indicated that the reward at retrieval improved recognition performance under positive and negative emotional conditions. The event-related potential results indicated that there were significant interactions between the reward and emotion in the average amplitude during recognition, and the significant reward effects from the frontal to parietal brain areas appeared at 130-800 ms for positive pictures and at 190-800 ms for negative pictures, but there were no significant reward effects of neutral pictures; the reward effect of positive items appeared relatively earlier, starting at 130 ms, and that of negative pictures began at 190 ms. These results indicate that monetary incentives at retrieval promote recognition of involuntarily learned emotional information.

Impairment of probabilistic reward-based learning in schizophrenia.

PubMed

Weiler, Julia A; Bellebaum, Christian; Brüne, Martin; Juckel, Georg; Daum, Irene

2009-09-01

Recent models assume that some symptoms of schizophrenia originate from defective reward processing mechanisms. Understanding the precise nature of reward-based learning impairments might thus make an important contribution to the understanding of schizophrenia and the development of treatment strategies. The present study investigated several features of probabilistic reward-based stimulus association learning, namely the acquisition of initial contingencies, reversal learning, generalization abilities, and the effects of reward magnitude. Compared to healthy controls, individuals with schizophrenia exhibited attenuated overall performance during acquisition, whereas learning rates across blocks were similar to the rates of controls. On the group level, persons with schizophrenia were, however, unable to learn the reversal of the initial reward contingencies. Exploratory analysis of only the subgroup of individuals with schizophrenia who showed significant learning during acquisition yielded deficits in reversal learning with low reward magnitudes only. There was further evidence of a mild generalization impairment of the persons with schizophrenia in an acquired equivalence task. In summary, although there was evidence of intact basic processing of reward magnitudes, individuals with schizophrenia were impaired at using this feedback for the adaptive guidance of behavior.

Employee Compensation.

ERIC Educational Resources Information Center

Osif, Bonnie A.; Harwood, Richard L.

1995-01-01

Presents an overview of selected literature about employee compensation. Highlights include the foundations of reward and recognition systems, incentive plans, problems with merit pay, a historical perspective on performance pay, evaluation criteria and processes, self-rating, job motivation and satisfaction, employee attitudes, collective…

Food reward system: current perspectives and future research needs.

PubMed

Alonso-Alonso, Miguel; Woods, Stephen C; Pelchat, Marcia; Grigson, Patricia Sue; Stice, Eric; Farooqi, Sadaf; Khoo, Chor San; Mattes, Richard D; Beauchamp, Gary K

2015-05-01

This article reviews current research and cross-disciplinary perspectives on the neuroscience of food reward in animals and humans, examines the scientific hypothesis of food addiction, discusses methodological and terminology challenges, and identifies knowledge gaps and future research needs. Topics addressed herein include the role of reward and hedonic aspects in the regulation of food intake, neuroanatomy and neurobiology of the reward system in animals and humans, responsivity of the brain reward system to palatable foods and drugs, translation of craving versus addiction, and cognitive control of food reward. The content is based on a workshop held in 2013 by the North American Branch of the International Life Sciences Institute. © The Author(s) 2015. Published by Oxford University Press on behalf of the International Life Sciences Institute.

Motivation and effort in individuals with social anhedonia

PubMed Central

McCarthy, Julie M.; Treadway, Michael T.; Blanchard, Jack J.

2015-01-01

It has been proposed that anhedonia may, in part, reflect difficulties in reward processing and effortful decision-making. The current study aimed to replicate previous findings of effortful decision-making deficits associated with elevated anhedonia and expand upon these findings by investigating whether these decision-making deficits are specific to elevated social anhedonia or are also associated with elevated positive schizotypy characteristics. The current study compared controls (n = 40) to individuals elevated on social anhedonia (n = 30), and individuals elevated on perceptual aberration/magical ideation (n = 30) on the Effort Expenditure for Rewards Task (EEfRT). Across groups, participants chose a higher proportion of hard tasks with increasing probability of reward and reward magnitude, demonstrating sensitivity to probability and reward values. Contrary to our expectations, when the probability of reward was most uncertain (50% probability), at low and medium reward values, the social anhedonia group demonstrated more effortful decision-making than either individuals high in positive schizotypy or controls. The positive schizotypy group only differed from controls (making less effortful choices than controls) when reward probability was lowest (12%) and the magnitude of reward was the smallest. Our results suggest that social anhedonia is related to intact motivation and effort for monetary rewards, but that individuals with this characteristic display a unique and perhaps inefficient pattern of effort allocation when the probability of reward is most uncertain. Future research is needed to better understand effortful decision-making and the processing of reward across a range of individual difference characteristics. PMID:25888337

Condition interference in rats performing a choice task with switched variable- and fixed-reward conditions.

PubMed

Funamizu, Akihiro; Ito, Makoto; Doya, Kenji; Kanzaki, Ryohei; Takahashi, Hirokazu

2015-01-01

Because humans and animals encounter various situations, the ability to adaptively decide upon responses to any situation is essential. To date, however, decision processes and the underlying neural substrates have been investigated under specific conditions; thus, little is known about how various conditions influence one another in these processes. In this study, we designed a binary choice task with variable- and fixed-reward conditions and investigated neural activities of the prelimbic cortex and dorsomedial striatum in rats. Variable- and fixed-reward conditions induced flexible and inflexible behaviors, respectively; one of the two conditions was randomly assigned in each trial for testing the possibility of condition interference. Rats were successfully conditioned such that they could find the better reward holes of variable-reward-condition and fixed-reward-condition trials. A learning interference model, which updated expected rewards (i.e., values) used in variable-reward-condition trials on the basis of combined experiences of both conditions, better fit choice behaviors than conventional models which updated values in each condition independently. Thus, although rats distinguished the trial condition, they updated values in a condition-interference manner. Our electrophysiological study suggests that this interfering value-updating is mediated by the prelimbic cortex and dorsomedial striatum. First, some prelimbic cortical and striatal neurons represented the action-reward associations irrespective of trial conditions. Second, the striatal neurons kept tracking the values of variable-reward condition even in fixed-reward-condition trials, such that values were possibly interferingly updated even in the fixed-reward condition.

Working Memory Load Strengthens Reward Prediction Errors.

PubMed

Collins, Anne G E; Ciullo, Brittany; Frank, Michael J; Badre, David

2017-04-19

Reinforcement learning (RL) in simple instrumental tasks is usually modeled as a monolithic process in which reward prediction errors (RPEs) are used to update expected values of choice options. This modeling ignores the different contributions of different memory and decision-making systems thought to contribute even to simple learning. In an fMRI experiment, we investigated how working memory (WM) and incremental RL processes interact to guide human learning. WM load was manipulated by varying the number of stimuli to be learned across blocks. Behavioral results and computational modeling confirmed that learning was best explained as a mixture of two mechanisms: a fast, capacity-limited, and delay-sensitive WM process together with slower RL. Model-based analysis of fMRI data showed that striatum and lateral prefrontal cortex were sensitive to RPE, as shown previously, but, critically, these signals were reduced when the learning problem was within capacity of WM. The degree of this neural interaction related to individual differences in the use of WM to guide behavioral learning. These results indicate that the two systems do not process information independently, but rather interact during learning. SIGNIFICANCE STATEMENT Reinforcement learning (RL) theory has been remarkably productive at improving our understanding of instrumental learning as well as dopaminergic and striatal network function across many mammalian species. However, this neural network is only one contributor to human learning and other mechanisms such as prefrontal cortex working memory also play a key role. Our results also show that these other players interact with the dopaminergic RL system, interfering with its key computation of reward prediction errors. Copyright © 2017 the authors 0270-6474/17/374332-11$15.00/0.

Gene expression changes in a zebrafish model of drug dependency suggest conservation of neuro-adaptation pathways.

PubMed

Kily, Layla J M; Cowe, Yuka C M; Hussain, Osman; Patel, Salma; McElwaine, Suzanne; Cotter, Finbarr E; Brennan, Caroline H

2008-05-01

Addiction is a complex psychiatric disorder considered to be a disease of the brain's natural reward reinforcement system. Repeated stimulation of the 'reward' pathway leads to adaptive changes in gene expression and synaptic organization that reinforce drug taking and underlie long-term changes in behaviour. The primitive nature of reward reinforcement pathways and the near universal ability of abused drugs to target the same system allow drug-associated reward and reinforcement to be studied in non-mammalian species. Zebrafish have proved to be a valuable model system for the study of vertebrate development and disease. Here we demonstrate that adult zebrafish show a dose-dependent acute conditioned place preference (CPP) reinforcement response to ethanol or nicotine. Repeated exposure of adult zebrafish to either nicotine or ethanol leads to a robust CPP response that persists following 3 weeks of abstinence and in the face of adverse stimuli, a behavioural indicator of the establishment of dependence. Microarray analysis using whole brain samples from drug-treated and control zebrafish identified 1362 genes that show a significant change in expression between control and treated individuals. Of these genes, 153 are common to both ethanol- and nicotine-treated animals. These genes include members of pathways and processes implicated in drug dependence in mammalian models, revealing conservation of neuro-adaptation pathways between zebrafish and mammals.

Opponent appetitive-aversive neural processes underlie predictive learning of pain relief.

PubMed

Seymour, Ben; O'Doherty, John P; Koltzenburg, Martin; Wiech, Katja; Frackowiak, Richard; Friston, Karl; Dolan, Raymond

2005-09-01

Termination of a painful or unpleasant event can be rewarding. However, whether the brain treats relief in a similar way as it treats natural reward is unclear, and the neural processes that underlie its representation as a motivational goal remain poorly understood. We used fMRI (functional magnetic resonance imaging) to investigate how humans learn to generate expectations of pain relief. Using a pavlovian conditioning procedure, we show that subjects experiencing prolonged experimentally induced pain can be conditioned to predict pain relief. This proceeds in a manner consistent with contemporary reward-learning theory (average reward/loss reinforcement learning), reflected by neural activity in the amygdala and midbrain. Furthermore, these reward-like learning signals are mirrored by opposite aversion-like signals in lateral orbitofrontal cortex and anterior cingulate cortex. This dual coding has parallels to 'opponent process' theories in psychology and promotes a formal account of prediction and expectation during pain.

Reward acts on the pFC to enhance distractor resistance of working memory representations.

PubMed

Fallon, Sean James; Cools, Roshan

2014-12-01

Working memory and reward processing are often thought to be separate, unrelated processes. However, most daily activities involve integrating these two types of information, and the two processes rarely, if ever, occur in isolation. Here, we show that working memory and reward interact in a task-dependent manner and that this task-dependent interaction involves modulation of the pFC by the ventral striatum. Specifically, BOLD signal during gains relative to losses in the ventral striatum and pFC was associated not only with enhanced distractor resistance but also with impairment in the ability to update working memory representations. Furthermore, the effect of reward on working memory was accompanied by differential coupling between the ventral striatum and ignore-related regions in the pFC. Together, these data demonstrate that reward-related signals modulate the balance between cognitive stability and cognitive flexibility by altering functional coupling between the ventral striatum and the pFC.

Registered nurses' experiences of rewarding in a Finnish University Hospital - an interview study.

PubMed

Seitovirta, Jaana; Partanen, Pirjo; Vehviläinen-Julkunen, Katri; Kvist, Tarja

2015-10-01

The purpose was to describe Finnish registered nurses' experiences of rewarding. The aim was to gather detailed information on the rewarding of nurses to help nurse managers and leaders to update existing reward strategy and to develop an effective reward system. Rewarding has been found positively to influence nurses' occupational well-being and commitment to their work, and the attractiveness of the health care field. A series of focused interviews with 10 registered nurses was conducted in 2011. Qualitative content analysis method was used. The nurses reported positive experiences with rewarding in the form of monetary compensation and other benefits, the positive aspects of nursing work and opportunities for professional development. The experiences of unsatisfactory rewarding generally stemmed from negative emotional experiences, lacking rewards and inequality in rewarding. It is essential to listen to nurses and to provide appropriate acknowledgement and appreciation of their work in order to develop an effective reward system. It is important to listen to nurses' experiences of rewarding because it enables nurse managers to maintain and increase the attractiveness of nursing and health care work in general. © 2014 John Wiley & Sons Ltd.

Pain and suicidality: insights from reward and addiction neuroscience.

PubMed

Elman, Igor; Borsook, David; Volkow, Nora D

2013-10-01

Suicidality is exceedingly prevalent in pain patients. Although the pathophysiology of this link remains unclear, it may be potentially related to the partial congruence of physical and emotional pain systems. The latter system's role in suicide is also conspicuous during setbacks and losses sustained in the context of social attachments. Here we propose a model based on the neural pathways mediating reward and anti-reward (i.e., allostatic adjustment to recurrent activation of the reward circuitry); both are relevant etiologic factors in pain, suicide and social attachments. A comprehensive literature search on neurobiology of pain and suicidality was performed. The collected articles were critically reviewed and relevant data were extracted and summarized within four key areas: (1) physical and emotional pain, (2) emotional pain and social attachments, (3) pain- and suicide-related alterations of the reward and anti-reward circuits as compared to addiction, which is the premier probe for dysfunction of these circuits and (4) mechanistically informed treatments of co-occurring pain and suicidality. Pain-, stress- and analgesic drugs-induced opponent and proponent states of the mesolimbic dopaminergic pathways may render reward and anti-reward systems vulnerable to sensitization, cross-sensitization and aberrant learning of contents and contexts associated with suicidal acts and behaviors. These findings suggest that pain patients exhibit alterations in the brain circuits mediating reward (depressed function) and anti-reward (sensitized function) that may affect their proclivity for suicide and support pain and suicidality classification among other "reward deficiency syndromes" and a new proposal for "enhanced anti-reward syndromes". We suggest that interventions aimed at restoring the balance between the reward and anti-reward networks in patients with chronic pain may help decreasing their suicide risk. Published by Elsevier Ltd.

The rewarding value of good motor performance in the context of monetary incentives.

PubMed

Lutz, Kai; Pedroni, Andreas; Nadig, Karin; Luechinger, Roger; Jäncke, Lutz

2012-07-01

Whether an agent receives positive task feedback or a monetary reward, neural activity in their striatum increases. In the latter case striatal activity reflects extrinsic reward processing, while in the former, striatal activity reflects the intrinsically rewarding effects of performing well. There can be a "hidden cost of reward", which is a detrimental effect of extrinsic on intrinsic reward value. This raises the question how these two types of reward interact. To address this, we applied a monetary incentive delay task: in all trials participants received feedback depending on their performance. In half of the trials they could additionally receive monetary reward if they performed well. This resulted in high performance trials, which were monetarily rewarded and high performance trials that were not. This made it possible to dissociate the neural correlates of performance feedback from the neural correlates of monetary reward that comes with high performance. Performance feedback alone elicits activation increases in the ventral striatum. This activation increases due to additional monetary reward. Neural response in the dorsal striatum on the other hand is only significantly increased by feedback when a monetary incentive is present. The quality of performance does not significantly influence dorsal striatum activity. In conclusion, our results indicate that the dorsal striatum is primarily sensitive to optional or actually received external rewards, whereas the ventral striatum may be coding intrinsic reward due to positive performance feedback. Thus the ventral striatum is suggested to be involved in the processing of intrinsically motivated behavior. Copyright © 2012 Elsevier Ltd. All rights reserved.

A Tribute to Charlie Chaplin: Induced Positive Affect Improves Reward-Based Decision-Learning in Parkinson’s Disease

PubMed Central

Ridderinkhof, K. Richard; van Wouwe, Nelleke C.; Band, Guido P. H.; Wylie, Scott A.; Van der Stigchel, Stefan; van Hees, Pieter; Buitenweg, Jessika; van de Vijver, Irene; van den Wildenberg, Wery P. M.

2012-01-01

Reward-based decision-learning refers to the process of learning to select those actions that lead to rewards while avoiding actions that lead to punishments. This process, known to rely on dopaminergic activity in striatal brain regions, is compromised in Parkinson’s disease (PD). We hypothesized that such decision-learning deficits are alleviated by induced positive affect, which is thought to incur transient boosts in midbrain and striatal dopaminergic activity. Computational measures of probabilistic reward-based decision-learning were determined for 51 patients diagnosed with PD. Previous work has shown these measures to rely on the nucleus caudatus (outcome evaluation during the early phases of learning) and the putamen (reward prediction during later phases of learning). We observed that induced positive affect facilitated learning, through its effects on reward prediction rather than outcome evaluation. Viewing a few minutes of comedy clips served to remedy dopamine-related problems associated with frontostriatal circuitry and, consequently, learning to predict which actions will yield reward. PMID:22707944

Advancing Engaged Scholarship in Promotion and Tenure: A Roadmap and Call for Reform

ERIC Educational Resources Information Center

O'Meara, KerryAnn; Eatman, Timothy; Petersen, Saul

2015-01-01

Despite the precipitous increase in nontenure-track faculty appointments, the promotion and tenure process continues to operate as a central "motivational and cultural force in the academic lives" of many faculty members. As a part of larger reward systems, the promotion and tenure process reflects institutional values, aspirations,…

Anticipatory Pleasure Predicts Motivation for Reward in Major Depression

PubMed Central

Sherdell, Lindsey; Waugh, Christian E.; Gotlib, Ian H.

2012-01-01

Anhedonia, the lack of interest or pleasure in response to hedonic stimuli or experiences, is a cardinal symptom of depression. This deficit in hedonic processing has been posited to influence depressed individuals’ motivation to engage in potentially rewarding experiences. Accumulating evidence indicates that hedonic processing is not a unitary construct but rather consists of an anticipatory and a consummatory phase. We examined how these components of hedonic processing influence motivation to obtain reward in participants diagnosed with major depression and in never-disordered controls. Thirty-eight currently depressed and 30 never-disordered control participants rated their liking of humorous and nonhumorous cartoons and then made a series of choices between viewing a cartoon from either group. Each choice was associated with a specified amount of effort participants would have to exert before viewing the chosen cartoon. Although depressed and control participants did not differ in their consummatory liking of the rewards, levels of reward liking predicted motivation to expend effort for the rewards only in the control participants; in the depressed participants, liking and motivation were dissociated. In the depressed group, levels of anticipatory anhedonia predicted motivation to exert effort for the rewards. These findings support the formulation that anhedonia is not a unitary construct and suggest that, for depressed individuals, deficits in motivation for reward are driven primarily by low anticipatory pleasure and not by decreased consummatory liking. PMID:21842963

How Has the Internet Reshaped Human Cognition?

PubMed

Loh, Kep Kee; Kanai, Ryota

2016-10-01

Throughout our evolutionary history, our cognitive systems have been altered by the advent of technological inventions such as primitive tools, spoken language, writing, and arithmetic systems. Thirty years ago, the Internet surfaced as the latest technological invention poised to deeply reshape human cognition. With its multifaceted affordances, the Internet environment has profoundly transformed our thoughts and behaviors. Growing up with Internet technologies, "Digital Natives" gravitate toward "shallow" information processing behaviors characterized by rapid attention shifting and reduced deliberations. They engage in increased multitasking behaviors that are linked to increased distractibility and poor executive control abilities. Digital natives also exhibit higher prevalence of Internet-related addictive behaviors that reflect altered reward-processing and self-control mechanisms. Recent neuroimaging investigations have suggested associations between these Internet-related cognitive impacts and structural changes in the brain. Against mounting apprehension over the Internet's consequences on our cognitive systems, several researchers have lamented that these concerns were often exaggerated beyond existing scientific evidence. In the present review, we aim to provide an objective overview of the Internet's impacts on our cognitive systems. We critically discuss current empirical evidence about how the Internet environment has altered the cognitive behaviors and structures involved in information processing, executive control, and reward-processing. © The Author(s) 2015.

A Developmental Perspective on Neuroeconomic Mechanisms of Contingency Management

PubMed Central

Stanger, Catherine; Budney, Alan J.; Bickel, Warren K.

2012-01-01

This paper provides a developmental overview of relevant theory and research on delay discounting and neuroeconomics, and their implications for CM approaches to treatment. Recent advances in neuroscience, and in particular the neuroscience of decision making, have the potential to inform treatment development for adolescent substance use in general, and contingency management (CM) treatments in particular. CM utilizes abstinence-based reinforcement to enhance motivation to engage in treatment and engender abstinence. CM interventions may be informed by research on delay discounting, a type of decision making that reflects how individuals value immediate vs. delayed rewards. Delay discounting reliably distinguishes substance abusers from non abusers and is a significant predictor of individual differences in response to substance use treatments. Delay discounting is also of high potential importance in the development of substance use problems in adolescence. Discounting may also be important in predicting response to CM, as CM attempts to directly influence this decision making process, shifting the preference from the immediate rewards of use to delayed rewards for choosing not to use. Multiple neural processes underlie decision making, and those processes have implications for adolescent substance abuse. There are significant neurodevelopmental processes that differentiate adolescents from adults. These processes are implicated in delay discounting, suggesting that adolescence may reflect a period of plasticity in temporal decision making. Understanding the neural mechanisms of delay discounting has led to promising working memory interventions directly targeting the executive functions that underlie individual choices. These interventions may be particularly helpful in combination with CM interventions that offer immediate rewards for brief periods of abstinence, and may show particular benefit in adolescence due to the heightened neural plasticity of systems that underlie temporal discounting in adolescence. PMID:22663343

Temporal dynamics of reward anticipation in the human brain.

PubMed

Zhang, Yuanyuan; Li, Qi; Wang, Zhao; Liu, Xun; Zheng, Ya

2017-09-01

Reward anticipation is a complex process including cue evaluation, motor preparation, and feedback anticipation. The present study investigated whether these psychological processes were dissociable on neural dynamics in terms of incentive valence and approach motivation. We recorded EEG when participants were performing a monetary incentive delay task, and found a cue-P3 during the cue-evaluation stage, a contingent negative variation (CNV) during the motor-preparation stage, and a stimulus-preceding negativity (SPN) during the feedback-anticipation stage. Critically, both the cue-P3 and SPN exhibited an enhanced sensitivity to gain versus loss anticipation, which was not observed for the CNV. Moreover, both the cue-P3 and SPN, instead of the CNV, for gain anticipation selectively predicted the participants' approach motivation as measured in a following effort expenditure for rewards task, particularly when reward uncertainty was maximal. Together, these results indicate that reward anticipation consists of several sub-stages, each with distinct functional significance, thus providing implications for neuropsychiatric diseases characterized by dysfunction in anticipatory reward processing. Copyright © 2017 Elsevier B.V. All rights reserved.

The role of the central ghrelin system in reward from food and chemical drugs.

PubMed

Dickson, Suzanne L; Egecioglu, Emil; Landgren, Sara; Skibicka, Karolina P; Engel, Jörgen A; Jerlhag, Elisabet

2011-06-20

Here we review recent advances that identify a role for the central ghrelin signalling system in reward from both natural rewards (such as food) and artificial rewards (that include alcohol and drugs of abuse). Whereas ghrelin emerged as a stomach-derived hormone involved in energy balance, hunger and meal initiation via hypothalamic circuits, it now seems clear that it also has a role in motivated reward-driven behaviours via activation of the so-called "cholinergic-dopaminergic reward link". This reward link comprises a dopamine projection from the ventral tegmental area (VTA) to the nucleus accumbens together with a cholinergic input, arising primarily from the laterodorsal tegmental area. Ghrelin administration into the VTA or LDTg activates the "cholinergic-dopaminergic" reward link, suggesting that ghrelin may increase the incentive value of motivated behaviours such as reward-seeking behaviour ("wanting" or "incentive motivation"). Further, direct injection of ghrelin into the brain ventricles or into the VTA increases the consumption of rewarding foods as well as alcohol in mice and rats. Studies in rodents show beneficial effects of ghrelin receptor (GHS-R1A) antagonists to suppress the intake of palatable food, to reduce preference for caloric foods, to suppress food reward and motivated behaviour for food. They have also been shown to reduce alcohol consumption, suppress reward induced by alcohol, cocaine and amphetamine. Furthermore, variations in the GHS-R1A and pro-ghrelin genes have been associated with high alcohol consumption, smoking and increased weight gain in alcohol dependent individuals as well as with bulimia nervosa and obesity. Thus, the central ghrelin signalling system interfaces neurobiological circuits involved in reward from food as well as chemical drugs; agents that directly or indirectly suppress this system emerge as potential candidate drugs for suppressing problematic over-eating that leads to obesity as well as for the treatment of substance use disorder. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Developmental Effects of Incentives on Response Inhibition

PubMed Central

Geier, Charles F.; Luna, Beatriz

2012-01-01

Inhibitory control and incentive processes underlie decision-making, yet few studies have explicitly examined their interaction across development. Here, the effects of potential rewards and losses on inhibitory control in sixty-four adolescents (13-17-year-olds) and forty-two young adults (18-29-year-olds) were examined using an incentivized antisaccade task. Notably, measures were implemented to minimize age-related differences in reward valuation and potentially confounding motivation effects. Incentives affected antisaccade metrics differently across the age groups. Younger adolescents generated more errors than adults on reward trials, but all groups performed well on loss trials. Adolescent saccade latencies also differed from adults across the range of reward trials. Overall, results suggest persistent immaturities in the integration of reward and inhibitory control processes across adolescence. PMID:22540668

Event-related brain potentials and the study of reward processing: Methodological considerations.

PubMed

Krigolson, Olave E

2017-11-14

There is growing interest in using electroencephalography and specifically the event-related brain potential (ERP) methodology to study human reward processing. Since the discovery of the feedback related negativity (Miltner et al., 1997) and the development of theories associating the feedback related negativity and more recently the reward positivity with reinforcement learning, midbrain dopamine function, and the anterior cingulate cortex (i.e., Holroyd and Coles, 2002) researchers have used the ERP methodology to probe the neural basis of reward learning in humans. However, examination of the feedback related negativity and the reward positivity cannot be done without an understanding of some key methodological issues that must be taken into account when using ERPs and examining these ERP components. For example, even the component name - the feedback related negativity - is a source of debate within the research community as some now strongly feel that the component should be named the reward positivity (Proudfit, 2015). Here, ten key methodological issues are discussed - confusion in component naming, the reward positivity, component identification, peak quantification and the use of difference waveforms, frequency (the N200) and component contamination (the P300), the impact of feedback timing, action, and task learnability, and how learning results in changes in the amplitude of the feedback-related negativity/reward positivity. The hope here is to not provide a definitive approach for examining the feedback related negativity/reward positivity, but instead to outline the key issues that must be taken into account when examining this component to assist researchers in their study of human reward processing with the ERP methodology. Copyright © 2017 Elsevier B.V. All rights reserved.

Drug-seeking behavior in an invertebrate system: evidence of morphine-induced reward, extinction and reinstatement in crayfish

PubMed Central

Nathaniel, Thomas I.; Panksepp, Jules; Huber, Robert

2009-01-01

Several lines of evidence suggest that exploring the neurochemical basis of reward in invertebrate species may provide clues for the fundamental behavioral and neurobiology underpinnings of drug addiction. How the presence of drug-sensitive reward relates to a decrease in drug-seeking behavior and reinstatement of drug seeking behavior in invertebrate systems is not known. The present study of a conditioned place preference (CPP) paradigm in crayfish (Orconectes rusticus) explores morphine-induced reward, extinction and reinstatement. Repeated intra-circulatory infusions of 2.5μg/g, 5.0μg/g and 10.0μg/g doses of morphine over 5 days serve as a reward when paired with a distinct visual or tactile environment. Morphine-induced CPP was extinguished after repeated saline injections for 5 days in the previously morphine-paired compartment. After the previously established CPP had been eliminated during the extinction phase, morphine-experienced crayfish were challenged with 2.5 μg/g, 5.0 μg/g and 10.0 μg/g respectively. The priming injections of morphine reinstated CPP in all training doses, suggesting that morphine-induced CPP is unrelenting, and that with time, it can be reinstated by morphine following extinction in an invertebrate model just like in mammals. Together with other recent studies, this work demonstrates the advantage of using crayfish as an invertebrate animal model to investigate the basic biological processes that underline exposure to mammalian drugs of abuse. PMID:18822319

The endocannabinoid system and nondrug rewarding behaviours.

PubMed

Fattore, Liana; Melis, Miriam; Fadda, Paola; Pistis, Marco; Fratta, Walter

2010-07-01

Rewarding behaviours such as sexual activity, eating, nursing, parenting, social interactions, and play activity are conserved strongly in evolution, and they are essential for development and survival. All of these behaviours are enjoyable and represent pleasant experiences with a high reward value. Remarkably, rewarding behaviours activate the same brain circuits that mediate the positive reinforcing effects of drugs of abuse and of other forms of addiction, such as gambling and food addiction. Given the involvement of the endocannabinoid system in a variety of physiological functions of the nervous system, it is not surprising that it takes part in the complex machinery that regulates gratification and perception of pleasure. In this review, we focus first on the role of the endocannabinoid system in the modulation of neural activity and synaptic functions in brain regions that are involved in natural and nonnatural rewards (namely, the ventral tegmental area, striatum, amygdala, and prefrontal cortex). Then, we examine the role of the endocannabinoid system in modulating behaviours that directly or indirectly activate these brain reward pathways. More specifically, current knowledge of the effects of the pharmacological manipulation of the endocannabinoid system on natural (eating, sexual behaviour, parenting, and social play) and pathological (gambling) rewarding behaviours is summarised and discussed. Copyright 2010 Elsevier Inc. All rights reserved.

Pathological gambling and alcohol dependence: neural disturbances in reward and loss avoidance processing.

PubMed

Romanczuk-Seiferth, Nina; Koehler, Saskia; Dreesen, Caspar; Wüstenberg, Torsten; Heinz, Andreas

2015-05-01

Pathological gambling (PG) shares clinical characteristics such as craving and loss of control with substance use disorders and is thus considered a behavioral addiction. While functional alterations in the mesolimbic reward system have been correlated with craving and relapse in substance use disorders, only a few studies have examined this brain circuit in PG, and no direct comparison has been conducted so far. Thus, we investigated the neuronal correlates of reward processing in PG in contrast to alcohol-dependent (AD) patients and healthy subjects. Eighteen PG patients, 15 AD patients and 17 controls were investigated with a monetary incentive delay task, in which visual cues predict the consequence (monetary gain, avoidance of loss, none) of a fast response to a subsequent target stimulus. Functional magnetic resonance imaging data were analyzed to account for possible confounding factors such as local gray matter volume. Activity in the right ventral striatum during loss anticipation was increased in PG patients compared with controls and AD patients. Moreover, PG patients showed decreased activation in the right ventral striatum and right medial prefrontal cortex during successful loss avoidance compared with controls, which was inversely associated with severity of gambling behavior. Thus, despite neurobiological similarities to substance use disorders in reward processing, as reported by previous studies, we found relevant differences with respect to the anticipation of loss as well as its avoidance (negative reinforcement), which further contributes to the understanding of PG. © 2014 Society for the Study of Addiction.

Rewards and advancements for clinical pharmacists.

PubMed

Goodwin, S Diane; Kane-Gill, Sandra L; Ng, Tien M H; Melroy, Joel T; Hess, Mary M; Tallian, Kimberly; Trujillo, Toby C; Vermeulen, Lee C

2010-01-01

The American College of Clinical Pharmacy charged the Clinical Practice Affairs Committee to review and update the College's 1995 White Paper, "Rewards and Advancements for Clinical Pharmacy Practitioners." Because of the limited data on the present state of rewards and advancements for clinical pharmacists, an online survey of "front-line" clinical pharmacists and pharmacy managers was conducted (1126 total respondents, 14% response rate). The resulting White Paper discusses motivators and existing systems of rewards and advancements for clinical pharmacists, as well as perceived barriers to implementation of these systems. Clinical pharmacists reported work-life balance, a challenging position, and opportunities for professional advancement as the most important factors for career success. At the time of the survey, financial rewards appeared not to be a major motivator for clinical pharmacists. Managers underestimated the importance that clinical pharmacists place on work-life balance and favorable work schedules. Although almost two thirds of the clinical pharmacists surveyed had not developed a professional development plan, 84% indicated an interest in career planning. Both clinical pharmacists and managers rated the lack of a clear reward and advancement structure as the most important barrier to effective systems of rewards and advancements. Pharmacy managers and administrators are encouraged to develop effective systems of rewards and advancements for clinical pharmacists that positively impact patient care and the institution's mission; these systems will benefit the clinical pharmacist, the health care institution, and the patient.

Failure analysis and modeling of a multicomputer system. M.S. Thesis

NASA Technical Reports Server (NTRS)

Subramani, Sujatha Srinivasan

1990-01-01

This thesis describes the results of an extensive measurement-based analysis of real error data collected from a 7-machine DEC VaxCluster multicomputer system. In addition to evaluating basic system error and failure characteristics, we develop reward models to analyze the impact of failures and errors on the system. The results show that, although 98 percent of errors in the shared resources recover, they result in 48 percent of all system failures. The analysis of rewards shows that the expected reward rate for the VaxCluster decreases to 0.5 in 100 days for a 3 out of 7 model, which is well over a 100 times that for a 7-out-of-7 model. A comparison of the reward rates for a range of k-out-of-n models indicates that the maximum increase in reward rate (0.25) occurs in going from the 6-out-of-7 model to the 5-out-of-7 model. The analysis also shows that software errors have the lowest reward (0.2 vs. 0.91 for network errors). The large loss in reward rate for software errors is due to the fact that a large proportion (94 percent) of software errors lead to failure. In comparison, the high reward rate for network errors is due to fast recovery from a majority of these errors (median recovery duration is 0 seconds).

Teasing apart the anticipatory and consummatory processing of monetary incentives: An event-related potential study of reward dynamics.

PubMed

Novak, Keisha D; Foti, Dan

2015-11-01

The monetary incentive delay (MID) task has been widely used in fMRI studies to investigate the neural networks involved in anticipatory and consummatory reward processing. Previous efforts to adapt the MID task for use with ERPs, however, have had limited success. Here, we sought to further decompose reward dynamics using a comprehensive set of anticipatory (cue-N2, cue-P3, contingent negative variation [CNV]) and consummatory ERPs (feedback negativity [FN], feedback P3 [fb-P3]). ERP data was recorded during adapted versions of the MID task across two experiments. Unlike previous studies, monetary incentive cues modulated the cue-N2, cue-P3, and CNV; however, cue-related ERPs and the CNV were uncorrelated with one another, indicating distinct anticipatory subprocesses. With regard to consummatory processing, FN amplitude primarily tracked outcome valence (reward vs. nonreward), whereas fb-P3 amplitude primarily tracked outcome salience (uncertain vs. certain). Independent modulation of the cue-P3 and fb-P3 was observed, indicating that these two P3 responses may uniquely capture the allocation of attention during anticipatory and consummatory reward processing, respectively. Overall, across two samples, consistent evidence of both anticipatory and consummatory ERP activity was observed on an adapted version of the MID paradigm, demonstrating for the first time how these ERP components may be integrated with one another to more fully characterize the time course of reward processing. This ERP-MID paradigm is well suited to parsing reward dynamics, and can be applied to both healthy and clinical populations. © 2015 Society for Psychophysiological Research.

Altered neural correlates of reward and loss processing during simulated slot-machine fMRI in pathological gambling and cocaine dependence☆

PubMed Central

Worhunsky, Patrick D.; Malison, Robert T.; Rogers, Robert D.; Potenza, Marc N.

2014-01-01

Background Individuals with gambling or substance-use disorders exhibit similar functional alterations in reward circuitry suggestive of a shared underlying vulnerability in addictive disorders. Additional research into common and unique alterations in reward-processing in substance-related and non-substance-related addictions may identify neural factors that could be targeted in treatment development for these disorders. Methods To investigate contextual reward-processing in pathological gambling, a slot-machine fMRI task was performed by three groups (with pathological gambling, cocaine dependence and neither disorder; N=24 each) to determine the extent to which two groups with addictions (non-substance-related and substance-related) showed similarities and differences with respect to each other and a non-addicted group during anticipatory periods and following the delivery of winning, losing and ‘near-miss’ outcomes. Results Individuals with pathological gambling or cocaine dependence compared to those with neither disorder exhibited exaggerated anticipatory activity in mesolimbic and ventrocortical regions, with pathological-gambling participants displaying greater positive possible-reward anticipation and cocaine-dependent participants displaying more negative certain-loss anticipation. Neither clinical sample exhibited medial frontal or striatal responses that were observed following near-miss outcomes in healthy comparison participants. Conclusions Alterations in anticipatory processing may be sensitive to the valence of rewards and content-disorder-specific. Common and unique findings in pathological gambling and cocaine dependence with respect to anticipatory reward and near-miss loss processing suggest shared and unique elements that might be targeted through behavioral or pharmacological interventions in the treatment of addictions. PMID:25448081

Medial prefrontal brain activation to anticipated reward and loss in obsessive–compulsive disorder☆

PubMed Central

Kaufmann, C.; Beucke, J.C.; Preuße, F.; Endrass, T.; Schlagenhauf, F.; Heinz, A.; Juckel, G.; Kathmann, N.

2013-01-01

Obsessive–compulsive disorder (OCD) is associated with dysfunctional brain activity in several regions which are also involved in the processing of motivational stimuli. Processing of reward and punishment appears to be of special importance to understand clinical symptoms. There is evidence for higher sensitivity to punishment in patients with OCD which raises the question how avoidance of punishment relates to activity within the brain's reward circuitry. We employed the monetary incentive delay task paradigm optimized for modeling the anticipation phase of immediate reward and punishment, in the context of a cross-sectional event-related FMRI study comparing OCD patients and healthy control participants (n = 19 in each group). While overall behavioral performance was similar in both groups, patients showed increased activation upon anticipated losses in a medial and superior frontal cortex region extending into the cingulate cortex, and decreased activation upon anticipated rewards. No evidence was found for altered activation of dorsal or ventral striatal regions. Patients also showed more delayed responses for anticipated rewards than for anticipated losses whereas the reverse was true in healthy participants. The medial prefrontal cortex has been shown to implement a domain-general process comprising negative affect, pain and cognitive control. This process uses information about punishment to control aversively motivated actions by integrating signals arriving from subcortical regions. Our results support the notion that OCD is associated with altered sensitivity to anticipated rewards and losses in a medial prefrontal region whereas there is no significant aberrant activation in ventral or dorsal striatal brain regions during processing of reinforcement anticipation. PMID:24179774

Medial prefrontal brain activation to anticipated reward and loss in obsessive-compulsive disorder.

PubMed

Kaufmann, C; Beucke, J C; Preuße, F; Endrass, T; Schlagenhauf, F; Heinz, A; Juckel, G; Kathmann, N

2013-01-01

Obsessive-compulsive disorder (OCD) is associated with dysfunctional brain activity in several regions which are also involved in the processing of motivational stimuli. Processing of reward and punishment appears to be of special importance to understand clinical symptoms. There is evidence for higher sensitivity to punishment in patients with OCD which raises the question how avoidance of punishment relates to activity within the brain's reward circuitry. We employed the monetary incentive delay task paradigm optimized for modeling the anticipation phase of immediate reward and punishment, in the context of a cross-sectional event-related FMRI study comparing OCD patients and healthy control participants (n = 19 in each group). While overall behavioral performance was similar in both groups, patients showed increased activation upon anticipated losses in a medial and superior frontal cortex region extending into the cingulate cortex, and decreased activation upon anticipated rewards. No evidence was found for altered activation of dorsal or ventral striatal regions. Patients also showed more delayed responses for anticipated rewards than for anticipated losses whereas the reverse was true in healthy participants. The medial prefrontal cortex has been shown to implement a domain-general process comprising negative affect, pain and cognitive control. This process uses information about punishment to control aversively motivated actions by integrating signals arriving from subcortical regions. Our results support the notion that OCD is associated with altered sensitivity to anticipated rewards and losses in a medial prefrontal region whereas there is no significant aberrant activation in ventral or dorsal striatal brain regions during processing of reinforcement anticipation.

Expectancy, ambiguity, and behavioral flexibility: separable and complementary roles of the orbital frontal cortex and amygdala in processing reward expectancies.

PubMed

Pauli, Wolfgang M; Hazy, Thomas E; O'Reilly, Randall C

2012-02-01

Appetitive goal-directed behavior can be associated with a cue-triggered expectancy that it will lead to a particular reward, a process thought to depend on the OFC and basolateral amygdala complex. We developed a biologically informed neural network model of this system to investigate the separable and complementary roles of these areas as the main components of a flexible expectancy system. These areas of interest are part of a neural network with additional subcortical areas, including the central nucleus of amygdala, ventral (limbic) and dorsomedial (associative) striatum. Our simulations are consistent with the view that the amygdala maintains Pavlovian associations through incremental updating of synaptic strength and that the OFC supports flexibility by maintaining an activation-based working memory of the recent reward history. Our model provides a mechanistic explanation for electrophysiological evidence that cue-related firing in OFC neurons is nonselectively early after a contingency change and why this nonselective firing is critical for promoting plasticity in the amygdala. This ambiguous activation results from the simultaneous maintenance of recent outcomes and obsolete Pavlovian contingencies in working memory. Furthermore, at the beginning of reversal, the OFC is critical for supporting responses that are no longer inappropriate. This result is inconsistent with an exclusive inhibitory account of OFC function.

Perceiving active listening activates the reward system and improves the impression of relevant experiences

PubMed Central

Kawamichi, Hiroaki; Yoshihara, Kazufumi; Sasaki, Akihiro T.; Sugawara, Sho K.; Tanabe, Hiroki C.; Shinohara, Ryoji; Sugisawa, Yuka; Tokutake, Kentaro; Mochizuki, Yukiko; Anme, Tokie; Sadato, Norihiro

2015-01-01

Although active listening is an influential behavior, which can affect the social responses of others, the neural correlates underlying its perception have remained unclear. Sensing active listening in social interactions is accompanied by an improvement in the recollected impressions of relevant experiences and is thought to arouse positive feelings. We therefore hypothesized that the recognition of active listening activates the reward system, and that the emotional appraisal of experiences that had been subject to active listening would be improved. To test these hypotheses, we conducted functional magnetic resonance imaging (fMRI) on participants viewing assessments of their own personal experiences made by evaluators with or without active listening attitude. Subjects rated evaluators who showed active listening more positively. Furthermore, they rated episodes more positively when they were evaluated by individuals showing active listening. Neural activation in the ventral striatum was enhanced by perceiving active listening, suggesting that this was processed as rewarding. It also activated the right anterior insula, representing positive emotional reappraisal processes. Furthermore, the mentalizing network was activated when participants were being evaluated, irrespective of active listening behavior. Therefore, perceiving active listening appeared to result in positive emotional appraisal and to invoke mental state attribution to the active listener. PMID:25188354

Reward-centricity and attenuated aversions: An adolescent phenotype emerging from studies in laboratory animals

PubMed Central

Doremus-Fitzwater, Tamara L.; Spear, Linda P.

2016-01-01

Adolescence is an evolutionarily conserved developmental period, with neural circuits and behaviors contributing to the detection, procurement, and receipt of rewards bearing similarity across species. Studies with laboratory animals suggest that adolescence is typified by a “reward-centric” phenotype—an increased sensitivity to rewards relative to adults. In contrast, adolescent rodents are reportedly less sensitive to the aversive properties of many drugs and naturally aversive stimuli. Alterations within the mesocorticolimbic dopamine and endocannabinoid systems likely contribute to an adolescent reward-sensitive, yet aversion-resistant, phenotype. Although early hypotheses postulated that developmental changes in dopaminergic circuitry would result in a “reward deficiency” syndrome, evidence now suggests the opposite: that adolescents are uniquely poised to seek out hedonic stimuli, experience greater “pleasure” from rewards, and consume rewarding stimuli in excess. Future studies that more clearly define the role of specific brain regions and neurotransmitter systems in the expression of behaviors toward reward- and aversive-related cues and stimuli are necessary to more fully understand an adolescent-proclivity for and vulnerability to rewards and drugs of potential abuse. PMID:27524639

Reward-centricity and attenuated aversions: An adolescent phenotype emerging from studies in laboratory animals.

PubMed

Doremus-Fitzwater, Tamara L; Spear, Linda P

2016-11-01

Adolescence is an evolutionarily conserved developmental period, with neural circuits and behaviors contributing to the detection, procurement, and receipt of rewards bearing similarity across species. Studies with laboratory animals suggest that adolescence is typified by a "reward-centric" phenotype-an increased sensitivity to rewards relative to adults. In contrast, adolescent rodents are reportedly less sensitive to the aversive properties of many drugs and naturally aversive stimuli. Alterations within the mesocorticolimbic dopamine and endocannabinoid systems likely contribute to an adolescent reward-sensitive, yet aversion-resistant, phenotype. Although early hypotheses postulated that developmental changes in dopaminergic circuitry would result in a "reward deficiency" syndrome, evidence now suggests the opposite: that adolescents are uniquely poised to seek out hedonic stimuli, experience greater "pleasure" from rewards, and consume rewarding stimuli in excess. Future studies that more clearly define the role of specific brain regions and neurotransmitter systems in the expression of behaviors toward reward- and aversive-related cues and stimuli are necessary to more fully understand an adolescent-proclivity for and vulnerability to rewards and drugs of potential abuse. Copyright © 2016 Elsevier Ltd. All rights reserved.

Combining a clinical ladder and performance appraisal system as a reward strategy: the EXCEL clinical ladder program.

PubMed

Moe, J K; Lonowski, L R; Yancer, D A

1994-09-01

In response to the dramatic changes occurring in health care today and a desire to reward professional nurses for clinical behaviors that would be valued in the future, Bergan Mercy Medical Center (BMMC) has developed an innovative clinical ladder/performance appraisal system. The BMMC EXCEL Clinical Ladder program, which is based on the developmental model of Patricia Benner, is a competency-based system that uniquely combines a clinical ladder and performance appraisal system. The program is clinically focused and contains optional components in which registered nurses (RNs) can receive additional credit for participation in professional growth and leadership activities. Nurses document examples of their practice through nursing narratives that describe actual clinical situations. The development and implementation processes, challenges encountered, and recommendations for alternative approaches to the implementation of such a unique system are discussed.

5 CFR 9701.409 - Rating and rewarding performance.

Code of Federal Regulations, 2014 CFR

2014-01-01

... MANAGEMENT SYSTEM (DEPARTMENT OF HOMELAND SECURITY-OFFICE OF PERSONNEL MANAGEMENT) DEPARTMENT OF HOMELAND SECURITY HUMAN RESOURCES MANAGEMENT SYSTEM Performance Management § 9701.409 Rating and rewarding... 5 Administrative Personnel 3 2014-01-01 2014-01-01 false Rating and rewarding performance. 9701...

5 CFR 9701.409 - Rating and rewarding performance.

Code of Federal Regulations, 2012 CFR

2012-01-01

... MANAGEMENT SYSTEM (DEPARTMENT OF HOMELAND SECURITY-OFFICE OF PERSONNEL MANAGEMENT) DEPARTMENT OF HOMELAND SECURITY HUMAN RESOURCES MANAGEMENT SYSTEM Performance Management § 9701.409 Rating and rewarding... 5 Administrative Personnel 3 2012-01-01 2012-01-01 false Rating and rewarding performance. 9701...

5 CFR 9701.409 - Rating and rewarding performance.

Code of Federal Regulations, 2011 CFR

2011-01-01

... MANAGEMENT SYSTEM (DEPARTMENT OF HOMELAND SECURITY-OFFICE OF PERSONNEL MANAGEMENT) DEPARTMENT OF HOMELAND SECURITY HUMAN RESOURCES MANAGEMENT SYSTEM Performance Management § 9701.409 Rating and rewarding... 5 Administrative Personnel 3 2011-01-01 2011-01-01 false Rating and rewarding performance. 9701...

5 CFR 9901.412 - Rating and rewarding performance.

Code of Federal Regulations, 2011 CFR

2011-01-01

... LABOR RELATIONS SYSTEMS (DEPARTMENT OF DEFENSE-OFFICE OF PERSONNEL MANAGEMENT) DEPARTMENT OF DEFENSE NATIONAL SECURITY PERSONNEL SYSTEM (NSPS) Performance Management § 9901.412 Rating and rewarding... 5 Administrative Personnel 3 2011-01-01 2011-01-01 false Rating and rewarding performance. 9901...